2024-04-12T08:49:39.594 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-12T08:49:39.594 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-12_02:08:08-upgrade-squid-distro-default-smithi/7653418 --name teuthology-2024-04-12_02:08:08-upgrade-squid-distro-default-smithi --description upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/teuthology-2024-04-12_02:08:08-upgrade-squid-distro-default-smithi/7653418/orig.config.yaml 2024-04-12T08:49:39.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T08:49:39.739 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-12_02:08:08-upgrade-squid-distro-default-smithi/7653418 branch: squid description: upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7653418' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: teuthology-2024-04-12_02:08:08-upgrade-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN sha1: b277feb2c7beb4597d8ecc39d58d5c36b81f613a ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b277feb2c7beb4597d8ecc39d58d5c36b81f613a kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: dea717a37c7849ca8459c02fb965020aedcc0a9a owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 4203 sha1: b277feb2c7beb4597d8ecc39d58d5c36b81f613a sleep_before_teardown: 0 subset: 26/32 suite: upgrade suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_dea717a37c7849ca8459c02fb965020aedcc0a9a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: dea717a37c7849ca8459c02fb965020aedcc0a9a targets: smithi117.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBX02lT+8/Swb0ZZ8s7+G74H5QTgwdzuwLaznPB+oSDIPzp8EgIYBtQyq4pTiUh1pQbavH1uSEzPYxyxl8thauY= smithi203.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKZ5ZfnugmmW22l6pAd2PxnrjQ8ZUw6NSveXv7WGK3wGyDcZvNarpUDOiju1QmgKgyDhlnjpyC8o+8F2BxSH9Es= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-12_02:08:08 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-04-12T08:49:39.739 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_dea717a37c7849ca8459c02fb965020aedcc0a9a/qa; will attempt to use it 2024-04-12T08:49:39.740 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_dea717a37c7849ca8459c02fb965020aedcc0a9a/qa/tasks 2024-04-12T08:49:39.740 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-12T08:49:39.742 INFO:teuthology.task.internal:Checking packages... 2024-04-12T08:49:39.765 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b277feb2c7beb4597d8ecc39d58d5c36b81f613a' 2024-04-12T08:49:39.765 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-12T08:49:39.765 INFO:teuthology.packaging:ref: None 2024-04-12T08:49:39.765 INFO:teuthology.packaging:tag: None 2024-04-12T08:49:39.765 INFO:teuthology.packaging:branch: squid 2024-04-12T08:49:39.765 INFO:teuthology.packaging:sha1: b277feb2c7beb4597d8ecc39d58d5c36b81f613a 2024-04-12T08:49:39.766 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-04-12T08:49:39.965 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2053.gb277feb2 2024-04-12T08:49:39.967 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-12T08:49:39.974 INFO:teuthology.task.internal:no buildpackages task found 2024-04-12T08:49:39.974 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-12T08:49:39.988 INFO:teuthology.task.internal:Saving configuration 2024-04-12T08:49:40.009 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-12T08:49:40.015 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-12T08:49:40.041 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-12_02:08:08-upgrade-squid-distro-default-smithi/7653418', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-12 08:44:35.228725', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBX02lT+8/Swb0ZZ8s7+G74H5QTgwdzuwLaznPB+oSDIPzp8EgIYBtQyq4pTiUh1pQbavH1uSEzPYxyxl8thauY='} 2024-04-12T08:49:40.065 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-12_02:08:08-upgrade-squid-distro-default-smithi/7653418', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-12 08:44:35.230332', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKZ5ZfnugmmW22l6pAd2PxnrjQ8ZUw6NSveXv7WGK3wGyDcZvNarpUDOiju1QmgKgyDhlnjpyC8o+8F2BxSH9Es='} 2024-04-12T08:49:40.065 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-12T08:49:40.071 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-04-12T08:49:40.071 INFO:teuthology.task.internal:roles: ubuntu@smithi203.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-04-12T08:49:40.071 INFO:teuthology.run_tasks:Running task console_log... 2024-04-12T08:49:40.145 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f60e3c0a0d0>, signals=[15]) 2024-04-12T08:49:40.145 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-12T08:49:40.153 INFO:teuthology.task.internal:Opening connections... 2024-04-12T08:49:40.153 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2024-04-12T08:49:40.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T08:49:40.259 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi203.front.sepia.ceph.com 2024-04-12T08:49:40.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T08:49:40.392 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-12T08:49:40.398 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2024-04-12T08:49:40.416 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2024-04-12T08:49:40.416 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-04-12T08:49:40.473 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2024-04-12T08:49:40.473 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9" 2024-04-12T08:49:40.473 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2024-04-12T08:49:40.473 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2024-04-12T08:49:40.473 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9" 2024-04-12T08:49:40.473 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9" 2024-04-12T08:49:40.473 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-12T08:49:40.473 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2024-04-12T08:49:40.474 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon" 2024-04-12T08:49:40.474 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-12T08:49:40.474 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2024-04-12T08:49:40.474 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-12T08:49:40.474 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-12T08:49:40.474 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-12T08:49:40.475 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-04-12T08:49:40.499 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2024-04-12T08:49:40.517 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2024-04-12T08:49:40.517 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2024-04-12T08:49:40.577 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2024-04-12T08:49:40.577 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="9" 2024-04-12T08:49:40.577 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2024-04-12T08:49:40.577 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2024-04-12T08:49:40.577 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="9" 2024-04-12T08:49:40.577 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el9" 2024-04-12T08:49:40.578 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-12T08:49:40.578 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2024-04-12T08:49:40.578 INFO:teuthology.orchestra.run.smithi203.stdout:LOGO="fedora-logo-icon" 2024-04-12T08:49:40.578 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-12T08:49:40.578 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2024-04-12T08:49:40.578 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-12T08:49:40.578 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-12T08:49:40.578 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-12T08:49:40.578 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2024-04-12T08:49:40.599 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-12T08:49:40.609 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-12T08:49:40.647 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-12T08:49:40.647 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2024-04-12T08:49:40.650 DEBUG:teuthology.orchestra.run.smithi203:> test '!' -e /home/ubuntu/cephtest 2024-04-12T08:49:40.665 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-12T08:49:40.671 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-12T08:49:40.671 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2024-04-12T08:49:40.706 DEBUG:teuthology.orchestra.run.smithi203:> test -z $(ls -A /var/lib/ceph) 2024-04-12T08:49:40.737 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-12T08:49:40.788 INFO:teuthology.run_tasks:Running task kernel... 2024-04-12T08:49:40.804 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-12T08:49:40.804 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-12T08:49:40.805 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-12T08:49:40.805 DEBUG:teuthology.orchestra.run.smithi203:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-12T08:49:40.820 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T08:49:40.821 DEBUG:teuthology.orchestra.run.smithi203:> uname -r 2024-04-12T08:49:40.821 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T08:49:40.822 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-04-12T08:49:40.879 INFO:teuthology.orchestra.run.smithi117.stdout:5.14.0-361.el9.x86_64 2024-04-12T08:49:40.879 INFO:teuthology.task.kernel:Running kernel on smithi117: 5.14.0-361.el9.x86_64 2024-04-12T08:49:40.879 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum install -y kernel 2024-04-12T08:49:40.880 INFO:teuthology.orchestra.run.smithi203.stdout:5.14.0-361.el9.x86_64 2024-04-12T08:49:40.880 INFO:teuthology.task.kernel:Running kernel on smithi203: 5.14.0-361.el9.x86_64 2024-04-12T08:49:40.881 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum install -y kernel 2024-04-12T08:49:42.931 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS-9 - AppStream 17 MB/s | 8.1 MB 00:00 2024-04-12T08:49:43.227 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS-9 - AppStream 12 MB/s | 8.1 MB 00:00 2024-04-12T08:49:44.697 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS-9 - BaseOS 5.8 MB/s | 2.5 MB 00:00 2024-04-12T08:49:44.852 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS-9 - BaseOS 8.5 MB/s | 2.5 MB 00:00 2024-04-12T08:49:46.046 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - BaseOS 8.9 MB/s | 8.0 MB 00:00 2024-04-12T08:49:48.222 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-04-12T08:49:52.366 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-04-12T08:49:53.698 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - Extras packages 87 kB/s | 16 kB 00:00 2024-04-12T08:49:54.050 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - BaseOS 941 kB/s | 8.0 MB 00:08 2024-04-12T08:49:56.607 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 7.5 MB/s | 21 MB 00:02 2024-04-12T08:49:57.417 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - AppStream 8.4 MB/s | 19 MB 00:02 2024-04-12T08:50:01.543 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-12T08:50:01.690 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-04-12T08:50:03.236 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 16 kB 00:00 2024-04-12T08:50:03.935 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T08:50:03.935 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T08:50:03.935 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T08:50:03.935 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.935 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T08:50:03.936 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.936 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T08:50:03.936 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.936 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T08:50:03.936 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.936 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T08:50:03.936 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.937 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T08:50:03.937 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.937 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T08:50:03.937 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.937 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T08:50:03.937 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.937 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T08:50:03.937 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.937 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T08:50:03.938 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.938 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T08:50:03.938 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.938 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T08:50:03.938 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.938 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T08:50:03.938 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.938 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T08:50:03.939 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.939 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T08:50:03.939 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.939 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T08:50:03.939 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.939 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T08:50:03.939 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.939 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T08:50:03.940 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.940 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T08:50:03.940 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.940 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T08:50:03.940 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.940 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T08:50:03.940 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.940 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T08:50:03.941 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.941 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T08:50:03.941 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.941 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T08:50:03.941 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.941 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T08:50:03.941 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.941 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T08:50:03.942 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.942 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T08:50:03.942 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.942 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T08:50:03.942 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.942 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T08:50:03.942 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.942 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T08:50:03.943 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.943 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T08:50:03.943 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.943 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T08:50:03.943 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.943 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T08:50:03.943 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.943 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T08:50:03.944 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.944 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T08:50:03.944 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.944 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T08:50:03.944 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.944 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T08:50:03.944 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.944 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.944 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.945 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:50:03.945 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.945 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.945 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.945 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.945 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T08:50:03.945 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.946 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.946 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.946 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.946 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.946 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.946 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:50:03.946 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.946 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.947 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.947 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.947 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:50:03.947 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.947 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.947 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.947 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.947 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:50:03.947 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.948 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.948 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.948 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.948 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:50:03.948 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.948 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.948 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.948 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.949 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:50:03.949 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.949 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.949 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.949 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.949 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:50:03.949 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.949 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.950 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:50:03.950 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:50:04.148 INFO:teuthology.orchestra.run.smithi203.stdout:Extra Packages for Enterprise Linux 27 MB/s | 21 MB 00:00 2024-04-12T08:50:04.289 INFO:teuthology.orchestra.run.smithi117.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-12T08:50:04.289 INFO:teuthology.orchestra.run.smithi117.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-12T08:50:04.401 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T08:50:04.411 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:50:04.411 INFO:teuthology.orchestra.run.smithi117.stdout: Package Architecture Version Repository Size 2024-04-12T08:50:04.411 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:50:04.412 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-12T08:50:04.412 INFO:teuthology.orchestra.run.smithi117.stdout: kernel x86_64 5.14.0-435.el9 baseos 214 k 2024-04-12T08:50:04.412 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-04-12T08:50:04.412 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-core x86_64 5.14.0-435.el9 baseos 15 M 2024-04-12T08:50:04.412 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules x86_64 5.14.0-435.el9 baseos 34 M 2024-04-12T08:50:04.412 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-core x86_64 5.14.0-435.el9 baseos 28 M 2024-04-12T08:50:04.412 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:50:04.412 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-12T08:50:04.412 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:50:04.412 INFO:teuthology.orchestra.run.smithi117.stdout:Install 4 Packages 2024-04-12T08:50:04.412 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:50:04.413 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 77 M 2024-04-12T08:50:04.413 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 123 M 2024-04-12T08:50:04.413 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-12T08:50:04.825 INFO:teuthology.orchestra.run.smithi117.stdout:(1/4): kernel-5.14.0-435.el9.x86_64.rpm 768 kB/s | 214 kB 00:00 2024-04-12T08:50:05.150 INFO:teuthology.orchestra.run.smithi117.stdout:(2/4): kernel-core-5.14.0-435.el9.x86_64.rpm 25 MB/s | 15 MB 00:00 2024-04-12T08:50:06.217 INFO:teuthology.orchestra.run.smithi117.stdout:(3/4): kernel-modules-5.14.0-435.el9.x86_64.rpm 20 MB/s | 34 MB 00:01 2024-04-12T08:50:06.592 INFO:teuthology.orchestra.run.smithi117.stdout:(4/4): kernel-modules-core-5.14.0-435.el9.x86_6 16 MB/s | 28 MB 00:01 2024-04-12T08:50:06.595 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:50:06.595 INFO:teuthology.orchestra.run.smithi117.stdout:Total 35 MB/s | 77 MB 00:02 2024-04-12T08:50:07.263 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-12T08:50:07.637 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-12T08:50:07.637 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-12T08:50:08.630 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-12T08:50:08.631 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-12T08:50:09.331 INFO:teuthology.orchestra.run.smithi203.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-04-12T08:50:11.103 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-12T08:50:11.554 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:50:11.554 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:50:11.554 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:50:11.554 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.554 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:50:11.554 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.554 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:50:11.554 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.554 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:50:11.554 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.555 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:50:11.555 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.555 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:50:11.555 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.555 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:50:11.555 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.555 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:50:11.555 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.555 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:50:11.555 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.555 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:50:11.555 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.555 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:50:11.555 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.555 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:50:11.556 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.556 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:50:11.556 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.556 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:50:11.556 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.556 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:50:11.556 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.556 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:50:11.556 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.556 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:50:11.556 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.556 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:50:11.556 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.556 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:50:11.556 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.556 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:50:11.557 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.557 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:50:11.557 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.557 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:50:11.557 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.557 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:50:11.557 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.557 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:50:11.557 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.557 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:50:11.557 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.557 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:50:11.557 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.557 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:50:11.557 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.557 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:50:11.558 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.558 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:50:11.558 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.558 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:50:11.558 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.558 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:50:11.558 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.558 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:50:11.558 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.558 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:50:11.558 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.558 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:50:11.558 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.558 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:50:11.559 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.559 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:50:11.559 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.559 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:50:11.559 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.559 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.559 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.559 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:50:11.559 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.559 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.559 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.559 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.559 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:50:11.559 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.559 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.560 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.560 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.560 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.560 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.560 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:50:11.560 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.560 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.560 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.560 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.560 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:50:11.560 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.560 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.560 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.560 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.560 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:50:11.560 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.561 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.561 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.561 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.561 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:50:11.561 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.561 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.561 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.561 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.561 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:50:11.561 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.561 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.561 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.561 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.561 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:50:11.561 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.561 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.562 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.562 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:50:11.955 INFO:teuthology.orchestra.run.smithi203.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-12T08:50:11.955 INFO:teuthology.orchestra.run.smithi203.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-12T08:50:11.966 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-modules-core-5.14.0-435.el9.x86_64 1/4 2024-04-12T08:50:12.050 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-12T08:50:12.077 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:50:12.089 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:50:12.089 INFO:teuthology.orchestra.run.smithi203.stdout: Package Architecture Version Repository Size 2024-04-12T08:50:12.089 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:50:12.089 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-04-12T08:50:12.089 INFO:teuthology.orchestra.run.smithi203.stdout: kernel x86_64 5.14.0-435.el9 baseos 214 k 2024-04-12T08:50:12.089 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-04-12T08:50:12.089 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-core x86_64 5.14.0-435.el9 baseos 15 M 2024-04-12T08:50:12.089 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-modules x86_64 5.14.0-435.el9 baseos 34 M 2024-04-12T08:50:12.089 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-modules-core x86_64 5.14.0-435.el9 baseos 28 M 2024-04-12T08:50:12.089 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:50:12.090 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-04-12T08:50:12.090 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:50:12.090 INFO:teuthology.orchestra.run.smithi203.stdout:Install 4 Packages 2024-04-12T08:50:12.090 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:50:12.090 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 77 M 2024-04-12T08:50:12.090 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 123 M 2024-04-12T08:50:12.091 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-04-12T08:50:12.824 INFO:teuthology.orchestra.run.smithi203.stdout:(1/4): kernel-5.14.0-435.el9.x86_64.rpm 346 kB/s | 214 kB 00:00 2024-04-12T08:50:14.820 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-12T08:50:14.961 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-12T08:50:15.466 INFO:teuthology.orchestra.run.smithi203.stdout:(2/4): kernel-modules-5.14.0-435.el9.x86_64.rpm 10 MB/s | 34 MB 00:03 2024-04-12T08:50:16.574 INFO:teuthology.orchestra.run.smithi203.stdout:(3/4): kernel-modules-core-5.14.0-435.el9.x86_6 7.4 MB/s | 28 MB 00:03 2024-04-12T08:50:18.491 INFO:teuthology.orchestra.run.smithi203.stdout:(4/4): kernel-core-5.14.0-435.el9.x86_64.rpm 2.4 MB/s | 15 MB 00:06 2024-04-12T08:50:18.491 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:50:18.492 INFO:teuthology.orchestra.run.smithi203.stdout:Total 12 MB/s | 77 MB 00:06 2024-04-12T08:50:19.157 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-04-12T08:50:19.551 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-04-12T08:50:19.551 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-04-12T08:50:19.650 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-12T08:50:19.736 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-5.14.0-435.el9.x86_64 4/4 2024-04-12T08:50:20.572 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-04-12T08:50:20.572 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-04-12T08:50:23.060 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-04-12T08:50:23.745 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : kernel-modules-core-5.14.0-435.el9.x86_64 1/4 2024-04-12T08:50:23.827 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-12T08:50:24.479 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-12T08:50:26.620 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-12T08:50:26.749 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-12T08:50:31.469 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-12T08:50:31.583 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : kernel-5.14.0-435.el9.x86_64 4/4 2024-04-12T08:50:36.337 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-12T08:50:53.538 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 4/4 2024-04-12T08:50:53.538 INFO:teuthology.orchestra.run.smithi117.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-12T08:50:53.538 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:50:53.583 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 4/4 2024-04-12T08:50:53.923 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-5.14.0-435.el9.x86_64 4/4 2024-04-12T08:50:53.923 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-5.14.0-435.el9.x86_64 1/4 2024-04-12T08:50:53.923 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-12T08:50:53.924 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-12T08:50:54.389 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-12T08:50:54.389 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:50:54.389 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-12T08:50:54.389 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-5.14.0-435.el9.x86_64 2024-04-12T08:50:54.389 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-core-5.14.0-435.el9.x86_64 2024-04-12T08:50:54.390 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-5.14.0-435.el9.x86_64 2024-04-12T08:50:54.390 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-core-5.14.0-435.el9.x86_64 2024-04-12T08:50:54.390 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:50:54.390 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T08:50:54.738 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q kernel | sort -rV | head -n 1 2024-04-12T08:50:54.832 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-12T08:50:54.833 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-12T08:50:54.833 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-435.el9.x86_64 2024-04-12T08:50:54.833 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-12T08:50:54.833 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-12T08:50:54.833 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-04-12T08:50:54.833 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi117.front.sepia.ceph.com, path=None, version=distro) 2024-04-12T08:50:54.833 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q kernel | sort -rV | head -n 1 2024-04-12T08:50:54.915 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-12T08:50:54.915 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-12T08:50:54.916 DEBUG:teuthology.orchestra.run.smithi117:> sudo rpm -qi grub2-tools 2024-04-12T08:50:54.960 INFO:teuthology.orchestra.run.smithi117.stdout:Name : grub2-tools 2024-04-12T08:50:54.960 INFO:teuthology.orchestra.run.smithi117.stdout:Epoch : 1 2024-04-12T08:50:54.960 INFO:teuthology.orchestra.run.smithi117.stdout:Version : 2.06 2024-04-12T08:50:54.960 INFO:teuthology.orchestra.run.smithi117.stdout:Release : 68.el9 2024-04-12T08:50:54.960 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: x86_64 2024-04-12T08:50:54.960 INFO:teuthology.orchestra.run.smithi117.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-12T08:50:54.960 INFO:teuthology.orchestra.run.smithi117.stdout:Group : Unspecified 2024-04-12T08:50:54.960 INFO:teuthology.orchestra.run.smithi117.stdout:Size : 8264254 2024-04-12T08:50:54.960 INFO:teuthology.orchestra.run.smithi117.stdout:License : GPLv3+ 2024-04-12T08:50:54.961 INFO:teuthology.orchestra.run.smithi117.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-12T08:50:54.961 INFO:teuthology.orchestra.run.smithi117.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-12T08:50:54.961 INFO:teuthology.orchestra.run.smithi117.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-12T08:50:54.961 INFO:teuthology.orchestra.run.smithi117.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-12T08:50:54.961 INFO:teuthology.orchestra.run.smithi117.stdout:Packager : builder@centos.org 2024-04-12T08:50:54.961 INFO:teuthology.orchestra.run.smithi117.stdout:Vendor : CentOS 2024-04-12T08:50:54.961 INFO:teuthology.orchestra.run.smithi117.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-12T08:50:54.961 INFO:teuthology.orchestra.run.smithi117.stdout:Summary : Support tools for GRUB. 2024-04-12T08:50:54.961 INFO:teuthology.orchestra.run.smithi117.stdout:Description : 2024-04-12T08:50:54.961 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:50:54.961 INFO:teuthology.orchestra.run.smithi117.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-12T08:50:54.961 INFO:teuthology.orchestra.run.smithi117.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-12T08:50:54.961 INFO:teuthology.orchestra.run.smithi117.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-12T08:50:54.961 INFO:teuthology.orchestra.run.smithi117.stdout:hardware devices. 2024-04-12T08:50:54.961 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:50:54.962 INFO:teuthology.orchestra.run.smithi117.stdout:This subpackage provides tools for support of all platforms. 2024-04-12T08:50:54.963 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-12T08:50:54.963 INFO:teuthology.task.kernel:Updating grub on smithi117 to boot 5.14.0-435.el9.x86_64 2024-04-12T08:50:54.963 DEBUG:teuthology.orchestra.run.smithi117:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-12T08:50:55.588 INFO:teuthology.orchestra.run.smithi117.stderr:Generating grub configuration file ... 2024-04-12T08:50:56.987 INFO:teuthology.orchestra.run.smithi117.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-12T08:50:57.027 INFO:teuthology.orchestra.run.smithi117.stderr:done 2024-04-12T08:50:57.030 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-04-12T08:50:57.049 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.Q5hmz1NHIj 2024-04-12T08:50:57.050 DEBUG:teuthology.orchestra.run.smithi117:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Q5hmz1NHIj 2024-04-12T08:50:57.122 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.Q5hmz1NHIj 2024-04-12T08:50:57.260 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.Q5hmz1NHIj is 6KB 2024-04-12T08:50:57.309 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.Q5hmz1NHIj 2024-04-12T08:50:57.323 DEBUG:teuthology.orchestra.run.smithi117:> sudo /bin/ls /boot/loader/entries || true 2024-04-12T08:50:57.387 INFO:teuthology.orchestra.run.smithi117.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-12T08:50:57.388 INFO:teuthology.orchestra.run.smithi117.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-12T08:50:57.388 INFO:teuthology.orchestra.run.smithi117.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-12T08:50:57.388 INFO:teuthology.orchestra.run.smithi117.stdout:15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64.conf 2024-04-12T08:50:57.389 DEBUG:teuthology.orchestra.run.smithi117:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64 2024-04-12T08:50:57.522 DEBUG:teuthology.orchestra.run.smithi117:> sudo shutdown -r now 2024-04-12T08:51:05.528 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 4/4 2024-04-12T08:51:05.528 INFO:teuthology.orchestra.run.smithi203.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-12T08:51:05.528 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:51:05.573 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 4/4 2024-04-12T08:51:05.942 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: kernel-5.14.0-435.el9.x86_64 4/4 2024-04-12T08:51:05.942 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : kernel-5.14.0-435.el9.x86_64 1/4 2024-04-12T08:51:05.942 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-12T08:51:05.943 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-12T08:51:06.407 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-12T08:51:06.407 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:51:06.407 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-04-12T08:51:06.407 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-5.14.0-435.el9.x86_64 2024-04-12T08:51:06.407 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-core-5.14.0-435.el9.x86_64 2024-04-12T08:51:06.407 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-modules-5.14.0-435.el9.x86_64 2024-04-12T08:51:06.407 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-modules-core-5.14.0-435.el9.x86_64 2024-04-12T08:51:06.407 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:51:06.407 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:51:06.744 DEBUG:teuthology.orchestra.run.smithi203:> rpm -q kernel | sort -rV | head -n 1 2024-04-12T08:51:06.842 INFO:teuthology.orchestra.run.smithi203.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-12T08:51:06.843 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-12T08:51:06.843 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-435.el9.x86_64 2024-04-12T08:51:06.843 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-12T08:51:06.843 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-12T08:51:06.843 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-04-12T08:51:06.843 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi203.front.sepia.ceph.com, path=None, version=distro) 2024-04-12T08:51:06.843 DEBUG:teuthology.orchestra.run.smithi203:> rpm -q kernel | sort -rV | head -n 1 2024-04-12T08:51:06.926 INFO:teuthology.orchestra.run.smithi203.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-12T08:51:06.926 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-12T08:51:06.926 DEBUG:teuthology.orchestra.run.smithi203:> sudo rpm -qi grub2-tools 2024-04-12T08:51:06.966 INFO:teuthology.orchestra.run.smithi203.stdout:Name : grub2-tools 2024-04-12T08:51:06.967 INFO:teuthology.orchestra.run.smithi203.stdout:Epoch : 1 2024-04-12T08:51:06.967 INFO:teuthology.orchestra.run.smithi203.stdout:Version : 2.06 2024-04-12T08:51:06.967 INFO:teuthology.orchestra.run.smithi203.stdout:Release : 68.el9 2024-04-12T08:51:06.967 INFO:teuthology.orchestra.run.smithi203.stdout:Architecture: x86_64 2024-04-12T08:51:06.967 INFO:teuthology.orchestra.run.smithi203.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-12T08:51:06.967 INFO:teuthology.orchestra.run.smithi203.stdout:Group : Unspecified 2024-04-12T08:51:06.967 INFO:teuthology.orchestra.run.smithi203.stdout:Size : 8264254 2024-04-12T08:51:06.967 INFO:teuthology.orchestra.run.smithi203.stdout:License : GPLv3+ 2024-04-12T08:51:06.967 INFO:teuthology.orchestra.run.smithi203.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-12T08:51:06.967 INFO:teuthology.orchestra.run.smithi203.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-12T08:51:06.967 INFO:teuthology.orchestra.run.smithi203.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-12T08:51:06.967 INFO:teuthology.orchestra.run.smithi203.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-12T08:51:06.967 INFO:teuthology.orchestra.run.smithi203.stdout:Packager : builder@centos.org 2024-04-12T08:51:06.968 INFO:teuthology.orchestra.run.smithi203.stdout:Vendor : CentOS 2024-04-12T08:51:06.968 INFO:teuthology.orchestra.run.smithi203.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-12T08:51:06.968 INFO:teuthology.orchestra.run.smithi203.stdout:Summary : Support tools for GRUB. 2024-04-12T08:51:06.968 INFO:teuthology.orchestra.run.smithi203.stdout:Description : 2024-04-12T08:51:06.968 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:51:06.968 INFO:teuthology.orchestra.run.smithi203.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-12T08:51:06.968 INFO:teuthology.orchestra.run.smithi203.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-12T08:51:06.968 INFO:teuthology.orchestra.run.smithi203.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-12T08:51:06.968 INFO:teuthology.orchestra.run.smithi203.stdout:hardware devices. 2024-04-12T08:51:06.968 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:51:06.968 INFO:teuthology.orchestra.run.smithi203.stdout:This subpackage provides tools for support of all platforms. 2024-04-12T08:51:06.969 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-12T08:51:06.969 INFO:teuthology.task.kernel:Updating grub on smithi203 to boot 5.14.0-435.el9.x86_64 2024-04-12T08:51:06.969 DEBUG:teuthology.orchestra.run.smithi203:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-12T08:51:07.580 INFO:teuthology.orchestra.run.smithi203.stderr:Generating grub configuration file ... 2024-04-12T08:51:08.921 INFO:teuthology.orchestra.run.smithi203.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-12T08:51:08.958 INFO:teuthology.orchestra.run.smithi203.stderr:done 2024-04-12T08:51:08.961 DEBUG:teuthology.orchestra.run.smithi203:> mktemp 2024-04-12T08:51:08.975 INFO:teuthology.orchestra.run.smithi203.stdout:/tmp/tmp.XMfCO8TGBz 2024-04-12T08:51:08.976 DEBUG:teuthology.orchestra.run.smithi203:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XMfCO8TGBz 2024-04-12T08:51:09.043 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0666 /tmp/tmp.XMfCO8TGBz 2024-04-12T08:51:09.180 DEBUG:teuthology.orchestra.remote:smithi203:/tmp/tmp.XMfCO8TGBz is 6KB 2024-04-12T08:51:09.228 DEBUG:teuthology.orchestra.run.smithi203:> rm -fr /tmp/tmp.XMfCO8TGBz 2024-04-12T08:51:09.243 DEBUG:teuthology.orchestra.run.smithi203:> sudo /bin/ls /boot/loader/entries || true 2024-04-12T08:51:09.307 INFO:teuthology.orchestra.run.smithi203.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-12T08:51:09.307 INFO:teuthology.orchestra.run.smithi203.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-12T08:51:09.307 INFO:teuthology.orchestra.run.smithi203.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-12T08:51:09.307 INFO:teuthology.orchestra.run.smithi203.stdout:15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64.conf 2024-04-12T08:51:09.309 DEBUG:teuthology.orchestra.run.smithi203:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64 2024-04-12T08:51:09.442 DEBUG:teuthology.orchestra.run.smithi203:> sudo shutdown -r now 2024-04-12T08:51:27.542 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-04-12T08:51:27.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-04-12T08:51:27.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T08:51:39.454 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-04-12T08:51:39.454 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-04-12T08:51:39.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T08:51:46.078 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-04-12T08:51:55.083 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-04-12T08:51:55.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T08:51:57.858 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-04-12T08:51:58.142 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-04-12T08:52:06.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-04-12T08:52:06.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T08:52:09.922 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-04-12T08:52:10.143 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-04-12T08:52:10.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T08:52:21.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-04-12T08:52:21.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T08:52:40.354 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-04-12T08:52:42.065 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-04-12T08:52:42.540 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-04-12T08:52:42.575 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-435.el9.x86_64"... 2024-04-12T08:52:42.576 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-04-12T08:52:42.596 INFO:teuthology.orchestra.run.smithi117.stdout:5.14.0-435.el9.x86_64 2024-04-12T08:52:42.596 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-435.el9.x86_64 vs 5.14.0-435.el9.x86_64 2024-04-12T08:52:42.596 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-12T08:52:42.596 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-12T08:52:43.597 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-04-12T08:52:43.597 DEBUG:teuthology.orchestra.run.smithi117:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-12T08:52:43.701 INFO:teuthology.orchestra.run.smithi117.stdout:ttyS1 2024-04-12T08:52:43.761 DEBUG:teuthology.parallel:result is None 2024-04-12T08:52:55.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-04-12T08:52:55.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T08:52:55.678 DEBUG:teuthology.orchestra.run.smithi203:> true 2024-04-12T08:52:56.076 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-04-12T08:52:56.076 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-435.el9.x86_64"... 2024-04-12T08:52:56.076 DEBUG:teuthology.orchestra.run.smithi203:> uname -r 2024-04-12T08:52:56.090 INFO:teuthology.orchestra.run.smithi203.stdout:5.14.0-435.el9.x86_64 2024-04-12T08:52:56.090 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-435.el9.x86_64 vs 5.14.0-435.el9.x86_64 2024-04-12T08:52:56.090 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-12T08:52:56.090 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-12T08:52:57.091 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-04-12T08:52:57.091 DEBUG:teuthology.orchestra.run.smithi203:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-12T08:52:57.148 INFO:teuthology.orchestra.run.smithi203.stdout:ttyS1 2024-04-12T08:52:57.183 DEBUG:teuthology.parallel:result is None 2024-04-12T08:52:57.183 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-12T08:52:57.192 INFO:teuthology.task.internal:Creating test directory... 2024-04-12T08:52:57.192 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-12T08:52:57.195 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-12T08:52:57.211 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-12T08:52:57.221 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-12T08:52:57.235 INFO:teuthology.task.internal:Creating archive directory... 2024-04-12T08:52:57.235 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-12T08:52:57.254 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-12T08:52:57.292 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-12T08:52:57.306 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-12T08:52:57.306 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-12T08:52:57.329 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-12T08:52:57.363 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-12T08:52:57.366 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-12T08:52:57.376 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-12T08:52:57.380 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-12T08:52:57.382 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-12T08:52:57.389 INFO:teuthology.task.internal:Configuring sudo... 2024-04-12T08:52:57.390 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-12T08:52:57.425 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-12T08:52:57.452 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-12T08:52:57.464 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-12T08:52:57.465 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-12T08:52:57.494 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-12T08:52:57.511 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-12T08:52:57.591 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-12T08:52:57.643 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-12T08:52:57.728 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-12T08:52:57.771 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-12T08:52:57.771 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-12T08:52:57.837 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-12T08:52:57.879 DEBUG:teuthology.orchestra.run.smithi203:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-12T08:52:57.927 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-12T08:52:58.010 DEBUG:teuthology.orchestra.run.smithi203:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-12T08:52:58.051 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-12T08:52:58.051 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-12T08:52:58.117 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2024-04-12T08:52:58.119 DEBUG:teuthology.orchestra.run.smithi203:> sudo service rsyslog restart 2024-04-12T08:52:58.165 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-12T08:52:58.203 INFO:teuthology.orchestra.run.smithi203.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-12T08:52:58.444 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-12T08:52:58.453 INFO:teuthology.task.internal:Starting timer... 2024-04-12T08:52:58.453 INFO:teuthology.run_tasks:Running task pcp... 2024-04-12T08:52:58.469 INFO:teuthology.run_tasks:Running task selinux... 2024-04-12T08:52:58.484 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-12T08:52:58.484 DEBUG:teuthology.orchestra.run.smithi117:> sudo service auditd rotate 2024-04-12T08:52:58.545 INFO:teuthology.orchestra.run.smithi117.stdout:Rotating logs: 2024-04-12T08:52:58.547 DEBUG:teuthology.orchestra.run.smithi203:> sudo service auditd rotate 2024-04-12T08:52:58.651 INFO:teuthology.orchestra.run.smithi203.stdout:Rotating logs: 2024-04-12T08:52:58.652 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-12T08:52:58.652 DEBUG:teuthology.orchestra.run.smithi117:> /usr/sbin/getenforce 2024-04-12T08:52:58.672 INFO:teuthology.orchestra.run.smithi117.stdout:Permissive 2024-04-12T08:52:58.673 DEBUG:teuthology.orchestra.run.smithi203:> /usr/sbin/getenforce 2024-04-12T08:52:58.699 INFO:teuthology.orchestra.run.smithi203.stdout:Permissive 2024-04-12T08:52:58.699 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi117.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi203.front.sepia.ceph.com': 'permissive'} 2024-04-12T08:52:58.700 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-12T08:52:58.739 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T08:52:58.740 DEBUG:teuthology.orchestra.run.smithi203:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-12T08:52:58.766 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T08:52:58.767 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-12T08:52:58.767 DEBUG:teuthology.orchestra.run.smithi117:> sudo /usr/sbin/setenforce permissive 2024-04-12T08:52:58.816 DEBUG:teuthology.orchestra.run.smithi203:> sudo /usr/sbin/setenforce permissive 2024-04-12T08:52:58.909 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-12T08:52:58.919 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-12T08:52:58.924 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-12T08:52:59.080 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-12T08:52:59.096 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-12T08:52:59.097 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi117.front.sepia.ceph.com,smithi203.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-12T08:57:17.722 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi117.front.sepia.ceph.com'), Remote(name='ubuntu@smithi203.front.sepia.ceph.com')] 2024-04-12T08:57:17.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-04-12T08:57:17.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T08:57:17.816 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-04-12T08:57:17.900 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-04-12T08:57:17.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-04-12T08:57:17.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T08:57:17.987 DEBUG:teuthology.orchestra.run.smithi203:> true 2024-04-12T08:57:18.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-04-12T08:57:18.065 INFO:teuthology.run_tasks:Running task clock... 2024-04-12T08:57:18.078 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-12T08:57:18.078 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-12T08:57:18.079 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-12T08:57:18.081 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-12T08:57:18.081 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-12T08:57:18.110 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-12T08:57:18.127 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-12T08:57:18.135 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-12T08:57:18.152 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-12T08:57:18.155 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: ntpd: command not found 2024-04-12T08:57:18.169 INFO:teuthology.orchestra.run.smithi117.stdout:506 Cannot talk to daemon 2024-04-12T08:57:18.181 INFO:teuthology.orchestra.run.smithi203.stderr:sudo: ntpd: command not found 2024-04-12T08:57:18.185 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-12T08:57:18.195 INFO:teuthology.orchestra.run.smithi203.stdout:506 Cannot talk to daemon 2024-04-12T08:57:18.201 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-12T08:57:18.212 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-12T08:57:18.228 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-12T08:57:18.252 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-04-12T08:57:18.256 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-12T08:57:18.256 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-04-12T08:57:18.256 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T08:57:18.256 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T08:57:18.256 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T08:57:18.256 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T08:57:18.284 INFO:teuthology.orchestra.run.smithi203.stderr:bash: line 1: ntpq: command not found 2024-04-12T08:57:18.288 INFO:teuthology.orchestra.run.smithi203.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-12T08:57:18.288 INFO:teuthology.orchestra.run.smithi203.stdout:=============================================================================== 2024-04-12T08:57:18.288 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T08:57:18.288 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T08:57:18.288 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T08:57:18.289 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T08:57:18.289 INFO:teuthology.run_tasks:Running task install... 2024-04-12T08:57:18.297 DEBUG:teuthology.task.install:project ceph 2024-04-12T08:57:18.297 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b277feb2c7beb4597d8ecc39d58d5c36b81f613a'}} 2024-04-12T08:57:18.297 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'b277feb2c7beb4597d8ecc39d58d5c36b81f613a'} 2024-04-12T08:57:18.297 INFO:teuthology.task.install:Using flavor: default 2024-04-12T08:57:18.303 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-12T08:57:18.303 INFO:teuthology.task.install:extra packages: [] 2024-04-12T08:57:18.303 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b277feb2c7beb4597d8ecc39d58d5c36b81f613a', 'tag': None, 'wait_for_package': False} 2024-04-12T08:57:18.304 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-12T08:57:18.304 INFO:teuthology.packaging:ref: None 2024-04-12T08:57:18.304 INFO:teuthology.packaging:tag: None 2024-04-12T08:57:18.304 INFO:teuthology.packaging:branch: quincy 2024-04-12T08:57:18.304 INFO:teuthology.packaging:sha1: b277feb2c7beb4597d8ecc39d58d5c36b81f613a 2024-04-12T08:57:18.304 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-12T08:57:18.306 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b277feb2c7beb4597d8ecc39d58d5c36b81f613a', 'tag': None, 'wait_for_package': False} 2024-04-12T08:57:18.306 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-12T08:57:18.306 INFO:teuthology.packaging:ref: None 2024-04-12T08:57:18.306 INFO:teuthology.packaging:tag: None 2024-04-12T08:57:18.306 INFO:teuthology.packaging:branch: quincy 2024-04-12T08:57:18.306 INFO:teuthology.packaging:sha1: b277feb2c7beb4597d8ecc39d58d5c36b81f613a 2024-04-12T08:57:18.306 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-12T08:57:18.516 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/d3b5060a17449edfae9385cdf792afec109fca5d/centos/9/flavors/default/ 2024-04-12T08:57:18.517 INFO:teuthology.task.install.rpm:Package version is 17.2.7-827.gd3b5060a 2024-04-12T08:57:18.543 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/d3b5060a17449edfae9385cdf792afec109fca5d/centos/9/flavors/default/ 2024-04-12T08:57:18.544 INFO:teuthology.task.install.rpm:Package version is 17.2.7-827.gd3b5060a 2024-04-12T08:57:18.632 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/d3b5060a17449edfae9385cdf792afec109fca5d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/d3b5060a17449edfae9385cdf792afec109fca5d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/d3b5060a17449edfae9385cdf792afec109fca5d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-12T08:57:18.633 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-12T08:57:18.633 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-12T08:57:18.661 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-12T08:57:18.661 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-12T08:57:18.661 INFO:teuthology.packaging:ref: None 2024-04-12T08:57:18.661 INFO:teuthology.packaging:tag: None 2024-04-12T08:57:18.661 INFO:teuthology.packaging:branch: quincy 2024-04-12T08:57:18.661 INFO:teuthology.packaging:sha1: b277feb2c7beb4597d8ecc39d58d5c36b81f613a 2024-04-12T08:57:18.661 DEBUG:teuthology.orchestra.run.smithi117:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-12T08:57:18.728 DEBUG:teuthology.orchestra.run.smithi117:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-12T08:57:18.771 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/d3b5060a17449edfae9385cdf792afec109fca5d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/d3b5060a17449edfae9385cdf792afec109fca5d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/d3b5060a17449edfae9385cdf792afec109fca5d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-12T08:57:18.771 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-12T08:57:18.771 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-12T08:57:18.801 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-12T08:57:18.801 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-12T08:57:18.802 INFO:teuthology.packaging:ref: None 2024-04-12T08:57:18.802 INFO:teuthology.packaging:tag: None 2024-04-12T08:57:18.802 INFO:teuthology.packaging:branch: quincy 2024-04-12T08:57:18.802 INFO:teuthology.packaging:sha1: b277feb2c7beb4597d8ecc39d58d5c36b81f613a 2024-04-12T08:57:18.802 DEBUG:teuthology.orchestra.run.smithi203:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-12T08:57:18.807 DEBUG:teuthology.orchestra.run.smithi117:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-12T08:57:18.871 DEBUG:teuthology.orchestra.run.smithi203:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-12T08:57:18.874 INFO:teuthology.orchestra.run.smithi117.stdout:check_obsoletes = 1 2024-04-12T08:57:18.876 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum clean all 2024-04-12T08:57:18.952 DEBUG:teuthology.orchestra.run.smithi203:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-12T08:57:19.018 INFO:teuthology.orchestra.run.smithi203.stdout:check_obsoletes = 1 2024-04-12T08:57:19.020 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum clean all 2024-04-12T08:57:19.131 INFO:teuthology.orchestra.run.smithi117.stdout:74 files removed 2024-04-12T08:57:19.159 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-radosgw 2024-04-12T08:57:19.273 INFO:teuthology.orchestra.run.smithi203.stdout:74 files removed 2024-04-12T08:57:19.302 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-radosgw 2024-04-12T08:57:19.807 INFO:teuthology.orchestra.run.smithi117.stdout:ceph packages for x86_64 222 kB/s | 77 kB 00:00 2024-04-12T08:57:20.082 INFO:teuthology.orchestra.run.smithi203.stdout:ceph packages for x86_64 162 kB/s | 77 kB 00:00 2024-04-12T08:57:20.224 INFO:teuthology.orchestra.run.smithi117.stdout:ceph noarch packages 25 kB/s | 9.2 kB 00:00 2024-04-12T08:57:20.441 INFO:teuthology.orchestra.run.smithi203.stdout:ceph noarch packages 30 kB/s | 9.2 kB 00:00 2024-04-12T08:57:20.791 INFO:teuthology.orchestra.run.smithi203.stdout:ceph source packages 5.7 kB/s | 1.8 kB 00:00 2024-04-12T08:57:20.870 INFO:teuthology.orchestra.run.smithi117.stdout:ceph source packages 2.9 kB/s | 1.8 kB 00:00 2024-04-12T08:57:21.235 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS-9 - AppStream 20 MB/s | 8.1 MB 00:00 2024-04-12T08:57:21.327 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS-9 - AppStream 19 MB/s | 8.1 MB 00:00 2024-04-12T08:57:23.136 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS-9 - BaseOS 5.2 MB/s | 2.5 MB 00:00 2024-04-12T08:57:23.152 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS-9 - BaseOS 6.2 MB/s | 2.5 MB 00:00 2024-04-12T08:57:24.743 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - BaseOS 7.0 MB/s | 8.0 MB 00:01 2024-04-12T08:57:24.959 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 8.0 MB 00:01 2024-04-12T08:57:26.569 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-04-12T08:57:27.852 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - AppStream 11 MB/s | 19 MB 00:01 2024-04-12T08:57:30.961 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 6.2 MB 00:00 2024-04-12T08:57:32.419 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - CRB 6.0 MB/s | 6.2 MB 00:01 2024-04-12T08:57:32.420 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 16 kB 00:00 2024-04-12T08:57:34.033 INFO:teuthology.orchestra.run.smithi203.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-04-12T08:57:34.102 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 16 kB 00:00 2024-04-12T08:57:35.998 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-04-12T08:57:39.106 INFO:teuthology.orchestra.run.smithi203.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-04-12T08:57:41.145 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-04-12T08:57:41.663 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:57:41.663 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:57:41.663 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:57:41.663 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.663 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:57:41.663 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.663 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:57:41.663 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.664 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:57:41.664 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.664 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:57:41.664 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.664 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:57:41.664 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.664 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:57:41.664 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.664 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:57:41.664 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.664 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:57:41.664 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.664 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:57:41.664 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.664 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:57:41.665 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.665 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:57:41.665 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.665 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:57:41.665 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.665 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:57:41.665 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.665 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:57:41.665 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.665 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:57:41.665 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.665 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:57:41.666 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.666 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:57:41.666 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.666 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:57:41.666 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.666 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:57:41.666 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.666 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:57:41.666 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.666 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:57:41.666 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.666 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:57:41.666 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.667 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:57:41.667 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.667 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:57:41.667 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.667 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:57:41.667 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.667 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:57:41.667 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.667 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:57:41.667 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.667 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:57:41.667 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.668 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:57:41.668 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.668 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:57:41.668 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.668 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:57:41.668 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.668 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:57:41.668 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.668 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:57:41.668 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.668 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:57:41.668 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.668 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:57:41.668 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.668 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:57:41.668 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.669 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.669 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.669 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:57:41.669 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.669 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.669 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.669 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.669 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:57:41.669 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.669 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.669 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.669 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.669 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.669 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.669 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:57:41.670 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.670 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.670 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.670 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.670 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:57:41.670 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.670 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.670 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.670 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.670 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:57:41.670 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.670 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.670 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.670 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.671 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:57:41.671 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.671 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.671 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.671 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.671 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:57:41.671 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.671 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.671 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.671 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.671 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:57:41.671 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.671 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.671 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:57:41.671 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:57:42.203 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:57:42.227 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:57:42.227 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-04-12T08:57:42.227 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:57:42.227 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-04-12T08:57:42.227 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-radosgw x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 14 M 2024-04-12T08:57:42.227 INFO:teuthology.orchestra.run.smithi203.stdout:Upgrading: 2024-04-12T08:57:42.227 INFO:teuthology.orchestra.run.smithi203.stdout: librados2 x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 3.1 M 2024-04-12T08:57:42.228 INFO:teuthology.orchestra.run.smithi203.stdout: librbd1 x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 2.9 M 2024-04-12T08:57:42.228 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-04-12T08:57:42.228 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-base x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 5.0 M 2024-04-12T08:57:42.228 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-common x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 22 M 2024-04-12T08:57:42.228 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-selinux x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 25 k 2024-04-12T08:57:42.228 INFO:teuthology.orchestra.run.smithi203.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-12T08:57:42.228 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs2 x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 637 k 2024-04-12T08:57:42.228 INFO:teuthology.orchestra.run.smithi203.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-12T08:57:42.228 INFO:teuthology.orchestra.run.smithi203.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-12T08:57:42.228 INFO:teuthology.orchestra.run.smithi203.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-12T08:57:42.228 INFO:teuthology.orchestra.run.smithi203.stdout: libradosstriper1 x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 458 k 2024-04-12T08:57:42.229 INFO:teuthology.orchestra.run.smithi203.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-12T08:57:42.229 INFO:teuthology.orchestra.run.smithi203.stdout: librgw2 x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 4.9 M 2024-04-12T08:57:42.229 INFO:teuthology.orchestra.run.smithi203.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-12T08:57:42.229 INFO:teuthology.orchestra.run.smithi203.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-12T08:57:42.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-argparse x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 45 k 2024-04-12T08:57:42.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-common x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 117 k 2024-04-12T08:57:42.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cephfs x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 156 k 2024-04-12T08:57:42.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-12T08:57:42.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rados x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 320 k 2024-04-12T08:57:42.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rbd x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 292 k 2024-04-12T08:57:42.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rgw x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 99 k 2024-04-12T08:57:42.229 INFO:teuthology.orchestra.run.smithi203.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-12T08:57:42.229 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:57:42.229 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-04-12T08:57:42.230 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:57:42.230 INFO:teuthology.orchestra.run.smithi203.stdout:Install 22 Packages 2024-04-12T08:57:42.230 INFO:teuthology.orchestra.run.smithi203.stdout:Upgrade 2 Packages 2024-04-12T08:57:42.230 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:57:42.230 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 58 M 2024-04-12T08:57:42.230 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-04-12T08:57:43.148 INFO:teuthology.orchestra.run.smithi203.stdout:(1/24): ceph-base-17.2.7-827.gd3b5060a.el9.x86_ 9.9 MB/s | 5.0 MB 00:00 2024-04-12T08:57:43.198 INFO:teuthology.orchestra.run.smithi203.stdout:(2/24): ceph-selinux-17.2.7-827.gd3b5060a.el9.x 505 kB/s | 25 kB 00:00 2024-04-12T08:57:43.273 INFO:teuthology.orchestra.run.smithi203.stdout:(3/24): libcephfs2-17.2.7-827.gd3b5060a.el9.x86 8.3 MB/s | 637 kB 00:00 2024-04-12T08:57:43.332 INFO:teuthology.orchestra.run.smithi203.stdout:(4/24): libradosstriper1-17.2.7-827.gd3b5060a.e 7.7 MB/s | 458 kB 00:00 2024-04-12T08:57:43.616 INFO:teuthology.orchestra.run.smithi203.stdout:(5/24): librgw2-17.2.7-827.gd3b5060a.el9.x86_64 17 MB/s | 4.9 MB 00:00 2024-04-12T08:57:43.658 INFO:teuthology.orchestra.run.smithi203.stdout:(6/24): python3-ceph-argparse-17.2.7-827.gd3b50 1.1 MB/s | 45 kB 00:00 2024-04-12T08:57:43.709 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T08:57:43.709 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T08:57:43.709 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T08:57:43.709 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.709 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T08:57:43.709 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.709 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T08:57:43.709 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.710 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T08:57:43.710 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.710 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T08:57:43.710 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.710 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T08:57:43.710 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.710 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T08:57:43.710 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.710 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T08:57:43.710 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.710 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T08:57:43.710 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.710 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T08:57:43.710 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.710 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T08:57:43.711 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.711 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T08:57:43.711 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.711 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T08:57:43.711 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.711 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T08:57:43.711 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.711 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T08:57:43.711 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.711 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T08:57:43.711 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.711 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T08:57:43.711 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.711 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T08:57:43.711 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.712 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T08:57:43.712 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.712 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T08:57:43.712 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.712 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T08:57:43.712 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.712 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T08:57:43.712 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.712 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T08:57:43.712 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.712 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T08:57:43.712 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.712 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T08:57:43.712 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.712 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T08:57:43.713 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.713 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T08:57:43.713 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.713 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T08:57:43.713 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.713 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T08:57:43.713 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.713 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T08:57:43.713 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.713 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T08:57:43.713 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.713 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T08:57:43.713 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.714 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T08:57:43.714 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.714 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T08:57:43.714 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.714 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T08:57:43.714 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.714 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T08:57:43.714 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.714 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T08:57:43.714 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.714 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.714 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.715 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:57:43.715 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.715 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.715 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.715 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.715 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T08:57:43.715 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.715 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.715 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.715 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.715 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.715 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.715 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:57:43.715 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.715 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.716 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.716 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.716 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:57:43.716 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.716 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.716 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.716 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.716 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:57:43.716 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.716 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.716 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.716 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.716 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:57:43.716 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.716 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.717 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.717 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.717 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:57:43.717 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.717 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.717 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.717 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.717 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:57:43.717 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.717 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.717 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.717 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:57:43.718 INFO:teuthology.orchestra.run.smithi203.stdout:(7/24): python3-ceph-common-17.2.7-827.gd3b5060 2.0 MB/s | 117 kB 00:00 2024-04-12T08:57:43.775 INFO:teuthology.orchestra.run.smithi203.stdout:(8/24): python3-cephfs-17.2.7-827.gd3b5060a.el9 2.6 MB/s | 156 kB 00:00 2024-04-12T08:57:43.842 INFO:teuthology.orchestra.run.smithi203.stdout:(9/24): python3-rados-17.2.7-827.gd3b5060a.el9. 4.7 MB/s | 320 kB 00:00 2024-04-12T08:57:43.892 INFO:teuthology.orchestra.run.smithi203.stdout:(10/24): python3-rbd-17.2.7-827.gd3b5060a.el9.x 5.7 MB/s | 292 kB 00:00 2024-04-12T08:57:43.942 INFO:teuthology.orchestra.run.smithi203.stdout:(11/24): python3-rgw-17.2.7-827.gd3b5060a.el9.x 2.0 MB/s | 99 kB 00:00 2024-04-12T08:57:44.143 INFO:teuthology.orchestra.run.smithi203.stdout:(12/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 800 kB/s | 160 kB 00:00 2024-04-12T08:57:44.210 INFO:teuthology.orchestra.run.smithi203.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 680 kB/s | 45 kB 00:00 2024-04-12T08:57:44.235 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T08:57:44.241 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:57:44.241 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-04-12T08:57:44.242 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:57:44.242 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-12T08:57:44.242 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 14 M 2024-04-12T08:57:44.242 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrading: 2024-04-12T08:57:44.242 INFO:teuthology.orchestra.run.smithi117.stdout: librados2 x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 3.1 M 2024-04-12T08:57:44.242 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1 x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 2.9 M 2024-04-12T08:57:44.242 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-04-12T08:57:44.242 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 5.0 M 2024-04-12T08:57:44.242 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 22 M 2024-04-12T08:57:44.242 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 25 k 2024-04-12T08:57:44.242 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-12T08:57:44.242 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2 x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 637 k 2024-04-12T08:57:44.243 INFO:teuthology.orchestra.run.smithi117.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-12T08:57:44.243 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-12T08:57:44.243 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-12T08:57:44.243 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 458 k 2024-04-12T08:57:44.243 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-12T08:57:44.243 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2 x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 4.9 M 2024-04-12T08:57:44.243 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-12T08:57:44.243 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-12T08:57:44.243 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 45 k 2024-04-12T08:57:44.243 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 117 k 2024-04-12T08:57:44.243 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 156 k 2024-04-12T08:57:44.243 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-12T08:57:44.243 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 320 k 2024-04-12T08:57:44.244 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 292 k 2024-04-12T08:57:44.244 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 99 k 2024-04-12T08:57:44.244 INFO:teuthology.orchestra.run.smithi117.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-12T08:57:44.244 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:57:44.244 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-12T08:57:44.244 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:57:44.244 INFO:teuthology.orchestra.run.smithi117.stdout:Install 22 Packages 2024-04-12T08:57:44.244 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrade 2 Packages 2024-04-12T08:57:44.244 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:57:44.244 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 58 M 2024-04-12T08:57:44.245 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-12T08:57:44.335 INFO:teuthology.orchestra.run.smithi203.stdout:(14/24): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-04-12T08:57:44.402 INFO:teuthology.orchestra.run.smithi203.stdout:(15/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-04-12T08:57:44.468 INFO:teuthology.orchestra.run.smithi203.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 633 kB/s | 42 kB 00:00 2024-04-12T08:57:44.811 INFO:teuthology.orchestra.run.smithi203.stdout:(17/24): ceph-radosgw-17.2.7-827.gd3b5060a.el9. 6.5 MB/s | 14 MB 00:02 2024-04-12T08:57:45.070 INFO:teuthology.orchestra.run.smithi203.stdout:(18/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 514 kB/s | 309 kB 00:00 2024-04-12T08:57:45.161 INFO:teuthology.orchestra.run.smithi203.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 139 kB/s | 49 kB 00:00 2024-04-12T08:57:45.545 INFO:teuthology.orchestra.run.smithi203.stdout:(20/24): ceph-common-17.2.7-827.gd3b5060a.el9.x 7.8 MB/s | 22 MB 00:02 2024-04-12T08:57:45.562 INFO:teuthology.orchestra.run.smithi203.stdout:(21/24): libunwind-1.6.2-1.el9.x86_64.rpm 137 kB/s | 67 kB 00:00 2024-04-12T08:57:45.979 INFO:teuthology.orchestra.run.smithi203.stdout:(22/24): librbd1-17.2.7-827.gd3b5060a.el9.x86_6 7.1 MB/s | 2.9 MB 00:00 2024-04-12T08:57:46.012 INFO:teuthology.orchestra.run.smithi203.stdout:(23/24): thrift-0.15.0-2.el9.x86_64.rpm 1.9 MB/s | 1.6 MB 00:00 2024-04-12T08:57:46.287 INFO:teuthology.orchestra.run.smithi117.stdout:(1/24): ceph-radosgw-17.2.7-827.gd3b5060a.el9.x 7.7 MB/s | 14 MB 00:01 2024-04-12T08:57:46.346 INFO:teuthology.orchestra.run.smithi117.stdout:(2/24): ceph-base-17.2.7-827.gd3b5060a.el9.x86_ 2.6 MB/s | 5.0 MB 00:01 2024-04-12T08:57:46.371 INFO:teuthology.orchestra.run.smithi117.stdout:(3/24): ceph-selinux-17.2.7-827.gd3b5060a.el9.x 301 kB/s | 25 kB 00:00 2024-04-12T08:57:46.404 INFO:teuthology.orchestra.run.smithi203.stdout:(24/24): librados2-17.2.7-827.gd3b5060a.el9.x86 3.6 MB/s | 3.1 MB 00:00 2024-04-12T08:57:46.408 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:57:46.408 INFO:teuthology.orchestra.run.smithi203.stdout:Total 14 MB/s | 58 MB 00:04 2024-04-12T08:57:46.438 INFO:teuthology.orchestra.run.smithi117.stdout:(4/24): libradosstriper1-17.2.7-827.gd3b5060a.e 6.7 MB/s | 458 kB 00:00 2024-04-12T08:57:46.469 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-04-12T08:57:46.502 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-04-12T08:57:46.503 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-04-12T08:57:46.572 INFO:teuthology.orchestra.run.smithi117.stdout:(5/24): libcephfs2-17.2.7-827.gd3b5060a.el9.x86 2.8 MB/s | 637 kB 00:00 2024-04-12T08:57:46.647 INFO:teuthology.orchestra.run.smithi117.stdout:(6/24): python3-ceph-argparse-17.2.7-827.gd3b50 603 kB/s | 45 kB 00:00 2024-04-12T08:57:46.722 INFO:teuthology.orchestra.run.smithi117.stdout:(7/24): python3-ceph-common-17.2.7-827.gd3b5060 1.5 MB/s | 117 kB 00:00 2024-04-12T08:57:46.814 INFO:teuthology.orchestra.run.smithi117.stdout:(8/24): librgw2-17.2.7-827.gd3b5060a.el9.x86_64 13 MB/s | 4.9 MB 00:00 2024-04-12T08:57:46.839 INFO:teuthology.orchestra.run.smithi117.stdout:(9/24): python3-cephfs-17.2.7-827.gd3b5060a.el9 1.3 MB/s | 156 kB 00:00 2024-04-12T08:57:46.864 INFO:teuthology.orchestra.run.smithi117.stdout:(10/24): python3-rados-17.2.7-827.gd3b5060a.el9 6.2 MB/s | 320 kB 00:00 2024-04-12T08:57:46.915 INFO:teuthology.orchestra.run.smithi117.stdout:(11/24): python3-rgw-17.2.7-827.gd3b5060a.el9.x 1.9 MB/s | 99 kB 00:00 2024-04-12T08:57:46.940 INFO:teuthology.orchestra.run.smithi117.stdout:(12/24): python3-rbd-17.2.7-827.gd3b5060a.el9.x 2.8 MB/s | 292 kB 00:00 2024-04-12T08:57:46.978 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-04-12T08:57:46.978 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-04-12T08:57:47.049 INFO:teuthology.orchestra.run.smithi117.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 419 kB/s | 45 kB 00:00 2024-04-12T08:57:47.090 INFO:teuthology.orchestra.run.smithi117.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 913 kB/s | 160 kB 00:00 2024-04-12T08:57:47.166 INFO:teuthology.orchestra.run.smithi117.stdout:(15/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-04-12T08:57:47.191 INFO:teuthology.orchestra.run.smithi117.stdout:(16/24): librdkafka-1.6.1-102.el9.x86_64.rpm 4.5 MB/s | 662 kB 00:00 2024-04-12T08:57:47.208 INFO:teuthology.orchestra.run.smithi117.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-04-12T08:57:47.392 INFO:teuthology.orchestra.run.smithi117.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 265 kB/s | 49 kB 00:00 2024-04-12T08:57:47.417 INFO:teuthology.orchestra.run.smithi117.stdout:(19/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.3 MB/s | 309 kB 00:00 2024-04-12T08:57:47.442 INFO:teuthology.orchestra.run.smithi117.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-04-12T08:57:47.684 INFO:teuthology.orchestra.run.smithi117.stdout:(21/24): ceph-common-17.2.7-827.gd3b5060a.el9.x 6.9 MB/s | 22 MB 00:03 2024-04-12T08:57:47.718 INFO:teuthology.orchestra.run.smithi117.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 5.3 MB/s | 1.6 MB 00:00 2024-04-12T08:57:47.960 INFO:teuthology.orchestra.run.smithi117.stdout:(23/24): librbd1-17.2.7-827.gd3b5060a.el9.x86_6 11 MB/s | 2.9 MB 00:00 2024-04-12T08:57:48.202 INFO:teuthology.orchestra.run.smithi117.stdout:(24/24): librados2-17.2.7-827.gd3b5060a.el9.x86 4.1 MB/s | 3.1 MB 00:00 2024-04-12T08:57:48.206 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:57:48.206 INFO:teuthology.orchestra.run.smithi117.stdout:Total 15 MB/s | 58 MB 00:03 2024-04-12T08:57:48.217 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-04-12T08:57:48.269 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-12T08:57:48.302 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-12T08:57:48.303 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-12T08:57:48.562 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-04-12T08:57:48.623 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : librados2-2:17.2.7-827.gd3b5060a.el9.x86_64 2/26 2024-04-12T08:57:48.714 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librados2-2:17.2.7-827.gd3b5060a.el9.x86_64 2/26 2024-04-12T08:57:48.766 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-12T08:57:48.766 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-12T08:57:48.793 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rados-2:17.2.7-827.gd3b5060a.el9.x86_64 3/26 2024-04-12T08:57:48.832 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephfs2-2:17.2.7-827.gd3b5060a.el9.x86_64 4/26 2024-04-12T08:57:48.904 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libcephfs2-2:17.2.7-827.gd3b5060a.el9.x86_64 4/26 2024-04-12T08:57:48.959 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-04-12T08:57:49.004 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-04-12T08:57:49.438 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-04-12T08:57:49.460 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librgw2-2:17.2.7-827.gd3b5060a.el9.x86_64 8/26 2024-04-12T08:57:49.523 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librgw2-2:17.2.7-827.gd3b5060a.el9.x86_64 8/26 2024-04-12T08:57:49.552 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-04-12T08:57:49.586 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ceph-argparse-2:17.2.7-827.gd3b5060a.el9.x 10/26 2024-04-12T08:57:49.623 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cephfs-2:17.2.7-827.gd3b5060a.el9.x86_64 11/26 2024-04-12T08:57:49.685 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rgw-2:17.2.7-827.gd3b5060a.el9.x86_64 12/26 2024-04-12T08:57:49.713 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libradosstriper1-2:17.2.7-827.gd3b5060a.el9.x86_64 13/26 2024-04-12T08:57:49.779 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libradosstriper1-2:17.2.7-827.gd3b5060a.el9.x86_64 13/26 2024-04-12T08:57:49.818 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-04-12T08:57:49.863 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-04-12T08:57:49.896 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-04-12T08:57:50.003 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-12T08:57:50.198 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-04-12T08:57:50.225 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : librbd1-2:17.2.7-827.gd3b5060a.el9.x86_64 18/26 2024-04-12T08:57:50.306 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librbd1-2:17.2.7-827.gd3b5060a.el9.x86_64 18/26 2024-04-12T08:57:50.360 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-04-12T08:57:50.379 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rbd-2:17.2.7-827.gd3b5060a.el9.x86_64 19/26 2024-04-12T08:57:50.403 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ceph-common-2:17.2.7-827.gd3b5060a.el9.x86 20/26 2024-04-12T08:57:50.412 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librados2-2:17.2.7-827.gd3b5060a.el9.x86_64 2/26 2024-04-12T08:57:50.503 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:17.2.7-827.gd3b5060a.el9.x86_64 2/26 2024-04-12T08:57:50.582 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rados-2:17.2.7-827.gd3b5060a.el9.x86_64 3/26 2024-04-12T08:57:50.630 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs2-2:17.2.7-827.gd3b5060a.el9.x86_64 4/26 2024-04-12T08:57:50.701 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs2-2:17.2.7-827.gd3b5060a.el9.x86_64 4/26 2024-04-12T08:57:50.752 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-04-12T08:57:50.793 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-04-12T08:57:51.233 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-04-12T08:57:51.257 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librgw2-2:17.2.7-827.gd3b5060a.el9.x86_64 8/26 2024-04-12T08:57:51.321 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librgw2-2:17.2.7-827.gd3b5060a.el9.x86_64 8/26 2024-04-12T08:57:51.357 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-04-12T08:57:51.408 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-argparse-2:17.2.7-827.gd3b5060a.el9.x 10/26 2024-04-12T08:57:51.446 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cephfs-2:17.2.7-827.gd3b5060a.el9.x86_64 11/26 2024-04-12T08:57:51.508 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rgw-2:17.2.7-827.gd3b5060a.el9.x86_64 12/26 2024-04-12T08:57:51.535 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libradosstriper1-2:17.2.7-827.gd3b5060a.el9.x86_64 13/26 2024-04-12T08:57:51.585 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libradosstriper1-2:17.2.7-827.gd3b5060a.el9.x86_64 13/26 2024-04-12T08:57:51.624 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-04-12T08:57:51.660 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-04-12T08:57:51.693 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-04-12T08:57:51.993 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-04-12T08:57:52.023 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librbd1-2:17.2.7-827.gd3b5060a.el9.x86_64 18/26 2024-04-12T08:57:52.104 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:17.2.7-827.gd3b5060a.el9.x86_64 18/26 2024-04-12T08:57:52.177 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rbd-2:17.2.7-827.gd3b5060a.el9.x86_64 19/26 2024-04-12T08:57:52.208 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-common-2:17.2.7-827.gd3b5060a.el9.x86 20/26 2024-04-12T08:57:52.865 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-common-2:17.2.7-827.gd3b5060a.el9.x86_64 21/26 2024-04-12T08:57:52.908 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-common-2:17.2.7-827.gd3b5060a.el9.x86_64 21/26 2024-04-12T08:57:53.430 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-common-2:17.2.7-827.gd3b5060a.el9.x86_64 21/26 2024-04-12T08:57:53.469 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-base-2:17.2.7-827.gd3b5060a.el9.x86_64 22/26 2024-04-12T08:57:53.569 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-base-2:17.2.7-827.gd3b5060a.el9.x86_64 22/26 2024-04-12T08:57:53.569 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-12T08:57:53.569 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-12T08:57:53.569 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:57:53.604 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-selinux-2:17.2.7-827.gd3b5060a.el9.x86_64 23/26 2024-04-12T08:57:54.592 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:17.2.7-827.gd3b5060a.el9.x86_64 21/26 2024-04-12T08:57:54.622 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-common-2:17.2.7-827.gd3b5060a.el9.x86_64 21/26 2024-04-12T08:57:55.164 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:17.2.7-827.gd3b5060a.el9.x86_64 21/26 2024-04-12T08:57:55.224 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-base-2:17.2.7-827.gd3b5060a.el9.x86_64 22/26 2024-04-12T08:57:55.297 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-base-2:17.2.7-827.gd3b5060a.el9.x86_64 22/26 2024-04-12T08:57:55.297 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-12T08:57:55.298 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-12T08:57:55.298 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:57:55.342 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-selinux-2:17.2.7-827.gd3b5060a.el9.x86_64 23/26 2024-04-12T08:58:03.350 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-selinux-2:17.2.7-827.gd3b5060a.el9.x86_64 23/26 2024-04-12T08:58:03.350 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /sys 2024-04-12T08:58:03.350 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /proc 2024-04-12T08:58:03.350 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /mnt 2024-04-12T08:58:03.351 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /var/tmp 2024-04-12T08:58:03.351 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /home 2024-04-12T08:58:03.351 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /root 2024-04-12T08:58:03.351 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /tmp 2024-04-12T08:58:03.351 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:04.642 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-radosgw-2:17.2.7-827.gd3b5060a.el9.x86_64 24/26 2024-04-12T08:58:04.703 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-827.gd3b5060a.el9.x86_64 24/26 2024-04-12T08:58:04.703 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T08:58:04.703 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-12T08:58:04.704 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-12T08:58:04.704 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-12T08:58:04.704 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:04.705 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-12T08:58:04.777 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-selinux-2:17.2.7-827.gd3b5060a.el9.x86_64 23/26 2024-04-12T08:58:04.777 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /sys 2024-04-12T08:58:04.777 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /proc 2024-04-12T08:58:04.777 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /mnt 2024-04-12T08:58:04.777 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /var/tmp 2024-04-12T08:58:04.778 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /home 2024-04-12T08:58:04.778 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /root 2024-04-12T08:58:04.778 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /tmp 2024-04-12T08:58:04.778 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:04.786 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-12T08:58:04.787 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-12T08:58:06.009 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-radosgw-2:17.2.7-827.gd3b5060a.el9.x86_64 24/26 2024-04-12T08:58:06.025 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-12T08:58:06.025 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-base-2:17.2.7-827.gd3b5060a.el9.x86_64 1/26 2024-04-12T08:58:06.025 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-common-2:17.2.7-827.gd3b5060a.el9.x86_64 2/26 2024-04-12T08:58:06.025 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-radosgw-2:17.2.7-827.gd3b5060a.el9.x86_64 3/26 2024-04-12T08:58:06.025 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-selinux-2:17.2.7-827.gd3b5060a.el9.x86_64 4/26 2024-04-12T08:58:06.025 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephfs2-2:17.2.7-827.gd3b5060a.el9.x86_64 5/26 2024-04-12T08:58:06.025 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libradosstriper1-2:17.2.7-827.gd3b5060a.el9.x86_64 6/26 2024-04-12T08:58:06.025 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librgw2-2:17.2.7-827.gd3b5060a.el9.x86_64 7/26 2024-04-12T08:58:06.025 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ceph-argparse-2:17.2.7-827.gd3b5060a.el9.x 8/26 2024-04-12T08:58:06.026 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ceph-common-2:17.2.7-827.gd3b5060a.el9.x86 9/26 2024-04-12T08:58:06.026 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cephfs-2:17.2.7-827.gd3b5060a.el9.x86_64 10/26 2024-04-12T08:58:06.026 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rados-2:17.2.7-827.gd3b5060a.el9.x86_64 11/26 2024-04-12T08:58:06.026 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rbd-2:17.2.7-827.gd3b5060a.el9.x86_64 12/26 2024-04-12T08:58:06.026 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rgw-2:17.2.7-827.gd3b5060a.el9.x86_64 13/26 2024-04-12T08:58:06.026 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-04-12T08:58:06.026 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-04-12T08:58:06.026 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-04-12T08:58:06.026 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-04-12T08:58:06.026 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-04-12T08:58:06.026 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-04-12T08:58:06.026 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-04-12T08:58:06.026 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-04-12T08:58:06.027 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-04-12T08:58:06.027 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados2-2:17.2.7-827.gd3b5060a.el9.x86_64 23/26 2024-04-12T08:58:06.027 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-04-12T08:58:06.027 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librbd1-2:17.2.7-827.gd3b5060a.el9.x86_64 25/26 2024-04-12T08:58:06.078 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-827.gd3b5060a.el9.x86_64 24/26 2024-04-12T08:58:06.078 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T08:58:06.078 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-12T08:58:06.078 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-12T08:58:06.078 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-12T08:58:06.078 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:06.080 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-12T08:58:06.162 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-12T08:58:06.162 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-12T08:58:07.119 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-04-12T08:58:07.119 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:07.119 INFO:teuthology.orchestra.run.smithi203.stdout:Upgraded: 2024-04-12T08:58:07.119 INFO:teuthology.orchestra.run.smithi203.stdout: librados2-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:07.119 INFO:teuthology.orchestra.run.smithi203.stdout: librbd1-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:07.120 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-04-12T08:58:07.120 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-base-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:07.120 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-common-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:07.120 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-radosgw-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:07.120 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-selinux-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:07.120 INFO:teuthology.orchestra.run.smithi203.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-12T08:58:07.120 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs2-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:07.120 INFO:teuthology.orchestra.run.smithi203.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-12T08:58:07.120 INFO:teuthology.orchestra.run.smithi203.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-12T08:58:07.120 INFO:teuthology.orchestra.run.smithi203.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-12T08:58:07.120 INFO:teuthology.orchestra.run.smithi203.stdout: libradosstriper1-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:07.120 INFO:teuthology.orchestra.run.smithi203.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-12T08:58:07.120 INFO:teuthology.orchestra.run.smithi203.stdout: librgw2-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:07.121 INFO:teuthology.orchestra.run.smithi203.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-12T08:58:07.121 INFO:teuthology.orchestra.run.smithi203.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-12T08:58:07.121 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-argparse-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:07.121 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-common-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:07.121 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cephfs-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:07.121 INFO:teuthology.orchestra.run.smithi203.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-12T08:58:07.121 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rados-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:07.121 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rbd-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:07.121 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rgw-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:07.121 INFO:teuthology.orchestra.run.smithi203.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-12T08:58:07.121 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:07.121 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:58:07.332 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-12T08:58:07.333 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-base-2:17.2.7-827.gd3b5060a.el9.x86_64 1/26 2024-04-12T08:58:07.333 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-common-2:17.2.7-827.gd3b5060a.el9.x86_64 2/26 2024-04-12T08:58:07.333 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-radosgw-2:17.2.7-827.gd3b5060a.el9.x86_64 3/26 2024-04-12T08:58:07.333 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-selinux-2:17.2.7-827.gd3b5060a.el9.x86_64 4/26 2024-04-12T08:58:07.333 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs2-2:17.2.7-827.gd3b5060a.el9.x86_64 5/26 2024-04-12T08:58:07.333 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libradosstriper1-2:17.2.7-827.gd3b5060a.el9.x86_64 6/26 2024-04-12T08:58:07.333 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librgw2-2:17.2.7-827.gd3b5060a.el9.x86_64 7/26 2024-04-12T08:58:07.333 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-argparse-2:17.2.7-827.gd3b5060a.el9.x 8/26 2024-04-12T08:58:07.333 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-common-2:17.2.7-827.gd3b5060a.el9.x86 9/26 2024-04-12T08:58:07.333 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cephfs-2:17.2.7-827.gd3b5060a.el9.x86_64 10/26 2024-04-12T08:58:07.333 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rados-2:17.2.7-827.gd3b5060a.el9.x86_64 11/26 2024-04-12T08:58:07.333 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rbd-2:17.2.7-827.gd3b5060a.el9.x86_64 12/26 2024-04-12T08:58:07.334 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rgw-2:17.2.7-827.gd3b5060a.el9.x86_64 13/26 2024-04-12T08:58:07.334 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-04-12T08:58:07.334 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-04-12T08:58:07.334 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-04-12T08:58:07.334 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-04-12T08:58:07.334 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-04-12T08:58:07.334 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-04-12T08:58:07.334 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-04-12T08:58:07.334 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-04-12T08:58:07.334 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-04-12T08:58:07.334 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:17.2.7-827.gd3b5060a.el9.x86_64 23/26 2024-04-12T08:58:07.334 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-04-12T08:58:07.334 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:17.2.7-827.gd3b5060a.el9.x86_64 25/26 2024-04-12T08:58:07.478 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-test 2024-04-12T08:58:08.071 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:00:29 ago on Fri 12 Apr 2024 08:57:39 AM UTC. 2024-04-12T08:58:08.304 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-04-12T08:58:08.304 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:08.304 INFO:teuthology.orchestra.run.smithi117.stdout:Upgraded: 2024-04-12T08:58:08.304 INFO:teuthology.orchestra.run.smithi117.stdout: librados2-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:08.304 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:08.304 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-12T08:58:08.304 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:08.305 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:08.305 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:08.305 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:08.305 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-12T08:58:08.305 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:08.305 INFO:teuthology.orchestra.run.smithi117.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-12T08:58:08.305 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-12T08:58:08.305 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-12T08:58:08.305 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:08.306 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-12T08:58:08.306 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:08.306 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-12T08:58:08.306 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-12T08:58:08.306 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:08.306 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:08.306 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:08.306 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-12T08:58:08.306 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:08.306 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:08.306 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:08.306 INFO:teuthology.orchestra.run.smithi117.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-12T08:58:08.307 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:08.307 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T08:58:08.366 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:58:08.366 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:58:08.366 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:58:08.366 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.366 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:58:08.366 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.366 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:58:08.366 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.366 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:58:08.367 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.367 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:58:08.367 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.367 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:58:08.367 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.367 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:58:08.367 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.367 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:58:08.367 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.367 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:58:08.367 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.367 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:58:08.367 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.367 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:58:08.368 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.368 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:58:08.368 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.368 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:58:08.368 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.368 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:58:08.368 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.368 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:58:08.368 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.368 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:58:08.368 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.368 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:58:08.368 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.368 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:58:08.369 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.369 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:58:08.369 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.369 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:58:08.369 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.369 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:58:08.369 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.369 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:58:08.369 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.369 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:58:08.369 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.369 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:58:08.369 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.369 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:58:08.369 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.370 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:58:08.370 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.370 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:58:08.370 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.370 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:58:08.370 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.370 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:58:08.370 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.370 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:58:08.370 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.370 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:58:08.370 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.370 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:58:08.371 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.371 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:58:08.371 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.371 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:58:08.371 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.371 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:58:08.371 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.371 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:58:08.371 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.371 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:58:08.371 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.371 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.371 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.371 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:58:08.372 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.372 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.372 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.372 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.372 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:58:08.372 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.372 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.372 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.372 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.372 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.372 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.372 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:58:08.372 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.372 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.372 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.373 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.373 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:58:08.373 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.373 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.373 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.373 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.373 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:58:08.373 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.373 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.373 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.373 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.373 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:58:08.373 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.373 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.374 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.374 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.374 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:58:08.374 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.374 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.374 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.374 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.374 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:58:08.374 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.374 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.374 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.374 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:58:08.444 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:58:08.444 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:58:08.444 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-04-12T08:58:08.444 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:58:08.445 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-04-12T08:58:08.445 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-test x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 48 M 2024-04-12T08:58:08.445 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-04-12T08:58:08.445 INFO:teuthology.orchestra.run.smithi203.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-12T08:58:08.445 INFO:teuthology.orchestra.run.smithi203.stdout: libcephsqlite x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 163 k 2024-04-12T08:58:08.445 INFO:teuthology.orchestra.run.smithi203.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-12T08:58:08.445 INFO:teuthology.orchestra.run.smithi203.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-12T08:58:08.445 INFO:teuthology.orchestra.run.smithi203.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-12T08:58:08.445 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:08.445 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-04-12T08:58:08.445 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:58:08.445 INFO:teuthology.orchestra.run.smithi203.stdout:Install 6 Packages 2024-04-12T08:58:08.445 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:08.446 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 49 M 2024-04-12T08:58:08.446 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 193 M 2024-04-12T08:58:08.446 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-04-12T08:58:08.654 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-test 2024-04-12T08:58:09.239 INFO:teuthology.orchestra.run.smithi203.stdout:(1/6): jq-1.6-16.el9.x86_64.rpm 721 kB/s | 187 kB 00:00 2024-04-12T08:58:09.240 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:00:28 ago on Fri 12 Apr 2024 08:57:41 AM UTC. 2024-04-12T08:58:09.323 INFO:teuthology.orchestra.run.smithi203.stdout:(2/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.6 MB/s | 218 kB 00:00 2024-04-12T08:58:09.348 INFO:teuthology.orchestra.run.smithi203.stdout:(3/6): libcephsqlite-17.2.7-827.gd3b5060a.el9.x 441 kB/s | 163 kB 00:00 2024-04-12T08:58:09.527 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T08:58:09.527 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T08:58:09.527 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T08:58:09.527 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.527 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T08:58:09.527 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.527 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T08:58:09.527 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.528 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T08:58:09.528 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.528 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T08:58:09.528 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.528 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T08:58:09.528 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.528 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T08:58:09.528 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.528 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T08:58:09.528 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.528 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T08:58:09.528 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.528 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T08:58:09.528 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.529 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T08:58:09.529 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.529 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T08:58:09.529 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.529 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T08:58:09.529 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.529 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T08:58:09.529 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.529 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T08:58:09.529 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.529 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T08:58:09.529 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.529 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T08:58:09.530 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.530 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T08:58:09.530 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.530 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T08:58:09.530 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.530 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T08:58:09.530 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.530 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T08:58:09.530 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.530 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T08:58:09.530 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.530 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T08:58:09.530 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.531 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T08:58:09.531 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.531 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T08:58:09.531 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.531 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T08:58:09.531 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.531 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T08:58:09.531 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.531 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T08:58:09.531 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.531 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T08:58:09.531 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.531 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T08:58:09.532 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.532 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T08:58:09.532 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.532 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T08:58:09.532 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.532 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T08:58:09.532 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.532 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T08:58:09.532 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.532 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T08:58:09.532 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.532 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T08:58:09.532 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.532 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T08:58:09.532 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.533 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.533 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.533 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:58:09.533 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.533 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.533 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.533 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.533 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T08:58:09.533 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.533 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.533 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.533 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.533 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.533 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.534 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:58:09.534 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.534 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.534 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.534 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.534 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:58:09.534 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.534 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.534 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.534 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.534 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:58:09.534 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.534 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.535 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.535 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.535 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:58:09.535 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.535 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.535 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.535 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.535 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:58:09.535 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.535 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.535 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.535 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.536 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:58:09.536 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.536 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.536 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.536 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:58:09.594 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T08:58:09.595 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:58:09.595 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-04-12T08:58:09.595 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:58:09.596 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-12T08:58:09.596 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 48 M 2024-04-12T08:58:09.596 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-04-12T08:58:09.596 INFO:teuthology.orchestra.run.smithi117.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-12T08:58:09.596 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 163 k 2024-04-12T08:58:09.596 INFO:teuthology.orchestra.run.smithi117.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-12T08:58:09.596 INFO:teuthology.orchestra.run.smithi117.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-12T08:58:09.596 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-12T08:58:09.596 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:09.596 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-12T08:58:09.596 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:58:09.596 INFO:teuthology.orchestra.run.smithi117.stdout:Install 6 Packages 2024-04-12T08:58:09.597 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:09.597 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 49 M 2024-04-12T08:58:09.597 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 193 M 2024-04-12T08:58:09.597 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-12T08:58:09.707 INFO:teuthology.orchestra.run.smithi203.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 178 kB/s | 64 kB 00:00 2024-04-12T08:58:09.915 INFO:teuthology.orchestra.run.smithi203.stdout:(5/6): socat-1.7.4.1-5.el9.x86_64.rpm 515 kB/s | 305 kB 00:00 2024-04-12T08:58:10.069 INFO:teuthology.orchestra.run.smithi117.stdout:(1/6): jq-1.6-16.el9.x86_64.rpm 692 kB/s | 187 kB 00:00 2024-04-12T08:58:10.152 INFO:teuthology.orchestra.run.smithi117.stdout:(2/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.6 MB/s | 218 kB 00:00 2024-04-12T08:58:10.411 INFO:teuthology.orchestra.run.smithi117.stdout:(3/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.2 MB/s | 305 kB 00:00 2024-04-12T08:58:10.436 INFO:teuthology.orchestra.run.smithi117.stdout:(4/6): libcephsqlite-17.2.7-827.gd3b5060a.el9.x 255 kB/s | 163 kB 00:00 2024-04-12T08:58:10.461 INFO:teuthology.orchestra.run.smithi117.stdout:(5/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-12T08:58:11.341 INFO:teuthology.orchestra.run.smithi203.stdout:(6/6): ceph-test-17.2.7-827.gd3b5060a.el9.x86_6 20 MB/s | 48 MB 00:02 2024-04-12T08:58:11.344 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:58:11.344 INFO:teuthology.orchestra.run.smithi203.stdout:Total 17 MB/s | 49 MB 00:02 2024-04-12T08:58:11.394 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-04-12T08:58:11.414 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-04-12T08:58:11.414 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-04-12T08:58:11.810 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-04-12T08:58:11.810 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-04-12T08:58:12.377 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-04-12T08:58:12.456 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-04-12T08:58:12.492 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-04-12T08:58:12.541 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-12T08:58:12.583 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-04-12T08:58:12.611 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephsqlite-2:17.2.7-827.gd3b5060a.el9.x86_64 5/6 2024-04-12T08:58:14.253 INFO:teuthology.orchestra.run.smithi117.stdout:(6/6): ceph-test-17.2.7-827.gd3b5060a.el9.x86_6 11 MB/s | 48 MB 00:04 2024-04-12T08:58:14.256 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:58:14.256 INFO:teuthology.orchestra.run.smithi117.stdout:Total 10 MB/s | 49 MB 00:04 2024-04-12T08:58:14.306 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-12T08:58:14.325 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-12T08:58:14.326 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-12T08:58:14.711 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-12T08:58:14.712 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-12T08:58:15.290 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-12T08:58:15.389 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-04-12T08:58:15.429 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-04-12T08:58:15.470 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-12T08:58:15.511 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-04-12T08:58:15.539 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephsqlite-2:17.2.7-827.gd3b5060a.el9.x86_64 5/6 2024-04-12T08:58:17.004 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libcephsqlite-2:17.2.7-827.gd3b5060a.el9.x86_64 5/6 2024-04-12T08:58:17.077 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-test-2:17.2.7-827.gd3b5060a.el9.x86_64 6/6 2024-04-12T08:58:19.417 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-test-2:17.2.7-827.gd3b5060a.el9.x86_64 6/6 2024-04-12T08:58:19.417 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-test-2:17.2.7-827.gd3b5060a.el9.x86_64 1/6 2024-04-12T08:58:19.417 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephsqlite-2:17.2.7-827.gd3b5060a.el9.x86_64 2/6 2024-04-12T08:58:19.417 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2024-04-12T08:58:19.417 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2024-04-12T08:58:19.417 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2024-04-12T08:58:19.797 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2024-04-12T08:58:19.797 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:19.798 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-04-12T08:58:19.798 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-test-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:19.798 INFO:teuthology.orchestra.run.smithi203.stdout: jq-1.6-16.el9.x86_64 2024-04-12T08:58:19.798 INFO:teuthology.orchestra.run.smithi203.stdout: libcephsqlite-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:19.798 INFO:teuthology.orchestra.run.smithi203.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-12T08:58:19.798 INFO:teuthology.orchestra.run.smithi203.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-12T08:58:19.798 INFO:teuthology.orchestra.run.smithi203.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-12T08:58:19.798 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:19.798 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:58:19.952 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephsqlite-2:17.2.7-827.gd3b5060a.el9.x86_64 5/6 2024-04-12T08:58:20.029 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-test-2:17.2.7-827.gd3b5060a.el9.x86_64 6/6 2024-04-12T08:58:20.127 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph 2024-04-12T08:58:20.724 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:00:41 ago on Fri 12 Apr 2024 08:57:39 AM UTC. 2024-04-12T08:58:21.011 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:58:21.011 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:58:21.011 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:58:21.012 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.012 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:58:21.012 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.012 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:58:21.012 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.012 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:58:21.012 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.012 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:58:21.012 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.012 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:58:21.012 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.012 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:58:21.012 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.012 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:58:21.013 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.013 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:58:21.013 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.013 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:58:21.013 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.013 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:58:21.013 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.013 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:58:21.013 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.013 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:58:21.013 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.013 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:58:21.014 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.014 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:58:21.014 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.014 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:58:21.014 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.014 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:58:21.014 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.014 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:58:21.014 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.015 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:58:21.015 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.015 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:58:21.015 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.015 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:58:21.015 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.015 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:58:21.015 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.015 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:58:21.015 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.015 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:58:21.015 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.015 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:58:21.015 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.015 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:58:21.016 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.016 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:58:21.016 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.016 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:58:21.016 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.016 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:58:21.016 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.016 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:58:21.016 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.016 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:58:21.016 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.016 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:58:21.016 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.016 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:58:21.017 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.017 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:58:21.017 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.017 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:58:21.017 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.017 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:58:21.017 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.017 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:58:21.017 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.017 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.017 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.017 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:58:21.017 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.017 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.018 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.018 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.018 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:58:21.018 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.018 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.018 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.018 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.018 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.018 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.018 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:58:21.018 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.018 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.018 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.018 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.019 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:58:21.019 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.019 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.019 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.019 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.019 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:58:21.019 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.019 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.019 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.019 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.019 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:58:21.019 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.019 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.019 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.019 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.020 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:58:21.020 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.020 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.020 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.020 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.020 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:58:21.020 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.020 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.020 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.020 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:58:21.082 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:58:21.085 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:58:21.085 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-04-12T08:58:21.085 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:58:21.085 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-04-12T08:58:21.085 INFO:teuthology.orchestra.run.smithi203.stdout: ceph x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 6.5 k 2024-04-12T08:58:21.085 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-04-12T08:58:21.085 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mds x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 2.1 M 2024-04-12T08:58:21.085 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 1.4 M 2024-04-12T08:58:21.086 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-modules-core noarch 2:17.2.7-827.gd3b5060a.el9 ceph-noarch 240 k 2024-04-12T08:58:21.086 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mon x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 3.9 M 2024-04-12T08:58:21.086 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-osd x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 15 M 2024-04-12T08:58:21.086 INFO:teuthology.orchestra.run.smithi203.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-12T08:58:21.086 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-12T08:58:21.086 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-12T08:58:21.086 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-12T08:58:21.086 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-12T08:58:21.086 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-12T08:58:21.086 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-12T08:58:21.086 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-12T08:58:21.086 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-12T08:58:21.086 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-12T08:58:21.087 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-12T08:58:21.087 INFO:teuthology.orchestra.run.smithi203.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-12T08:58:21.087 INFO:teuthology.orchestra.run.smithi203.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-12T08:58:21.087 INFO:teuthology.orchestra.run.smithi203.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-12T08:58:21.087 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-12T08:58:21.087 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-12T08:58:21.087 INFO:teuthology.orchestra.run.smithi203.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-12T08:58:21.087 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-12T08:58:21.087 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-12T08:58:21.087 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-12T08:58:21.087 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-12T08:58:21.087 INFO:teuthology.orchestra.run.smithi203.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-12T08:58:21.087 INFO:teuthology.orchestra.run.smithi203.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-12T08:58:21.088 INFO:teuthology.orchestra.run.smithi203.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-12T08:58:21.088 INFO:teuthology.orchestra.run.smithi203.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-12T08:58:21.088 INFO:teuthology.orchestra.run.smithi203.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-12T08:58:21.088 INFO:teuthology.orchestra.run.smithi203.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-12T08:58:21.088 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:21.088 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-04-12T08:58:21.088 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:58:21.088 INFO:teuthology.orchestra.run.smithi203.stdout:Install 33 Packages 2024-04-12T08:58:21.088 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:21.089 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 27 M 2024-04-12T08:58:21.089 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 96 M 2024-04-12T08:58:21.089 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-04-12T08:58:21.979 INFO:teuthology.orchestra.run.smithi203.stdout:(1/33): ceph-17.2.7-827.gd3b5060a.el9.x86_64.rp 35 kB/s | 6.5 kB 00:00 2024-04-12T08:58:22.170 INFO:teuthology.orchestra.run.smithi203.stdout:(2/33): ceph-mgr-17.2.7-827.gd3b5060a.el9.x86_6 3.7 MB/s | 1.4 MB 00:00 2024-04-12T08:58:22.204 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-test-2:17.2.7-827.gd3b5060a.el9.x86_64 6/6 2024-04-12T08:58:22.204 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-test-2:17.2.7-827.gd3b5060a.el9.x86_64 1/6 2024-04-12T08:58:22.204 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephsqlite-2:17.2.7-827.gd3b5060a.el9.x86_64 2/6 2024-04-12T08:58:22.204 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2024-04-12T08:58:22.204 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2024-04-12T08:58:22.204 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2024-04-12T08:58:22.237 INFO:teuthology.orchestra.run.smithi203.stdout:(3/33): ceph-mds-17.2.7-827.gd3b5060a.el9.x86_6 4.7 MB/s | 2.1 MB 00:00 2024-04-12T08:58:22.337 INFO:teuthology.orchestra.run.smithi203.stdout:(4/33): ceph-mgr-modules-core-17.2.7-827.gd3b50 2.3 MB/s | 240 kB 00:00 2024-04-12T08:58:22.529 INFO:teuthology.orchestra.run.smithi203.stdout:(5/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-04-12T08:58:22.583 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2024-04-12T08:58:22.583 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:22.583 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-12T08:58:22.583 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:22.583 INFO:teuthology.orchestra.run.smithi117.stdout: jq-1.6-16.el9.x86_64 2024-04-12T08:58:22.583 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:22.583 INFO:teuthology.orchestra.run.smithi117.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-12T08:58:22.583 INFO:teuthology.orchestra.run.smithi117.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-12T08:58:22.583 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-12T08:58:22.583 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:22.583 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T08:58:22.638 INFO:teuthology.orchestra.run.smithi203.stdout:(6/33): ceph-mon-17.2.7-827.gd3b5060a.el9.x86_6 5.9 MB/s | 3.9 MB 00:00 2024-04-12T08:58:22.672 INFO:teuthology.orchestra.run.smithi203.stdout:(7/33): python3-cryptography-36.0.1-4.el9.x86_6 8.6 MB/s | 1.2 MB 00:00 2024-04-12T08:58:22.747 INFO:teuthology.orchestra.run.smithi203.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 1.8 MB/s | 135 kB 00:00 2024-04-12T08:58:22.773 INFO:teuthology.orchestra.run.smithi203.stdout:(9/33): python3-ply-3.11-14.el9.noarch.rpm 793 kB/s | 106 kB 00:00 2024-04-12T08:58:22.798 INFO:teuthology.orchestra.run.smithi203.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 2.4 MB/s | 125 kB 00:00 2024-04-12T08:58:22.869 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph 2024-04-12T08:58:22.982 INFO:teuthology.orchestra.run.smithi203.stdout:(11/33): ceph-osd-17.2.7-827.gd3b5060a.el9.x86_ 19 MB/s | 15 MB 00:00 2024-04-12T08:58:23.007 INFO:teuthology.orchestra.run.smithi203.stdout:(12/33): python3-urllib3-1.26.5-5.el9.noarch.rp 918 kB/s | 215 kB 00:00 2024-04-12T08:58:23.074 INFO:teuthology.orchestra.run.smithi203.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 378 kB/s | 35 kB 00:00 2024-04-12T08:58:23.099 INFO:teuthology.orchestra.run.smithi203.stdout:(14/33): python3-mako-1.1.4-6.el9.noarch.rpm 572 kB/s | 172 kB 00:00 2024-04-12T08:58:23.125 INFO:teuthology.orchestra.run.smithi203.stdout:(15/33): python3-pytz-2021.1-5.el9.noarch.rpm 434 kB/s | 51 kB 00:00 2024-04-12T08:58:23.150 INFO:teuthology.orchestra.run.smithi203.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 551 kB/s | 42 kB 00:00 2024-04-12T08:58:23.225 INFO:teuthology.orchestra.run.smithi203.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 346 kB/s | 43 kB 00:00 2024-04-12T08:58:23.276 INFO:teuthology.orchestra.run.smithi203.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 214 kB/s | 11 kB 00:00 2024-04-12T08:58:23.309 INFO:teuthology.orchestra.run.smithi203.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 933 kB/s | 172 kB 00:00 2024-04-12T08:58:23.343 INFO:teuthology.orchestra.run.smithi203.stdout:(20/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.8 MB/s | 358 kB 00:00 2024-04-12T08:58:23.368 INFO:teuthology.orchestra.run.smithi203.stdout:(21/33): python3-jaraco-classes-3.2.1-5.el9.noa 192 kB/s | 18 kB 00:00 2024-04-12T08:58:23.393 INFO:teuthology.orchestra.run.smithi203.stdout:(22/33): python3-jaraco-collections-3.0.0-8.el9 276 kB/s | 23 kB 00:00 2024-04-12T08:58:23.419 INFO:teuthology.orchestra.run.smithi203.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 258 kB/s | 19 kB 00:00 2024-04-12T08:58:23.444 INFO:teuthology.orchestra.run.smithi203.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 260 kB/s | 20 kB 00:00 2024-04-12T08:58:23.469 INFO:teuthology.orchestra.run.smithi203.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-04-12T08:58:23.480 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:00:42 ago on Fri 12 Apr 2024 08:57:41 AM UTC. 2024-04-12T08:58:23.494 INFO:teuthology.orchestra.run.smithi203.stdout:(26/33): python3-logutils-0.3.5-21.el9.noarch.r 615 kB/s | 46 kB 00:00 2024-04-12T08:58:23.520 INFO:teuthology.orchestra.run.smithi203.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 325 kB/s | 16 kB 00:00 2024-04-12T08:58:23.562 INFO:teuthology.orchestra.run.smithi203.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 861 kB/s | 36 kB 00:00 2024-04-12T08:58:23.587 INFO:teuthology.orchestra.run.smithi203.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 974 kB/s | 90 kB 00:00 2024-04-12T08:58:23.621 INFO:teuthology.orchestra.run.smithi203.stdout:(30/33): python3-webob-1.8.7-6.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-04-12T08:58:23.663 INFO:teuthology.orchestra.run.smithi203.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 482 kB/s | 20 kB 00:00 2024-04-12T08:58:23.697 INFO:teuthology.orchestra.run.smithi203.stdout:(32/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.1 MB/s | 272 kB 00:00 2024-04-12T08:58:23.777 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T08:58:23.778 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T08:58:23.778 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T08:58:23.778 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.779 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T08:58:23.779 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.779 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T08:58:23.779 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.779 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T08:58:23.780 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.780 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T08:58:23.780 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.781 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T08:58:23.781 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.781 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T08:58:23.781 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.781 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T08:58:23.782 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.782 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T08:58:23.783 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.783 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T08:58:23.783 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.783 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T08:58:23.783 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.783 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T08:58:23.784 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.784 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T08:58:23.784 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.784 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T08:58:23.784 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.784 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T08:58:23.785 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.785 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T08:58:23.785 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.785 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T08:58:23.785 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.785 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T08:58:23.785 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.786 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T08:58:23.786 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.786 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T08:58:23.786 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.786 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T08:58:23.786 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.786 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T08:58:23.787 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.787 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T08:58:23.787 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.787 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T08:58:23.787 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.787 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T08:58:23.787 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.787 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T08:58:23.787 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.788 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T08:58:23.788 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.788 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T08:58:23.788 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.788 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T08:58:23.788 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.788 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T08:58:23.788 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.789 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T08:58:23.789 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.789 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T08:58:23.789 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.789 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T08:58:23.789 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.790 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T08:58:23.790 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.790 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T08:58:23.790 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.790 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T08:58:23.790 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.791 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T08:58:23.791 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.791 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.791 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.791 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:58:23.791 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.791 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.794 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.794 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.795 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T08:58:23.795 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.795 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.795 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.795 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.795 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.795 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.795 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:58:23.795 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.796 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.796 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.796 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.796 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:58:23.796 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.796 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.796 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.796 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.796 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:58:23.797 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.797 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.797 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.797 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.797 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:58:23.797 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.797 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.797 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.797 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.798 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:58:23.798 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.798 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.798 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.798 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.798 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:58:23.798 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.798 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.798 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.798 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:58:23.846 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T08:58:23.848 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:58:23.848 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-04-12T08:58:23.848 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:58:23.848 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-12T08:58:23.848 INFO:teuthology.orchestra.run.smithi117.stdout: ceph x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 6.5 k 2024-04-12T08:58:23.849 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-04-12T08:58:23.849 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 2.1 M 2024-04-12T08:58:23.849 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 1.4 M 2024-04-12T08:58:23.849 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core noarch 2:17.2.7-827.gd3b5060a.el9 ceph-noarch 240 k 2024-04-12T08:58:23.849 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 3.9 M 2024-04-12T08:58:23.849 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 15 M 2024-04-12T08:58:23.849 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-12T08:58:23.849 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-12T08:58:23.849 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-12T08:58:23.849 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-12T08:58:23.849 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-12T08:58:23.849 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-12T08:58:23.849 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-12T08:58:23.849 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-12T08:58:23.850 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-12T08:58:23.850 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-12T08:58:23.850 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-12T08:58:23.850 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-12T08:58:23.850 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-12T08:58:23.850 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-12T08:58:23.850 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-12T08:58:23.850 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-12T08:58:23.850 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-12T08:58:23.850 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-12T08:58:23.850 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-12T08:58:23.850 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-12T08:58:23.850 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-12T08:58:23.850 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-12T08:58:23.851 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-12T08:58:23.851 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-12T08:58:23.851 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-12T08:58:23.851 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-12T08:58:23.851 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-12T08:58:23.851 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:23.851 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-12T08:58:23.851 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:58:23.851 INFO:teuthology.orchestra.run.smithi117.stdout:Install 33 Packages 2024-04-12T08:58:23.851 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:23.852 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 27 M 2024-04-12T08:58:23.852 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 96 M 2024-04-12T08:58:23.852 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-12T08:58:23.855 INFO:teuthology.orchestra.run.smithi203.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.6 MB/s | 427 kB 00:00 2024-04-12T08:58:23.856 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:58:23.857 INFO:teuthology.orchestra.run.smithi203.stdout:Total 9.8 MB/s | 27 MB 00:02 2024-04-12T08:58:23.979 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-04-12T08:58:24.016 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-04-12T08:58:24.017 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-04-12T08:58:24.348 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-04-12T08:58:24.349 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-04-12T08:58:24.804 INFO:teuthology.orchestra.run.smithi117.stdout:(1/33): ceph-17.2.7-827.gd3b5060a.el9.x86_64.rp 14 kB/s | 6.5 kB 00:00 2024-04-12T08:58:24.854 INFO:teuthology.orchestra.run.smithi117.stdout:(2/33): ceph-mds-17.2.7-827.gd3b5060a.el9.x86_6 3.9 MB/s | 2.1 MB 00:00 2024-04-12T08:58:24.888 INFO:teuthology.orchestra.run.smithi117.stdout:(3/33): ceph-mgr-17.2.7-827.gd3b5060a.el9.x86_6 2.5 MB/s | 1.4 MB 00:00 2024-04-12T08:58:24.980 INFO:teuthology.orchestra.run.smithi117.stdout:(4/33): ceph-mgr-modules-core-17.2.7-827.gd3b50 2.6 MB/s | 240 kB 00:00 2024-04-12T08:58:25.163 INFO:teuthology.orchestra.run.smithi117.stdout:(5/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2024-04-12T08:58:25.414 INFO:teuthology.orchestra.run.smithi117.stdout:(6/33): python3-cryptography-36.0.1-4.el9.x86_6 4.9 MB/s | 1.2 MB 00:00 2024-04-12T08:58:25.472 INFO:teuthology.orchestra.run.smithi117.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-04-12T08:58:25.623 INFO:teuthology.orchestra.run.smithi117.stdout:(8/33): ceph-osd-17.2.7-827.gd3b5060a.el9.x86_6 20 MB/s | 15 MB 00:00 2024-04-12T08:58:25.648 INFO:teuthology.orchestra.run.smithi117.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 770 kB/s | 135 kB 00:00 2024-04-12T08:58:25.662 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-04-12T08:58:25.732 INFO:teuthology.orchestra.run.smithi117.stdout:(10/33): python3-urllib3-1.26.5-5.el9.noarch.rp 2.5 MB/s | 215 kB 00:00 2024-04-12T08:58:25.749 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-04-12T08:58:25.782 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-04-12T08:58:25.790 INFO:teuthology.orchestra.run.smithi117.stdout:(11/33): python3-requests-2.25.1-8.el9.noarch.r 748 kB/s | 125 kB 00:00 2024-04-12T08:58:25.815 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-04-12T08:58:25.865 INFO:teuthology.orchestra.run.smithi117.stdout:(12/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-04-12T08:58:25.899 INFO:teuthology.orchestra.run.smithi117.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 320 kB/s | 35 kB 00:00 2024-04-12T08:58:25.907 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-04-12T08:58:25.924 INFO:teuthology.orchestra.run.smithi117.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 870 kB/s | 51 kB 00:00 2024-04-12T08:58:25.966 INFO:teuthology.orchestra.run.smithi117.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 623 kB/s | 42 kB 00:00 2024-04-12T08:58:25.985 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-04-12T08:58:26.026 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-04-12T08:58:26.061 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-04-12T08:58:26.091 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-04-12T08:58:26.125 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-04-12T08:58:26.159 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-04-12T08:58:26.199 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-04-12T08:58:26.234 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-04-12T08:58:26.269 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-04-12T08:58:26.311 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-04-12T08:58:26.389 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-04-12T08:58:26.408 INFO:teuthology.orchestra.run.smithi117.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 90 kB/s | 43 kB 00:00 2024-04-12T08:58:26.508 INFO:teuthology.orchestra.run.smithi117.stdout:(17/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 317 kB/s | 172 kB 00:00 2024-04-12T08:58:26.549 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-04-12T08:58:26.625 INFO:teuthology.orchestra.run.smithi117.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 92 kB/s | 11 kB 00:00 2024-04-12T08:58:26.633 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-04-12T08:58:26.685 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-04-12T08:58:26.724 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-04-12T08:58:26.750 INFO:teuthology.orchestra.run.smithi117.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 141 kB/s | 18 kB 00:00 2024-04-12T08:58:26.773 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-04-12T08:58:26.829 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-04-12T08:58:26.884 INFO:teuthology.orchestra.run.smithi117.stdout:(20/33): python3-jaraco-collections-3.0.0-8.el9 174 kB/s | 23 kB 00:00 2024-04-12T08:58:26.918 INFO:teuthology.orchestra.run.smithi117.stdout:(21/33): python3-cherrypy-18.6.1-2.el9.noarch.r 704 kB/s | 358 kB 00:00 2024-04-12T08:58:27.023 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-04-12T08:58:27.026 INFO:teuthology.orchestra.run.smithi117.stdout:(22/33): ceph-mon-17.2.7-827.gd3b5060a.el9.x86_ 1.8 MB/s | 3.9 MB 00:02 2024-04-12T08:58:27.051 INFO:teuthology.orchestra.run.smithi117.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 116 kB/s | 19 kB 00:00 2024-04-12T08:58:27.070 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-04-12T08:58:27.085 INFO:teuthology.orchestra.run.smithi117.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 117 kB/s | 20 kB 00:00 2024-04-12T08:58:27.140 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-04-12T08:58:27.202 INFO:teuthology.orchestra.run.smithi117.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 677 kB/s | 79 kB 00:00 2024-04-12T08:58:27.230 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-04-12T08:58:27.280 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-04-12T08:58:27.294 INFO:teuthology.orchestra.run.smithi117.stdout:(26/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2024-04-12T08:58:27.319 INFO:teuthology.orchestra.run.smithi117.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 140 kB/s | 16 kB 00:00 2024-04-12T08:58:27.391 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-04-12T08:58:27.411 INFO:teuthology.orchestra.run.smithi117.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 768 kB/s | 90 kB 00:00 2024-04-12T08:58:27.436 INFO:teuthology.orchestra.run.smithi117.stdout:(29/33): python3-logutils-0.3.5-21.el9.noarch.r 113 kB/s | 46 kB 00:00 2024-04-12T08:58:27.479 INFO:teuthology.orchestra.run.smithi117.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 225 kB/s | 36 kB 00:00 2024-04-12T08:58:27.529 INFO:teuthology.orchestra.run.smithi117.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-04-12T08:58:27.540 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-827.gd3b5060a.el9.n 28/33 2024-04-12T08:58:27.589 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-2:17.2.7-827.gd3b5060a.el9.x86_64 29/33 2024-04-12T08:58:27.595 INFO:teuthology.orchestra.run.smithi117.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 171 kB/s | 20 kB 00:00 2024-04-12T08:58:27.619 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-2:17.2.7-827.gd3b5060a.el9.x86_64 29/33 2024-04-12T08:58:27.619 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T08:58:27.619 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-12T08:58:27.619 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-12T08:58:27.619 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-12T08:58:27.619 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:27.837 INFO:teuthology.orchestra.run.smithi117.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.0 MB/s | 427 kB 00:00 2024-04-12T08:58:27.839 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:58:27.839 INFO:teuthology.orchestra.run.smithi117.stdout:Total 6.8 MB/s | 27 MB 00:03 2024-04-12T08:58:27.956 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-12T08:58:27.992 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-12T08:58:27.992 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-12T08:58:28.336 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-12T08:58:28.336 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-12T08:58:28.924 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-osd-2:17.2.7-827.gd3b5060a.el9.x86_64 30/33 2024-04-12T08:58:28.950 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-osd-2:17.2.7-827.gd3b5060a.el9.x86_64 30/33 2024-04-12T08:58:28.950 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T08:58:28.951 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-12T08:58:28.951 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-12T08:58:28.951 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-12T08:58:28.951 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:29.325 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mon-2:17.2.7-827.gd3b5060a.el9.x86_64 31/33 2024-04-12T08:58:29.348 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mon-2:17.2.7-827.gd3b5060a.el9.x86_64 31/33 2024-04-12T08:58:29.348 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T08:58:29.348 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-12T08:58:29.349 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-12T08:58:29.349 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-12T08:58:29.349 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:29.551 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mds-2:17.2.7-827.gd3b5060a.el9.x86_64 32/33 2024-04-12T08:58:29.574 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mds-2:17.2.7-827.gd3b5060a.el9.x86_64 32/33 2024-04-12T08:58:29.574 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T08:58:29.574 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-12T08:58:29.574 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-12T08:58:29.574 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-12T08:58:29.574 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:29.595 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-12T08:58:29.639 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-2:17.2.7-827.gd3b5060a.el9.x86_64 33/33 2024-04-12T08:58:29.648 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-04-12T08:58:29.680 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-04-12T08:58:29.713 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-04-12T08:58:29.803 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-04-12T08:58:29.875 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-04-12T08:58:29.920 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-04-12T08:58:29.951 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-04-12T08:58:29.981 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-04-12T08:58:30.016 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-04-12T08:58:30.049 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-04-12T08:58:30.089 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-04-12T08:58:30.124 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-04-12T08:58:30.159 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-04-12T08:58:30.201 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-04-12T08:58:30.277 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-04-12T08:58:30.414 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-04-12T08:58:30.495 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-04-12T08:58:30.549 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-04-12T08:58:30.588 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-04-12T08:58:30.638 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-04-12T08:58:30.693 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-04-12T08:58:30.885 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-04-12T08:58:30.926 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-04-12T08:58:31.005 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-04-12T08:58:31.100 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-04-12T08:58:31.137 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-04-12T08:58:31.257 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-04-12T08:58:31.320 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-2:17.2.7-827.gd3b5060a.el9.x86_64 33/33 2024-04-12T08:58:31.320 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-2:17.2.7-827.gd3b5060a.el9.x86_64 1/33 2024-04-12T08:58:31.320 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mds-2:17.2.7-827.gd3b5060a.el9.x86_64 2/33 2024-04-12T08:58:31.320 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-2:17.2.7-827.gd3b5060a.el9.x86_64 3/33 2024-04-12T08:58:31.320 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mon-2:17.2.7-827.gd3b5060a.el9.x86_64 4/33 2024-04-12T08:58:31.320 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-osd-2:17.2.7-827.gd3b5060a.el9.x86_64 5/33 2024-04-12T08:58:31.320 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-827.gd3b5060a.el9.n 6/33 2024-04-12T08:58:31.320 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-04-12T08:58:31.320 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-04-12T08:58:31.320 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-04-12T08:58:31.320 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-04-12T08:58:31.321 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-04-12T08:58:31.321 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-04-12T08:58:31.321 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-04-12T08:58:31.321 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-04-12T08:58:31.321 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-04-12T08:58:31.321 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-04-12T08:58:31.321 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-04-12T08:58:31.321 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-12T08:58:31.321 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-04-12T08:58:31.321 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-04-12T08:58:31.321 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-04-12T08:58:31.321 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-04-12T08:58:31.321 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-04-12T08:58:31.321 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-04-12T08:58:31.321 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-04-12T08:58:31.322 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-04-12T08:58:31.322 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-12T08:58:31.322 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-04-12T08:58:31.322 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-04-12T08:58:31.322 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-04-12T08:58:31.322 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-04-12T08:58:31.322 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-04-12T08:58:31.403 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-827.gd3b5060a.el9.n 28/33 2024-04-12T08:58:31.435 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-2:17.2.7-827.gd3b5060a.el9.x86_64 29/33 2024-04-12T08:58:31.460 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-2:17.2.7-827.gd3b5060a.el9.x86_64 29/33 2024-04-12T08:58:31.461 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T08:58:31.461 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-12T08:58:31.461 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-12T08:58:31.461 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-12T08:58:31.461 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:32.152 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-04-12T08:58:32.152 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:32.152 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-04-12T08:58:32.152 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:32.152 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mds-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:32.152 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:32.152 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-modules-core-2:17.2.7-827.gd3b5060a.el9.noarch 2024-04-12T08:58:32.152 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mon-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:32.152 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-osd-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:32.152 INFO:teuthology.orchestra.run.smithi203.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-12T08:58:32.153 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-12T08:58:32.153 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-12T08:58:32.153 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-12T08:58:32.153 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-12T08:58:32.153 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-12T08:58:32.153 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-12T08:58:32.153 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-12T08:58:32.153 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-12T08:58:32.153 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-12T08:58:32.153 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-12T08:58:32.153 INFO:teuthology.orchestra.run.smithi203.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-12T08:58:32.153 INFO:teuthology.orchestra.run.smithi203.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-12T08:58:32.153 INFO:teuthology.orchestra.run.smithi203.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-12T08:58:32.154 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-12T08:58:32.154 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ply-3.11-14.el9.noarch 2024-04-12T08:58:32.154 INFO:teuthology.orchestra.run.smithi203.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-12T08:58:32.154 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-12T08:58:32.154 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-12T08:58:32.154 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-12T08:58:32.154 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-12T08:58:32.154 INFO:teuthology.orchestra.run.smithi203.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-12T08:58:32.154 INFO:teuthology.orchestra.run.smithi203.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-12T08:58:32.154 INFO:teuthology.orchestra.run.smithi203.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-12T08:58:32.154 INFO:teuthology.orchestra.run.smithi203.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-12T08:58:32.154 INFO:teuthology.orchestra.run.smithi203.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-12T08:58:32.154 INFO:teuthology.orchestra.run.smithi203.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-12T08:58:32.155 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:32.155 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:58:32.484 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-base 2024-04-12T08:58:32.761 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-osd-2:17.2.7-827.gd3b5060a.el9.x86_64 30/33 2024-04-12T08:58:32.788 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-osd-2:17.2.7-827.gd3b5060a.el9.x86_64 30/33 2024-04-12T08:58:32.788 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T08:58:32.788 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-12T08:58:32.788 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-12T08:58:32.788 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-12T08:58:32.788 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:33.084 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:00:54 ago on Fri 12 Apr 2024 08:57:39 AM UTC. 2024-04-12T08:58:33.153 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mon-2:17.2.7-827.gd3b5060a.el9.x86_64 31/33 2024-04-12T08:58:33.177 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mon-2:17.2.7-827.gd3b5060a.el9.x86_64 31/33 2024-04-12T08:58:33.177 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T08:58:33.177 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-12T08:58:33.177 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-12T08:58:33.177 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-12T08:58:33.177 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:33.371 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:58:33.371 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:58:33.371 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:58:33.371 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.372 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:58:33.372 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.372 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:58:33.372 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.372 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:58:33.372 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.372 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:58:33.372 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.372 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:58:33.372 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.372 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:58:33.372 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.372 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:58:33.372 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.373 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:58:33.373 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.373 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:58:33.373 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.373 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:58:33.373 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.373 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:58:33.373 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.373 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:58:33.373 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.373 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:58:33.373 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.373 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:58:33.373 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.374 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:58:33.374 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.374 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:58:33.374 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.374 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:58:33.374 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.374 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:58:33.374 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.374 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:58:33.374 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.374 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:58:33.374 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.374 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:58:33.374 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.375 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:58:33.375 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.375 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:58:33.375 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.375 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:58:33.375 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.375 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:58:33.375 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.375 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:58:33.375 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.375 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:58:33.375 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.375 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:58:33.375 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.376 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:58:33.376 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.376 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:58:33.376 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.376 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:58:33.376 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.376 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:58:33.376 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.376 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:58:33.376 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.376 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:58:33.376 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.376 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:58:33.376 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.377 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:58:33.377 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.377 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.377 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.377 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:58:33.377 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.377 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.377 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.377 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.377 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:58:33.377 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.377 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.377 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.377 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.378 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.378 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.378 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:58:33.378 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.378 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.378 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.378 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.378 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:58:33.378 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.378 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.378 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.378 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.378 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:58:33.378 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.379 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.379 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.379 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.379 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:58:33.379 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.379 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.379 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.379 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.379 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:58:33.379 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.379 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.379 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.379 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.379 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:58:33.380 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.380 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.380 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.380 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:58:33.380 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mds-2:17.2.7-827.gd3b5060a.el9.x86_64 32/33 2024-04-12T08:58:33.380 INFO:teuthology.orchestra.run.smithi203.stdout:Package ceph-base-2:17.2.7-827.gd3b5060a.el9.x86_64 is already installed. 2024-04-12T08:58:33.402 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mds-2:17.2.7-827.gd3b5060a.el9.x86_64 32/33 2024-04-12T08:58:33.402 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T08:58:33.402 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-12T08:58:33.402 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-12T08:58:33.402 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-12T08:58:33.402 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:33.437 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:58:33.438 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-04-12T08:58:33.438 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:58:33.459 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-2:17.2.7-827.gd3b5060a.el9.x86_64 33/33 2024-04-12T08:58:33.527 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install cephadm 2024-04-12T08:58:34.136 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:00:55 ago on Fri 12 Apr 2024 08:57:39 AM UTC. 2024-04-12T08:58:34.422 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:58:34.422 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:58:34.422 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:58:34.422 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.422 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:58:34.422 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.422 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:58:34.422 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.422 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:58:34.422 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.422 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:58:34.423 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.423 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:58:34.423 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.423 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:58:34.423 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.423 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:58:34.423 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.423 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:58:34.423 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.423 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:58:34.423 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.423 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:58:34.423 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.423 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:58:34.424 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.424 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:58:34.424 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.424 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:58:34.424 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.424 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:58:34.424 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.424 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:58:34.424 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.424 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:58:34.424 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.424 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:58:34.424 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.424 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:58:34.425 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.425 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:58:34.425 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.425 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:58:34.425 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.425 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:58:34.425 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.425 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:58:34.425 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.425 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:58:34.425 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.425 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:58:34.425 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.425 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:58:34.426 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.426 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:58:34.426 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.426 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:58:34.426 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.426 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:58:34.426 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.426 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:58:34.426 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.426 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:58:34.426 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.426 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:58:34.426 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.426 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:58:34.427 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.427 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:58:34.427 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.427 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:58:34.427 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.427 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:58:34.427 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.427 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:58:34.427 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.427 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.427 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.427 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:58:34.427 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.427 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.428 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.428 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.428 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:58:34.428 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.428 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.428 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.428 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.428 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.428 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.428 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:58:34.428 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.428 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.428 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.428 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.429 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:58:34.429 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.429 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.429 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.429 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.429 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:58:34.429 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.429 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.429 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.429 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.429 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:58:34.429 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.429 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.429 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.430 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.430 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:58:34.430 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.430 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.430 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.430 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.430 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:58:34.430 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.430 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.430 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.430 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:58:34.488 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:58:34.488 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:58:34.489 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-04-12T08:58:34.489 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:58:34.489 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-04-12T08:58:34.489 INFO:teuthology.orchestra.run.smithi203.stdout: cephadm noarch 2:17.2.7-827.gd3b5060a.el9 ceph-noarch 82 k 2024-04-12T08:58:34.489 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:34.489 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-04-12T08:58:34.489 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:58:34.489 INFO:teuthology.orchestra.run.smithi203.stdout:Install 1 Package 2024-04-12T08:58:34.489 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:34.490 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 82 k 2024-04-12T08:58:34.490 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 372 k 2024-04-12T08:58:34.490 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-04-12T08:58:34.702 INFO:teuthology.orchestra.run.smithi203.stdout:cephadm-17.2.7-827.gd3b5060a.el9.noarch.rpm 386 kB/s | 82 kB 00:00 2024-04-12T08:58:34.703 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:58:34.703 INFO:teuthology.orchestra.run.smithi203.stdout:Total 384 kB/s | 82 kB 00:00 2024-04-12T08:58:34.703 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-04-12T08:58:34.708 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-04-12T08:58:34.708 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-04-12T08:58:34.710 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-04-12T08:58:34.710 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-04-12T08:58:34.777 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-04-12T08:58:34.995 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-2:17.2.7-827.gd3b5060a.el9.x86_64 33/33 2024-04-12T08:58:34.995 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-2:17.2.7-827.gd3b5060a.el9.x86_64 1/33 2024-04-12T08:58:34.996 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mds-2:17.2.7-827.gd3b5060a.el9.x86_64 2/33 2024-04-12T08:58:34.996 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-2:17.2.7-827.gd3b5060a.el9.x86_64 3/33 2024-04-12T08:58:34.996 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mon-2:17.2.7-827.gd3b5060a.el9.x86_64 4/33 2024-04-12T08:58:34.996 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-osd-2:17.2.7-827.gd3b5060a.el9.x86_64 5/33 2024-04-12T08:58:34.996 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-827.gd3b5060a.el9.n 6/33 2024-04-12T08:58:34.996 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-04-12T08:58:34.996 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-04-12T08:58:34.996 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-04-12T08:58:34.996 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-04-12T08:58:34.996 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-04-12T08:58:34.996 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-04-12T08:58:34.996 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-04-12T08:58:34.996 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-04-12T08:58:34.996 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-04-12T08:58:34.997 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-04-12T08:58:34.997 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-04-12T08:58:34.997 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-12T08:58:34.997 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-04-12T08:58:34.997 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-04-12T08:58:34.997 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-04-12T08:58:34.997 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-04-12T08:58:34.997 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-04-12T08:58:34.997 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-04-12T08:58:34.997 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-04-12T08:58:34.997 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-04-12T08:58:34.997 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-12T08:58:34.998 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-04-12T08:58:34.998 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-04-12T08:58:34.998 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-04-12T08:58:34.998 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-04-12T08:58:34.998 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-04-12T08:58:35.233 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: cephadm-2:17.2.7-827.gd3b5060a.el9.noarch 1/1 2024-04-12T08:58:35.324 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephadm-2:17.2.7-827.gd3b5060a.el9.noarch 1/1 2024-04-12T08:58:35.716 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: cephadm-2:17.2.7-827.gd3b5060a.el9.noarch 1/1 2024-04-12T08:58:35.901 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-04-12T08:58:35.901 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:35.901 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-12T08:58:35.901 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:35.901 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:35.901 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:35.901 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core-2:17.2.7-827.gd3b5060a.el9.noarch 2024-04-12T08:58:35.901 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:35.901 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:35.901 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-12T08:58:35.902 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-12T08:58:35.902 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-12T08:58:35.902 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-12T08:58:35.902 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-12T08:58:35.902 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-12T08:58:35.902 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-12T08:58:35.902 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-12T08:58:35.902 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-12T08:58:35.902 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-12T08:58:35.902 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-12T08:58:35.902 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-12T08:58:35.902 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-12T08:58:35.902 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-12T08:58:35.902 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-12T08:58:35.903 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply-3.11-14.el9.noarch 2024-04-12T08:58:35.903 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-12T08:58:35.903 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-12T08:58:35.903 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-12T08:58:35.903 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-12T08:58:35.903 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-12T08:58:35.903 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-12T08:58:35.903 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-12T08:58:35.903 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-12T08:58:35.903 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-12T08:58:35.903 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-12T08:58:35.903 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-12T08:58:35.903 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:35.903 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T08:58:36.012 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephadm-2:17.2.7-827.gd3b5060a.el9.noarch 1/1 2024-04-12T08:58:36.012 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:36.012 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-04-12T08:58:36.012 INFO:teuthology.orchestra.run.smithi203.stdout: cephadm-2:17.2.7-827.gd3b5060a.el9.noarch 2024-04-12T08:58:36.012 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:36.012 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:58:36.230 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-immutable-object-cache 2024-04-12T08:58:36.240 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-base 2024-04-12T08:58:36.837 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:00:55 ago on Fri 12 Apr 2024 08:57:41 AM UTC. 2024-04-12T08:58:36.840 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:00:57 ago on Fri 12 Apr 2024 08:57:39 AM UTC. 2024-04-12T08:58:37.126 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T08:58:37.126 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T08:58:37.126 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T08:58:37.126 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.126 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T08:58:37.126 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.126 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T08:58:37.126 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.127 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T08:58:37.127 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.127 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T08:58:37.127 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.127 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T08:58:37.127 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.127 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T08:58:37.127 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.127 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T08:58:37.127 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.127 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T08:58:37.127 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.127 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T08:58:37.127 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.128 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T08:58:37.128 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.128 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T08:58:37.128 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.128 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T08:58:37.128 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.128 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T08:58:37.128 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.128 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T08:58:37.128 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.128 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T08:58:37.128 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.128 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T08:58:37.128 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.128 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T08:58:37.129 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.129 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T08:58:37.129 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.129 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T08:58:37.129 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.129 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T08:58:37.129 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.129 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T08:58:37.129 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.129 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T08:58:37.129 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.129 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T08:58:37.129 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.129 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T08:58:37.130 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.130 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T08:58:37.130 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.130 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T08:58:37.130 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.130 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T08:58:37.130 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.130 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T08:58:37.130 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.130 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T08:58:37.130 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.130 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T08:58:37.130 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.130 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T08:58:37.130 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.131 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T08:58:37.131 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.131 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T08:58:37.131 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.131 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T08:58:37.131 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.131 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T08:58:37.131 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.131 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T08:58:37.131 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.131 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.131 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.131 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:58:37.131 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.132 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.132 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.132 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.132 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T08:58:37.132 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.132 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.132 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.132 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.132 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.132 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.132 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:58:37.132 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.132 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.132 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.132 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.133 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:58:37.133 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.133 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.133 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.133 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.133 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:58:37.133 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.133 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.133 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.133 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.133 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:58:37.133 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.133 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.133 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.133 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.134 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:58:37.134 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.134 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.134 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.134 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.134 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:58:37.134 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.134 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.134 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.134 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.134 INFO:teuthology.orchestra.run.smithi117.stdout:Package ceph-base-2:17.2.7-827.gd3b5060a.el9.x86_64 is already installed. 2024-04-12T08:58:37.136 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:58:37.136 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:58:37.136 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:58:37.136 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.136 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:58:37.136 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.136 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:58:37.136 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.137 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:58:37.137 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.137 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:58:37.137 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.137 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:58:37.137 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.137 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:58:37.137 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.137 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:58:37.137 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.137 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:58:37.137 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.137 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:58:37.137 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.137 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:58:37.137 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.137 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:58:37.138 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.138 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:58:37.138 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.138 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:58:37.138 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.138 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:58:37.138 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.138 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:58:37.138 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.138 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:58:37.138 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.138 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:58:37.138 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.138 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:58:37.139 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.139 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:58:37.139 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.139 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:58:37.139 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.139 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:58:37.139 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.139 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:58:37.139 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.139 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:58:37.139 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.139 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:58:37.139 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.139 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:58:37.139 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.140 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:58:37.140 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.140 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:58:37.140 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.140 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:58:37.140 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.140 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:58:37.140 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.140 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:58:37.140 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.140 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:58:37.140 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.140 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:58:37.140 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.141 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:58:37.141 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.141 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:58:37.141 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.141 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:58:37.141 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.141 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:58:37.141 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.141 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.141 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.141 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:58:37.141 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.141 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.142 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.142 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.142 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:58:37.142 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.142 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.142 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.142 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.142 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.142 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.142 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:58:37.142 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.142 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.142 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.143 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.143 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:58:37.143 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.143 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.143 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.143 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.143 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:58:37.143 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.143 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.143 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.143 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.143 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:58:37.143 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.143 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.144 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.144 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.144 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:58:37.144 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.144 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.144 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.144 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.144 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:58:37.144 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.144 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.144 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.144 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:58:37.195 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T08:58:37.196 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-04-12T08:58:37.196 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T08:58:37.205 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:58:37.205 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:58:37.206 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repo Size 2024-04-12T08:58:37.206 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:58:37.206 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-04-12T08:58:37.206 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 137 k 2024-04-12T08:58:37.206 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:37.206 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-04-12T08:58:37.206 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:58:37.206 INFO:teuthology.orchestra.run.smithi203.stdout:Install 1 Package 2024-04-12T08:58:37.206 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:37.206 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 137 k 2024-04-12T08:58:37.206 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 379 k 2024-04-12T08:58:37.206 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-04-12T08:58:37.269 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install cephadm 2024-04-12T08:58:37.402 INFO:teuthology.orchestra.run.smithi203.stdout:ceph-immutable-object-cache-17.2.7-827.gd3b5060 705 kB/s | 137 kB 00:00 2024-04-12T08:58:37.402 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:58:37.403 INFO:teuthology.orchestra.run.smithi203.stdout:Total 698 kB/s | 137 kB 00:00 2024-04-12T08:58:37.403 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-04-12T08:58:37.410 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-04-12T08:58:37.410 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-04-12T08:58:37.462 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-04-12T08:58:37.463 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-04-12T08:58:37.611 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-04-12T08:58:37.678 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-827.gd3b5060a.e 1/1 2024-04-12T08:58:37.702 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-827.gd3b5060a.e 1/1 2024-04-12T08:58:37.702 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T08:58:37.702 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-12T08:58:37.702 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:37.857 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:00:56 ago on Fri 12 Apr 2024 08:57:41 AM UTC. 2024-04-12T08:58:38.144 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T08:58:38.145 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T08:58:38.145 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T08:58:38.145 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.145 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T08:58:38.145 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.145 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T08:58:38.145 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.145 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T08:58:38.145 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.145 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T08:58:38.145 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.145 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T08:58:38.145 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.145 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T08:58:38.146 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.146 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T08:58:38.146 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.146 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T08:58:38.146 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.146 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T08:58:38.146 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.146 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T08:58:38.146 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.146 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T08:58:38.146 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.146 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T08:58:38.146 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.147 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T08:58:38.147 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.147 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T08:58:38.147 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.147 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T08:58:38.147 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.147 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T08:58:38.147 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.147 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T08:58:38.147 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.147 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T08:58:38.147 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.147 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T08:58:38.147 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.147 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T08:58:38.148 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.148 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T08:58:38.148 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.148 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T08:58:38.148 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.148 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T08:58:38.148 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.148 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T08:58:38.148 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.148 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T08:58:38.148 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.148 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T08:58:38.148 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.148 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T08:58:38.148 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.149 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T08:58:38.149 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.149 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T08:58:38.149 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.149 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T08:58:38.149 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.149 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T08:58:38.149 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.149 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T08:58:38.149 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.149 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T08:58:38.149 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.149 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T08:58:38.149 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.149 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T08:58:38.150 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.150 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T08:58:38.150 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.150 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.150 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.150 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:58:38.150 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.150 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.150 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.150 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.150 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T08:58:38.150 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.150 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.150 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.151 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.151 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.151 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.151 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:58:38.151 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.151 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.151 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.151 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.151 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:58:38.151 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.151 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.151 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.151 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.151 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:58:38.152 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.152 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.152 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.152 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.152 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:58:38.152 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.152 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.152 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.152 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.152 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:58:38.152 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.152 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.152 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.152 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.153 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:58:38.153 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.153 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.153 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.153 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:58:38.212 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T08:58:38.213 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:58:38.213 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-04-12T08:58:38.213 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:58:38.213 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-12T08:58:38.213 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm noarch 2:17.2.7-827.gd3b5060a.el9 ceph-noarch 82 k 2024-04-12T08:58:38.213 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:38.213 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-12T08:58:38.214 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:58:38.214 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-04-12T08:58:38.214 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:38.214 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 82 k 2024-04-12T08:58:38.214 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 372 k 2024-04-12T08:58:38.214 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-12T08:58:38.403 INFO:teuthology.orchestra.run.smithi117.stdout:cephadm-17.2.7-827.gd3b5060a.el9.noarch.rpm 435 kB/s | 82 kB 00:00 2024-04-12T08:58:38.403 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:58:38.404 INFO:teuthology.orchestra.run.smithi117.stdout:Total 431 kB/s | 82 kB 00:00 2024-04-12T08:58:38.404 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-12T08:58:38.409 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-12T08:58:38.409 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-12T08:58:38.411 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-12T08:58:38.411 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-12T08:58:38.488 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-12T08:58:38.687 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-827.gd3b5060a.e 1/1 2024-04-12T08:58:38.687 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:38.687 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-04-12T08:58:38.687 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-immutable-object-cache-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:38.687 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:38.687 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:58:38.908 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:17.2.7-827.gd3b5060a.el9.noarch 1/1 2024-04-12T08:58:38.938 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-mgr 2024-04-12T08:58:39.000 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephadm-2:17.2.7-827.gd3b5060a.el9.noarch 1/1 2024-04-12T08:58:39.374 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:17.2.7-827.gd3b5060a.el9.noarch 1/1 2024-04-12T08:58:39.545 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:00 ago on Fri 12 Apr 2024 08:57:39 AM UTC. 2024-04-12T08:58:39.719 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephadm-2:17.2.7-827.gd3b5060a.el9.noarch 1/1 2024-04-12T08:58:39.719 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:39.719 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-12T08:58:39.719 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm-2:17.2.7-827.gd3b5060a.el9.noarch 2024-04-12T08:58:39.720 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:39.720 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T08:58:39.832 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:58:39.832 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:58:39.832 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:58:39.832 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.832 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:58:39.833 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.833 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:58:39.833 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.833 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:58:39.833 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.833 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:58:39.833 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.833 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:58:39.833 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.833 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:58:39.833 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.833 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:58:39.833 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.834 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:58:39.834 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.834 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:58:39.834 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.834 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:58:39.834 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.834 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:58:39.834 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.834 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:58:39.834 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.834 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:58:39.834 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.834 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:58:39.834 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.834 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:58:39.835 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.835 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:58:39.835 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.835 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:58:39.835 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.835 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:58:39.835 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.835 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:58:39.835 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.835 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:58:39.835 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.835 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:58:39.835 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.835 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:58:39.836 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.836 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:58:39.836 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.836 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:58:39.836 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.836 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:58:39.836 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.836 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:58:39.836 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.836 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:58:39.836 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.836 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:58:39.836 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.836 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:58:39.837 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.837 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:58:39.837 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.837 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:58:39.837 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.837 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:58:39.837 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.837 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:58:39.837 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.837 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:58:39.837 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.837 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:58:39.837 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.837 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:58:39.837 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.838 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.838 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.838 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:58:39.838 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.838 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.838 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.838 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.838 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:58:39.838 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.838 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.838 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.838 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.838 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.838 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.839 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:58:39.839 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.839 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.839 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.839 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.839 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:58:39.839 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.839 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.839 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.839 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.839 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:58:39.839 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.839 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.839 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.839 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.840 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:58:39.840 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.840 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.840 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.840 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.840 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:58:39.840 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.840 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.840 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.840 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.840 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:58:39.840 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.840 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.840 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.841 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:58:39.841 INFO:teuthology.orchestra.run.smithi203.stdout:Package ceph-mgr-2:17.2.7-827.gd3b5060a.el9.x86_64 is already installed. 2024-04-12T08:58:39.899 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:58:39.900 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-04-12T08:58:39.900 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:58:39.947 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-immutable-object-cache 2024-04-12T08:58:39.985 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-mgr-dashboard 2024-04-12T08:58:40.556 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:00:59 ago on Fri 12 Apr 2024 08:57:41 AM UTC. 2024-04-12T08:58:40.574 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:01 ago on Fri 12 Apr 2024 08:57:39 AM UTC. 2024-04-12T08:58:40.847 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T08:58:40.847 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T08:58:40.847 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T08:58:40.848 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.848 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T08:58:40.848 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.848 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T08:58:40.848 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.848 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T08:58:40.848 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.848 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T08:58:40.848 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.848 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T08:58:40.848 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.848 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T08:58:40.848 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.849 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T08:58:40.849 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.849 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T08:58:40.849 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.849 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T08:58:40.849 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.849 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T08:58:40.849 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.849 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T08:58:40.849 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.849 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T08:58:40.849 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.849 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T08:58:40.850 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.850 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T08:58:40.850 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.850 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T08:58:40.850 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.850 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T08:58:40.850 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.850 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T08:58:40.850 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.850 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T08:58:40.850 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.850 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T08:58:40.850 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.851 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T08:58:40.851 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.851 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T08:58:40.851 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.851 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T08:58:40.851 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.851 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T08:58:40.851 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.851 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T08:58:40.851 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.851 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T08:58:40.851 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.851 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T08:58:40.852 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.852 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T08:58:40.852 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.852 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T08:58:40.852 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.852 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T08:58:40.852 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.852 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T08:58:40.852 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.852 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T08:58:40.852 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.852 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T08:58:40.852 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.852 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T08:58:40.853 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.853 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T08:58:40.853 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.853 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T08:58:40.853 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.853 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T08:58:40.853 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.853 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.853 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.853 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:58:40.853 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.853 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.853 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.854 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.854 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T08:58:40.854 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.854 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.854 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.854 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.854 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.854 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.854 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:58:40.854 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.854 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.854 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.855 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.855 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:58:40.855 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.855 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.855 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.855 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.855 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:58:40.855 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.855 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.855 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.855 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.855 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:58:40.855 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.856 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.856 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.856 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.856 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:58:40.856 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.856 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.856 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.856 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.856 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:58:40.856 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.856 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.856 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.856 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.862 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:58:40.862 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:58:40.862 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:58:40.862 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.862 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:58:40.862 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.863 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:58:40.863 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.863 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:58:40.863 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.863 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:58:40.863 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.863 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:58:40.863 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.863 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:58:40.863 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.863 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:58:40.863 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.863 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:58:40.864 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.864 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:58:40.864 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.864 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:58:40.864 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.864 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:58:40.864 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.864 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:58:40.864 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.864 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:58:40.864 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.864 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:58:40.864 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.864 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:58:40.864 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.865 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:58:40.865 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.865 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:58:40.865 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.865 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:58:40.865 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.865 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:58:40.865 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.865 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:58:40.865 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.865 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:58:40.865 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.865 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:58:40.866 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.866 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:58:40.866 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.866 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:58:40.866 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.866 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:58:40.866 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.866 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:58:40.866 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.866 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:58:40.866 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.866 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:58:40.866 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.867 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:58:40.867 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.867 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:58:40.867 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.867 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:58:40.867 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.867 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:58:40.867 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.867 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:58:40.867 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.867 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:58:40.867 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.867 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:58:40.868 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.868 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:58:40.868 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.868 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.868 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.868 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:58:40.868 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.868 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.868 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.868 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.868 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:58:40.868 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.868 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.868 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.869 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.869 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.869 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.869 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:58:40.869 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.869 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.869 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.869 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.869 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:58:40.869 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.869 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.869 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.869 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.869 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:58:40.870 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.870 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.870 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.870 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.870 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:58:40.870 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.870 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.870 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.870 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.870 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:58:40.870 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.870 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.870 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.871 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.871 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:58:40.871 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.871 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.871 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.871 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:58:40.915 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T08:58:40.915 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:58:40.915 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repo Size 2024-04-12T08:58:40.915 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:58:40.915 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-12T08:58:40.916 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 137 k 2024-04-12T08:58:40.916 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:40.916 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-12T08:58:40.916 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:58:40.916 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-04-12T08:58:40.916 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:40.916 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 137 k 2024-04-12T08:58:40.917 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 379 k 2024-04-12T08:58:40.917 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-12T08:58:40.930 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:58:40.931 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:58:40.931 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-04-12T08:58:40.931 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:58:40.932 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-04-12T08:58:40.932 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-dashboard noarch 2:17.2.7-827.gd3b5060a.el9 ceph-noarch 1.7 M 2024-04-12T08:58:40.932 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-04-12T08:58:40.932 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-grafana-dashboards noarch 2:17.2.7-827.gd3b5060a.el9 ceph-noarch 24 k 2024-04-12T08:58:40.932 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-prometheus-alerts noarch 2:17.2.7-827.gd3b5060a.el9 ceph-noarch 15 k 2024-04-12T08:58:40.932 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-04-12T08:58:40.932 INFO:teuthology.orchestra.run.smithi203.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-12T08:58:40.932 INFO:teuthology.orchestra.run.smithi203.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-12T08:58:40.932 INFO:teuthology.orchestra.run.smithi203.stdout:Installing weak dependencies: 2024-04-12T08:58:40.932 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-04-12T08:58:40.932 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:40.932 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-04-12T08:58:40.932 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:58:40.933 INFO:teuthology.orchestra.run.smithi203.stdout:Install 7 Packages 2024-04-12T08:58:40.933 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:40.933 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 2.0 M 2024-04-12T08:58:40.933 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 8.1 M 2024-04-12T08:58:40.933 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-04-12T08:58:41.227 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-immutable-object-cache-17.2.7-827.gd3b5060 443 kB/s | 137 kB 00:00 2024-04-12T08:58:41.227 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:58:41.227 INFO:teuthology.orchestra.run.smithi117.stdout:Total 442 kB/s | 137 kB 00:00 2024-04-12T08:58:41.227 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-12T08:58:41.235 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-12T08:58:41.235 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-12T08:58:41.287 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-12T08:58:41.287 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-12T08:58:41.307 INFO:teuthology.orchestra.run.smithi203.stdout:(1/7): ceph-grafana-dashboards-17.2.7-827.gd3b5 132 kB/s | 24 kB 00:00 2024-04-12T08:58:41.333 INFO:teuthology.orchestra.run.smithi203.stdout:(2/7): ceph-prometheus-alerts-17.2.7-827.gd3b50 69 kB/s | 15 kB 00:00 2024-04-12T08:58:41.429 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-12T08:58:41.494 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-827.gd3b5060a.e 1/1 2024-04-12T08:58:41.519 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-827.gd3b5060a.e 1/1 2024-04-12T08:58:41.519 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T08:58:41.519 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-12T08:58:41.520 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:41.616 INFO:teuthology.orchestra.run.smithi203.stdout:(3/7): ceph-mgr-dashboard-17.2.7-827.gd3b5060a. 3.4 MB/s | 1.7 MB 00:00 2024-04-12T08:58:41.642 INFO:teuthology.orchestra.run.smithi203.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 27 kB/s | 9.0 kB 00:00 2024-04-12T08:58:41.792 INFO:teuthology.orchestra.run.smithi203.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 89 kB/s | 41 kB 00:00 2024-04-12T08:58:41.851 INFO:teuthology.orchestra.run.smithi203.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 131 kB/s | 31 kB 00:00 2024-04-12T08:58:41.943 INFO:teuthology.orchestra.run.smithi203.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 627 kB/s | 188 kB 00:00 2024-04-12T08:58:41.944 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:58:41.945 INFO:teuthology.orchestra.run.smithi203.stdout:Total 2.0 MB/s | 2.0 MB 00:01 2024-04-12T08:58:41.945 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-04-12T08:58:41.953 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-04-12T08:58:41.953 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-04-12T08:58:42.019 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-04-12T08:58:42.019 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-04-12T08:58:42.339 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-04-12T08:58:42.402 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-04-12T08:58:42.436 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-04-12T08:58:42.491 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-04-12T08:58:42.523 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-04-12T08:58:42.527 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-827.gd3b5060a.e 1/1 2024-04-12T08:58:42.527 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:42.527 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-12T08:58:42.527 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:58:42.527 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:42.528 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T08:58:42.552 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-827.gd3b5060a.el9.no 5/7 2024-04-12T08:58:42.779 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-827.gd3b5060a.el9.n 6/7 2024-04-12T08:58:42.787 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr 2024-04-12T08:58:42.805 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-827.gd3b5060a.el9.noarch 7/7 2024-04-12T08:58:43.347 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-827.gd3b5060a.el9.noarch 7/7 2024-04-12T08:58:43.347 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-827.gd3b5060a.el9.n 1/7 2024-04-12T08:58:43.347 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-827.gd3b5060a.el9.noarch 2/7 2024-04-12T08:58:43.347 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-827.gd3b5060a.el9.no 3/7 2024-04-12T08:58:43.347 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-04-12T08:58:43.347 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-04-12T08:58:43.348 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-04-12T08:58:43.386 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:02 ago on Fri 12 Apr 2024 08:57:41 AM UTC. 2024-04-12T08:58:43.678 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-04-12T08:58:43.678 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:43.678 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-04-12T08:58:43.678 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-grafana-dashboards-2:17.2.7-827.gd3b5060a.el9.noarch 2024-04-12T08:58:43.678 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-dashboard-2:17.2.7-827.gd3b5060a.el9.noarch 2024-04-12T08:58:43.679 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-prometheus-alerts-2:17.2.7-827.gd3b5060a.el9.noarch 2024-04-12T08:58:43.679 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-04-12T08:58:43.679 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-04-12T08:58:43.679 INFO:teuthology.orchestra.run.smithi203.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-12T08:58:43.679 INFO:teuthology.orchestra.run.smithi203.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-12T08:58:43.679 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:43.679 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:58:43.684 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T08:58:43.684 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T08:58:43.685 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T08:58:43.685 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.685 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T08:58:43.685 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.685 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T08:58:43.685 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.685 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T08:58:43.685 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.685 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T08:58:43.685 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.685 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T08:58:43.685 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.685 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T08:58:43.686 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.686 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T08:58:43.686 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.686 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T08:58:43.686 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.686 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T08:58:43.686 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.686 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T08:58:43.686 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.686 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T08:58:43.686 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.686 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T08:58:43.686 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.686 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T08:58:43.687 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.687 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T08:58:43.687 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.687 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T08:58:43.687 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.687 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T08:58:43.687 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.687 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T08:58:43.687 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.687 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T08:58:43.687 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.687 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T08:58:43.687 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.688 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T08:58:43.688 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.688 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T08:58:43.688 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.688 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T08:58:43.688 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.688 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T08:58:43.688 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.688 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T08:58:43.688 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.688 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T08:58:43.688 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.688 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T08:58:43.688 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.688 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T08:58:43.689 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.689 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T08:58:43.689 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.689 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T08:58:43.689 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.689 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T08:58:43.689 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.689 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T08:58:43.689 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.689 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T08:58:43.689 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.689 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T08:58:43.689 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.689 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T08:58:43.689 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.690 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T08:58:43.690 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.690 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T08:58:43.690 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.690 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.690 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.690 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:58:43.690 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.690 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.690 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.690 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.690 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T08:58:43.690 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.690 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.691 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.691 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.691 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.691 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.691 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:58:43.691 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.691 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.691 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.691 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.691 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:58:43.691 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.691 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.691 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.691 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.691 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:58:43.692 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.692 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.692 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.692 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.692 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:58:43.692 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.692 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.692 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.692 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.692 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:58:43.692 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.692 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.692 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.692 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.693 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:58:43.693 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.693 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.693 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.693 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:58:43.693 INFO:teuthology.orchestra.run.smithi117.stdout:Package ceph-mgr-2:17.2.7-827.gd3b5060a.el9.x86_64 is already installed. 2024-04-12T08:58:43.751 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T08:58:43.752 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-04-12T08:58:43.752 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T08:58:43.835 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr-dashboard 2024-04-12T08:58:43.936 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-12T08:58:44.421 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:03 ago on Fri 12 Apr 2024 08:57:41 AM UTC. 2024-04-12T08:58:44.527 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:05 ago on Fri 12 Apr 2024 08:57:39 AM UTC. 2024-04-12T08:58:44.713 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T08:58:44.714 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T08:58:44.714 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T08:58:44.714 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.714 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T08:58:44.714 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.714 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T08:58:44.714 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.714 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T08:58:44.714 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.714 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T08:58:44.714 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.714 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T08:58:44.715 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.715 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T08:58:44.715 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.715 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T08:58:44.715 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.715 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T08:58:44.715 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.715 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T08:58:44.715 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.715 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T08:58:44.715 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.715 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T08:58:44.715 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.716 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T08:58:44.716 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.716 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T08:58:44.716 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.716 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T08:58:44.716 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.716 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T08:58:44.716 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.716 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T08:58:44.716 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.716 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T08:58:44.716 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.716 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T08:58:44.716 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.717 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T08:58:44.717 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.717 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T08:58:44.717 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.717 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T08:58:44.717 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.717 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T08:58:44.717 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.717 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T08:58:44.717 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.717 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T08:58:44.717 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.717 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T08:58:44.717 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.718 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T08:58:44.718 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.718 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T08:58:44.718 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.718 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T08:58:44.718 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.718 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T08:58:44.718 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.718 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T08:58:44.718 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.718 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T08:58:44.719 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.719 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T08:58:44.719 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.719 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T08:58:44.719 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.719 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T08:58:44.719 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.719 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T08:58:44.719 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.719 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T08:58:44.719 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.719 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.719 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.720 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:58:44.720 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.720 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.720 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.720 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.720 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T08:58:44.720 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.720 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.720 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.720 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.720 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.720 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.720 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:58:44.720 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.720 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.721 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.721 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.721 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:58:44.721 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.721 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.721 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.721 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.721 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:58:44.721 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.721 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.721 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.721 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.721 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:58:44.721 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.722 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.722 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.722 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.722 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:58:44.722 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.722 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.722 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.722 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.722 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:58:44.723 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.723 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.723 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.723 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.783 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T08:58:44.784 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:58:44.784 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-04-12T08:58:44.784 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:58:44.784 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-12T08:58:44.784 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard noarch 2:17.2.7-827.gd3b5060a.el9 ceph-noarch 1.7 M 2024-04-12T08:58:44.784 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-04-12T08:58:44.785 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards noarch 2:17.2.7-827.gd3b5060a.el9 ceph-noarch 24 k 2024-04-12T08:58:44.785 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts noarch 2:17.2.7-827.gd3b5060a.el9 ceph-noarch 15 k 2024-04-12T08:58:44.785 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-04-12T08:58:44.785 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-12T08:58:44.785 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-12T08:58:44.785 INFO:teuthology.orchestra.run.smithi117.stdout:Installing weak dependencies: 2024-04-12T08:58:44.785 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-04-12T08:58:44.785 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:44.785 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-12T08:58:44.785 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:58:44.785 INFO:teuthology.orchestra.run.smithi117.stdout:Install 7 Packages 2024-04-12T08:58:44.785 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:44.786 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 2.0 M 2024-04-12T08:58:44.786 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 8.1 M 2024-04-12T08:58:44.786 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-12T08:58:44.819 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:58:44.819 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:58:44.820 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:58:44.820 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.820 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:58:44.820 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.820 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:58:44.820 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.820 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:58:44.820 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.820 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:58:44.820 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.820 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:58:44.820 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.820 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:58:44.821 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.821 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:58:44.821 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.821 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:58:44.821 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.821 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:58:44.821 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.821 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:58:44.821 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.821 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:58:44.821 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.821 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:58:44.821 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.821 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:58:44.821 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.822 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:58:44.822 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.822 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:58:44.822 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.822 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:58:44.822 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.822 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:58:44.822 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.822 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:58:44.822 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.822 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:58:44.822 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.822 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:58:44.823 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.823 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:58:44.823 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.823 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:58:44.823 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.823 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:58:44.823 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.823 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:58:44.823 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.823 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:58:44.823 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.823 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:58:44.823 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.823 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:58:44.824 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.824 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:58:44.824 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.824 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:58:44.824 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.824 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:58:44.824 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.824 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:58:44.824 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.824 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:58:44.824 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.824 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:58:44.824 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.825 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:58:44.825 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.825 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:58:44.825 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.825 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:58:44.825 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.825 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.825 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.825 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:58:44.825 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.825 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.825 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.826 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.826 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:58:44.826 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.826 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.826 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.826 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.826 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.826 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.826 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:58:44.826 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.826 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.826 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.826 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.827 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:58:44.827 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.827 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.827 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.827 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.827 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:58:44.827 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.827 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.827 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.827 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.827 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:58:44.827 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.828 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.828 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.828 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.828 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:58:44.828 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.828 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.828 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.828 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.828 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:58:44.828 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.828 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.828 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.828 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:58:44.890 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:58:44.891 INFO:teuthology.orchestra.run.smithi203.stdout:====================================================================================== 2024-04-12T08:58:44.891 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-04-12T08:58:44.891 INFO:teuthology.orchestra.run.smithi203.stdout:====================================================================================== 2024-04-12T08:58:44.891 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-04-12T08:58:44.891 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-827.gd3b5060a.el9 ceph-noarch 7.4 M 2024-04-12T08:58:44.892 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-04-12T08:58:44.892 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-12T08:58:44.892 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-12T08:58:44.892 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-12T08:58:44.892 INFO:teuthology.orchestra.run.smithi203.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-12T08:58:44.892 INFO:teuthology.orchestra.run.smithi203.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-12T08:58:44.892 INFO:teuthology.orchestra.run.smithi203.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-12T08:58:44.892 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-12T08:58:44.892 INFO:teuthology.orchestra.run.smithi203.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-12T08:58:44.892 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-12T08:58:44.892 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-12T08:58:44.892 INFO:teuthology.orchestra.run.smithi203.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-12T08:58:44.892 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:44.892 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-04-12T08:58:44.892 INFO:teuthology.orchestra.run.smithi203.stdout:====================================================================================== 2024-04-12T08:58:44.893 INFO:teuthology.orchestra.run.smithi203.stdout:Install 12 Packages 2024-04-12T08:58:44.893 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:58:44.893 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 38 M 2024-04-12T08:58:44.893 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 209 M 2024-04-12T08:58:44.893 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-04-12T08:58:45.309 INFO:teuthology.orchestra.run.smithi203.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-04-12T08:58:45.342 INFO:teuthology.orchestra.run.smithi203.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.7 MB/s | 803 kB 00:00 2024-04-12T08:58:45.481 INFO:teuthology.orchestra.run.smithi117.stdout:(1/7): ceph-grafana-dashboards-17.2.7-827.gd3b5 69 kB/s | 24 kB 00:00 2024-04-12T08:58:45.514 INFO:teuthology.orchestra.run.smithi117.stdout:(2/7): ceph-prometheus-alerts-17.2.7-827.gd3b50 38 kB/s | 15 kB 00:00 2024-04-12T08:58:45.559 INFO:teuthology.orchestra.run.smithi203.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 131 kB/s | 33 kB 00:00 2024-04-12T08:58:45.659 INFO:teuthology.orchestra.run.smithi203.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 182 kB/s | 18 kB 00:00 2024-04-12T08:58:45.739 INFO:teuthology.orchestra.run.smithi117.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 35 kB/s | 9.0 kB 00:00 2024-04-12T08:58:45.785 INFO:teuthology.orchestra.run.smithi203.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 288 kB/s | 35 kB 00:00 2024-04-12T08:58:45.973 INFO:teuthology.orchestra.run.smithi117.stdout:(4/7): ceph-mgr-dashboard-17.2.7-827.gd3b5060a. 2.0 MB/s | 1.7 MB 00:00 2024-04-12T08:58:45.998 INFO:teuthology.orchestra.run.smithi117.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 119 kB/s | 31 kB 00:00 2024-04-12T08:58:46.015 INFO:teuthology.orchestra.run.smithi117.stdout:(6/7): python3-jwt-2.4.0-1.el9.noarch.rpm 82 kB/s | 41 kB 00:00 2024-04-12T08:58:47.394 INFO:teuthology.orchestra.run.smithi203.stdout:(6/12): ceph-mgr-diskprediction-local-17.2.7-82 3.3 MB/s | 7.4 MB 00:02 2024-04-12T08:58:47.619 INFO:teuthology.orchestra.run.smithi203.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 1.3 MB/s | 3.0 MB 00:02 2024-04-12T08:58:47.727 INFO:teuthology.orchestra.run.smithi203.stdout:(8/12): python3-devel-3.9.17-2.el9.x86_64.rpm 736 kB/s | 245 kB 00:00 2024-04-12T08:58:47.819 INFO:teuthology.orchestra.run.smithi203.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.7 MB/s | 250 kB 00:00 2024-04-12T08:58:47.895 INFO:teuthology.orchestra.run.smithi203.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 2.2 MB/s | 4.7 MB 00:02 2024-04-12T08:58:48.323 INFO:teuthology.orchestra.run.smithi117.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 80 kB/s | 188 kB 00:02 2024-04-12T08:58:48.326 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:58:48.326 INFO:teuthology.orchestra.run.smithi117.stdout:Total 577 kB/s | 2.0 MB 00:03 2024-04-12T08:58:48.327 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-12T08:58:48.336 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-12T08:58:48.336 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-12T08:58:48.406 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-12T08:58:48.407 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-12T08:58:48.700 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-12T08:58:48.775 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-04-12T08:58:48.809 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-04-12T08:58:48.856 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-04-12T08:58:48.895 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-04-12T08:58:48.933 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-827.gd3b5060a.el9.no 5/7 2024-04-12T08:58:49.162 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-827.gd3b5060a.el9.n 6/7 2024-04-12T08:58:49.194 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-827.gd3b5060a.el9.noarch 7/7 2024-04-12T08:58:49.697 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-827.gd3b5060a.el9.noarch 7/7 2024-04-12T08:58:49.697 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-827.gd3b5060a.el9.n 1/7 2024-04-12T08:58:49.697 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-827.gd3b5060a.el9.noarch 2/7 2024-04-12T08:58:49.697 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-827.gd3b5060a.el9.no 3/7 2024-04-12T08:58:49.697 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-04-12T08:58:49.697 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-04-12T08:58:49.697 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-04-12T08:58:50.011 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-04-12T08:58:50.011 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:50.011 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-12T08:58:50.011 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards-2:17.2.7-827.gd3b5060a.el9.noarch 2024-04-12T08:58:50.011 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard-2:17.2.7-827.gd3b5060a.el9.noarch 2024-04-12T08:58:50.011 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts-2:17.2.7-827.gd3b5060a.el9.noarch 2024-04-12T08:58:50.011 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-04-12T08:58:50.012 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-04-12T08:58:50.012 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-12T08:58:50.012 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-12T08:58:50.012 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:50.012 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T08:58:50.215 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-12T08:58:50.806 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:09 ago on Fri 12 Apr 2024 08:57:41 AM UTC. 2024-04-12T08:58:51.102 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T08:58:51.102 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T08:58:51.102 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T08:58:51.102 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.102 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T08:58:51.102 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.102 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T08:58:51.102 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.102 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T08:58:51.103 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.103 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T08:58:51.103 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.103 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T08:58:51.103 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.103 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T08:58:51.103 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.103 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T08:58:51.103 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.103 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T08:58:51.103 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.103 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T08:58:51.103 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.103 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T08:58:51.103 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.104 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T08:58:51.104 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.104 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T08:58:51.104 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.104 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T08:58:51.104 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.104 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T08:58:51.104 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.104 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T08:58:51.104 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.104 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T08:58:51.104 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.104 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T08:58:51.104 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.105 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T08:58:51.105 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.105 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T08:58:51.105 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.105 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T08:58:51.105 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.105 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T08:58:51.105 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.105 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T08:58:51.105 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.105 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T08:58:51.105 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.105 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T08:58:51.105 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.105 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T08:58:51.106 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.106 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T08:58:51.106 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.106 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T08:58:51.106 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.106 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T08:58:51.106 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.106 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T08:58:51.106 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.106 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T08:58:51.106 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.106 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T08:58:51.106 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.106 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T08:58:51.107 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.107 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T08:58:51.107 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.107 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T08:58:51.107 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.107 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T08:58:51.107 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.107 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T08:58:51.107 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.107 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.107 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.107 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:58:51.107 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.107 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.107 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.108 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.108 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T08:58:51.108 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.108 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.108 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.108 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.108 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.108 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.108 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:58:51.108 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.108 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.108 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.108 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.108 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:58:51.109 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.109 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.109 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.109 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.109 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:58:51.109 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.109 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.109 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.109 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.109 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:58:51.109 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.109 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.109 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.109 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.109 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:58:51.109 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.110 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.110 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.110 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.110 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:58:51.110 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.110 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.110 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.110 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:58:51.171 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T08:58:51.172 INFO:teuthology.orchestra.run.smithi117.stdout:====================================================================================== 2024-04-12T08:58:51.172 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-04-12T08:58:51.172 INFO:teuthology.orchestra.run.smithi117.stdout:====================================================================================== 2024-04-12T08:58:51.172 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-12T08:58:51.172 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-827.gd3b5060a.el9 ceph-noarch 7.4 M 2024-04-12T08:58:51.172 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-04-12T08:58:51.172 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-12T08:58:51.173 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-12T08:58:51.173 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-12T08:58:51.173 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-12T08:58:51.173 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-12T08:58:51.173 INFO:teuthology.orchestra.run.smithi117.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-12T08:58:51.173 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-12T08:58:51.173 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-12T08:58:51.173 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-12T08:58:51.173 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-12T08:58:51.173 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-12T08:58:51.173 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:51.173 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-12T08:58:51.173 INFO:teuthology.orchestra.run.smithi117.stdout:====================================================================================== 2024-04-12T08:58:51.173 INFO:teuthology.orchestra.run.smithi117.stdout:Install 12 Packages 2024-04-12T08:58:51.174 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:58:51.174 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 38 M 2024-04-12T08:58:51.174 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 209 M 2024-04-12T08:58:51.174 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-12T08:58:52.022 INFO:teuthology.orchestra.run.smithi117.stdout:(1/12): ceph-mgr-diskprediction-local-17.2.7-82 13 MB/s | 7.4 MB 00:00 2024-04-12T08:58:52.055 INFO:teuthology.orchestra.run.smithi117.stdout:(2/12): libquadmath-11.4.1-3.el9.x86_64.rpm 323 kB/s | 195 kB 00:00 2024-04-12T08:58:52.314 INFO:teuthology.orchestra.run.smithi117.stdout:(3/12): libgfortran-11.4.1-3.el9.x86_64.rpm 930 kB/s | 803 kB 00:00 2024-04-12T08:58:52.361 INFO:teuthology.orchestra.run.smithi203.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.1 MB/s | 5.1 MB 00:04 2024-04-12T08:58:52.639 INFO:teuthology.orchestra.run.smithi117.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 53 kB/s | 33 kB 00:00 2024-04-12T08:58:52.889 INFO:teuthology.orchestra.run.smithi117.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 33 kB/s | 18 kB 00:00 2024-04-12T08:58:53.315 INFO:teuthology.orchestra.run.smithi117.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 52 kB/s | 35 kB 00:00 2024-04-12T08:58:54.323 INFO:teuthology.orchestra.run.smithi117.stdout:(7/12): python3-devel-3.9.17-2.el9.x86_64.rpm 243 kB/s | 245 kB 00:01 2024-04-12T08:58:54.378 INFO:teuthology.orchestra.run.smithi203.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.5 MB/s | 16 MB 00:06 2024-04-12T08:58:54.379 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:58:54.379 INFO:teuthology.orchestra.run.smithi203.stdout:Total 4.0 MB/s | 38 MB 00:09 2024-04-12T08:58:54.736 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-04-12T08:58:54.763 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-04-12T08:58:54.763 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-04-12T08:58:55.260 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-04-12T08:58:55.260 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-04-12T08:58:56.027 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-04-12T08:58:56.095 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-12T08:58:56.143 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-12T08:58:56.250 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-12T08:58:56.302 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-04-12T08:58:56.481 INFO:teuthology.orchestra.run.smithi117.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 692 kB/s | 3.0 MB 00:04 2024-04-12T08:58:56.485 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-12T08:58:56.518 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-12T08:58:56.604 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-12T08:58:57.254 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-12T08:58:57.364 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-12T08:58:57.373 INFO:teuthology.orchestra.run.smithi117.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 281 kB/s | 250 kB 00:00 2024-04-12T08:58:58.623 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-12T08:58:59.656 INFO:teuthology.orchestra.run.smithi117.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 717 kB/s | 4.7 MB 00:06 2024-04-12T08:58:59.669 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-12T08:58:59.703 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-827.gd3b506 12/12 2024-04-12T08:59:01.273 INFO:teuthology.orchestra.run.smithi117.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 751 kB/s | 5.1 MB 00:06 2024-04-12T08:59:02.359 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-827.gd3b506 12/12 2024-04-12T08:59:02.359 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-827.gd3b506 1/12 2024-04-12T08:59:02.359 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-12T08:59:02.359 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-12T08:59:02.359 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-12T08:59:02.359 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-12T08:59:02.360 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-12T08:59:02.360 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-12T08:59:02.360 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-12T08:59:02.360 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 9/12 2024-04-12T08:59:02.360 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-12T08:59:02.360 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-12T08:59:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-12T08:59:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:02.831 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-04-12T08:59:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-diskprediction-local-2:17.2.7-827.gd3b5060a.el9.noarch 2024-04-12T08:59:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-12T08:59:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-12T08:59:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-12T08:59:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-12T08:59:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-12T08:59:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-12T08:59:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-12T08:59:02.831 INFO:teuthology.orchestra.run.smithi203.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-12T08:59:02.832 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-12T08:59:02.832 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-12T08:59:02.832 INFO:teuthology.orchestra.run.smithi203.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-12T08:59:02.832 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:02.832 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:59:03.311 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-mgr-rook 2024-04-12T08:59:03.915 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:24 ago on Fri 12 Apr 2024 08:57:39 AM UTC. 2024-04-12T08:59:04.203 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:59:04.203 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:59:04.203 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:59:04.203 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.203 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:59:04.203 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.203 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:59:04.203 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.204 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:59:04.204 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.204 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:59:04.204 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.204 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:59:04.204 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.204 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:59:04.204 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.204 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:59:04.204 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.204 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:59:04.204 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.204 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:59:04.204 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.204 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:59:04.205 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.205 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:59:04.205 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.205 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:59:04.205 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.205 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:59:04.205 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.205 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:59:04.205 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.205 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:59:04.205 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.205 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:59:04.205 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.205 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:59:04.206 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.206 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:59:04.206 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.206 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:59:04.206 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.206 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:59:04.206 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.206 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:59:04.206 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.206 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:59:04.206 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.206 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:59:04.206 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.206 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:59:04.206 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.206 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:59:04.207 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.207 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:59:04.207 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.207 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:59:04.207 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.207 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:59:04.207 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.207 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:59:04.207 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.207 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:59:04.207 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.207 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:59:04.207 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.207 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:59:04.208 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.208 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:59:04.208 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.208 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:59:04.208 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.208 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:59:04.208 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.208 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:59:04.208 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.208 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.208 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.208 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:04.208 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.209 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.209 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.209 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.209 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:59:04.209 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.209 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.209 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.209 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.209 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.209 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.209 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:04.209 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.209 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.209 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.209 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.210 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:04.210 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.210 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.210 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.210 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.210 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:04.210 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.210 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.210 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.210 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.210 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:04.210 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.210 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.210 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.210 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.210 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:04.211 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.211 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.211 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.211 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.211 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:04.211 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.211 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.211 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.211 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:04.272 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:59:04.274 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:59:04.274 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-04-12T08:59:04.274 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:59:04.274 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-04-12T08:59:04.274 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-rook noarch 2:17.2.7-827.gd3b5060a.el9 ceph-noarch 47 k 2024-04-12T08:59:04.274 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-04-12T08:59:04.274 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-12T08:59:04.274 INFO:teuthology.orchestra.run.smithi203.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-12T08:59:04.275 INFO:teuthology.orchestra.run.smithi203.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-12T08:59:04.275 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-12T08:59:04.275 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-12T08:59:04.275 INFO:teuthology.orchestra.run.smithi203.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-12T08:59:04.275 INFO:teuthology.orchestra.run.smithi203.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-12T08:59:04.275 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-12T08:59:04.275 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-12T08:59:04.275 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-12T08:59:04.275 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-12T08:59:04.275 INFO:teuthology.orchestra.run.smithi203.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-12T08:59:04.275 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:04.275 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-04-12T08:59:04.275 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:59:04.275 INFO:teuthology.orchestra.run.smithi203.stdout:Install 13 Packages 2024-04-12T08:59:04.276 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:04.276 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 2.2 M 2024-04-12T08:59:04.276 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 26 M 2024-04-12T08:59:04.277 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-04-12T08:59:04.608 INFO:teuthology.orchestra.run.smithi203.stdout:(1/13): ceph-mgr-rook-17.2.7-827.gd3b5060a.el9. 267 kB/s | 47 kB 00:00 2024-04-12T08:59:04.692 INFO:teuthology.orchestra.run.smithi203.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 73 kB/s | 19 kB 00:00 2024-04-12T08:59:04.717 INFO:teuthology.orchestra.run.smithi203.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 89 kB/s | 26 kB 00:00 2024-04-12T08:59:05.110 INFO:teuthology.orchestra.run.smithi203.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 444 kB/s | 222 kB 00:00 2024-04-12T08:59:05.135 INFO:teuthology.orchestra.run.smithi203.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 359 kB/s | 159 kB 00:00 2024-04-12T08:59:05.160 INFO:teuthology.orchestra.run.smithi203.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 630 kB/s | 279 kB 00:00 2024-04-12T08:59:05.210 INFO:teuthology.orchestra.run.smithi203.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 533 kB/s | 54 kB 00:00 2024-04-12T08:59:05.761 INFO:teuthology.orchestra.run.smithi203.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 25 kB/s | 15 kB 00:00 2024-04-12T08:59:05.953 INFO:teuthology.orchestra.run.smithi203.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 39 kB/s | 32 kB 00:00 2024-04-12T08:59:06.486 INFO:teuthology.orchestra.run.smithi203.stdout:(10/13): python3-google-auth-2.28.2-1.el9.noarc 165 kB/s | 203 kB 00:01 2024-04-12T08:59:06.737 INFO:teuthology.orchestra.run.smithi203.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 75 kB/s | 59 kB 00:00 2024-04-12T08:59:07.586 INFO:teuthology.orchestra.run.smithi203.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 82 kB/s | 90 kB 00:01 2024-04-12T08:59:07.795 INFO:teuthology.orchestra.run.smithi203.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 514 kB/s | 1.0 MB 00:02 2024-04-12T08:59:07.799 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:59:07.799 INFO:teuthology.orchestra.run.smithi203.stdout:Total 638 kB/s | 2.2 MB 00:03 2024-04-12T08:59:07.866 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-04-12T08:59:07.882 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-04-12T08:59:07.882 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-04-12T08:59:07.976 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-04-12T08:59:07.977 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-04-12T08:59:08.490 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-04-12T08:59:08.657 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-12T08:59:08.713 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-12T08:59:08.776 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-12T08:59:08.806 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-12T08:59:08.847 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-12T08:59:08.940 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-12T08:59:09.051 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-04-12T08:59:09.099 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-12T08:59:09.817 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-12T08:59:09.872 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-12T08:59:09.906 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-12T08:59:09.951 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-12T08:59:09.976 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-rook-2:17.2.7-827.gd3b5060a.el9.noarch 13/13 2024-04-12T08:59:10.796 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-827.gd3b5060a.el9.noarch 13/13 2024-04-12T08:59:10.796 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-rook-2:17.2.7-827.gd3b5060a.el9.noarch 1/13 2024-04-12T08:59:10.796 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-12T08:59:10.796 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-12T08:59:10.796 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-12T08:59:10.796 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-12T08:59:10.796 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-12T08:59:10.797 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-12T08:59:10.797 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-12T08:59:10.797 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-12T08:59:10.797 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-04-12T08:59:10.797 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-12T08:59:10.797 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-12T08:59:11.165 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-12T08:59:11.165 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:11.165 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-04-12T08:59:11.165 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-rook-2:17.2.7-827.gd3b5060a.el9.noarch 2024-04-12T08:59:11.165 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-12T08:59:11.165 INFO:teuthology.orchestra.run.smithi203.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-12T08:59:11.165 INFO:teuthology.orchestra.run.smithi203.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-12T08:59:11.165 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-12T08:59:11.165 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-12T08:59:11.166 INFO:teuthology.orchestra.run.smithi203.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-12T08:59:11.166 INFO:teuthology.orchestra.run.smithi203.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-12T08:59:11.166 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-12T08:59:11.166 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-12T08:59:11.166 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-12T08:59:11.166 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-12T08:59:11.166 INFO:teuthology.orchestra.run.smithi203.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-12T08:59:11.166 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:11.166 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:59:11.439 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-mgr-cephadm 2024-04-12T08:59:12.036 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:33 ago on Fri 12 Apr 2024 08:57:39 AM UTC. 2024-04-12T08:59:12.325 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:59:12.325 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:59:12.325 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:59:12.325 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.325 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:59:12.325 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.325 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:59:12.325 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.325 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:59:12.326 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.326 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:59:12.326 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.326 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:59:12.326 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.326 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:59:12.326 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.326 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:59:12.326 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.326 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:59:12.326 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.326 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:59:12.326 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.326 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:59:12.327 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.327 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:59:12.327 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.327 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:59:12.327 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.327 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:59:12.327 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.327 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:59:12.327 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.327 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:59:12.327 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.327 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:59:12.327 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.327 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:59:12.327 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.327 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:59:12.328 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.328 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:59:12.328 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.328 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:59:12.328 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.328 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:59:12.328 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.328 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:59:12.328 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.328 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:59:12.328 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.328 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:59:12.328 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.328 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:59:12.329 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.329 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:59:12.329 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.329 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:59:12.329 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.329 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:59:12.329 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.329 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:59:12.329 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.329 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:59:12.329 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.329 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:59:12.329 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.329 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:59:12.329 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.330 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:59:12.330 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.330 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:59:12.330 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.330 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:59:12.330 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.330 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:59:12.330 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.330 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.330 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.330 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:12.330 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.330 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.331 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.331 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.331 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:59:12.331 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.331 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.331 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.331 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.331 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.331 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.331 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:12.331 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.331 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.331 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.331 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.332 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:12.332 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.332 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.332 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.332 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.332 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:12.332 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.332 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.332 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.332 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.332 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:12.332 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.332 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.333 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.333 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.333 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:12.333 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.333 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.333 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.333 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.333 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:12.333 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.333 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.333 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.333 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:12.394 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:59:12.394 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:59:12.395 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-04-12T08:59:12.395 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:59:12.395 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-04-12T08:59:12.395 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-cephadm noarch 2:17.2.7-827.gd3b5060a.el9 ceph-noarch 123 k 2024-04-12T08:59:12.395 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-04-12T08:59:12.395 INFO:teuthology.orchestra.run.smithi203.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-12T08:59:12.395 INFO:teuthology.orchestra.run.smithi203.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-12T08:59:12.395 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-12T08:59:12.395 INFO:teuthology.orchestra.run.smithi203.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-12T08:59:12.395 INFO:teuthology.orchestra.run.smithi203.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-12T08:59:12.395 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:12.395 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-04-12T08:59:12.395 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:59:12.396 INFO:teuthology.orchestra.run.smithi203.stdout:Install 6 Packages 2024-04-12T08:59:12.396 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:12.396 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 7.0 M 2024-04-12T08:59:12.396 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 33 M 2024-04-12T08:59:12.396 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-04-12T08:59:12.924 INFO:teuthology.orchestra.run.smithi203.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 759 kB/s | 248 kB 00:00 2024-04-12T08:59:12.949 INFO:teuthology.orchestra.run.smithi203.stdout:(2/6): ceph-mgr-cephadm-17.2.7-827.gd3b5060a.el 351 kB/s | 123 kB 00:00 2024-04-12T08:59:13.258 INFO:teuthology.orchestra.run.smithi203.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 187 kB/s | 58 kB 00:00 2024-04-12T08:59:13.358 INFO:teuthology.orchestra.run.smithi203.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 511 kB/s | 51 kB 00:00 2024-04-12T08:59:13.433 INFO:teuthology.orchestra.run.smithi203.stdout:(5/6): python3-babel-2.9.1-2.el9.noarch.rpm 7.1 MB/s | 6.0 MB 00:00 2024-04-12T08:59:13.775 INFO:teuthology.orchestra.run.smithi203.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 644 kB/s | 548 kB 00:00 2024-04-12T08:59:13.777 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:59:13.777 INFO:teuthology.orchestra.run.smithi203.stdout:Total 5.0 MB/s | 7.0 MB 00:01 2024-04-12T08:59:13.847 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-04-12T08:59:13.859 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-04-12T08:59:13.859 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-04-12T08:59:13.961 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-04-12T08:59:13.961 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-04-12T08:59:14.270 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-04-12T08:59:14.457 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-12T08:59:14.510 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-12T08:59:15.025 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-12T08:59:15.105 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-12T08:59:15.160 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-12T08:59:15.190 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-827.gd3b5060a.el9.noarch 6/6 2024-04-12T08:59:16.017 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-827.gd3b5060a.el9.noarch 6/6 2024-04-12T08:59:16.017 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-827.gd3b5060a.el9.noarch 1/6 2024-04-12T08:59:16.017 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-12T08:59:16.017 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-12T08:59:16.017 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-12T08:59:16.017 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-12T08:59:16.330 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-12T08:59:16.330 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:16.331 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-04-12T08:59:16.331 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-cephadm-2:17.2.7-827.gd3b5060a.el9.noarch 2024-04-12T08:59:16.331 INFO:teuthology.orchestra.run.smithi203.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-12T08:59:16.331 INFO:teuthology.orchestra.run.smithi203.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-12T08:59:16.331 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-12T08:59:16.331 INFO:teuthology.orchestra.run.smithi203.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-12T08:59:16.331 INFO:teuthology.orchestra.run.smithi203.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-12T08:59:16.331 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:16.331 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:59:16.599 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-fuse 2024-04-12T08:59:17.198 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:38 ago on Fri 12 Apr 2024 08:57:39 AM UTC. 2024-04-12T08:59:17.486 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:59:17.486 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:59:17.486 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:59:17.486 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.486 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:59:17.486 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.486 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:59:17.486 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.486 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:59:17.486 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.486 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:59:17.486 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.487 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:59:17.487 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.487 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:59:17.487 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.487 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:59:17.487 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.487 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:59:17.487 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.487 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:59:17.487 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.487 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:59:17.487 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.487 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:59:17.487 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.487 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:59:17.488 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.488 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:59:17.488 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.488 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:59:17.488 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.488 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:59:17.488 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.488 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:59:17.488 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.488 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:59:17.488 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.488 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:59:17.488 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.488 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:59:17.489 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.489 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:59:17.489 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.489 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:59:17.489 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.489 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:59:17.489 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.489 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:59:17.489 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.489 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:59:17.489 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.489 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:59:17.489 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.489 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:59:17.489 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.489 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:59:17.490 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.490 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:59:17.490 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.490 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:59:17.490 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.490 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:59:17.490 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.490 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:59:17.490 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.490 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:59:17.490 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.490 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:59:17.490 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.491 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:59:17.491 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.491 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:59:17.491 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.491 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:59:17.491 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.491 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.491 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.491 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:17.491 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.491 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.491 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.491 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.491 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:59:17.491 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.492 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.492 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.492 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.492 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.492 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.492 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:17.492 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.492 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.492 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.492 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.492 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:17.492 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.492 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.492 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.493 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.493 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:17.493 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.493 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.493 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.493 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.493 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:17.493 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.493 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.493 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.493 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.493 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:17.493 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.493 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.493 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.494 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.494 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:17.494 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.494 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.494 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.494 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:17.555 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:59:17.555 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:59:17.555 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-04-12T08:59:17.555 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:59:17.555 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-04-12T08:59:17.556 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-fuse x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 812 k 2024-04-12T08:59:17.556 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-04-12T08:59:17.556 INFO:teuthology.orchestra.run.smithi203.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-12T08:59:17.556 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:17.556 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-04-12T08:59:17.556 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:59:17.556 INFO:teuthology.orchestra.run.smithi203.stdout:Install 2 Packages 2024-04-12T08:59:17.556 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:17.557 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 892 k 2024-04-12T08:59:17.557 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 2.6 M 2024-04-12T08:59:17.557 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-04-12T08:59:17.803 INFO:teuthology.orchestra.run.smithi203.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 444 kB/s | 80 kB 00:00 2024-04-12T08:59:18.037 INFO:teuthology.orchestra.run.smithi203.stdout:(2/2): ceph-fuse-17.2.7-827.gd3b5060a.el9.x86_6 1.9 MB/s | 812 kB 00:00 2024-04-12T08:59:18.037 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:59:18.037 INFO:teuthology.orchestra.run.smithi203.stdout:Total 1.8 MB/s | 892 kB 00:00 2024-04-12T08:59:18.049 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-04-12T08:59:18.069 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-04-12T08:59:18.070 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-04-12T08:59:18.144 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-04-12T08:59:18.145 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-04-12T08:59:18.286 INFO:teuthology.orchestra.run.smithi117.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 796 kB/s | 16 MB 00:20 2024-04-12T08:59:18.288 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:59:18.288 INFO:teuthology.orchestra.run.smithi117.stdout:Total 1.4 MB/s | 38 MB 00:27 2024-04-12T08:59:18.336 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-04-12T08:59:18.457 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-12T08:59:18.527 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-fuse-2:17.2.7-827.gd3b5060a.el9.x86_64 2/2 2024-04-12T08:59:18.642 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-12T08:59:18.669 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-12T08:59:18.669 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-12T08:59:19.164 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-12T08:59:19.165 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-12T08:59:19.182 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-fuse-2:17.2.7-827.gd3b5060a.el9.x86_64 2/2 2024-04-12T08:59:19.182 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-fuse-2:17.2.7-827.gd3b5060a.el9.x86_64 1/2 2024-04-12T08:59:19.501 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-12T08:59:19.501 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:19.501 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-04-12T08:59:19.501 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-fuse-2:17.2.7-827.gd3b5060a.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-12T08:59:19.501 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:19.501 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:59:19.794 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install librados-devel 2024-04-12T08:59:19.923 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-12T08:59:19.999 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-12T08:59:20.042 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-12T08:59:20.143 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-12T08:59:20.177 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-04-12T08:59:20.368 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-12T08:59:20.401 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-12T08:59:20.401 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:41 ago on Fri 12 Apr 2024 08:57:39 AM UTC. 2024-04-12T08:59:20.486 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-12T08:59:20.689 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:59:20.690 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:59:20.690 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:59:20.690 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.690 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:59:20.690 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.690 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:59:20.690 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.690 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:59:20.690 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.690 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:59:20.690 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.690 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:59:20.691 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.691 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:59:20.691 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.691 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:59:20.691 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.691 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:59:20.691 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.691 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:59:20.691 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.691 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:59:20.691 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.691 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:59:20.691 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.691 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:59:20.691 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.692 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:59:20.692 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.692 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:59:20.692 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.692 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:59:20.692 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.692 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:59:20.692 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.692 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:59:20.692 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.692 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:59:20.692 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.692 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:59:20.692 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.692 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:59:20.693 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.693 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:59:20.693 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.693 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:59:20.693 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.693 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:59:20.693 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.693 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:59:20.693 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.693 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:59:20.693 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.693 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:59:20.693 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.693 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:59:20.694 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.694 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:59:20.694 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.694 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:59:20.694 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.694 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:59:20.694 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.694 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:59:20.694 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.694 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:59:20.694 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.694 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:59:20.694 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.694 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:59:20.694 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.694 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:59:20.695 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.695 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:59:20.695 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.695 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.695 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.695 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:20.695 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.695 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.695 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.695 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.695 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:59:20.695 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.695 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.695 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.695 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.695 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.696 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.696 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:20.696 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.696 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.696 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.696 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.696 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:20.696 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.696 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.696 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.696 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.696 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:20.696 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.696 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.697 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.697 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.697 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:20.697 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.697 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.697 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.697 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.697 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:20.697 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.697 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.697 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.697 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.697 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:20.697 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.697 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.697 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.698 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:20.758 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:59:20.759 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:59:20.759 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repo Size 2024-04-12T08:59:20.759 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:59:20.759 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-04-12T08:59:20.759 INFO:teuthology.orchestra.run.smithi203.stdout: librados-devel x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 126 k 2024-04-12T08:59:20.759 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:20.759 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-04-12T08:59:20.759 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:59:20.759 INFO:teuthology.orchestra.run.smithi203.stdout:Install 1 Package 2024-04-12T08:59:20.759 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:20.762 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 126 k 2024-04-12T08:59:20.762 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 448 k 2024-04-12T08:59:20.762 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-04-12T08:59:20.967 INFO:teuthology.orchestra.run.smithi203.stdout:librados-devel-17.2.7-827.gd3b5060a.el9.x86_64. 609 kB/s | 126 kB 00:00 2024-04-12T08:59:20.968 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:59:20.968 INFO:teuthology.orchestra.run.smithi203.stdout:Total 605 kB/s | 126 kB 00:00 2024-04-12T08:59:20.969 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-04-12T08:59:20.974 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-04-12T08:59:20.974 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-04-12T08:59:21.031 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-04-12T08:59:21.032 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-04-12T08:59:21.129 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-12T08:59:21.180 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-04-12T08:59:21.247 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-12T08:59:21.290 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librados-devel-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T08:59:21.751 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librados-devel-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T08:59:22.195 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados-devel-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T08:59:22.196 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:22.196 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-04-12T08:59:22.196 INFO:teuthology.orchestra.run.smithi203.stdout: librados-devel-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:59:22.196 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:22.196 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:59:22.476 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-12T08:59:22.502 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install libcephfs2 2024-04-12T08:59:23.117 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:44 ago on Fri 12 Apr 2024 08:57:39 AM UTC. 2024-04-12T08:59:23.404 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:59:23.404 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:59:23.404 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:59:23.404 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.404 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:59:23.404 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.404 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:59:23.404 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.404 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:59:23.404 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.405 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:59:23.405 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.405 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:59:23.405 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.405 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:59:23.405 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.405 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:59:23.405 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.405 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:59:23.405 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.405 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:59:23.405 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.406 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:59:23.406 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.406 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:59:23.406 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.406 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:59:23.406 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.406 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:59:23.406 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.406 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:59:23.406 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.406 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:59:23.406 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.406 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:59:23.407 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.407 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:59:23.407 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.407 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:59:23.407 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.407 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:59:23.407 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.407 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:59:23.407 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.407 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:59:23.407 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.407 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:59:23.407 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.408 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:59:23.408 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.408 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:59:23.408 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.408 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:59:23.408 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.408 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:59:23.408 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.408 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:59:23.408 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.408 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:59:23.408 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.408 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:59:23.408 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.408 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:59:23.409 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.409 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:59:23.409 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.409 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:59:23.409 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.409 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:59:23.409 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.409 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:59:23.409 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.409 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:59:23.409 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.409 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:59:23.409 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.409 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.409 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.410 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:23.410 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.410 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.410 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.410 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.410 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:59:23.410 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.410 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.410 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.410 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.411 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.411 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.411 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:23.411 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.411 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.411 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.411 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.411 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:23.411 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.411 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.411 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.411 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.412 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:23.412 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.412 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.412 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.412 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.412 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:23.412 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.412 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.412 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.412 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.412 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:23.412 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.412 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.412 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.412 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.413 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:23.413 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.413 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.413 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.413 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:23.413 INFO:teuthology.orchestra.run.smithi203.stdout:Package libcephfs2-2:17.2.7-827.gd3b5060a.el9.x86_64 is already installed. 2024-04-12T08:59:23.473 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:59:23.474 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-04-12T08:59:23.474 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:59:23.506 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-12T08:59:23.533 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-827.gd3b506 12/12 2024-04-12T08:59:23.557 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install libcephfs-devel 2024-04-12T08:59:24.157 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:45 ago on Fri 12 Apr 2024 08:57:39 AM UTC. 2024-04-12T08:59:24.450 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:59:24.451 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:59:24.451 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:59:24.451 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.451 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:59:24.451 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.451 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:59:24.451 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.451 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:59:24.451 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.451 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:59:24.451 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.451 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:59:24.452 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.452 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:59:24.452 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.452 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:59:24.452 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.452 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:59:24.452 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.452 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:59:24.452 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.452 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:59:24.452 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.452 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:59:24.452 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.453 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:59:24.453 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.453 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:59:24.453 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.453 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:59:24.453 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.453 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:59:24.453 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.453 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:59:24.453 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.453 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:59:24.453 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.453 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:59:24.454 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.454 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:59:24.454 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.454 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:59:24.454 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.454 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:59:24.454 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.454 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:59:24.454 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.454 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:59:24.454 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.454 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:59:24.454 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.454 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:59:24.454 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.455 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:59:24.455 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.455 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:59:24.455 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.455 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:59:24.455 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.455 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:59:24.455 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.455 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:59:24.455 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.455 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:59:24.455 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.455 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:59:24.455 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.455 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:59:24.455 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.456 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:59:24.456 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.456 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:59:24.456 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.456 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:59:24.456 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.456 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.456 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.456 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:24.456 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.456 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.456 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.456 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.456 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:59:24.456 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.456 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.457 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.457 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.457 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.457 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.457 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:24.457 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.457 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.457 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.457 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.457 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:24.457 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.457 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.457 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.457 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.457 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:24.458 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.458 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.458 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.458 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.458 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:24.458 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.458 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.458 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.458 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.458 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:24.458 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.458 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.458 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.458 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.458 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:24.458 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.459 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.459 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.459 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:24.519 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:59:24.520 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:59:24.520 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repo Size 2024-04-12T08:59:24.520 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:59:24.520 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-04-12T08:59:24.520 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs-devel x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 25 k 2024-04-12T08:59:24.520 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:24.520 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-04-12T08:59:24.520 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:59:24.521 INFO:teuthology.orchestra.run.smithi203.stdout:Install 1 Package 2024-04-12T08:59:24.521 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:24.521 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 25 k 2024-04-12T08:59:24.521 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 110 k 2024-04-12T08:59:24.521 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-04-12T08:59:24.689 INFO:teuthology.orchestra.run.smithi203.stdout:libcephfs-devel-17.2.7-827.gd3b5060a.el9.x86_64 149 kB/s | 25 kB 00:00 2024-04-12T08:59:24.689 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:59:24.690 INFO:teuthology.orchestra.run.smithi203.stdout:Total 148 kB/s | 25 kB 00:00 2024-04-12T08:59:24.690 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-04-12T08:59:24.693 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-04-12T08:59:24.693 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-04-12T08:59:24.694 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-04-12T08:59:24.695 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-04-12T08:59:24.774 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-04-12T08:59:24.887 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephfs-devel-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T08:59:25.246 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T08:59:25.539 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephfs-devel-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T08:59:25.539 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:25.539 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-04-12T08:59:25.539 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs-devel-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:59:25.539 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:25.539 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:59:25.764 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install librados2 2024-04-12T08:59:25.983 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-827.gd3b506 12/12 2024-04-12T08:59:25.983 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-827.gd3b506 1/12 2024-04-12T08:59:25.983 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-12T08:59:25.983 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-12T08:59:25.983 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-12T08:59:25.983 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-12T08:59:25.983 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-12T08:59:25.983 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-12T08:59:25.983 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-12T08:59:25.983 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 9/12 2024-04-12T08:59:25.983 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-12T08:59:25.984 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-12T08:59:26.365 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:47 ago on Fri 12 Apr 2024 08:57:39 AM UTC. 2024-04-12T08:59:26.406 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-12T08:59:26.406 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:59:26.406 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-12T08:59:26.406 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local-2:17.2.7-827.gd3b5060a.el9.noarch 2024-04-12T08:59:26.406 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-12T08:59:26.406 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-12T08:59:26.406 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-12T08:59:26.406 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-12T08:59:26.406 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-12T08:59:26.406 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-12T08:59:26.407 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-12T08:59:26.407 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-12T08:59:26.407 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-12T08:59:26.407 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-12T08:59:26.407 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-12T08:59:26.407 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:59:26.407 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T08:59:26.658 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:59:26.658 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:59:26.658 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:59:26.658 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.658 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:59:26.658 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.658 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:59:26.659 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.659 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:59:26.659 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.659 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:59:26.659 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.659 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:59:26.659 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.659 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:59:26.659 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.659 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:59:26.659 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.659 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:59:26.659 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.659 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:59:26.660 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.660 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:59:26.660 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.660 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:59:26.660 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.660 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:59:26.660 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.660 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:59:26.660 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.660 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:59:26.660 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.660 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:59:26.660 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.661 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:59:26.661 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.661 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:59:26.661 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.661 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:59:26.661 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.661 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:59:26.661 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.661 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:59:26.661 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.661 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:59:26.661 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.661 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:59:26.661 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.662 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:59:26.662 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.662 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:59:26.662 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.662 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:59:26.662 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.662 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:59:26.662 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.662 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:59:26.662 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.662 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:59:26.662 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.662 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:59:26.663 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.663 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:59:26.663 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.663 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:59:26.663 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.663 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:59:26.663 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.663 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:59:26.663 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.663 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:59:26.663 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.663 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:59:26.663 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.663 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:59:26.664 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.664 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.664 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.664 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:26.664 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.664 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.664 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.664 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.664 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:59:26.664 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.664 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.664 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.664 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.664 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.664 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.665 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:26.665 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.665 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.665 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.665 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.665 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:26.665 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.665 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.665 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.665 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.665 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:26.665 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.665 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.665 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.666 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.666 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:26.666 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.666 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.666 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.666 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.666 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:26.666 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.666 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.666 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.666 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.666 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:26.666 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.666 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.667 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.667 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:26.667 INFO:teuthology.orchestra.run.smithi203.stdout:Package librados2-2:17.2.7-827.gd3b5060a.el9.x86_64 is already installed. 2024-04-12T08:59:26.727 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:59:26.728 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-04-12T08:59:26.728 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:59:26.802 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr-rook 2024-04-12T08:59:26.812 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install librbd1 2024-04-12T08:59:27.409 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:46 ago on Fri 12 Apr 2024 08:57:41 AM UTC. 2024-04-12T08:59:27.414 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:48 ago on Fri 12 Apr 2024 08:57:39 AM UTC. 2024-04-12T08:59:27.698 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T08:59:27.698 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T08:59:27.698 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T08:59:27.698 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.698 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T08:59:27.698 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.698 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T08:59:27.698 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.698 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T08:59:27.698 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.699 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T08:59:27.699 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.699 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T08:59:27.699 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.699 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T08:59:27.699 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.699 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T08:59:27.699 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.699 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T08:59:27.699 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.699 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T08:59:27.699 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.699 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T08:59:27.699 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.699 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T08:59:27.700 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.700 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T08:59:27.700 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.700 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T08:59:27.700 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.700 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T08:59:27.700 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.700 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T08:59:27.700 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.700 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T08:59:27.700 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.700 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T08:59:27.700 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.700 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T08:59:27.701 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.701 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T08:59:27.701 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.701 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T08:59:27.701 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.701 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T08:59:27.701 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.701 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T08:59:27.701 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.701 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T08:59:27.701 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.701 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T08:59:27.701 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.701 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T08:59:27.701 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.702 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T08:59:27.702 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.702 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T08:59:27.702 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.702 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T08:59:27.702 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.702 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T08:59:27.702 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.702 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T08:59:27.702 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.702 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T08:59:27.702 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.702 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T08:59:27.703 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.703 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T08:59:27.703 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.703 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T08:59:27.703 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.703 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T08:59:27.703 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.703 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T08:59:27.703 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.703 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.703 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.703 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:27.703 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.703 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.703 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.704 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.704 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T08:59:27.704 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.704 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.704 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.704 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.704 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.704 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.704 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:27.704 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.704 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.704 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.704 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.704 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:27.704 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.705 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.705 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.705 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.705 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:27.705 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.705 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.705 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.705 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.705 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:27.705 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.705 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.705 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.705 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.705 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:27.706 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.706 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.706 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.706 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.706 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:27.706 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.706 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.706 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.706 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.706 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:59:27.707 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:59:27.707 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:59:27.707 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.707 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:59:27.707 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.707 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:59:27.707 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.707 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:59:27.707 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.707 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:59:27.707 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.707 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:59:27.707 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.707 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:59:27.707 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.708 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:59:27.708 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.708 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:59:27.708 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.708 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:59:27.708 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.708 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:59:27.708 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.708 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:59:27.708 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.708 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:59:27.708 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.708 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:59:27.708 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.708 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:59:27.709 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.709 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:59:27.709 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.709 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:59:27.709 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.709 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:59:27.709 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.709 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:59:27.709 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.709 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:59:27.709 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.709 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:59:27.709 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.709 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:59:27.710 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.710 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:59:27.710 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.710 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:59:27.710 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.710 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:59:27.710 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.710 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:59:27.710 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.710 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:59:27.710 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.710 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:59:27.710 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.711 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:59:27.711 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.711 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:59:27.711 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.711 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:59:27.711 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.711 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:59:27.711 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.711 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:59:27.711 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.711 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:59:27.711 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.711 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:59:27.711 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.712 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:59:27.712 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.712 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:59:27.712 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.712 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.712 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.712 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:27.712 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.712 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.712 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.712 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.712 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:59:27.712 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.712 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.712 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.713 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.713 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.713 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.713 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:27.713 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.713 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.713 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.713 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.713 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:27.713 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.713 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.713 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.713 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.713 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:27.713 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.713 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.714 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.714 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.714 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:27.714 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.714 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.714 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.714 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.714 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:27.714 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.714 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.714 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.714 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.714 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:27.714 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.715 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.715 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.715 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:27.715 INFO:teuthology.orchestra.run.smithi203.stdout:Package librbd1-2:17.2.7-827.gd3b5060a.el9.x86_64 is already installed. 2024-04-12T08:59:27.768 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T08:59:27.769 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:59:27.769 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-04-12T08:59:27.770 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:59:27.770 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-12T08:59:27.770 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook noarch 2:17.2.7-827.gd3b5060a.el9 ceph-noarch 47 k 2024-04-12T08:59:27.770 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-04-12T08:59:27.770 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-12T08:59:27.770 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-12T08:59:27.770 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-12T08:59:27.770 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-12T08:59:27.770 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-12T08:59:27.770 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-12T08:59:27.770 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-12T08:59:27.770 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-12T08:59:27.771 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-12T08:59:27.771 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-12T08:59:27.771 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-12T08:59:27.771 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-12T08:59:27.771 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:59:27.771 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-12T08:59:27.771 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:59:27.771 INFO:teuthology.orchestra.run.smithi117.stdout:Install 13 Packages 2024-04-12T08:59:27.771 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:59:27.772 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 2.2 M 2024-04-12T08:59:27.772 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 26 M 2024-04-12T08:59:27.772 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-12T08:59:27.775 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:59:27.776 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-04-12T08:59:27.776 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:59:27.855 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install python3-rados 2024-04-12T08:59:28.284 INFO:teuthology.orchestra.run.smithi117.stdout:(1/13): ceph-mgr-rook-17.2.7-827.gd3b5060a.el9. 240 kB/s | 47 kB 00:00 2024-04-12T08:59:28.359 INFO:teuthology.orchestra.run.smithi117.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 70 kB/s | 19 kB 00:00 2024-04-12T08:59:28.384 INFO:teuthology.orchestra.run.smithi117.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 86 kB/s | 26 kB 00:00 2024-04-12T08:59:28.449 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:49 ago on Fri 12 Apr 2024 08:57:39 AM UTC. 2024-04-12T08:59:28.726 INFO:teuthology.orchestra.run.smithi117.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 433 kB/s | 159 kB 00:00 2024-04-12T08:59:28.738 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:59:28.738 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:59:28.738 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:59:28.738 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.739 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:59:28.739 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.739 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:59:28.739 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.739 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:59:28.739 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.739 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:59:28.739 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.739 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:59:28.739 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.739 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:59:28.739 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.739 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:59:28.739 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.739 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:59:28.739 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.740 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:59:28.740 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.740 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:59:28.740 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.740 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:59:28.740 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.740 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:59:28.740 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.740 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:59:28.740 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.740 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:59:28.740 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.740 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:59:28.740 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.740 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:59:28.740 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.741 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:59:28.741 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.741 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:59:28.741 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.741 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:59:28.741 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.741 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:59:28.741 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.741 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:59:28.741 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.741 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:59:28.741 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.741 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:59:28.742 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.742 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:59:28.742 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.742 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:59:28.742 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.742 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:59:28.742 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.742 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:59:28.742 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.742 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:59:28.742 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.742 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:59:28.742 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.742 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:59:28.742 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.743 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:59:28.743 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.743 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:59:28.743 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.743 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:59:28.743 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.743 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:59:28.743 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.743 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:59:28.743 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.743 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:59:28.743 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.743 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.743 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.743 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:28.744 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.744 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.744 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.744 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.744 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:59:28.744 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.744 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.744 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.744 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.744 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.744 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.744 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:28.744 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.744 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.744 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.744 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.745 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:28.745 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.745 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.745 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.745 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.745 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:28.745 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.745 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.745 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.745 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.745 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:28.745 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.745 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.745 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.745 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.745 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:28.746 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.746 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.746 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.746 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.746 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:28.746 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.746 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.746 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.746 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:28.746 INFO:teuthology.orchestra.run.smithi203.stdout:Package python3-rados-2:17.2.7-827.gd3b5060a.el9.x86_64 is already installed. 2024-04-12T08:59:28.806 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:59:28.807 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-04-12T08:59:28.807 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:59:28.826 INFO:teuthology.orchestra.run.smithi117.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 410 kB/s | 222 kB 00:00 2024-04-12T08:59:28.851 INFO:teuthology.orchestra.run.smithi117.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 428 kB/s | 54 kB 00:00 2024-04-12T08:59:28.888 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install python3-rgw 2024-04-12T08:59:28.927 INFO:teuthology.orchestra.run.smithi117.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 514 kB/s | 279 kB 00:00 2024-04-12T08:59:29.235 INFO:teuthology.orchestra.run.smithi117.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 79 kB/s | 32 kB 00:00 2024-04-12T08:59:29.261 INFO:teuthology.orchestra.run.smithi117.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 37 kB/s | 15 kB 00:00 2024-04-12T08:59:29.469 INFO:teuthology.orchestra.run.smithi117.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 284 kB/s | 59 kB 00:00 2024-04-12T08:59:29.484 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:50 ago on Fri 12 Apr 2024 08:57:39 AM UTC. 2024-04-12T08:59:29.545 INFO:teuthology.orchestra.run.smithi117.stdout:(11/13): python3-google-auth-2.28.2-1.el9.noarc 357 kB/s | 203 kB 00:00 2024-04-12T08:59:29.636 INFO:teuthology.orchestra.run.smithi117.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 538 kB/s | 90 kB 00:00 2024-04-12T08:59:29.695 INFO:teuthology.orchestra.run.smithi117.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.2 MB/s | 1.0 MB 00:00 2024-04-12T08:59:29.698 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:59:29.698 INFO:teuthology.orchestra.run.smithi117.stdout:Total 1.1 MB/s | 2.2 MB 00:01 2024-04-12T08:59:29.765 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-12T08:59:29.774 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:59:29.774 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:59:29.774 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:59:29.774 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.774 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:59:29.774 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.774 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:59:29.774 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.774 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:59:29.775 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.775 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:59:29.775 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.775 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:59:29.775 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.775 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:59:29.775 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.775 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:59:29.775 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.775 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:59:29.775 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.775 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:59:29.775 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.775 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:59:29.775 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.776 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:59:29.776 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.776 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:59:29.776 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.776 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:59:29.776 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.776 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:59:29.776 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.776 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:59:29.776 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.776 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:59:29.776 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.776 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:59:29.776 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.776 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:59:29.777 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.777 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:59:29.777 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.777 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:59:29.777 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.777 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:59:29.777 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.777 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:59:29.777 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.777 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:59:29.777 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.777 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:59:29.777 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.777 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:59:29.778 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.778 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:59:29.778 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.778 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:59:29.778 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.778 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:59:29.778 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.778 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:59:29.778 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.778 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:59:29.778 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.778 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:59:29.778 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.779 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:59:29.779 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.779 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:59:29.779 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.779 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:59:29.779 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.779 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:59:29.779 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.779 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:59:29.779 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.779 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.779 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.779 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:29.779 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.780 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.780 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.780 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.780 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:59:29.780 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.780 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.780 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.780 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.780 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.780 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.780 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:29.780 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.780 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.780 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.781 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.781 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:29.781 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.781 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.781 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.781 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.781 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:29.781 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.781 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.781 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.781 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.781 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:29.781 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.781 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.782 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.782 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.782 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:29.782 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.782 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.782 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.782 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.782 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:29.782 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.782 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.782 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.782 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:29.783 INFO:teuthology.orchestra.run.smithi203.stdout:Package python3-rgw-2:17.2.7-827.gd3b5060a.el9.x86_64 is already installed. 2024-04-12T08:59:29.783 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-12T08:59:29.783 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-12T08:59:29.842 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:59:29.843 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-04-12T08:59:29.844 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:59:29.875 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-12T08:59:29.877 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-12T08:59:29.930 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install python3-cephfs 2024-04-12T08:59:30.385 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-12T08:59:30.550 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-12T08:59:30.554 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:51 ago on Fri 12 Apr 2024 08:57:39 AM UTC. 2024-04-12T08:59:30.604 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-12T08:59:30.660 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-12T08:59:30.697 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-12T08:59:30.738 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-12T08:59:30.833 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-12T08:59:30.856 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:59:30.856 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:59:30.856 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:59:30.856 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.856 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:59:30.856 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.856 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:59:30.856 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.857 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:59:30.857 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.857 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:59:30.857 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.857 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:59:30.857 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.857 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:59:30.857 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.857 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:59:30.857 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.857 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:59:30.857 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.857 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:59:30.857 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.858 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:59:30.858 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.858 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:59:30.858 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.858 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:59:30.858 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.858 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:59:30.858 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.858 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:59:30.858 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.858 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:59:30.858 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.859 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:59:30.859 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.859 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:59:30.859 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.859 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:59:30.859 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.859 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:59:30.859 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.859 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:59:30.860 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.860 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:59:30.860 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.860 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:59:30.860 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.860 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:59:30.860 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.860 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:59:30.860 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.860 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:59:30.861 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.861 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:59:30.861 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.861 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:59:30.861 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.861 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:59:30.861 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.861 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:59:30.861 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.861 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:59:30.861 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.861 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:59:30.861 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.861 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:59:30.862 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.862 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:59:30.862 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.862 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:59:30.862 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.862 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:59:30.862 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.862 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:59:30.862 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.862 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.862 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.862 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:30.862 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.862 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.863 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.863 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.863 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:59:30.863 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.863 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.863 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.863 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.863 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.863 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.863 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:30.863 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.863 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.863 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.863 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.864 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:30.864 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.864 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.864 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.864 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.864 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:30.864 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.864 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.864 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.865 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.865 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:30.865 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.865 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.865 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.865 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.865 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:30.865 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.865 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.865 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.865 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.865 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:30.865 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.865 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.865 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.866 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:30.866 INFO:teuthology.orchestra.run.smithi203.stdout:Package python3-cephfs-2:17.2.7-827.gd3b5060a.el9.x86_64 is already installed. 2024-04-12T08:59:30.929 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:59:30.930 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-04-12T08:59:30.930 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:59:30.942 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-04-12T08:59:30.999 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-12T08:59:31.021 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install python3-rbd 2024-04-12T08:59:31.636 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:52 ago on Fri 12 Apr 2024 08:57:39 AM UTC. 2024-04-12T08:59:31.734 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-12T08:59:31.787 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-12T08:59:31.821 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-12T08:59:31.866 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-12T08:59:31.890 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-rook-2:17.2.7-827.gd3b5060a.el9.noarch 13/13 2024-04-12T08:59:31.925 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:59:31.926 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:59:31.926 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:59:31.926 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.926 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:59:31.926 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.926 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:59:31.926 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.926 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:59:31.926 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.926 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:59:31.926 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.926 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:59:31.926 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.927 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:59:31.927 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.927 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:59:31.927 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.927 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:59:31.927 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.927 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:59:31.927 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.927 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:59:31.927 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.927 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:59:31.927 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.927 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:59:31.927 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.927 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:59:31.928 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.928 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:59:31.928 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.928 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:59:31.928 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.928 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:59:31.928 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.928 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:59:31.928 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.928 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:59:31.928 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.928 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:59:31.928 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.928 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:59:31.928 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.929 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:59:31.929 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.929 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:59:31.929 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.929 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:59:31.929 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.929 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:59:31.929 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.929 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:59:31.929 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.929 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:59:31.929 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.929 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:59:31.929 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.930 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:59:31.930 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.930 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:59:31.930 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.930 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:59:31.930 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.930 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:59:31.930 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.930 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:59:31.930 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.930 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:59:31.930 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.930 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:59:31.930 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.931 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:59:31.931 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.931 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:59:31.931 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.931 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.931 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.931 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:31.931 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.931 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.931 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.931 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.931 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:59:31.931 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.931 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.932 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.932 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.932 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.932 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.932 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:31.932 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.932 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.932 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.932 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.932 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:31.932 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.932 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.932 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.932 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.933 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:31.933 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.933 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.933 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.933 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.933 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:31.933 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.933 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.933 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.933 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.933 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:31.933 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.933 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.933 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.933 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.933 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:31.934 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.934 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.934 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.934 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:31.934 INFO:teuthology.orchestra.run.smithi203.stdout:Package python3-rbd-2:17.2.7-827.gd3b5060a.el9.x86_64 is already installed. 2024-04-12T08:59:31.996 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:59:31.997 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-04-12T08:59:31.997 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:59:32.116 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install rbd-fuse 2024-04-12T08:59:32.714 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:53 ago on Fri 12 Apr 2024 08:57:39 AM UTC. 2024-04-12T08:59:32.759 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-827.gd3b5060a.el9.noarch 13/13 2024-04-12T08:59:32.759 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-rook-2:17.2.7-827.gd3b5060a.el9.noarch 1/13 2024-04-12T08:59:32.759 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-12T08:59:32.759 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-12T08:59:32.759 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-12T08:59:32.760 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-12T08:59:32.760 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-12T08:59:32.760 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-12T08:59:32.760 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-12T08:59:32.760 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-12T08:59:32.760 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-04-12T08:59:32.760 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-12T08:59:32.760 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-12T08:59:33.000 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:59:33.000 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:59:33.000 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:59:33.000 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.000 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:59:33.000 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.000 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:59:33.000 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.001 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:59:33.001 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.001 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:59:33.001 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.001 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:59:33.001 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.001 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:59:33.001 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.001 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:59:33.001 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.001 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:59:33.001 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.001 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:59:33.001 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.001 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:59:33.002 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.002 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:59:33.002 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.002 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:59:33.002 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.002 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:59:33.002 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.002 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:59:33.002 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.002 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:59:33.002 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.002 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:59:33.002 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.002 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:59:33.003 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.003 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:59:33.003 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.003 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:59:33.003 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.003 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:59:33.003 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.003 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:59:33.003 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.003 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:59:33.003 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.003 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:59:33.003 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.003 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:59:33.003 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.004 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:59:33.004 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.004 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:59:33.004 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.004 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:59:33.004 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.004 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:59:33.004 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.004 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:59:33.004 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.004 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:59:33.004 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.004 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:59:33.004 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.005 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:59:33.005 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.005 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:59:33.005 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.005 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:59:33.005 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.005 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:59:33.005 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.005 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:59:33.005 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.005 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.005 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.005 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:33.005 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.006 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.006 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.006 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.006 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:59:33.006 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.006 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.006 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.006 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.006 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.006 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.006 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:33.006 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.006 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.006 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.007 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.007 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:33.007 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.007 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.007 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.007 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.007 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:33.007 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.007 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.007 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.007 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.007 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:33.007 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.008 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.008 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.008 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.008 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:33.008 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.008 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.008 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.008 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.008 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:33.008 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.008 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.008 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.008 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:33.069 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:59:33.070 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:59:33.070 INFO:teuthology.orchestra.run.smithi203.stdout: Package Architecture Version Repository Size 2024-04-12T08:59:33.070 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:59:33.070 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-04-12T08:59:33.070 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-fuse x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 82 k 2024-04-12T08:59:33.070 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:33.070 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-04-12T08:59:33.071 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:59:33.071 INFO:teuthology.orchestra.run.smithi203.stdout:Install 1 Package 2024-04-12T08:59:33.071 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:33.071 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 82 k 2024-04-12T08:59:33.071 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 222 k 2024-04-12T08:59:33.071 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-04-12T08:59:33.124 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-12T08:59:33.124 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:59:33.124 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-12T08:59:33.124 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook-2:17.2.7-827.gd3b5060a.el9.noarch 2024-04-12T08:59:33.124 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-12T08:59:33.124 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-12T08:59:33.124 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-12T08:59:33.124 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-12T08:59:33.125 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-12T08:59:33.125 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-12T08:59:33.125 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-12T08:59:33.125 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-12T08:59:33.125 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-12T08:59:33.125 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-12T08:59:33.125 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-12T08:59:33.125 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-12T08:59:33.125 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:59:33.125 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T08:59:33.358 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr-cephadm 2024-04-12T08:59:33.393 INFO:teuthology.orchestra.run.smithi203.stdout:rbd-fuse-17.2.7-827.gd3b5060a.el9.x86_64.rpm 255 kB/s | 82 kB 00:00 2024-04-12T08:59:33.393 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:59:33.394 INFO:teuthology.orchestra.run.smithi203.stdout:Total 254 kB/s | 82 kB 00:00 2024-04-12T08:59:33.394 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-04-12T08:59:33.400 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-04-12T08:59:33.401 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-04-12T08:59:33.458 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-04-12T08:59:33.459 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-04-12T08:59:33.598 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-04-12T08:59:33.698 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-fuse-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T08:59:33.954 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:52 ago on Fri 12 Apr 2024 08:57:41 AM UTC. 2024-04-12T08:59:34.080 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: rbd-fuse-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T08:59:34.246 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T08:59:34.247 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T08:59:34.247 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T08:59:34.247 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.247 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T08:59:34.247 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.247 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T08:59:34.247 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.247 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T08:59:34.247 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.247 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T08:59:34.247 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.247 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T08:59:34.248 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.248 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T08:59:34.248 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.248 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T08:59:34.248 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.248 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T08:59:34.248 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.248 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T08:59:34.248 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.248 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T08:59:34.248 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.248 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T08:59:34.248 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.248 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T08:59:34.248 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.249 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T08:59:34.249 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.249 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T08:59:34.249 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.249 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T08:59:34.249 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.249 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T08:59:34.249 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.249 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T08:59:34.249 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.249 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T08:59:34.249 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.249 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T08:59:34.249 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.249 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T08:59:34.250 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.250 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T08:59:34.250 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.250 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T08:59:34.250 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.250 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T08:59:34.250 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.250 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T08:59:34.250 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.250 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T08:59:34.250 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.250 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T08:59:34.250 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.250 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T08:59:34.251 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.251 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T08:59:34.251 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.251 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T08:59:34.251 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.251 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T08:59:34.251 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.251 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T08:59:34.251 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.251 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T08:59:34.251 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.251 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T08:59:34.251 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.251 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T08:59:34.251 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.251 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T08:59:34.252 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.252 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T08:59:34.252 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.252 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.252 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.252 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:34.252 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.252 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.252 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.252 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.252 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T08:59:34.252 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.252 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.252 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.252 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.252 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.253 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.253 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:34.253 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.253 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.253 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.253 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.253 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:34.253 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.253 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.253 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.253 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.253 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:34.253 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.253 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.253 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.254 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.254 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:34.254 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.254 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.254 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.254 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.254 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:34.254 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.254 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.254 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.254 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.254 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:34.254 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.254 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.254 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.255 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:34.316 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T08:59:34.317 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:59:34.317 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-04-12T08:59:34.317 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:59:34.317 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-12T08:59:34.317 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm noarch 2:17.2.7-827.gd3b5060a.el9 ceph-noarch 123 k 2024-04-12T08:59:34.317 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-04-12T08:59:34.317 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-12T08:59:34.317 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-12T08:59:34.318 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-12T08:59:34.318 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-12T08:59:34.318 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-12T08:59:34.318 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:59:34.318 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-12T08:59:34.318 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:59:34.318 INFO:teuthology.orchestra.run.smithi117.stdout:Install 6 Packages 2024-04-12T08:59:34.318 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:59:34.319 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 7.0 M 2024-04-12T08:59:34.319 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 33 M 2024-04-12T08:59:34.319 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-12T08:59:34.363 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-fuse-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T08:59:34.363 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:34.364 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-04-12T08:59:34.364 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-fuse-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:59:34.364 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:34.364 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:59:34.613 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install rbd-mirror 2024-04-12T08:59:35.163 INFO:teuthology.orchestra.run.smithi117.stdout:(1/6): ceph-mgr-cephadm-17.2.7-827.gd3b5060a.el 264 kB/s | 123 kB 00:00 2024-04-12T08:59:35.214 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:56 ago on Fri 12 Apr 2024 08:57:39 AM UTC. 2024-04-12T08:59:35.509 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:59:35.509 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:59:35.509 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:59:35.509 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.509 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:59:35.509 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.510 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:59:35.510 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.510 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:59:35.510 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.510 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:59:35.510 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.510 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:59:35.510 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.510 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:59:35.510 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.510 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:59:35.510 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.510 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:59:35.511 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.511 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:59:35.511 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.511 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:59:35.511 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.511 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:59:35.511 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.511 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:59:35.511 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.511 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:59:35.511 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.511 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:59:35.511 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.511 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:59:35.512 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.512 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:59:35.512 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.512 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:59:35.512 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.512 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:59:35.512 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.512 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:59:35.512 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.512 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:59:35.512 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.512 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:59:35.512 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.512 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:59:35.513 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.513 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:59:35.513 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.513 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:59:35.513 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.513 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:59:35.513 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.513 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:59:35.513 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.513 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:59:35.513 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.513 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:59:35.513 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.514 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:59:35.514 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.514 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:59:35.514 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.514 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:59:35.514 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.514 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:59:35.514 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.514 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:59:35.514 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.514 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:59:35.514 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.514 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:59:35.514 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.515 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:59:35.515 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.515 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.515 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.515 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:35.515 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.515 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.515 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.515 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.515 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:59:35.515 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.515 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.515 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.515 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.516 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.516 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.516 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:35.516 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.516 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.516 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.516 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.516 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:35.516 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.516 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.516 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.516 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.516 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:35.516 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.517 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.517 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.517 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.517 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:35.517 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.517 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.517 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.517 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.517 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:35.517 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.517 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.517 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.517 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.517 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:35.517 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.518 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.518 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.518 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:35.577 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:59:35.578 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:59:35.578 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repo Size 2024-04-12T08:59:35.578 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:59:35.579 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-04-12T08:59:35.579 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-mirror x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 2.9 M 2024-04-12T08:59:35.579 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:35.579 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-04-12T08:59:35.579 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:59:35.579 INFO:teuthology.orchestra.run.smithi203.stdout:Install 1 Package 2024-04-12T08:59:35.579 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:35.579 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 2.9 M 2024-04-12T08:59:35.579 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 12 M 2024-04-12T08:59:35.579 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-04-12T08:59:35.664 INFO:teuthology.orchestra.run.smithi117.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.1 MB/s | 548 kB 00:00 2024-04-12T08:59:35.747 INFO:teuthology.orchestra.run.smithi117.stdout:(3/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 236 kB/s | 248 kB 00:01 2024-04-12T08:59:35.789 INFO:teuthology.orchestra.run.smithi117.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 461 kB/s | 58 kB 00:00 2024-04-12T08:59:35.964 INFO:teuthology.orchestra.run.smithi203.stdout:rbd-mirror-17.2.7-827.gd3b5060a.el9.x86_64.rpm 7.6 MB/s | 2.9 MB 00:00 2024-04-12T08:59:35.965 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:59:35.965 INFO:teuthology.orchestra.run.smithi203.stdout:Total 7.6 MB/s | 2.9 MB 00:00 2024-04-12T08:59:35.965 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-04-12T08:59:35.974 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-04-12T08:59:35.974 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-04-12T08:59:36.049 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-04-12T08:59:36.049 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-04-12T08:59:36.064 INFO:teuthology.orchestra.run.smithi117.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 161 kB/s | 51 kB 00:00 2024-04-12T08:59:36.463 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-04-12T08:59:36.573 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-mirror-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T08:59:36.598 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: rbd-mirror-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T08:59:36.598 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T08:59:36.598 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-12T08:59:36.598 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-12T08:59:36.598 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-12T08:59:36.598 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:37.787 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-mirror-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T08:59:37.787 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:37.787 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-04-12T08:59:37.787 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-mirror-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:59:37.787 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:37.787 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:59:38.058 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install rbd-nbd 2024-04-12T08:59:38.671 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:59 ago on Fri 12 Apr 2024 08:57:39 AM UTC. 2024-04-12T08:59:38.960 INFO:teuthology.orchestra.run.smithi203.stderr:Modular dependency problems: 2024-04-12T08:59:38.960 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T08:59:38.960 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 1: conflicting requests 2024-04-12T08:59:38.960 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.961 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 2: conflicting requests 2024-04-12T08:59:38.961 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.961 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 3: conflicting requests 2024-04-12T08:59:38.961 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.961 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 4: conflicting requests 2024-04-12T08:59:38.961 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.961 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 5: conflicting requests 2024-04-12T08:59:38.961 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.961 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 6: conflicting requests 2024-04-12T08:59:38.961 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.961 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 7: conflicting requests 2024-04-12T08:59:38.961 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.961 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 8: conflicting requests 2024-04-12T08:59:38.961 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.961 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 9: conflicting requests 2024-04-12T08:59:38.962 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.962 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 10: conflicting requests 2024-04-12T08:59:38.962 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.962 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 11: conflicting requests 2024-04-12T08:59:38.962 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.962 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 12: conflicting requests 2024-04-12T08:59:38.962 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.962 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 13: conflicting requests 2024-04-12T08:59:38.962 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.962 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 14: conflicting requests 2024-04-12T08:59:38.962 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.962 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 15: conflicting requests 2024-04-12T08:59:38.962 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.963 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 16: conflicting requests 2024-04-12T08:59:38.963 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.963 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 17: conflicting requests 2024-04-12T08:59:38.963 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.963 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 18: conflicting requests 2024-04-12T08:59:38.963 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.963 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 19: conflicting requests 2024-04-12T08:59:38.963 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.963 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 20: conflicting requests 2024-04-12T08:59:38.963 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.963 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 21: conflicting requests 2024-04-12T08:59:38.963 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.963 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 22: conflicting requests 2024-04-12T08:59:38.963 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.963 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 23: conflicting requests 2024-04-12T08:59:38.964 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.964 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 24: conflicting requests 2024-04-12T08:59:38.964 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.964 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 25: conflicting requests 2024-04-12T08:59:38.964 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.964 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 26: conflicting requests 2024-04-12T08:59:38.964 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.964 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 27: conflicting requests 2024-04-12T08:59:38.964 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.964 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 28: conflicting requests 2024-04-12T08:59:38.964 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.964 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 29: conflicting requests 2024-04-12T08:59:38.964 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.964 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 30: conflicting requests 2024-04-12T08:59:38.965 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.965 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 31: conflicting requests 2024-04-12T08:59:38.965 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.965 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 32: conflicting requests 2024-04-12T08:59:38.965 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.965 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 33: conflicting requests 2024-04-12T08:59:38.965 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.965 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 34: conflicting requests 2024-04-12T08:59:38.965 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.965 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 35: conflicting requests 2024-04-12T08:59:38.965 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.965 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 36: conflicting requests 2024-04-12T08:59:38.965 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.965 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 37: conflicting requests 2024-04-12T08:59:38.965 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.966 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.966 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.966 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:38.966 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.966 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.966 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.966 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.966 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 39: conflicting requests 2024-04-12T08:59:38.966 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.966 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.966 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.966 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.966 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.966 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.966 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:38.967 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.967 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.967 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.967 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.967 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:38.967 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.967 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.967 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.967 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.967 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:38.967 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.967 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.967 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.967 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.968 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:38.968 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.968 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.968 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.968 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.968 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:38.968 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.968 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.968 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.968 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.968 INFO:teuthology.orchestra.run.smithi203.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:38.968 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.968 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.968 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:38.969 INFO:teuthology.orchestra.run.smithi203.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:39.029 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-04-12T08:59:39.030 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:59:39.030 INFO:teuthology.orchestra.run.smithi203.stdout: Package Architecture Version Repository Size 2024-04-12T08:59:39.030 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:59:39.030 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-04-12T08:59:39.030 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-nbd x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 165 k 2024-04-12T08:59:39.030 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:39.030 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-04-12T08:59:39.030 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-04-12T08:59:39.031 INFO:teuthology.orchestra.run.smithi203.stdout:Install 1 Package 2024-04-12T08:59:39.031 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:39.031 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 165 k 2024-04-12T08:59:39.031 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 477 k 2024-04-12T08:59:39.031 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-04-12T08:59:39.376 INFO:teuthology.orchestra.run.smithi203.stdout:rbd-nbd-17.2.7-827.gd3b5060a.el9.x86_64.rpm 478 kB/s | 165 kB 00:00 2024-04-12T08:59:39.377 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:59:39.377 INFO:teuthology.orchestra.run.smithi203.stdout:Total 476 kB/s | 165 kB 00:00 2024-04-12T08:59:39.377 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-04-12T08:59:39.385 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-04-12T08:59:39.385 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-04-12T08:59:39.444 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-04-12T08:59:39.445 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-04-12T08:59:39.590 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-04-12T08:59:39.700 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-nbd-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T08:59:40.107 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: rbd-nbd-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T08:59:40.410 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-nbd-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T08:59:40.410 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:40.411 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-04-12T08:59:40.411 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-nbd-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:59:40.411 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T08:59:40.411 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-04-12T08:59:40.666 DEBUG:teuthology.parallel:result is None 2024-04-12T08:59:43.622 INFO:teuthology.orchestra.run.smithi117.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 684 kB/s | 6.0 MB 00:08 2024-04-12T08:59:43.623 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:59:43.623 INFO:teuthology.orchestra.run.smithi117.stdout:Total 767 kB/s | 7.0 MB 00:09 2024-04-12T08:59:43.697 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-12T08:59:43.709 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-12T08:59:43.709 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-12T08:59:43.813 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-12T08:59:43.813 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-12T08:59:44.132 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-12T08:59:44.317 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-12T08:59:44.374 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-12T08:59:44.912 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-12T08:59:45.001 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-12T08:59:45.056 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-12T08:59:45.085 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-827.gd3b5060a.el9.noarch 6/6 2024-04-12T08:59:45.887 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-827.gd3b5060a.el9.noarch 6/6 2024-04-12T08:59:45.887 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-827.gd3b5060a.el9.noarch 1/6 2024-04-12T08:59:45.887 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-12T08:59:45.887 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-12T08:59:45.887 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-12T08:59:45.887 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-12T08:59:46.205 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-12T08:59:46.205 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:59:46.205 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-12T08:59:46.205 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm-2:17.2.7-827.gd3b5060a.el9.noarch 2024-04-12T08:59:46.205 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-12T08:59:46.205 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-12T08:59:46.205 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-12T08:59:46.205 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-12T08:59:46.205 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-12T08:59:46.205 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:59:46.206 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T08:59:46.458 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-fuse 2024-04-12T08:59:47.058 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:06 ago on Fri 12 Apr 2024 08:57:41 AM UTC. 2024-04-12T08:59:47.349 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T08:59:47.349 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T08:59:47.349 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T08:59:47.350 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.350 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T08:59:47.350 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.350 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T08:59:47.350 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.350 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T08:59:47.350 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.350 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T08:59:47.350 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.350 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T08:59:47.350 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.350 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T08:59:47.350 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.350 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T08:59:47.351 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.351 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T08:59:47.351 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.351 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T08:59:47.351 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.351 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T08:59:47.351 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.351 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T08:59:47.351 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.351 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T08:59:47.354 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.354 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T08:59:47.354 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.354 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T08:59:47.354 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.354 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T08:59:47.354 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.354 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T08:59:47.354 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.354 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T08:59:47.354 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.354 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T08:59:47.355 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.355 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T08:59:47.355 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.355 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T08:59:47.355 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.355 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T08:59:47.355 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.355 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T08:59:47.355 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.355 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T08:59:47.355 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.355 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T08:59:47.355 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.355 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T08:59:47.356 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.356 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T08:59:47.356 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.356 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T08:59:47.356 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.356 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T08:59:47.356 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.356 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T08:59:47.356 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.356 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T08:59:47.356 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.356 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T08:59:47.356 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.356 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T08:59:47.356 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.357 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T08:59:47.357 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.357 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T08:59:47.357 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.357 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T08:59:47.357 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.357 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T08:59:47.357 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.357 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.357 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.357 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:47.357 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.357 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.357 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.358 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.358 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T08:59:47.358 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.358 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.358 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.358 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.358 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.358 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.358 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:47.358 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.358 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.358 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.358 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.359 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:47.359 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.359 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.359 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.359 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.359 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:47.359 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.359 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.359 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.359 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.359 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:47.359 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.359 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.359 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.359 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.360 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:47.360 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.360 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.360 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.360 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.360 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:47.360 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.360 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.360 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.360 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:47.419 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T08:59:47.419 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:59:47.419 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-04-12T08:59:47.419 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:59:47.419 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-12T08:59:47.420 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 812 k 2024-04-12T08:59:47.420 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-04-12T08:59:47.420 INFO:teuthology.orchestra.run.smithi117.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-12T08:59:47.420 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:59:47.420 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-12T08:59:47.420 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:59:47.420 INFO:teuthology.orchestra.run.smithi117.stdout:Install 2 Packages 2024-04-12T08:59:47.420 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:59:47.421 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 892 k 2024-04-12T08:59:47.421 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 2.6 M 2024-04-12T08:59:47.421 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-12T08:59:47.581 INFO:teuthology.orchestra.run.smithi117.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 803 kB/s | 80 kB 00:00 2024-04-12T08:59:47.773 INFO:teuthology.orchestra.run.smithi117.stdout:(2/2): ceph-fuse-17.2.7-827.gd3b5060a.el9.x86_6 2.7 MB/s | 812 kB 00:00 2024-04-12T08:59:47.773 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:59:47.773 INFO:teuthology.orchestra.run.smithi117.stdout:Total 2.5 MB/s | 892 kB 00:00 2024-04-12T08:59:47.785 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-12T08:59:47.806 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-12T08:59:47.807 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-12T08:59:47.882 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-12T08:59:47.882 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-12T08:59:48.126 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-12T08:59:48.258 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-12T08:59:48.322 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-fuse-2:17.2.7-827.gd3b5060a.el9.x86_64 2/2 2024-04-12T08:59:49.033 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-fuse-2:17.2.7-827.gd3b5060a.el9.x86_64 2/2 2024-04-12T08:59:49.034 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-fuse-2:17.2.7-827.gd3b5060a.el9.x86_64 1/2 2024-04-12T08:59:49.354 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-12T08:59:49.354 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:59:49.354 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-12T08:59:49.354 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse-2:17.2.7-827.gd3b5060a.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-12T08:59:49.355 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:59:49.355 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T08:59:49.627 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install librados-devel 2024-04-12T08:59:50.237 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:09 ago on Fri 12 Apr 2024 08:57:41 AM UTC. 2024-04-12T08:59:50.529 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T08:59:50.529 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T08:59:50.529 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T08:59:50.529 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.529 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T08:59:50.529 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.529 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T08:59:50.529 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.529 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T08:59:50.529 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.529 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T08:59:50.529 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.530 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T08:59:50.530 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.530 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T08:59:50.530 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.530 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T08:59:50.530 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.530 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T08:59:50.530 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.530 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T08:59:50.530 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.530 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T08:59:50.530 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.530 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T08:59:50.530 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.530 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T08:59:50.531 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.531 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T08:59:50.531 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.531 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T08:59:50.531 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.531 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T08:59:50.531 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.531 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T08:59:50.531 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.531 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T08:59:50.531 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.531 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T08:59:50.531 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.531 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T08:59:50.531 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.531 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T08:59:50.532 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.532 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T08:59:50.532 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.532 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T08:59:50.532 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.532 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T08:59:50.532 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.532 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T08:59:50.532 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.532 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T08:59:50.532 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.532 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T08:59:50.532 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.532 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T08:59:50.532 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.532 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T08:59:50.533 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.533 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T08:59:50.533 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.533 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T08:59:50.533 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.533 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T08:59:50.533 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.533 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T08:59:50.533 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.533 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T08:59:50.533 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.533 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T08:59:50.533 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.533 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T08:59:50.533 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.533 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T08:59:50.534 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.534 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.534 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.534 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:50.534 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.534 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.534 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.534 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.534 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T08:59:50.534 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.534 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.534 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.534 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.534 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.535 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.535 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:50.535 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.535 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.535 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.535 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.535 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:50.535 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.535 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.535 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.535 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.535 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:50.535 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.535 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.535 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.536 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.536 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:50.536 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.536 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.536 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.536 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.536 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:50.536 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.536 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.536 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.536 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.536 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:50.536 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.536 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.536 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.537 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:50.598 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T08:59:50.599 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:59:50.599 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repo Size 2024-04-12T08:59:50.599 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:59:50.599 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-12T08:59:50.599 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 126 k 2024-04-12T08:59:50.599 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:59:50.599 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-12T08:59:50.599 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:59:50.599 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-04-12T08:59:50.599 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:59:50.600 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 126 k 2024-04-12T08:59:50.600 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 448 k 2024-04-12T08:59:50.600 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-12T08:59:50.818 INFO:teuthology.orchestra.run.smithi117.stdout:librados-devel-17.2.7-827.gd3b5060a.el9.x86_64. 579 kB/s | 126 kB 00:00 2024-04-12T08:59:50.819 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:59:50.819 INFO:teuthology.orchestra.run.smithi117.stdout:Total 575 kB/s | 126 kB 00:00 2024-04-12T08:59:50.819 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-12T08:59:50.824 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-12T08:59:50.824 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-12T08:59:50.882 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-12T08:59:50.882 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-12T08:59:51.033 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-12T08:59:51.124 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librados-devel-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T08:59:51.597 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados-devel-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T08:59:51.880 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados-devel-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T08:59:51.880 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:59:51.880 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-12T08:59:51.881 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:59:51.881 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:59:51.881 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T08:59:52.127 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install libcephfs2 2024-04-12T08:59:52.731 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:11 ago on Fri 12 Apr 2024 08:57:41 AM UTC. 2024-04-12T08:59:53.031 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T08:59:53.031 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T08:59:53.031 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T08:59:53.031 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.031 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T08:59:53.031 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.031 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T08:59:53.032 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.032 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T08:59:53.032 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.032 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T08:59:53.032 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.032 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T08:59:53.032 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.032 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T08:59:53.032 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.032 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T08:59:53.032 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.032 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T08:59:53.032 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.033 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T08:59:53.033 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.033 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T08:59:53.033 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.033 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T08:59:53.033 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.033 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T08:59:53.033 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.033 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T08:59:53.033 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.033 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T08:59:53.033 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.033 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T08:59:53.034 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.034 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T08:59:53.034 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.034 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T08:59:53.034 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.034 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T08:59:53.034 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.034 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T08:59:53.034 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.034 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T08:59:53.034 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.034 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T08:59:53.035 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.035 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T08:59:53.035 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.035 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T08:59:53.035 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.035 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T08:59:53.035 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.035 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T08:59:53.035 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.035 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T08:59:53.035 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.035 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T08:59:53.035 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.036 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T08:59:53.036 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.036 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T08:59:53.036 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.036 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T08:59:53.036 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.036 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T08:59:53.036 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.036 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T08:59:53.036 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.036 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T08:59:53.036 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.037 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T08:59:53.037 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.037 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T08:59:53.037 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.037 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T08:59:53.037 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.037 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.037 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.037 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:53.037 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.037 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.037 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.037 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.038 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T08:59:53.038 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.038 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.038 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.038 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.038 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.038 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.038 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:53.038 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.038 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.038 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.038 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.038 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:53.039 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.039 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.039 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.039 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.039 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:53.039 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.039 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.039 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.039 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.039 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:53.039 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.039 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.040 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.040 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.040 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:53.040 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.040 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.040 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.040 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.040 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:53.040 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.040 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.040 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.040 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:53.041 INFO:teuthology.orchestra.run.smithi117.stdout:Package libcephfs2-2:17.2.7-827.gd3b5060a.el9.x86_64 is already installed. 2024-04-12T08:59:53.100 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T08:59:53.101 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-04-12T08:59:53.101 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T08:59:53.180 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install libcephfs-devel 2024-04-12T08:59:53.815 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:12 ago on Fri 12 Apr 2024 08:57:41 AM UTC. 2024-04-12T08:59:54.118 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T08:59:54.118 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T08:59:54.118 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T08:59:54.118 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.119 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T08:59:54.119 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.119 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T08:59:54.119 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.119 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T08:59:54.119 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.119 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T08:59:54.119 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.119 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T08:59:54.119 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.119 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T08:59:54.119 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.120 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T08:59:54.120 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.120 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T08:59:54.120 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.120 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T08:59:54.120 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.120 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T08:59:54.120 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.120 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T08:59:54.120 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.120 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T08:59:54.120 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.120 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T08:59:54.120 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.120 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T08:59:54.121 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.121 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T08:59:54.121 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.121 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T08:59:54.121 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.121 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T08:59:54.121 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.121 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T08:59:54.121 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.121 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T08:59:54.121 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.121 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T08:59:54.121 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.121 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T08:59:54.121 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.122 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T08:59:54.122 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.122 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T08:59:54.122 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.122 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T08:59:54.122 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.122 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T08:59:54.122 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.122 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T08:59:54.122 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.122 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T08:59:54.122 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.123 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T08:59:54.123 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.123 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T08:59:54.123 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.123 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T08:59:54.123 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.123 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T08:59:54.123 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.123 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T08:59:54.123 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.123 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T08:59:54.123 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.123 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T08:59:54.123 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.124 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T08:59:54.124 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.124 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T08:59:54.124 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.124 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.124 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.124 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:54.124 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.124 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.124 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.124 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.124 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T08:59:54.124 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.124 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.125 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.125 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.125 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.125 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.125 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:54.125 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.125 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.125 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.125 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.125 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:54.125 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.125 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.125 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.125 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.125 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:54.126 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.126 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.126 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.126 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.126 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:54.126 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.126 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.126 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.126 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.126 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:54.126 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.126 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.126 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.127 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.127 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:54.127 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.127 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.127 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.127 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:54.190 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T08:59:54.191 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:59:54.191 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repo Size 2024-04-12T08:59:54.191 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:59:54.191 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-12T08:59:54.191 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 25 k 2024-04-12T08:59:54.191 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:59:54.191 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-12T08:59:54.191 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T08:59:54.192 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-04-12T08:59:54.192 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:59:54.192 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 25 k 2024-04-12T08:59:54.192 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 110 k 2024-04-12T08:59:54.192 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-12T08:59:54.357 INFO:teuthology.orchestra.run.smithi117.stdout:libcephfs-devel-17.2.7-827.gd3b5060a.el9.x86_64 152 kB/s | 25 kB 00:00 2024-04-12T08:59:54.357 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-12T08:59:54.358 INFO:teuthology.orchestra.run.smithi117.stdout:Total 150 kB/s | 25 kB 00:00 2024-04-12T08:59:54.358 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-12T08:59:54.361 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-12T08:59:54.361 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-12T08:59:54.363 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-12T08:59:54.363 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-12T08:59:54.448 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-12T08:59:54.554 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs-devel-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T08:59:54.922 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T08:59:55.202 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs-devel-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T08:59:55.202 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:59:55.202 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-12T08:59:55.202 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T08:59:55.202 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T08:59:55.202 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T08:59:55.377 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install librados2 2024-04-12T08:59:55.974 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:14 ago on Fri 12 Apr 2024 08:57:41 AM UTC. 2024-04-12T08:59:56.261 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T08:59:56.261 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T08:59:56.261 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T08:59:56.261 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.261 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T08:59:56.261 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.261 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T08:59:56.262 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.262 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T08:59:56.262 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.262 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T08:59:56.262 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.262 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T08:59:56.262 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.262 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T08:59:56.262 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.262 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T08:59:56.262 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.262 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T08:59:56.262 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.263 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T08:59:56.263 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.263 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T08:59:56.263 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.263 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T08:59:56.263 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.263 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T08:59:56.263 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.263 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T08:59:56.263 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.263 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T08:59:56.263 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.263 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T08:59:56.263 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.263 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T08:59:56.264 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.264 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T08:59:56.264 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.264 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T08:59:56.264 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.264 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T08:59:56.264 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.264 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T08:59:56.264 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.264 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T08:59:56.264 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.264 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T08:59:56.264 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.265 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T08:59:56.265 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.265 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T08:59:56.265 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.265 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T08:59:56.265 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.265 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T08:59:56.265 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.265 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T08:59:56.265 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.265 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T08:59:56.265 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.265 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T08:59:56.265 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.266 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T08:59:56.266 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.266 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T08:59:56.266 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.266 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T08:59:56.266 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.266 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T08:59:56.266 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.266 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T08:59:56.266 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.266 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T08:59:56.266 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.266 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T08:59:56.266 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.267 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.267 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.267 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:56.267 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.267 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.267 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.267 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.267 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T08:59:56.267 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.267 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.267 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.267 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.267 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.267 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.268 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:56.268 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.268 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.268 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.268 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.268 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:56.268 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.268 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.268 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.268 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.268 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:56.268 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.268 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.268 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.268 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.269 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:56.269 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.269 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.269 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.269 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.269 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:56.269 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.269 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.269 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.269 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.269 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:56.269 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.269 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.269 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.270 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:56.270 INFO:teuthology.orchestra.run.smithi117.stdout:Package librados2-2:17.2.7-827.gd3b5060a.el9.x86_64 is already installed. 2024-04-12T08:59:56.331 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T08:59:56.332 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-04-12T08:59:56.333 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T08:59:56.406 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install librbd1 2024-04-12T08:59:57.004 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:16 ago on Fri 12 Apr 2024 08:57:41 AM UTC. 2024-04-12T08:59:57.295 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T08:59:57.295 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T08:59:57.295 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T08:59:57.295 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.295 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T08:59:57.295 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.295 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T08:59:57.295 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.295 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T08:59:57.295 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.295 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T08:59:57.295 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.296 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T08:59:57.296 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.296 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T08:59:57.296 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.296 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T08:59:57.296 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.296 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T08:59:57.296 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.296 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T08:59:57.296 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.296 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T08:59:57.296 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.296 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T08:59:57.296 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.296 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T08:59:57.297 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.297 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T08:59:57.297 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.297 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T08:59:57.297 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.297 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T08:59:57.297 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.297 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T08:59:57.297 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.297 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T08:59:57.297 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.297 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T08:59:57.297 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.297 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T08:59:57.298 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.298 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T08:59:57.298 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.298 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T08:59:57.298 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.298 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T08:59:57.298 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.298 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T08:59:57.298 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.298 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T08:59:57.298 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.298 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T08:59:57.298 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.299 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T08:59:57.299 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.299 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T08:59:57.299 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.299 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T08:59:57.299 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.299 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T08:59:57.299 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.299 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T08:59:57.299 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.299 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T08:59:57.299 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.299 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T08:59:57.299 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.300 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T08:59:57.300 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.300 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T08:59:57.300 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.300 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T08:59:57.300 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.300 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T08:59:57.300 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.300 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.300 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.300 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:57.300 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.300 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.300 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.301 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.301 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T08:59:57.301 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.301 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.301 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.301 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.301 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.301 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.301 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:57.301 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.301 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.301 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.301 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.301 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:57.302 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.302 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.302 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.302 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.302 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:57.302 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.302 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.302 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.302 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.302 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:57.302 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.302 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.302 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.302 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.303 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:57.303 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.303 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.303 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.303 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.303 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:57.303 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.303 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.303 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.303 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:57.304 INFO:teuthology.orchestra.run.smithi117.stdout:Package librbd1-2:17.2.7-827.gd3b5060a.el9.x86_64 is already installed. 2024-04-12T08:59:57.364 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T08:59:57.365 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-04-12T08:59:57.365 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T08:59:57.447 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install python3-rados 2024-04-12T08:59:58.041 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:17 ago on Fri 12 Apr 2024 08:57:41 AM UTC. 2024-04-12T08:59:58.330 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T08:59:58.330 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T08:59:58.331 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T08:59:58.331 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.331 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T08:59:58.331 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.331 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T08:59:58.331 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.331 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T08:59:58.331 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.331 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T08:59:58.331 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.331 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T08:59:58.331 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.332 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T08:59:58.332 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.332 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T08:59:58.332 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.332 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T08:59:58.332 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.332 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T08:59:58.332 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.332 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T08:59:58.332 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.332 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T08:59:58.332 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.332 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T08:59:58.332 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.333 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T08:59:58.333 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.333 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T08:59:58.333 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.333 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T08:59:58.333 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.333 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T08:59:58.333 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.333 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T08:59:58.333 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.333 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T08:59:58.333 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.333 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T08:59:58.333 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.333 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T08:59:58.334 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.334 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T08:59:58.334 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.334 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T08:59:58.334 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.334 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T08:59:58.334 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.334 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T08:59:58.334 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.334 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T08:59:58.334 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.334 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T08:59:58.334 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.335 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T08:59:58.335 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.335 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T08:59:58.335 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.335 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T08:59:58.335 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.335 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T08:59:58.335 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.335 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T08:59:58.335 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.335 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T08:59:58.335 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.335 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T08:59:58.335 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.335 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T08:59:58.336 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.336 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T08:59:58.336 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.336 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T08:59:58.336 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.336 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.336 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.336 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:58.336 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.336 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.336 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.336 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.336 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T08:59:58.336 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.336 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.336 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.337 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.337 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.337 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.337 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:58.337 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.337 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.337 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.337 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.337 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:58.337 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.337 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.337 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.337 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.337 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:58.337 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.337 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.338 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.338 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.338 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:58.338 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.338 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.338 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.338 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.338 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:58.338 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.338 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.338 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.338 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.338 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:58.338 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.339 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.339 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.339 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:58.342 INFO:teuthology.orchestra.run.smithi117.stdout:Package python3-rados-2:17.2.7-827.gd3b5060a.el9.x86_64 is already installed. 2024-04-12T08:59:58.399 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T08:59:58.400 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-04-12T08:59:58.400 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T08:59:58.484 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install python3-rgw 2024-04-12T08:59:59.075 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:18 ago on Fri 12 Apr 2024 08:57:41 AM UTC. 2024-04-12T08:59:59.361 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T08:59:59.362 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T08:59:59.362 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T08:59:59.362 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.362 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T08:59:59.362 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.362 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T08:59:59.362 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.362 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T08:59:59.362 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.362 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T08:59:59.362 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.362 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T08:59:59.362 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.362 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T08:59:59.363 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.363 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T08:59:59.363 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.363 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T08:59:59.363 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.363 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T08:59:59.363 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.363 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T08:59:59.363 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.363 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T08:59:59.363 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.363 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T08:59:59.363 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.363 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T08:59:59.364 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.364 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T08:59:59.364 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.364 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T08:59:59.364 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.364 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T08:59:59.364 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.364 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T08:59:59.364 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.364 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T08:59:59.364 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.364 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T08:59:59.364 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.364 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T08:59:59.364 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.364 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T08:59:59.365 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.365 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T08:59:59.365 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.365 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T08:59:59.365 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.365 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T08:59:59.365 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.365 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T08:59:59.365 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.365 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T08:59:59.365 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.365 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T08:59:59.365 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.365 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T08:59:59.366 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.366 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T08:59:59.366 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.366 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T08:59:59.366 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.366 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T08:59:59.366 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.366 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T08:59:59.366 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.366 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T08:59:59.366 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.366 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T08:59:59.366 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.366 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T08:59:59.367 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.367 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T08:59:59.367 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.367 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.367 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.367 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T08:59:59.367 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.367 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.367 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.367 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.367 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T08:59:59.367 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.367 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.367 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.367 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.367 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.368 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.368 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T08:59:59.368 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.368 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.368 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.368 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.368 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T08:59:59.368 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.368 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.368 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.368 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.368 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T08:59:59.368 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.368 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.368 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.369 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.369 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T08:59:59.369 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.369 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.369 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.369 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.369 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T08:59:59.369 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.369 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.369 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.369 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.369 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T08:59:59.369 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.369 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.369 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.369 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T08:59:59.370 INFO:teuthology.orchestra.run.smithi117.stdout:Package python3-rgw-2:17.2.7-827.gd3b5060a.el9.x86_64 is already installed. 2024-04-12T08:59:59.430 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T08:59:59.431 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-04-12T08:59:59.432 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T08:59:59.505 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install python3-cephfs 2024-04-12T09:00:00.100 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:19 ago on Fri 12 Apr 2024 08:57:41 AM UTC. 2024-04-12T09:00:00.389 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T09:00:00.390 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T09:00:00.390 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T09:00:00.390 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.390 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T09:00:00.390 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.390 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T09:00:00.390 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.390 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T09:00:00.390 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.390 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T09:00:00.390 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.390 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T09:00:00.390 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.391 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T09:00:00.391 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.391 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T09:00:00.391 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.391 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T09:00:00.391 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.391 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T09:00:00.391 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.391 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T09:00:00.391 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.391 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T09:00:00.391 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.391 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T09:00:00.391 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.391 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T09:00:00.392 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.392 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T09:00:00.392 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.392 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T09:00:00.392 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.392 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T09:00:00.392 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.392 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T09:00:00.392 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.392 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T09:00:00.392 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.392 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T09:00:00.392 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.392 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T09:00:00.392 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.392 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T09:00:00.393 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.393 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T09:00:00.393 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.393 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T09:00:00.393 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.393 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T09:00:00.393 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.393 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T09:00:00.393 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.393 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T09:00:00.393 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.393 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T09:00:00.393 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.393 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T09:00:00.394 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.394 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T09:00:00.394 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.394 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T09:00:00.394 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.394 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T09:00:00.394 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.394 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T09:00:00.394 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.394 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T09:00:00.394 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.394 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T09:00:00.394 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.394 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T09:00:00.395 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.395 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T09:00:00.395 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.395 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.395 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.395 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T09:00:00.395 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.395 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.395 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.395 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.395 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T09:00:00.395 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.395 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.395 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.395 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.396 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.396 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.396 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T09:00:00.396 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.396 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.396 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.396 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.396 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T09:00:00.396 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.396 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.396 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.396 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.396 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T09:00:00.396 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.396 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.396 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.397 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.397 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T09:00:00.397 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.397 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.397 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.397 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.397 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T09:00:00.397 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.397 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.397 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.397 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.397 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T09:00:00.397 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.397 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.397 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.397 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T09:00:00.398 INFO:teuthology.orchestra.run.smithi117.stdout:Package python3-cephfs-2:17.2.7-827.gd3b5060a.el9.x86_64 is already installed. 2024-04-12T09:00:00.460 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T09:00:00.461 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-04-12T09:00:00.462 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T09:00:00.533 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install python3-rbd 2024-04-12T09:00:01.130 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:20 ago on Fri 12 Apr 2024 08:57:41 AM UTC. 2024-04-12T09:00:01.422 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T09:00:01.422 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T09:00:01.422 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T09:00:01.422 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.422 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T09:00:01.422 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.422 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T09:00:01.422 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.422 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T09:00:01.423 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.423 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T09:00:01.423 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.423 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T09:00:01.423 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.423 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T09:00:01.423 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.423 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T09:00:01.423 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.423 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T09:00:01.423 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.423 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T09:00:01.423 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.423 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T09:00:01.424 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.424 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T09:00:01.424 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.424 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T09:00:01.424 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.424 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T09:00:01.424 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.424 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T09:00:01.424 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.424 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T09:00:01.424 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.424 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T09:00:01.424 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.424 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T09:00:01.424 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.424 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T09:00:01.425 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.425 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T09:00:01.425 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.425 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T09:00:01.425 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.425 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T09:00:01.425 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.425 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T09:00:01.425 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.425 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T09:00:01.425 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.425 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T09:00:01.425 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.425 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T09:00:01.426 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.426 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T09:00:01.426 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.426 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T09:00:01.426 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.426 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T09:00:01.426 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.426 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T09:00:01.426 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.426 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T09:00:01.426 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.426 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T09:00:01.426 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.426 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T09:00:01.426 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.426 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T09:00:01.427 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.427 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T09:00:01.427 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.427 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T09:00:01.427 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.427 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T09:00:01.427 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.427 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.427 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.427 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T09:00:01.427 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.427 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.427 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.427 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.428 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T09:00:01.428 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.428 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.428 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.428 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.428 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.428 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.428 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T09:00:01.428 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.428 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.428 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.428 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.428 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T09:00:01.428 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.428 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.429 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.429 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.429 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T09:00:01.429 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.429 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.429 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.429 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.429 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T09:00:01.429 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.429 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.429 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.429 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.429 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T09:00:01.429 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.429 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.429 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.430 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.430 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T09:00:01.430 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.430 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.430 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.430 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T09:00:01.430 INFO:teuthology.orchestra.run.smithi117.stdout:Package python3-rbd-2:17.2.7-827.gd3b5060a.el9.x86_64 is already installed. 2024-04-12T09:00:01.491 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T09:00:01.492 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-04-12T09:00:01.492 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T09:00:01.571 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install rbd-fuse 2024-04-12T09:00:02.175 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:21 ago on Fri 12 Apr 2024 08:57:41 AM UTC. 2024-04-12T09:00:02.465 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T09:00:02.466 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T09:00:02.466 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T09:00:02.466 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.466 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T09:00:02.466 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.466 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T09:00:02.466 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.466 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T09:00:02.466 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.466 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T09:00:02.466 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.467 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T09:00:02.467 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.467 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T09:00:02.467 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.467 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T09:00:02.467 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.467 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T09:00:02.467 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.467 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T09:00:02.467 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.467 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T09:00:02.467 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.467 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T09:00:02.467 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.468 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T09:00:02.468 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.468 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T09:00:02.468 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.468 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T09:00:02.468 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.468 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T09:00:02.468 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.468 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T09:00:02.468 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.468 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T09:00:02.468 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.468 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T09:00:02.468 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.469 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T09:00:02.469 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.469 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T09:00:02.469 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.469 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T09:00:02.469 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.469 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T09:00:02.469 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.469 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T09:00:02.469 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.469 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T09:00:02.469 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.469 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T09:00:02.469 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.470 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T09:00:02.470 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.470 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T09:00:02.470 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.470 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T09:00:02.470 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.470 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T09:00:02.470 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.470 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T09:00:02.470 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.470 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T09:00:02.470 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.470 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T09:00:02.471 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.471 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T09:00:02.471 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.471 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T09:00:02.471 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.471 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T09:00:02.471 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.471 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T09:00:02.471 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.471 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.471 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.471 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T09:00:02.471 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.471 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.472 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.472 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.472 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T09:00:02.472 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.472 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.472 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.472 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.472 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.472 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.472 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T09:00:02.472 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.472 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.472 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.472 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.473 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T09:00:02.473 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.473 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.473 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.473 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.473 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T09:00:02.473 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.473 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.473 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.473 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.473 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T09:00:02.473 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.473 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.473 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.473 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.474 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T09:00:02.474 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.474 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.474 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.474 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.474 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T09:00:02.474 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.474 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.474 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.474 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T09:00:02.535 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T09:00:02.536 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T09:00:02.536 INFO:teuthology.orchestra.run.smithi117.stdout: Package Architecture Version Repository Size 2024-04-12T09:00:02.536 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T09:00:02.536 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-12T09:00:02.536 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 82 k 2024-04-12T09:00:02.536 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:00:02.536 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-12T09:00:02.536 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T09:00:02.536 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-04-12T09:00:02.536 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:00:02.537 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 82 k 2024-04-12T09:00:02.537 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 222 k 2024-04-12T09:00:02.537 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-12T09:00:02.877 INFO:teuthology.orchestra.run.smithi117.stdout:rbd-fuse-17.2.7-827.gd3b5060a.el9.x86_64.rpm 241 kB/s | 82 kB 00:00 2024-04-12T09:00:02.877 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-12T09:00:02.877 INFO:teuthology.orchestra.run.smithi117.stdout:Total 240 kB/s | 82 kB 00:00 2024-04-12T09:00:02.878 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-12T09:00:02.885 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-12T09:00:02.885 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-12T09:00:02.944 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-12T09:00:02.945 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-12T09:00:03.082 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-12T09:00:03.184 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-fuse-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T09:00:03.613 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-fuse-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T09:00:03.908 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-fuse-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T09:00:03.908 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:00:03.908 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-12T09:00:03.908 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T09:00:03.908 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:00:03.908 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T09:00:04.138 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install rbd-mirror 2024-04-12T09:00:04.748 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:23 ago on Fri 12 Apr 2024 08:57:41 AM UTC. 2024-04-12T09:00:05.044 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T09:00:05.044 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T09:00:05.044 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T09:00:05.044 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.044 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T09:00:05.044 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.045 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T09:00:05.045 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.045 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T09:00:05.045 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.045 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T09:00:05.045 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.045 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T09:00:05.045 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.045 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T09:00:05.045 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.045 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T09:00:05.045 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.045 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T09:00:05.045 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.045 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T09:00:05.045 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.046 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T09:00:05.046 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.046 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T09:00:05.046 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.046 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T09:00:05.046 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.046 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T09:00:05.046 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.046 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T09:00:05.046 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.046 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T09:00:05.046 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.046 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T09:00:05.047 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.047 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T09:00:05.047 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.047 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T09:00:05.047 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.047 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T09:00:05.047 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.047 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T09:00:05.047 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.047 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T09:00:05.047 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.047 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T09:00:05.047 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.047 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T09:00:05.047 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.048 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T09:00:05.048 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.048 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T09:00:05.048 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.048 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T09:00:05.048 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.048 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T09:00:05.048 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.048 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T09:00:05.048 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.048 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T09:00:05.048 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.048 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T09:00:05.049 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.049 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T09:00:05.049 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.049 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T09:00:05.049 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.049 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T09:00:05.049 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.049 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T09:00:05.049 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.049 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T09:00:05.049 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.049 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T09:00:05.049 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.049 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.049 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.050 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T09:00:05.050 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.050 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.050 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.050 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.050 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T09:00:05.050 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.050 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.050 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.050 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.050 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.050 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.050 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T09:00:05.050 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.050 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.051 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.051 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.051 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T09:00:05.051 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.051 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.051 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.051 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.051 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T09:00:05.051 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.051 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.051 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.051 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.051 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T09:00:05.051 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.052 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.052 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.052 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.052 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T09:00:05.052 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.052 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.052 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.052 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.052 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T09:00:05.052 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.052 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.052 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.052 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T09:00:05.114 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T09:00:05.115 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T09:00:05.115 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repo Size 2024-04-12T09:00:05.115 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T09:00:05.115 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-12T09:00:05.115 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 2.9 M 2024-04-12T09:00:05.115 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:00:05.115 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-12T09:00:05.115 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T09:00:05.116 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-04-12T09:00:05.116 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:00:05.116 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 2.9 M 2024-04-12T09:00:05.116 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 12 M 2024-04-12T09:00:05.116 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-12T09:00:06.221 INFO:teuthology.orchestra.run.smithi117.stdout:rbd-mirror-17.2.7-827.gd3b5060a.el9.x86_64.rpm 2.7 MB/s | 2.9 MB 00:01 2024-04-12T09:00:06.222 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-12T09:00:06.223 INFO:teuthology.orchestra.run.smithi117.stdout:Total 2.7 MB/s | 2.9 MB 00:01 2024-04-12T09:00:06.223 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-12T09:00:06.233 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-12T09:00:06.234 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-12T09:00:06.313 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-12T09:00:06.314 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-12T09:00:06.735 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-12T09:00:06.797 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-mirror-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T09:00:06.822 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-mirror-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T09:00:06.822 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T09:00:06.822 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-12T09:00:06.822 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-12T09:00:06.822 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-12T09:00:06.822 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:00:07.967 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-mirror-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T09:00:07.967 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:00:07.968 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-12T09:00:07.968 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T09:00:07.968 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:00:07.968 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T09:00:08.216 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install rbd-nbd 2024-04-12T09:00:08.835 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:02:27 ago on Fri 12 Apr 2024 08:57:41 AM UTC. 2024-04-12T09:00:09.124 INFO:teuthology.orchestra.run.smithi117.stderr:Modular dependency problems: 2024-04-12T09:00:09.124 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T09:00:09.125 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 1: conflicting requests 2024-04-12T09:00:09.125 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.125 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 2: conflicting requests 2024-04-12T09:00:09.125 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.125 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 3: conflicting requests 2024-04-12T09:00:09.125 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.125 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 4: conflicting requests 2024-04-12T09:00:09.125 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.125 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 5: conflicting requests 2024-04-12T09:00:09.125 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.125 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 6: conflicting requests 2024-04-12T09:00:09.125 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.126 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 7: conflicting requests 2024-04-12T09:00:09.126 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.126 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 8: conflicting requests 2024-04-12T09:00:09.126 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.126 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 9: conflicting requests 2024-04-12T09:00:09.126 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.126 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 10: conflicting requests 2024-04-12T09:00:09.126 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.126 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 11: conflicting requests 2024-04-12T09:00:09.126 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.126 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 12: conflicting requests 2024-04-12T09:00:09.126 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.126 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 13: conflicting requests 2024-04-12T09:00:09.126 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.127 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 14: conflicting requests 2024-04-12T09:00:09.127 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.127 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 15: conflicting requests 2024-04-12T09:00:09.127 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.127 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 16: conflicting requests 2024-04-12T09:00:09.127 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.127 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 17: conflicting requests 2024-04-12T09:00:09.127 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.127 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 18: conflicting requests 2024-04-12T09:00:09.127 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.127 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 19: conflicting requests 2024-04-12T09:00:09.127 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.127 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 20: conflicting requests 2024-04-12T09:00:09.127 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.128 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 21: conflicting requests 2024-04-12T09:00:09.128 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.128 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 22: conflicting requests 2024-04-12T09:00:09.128 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.128 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 23: conflicting requests 2024-04-12T09:00:09.128 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.128 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 24: conflicting requests 2024-04-12T09:00:09.128 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.128 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 25: conflicting requests 2024-04-12T09:00:09.128 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.128 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 26: conflicting requests 2024-04-12T09:00:09.128 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.128 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 27: conflicting requests 2024-04-12T09:00:09.128 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.128 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 28: conflicting requests 2024-04-12T09:00:09.129 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.129 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 29: conflicting requests 2024-04-12T09:00:09.129 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.129 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 30: conflicting requests 2024-04-12T09:00:09.129 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.129 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 31: conflicting requests 2024-04-12T09:00:09.129 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.129 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 32: conflicting requests 2024-04-12T09:00:09.129 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.129 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 33: conflicting requests 2024-04-12T09:00:09.129 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.129 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 34: conflicting requests 2024-04-12T09:00:09.129 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.129 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 35: conflicting requests 2024-04-12T09:00:09.129 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.130 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 36: conflicting requests 2024-04-12T09:00:09.130 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.130 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 37: conflicting requests 2024-04-12T09:00:09.130 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.130 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.130 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.130 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T09:00:09.130 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.130 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.130 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.130 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.130 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 39: conflicting requests 2024-04-12T09:00:09.130 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.131 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.131 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.131 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.131 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.131 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.131 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T09:00:09.131 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.131 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.131 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.131 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.131 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T09:00:09.131 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.131 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.131 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.132 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.132 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T09:00:09.132 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.132 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.132 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.132 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.132 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T09:00:09.132 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.132 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.132 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.133 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.133 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T09:00:09.133 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.133 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.133 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.133 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.133 INFO:teuthology.orchestra.run.smithi117.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T09:00:09.133 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.133 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.133 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.133 INFO:teuthology.orchestra.run.smithi117.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T09:00:09.194 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-04-12T09:00:09.194 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T09:00:09.195 INFO:teuthology.orchestra.run.smithi117.stdout: Package Architecture Version Repository Size 2024-04-12T09:00:09.195 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T09:00:09.195 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-04-12T09:00:09.195 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd x86_64 2:17.2.7-827.gd3b5060a.el9 ceph 165 k 2024-04-12T09:00:09.195 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:00:09.195 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-04-12T09:00:09.195 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-04-12T09:00:09.195 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-04-12T09:00:09.195 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:00:09.196 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 165 k 2024-04-12T09:00:09.196 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 477 k 2024-04-12T09:00:09.196 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-04-12T09:00:09.550 INFO:teuthology.orchestra.run.smithi117.stdout:rbd-nbd-17.2.7-827.gd3b5060a.el9.x86_64.rpm 467 kB/s | 165 kB 00:00 2024-04-12T09:00:09.550 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-12T09:00:09.551 INFO:teuthology.orchestra.run.smithi117.stdout:Total 464 kB/s | 165 kB 00:00 2024-04-12T09:00:09.551 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-04-12T09:00:09.558 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-04-12T09:00:09.558 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-04-12T09:00:09.617 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-04-12T09:00:09.618 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-04-12T09:00:09.774 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-04-12T09:00:09.875 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-nbd-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T09:00:10.287 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-nbd-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T09:00:10.617 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-nbd-2:17.2.7-827.gd3b5060a.el9.x86_64 1/1 2024-04-12T09:00:10.618 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:00:10.618 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-04-12T09:00:10.618 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd-2:17.2.7-827.gd3b5060a.el9.x86_64 2024-04-12T09:00:10.618 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:00:10.618 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-04-12T09:00:10.852 DEBUG:teuthology.parallel:result is None 2024-04-12T09:00:10.853 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-12T09:00:10.853 INFO:teuthology.packaging:ref: None 2024-04-12T09:00:10.853 INFO:teuthology.packaging:tag: None 2024-04-12T09:00:10.853 INFO:teuthology.packaging:branch: quincy 2024-04-12T09:00:10.853 INFO:teuthology.packaging:sha1: b277feb2c7beb4597d8ecc39d58d5c36b81f613a 2024-04-12T09:00:10.853 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-12T09:00:11.096 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-12T09:00:11.117 INFO:teuthology.orchestra.run.smithi117.stdout:17.2.7-827.gd3b5060a.el9 2024-04-12T09:00:11.118 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-827.gd3b5060a.el9 2024-04-12T09:00:11.118 INFO:teuthology.task.install:The correct ceph version 17.2.7-827.gd3b5060a is installed. 2024-04-12T09:00:11.120 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-12T09:00:11.120 INFO:teuthology.packaging:ref: None 2024-04-12T09:00:11.120 INFO:teuthology.packaging:tag: None 2024-04-12T09:00:11.120 INFO:teuthology.packaging:branch: quincy 2024-04-12T09:00:11.120 INFO:teuthology.packaging:sha1: b277feb2c7beb4597d8ecc39d58d5c36b81f613a 2024-04-12T09:00:11.120 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-12T09:00:11.334 DEBUG:teuthology.orchestra.run.smithi203:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-12T09:00:11.358 INFO:teuthology.orchestra.run.smithi203.stdout:17.2.7-827.gd3b5060a.el9 2024-04-12T09:00:11.359 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-827.gd3b5060a.el9 2024-04-12T09:00:11.359 INFO:teuthology.task.install:The correct ceph version 17.2.7-827.gd3b5060a is installed. 2024-04-12T09:00:11.360 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-12T09:00:11.360 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-12T09:00:11.360 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-12T09:00:11.389 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-12T09:00:11.389 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-12T09:00:11.448 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-12T09:00:11.448 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-12T09:00:11.448 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2024-04-12T09:00:11.475 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-12T09:00:11.541 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-12T09:00:11.542 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/daemon-helper 2024-04-12T09:00:11.573 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-12T09:00:11.640 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-12T09:00:11.641 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-12T09:00:11.641 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-12T09:00:11.667 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-12T09:00:11.734 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-12T09:00:11.734 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-12T09:00:11.761 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-12T09:00:11.829 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-12T09:00:11.829 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-12T09:00:11.829 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/stdin-killer 2024-04-12T09:00:11.855 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-12T09:00:11.922 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-12T09:00:11.922 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/stdin-killer 2024-04-12T09:00:11.950 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-12T09:00:12.018 INFO:teuthology.run_tasks:Running task print... 2024-04-12T09:00:12.027 INFO:teuthology.task.print:**** done install task... 2024-04-12T09:00:12.028 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-12T09:00:12.159 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': 'b277feb2c7beb4597d8ecc39d58d5c36b81f613a'} 2024-04-12T09:00:12.159 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-04-12T09:00:12.159 INFO:tasks.cephadm:Cluster fsid is 12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:00:12.160 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-12T09:00:12.160 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-04-12T09:00:12.160 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi117': '172.21.15.117', 'mon.smithi203': '172.21.15.203'} 2024-04-12T09:00:12.160 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-12T09:00:12.160 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname $(hostname -s) 2024-04-12T09:00:12.187 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname $(hostname -s) 2024-04-12T09:00:12.215 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-04-12T09:00:12.216 DEBUG:teuthology.orchestra.run.smithi117:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-12T09:00:12.472 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r--. 1 ubuntu ubuntu 375153 Apr 12 09:00 /home/ubuntu/cephtest/cephadm 2024-04-12T09:00:12.472 DEBUG:teuthology.orchestra.run.smithi203:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-12T09:00:12.647 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r--. 1 ubuntu ubuntu 375153 Apr 12 09:00 /home/ubuntu/cephtest/cephadm 2024-04-12T09:00:12.647 DEBUG:teuthology.orchestra.run.smithi117:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-12T09:00:12.663 DEBUG:teuthology.orchestra.run.smithi203:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-12T09:00:12.686 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-04-12T09:00:12.687 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-04-12T09:00:12.706 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-04-12T09:00:13.526 INFO:teuthology.orchestra.run.smithi203.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-12T09:00:13.610 INFO:teuthology.orchestra.run.smithi117.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-12T09:01:04.359 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:01:04.360 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)", 2024-04-12T09:01:04.360 INFO:teuthology.orchestra.run.smithi117.stdout: "image_id": "21de9b7369ad8457bc44c6aca16b9dfec25bf172fb7b6ebd80f97d4df2005241", 2024-04-12T09:01:04.360 INFO:teuthology.orchestra.run.smithi117.stdout: "repo_digests": [ 2024-04-12T09:01:04.360 INFO:teuthology.orchestra.run.smithi117.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe" 2024-04-12T09:01:04.360 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2024-04-12T09:01:04.360 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:01:06.452 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-04-12T09:01:06.452 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_version": "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)", 2024-04-12T09:01:06.452 INFO:teuthology.orchestra.run.smithi203.stdout: "image_id": "21de9b7369ad8457bc44c6aca16b9dfec25bf172fb7b6ebd80f97d4df2005241", 2024-04-12T09:01:06.452 INFO:teuthology.orchestra.run.smithi203.stdout: "repo_digests": [ 2024-04-12T09:01:06.452 INFO:teuthology.orchestra.run.smithi203.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe" 2024-04-12T09:01:06.452 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-04-12T09:01:06.452 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-04-12T09:01:06.470 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph 2024-04-12T09:01:06.504 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /etc/ceph 2024-04-12T09:01:06.533 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /etc/ceph 2024-04-12T09:01:06.575 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 777 /etc/ceph 2024-04-12T09:01:06.601 INFO:tasks.cephadm:Writing seed config... 2024-04-12T09:01:06.602 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-04-12T09:01:06.603 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-04-12T09:01:06.603 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-04-12T09:01:06.603 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-04-12T09:01:06.603 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-04-12T09:01:06.603 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-12T09:01:06.603 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-12T09:01:06.603 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-04-12T09:01:06.603 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-04-12T09:01:06.603 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-12T09:01:06.603 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-12T09:01:06.603 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-04-12T09:01:06.603 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-12T09:01:06.603 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-12T09:01:06.603 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-12T09:01:06.603 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-12T09:01:06.603 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-12T09:01:06.603 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-12T09:01:06.604 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-12T09:01:06.604 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-12T09:01:06.604 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-12T09:01:06.604 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-12T09:01:06.604 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-12T09:01:06.604 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-04-12T09:01:06.604 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-12T09:01:06.604 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-12T09:01:06.604 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-12T09:01:06.604 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-12T09:01:06.604 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-12T09:01:06.604 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-12T09:01:06.604 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-12T09:01:06.604 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-12T09:01:06.605 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-12T09:01:06.605 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-12T09:01:06.605 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-12T09:01:06.605 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-12T09:01:06.605 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-12T09:01:06.605 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-12T09:01:06.605 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-12T09:01:06.605 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-12T09:01:06.605 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-12T09:01:06.605 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-12T09:01:06.606 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-12T09:01:06.606 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-12T09:01:06.633 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 12161984-f8ab-11ee-bc8c-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-12T09:01:06.633 DEBUG:teuthology.orchestra.run.smithi117:mon.smithi117> sudo journalctl -f -n 0 -u ceph-12161984-f8ab-11ee-bc8c-c7b262605968@mon.smithi117.service 2024-04-12T09:01:06.676 INFO:tasks.cephadm:Bootstrapping... 2024-04-12T09:01:06.676 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.117 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-12T09:01:06.882 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-04-12T09:01:06.883 INFO:teuthology.orchestra.run.smithi117.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '12161984-f8ab-11ee-bc8c-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.117', '--skip-admin-label'] 2024-04-12T09:01:06.908 INFO:teuthology.orchestra.run.smithi117.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-12T09:01:06.909 INFO:teuthology.orchestra.run.smithi117.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-12T09:01:06.909 INFO:teuthology.orchestra.run.smithi117.stdout:Verifying podman|docker is present... 2024-04-12T09:01:06.933 INFO:teuthology.orchestra.run.smithi117.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-12T09:01:06.933 INFO:teuthology.orchestra.run.smithi117.stdout:Verifying lvm2 is present... 2024-04-12T09:01:06.933 INFO:teuthology.orchestra.run.smithi117.stdout:Verifying time synchronization is in place... 2024-04-12T09:01:06.941 INFO:teuthology.orchestra.run.smithi117.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-12T09:01:06.941 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-12T09:01:06.946 INFO:teuthology.orchestra.run.smithi117.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-12T09:01:06.947 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl: stdout inactive 2024-04-12T09:01:06.953 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl: stdout enabled 2024-04-12T09:01:06.960 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl: stdout active 2024-04-12T09:01:06.960 INFO:teuthology.orchestra.run.smithi117.stdout:Unit chronyd.service is enabled and running 2024-04-12T09:01:06.960 INFO:teuthology.orchestra.run.smithi117.stdout:Repeating the final host check... 2024-04-12T09:01:06.984 INFO:teuthology.orchestra.run.smithi117.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-12T09:01:06.984 INFO:teuthology.orchestra.run.smithi117.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-12T09:01:06.984 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl is present 2024-04-12T09:01:06.984 INFO:teuthology.orchestra.run.smithi117.stdout:lvcreate is present 2024-04-12T09:01:06.990 INFO:teuthology.orchestra.run.smithi117.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-12T09:01:06.990 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-12T09:01:07.007 INFO:teuthology.orchestra.run.smithi117.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-12T09:01:07.007 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl: stdout inactive 2024-04-12T09:01:07.007 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl: stdout enabled 2024-04-12T09:01:07.010 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl: stdout active 2024-04-12T09:01:07.010 INFO:teuthology.orchestra.run.smithi117.stdout:Unit chronyd.service is enabled and running 2024-04-12T09:01:07.010 INFO:teuthology.orchestra.run.smithi117.stdout:Host looks OK 2024-04-12T09:01:07.010 INFO:teuthology.orchestra.run.smithi117.stdout:Cluster fsid: 12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:01:07.010 INFO:teuthology.orchestra.run.smithi117.stdout:Acquiring lock 140442132509792 on /run/cephadm/12161984-f8ab-11ee-bc8c-c7b262605968.lock 2024-04-12T09:01:07.010 INFO:teuthology.orchestra.run.smithi117.stdout:Lock 140442132509792 acquired on /run/cephadm/12161984-f8ab-11ee-bc8c-c7b262605968.lock 2024-04-12T09:01:07.010 INFO:teuthology.orchestra.run.smithi117.stdout:Verifying IP 172.21.15.117 port 3300 ... 2024-04-12T09:01:07.011 INFO:teuthology.orchestra.run.smithi117.stdout:Verifying IP 172.21.15.117 port 6789 ... 2024-04-12T09:01:07.011 INFO:teuthology.orchestra.run.smithi117.stdout:Base mon IP(s) is [172.21.15.117:3300, 172.21.15.117:6789], mon addrv is [v2:172.21.15.117:3300,v1:172.21.15.117:6789] 2024-04-12T09:01:07.014 INFO:teuthology.orchestra.run.smithi117.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.117 metric 100 2024-04-12T09:01:07.015 INFO:teuthology.orchestra.run.smithi117.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.117 metric 100 2024-04-12T09:01:07.017 INFO:teuthology.orchestra.run.smithi117.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-12T09:01:07.017 INFO:teuthology.orchestra.run.smithi117.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-04-12T09:01:07.017 INFO:teuthology.orchestra.run.smithi117.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1790sec hoplimit 64 pref medium 2024-04-12T09:01:07.020 INFO:teuthology.orchestra.run.smithi117.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-12T09:01:07.020 INFO:teuthology.orchestra.run.smithi117.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-12T09:01:07.020 INFO:teuthology.orchestra.run.smithi117.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-12T09:01:07.020 INFO:teuthology.orchestra.run.smithi117.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-04-12T09:01:07.020 INFO:teuthology.orchestra.run.smithi117.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2024-04-12T09:01:07.020 INFO:teuthology.orchestra.run.smithi117.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-12T09:01:07.021 INFO:teuthology.orchestra.run.smithi117.stdout:Mon IP `172.21.15.117` is in CIDR network `172.21.0.0/20` 2024-04-12T09:01:07.021 INFO:teuthology.orchestra.run.smithi117.stdout:Mon IP `172.21.15.117` is in CIDR network `172.21.0.0/20` 2024-04-12T09:01:07.021 INFO:teuthology.orchestra.run.smithi117.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-12T09:01:07.021 INFO:teuthology.orchestra.run.smithi117.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-12T09:01:07.022 INFO:teuthology.orchestra.run.smithi117.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-12T09:01:07.498 INFO:teuthology.orchestra.run.smithi117.stdout:/bin/podman: stdout 21de9b7369ad8457bc44c6aca16b9dfec25bf172fb7b6ebd80f97d4df2005241 2024-04-12T09:01:07.498 INFO:teuthology.orchestra.run.smithi117.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-12T09:01:07.499 INFO:teuthology.orchestra.run.smithi117.stdout:/bin/podman: stderr Getting image source signatures 2024-04-12T09:01:07.499 INFO:teuthology.orchestra.run.smithi117.stdout:/bin/podman: stderr Copying blob sha256:6a38c9a31ea4c6c1e3d079c8edc2f3b418b00f3ce1d3a48ffe92dcb2ef7b4e51 2024-04-12T09:01:07.499 INFO:teuthology.orchestra.run.smithi117.stdout:/bin/podman: stderr Copying blob sha256:9793b5b5582798bde394f4383d142e9f248a25e4ebfd72ee05ea9ec6251a877d 2024-04-12T09:01:07.499 INFO:teuthology.orchestra.run.smithi117.stdout:/bin/podman: stderr Copying config sha256:21de9b7369ad8457bc44c6aca16b9dfec25bf172fb7b6ebd80f97d4df2005241 2024-04-12T09:01:07.499 INFO:teuthology.orchestra.run.smithi117.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-12T09:01:08.387 INFO:teuthology.orchestra.run.smithi117.stdout:ceph: stdout ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable) 2024-04-12T09:01:08.387 INFO:teuthology.orchestra.run.smithi117.stdout:Ceph version: ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable) 2024-04-12T09:01:08.387 INFO:teuthology.orchestra.run.smithi117.stdout:Extracting ceph user uid/gid from container image... 2024-04-12T09:01:14.268 INFO:teuthology.orchestra.run.smithi117.stdout:stat: stdout 167 167 2024-04-12T09:01:14.268 INFO:teuthology.orchestra.run.smithi117.stdout:Creating initial keys... 2024-04-12T09:01:17.913 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph-authtool: stdout AQBd+BhmINC1ARAACqJnpL3f9JE9xfabRPN1KA== 2024-04-12T09:01:18.926 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph-authtool: stdout AQBe+BhmskmHDRAAMrHzVohaqdycEJVSumAXng== 2024-04-12T09:01:19.823 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph-authtool: stdout AQBf+BhmD/hgCxAAZvqZ5U0am2dFriw8Feor5w== 2024-04-12T09:01:19.824 INFO:teuthology.orchestra.run.smithi117.stdout:Creating initial monmap... 2024-04-12T09:01:20.722 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-12T09:01:20.722 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-04-12T09:01:20.723 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:01:20.723 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-12T09:01:20.723 INFO:teuthology.orchestra.run.smithi117.stdout:monmaptool for smithi117 [v2:172.21.15.117:3300,v1:172.21.15.117:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-12T09:01:20.723 INFO:teuthology.orchestra.run.smithi117.stdout:setting min_mon_release = octopus 2024-04-12T09:01:20.723 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/monmaptool: set fsid to 12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:01:20.723 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-12T09:01:20.723 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:01:20.723 INFO:teuthology.orchestra.run.smithi117.stdout:Creating mon... 2024-04-12T09:01:22.061 INFO:teuthology.orchestra.run.smithi117.stdout:create mon.smithi117 on 2024-04-12T09:01:22.244 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-12T09:01:22.382 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-12T09:01:22.527 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-12161984-f8ab-11ee-bc8c-c7b262605968.target → /etc/systemd/system/ceph-12161984-f8ab-11ee-bc8c-c7b262605968.target. 2024-04-12T09:01:22.528 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-12161984-f8ab-11ee-bc8c-c7b262605968.target → /etc/systemd/system/ceph-12161984-f8ab-11ee-bc8c-c7b262605968.target. 2024-04-12T09:01:22.791 INFO:teuthology.orchestra.run.smithi117.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-12161984-f8ab-11ee-bc8c-c7b262605968@mon.smithi117 2024-04-12T09:01:22.792 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl: stderr Failed to reset failed state of unit ceph-12161984-f8ab-11ee-bc8c-c7b262605968@mon.smithi117.service: Unit ceph-12161984-f8ab-11ee-bc8c-c7b262605968@mon.smithi117.service not loaded. 2024-04-12T09:01:23.126 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-12161984-f8ab-11ee-bc8c-c7b262605968.target.wants/ceph-12161984-f8ab-11ee-bc8c-c7b262605968@mon.smithi117.service → /etc/systemd/system/ceph-12161984-f8ab-11ee-bc8c-c7b262605968@.service. 2024-04-12T09:01:23.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:23 smithi117 podman[28890]: 2024-04-12 09:01:23.268861575 +0000 UTC m=+0.017528862 image pull 21de9b7369ad8457bc44c6aca16b9dfec25bf172fb7b6ebd80f97d4df2005241 quay.ceph.io/ceph-ci/ceph:quincy 2024-04-12T09:01:24.212 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:23 smithi117 podman[28890]: 2024-04-12 09:01:23.957412909 +0000 UTC m=+0.706080186 container create 981f6d06cd466630231bcacb1150cb67fde0fde1d17b7dd9c171475900367e1f (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, RELEASE=quincy-d3b5060, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T09:01:24.212 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:24 smithi117 podman[28890]: 2024-04-12 09:01:24.168099983 +0000 UTC m=+0.916767258 container init 981f6d06cd466630231bcacb1150cb67fde0fde1d17b7dd9c171475900367e1f (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-d3b5060, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, ceph=True) 2024-04-12T09:01:24.212 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:24 smithi117 podman[28890]: 2024-04-12 09:01:24.170948014 +0000 UTC m=+0.919615289 container start 981f6d06cd466630231bcacb1150cb67fde0fde1d17b7dd9c171475900367e1f (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-d3b5060, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD) 2024-04-12T09:01:24.283 INFO:teuthology.orchestra.run.smithi117.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-12T09:01:24.283 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl: stdout disabled 2024-04-12T09:01:24.290 INFO:teuthology.orchestra.run.smithi117.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-12T09:01:24.290 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl: stdout inactive 2024-04-12T09:01:24.290 INFO:teuthology.orchestra.run.smithi117.stdout:firewalld.service is not enabled 2024-04-12T09:01:24.290 INFO:teuthology.orchestra.run.smithi117.stdout:Not possible to enable service . firewalld.service is not available 2024-04-12T09:01:24.291 INFO:teuthology.orchestra.run.smithi117.stdout:Waiting for mon to start... 2024-04-12T09:01:24.291 INFO:teuthology.orchestra.run.smithi117.stdout:Waiting for mon... 2024-04-12T09:01:24.524 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:24 smithi117 ceph-mon[28909]: mkfs 12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:01:24.524 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:24 smithi117 ceph-mon[28909]: mon.smithi117 is new leader, mons smithi117 in quorum (ranks 0) 2024-04-12T09:01:24.524 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:24 smithi117 bash[28890]: 981f6d06cd466630231bcacb1150cb67fde0fde1d17b7dd9c171475900367e1f 2024-04-12T09:01:24.524 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:24 smithi117 systemd[1]: Started Ceph mon.smithi117 for 12161984-f8ab-11ee-bc8c-c7b262605968. 2024-04-12T09:01:25.342 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout cluster: 2024-04-12T09:01:25.342 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout id: 12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:01:25.342 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-12T09:01:25.342 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout 2024-04-12T09:01:25.342 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout services: 2024-04-12T09:01:25.342 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi117 (age 0.611579s) 2024-04-12T09:01:25.342 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-12T09:01:25.342 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-12T09:01:25.342 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout 2024-04-12T09:01:25.343 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout data: 2024-04-12T09:01:25.343 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-12T09:01:25.343 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-12T09:01:25.343 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-12T09:01:25.343 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout pgs: 2024-04-12T09:01:25.343 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout 2024-04-12T09:01:25.343 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.741+0000 7fef7cd01700 1 Processor -- start 2024-04-12T09:01:25.343 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.742+0000 7fef7cd01700 1 -- start start 2024-04-12T09:01:25.343 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.742+0000 7fef7cd01700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef78078c50 0x7fef78077250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:25.343 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.742+0000 7fef7cd01700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef78079060 con 0x7fef78078c50 2024-04-12T09:01:25.343 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.742+0000 7fef7659c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef78078c50 0x7fef78077250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:25.343 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.742+0000 7fef7659c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef78078c50 0x7fef78077250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51004/0 (socket says 172.21.15.117:51004) 2024-04-12T09:01:25.343 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.742+0000 7fef7659c700 1 -- 172.21.15.117:0/3070818707 learned_addr learned my addr 172.21.15.117:0/3070818707 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:25.343 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.743+0000 7fef7659c700 1 -- 172.21.15.117:0/3070818707 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef78077790 con 0x7fef78078c50 2024-04-12T09:01:25.344 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.743+0000 7fef7659c700 1 --2- 172.21.15.117:0/3070818707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef78078c50 0x7fef78077250 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0098e0 tx=0x7fef6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55503b46b7c3d76 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:25.344 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.743+0000 7fef7559a700 1 -- 172.21.15.117:0/3070818707 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fef6c00b860 con 0x7fef78078c50 2024-04-12T09:01:25.344 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.743+0000 7fef7559a700 1 -- 172.21.15.117:0/3070818707 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c00b9c0 con 0x7fef78078c50 2024-04-12T09:01:25.344 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.743+0000 7fef7559a700 1 -- 172.21.15.117:0/3070818707 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fef6c00bc90 con 0x7fef78078c50 2024-04-12T09:01:25.344 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.743+0000 7fef7cd01700 1 -- 172.21.15.117:0/3070818707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef78078c50 msgr2=0x7fef78077250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:25.344 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.743+0000 7fef7cd01700 1 --2- 172.21.15.117:0/3070818707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef78078c50 0x7fef78077250 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0098e0 tx=0x7fef6c009250 comp rx=0 tx=0).stop 2024-04-12T09:01:25.344 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.744+0000 7fef7cd01700 1 -- 172.21.15.117:0/3070818707 shutdown_connections 2024-04-12T09:01:25.344 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.744+0000 7fef7cd01700 1 --2- 172.21.15.117:0/3070818707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef78078c50 0x7fef78077250 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:25.344 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.744+0000 7fef7cd01700 1 -- 172.21.15.117:0/3070818707 >> 172.21.15.117:0/3070818707 conn(0x7fef780fe0a0 msgr2=0x7fef781004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:25.344 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.744+0000 7fef7cd01700 1 -- 172.21.15.117:0/3070818707 shutdown_connections 2024-04-12T09:01:25.344 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.744+0000 7fef7cd01700 1 -- 172.21.15.117:0/3070818707 wait complete. 2024-04-12T09:01:25.344 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.744+0000 7fef7cd01700 1 Processor -- start 2024-04-12T09:01:25.344 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.744+0000 7fef7cd01700 1 -- start start 2024-04-12T09:01:25.344 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.744+0000 7fef7cd01700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef78078c50 0x7fef781130f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:25.344 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.744+0000 7fef7cd01700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef78113630 con 0x7fef78078c50 2024-04-12T09:01:25.345 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.744+0000 7fef7659c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef78078c50 0x7fef781130f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:25.345 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.744+0000 7fef7659c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef78078c50 0x7fef781130f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51008/0 (socket says 172.21.15.117:51008) 2024-04-12T09:01:25.345 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.745+0000 7fef7659c700 1 -- 172.21.15.117:0/463927519 learned_addr learned my addr 172.21.15.117:0/463927519 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:25.345 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.745+0000 7fef7659c700 1 -- 172.21.15.117:0/463927519 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c0094f0 con 0x7fef78078c50 2024-04-12T09:01:25.345 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.745+0000 7fef7659c700 1 --2- 172.21.15.117:0/463927519 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef78078c50 0x7fef781130f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009290 tx=0x7fef6c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:25.345 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.745+0000 7fef66ffd700 1 -- 172.21.15.117:0/463927519 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fef6c01c5c0 con 0x7fef78078c50 2024-04-12T09:01:25.345 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.745+0000 7fef66ffd700 1 -- 172.21.15.117:0/463927519 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c01c740 con 0x7fef78078c50 2024-04-12T09:01:25.345 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.745+0000 7fef66ffd700 1 -- 172.21.15.117:0/463927519 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fef6c01ca50 con 0x7fef78078c50 2024-04-12T09:01:25.345 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.745+0000 7fef7cd01700 1 -- 172.21.15.117:0/463927519 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef78113830 con 0x7fef78078c50 2024-04-12T09:01:25.345 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.745+0000 7fef7cd01700 1 -- 172.21.15.117:0/463927519 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef781143a0 con 0x7fef78078c50 2024-04-12T09:01:25.345 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.745+0000 7fef66ffd700 1 -- 172.21.15.117:0/463927519 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fef6c01a450 con 0x7fef78078c50 2024-04-12T09:01:25.345 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.745+0000 7fef66ffd700 1 -- 172.21.15.117:0/463927519 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fef6c02e790 con 0x7fef78078c50 2024-04-12T09:01:25.346 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.746+0000 7fef7cd01700 1 -- 172.21.15.117:0/463927519 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7805f5f0 con 0x7fef78078c50 2024-04-12T09:01:25.346 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.748+0000 7fef66ffd700 1 -- 172.21.15.117:0/463927519 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fef6c01ce30 con 0x7fef78078c50 2024-04-12T09:01:25.346 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.817+0000 7fef7cd01700 1 -- 172.21.15.117:0/463927519 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fef78114e70 con 0x7fef78078c50 2024-04-12T09:01:25.346 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.817+0000 7fef66ffd700 1 -- 172.21.15.117:0/463927519 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7fef6c01a890 con 0x7fef78078c50 2024-04-12T09:01:25.346 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.818+0000 7fef7cd01700 1 -- 172.21.15.117:0/463927519 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef78078c50 msgr2=0x7fef781130f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:25.346 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.818+0000 7fef7cd01700 1 --2- 172.21.15.117:0/463927519 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef78078c50 0x7fef781130f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009290 tx=0x7fef6c016000 comp rx=0 tx=0).stop 2024-04-12T09:01:25.346 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.818+0000 7fef7cd01700 1 -- 172.21.15.117:0/463927519 shutdown_connections 2024-04-12T09:01:25.346 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.818+0000 7fef7cd01700 1 --2- 172.21.15.117:0/463927519 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef78078c50 0x7fef781130f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:25.346 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.818+0000 7fef7cd01700 1 -- 172.21.15.117:0/463927519 >> 172.21.15.117:0/463927519 conn(0x7fef780fe0a0 msgr2=0x7fef78109f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:25.346 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.818+0000 7fef7cd01700 1 -- 172.21.15.117:0/463927519 shutdown_connections 2024-04-12T09:01:25.346 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:24.818+0000 7fef7cd01700 1 -- 172.21.15.117:0/463927519 wait complete. 2024-04-12T09:01:25.347 INFO:teuthology.orchestra.run.smithi117.stdout:mon is available 2024-04-12T09:01:25.347 INFO:teuthology.orchestra.run.smithi117.stdout:Assimilating anything we can from ceph.conf... 2024-04-12T09:01:25.460 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:25 smithi117 ceph-mon[28909]: mon.smithi117 is new leader, mons smithi117 in quorum (ranks 0) 2024-04-12T09:01:25.461 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:25 smithi117 ceph-mon[28909]: monmap e1: 1 mons at {smithi117=[v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-12T09:01:25.461 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:25 smithi117 ceph-mon[28909]: fsmap 2024-04-12T09:01:25.461 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:25 smithi117 ceph-mon[28909]: osdmap e1: 0 total, 0 up, 0 in 2024-04-12T09:01:25.461 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:25 smithi117 ceph-mon[28909]: mgrmap e1: no daemons active 2024-04-12T09:01:25.461 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:25 smithi117 ceph-mon[28909]: from='client.? 172.21.15.117:0/463927519' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-12T09:01:26.398 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout 2024-04-12T09:01:26.398 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout [global] 2024-04-12T09:01:26.398 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout fsid = 12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:01:26.398 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.117:3300,v1:172.21.15.117:6789] 2024-04-12T09:01:26.398 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-12T09:01:26.398 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-12T09:01:26.398 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-12T09:01:26.398 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-12T09:01:26.398 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout 2024-04-12T09:01:26.399 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-12T09:01:26.399 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-12T09:01:26.399 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout 2024-04-12T09:01:26.399 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout [osd] 2024-04-12T09:01:26.399 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-12T09:01:26.399 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-12T09:01:26.399 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-12T09:01:26.399 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-12T09:01:26.399 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-12T09:01:26.399 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.737+0000 7f9d31c5e700 1 Processor -- start 2024-04-12T09:01:26.399 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.737+0000 7f9d31c5e700 1 -- start start 2024-04-12T09:01:26.399 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.737+0000 7f9d31c5e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d2c1028f0 0x7f9d2c102d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:26.399 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.737+0000 7f9d31c5e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c103240 con 0x7f9d2c1028f0 2024-04-12T09:01:26.399 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.738+0000 7f9d2b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d2c1028f0 0x7f9d2c102d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:26.399 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.738+0000 7f9d2b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d2c1028f0 0x7f9d2c102d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51022/0 (socket says 172.21.15.117:51022) 2024-04-12T09:01:26.400 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.738+0000 7f9d2b7fe700 1 -- 172.21.15.117:0/690244061 learned_addr learned my addr 172.21.15.117:0/690244061 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:26.400 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.738+0000 7f9d2b7fe700 1 -- 172.21.15.117:0/690244061 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2c103380 con 0x7f9d2c1028f0 2024-04-12T09:01:26.400 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.738+0000 7f9d2b7fe700 1 --2- 172.21.15.117:0/690244061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d2c1028f0 0x7f9d2c102d00 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0098e0 tx=0x7f9d1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53560b541eac9e5c server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:26.400 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.738+0000 7f9d2a7fc700 1 -- 172.21.15.117:0/690244061 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d1c00b860 con 0x7f9d2c1028f0 2024-04-12T09:01:26.400 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.738+0000 7f9d2a7fc700 1 -- 172.21.15.117:0/690244061 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c00b9c0 con 0x7f9d2c1028f0 2024-04-12T09:01:26.400 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.738+0000 7f9d2a7fc700 1 -- 172.21.15.117:0/690244061 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d1c00bc90 con 0x7f9d2c1028f0 2024-04-12T09:01:26.400 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.739+0000 7f9d31c5e700 1 -- 172.21.15.117:0/690244061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d2c1028f0 msgr2=0x7f9d2c102d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:26.400 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.739+0000 7f9d31c5e700 1 --2- 172.21.15.117:0/690244061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d2c1028f0 0x7f9d2c102d00 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0098e0 tx=0x7f9d1c009250 comp rx=0 tx=0).stop 2024-04-12T09:01:26.400 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.739+0000 7f9d31c5e700 1 -- 172.21.15.117:0/690244061 shutdown_connections 2024-04-12T09:01:26.400 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.739+0000 7f9d31c5e700 1 --2- 172.21.15.117:0/690244061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d2c1028f0 0x7f9d2c102d00 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:26.400 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.739+0000 7f9d31c5e700 1 -- 172.21.15.117:0/690244061 >> 172.21.15.117:0/690244061 conn(0x7f9d2c0fe070 msgr2=0x7f9d2c100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:26.400 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.739+0000 7f9d31c5e700 1 -- 172.21.15.117:0/690244061 shutdown_connections 2024-04-12T09:01:26.400 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.739+0000 7f9d31c5e700 1 -- 172.21.15.117:0/690244061 wait complete. 2024-04-12T09:01:26.400 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.739+0000 7f9d31c5e700 1 Processor -- start 2024-04-12T09:01:26.400 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.740+0000 7f9d31c5e700 1 -- start start 2024-04-12T09:01:26.401 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.740+0000 7f9d31c5e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d2c1028f0 0x7f9d2c110f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:26.401 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.740+0000 7f9d31c5e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c111450 con 0x7f9d2c1028f0 2024-04-12T09:01:26.401 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.740+0000 7f9d2b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d2c1028f0 0x7f9d2c110f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:26.401 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.740+0000 7f9d2b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d2c1028f0 0x7f9d2c110f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51024/0 (socket says 172.21.15.117:51024) 2024-04-12T09:01:26.401 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.740+0000 7f9d2b7fe700 1 -- 172.21.15.117:0/2753597982 learned_addr learned my addr 172.21.15.117:0/2753597982 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:26.401 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.740+0000 7f9d2b7fe700 1 -- 172.21.15.117:0/2753597982 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c0094f0 con 0x7f9d2c1028f0 2024-04-12T09:01:26.401 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.740+0000 7f9d2b7fe700 1 --2- 172.21.15.117:0/2753597982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d2c1028f0 0x7f9d2c110f10 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c003080 tx=0x7f9d1c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:26.401 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.740+0000 7f9d13fff700 1 -- 172.21.15.117:0/2753597982 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d1c01c5c0 con 0x7f9d2c1028f0 2024-04-12T09:01:26.401 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.740+0000 7f9d13fff700 1 -- 172.21.15.117:0/2753597982 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c01c720 con 0x7f9d2c1028f0 2024-04-12T09:01:26.401 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.740+0000 7f9d13fff700 1 -- 172.21.15.117:0/2753597982 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d1c01ca30 con 0x7f9d2c1028f0 2024-04-12T09:01:26.401 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.740+0000 7f9d31c5e700 1 -- 172.21.15.117:0/2753597982 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2c111650 con 0x7f9d2c1028f0 2024-04-12T09:01:26.401 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.741+0000 7f9d31c5e700 1 -- 172.21.15.117:0/2753597982 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2c1120e0 con 0x7f9d2c1028f0 2024-04-12T09:01:26.401 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.741+0000 7f9d13fff700 1 -- 172.21.15.117:0/2753597982 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9d1c01a450 con 0x7f9d2c1028f0 2024-04-12T09:01:26.401 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.741+0000 7f9d13fff700 1 -- 172.21.15.117:0/2753597982 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9d1c02e790 con 0x7f9d2c1028f0 2024-04-12T09:01:26.401 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.741+0000 7f9d31c5e700 1 -- 172.21.15.117:0/2753597982 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d2c05f5f0 con 0x7f9d2c1028f0 2024-04-12T09:01:26.402 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.744+0000 7f9d13fff700 1 -- 172.21.15.117:0/2753597982 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9d1c01a890 con 0x7f9d2c1028f0 2024-04-12T09:01:26.402 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.810+0000 7f9d31c5e700 1 -- 172.21.15.117:0/2753597982 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f9d2c04bed0 con 0x7f9d2c1028f0 2024-04-12T09:01:26.402 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.813+0000 7f9d13fff700 1 -- 172.21.15.117:0/2753597982 <== mon.0 v2:172.21.15.117:3300/0 7 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f9d1c02ee80 con 0x7f9d2c1028f0 2024-04-12T09:01:26.402 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.813+0000 7f9d13fff700 1 -- 172.21.15.117:0/2753597982 <== mon.0 v2:172.21.15.117:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+431 (secure 0 0 0) 0x7f9d1c01b790 con 0x7f9d2c1028f0 2024-04-12T09:01:26.402 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.814+0000 7f9d31c5e700 1 -- 172.21.15.117:0/2753597982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d2c1028f0 msgr2=0x7f9d2c110f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:26.402 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.814+0000 7f9d31c5e700 1 --2- 172.21.15.117:0/2753597982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d2c1028f0 0x7f9d2c110f10 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c003080 tx=0x7f9d1c016000 comp rx=0 tx=0).stop 2024-04-12T09:01:26.402 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.814+0000 7f9d31c5e700 1 -- 172.21.15.117:0/2753597982 shutdown_connections 2024-04-12T09:01:26.402 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.814+0000 7f9d31c5e700 1 --2- 172.21.15.117:0/2753597982 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d2c1028f0 0x7f9d2c110f10 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:26.402 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.814+0000 7f9d31c5e700 1 -- 172.21.15.117:0/2753597982 >> 172.21.15.117:0/2753597982 conn(0x7f9d2c0fe070 msgr2=0x7f9d2c107dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:26.402 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.814+0000 7f9d31c5e700 1 -- 172.21.15.117:0/2753597982 shutdown_connections 2024-04-12T09:01:26.402 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:25.814+0000 7f9d31c5e700 1 -- 172.21.15.117:0/2753597982 wait complete. 2024-04-12T09:01:26.402 INFO:teuthology.orchestra.run.smithi117.stdout:Generating new minimal ceph.conf... 2024-04-12T09:01:26.515 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:26 smithi117 ceph-mon[28909]: from='client.? 172.21.15.117:0/2753597982' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-12T09:01:26.515 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:26 smithi117 ceph-mon[28909]: from='client.? 172.21.15.117:0/2753597982' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-12T09:01:27.386 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.802+0000 7f4f25ea9700 1 Processor -- start 2024-04-12T09:01:27.386 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.802+0000 7f4f25ea9700 1 -- start start 2024-04-12T09:01:27.386 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.802+0000 7f4f25ea9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f201017a0 0x7f4f20101bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:27.386 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.802+0000 7f4f25ea9700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f201020f0 con 0x7f4f201017a0 2024-04-12T09:01:27.386 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.802+0000 7f4f1f7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f201017a0 0x7f4f20101bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:27.386 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.802+0000 7f4f1f7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f201017a0 0x7f4f20101bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51028/0 (socket says 172.21.15.117:51028) 2024-04-12T09:01:27.386 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.802+0000 7f4f1f7fe700 1 -- 172.21.15.117:0/2162639161 learned_addr learned my addr 172.21.15.117:0/2162639161 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:27.386 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.802+0000 7f4f1f7fe700 1 -- 172.21.15.117:0/2162639161 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f20102230 con 0x7f4f201017a0 2024-04-12T09:01:27.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.803+0000 7f4f1f7fe700 1 --2- 172.21.15.117:0/2162639161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f201017a0 0x7f4f20101bb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4f100098e0 tx=0x7f4f10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fff6892529280 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:27.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.803+0000 7f4f1e7fc700 1 -- 172.21.15.117:0/2162639161 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f1000b860 con 0x7f4f201017a0 2024-04-12T09:01:27.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.803+0000 7f4f1e7fc700 1 -- 172.21.15.117:0/2162639161 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4f1000be50 con 0x7f4f201017a0 2024-04-12T09:01:27.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.803+0000 7f4f1e7fc700 1 -- 172.21.15.117:0/2162639161 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f10010380 con 0x7f4f201017a0 2024-04-12T09:01:27.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.803+0000 7f4f25ea9700 1 -- 172.21.15.117:0/2162639161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f201017a0 msgr2=0x7f4f20101bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:27.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.803+0000 7f4f25ea9700 1 --2- 172.21.15.117:0/2162639161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f201017a0 0x7f4f20101bb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4f100098e0 tx=0x7f4f10009250 comp rx=0 tx=0).stop 2024-04-12T09:01:27.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.803+0000 7f4f25ea9700 1 -- 172.21.15.117:0/2162639161 shutdown_connections 2024-04-12T09:01:27.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.803+0000 7f4f25ea9700 1 --2- 172.21.15.117:0/2162639161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f201017a0 0x7f4f20101bb0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:27.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.803+0000 7f4f25ea9700 1 -- 172.21.15.117:0/2162639161 >> 172.21.15.117:0/2162639161 conn(0x7f4f200fcf40 msgr2=0x7f4f200ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:27.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.803+0000 7f4f25ea9700 1 -- 172.21.15.117:0/2162639161 shutdown_connections 2024-04-12T09:01:27.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.803+0000 7f4f25ea9700 1 -- 172.21.15.117:0/2162639161 wait complete. 2024-04-12T09:01:27.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.804+0000 7f4f25ea9700 1 Processor -- start 2024-04-12T09:01:27.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.804+0000 7f4f25ea9700 1 -- start start 2024-04-12T09:01:27.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.804+0000 7f4f25ea9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f201017a0 0x7f4f20076b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:27.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.804+0000 7f4f25ea9700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f201143c0 con 0x7f4f201017a0 2024-04-12T09:01:27.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.804+0000 7f4f1f7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f201017a0 0x7f4f20076b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:27.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.804+0000 7f4f1f7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f201017a0 0x7f4f20076b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51030/0 (socket says 172.21.15.117:51030) 2024-04-12T09:01:27.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.804+0000 7f4f1f7fe700 1 -- 172.21.15.117:0/3232756179 learned_addr learned my addr 172.21.15.117:0/3232756179 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:27.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.805+0000 7f4f1f7fe700 1 -- 172.21.15.117:0/3232756179 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f100094f0 con 0x7f4f201017a0 2024-04-12T09:01:27.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.805+0000 7f4f1f7fe700 1 --2- 172.21.15.117:0/3232756179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f201017a0 0x7f4f20076b20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000b440 tx=0x7f4f10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:27.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.805+0000 7f4f07fff700 1 -- 172.21.15.117:0/3232756179 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f10010760 con 0x7f4f201017a0 2024-04-12T09:01:27.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.805+0000 7f4f07fff700 1 -- 172.21.15.117:0/3232756179 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4f10010d50 con 0x7f4f201017a0 2024-04-12T09:01:27.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.805+0000 7f4f07fff700 1 -- 172.21.15.117:0/3232756179 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f1001ae20 con 0x7f4f201017a0 2024-04-12T09:01:27.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.805+0000 7f4f25ea9700 1 -- 172.21.15.117:0/3232756179 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f20114500 con 0x7f4f201017a0 2024-04-12T09:01:27.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.805+0000 7f4f25ea9700 1 -- 172.21.15.117:0/3232756179 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f20114990 con 0x7f4f201017a0 2024-04-12T09:01:27.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.805+0000 7f4f07fff700 1 -- 172.21.15.117:0/3232756179 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4f1002e6c0 con 0x7f4f201017a0 2024-04-12T09:01:27.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.805+0000 7f4f07fff700 1 -- 172.21.15.117:0/3232756179 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f4f100248c0 con 0x7f4f201017a0 2024-04-12T09:01:27.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.806+0000 7f4f25ea9700 1 -- 172.21.15.117:0/3232756179 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2004bed0 con 0x7f4f201017a0 2024-04-12T09:01:27.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.808+0000 7f4f07fff700 1 -- 172.21.15.117:0/3232756179 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4f10029070 con 0x7f4f201017a0 2024-04-12T09:01:27.389 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.873+0000 7f4f25ea9700 1 -- 172.21.15.117:0/3232756179 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f4f20103570 con 0x7f4f201017a0 2024-04-12T09:01:27.389 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.874+0000 7f4f07fff700 1 -- 172.21.15.117:0/3232756179 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7f4f1001a6a0 con 0x7f4f201017a0 2024-04-12T09:01:27.389 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.874+0000 7f4f25ea9700 1 -- 172.21.15.117:0/3232756179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f201017a0 msgr2=0x7f4f20076b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:27.389 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.874+0000 7f4f25ea9700 1 --2- 172.21.15.117:0/3232756179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f201017a0 0x7f4f20076b20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000b440 tx=0x7f4f10009250 comp rx=0 tx=0).stop 2024-04-12T09:01:27.389 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.875+0000 7f4f25ea9700 1 -- 172.21.15.117:0/3232756179 shutdown_connections 2024-04-12T09:01:27.389 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.875+0000 7f4f25ea9700 1 --2- 172.21.15.117:0/3232756179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f201017a0 0x7f4f20076b20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:27.389 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.875+0000 7f4f25ea9700 1 -- 172.21.15.117:0/3232756179 >> 172.21.15.117:0/3232756179 conn(0x7f4f200fcf40 msgr2=0x7f4f200fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:27.389 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.875+0000 7f4f25ea9700 1 -- 172.21.15.117:0/3232756179 shutdown_connections 2024-04-12T09:01:27.389 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:26.875+0000 7f4f25ea9700 1 -- 172.21.15.117:0/3232756179 wait complete. 2024-04-12T09:01:27.389 INFO:teuthology.orchestra.run.smithi117.stdout:Restarting the monitor... 2024-04-12T09:01:27.641 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:27 smithi117 ceph-mon[28909]: from='client.? 172.21.15.117:0/3232756179' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:01:27.641 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:27 smithi117 systemd[1]: Stopping Ceph mon.smithi117 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:01:27.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:27 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117[28905]: 2024-04-12T09:01:27.639+0000 7f15b3a95700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi117 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T09:01:27.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:27 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117[28905]: 2024-04-12T09:01:27.639+0000 7f15b3a95700 -1 mon.smithi117@0(leader) e1 *** Got Signal Terminated *** 2024-04-12T09:01:27.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:27 smithi117 podman[29151]: 2024-04-12 09:01:27.732243224 +0000 UTC m=+0.188557140 container died 981f6d06cd466630231bcacb1150cb67fde0fde1d17b7dd9c171475900367e1f (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-d3b5060, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-12T09:01:28.349 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 podman[29151]: 2024-04-12 09:01:28.089276439 +0000 UTC m=+0.545590356 container cleanup 981f6d06cd466630231bcacb1150cb67fde0fde1d17b7dd9c171475900367e1f (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117, GIT_BRANCH=HEAD, RELEASE=quincy-d3b5060, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, GIT_CLEAN=True) 2024-04-12T09:01:28.349 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 bash[29151]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117 2024-04-12T09:01:28.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 podman[29165]: 2024-04-12 09:01:28.348780775 +0000 UTC m=+0.619553901 container remove 981f6d06cd466630231bcacb1150cb67fde0fde1d17b7dd9c171475900367e1f (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=quincy-d3b5060, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-04-12T09:01:28.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 systemd[1]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968@mon.smithi117.service: Deactivated successfully. 2024-04-12T09:01:28.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 systemd[1]: Stopped Ceph mon.smithi117 for 12161984-f8ab-11ee-bc8c-c7b262605968. 2024-04-12T09:01:28.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 systemd[1]: Starting Ceph mon.smithi117 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:01:28.969 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 podman[29258]: 2024-04-12 09:01:28.716579601 +0000 UTC m=+0.112977469 container create f9d5f7ac5270f6e964257b43e08d38b79d97a83858cc6ccfb8e9c197a3579c48 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=quincy-d3b5060, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-12T09:01:28.969 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 podman[29258]: 2024-04-12 09:01:28.621011861 +0000 UTC m=+0.017409730 image pull 21de9b7369ad8457bc44c6aca16b9dfec25bf172fb7b6ebd80f97d4df2005241 quay.ceph.io/ceph-ci/ceph:quincy 2024-04-12T09:01:28.969 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 podman[29258]: 2024-04-12 09:01:28.893696133 +0000 UTC m=+0.290094002 container init f9d5f7ac5270f6e964257b43e08d38b79d97a83858cc6ccfb8e9c197a3579c48 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-d3b5060, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-04-12T09:01:28.969 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 podman[29258]: 2024-04-12 09:01:28.896475931 +0000 UTC m=+0.292873806 container start f9d5f7ac5270f6e964257b43e08d38b79d97a83858cc6ccfb8e9c197a3579c48 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240409, RELEASE=quincy-d3b5060, io.buildah.version=1.33.5, ceph=True) 2024-04-12T09:01:28.970 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: set uid:gid to 167:167 (ceph:ceph) 2024-04-12T09:01:28.970 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable), process ceph-mon, pid 2 2024-04-12T09:01:28.970 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: pidfile_write: ignore empty --pid-file 2024-04-12T09:01:28.970 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: load: jerasure load: lrc 2024-04-12T09:01:28.970 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: RocksDB version: 6.15.5 2024-04-12T09:01:28.970 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-04-12T09:01:28.970 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Compile date Apr 9 2024 2024-04-12T09:01:28.970 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: DB SUMMARY 2024-04-12T09:01:28.970 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: DB Session ID: 8KBAZZMNJUCODTYEIU9M 2024-04-12T09:01:28.970 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: CURRENT file: CURRENT 2024-04-12T09:01:28.970 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: IDENTITY file: IDENTITY 2024-04-12T09:01:28.970 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-04-12T09:01:28.970 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi117/store.db dir, Total Num: 1, files: 000008.sst 2024-04-12T09:01:28.971 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi117/store.db: 000010.log size: 98174 ; 2024-04-12T09:01:28.971 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.error_if_exists: 0 2024-04-12T09:01:28.971 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.create_if_missing: 0 2024-04-12T09:01:28.971 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.paranoid_checks: 1 2024-04-12T09:01:28.971 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-12T09:01:28.971 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.env: 0x55751206ba80 2024-04-12T09:01:28.971 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.fs: Posix File System 2024-04-12T09:01:28.971 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.info_log: 0x5575140adc00 2024-04-12T09:01:28.971 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_file_opening_threads: 16 2024-04-12T09:01:28.971 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.statistics: (nil) 2024-04-12T09:01:28.971 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.use_fsync: 0 2024-04-12T09:01:28.971 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_log_file_size: 0 2024-04-12T09:01:28.971 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-12T09:01:28.971 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-12T09:01:28.971 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.keep_log_file_num: 1000 2024-04-12T09:01:28.972 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.recycle_log_file_num: 0 2024-04-12T09:01:28.972 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.allow_fallocate: 1 2024-04-12T09:01:28.972 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.allow_mmap_reads: 0 2024-04-12T09:01:28.972 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.allow_mmap_writes: 0 2024-04-12T09:01:28.972 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.use_direct_reads: 0 2024-04-12T09:01:28.972 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-12T09:01:28.972 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.create_missing_column_families: 0 2024-04-12T09:01:28.972 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.db_log_dir: 2024-04-12T09:01:28.972 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi117/store.db 2024-04-12T09:01:28.972 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-12T09:01:28.972 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-12T09:01:28.972 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-12T09:01:28.972 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-12T09:01:28.972 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-12T09:01:28.972 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-12T09:01:28.973 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.advise_random_on_open: 1 2024-04-12T09:01:28.973 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.db_write_buffer_size: 0 2024-04-12T09:01:28.973 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.write_buffer_manager: 0x557514e22990 2024-04-12T09:01:28.973 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-12T09:01:28.973 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-04-12T09:01:28.973 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-12T09:01:28.973 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-12T09:01:28.973 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.rate_limiter: (nil) 2024-04-12T09:01:28.973 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-12T09:01:28.973 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.wal_recovery_mode: 2 2024-04-12T09:01:28.973 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.enable_thread_tracking: 0 2024-04-12T09:01:28.973 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.enable_pipelined_write: 0 2024-04-12T09:01:28.975 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.unordered_write: 0 2024-04-12T09:01:28.975 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-12T09:01:28.975 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-12T09:01:28.975 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-12T09:01:28.975 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-12T09:01:28.975 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.row_cache: None 2024-04-12T09:01:28.975 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.wal_filter: None 2024-04-12T09:01:28.975 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-12T09:01:28.975 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.allow_ingest_behind: 0 2024-04-12T09:01:28.975 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.preserve_deletes: 0 2024-04-12T09:01:28.975 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.two_write_queues: 0 2024-04-12T09:01:28.975 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.manual_wal_flush: 0 2024-04-12T09:01:28.976 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.atomic_flush: 0 2024-04-12T09:01:28.976 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-12T09:01:28.976 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-12T09:01:28.976 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-12T09:01:28.976 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.log_readahead_size: 0 2024-04-12T09:01:28.976 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-12T09:01:28.976 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.best_efforts_recovery: 0 2024-04-12T09:01:28.976 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-12T09:01:28.976 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-12T09:01:28.976 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.allow_data_in_errors: 0 2024-04-12T09:01:28.976 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.db_host_id: __hostname__ 2024-04-12T09:01:28.976 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_background_jobs: 2 2024-04-12T09:01:28.976 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_background_compactions: -1 2024-04-12T09:01:28.976 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_subcompactions: 1 2024-04-12T09:01:28.977 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-12T09:01:28.977 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-12T09:01:28.977 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-12T09:01:28.977 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_total_wal_size: 0 2024-04-12T09:01:28.977 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-12T09:01:28.977 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-12T09:01:28.977 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-12T09:01:28.977 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-12T09:01:28.977 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_open_files: -1 2024-04-12T09:01:28.977 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.bytes_per_sync: 0 2024-04-12T09:01:28.977 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-12T09:01:28.977 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-12T09:01:28.977 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.compaction_readahead_size: 0 2024-04-12T09:01:28.977 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_background_flushes: -1 2024-04-12T09:01:28.977 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Compression algorithms supported: 2024-04-12T09:01:28.977 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-12T09:01:28.978 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: kZSTD supported: 0 2024-04-12T09:01:28.978 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: kXpressCompression supported: 0 2024-04-12T09:01:28.978 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: kLZ4HCCompression supported: 1 2024-04-12T09:01:28.978 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: kZlibCompression supported: 1 2024-04-12T09:01:28.978 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: kSnappyCompression supported: 1 2024-04-12T09:01:28.978 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: kLZ4Compression supported: 1 2024-04-12T09:01:28.978 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: kBZip2Compression supported: 0 2024-04-12T09:01:28.978 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-12T09:01:28.978 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi117/store.db/MANIFEST-000009 2024-04-12T09:01:28.978 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-04-12T09:01:28.978 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-12T09:01:28.978 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.merge_operator: 2024-04-12T09:01:28.978 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.compaction_filter: None 2024-04-12T09:01:28.978 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.compaction_filter_factory: None 2024-04-12T09:01:28.978 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.sst_partitioner_factory: None 2024-04-12T09:01:28.979 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-12T09:01:28.979 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-12T09:01:28.979 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557514102f58) 2024-04-12T09:01:28.982 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: cache_index_and_filter_blocks: 1 2024-04-12T09:01:28.982 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-12T09:01:28.982 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-12T09:01:28.982 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: pin_top_level_index_and_filter: 1 2024-04-12T09:01:28.982 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: index_type: 0 2024-04-12T09:01:28.982 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: data_block_index_type: 0 2024-04-12T09:01:28.983 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: index_shortening: 1 2024-04-12T09:01:28.983 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-12T09:01:28.983 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: hash_index_allow_collision: 1 2024-04-12T09:01:28.983 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: checksum: 1 2024-04-12T09:01:28.983 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: no_block_cache: 0 2024-04-12T09:01:28.983 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: block_cache: 0x557514135090 2024-04-12T09:01:28.983 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: block_cache_name: BinnedLRUCache 2024-04-12T09:01:28.983 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: block_cache_options: 2024-04-12T09:01:28.983 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: capacity : 536870912 2024-04-12T09:01:28.983 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: num_shard_bits : 4 2024-04-12T09:01:28.983 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: strict_capacity_limit : 0 2024-04-12T09:01:28.983 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: high_pri_pool_ratio: 0.000 2024-04-12T09:01:28.983 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: block_cache_compressed: (nil) 2024-04-12T09:01:28.983 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: persistent_cache: (nil) 2024-04-12T09:01:28.983 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: block_size: 4096 2024-04-12T09:01:28.984 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: block_size_deviation: 10 2024-04-12T09:01:28.984 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: block_restart_interval: 16 2024-04-12T09:01:28.984 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: index_block_restart_interval: 1 2024-04-12T09:01:28.984 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: metadata_block_size: 4096 2024-04-12T09:01:28.984 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: partition_filters: 0 2024-04-12T09:01:28.984 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: use_delta_encoding: 1 2024-04-12T09:01:28.984 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-04-12T09:01:28.984 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: whole_key_filtering: 1 2024-04-12T09:01:28.984 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: verify_compression: 0 2024-04-12T09:01:28.984 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: read_amp_bytes_per_bit: 0 2024-04-12T09:01:28.984 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: format_version: 4 2024-04-12T09:01:28.984 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: enable_index_compression: 1 2024-04-12T09:01:28.984 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: block_align: 0 2024-04-12T09:01:28.984 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.write_buffer_size: 33554432 2024-04-12T09:01:28.984 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_write_buffer_number: 2 2024-04-12T09:01:28.985 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.compression: NoCompression 2024-04-12T09:01:28.985 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.bottommost_compression: Disabled 2024-04-12T09:01:28.985 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.prefix_extractor: nullptr 2024-04-12T09:01:28.985 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-12T09:01:28.985 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.num_levels: 7 2024-04-12T09:01:28.985 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-12T09:01:28.985 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-12T09:01:28.985 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-12T09:01:28.985 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-12T09:01:28.985 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-12T09:01:28.985 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-12T09:01:28.985 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-12T09:01:28.985 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-12T09:01:28.985 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-12T09:01:28.986 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-12T09:01:28.986 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-12T09:01:28.986 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.compression_opts.level: 32767 2024-04-12T09:01:28.986 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.compression_opts.strategy: 0 2024-04-12T09:01:28.986 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-12T09:01:28.986 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-12T09:01:28.986 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-12T09:01:28.986 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.compression_opts.enabled: false 2024-04-12T09:01:28.986 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-12T09:01:28.986 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-12T09:01:28.986 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-12T09:01:28.986 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.target_file_size_base: 67108864 2024-04-12T09:01:28.986 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-12T09:01:28.986 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-12T09:01:28.987 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-12T09:01:28.987 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-12T09:01:28.987 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-12T09:01:28.987 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-12T09:01:28.987 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-12T09:01:28.987 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-12T09:01:28.987 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-12T09:01:28.987 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-12T09:01:28.987 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-12T09:01:28.987 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-12T09:01:28.987 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-12T09:01:28.987 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.arena_block_size: 4194304 2024-04-12T09:01:28.987 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-12T09:01:28.987 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-12T09:01:28.987 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-04-12T09:01:28.988 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.disable_auto_compactions: 0 2024-04-12T09:01:28.988 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-12T09:01:28.988 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-12T09:01:28.988 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-12T09:01:28.988 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-12T09:01:28.988 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-12T09:01:28.988 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-12T09:01:28.988 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-12T09:01:28.988 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-12T09:01:28.988 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-12T09:01:28.988 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-12T09:01:28.988 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.table_properties_collectors: 2024-04-12T09:01:28.988 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.inplace_update_support: 0 2024-04-12T09:01:28.988 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-12T09:01:28.988 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-12T09:01:28.989 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-12T09:01:28.989 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-12T09:01:28.989 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.bloom_locality: 0 2024-04-12T09:01:28.989 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.max_successive_merges: 0 2024-04-12T09:01:28.989 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-12T09:01:28.989 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.paranoid_file_checks: 0 2024-04-12T09:01:28.989 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.force_consistency_checks: 1 2024-04-12T09:01:28.989 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.report_bg_io_stats: 0 2024-04-12T09:01:28.989 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.ttl: 2592000 2024-04-12T09:01:28.989 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-12T09:01:28.989 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.enable_blob_files: false 2024-04-12T09:01:28.989 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.min_blob_size: 0 2024-04-12T09:01:28.989 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.blob_file_size: 268435456 2024-04-12T09:01:28.989 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-12T09:01:28.990 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-12T09:01:28.990 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-12T09:01:28.990 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi117/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-12T09:01:28.990 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-04-12T09:01:28.990 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-04-12T09:01:28.990 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712912488923339, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-04-12T09:01:28.990 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-04-12T09:01:28.990 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-04-12T09:01:28.990 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712912488924505, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93380, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91492, "index_size": 248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13576, "raw_average_key_size": 49, "raw_value_size": 84056, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1712912488, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "4ca7ff06-9e66-4245-af89-b174f237aad3", "db_session_id": "8KBAZZMNJUCODTYEIU9M"}} 2024-04-12T09:01:28.990 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-04-12T09:01:28.990 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712912488924972, "job": 1, "event": "recovery_finished"} 2024-04-12T09:01:28.990 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi117/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-12T09:01:28.990 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x5575140c9180 2024-04-12T09:01:28.990 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: DB pointer 0x55751419e000 2024-04-12T09:01:28.991 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-04-12T09:01:28.991 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-04-12T09:01:28.991 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: ** DB Stats ** 2024-04-12T09:01:28.991 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-12T09:01:28.991 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-12T09:01:28.991 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-12T09:01:28.991 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-12T09:01:28.991 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-12T09:01:28.991 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-04-12T09:01:28.991 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-12T09:01:28.991 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-04-12T09:01:28.991 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: ** Compaction Stats [default] ** 2024-04-12T09:01:28.991 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-12T09:01:28.991 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-12T09:01:28.991 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: L0 2/0 92.99 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 117.2 0.00 0.00 1 0.001 0 0 2024-04-12T09:01:28.992 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Sum 2/0 92.99 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 117.2 0.00 0.00 1 0.001 0 0 2024-04-12T09:01:28.992 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 117.2 0.00 0.00 1 0.001 0 0 2024-04-12T09:01:28.992 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-04-12T09:01:28.992 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: ** Compaction Stats [default] ** 2024-04-12T09:01:28.992 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-12T09:01:28.992 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-12T09:01:28.992 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 117.2 0.00 0.00 1 0.001 0 0 2024-04-12T09:01:28.992 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-12T09:01:28.992 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-12T09:01:28.992 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-12T09:01:28.992 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-12T09:01:28.992 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-12T09:01:28.992 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-12T09:01:28.992 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Cumulative compaction: 0.00 GB write, 21.34 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-12T09:01:28.992 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Interval compaction: 0.00 GB write, 21.34 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-12T09:01:28.993 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-12T09:01:28.993 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-04-12T09:01:28.993 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-12T09:01:28.993 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-04-12T09:01:28.993 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: ** Compaction Stats [default] ** 2024-04-12T09:01:28.993 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-12T09:01:28.993 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-12T09:01:28.993 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: L0 2/0 92.99 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 117.2 0.00 0.00 1 0.001 0 0 2024-04-12T09:01:28.993 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Sum 2/0 92.99 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 117.2 0.00 0.00 1 0.001 0 0 2024-04-12T09:01:28.993 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-04-12T09:01:28.993 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-04-12T09:01:28.993 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: ** Compaction Stats [default] ** 2024-04-12T09:01:28.993 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-12T09:01:28.993 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-12T09:01:28.994 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 117.2 0.00 0.00 1 0.001 0 0 2024-04-12T09:01:28.994 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-12T09:01:28.994 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-12T09:01:28.994 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-12T09:01:28.994 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-12T09:01:28.994 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-12T09:01:28.994 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-12T09:01:28.994 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Cumulative compaction: 0.00 GB write, 21.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-12T09:01:28.994 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-12T09:01:28.994 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-12T09:01:28.994 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-04-12T09:01:28.994 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-12T09:01:28.994 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: starting mon.smithi117 rank 0 at public addrs [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] at bind addrs [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi117 fsid 12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:01:28.994 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: mon.smithi117@-1(???) e1 preinit fsid 12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:01:28.994 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: mon.smithi117@-1(???).mds e1 new map 2024-04-12T09:01:28.995 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: mon.smithi117@-1(???).mds e1 print_map 2024-04-12T09:01:28.995 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: e1 2024-04-12T09:01:28.995 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T09:01:28.995 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:01:28.995 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: legacy client fscid: -1 2024-04-12T09:01:28.995 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-04-12T09:01:28.995 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: No filesystems configured 2024-04-12T09:01:28.995 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: mon.smithi117@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-12T09:01:28.995 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: mon.smithi117@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-12T09:01:28.995 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: mon.smithi117@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-12T09:01:28.995 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: mon.smithi117@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-12T09:01:28.995 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: mon.smithi117@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-12T09:01:28.995 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 bash[29258]: f9d5f7ac5270f6e964257b43e08d38b79d97a83858cc6ccfb8e9c197a3579c48 2024-04-12T09:01:28.996 INFO:teuthology.orchestra.run.smithi117.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-12T09:01:29.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 systemd[1]: Started Ceph mon.smithi117 for 12161984-f8ab-11ee-bc8c-c7b262605968. 2024-04-12T09:01:29.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: mon.smithi117 is new leader, mons smithi117 in quorum (ranks 0) 2024-04-12T09:01:29.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: monmap e1: 1 mons at {smithi117=[v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-12T09:01:29.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: fsmap 2024-04-12T09:01:29.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: osdmap e1: 0 total, 0 up, 0 in 2024-04-12T09:01:29.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:28 smithi117 ceph-mon[29277]: mgrmap e1: no daemons active 2024-04-12T09:01:30.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.727+0000 7ff127658700 1 Processor -- start 2024-04-12T09:01:30.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.727+0000 7ff127658700 1 -- start start 2024-04-12T09:01:30.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.727+0000 7ff127658700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff120078bc0 0x7ff120077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:30.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.728+0000 7ff127658700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff120078fd0 con 0x7ff120078bc0 2024-04-12T09:01:30.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.728+0000 7ff1253f4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff120078bc0 0x7ff120077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:30.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.728+0000 7ff1253f4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff120078bc0 0x7ff120077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33034/0 (socket says 172.21.15.117:33034) 2024-04-12T09:01:30.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.728+0000 7ff1253f4700 1 -- 172.21.15.117:0/2481378980 learned_addr learned my addr 172.21.15.117:0/2481378980 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:30.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.728+0000 7ff1253f4700 1 -- 172.21.15.117:0/2481378980 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff120079110 con 0x7ff120078bc0 2024-04-12T09:01:30.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.728+0000 7ff1253f4700 1 --2- 172.21.15.117:0/2481378980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff120078bc0 0x7ff120077210 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009e50 tx=0x7ff11c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62eae972cd9186c server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:30.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.729+0000 7ff117fff700 1 -- 172.21.15.117:0/2481378980 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff11c0092e0 con 0x7ff120078bc0 2024-04-12T09:01:30.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.729+0000 7ff117fff700 1 -- 172.21.15.117:0/2481378980 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ff11c012430 con 0x7ff120078bc0 2024-04-12T09:01:30.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.729+0000 7ff117fff700 1 -- 172.21.15.117:0/2481378980 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff11c0075c0 con 0x7ff120078bc0 2024-04-12T09:01:30.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.729+0000 7ff127658700 1 -- 172.21.15.117:0/2481378980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff120078bc0 msgr2=0x7ff120077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:30.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.729+0000 7ff127658700 1 --2- 172.21.15.117:0/2481378980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff120078bc0 0x7ff120077210 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009e50 tx=0x7ff11c009840 comp rx=0 tx=0).stop 2024-04-12T09:01:30.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.729+0000 7ff127658700 1 -- 172.21.15.117:0/2481378980 shutdown_connections 2024-04-12T09:01:30.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.729+0000 7ff127658700 1 --2- 172.21.15.117:0/2481378980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff120078bc0 0x7ff120077210 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:30.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.729+0000 7ff127658700 1 -- 172.21.15.117:0/2481378980 >> 172.21.15.117:0/2481378980 conn(0x7ff1200fe0a0 msgr2=0x7ff1201004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:30.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.730+0000 7ff127658700 1 -- 172.21.15.117:0/2481378980 shutdown_connections 2024-04-12T09:01:30.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.730+0000 7ff127658700 1 -- 172.21.15.117:0/2481378980 wait complete. 2024-04-12T09:01:30.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.730+0000 7ff127658700 1 Processor -- start 2024-04-12T09:01:30.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.730+0000 7ff127658700 1 -- start start 2024-04-12T09:01:30.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.730+0000 7ff127658700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff120078bc0 0x7ff120113960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:30.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.730+0000 7ff127658700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff120113ea0 con 0x7ff120078bc0 2024-04-12T09:01:30.377 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.730+0000 7ff1253f4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff120078bc0 0x7ff120113960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:30.377 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.730+0000 7ff1253f4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff120078bc0 0x7ff120113960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33040/0 (socket says 172.21.15.117:33040) 2024-04-12T09:01:30.377 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.730+0000 7ff1253f4700 1 -- 172.21.15.117:0/2490377242 learned_addr learned my addr 172.21.15.117:0/2490377242 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:30.377 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.731+0000 7ff1253f4700 1 -- 172.21.15.117:0/2490377242 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c009ae0 con 0x7ff120078bc0 2024-04-12T09:01:30.377 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.731+0000 7ff1253f4700 1 --2- 172.21.15.117:0/2490377242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff120078bc0 0x7ff120113960 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009fd0 tx=0x7ff11c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:30.377 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.731+0000 7ff115ffb700 1 -- 172.21.15.117:0/2490377242 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff11c0092e0 con 0x7ff120078bc0 2024-04-12T09:01:30.377 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.731+0000 7ff127658700 1 -- 172.21.15.117:0/2490377242 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1201140a0 con 0x7ff120078bc0 2024-04-12T09:01:30.377 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.731+0000 7ff115ffb700 1 -- 172.21.15.117:0/2490377242 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ff11c007cc0 con 0x7ff120078bc0 2024-04-12T09:01:30.377 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.731+0000 7ff115ffb700 1 -- 172.21.15.117:0/2490377242 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff11c01c850 con 0x7ff120078bc0 2024-04-12T09:01:30.377 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.731+0000 7ff127658700 1 -- 172.21.15.117:0/2490377242 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff120114c10 con 0x7ff120078bc0 2024-04-12T09:01:30.377 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.731+0000 7ff115ffb700 1 -- 172.21.15.117:0/2490377242 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff11c019070 con 0x7ff120078bc0 2024-04-12T09:01:30.378 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.731+0000 7ff115ffb700 1 -- 172.21.15.117:0/2490377242 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff11c025b00 con 0x7ff120078bc0 2024-04-12T09:01:30.378 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.732+0000 7ff127658700 1 -- 172.21.15.117:0/2490377242 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff12005f5f0 con 0x7ff120078bc0 2024-04-12T09:01:30.378 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.734+0000 7ff115ffb700 1 -- 172.21.15.117:0/2490377242 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ff11c02a060 con 0x7ff120078bc0 2024-04-12T09:01:30.378 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.801+0000 7ff127658700 1 -- 172.21.15.117:0/2490377242 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7ff120108ad0 con 0x7ff120078bc0 2024-04-12T09:01:30.378 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.804+0000 7ff115ffb700 1 -- 172.21.15.117:0/2490377242 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff11c020070 con 0x7ff120078bc0 2024-04-12T09:01:30.378 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.804+0000 7ff127658700 1 -- 172.21.15.117:0/2490377242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff120078bc0 msgr2=0x7ff120113960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:30.378 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.804+0000 7ff127658700 1 --2- 172.21.15.117:0/2490377242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff120078bc0 0x7ff120113960 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009fd0 tx=0x7ff11c009840 comp rx=0 tx=0).stop 2024-04-12T09:01:30.378 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.804+0000 7ff127658700 1 -- 172.21.15.117:0/2490377242 shutdown_connections 2024-04-12T09:01:30.378 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.804+0000 7ff127658700 1 --2- 172.21.15.117:0/2490377242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff120078bc0 0x7ff120113960 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:30.378 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.804+0000 7ff127658700 1 -- 172.21.15.117:0/2490377242 >> 172.21.15.117:0/2490377242 conn(0x7ff1200fe0a0 msgr2=0x7ff1200fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:30.379 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.804+0000 7ff127658700 1 -- 172.21.15.117:0/2490377242 shutdown_connections 2024-04-12T09:01:30.379 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:29.805+0000 7ff127658700 1 -- 172.21.15.117:0/2490377242 wait complete. 2024-04-12T09:01:30.379 INFO:teuthology.orchestra.run.smithi117.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-12T09:01:30.379 INFO:teuthology.orchestra.run.smithi117.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-12T09:01:30.379 INFO:teuthology.orchestra.run.smithi117.stdout:Creating mgr... 2024-04-12T09:01:30.379 INFO:teuthology.orchestra.run.smithi117.stdout:Verifying port 9283 ... 2024-04-12T09:01:30.538 INFO:teuthology.orchestra.run.smithi117.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-12161984-f8ab-11ee-bc8c-c7b262605968@mgr.smithi117.oyaxql 2024-04-12T09:01:30.538 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl: stderr Failed to reset failed state of unit ceph-12161984-f8ab-11ee-bc8c-c7b262605968@mgr.smithi117.oyaxql.service: Unit ceph-12161984-f8ab-11ee-bc8c-c7b262605968@mgr.smithi117.oyaxql.service not loaded. 2024-04-12T09:01:30.682 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-12161984-f8ab-11ee-bc8c-c7b262605968.target.wants/ceph-12161984-f8ab-11ee-bc8c-c7b262605968@mgr.smithi117.oyaxql.service → /etc/systemd/system/ceph-12161984-f8ab-11ee-bc8c-c7b262605968@.service. 2024-04-12T09:01:31.002 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:30 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/2490377242' entity='client.admin' 2024-04-12T09:01:31.142 INFO:teuthology.orchestra.run.smithi117.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-12T09:01:31.143 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl: stdout disabled 2024-04-12T09:01:31.150 INFO:teuthology.orchestra.run.smithi117.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-12T09:01:31.151 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl: stdout inactive 2024-04-12T09:01:31.151 INFO:teuthology.orchestra.run.smithi117.stdout:firewalld.service is not enabled 2024-04-12T09:01:31.151 INFO:teuthology.orchestra.run.smithi117.stdout:Not possible to enable service . firewalld.service is not available 2024-04-12T09:01:31.159 INFO:teuthology.orchestra.run.smithi117.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-12T09:01:31.159 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl: stdout disabled 2024-04-12T09:01:31.167 INFO:teuthology.orchestra.run.smithi117.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-12T09:01:31.167 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl: stdout inactive 2024-04-12T09:01:31.167 INFO:teuthology.orchestra.run.smithi117.stdout:firewalld.service is not enabled 2024-04-12T09:01:31.167 INFO:teuthology.orchestra.run.smithi117.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2024-04-12T09:01:31.167 INFO:teuthology.orchestra.run.smithi117.stdout:Waiting for mgr to start... 2024-04-12T09:01:31.167 INFO:teuthology.orchestra.run.smithi117.stdout:Waiting for mgr... 2024-04-12T09:01:31.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:31 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/1034914154' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-12T09:01:32.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout 2024-04-12T09:01:32.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout { 2024-04-12T09:01:32.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "fsid": "12161984-f8ab-11ee-bc8c-c7b262605968", 2024-04-12T09:01:32.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "health": { 2024-04-12T09:01:32.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-12T09:01:32.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-12T09:01:32.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-12T09:01:32.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:32.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-12T09:01:32.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-12T09:01:32.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout 0 2024-04-12T09:01:32.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout ], 2024-04-12T09:01:32.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-12T09:01:32.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "smithi117" 2024-04-12T09:01:32.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout ], 2024-04-12T09:01:32.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-04-12T09:01:32.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-12T09:01:32.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T09:01:32.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-12T09:01:32.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-12T09:01:32.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:32.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-12T09:01:32.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T09:01:32.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-12T09:01:32.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-12T09:01:32.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-12T09:01:32.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-12T09:01:32.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-12T09:01:32.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-12T09:01:32.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:32.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-12T09:01:32.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-12T09:01:32.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-12T09:01:32.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-12T09:01:32.376 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-12T09:01:32.384 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-12T09:01:32.384 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-12T09:01:32.384 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-12T09:01:32.384 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-12T09:01:32.384 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:32.384 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-12T09:01:32.384 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T09:01:32.384 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-12T09:01:32.384 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-12T09:01:32.385 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:32.385 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-12T09:01:32.385 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-12T09:01:32.385 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-12T09:01:32.385 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-12T09:01:32.385 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-12T09:01:32.385 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-12T09:01:32.385 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "restful" 2024-04-12T09:01:32.385 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout ], 2024-04-12T09:01:32.385 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-12T09:01:32.385 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:32.385 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-12T09:01:32.385 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T09:01:32.385 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "modified": "2024-04-12T09:01:24.210556+0000", 2024-04-12T09:01:32.385 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-12T09:01:32.385 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:32.386 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-12T09:01:32.386 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout } 2024-04-12T09:01:32.386 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.603+0000 7fe2f876c700 1 Processor -- start 2024-04-12T09:01:32.386 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.603+0000 7fe2f876c700 1 -- start start 2024-04-12T09:01:32.386 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.603+0000 7fe2f876c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2f0101830 0x7fe2f0101c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:32.386 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.603+0000 7fe2f876c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f0102180 con 0x7fe2f0101830 2024-04-12T09:01:32.386 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.604+0000 7fe2f6508700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2f0101830 0x7fe2f0101c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:32.386 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.604+0000 7fe2f6508700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2f0101830 0x7fe2f0101c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33074/0 (socket says 172.21.15.117:33074) 2024-04-12T09:01:32.386 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.604+0000 7fe2f6508700 1 -- 172.21.15.117:0/2490552689 learned_addr learned my addr 172.21.15.117:0/2490552689 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:32.386 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.604+0000 7fe2f6508700 1 -- 172.21.15.117:0/2490552689 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f01022c0 con 0x7fe2f0101830 2024-04-12T09:01:32.386 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.604+0000 7fe2f6508700 1 --2- 172.21.15.117:0/2490552689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2f0101830 0x7fe2f0101c40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0098e0 tx=0x7fe2ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3f4addd99d9786 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:32.386 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.604+0000 7fe2f5506700 1 -- 172.21.15.117:0/2490552689 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe2ec00b860 con 0x7fe2f0101830 2024-04-12T09:01:32.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.604+0000 7fe2f5506700 1 -- 172.21.15.117:0/2490552689 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe2ec00be50 con 0x7fe2f0101830 2024-04-12T09:01:32.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.604+0000 7fe2f5506700 1 -- 172.21.15.117:0/2490552689 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe2ec010380 con 0x7fe2f0101830 2024-04-12T09:01:32.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.605+0000 7fe2f876c700 1 -- 172.21.15.117:0/2490552689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2f0101830 msgr2=0x7fe2f0101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:32.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.605+0000 7fe2f876c700 1 --2- 172.21.15.117:0/2490552689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2f0101830 0x7fe2f0101c40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0098e0 tx=0x7fe2ec009250 comp rx=0 tx=0).stop 2024-04-12T09:01:32.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.605+0000 7fe2f876c700 1 -- 172.21.15.117:0/2490552689 shutdown_connections 2024-04-12T09:01:32.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.605+0000 7fe2f876c700 1 --2- 172.21.15.117:0/2490552689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2f0101830 0x7fe2f0101c40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:32.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.605+0000 7fe2f876c700 1 -- 172.21.15.117:0/2490552689 >> 172.21.15.117:0/2490552689 conn(0x7fe2f00fcfb0 msgr2=0x7fe2f00ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:32.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.605+0000 7fe2f876c700 1 -- 172.21.15.117:0/2490552689 shutdown_connections 2024-04-12T09:01:32.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.605+0000 7fe2f876c700 1 -- 172.21.15.117:0/2490552689 wait complete. 2024-04-12T09:01:32.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.605+0000 7fe2f876c700 1 Processor -- start 2024-04-12T09:01:32.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.606+0000 7fe2f876c700 1 -- start start 2024-04-12T09:01:32.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.606+0000 7fe2f876c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2f0101830 0x7fe2f01079e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:32.387 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.606+0000 7fe2f876c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f0107f20 con 0x7fe2f0101830 2024-04-12T09:01:32.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.606+0000 7fe2f6508700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2f0101830 0x7fe2f01079e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:32.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.606+0000 7fe2f6508700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2f0101830 0x7fe2f01079e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33078/0 (socket says 172.21.15.117:33078) 2024-04-12T09:01:32.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.606+0000 7fe2f6508700 1 -- 172.21.15.117:0/1034914154 learned_addr learned my addr 172.21.15.117:0/1034914154 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:32.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.606+0000 7fe2f6508700 1 -- 172.21.15.117:0/1034914154 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec0094f0 con 0x7fe2f0101830 2024-04-12T09:01:32.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.606+0000 7fe2f6508700 1 --2- 172.21.15.117:0/1034914154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2f0101830 0x7fe2f01079e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec006b00 tx=0x7fe2ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:32.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.606+0000 7fe2e6ffd700 1 -- 172.21.15.117:0/1034914154 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe2ec010760 con 0x7fe2f0101830 2024-04-12T09:01:32.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.606+0000 7fe2f876c700 1 -- 172.21.15.117:0/1034914154 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f0105f90 con 0x7fe2f0101830 2024-04-12T09:01:32.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.606+0000 7fe2e6ffd700 1 -- 172.21.15.117:0/1034914154 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe2ec010d50 con 0x7fe2f0101830 2024-04-12T09:01:32.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.606+0000 7fe2e6ffd700 1 -- 172.21.15.117:0/1034914154 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe2ec01ad40 con 0x7fe2f0101830 2024-04-12T09:01:32.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.606+0000 7fe2f876c700 1 -- 172.21.15.117:0/1034914154 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f0106480 con 0x7fe2f0101830 2024-04-12T09:01:32.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.607+0000 7fe2e6ffd700 1 -- 172.21.15.117:0/1034914154 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe2ec02e6c0 con 0x7fe2f0101830 2024-04-12T09:01:32.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.607+0000 7fe2e6ffd700 1 -- 172.21.15.117:0/1034914154 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe2ec024860 con 0x7fe2f0101830 2024-04-12T09:01:32.388 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.607+0000 7fe2f876c700 1 -- 172.21.15.117:0/1034914154 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f004bed0 con 0x7fe2f0101830 2024-04-12T09:01:32.389 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.609+0000 7fe2e6ffd700 1 -- 172.21.15.117:0/1034914154 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe2ec029070 con 0x7fe2f0101830 2024-04-12T09:01:32.389 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.681+0000 7fe2f876c700 1 -- 172.21.15.117:0/1034914154 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fe2f010b2e0 con 0x7fe2f0101830 2024-04-12T09:01:32.389 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.681+0000 7fe2e6ffd700 1 -- 172.21.15.117:0/1034914154 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fe2ec01a5c0 con 0x7fe2f0101830 2024-04-12T09:01:32.389 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.682+0000 7fe2f876c700 1 -- 172.21.15.117:0/1034914154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2f0101830 msgr2=0x7fe2f01079e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:32.389 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.682+0000 7fe2f876c700 1 --2- 172.21.15.117:0/1034914154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2f0101830 0x7fe2f01079e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec006b00 tx=0x7fe2ec009250 comp rx=0 tx=0).stop 2024-04-12T09:01:32.389 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.682+0000 7fe2f876c700 1 -- 172.21.15.117:0/1034914154 shutdown_connections 2024-04-12T09:01:32.389 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.682+0000 7fe2f876c700 1 --2- 172.21.15.117:0/1034914154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2f0101830 0x7fe2f01079e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:32.389 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.682+0000 7fe2f876c700 1 -- 172.21.15.117:0/1034914154 >> 172.21.15.117:0/1034914154 conn(0x7fe2f00fcfb0 msgr2=0x7fe2f00fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:32.389 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.682+0000 7fe2f876c700 1 -- 172.21.15.117:0/1034914154 shutdown_connections 2024-04-12T09:01:32.389 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:31.682+0000 7fe2f876c700 1 -- 172.21.15.117:0/1034914154 wait complete. 2024-04-12T09:01:32.389 INFO:teuthology.orchestra.run.smithi117.stdout:mgr not available, waiting (1/15)... 2024-04-12T09:01:35.102 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:34 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/2593558415' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-12T09:01:35.488 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout 2024-04-12T09:01:35.488 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout { 2024-04-12T09:01:35.488 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "fsid": "12161984-f8ab-11ee-bc8c-c7b262605968", 2024-04-12T09:01:35.488 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "health": { 2024-04-12T09:01:35.488 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-12T09:01:35.488 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-12T09:01:35.488 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-12T09:01:35.488 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:35.488 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-12T09:01:35.488 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-12T09:01:35.488 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout 0 2024-04-12T09:01:35.489 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout ], 2024-04-12T09:01:35.489 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-12T09:01:35.489 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "smithi117" 2024-04-12T09:01:35.489 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout ], 2024-04-12T09:01:35.489 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-04-12T09:01:35.489 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-12T09:01:35.489 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T09:01:35.489 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-12T09:01:35.489 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-12T09:01:35.489 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:35.489 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-12T09:01:35.489 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T09:01:35.489 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-12T09:01:35.489 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-12T09:01:35.490 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-12T09:01:35.490 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-12T09:01:35.490 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-12T09:01:35.490 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-12T09:01:35.490 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:35.490 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-12T09:01:35.490 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-12T09:01:35.490 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-12T09:01:35.490 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-12T09:01:35.490 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-12T09:01:35.490 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-12T09:01:35.490 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-12T09:01:35.490 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-12T09:01:35.490 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "restful" 2024-04-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout ], 2024-04-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "modified": "2024-04-12T09:01:24.210556+0000", 2024-04-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout } 2024-04-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.809+0000 7f0307622700 1 Processor -- start 2024-04-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.809+0000 7f0307622700 1 -- start start 2024-04-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.810+0000 7f0307622700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0300101830 0x7f0300101c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.810+0000 7f0307622700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0300102180 con 0x7f0300101830 2024-04-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.810+0000 7f03053be700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0300101830 0x7f0300101c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.810+0000 7f03053be700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0300101830 0x7f0300101c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33092/0 (socket says 172.21.15.117:33092) 2024-04-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.810+0000 7f03053be700 1 -- 172.21.15.117:0/2289849142 learned_addr learned my addr 172.21.15.117:0/2289849142 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.810+0000 7f03053be700 1 -- 172.21.15.117:0/2289849142 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03001022c0 con 0x7f0300101830 2024-04-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.810+0000 7f03053be700 1 --2- 172.21.15.117:0/2289849142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0300101830 0x7f0300101c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f02fc00bb80 tx=0x7f02fc00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe198c8c86525ce4 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.810+0000 7f02f7fff700 1 -- 172.21.15.117:0/2289849142 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f02fc00dd00 con 0x7f0300101830 2024-04-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.810+0000 7f02f7fff700 1 -- 172.21.15.117:0/2289849142 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f02fc00de60 con 0x7f0300101830 2024-04-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.810+0000 7f02f7fff700 1 -- 172.21.15.117:0/2289849142 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f02fc0188a0 con 0x7f0300101830 2024-04-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.811+0000 7f0307622700 1 -- 172.21.15.117:0/2289849142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0300101830 msgr2=0x7f0300101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.811+0000 7f0307622700 1 --2- 172.21.15.117:0/2289849142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0300101830 0x7f0300101c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f02fc00bb80 tx=0x7f02fc00b4f0 comp rx=0 tx=0).stop 2024-04-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.811+0000 7f0307622700 1 -- 172.21.15.117:0/2289849142 shutdown_connections 2024-04-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.811+0000 7f0307622700 1 --2- 172.21.15.117:0/2289849142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0300101830 0x7f0300101c40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.811+0000 7f0307622700 1 -- 172.21.15.117:0/2289849142 >> 172.21.15.117:0/2289849142 conn(0x7f03000fcfb0 msgr2=0x7f03000ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.811+0000 7f0307622700 1 -- 172.21.15.117:0/2289849142 shutdown_connections 2024-04-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.811+0000 7f0307622700 1 -- 172.21.15.117:0/2289849142 wait complete. 2024-04-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.812+0000 7f0307622700 1 Processor -- start 2024-04-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.812+0000 7f0307622700 1 -- start start 2024-04-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.812+0000 7f0307622700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0300101830 0x7f0300113890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.812+0000 7f0307622700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0300113dd0 con 0x7f0300101830 2024-04-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.812+0000 7f03053be700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0300101830 0x7f0300113890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.812+0000 7f03053be700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0300101830 0x7f0300113890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33096/0 (socket says 172.21.15.117:33096) 2024-04-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.812+0000 7f03053be700 1 -- 172.21.15.117:0/2593558415 learned_addr learned my addr 172.21.15.117:0/2593558415 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.813+0000 7f03053be700 1 -- 172.21.15.117:0/2593558415 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02fc00b790 con 0x7f0300101830 2024-04-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.813+0000 7f03053be700 1 --2- 172.21.15.117:0/2593558415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0300101830 0x7f0300113890 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f02fc0184f0 tx=0x7f02fc00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.813+0000 7f02f5ffb700 1 -- 172.21.15.117:0/2593558415 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f02fc00dc70 con 0x7f0300101830 2024-04-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.813+0000 7f02f5ffb700 1 -- 172.21.15.117:0/2593558415 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f02fc010bd0 con 0x7f0300101830 2024-04-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.813+0000 7f0307622700 1 -- 172.21.15.117:0/2593558415 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0300113fd0 con 0x7f0300101830 2024-04-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.813+0000 7f02f5ffb700 1 -- 172.21.15.117:0/2593558415 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f02fc021550 con 0x7f0300101830 2024-04-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.813+0000 7f0307622700 1 -- 172.21.15.117:0/2593558415 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0300114b40 con 0x7f0300101830 2024-04-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.813+0000 7f02f5ffb700 1 -- 172.21.15.117:0/2593558415 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f02fc021700 con 0x7f0300101830 2024-04-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.813+0000 7f02f5ffb700 1 -- 172.21.15.117:0/2593558415 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f02fc014070 con 0x7f0300101830 2024-04-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.814+0000 7f0307622700 1 -- 172.21.15.117:0/2593558415 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030005f5f0 con 0x7f0300101830 2024-04-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.816+0000 7f02f5ffb700 1 -- 172.21.15.117:0/2593558415 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f02fc031060 con 0x7f0300101830 2024-04-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.887+0000 7f0307622700 1 -- 172.21.15.117:0/2593558415 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f0300103560 con 0x7f0300101830 2024-04-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.888+0000 7f02f5ffb700 1 -- 172.21.15.117:0/2593558415 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f02fc026020 con 0x7f0300101830 2024-04-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.889+0000 7f0307622700 1 -- 172.21.15.117:0/2593558415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0300101830 msgr2=0x7f0300113890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.889+0000 7f0307622700 1 --2- 172.21.15.117:0/2593558415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0300101830 0x7f0300113890 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f02fc0184f0 tx=0x7f02fc00b4f0 comp rx=0 tx=0).stop 2024-04-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.889+0000 7f0307622700 1 -- 172.21.15.117:0/2593558415 shutdown_connections 2024-04-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.889+0000 7f0307622700 1 --2- 172.21.15.117:0/2593558415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0300101830 0x7f0300113890 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:35.496 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.889+0000 7f0307622700 1 -- 172.21.15.117:0/2593558415 >> 172.21.15.117:0/2593558415 conn(0x7f03000fcfb0 msgr2=0x7f0300105c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:35.496 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.889+0000 7f0307622700 1 -- 172.21.15.117:0/2593558415 shutdown_connections 2024-04-12T09:01:35.496 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:34.889+0000 7f0307622700 1 -- 172.21.15.117:0/2593558415 wait complete. 2024-04-12T09:01:35.496 INFO:teuthology.orchestra.run.smithi117.stdout:mgr not available, waiting (2/15)... 2024-04-12T09:01:37.608 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:37 smithi117 ceph-mon[29277]: Activating manager daemon smithi117.oyaxql 2024-04-12T09:01:37.608 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:37 smithi117 ceph-mon[29277]: mgrmap e2: smithi117.oyaxql(active, starting, since 0.00277534s) 2024-04-12T09:01:37.608 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:37 smithi117 ceph-mon[29277]: from='mgr.14100 172.21.15.117:0/2039401859' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-12T09:01:37.608 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:37 smithi117 ceph-mon[29277]: from='mgr.14100 172.21.15.117:0/2039401859' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-12T09:01:37.608 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:37 smithi117 ceph-mon[29277]: from='mgr.14100 172.21.15.117:0/2039401859' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-12T09:01:37.609 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:37 smithi117 ceph-mon[29277]: from='mgr.14100 172.21.15.117:0/2039401859' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-04-12T09:01:37.609 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:37 smithi117 ceph-mon[29277]: from='mgr.14100 172.21.15.117:0/2039401859' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr metadata", "who": "smithi117.oyaxql", "id": "smithi117.oyaxql"}]: dispatch 2024-04-12T09:01:37.609 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:37 smithi117 ceph-mon[29277]: Manager daemon smithi117.oyaxql is now available 2024-04-12T09:01:37.609 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:37 smithi117 ceph-mon[29277]: from='mgr.14100 172.21.15.117:0/2039401859' entity='mgr.smithi117.oyaxql' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.oyaxql/mirror_snapshot_schedule"}]: dispatch 2024-04-12T09:01:37.609 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:37 smithi117 ceph-mon[29277]: from='mgr.14100 172.21.15.117:0/2039401859' entity='mgr.smithi117.oyaxql' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.oyaxql/trash_purge_schedule"}]: dispatch 2024-04-12T09:01:37.609 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:37 smithi117 ceph-mon[29277]: from='mgr.14100 172.21.15.117:0/2039401859' entity='mgr.smithi117.oyaxql' 2024-04-12T09:01:37.609 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:37 smithi117 ceph-mon[29277]: from='mgr.14100 172.21.15.117:0/2039401859' entity='mgr.smithi117.oyaxql' 2024-04-12T09:01:37.609 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:37 smithi117 ceph-mon[29277]: from='mgr.14100 172.21.15.117:0/2039401859' entity='mgr.smithi117.oyaxql' 2024-04-12T09:01:38.561 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout 2024-04-12T09:01:38.561 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout { 2024-04-12T09:01:38.561 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "fsid": "12161984-f8ab-11ee-bc8c-c7b262605968", 2024-04-12T09:01:38.561 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "health": { 2024-04-12T09:01:38.562 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-12T09:01:38.562 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-12T09:01:38.562 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-12T09:01:38.562 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:38.562 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-12T09:01:38.562 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-12T09:01:38.562 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout 0 2024-04-12T09:01:38.562 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout ], 2024-04-12T09:01:38.562 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-12T09:01:38.562 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "smithi117" 2024-04-12T09:01:38.562 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout ], 2024-04-12T09:01:38.562 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-04-12T09:01:38.562 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-12T09:01:38.563 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T09:01:38.563 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-12T09:01:38.563 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-12T09:01:38.563 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:38.563 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-12T09:01:38.563 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T09:01:38.563 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-12T09:01:38.563 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-12T09:01:38.563 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-12T09:01:38.563 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-12T09:01:38.563 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-12T09:01:38.563 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-12T09:01:38.563 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:38.571 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-12T09:01:38.571 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-12T09:01:38.571 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-12T09:01:38.571 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-12T09:01:38.571 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-12T09:01:38.571 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-12T09:01:38.571 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-12T09:01:38.571 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-12T09:01:38.571 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-12T09:01:38.571 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:38.571 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-12T09:01:38.571 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T09:01:38.572 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-12T09:01:38.572 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-12T09:01:38.572 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:38.572 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-12T09:01:38.572 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-12T09:01:38.572 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-12T09:01:38.572 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-12T09:01:38.572 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-12T09:01:38.572 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-12T09:01:38.572 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "restful" 2024-04-12T09:01:38.572 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout ], 2024-04-12T09:01:38.572 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-12T09:01:38.572 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:38.572 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-12T09:01:38.573 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T09:01:38.573 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "modified": "2024-04-12T09:01:24.210556+0000", 2024-04-12T09:01:38.573 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-12T09:01:38.573 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:38.573 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-12T09:01:38.573 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout } 2024-04-12T09:01:38.573 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.920+0000 7f710fe3d700 1 Processor -- start 2024-04-12T09:01:38.573 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.920+0000 7f710fe3d700 1 -- start start 2024-04-12T09:01:38.573 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.920+0000 7f710fe3d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7108071270 0x7f7108105520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:38.573 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.920+0000 7f710fe3d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7108071680 con 0x7f7108071270 2024-04-12T09:01:38.573 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.921+0000 7f710dbd9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7108071270 0x7f7108105520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:38.573 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.921+0000 7f710dbd9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7108071270 0x7f7108105520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33170/0 (socket says 172.21.15.117:33170) 2024-04-12T09:01:38.573 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.921+0000 7f710dbd9700 1 -- 172.21.15.117:0/2188970462 learned_addr learned my addr 172.21.15.117:0/2188970462 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:38.573 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.921+0000 7f710dbd9700 1 -- 172.21.15.117:0/2188970462 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7108105a60 con 0x7f7108071270 2024-04-12T09:01:38.573 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.921+0000 7f710dbd9700 1 --2- 172.21.15.117:0/2188970462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7108071270 0x7f7108105520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7100009e50 tx=0x7f7100009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210a20fa3bce1b74 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:38.573 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.921+0000 7f710cbd7700 1 -- 172.21.15.117:0/2188970462 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71000092e0 con 0x7f7108071270 2024-04-12T09:01:38.574 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.921+0000 7f710cbd7700 1 -- 172.21.15.117:0/2188970462 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7100012430 con 0x7f7108071270 2024-04-12T09:01:38.574 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.921+0000 7f710cbd7700 1 -- 172.21.15.117:0/2188970462 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71000075c0 con 0x7f7108071270 2024-04-12T09:01:38.574 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.922+0000 7f710fe3d700 1 -- 172.21.15.117:0/2188970462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7108071270 msgr2=0x7f7108105520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:38.574 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.922+0000 7f710fe3d700 1 --2- 172.21.15.117:0/2188970462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7108071270 0x7f7108105520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7100009e50 tx=0x7f7100009840 comp rx=0 tx=0).stop 2024-04-12T09:01:38.574 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.922+0000 7f710fe3d700 1 -- 172.21.15.117:0/2188970462 shutdown_connections 2024-04-12T09:01:38.574 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.922+0000 7f710fe3d700 1 --2- 172.21.15.117:0/2188970462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7108071270 0x7f7108105520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:38.574 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.922+0000 7f710fe3d700 1 -- 172.21.15.117:0/2188970462 >> 172.21.15.117:0/2188970462 conn(0x7f71080fcfb0 msgr2=0x7f71080ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:38.574 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.922+0000 7f710fe3d700 1 -- 172.21.15.117:0/2188970462 shutdown_connections 2024-04-12T09:01:38.574 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.922+0000 7f710fe3d700 1 -- 172.21.15.117:0/2188970462 wait complete. 2024-04-12T09:01:38.574 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.923+0000 7f710fe3d700 1 Processor -- start 2024-04-12T09:01:38.577 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.923+0000 7f710fe3d700 1 -- start start 2024-04-12T09:01:38.578 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.923+0000 7f710fe3d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7108071270 0x7f7108111740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:38.578 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.923+0000 7f710fe3d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7108111c80 con 0x7f7108071270 2024-04-12T09:01:38.578 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.923+0000 7f710dbd9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7108071270 0x7f7108111740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:38.578 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.923+0000 7f710dbd9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7108071270 0x7f7108111740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33180/0 (socket says 172.21.15.117:33180) 2024-04-12T09:01:38.578 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.923+0000 7f710dbd9700 1 -- 172.21.15.117:0/1987890150 learned_addr learned my addr 172.21.15.117:0/1987890150 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:38.578 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.923+0000 7f710dbd9700 1 -- 172.21.15.117:0/1987890150 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7100009ae0 con 0x7f7108071270 2024-04-12T09:01:38.578 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.923+0000 7f710dbd9700 1 --2- 172.21.15.117:0/1987890150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7108071270 0x7f7108111740 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7100000f80 tx=0x7f7100009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:38.578 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.923+0000 7f71067fc700 1 -- 172.21.15.117:0/1987890150 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71000092e0 con 0x7f7108071270 2024-04-12T09:01:38.578 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.923+0000 7f71067fc700 1 -- 172.21.15.117:0/1987890150 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7100007cc0 con 0x7f7108071270 2024-04-12T09:01:38.578 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.923+0000 7f710fe3d700 1 -- 172.21.15.117:0/1987890150 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7108111e80 con 0x7f7108071270 2024-04-12T09:01:38.578 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.924+0000 7f71067fc700 1 -- 172.21.15.117:0/1987890150 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f710001c910 con 0x7f7108071270 2024-04-12T09:01:38.578 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.924+0000 7f710fe3d700 1 -- 172.21.15.117:0/1987890150 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71081129f0 con 0x7f7108071270 2024-04-12T09:01:38.579 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.924+0000 7f71067fc700 1 -- 172.21.15.117:0/1987890150 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 2) v1 ==== 43124+0+0 (secure 0 0 0) 0x7f7100019070 con 0x7f7108071270 2024-04-12T09:01:38.579 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.925+0000 7f710fe3d700 1 -- 172.21.15.117:0/1987890150 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710805f5f0 con 0x7f7108071270 2024-04-12T09:01:38.579 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.925+0000 7f71067fc700 1 -- 172.21.15.117:0/1987890150 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f7100049b00 con 0x7f7108071270 2024-04-12T09:01:38.579 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.927+0000 7f71067fc700 1 -- 172.21.15.117:0/1987890150 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f7100019910 con 0x7f7108071270 2024-04-12T09:01:38.579 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.995+0000 7f710fe3d700 1 -- 172.21.15.117:0/1987890150 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f7108113540 con 0x7f7108071270 2024-04-12T09:01:38.579 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.995+0000 7f71067fc700 1 -- 172.21.15.117:0/1987890150 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f7100017030 con 0x7f7108071270 2024-04-12T09:01:38.579 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.996+0000 7f710fe3d700 1 -- 172.21.15.117:0/1987890150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7108071270 msgr2=0x7f7108111740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:38.579 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.996+0000 7f710fe3d700 1 --2- 172.21.15.117:0/1987890150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7108071270 0x7f7108111740 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7100000f80 tx=0x7f7100009840 comp rx=0 tx=0).stop 2024-04-12T09:01:38.579 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.996+0000 7f710fe3d700 1 -- 172.21.15.117:0/1987890150 shutdown_connections 2024-04-12T09:01:38.579 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.996+0000 7f710fe3d700 1 --2- 172.21.15.117:0/1987890150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7108071270 0x7f7108111740 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:38.579 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.996+0000 7f710fe3d700 1 -- 172.21.15.117:0/1987890150 >> 172.21.15.117:0/1987890150 conn(0x7f71080fcfb0 msgr2=0x7f71080fdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:38.579 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.996+0000 7f710fe3d700 1 -- 172.21.15.117:0/1987890150 shutdown_connections 2024-04-12T09:01:38.579 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:37.996+0000 7f710fe3d700 1 -- 172.21.15.117:0/1987890150 wait complete. 2024-04-12T09:01:38.579 INFO:teuthology.orchestra.run.smithi117.stdout:mgr not available, waiting (3/15)... 2024-04-12T09:01:38.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:38 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/1987890150' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-12T09:01:38.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:38 smithi117 ceph-mon[29277]: mgrmap e3: smithi117.oyaxql(active, since 1.00642s) 2024-04-12T09:01:40.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:40 smithi117 ceph-mon[29277]: mgrmap e4: smithi117.oyaxql(active, since 2s) 2024-04-12T09:01:41.851 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout 2024-04-12T09:01:41.851 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout { 2024-04-12T09:01:41.851 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "fsid": "12161984-f8ab-11ee-bc8c-c7b262605968", 2024-04-12T09:01:41.851 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "health": { 2024-04-12T09:01:41.851 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-12T09:01:41.851 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-12T09:01:41.851 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-12T09:01:41.851 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:41.851 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-12T09:01:41.852 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-12T09:01:41.852 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout 0 2024-04-12T09:01:41.852 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout ], 2024-04-12T09:01:41.852 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-12T09:01:41.852 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "smithi117" 2024-04-12T09:01:41.852 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout ], 2024-04-12T09:01:41.852 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-04-12T09:01:41.852 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-12T09:01:41.852 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T09:01:41.852 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-12T09:01:41.852 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-12T09:01:41.852 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:41.852 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-12T09:01:41.852 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T09:01:41.852 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-12T09:01:41.852 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-12T09:01:41.852 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-12T09:01:41.861 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-12T09:01:41.861 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-12T09:01:41.861 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-12T09:01:41.861 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:41.862 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-12T09:01:41.862 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-12T09:01:41.862 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-12T09:01:41.862 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-12T09:01:41.862 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-12T09:01:41.862 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-12T09:01:41.862 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-12T09:01:41.862 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-12T09:01:41.862 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-12T09:01:41.862 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:41.862 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-12T09:01:41.862 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T09:01:41.863 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-12T09:01:41.863 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-12T09:01:41.863 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:41.863 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-12T09:01:41.863 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-12T09:01:41.863 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-12T09:01:41.863 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-12T09:01:41.863 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-12T09:01:41.863 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-12T09:01:41.863 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "restful" 2024-04-12T09:01:41.863 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout ], 2024-04-12T09:01:41.863 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-12T09:01:41.863 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:41.863 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-12T09:01:41.863 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-12T09:01:41.864 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "modified": "2024-04-12T09:01:24.210556+0000", 2024-04-12T09:01:41.864 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-12T09:01:41.864 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout }, 2024-04-12T09:01:41.864 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-12T09:01:41.864 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout } 2024-04-12T09:01:41.864 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.021+0000 7fe387d90700 1 Processor -- start 2024-04-12T09:01:41.864 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.022+0000 7fe387d90700 1 -- start start 2024-04-12T09:01:41.864 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.022+0000 7fe387d90700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe380101d70 0x7fe380102180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:41.864 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.022+0000 7fe387d90700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3801026c0 con 0x7fe380101d70 2024-04-12T09:01:41.864 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.022+0000 7fe385b2c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe380101d70 0x7fe380102180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:41.864 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.022+0000 7fe385b2c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe380101d70 0x7fe380102180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58434/0 (socket says 172.21.15.117:58434) 2024-04-12T09:01:41.864 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.022+0000 7fe385b2c700 1 -- 172.21.15.117:0/4240737022 learned_addr learned my addr 172.21.15.117:0/4240737022 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:41.864 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.022+0000 7fe385b2c700 1 -- 172.21.15.117:0/4240737022 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe380102800 con 0x7fe380101d70 2024-04-12T09:01:41.864 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.023+0000 7fe385b2c700 1 --2- 172.21.15.117:0/4240737022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe380101d70 0x7fe380102180 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe3700098e0 tx=0x7fe370009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84338cf8980c3c7b server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.023+0000 7fe384b2a700 1 -- 172.21.15.117:0/4240737022 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe37000b860 con 0x7fe380101d70 2024-04-12T09:01:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.023+0000 7fe384b2a700 1 -- 172.21.15.117:0/4240737022 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe37000be50 con 0x7fe380101d70 2024-04-12T09:01:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.023+0000 7fe384b2a700 1 -- 172.21.15.117:0/4240737022 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe370010380 con 0x7fe380101d70 2024-04-12T09:01:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.023+0000 7fe387d90700 1 -- 172.21.15.117:0/4240737022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe380101d70 msgr2=0x7fe380102180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.023+0000 7fe387d90700 1 --2- 172.21.15.117:0/4240737022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe380101d70 0x7fe380102180 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe3700098e0 tx=0x7fe370009250 comp rx=0 tx=0).stop 2024-04-12T09:01:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.023+0000 7fe387d90700 1 -- 172.21.15.117:0/4240737022 shutdown_connections 2024-04-12T09:01:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.023+0000 7fe387d90700 1 --2- 172.21.15.117:0/4240737022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe380101d70 0x7fe380102180 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.023+0000 7fe387d90700 1 -- 172.21.15.117:0/4240737022 >> 172.21.15.117:0/4240737022 conn(0x7fe3800fc700 msgr2=0x7fe3800feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.023+0000 7fe387d90700 1 -- 172.21.15.117:0/4240737022 shutdown_connections 2024-04-12T09:01:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.023+0000 7fe387d90700 1 -- 172.21.15.117:0/4240737022 wait complete. 2024-04-12T09:01:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.024+0000 7fe387d90700 1 Processor -- start 2024-04-12T09:01:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.024+0000 7fe387d90700 1 -- start start 2024-04-12T09:01:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.024+0000 7fe387d90700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe380101d70 0x7fe3801015d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:41.865 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.024+0000 7fe387d90700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe380114340 con 0x7fe380101d70 2024-04-12T09:01:41.866 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.024+0000 7fe385b2c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe380101d70 0x7fe3801015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:41.867 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.024+0000 7fe385b2c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe380101d70 0x7fe3801015d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58440/0 (socket says 172.21.15.117:58440) 2024-04-12T09:01:41.867 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.024+0000 7fe385b2c700 1 -- 172.21.15.117:0/3888966026 learned_addr learned my addr 172.21.15.117:0/3888966026 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:41.867 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.024+0000 7fe385b2c700 1 -- 172.21.15.117:0/3888966026 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3700094f0 con 0x7fe380101d70 2024-04-12T09:01:41.867 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.025+0000 7fe385b2c700 1 --2- 172.21.15.117:0/3888966026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe380101d70 0x7fe3801015d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe370000c00 tx=0x7fe370009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:41.867 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.025+0000 7fe3767fc700 1 -- 172.21.15.117:0/3888966026 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe3700107c0 con 0x7fe380101d70 2024-04-12T09:01:41.867 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.025+0000 7fe3767fc700 1 -- 172.21.15.117:0/3888966026 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe370010db0 con 0x7fe380101d70 2024-04-12T09:01:41.867 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.025+0000 7fe3767fc700 1 -- 172.21.15.117:0/3888966026 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe37001ad00 con 0x7fe380101d70 2024-04-12T09:01:41.868 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.025+0000 7fe387d90700 1 -- 172.21.15.117:0/3888966026 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe380114480 con 0x7fe380101d70 2024-04-12T09:01:41.868 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.025+0000 7fe387d90700 1 -- 172.21.15.117:0/3888966026 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe380114970 con 0x7fe380101d70 2024-04-12T09:01:41.868 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.026+0000 7fe3767fc700 1 -- 172.21.15.117:0/3888966026 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 4) v1 ==== 43357+0+0 (secure 0 0 0) 0x7fe370010920 con 0x7fe380101d70 2024-04-12T09:01:41.868 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.026+0000 7fe387d90700 1 -- 172.21.15.117:0/3888966026 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe38004bed0 con 0x7fe380101d70 2024-04-12T09:01:41.868 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.026+0000 7fe3767fc700 1 --2- 172.21.15.117:0/3888966026 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7fe36c036790 0x7fe36c038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:41.868 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.026+0000 7fe3767fc700 1 -- 172.21.15.117:0/3888966026 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe37004a5b0 con 0x7fe380101d70 2024-04-12T09:01:41.868 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.026+0000 7fe38532b700 1 --2- 172.21.15.117:0/3888966026 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7fe36c036790 0x7fe36c038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:41.868 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.026+0000 7fe38532b700 1 --2- 172.21.15.117:0/3888966026 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7fe36c036790 0x7fe36c038c40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe37c009990 tx=0x7fe37c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:41.868 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.031+0000 7fe3767fc700 1 -- 172.21.15.117:0/3888966026 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fe370010bd0 con 0x7fe380101d70 2024-04-12T09:01:41.868 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.300+0000 7fe387d90700 1 -- 172.21.15.117:0/3888966026 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fe380103670 con 0x7fe380101d70 2024-04-12T09:01:41.868 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.301+0000 7fe3767fc700 1 -- 172.21.15.117:0/3888966026 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fe370023810 con 0x7fe380101d70 2024-04-12T09:01:41.868 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.303+0000 7fe387d90700 1 -- 172.21.15.117:0/3888966026 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7fe36c036790 msgr2=0x7fe36c038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:41.869 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.303+0000 7fe387d90700 1 --2- 172.21.15.117:0/3888966026 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7fe36c036790 0x7fe36c038c40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe37c009990 tx=0x7fe37c006e40 comp rx=0 tx=0).stop 2024-04-12T09:01:41.869 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.303+0000 7fe387d90700 1 -- 172.21.15.117:0/3888966026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe380101d70 msgr2=0x7fe3801015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:41.869 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.303+0000 7fe387d90700 1 --2- 172.21.15.117:0/3888966026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe380101d70 0x7fe3801015d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe370000c00 tx=0x7fe370009250 comp rx=0 tx=0).stop 2024-04-12T09:01:41.869 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.303+0000 7fe387d90700 1 -- 172.21.15.117:0/3888966026 shutdown_connections 2024-04-12T09:01:41.870 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.303+0000 7fe387d90700 1 --2- 172.21.15.117:0/3888966026 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7fe36c036790 0x7fe36c038c40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:41.870 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.303+0000 7fe387d90700 1 --2- 172.21.15.117:0/3888966026 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe380101d70 0x7fe3801015d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:41.870 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.303+0000 7fe387d90700 1 -- 172.21.15.117:0/3888966026 >> 172.21.15.117:0/3888966026 conn(0x7fe3800fc700 msgr2=0x7fe3800fd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:41.870 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.303+0000 7fe387d90700 1 -- 172.21.15.117:0/3888966026 shutdown_connections 2024-04-12T09:01:41.870 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:41.303+0000 7fe387d90700 1 -- 172.21.15.117:0/3888966026 wait complete. 2024-04-12T09:01:41.870 INFO:teuthology.orchestra.run.smithi117.stdout:mgr is available 2024-04-12T09:01:41.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:41 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/3888966026' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-12T09:01:42.826 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:42 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/2621693122' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-12T09:01:43.112 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout 2024-04-12T09:01:43.112 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout [global] 2024-04-12T09:01:43.112 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout fsid = 12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:01:43.112 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-12T09:01:43.112 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-12T09:01:43.112 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-12T09:01:43.112 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-12T09:01:43.113 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout 2024-04-12T09:01:43.113 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-12T09:01:43.113 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-12T09:01:43.113 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout 2024-04-12T09:01:43.113 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout [osd] 2024-04-12T09:01:43.113 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-12T09:01:43.113 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-12T09:01:43.113 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-12T09:01:43.113 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-12T09:01:43.113 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-12T09:01:43.113 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.334+0000 7faa63186700 1 Processor -- start 2024-04-12T09:01:43.113 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.334+0000 7faa63186700 1 -- start start 2024-04-12T09:01:43.114 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.334+0000 7faa63186700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa5c078c30 0x7faa5c077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:43.114 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.334+0000 7faa63186700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c079040 con 0x7faa5c078c30 2024-04-12T09:01:43.114 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.334+0000 7faa60f22700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa5c078c30 0x7faa5c077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:43.114 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.334+0000 7faa60f22700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa5c078c30 0x7faa5c077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58456/0 (socket says 172.21.15.117:58456) 2024-04-12T09:01:43.114 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.334+0000 7faa60f22700 1 -- 172.21.15.117:0/3583721522 learned_addr learned my addr 172.21.15.117:0/3583721522 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:43.114 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.335+0000 7faa60f22700 1 -- 172.21.15.117:0/3583721522 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5c077770 con 0x7faa5c078c30 2024-04-12T09:01:43.114 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.335+0000 7faa60f22700 1 --2- 172.21.15.117:0/3583721522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa5c078c30 0x7faa5c077230 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faa500098e0 tx=0x7faa50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5daba782ea57db8c server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:43.114 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.335+0000 7faa5b7fe700 1 -- 172.21.15.117:0/3583721522 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa5000b860 con 0x7faa5c078c30 2024-04-12T09:01:43.114 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.335+0000 7faa5b7fe700 1 -- 172.21.15.117:0/3583721522 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7faa5000be50 con 0x7faa5c078c30 2024-04-12T09:01:43.114 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.335+0000 7faa5b7fe700 1 -- 172.21.15.117:0/3583721522 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa50010380 con 0x7faa5c078c30 2024-04-12T09:01:43.114 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.335+0000 7faa63186700 1 -- 172.21.15.117:0/3583721522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa5c078c30 msgr2=0x7faa5c077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:43.114 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.335+0000 7faa63186700 1 --2- 172.21.15.117:0/3583721522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa5c078c30 0x7faa5c077230 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faa500098e0 tx=0x7faa50009250 comp rx=0 tx=0).stop 2024-04-12T09:01:43.115 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.335+0000 7faa63186700 1 -- 172.21.15.117:0/3583721522 shutdown_connections 2024-04-12T09:01:43.115 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.335+0000 7faa63186700 1 --2- 172.21.15.117:0/3583721522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa5c078c30 0x7faa5c077230 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:43.115 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.335+0000 7faa63186700 1 -- 172.21.15.117:0/3583721522 >> 172.21.15.117:0/3583721522 conn(0x7faa5c0fe070 msgr2=0x7faa5c1004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:43.115 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.335+0000 7faa63186700 1 -- 172.21.15.117:0/3583721522 shutdown_connections 2024-04-12T09:01:43.115 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.335+0000 7faa63186700 1 -- 172.21.15.117:0/3583721522 wait complete. 2024-04-12T09:01:43.115 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.336+0000 7faa63186700 1 Processor -- start 2024-04-12T09:01:43.115 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.336+0000 7faa63186700 1 -- start start 2024-04-12T09:01:43.115 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.336+0000 7faa63186700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa5c078c30 0x7faa5c113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:43.115 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.336+0000 7faa63186700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c113ec0 con 0x7faa5c078c30 2024-04-12T09:01:43.115 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.336+0000 7faa60f22700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa5c078c30 0x7faa5c113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:43.115 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.336+0000 7faa60f22700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa5c078c30 0x7faa5c113980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58470/0 (socket says 172.21.15.117:58470) 2024-04-12T09:01:43.115 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.336+0000 7faa60f22700 1 -- 172.21.15.117:0/2621693122 learned_addr learned my addr 172.21.15.117:0/2621693122 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:43.115 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.337+0000 7faa60f22700 1 -- 172.21.15.117:0/2621693122 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa500094f0 con 0x7faa5c078c30 2024-04-12T09:01:43.115 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.337+0000 7faa60f22700 1 --2- 172.21.15.117:0/2621693122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa5c078c30 0x7faa5c113980 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faa50006d40 tx=0x7faa50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:43.116 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.337+0000 7faa597fa700 1 -- 172.21.15.117:0/2621693122 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa50010760 con 0x7faa5c078c30 2024-04-12T09:01:43.116 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.337+0000 7faa63186700 1 -- 172.21.15.117:0/2621693122 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5c1140c0 con 0x7faa5c078c30 2024-04-12T09:01:43.116 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.337+0000 7faa597fa700 1 -- 172.21.15.117:0/2621693122 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7faa50010d50 con 0x7faa5c078c30 2024-04-12T09:01:43.116 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.337+0000 7faa597fa700 1 -- 172.21.15.117:0/2621693122 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa5001adc0 con 0x7faa5c078c30 2024-04-12T09:01:43.116 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.337+0000 7faa63186700 1 -- 172.21.15.117:0/2621693122 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5c114c30 con 0x7faa5c078c30 2024-04-12T09:01:43.116 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.338+0000 7faa597fa700 1 -- 172.21.15.117:0/2621693122 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 4) v1 ==== 43357+0+0 (secure 0 0 0) 0x7faa500193c0 con 0x7faa5c078c30 2024-04-12T09:01:43.116 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.338+0000 7faa597fa700 1 --2- 172.21.15.117:0/2621693122 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7faa4c036720 0x7faa4c038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:43.116 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.338+0000 7faa63186700 1 -- 172.21.15.117:0/2621693122 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5c05f5f0 con 0x7faa5c078c30 2024-04-12T09:01:43.116 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.338+0000 7faa597fa700 1 -- 172.21.15.117:0/2621693122 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7faa50049c60 con 0x7faa5c078c30 2024-04-12T09:01:43.116 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.338+0000 7faa5bfff700 1 --2- 172.21.15.117:0/2621693122 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7faa4c036720 0x7faa4c038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:43.116 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.338+0000 7faa5bfff700 1 --2- 172.21.15.117:0/2621693122 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7faa4c036720 0x7faa4c038bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faa48009990 tx=0x7faa48006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:43.116 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.343+0000 7faa597fa700 1 -- 172.21.15.117:0/2621693122 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7faa50023360 con 0x7faa5c078c30 2024-04-12T09:01:43.117 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.524+0000 7faa63186700 1 -- 172.21.15.117:0/2621693122 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7faa5c04bed0 con 0x7faa5c078c30 2024-04-12T09:01:43.117 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.525+0000 7faa597fa700 1 -- 172.21.15.117:0/2621693122 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7faa50020020 con 0x7faa5c078c30 2024-04-12T09:01:43.117 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.527+0000 7faa63186700 1 -- 172.21.15.117:0/2621693122 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7faa4c036720 msgr2=0x7faa4c038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:43.117 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.527+0000 7faa63186700 1 --2- 172.21.15.117:0/2621693122 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7faa4c036720 0x7faa4c038bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faa48009990 tx=0x7faa48006e40 comp rx=0 tx=0).stop 2024-04-12T09:01:43.117 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.527+0000 7faa63186700 1 -- 172.21.15.117:0/2621693122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa5c078c30 msgr2=0x7faa5c113980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:43.117 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.527+0000 7faa63186700 1 --2- 172.21.15.117:0/2621693122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa5c078c30 0x7faa5c113980 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faa50006d40 tx=0x7faa50009250 comp rx=0 tx=0).stop 2024-04-12T09:01:43.117 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.527+0000 7faa63186700 1 -- 172.21.15.117:0/2621693122 shutdown_connections 2024-04-12T09:01:43.117 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.527+0000 7faa63186700 1 --2- 172.21.15.117:0/2621693122 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7faa4c036720 0x7faa4c038bd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:43.117 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.527+0000 7faa63186700 1 --2- 172.21.15.117:0/2621693122 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa5c078c30 0x7faa5c113980 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:43.117 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.527+0000 7faa63186700 1 -- 172.21.15.117:0/2621693122 >> 172.21.15.117:0/2621693122 conn(0x7faa5c0fe070 msgr2=0x7faa5c0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:43.117 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.527+0000 7faa63186700 1 -- 172.21.15.117:0/2621693122 shutdown_connections 2024-04-12T09:01:43.117 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:42.527+0000 7faa63186700 1 -- 172.21.15.117:0/2621693122 wait complete. 2024-04-12T09:01:43.117 INFO:teuthology.orchestra.run.smithi117.stdout:Enabling cephadm module... 2024-04-12T09:01:44.141 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:43 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/1274618010' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-12T09:01:44.407 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.535+0000 7f383e394700 1 Processor -- start 2024-04-12T09:01:44.407 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.535+0000 7f383e394700 1 -- start start 2024-04-12T09:01:44.407 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.535+0000 7f383e394700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3838102900 0x7f3838102d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:44.407 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.535+0000 7f383e394700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3838103250 con 0x7f3838102900 2024-04-12T09:01:44.407 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.536+0000 7f3837fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3838102900 0x7f3838102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:44.407 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.536+0000 7f3837fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3838102900 0x7f3838102d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58480/0 (socket says 172.21.15.117:58480) 2024-04-12T09:01:44.408 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.536+0000 7f3837fff700 1 -- 172.21.15.117:0/773631015 learned_addr learned my addr 172.21.15.117:0/773631015 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:44.408 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.536+0000 7f3837fff700 1 -- 172.21.15.117:0/773631015 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3838103390 con 0x7f3838102900 2024-04-12T09:01:44.408 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.536+0000 7f3837fff700 1 --2- 172.21.15.117:0/773631015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3838102900 0x7f3838102d10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f38280098e0 tx=0x7f3828009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2813c55433b1b2b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:44.408 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.536+0000 7f3836ffd700 1 -- 172.21.15.117:0/773631015 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f382800b860 con 0x7f3838102900 2024-04-12T09:01:44.408 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.536+0000 7f3836ffd700 1 -- 172.21.15.117:0/773631015 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f382800be50 con 0x7f3838102900 2024-04-12T09:01:44.408 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.536+0000 7f3836ffd700 1 -- 172.21.15.117:0/773631015 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3828010380 con 0x7f3838102900 2024-04-12T09:01:44.408 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.537+0000 7f383e394700 1 -- 172.21.15.117:0/773631015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3838102900 msgr2=0x7f3838102d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:44.408 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.537+0000 7f383e394700 1 --2- 172.21.15.117:0/773631015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3838102900 0x7f3838102d10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f38280098e0 tx=0x7f3828009250 comp rx=0 tx=0).stop 2024-04-12T09:01:44.408 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.537+0000 7f383e394700 1 -- 172.21.15.117:0/773631015 shutdown_connections 2024-04-12T09:01:44.408 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.537+0000 7f383e394700 1 --2- 172.21.15.117:0/773631015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3838102900 0x7f3838102d10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:44.408 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.537+0000 7f383e394700 1 -- 172.21.15.117:0/773631015 >> 172.21.15.117:0/773631015 conn(0x7f38380fe0a0 msgr2=0x7f38381004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:44.408 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.537+0000 7f383e394700 1 -- 172.21.15.117:0/773631015 shutdown_connections 2024-04-12T09:01:44.408 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.537+0000 7f383e394700 1 -- 172.21.15.117:0/773631015 wait complete. 2024-04-12T09:01:44.409 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.537+0000 7f383e394700 1 Processor -- start 2024-04-12T09:01:44.409 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.538+0000 7f383e394700 1 -- start start 2024-04-12T09:01:44.409 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.538+0000 7f383e394700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3838102900 0x7f3838111670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:44.409 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.538+0000 7f383e394700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3838111bb0 con 0x7f3838102900 2024-04-12T09:01:44.409 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.538+0000 7f3837fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3838102900 0x7f3838111670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:44.409 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.538+0000 7f3837fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3838102900 0x7f3838111670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58486/0 (socket says 172.21.15.117:58486) 2024-04-12T09:01:44.409 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.538+0000 7f3837fff700 1 -- 172.21.15.117:0/1274618010 learned_addr learned my addr 172.21.15.117:0/1274618010 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:44.409 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.538+0000 7f3837fff700 1 -- 172.21.15.117:0/1274618010 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38280094f0 con 0x7f3838102900 2024-04-12T09:01:44.409 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.538+0000 7f3837fff700 1 --2- 172.21.15.117:0/1274618010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3838102900 0x7f3838111670 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3828000c00 tx=0x7f3828009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:44.409 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.538+0000 7f3834ff9700 1 -- 172.21.15.117:0/1274618010 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f38280107c0 con 0x7f3838102900 2024-04-12T09:01:44.409 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.538+0000 7f383e394700 1 -- 172.21.15.117:0/1274618010 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3838111db0 con 0x7f3838102900 2024-04-12T09:01:44.409 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.538+0000 7f3834ff9700 1 -- 172.21.15.117:0/1274618010 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f3828010db0 con 0x7f3838102900 2024-04-12T09:01:44.409 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.538+0000 7f3834ff9700 1 -- 172.21.15.117:0/1274618010 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f382801ad00 con 0x7f3838102900 2024-04-12T09:01:44.409 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.538+0000 7f383e394700 1 -- 172.21.15.117:0/1274618010 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3838112920 con 0x7f3838102900 2024-04-12T09:01:44.410 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.539+0000 7f3834ff9700 1 -- 172.21.15.117:0/1274618010 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 4) v1 ==== 43357+0+0 (secure 0 0 0) 0x7f38280193c0 con 0x7f3838102900 2024-04-12T09:01:44.410 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.539+0000 7f383e394700 1 -- 172.21.15.117:0/1274618010 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f383805f5f0 con 0x7f3838102900 2024-04-12T09:01:44.410 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.539+0000 7f3834ff9700 1 --2- 172.21.15.117:0/1274618010 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7f3824036740 0x7f3824038bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:44.410 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.539+0000 7f3834ff9700 1 -- 172.21.15.117:0/1274618010 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f382804a620 con 0x7f3838102900 2024-04-12T09:01:44.410 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.539+0000 7f38377fe700 1 --2- 172.21.15.117:0/1274618010 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7f3824036740 0x7f3824038bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:44.410 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.540+0000 7f38377fe700 1 --2- 172.21.15.117:0/1274618010 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7f3824036740 0x7f3824038bf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3820009990 tx=0x7f3820006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:44.410 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.544+0000 7f3834ff9700 1 -- 172.21.15.117:0/1274618010 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f3828019670 con 0x7f3838102900 2024-04-12T09:01:44.410 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.782+0000 7f383e394700 1 -- 172.21.15.117:0/1274618010 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f383804bed0 con 0x7f3838102900 2024-04-12T09:01:44.410 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.835+0000 7f3834ff9700 1 -- 172.21.15.117:0/1274618010 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mgrmap(e 5) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f382801a530 con 0x7f3838102900 2024-04-12T09:01:44.410 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.836+0000 7f3834ff9700 1 -- 172.21.15.117:0/1274618010 <== mon.0 v2:172.21.15.117:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f3828016260 con 0x7f3838102900 2024-04-12T09:01:44.410 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.838+0000 7f383e394700 1 -- 172.21.15.117:0/1274618010 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7f3824036740 msgr2=0x7f3824038bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:44.410 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.838+0000 7f383e394700 1 --2- 172.21.15.117:0/1274618010 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7f3824036740 0x7f3824038bf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3820009990 tx=0x7f3820006e40 comp rx=0 tx=0).stop 2024-04-12T09:01:44.410 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.838+0000 7f383e394700 1 -- 172.21.15.117:0/1274618010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3838102900 msgr2=0x7f3838111670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:44.411 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.838+0000 7f383e394700 1 --2- 172.21.15.117:0/1274618010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3838102900 0x7f3838111670 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3828000c00 tx=0x7f3828009250 comp rx=0 tx=0).stop 2024-04-12T09:01:44.411 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.838+0000 7f383e394700 1 -- 172.21.15.117:0/1274618010 shutdown_connections 2024-04-12T09:01:44.411 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.838+0000 7f383e394700 1 --2- 172.21.15.117:0/1274618010 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7f3824036740 0x7f3824038bf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:44.411 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.838+0000 7f383e394700 1 --2- 172.21.15.117:0/1274618010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3838102900 0x7f3838111670 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:44.411 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.838+0000 7f383e394700 1 -- 172.21.15.117:0/1274618010 >> 172.21.15.117:0/1274618010 conn(0x7f38380fe0a0 msgr2=0x7f38380feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:44.411 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.839+0000 7f383e394700 1 -- 172.21.15.117:0/1274618010 shutdown_connections 2024-04-12T09:01:44.411 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:43.839+0000 7f383e394700 1 -- 172.21.15.117:0/1274618010 wait complete. 2024-04-12T09:01:45.018 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:44 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/1274618010' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-12T09:01:45.019 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:44 smithi117 ceph-mon[29277]: mgrmap e5: smithi117.oyaxql(active, since 6s) 2024-04-12T09:01:45.789 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout { 2024-04-12T09:01:45.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-12T09:01:45.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-12T09:01:45.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "active_name": "smithi117.oyaxql", 2024-04-12T09:01:45.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-12T09:01:45.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout } 2024-04-12T09:01:45.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.813+0000 7fbeb2f2c700 1 Processor -- start 2024-04-12T09:01:45.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.813+0000 7fbeb2f2c700 1 -- start start 2024-04-12T09:01:45.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.813+0000 7fbeb2f2c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbeac102cd0 0x7fbeac1030e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:45.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.813+0000 7fbeb2f2c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac1036b0 con 0x7fbeac102cd0 2024-04-12T09:01:45.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.813+0000 7fbeb0cc8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbeac102cd0 0x7fbeac1030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:45.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.813+0000 7fbeb0cc8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbeac102cd0 0x7fbeac1030e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58518/0 (socket says 172.21.15.117:58518) 2024-04-12T09:01:45.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.813+0000 7fbeb0cc8700 1 -- 172.21.15.117:0/2221063188 learned_addr learned my addr 172.21.15.117:0/2221063188 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:45.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.813+0000 7fbeb0cc8700 1 -- 172.21.15.117:0/2221063188 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac1037f0 con 0x7fbeac102cd0 2024-04-12T09:01:45.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.814+0000 7fbeb0cc8700 1 --2- 172.21.15.117:0/2221063188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbeac102cd0 0x7fbeac1030e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbea00098e0 tx=0x7fbea0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c545842b98e699 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:45.791 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.814+0000 7fbeab7fe700 1 -- 172.21.15.117:0/2221063188 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbea000b860 con 0x7fbeac102cd0 2024-04-12T09:01:45.791 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.814+0000 7fbeab7fe700 1 -- 172.21.15.117:0/2221063188 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fbea000be50 con 0x7fbeac102cd0 2024-04-12T09:01:45.791 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.814+0000 7fbeab7fe700 1 -- 172.21.15.117:0/2221063188 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbea0010380 con 0x7fbeac102cd0 2024-04-12T09:01:45.791 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.814+0000 7fbeb2f2c700 1 -- 172.21.15.117:0/2221063188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbeac102cd0 msgr2=0x7fbeac1030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:45.791 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.814+0000 7fbeb2f2c700 1 --2- 172.21.15.117:0/2221063188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbeac102cd0 0x7fbeac1030e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbea00098e0 tx=0x7fbea0009250 comp rx=0 tx=0).stop 2024-04-12T09:01:45.791 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.814+0000 7fbeb2f2c700 1 -- 172.21.15.117:0/2221063188 shutdown_connections 2024-04-12T09:01:45.791 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.814+0000 7fbeb2f2c700 1 --2- 172.21.15.117:0/2221063188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbeac102cd0 0x7fbeac1030e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:45.791 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.814+0000 7fbeb2f2c700 1 -- 172.21.15.117:0/2221063188 >> 172.21.15.117:0/2221063188 conn(0x7fbeac0fc730 msgr2=0x7fbeac0feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:45.791 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.815+0000 7fbeb2f2c700 1 -- 172.21.15.117:0/2221063188 shutdown_connections 2024-04-12T09:01:45.791 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.815+0000 7fbeb2f2c700 1 -- 172.21.15.117:0/2221063188 wait complete. 2024-04-12T09:01:45.791 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.815+0000 7fbeb2f2c700 1 Processor -- start 2024-04-12T09:01:45.791 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.815+0000 7fbeb2f2c700 1 -- start start 2024-04-12T09:01:45.791 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.815+0000 7fbeb2f2c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbeac102cd0 0x7fbeac113900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:45.791 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.815+0000 7fbeb2f2c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac113e40 con 0x7fbeac102cd0 2024-04-12T09:01:45.791 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.815+0000 7fbeb0cc8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbeac102cd0 0x7fbeac113900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:45.791 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.815+0000 7fbeb0cc8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbeac102cd0 0x7fbeac113900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58528/0 (socket says 172.21.15.117:58528) 2024-04-12T09:01:45.792 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.815+0000 7fbeb0cc8700 1 -- 172.21.15.117:0/2685719781 learned_addr learned my addr 172.21.15.117:0/2685719781 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:45.792 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.816+0000 7fbeb0cc8700 1 -- 172.21.15.117:0/2685719781 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea00094f0 con 0x7fbeac102cd0 2024-04-12T09:01:45.792 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.816+0000 7fbeb0cc8700 1 --2- 172.21.15.117:0/2685719781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbeac102cd0 0x7fbeac113900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbea000ba90 tx=0x7fbea0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:45.792 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.816+0000 7fbea97fa700 1 -- 172.21.15.117:0/2685719781 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbea00107c0 con 0x7fbeac102cd0 2024-04-12T09:01:45.792 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.816+0000 7fbeb2f2c700 1 -- 172.21.15.117:0/2685719781 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeac114040 con 0x7fbeac102cd0 2024-04-12T09:01:45.792 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.816+0000 7fbea97fa700 1 -- 172.21.15.117:0/2685719781 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fbea0010db0 con 0x7fbeac102cd0 2024-04-12T09:01:45.792 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.816+0000 7fbea97fa700 1 -- 172.21.15.117:0/2685719781 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbea001add0 con 0x7fbeac102cd0 2024-04-12T09:01:45.792 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.816+0000 7fbeb2f2c700 1 -- 172.21.15.117:0/2685719781 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeac114bb0 con 0x7fbeac102cd0 2024-04-12T09:01:45.792 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.817+0000 7fbea97fa700 1 -- 172.21.15.117:0/2685719781 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fbea002e440 con 0x7fbeac102cd0 2024-04-12T09:01:45.792 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.817+0000 7fbea97fa700 1 --2- 172.21.15.117:0/2685719781 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7fbe9c036790 0x7fbe9c038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:45.792 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.817+0000 7fbea97fa700 1 -- 172.21.15.117:0/2685719781 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fbea004b520 con 0x7fbeac102cd0 2024-04-12T09:01:45.792 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.817+0000 7fbeb2f2c700 1 -- 172.21.15.117:0/2685719781 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeac05f5f0 con 0x7fbeac102cd0 2024-04-12T09:01:45.792 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.817+0000 7fbeabfff700 1 -- 172.21.15.117:0/2685719781 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7fbe9c036790 msgr2=0x7fbe9c038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:6800/2893585477 2024-04-12T09:01:45.792 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.817+0000 7fbeabfff700 1 --2- 172.21.15.117:0/2685719781 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7fbe9c036790 0x7fbe9c038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T09:01:45.792 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:44.822+0000 7fbea97fa700 1 -- 172.21.15.117:0/2685719781 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fbea0018940 con 0x7fbeac102cd0 2024-04-12T09:01:45.793 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:45.018+0000 7fbeabfff700 1 -- 172.21.15.117:0/2685719781 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7fbe9c036790 msgr2=0x7fbe9c038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:6800/2893585477 2024-04-12T09:01:45.793 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:45.018+0000 7fbeabfff700 1 --2- 172.21.15.117:0/2685719781 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7fbe9c036790 0x7fbe9c038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T09:01:45.793 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:45.067+0000 7fbeb2f2c700 1 -- 172.21.15.117:0/2685719781 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fbeac114eb0 con 0x7fbeac102cd0 2024-04-12T09:01:45.793 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:45.068+0000 7fbea97fa700 1 -- 172.21.15.117:0/2685719781 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fbea0018350 con 0x7fbeac102cd0 2024-04-12T09:01:45.793 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:45.070+0000 7fbeb2f2c700 1 -- 172.21.15.117:0/2685719781 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7fbe9c036790 msgr2=0x7fbe9c038c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T09:01:45.793 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:45.070+0000 7fbeb2f2c700 1 --2- 172.21.15.117:0/2685719781 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7fbe9c036790 0x7fbe9c038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:45.793 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:45.070+0000 7fbeb2f2c700 1 -- 172.21.15.117:0/2685719781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbeac102cd0 msgr2=0x7fbeac113900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:45.793 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:45.070+0000 7fbeb2f2c700 1 --2- 172.21.15.117:0/2685719781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbeac102cd0 0x7fbeac113900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbea000ba90 tx=0x7fbea0009250 comp rx=0 tx=0).stop 2024-04-12T09:01:45.793 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:45.070+0000 7fbeb2f2c700 1 -- 172.21.15.117:0/2685719781 shutdown_connections 2024-04-12T09:01:45.793 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:45.070+0000 7fbeb2f2c700 1 --2- 172.21.15.117:0/2685719781 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7fbe9c036790 0x7fbe9c038c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:45.793 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:45.070+0000 7fbeb2f2c700 1 --2- 172.21.15.117:0/2685719781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbeac102cd0 0x7fbeac113900 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:45.793 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:45.070+0000 7fbeb2f2c700 1 -- 172.21.15.117:0/2685719781 >> 172.21.15.117:0/2685719781 conn(0x7fbeac0fc730 msgr2=0x7fbeac0fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:45.793 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:45.070+0000 7fbeb2f2c700 1 -- 172.21.15.117:0/2685719781 shutdown_connections 2024-04-12T09:01:45.793 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:45.070+0000 7fbeb2f2c700 1 -- 172.21.15.117:0/2685719781 wait complete. 2024-04-12T09:01:45.793 INFO:teuthology.orchestra.run.smithi117.stdout:Waiting for the mgr to restart... 2024-04-12T09:01:45.793 INFO:teuthology.orchestra.run.smithi117.stdout:Waiting for mgr epoch 5... 2024-04-12T09:01:46.047 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:45 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/2685719781' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-12T09:01:50.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:50 smithi117 ceph-mon[29277]: Active manager daemon smithi117.oyaxql restarted 2024-04-12T09:01:50.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:50 smithi117 ceph-mon[29277]: Activating manager daemon smithi117.oyaxql 2024-04-12T09:01:50.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:50 smithi117 ceph-mon[29277]: osdmap e2: 0 total, 0 up, 0 in 2024-04-12T09:01:50.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:50 smithi117 ceph-mon[29277]: mgrmap e6: smithi117.oyaxql(active, starting, since 0.00326817s) 2024-04-12T09:01:50.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:50 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-04-12T09:01:50.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:50 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr metadata", "who": "smithi117.oyaxql", "id": "smithi117.oyaxql"}]: dispatch 2024-04-12T09:01:50.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:50 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-12T09:01:50.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:50 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-12T09:01:50.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:50 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-12T09:01:50.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:50 smithi117 ceph-mon[29277]: Manager daemon smithi117.oyaxql is now available 2024-04-12T09:01:50.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:50 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' 2024-04-12T09:01:50.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:50 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' 2024-04-12T09:01:50.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:50 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:01:50.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:50 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:01:50.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:50 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:01:50.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:50 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.oyaxql/mirror_snapshot_schedule"}]: dispatch 2024-04-12T09:01:50.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:50 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.oyaxql/trash_purge_schedule"}]: dispatch 2024-04-12T09:01:51.644 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:51 smithi117 ceph-mon[29277]: Found migration_current of "None". Setting to last migration. 2024-04-12T09:01:51.644 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:51 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' 2024-04-12T09:01:51.645 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:51 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:01:51.645 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:51 smithi117 ceph-mon[29277]: mgrmap e7: smithi117.oyaxql(active, since 1.0055s) 2024-04-12T09:01:51.979 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout { 2024-04-12T09:01:51.980 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-12T09:01:51.980 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-12T09:01:51.980 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout } 2024-04-12T09:01:51.980 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.161+0000 7f3486eb1700 1 Processor -- start 2024-04-12T09:01:51.980 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.161+0000 7f3486eb1700 1 -- start start 2024-04-12T09:01:51.980 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.162+0000 7f3486eb1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3480076cd0 0x7f34801054b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:51.980 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.162+0000 7f3486eb1700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34801059f0 con 0x7f3480076cd0 2024-04-12T09:01:51.980 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.162+0000 7f3484c4d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3480076cd0 0x7f34801054b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:51.980 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.162+0000 7f3484c4d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3480076cd0 0x7f34801054b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58544/0 (socket says 172.21.15.117:58544) 2024-04-12T09:01:51.980 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.162+0000 7f3484c4d700 1 -- 172.21.15.117:0/2833851843 learned_addr learned my addr 172.21.15.117:0/2833851843 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:51.980 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.162+0000 7f3484c4d700 1 -- 172.21.15.117:0/2833851843 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3480105b30 con 0x7f3480076cd0 2024-04-12T09:01:51.980 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.162+0000 7f3484c4d700 1 --2- 172.21.15.117:0/2833851843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3480076cd0 0x7f34801054b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f34740098e0 tx=0x7f3474009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872e5461c8949ee3 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:51.980 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.162+0000 7f347f7fe700 1 -- 172.21.15.117:0/2833851843 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f347400b860 con 0x7f3480076cd0 2024-04-12T09:01:51.981 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.162+0000 7f347f7fe700 1 -- 172.21.15.117:0/2833851843 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f347400be50 con 0x7f3480076cd0 2024-04-12T09:01:51.981 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.162+0000 7f347f7fe700 1 -- 172.21.15.117:0/2833851843 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3474010380 con 0x7f3480076cd0 2024-04-12T09:01:51.981 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.163+0000 7f3486eb1700 1 -- 172.21.15.117:0/2833851843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3480076cd0 msgr2=0x7f34801054b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:51.981 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.163+0000 7f3486eb1700 1 --2- 172.21.15.117:0/2833851843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3480076cd0 0x7f34801054b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f34740098e0 tx=0x7f3474009250 comp rx=0 tx=0).stop 2024-04-12T09:01:51.981 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.163+0000 7f3486eb1700 1 -- 172.21.15.117:0/2833851843 shutdown_connections 2024-04-12T09:01:51.981 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.163+0000 7f3486eb1700 1 --2- 172.21.15.117:0/2833851843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3480076cd0 0x7f34801054b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:51.981 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.163+0000 7f3486eb1700 1 -- 172.21.15.117:0/2833851843 >> 172.21.15.117:0/2833851843 conn(0x7f34800fcf40 msgr2=0x7f34800ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:51.981 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.163+0000 7f3486eb1700 1 -- 172.21.15.117:0/2833851843 shutdown_connections 2024-04-12T09:01:51.981 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.163+0000 7f3486eb1700 1 -- 172.21.15.117:0/2833851843 wait complete. 2024-04-12T09:01:51.981 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.164+0000 7f3486eb1700 1 Processor -- start 2024-04-12T09:01:51.981 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.164+0000 7f3486eb1700 1 -- start start 2024-04-12T09:01:51.981 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.164+0000 7f3486eb1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3480076cd0 0x7f3480102e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:51.981 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.164+0000 7f3486eb1700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3480103340 con 0x7f3480076cd0 2024-04-12T09:01:51.981 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.164+0000 7f3484c4d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3480076cd0 0x7f3480102e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:51.981 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.164+0000 7f3484c4d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3480076cd0 0x7f3480102e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58560/0 (socket says 172.21.15.117:58560) 2024-04-12T09:01:51.982 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.164+0000 7f3484c4d700 1 -- 172.21.15.117:0/1226954420 learned_addr learned my addr 172.21.15.117:0/1226954420 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:51.982 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.164+0000 7f3484c4d700 1 -- 172.21.15.117:0/1226954420 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34740094f0 con 0x7f3480076cd0 2024-04-12T09:01:51.982 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.165+0000 7f3484c4d700 1 --2- 172.21.15.117:0/1226954420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3480076cd0 0x7f3480102e00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f347400ba90 tx=0x7f3474009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:51.982 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.165+0000 7f347d7fa700 1 -- 172.21.15.117:0/1226954420 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34740107c0 con 0x7f3480076cd0 2024-04-12T09:01:51.982 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.165+0000 7f3486eb1700 1 -- 172.21.15.117:0/1226954420 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34801013b0 con 0x7f3480076cd0 2024-04-12T09:01:51.982 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.165+0000 7f347d7fa700 1 -- 172.21.15.117:0/1226954420 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f3474010db0 con 0x7f3480076cd0 2024-04-12T09:01:51.982 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.165+0000 7f347d7fa700 1 -- 172.21.15.117:0/1226954420 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f347401ada0 con 0x7f3480076cd0 2024-04-12T09:01:51.982 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.165+0000 7f3486eb1700 1 -- 172.21.15.117:0/1226954420 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34801018a0 con 0x7f3480076cd0 2024-04-12T09:01:51.982 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.166+0000 7f347d7fa700 1 -- 172.21.15.117:0/1226954420 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f3474010920 con 0x7f3480076cd0 2024-04-12T09:01:51.982 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.166+0000 7f347d7fa700 1 --2- 172.21.15.117:0/1226954420 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7f34700367e0 0x7f3470038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:51.982 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.166+0000 7f347d7fa700 1 -- 172.21.15.117:0/1226954420 --> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f34700393a0 con 0x7f34700367e0 2024-04-12T09:01:51.982 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.166+0000 7f347d7fa700 1 -- 172.21.15.117:0/1226954420 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f347404a600 con 0x7f3480076cd0 2024-04-12T09:01:51.982 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.166+0000 7f347ffff700 1 -- 172.21.15.117:0/1226954420 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7f34700367e0 msgr2=0x7f3470038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:6800/2893585477 2024-04-12T09:01:51.982 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.166+0000 7f347ffff700 1 --2- 172.21.15.117:0/1226954420 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7f34700367e0 0x7f3470038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T09:01:51.983 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.367+0000 7f347ffff700 1 -- 172.21.15.117:0/1226954420 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7f34700367e0 msgr2=0x7f3470038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:6800/2893585477 2024-04-12T09:01:51.983 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.367+0000 7f347ffff700 1 --2- 172.21.15.117:0/1226954420 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7f34700367e0 0x7f3470038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T09:01:51.983 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.768+0000 7f347ffff700 1 -- 172.21.15.117:0/1226954420 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7f34700367e0 msgr2=0x7f3470038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:6800/2893585477 2024-04-12T09:01:51.983 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:46.768+0000 7f347ffff700 1 --2- 172.21.15.117:0/1226954420 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7f34700367e0 0x7f3470038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T09:01:51.983 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:47.569+0000 7f347ffff700 1 -- 172.21.15.117:0/1226954420 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7f34700367e0 msgr2=0x7f3470038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:6800/2893585477 2024-04-12T09:01:51.983 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:47.569+0000 7f347ffff700 1 --2- 172.21.15.117:0/1226954420 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7f34700367e0 0x7f3470038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T09:01:51.983 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:49.170+0000 7f347ffff700 1 -- 172.21.15.117:0/1226954420 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7f34700367e0 msgr2=0x7f3470038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:6800/2893585477 2024-04-12T09:01:51.983 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:49.170+0000 7f347ffff700 1 --2- 172.21.15.117:0/1226954420 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7f34700367e0 0x7f3470038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-12T09:01:51.983 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:50.340+0000 7f347d7fa700 1 -- 172.21.15.117:0/1226954420 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mgrmap(e 6) v1 ==== 43135+0+0 (secure 0 0 0) 0x7f347402e7c0 con 0x7f3480076cd0 2024-04-12T09:01:51.983 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:50.340+0000 7f347d7fa700 1 -- 172.21.15.117:0/1226954420 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7f34700367e0 msgr2=0x7f3470038c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T09:01:51.983 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:50.340+0000 7f347d7fa700 1 --2- 172.21.15.117:0/1226954420 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7f34700367e0 0x7f3470038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:51.983 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:51.343+0000 7f347d7fa700 1 -- 172.21.15.117:0/1226954420 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mgrmap(e 7) v1 ==== 43262+0+0 (secure 0 0 0) 0x7f3474018350 con 0x7f3480076cd0 2024-04-12T09:01:51.983 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:51.343+0000 7f347d7fa700 1 --2- 172.21.15.117:0/1226954420 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f3470039fc0 0x7f347003c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:51.983 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:51.343+0000 7f347d7fa700 1 -- 172.21.15.117:0/1226954420 --> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f34700393a0 con 0x7f3470039fc0 2024-04-12T09:01:51.983 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:51.343+0000 7f347ffff700 1 --2- 172.21.15.117:0/1226954420 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f3470039fc0 0x7f347003c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:51.984 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:51.344+0000 7f347ffff700 1 --2- 172.21.15.117:0/1226954420 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f3470039fc0 0x7f347003c3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f346c0039d0 tx=0x7f346c009350 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:51.984 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:51.344+0000 7f347d7fa700 1 -- 172.21.15.117:0/1226954420 <== mgr.14120 v2:172.21.15.117:6800/791370182 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f34700393a0 con 0x7f3470039fc0 2024-04-12T09:01:51.984 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:51.350+0000 7f3486eb1700 1 -- 172.21.15.117:0/1226954420 --> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f348005f5f0 con 0x7f3470039fc0 2024-04-12T09:01:51.984 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:51.350+0000 7f347d7fa700 1 -- 172.21.15.117:0/1226954420 <== mgr.14120 v2:172.21.15.117:6800/791370182 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f348005f5f0 con 0x7f3470039fc0 2024-04-12T09:01:51.984 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:51.351+0000 7f3486eb1700 1 -- 172.21.15.117:0/1226954420 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f3470039fc0 msgr2=0x7f347003c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:51.984 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:51.351+0000 7f3486eb1700 1 --2- 172.21.15.117:0/1226954420 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f3470039fc0 0x7f347003c3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f346c0039d0 tx=0x7f346c009350 comp rx=0 tx=0).stop 2024-04-12T09:01:51.984 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:51.351+0000 7f3486eb1700 1 -- 172.21.15.117:0/1226954420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3480076cd0 msgr2=0x7f3480102e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:51.984 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:51.351+0000 7f3486eb1700 1 --2- 172.21.15.117:0/1226954420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3480076cd0 0x7f3480102e00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f347400ba90 tx=0x7f3474009250 comp rx=0 tx=0).stop 2024-04-12T09:01:51.984 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:51.351+0000 7f3486eb1700 1 -- 172.21.15.117:0/1226954420 shutdown_connections 2024-04-12T09:01:51.984 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:51.351+0000 7f3486eb1700 1 --2- 172.21.15.117:0/1226954420 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f3470039fc0 0x7f347003c3a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:51.984 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:51.351+0000 7f3486eb1700 1 --2- 172.21.15.117:0/1226954420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3480076cd0 0x7f3480102e00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:51.984 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:51.351+0000 7f3486eb1700 1 --2- 172.21.15.117:0/1226954420 >> [v2:172.21.15.117:6800/2893585477,v1:172.21.15.117:6801/2893585477] conn(0x7f34700367e0 0x7f3470038c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:51.984 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:51.351+0000 7f3486eb1700 1 -- 172.21.15.117:0/1226954420 >> 172.21.15.117:0/1226954420 conn(0x7f34800fcf40 msgr2=0x7f34800fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:51.984 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:51.351+0000 7f3486eb1700 1 -- 172.21.15.117:0/1226954420 shutdown_connections 2024-04-12T09:01:51.984 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:51.351+0000 7f3486eb1700 1 -- 172.21.15.117:0/1226954420 wait complete. 2024-04-12T09:01:51.985 INFO:teuthology.orchestra.run.smithi117.stdout:mgr epoch 5 is available 2024-04-12T09:01:51.985 INFO:teuthology.orchestra.run.smithi117.stdout:Setting orchestrator backend to cephadm... 2024-04-12T09:01:52.569 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:52 smithi117 ceph-mon[29277]: [12/Apr/2024:09:01:51] ENGINE Bus STARTING 2024-04-12T09:01:52.569 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:52 smithi117 ceph-mon[29277]: [12/Apr/2024:09:01:51] ENGINE Serving on https://172.21.15.117:7150 2024-04-12T09:01:52.569 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:52 smithi117 ceph-mon[29277]: [12/Apr/2024:09:01:51] ENGINE Bus STARTED 2024-04-12T09:01:52.569 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:52 smithi117 ceph-mon[29277]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-12T09:01:52.569 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:52 smithi117 ceph-mon[29277]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-12T09:01:53.135 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.358+0000 7fea96d64700 1 Processor -- start 2024-04-12T09:01:53.136 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.359+0000 7fea96d64700 1 -- start start 2024-04-12T09:01:53.136 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.359+0000 7fea96d64700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea90103ec0 0x7fea901042d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:53.136 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.359+0000 7fea96d64700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea90070e20 con 0x7fea90103ec0 2024-04-12T09:01:53.136 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.359+0000 7fea94b00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea90103ec0 0x7fea901042d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:53.136 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.359+0000 7fea94b00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea90103ec0 0x7fea901042d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40398/0 (socket says 172.21.15.117:40398) 2024-04-12T09:01:53.136 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.359+0000 7fea94b00700 1 -- 172.21.15.117:0/3549277390 learned_addr learned my addr 172.21.15.117:0/3549277390 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:53.136 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.359+0000 7fea94b00700 1 -- 172.21.15.117:0/3549277390 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea90104810 con 0x7fea90103ec0 2024-04-12T09:01:53.136 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.359+0000 7fea94b00700 1 --2- 172.21.15.117:0/3549277390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea90103ec0 0x7fea901042d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fea840098e0 tx=0x7fea84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d259ea76d115b88 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:53.136 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.360+0000 7fea8f7fe700 1 -- 172.21.15.117:0/3549277390 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea8400b860 con 0x7fea90103ec0 2024-04-12T09:01:53.136 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.360+0000 7fea8f7fe700 1 -- 172.21.15.117:0/3549277390 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fea8400be50 con 0x7fea90103ec0 2024-04-12T09:01:53.136 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.360+0000 7fea8f7fe700 1 -- 172.21.15.117:0/3549277390 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea84010380 con 0x7fea90103ec0 2024-04-12T09:01:53.136 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.360+0000 7fea96d64700 1 -- 172.21.15.117:0/3549277390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea90103ec0 msgr2=0x7fea901042d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:53.137 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.360+0000 7fea96d64700 1 --2- 172.21.15.117:0/3549277390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea90103ec0 0x7fea901042d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fea840098e0 tx=0x7fea84009250 comp rx=0 tx=0).stop 2024-04-12T09:01:53.137 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.360+0000 7fea96d64700 1 -- 172.21.15.117:0/3549277390 shutdown_connections 2024-04-12T09:01:53.137 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.360+0000 7fea96d64700 1 --2- 172.21.15.117:0/3549277390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea90103ec0 0x7fea901042d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:53.137 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.360+0000 7fea96d64700 1 -- 172.21.15.117:0/3549277390 >> 172.21.15.117:0/3549277390 conn(0x7fea900fc6c0 msgr2=0x7fea900fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:53.137 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.360+0000 7fea96d64700 1 -- 172.21.15.117:0/3549277390 shutdown_connections 2024-04-12T09:01:53.137 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.360+0000 7fea96d64700 1 -- 172.21.15.117:0/3549277390 wait complete. 2024-04-12T09:01:53.137 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.361+0000 7fea96d64700 1 Processor -- start 2024-04-12T09:01:53.137 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.361+0000 7fea96d64700 1 -- start start 2024-04-12T09:01:53.137 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.361+0000 7fea96d64700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea90103ec0 0x7fea90111700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:53.137 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.361+0000 7fea96d64700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea90111c40 con 0x7fea90103ec0 2024-04-12T09:01:53.137 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.361+0000 7fea94b00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea90103ec0 0x7fea90111700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:53.137 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.361+0000 7fea94b00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea90103ec0 0x7fea90111700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40402/0 (socket says 172.21.15.117:40402) 2024-04-12T09:01:53.138 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.361+0000 7fea94b00700 1 -- 172.21.15.117:0/287359557 learned_addr learned my addr 172.21.15.117:0/287359557 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:53.138 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.361+0000 7fea94b00700 1 -- 172.21.15.117:0/287359557 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea840094f0 con 0x7fea90103ec0 2024-04-12T09:01:53.138 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.361+0000 7fea94b00700 1 --2- 172.21.15.117:0/287359557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea90103ec0 0x7fea90111700 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fea84006b00 tx=0x7fea84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:53.138 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.362+0000 7fea8d7fa700 1 -- 172.21.15.117:0/287359557 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea84010760 con 0x7fea90103ec0 2024-04-12T09:01:53.138 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.362+0000 7fea8d7fa700 1 -- 172.21.15.117:0/287359557 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fea84010d50 con 0x7fea90103ec0 2024-04-12T09:01:53.138 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.362+0000 7fea96d64700 1 -- 172.21.15.117:0/287359557 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea90111e40 con 0x7fea90103ec0 2024-04-12T09:01:53.138 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.362+0000 7fea8d7fa700 1 -- 172.21.15.117:0/287359557 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea8401ad40 con 0x7fea90103ec0 2024-04-12T09:01:53.138 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.362+0000 7fea96d64700 1 -- 172.21.15.117:0/287359557 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea901129b0 con 0x7fea90103ec0 2024-04-12T09:01:53.138 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.362+0000 7fea8d7fa700 1 -- 172.21.15.117:0/287359557 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 7) v1 ==== 43262+0+0 (secure 0 0 0) 0x7fea8402e440 con 0x7fea90103ec0 2024-04-12T09:01:53.138 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.363+0000 7fea8d7fa700 1 --2- 172.21.15.117:0/287359557 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fea800366b0 0x7fea80038b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:53.138 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.363+0000 7fea8d7fa700 1 -- 172.21.15.117:0/287359557 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fea8401a5c0 con 0x7fea90103ec0 2024-04-12T09:01:53.138 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.363+0000 7fea8ffff700 1 --2- 172.21.15.117:0/287359557 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fea800366b0 0x7fea80038b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:53.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.363+0000 7fea96d64700 1 -- 172.21.15.117:0/287359557 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea9005f5f0 con 0x7fea90103ec0 2024-04-12T09:01:53.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.363+0000 7fea8ffff700 1 --2- 172.21.15.117:0/287359557 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fea800366b0 0x7fea80038b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fea7c009990 tx=0x7fea7c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:53.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.368+0000 7fea8d7fa700 1 -- 172.21.15.117:0/287359557 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fea84018940 con 0x7fea90103ec0 2024-04-12T09:01:53.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.396+0000 7fea8d7fa700 1 -- 172.21.15.117:0/287359557 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fea84021d60 con 0x7fea90103ec0 2024-04-12T09:01:53.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.568+0000 7fea96d64700 1 -- 172.21.15.117:0/287359557 --> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fea900fd9b0 con 0x7fea800366b0 2024-04-12T09:01:53.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.577+0000 7fea8d7fa700 1 -- 172.21.15.117:0/287359557 <== mgr.14120 v2:172.21.15.117:6800/791370182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fea900fd9b0 con 0x7fea800366b0 2024-04-12T09:01:53.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.579+0000 7fea96d64700 1 -- 172.21.15.117:0/287359557 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fea800366b0 msgr2=0x7fea80038b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:53.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.579+0000 7fea96d64700 1 --2- 172.21.15.117:0/287359557 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fea800366b0 0x7fea80038b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fea7c009990 tx=0x7fea7c006e40 comp rx=0 tx=0).stop 2024-04-12T09:01:53.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.579+0000 7fea96d64700 1 -- 172.21.15.117:0/287359557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea90103ec0 msgr2=0x7fea90111700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:53.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.579+0000 7fea96d64700 1 --2- 172.21.15.117:0/287359557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea90103ec0 0x7fea90111700 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fea84006b00 tx=0x7fea84009250 comp rx=0 tx=0).stop 2024-04-12T09:01:53.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.579+0000 7fea96d64700 1 -- 172.21.15.117:0/287359557 shutdown_connections 2024-04-12T09:01:53.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.579+0000 7fea96d64700 1 --2- 172.21.15.117:0/287359557 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fea800366b0 0x7fea80038b60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:53.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.579+0000 7fea96d64700 1 --2- 172.21.15.117:0/287359557 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea90103ec0 0x7fea90111700 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:53.140 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.579+0000 7fea96d64700 1 -- 172.21.15.117:0/287359557 >> 172.21.15.117:0/287359557 conn(0x7fea900fc6c0 msgr2=0x7fea900fd260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:53.140 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.579+0000 7fea96d64700 1 -- 172.21.15.117:0/287359557 shutdown_connections 2024-04-12T09:01:53.140 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:52.579+0000 7fea96d64700 1 -- 172.21.15.117:0/287359557 wait complete. 2024-04-12T09:01:53.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:53 smithi117 ceph-mon[29277]: mgrmap e8: smithi117.oyaxql(active, since 2s) 2024-04-12T09:01:53.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:53 smithi117 ceph-mon[29277]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:01:53.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:53 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' 2024-04-12T09:01:53.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:53 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:01:54.291 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-12T09:01:54.291 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.551+0000 7fc021045700 1 Processor -- start 2024-04-12T09:01:54.291 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.551+0000 7fc021045700 1 -- start start 2024-04-12T09:01:54.291 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.551+0000 7fc021045700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc01c076bc0 0x7fc01c1054d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:54.291 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.551+0000 7fc021045700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c105a10 con 0x7fc01c076bc0 2024-04-12T09:01:54.291 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.551+0000 7fc01ad9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc01c076bc0 0x7fc01c1054d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:54.291 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.551+0000 7fc01ad9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc01c076bc0 0x7fc01c1054d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40404/0 (socket says 172.21.15.117:40404) 2024-04-12T09:01:54.291 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.551+0000 7fc01ad9d700 1 -- 172.21.15.117:0/1842815128 learned_addr learned my addr 172.21.15.117:0/1842815128 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:54.291 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.551+0000 7fc01ad9d700 1 -- 172.21.15.117:0/1842815128 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c105b50 con 0x7fc01c076bc0 2024-04-12T09:01:54.292 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.552+0000 7fc01ad9d700 1 --2- 172.21.15.117:0/1842815128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc01c076bc0 0x7fc01c1054d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc00c0098e0 tx=0x7fc00c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3183d498c5e67551 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:54.292 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.552+0000 7fc019d9b700 1 -- 172.21.15.117:0/1842815128 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc00c00b860 con 0x7fc01c076bc0 2024-04-12T09:01:54.292 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.552+0000 7fc019d9b700 1 -- 172.21.15.117:0/1842815128 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fc00c00be50 con 0x7fc01c076bc0 2024-04-12T09:01:54.292 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.552+0000 7fc019d9b700 1 -- 172.21.15.117:0/1842815128 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc00c010380 con 0x7fc01c076bc0 2024-04-12T09:01:54.292 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.552+0000 7fc021045700 1 -- 172.21.15.117:0/1842815128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc01c076bc0 msgr2=0x7fc01c1054d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:54.292 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.552+0000 7fc021045700 1 --2- 172.21.15.117:0/1842815128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc01c076bc0 0x7fc01c1054d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc00c0098e0 tx=0x7fc00c009250 comp rx=0 tx=0).stop 2024-04-12T09:01:54.292 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.552+0000 7fc021045700 1 -- 172.21.15.117:0/1842815128 shutdown_connections 2024-04-12T09:01:54.292 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.552+0000 7fc021045700 1 --2- 172.21.15.117:0/1842815128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc01c076bc0 0x7fc01c1054d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:54.292 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.552+0000 7fc021045700 1 -- 172.21.15.117:0/1842815128 >> 172.21.15.117:0/1842815128 conn(0x7fc01c0fcf40 msgr2=0x7fc01c0ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:54.292 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.552+0000 7fc021045700 1 -- 172.21.15.117:0/1842815128 shutdown_connections 2024-04-12T09:01:54.292 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.552+0000 7fc021045700 1 -- 172.21.15.117:0/1842815128 wait complete. 2024-04-12T09:01:54.292 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.553+0000 7fc021045700 1 Processor -- start 2024-04-12T09:01:54.292 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.553+0000 7fc021045700 1 -- start start 2024-04-12T09:01:54.292 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.553+0000 7fc021045700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc01c076bc0 0x7fc01c111720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:54.292 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.553+0000 7fc021045700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c111c60 con 0x7fc01c076bc0 2024-04-12T09:01:54.293 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.553+0000 7fc01ad9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc01c076bc0 0x7fc01c111720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:54.293 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.553+0000 7fc01ad9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc01c076bc0 0x7fc01c111720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40418/0 (socket says 172.21.15.117:40418) 2024-04-12T09:01:54.293 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.553+0000 7fc01ad9d700 1 -- 172.21.15.117:0/3737434460 learned_addr learned my addr 172.21.15.117:0/3737434460 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:54.293 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.554+0000 7fc01ad9d700 1 -- 172.21.15.117:0/3737434460 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c0094f0 con 0x7fc01c076bc0 2024-04-12T09:01:54.293 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.554+0000 7fc01ad9d700 1 --2- 172.21.15.117:0/3737434460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc01c076bc0 0x7fc01c111720 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00b440 tx=0x7fc00c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:54.293 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.554+0000 7fc0037fe700 1 -- 172.21.15.117:0/3737434460 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc00c010760 con 0x7fc01c076bc0 2024-04-12T09:01:54.293 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.554+0000 7fc0037fe700 1 -- 172.21.15.117:0/3737434460 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fc00c010d50 con 0x7fc01c076bc0 2024-04-12T09:01:54.293 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.554+0000 7fc021045700 1 -- 172.21.15.117:0/3737434460 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01c111e60 con 0x7fc01c076bc0 2024-04-12T09:01:54.293 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.554+0000 7fc0037fe700 1 -- 172.21.15.117:0/3737434460 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc00c01adc0 con 0x7fc01c076bc0 2024-04-12T09:01:54.293 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.554+0000 7fc021045700 1 -- 172.21.15.117:0/3737434460 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01c1129d0 con 0x7fc01c076bc0 2024-04-12T09:01:54.293 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.555+0000 7fc0037fe700 1 -- 172.21.15.117:0/3737434460 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fc00c019410 con 0x7fc01c076bc0 2024-04-12T09:01:54.293 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.555+0000 7fc021045700 1 -- 172.21.15.117:0/3737434460 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01c05f5f0 con 0x7fc01c076bc0 2024-04-12T09:01:54.293 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.555+0000 7fc0037fe700 1 --2- 172.21.15.117:0/3737434460 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fc004036770 0x7fc004038c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:54.293 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.555+0000 7fc0037fe700 1 -- 172.21.15.117:0/3737434460 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc00c049fe0 con 0x7fc01c076bc0 2024-04-12T09:01:54.293 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.555+0000 7fc01a59c700 1 --2- 172.21.15.117:0/3737434460 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fc004036770 0x7fc004038c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:54.294 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.555+0000 7fc01a59c700 1 --2- 172.21.15.117:0/3737434460 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fc004036770 0x7fc004038c20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc010009990 tx=0x7fc010006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:54.294 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.560+0000 7fc0037fe700 1 -- 172.21.15.117:0/3737434460 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fc00c023940 con 0x7fc01c076bc0 2024-04-12T09:01:54.294 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.749+0000 7fc021045700 1 -- 172.21.15.117:0/3737434460 --> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fc01c0fe320 con 0x7fc004036770 2024-04-12T09:01:54.294 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.750+0000 7fc0037fe700 1 -- 172.21.15.117:0/3737434460 <== mgr.14120 v2:172.21.15.117:6800/791370182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fc01c0fe320 con 0x7fc004036770 2024-04-12T09:01:54.294 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.752+0000 7fc021045700 1 -- 172.21.15.117:0/3737434460 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fc004036770 msgr2=0x7fc004038c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:54.294 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.752+0000 7fc021045700 1 --2- 172.21.15.117:0/3737434460 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fc004036770 0x7fc004038c20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc010009990 tx=0x7fc010006e40 comp rx=0 tx=0).stop 2024-04-12T09:01:54.294 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.752+0000 7fc021045700 1 -- 172.21.15.117:0/3737434460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc01c076bc0 msgr2=0x7fc01c111720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:54.294 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.752+0000 7fc021045700 1 --2- 172.21.15.117:0/3737434460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc01c076bc0 0x7fc01c111720 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00b440 tx=0x7fc00c009250 comp rx=0 tx=0).stop 2024-04-12T09:01:54.294 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.752+0000 7fc021045700 1 -- 172.21.15.117:0/3737434460 shutdown_connections 2024-04-12T09:01:54.294 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.752+0000 7fc021045700 1 --2- 172.21.15.117:0/3737434460 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fc004036770 0x7fc004038c20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:54.294 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.752+0000 7fc021045700 1 --2- 172.21.15.117:0/3737434460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc01c076bc0 0x7fc01c111720 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:54.294 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.752+0000 7fc021045700 1 -- 172.21.15.117:0/3737434460 >> 172.21.15.117:0/3737434460 conn(0x7fc01c0fcf40 msgr2=0x7fc01c0fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:54.294 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.752+0000 7fc021045700 1 -- 172.21.15.117:0/3737434460 shutdown_connections 2024-04-12T09:01:54.294 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:53.752+0000 7fc021045700 1 -- 172.21.15.117:0/3737434460 wait complete. 2024-04-12T09:01:54.294 INFO:teuthology.orchestra.run.smithi117.stdout:Generating ssh key... 2024-04-12T09:01:54.537 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:54 smithi117 ceph-mon[29277]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:01:55.905 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.735+0000 7fe313ae1700 1 Processor -- start 2024-04-12T09:01:55.905 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.735+0000 7fe313ae1700 1 -- start start 2024-04-12T09:01:55.905 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.735+0000 7fe313ae1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe30c102c70 0x7fe30c103080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:55.905 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.735+0000 7fe313ae1700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c103650 con 0x7fe30c102c70 2024-04-12T09:01:55.905 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.735+0000 7fe31187d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe30c102c70 0x7fe30c103080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:55.905 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.735+0000 7fe31187d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe30c102c70 0x7fe30c103080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40428/0 (socket says 172.21.15.117:40428) 2024-04-12T09:01:55.905 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.735+0000 7fe31187d700 1 -- 172.21.15.117:0/3545426883 learned_addr learned my addr 172.21.15.117:0/3545426883 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:55.905 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.735+0000 7fe31187d700 1 -- 172.21.15.117:0/3545426883 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c103790 con 0x7fe30c102c70 2024-04-12T09:01:55.905 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.736+0000 7fe31187d700 1 --2- 172.21.15.117:0/3545426883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe30c102c70 0x7fe30c103080 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe3080098e0 tx=0x7fe308009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d2d79d5f4ab1ac server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:55.906 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.736+0000 7fe31087b700 1 -- 172.21.15.117:0/3545426883 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe30800b860 con 0x7fe30c102c70 2024-04-12T09:01:55.906 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.736+0000 7fe31087b700 1 -- 172.21.15.117:0/3545426883 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe30800be50 con 0x7fe30c102c70 2024-04-12T09:01:55.906 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.736+0000 7fe31087b700 1 -- 172.21.15.117:0/3545426883 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe308010380 con 0x7fe30c102c70 2024-04-12T09:01:55.906 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.736+0000 7fe313ae1700 1 -- 172.21.15.117:0/3545426883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe30c102c70 msgr2=0x7fe30c103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:55.906 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.736+0000 7fe313ae1700 1 --2- 172.21.15.117:0/3545426883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe30c102c70 0x7fe30c103080 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe3080098e0 tx=0x7fe308009250 comp rx=0 tx=0).stop 2024-04-12T09:01:55.906 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.736+0000 7fe313ae1700 1 -- 172.21.15.117:0/3545426883 shutdown_connections 2024-04-12T09:01:55.906 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.736+0000 7fe313ae1700 1 --2- 172.21.15.117:0/3545426883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe30c102c70 0x7fe30c103080 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:55.906 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.736+0000 7fe313ae1700 1 -- 172.21.15.117:0/3545426883 >> 172.21.15.117:0/3545426883 conn(0x7fe30c0fc6f0 msgr2=0x7fe30c0feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:55.906 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.737+0000 7fe313ae1700 1 -- 172.21.15.117:0/3545426883 shutdown_connections 2024-04-12T09:01:55.906 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.737+0000 7fe313ae1700 1 -- 172.21.15.117:0/3545426883 wait complete. 2024-04-12T09:01:55.906 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.737+0000 7fe313ae1700 1 Processor -- start 2024-04-12T09:01:55.906 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.737+0000 7fe313ae1700 1 -- start start 2024-04-12T09:01:55.906 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.737+0000 7fe313ae1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe30c102c70 0x7fe30c113820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:55.907 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.737+0000 7fe313ae1700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c113d60 con 0x7fe30c102c70 2024-04-12T09:01:55.907 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.737+0000 7fe31187d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe30c102c70 0x7fe30c113820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:55.907 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.737+0000 7fe31187d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe30c102c70 0x7fe30c113820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40442/0 (socket says 172.21.15.117:40442) 2024-04-12T09:01:55.907 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.737+0000 7fe31187d700 1 -- 172.21.15.117:0/3633744533 learned_addr learned my addr 172.21.15.117:0/3633744533 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:55.907 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.738+0000 7fe31187d700 1 -- 172.21.15.117:0/3633744533 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3080094f0 con 0x7fe30c102c70 2024-04-12T09:01:55.907 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.738+0000 7fe31187d700 1 --2- 172.21.15.117:0/3633744533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe30c102c70 0x7fe30c113820 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe308006b00 tx=0x7fe308009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:55.907 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.738+0000 7fe3027fc700 1 -- 172.21.15.117:0/3633744533 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe3080107c0 con 0x7fe30c102c70 2024-04-12T09:01:55.907 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.738+0000 7fe3027fc700 1 -- 172.21.15.117:0/3633744533 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe308010db0 con 0x7fe30c102c70 2024-04-12T09:01:55.907 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.738+0000 7fe313ae1700 1 -- 172.21.15.117:0/3633744533 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30c113f60 con 0x7fe30c102c70 2024-04-12T09:01:55.907 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.738+0000 7fe3027fc700 1 -- 172.21.15.117:0/3633744533 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe30801acf0 con 0x7fe30c102c70 2024-04-12T09:01:55.907 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.738+0000 7fe313ae1700 1 -- 172.21.15.117:0/3633744533 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30c114ad0 con 0x7fe30c102c70 2024-04-12T09:01:55.907 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.739+0000 7fe3027fc700 1 -- 172.21.15.117:0/3633744533 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fe3080193c0 con 0x7fe30c102c70 2024-04-12T09:01:55.907 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.739+0000 7fe3027fc700 1 --2- 172.21.15.117:0/3633744533 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fe2f8036790 0x7fe2f8038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:55.908 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.739+0000 7fe3027fc700 1 -- 172.21.15.117:0/3633744533 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe30804a680 con 0x7fe30c102c70 2024-04-12T09:01:55.908 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.739+0000 7fe313ae1700 1 -- 172.21.15.117:0/3633744533 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30c05f5f0 con 0x7fe30c102c70 2024-04-12T09:01:55.908 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.739+0000 7fe31107c700 1 --2- 172.21.15.117:0/3633744533 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fe2f8036790 0x7fe2f8038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:55.908 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.739+0000 7fe31107c700 1 --2- 172.21.15.117:0/3633744533 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fe2f8036790 0x7fe2f8038c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009990 tx=0x7fe2fc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:55.908 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.744+0000 7fe3027fc700 1 -- 172.21.15.117:0/3633744533 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fe308022930 con 0x7fe30c102c70 2024-04-12T09:01:55.908 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:54.929+0000 7fe313ae1700 1 -- 172.21.15.117:0/3633744533 --> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fe30c0fd980 con 0x7fe2f8036790 2024-04-12T09:01:55.908 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:55.327+0000 7fe3027fc700 1 -- 172.21.15.117:0/3633744533 <== mgr.14120 v2:172.21.15.117:6800/791370182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe30c0fd980 con 0x7fe2f8036790 2024-04-12T09:01:55.908 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:55.329+0000 7fe313ae1700 1 -- 172.21.15.117:0/3633744533 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fe2f8036790 msgr2=0x7fe2f8038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:55.908 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:55.329+0000 7fe313ae1700 1 --2- 172.21.15.117:0/3633744533 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fe2f8036790 0x7fe2f8038c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009990 tx=0x7fe2fc006e40 comp rx=0 tx=0).stop 2024-04-12T09:01:55.908 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:55.329+0000 7fe313ae1700 1 -- 172.21.15.117:0/3633744533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe30c102c70 msgr2=0x7fe30c113820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:55.908 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:55.329+0000 7fe313ae1700 1 --2- 172.21.15.117:0/3633744533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe30c102c70 0x7fe30c113820 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe308006b00 tx=0x7fe308009250 comp rx=0 tx=0).stop 2024-04-12T09:01:55.908 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:55.329+0000 7fe313ae1700 1 -- 172.21.15.117:0/3633744533 shutdown_connections 2024-04-12T09:01:55.908 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:55.329+0000 7fe313ae1700 1 --2- 172.21.15.117:0/3633744533 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fe2f8036790 0x7fe2f8038c40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:55.909 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:55.329+0000 7fe313ae1700 1 --2- 172.21.15.117:0/3633744533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe30c102c70 0x7fe30c113820 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:55.909 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:55.329+0000 7fe313ae1700 1 -- 172.21.15.117:0/3633744533 >> 172.21.15.117:0/3633744533 conn(0x7fe30c0fc6f0 msgr2=0x7fe30c0fd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:55.909 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:55.329+0000 7fe313ae1700 1 -- 172.21.15.117:0/3633744533 shutdown_connections 2024-04-12T09:01:55.909 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:55.329+0000 7fe313ae1700 1 -- 172.21.15.117:0/3633744533 wait complete. 2024-04-12T09:01:56.466 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:56 smithi117 ceph-mon[29277]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:01:56.467 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:56 smithi117 ceph-mon[29277]: Generating ssh key... 2024-04-12T09:01:56.467 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:56 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' 2024-04-12T09:01:56.467 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:56 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' 2024-04-12T09:01:57.095 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1eqPtL6oAXvRvl80gBmeWr7ayhH124S7Cy0CmUyKGoD5KeErKFplViT6SIg/YQ79kokPZIJy3ebTTCBB2lAIfv+HJwx2/znkuooJAyWz5n9+7RywwuQXId4E/teon/NrgEpXHOBKyX4AjhlDqV5n6RL9LwKZHQsRdMbPs+tOUYEqdrsLQHFvsEKUJmYsy1GjknhzMimgNV58etyNzUvJdAObd1oHYTTDrbyAplbvLfwZqT2IuwEK+FFDKlYYzjBwfAB2/WinZZOtJo8MMZ6UzEp7Amfp8EIraai4C+hmrkdwmzN80Kb/vfmLi1racheEUzc2rcioF0m8f5/TpvXEv9frwU75bJfwuksmXIXTEhgI0vL8Pu1/gu6HzNi7Rc1OVu77iTjGnAmcjt2+R1WMlXegsq3Mdbx6FPsBpYF+up6KTKGYZzJRBvffFAZcqCqfqteLY92HEbDuSWEJN1FnXHhokYfRDoeg5E2U78sb+qi2E3A7q7zjK2drj361AI60= ceph-12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:01:57.096 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.269+0000 7f4d4a622700 1 Processor -- start 2024-04-12T09:01:57.096 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.269+0000 7f4d4a622700 1 -- start start 2024-04-12T09:01:57.096 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.269+0000 7f4d4a622700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d44102920 0x7f4d44102d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:57.096 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.269+0000 7f4d4a622700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d44103270 con 0x7f4d44102920 2024-04-12T09:01:57.096 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.269+0000 7f4d43fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d44102920 0x7f4d44102d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:57.096 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.269+0000 7f4d43fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d44102920 0x7f4d44102d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40448/0 (socket says 172.21.15.117:40448) 2024-04-12T09:01:57.096 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.269+0000 7f4d43fff700 1 -- 172.21.15.117:0/4030323279 learned_addr learned my addr 172.21.15.117:0/4030323279 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:57.096 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.270+0000 7f4d43fff700 1 -- 172.21.15.117:0/4030323279 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d441033b0 con 0x7f4d44102920 2024-04-12T09:01:57.096 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.270+0000 7f4d43fff700 1 --2- 172.21.15.117:0/4030323279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d44102920 0x7f4d44102d30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4d340098e0 tx=0x7f4d34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142c0a555e05138f server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:57.096 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.270+0000 7f4d42ffd700 1 -- 172.21.15.117:0/4030323279 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d3400b860 con 0x7f4d44102920 2024-04-12T09:01:57.096 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.270+0000 7f4d42ffd700 1 -- 172.21.15.117:0/4030323279 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4d3400be50 con 0x7f4d44102920 2024-04-12T09:01:57.096 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.270+0000 7f4d42ffd700 1 -- 172.21.15.117:0/4030323279 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d34010380 con 0x7f4d44102920 2024-04-12T09:01:57.097 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.270+0000 7f4d4a622700 1 -- 172.21.15.117:0/4030323279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d44102920 msgr2=0x7f4d44102d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:57.097 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.270+0000 7f4d4a622700 1 --2- 172.21.15.117:0/4030323279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d44102920 0x7f4d44102d30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4d340098e0 tx=0x7f4d34009250 comp rx=0 tx=0).stop 2024-04-12T09:01:57.097 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.270+0000 7f4d4a622700 1 -- 172.21.15.117:0/4030323279 shutdown_connections 2024-04-12T09:01:57.097 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.270+0000 7f4d4a622700 1 --2- 172.21.15.117:0/4030323279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d44102920 0x7f4d44102d30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:57.097 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.270+0000 7f4d4a622700 1 -- 172.21.15.117:0/4030323279 >> 172.21.15.117:0/4030323279 conn(0x7f4d440fe0a0 msgr2=0x7f4d441004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:57.097 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.270+0000 7f4d4a622700 1 -- 172.21.15.117:0/4030323279 shutdown_connections 2024-04-12T09:01:57.097 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.270+0000 7f4d4a622700 1 -- 172.21.15.117:0/4030323279 wait complete. 2024-04-12T09:01:57.097 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.271+0000 7f4d4a622700 1 Processor -- start 2024-04-12T09:01:57.097 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.271+0000 7f4d4a622700 1 -- start start 2024-04-12T09:01:57.097 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.271+0000 7f4d4a622700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d44102920 0x7f4d441116a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:57.097 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.271+0000 7f4d4a622700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d44111be0 con 0x7f4d44102920 2024-04-12T09:01:57.097 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.271+0000 7f4d43fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d44102920 0x7f4d441116a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:57.097 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.271+0000 7f4d43fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d44102920 0x7f4d441116a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40458/0 (socket says 172.21.15.117:40458) 2024-04-12T09:01:57.097 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.271+0000 7f4d43fff700 1 -- 172.21.15.117:0/3247256899 learned_addr learned my addr 172.21.15.117:0/3247256899 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:01:57.097 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.272+0000 7f4d43fff700 1 -- 172.21.15.117:0/3247256899 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d340094f0 con 0x7f4d44102920 2024-04-12T09:01:57.097 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.272+0000 7f4d43fff700 1 --2- 172.21.15.117:0/3247256899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d44102920 0x7f4d441116a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4d34000c00 tx=0x7f4d34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:57.098 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.272+0000 7f4d40ff9700 1 -- 172.21.15.117:0/3247256899 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d340107c0 con 0x7f4d44102920 2024-04-12T09:01:57.098 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.272+0000 7f4d40ff9700 1 -- 172.21.15.117:0/3247256899 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f4d34010db0 con 0x7f4d44102920 2024-04-12T09:01:57.098 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.272+0000 7f4d4a622700 1 -- 172.21.15.117:0/3247256899 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d44111de0 con 0x7f4d44102920 2024-04-12T09:01:57.098 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.272+0000 7f4d40ff9700 1 -- 172.21.15.117:0/3247256899 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d3401ad00 con 0x7f4d44102920 2024-04-12T09:01:57.098 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.272+0000 7f4d4a622700 1 -- 172.21.15.117:0/3247256899 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d44112950 con 0x7f4d44102920 2024-04-12T09:01:57.098 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.273+0000 7f4d40ff9700 1 -- 172.21.15.117:0/3247256899 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f4d340193c0 con 0x7f4d44102920 2024-04-12T09:01:57.098 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.273+0000 7f4d4a622700 1 -- 172.21.15.117:0/3247256899 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d4405f5f0 con 0x7f4d44102920 2024-04-12T09:01:57.098 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.273+0000 7f4d40ff9700 1 --2- 172.21.15.117:0/3247256899 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f4d2c036790 0x7f4d2c038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:01:57.098 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.273+0000 7f4d40ff9700 1 -- 172.21.15.117:0/3247256899 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f4d3404a670 con 0x7f4d44102920 2024-04-12T09:01:57.098 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.273+0000 7f4d437fe700 1 --2- 172.21.15.117:0/3247256899 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f4d2c036790 0x7f4d2c038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:01:57.098 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.274+0000 7f4d437fe700 1 --2- 172.21.15.117:0/3247256899 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f4d2c036790 0x7f4d2c038c40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009990 tx=0x7f4d38006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:01:57.098 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.278+0000 7f4d40ff9700 1 -- 172.21.15.117:0/3247256899 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f4d34022930 con 0x7f4d44102920 2024-04-12T09:01:57.098 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.465+0000 7f4d4a622700 1 -- 172.21.15.117:0/3247256899 --> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d440ff310 con 0x7f4d2c036790 2024-04-12T09:01:57.098 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.466+0000 7f4d40ff9700 1 -- 172.21.15.117:0/3247256899 <== mgr.14120 v2:172.21.15.117:6800/791370182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f4d440ff310 con 0x7f4d2c036790 2024-04-12T09:01:57.099 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.469+0000 7f4d4a622700 1 -- 172.21.15.117:0/3247256899 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f4d2c036790 msgr2=0x7f4d2c038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:57.099 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.469+0000 7f4d4a622700 1 --2- 172.21.15.117:0/3247256899 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f4d2c036790 0x7f4d2c038c40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009990 tx=0x7f4d38006e40 comp rx=0 tx=0).stop 2024-04-12T09:01:57.099 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.469+0000 7f4d4a622700 1 -- 172.21.15.117:0/3247256899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d44102920 msgr2=0x7f4d441116a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:01:57.099 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.469+0000 7f4d4a622700 1 --2- 172.21.15.117:0/3247256899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d44102920 0x7f4d441116a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4d34000c00 tx=0x7f4d34009250 comp rx=0 tx=0).stop 2024-04-12T09:01:57.099 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.469+0000 7f4d4a622700 1 -- 172.21.15.117:0/3247256899 shutdown_connections 2024-04-12T09:01:57.099 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.469+0000 7f4d4a622700 1 --2- 172.21.15.117:0/3247256899 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f4d2c036790 0x7f4d2c038c40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:57.099 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.469+0000 7f4d4a622700 1 --2- 172.21.15.117:0/3247256899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d44102920 0x7f4d441116a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:01:57.099 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.469+0000 7f4d4a622700 1 -- 172.21.15.117:0/3247256899 >> 172.21.15.117:0/3247256899 conn(0x7f4d440fe0a0 msgr2=0x7f4d440fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:01:57.099 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.469+0000 7f4d4a622700 1 -- 172.21.15.117:0/3247256899 shutdown_connections 2024-04-12T09:01:57.099 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:56.469+0000 7f4d4a622700 1 -- 172.21.15.117:0/3247256899 wait complete. 2024-04-12T09:01:57.099 INFO:teuthology.orchestra.run.smithi117.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-12T09:01:57.099 INFO:teuthology.orchestra.run.smithi117.stdout:Adding key to root@localhost authorized_keys... 2024-04-12T09:01:57.099 INFO:teuthology.orchestra.run.smithi117.stdout:Adding host smithi117... 2024-04-12T09:01:57.365 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:57 smithi117 ceph-mon[29277]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:01:58.535 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:58 smithi117 ceph-mon[29277]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi117", "addr": "172.21.15.117", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:01:59.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:01:59 smithi117 ceph-mon[29277]: Deploying cephadm binary to smithi117 2024-04-12T09:02:00.337 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout Added host 'smithi117' with addr '172.21.15.117' 2024-04-12T09:02:00.337 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.462+0000 7f2c06b76700 1 Processor -- start 2024-04-12T09:02:00.337 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.462+0000 7f2c06b76700 1 -- start start 2024-04-12T09:02:00.337 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.462+0000 7f2c06b76700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c00102910 0x7f2c00102d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:00.337 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.462+0000 7f2c06b76700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c00103260 con 0x7f2c00102910 2024-04-12T09:02:00.337 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.462+0000 7f2c04912700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c00102910 0x7f2c00102d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:00.338 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.462+0000 7f2c04912700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c00102910 0x7f2c00102d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40474/0 (socket says 172.21.15.117:40474) 2024-04-12T09:02:00.338 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.462+0000 7f2c04912700 1 -- 172.21.15.117:0/1147918329 learned_addr learned my addr 172.21.15.117:0/1147918329 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:00.338 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.462+0000 7f2c04912700 1 -- 172.21.15.117:0/1147918329 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c001033a0 con 0x7f2c00102910 2024-04-12T09:02:00.338 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.462+0000 7f2c04912700 1 --2- 172.21.15.117:0/1147918329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c00102910 0x7f2c00102d20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2bf40098e0 tx=0x7f2bf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d1373731bd1fb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:00.338 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.463+0000 7f2bff7fe700 1 -- 172.21.15.117:0/1147918329 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2bf400b860 con 0x7f2c00102910 2024-04-12T09:02:00.338 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.463+0000 7f2bff7fe700 1 -- 172.21.15.117:0/1147918329 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f2bf400be50 con 0x7f2c00102910 2024-04-12T09:02:00.338 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.463+0000 7f2bff7fe700 1 -- 172.21.15.117:0/1147918329 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2bf4010380 con 0x7f2c00102910 2024-04-12T09:02:00.338 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.463+0000 7f2c06b76700 1 -- 172.21.15.117:0/1147918329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c00102910 msgr2=0x7f2c00102d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:00.338 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.463+0000 7f2c06b76700 1 --2- 172.21.15.117:0/1147918329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c00102910 0x7f2c00102d20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2bf40098e0 tx=0x7f2bf4009250 comp rx=0 tx=0).stop 2024-04-12T09:02:00.338 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.463+0000 7f2c06b76700 1 -- 172.21.15.117:0/1147918329 shutdown_connections 2024-04-12T09:02:00.338 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.463+0000 7f2c06b76700 1 --2- 172.21.15.117:0/1147918329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c00102910 0x7f2c00102d20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:00.338 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.463+0000 7f2c06b76700 1 -- 172.21.15.117:0/1147918329 >> 172.21.15.117:0/1147918329 conn(0x7f2c000fe070 msgr2=0x7f2c001004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:00.338 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.463+0000 7f2c06b76700 1 -- 172.21.15.117:0/1147918329 shutdown_connections 2024-04-12T09:02:00.338 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.463+0000 7f2c06b76700 1 -- 172.21.15.117:0/1147918329 wait complete. 2024-04-12T09:02:00.339 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.464+0000 7f2c06b76700 1 Processor -- start 2024-04-12T09:02:00.339 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.464+0000 7f2c06b76700 1 -- start start 2024-04-12T09:02:00.339 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.464+0000 7f2c06b76700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c00102910 0x7f2c001116d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:00.339 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.464+0000 7f2c06b76700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c00111c10 con 0x7f2c00102910 2024-04-12T09:02:00.339 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.464+0000 7f2c04912700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c00102910 0x7f2c001116d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:00.339 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.464+0000 7f2c04912700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c00102910 0x7f2c001116d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40478/0 (socket says 172.21.15.117:40478) 2024-04-12T09:02:00.339 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.464+0000 7f2c04912700 1 -- 172.21.15.117:0/119580412 learned_addr learned my addr 172.21.15.117:0/119580412 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:00.339 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.464+0000 7f2c04912700 1 -- 172.21.15.117:0/119580412 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf40094f0 con 0x7f2c00102910 2024-04-12T09:02:00.339 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.464+0000 7f2c04912700 1 --2- 172.21.15.117:0/119580412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c00102910 0x7f2c001116d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2bf400b440 tx=0x7f2bf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:00.339 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.465+0000 7f2bfd7fa700 1 -- 172.21.15.117:0/119580412 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2bf4010760 con 0x7f2c00102910 2024-04-12T09:02:00.339 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.465+0000 7f2bfd7fa700 1 -- 172.21.15.117:0/119580412 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f2bf4010d50 con 0x7f2c00102910 2024-04-12T09:02:00.340 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.465+0000 7f2bfd7fa700 1 -- 172.21.15.117:0/119580412 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2bf401ae20 con 0x7f2c00102910 2024-04-12T09:02:00.340 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.465+0000 7f2c06b76700 1 -- 172.21.15.117:0/119580412 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c00111e10 con 0x7f2c00102910 2024-04-12T09:02:00.340 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.465+0000 7f2c06b76700 1 -- 172.21.15.117:0/119580412 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c00112980 con 0x7f2c00102910 2024-04-12T09:02:00.340 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.465+0000 7f2bfd7fa700 1 -- 172.21.15.117:0/119580412 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f2bf40108c0 con 0x7f2c00102910 2024-04-12T09:02:00.340 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.466+0000 7f2c06b76700 1 -- 172.21.15.117:0/119580412 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c0005f5f0 con 0x7f2c00102910 2024-04-12T09:02:00.340 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.466+0000 7f2bfd7fa700 1 --2- 172.21.15.117:0/119580412 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f2bf0036770 0x7f2bf0038c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:00.340 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.466+0000 7f2bfd7fa700 1 -- 172.21.15.117:0/119580412 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f2bf404a5c0 con 0x7f2c00102910 2024-04-12T09:02:00.340 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.466+0000 7f2bfffff700 1 --2- 172.21.15.117:0/119580412 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f2bf0036770 0x7f2bf0038c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:00.340 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.466+0000 7f2bfffff700 1 --2- 172.21.15.117:0/119580412 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f2bf0036770 0x7f2bf0038c20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2bec009990 tx=0x7f2bec006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:00.340 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.470+0000 7f2bfd7fa700 1 -- 172.21.15.117:0/119580412 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f2bf401a430 con 0x7f2c00102910 2024-04-12T09:02:00.340 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:57.658+0000 7f2c06b76700 1 -- 172.21.15.117:0/119580412 --> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi117", "addr": "172.21.15.117", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c000ff2b0 con 0x7f2bf0036770 2024-04-12T09:02:00.340 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:59.694+0000 7f2bfd7fa700 1 -- 172.21.15.117:0/119580412 <== mgr.14120 v2:172.21.15.117:6800/791370182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f2c000ff2b0 con 0x7f2bf0036770 2024-04-12T09:02:00.340 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:59.696+0000 7f2c06b76700 1 -- 172.21.15.117:0/119580412 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f2bf0036770 msgr2=0x7f2bf0038c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:00.340 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:59.696+0000 7f2c06b76700 1 --2- 172.21.15.117:0/119580412 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f2bf0036770 0x7f2bf0038c20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2bec009990 tx=0x7f2bec006e40 comp rx=0 tx=0).stop 2024-04-12T09:02:00.341 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:59.696+0000 7f2c06b76700 1 -- 172.21.15.117:0/119580412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c00102910 msgr2=0x7f2c001116d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:00.341 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:59.696+0000 7f2c06b76700 1 --2- 172.21.15.117:0/119580412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c00102910 0x7f2c001116d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2bf400b440 tx=0x7f2bf4009250 comp rx=0 tx=0).stop 2024-04-12T09:02:00.341 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:59.696+0000 7f2c06b76700 1 -- 172.21.15.117:0/119580412 shutdown_connections 2024-04-12T09:02:00.341 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:59.696+0000 7f2c06b76700 1 --2- 172.21.15.117:0/119580412 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f2bf0036770 0x7f2bf0038c20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:00.341 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:59.697+0000 7f2c06b76700 1 --2- 172.21.15.117:0/119580412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c00102910 0x7f2c001116d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:00.341 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:59.697+0000 7f2c06b76700 1 -- 172.21.15.117:0/119580412 >> 172.21.15.117:0/119580412 conn(0x7f2c000fe070 msgr2=0x7f2c000feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:00.341 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:59.697+0000 7f2c06b76700 1 -- 172.21.15.117:0/119580412 shutdown_connections 2024-04-12T09:02:00.341 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:01:59.697+0000 7f2c06b76700 1 -- 172.21.15.117:0/119580412 wait complete. 2024-04-12T09:02:00.341 INFO:teuthology.orchestra.run.smithi117.stdout:Deploying mon service with default placement... 2024-04-12T09:02:00.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:00 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:00.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:00 smithi117 ceph-mon[29277]: Added host smithi117 2024-04-12T09:02:00.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:00 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:02:01.787 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-12T09:02:01.787 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.740+0000 7fd7992f8700 1 Processor -- start 2024-04-12T09:02:01.787 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.740+0000 7fd7992f8700 1 -- start start 2024-04-12T09:02:01.787 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.740+0000 7fd7992f8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd794071230 0x7fd794105560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:01.787 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.740+0000 7fd7992f8700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd794071640 con 0x7fd794071230 2024-04-12T09:02:01.788 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.741+0000 7fd792ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd794071230 0x7fd794105560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:01.788 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.741+0000 7fd792ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd794071230 0x7fd794105560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40328/0 (socket says 172.21.15.117:40328) 2024-04-12T09:02:01.788 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.741+0000 7fd792ffd700 1 -- 172.21.15.117:0/2717277584 learned_addr learned my addr 172.21.15.117:0/2717277584 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:01.788 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.741+0000 7fd792ffd700 1 -- 172.21.15.117:0/2717277584 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd794105aa0 con 0x7fd794071230 2024-04-12T09:02:01.788 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.741+0000 7fd792ffd700 1 --2- 172.21.15.117:0/2717277584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd794071230 0x7fd794105560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd784009e50 tx=0x7fd784009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed9189a2259a476 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:01.788 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.741+0000 7fd791ffb700 1 -- 172.21.15.117:0/2717277584 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd7840092e0 con 0x7fd794071230 2024-04-12T09:02:01.788 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.741+0000 7fd791ffb700 1 -- 172.21.15.117:0/2717277584 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd784012430 con 0x7fd794071230 2024-04-12T09:02:01.788 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.741+0000 7fd791ffb700 1 -- 172.21.15.117:0/2717277584 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd7840075c0 con 0x7fd794071230 2024-04-12T09:02:01.788 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.742+0000 7fd7992f8700 1 -- 172.21.15.117:0/2717277584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd794071230 msgr2=0x7fd794105560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:01.788 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.742+0000 7fd7992f8700 1 --2- 172.21.15.117:0/2717277584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd794071230 0x7fd794105560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd784009e50 tx=0x7fd784009840 comp rx=0 tx=0).stop 2024-04-12T09:02:01.788 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.742+0000 7fd7992f8700 1 -- 172.21.15.117:0/2717277584 shutdown_connections 2024-04-12T09:02:01.788 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.742+0000 7fd7992f8700 1 --2- 172.21.15.117:0/2717277584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd794071230 0x7fd794105560 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:01.788 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.742+0000 7fd7992f8700 1 -- 172.21.15.117:0/2717277584 >> 172.21.15.117:0/2717277584 conn(0x7fd7940fcfb0 msgr2=0x7fd7940ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:01.788 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.742+0000 7fd7992f8700 1 -- 172.21.15.117:0/2717277584 shutdown_connections 2024-04-12T09:02:01.789 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.742+0000 7fd7992f8700 1 -- 172.21.15.117:0/2717277584 wait complete. 2024-04-12T09:02:01.789 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.743+0000 7fd7992f8700 1 Processor -- start 2024-04-12T09:02:01.789 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.743+0000 7fd7992f8700 1 -- start start 2024-04-12T09:02:01.789 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.743+0000 7fd7992f8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd794071230 0x7fd794111760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:01.789 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.743+0000 7fd7992f8700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd794111ca0 con 0x7fd794071230 2024-04-12T09:02:01.789 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.743+0000 7fd792ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd794071230 0x7fd794111760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:01.789 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.743+0000 7fd792ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd794071230 0x7fd794111760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40344/0 (socket says 172.21.15.117:40344) 2024-04-12T09:02:01.789 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.743+0000 7fd792ffd700 1 -- 172.21.15.117:0/1538711108 learned_addr learned my addr 172.21.15.117:0/1538711108 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:01.789 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.743+0000 7fd792ffd700 1 -- 172.21.15.117:0/1538711108 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd784009ae0 con 0x7fd794071230 2024-04-12T09:02:01.789 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.743+0000 7fd792ffd700 1 --2- 172.21.15.117:0/1538711108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd794071230 0x7fd794111760 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd784000f80 tx=0x7fd784009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:01.789 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.743+0000 7fd78b7fe700 1 -- 172.21.15.117:0/1538711108 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd7840092e0 con 0x7fd794071230 2024-04-12T09:02:01.789 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.743+0000 7fd78b7fe700 1 -- 172.21.15.117:0/1538711108 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd784007cc0 con 0x7fd794071230 2024-04-12T09:02:01.789 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.743+0000 7fd7992f8700 1 -- 172.21.15.117:0/1538711108 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd794111ea0 con 0x7fd794071230 2024-04-12T09:02:01.789 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.743+0000 7fd78b7fe700 1 -- 172.21.15.117:0/1538711108 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd78401c910 con 0x7fd794071230 2024-04-12T09:02:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.743+0000 7fd7992f8700 1 -- 172.21.15.117:0/1538711108 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd794112a10 con 0x7fd794071230 2024-04-12T09:02:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.744+0000 7fd78b7fe700 1 -- 172.21.15.117:0/1538711108 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fd784019070 con 0x7fd794071230 2024-04-12T09:02:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.745+0000 7fd78b7fe700 1 --2- 172.21.15.117:0/1538711108 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fd7800367e0 0x7fd780038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.745+0000 7fd7992f8700 1 -- 172.21.15.117:0/1538711108 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd79405f5f0 con 0x7fd794071230 2024-04-12T09:02:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.745+0000 7fd78b7fe700 1 -- 172.21.15.117:0/1538711108 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd784049e30 con 0x7fd794071230 2024-04-12T09:02:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.745+0000 7fd7927fc700 1 --2- 172.21.15.117:0/1538711108 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fd7800367e0 0x7fd780038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.745+0000 7fd7927fc700 1 --2- 172.21.15.117:0/1538711108 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fd7800367e0 0x7fd780038c90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd77c009990 tx=0x7fd77c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.749+0000 7fd78b7fe700 1 -- 172.21.15.117:0/1538711108 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fd784021260 con 0x7fd794071230 2024-04-12T09:02:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.975+0000 7fd7992f8700 1 -- 172.21.15.117:0/1538711108 --> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7940fe470 con 0x7fd7800367e0 2024-04-12T09:02:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.982+0000 7fd78b7fe700 1 -- 172.21.15.117:0/1538711108 <== mgr.14120 v2:172.21.15.117:6800/791370182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd7940fe470 con 0x7fd7800367e0 2024-04-12T09:02:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.984+0000 7fd7992f8700 1 -- 172.21.15.117:0/1538711108 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fd7800367e0 msgr2=0x7fd780038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.984+0000 7fd7992f8700 1 --2- 172.21.15.117:0/1538711108 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fd7800367e0 0x7fd780038c90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd77c009990 tx=0x7fd77c006e40 comp rx=0 tx=0).stop 2024-04-12T09:02:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.984+0000 7fd7992f8700 1 -- 172.21.15.117:0/1538711108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd794071230 msgr2=0x7fd794111760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:01.791 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.984+0000 7fd7992f8700 1 --2- 172.21.15.117:0/1538711108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd794071230 0x7fd794111760 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd784000f80 tx=0x7fd784009840 comp rx=0 tx=0).stop 2024-04-12T09:02:01.791 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.984+0000 7fd7992f8700 1 -- 172.21.15.117:0/1538711108 shutdown_connections 2024-04-12T09:02:01.791 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.984+0000 7fd7992f8700 1 --2- 172.21.15.117:0/1538711108 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fd7800367e0 0x7fd780038c90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:01.791 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.984+0000 7fd7992f8700 1 --2- 172.21.15.117:0/1538711108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd794071230 0x7fd794111760 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:01.791 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.984+0000 7fd7992f8700 1 -- 172.21.15.117:0/1538711108 >> 172.21.15.117:0/1538711108 conn(0x7fd7940fcfb0 msgr2=0x7fd7940fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:01.791 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.984+0000 7fd7992f8700 1 -- 172.21.15.117:0/1538711108 shutdown_connections 2024-04-12T09:02:01.791 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:00.984+0000 7fd7992f8700 1 -- 172.21.15.117:0/1538711108 wait complete. 2024-04-12T09:02:01.791 INFO:teuthology.orchestra.run.smithi117.stdout:Deploying mgr service with default placement... 2024-04-12T09:02:02.082 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:01 smithi117 ceph-mon[29277]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:02:02.082 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:01 smithi117 ceph-mon[29277]: Saving service mon spec with placement count:5 2024-04-12T09:02:02.083 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:01 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:03.070 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-12T09:02:03.071 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.180+0000 7ffa7721f700 1 Processor -- start 2024-04-12T09:02:03.071 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.180+0000 7ffa7721f700 1 -- start start 2024-04-12T09:02:03.071 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.181+0000 7ffa7721f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa70102860 0x7ffa70102c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:03.071 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.181+0000 7ffa7721f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa701031b0 con 0x7ffa70102860 2024-04-12T09:02:03.071 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.181+0000 7ffa74fbb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa70102860 0x7ffa70102c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:03.071 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.181+0000 7ffa74fbb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa70102860 0x7ffa70102c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40356/0 (socket says 172.21.15.117:40356) 2024-04-12T09:02:03.071 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.181+0000 7ffa74fbb700 1 -- 172.21.15.117:0/4026001783 learned_addr learned my addr 172.21.15.117:0/4026001783 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:03.071 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.181+0000 7ffa74fbb700 1 -- 172.21.15.117:0/4026001783 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa701032f0 con 0x7ffa70102860 2024-04-12T09:02:03.071 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.181+0000 7ffa74fbb700 1 --2- 172.21.15.117:0/4026001783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa70102860 0x7ffa70102c70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ffa640098e0 tx=0x7ffa64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc5487e971ff387d server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:03.071 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.182+0000 7ffa6f7fe700 1 -- 172.21.15.117:0/4026001783 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa6400b860 con 0x7ffa70102860 2024-04-12T09:02:03.071 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.182+0000 7ffa6f7fe700 1 -- 172.21.15.117:0/4026001783 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ffa6400be50 con 0x7ffa70102860 2024-04-12T09:02:03.071 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.182+0000 7ffa6f7fe700 1 -- 172.21.15.117:0/4026001783 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa64010380 con 0x7ffa70102860 2024-04-12T09:02:03.071 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.182+0000 7ffa7721f700 1 -- 172.21.15.117:0/4026001783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa70102860 msgr2=0x7ffa70102c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:03.072 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.182+0000 7ffa7721f700 1 --2- 172.21.15.117:0/4026001783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa70102860 0x7ffa70102c70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ffa640098e0 tx=0x7ffa64009250 comp rx=0 tx=0).stop 2024-04-12T09:02:03.072 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.182+0000 7ffa7721f700 1 -- 172.21.15.117:0/4026001783 shutdown_connections 2024-04-12T09:02:03.072 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.182+0000 7ffa7721f700 1 --2- 172.21.15.117:0/4026001783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa70102860 0x7ffa70102c70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:03.072 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.182+0000 7ffa7721f700 1 -- 172.21.15.117:0/4026001783 >> 172.21.15.117:0/4026001783 conn(0x7ffa700fe000 msgr2=0x7ffa70100410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:03.072 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.182+0000 7ffa7721f700 1 -- 172.21.15.117:0/4026001783 shutdown_connections 2024-04-12T09:02:03.072 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.182+0000 7ffa7721f700 1 -- 172.21.15.117:0/4026001783 wait complete. 2024-04-12T09:02:03.072 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.183+0000 7ffa7721f700 1 Processor -- start 2024-04-12T09:02:03.072 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.183+0000 7ffa7721f700 1 -- start start 2024-04-12T09:02:03.072 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.183+0000 7ffa7721f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa70102860 0x7ffa70078c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:03.072 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.183+0000 7ffa7721f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa70079180 con 0x7ffa70102860 2024-04-12T09:02:03.072 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.183+0000 7ffa74fbb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa70102860 0x7ffa70078c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:03.072 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.183+0000 7ffa74fbb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa70102860 0x7ffa70078c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40362/0 (socket says 172.21.15.117:40362) 2024-04-12T09:02:03.072 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.183+0000 7ffa74fbb700 1 -- 172.21.15.117:0/2340402216 learned_addr learned my addr 172.21.15.117:0/2340402216 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:03.072 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.184+0000 7ffa74fbb700 1 -- 172.21.15.117:0/2340402216 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa640094f0 con 0x7ffa70102860 2024-04-12T09:02:03.072 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.184+0000 7ffa74fbb700 1 --2- 172.21.15.117:0/2340402216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa70102860 0x7ffa70078c40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffa64000c00 tx=0x7ffa64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:03.073 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.184+0000 7ffa6d7fa700 1 -- 172.21.15.117:0/2340402216 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa640107c0 con 0x7ffa70102860 2024-04-12T09:02:03.073 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.184+0000 7ffa6d7fa700 1 -- 172.21.15.117:0/2340402216 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ffa64010db0 con 0x7ffa70102860 2024-04-12T09:02:03.073 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.184+0000 7ffa7721f700 1 -- 172.21.15.117:0/2340402216 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa700771f0 con 0x7ffa70102860 2024-04-12T09:02:03.073 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.184+0000 7ffa6d7fa700 1 -- 172.21.15.117:0/2340402216 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa6401ad00 con 0x7ffa70102860 2024-04-12T09:02:03.073 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.184+0000 7ffa7721f700 1 -- 172.21.15.117:0/2340402216 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa700776e0 con 0x7ffa70102860 2024-04-12T09:02:03.073 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.185+0000 7ffa6d7fa700 1 -- 172.21.15.117:0/2340402216 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7ffa640193c0 con 0x7ffa70102860 2024-04-12T09:02:03.073 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.186+0000 7ffa6d7fa700 1 --2- 172.21.15.117:0/2340402216 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7ffa60036830 0x7ffa60038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:03.073 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.186+0000 7ffa6d7fa700 1 -- 172.21.15.117:0/2340402216 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ffa6404a6e0 con 0x7ffa70102860 2024-04-12T09:02:03.073 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.186+0000 7ffa7721f700 1 -- 172.21.15.117:0/2340402216 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa7004bed0 con 0x7ffa70102860 2024-04-12T09:02:03.073 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.186+0000 7ffa6ffff700 1 --2- 172.21.15.117:0/2340402216 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7ffa60036830 0x7ffa60038ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:03.073 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.186+0000 7ffa6ffff700 1 --2- 172.21.15.117:0/2340402216 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7ffa60036830 0x7ffa60038ce0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c009990 tx=0x7ffa5c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:03.073 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.191+0000 7ffa6d7fa700 1 -- 172.21.15.117:0/2340402216 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7ffa640196c0 con 0x7ffa70102860 2024-04-12T09:02:03.073 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.394+0000 7ffa7721f700 1 -- 172.21.15.117:0/2340402216 --> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa70077d70 con 0x7ffa60036830 2024-04-12T09:02:03.073 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.398+0000 7ffa6d7fa700 1 -- 172.21.15.117:0/2340402216 <== mgr.14120 v2:172.21.15.117:6800/791370182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ffa70077d70 con 0x7ffa60036830 2024-04-12T09:02:03.074 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.400+0000 7ffa7721f700 1 -- 172.21.15.117:0/2340402216 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7ffa60036830 msgr2=0x7ffa60038ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:03.074 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.400+0000 7ffa7721f700 1 --2- 172.21.15.117:0/2340402216 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7ffa60036830 0x7ffa60038ce0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c009990 tx=0x7ffa5c006e40 comp rx=0 tx=0).stop 2024-04-12T09:02:03.074 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.400+0000 7ffa7721f700 1 -- 172.21.15.117:0/2340402216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa70102860 msgr2=0x7ffa70078c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:03.074 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.400+0000 7ffa7721f700 1 --2- 172.21.15.117:0/2340402216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa70102860 0x7ffa70078c40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffa64000c00 tx=0x7ffa64009250 comp rx=0 tx=0).stop 2024-04-12T09:02:03.074 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.400+0000 7ffa7721f700 1 -- 172.21.15.117:0/2340402216 shutdown_connections 2024-04-12T09:02:03.074 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.400+0000 7ffa7721f700 1 --2- 172.21.15.117:0/2340402216 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7ffa60036830 0x7ffa60038ce0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:03.074 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.400+0000 7ffa7721f700 1 --2- 172.21.15.117:0/2340402216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa70102860 0x7ffa70078c40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:03.074 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.400+0000 7ffa7721f700 1 -- 172.21.15.117:0/2340402216 >> 172.21.15.117:0/2340402216 conn(0x7ffa700fe000 msgr2=0x7ffa700feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:03.074 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.400+0000 7ffa7721f700 1 -- 172.21.15.117:0/2340402216 shutdown_connections 2024-04-12T09:02:03.074 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:02.400+0000 7ffa7721f700 1 -- 172.21.15.117:0/2340402216 wait complete. 2024-04-12T09:02:03.074 INFO:teuthology.orchestra.run.smithi117.stdout:Deploying crash service with default placement... 2024-04-12T09:02:03.617 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:03 smithi117 ceph-mon[29277]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:02:03.617 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:03 smithi117 ceph-mon[29277]: Saving service mgr spec with placement count:2 2024-04-12T09:02:03.617 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:03 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:04.371 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-04-12T09:02:04.371 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.446+0000 7f695f9a5700 1 Processor -- start 2024-04-12T09:02:04.371 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.446+0000 7f695f9a5700 1 -- start start 2024-04-12T09:02:04.371 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.446+0000 7f695f9a5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6958078c50 0x7f6958077250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:04.371 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.446+0000 7f695f9a5700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6958079060 con 0x7f6958078c50 2024-04-12T09:02:04.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.446+0000 7f695d741700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6958078c50 0x7f6958077250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:04.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.446+0000 7f695d741700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6958078c50 0x7f6958077250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40364/0 (socket says 172.21.15.117:40364) 2024-04-12T09:02:04.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.446+0000 7f695d741700 1 -- 172.21.15.117:0/3911502952 learned_addr learned my addr 172.21.15.117:0/3911502952 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:04.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.446+0000 7f695d741700 1 -- 172.21.15.117:0/3911502952 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6958077790 con 0x7f6958078c50 2024-04-12T09:02:04.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.447+0000 7f695d741700 1 --2- 172.21.15.117:0/3911502952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6958078c50 0x7f6958077250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f69540098e0 tx=0x7f6954009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5fdd94ea19757c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:04.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.447+0000 7f694ffff700 1 -- 172.21.15.117:0/3911502952 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f695400b860 con 0x7f6958078c50 2024-04-12T09:02:04.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.447+0000 7f694ffff700 1 -- 172.21.15.117:0/3911502952 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f695400be50 con 0x7f6958078c50 2024-04-12T09:02:04.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.447+0000 7f694ffff700 1 -- 172.21.15.117:0/3911502952 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6954010380 con 0x7f6958078c50 2024-04-12T09:02:04.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.447+0000 7f695f9a5700 1 -- 172.21.15.117:0/3911502952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6958078c50 msgr2=0x7f6958077250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:04.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.447+0000 7f695f9a5700 1 --2- 172.21.15.117:0/3911502952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6958078c50 0x7f6958077250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f69540098e0 tx=0x7f6954009250 comp rx=0 tx=0).stop 2024-04-12T09:02:04.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.447+0000 7f695f9a5700 1 -- 172.21.15.117:0/3911502952 shutdown_connections 2024-04-12T09:02:04.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.447+0000 7f695f9a5700 1 --2- 172.21.15.117:0/3911502952 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6958078c50 0x7f6958077250 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:04.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.447+0000 7f695f9a5700 1 -- 172.21.15.117:0/3911502952 >> 172.21.15.117:0/3911502952 conn(0x7f69580fe070 msgr2=0x7f6958100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:04.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.448+0000 7f695f9a5700 1 -- 172.21.15.117:0/3911502952 shutdown_connections 2024-04-12T09:02:04.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.448+0000 7f695f9a5700 1 -- 172.21.15.117:0/3911502952 wait complete. 2024-04-12T09:02:04.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.448+0000 7f695f9a5700 1 Processor -- start 2024-04-12T09:02:04.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.448+0000 7f695f9a5700 1 -- start start 2024-04-12T09:02:04.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.448+0000 7f695f9a5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6958078c50 0x7f69581139b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:04.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.448+0000 7f695f9a5700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6958113ef0 con 0x7f6958078c50 2024-04-12T09:02:04.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.448+0000 7f695d741700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6958078c50 0x7f69581139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:04.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.448+0000 7f695d741700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6958078c50 0x7f69581139b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40376/0 (socket says 172.21.15.117:40376) 2024-04-12T09:02:04.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.448+0000 7f695d741700 1 -- 172.21.15.117:0/1298039735 learned_addr learned my addr 172.21.15.117:0/1298039735 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:04.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.449+0000 7f695d741700 1 -- 172.21.15.117:0/1298039735 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69540094f0 con 0x7f6958078c50 2024-04-12T09:02:04.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.449+0000 7f695d741700 1 --2- 172.21.15.117:0/1298039735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6958078c50 0x7f69581139b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6954006fd0 tx=0x7f6954009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:04.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.449+0000 7f694dffb700 1 -- 172.21.15.117:0/1298039735 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6954010760 con 0x7f6958078c50 2024-04-12T09:02:04.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.449+0000 7f694dffb700 1 -- 172.21.15.117:0/1298039735 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f6954010d50 con 0x7f6958078c50 2024-04-12T09:02:04.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.449+0000 7f695f9a5700 1 -- 172.21.15.117:0/1298039735 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69581140f0 con 0x7f6958078c50 2024-04-12T09:02:04.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.449+0000 7f694dffb700 1 -- 172.21.15.117:0/1298039735 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f695401adc0 con 0x7f6958078c50 2024-04-12T09:02:04.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.449+0000 7f695f9a5700 1 -- 172.21.15.117:0/1298039735 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6958114c60 con 0x7f6958078c50 2024-04-12T09:02:04.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.450+0000 7f694dffb700 1 -- 172.21.15.117:0/1298039735 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f69540193c0 con 0x7f6958078c50 2024-04-12T09:02:04.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.450+0000 7f695f9a5700 1 -- 172.21.15.117:0/1298039735 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695805f5f0 con 0x7f6958078c50 2024-04-12T09:02:04.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.450+0000 7f694dffb700 1 --2- 172.21.15.117:0/1298039735 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f69440367e0 0x7f6944038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:04.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.450+0000 7f694dffb700 1 -- 172.21.15.117:0/1298039735 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6954049e70 con 0x7f6958078c50 2024-04-12T09:02:04.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.450+0000 7f695cf40700 1 --2- 172.21.15.117:0/1298039735 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f69440367e0 0x7f6944038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:04.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.451+0000 7f695cf40700 1 --2- 172.21.15.117:0/1298039735 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f69440367e0 0x7f6944038c90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6948009990 tx=0x7f6948006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:04.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.455+0000 7f694dffb700 1 -- 172.21.15.117:0/1298039735 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f6954023940 con 0x7f6958078c50 2024-04-12T09:02:04.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.653+0000 7f695f9a5700 1 -- 172.21.15.117:0/1298039735 --> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f69580ff4e0 con 0x7f69440367e0 2024-04-12T09:02:04.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.660+0000 7f694dffb700 1 -- 172.21.15.117:0/1298039735 <== mgr.14120 v2:172.21.15.117:6800/791370182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f69580ff4e0 con 0x7f69440367e0 2024-04-12T09:02:04.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.661+0000 7f695f9a5700 1 -- 172.21.15.117:0/1298039735 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f69440367e0 msgr2=0x7f6944038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:04.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.662+0000 7f695f9a5700 1 --2- 172.21.15.117:0/1298039735 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f69440367e0 0x7f6944038c90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6948009990 tx=0x7f6948006e40 comp rx=0 tx=0).stop 2024-04-12T09:02:04.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.662+0000 7f695f9a5700 1 -- 172.21.15.117:0/1298039735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6958078c50 msgr2=0x7f69581139b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:04.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.662+0000 7f695f9a5700 1 --2- 172.21.15.117:0/1298039735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6958078c50 0x7f69581139b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6954006fd0 tx=0x7f6954009250 comp rx=0 tx=0).stop 2024-04-12T09:02:04.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.662+0000 7f695f9a5700 1 -- 172.21.15.117:0/1298039735 shutdown_connections 2024-04-12T09:02:04.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.662+0000 7f695f9a5700 1 --2- 172.21.15.117:0/1298039735 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f69440367e0 0x7f6944038c90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:04.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.662+0000 7f695f9a5700 1 --2- 172.21.15.117:0/1298039735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6958078c50 0x7f69581139b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:04.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.662+0000 7f695f9a5700 1 -- 172.21.15.117:0/1298039735 >> 172.21.15.117:0/1298039735 conn(0x7f69580fe070 msgr2=0x7f69580fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:04.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.662+0000 7f695f9a5700 1 -- 172.21.15.117:0/1298039735 shutdown_connections 2024-04-12T09:02:04.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:03.662+0000 7f695f9a5700 1 -- 172.21.15.117:0/1298039735 wait complete. 2024-04-12T09:02:04.375 INFO:teuthology.orchestra.run.smithi117.stdout:Deploying prometheus service with default placement... 2024-04-12T09:02:04.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:04 smithi117 ceph-mon[29277]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:02:04.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:04 smithi117 ceph-mon[29277]: Saving service crash spec with placement * 2024-04-12T09:02:04.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:04 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:06.054 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:05 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:06.054 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:05 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:06.055 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:05 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:06.065 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-04-12T09:02:06.065 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.283+0000 7f9b0e59e700 1 Processor -- start 2024-04-12T09:02:06.066 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.283+0000 7f9b0e59e700 1 -- start start 2024-04-12T09:02:06.066 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.283+0000 7f9b0e59e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b08071230 0x7f9b08107780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:06.066 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.283+0000 7f9b0e59e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b08071640 con 0x7f9b08071230 2024-04-12T09:02:06.066 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.284+0000 7f9b0d59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b08071230 0x7f9b08107780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:06.066 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.284+0000 7f9b0d59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b08071230 0x7f9b08107780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40378/0 (socket says 172.21.15.117:40378) 2024-04-12T09:02:06.066 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.284+0000 7f9b0d59c700 1 -- 172.21.15.117:0/2206734422 learned_addr learned my addr 172.21.15.117:0/2206734422 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:06.066 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.284+0000 7f9b0d59c700 1 -- 172.21.15.117:0/2206734422 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b08103170 con 0x7f9b08071230 2024-04-12T09:02:06.066 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.284+0000 7f9b0d59c700 1 --2- 172.21.15.117:0/2206734422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b08071230 0x7f9b08107780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9af80098e0 tx=0x7f9af8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb553b27c3ec6581 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:06.066 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.284+0000 7f9afffff700 1 -- 172.21.15.117:0/2206734422 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9af800b860 con 0x7f9b08071230 2024-04-12T09:02:06.066 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.284+0000 7f9afffff700 1 -- 172.21.15.117:0/2206734422 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9af800be90 con 0x7f9b08071230 2024-04-12T09:02:06.066 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.284+0000 7f9afffff700 1 -- 172.21.15.117:0/2206734422 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9af80103c0 con 0x7f9b08071230 2024-04-12T09:02:06.067 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.285+0000 7f9b0e59e700 1 -- 172.21.15.117:0/2206734422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b08071230 msgr2=0x7f9b08107780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:06.067 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.285+0000 7f9b0e59e700 1 --2- 172.21.15.117:0/2206734422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b08071230 0x7f9b08107780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9af80098e0 tx=0x7f9af8009250 comp rx=0 tx=0).stop 2024-04-12T09:02:06.067 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.285+0000 7f9b0e59e700 1 -- 172.21.15.117:0/2206734422 shutdown_connections 2024-04-12T09:02:06.067 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.285+0000 7f9b0e59e700 1 --2- 172.21.15.117:0/2206734422 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b08071230 0x7f9b08107780 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:06.067 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.285+0000 7f9b0e59e700 1 -- 172.21.15.117:0/2206734422 >> 172.21.15.117:0/2206734422 conn(0x7f9b080fcdd0 msgr2=0x7f9b080ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:06.067 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.285+0000 7f9b0e59e700 1 -- 172.21.15.117:0/2206734422 shutdown_connections 2024-04-12T09:02:06.067 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.285+0000 7f9b0e59e700 1 -- 172.21.15.117:0/2206734422 wait complete. 2024-04-12T09:02:06.067 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.286+0000 7f9b0e59e700 1 Processor -- start 2024-04-12T09:02:06.067 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.286+0000 7f9b0e59e700 1 -- start start 2024-04-12T09:02:06.067 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.286+0000 7f9b0e59e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b08071230 0x7f9b08113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:06.067 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.286+0000 7f9b0e59e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b08113c40 con 0x7f9b08071230 2024-04-12T09:02:06.067 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.286+0000 7f9b0d59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b08071230 0x7f9b08113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:06.067 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.286+0000 7f9b0d59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b08071230 0x7f9b08113700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40382/0 (socket says 172.21.15.117:40382) 2024-04-12T09:02:06.068 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.286+0000 7f9b0d59c700 1 -- 172.21.15.117:0/3484339209 learned_addr learned my addr 172.21.15.117:0/3484339209 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:06.068 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.286+0000 7f9b0d59c700 1 -- 172.21.15.117:0/3484339209 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af80094f0 con 0x7f9b08071230 2024-04-12T09:02:06.068 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.286+0000 7f9b0d59c700 1 --2- 172.21.15.117:0/3484339209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b08071230 0x7f9b08113700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9af8006d40 tx=0x7f9af8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:06.068 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.286+0000 7f9afdffb700 1 -- 172.21.15.117:0/3484339209 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9af8010840 con 0x7f9b08071230 2024-04-12T09:02:06.068 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.286+0000 7f9afdffb700 1 -- 172.21.15.117:0/3484339209 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9af8010e70 con 0x7f9b08071230 2024-04-12T09:02:06.068 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.286+0000 7f9afdffb700 1 -- 172.21.15.117:0/3484339209 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9af8024ea0 con 0x7f9b08071230 2024-04-12T09:02:06.068 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.286+0000 7f9b0e59e700 1 -- 172.21.15.117:0/3484339209 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b08113ea0 con 0x7f9b08071230 2024-04-12T09:02:06.068 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.287+0000 7f9b0e59e700 1 -- 172.21.15.117:0/3484339209 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b081149b0 con 0x7f9b08071230 2024-04-12T09:02:06.068 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.288+0000 7f9afdffb700 1 -- 172.21.15.117:0/3484339209 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f9af80109a0 con 0x7f9b08071230 2024-04-12T09:02:06.068 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.288+0000 7f9b0e59e700 1 -- 172.21.15.117:0/3484339209 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b0805f5f0 con 0x7f9b08071230 2024-04-12T09:02:06.068 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.288+0000 7f9afdffb700 1 --2- 172.21.15.117:0/3484339209 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f9af4036720 0x7f9af4038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:06.068 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.288+0000 7f9afdffb700 1 -- 172.21.15.117:0/3484339209 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9af804a6c0 con 0x7f9b08071230 2024-04-12T09:02:06.068 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.288+0000 7f9b0cd9b700 1 --2- 172.21.15.117:0/3484339209 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f9af4036720 0x7f9af4038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:06.068 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.288+0000 7f9b0cd9b700 1 --2- 172.21.15.117:0/3484339209 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f9af4036720 0x7f9af4038bd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9b04009990 tx=0x7f9b04006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:06.069 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.293+0000 7f9afdffb700 1 -- 172.21.15.117:0/3484339209 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f9af8024430 con 0x7f9b08071230 2024-04-12T09:02:06.069 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.510+0000 7f9b0e59e700 1 -- 172.21.15.117:0/3484339209 --> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b080fe150 con 0x7f9af4036720 2024-04-12T09:02:06.069 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.515+0000 7f9afdffb700 1 -- 172.21.15.117:0/3484339209 <== mgr.14120 v2:172.21.15.117:6800/791370182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f9b080fe150 con 0x7f9af4036720 2024-04-12T09:02:06.069 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.517+0000 7f9b0e59e700 1 -- 172.21.15.117:0/3484339209 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f9af4036720 msgr2=0x7f9af4038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:06.069 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.517+0000 7f9b0e59e700 1 --2- 172.21.15.117:0/3484339209 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f9af4036720 0x7f9af4038bd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9b04009990 tx=0x7f9b04006e40 comp rx=0 tx=0).stop 2024-04-12T09:02:06.069 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.517+0000 7f9b0e59e700 1 -- 172.21.15.117:0/3484339209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b08071230 msgr2=0x7f9b08113700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:06.069 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.517+0000 7f9b0e59e700 1 --2- 172.21.15.117:0/3484339209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b08071230 0x7f9b08113700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9af8006d40 tx=0x7f9af8009250 comp rx=0 tx=0).stop 2024-04-12T09:02:06.069 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.517+0000 7f9b0e59e700 1 -- 172.21.15.117:0/3484339209 shutdown_connections 2024-04-12T09:02:06.069 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.517+0000 7f9b0e59e700 1 --2- 172.21.15.117:0/3484339209 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f9af4036720 0x7f9af4038bd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:06.069 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.517+0000 7f9b0e59e700 1 --2- 172.21.15.117:0/3484339209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b08071230 0x7f9b08113700 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:06.069 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.517+0000 7f9b0e59e700 1 -- 172.21.15.117:0/3484339209 >> 172.21.15.117:0/3484339209 conn(0x7f9b080fcdd0 msgr2=0x7f9b080fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:06.069 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.517+0000 7f9b0e59e700 1 -- 172.21.15.117:0/3484339209 shutdown_connections 2024-04-12T09:02:06.069 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:05.517+0000 7f9b0e59e700 1 -- 172.21.15.117:0/3484339209 wait complete. 2024-04-12T09:02:06.069 INFO:teuthology.orchestra.run.smithi117.stdout:Deploying grafana service with default placement... 2024-04-12T09:02:07.060 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:06 smithi117 ceph-mon[29277]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:02:07.060 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:06 smithi117 ceph-mon[29277]: Saving service prometheus spec with placement count:1 2024-04-12T09:02:07.060 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:06 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:07.856 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-04-12T09:02:07.856 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.072+0000 7f40557ba700 1 Processor -- start 2024-04-12T09:02:07.856 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.072+0000 7f40557ba700 1 -- start start 2024-04-12T09:02:07.856 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.072+0000 7f40557ba700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40501028c0 0x7f4050102cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:07.856 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.072+0000 7f40557ba700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4050103210 con 0x7f40501028c0 2024-04-12T09:02:07.856 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.072+0000 7f404effd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40501028c0 0x7f4050102cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:07.857 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.072+0000 7f404effd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40501028c0 0x7f4050102cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40388/0 (socket says 172.21.15.117:40388) 2024-04-12T09:02:07.857 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.072+0000 7f404effd700 1 -- 172.21.15.117:0/4125423315 learned_addr learned my addr 172.21.15.117:0/4125423315 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:07.857 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.072+0000 7f404effd700 1 -- 172.21.15.117:0/4125423315 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4050103350 con 0x7f40501028c0 2024-04-12T09:02:07.857 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.073+0000 7f404effd700 1 --2- 172.21.15.117:0/4125423315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40501028c0 0x7f4050102cd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f40400098e0 tx=0x7f4040009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c727128c911d54 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:07.857 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.073+0000 7f404dffb700 1 -- 172.21.15.117:0/4125423315 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f404000b860 con 0x7f40501028c0 2024-04-12T09:02:07.857 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.073+0000 7f404dffb700 1 -- 172.21.15.117:0/4125423315 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f404000be90 con 0x7f40501028c0 2024-04-12T09:02:07.857 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.073+0000 7f404dffb700 1 -- 172.21.15.117:0/4125423315 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f40400103c0 con 0x7f40501028c0 2024-04-12T09:02:07.857 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.073+0000 7f40557ba700 1 -- 172.21.15.117:0/4125423315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40501028c0 msgr2=0x7f4050102cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:07.857 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.073+0000 7f40557ba700 1 --2- 172.21.15.117:0/4125423315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40501028c0 0x7f4050102cd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f40400098e0 tx=0x7f4040009250 comp rx=0 tx=0).stop 2024-04-12T09:02:07.857 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.073+0000 7f40557ba700 1 -- 172.21.15.117:0/4125423315 shutdown_connections 2024-04-12T09:02:07.857 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.073+0000 7f40557ba700 1 --2- 172.21.15.117:0/4125423315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40501028c0 0x7f4050102cd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:07.857 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.073+0000 7f40557ba700 1 -- 172.21.15.117:0/4125423315 >> 172.21.15.117:0/4125423315 conn(0x7f40500fe080 msgr2=0x7f4050100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:07.858 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.074+0000 7f40557ba700 1 -- 172.21.15.117:0/4125423315 shutdown_connections 2024-04-12T09:02:07.858 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.074+0000 7f40557ba700 1 -- 172.21.15.117:0/4125423315 wait complete. 2024-04-12T09:02:07.858 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.074+0000 7f40557ba700 1 Processor -- start 2024-04-12T09:02:07.858 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.074+0000 7f40557ba700 1 -- start start 2024-04-12T09:02:07.858 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.074+0000 7f40557ba700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40501028c0 0x7f40501116c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:07.858 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.074+0000 7f40557ba700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4050111c00 con 0x7f40501028c0 2024-04-12T09:02:07.858 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.074+0000 7f404effd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40501028c0 0x7f40501116c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:07.858 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.075+0000 7f404effd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40501028c0 0x7f40501116c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40394/0 (socket says 172.21.15.117:40394) 2024-04-12T09:02:07.858 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.075+0000 7f404effd700 1 -- 172.21.15.117:0/2215756234 learned_addr learned my addr 172.21.15.117:0/2215756234 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:07.858 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.075+0000 7f404effd700 1 -- 172.21.15.117:0/2215756234 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40400094f0 con 0x7f40501028c0 2024-04-12T09:02:07.858 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.075+0000 7f404effd700 1 --2- 172.21.15.117:0/2215756234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40501028c0 0x7f40501116c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4040011680 tx=0x7f4040009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:07.858 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.075+0000 7f40377fe700 1 -- 172.21.15.117:0/2215756234 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4040010890 con 0x7f40501028c0 2024-04-12T09:02:07.859 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.075+0000 7f40557ba700 1 -- 172.21.15.117:0/2215756234 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4050111e00 con 0x7f40501028c0 2024-04-12T09:02:07.859 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.075+0000 7f40377fe700 1 -- 172.21.15.117:0/2215756234 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4040010ec0 con 0x7f40501028c0 2024-04-12T09:02:07.859 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.075+0000 7f40377fe700 1 -- 172.21.15.117:0/2215756234 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f40400243f0 con 0x7f40501028c0 2024-04-12T09:02:07.859 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.075+0000 7f40557ba700 1 -- 172.21.15.117:0/2215756234 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4050112970 con 0x7f40501028c0 2024-04-12T09:02:07.859 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.076+0000 7f40377fe700 1 -- 172.21.15.117:0/2215756234 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f404002d3f0 con 0x7f40501028c0 2024-04-12T09:02:07.859 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.076+0000 7f40377fe700 1 --2- 172.21.15.117:0/2215756234 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f40380367e0 0x7f4038038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:07.859 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.076+0000 7f40557ba700 1 -- 172.21.15.117:0/2215756234 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f405005f5f0 con 0x7f40501028c0 2024-04-12T09:02:07.859 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.076+0000 7f40377fe700 1 -- 172.21.15.117:0/2215756234 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f404004a270 con 0x7f40501028c0 2024-04-12T09:02:07.859 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.077+0000 7f404e7fc700 1 --2- 172.21.15.117:0/2215756234 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f40380367e0 0x7f4038038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:07.859 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.077+0000 7f404e7fc700 1 --2- 172.21.15.117:0/2215756234 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f40380367e0 0x7f4038038c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4044009990 tx=0x7f4044006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:07.859 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.081+0000 7f40377fe700 1 -- 172.21.15.117:0/2215756234 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f40400193c0 con 0x7f40501028c0 2024-04-12T09:02:07.860 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.311+0000 7f40557ba700 1 -- 172.21.15.117:0/2215756234 --> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f40500ff340 con 0x7f40380367e0 2024-04-12T09:02:07.860 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.316+0000 7f40377fe700 1 -- 172.21.15.117:0/2215756234 <== mgr.14120 v2:172.21.15.117:6800/791370182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f40500ff340 con 0x7f40380367e0 2024-04-12T09:02:07.860 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.318+0000 7f40557ba700 1 -- 172.21.15.117:0/2215756234 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f40380367e0 msgr2=0x7f4038038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:07.860 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.318+0000 7f40557ba700 1 --2- 172.21.15.117:0/2215756234 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f40380367e0 0x7f4038038c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4044009990 tx=0x7f4044006e40 comp rx=0 tx=0).stop 2024-04-12T09:02:07.860 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.318+0000 7f40557ba700 1 -- 172.21.15.117:0/2215756234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40501028c0 msgr2=0x7f40501116c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:07.860 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.318+0000 7f40557ba700 1 --2- 172.21.15.117:0/2215756234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40501028c0 0x7f40501116c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4040011680 tx=0x7f4040009250 comp rx=0 tx=0).stop 2024-04-12T09:02:07.860 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.318+0000 7f40557ba700 1 -- 172.21.15.117:0/2215756234 shutdown_connections 2024-04-12T09:02:07.860 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.318+0000 7f40557ba700 1 --2- 172.21.15.117:0/2215756234 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f40380367e0 0x7f4038038c90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:07.860 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.318+0000 7f40557ba700 1 --2- 172.21.15.117:0/2215756234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f40501028c0 0x7f40501116c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:07.860 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.318+0000 7f40557ba700 1 -- 172.21.15.117:0/2215756234 >> 172.21.15.117:0/2215756234 conn(0x7f40500fe080 msgr2=0x7f40500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:07.860 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.318+0000 7f40557ba700 1 -- 172.21.15.117:0/2215756234 shutdown_connections 2024-04-12T09:02:07.860 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:07.318+0000 7f40557ba700 1 -- 172.21.15.117:0/2215756234 wait complete. 2024-04-12T09:02:07.860 INFO:teuthology.orchestra.run.smithi117.stdout:Deploying node-exporter service with default placement... 2024-04-12T09:02:08.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:08 smithi117 ceph-mon[29277]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:02:08.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:08 smithi117 ceph-mon[29277]: Saving service grafana spec with placement count:1 2024-04-12T09:02:08.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:08 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:08.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:08 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:09.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:09 smithi117 ceph-mon[29277]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:02:09.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:09 smithi117 ceph-mon[29277]: Saving service node-exporter spec with placement * 2024-04-12T09:02:09.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:09 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:10.062 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-04-12T09:02:10.062 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.254+0000 7efe18795700 1 Processor -- start 2024-04-12T09:02:10.062 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.254+0000 7efe18795700 1 -- start start 2024-04-12T09:02:10.062 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.254+0000 7efe18795700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe10102910 0x7efe10102d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:10.062 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.254+0000 7efe18795700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe10103260 con 0x7efe10102910 2024-04-12T09:02:10.062 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.255+0000 7efe16531700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe10102910 0x7efe10102d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:10.062 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.255+0000 7efe16531700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe10102910 0x7efe10102d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40406/0 (socket says 172.21.15.117:40406) 2024-04-12T09:02:10.063 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.255+0000 7efe16531700 1 -- 172.21.15.117:0/1491996669 learned_addr learned my addr 172.21.15.117:0/1491996669 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:10.063 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.255+0000 7efe16531700 1 -- 172.21.15.117:0/1491996669 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe101033a0 con 0x7efe10102910 2024-04-12T09:02:10.063 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.255+0000 7efe16531700 1 --2- 172.21.15.117:0/1491996669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe10102910 0x7efe10102d20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0098e0 tx=0x7efe0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b979fdb38a18fbd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:10.063 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.255+0000 7efe1552f700 1 -- 172.21.15.117:0/1491996669 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe0c00b860 con 0x7efe10102910 2024-04-12T09:02:10.063 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.255+0000 7efe1552f700 1 -- 172.21.15.117:0/1491996669 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe0c00be90 con 0x7efe10102910 2024-04-12T09:02:10.063 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.255+0000 7efe1552f700 1 -- 172.21.15.117:0/1491996669 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe0c0103c0 con 0x7efe10102910 2024-04-12T09:02:10.063 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.256+0000 7efe18795700 1 -- 172.21.15.117:0/1491996669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe10102910 msgr2=0x7efe10102d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:10.063 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.256+0000 7efe18795700 1 --2- 172.21.15.117:0/1491996669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe10102910 0x7efe10102d20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0098e0 tx=0x7efe0c009250 comp rx=0 tx=0).stop 2024-04-12T09:02:10.063 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.256+0000 7efe18795700 1 -- 172.21.15.117:0/1491996669 shutdown_connections 2024-04-12T09:02:10.063 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.256+0000 7efe18795700 1 --2- 172.21.15.117:0/1491996669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe10102910 0x7efe10102d20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:10.063 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.256+0000 7efe18795700 1 -- 172.21.15.117:0/1491996669 >> 172.21.15.117:0/1491996669 conn(0x7efe100fe070 msgr2=0x7efe101004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:10.063 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.256+0000 7efe18795700 1 -- 172.21.15.117:0/1491996669 shutdown_connections 2024-04-12T09:02:10.063 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.256+0000 7efe18795700 1 -- 172.21.15.117:0/1491996669 wait complete. 2024-04-12T09:02:10.063 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.256+0000 7efe18795700 1 Processor -- start 2024-04-12T09:02:10.064 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.256+0000 7efe18795700 1 -- start start 2024-04-12T09:02:10.064 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.257+0000 7efe18795700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe10102910 0x7efe10111720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:10.064 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.257+0000 7efe18795700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe10111c60 con 0x7efe10102910 2024-04-12T09:02:10.064 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.257+0000 7efe16531700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe10102910 0x7efe10111720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:10.064 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.257+0000 7efe16531700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe10102910 0x7efe10111720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40410/0 (socket says 172.21.15.117:40410) 2024-04-12T09:02:10.064 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.257+0000 7efe16531700 1 -- 172.21.15.117:0/81724697 learned_addr learned my addr 172.21.15.117:0/81724697 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:10.064 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.257+0000 7efe16531700 1 -- 172.21.15.117:0/81724697 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c0094f0 con 0x7efe10102910 2024-04-12T09:02:10.064 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.257+0000 7efe16531700 1 --2- 172.21.15.117:0/81724697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe10102910 0x7efe10111720 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efe0c011680 tx=0x7efe0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:10.064 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.257+0000 7efe06ffd700 1 -- 172.21.15.117:0/81724697 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe0c010890 con 0x7efe10102910 2024-04-12T09:02:10.064 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.257+0000 7efe06ffd700 1 -- 172.21.15.117:0/81724697 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe0c010ec0 con 0x7efe10102910 2024-04-12T09:02:10.064 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.257+0000 7efe18795700 1 -- 172.21.15.117:0/81724697 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe10111e60 con 0x7efe10102910 2024-04-12T09:02:10.064 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.257+0000 7efe06ffd700 1 -- 172.21.15.117:0/81724697 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe0c0243f0 con 0x7efe10102910 2024-04-12T09:02:10.064 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.257+0000 7efe18795700 1 -- 172.21.15.117:0/81724697 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe101129d0 con 0x7efe10102910 2024-04-12T09:02:10.064 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.258+0000 7efe06ffd700 1 -- 172.21.15.117:0/81724697 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7efe0c02d3f0 con 0x7efe10102910 2024-04-12T09:02:10.064 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.258+0000 7efe18795700 1 -- 172.21.15.117:0/81724697 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe1005f5f0 con 0x7efe10102910 2024-04-12T09:02:10.065 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.258+0000 7efe06ffd700 1 --2- 172.21.15.117:0/81724697 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7efdfc036790 0x7efdfc038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:10.065 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.258+0000 7efe06ffd700 1 -- 172.21.15.117:0/81724697 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7efe0c04a4b0 con 0x7efe10102910 2024-04-12T09:02:10.065 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.258+0000 7efe15d30700 1 --2- 172.21.15.117:0/81724697 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7efdfc036790 0x7efdfc038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:10.065 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.259+0000 7efe15d30700 1 --2- 172.21.15.117:0/81724697 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7efdfc036790 0x7efdfc038c40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efe00009990 tx=0x7efe00006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:10.065 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.263+0000 7efe06ffd700 1 -- 172.21.15.117:0/81724697 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7efe0c02b8e0 con 0x7efe10102910 2024-04-12T09:02:10.065 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.463+0000 7efe18795700 1 -- 172.21.15.117:0/81724697 --> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7efe100ff360 con 0x7efdfc036790 2024-04-12T09:02:10.065 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.467+0000 7efe06ffd700 1 -- 172.21.15.117:0/81724697 <== mgr.14120 v2:172.21.15.117:6800/791370182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7efe100ff360 con 0x7efdfc036790 2024-04-12T09:02:10.065 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.469+0000 7efe18795700 1 -- 172.21.15.117:0/81724697 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7efdfc036790 msgr2=0x7efdfc038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:10.065 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.469+0000 7efe18795700 1 --2- 172.21.15.117:0/81724697 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7efdfc036790 0x7efdfc038c40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efe00009990 tx=0x7efe00006e40 comp rx=0 tx=0).stop 2024-04-12T09:02:10.065 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.469+0000 7efe18795700 1 -- 172.21.15.117:0/81724697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe10102910 msgr2=0x7efe10111720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:10.065 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.469+0000 7efe18795700 1 --2- 172.21.15.117:0/81724697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe10102910 0x7efe10111720 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efe0c011680 tx=0x7efe0c009250 comp rx=0 tx=0).stop 2024-04-12T09:02:10.065 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.469+0000 7efe18795700 1 -- 172.21.15.117:0/81724697 shutdown_connections 2024-04-12T09:02:10.065 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.469+0000 7efe18795700 1 --2- 172.21.15.117:0/81724697 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7efdfc036790 0x7efdfc038c40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:10.065 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.469+0000 7efe18795700 1 --2- 172.21.15.117:0/81724697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efe10102910 0x7efe10111720 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:10.066 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.469+0000 7efe18795700 1 -- 172.21.15.117:0/81724697 >> 172.21.15.117:0/81724697 conn(0x7efe100fe070 msgr2=0x7efe100fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:10.066 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.469+0000 7efe18795700 1 -- 172.21.15.117:0/81724697 shutdown_connections 2024-04-12T09:02:10.066 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:08.469+0000 7efe18795700 1 -- 172.21.15.117:0/81724697 wait complete. 2024-04-12T09:02:10.066 INFO:teuthology.orchestra.run.smithi117.stdout:Deploying alertmanager service with default placement... 2024-04-12T09:02:11.215 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-04-12T09:02:11.216 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.507+0000 7f77925ae700 1 Processor -- start 2024-04-12T09:02:11.216 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.507+0000 7f77925ae700 1 -- start start 2024-04-12T09:02:11.216 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.507+0000 7f77925ae700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f778c101db0 0x7f778c1021c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:11.216 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.507+0000 7f77925ae700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c102700 con 0x7f778c101db0 2024-04-12T09:02:11.216 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.507+0000 7f778bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f778c101db0 0x7f778c1021c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:11.216 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.507+0000 7f778bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f778c101db0 0x7f778c1021c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55380/0 (socket says 172.21.15.117:55380) 2024-04-12T09:02:11.216 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.507+0000 7f778bfff700 1 -- 172.21.15.117:0/157932296 learned_addr learned my addr 172.21.15.117:0/157932296 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:11.216 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.507+0000 7f778bfff700 1 -- 172.21.15.117:0/157932296 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778c102840 con 0x7f778c101db0 2024-04-12T09:02:11.216 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.508+0000 7f778bfff700 1 --2- 172.21.15.117:0/157932296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f778c101db0 0x7f778c1021c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f777c0098e0 tx=0x7f777c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2012cadbe33d9a25 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:11.216 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.508+0000 7f778affd700 1 -- 172.21.15.117:0/157932296 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f777c00b860 con 0x7f778c101db0 2024-04-12T09:02:11.216 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.508+0000 7f778affd700 1 -- 172.21.15.117:0/157932296 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f777c00be90 con 0x7f778c101db0 2024-04-12T09:02:11.216 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.508+0000 7f778affd700 1 -- 172.21.15.117:0/157932296 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f777c0103c0 con 0x7f778c101db0 2024-04-12T09:02:11.216 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.508+0000 7f77925ae700 1 -- 172.21.15.117:0/157932296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f778c101db0 msgr2=0x7f778c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:11.216 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.508+0000 7f77925ae700 1 --2- 172.21.15.117:0/157932296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f778c101db0 0x7f778c1021c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f777c0098e0 tx=0x7f777c009250 comp rx=0 tx=0).stop 2024-04-12T09:02:11.216 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.508+0000 7f77925ae700 1 -- 172.21.15.117:0/157932296 shutdown_connections 2024-04-12T09:02:11.217 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.508+0000 7f77925ae700 1 --2- 172.21.15.117:0/157932296 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f778c101db0 0x7f778c1021c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:11.217 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.508+0000 7f77925ae700 1 -- 172.21.15.117:0/157932296 >> 172.21.15.117:0/157932296 conn(0x7f778c0fc6c0 msgr2=0x7f778c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:11.217 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.508+0000 7f77925ae700 1 -- 172.21.15.117:0/157932296 shutdown_connections 2024-04-12T09:02:11.217 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.508+0000 7f77925ae700 1 -- 172.21.15.117:0/157932296 wait complete. 2024-04-12T09:02:11.217 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.509+0000 7f77925ae700 1 Processor -- start 2024-04-12T09:02:11.217 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.509+0000 7f77925ae700 1 -- start start 2024-04-12T09:02:11.217 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.509+0000 7f77925ae700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f778c101db0 0x7f778c1139a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:11.217 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.509+0000 7f77925ae700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c113ee0 con 0x7f778c101db0 2024-04-12T09:02:11.217 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.509+0000 7f778bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f778c101db0 0x7f778c1139a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:11.217 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.509+0000 7f778bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f778c101db0 0x7f778c1139a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55388/0 (socket says 172.21.15.117:55388) 2024-04-12T09:02:11.217 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.509+0000 7f778bfff700 1 -- 172.21.15.117:0/1248143634 learned_addr learned my addr 172.21.15.117:0/1248143634 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:11.217 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.510+0000 7f778bfff700 1 -- 172.21.15.117:0/1248143634 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777c0094f0 con 0x7f778c101db0 2024-04-12T09:02:11.217 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.510+0000 7f778bfff700 1 --2- 172.21.15.117:0/1248143634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f778c101db0 0x7f778c1139a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f777c006b00 tx=0x7f777c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:11.217 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.510+0000 7f7788ff9700 1 -- 172.21.15.117:0/1248143634 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f777c010840 con 0x7f778c101db0 2024-04-12T09:02:11.217 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.510+0000 7f7788ff9700 1 -- 172.21.15.117:0/1248143634 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f777c010e70 con 0x7f778c101db0 2024-04-12T09:02:11.217 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.510+0000 7f77925ae700 1 -- 172.21.15.117:0/1248143634 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f778c1140e0 con 0x7f778c101db0 2024-04-12T09:02:11.218 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.510+0000 7f7788ff9700 1 -- 172.21.15.117:0/1248143634 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f777c01ae70 con 0x7f778c101db0 2024-04-12T09:02:11.218 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.510+0000 7f77925ae700 1 -- 172.21.15.117:0/1248143634 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f778c114c50 con 0x7f778c101db0 2024-04-12T09:02:11.218 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.511+0000 7f7788ff9700 1 -- 172.21.15.117:0/1248143634 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f777c0244d0 con 0x7f778c101db0 2024-04-12T09:02:11.218 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.511+0000 7f77925ae700 1 -- 172.21.15.117:0/1248143634 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f778c05f5f0 con 0x7f778c101db0 2024-04-12T09:02:11.218 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.511+0000 7f7788ff9700 1 --2- 172.21.15.117:0/1248143634 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f7774036790 0x7f7774038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:11.218 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.511+0000 7f7788ff9700 1 -- 172.21.15.117:0/1248143634 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f777c04abe0 con 0x7f778c101db0 2024-04-12T09:02:11.218 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.511+0000 7f778b7fe700 1 --2- 172.21.15.117:0/1248143634 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f7774036790 0x7f7774038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:11.218 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.512+0000 7f778b7fe700 1 --2- 172.21.15.117:0/1248143634 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f7774036790 0x7f7774038c40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7780009990 tx=0x7f7780006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:11.218 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.516+0000 7f7788ff9700 1 -- 172.21.15.117:0/1248143634 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f777c02e440 con 0x7f778c101db0 2024-04-12T09:02:11.218 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.711+0000 7f77925ae700 1 -- 172.21.15.117:0/1248143634 --> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f778c1157d0 con 0x7f7774036790 2024-04-12T09:02:11.218 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.718+0000 7f7788ff9700 1 -- 172.21.15.117:0/1248143634 <== mgr.14120 v2:172.21.15.117:6800/791370182 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f778c1157d0 con 0x7f7774036790 2024-04-12T09:02:11.218 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.720+0000 7f77925ae700 1 -- 172.21.15.117:0/1248143634 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f7774036790 msgr2=0x7f7774038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:11.218 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.720+0000 7f77925ae700 1 --2- 172.21.15.117:0/1248143634 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f7774036790 0x7f7774038c40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7780009990 tx=0x7f7780006e40 comp rx=0 tx=0).stop 2024-04-12T09:02:11.218 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.720+0000 7f77925ae700 1 -- 172.21.15.117:0/1248143634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f778c101db0 msgr2=0x7f778c1139a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:11.218 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.720+0000 7f77925ae700 1 --2- 172.21.15.117:0/1248143634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f778c101db0 0x7f778c1139a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f777c006b00 tx=0x7f777c009250 comp rx=0 tx=0).stop 2024-04-12T09:02:11.219 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.720+0000 7f77925ae700 1 -- 172.21.15.117:0/1248143634 shutdown_connections 2024-04-12T09:02:11.219 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.720+0000 7f77925ae700 1 --2- 172.21.15.117:0/1248143634 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f7774036790 0x7f7774038c40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:11.219 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.720+0000 7f77925ae700 1 --2- 172.21.15.117:0/1248143634 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f778c101db0 0x7f778c1139a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:11.219 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.720+0000 7f77925ae700 1 -- 172.21.15.117:0/1248143634 >> 172.21.15.117:0/1248143634 conn(0x7f778c0fc6c0 msgr2=0x7f778c0fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:11.219 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.720+0000 7f77925ae700 1 -- 172.21.15.117:0/1248143634 shutdown_connections 2024-04-12T09:02:11.219 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:10.720+0000 7f77925ae700 1 -- 172.21.15.117:0/1248143634 wait complete. 2024-04-12T09:02:11.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:11 smithi117 ceph-mon[29277]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:02:11.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:11 smithi117 ceph-mon[29277]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:02:11.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:11 smithi117 ceph-mon[29277]: Saving service alertmanager spec with placement count:1 2024-04-12T09:02:11.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:11 smithi117 ceph-mon[29277]: from='mgr.14120 172.21.15.117:0/3982324790' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:12.438 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.641+0000 7fa93aac4700 1 Processor -- start 2024-04-12T09:02:12.438 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.641+0000 7fa93aac4700 1 -- start start 2024-04-12T09:02:12.438 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.641+0000 7fa93aac4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9341017a0 0x7fa934101bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:12.439 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.641+0000 7fa93aac4700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9341020f0 con 0x7fa9341017a0 2024-04-12T09:02:12.439 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.641+0000 7fa938860700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9341017a0 0x7fa934101bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:12.439 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.641+0000 7fa938860700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9341017a0 0x7fa934101bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55396/0 (socket says 172.21.15.117:55396) 2024-04-12T09:02:12.439 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.641+0000 7fa938860700 1 -- 172.21.15.117:0/4087267165 learned_addr learned my addr 172.21.15.117:0/4087267165 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:12.439 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.641+0000 7fa938860700 1 -- 172.21.15.117:0/4087267165 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa934102230 con 0x7fa9341017a0 2024-04-12T09:02:12.439 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.641+0000 7fa938860700 1 --2- 172.21.15.117:0/4087267165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9341017a0 0x7fa934101bb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa92800bb80 tx=0x7fa92800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0c05e2627e520c server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:12.439 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.642+0000 7fa9337fe700 1 -- 172.21.15.117:0/4087267165 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa92800dd00 con 0x7fa9341017a0 2024-04-12T09:02:12.439 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.642+0000 7fa9337fe700 1 -- 172.21.15.117:0/4087267165 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa92800de60 con 0x7fa9341017a0 2024-04-12T09:02:12.439 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.642+0000 7fa9337fe700 1 -- 172.21.15.117:0/4087267165 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa928018920 con 0x7fa9341017a0 2024-04-12T09:02:12.439 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.642+0000 7fa93aac4700 1 -- 172.21.15.117:0/4087267165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9341017a0 msgr2=0x7fa934101bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:12.439 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.642+0000 7fa93aac4700 1 --2- 172.21.15.117:0/4087267165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9341017a0 0x7fa934101bb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa92800bb80 tx=0x7fa92800b4f0 comp rx=0 tx=0).stop 2024-04-12T09:02:12.439 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.642+0000 7fa93aac4700 1 -- 172.21.15.117:0/4087267165 shutdown_connections 2024-04-12T09:02:12.439 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.642+0000 7fa93aac4700 1 --2- 172.21.15.117:0/4087267165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9341017a0 0x7fa934101bb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:12.439 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.642+0000 7fa93aac4700 1 -- 172.21.15.117:0/4087267165 >> 172.21.15.117:0/4087267165 conn(0x7fa9340fcf40 msgr2=0x7fa9340ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:12.439 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.642+0000 7fa93aac4700 1 -- 172.21.15.117:0/4087267165 shutdown_connections 2024-04-12T09:02:12.439 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.642+0000 7fa93aac4700 1 -- 172.21.15.117:0/4087267165 wait complete. 2024-04-12T09:02:12.440 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.643+0000 7fa93aac4700 1 Processor -- start 2024-04-12T09:02:12.440 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.643+0000 7fa93aac4700 1 -- start start 2024-04-12T09:02:12.440 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.643+0000 7fa93aac4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9341017a0 0x7fa9341138c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:12.440 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.643+0000 7fa93aac4700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa934113e00 con 0x7fa9341017a0 2024-04-12T09:02:12.440 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.643+0000 7fa938860700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9341017a0 0x7fa9341138c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:12.440 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.643+0000 7fa938860700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9341017a0 0x7fa9341138c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55400/0 (socket says 172.21.15.117:55400) 2024-04-12T09:02:12.440 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.643+0000 7fa938860700 1 -- 172.21.15.117:0/2329125874 learned_addr learned my addr 172.21.15.117:0/2329125874 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:12.440 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.643+0000 7fa938860700 1 -- 172.21.15.117:0/2329125874 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92800b790 con 0x7fa9341017a0 2024-04-12T09:02:12.440 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.644+0000 7fa938860700 1 --2- 172.21.15.117:0/2329125874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9341017a0 0x7fa9341138c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa9280106a0 tx=0x7fa92800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:12.440 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.644+0000 7fa9317fa700 1 -- 172.21.15.117:0/2329125874 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa928018e90 con 0x7fa9341017a0 2024-04-12T09:02:12.440 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.644+0000 7fa9317fa700 1 -- 172.21.15.117:0/2329125874 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa928010c30 con 0x7fa9341017a0 2024-04-12T09:02:12.440 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.644+0000 7fa93aac4700 1 -- 172.21.15.117:0/2329125874 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa934114000 con 0x7fa9341017a0 2024-04-12T09:02:12.440 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.644+0000 7fa9317fa700 1 -- 172.21.15.117:0/2329125874 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa928021530 con 0x7fa9341017a0 2024-04-12T09:02:12.440 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.644+0000 7fa93aac4700 1 -- 172.21.15.117:0/2329125874 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa934114b20 con 0x7fa9341017a0 2024-04-12T09:02:12.440 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.645+0000 7fa9317fa700 1 -- 172.21.15.117:0/2329125874 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fa928021720 con 0x7fa9341017a0 2024-04-12T09:02:12.440 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.645+0000 7fa93aac4700 1 -- 172.21.15.117:0/2329125874 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa93405f5f0 con 0x7fa9341017a0 2024-04-12T09:02:12.441 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.645+0000 7fa9317fa700 1 --2- 172.21.15.117:0/2329125874 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fa924036790 0x7fa924038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:12.441 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.645+0000 7fa9317fa700 1 -- 172.21.15.117:0/2329125874 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa928014070 con 0x7fa9341017a0 2024-04-12T09:02:12.441 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.645+0000 7fa933fff700 1 --2- 172.21.15.117:0/2329125874 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fa924036790 0x7fa924038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:12.441 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.645+0000 7fa933fff700 1 --2- 172.21.15.117:0/2329125874 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fa924036790 0x7fa924038c40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa920009990 tx=0x7fa920006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:12.441 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.650+0000 7fa9317fa700 1 -- 172.21.15.117:0/2329125874 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fa92801fd10 con 0x7fa9341017a0 2024-04-12T09:02:12.441 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.854+0000 7fa93aac4700 1 -- 172.21.15.117:0/2329125874 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fa93404bed0 con 0x7fa9341017a0 2024-04-12T09:02:12.441 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.857+0000 7fa9317fa700 1 -- 172.21.15.117:0/2329125874 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fa928026020 con 0x7fa9341017a0 2024-04-12T09:02:12.441 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.859+0000 7fa93aac4700 1 -- 172.21.15.117:0/2329125874 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fa924036790 msgr2=0x7fa924038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:12.441 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.859+0000 7fa93aac4700 1 --2- 172.21.15.117:0/2329125874 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fa924036790 0x7fa924038c40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa920009990 tx=0x7fa920006e40 comp rx=0 tx=0).stop 2024-04-12T09:02:12.441 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.860+0000 7fa93aac4700 1 -- 172.21.15.117:0/2329125874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9341017a0 msgr2=0x7fa9341138c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:12.441 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.860+0000 7fa93aac4700 1 --2- 172.21.15.117:0/2329125874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9341017a0 0x7fa9341138c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa9280106a0 tx=0x7fa92800b4f0 comp rx=0 tx=0).stop 2024-04-12T09:02:12.441 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.860+0000 7fa93aac4700 1 -- 172.21.15.117:0/2329125874 shutdown_connections 2024-04-12T09:02:12.441 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.860+0000 7fa93aac4700 1 --2- 172.21.15.117:0/2329125874 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7fa924036790 0x7fa924038c40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:12.441 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.860+0000 7fa93aac4700 1 --2- 172.21.15.117:0/2329125874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9341017a0 0x7fa9341138c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:12.441 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.860+0000 7fa93aac4700 1 -- 172.21.15.117:0/2329125874 >> 172.21.15.117:0/2329125874 conn(0x7fa9340fcf40 msgr2=0x7fa934105c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:12.441 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.860+0000 7fa93aac4700 1 -- 172.21.15.117:0/2329125874 shutdown_connections 2024-04-12T09:02:12.442 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:11.860+0000 7fa93aac4700 1 -- 172.21.15.117:0/2329125874 wait complete. 2024-04-12T09:02:13.058 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:12 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/2329125874' entity='client.admin' 2024-04-12T09:02:13.579 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.863+0000 7f5d2b9b8700 1 Processor -- start 2024-04-12T09:02:13.594 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.863+0000 7f5d2b9b8700 1 -- start start 2024-04-12T09:02:13.594 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.863+0000 7f5d2b9b8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d24076ba0 0x7f5d241078f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:13.594 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.863+0000 7f5d2b9b8700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d241032e0 con 0x7f5d24076ba0 2024-04-12T09:02:13.594 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.863+0000 7f5d29754700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d24076ba0 0x7f5d241078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:13.594 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.863+0000 7f5d29754700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d24076ba0 0x7f5d241078f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55402/0 (socket says 172.21.15.117:55402) 2024-04-12T09:02:13.594 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.863+0000 7f5d29754700 1 -- 172.21.15.117:0/4151258491 learned_addr learned my addr 172.21.15.117:0/4151258491 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:13.594 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.864+0000 7f5d29754700 1 -- 172.21.15.117:0/4151258491 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d24107e30 con 0x7f5d24076ba0 2024-04-12T09:02:13.594 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.864+0000 7f5d29754700 1 --2- 172.21.15.117:0/4151258491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d24076ba0 0x7f5d241078f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009e50 tx=0x7f5d1c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8a4c08d8e66cd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:13.594 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.864+0000 7f5d1bfff700 1 -- 172.21.15.117:0/4151258491 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d1c0092e0 con 0x7f5d24076ba0 2024-04-12T09:02:13.594 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.864+0000 7f5d1bfff700 1 -- 172.21.15.117:0/4151258491 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d1c012430 con 0x7f5d24076ba0 2024-04-12T09:02:13.595 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.864+0000 7f5d1bfff700 1 -- 172.21.15.117:0/4151258491 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d1c0075a0 con 0x7f5d24076ba0 2024-04-12T09:02:13.595 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.864+0000 7f5d2b9b8700 1 -- 172.21.15.117:0/4151258491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d24076ba0 msgr2=0x7f5d241078f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:13.595 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.864+0000 7f5d2b9b8700 1 --2- 172.21.15.117:0/4151258491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d24076ba0 0x7f5d241078f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009e50 tx=0x7f5d1c009840 comp rx=0 tx=0).stop 2024-04-12T09:02:13.595 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.865+0000 7f5d2b9b8700 1 -- 172.21.15.117:0/4151258491 shutdown_connections 2024-04-12T09:02:13.595 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.865+0000 7f5d2b9b8700 1 --2- 172.21.15.117:0/4151258491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d24076ba0 0x7f5d241078f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:13.595 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.865+0000 7f5d2b9b8700 1 -- 172.21.15.117:0/4151258491 >> 172.21.15.117:0/4151258491 conn(0x7f5d240fcf40 msgr2=0x7f5d240ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:13.595 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.865+0000 7f5d2b9b8700 1 -- 172.21.15.117:0/4151258491 shutdown_connections 2024-04-12T09:02:13.595 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.865+0000 7f5d2b9b8700 1 -- 172.21.15.117:0/4151258491 wait complete. 2024-04-12T09:02:13.595 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.865+0000 7f5d2b9b8700 1 Processor -- start 2024-04-12T09:02:13.595 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.865+0000 7f5d2b9b8700 1 -- start start 2024-04-12T09:02:13.595 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.865+0000 7f5d2b9b8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d24076ba0 0x7f5d24113940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:13.595 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.865+0000 7f5d2b9b8700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d24113e80 con 0x7f5d24076ba0 2024-04-12T09:02:13.595 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.865+0000 7f5d29754700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d24076ba0 0x7f5d24113940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:13.595 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.865+0000 7f5d29754700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d24076ba0 0x7f5d24113940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55410/0 (socket says 172.21.15.117:55410) 2024-04-12T09:02:13.595 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.865+0000 7f5d29754700 1 -- 172.21.15.117:0/634074398 learned_addr learned my addr 172.21.15.117:0/634074398 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:13.596 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.866+0000 7f5d29754700 1 -- 172.21.15.117:0/634074398 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c009ae0 con 0x7f5d24076ba0 2024-04-12T09:02:13.596 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.866+0000 7f5d29754700 1 --2- 172.21.15.117:0/634074398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d24076ba0 0x7f5d24113940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009fd0 tx=0x7f5d1c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:13.596 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.866+0000 7f5d19ffb700 1 -- 172.21.15.117:0/634074398 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d1c0092e0 con 0x7f5d24076ba0 2024-04-12T09:02:13.596 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.866+0000 7f5d2b9b8700 1 -- 172.21.15.117:0/634074398 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d24114080 con 0x7f5d24076ba0 2024-04-12T09:02:13.596 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.866+0000 7f5d19ffb700 1 -- 172.21.15.117:0/634074398 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d1c007ce0 con 0x7f5d24076ba0 2024-04-12T09:02:13.596 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.866+0000 7f5d19ffb700 1 -- 172.21.15.117:0/634074398 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d1c0259c0 con 0x7f5d24076ba0 2024-04-12T09:02:13.596 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.866+0000 7f5d2b9b8700 1 -- 172.21.15.117:0/634074398 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d24114bf0 con 0x7f5d24076ba0 2024-04-12T09:02:13.596 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.867+0000 7f5d19ffb700 1 -- 172.21.15.117:0/634074398 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f5d1c019050 con 0x7f5d24076ba0 2024-04-12T09:02:13.596 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.867+0000 7f5d2b9b8700 1 -- 172.21.15.117:0/634074398 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d2405f5f0 con 0x7f5d24076ba0 2024-04-12T09:02:13.596 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.867+0000 7f5d19ffb700 1 --2- 172.21.15.117:0/634074398 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f5d100367e0 0x7f5d10038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:13.596 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.867+0000 7f5d19ffb700 1 -- 172.21.15.117:0/634074398 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f5d1c04a1f0 con 0x7f5d24076ba0 2024-04-12T09:02:13.596 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.867+0000 7f5d28f53700 1 --2- 172.21.15.117:0/634074398 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f5d100367e0 0x7f5d10038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:13.596 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.868+0000 7f5d28f53700 1 --2- 172.21.15.117:0/634074398 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f5d100367e0 0x7f5d10038c90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5d14009990 tx=0x7f5d14006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:13.597 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:12.872+0000 7f5d19ffb700 1 -- 172.21.15.117:0/634074398 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f5d1c02d9a0 con 0x7f5d24076ba0 2024-04-12T09:02:13.597 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.057+0000 7f5d2b9b8700 1 -- 172.21.15.117:0/634074398 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f5d2404bed0 con 0x7f5d24076ba0 2024-04-12T09:02:13.597 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.061+0000 7f5d19ffb700 1 -- 172.21.15.117:0/634074398 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f5d1c017030 con 0x7f5d24076ba0 2024-04-12T09:02:13.597 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.063+0000 7f5d2b9b8700 1 -- 172.21.15.117:0/634074398 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f5d100367e0 msgr2=0x7f5d10038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:13.597 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.063+0000 7f5d2b9b8700 1 --2- 172.21.15.117:0/634074398 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f5d100367e0 0x7f5d10038c90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5d14009990 tx=0x7f5d14006e40 comp rx=0 tx=0).stop 2024-04-12T09:02:13.597 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.063+0000 7f5d2b9b8700 1 -- 172.21.15.117:0/634074398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d24076ba0 msgr2=0x7f5d24113940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:13.597 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.063+0000 7f5d2b9b8700 1 --2- 172.21.15.117:0/634074398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d24076ba0 0x7f5d24113940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009fd0 tx=0x7f5d1c009840 comp rx=0 tx=0).stop 2024-04-12T09:02:13.597 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.063+0000 7f5d2b9b8700 1 -- 172.21.15.117:0/634074398 shutdown_connections 2024-04-12T09:02:13.597 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.063+0000 7f5d2b9b8700 1 --2- 172.21.15.117:0/634074398 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f5d100367e0 0x7f5d10038c90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:13.597 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.063+0000 7f5d2b9b8700 1 --2- 172.21.15.117:0/634074398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5d24076ba0 0x7f5d24113940 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009fd0 tx=0x7f5d1c009840 comp rx=0 tx=0).stop 2024-04-12T09:02:13.597 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.063+0000 7f5d2b9b8700 1 -- 172.21.15.117:0/634074398 >> 172.21.15.117:0/634074398 conn(0x7f5d240fcf40 msgr2=0x7f5d240fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:13.597 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.063+0000 7f5d2b9b8700 1 -- 172.21.15.117:0/634074398 shutdown_connections 2024-04-12T09:02:13.597 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.064+0000 7f5d2b9b8700 1 -- 172.21.15.117:0/634074398 wait complete. 2024-04-12T09:02:13.597 INFO:teuthology.orchestra.run.smithi117.stdout:Enabling the dashboard module... 2024-04-12T09:02:13.982 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:13 smithi117 ceph-mon[29277]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:02:13.982 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:13 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/634074398' entity='client.admin' 2024-04-12T09:02:15.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:14 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/558953421' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-12T09:02:15.467 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.995+0000 7eff517c0700 1 Processor -- start 2024-04-12T09:02:15.468 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.995+0000 7eff517c0700 1 -- start start 2024-04-12T09:02:15.468 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.995+0000 7eff517c0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff4c076bc0 0x7eff4c1054d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:15.468 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.995+0000 7eff517c0700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c105a10 con 0x7eff4c076bc0 2024-04-12T09:02:15.468 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.995+0000 7eff4affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff4c076bc0 0x7eff4c1054d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:15.468 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.995+0000 7eff4affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff4c076bc0 0x7eff4c1054d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55412/0 (socket says 172.21.15.117:55412) 2024-04-12T09:02:15.468 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.995+0000 7eff4affd700 1 -- 172.21.15.117:0/3035164739 learned_addr learned my addr 172.21.15.117:0/3035164739 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:15.468 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.995+0000 7eff4affd700 1 -- 172.21.15.117:0/3035164739 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c105b50 con 0x7eff4c076bc0 2024-04-12T09:02:15.468 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.996+0000 7eff4affd700 1 --2- 172.21.15.117:0/3035164739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff4c076bc0 0x7eff4c1054d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0098e0 tx=0x7eff3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d34a6a982b1d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:15.468 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.996+0000 7eff49ffb700 1 -- 172.21.15.117:0/3035164739 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff3c00b860 con 0x7eff4c076bc0 2024-04-12T09:02:15.468 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.996+0000 7eff49ffb700 1 -- 172.21.15.117:0/3035164739 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff3c00be90 con 0x7eff4c076bc0 2024-04-12T09:02:15.468 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.996+0000 7eff49ffb700 1 -- 172.21.15.117:0/3035164739 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff3c0103c0 con 0x7eff4c076bc0 2024-04-12T09:02:15.468 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.996+0000 7eff517c0700 1 -- 172.21.15.117:0/3035164739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff4c076bc0 msgr2=0x7eff4c1054d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:15.469 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.996+0000 7eff517c0700 1 --2- 172.21.15.117:0/3035164739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff4c076bc0 0x7eff4c1054d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0098e0 tx=0x7eff3c009250 comp rx=0 tx=0).stop 2024-04-12T09:02:15.469 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.996+0000 7eff517c0700 1 -- 172.21.15.117:0/3035164739 shutdown_connections 2024-04-12T09:02:15.469 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.996+0000 7eff517c0700 1 --2- 172.21.15.117:0/3035164739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff4c076bc0 0x7eff4c1054d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:15.469 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.996+0000 7eff517c0700 1 -- 172.21.15.117:0/3035164739 >> 172.21.15.117:0/3035164739 conn(0x7eff4c0fcf40 msgr2=0x7eff4c0ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:15.469 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.996+0000 7eff517c0700 1 -- 172.21.15.117:0/3035164739 shutdown_connections 2024-04-12T09:02:15.469 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.996+0000 7eff517c0700 1 -- 172.21.15.117:0/3035164739 wait complete. 2024-04-12T09:02:15.469 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.997+0000 7eff517c0700 1 Processor -- start 2024-04-12T09:02:15.469 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.997+0000 7eff517c0700 1 -- start start 2024-04-12T09:02:15.469 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.997+0000 7eff517c0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff4c076bc0 0x7eff4c111700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:15.469 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.997+0000 7eff517c0700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c111c40 con 0x7eff4c076bc0 2024-04-12T09:02:15.469 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.997+0000 7eff4affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff4c076bc0 0x7eff4c111700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:15.469 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.997+0000 7eff4affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff4c076bc0 0x7eff4c111700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55414/0 (socket says 172.21.15.117:55414) 2024-04-12T09:02:15.469 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.997+0000 7eff4affd700 1 -- 172.21.15.117:0/558953421 learned_addr learned my addr 172.21.15.117:0/558953421 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:15.469 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.997+0000 7eff4affd700 1 -- 172.21.15.117:0/558953421 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c0094f0 con 0x7eff4c076bc0 2024-04-12T09:02:15.469 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.998+0000 7eff4affd700 1 --2- 172.21.15.117:0/558953421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff4c076bc0 0x7eff4c111700 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0094c0 tx=0x7eff3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:15.470 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.998+0000 7eff337fe700 1 -- 172.21.15.117:0/558953421 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff3c010890 con 0x7eff4c076bc0 2024-04-12T09:02:15.470 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.998+0000 7eff337fe700 1 -- 172.21.15.117:0/558953421 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff3c010ec0 con 0x7eff4c076bc0 2024-04-12T09:02:15.470 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.998+0000 7eff517c0700 1 -- 172.21.15.117:0/558953421 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff4c111e40 con 0x7eff4c076bc0 2024-04-12T09:02:15.470 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.998+0000 7eff337fe700 1 -- 172.21.15.117:0/558953421 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff3c0243f0 con 0x7eff4c076bc0 2024-04-12T09:02:15.470 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.998+0000 7eff517c0700 1 -- 172.21.15.117:0/558953421 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff4c1129b0 con 0x7eff4c076bc0 2024-04-12T09:02:15.470 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.999+0000 7eff337fe700 1 -- 172.21.15.117:0/558953421 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7eff3c02d3f0 con 0x7eff4c076bc0 2024-04-12T09:02:15.470 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.999+0000 7eff517c0700 1 -- 172.21.15.117:0/558953421 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff4c05f5f0 con 0x7eff4c076bc0 2024-04-12T09:02:15.470 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.999+0000 7eff337fe700 1 --2- 172.21.15.117:0/558953421 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7eff34036790 0x7eff34038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:15.470 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.999+0000 7eff337fe700 1 -- 172.21.15.117:0/558953421 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7eff3c04a570 con 0x7eff4c076bc0 2024-04-12T09:02:15.470 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.999+0000 7eff4a7fc700 1 --2- 172.21.15.117:0/558953421 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7eff34036790 0x7eff34038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:15.470 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:13.999+0000 7eff4a7fc700 1 --2- 172.21.15.117:0/558953421 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7eff34036790 0x7eff34038c40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7eff40009990 tx=0x7eff40006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:15.471 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:14.004+0000 7eff337fe700 1 -- 172.21.15.117:0/558953421 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7eff3c02b8e0 con 0x7eff4c076bc0 2024-04-12T09:02:15.471 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:14.243+0000 7eff517c0700 1 -- 172.21.15.117:0/558953421 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7eff4c04bed0 con 0x7eff4c076bc0 2024-04-12T09:02:15.471 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:14.864+0000 7eff337fe700 1 -- 172.21.15.117:0/558953421 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mgrmap(e 9) v1 ==== 43381+0+0 (secure 0 0 0) 0x7eff3c01a7e0 con 0x7eff4c076bc0 2024-04-12T09:02:15.471 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:14.866+0000 7eff337fe700 1 -- 172.21.15.117:0/558953421 <== mon.0 v2:172.21.15.117:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7eff3c02d7b0 con 0x7eff4c076bc0 2024-04-12T09:02:15.471 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:14.869+0000 7eff517c0700 1 -- 172.21.15.117:0/558953421 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7eff34036790 msgr2=0x7eff34038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:15.471 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:14.869+0000 7eff517c0700 1 --2- 172.21.15.117:0/558953421 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7eff34036790 0x7eff34038c40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7eff40009990 tx=0x7eff40006e40 comp rx=0 tx=0).stop 2024-04-12T09:02:15.471 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:14.869+0000 7eff517c0700 1 -- 172.21.15.117:0/558953421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff4c076bc0 msgr2=0x7eff4c111700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:15.471 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:14.869+0000 7eff517c0700 1 --2- 172.21.15.117:0/558953421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff4c076bc0 0x7eff4c111700 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0094c0 tx=0x7eff3c009250 comp rx=0 tx=0).stop 2024-04-12T09:02:15.471 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:14.869+0000 7eff517c0700 1 -- 172.21.15.117:0/558953421 shutdown_connections 2024-04-12T09:02:15.471 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:14.869+0000 7eff517c0700 1 --2- 172.21.15.117:0/558953421 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7eff34036790 0x7eff34038c40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:15.471 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:14.869+0000 7eff517c0700 1 --2- 172.21.15.117:0/558953421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff4c076bc0 0x7eff4c111700 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:15.471 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:14.869+0000 7eff517c0700 1 -- 172.21.15.117:0/558953421 >> 172.21.15.117:0/558953421 conn(0x7eff4c0fcf40 msgr2=0x7eff4c0fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:15.471 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:14.869+0000 7eff517c0700 1 -- 172.21.15.117:0/558953421 shutdown_connections 2024-04-12T09:02:15.471 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:14.869+0000 7eff517c0700 1 -- 172.21.15.117:0/558953421 wait complete. 2024-04-12T09:02:16.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:15 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/558953421' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-12T09:02:16.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:15 smithi117 ceph-mon[29277]: mgrmap e9: smithi117.oyaxql(active, since 24s) 2024-04-12T09:02:16.683 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout { 2024-04-12T09:02:16.683 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-12T09:02:16.683 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-12T09:02:16.684 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "active_name": "smithi117.oyaxql", 2024-04-12T09:02:16.684 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-12T09:02:16.684 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout } 2024-04-12T09:02:16.684 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.858+0000 7ff1e4e3f700 1 Processor -- start 2024-04-12T09:02:16.684 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.858+0000 7ff1e4e3f700 1 -- start start 2024-04-12T09:02:16.684 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.858+0000 7ff1e4e3f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1e0101830 0x7ff1e0101c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:16.684 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.858+0000 7ff1e4e3f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e0102180 con 0x7ff1e0101830 2024-04-12T09:02:16.684 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.858+0000 7ff1de59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1e0101830 0x7ff1e0101c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:16.684 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.858+0000 7ff1de59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1e0101830 0x7ff1e0101c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55428/0 (socket says 172.21.15.117:55428) 2024-04-12T09:02:16.684 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.858+0000 7ff1de59c700 1 -- 172.21.15.117:0/1714378216 learned_addr learned my addr 172.21.15.117:0/1714378216 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:16.685 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.858+0000 7ff1de59c700 1 -- 172.21.15.117:0/1714378216 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e01022c0 con 0x7ff1e0101830 2024-04-12T09:02:16.685 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.859+0000 7ff1de59c700 1 --2- 172.21.15.117:0/1714378216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1e0101830 0x7ff1e0101c40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff1d00098e0 tx=0x7ff1d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0719dbbe49232a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:16.685 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.859+0000 7ff1dd59a700 1 -- 172.21.15.117:0/1714378216 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1d000b860 con 0x7ff1e0101830 2024-04-12T09:02:16.685 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.859+0000 7ff1dd59a700 1 -- 172.21.15.117:0/1714378216 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff1d000be90 con 0x7ff1e0101830 2024-04-12T09:02:16.685 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.859+0000 7ff1dd59a700 1 -- 172.21.15.117:0/1714378216 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1d00103c0 con 0x7ff1e0101830 2024-04-12T09:02:16.685 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.859+0000 7ff1e4e3f700 1 -- 172.21.15.117:0/1714378216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1e0101830 msgr2=0x7ff1e0101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:16.685 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.859+0000 7ff1e4e3f700 1 --2- 172.21.15.117:0/1714378216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1e0101830 0x7ff1e0101c40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff1d00098e0 tx=0x7ff1d0009250 comp rx=0 tx=0).stop 2024-04-12T09:02:16.685 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.859+0000 7ff1e4e3f700 1 -- 172.21.15.117:0/1714378216 shutdown_connections 2024-04-12T09:02:16.685 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.859+0000 7ff1e4e3f700 1 --2- 172.21.15.117:0/1714378216 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1e0101830 0x7ff1e0101c40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:16.685 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.859+0000 7ff1e4e3f700 1 -- 172.21.15.117:0/1714378216 >> 172.21.15.117:0/1714378216 conn(0x7ff1e00fcfb0 msgr2=0x7ff1e00ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:16.685 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.859+0000 7ff1e4e3f700 1 -- 172.21.15.117:0/1714378216 shutdown_connections 2024-04-12T09:02:16.686 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.859+0000 7ff1e4e3f700 1 -- 172.21.15.117:0/1714378216 wait complete. 2024-04-12T09:02:16.686 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.860+0000 7ff1e4e3f700 1 Processor -- start 2024-04-12T09:02:16.686 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.860+0000 7ff1e4e3f700 1 -- start start 2024-04-12T09:02:16.686 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.860+0000 7ff1e4e3f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1e0101830 0x7ff1e0110640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:16.686 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.860+0000 7ff1e4e3f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e0110b80 con 0x7ff1e0101830 2024-04-12T09:02:16.686 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.860+0000 7ff1de59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1e0101830 0x7ff1e0110640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:16.686 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.861+0000 7ff1de59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1e0101830 0x7ff1e0110640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55436/0 (socket says 172.21.15.117:55436) 2024-04-12T09:02:16.686 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.861+0000 7ff1de59c700 1 -- 172.21.15.117:0/2143210809 learned_addr learned my addr 172.21.15.117:0/2143210809 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:16.686 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.861+0000 7ff1de59c700 1 -- 172.21.15.117:0/2143210809 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d00094f0 con 0x7ff1e0101830 2024-04-12T09:02:16.686 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.861+0000 7ff1de59c700 1 --2- 172.21.15.117:0/2143210809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1e0101830 0x7ff1e0110640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0011c10 tx=0x7ff1d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:16.686 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.861+0000 7ff1ceffd700 1 -- 172.21.15.117:0/2143210809 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1d0010890 con 0x7ff1e0101830 2024-04-12T09:02:16.686 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.861+0000 7ff1e4e3f700 1 -- 172.21.15.117:0/2143210809 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e0110d80 con 0x7ff1e0101830 2024-04-12T09:02:16.686 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.861+0000 7ff1ceffd700 1 -- 172.21.15.117:0/2143210809 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff1d0010ec0 con 0x7ff1e0101830 2024-04-12T09:02:16.687 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.861+0000 7ff1ceffd700 1 -- 172.21.15.117:0/2143210809 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1d00243f0 con 0x7ff1e0101830 2024-04-12T09:02:16.687 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.861+0000 7ff1e4e3f700 1 -- 172.21.15.117:0/2143210809 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e01118f0 con 0x7ff1e0101830 2024-04-12T09:02:16.687 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.862+0000 7ff1ceffd700 1 -- 172.21.15.117:0/2143210809 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 9) v1 ==== 43381+0+0 (secure 0 0 0) 0x7ff1d002d3f0 con 0x7ff1e0101830 2024-04-12T09:02:16.687 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.862+0000 7ff1e4e3f700 1 -- 172.21.15.117:0/2143210809 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e005f5f0 con 0x7ff1e0101830 2024-04-12T09:02:16.687 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.862+0000 7ff1ceffd700 1 --2- 172.21.15.117:0/2143210809 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7ff1c8036830 0x7ff1c8038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:16.687 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.862+0000 7ff1ceffd700 1 -- 172.21.15.117:0/2143210809 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff1d004a400 con 0x7ff1e0101830 2024-04-12T09:02:16.687 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.862+0000 7ff1ddd9b700 1 -- 172.21.15.117:0/2143210809 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7ff1c8036830 msgr2=0x7ff1c8038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:6800/791370182 2024-04-12T09:02:16.687 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.862+0000 7ff1ddd9b700 1 --2- 172.21.15.117:0/2143210809 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7ff1c8036830 0x7ff1c8038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T09:02:16.687 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:15.867+0000 7ff1ceffd700 1 -- 172.21.15.117:0/2143210809 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7ff1d002b8b0 con 0x7ff1e0101830 2024-04-12T09:02:16.687 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:16.063+0000 7ff1ddd9b700 1 -- 172.21.15.117:0/2143210809 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7ff1c8036830 msgr2=0x7ff1c8038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:6800/791370182 2024-04-12T09:02:16.687 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:16.063+0000 7ff1ddd9b700 1 --2- 172.21.15.117:0/2143210809 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7ff1c8036830 0x7ff1c8038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T09:02:16.687 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:16.111+0000 7ff1e4e3f700 1 -- 172.21.15.117:0/2143210809 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7ff1e0111c90 con 0x7ff1e0101830 2024-04-12T09:02:16.687 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:16.111+0000 7ff1ceffd700 1 -- 172.21.15.117:0/2143210809 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7ff1d002b2f0 con 0x7ff1e0101830 2024-04-12T09:02:16.688 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:16.113+0000 7ff1e4e3f700 1 -- 172.21.15.117:0/2143210809 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7ff1c8036830 msgr2=0x7ff1c8038ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T09:02:16.688 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:16.113+0000 7ff1e4e3f700 1 --2- 172.21.15.117:0/2143210809 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7ff1c8036830 0x7ff1c8038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:16.688 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:16.113+0000 7ff1e4e3f700 1 -- 172.21.15.117:0/2143210809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1e0101830 msgr2=0x7ff1e0110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:16.688 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:16.113+0000 7ff1e4e3f700 1 --2- 172.21.15.117:0/2143210809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1e0101830 0x7ff1e0110640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0011c10 tx=0x7ff1d0009250 comp rx=0 tx=0).stop 2024-04-12T09:02:16.688 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:16.113+0000 7ff1e4e3f700 1 -- 172.21.15.117:0/2143210809 shutdown_connections 2024-04-12T09:02:16.688 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:16.113+0000 7ff1e4e3f700 1 --2- 172.21.15.117:0/2143210809 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7ff1c8036830 0x7ff1c8038ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:16.688 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:16.113+0000 7ff1e4e3f700 1 --2- 172.21.15.117:0/2143210809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1e0101830 0x7ff1e0110640 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:16.688 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:16.113+0000 7ff1e4e3f700 1 -- 172.21.15.117:0/2143210809 >> 172.21.15.117:0/2143210809 conn(0x7ff1e00fcfb0 msgr2=0x7ff1e00fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:16.688 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:16.113+0000 7ff1e4e3f700 1 -- 172.21.15.117:0/2143210809 shutdown_connections 2024-04-12T09:02:16.688 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:16.114+0000 7ff1e4e3f700 1 -- 172.21.15.117:0/2143210809 wait complete. 2024-04-12T09:02:16.688 INFO:teuthology.orchestra.run.smithi117.stdout:Waiting for the mgr to restart... 2024-04-12T09:02:16.688 INFO:teuthology.orchestra.run.smithi117.stdout:Waiting for mgr epoch 9... 2024-04-12T09:02:16.995 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:16 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/2143210809' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-12T09:02:21.533 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:21 smithi117 ceph-mon[29277]: Active manager daemon smithi117.oyaxql restarted 2024-04-12T09:02:21.533 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:21 smithi117 ceph-mon[29277]: Activating manager daemon smithi117.oyaxql 2024-04-12T09:02:21.534 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:21 smithi117 ceph-mon[29277]: osdmap e3: 0 total, 0 up, 0 in 2024-04-12T09:02:21.534 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:21 smithi117 ceph-mon[29277]: mgrmap e10: smithi117.oyaxql(active, starting, since 0.0030342s) 2024-04-12T09:02:21.534 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:21 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-04-12T09:02:21.534 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:21 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr metadata", "who": "smithi117.oyaxql", "id": "smithi117.oyaxql"}]: dispatch 2024-04-12T09:02:21.534 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:21 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-12T09:02:21.534 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:21 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-12T09:02:21.534 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:21 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-12T09:02:21.534 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:21 smithi117 ceph-mon[29277]: Manager daemon smithi117.oyaxql is now available 2024-04-12T09:02:21.534 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:21 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:02:21.534 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:21 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:02:21.534 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:21 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.oyaxql/mirror_snapshot_schedule"}]: dispatch 2024-04-12T09:02:21.534 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:21 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.oyaxql/trash_purge_schedule"}]: dispatch 2024-04-12T09:02:23.136 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout { 2024-04-12T09:02:23.137 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-12T09:02:23.137 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-12T09:02:23.137 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout } 2024-04-12T09:02:23.137 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.207+0000 7f054cf87700 1 Processor -- start 2024-04-12T09:02:23.137 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.207+0000 7f054cf87700 1 -- start start 2024-04-12T09:02:23.137 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.207+0000 7f054cf87700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0548101860 0x7f0548101c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:23.137 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.207+0000 7f054cf87700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05481021b0 con 0x7f0548101860 2024-04-12T09:02:23.137 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.208+0000 7f054659c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0548101860 0x7f0548101c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:23.137 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.208+0000 7f054659c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0548101860 0x7f0548101c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55440/0 (socket says 172.21.15.117:55440) 2024-04-12T09:02:23.137 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.208+0000 7f054659c700 1 -- 172.21.15.117:0/644083868 learned_addr learned my addr 172.21.15.117:0/644083868 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:23.137 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.208+0000 7f054659c700 1 -- 172.21.15.117:0/644083868 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05481022f0 con 0x7f0548101860 2024-04-12T09:02:23.137 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.208+0000 7f054659c700 1 --2- 172.21.15.117:0/644083868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0548101860 0x7f0548101c70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f05380098e0 tx=0x7f0538009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412b19a0649391b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:23.138 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.208+0000 7f054559a700 1 -- 172.21.15.117:0/644083868 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f053800b8f0 con 0x7f0548101860 2024-04-12T09:02:23.138 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.208+0000 7f054559a700 1 -- 172.21.15.117:0/644083868 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0538011420 con 0x7f0548101860 2024-04-12T09:02:23.138 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.208+0000 7f054559a700 1 -- 172.21.15.117:0/644083868 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0538010540 con 0x7f0548101860 2024-04-12T09:02:23.138 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.209+0000 7f054cf87700 1 -- 172.21.15.117:0/644083868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0548101860 msgr2=0x7f0548101c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:23.138 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.209+0000 7f054cf87700 1 --2- 172.21.15.117:0/644083868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0548101860 0x7f0548101c70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f05380098e0 tx=0x7f0538009250 comp rx=0 tx=0).stop 2024-04-12T09:02:23.138 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.209+0000 7f054cf87700 1 -- 172.21.15.117:0/644083868 shutdown_connections 2024-04-12T09:02:23.138 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.209+0000 7f054cf87700 1 --2- 172.21.15.117:0/644083868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0548101860 0x7f0548101c70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:23.138 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.209+0000 7f054cf87700 1 -- 172.21.15.117:0/644083868 >> 172.21.15.117:0/644083868 conn(0x7f05480fcfa0 msgr2=0x7f05480ff3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:23.138 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.209+0000 7f054cf87700 1 -- 172.21.15.117:0/644083868 shutdown_connections 2024-04-12T09:02:23.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.209+0000 7f054cf87700 1 -- 172.21.15.117:0/644083868 wait complete. 2024-04-12T09:02:23.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.209+0000 7f054cf87700 1 Processor -- start 2024-04-12T09:02:23.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.210+0000 7f054cf87700 1 -- start start 2024-04-12T09:02:23.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.210+0000 7f054cf87700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0548101860 0x7f05481079f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:23.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.210+0000 7f054cf87700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0548107f30 con 0x7f0548101860 2024-04-12T09:02:23.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.210+0000 7f054659c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0548101860 0x7f05481079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:23.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.210+0000 7f054659c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0548101860 0x7f05481079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55446/0 (socket says 172.21.15.117:55446) 2024-04-12T09:02:23.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.210+0000 7f054659c700 1 -- 172.21.15.117:0/2291647070 learned_addr learned my addr 172.21.15.117:0/2291647070 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:23.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.210+0000 7f054659c700 1 -- 172.21.15.117:0/2291647070 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05380094f0 con 0x7f0548101860 2024-04-12T09:02:23.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.210+0000 7f054659c700 1 --2- 172.21.15.117:0/2291647070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0548101860 0x7f05481079f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0538006b00 tx=0x7f0538009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:23.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.210+0000 7f0536ffd700 1 -- 172.21.15.117:0/2291647070 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0538010800 con 0x7f0548101860 2024-04-12T09:02:23.139 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.210+0000 7f0536ffd700 1 -- 172.21.15.117:0/2291647070 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0538010e30 con 0x7f0548101860 2024-04-12T09:02:23.140 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.210+0000 7f054cf87700 1 -- 172.21.15.117:0/2291647070 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0548105fa0 con 0x7f0548101860 2024-04-12T09:02:23.140 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.210+0000 7f0536ffd700 1 -- 172.21.15.117:0/2291647070 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f053801ae40 con 0x7f0548101860 2024-04-12T09:02:23.140 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.210+0000 7f054cf87700 1 -- 172.21.15.117:0/2291647070 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0548106490 con 0x7f0548101860 2024-04-12T09:02:23.140 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.211+0000 7f0536ffd700 1 -- 172.21.15.117:0/2291647070 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 9) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f0538024450 con 0x7f0548101860 2024-04-12T09:02:23.140 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.211+0000 7f0536ffd700 1 --2- 172.21.15.117:0/2291647070 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f0530036770 0x7f0530038c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:23.140 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.211+0000 7f0536ffd700 1 -- 172.21.15.117:0/2291647070 --> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0530039330 con 0x7f0530036770 2024-04-12T09:02:23.140 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.212+0000 7f0536ffd700 1 -- 172.21.15.117:0/2291647070 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f053804a7c0 con 0x7f0548101860 2024-04-12T09:02:23.140 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.212+0000 7f0545d9b700 1 -- 172.21.15.117:0/2291647070 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f0530036770 msgr2=0x7f0530038c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:6800/791370182 2024-04-12T09:02:23.140 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.212+0000 7f0545d9b700 1 --2- 172.21.15.117:0/2291647070 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f0530036770 0x7f0530038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T09:02:23.140 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.413+0000 7f0545d9b700 1 -- 172.21.15.117:0/2291647070 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f0530036770 msgr2=0x7f0530038c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:6800/791370182 2024-04-12T09:02:23.140 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.413+0000 7f0545d9b700 1 --2- 172.21.15.117:0/2291647070 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f0530036770 0x7f0530038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T09:02:23.140 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.814+0000 7f0545d9b700 1 -- 172.21.15.117:0/2291647070 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f0530036770 msgr2=0x7f0530038c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:6800/791370182 2024-04-12T09:02:23.141 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:17.814+0000 7f0545d9b700 1 --2- 172.21.15.117:0/2291647070 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f0530036770 0x7f0530038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T09:02:23.141 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:18.615+0000 7f0545d9b700 1 -- 172.21.15.117:0/2291647070 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f0530036770 msgr2=0x7f0530038c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:6800/791370182 2024-04-12T09:02:23.141 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:18.615+0000 7f0545d9b700 1 --2- 172.21.15.117:0/2291647070 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f0530036770 0x7f0530038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T09:02:23.141 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:20.216+0000 7f0545d9b700 1 -- 172.21.15.117:0/2291647070 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f0530036770 msgr2=0x7f0530038c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:6800/791370182 2024-04-12T09:02:23.141 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:20.216+0000 7f0545d9b700 1 --2- 172.21.15.117:0/2291647070 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f0530036770 0x7f0530038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-12T09:02:23.141 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:21.423+0000 7f0536ffd700 1 -- 172.21.15.117:0/2291647070 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mgrmap(e 10) v1 ==== 43148+0+0 (secure 0 0 0) 0x7f053801a6f0 con 0x7f0548101860 2024-04-12T09:02:23.141 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:21.423+0000 7f0536ffd700 1 -- 172.21.15.117:0/2291647070 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f0530036770 msgr2=0x7f0530038c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T09:02:23.141 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:21.423+0000 7f0536ffd700 1 --2- 172.21.15.117:0/2291647070 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f0530036770 0x7f0530038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:23.141 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:22.425+0000 7f0536ffd700 1 -- 172.21.15.117:0/2291647070 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mgrmap(e 11) v1 ==== 43275+0+0 (secure 0 0 0) 0x7f0538017ca0 con 0x7f0548101860 2024-04-12T09:02:23.141 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:22.425+0000 7f0536ffd700 1 --2- 172.21.15.117:0/2291647070 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f053003a000 0x7f053003c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:23.141 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:22.425+0000 7f0536ffd700 1 -- 172.21.15.117:0/2291647070 --> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0530039330 con 0x7f053003a000 2024-04-12T09:02:23.141 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:22.426+0000 7f0545d9b700 1 --2- 172.21.15.117:0/2291647070 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f053003a000 0x7f053003c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:23.141 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:22.426+0000 7f0545d9b700 1 --2- 172.21.15.117:0/2291647070 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f053003a000 0x7f053003c3e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f053c0039d0 tx=0x7f053c0092f0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:23.142 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:22.427+0000 7f0536ffd700 1 -- 172.21.15.117:0/2291647070 <== mgr.14162 v2:172.21.15.117:6800/790148838 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f0530039330 con 0x7f053003a000 2024-04-12T09:02:23.142 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:22.432+0000 7f054cf87700 1 -- 172.21.15.117:0/2291647070 --> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f054804bed0 con 0x7f053003a000 2024-04-12T09:02:23.142 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:22.433+0000 7f0536ffd700 1 -- 172.21.15.117:0/2291647070 <== mgr.14162 v2:172.21.15.117:6800/790148838 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f054804bed0 con 0x7f053003a000 2024-04-12T09:02:23.142 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:22.433+0000 7f054cf87700 1 -- 172.21.15.117:0/2291647070 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f053003a000 msgr2=0x7f053003c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:23.142 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:22.433+0000 7f054cf87700 1 --2- 172.21.15.117:0/2291647070 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f053003a000 0x7f053003c3e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f053c0039d0 tx=0x7f053c0092f0 comp rx=0 tx=0).stop 2024-04-12T09:02:23.142 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:22.433+0000 7f054cf87700 1 -- 172.21.15.117:0/2291647070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0548101860 msgr2=0x7f05481079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:23.142 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:22.433+0000 7f054cf87700 1 --2- 172.21.15.117:0/2291647070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0548101860 0x7f05481079f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0538006b00 tx=0x7f0538009250 comp rx=0 tx=0).stop 2024-04-12T09:02:23.142 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:22.433+0000 7f054cf87700 1 -- 172.21.15.117:0/2291647070 shutdown_connections 2024-04-12T09:02:23.142 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:22.433+0000 7f054cf87700 1 --2- 172.21.15.117:0/2291647070 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f053003a000 0x7f053003c3e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:23.142 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:22.433+0000 7f054cf87700 1 --2- 172.21.15.117:0/2291647070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0548101860 0x7f05481079f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:23.142 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:22.433+0000 7f054cf87700 1 --2- 172.21.15.117:0/2291647070 >> [v2:172.21.15.117:6800/791370182,v1:172.21.15.117:6801/791370182] conn(0x7f0530036770 0x7f0530038c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:23.142 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:22.433+0000 7f054cf87700 1 -- 172.21.15.117:0/2291647070 >> 172.21.15.117:0/2291647070 conn(0x7f05480fcfa0 msgr2=0x7f05480fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:23.143 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:22.433+0000 7f054cf87700 1 -- 172.21.15.117:0/2291647070 shutdown_connections 2024-04-12T09:02:23.143 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:22.433+0000 7f054cf87700 1 -- 172.21.15.117:0/2291647070 wait complete. 2024-04-12T09:02:23.143 INFO:teuthology.orchestra.run.smithi117.stdout:mgr epoch 9 is available 2024-04-12T09:02:23.143 INFO:teuthology.orchestra.run.smithi117.stdout:Generating a dashboard self-signed certificate... 2024-04-12T09:02:23.382 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:23 smithi117 ceph-mon[29277]: [12/Apr/2024:09:02:22] ENGINE Bus STARTING 2024-04-12T09:02:23.382 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:23 smithi117 ceph-mon[29277]: [12/Apr/2024:09:02:22] ENGINE Serving on https://172.21.15.117:7150 2024-04-12T09:02:23.382 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:23 smithi117 ceph-mon[29277]: [12/Apr/2024:09:02:22] ENGINE Bus STARTED 2024-04-12T09:02:23.382 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:23 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:23.383 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:23 smithi117 ceph-mon[29277]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-12T09:02:23.383 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:23 smithi117 ceph-mon[29277]: mgrmap e11: smithi117.oyaxql(active, since 1.00582s) 2024-04-12T09:02:23.383 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:23 smithi117 ceph-mon[29277]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-12T09:02:23.383 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:23 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:24.542 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-12T09:02:24.542 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.596+0000 7f6009feb700 1 Processor -- start 2024-04-12T09:02:24.542 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.596+0000 7f6009feb700 1 -- start start 2024-04-12T09:02:24.542 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.596+0000 7f6009feb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6004071290 0x7f6004105500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:24.542 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.596+0000 7f6009feb700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60040716a0 con 0x7f6004071290 2024-04-12T09:02:24.542 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.597+0000 7f60037fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6004071290 0x7f6004105500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:24.542 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.597+0000 7f60037fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6004071290 0x7f6004105500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51560/0 (socket says 172.21.15.117:51560) 2024-04-12T09:02:24.542 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.597+0000 7f60037fe700 1 -- 172.21.15.117:0/378663898 learned_addr learned my addr 172.21.15.117:0/378663898 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:24.542 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.597+0000 7f60037fe700 1 -- 172.21.15.117:0/378663898 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6004105a40 con 0x7f6004071290 2024-04-12T09:02:24.543 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.597+0000 7f60037fe700 1 --2- 172.21.15.117:0/378663898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6004071290 0x7f6004105500 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5ff40098e0 tx=0x7f5ff4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33b77a3fd6cea91 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:24.543 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.597+0000 7f60027fc700 1 -- 172.21.15.117:0/378663898 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ff400b860 con 0x7f6004071290 2024-04-12T09:02:24.543 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.597+0000 7f60027fc700 1 -- 172.21.15.117:0/378663898 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ff400be90 con 0x7f6004071290 2024-04-12T09:02:24.543 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.597+0000 7f60027fc700 1 -- 172.21.15.117:0/378663898 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ff40103c0 con 0x7f6004071290 2024-04-12T09:02:24.543 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.598+0000 7f6009feb700 1 -- 172.21.15.117:0/378663898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6004071290 msgr2=0x7f6004105500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:24.543 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.598+0000 7f6009feb700 1 --2- 172.21.15.117:0/378663898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6004071290 0x7f6004105500 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5ff40098e0 tx=0x7f5ff4009250 comp rx=0 tx=0).stop 2024-04-12T09:02:24.543 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.598+0000 7f6009feb700 1 -- 172.21.15.117:0/378663898 shutdown_connections 2024-04-12T09:02:24.543 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.598+0000 7f6009feb700 1 --2- 172.21.15.117:0/378663898 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6004071290 0x7f6004105500 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:24.543 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.598+0000 7f6009feb700 1 -- 172.21.15.117:0/378663898 >> 172.21.15.117:0/378663898 conn(0x7f60040fcfb0 msgr2=0x7f60040ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:24.543 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.598+0000 7f6009feb700 1 -- 172.21.15.117:0/378663898 shutdown_connections 2024-04-12T09:02:24.543 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.598+0000 7f6009feb700 1 -- 172.21.15.117:0/378663898 wait complete. 2024-04-12T09:02:24.543 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.599+0000 7f6009feb700 1 Processor -- start 2024-04-12T09:02:24.544 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.599+0000 7f6009feb700 1 -- start start 2024-04-12T09:02:24.544 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.599+0000 7f6009feb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6004071290 0x7f6004102e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:24.544 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.599+0000 7f6009feb700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6004103390 con 0x7f6004071290 2024-04-12T09:02:24.544 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.599+0000 7f60037fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6004071290 0x7f6004102e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:24.544 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.599+0000 7f60037fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6004071290 0x7f6004102e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51564/0 (socket says 172.21.15.117:51564) 2024-04-12T09:02:24.544 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.599+0000 7f60037fe700 1 -- 172.21.15.117:0/1780367054 learned_addr learned my addr 172.21.15.117:0/1780367054 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:24.544 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.600+0000 7f60037fe700 1 -- 172.21.15.117:0/1780367054 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff40094f0 con 0x7f6004071290 2024-04-12T09:02:24.544 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.600+0000 7f60037fe700 1 --2- 172.21.15.117:0/1780367054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6004071290 0x7f6004102e50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5ff40094c0 tx=0x7f5ff4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:24.544 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.600+0000 7f5febfff700 1 -- 172.21.15.117:0/1780367054 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ff40118f0 con 0x7f6004071290 2024-04-12T09:02:24.544 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.600+0000 7f5febfff700 1 -- 172.21.15.117:0/1780367054 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ff4010d60 con 0x7f6004071290 2024-04-12T09:02:24.544 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.600+0000 7f6009feb700 1 -- 172.21.15.117:0/1780367054 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6004101400 con 0x7f6004071290 2024-04-12T09:02:24.544 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.600+0000 7f5febfff700 1 -- 172.21.15.117:0/1780367054 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ff401a430 con 0x7f6004071290 2024-04-12T09:02:24.544 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.600+0000 7f6009feb700 1 -- 172.21.15.117:0/1780367054 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60041018f0 con 0x7f6004071290 2024-04-12T09:02:24.545 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.601+0000 7f6009feb700 1 -- 172.21.15.117:0/1780367054 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f600404bed0 con 0x7f6004071290 2024-04-12T09:02:24.545 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.601+0000 7f5febfff700 1 -- 172.21.15.117:0/1780367054 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 11) v1 ==== 43275+0+0 (secure 0 0 0) 0x7f5ff401a590 con 0x7f6004071290 2024-04-12T09:02:24.545 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.601+0000 7f5febfff700 1 --2- 172.21.15.117:0/1780367054 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f5fec036710 0x7f5fec038bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:24.545 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.601+0000 7f5febfff700 1 -- 172.21.15.117:0/1780367054 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5ff404a3b0 con 0x7f6004071290 2024-04-12T09:02:24.545 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.602+0000 7f6002ffd700 1 --2- 172.21.15.117:0/1780367054 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f5fec036710 0x7f5fec038bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:24.545 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.602+0000 7f6002ffd700 1 --2- 172.21.15.117:0/1780367054 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f5fec036710 0x7f5fec038bc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8009990 tx=0x7f5ff8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:24.545 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.610+0000 7f5febfff700 1 -- 172.21.15.117:0/1780367054 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f5ff4018db0 con 0x7f6004071290 2024-04-12T09:02:24.545 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.808+0000 7f6009feb700 1 -- 172.21.15.117:0/1780367054 --> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f6004102000 con 0x7f5fec036710 2024-04-12T09:02:24.545 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.894+0000 7f5febfff700 1 -- 172.21.15.117:0/1780367054 <== mgr.14162 v2:172.21.15.117:6800/790148838 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f6004102000 con 0x7f5fec036710 2024-04-12T09:02:24.545 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.896+0000 7f6009feb700 1 -- 172.21.15.117:0/1780367054 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f5fec036710 msgr2=0x7f5fec038bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:24.545 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.896+0000 7f6009feb700 1 --2- 172.21.15.117:0/1780367054 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f5fec036710 0x7f5fec038bc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8009990 tx=0x7f5ff8006e40 comp rx=0 tx=0).stop 2024-04-12T09:02:24.545 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.896+0000 7f6009feb700 1 -- 172.21.15.117:0/1780367054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6004071290 msgr2=0x7f6004102e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:24.545 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.896+0000 7f6009feb700 1 --2- 172.21.15.117:0/1780367054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6004071290 0x7f6004102e50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5ff40094c0 tx=0x7f5ff4009250 comp rx=0 tx=0).stop 2024-04-12T09:02:24.545 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.896+0000 7f6009feb700 1 -- 172.21.15.117:0/1780367054 shutdown_connections 2024-04-12T09:02:24.545 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.896+0000 7f6009feb700 1 --2- 172.21.15.117:0/1780367054 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f5fec036710 0x7f5fec038bc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:24.546 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.896+0000 7f6009feb700 1 --2- 172.21.15.117:0/1780367054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6004071290 0x7f6004102e50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:24.546 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.896+0000 7f6009feb700 1 -- 172.21.15.117:0/1780367054 >> 172.21.15.117:0/1780367054 conn(0x7f60040fcfb0 msgr2=0x7f60040fdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:24.546 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.896+0000 7f6009feb700 1 -- 172.21.15.117:0/1780367054 shutdown_connections 2024-04-12T09:02:24.546 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:23.896+0000 7f6009feb700 1 -- 172.21.15.117:0/1780367054 wait complete. 2024-04-12T09:02:24.546 INFO:teuthology.orchestra.run.smithi117.stdout:Creating initial admin user... 2024-04-12T09:02:25.130 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:24 smithi117 ceph-mon[29277]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:02:25.131 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:24 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:25.131 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:24 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:25.131 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:24 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:25.131 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:24 smithi117 ceph-mon[29277]: mgrmap e12: smithi117.oyaxql(active, since 2s) 2024-04-12T09:02:26.371 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$E6ogrzpONrWAWof0KKpE3uj7n90Qqx8LNKwfZziDJsqrkRkPVXAoS", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1712912545, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-12T09:02:26.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.914+0000 7ff890fe6700 1 Processor -- start 2024-04-12T09:02:26.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.914+0000 7ff890fe6700 1 -- start start 2024-04-12T09:02:26.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.914+0000 7ff890fe6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff88c076ab0 0x7ff88c1055a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:26.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.914+0000 7ff890fe6700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c076ec0 con 0x7ff88c076ab0 2024-04-12T09:02:26.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.915+0000 7ff88a59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff88c076ab0 0x7ff88c1055a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:26.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.915+0000 7ff88a59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff88c076ab0 0x7ff88c1055a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51578/0 (socket says 172.21.15.117:51578) 2024-04-12T09:02:26.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.915+0000 7ff88a59c700 1 -- 172.21.15.117:0/2726398148 learned_addr learned my addr 172.21.15.117:0/2726398148 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:26.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.915+0000 7ff88a59c700 1 -- 172.21.15.117:0/2726398148 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88c105ae0 con 0x7ff88c076ab0 2024-04-12T09:02:26.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.915+0000 7ff88a59c700 1 --2- 172.21.15.117:0/2726398148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff88c076ab0 0x7ff88c1055a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff87c0098e0 tx=0x7ff87c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b008907b47d3df server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:26.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.915+0000 7ff88959a700 1 -- 172.21.15.117:0/2726398148 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff87c00b8f0 con 0x7ff88c076ab0 2024-04-12T09:02:26.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.915+0000 7ff88959a700 1 -- 172.21.15.117:0/2726398148 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff87c011420 con 0x7ff88c076ab0 2024-04-12T09:02:26.372 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.915+0000 7ff88959a700 1 -- 172.21.15.117:0/2726398148 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff87c010540 con 0x7ff88c076ab0 2024-04-12T09:02:26.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.916+0000 7ff890fe6700 1 -- 172.21.15.117:0/2726398148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff88c076ab0 msgr2=0x7ff88c1055a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:26.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.916+0000 7ff890fe6700 1 --2- 172.21.15.117:0/2726398148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff88c076ab0 0x7ff88c1055a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff87c0098e0 tx=0x7ff87c009250 comp rx=0 tx=0).stop 2024-04-12T09:02:26.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.916+0000 7ff890fe6700 1 -- 172.21.15.117:0/2726398148 shutdown_connections 2024-04-12T09:02:26.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.916+0000 7ff890fe6700 1 --2- 172.21.15.117:0/2726398148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff88c076ab0 0x7ff88c1055a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:26.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.916+0000 7ff890fe6700 1 -- 172.21.15.117:0/2726398148 >> 172.21.15.117:0/2726398148 conn(0x7ff88c0fcf70 msgr2=0x7ff88c0ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:26.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.916+0000 7ff890fe6700 1 -- 172.21.15.117:0/2726398148 shutdown_connections 2024-04-12T09:02:26.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.916+0000 7ff890fe6700 1 -- 172.21.15.117:0/2726398148 wait complete. 2024-04-12T09:02:26.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.917+0000 7ff890fe6700 1 Processor -- start 2024-04-12T09:02:26.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.917+0000 7ff890fe6700 1 -- start start 2024-04-12T09:02:26.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.917+0000 7ff890fe6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff88c076ab0 0x7ff88c1116a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:26.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.917+0000 7ff890fe6700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c111be0 con 0x7ff88c076ab0 2024-04-12T09:02:26.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.917+0000 7ff88a59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff88c076ab0 0x7ff88c1116a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:26.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.917+0000 7ff88a59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff88c076ab0 0x7ff88c1116a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51592/0 (socket says 172.21.15.117:51592) 2024-04-12T09:02:26.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.917+0000 7ff88a59c700 1 -- 172.21.15.117:0/14257806 learned_addr learned my addr 172.21.15.117:0/14257806 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:26.373 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.917+0000 7ff88a59c700 1 -- 172.21.15.117:0/14257806 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87c0094f0 con 0x7ff88c076ab0 2024-04-12T09:02:26.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.917+0000 7ff88a59c700 1 --2- 172.21.15.117:0/14257806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff88c076ab0 0x7ff88c1116a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff87c011e90 tx=0x7ff87c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:26.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.918+0000 7ff87affd700 1 -- 172.21.15.117:0/14257806 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff87c00beb0 con 0x7ff88c076ab0 2024-04-12T09:02:26.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.918+0000 7ff890fe6700 1 -- 172.21.15.117:0/14257806 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff88c111de0 con 0x7ff88c076ab0 2024-04-12T09:02:26.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.918+0000 7ff87affd700 1 -- 172.21.15.117:0/14257806 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff87c010c80 con 0x7ff88c076ab0 2024-04-12T09:02:26.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.918+0000 7ff87affd700 1 -- 172.21.15.117:0/14257806 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff87c01ad40 con 0x7ff88c076ab0 2024-04-12T09:02:26.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.918+0000 7ff890fe6700 1 -- 172.21.15.117:0/14257806 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff88c112950 con 0x7ff88c076ab0 2024-04-12T09:02:26.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.918+0000 7ff87affd700 1 -- 172.21.15.117:0/14257806 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 12) v1 ==== 43381+0+0 (secure 0 0 0) 0x7ff87c02d3f0 con 0x7ff88c076ab0 2024-04-12T09:02:26.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.919+0000 7ff87affd700 1 --2- 172.21.15.117:0/14257806 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7ff874036870 0x7ff874038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:26.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.919+0000 7ff87affd700 1 -- 172.21.15.117:0/14257806 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff87c04b550 con 0x7ff88c076ab0 2024-04-12T09:02:26.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.919+0000 7ff889d9b700 1 --2- 172.21.15.117:0/14257806 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7ff874036870 0x7ff874038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:26.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.919+0000 7ff890fe6700 1 -- 172.21.15.117:0/14257806 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff88c05f5f0 con 0x7ff88c076ab0 2024-04-12T09:02:26.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.919+0000 7ff889d9b700 1 --2- 172.21.15.117:0/14257806 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7ff874036870 0x7ff874038d20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff880009990 tx=0x7ff880006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:26.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:24.924+0000 7ff87affd700 1 -- 172.21.15.117:0/14257806 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7ff87c02b8f0 con 0x7ff88c076ab0 2024-04-12T09:02:26.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:25.129+0000 7ff890fe6700 1 -- 172.21.15.117:0/14257806 --> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7ff88c04bed0 con 0x7ff874036870 2024-04-12T09:02:26.374 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:25.354+0000 7ff87affd700 1 -- 172.21.15.117:0/14257806 <== mgr.14162 v2:172.21.15.117:6800/790148838 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7ff88c04bed0 con 0x7ff874036870 2024-04-12T09:02:26.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:25.356+0000 7ff890fe6700 1 -- 172.21.15.117:0/14257806 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7ff874036870 msgr2=0x7ff874038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:26.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:25.356+0000 7ff890fe6700 1 --2- 172.21.15.117:0/14257806 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7ff874036870 0x7ff874038d20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff880009990 tx=0x7ff880006e40 comp rx=0 tx=0).stop 2024-04-12T09:02:26.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:25.356+0000 7ff890fe6700 1 -- 172.21.15.117:0/14257806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff88c076ab0 msgr2=0x7ff88c1116a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:26.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:25.356+0000 7ff890fe6700 1 --2- 172.21.15.117:0/14257806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff88c076ab0 0x7ff88c1116a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff87c011e90 tx=0x7ff87c009250 comp rx=0 tx=0).stop 2024-04-12T09:02:26.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:25.356+0000 7ff890fe6700 1 -- 172.21.15.117:0/14257806 shutdown_connections 2024-04-12T09:02:26.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:25.356+0000 7ff890fe6700 1 --2- 172.21.15.117:0/14257806 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7ff874036870 0x7ff874038d20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:26.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:25.356+0000 7ff890fe6700 1 --2- 172.21.15.117:0/14257806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff88c076ab0 0x7ff88c1116a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:26.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:25.356+0000 7ff890fe6700 1 -- 172.21.15.117:0/14257806 >> 172.21.15.117:0/14257806 conn(0x7ff88c0fcf70 msgr2=0x7ff88c0fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:26.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:25.356+0000 7ff890fe6700 1 -- 172.21.15.117:0/14257806 shutdown_connections 2024-04-12T09:02:26.375 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:25.356+0000 7ff890fe6700 1 -- 172.21.15.117:0/14257806 wait complete. 2024-04-12T09:02:26.375 INFO:teuthology.orchestra.run.smithi117.stdout:Fetching dashboard port number... 2024-04-12T09:02:26.648 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:26 smithi117 ceph-mon[29277]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:02:26.648 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:26 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:27.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:27 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/1905462237' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-12T09:02:27.703 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stdout 8443 2024-04-12T09:02:27.703 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.837+0000 7f662b967700 1 Processor -- start 2024-04-12T09:02:27.703 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.837+0000 7f662b967700 1 -- start start 2024-04-12T09:02:27.703 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.837+0000 7f662b967700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6624102920 0x7f6624102d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:27.703 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.837+0000 7f662b967700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6624103270 con 0x7f6624102920 2024-04-12T09:02:27.703 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.837+0000 7f6629703700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6624102920 0x7f6624102d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:27.703 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.837+0000 7f6629703700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6624102920 0x7f6624102d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51598/0 (socket says 172.21.15.117:51598) 2024-04-12T09:02:27.703 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.837+0000 7f6629703700 1 -- 172.21.15.117:0/3131289917 learned_addr learned my addr 172.21.15.117:0/3131289917 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:27.703 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.837+0000 7f6629703700 1 -- 172.21.15.117:0/3131289917 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66241033b0 con 0x7f6624102920 2024-04-12T09:02:27.703 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.838+0000 7f6629703700 1 --2- 172.21.15.117:0/3131289917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6624102920 0x7f6624102d30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f66200098e0 tx=0x7f6620009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a895ffd37d63db7 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:27.703 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.838+0000 7f661bfff700 1 -- 172.21.15.117:0/3131289917 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f662000b860 con 0x7f6624102920 2024-04-12T09:02:27.704 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.838+0000 7f661bfff700 1 -- 172.21.15.117:0/3131289917 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f662000be90 con 0x7f6624102920 2024-04-12T09:02:27.704 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.838+0000 7f661bfff700 1 -- 172.21.15.117:0/3131289917 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f66200103c0 con 0x7f6624102920 2024-04-12T09:02:27.704 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.838+0000 7f662b967700 1 -- 172.21.15.117:0/3131289917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6624102920 msgr2=0x7f6624102d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:27.704 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.838+0000 7f662b967700 1 --2- 172.21.15.117:0/3131289917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6624102920 0x7f6624102d30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f66200098e0 tx=0x7f6620009250 comp rx=0 tx=0).stop 2024-04-12T09:02:27.704 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.838+0000 7f662b967700 1 -- 172.21.15.117:0/3131289917 shutdown_connections 2024-04-12T09:02:27.704 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.838+0000 7f662b967700 1 --2- 172.21.15.117:0/3131289917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6624102920 0x7f6624102d30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:27.704 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.838+0000 7f662b967700 1 -- 172.21.15.117:0/3131289917 >> 172.21.15.117:0/3131289917 conn(0x7f66240fe0a0 msgr2=0x7f66241004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:27.704 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.838+0000 7f662b967700 1 -- 172.21.15.117:0/3131289917 shutdown_connections 2024-04-12T09:02:27.704 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.838+0000 7f662b967700 1 -- 172.21.15.117:0/3131289917 wait complete. 2024-04-12T09:02:27.704 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.839+0000 7f662b967700 1 Processor -- start 2024-04-12T09:02:27.704 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.839+0000 7f662b967700 1 -- start start 2024-04-12T09:02:27.704 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.839+0000 7f662b967700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6624102920 0x7f6624111700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:27.704 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.839+0000 7f662b967700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6624111c40 con 0x7f6624102920 2024-04-12T09:02:27.704 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.839+0000 7f6629703700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6624102920 0x7f6624111700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:27.704 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.839+0000 7f6629703700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6624102920 0x7f6624111700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51608/0 (socket says 172.21.15.117:51608) 2024-04-12T09:02:27.705 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.839+0000 7f6629703700 1 -- 172.21.15.117:0/1905462237 learned_addr learned my addr 172.21.15.117:0/1905462237 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:27.705 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.839+0000 7f6629703700 1 -- 172.21.15.117:0/1905462237 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66200094f0 con 0x7f6624102920 2024-04-12T09:02:27.705 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.840+0000 7f6629703700 1 --2- 172.21.15.117:0/1905462237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6624102920 0x7f6624111700 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6620011680 tx=0x7f6620009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:27.705 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.840+0000 7f6619ffb700 1 -- 172.21.15.117:0/1905462237 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6620010890 con 0x7f6624102920 2024-04-12T09:02:27.705 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.840+0000 7f6619ffb700 1 -- 172.21.15.117:0/1905462237 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6620010ec0 con 0x7f6624102920 2024-04-12T09:02:27.705 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.840+0000 7f662b967700 1 -- 172.21.15.117:0/1905462237 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6624111e40 con 0x7f6624102920 2024-04-12T09:02:27.705 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.840+0000 7f6619ffb700 1 -- 172.21.15.117:0/1905462237 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f66200243f0 con 0x7f6624102920 2024-04-12T09:02:27.705 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.840+0000 7f662b967700 1 -- 172.21.15.117:0/1905462237 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66241129b0 con 0x7f6624102920 2024-04-12T09:02:27.705 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.841+0000 7f6619ffb700 1 -- 172.21.15.117:0/1905462237 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 12) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f662002d3f0 con 0x7f6624102920 2024-04-12T09:02:27.705 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.841+0000 7f662b967700 1 -- 172.21.15.117:0/1905462237 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f662405f5f0 con 0x7f6624102920 2024-04-12T09:02:27.705 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.841+0000 7f6619ffb700 1 --2- 172.21.15.117:0/1905462237 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f6610036830 0x7f6610038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:27.705 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.841+0000 7f6619ffb700 1 -- 172.21.15.117:0/1905462237 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f662004a320 con 0x7f6624102920 2024-04-12T09:02:27.705 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.841+0000 7f6628f02700 1 --2- 172.21.15.117:0/1905462237 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f6610036830 0x7f6610038ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:27.705 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.841+0000 7f6628f02700 1 --2- 172.21.15.117:0/1905462237 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f6610036830 0x7f6610038ce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6614009990 tx=0x7f6614006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:27.705 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:26.846+0000 7f6619ffb700 1 -- 172.21.15.117:0/1905462237 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f662002b8e0 con 0x7f6624102920 2024-04-12T09:02:27.706 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:27.030+0000 7f662b967700 1 -- 172.21.15.117:0/1905462237 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f662404bed0 con 0x7f6624102920 2024-04-12T09:02:27.706 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:27.031+0000 7f6619ffb700 1 -- 172.21.15.117:0/1905462237 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f6620006d70 con 0x7f6624102920 2024-04-12T09:02:27.706 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:27.033+0000 7f662b967700 1 -- 172.21.15.117:0/1905462237 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f6610036830 msgr2=0x7f6610038ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:27.706 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:27.033+0000 7f662b967700 1 --2- 172.21.15.117:0/1905462237 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f6610036830 0x7f6610038ce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6614009990 tx=0x7f6614006e40 comp rx=0 tx=0).stop 2024-04-12T09:02:27.706 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:27.033+0000 7f662b967700 1 -- 172.21.15.117:0/1905462237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6624102920 msgr2=0x7f6624111700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:27.706 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:27.033+0000 7f662b967700 1 --2- 172.21.15.117:0/1905462237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6624102920 0x7f6624111700 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6620011680 tx=0x7f6620009250 comp rx=0 tx=0).stop 2024-04-12T09:02:27.706 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:27.033+0000 7f662b967700 1 -- 172.21.15.117:0/1905462237 shutdown_connections 2024-04-12T09:02:27.706 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:27.033+0000 7f662b967700 1 --2- 172.21.15.117:0/1905462237 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f6610036830 0x7f6610038ce0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:27.706 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:27.033+0000 7f662b967700 1 --2- 172.21.15.117:0/1905462237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6624102920 0x7f6624111700 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:27.706 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:27.033+0000 7f662b967700 1 -- 172.21.15.117:0/1905462237 >> 172.21.15.117:0/1905462237 conn(0x7f66240fe0a0 msgr2=0x7f66240fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:27.706 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:27.033+0000 7f662b967700 1 -- 172.21.15.117:0/1905462237 shutdown_connections 2024-04-12T09:02:27.706 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:27.033+0000 7f662b967700 1 -- 172.21.15.117:0/1905462237 wait complete. 2024-04-12T09:02:27.712 INFO:teuthology.orchestra.run.smithi117.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-12T09:02:27.712 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl: stdout disabled 2024-04-12T09:02:27.720 INFO:teuthology.orchestra.run.smithi117.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-12T09:02:27.720 INFO:teuthology.orchestra.run.smithi117.stdout:systemctl: stdout inactive 2024-04-12T09:02:27.720 INFO:teuthology.orchestra.run.smithi117.stdout:firewalld.service is not enabled 2024-04-12T09:02:27.720 INFO:teuthology.orchestra.run.smithi117.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-12T09:02:27.722 INFO:teuthology.orchestra.run.smithi117.stdout:Ceph Dashboard is now available at: 2024-04-12T09:02:27.722 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:02:27.722 INFO:teuthology.orchestra.run.smithi117.stdout: URL: https://smithi117.front.sepia.ceph.com:8443/ 2024-04-12T09:02:27.722 INFO:teuthology.orchestra.run.smithi117.stdout: User: admin 2024-04-12T09:02:27.722 INFO:teuthology.orchestra.run.smithi117.stdout: Password: uu5roq2mpg 2024-04-12T09:02:27.722 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:02:27.723 INFO:teuthology.orchestra.run.smithi117.stdout:Saving cluster configuration to /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config directory 2024-04-12T09:02:27.723 INFO:teuthology.orchestra.run.smithi117.stdout:Enabling autotune for osd_memory_target 2024-04-12T09:02:28.933 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.152+0000 7f571c27a700 1 Processor -- start 2024-04-12T09:02:28.933 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.152+0000 7f571c27a700 1 -- start start 2024-04-12T09:02:28.933 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.152+0000 7f571c27a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57141017a0 0x7f5714101bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:28.933 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.152+0000 7f571c27a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57141020f0 con 0x7f57141017a0 2024-04-12T09:02:28.933 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.153+0000 7f571a016700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57141017a0 0x7f5714101bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:28.933 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.153+0000 7f571a016700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57141017a0 0x7f5714101bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51614/0 (socket says 172.21.15.117:51614) 2024-04-12T09:02:28.933 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.153+0000 7f571a016700 1 -- 172.21.15.117:0/1690576768 learned_addr learned my addr 172.21.15.117:0/1690576768 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:28.933 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.153+0000 7f571a016700 1 -- 172.21.15.117:0/1690576768 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5714102230 con 0x7f57141017a0 2024-04-12T09:02:28.934 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.153+0000 7f571a016700 1 --2- 172.21.15.117:0/1690576768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57141017a0 0x7f5714101bb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f57100098e0 tx=0x7f5710009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a281011dfcdf608d server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:28.934 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.153+0000 7f5719014700 1 -- 172.21.15.117:0/1690576768 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f571000b860 con 0x7f57141017a0 2024-04-12T09:02:28.934 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.153+0000 7f5719014700 1 -- 172.21.15.117:0/1690576768 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f571000be90 con 0x7f57141017a0 2024-04-12T09:02:28.934 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.153+0000 7f5719014700 1 -- 172.21.15.117:0/1690576768 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57100103c0 con 0x7f57141017a0 2024-04-12T09:02:28.934 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.154+0000 7f571c27a700 1 -- 172.21.15.117:0/1690576768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57141017a0 msgr2=0x7f5714101bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:28.934 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.154+0000 7f571c27a700 1 --2- 172.21.15.117:0/1690576768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57141017a0 0x7f5714101bb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f57100098e0 tx=0x7f5710009250 comp rx=0 tx=0).stop 2024-04-12T09:02:28.934 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.154+0000 7f571c27a700 1 -- 172.21.15.117:0/1690576768 shutdown_connections 2024-04-12T09:02:28.934 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.154+0000 7f571c27a700 1 --2- 172.21.15.117:0/1690576768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57141017a0 0x7f5714101bb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:28.934 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.154+0000 7f571c27a700 1 -- 172.21.15.117:0/1690576768 >> 172.21.15.117:0/1690576768 conn(0x7f57140fcf40 msgr2=0x7f57140ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:28.934 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.154+0000 7f571c27a700 1 -- 172.21.15.117:0/1690576768 shutdown_connections 2024-04-12T09:02:28.934 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.154+0000 7f571c27a700 1 -- 172.21.15.117:0/1690576768 wait complete. 2024-04-12T09:02:28.934 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.154+0000 7f571c27a700 1 Processor -- start 2024-04-12T09:02:28.934 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.154+0000 7f571c27a700 1 -- start start 2024-04-12T09:02:28.934 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.155+0000 7f571c27a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57141017a0 0x7f5714076b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:28.935 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.155+0000 7f571c27a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57141143d0 con 0x7f57141017a0 2024-04-12T09:02:28.935 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.155+0000 7f571a016700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57141017a0 0x7f5714076b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:28.935 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.155+0000 7f571a016700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57141017a0 0x7f5714076b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51616/0 (socket says 172.21.15.117:51616) 2024-04-12T09:02:28.935 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.155+0000 7f571a016700 1 -- 172.21.15.117:0/361677902 learned_addr learned my addr 172.21.15.117:0/361677902 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:28.935 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.155+0000 7f571a016700 1 -- 172.21.15.117:0/361677902 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57100094f0 con 0x7f57141017a0 2024-04-12T09:02:28.935 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.155+0000 7f571a016700 1 --2- 172.21.15.117:0/361677902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57141017a0 0x7f5714076b40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f57100090b0 tx=0x7f5710009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:28.935 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.155+0000 7f570affd700 1 -- 172.21.15.117:0/361677902 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5710010840 con 0x7f57141017a0 2024-04-12T09:02:28.935 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.155+0000 7f571c27a700 1 -- 172.21.15.117:0/361677902 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5714114510 con 0x7f57141017a0 2024-04-12T09:02:28.935 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.155+0000 7f570affd700 1 -- 172.21.15.117:0/361677902 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5710010e70 con 0x7f57141017a0 2024-04-12T09:02:28.935 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.155+0000 7f570affd700 1 -- 172.21.15.117:0/361677902 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5710024e40 con 0x7f57141017a0 2024-04-12T09:02:28.935 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.155+0000 7f571c27a700 1 -- 172.21.15.117:0/361677902 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57141149a0 con 0x7f57141017a0 2024-04-12T09:02:28.935 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.156+0000 7f570affd700 1 -- 172.21.15.117:0/361677902 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 12) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f571001a510 con 0x7f57141017a0 2024-04-12T09:02:28.935 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.156+0000 7f571c27a700 1 -- 172.21.15.117:0/361677902 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f571404bed0 con 0x7f57141017a0 2024-04-12T09:02:28.935 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.156+0000 7f570affd700 1 --2- 172.21.15.117:0/361677902 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f5700036790 0x7f5700038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:28.936 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.156+0000 7f570affd700 1 -- 172.21.15.117:0/361677902 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f571004a920 con 0x7f57141017a0 2024-04-12T09:02:28.936 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.157+0000 7f5719815700 1 --2- 172.21.15.117:0/361677902 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f5700036790 0x7f5700038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:28.936 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.157+0000 7f5719815700 1 --2- 172.21.15.117:0/361677902 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f5700036790 0x7f5700038c40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5704009990 tx=0x7f5704006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:28.936 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.161+0000 7f570affd700 1 -- 172.21.15.117:0/361677902 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f5710018940 con 0x7f57141017a0 2024-04-12T09:02:28.936 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.345+0000 7f571c27a700 1 -- 172.21.15.117:0/361677902 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f5714103540 con 0x7f57141017a0 2024-04-12T09:02:28.936 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.345+0000 7f570affd700 1 -- 172.21.15.117:0/361677902 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f5710018350 con 0x7f57141017a0 2024-04-12T09:02:28.936 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.347+0000 7f571c27a700 1 -- 172.21.15.117:0/361677902 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f5700036790 msgr2=0x7f5700038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:28.936 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.347+0000 7f571c27a700 1 --2- 172.21.15.117:0/361677902 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f5700036790 0x7f5700038c40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5704009990 tx=0x7f5704006e40 comp rx=0 tx=0).stop 2024-04-12T09:02:28.936 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.347+0000 7f571c27a700 1 -- 172.21.15.117:0/361677902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57141017a0 msgr2=0x7f5714076b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:28.936 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.347+0000 7f571c27a700 1 --2- 172.21.15.117:0/361677902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57141017a0 0x7f5714076b40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f57100090b0 tx=0x7f5710009250 comp rx=0 tx=0).stop 2024-04-12T09:02:28.936 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.348+0000 7f571c27a700 1 -- 172.21.15.117:0/361677902 shutdown_connections 2024-04-12T09:02:28.936 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.348+0000 7f571c27a700 1 --2- 172.21.15.117:0/361677902 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f5700036790 0x7f5700038c40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:28.936 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.348+0000 7f571c27a700 1 --2- 172.21.15.117:0/361677902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57141017a0 0x7f5714076b40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:28.937 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.348+0000 7f571c27a700 1 -- 172.21.15.117:0/361677902 >> 172.21.15.117:0/361677902 conn(0x7f57140fcf40 msgr2=0x7f57140fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:28.937 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.348+0000 7f571c27a700 1 -- 172.21.15.117:0/361677902 shutdown_connections 2024-04-12T09:02:28.937 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:28.348+0000 7f571c27a700 1 -- 172.21.15.117:0/361677902 wait complete. 2024-04-12T09:02:29.645 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:29 smithi117 ceph-mon[29277]: mgrmap e13: smithi117.oyaxql(active, since 6s) 2024-04-12T09:02:30.232 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.342+0000 7fba7cc5f700 1 Processor -- start 2024-04-12T09:02:30.232 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.342+0000 7fba7cc5f700 1 -- start start 2024-04-12T09:02:30.232 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.342+0000 7fba7cc5f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba78101750 0x7fba78101b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:30.232 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.342+0000 7fba7cc5f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba781020a0 con 0x7fba78101750 2024-04-12T09:02:30.232 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.342+0000 7fba7659c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba78101750 0x7fba78101b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:30.232 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.342+0000 7fba7659c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba78101750 0x7fba78101b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51618/0 (socket says 172.21.15.117:51618) 2024-04-12T09:02:30.232 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.342+0000 7fba7659c700 1 -- 172.21.15.117:0/2107919154 learned_addr learned my addr 172.21.15.117:0/2107919154 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:30.232 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.343+0000 7fba7659c700 1 -- 172.21.15.117:0/2107919154 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba781021e0 con 0x7fba78101750 2024-04-12T09:02:30.232 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.343+0000 7fba7659c700 1 --2- 172.21.15.117:0/2107919154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba78101750 0x7fba78101b60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fba680098e0 tx=0x7fba68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8f7935c281c4a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:30.232 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.343+0000 7fba7559a700 1 -- 172.21.15.117:0/2107919154 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba6800b860 con 0x7fba78101750 2024-04-12T09:02:30.232 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.343+0000 7fba7559a700 1 -- 172.21.15.117:0/2107919154 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba6800be90 con 0x7fba78101750 2024-04-12T09:02:30.233 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.343+0000 7fba7559a700 1 -- 172.21.15.117:0/2107919154 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba680103c0 con 0x7fba78101750 2024-04-12T09:02:30.233 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.343+0000 7fba7cc5f700 1 -- 172.21.15.117:0/2107919154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba78101750 msgr2=0x7fba78101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:30.233 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.343+0000 7fba7cc5f700 1 --2- 172.21.15.117:0/2107919154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba78101750 0x7fba78101b60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fba680098e0 tx=0x7fba68009250 comp rx=0 tx=0).stop 2024-04-12T09:02:30.233 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.344+0000 7fba7cc5f700 1 -- 172.21.15.117:0/2107919154 shutdown_connections 2024-04-12T09:02:30.233 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.344+0000 7fba7cc5f700 1 --2- 172.21.15.117:0/2107919154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba78101750 0x7fba78101b60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:30.233 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.344+0000 7fba7cc5f700 1 -- 172.21.15.117:0/2107919154 >> 172.21.15.117:0/2107919154 conn(0x7fba780fcf30 msgr2=0x7fba780ff340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:30.233 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.344+0000 7fba7cc5f700 1 -- 172.21.15.117:0/2107919154 shutdown_connections 2024-04-12T09:02:30.233 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.344+0000 7fba7cc5f700 1 -- 172.21.15.117:0/2107919154 wait complete. 2024-04-12T09:02:30.233 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.344+0000 7fba7cc5f700 1 Processor -- start 2024-04-12T09:02:30.233 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.344+0000 7fba7cc5f700 1 -- start start 2024-04-12T09:02:30.233 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.344+0000 7fba7cc5f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba78101750 0x7fba78110650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:30.233 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.344+0000 7fba7cc5f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba78110b90 con 0x7fba78101750 2024-04-12T09:02:30.233 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.344+0000 7fba7659c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba78101750 0x7fba78110650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:30.233 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.344+0000 7fba7659c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba78101750 0x7fba78110650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51630/0 (socket says 172.21.15.117:51630) 2024-04-12T09:02:30.233 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.344+0000 7fba7659c700 1 -- 172.21.15.117:0/2068453334 learned_addr learned my addr 172.21.15.117:0/2068453334 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:30.234 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.345+0000 7fba7659c700 1 -- 172.21.15.117:0/2068453334 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba680094f0 con 0x7fba78101750 2024-04-12T09:02:30.234 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.345+0000 7fba7659c700 1 --2- 172.21.15.117:0/2068453334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba78101750 0x7fba78110650 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fba68011c10 tx=0x7fba68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:30.234 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.345+0000 7fba66ffd700 1 -- 172.21.15.117:0/2068453334 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba68010890 con 0x7fba78101750 2024-04-12T09:02:30.234 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.345+0000 7fba66ffd700 1 -- 172.21.15.117:0/2068453334 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba68010ec0 con 0x7fba78101750 2024-04-12T09:02:30.234 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.345+0000 7fba7cc5f700 1 -- 172.21.15.117:0/2068453334 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba78110d90 con 0x7fba78101750 2024-04-12T09:02:30.234 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.345+0000 7fba66ffd700 1 -- 172.21.15.117:0/2068453334 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba680243f0 con 0x7fba78101750 2024-04-12T09:02:30.234 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.345+0000 7fba7cc5f700 1 -- 172.21.15.117:0/2068453334 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba78111900 con 0x7fba78101750 2024-04-12T09:02:30.234 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.346+0000 7fba66ffd700 1 -- 172.21.15.117:0/2068453334 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fba6802d3f0 con 0x7fba78101750 2024-04-12T09:02:30.234 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.346+0000 7fba66ffd700 1 --2- 172.21.15.117:0/2068453334 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fba60036880 0x7fba60038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:30.234 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.346+0000 7fba66ffd700 1 -- 172.21.15.117:0/2068453334 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fba6804a550 con 0x7fba78101750 2024-04-12T09:02:30.234 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.346+0000 7fba75d9b700 1 --2- 172.21.15.117:0/2068453334 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fba60036880 0x7fba60038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:30.234 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.346+0000 7fba7cc5f700 1 -- 172.21.15.117:0/2068453334 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7805f5f0 con 0x7fba78101750 2024-04-12T09:02:30.234 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.347+0000 7fba75d9b700 1 --2- 172.21.15.117:0/2068453334 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fba60036880 0x7fba60038d30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fba6c009990 tx=0x7fba6c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:30.234 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.351+0000 7fba66ffd700 1 -- 172.21.15.117:0/2068453334 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fba6802b8e0 con 0x7fba78101750 2024-04-12T09:02:30.234 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.644+0000 7fba7cc5f700 1 -- 172.21.15.117:0/2068453334 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fba7804bed0 con 0x7fba78101750 2024-04-12T09:02:30.235 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.649+0000 7fba66ffd700 1 -- 172.21.15.117:0/2068453334 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7fba6802b2f0 con 0x7fba78101750 2024-04-12T09:02:30.235 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.651+0000 7fba7cc5f700 1 -- 172.21.15.117:0/2068453334 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fba60036880 msgr2=0x7fba60038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:30.235 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.651+0000 7fba7cc5f700 1 --2- 172.21.15.117:0/2068453334 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fba60036880 0x7fba60038d30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fba6c009990 tx=0x7fba6c006e40 comp rx=0 tx=0).stop 2024-04-12T09:02:30.235 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.651+0000 7fba7cc5f700 1 -- 172.21.15.117:0/2068453334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba78101750 msgr2=0x7fba78110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:30.235 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.651+0000 7fba7cc5f700 1 --2- 172.21.15.117:0/2068453334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba78101750 0x7fba78110650 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fba68011c10 tx=0x7fba68009250 comp rx=0 tx=0).stop 2024-04-12T09:02:30.235 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.651+0000 7fba7cc5f700 1 -- 172.21.15.117:0/2068453334 shutdown_connections 2024-04-12T09:02:30.235 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.651+0000 7fba7cc5f700 1 --2- 172.21.15.117:0/2068453334 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fba60036880 0x7fba60038d30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:30.235 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.651+0000 7fba7cc5f700 1 --2- 172.21.15.117:0/2068453334 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba78101750 0x7fba78110650 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:30.235 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.651+0000 7fba7cc5f700 1 -- 172.21.15.117:0/2068453334 >> 172.21.15.117:0/2068453334 conn(0x7fba780fcf30 msgr2=0x7fba780fdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:30.235 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.651+0000 7fba7cc5f700 1 -- 172.21.15.117:0/2068453334 shutdown_connections 2024-04-12T09:02:30.235 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr 2024-04-12T09:02:29.651+0000 7fba7cc5f700 1 -- 172.21.15.117:0/2068453334 wait complete. 2024-04-12T09:02:30.235 INFO:teuthology.orchestra.run.smithi117.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-12T09:02:30.235 INFO:teuthology.orchestra.run.smithi117.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-12T09:02:30.235 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:02:30.235 INFO:teuthology.orchestra.run.smithi117.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-12T09:02:30.236 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:02:30.236 INFO:teuthology.orchestra.run.smithi117.stdout:Or, if you are only running a single cluster on this host: 2024-04-12T09:02:30.236 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:02:30.236 INFO:teuthology.orchestra.run.smithi117.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-12T09:02:30.236 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:02:30.236 INFO:teuthology.orchestra.run.smithi117.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-12T09:02:30.236 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:02:30.236 INFO:teuthology.orchestra.run.smithi117.stdout: ceph telemetry on 2024-04-12T09:02:30.236 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:02:30.236 INFO:teuthology.orchestra.run.smithi117.stdout:For more information see: 2024-04-12T09:02:30.236 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:02:30.236 INFO:teuthology.orchestra.run.smithi117.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-04-12T09:02:30.236 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:02:30.236 INFO:teuthology.orchestra.run.smithi117.stdout:Bootstrap complete. 2024-04-12T09:02:30.265 INFO:tasks.cephadm:Fetching config... 2024-04-12T09:02:30.266 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-12T09:02:30.266 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-12T09:02:30.322 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-12T09:02:30.322 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-12T09:02:30.322 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-12T09:02:30.377 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-12T09:02:30.378 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-12T09:02:30.378 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/keyring of=/dev/stdout 2024-04-12T09:02:30.444 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-12T09:02:30.444 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-12T09:02:30.444 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-12T09:02:30.499 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-12T09:02:30.499 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1eqPtL6oAXvRvl80gBmeWr7ayhH124S7Cy0CmUyKGoD5KeErKFplViT6SIg/YQ79kokPZIJy3ebTTCBB2lAIfv+HJwx2/znkuooJAyWz5n9+7RywwuQXId4E/teon/NrgEpXHOBKyX4AjhlDqV5n6RL9LwKZHQsRdMbPs+tOUYEqdrsLQHFvsEKUJmYsy1GjknhzMimgNV58etyNzUvJdAObd1oHYTTDrbyAplbvLfwZqT2IuwEK+FFDKlYYzjBwfAB2/WinZZOtJo8MMZ6UzEp7Amfp8EIraai4C+hmrkdwmzN80Kb/vfmLi1racheEUzc2rcioF0m8f5/TpvXEv9frwU75bJfwuksmXIXTEhgI0vL8Pu1/gu6HzNi7Rc1OVu77iTjGnAmcjt2+R1WMlXegsq3Mdbx6FPsBpYF+up6KTKGYZzJRBvffFAZcqCqfqteLY92HEbDuSWEJN1FnXHhokYfRDoeg5E2U78sb+qi2E3A7q7zjK2drj361AI60= ceph-12161984-f8ab-11ee-bc8c-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-12T09:02:30.580 INFO:teuthology.orchestra.run.smithi117.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1eqPtL6oAXvRvl80gBmeWr7ayhH124S7Cy0CmUyKGoD5KeErKFplViT6SIg/YQ79kokPZIJy3ebTTCBB2lAIfv+HJwx2/znkuooJAyWz5n9+7RywwuQXId4E/teon/NrgEpXHOBKyX4AjhlDqV5n6RL9LwKZHQsRdMbPs+tOUYEqdrsLQHFvsEKUJmYsy1GjknhzMimgNV58etyNzUvJdAObd1oHYTTDrbyAplbvLfwZqT2IuwEK+FFDKlYYzjBwfAB2/WinZZOtJo8MMZ6UzEp7Amfp8EIraai4C+hmrkdwmzN80Kb/vfmLi1racheEUzc2rcioF0m8f5/TpvXEv9frwU75bJfwuksmXIXTEhgI0vL8Pu1/gu6HzNi7Rc1OVu77iTjGnAmcjt2+R1WMlXegsq3Mdbx6FPsBpYF+up6KTKGYZzJRBvffFAZcqCqfqteLY92HEbDuSWEJN1FnXHhokYfRDoeg5E2U78sb+qi2E3A7q7zjK2drj361AI60= ceph-12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:02:30.594 DEBUG:teuthology.orchestra.run.smithi203:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1eqPtL6oAXvRvl80gBmeWr7ayhH124S7Cy0CmUyKGoD5KeErKFplViT6SIg/YQ79kokPZIJy3ebTTCBB2lAIfv+HJwx2/znkuooJAyWz5n9+7RywwuQXId4E/teon/NrgEpXHOBKyX4AjhlDqV5n6RL9LwKZHQsRdMbPs+tOUYEqdrsLQHFvsEKUJmYsy1GjknhzMimgNV58etyNzUvJdAObd1oHYTTDrbyAplbvLfwZqT2IuwEK+FFDKlYYzjBwfAB2/WinZZOtJo8MMZ6UzEp7Amfp8EIraai4C+hmrkdwmzN80Kb/vfmLi1racheEUzc2rcioF0m8f5/TpvXEv9frwU75bJfwuksmXIXTEhgI0vL8Pu1/gu6HzNi7Rc1OVu77iTjGnAmcjt2+R1WMlXegsq3Mdbx6FPsBpYF+up6KTKGYZzJRBvffFAZcqCqfqteLY92HEbDuSWEJN1FnXHhokYfRDoeg5E2U78sb+qi2E3A7q7zjK2drj361AI60= ceph-12161984-f8ab-11ee-bc8c-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-12T09:02:30.640 INFO:teuthology.orchestra.run.smithi203.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1eqPtL6oAXvRvl80gBmeWr7ayhH124S7Cy0CmUyKGoD5KeErKFplViT6SIg/YQ79kokPZIJy3ebTTCBB2lAIfv+HJwx2/znkuooJAyWz5n9+7RywwuQXId4E/teon/NrgEpXHOBKyX4AjhlDqV5n6RL9LwKZHQsRdMbPs+tOUYEqdrsLQHFvsEKUJmYsy1GjknhzMimgNV58etyNzUvJdAObd1oHYTTDrbyAplbvLfwZqT2IuwEK+FFDKlYYzjBwfAB2/WinZZOtJo8MMZ6UzEp7Amfp8EIraai4C+hmrkdwmzN80Kb/vfmLi1racheEUzc2rcioF0m8f5/TpvXEv9frwU75bJfwuksmXIXTEhgI0vL8Pu1/gu6HzNi7Rc1OVu77iTjGnAmcjt2+R1WMlXegsq3Mdbx6FPsBpYF+up6KTKGYZzJRBvffFAZcqCqfqteLY92HEbDuSWEJN1FnXHhokYfRDoeg5E2U78sb+qi2E3A7q7zjK2drj361AI60= ceph-12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:02:30.655 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-12T09:02:30.905 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:02:30.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:30 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/2068453334' entity='client.admin' 2024-04-12T09:02:33.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.361+0000 7fab0fcba700 1 -- 172.21.15.117:0/2777115495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab080fe0a0 msgr2=0x7fab080fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:33.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.361+0000 7fab0fcba700 1 --2- 172.21.15.117:0/2777115495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab080fe0a0 0x7fab080fe4b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fab040048c0 tx=0x7fab04009e30 comp rx=0 tx=0).stop 2024-04-12T09:02:33.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.361+0000 7fab0fcba700 1 -- 172.21.15.117:0/2777115495 shutdown_connections 2024-04-12T09:02:33.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.361+0000 7fab0fcba700 1 --2- 172.21.15.117:0/2777115495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab080fe0a0 0x7fab080fe4b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:33.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.361+0000 7fab0fcba700 1 -- 172.21.15.117:0/2777115495 >> 172.21.15.117:0/2777115495 conn(0x7fab080f6840 msgr2=0x7fab080f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:33.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.362+0000 7fab0fcba700 1 -- 172.21.15.117:0/2777115495 shutdown_connections 2024-04-12T09:02:33.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.362+0000 7fab0fcba700 1 -- 172.21.15.117:0/2777115495 wait complete. 2024-04-12T09:02:33.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.362+0000 7fab0fcba700 1 Processor -- start 2024-04-12T09:02:33.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.362+0000 7fab0fcba700 1 -- start start 2024-04-12T09:02:33.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.362+0000 7fab0fcba700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab080fe0a0 0x7fab0810d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:33.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.362+0000 7fab0fcba700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0810d600 con 0x7fab080fe0a0 2024-04-12T09:02:33.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.362+0000 7fab0da56700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab080fe0a0 0x7fab0810d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:33.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.362+0000 7fab0da56700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab080fe0a0 0x7fab0810d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44862/0 (socket says 172.21.15.117:44862) 2024-04-12T09:02:33.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.362+0000 7fab0da56700 1 -- 172.21.15.117:0/2373996411 learned_addr learned my addr 172.21.15.117:0/2373996411 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:33.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.362+0000 7fab0da56700 1 -- 172.21.15.117:0/2373996411 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab04005040 con 0x7fab080fe0a0 2024-04-12T09:02:33.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.363+0000 7fab0da56700 1 --2- 172.21.15.117:0/2373996411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab080fe0a0 0x7fab0810d0c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fab040096b0 tx=0x7fab04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:33.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.363+0000 7faafe7fc700 1 -- 172.21.15.117:0/2373996411 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab0400bed0 con 0x7fab080fe0a0 2024-04-12T09:02:33.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.363+0000 7faafe7fc700 1 -- 172.21.15.117:0/2373996411 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab0400b5c0 con 0x7fab080fe0a0 2024-04-12T09:02:33.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.363+0000 7fab0fcba700 1 -- 172.21.15.117:0/2373996411 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab0810d800 con 0x7fab080fe0a0 2024-04-12T09:02:33.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.363+0000 7faafe7fc700 1 -- 172.21.15.117:0/2373996411 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab0401c5b0 con 0x7fab080fe0a0 2024-04-12T09:02:33.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.363+0000 7fab0fcba700 1 -- 172.21.15.117:0/2373996411 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab0810e370 con 0x7fab080fe0a0 2024-04-12T09:02:33.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.364+0000 7faafe7fc700 1 -- 172.21.15.117:0/2373996411 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fab04004d30 con 0x7fab080fe0a0 2024-04-12T09:02:33.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.364+0000 7faafe7fc700 1 --2- 172.21.15.117:0/2373996411 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7faaf40368d0 0x7faaf4038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:33.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.364+0000 7fab0fcba700 1 -- 172.21.15.117:0/2373996411 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab08102f70 con 0x7fab080fe0a0 2024-04-12T09:02:33.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.364+0000 7faafe7fc700 1 -- 172.21.15.117:0/2373996411 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fab04049a00 con 0x7fab080fe0a0 2024-04-12T09:02:33.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.364+0000 7fab0d255700 1 --2- 172.21.15.117:0/2373996411 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7faaf40368d0 0x7faaf4038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:33.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.364+0000 7fab0d255700 1 --2- 172.21.15.117:0/2373996411 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7faaf40368d0 0x7faaf4038d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009990 tx=0x7faaf8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:33.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.369+0000 7faafe7fc700 1 -- 172.21.15.117:0/2373996411 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fab04011550 con 0x7fab080fe0a0 2024-04-12T09:02:33.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.559+0000 7fab0fcba700 1 -- 172.21.15.117:0/2373996411 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fab0805f5f0 con 0x7fab080fe0a0 2024-04-12T09:02:33.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.562+0000 7faafe7fc700 1 -- 172.21.15.117:0/2373996411 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fab04011370 con 0x7fab080fe0a0 2024-04-12T09:02:33.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.565+0000 7fab0fcba700 1 -- 172.21.15.117:0/2373996411 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7faaf40368d0 msgr2=0x7faaf4038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:33.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.565+0000 7fab0fcba700 1 --2- 172.21.15.117:0/2373996411 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7faaf40368d0 0x7faaf4038d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009990 tx=0x7faaf8006e40 comp rx=0 tx=0).stop 2024-04-12T09:02:33.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.565+0000 7fab0fcba700 1 -- 172.21.15.117:0/2373996411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab080fe0a0 msgr2=0x7fab0810d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:33.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.565+0000 7fab0fcba700 1 --2- 172.21.15.117:0/2373996411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab080fe0a0 0x7fab0810d0c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fab040096b0 tx=0x7fab04009e30 comp rx=0 tx=0).stop 2024-04-12T09:02:33.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.565+0000 7fab0fcba700 1 -- 172.21.15.117:0/2373996411 shutdown_connections 2024-04-12T09:02:33.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.565+0000 7fab0fcba700 1 --2- 172.21.15.117:0/2373996411 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7faaf40368d0 0x7faaf4038d80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:33.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.565+0000 7fab0fcba700 1 --2- 172.21.15.117:0/2373996411 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab080fe0a0 0x7fab0810d0c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:33.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.565+0000 7fab0fcba700 1 -- 172.21.15.117:0/2373996411 >> 172.21.15.117:0/2373996411 conn(0x7fab080f6840 msgr2=0x7fab08103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:33.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.565+0000 7fab0fcba700 1 -- 172.21.15.117:0/2373996411 shutdown_connections 2024-04-12T09:02:33.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:33.565+0000 7fab0fcba700 1 -- 172.21.15.117:0/2373996411 wait complete. 2024-04-12T09:02:34.172 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-12T09:02:34.173 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-12T09:02:34.857 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:02:34.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:34 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/2373996411' entity='client.admin' 2024-04-12T09:02:35.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:35 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:35.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:35 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:35.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:35 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd/host:smithi117", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:02:35.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:35 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:35.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:35 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi117", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T09:02:35.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:35 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi117", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-12T09:02:35.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:35 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:02:35.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:35 smithi117 ceph-mon[29277]: Deploying daemon crash.smithi117 on smithi117 2024-04-12T09:02:36.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.236+0000 7f4879442700 1 -- 172.21.15.117:0/728694617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48740fd650 msgr2=0x7f48740ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:36.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.236+0000 7f4879442700 1 --2- 172.21.15.117:0/728694617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48740fd650 0x7f48740ffa30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f48640048c0 tx=0x7f4864009e30 comp rx=0 tx=0).stop 2024-04-12T09:02:36.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.236+0000 7f4879442700 1 -- 172.21.15.117:0/728694617 shutdown_connections 2024-04-12T09:02:36.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.236+0000 7f4879442700 1 --2- 172.21.15.117:0/728694617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48740fd650 0x7f48740ffa30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:36.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.236+0000 7f4879442700 1 -- 172.21.15.117:0/728694617 >> 172.21.15.117:0/728694617 conn(0x7f48740f70d0 msgr2=0x7f48740f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:36.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.236+0000 7f4879442700 1 -- 172.21.15.117:0/728694617 shutdown_connections 2024-04-12T09:02:36.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.236+0000 7f4879442700 1 -- 172.21.15.117:0/728694617 wait complete. 2024-04-12T09:02:36.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.236+0000 7f4879442700 1 Processor -- start 2024-04-12T09:02:36.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.237+0000 7f4879442700 1 -- start start 2024-04-12T09:02:36.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.237+0000 7f4879442700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48740fd650 0x7f487410d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:36.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.237+0000 7f4879442700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487410d5e0 con 0x7f48740fd650 2024-04-12T09:02:36.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.237+0000 7f4872ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48740fd650 0x7f487410d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:36.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.237+0000 7f4872ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48740fd650 0x7f487410d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44888/0 (socket says 172.21.15.117:44888) 2024-04-12T09:02:36.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.237+0000 7f4872ffd700 1 -- 172.21.15.117:0/2275524013 learned_addr learned my addr 172.21.15.117:0/2275524013 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:36.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.237+0000 7f4872ffd700 1 -- 172.21.15.117:0/2275524013 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4864005040 con 0x7f48740fd650 2024-04-12T09:02:36.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.237+0000 7f4872ffd700 1 --2- 172.21.15.117:0/2275524013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48740fd650 0x7f487410d0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4864009680 tx=0x7f4864009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:36.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.237+0000 7f486bfff700 1 -- 172.21.15.117:0/2275524013 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f486400bed0 con 0x7f48740fd650 2024-04-12T09:02:36.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.237+0000 7f4879442700 1 -- 172.21.15.117:0/2275524013 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487410d7e0 con 0x7f48740fd650 2024-04-12T09:02:36.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.237+0000 7f486bfff700 1 -- 172.21.15.117:0/2275524013 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f486400b5c0 con 0x7f48740fd650 2024-04-12T09:02:36.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.237+0000 7f486bfff700 1 -- 172.21.15.117:0/2275524013 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f486401c5b0 con 0x7f48740fd650 2024-04-12T09:02:36.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.238+0000 7f4879442700 1 -- 172.21.15.117:0/2275524013 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487410e350 con 0x7f48740fd650 2024-04-12T09:02:36.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.238+0000 7f486bfff700 1 -- 172.21.15.117:0/2275524013 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f486401c710 con 0x7f48740fd650 2024-04-12T09:02:36.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.238+0000 7f4879442700 1 -- 172.21.15.117:0/2275524013 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4874102f60 con 0x7f48740fd650 2024-04-12T09:02:36.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.238+0000 7f486bfff700 1 --2- 172.21.15.117:0/2275524013 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f4860036880 0x7f4860038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:36.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.238+0000 7f486bfff700 1 -- 172.21.15.117:0/2275524013 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4864049960 con 0x7f48740fd650 2024-04-12T09:02:36.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.239+0000 7f486a7fc700 1 --2- 172.21.15.117:0/2275524013 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f4860036880 0x7f4860038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:36.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.239+0000 7f486a7fc700 1 --2- 172.21.15.117:0/2275524013 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f4860036880 0x7f4860038d30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f485c009990 tx=0x7f485c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:36.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.243+0000 7f486bfff700 1 -- 172.21.15.117:0/2275524013 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f4864025780 con 0x7f48740fd650 2024-04-12T09:02:36.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.442+0000 7f4879442700 1 -- 172.21.15.117:0/2275524013 --> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f487410e590 con 0x7f4860036880 2024-04-12T09:02:36.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.445+0000 7f486bfff700 1 -- 172.21.15.117:0/2275524013 <== mgr.14162 v2:172.21.15.117:6800/790148838 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f487410e590 con 0x7f4860036880 2024-04-12T09:02:36.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.447+0000 7f4879442700 1 -- 172.21.15.117:0/2275524013 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f4860036880 msgr2=0x7f4860038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:36.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.447+0000 7f4879442700 1 --2- 172.21.15.117:0/2275524013 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f4860036880 0x7f4860038d30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f485c009990 tx=0x7f485c006e40 comp rx=0 tx=0).stop 2024-04-12T09:02:36.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.447+0000 7f4879442700 1 -- 172.21.15.117:0/2275524013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48740fd650 msgr2=0x7f487410d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:36.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.447+0000 7f4879442700 1 --2- 172.21.15.117:0/2275524013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48740fd650 0x7f487410d0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4864009680 tx=0x7f4864009e30 comp rx=0 tx=0).stop 2024-04-12T09:02:36.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.447+0000 7f4879442700 1 -- 172.21.15.117:0/2275524013 shutdown_connections 2024-04-12T09:02:36.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.447+0000 7f4879442700 1 --2- 172.21.15.117:0/2275524013 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f4860036880 0x7f4860038d30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:36.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.447+0000 7f4879442700 1 --2- 172.21.15.117:0/2275524013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48740fd650 0x7f487410d0a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:36.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.447+0000 7f4879442700 1 -- 172.21.15.117:0/2275524013 >> 172.21.15.117:0/2275524013 conn(0x7f48740f70d0 msgr2=0x7f4874103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:36.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.447+0000 7f4879442700 1 -- 172.21.15.117:0/2275524013 shutdown_connections 2024-04-12T09:02:36.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:36.447+0000 7f4879442700 1 -- 172.21.15.117:0/2275524013 wait complete. 2024-04-12T09:02:37.124 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi203 2024-04-12T09:02:37.125 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-12T09:02:37.125 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/etc/ceph/ceph.conf 2024-04-12T09:02:37.145 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-12T09:02:37.145 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-12T09:02:37.202 INFO:tasks.cephadm:Adding host smithi203 to orchestrator... 2024-04-12T09:02:37.202 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph orch host add smithi203 2024-04-12T09:02:37.583 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:02:37.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:37 smithi117 ceph-mon[29277]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:02:37.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:37 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:39.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.386+0000 7f74309dd700 1 -- 172.21.15.117:0/1055995791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f742c0fe0a0 msgr2=0x7f742c0fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:39.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.386+0000 7f74309dd700 1 --2- 172.21.15.117:0/1055995791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f742c0fe0a0 0x7f742c0fe4b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f74240048c0 tx=0x7f7424009e30 comp rx=0 tx=0).stop 2024-04-12T09:02:39.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.386+0000 7f74309dd700 1 -- 172.21.15.117:0/1055995791 shutdown_connections 2024-04-12T09:02:39.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.386+0000 7f74309dd700 1 --2- 172.21.15.117:0/1055995791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f742c0fe0a0 0x7f742c0fe4b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:39.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.386+0000 7f74309dd700 1 -- 172.21.15.117:0/1055995791 >> 172.21.15.117:0/1055995791 conn(0x7f742c0f6840 msgr2=0x7f742c0f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:39.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.386+0000 7f74309dd700 1 -- 172.21.15.117:0/1055995791 shutdown_connections 2024-04-12T09:02:39.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.386+0000 7f74309dd700 1 -- 172.21.15.117:0/1055995791 wait complete. 2024-04-12T09:02:39.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.386+0000 7f74309dd700 1 Processor -- start 2024-04-12T09:02:39.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.386+0000 7f74309dd700 1 -- start start 2024-04-12T09:02:39.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.387+0000 7f74309dd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f742c0fe0a0 0x7f742c10d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:39.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.387+0000 7f74309dd700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c10d600 con 0x7f742c0fe0a0 2024-04-12T09:02:39.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.387+0000 7f742a59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f742c0fe0a0 0x7f742c10d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:39.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.387+0000 7f742a59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f742c0fe0a0 0x7f742c10d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44908/0 (socket says 172.21.15.117:44908) 2024-04-12T09:02:39.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.387+0000 7f742a59c700 1 -- 172.21.15.117:0/824512025 learned_addr learned my addr 172.21.15.117:0/824512025 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:39.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.387+0000 7f742a59c700 1 -- 172.21.15.117:0/824512025 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7424005040 con 0x7f742c0fe0a0 2024-04-12T09:02:39.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.387+0000 7f742a59c700 1 --2- 172.21.15.117:0/824512025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f742c0fe0a0 0x7f742c10d0c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7424009680 tx=0x7f7424009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:39.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.387+0000 7f741affd700 1 -- 172.21.15.117:0/824512025 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f742400b5c0 con 0x7f742c0fe0a0 2024-04-12T09:02:39.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.387+0000 7f74309dd700 1 -- 172.21.15.117:0/824512025 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f742c10d800 con 0x7f742c0fe0a0 2024-04-12T09:02:39.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.387+0000 7f741affd700 1 -- 172.21.15.117:0/824512025 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f742400be70 con 0x7f742c0fe0a0 2024-04-12T09:02:39.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.387+0000 7f741affd700 1 -- 172.21.15.117:0/824512025 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74240135a0 con 0x7f742c0fe0a0 2024-04-12T09:02:39.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.387+0000 7f74309dd700 1 -- 172.21.15.117:0/824512025 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742c10e370 con 0x7f742c0fe0a0 2024-04-12T09:02:39.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.388+0000 7f741affd700 1 -- 172.21.15.117:0/824512025 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f7424013860 con 0x7f742c0fe0a0 2024-04-12T09:02:39.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.388+0000 7f741affd700 1 --2- 172.21.15.117:0/824512025 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f7414036880 0x7f7414038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:39.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.388+0000 7f741affd700 1 -- 172.21.15.117:0/824512025 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7424049380 con 0x7f742c0fe0a0 2024-04-12T09:02:39.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.388+0000 7f7429d9b700 1 --2- 172.21.15.117:0/824512025 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f7414036880 0x7f7414038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:39.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.388+0000 7f74309dd700 1 -- 172.21.15.117:0/824512025 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f742c102f70 con 0x7f742c0fe0a0 2024-04-12T09:02:39.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.389+0000 7f7429d9b700 1 --2- 172.21.15.117:0/824512025 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f7414036880 0x7f7414038d30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7420009990 tx=0x7f7420006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:39.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.393+0000 7f741affd700 1 -- 172.21.15.117:0/824512025 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f7424021020 con 0x7f742c0fe0a0 2024-04-12T09:02:39.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:39.589+0000 7f74309dd700 1 -- 172.21.15.117:0/824512025 --> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi203", "target": ["mon-mgr", ""]}) v1 -- 0x7f742c1028b0 con 0x7f7414036880 2024-04-12T09:02:41.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:40 smithi117 ceph-mon[29277]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi203", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:02:41.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:40 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:41.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:40 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:41.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:40 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:41.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:40 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:41.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:40 smithi117 ceph-mon[29277]: Deploying daemon node-exporter.smithi117 on smithi117 2024-04-12T09:02:41.678 INFO:teuthology.orchestra.run.smithi117.stdout:Added host 'smithi203' with addr '172.21.15.203' 2024-04-12T09:02:41.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:41.675+0000 7f741affd700 1 -- 172.21.15.117:0/824512025 <== mgr.14162 v2:172.21.15.117:6800/790148838 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f742c1028b0 con 0x7f7414036880 2024-04-12T09:02:41.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:41.677+0000 7f74309dd700 1 -- 172.21.15.117:0/824512025 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f7414036880 msgr2=0x7f7414038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:41.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:41.677+0000 7f74309dd700 1 --2- 172.21.15.117:0/824512025 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f7414036880 0x7f7414038d30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7420009990 tx=0x7f7420006e40 comp rx=0 tx=0).stop 2024-04-12T09:02:41.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:41.677+0000 7f74309dd700 1 -- 172.21.15.117:0/824512025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f742c0fe0a0 msgr2=0x7f742c10d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:41.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:41.677+0000 7f74309dd700 1 --2- 172.21.15.117:0/824512025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f742c0fe0a0 0x7f742c10d0c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7424009680 tx=0x7f7424009e30 comp rx=0 tx=0).stop 2024-04-12T09:02:41.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:41.678+0000 7f74309dd700 1 -- 172.21.15.117:0/824512025 shutdown_connections 2024-04-12T09:02:41.680 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:41.678+0000 7f74309dd700 1 --2- 172.21.15.117:0/824512025 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f7414036880 0x7f7414038d30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:41.680 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:41.678+0000 7f74309dd700 1 --2- 172.21.15.117:0/824512025 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f742c0fe0a0 0x7f742c10d0c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:41.680 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:41.678+0000 7f74309dd700 1 -- 172.21.15.117:0/824512025 >> 172.21.15.117:0/824512025 conn(0x7f742c0f6840 msgr2=0x7f742c103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:41.680 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:41.678+0000 7f74309dd700 1 -- 172.21.15.117:0/824512025 shutdown_connections 2024-04-12T09:02:41.680 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:41.678+0000 7f74309dd700 1 -- 172.21.15.117:0/824512025 wait complete. 2024-04-12T09:02:42.081 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:41 smithi117 ceph-mon[29277]: Deploying cephadm binary to smithi203 2024-04-12T09:02:42.082 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:41 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:42.082 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:41 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:42.624 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph orch host ls --format=json 2024-04-12T09:02:42.884 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:02:43.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:42 smithi117 ceph-mon[29277]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:02:43.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:42 smithi117 ceph-mon[29277]: Added host smithi203 2024-04-12T09:02:45.091 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.089+0000 7eff700c3700 1 -- 172.21.15.117:0/1133298079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff680fe0b0 msgr2=0x7eff680fe4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:45.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.089+0000 7eff700c3700 1 --2- 172.21.15.117:0/1133298079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff680fe0b0 0x7eff680fe4c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7eff640048c0 tx=0x7eff64009e30 comp rx=0 tx=0).stop 2024-04-12T09:02:45.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.089+0000 7eff700c3700 1 -- 172.21.15.117:0/1133298079 shutdown_connections 2024-04-12T09:02:45.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.089+0000 7eff700c3700 1 --2- 172.21.15.117:0/1133298079 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff680fe0b0 0x7eff680fe4c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:45.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.089+0000 7eff700c3700 1 -- 172.21.15.117:0/1133298079 >> 172.21.15.117:0/1133298079 conn(0x7eff680f6850 msgr2=0x7eff680f8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:45.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.089+0000 7eff700c3700 1 -- 172.21.15.117:0/1133298079 shutdown_connections 2024-04-12T09:02:45.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.089+0000 7eff700c3700 1 -- 172.21.15.117:0/1133298079 wait complete. 2024-04-12T09:02:45.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.089+0000 7eff700c3700 1 Processor -- start 2024-04-12T09:02:45.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.090+0000 7eff700c3700 1 -- start start 2024-04-12T09:02:45.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.090+0000 7eff700c3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff680fe0b0 0x7eff6810d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:45.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.090+0000 7eff700c3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6810d600 con 0x7eff680fe0b0 2024-04-12T09:02:45.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.090+0000 7eff6de5f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff680fe0b0 0x7eff6810d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:45.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.090+0000 7eff6de5f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff680fe0b0 0x7eff6810d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57890/0 (socket says 172.21.15.117:57890) 2024-04-12T09:02:45.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.090+0000 7eff6de5f700 1 -- 172.21.15.117:0/1025423745 learned_addr learned my addr 172.21.15.117:0/1025423745 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:45.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.090+0000 7eff6de5f700 1 -- 172.21.15.117:0/1025423745 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff64005040 con 0x7eff680fe0b0 2024-04-12T09:02:45.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.090+0000 7eff6de5f700 1 --2- 172.21.15.117:0/1025423745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff680fe0b0 0x7eff6810d0c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7eff64009680 tx=0x7eff64009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:45.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.090+0000 7eff5e7fc700 1 -- 172.21.15.117:0/1025423745 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff6400b5c0 con 0x7eff680fe0b0 2024-04-12T09:02:45.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.090+0000 7eff5e7fc700 1 -- 172.21.15.117:0/1025423745 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff6400be70 con 0x7eff680fe0b0 2024-04-12T09:02:45.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.090+0000 7eff700c3700 1 -- 172.21.15.117:0/1025423745 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6810d800 con 0x7eff680fe0b0 2024-04-12T09:02:45.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.090+0000 7eff5e7fc700 1 -- 172.21.15.117:0/1025423745 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7eff640135a0 con 0x7eff680fe0b0 2024-04-12T09:02:45.093 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.090+0000 7eff700c3700 1 -- 172.21.15.117:0/1025423745 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6810e370 con 0x7eff680fe0b0 2024-04-12T09:02:45.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.091+0000 7eff5e7fc700 1 -- 172.21.15.117:0/1025423745 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7eff6401c430 con 0x7eff680fe0b0 2024-04-12T09:02:45.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.091+0000 7eff700c3700 1 -- 172.21.15.117:0/1025423745 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff68102f80 con 0x7eff680fe0b0 2024-04-12T09:02:45.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.091+0000 7eff5e7fc700 1 --2- 172.21.15.117:0/1025423745 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7eff540368d0 0x7eff54038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:45.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.091+0000 7eff5e7fc700 1 -- 172.21.15.117:0/1025423745 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7eff64049320 con 0x7eff680fe0b0 2024-04-12T09:02:45.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.091+0000 7eff6d65e700 1 --2- 172.21.15.117:0/1025423745 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7eff540368d0 0x7eff54038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:45.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.092+0000 7eff6d65e700 1 --2- 172.21.15.117:0/1025423745 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7eff540368d0 0x7eff54038d80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7eff58009990 tx=0x7eff58006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:45.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.096+0000 7eff5e7fc700 1 -- 172.21.15.117:0/1025423745 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7eff64011550 con 0x7eff680fe0b0 2024-04-12T09:02:45.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:44 smithi117 ceph-mon[29277]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:02:45.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:44 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:45.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:44 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:45.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:44 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:45.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:44 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:45.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.291+0000 7eff700c3700 1 -- 172.21.15.117:0/1025423745 --> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff6805f690 con 0x7eff540368d0 2024-04-12T09:02:45.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.292+0000 7eff5e7fc700 1 -- 172.21.15.117:0/1025423745 <== mgr.14162 v2:172.21.15.117:6800/790148838 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7eff6805f690 con 0x7eff540368d0 2024-04-12T09:02:45.293 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:02:45.293 INFO:teuthology.orchestra.run.smithi117.stdout:[{"addr": "172.21.15.117", "hostname": "smithi117", "labels": [], "status": ""}, {"addr": "172.21.15.203", "hostname": "smithi203", "labels": [], "status": ""}] 2024-04-12T09:02:45.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.294+0000 7eff700c3700 1 -- 172.21.15.117:0/1025423745 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7eff540368d0 msgr2=0x7eff54038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:45.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.294+0000 7eff700c3700 1 --2- 172.21.15.117:0/1025423745 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7eff540368d0 0x7eff54038d80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7eff58009990 tx=0x7eff58006e40 comp rx=0 tx=0).stop 2024-04-12T09:02:45.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.294+0000 7eff700c3700 1 -- 172.21.15.117:0/1025423745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff680fe0b0 msgr2=0x7eff6810d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:45.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.294+0000 7eff700c3700 1 --2- 172.21.15.117:0/1025423745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff680fe0b0 0x7eff6810d0c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7eff64009680 tx=0x7eff64009e30 comp rx=0 tx=0).stop 2024-04-12T09:02:45.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.294+0000 7eff700c3700 1 -- 172.21.15.117:0/1025423745 shutdown_connections 2024-04-12T09:02:45.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.294+0000 7eff700c3700 1 --2- 172.21.15.117:0/1025423745 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7eff540368d0 0x7eff54038d80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:45.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.294+0000 7eff700c3700 1 --2- 172.21.15.117:0/1025423745 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff680fe0b0 0x7eff6810d0c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:45.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.294+0000 7eff700c3700 1 -- 172.21.15.117:0/1025423745 >> 172.21.15.117:0/1025423745 conn(0x7eff680f6850 msgr2=0x7eff68103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:45.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.294+0000 7eff700c3700 1 -- 172.21.15.117:0/1025423745 shutdown_connections 2024-04-12T09:02:45.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:45.294+0000 7eff700c3700 1 -- 172.21.15.117:0/1025423745 wait complete. 2024-04-12T09:02:45.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:45 smithi117 ceph-mon[29277]: Deploying daemon alertmanager.smithi117 on smithi117 2024-04-12T09:02:46.360 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-12T09:02:46.360 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph osd crush tunables default 2024-04-12T09:02:46.630 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:02:47.123 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:46 smithi117 ceph-mon[29277]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-12T09:02:47.123 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:46 smithi117 ceph-mon[29277]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:02:47.123 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:46 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:49.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:48 smithi117 ceph-mon[29277]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:02:49.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.852+0000 7f88f46ee700 1 -- 172.21.15.117:0/694804071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88ec0fca60 msgr2=0x7f88ec0fce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:49.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.852+0000 7f88f46ee700 1 --2- 172.21.15.117:0/694804071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88ec0fca60 0x7f88ec0fce70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f88e80048c0 tx=0x7f88e8009e30 comp rx=0 tx=0).stop 2024-04-12T09:02:49.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.852+0000 7f88f46ee700 1 -- 172.21.15.117:0/694804071 shutdown_connections 2024-04-12T09:02:49.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.852+0000 7f88f46ee700 1 --2- 172.21.15.117:0/694804071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88ec0fca60 0x7f88ec0fce70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:49.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.852+0000 7f88f46ee700 1 -- 172.21.15.117:0/694804071 >> 172.21.15.117:0/694804071 conn(0x7f88ec0f81c0 msgr2=0x7f88ec0fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:49.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.852+0000 7f88f46ee700 1 -- 172.21.15.117:0/694804071 shutdown_connections 2024-04-12T09:02:49.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.852+0000 7f88f46ee700 1 -- 172.21.15.117:0/694804071 wait complete. 2024-04-12T09:02:49.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.852+0000 7f88f46ee700 1 Processor -- start 2024-04-12T09:02:49.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.852+0000 7f88f46ee700 1 -- start start 2024-04-12T09:02:49.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.853+0000 7f88f46ee700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88ec0fca60 0x7f88ec10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:49.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.853+0000 7f88f46ee700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec10d5f0 con 0x7f88ec0fca60 2024-04-12T09:02:49.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.853+0000 7f88f248a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88ec0fca60 0x7f88ec10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:49.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.853+0000 7f88f248a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88ec0fca60 0x7f88ec10d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:56530/0 (socket says 172.21.15.117:56530) 2024-04-12T09:02:49.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.853+0000 7f88f248a700 1 -- 172.21.15.117:0/2999484496 learned_addr learned my addr 172.21.15.117:0/2999484496 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:02:49.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.853+0000 7f88f248a700 1 -- 172.21.15.117:0/2999484496 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e8005040 con 0x7f88ec0fca60 2024-04-12T09:02:49.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.853+0000 7f88f248a700 1 --2- 172.21.15.117:0/2999484496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88ec0fca60 0x7f88ec10d0b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f88e8009680 tx=0x7f88e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:49.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.853+0000 7f88e2ffd700 1 -- 172.21.15.117:0/2999484496 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88e800b5c0 con 0x7f88ec0fca60 2024-04-12T09:02:49.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.853+0000 7f88e2ffd700 1 -- 172.21.15.117:0/2999484496 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f88e800be70 con 0x7f88ec0fca60 2024-04-12T09:02:49.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.853+0000 7f88f46ee700 1 -- 172.21.15.117:0/2999484496 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ec10d7f0 con 0x7f88ec0fca60 2024-04-12T09:02:49.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.853+0000 7f88e2ffd700 1 -- 172.21.15.117:0/2999484496 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88e80135a0 con 0x7f88ec0fca60 2024-04-12T09:02:49.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.853+0000 7f88f46ee700 1 -- 172.21.15.117:0/2999484496 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ec10e360 con 0x7f88ec0fca60 2024-04-12T09:02:49.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.854+0000 7f88e2ffd700 1 -- 172.21.15.117:0/2999484496 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f88e8013860 con 0x7f88ec0fca60 2024-04-12T09:02:49.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.854+0000 7f88f46ee700 1 -- 172.21.15.117:0/2999484496 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88ec102f70 con 0x7f88ec0fca60 2024-04-12T09:02:49.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.854+0000 7f88e2ffd700 1 --2- 172.21.15.117:0/2999484496 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f88d8036880 0x7f88d8038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:49.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.854+0000 7f88e2ffd700 1 -- 172.21.15.117:0/2999484496 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f88e80493d0 con 0x7f88ec0fca60 2024-04-12T09:02:49.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.854+0000 7f88f1c89700 1 --2- 172.21.15.117:0/2999484496 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f88d8036880 0x7f88d8038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:49.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.855+0000 7f88f1c89700 1 --2- 172.21.15.117:0/2999484496 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f88d8036880 0x7f88d8038d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f88dc009990 tx=0x7f88dc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:49.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:49.859+0000 7f88e2ffd700 1 -- 172.21.15.117:0/2999484496 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f88e8011960 con 0x7f88ec0fca60 2024-04-12T09:02:50.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:50.052+0000 7f88f46ee700 1 -- 172.21.15.117:0/2999484496 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f88ec10ed70 con 0x7f88ec0fca60 2024-04-12T09:02:50.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:50.896+0000 7f88e2ffd700 1 -- 172.21.15.117:0/2999484496 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f88e8011370 con 0x7f88ec0fca60 2024-04-12T09:02:50.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:50.899+0000 7f88f46ee700 1 -- 172.21.15.117:0/2999484496 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f88d8036880 msgr2=0x7f88d8038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:50.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:50.899+0000 7f88f46ee700 1 --2- 172.21.15.117:0/2999484496 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f88d8036880 0x7f88d8038d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f88dc009990 tx=0x7f88dc006e40 comp rx=0 tx=0).stop 2024-04-12T09:02:50.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:50.899+0000 7f88f46ee700 1 -- 172.21.15.117:0/2999484496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88ec0fca60 msgr2=0x7f88ec10d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:50.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:50.899+0000 7f88f46ee700 1 --2- 172.21.15.117:0/2999484496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88ec0fca60 0x7f88ec10d0b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f88e8009680 tx=0x7f88e8009e30 comp rx=0 tx=0).stop 2024-04-12T09:02:50.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:50.899+0000 7f88f46ee700 1 -- 172.21.15.117:0/2999484496 shutdown_connections 2024-04-12T09:02:50.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:50.899+0000 7f88f46ee700 1 --2- 172.21.15.117:0/2999484496 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f88d8036880 0x7f88d8038d30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:50.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:50.899+0000 7f88f46ee700 1 --2- 172.21.15.117:0/2999484496 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88ec0fca60 0x7f88ec10d0b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:50.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:50.899+0000 7f88f46ee700 1 -- 172.21.15.117:0/2999484496 >> 172.21.15.117:0/2999484496 conn(0x7f88ec0f81c0 msgr2=0x7f88ec103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:50.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:50.899+0000 7f88f46ee700 1 -- 172.21.15.117:0/2999484496 shutdown_connections 2024-04-12T09:02:50.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:02:50.899+0000 7f88f46ee700 1 -- 172.21.15.117:0/2999484496 wait complete. 2024-04-12T09:02:50.901 INFO:teuthology.orchestra.run.smithi117.stderr:adjusted tunables profile to default 2024-04-12T09:02:50.947 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:50 smithi117 ceph-mon[29277]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:02:50.947 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:50 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/2999484496' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-12T09:02:51.546 INFO:tasks.cephadm:Adding mon.smithi117 on smithi117 2024-04-12T09:02:51.546 INFO:tasks.cephadm:Adding mon.smithi203 on smithi203 2024-04-12T09:02:51.546 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph orch apply mon '2;smithi117:172.21.15.117=smithi117;smithi203:172.21.15.203=smithi203' 2024-04-12T09:02:51.795 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:02:51.842 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:02:52.112 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:51 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/2999484496' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-12T09:02:52.113 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:51 smithi117 ceph-mon[29277]: osdmap e4: 0 total, 0 up, 0 in 2024-04-12T09:02:53.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:52 smithi117 ceph-mon[29277]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:02:53.270 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.267+0000 7f0e62590700 1 -- 172.21.15.203:0/3736669194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e5c066960 msgr2=0x7f0e5c0ff6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:53.270 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.267+0000 7f0e62590700 1 --2- 172.21.15.203:0/3736669194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e5c066960 0x7f0e5c0ff6a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0048c0 tx=0x7f0e4c009e30 comp rx=0 tx=0).stop 2024-04-12T09:02:53.270 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.267+0000 7f0e62590700 1 -- 172.21.15.203:0/3736669194 shutdown_connections 2024-04-12T09:02:53.270 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.267+0000 7f0e62590700 1 --2- 172.21.15.203:0/3736669194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e5c066960 0x7f0e5c0ff6a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:53.270 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.267+0000 7f0e62590700 1 -- 172.21.15.203:0/3736669194 >> 172.21.15.203:0/3736669194 conn(0x7f0e5c0f7090 msgr2=0x7f0e5c0f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:53.270 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.267+0000 7f0e62590700 1 -- 172.21.15.203:0/3736669194 shutdown_connections 2024-04-12T09:02:53.270 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.267+0000 7f0e62590700 1 -- 172.21.15.203:0/3736669194 wait complete. 2024-04-12T09:02:53.270 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.268+0000 7f0e62590700 1 Processor -- start 2024-04-12T09:02:53.270 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.268+0000 7f0e62590700 1 -- start start 2024-04-12T09:02:53.270 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.268+0000 7f0e62590700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e5c066960 0x7f0e5c10d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:53.271 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.268+0000 7f0e62590700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c10d620 con 0x7f0e5c066960 2024-04-12T09:02:53.271 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.269+0000 7f0e5bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e5c066960 0x7f0e5c10d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:53.271 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.269+0000 7f0e5bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e5c066960 0x7f0e5c10d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.203:36990/0 (socket says 172.21.15.203:36990) 2024-04-12T09:02:53.271 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.269+0000 7f0e5bfff700 1 -- 172.21.15.203:0/2151368784 learned_addr learned my addr 172.21.15.203:0/2151368784 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-12T09:02:53.271 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.269+0000 7f0e5bfff700 1 -- 172.21.15.203:0/2151368784 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c005040 con 0x7f0e5c066960 2024-04-12T09:02:53.271 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.269+0000 7f0e5bfff700 1 --2- 172.21.15.203:0/2151368784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e5c066960 0x7f0e5c10d0e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c009680 tx=0x7f0e4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:53.271 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.269+0000 7f0e58ff9700 1 -- 172.21.15.203:0/2151368784 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0e4c00bed0 con 0x7f0e5c066960 2024-04-12T09:02:53.271 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.269+0000 7f0e58ff9700 1 -- 172.21.15.203:0/2151368784 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0e4c00b5c0 con 0x7f0e5c066960 2024-04-12T09:02:53.271 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.269+0000 7f0e62590700 1 -- 172.21.15.203:0/2151368784 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e5c10d820 con 0x7f0e5c066960 2024-04-12T09:02:53.271 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.269+0000 7f0e58ff9700 1 -- 172.21.15.203:0/2151368784 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0e4c01c5b0 con 0x7f0e5c066960 2024-04-12T09:02:53.271 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.269+0000 7f0e62590700 1 -- 172.21.15.203:0/2151368784 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5c10e390 con 0x7f0e5c066960 2024-04-12T09:02:53.272 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.270+0000 7f0e58ff9700 1 -- 172.21.15.203:0/2151368784 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f0e4c01c710 con 0x7f0e5c066960 2024-04-12T09:02:53.272 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.270+0000 7f0e58ff9700 1 --2- 172.21.15.203:0/2151368784 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f0e44036880 0x7f0e44038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:53.272 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.270+0000 7f0e58ff9700 1 -- 172.21.15.203:0/2151368784 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0e4c049a20 con 0x7f0e5c066960 2024-04-12T09:02:53.272 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.270+0000 7f0e62590700 1 -- 172.21.15.203:0/2151368784 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e5c102f50 con 0x7f0e5c066960 2024-04-12T09:02:53.272 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.270+0000 7f0e5b7fe700 1 --2- 172.21.15.203:0/2151368784 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f0e44036880 0x7f0e44038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:53.273 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.271+0000 7f0e5b7fe700 1 --2- 172.21.15.203:0/2151368784 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f0e44036880 0x7f0e44038d30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009990 tx=0x7f0e50006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:53.275 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.275+0000 7f0e58ff9700 1 -- 172.21.15.203:0/2151368784 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f0e4c025400 con 0x7f0e5c066960 2024-04-12T09:02:53.469 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.469+0000 7f0e62590700 1 -- 172.21.15.203:0/2151368784 --> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi117:172.21.15.117=smithi117;smithi203:172.21.15.203=smithi203", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e5c10e5d0 con 0x7f0e44036880 2024-04-12T09:02:53.474 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.474+0000 7f0e58ff9700 1 -- 172.21.15.203:0/2151368784 <== mgr.14162 v2:172.21.15.117:6800/790148838 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f0e5c10e5d0 con 0x7f0e44036880 2024-04-12T09:02:53.474 INFO:teuthology.orchestra.run.smithi203.stdout:Scheduled mon update... 2024-04-12T09:02:53.476 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.476+0000 7f0e62590700 1 -- 172.21.15.203:0/2151368784 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f0e44036880 msgr2=0x7f0e44038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:53.476 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.476+0000 7f0e62590700 1 --2- 172.21.15.203:0/2151368784 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f0e44036880 0x7f0e44038d30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009990 tx=0x7f0e50006e40 comp rx=0 tx=0).stop 2024-04-12T09:02:53.476 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.476+0000 7f0e62590700 1 -- 172.21.15.203:0/2151368784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e5c066960 msgr2=0x7f0e5c10d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:53.477 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.476+0000 7f0e62590700 1 --2- 172.21.15.203:0/2151368784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e5c066960 0x7f0e5c10d0e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c009680 tx=0x7f0e4c009e30 comp rx=0 tx=0).stop 2024-04-12T09:02:53.477 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.476+0000 7f0e62590700 1 -- 172.21.15.203:0/2151368784 shutdown_connections 2024-04-12T09:02:53.477 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.476+0000 7f0e62590700 1 --2- 172.21.15.203:0/2151368784 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f0e44036880 0x7f0e44038d30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:53.477 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.476+0000 7f0e62590700 1 --2- 172.21.15.203:0/2151368784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e5c066960 0x7f0e5c10d0e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:53.477 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.476+0000 7f0e62590700 1 -- 172.21.15.203:0/2151368784 >> 172.21.15.203:0/2151368784 conn(0x7f0e5c0f7090 msgr2=0x7f0e5c103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:53.477 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.476+0000 7f0e62590700 1 -- 172.21.15.203:0/2151368784 shutdown_connections 2024-04-12T09:02:53.477 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:53.476+0000 7f0e62590700 1 -- 172.21.15.203:0/2151368784 wait complete. 2024-04-12T09:02:54.013 DEBUG:teuthology.orchestra.run.smithi203:mon.smithi203> sudo journalctl -f -n 0 -u ceph-12161984-f8ab-11ee-bc8c-c7b262605968@mon.smithi203.service 2024-04-12T09:02:54.015 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T09:02:54.015 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T09:02:54.292 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:02:54.339 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:02:54.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:54 smithi117 ceph-mon[29277]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:02:54.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:54 smithi117 ceph-mon[29277]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi117:172.21.15.117=smithi117;smithi203:172.21.15.203=smithi203", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:02:54.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:54 smithi117 ceph-mon[29277]: Saving service mon spec with placement smithi117:172.21.15.117=smithi117;smithi203:172.21.15.203=smithi203;count:2 2024-04-12T09:02:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:54 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:54 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:54 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:54 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:54 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:54 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:54 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:54 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-12T09:02:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:54 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:55.729 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.727+0000 7fc2ee0c9700 1 -- 172.21.15.203:0/1636278228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2e80fca60 msgr2=0x7fc2e80fce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:55.729 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.727+0000 7fc2ee0c9700 1 --2- 172.21.15.203:0/1636278228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2e80fca60 0x7fc2e80fce70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80048c0 tx=0x7fc2d8009e30 comp rx=0 tx=0).stop 2024-04-12T09:02:55.729 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.727+0000 7fc2ee0c9700 1 -- 172.21.15.203:0/1636278228 shutdown_connections 2024-04-12T09:02:55.729 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.727+0000 7fc2ee0c9700 1 --2- 172.21.15.203:0/1636278228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2e80fca60 0x7fc2e80fce70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:55.729 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.727+0000 7fc2ee0c9700 1 -- 172.21.15.203:0/1636278228 >> 172.21.15.203:0/1636278228 conn(0x7fc2e80f81c0 msgr2=0x7fc2e80fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:55.729 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.727+0000 7fc2ee0c9700 1 -- 172.21.15.203:0/1636278228 shutdown_connections 2024-04-12T09:02:55.729 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.727+0000 7fc2ee0c9700 1 -- 172.21.15.203:0/1636278228 wait complete. 2024-04-12T09:02:55.729 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.727+0000 7fc2ee0c9700 1 Processor -- start 2024-04-12T09:02:55.729 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.727+0000 7fc2ee0c9700 1 -- start start 2024-04-12T09:02:55.730 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.728+0000 7fc2ee0c9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2e80fca60 0x7fc2e810d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:55.730 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.728+0000 7fc2ee0c9700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e810d5d0 con 0x7fc2e80fca60 2024-04-12T09:02:55.730 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.728+0000 7fc2e77fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2e80fca60 0x7fc2e810d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:55.730 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.728+0000 7fc2e77fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2e80fca60 0x7fc2e810d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.203:37848/0 (socket says 172.21.15.203:37848) 2024-04-12T09:02:55.730 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.728+0000 7fc2e77fe700 1 -- 172.21.15.203:0/766650593 learned_addr learned my addr 172.21.15.203:0/766650593 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-12T09:02:55.730 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.728+0000 7fc2e77fe700 1 -- 172.21.15.203:0/766650593 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d8005040 con 0x7fc2e80fca60 2024-04-12T09:02:55.730 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.728+0000 7fc2e77fe700 1 --2- 172.21.15.203:0/766650593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2e80fca60 0x7fc2e810d090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009680 tx=0x7fc2d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:55.730 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.728+0000 7fc2e4ff9700 1 -- 172.21.15.203:0/766650593 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2d800b5c0 con 0x7fc2e80fca60 2024-04-12T09:02:55.730 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.728+0000 7fc2e4ff9700 1 -- 172.21.15.203:0/766650593 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc2d800be70 con 0x7fc2e80fca60 2024-04-12T09:02:55.730 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.729+0000 7fc2ee0c9700 1 -- 172.21.15.203:0/766650593 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e810d7d0 con 0x7fc2e80fca60 2024-04-12T09:02:55.730 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.729+0000 7fc2e4ff9700 1 -- 172.21.15.203:0/766650593 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2d80135a0 con 0x7fc2e80fca60 2024-04-12T09:02:55.730 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.729+0000 7fc2ee0c9700 1 -- 172.21.15.203:0/766650593 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e810e340 con 0x7fc2e80fca60 2024-04-12T09:02:55.731 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.729+0000 7fc2e4ff9700 1 -- 172.21.15.203:0/766650593 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fc2d801ca90 con 0x7fc2e80fca60 2024-04-12T09:02:55.731 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.729+0000 7fc2ee0c9700 1 -- 172.21.15.203:0/766650593 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e8102f70 con 0x7fc2e80fca60 2024-04-12T09:02:55.731 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.730+0000 7fc2e4ff9700 1 --2- 172.21.15.203:0/766650593 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fc2d4036880 0x7fc2d4038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:55.731 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.730+0000 7fc2e4ff9700 1 -- 172.21.15.203:0/766650593 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc2d8049460 con 0x7fc2e80fca60 2024-04-12T09:02:55.731 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.730+0000 7fc2dffff700 1 --2- 172.21.15.203:0/766650593 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fc2d4036880 0x7fc2d4038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:55.731 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.730+0000 7fc2dffff700 1 --2- 172.21.15.203:0/766650593 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fc2d4036880 0x7fc2d4038d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009990 tx=0x7fc2d0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:55.735 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:55.735+0000 7fc2e4ff9700 1 -- 172.21.15.203:0/766650593 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fc2d8011960 con 0x7fc2e80fca60 2024-04-12T09:02:55.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:55 smithi117 ceph-mon[29277]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-12T09:02:55.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:55 smithi117 ceph-mon[29277]: Deploying daemon grafana.smithi117 on smithi117 2024-04-12T09:02:56.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:56.000+0000 7fc2ee0c9700 1 -- 172.21.15.203:0/766650593 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc2e810ed50 con 0x7fc2e80fca60 2024-04-12T09:02:56.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:56.001+0000 7fc2e4ff9700 1 -- 172.21.15.203:0/766650593 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fc2d8021070 con 0x7fc2e80fca60 2024-04-12T09:02:56.001 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T09:02:56.001 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"12161984-f8ab-11ee-bc8c-c7b262605968","modified":"2024-04-12T09:01:20.152816Z","created":"2024-04-12T09:01:20.152816Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi117","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T09:02:56.003 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:56.002+0000 7fc2ee0c9700 1 -- 172.21.15.203:0/766650593 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fc2d4036880 msgr2=0x7fc2d4038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:56.003 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:56.003+0000 7fc2ee0c9700 1 --2- 172.21.15.203:0/766650593 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fc2d4036880 0x7fc2d4038d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009990 tx=0x7fc2d0006e40 comp rx=0 tx=0).stop 2024-04-12T09:02:56.003 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:56.003+0000 7fc2ee0c9700 1 -- 172.21.15.203:0/766650593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2e80fca60 msgr2=0x7fc2e810d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:56.003 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:56.003+0000 7fc2ee0c9700 1 --2- 172.21.15.203:0/766650593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2e80fca60 0x7fc2e810d090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009680 tx=0x7fc2d8009e30 comp rx=0 tx=0).stop 2024-04-12T09:02:56.003 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:56.003+0000 7fc2ee0c9700 1 -- 172.21.15.203:0/766650593 shutdown_connections 2024-04-12T09:02:56.004 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:56.003+0000 7fc2ee0c9700 1 --2- 172.21.15.203:0/766650593 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fc2d4036880 0x7fc2d4038d30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:56.004 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:56.003+0000 7fc2ee0c9700 1 --2- 172.21.15.203:0/766650593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2e80fca60 0x7fc2e810d090 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:56.004 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:56.003+0000 7fc2ee0c9700 1 -- 172.21.15.203:0/766650593 >> 172.21.15.203:0/766650593 conn(0x7fc2e80f81c0 msgr2=0x7fc2e8103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:56.004 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:56.003+0000 7fc2ee0c9700 1 -- 172.21.15.203:0/766650593 shutdown_connections 2024-04-12T09:02:56.004 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:56.003+0000 7fc2ee0c9700 1 -- 172.21.15.203:0/766650593 wait complete. 2024-04-12T09:02:56.004 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-04-12T09:02:56.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:56 smithi117 ceph-mon[29277]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:02:56.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:56 smithi117 ceph-mon[29277]: from='client.? 172.21.15.203:0/766650593' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:02:56.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:56 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:02:57.523 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T09:02:57.523 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T09:02:57.772 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:02:57.819 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:02:58.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:58 smithi117 ceph-mon[29277]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:02:59.190 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.188+0000 7fa78d09a700 1 -- 172.21.15.203:0/296356084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7880669c0 msgr2=0x7fa7880ff640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:59.191 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.188+0000 7fa78d09a700 1 --2- 172.21.15.203:0/296356084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7880669c0 0x7fa7880ff640 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa7780048c0 tx=0x7fa778009e30 comp rx=0 tx=0).stop 2024-04-12T09:02:59.191 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.188+0000 7fa78d09a700 1 -- 172.21.15.203:0/296356084 shutdown_connections 2024-04-12T09:02:59.191 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.188+0000 7fa78d09a700 1 --2- 172.21.15.203:0/296356084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7880669c0 0x7fa7880ff640 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:59.191 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.188+0000 7fa78d09a700 1 -- 172.21.15.203:0/296356084 >> 172.21.15.203:0/296356084 conn(0x7fa7880f7090 msgr2=0x7fa7880f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:59.191 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.188+0000 7fa78d09a700 1 -- 172.21.15.203:0/296356084 shutdown_connections 2024-04-12T09:02:59.191 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.188+0000 7fa78d09a700 1 -- 172.21.15.203:0/296356084 wait complete. 2024-04-12T09:02:59.191 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.188+0000 7fa78d09a700 1 Processor -- start 2024-04-12T09:02:59.191 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.188+0000 7fa78d09a700 1 -- start start 2024-04-12T09:02:59.191 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.188+0000 7fa78d09a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7880669c0 0x7fa78810d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:59.191 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.188+0000 7fa78d09a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78810d620 con 0x7fa7880669c0 2024-04-12T09:02:59.192 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.189+0000 7fa786d9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7880669c0 0x7fa78810d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:59.192 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.189+0000 7fa786d9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7880669c0 0x7fa78810d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.203:37864/0 (socket says 172.21.15.203:37864) 2024-04-12T09:02:59.192 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.189+0000 7fa786d9d700 1 -- 172.21.15.203:0/1196688963 learned_addr learned my addr 172.21.15.203:0/1196688963 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-12T09:02:59.192 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.189+0000 7fa786d9d700 1 -- 172.21.15.203:0/1196688963 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa778005040 con 0x7fa7880669c0 2024-04-12T09:02:59.192 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.189+0000 7fa786d9d700 1 --2- 172.21.15.203:0/1196688963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7880669c0 0x7fa78810d0e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa778009680 tx=0x7fa778009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:59.192 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.189+0000 7fa76f7fe700 1 -- 172.21.15.203:0/1196688963 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa77800bed0 con 0x7fa7880669c0 2024-04-12T09:02:59.192 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.189+0000 7fa76f7fe700 1 -- 172.21.15.203:0/1196688963 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa77800b5c0 con 0x7fa7880669c0 2024-04-12T09:02:59.192 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.189+0000 7fa78d09a700 1 -- 172.21.15.203:0/1196688963 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa78810d820 con 0x7fa7880669c0 2024-04-12T09:02:59.192 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.189+0000 7fa76f7fe700 1 -- 172.21.15.203:0/1196688963 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa77801c5b0 con 0x7fa7880669c0 2024-04-12T09:02:59.192 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.189+0000 7fa78d09a700 1 -- 172.21.15.203:0/1196688963 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa78810e390 con 0x7fa7880669c0 2024-04-12T09:02:59.192 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.190+0000 7fa76f7fe700 1 -- 172.21.15.203:0/1196688963 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fa778013420 con 0x7fa7880669c0 2024-04-12T09:02:59.192 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.190+0000 7fa78d09a700 1 -- 172.21.15.203:0/1196688963 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa788102f50 con 0x7fa7880669c0 2024-04-12T09:02:59.192 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.190+0000 7fa76f7fe700 1 --2- 172.21.15.203:0/1196688963 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fa7700368d0 0x7fa770038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:02:59.192 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.190+0000 7fa76f7fe700 1 -- 172.21.15.203:0/1196688963 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa7780499f0 con 0x7fa7880669c0 2024-04-12T09:02:59.193 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.191+0000 7fa78659c700 1 --2- 172.21.15.203:0/1196688963 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fa7700368d0 0x7fa770038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:02:59.193 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.191+0000 7fa78659c700 1 --2- 172.21.15.203:0/1196688963 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fa7700368d0 0x7fa770038d80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009990 tx=0x7fa77c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:02:59.195 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.195+0000 7fa76f7fe700 1 -- 172.21.15.203:0/1196688963 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fa778013a80 con 0x7fa7880669c0 2024-04-12T09:02:59.455 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.453+0000 7fa78d09a700 1 -- 172.21.15.203:0/1196688963 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa78810eda0 con 0x7fa7880669c0 2024-04-12T09:02:59.456 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.454+0000 7fa76f7fe700 1 -- 172.21.15.203:0/1196688963 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fa778011370 con 0x7fa7880669c0 2024-04-12T09:02:59.456 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T09:02:59.456 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"12161984-f8ab-11ee-bc8c-c7b262605968","modified":"2024-04-12T09:01:20.152816Z","created":"2024-04-12T09:01:20.152816Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi117","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T09:02:59.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.456+0000 7fa78d09a700 1 -- 172.21.15.203:0/1196688963 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fa7700368d0 msgr2=0x7fa770038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:59.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.456+0000 7fa78d09a700 1 --2- 172.21.15.203:0/1196688963 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fa7700368d0 0x7fa770038d80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009990 tx=0x7fa77c006e40 comp rx=0 tx=0).stop 2024-04-12T09:02:59.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.456+0000 7fa78d09a700 1 -- 172.21.15.203:0/1196688963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7880669c0 msgr2=0x7fa78810d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:02:59.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.456+0000 7fa78d09a700 1 --2- 172.21.15.203:0/1196688963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7880669c0 0x7fa78810d0e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa778009680 tx=0x7fa778009e30 comp rx=0 tx=0).stop 2024-04-12T09:02:59.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.456+0000 7fa78d09a700 1 -- 172.21.15.203:0/1196688963 shutdown_connections 2024-04-12T09:02:59.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.456+0000 7fa78d09a700 1 --2- 172.21.15.203:0/1196688963 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fa7700368d0 0x7fa770038d80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:59.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.456+0000 7fa78d09a700 1 --2- 172.21.15.203:0/1196688963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa7880669c0 0x7fa78810d0e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:02:59.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.456+0000 7fa78d09a700 1 -- 172.21.15.203:0/1196688963 >> 172.21.15.203:0/1196688963 conn(0x7fa7880f7090 msgr2=0x7fa788103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:02:59.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.456+0000 7fa78d09a700 1 -- 172.21.15.203:0/1196688963 shutdown_connections 2024-04-12T09:02:59.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:02:59.456+0000 7fa78d09a700 1 -- 172.21.15.203:0/1196688963 wait complete. 2024-04-12T09:02:59.458 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-04-12T09:02:59.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:02:59 smithi117 ceph-mon[29277]: from='client.? 172.21.15.203:0/1196688963' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:00.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:00 smithi117 ceph-mon[29277]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:01.054 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T09:03:01.054 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T09:03:01.309 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:03:01.357 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:03:02.750 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.749+0000 7f98fa854700 1 -- 172.21.15.203:0/1590882983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98f40fb960 msgr2=0x7f98f40fbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:02.751 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.749+0000 7f98fa854700 1 --2- 172.21.15.203:0/1590882983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98f40fb960 0x7f98f40fbd70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f98e40048c0 tx=0x7f98e4009e30 comp rx=0 tx=0).stop 2024-04-12T09:03:02.751 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.749+0000 7f98fa854700 1 -- 172.21.15.203:0/1590882983 shutdown_connections 2024-04-12T09:03:02.751 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.749+0000 7f98fa854700 1 --2- 172.21.15.203:0/1590882983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98f40fb960 0x7f98f40fbd70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:02.751 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.749+0000 7f98fa854700 1 -- 172.21.15.203:0/1590882983 >> 172.21.15.203:0/1590882983 conn(0x7f98f40f70c0 msgr2=0x7f98f40f94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:02.751 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.749+0000 7f98fa854700 1 -- 172.21.15.203:0/1590882983 shutdown_connections 2024-04-12T09:03:02.751 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.749+0000 7f98fa854700 1 -- 172.21.15.203:0/1590882983 wait complete. 2024-04-12T09:03:02.751 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.749+0000 7f98fa854700 1 Processor -- start 2024-04-12T09:03:02.751 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.750+0000 7f98fa854700 1 -- start start 2024-04-12T09:03:02.751 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.750+0000 7f98fa854700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98f40fb960 0x7f98f410bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:02.751 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.750+0000 7f98fa854700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f410c4d0 con 0x7f98f40fb960 2024-04-12T09:03:02.751 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.750+0000 7f98f3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98f40fb960 0x7f98f410bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:02.751 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.750+0000 7f98f3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98f40fb960 0x7f98f410bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.203:37890/0 (socket says 172.21.15.203:37890) 2024-04-12T09:03:02.751 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.750+0000 7f98f3fff700 1 -- 172.21.15.203:0/1508258401 learned_addr learned my addr 172.21.15.203:0/1508258401 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-12T09:03:02.751 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.750+0000 7f98f3fff700 1 -- 172.21.15.203:0/1508258401 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e4005040 con 0x7f98f40fb960 2024-04-12T09:03:02.751 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.750+0000 7f98f3fff700 1 --2- 172.21.15.203:0/1508258401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98f40fb960 0x7f98f410bf90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f98e40096b0 tx=0x7f98e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:02.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.751+0000 7f98f0ff9700 1 -- 172.21.15.203:0/1508258401 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f98e400bed0 con 0x7f98f40fb960 2024-04-12T09:03:02.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.751+0000 7f98fa854700 1 -- 172.21.15.203:0/1508258401 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f410c6d0 con 0x7f98f40fb960 2024-04-12T09:03:02.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.751+0000 7f98f0ff9700 1 -- 172.21.15.203:0/1508258401 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f98e400b5c0 con 0x7f98f40fb960 2024-04-12T09:03:02.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.751+0000 7f98f0ff9700 1 -- 172.21.15.203:0/1508258401 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f98e401c5b0 con 0x7f98f40fb960 2024-04-12T09:03:02.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.751+0000 7f98fa854700 1 -- 172.21.15.203:0/1508258401 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f410d240 con 0x7f98f40fb960 2024-04-12T09:03:02.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.751+0000 7f98fa854700 1 -- 172.21.15.203:0/1508258401 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f4101e70 con 0x7f98f40fb960 2024-04-12T09:03:02.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.752+0000 7f98f0ff9700 1 -- 172.21.15.203:0/1508258401 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f98e4013a80 con 0x7f98f40fb960 2024-04-12T09:03:02.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.752+0000 7f98f0ff9700 1 --2- 172.21.15.203:0/1508258401 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f98dc03ac80 0x7f98dc03d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:02.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.752+0000 7f98f0ff9700 1 -- 172.21.15.203:0/1508258401 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f98e4049ae0 con 0x7f98f40fb960 2024-04-12T09:03:02.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.752+0000 7f98f37fe700 1 --2- 172.21.15.203:0/1508258401 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f98dc03ac80 0x7f98dc03d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:02.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.752+0000 7f98f37fe700 1 --2- 172.21.15.203:0/1508258401 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f98dc03ac80 0x7f98dc03d130 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009990 tx=0x7f98e8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:02.760 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:02.760+0000 7f98f0ff9700 1 -- 172.21.15.203:0/1508258401 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f98e4011940 con 0x7f98f40fb960 2024-04-12T09:03:02.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:02 smithi117 ceph-mon[29277]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:03.022 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:03.021+0000 7f98fa854700 1 -- 172.21.15.203:0/1508258401 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f98f410dc50 con 0x7f98f40fb960 2024-04-12T09:03:03.022 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:03.022+0000 7f98f0ff9700 1 -- 172.21.15.203:0/1508258401 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f98e4011370 con 0x7f98f40fb960 2024-04-12T09:03:03.023 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T09:03:03.023 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"12161984-f8ab-11ee-bc8c-c7b262605968","modified":"2024-04-12T09:01:20.152816Z","created":"2024-04-12T09:01:20.152816Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi117","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T09:03:03.025 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:03.024+0000 7f98fa854700 1 -- 172.21.15.203:0/1508258401 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f98dc03ac80 msgr2=0x7f98dc03d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:03.025 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:03.024+0000 7f98fa854700 1 --2- 172.21.15.203:0/1508258401 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f98dc03ac80 0x7f98dc03d130 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009990 tx=0x7f98e8006e40 comp rx=0 tx=0).stop 2024-04-12T09:03:03.025 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:03.024+0000 7f98fa854700 1 -- 172.21.15.203:0/1508258401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98f40fb960 msgr2=0x7f98f410bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:03.025 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:03.024+0000 7f98fa854700 1 --2- 172.21.15.203:0/1508258401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98f40fb960 0x7f98f410bf90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f98e40096b0 tx=0x7f98e4009e30 comp rx=0 tx=0).stop 2024-04-12T09:03:03.025 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:03.024+0000 7f98fa854700 1 -- 172.21.15.203:0/1508258401 shutdown_connections 2024-04-12T09:03:03.025 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:03.024+0000 7f98fa854700 1 --2- 172.21.15.203:0/1508258401 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f98dc03ac80 0x7f98dc03d130 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:03.025 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:03.024+0000 7f98fa854700 1 --2- 172.21.15.203:0/1508258401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98f40fb960 0x7f98f410bf90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:03.025 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:03.024+0000 7f98fa854700 1 -- 172.21.15.203:0/1508258401 >> 172.21.15.203:0/1508258401 conn(0x7f98f40f70c0 msgr2=0x7f98f4102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:03.025 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:03.024+0000 7f98fa854700 1 -- 172.21.15.203:0/1508258401 shutdown_connections 2024-04-12T09:03:03.025 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:03.024+0000 7f98fa854700 1 -- 172.21.15.203:0/1508258401 wait complete. 2024-04-12T09:03:03.026 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-04-12T09:03:03.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:03 smithi117 ceph-mon[29277]: from='client.? 172.21.15.203:0/1508258401' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:04.573 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T09:03:04.573 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T09:03:04.821 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:03:04.867 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:03:04.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:04 smithi117 ceph-mon[29277]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:06.195 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.194+0000 7f62e5b99700 1 -- 172.21.15.203:0/1515122085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62e00fd040 msgr2=0x7f62e00fd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:06.195 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.194+0000 7f62e5b99700 1 --2- 172.21.15.203:0/1515122085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62e00fd040 0x7f62e00fd450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009c60 tx=0x7f62d8004d10 comp rx=0 tx=0).stop 2024-04-12T09:03:06.196 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.194+0000 7f62e5b99700 1 -- 172.21.15.203:0/1515122085 shutdown_connections 2024-04-12T09:03:06.196 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.194+0000 7f62e5b99700 1 --2- 172.21.15.203:0/1515122085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62e00fd040 0x7f62e00fd450 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:06.196 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.194+0000 7f62e5b99700 1 -- 172.21.15.203:0/1515122085 >> 172.21.15.203:0/1515122085 conn(0x7f62e00f70c0 msgr2=0x7f62e00f94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:06.196 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.195+0000 7f62e5b99700 1 -- 172.21.15.203:0/1515122085 shutdown_connections 2024-04-12T09:03:06.196 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.195+0000 7f62e5b99700 1 -- 172.21.15.203:0/1515122085 wait complete. 2024-04-12T09:03:06.196 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.195+0000 7f62e5b99700 1 Processor -- start 2024-04-12T09:03:06.196 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.195+0000 7f62e5b99700 1 -- start start 2024-04-12T09:03:06.196 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.195+0000 7f62e5b99700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62e00fd040 0x7f62e00f9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:06.196 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.195+0000 7f62e5b99700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e00f9590 con 0x7f62e00fd040 2024-04-12T09:03:06.198 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.196+0000 7f62df7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62e00fd040 0x7f62e00f9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:06.198 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.196+0000 7f62df7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62e00fd040 0x7f62e00f9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.203:53830/0 (socket says 172.21.15.203:53830) 2024-04-12T09:03:06.198 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.196+0000 7f62df7fe700 1 -- 172.21.15.203:0/2006650720 learned_addr learned my addr 172.21.15.203:0/2006650720 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-12T09:03:06.198 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.196+0000 7f62df7fe700 1 -- 172.21.15.203:0/2006650720 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d8009940 con 0x7f62e00fd040 2024-04-12T09:03:06.198 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.196+0000 7f62df7fe700 1 --2- 172.21.15.203:0/2006650720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62e00fd040 0x7f62e00f9050 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009500 tx=0x7f62d8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:06.198 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.196+0000 7f62d7fff700 1 -- 172.21.15.203:0/2006650720 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62d8007c80 con 0x7f62e00fd040 2024-04-12T09:03:06.198 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.196+0000 7f62e5b99700 1 -- 172.21.15.203:0/2006650720 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e00f7660 con 0x7f62e00fd040 2024-04-12T09:03:06.198 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.196+0000 7f62d7fff700 1 -- 172.21.15.203:0/2006650720 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f62d801d910 con 0x7f62e00fd040 2024-04-12T09:03:06.198 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.196+0000 7f62d7fff700 1 -- 172.21.15.203:0/2006650720 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62d80129d0 con 0x7f62e00fd040 2024-04-12T09:03:06.198 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.196+0000 7f62e5b99700 1 -- 172.21.15.203:0/2006650720 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e00f7b50 con 0x7f62e00fd040 2024-04-12T09:03:06.198 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.197+0000 7f62d7fff700 1 -- 172.21.15.203:0/2006650720 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f62d8019040 con 0x7f62e00fd040 2024-04-12T09:03:06.198 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.197+0000 7f62e5b99700 1 -- 172.21.15.203:0/2006650720 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e005f5f0 con 0x7f62e00fd040 2024-04-12T09:03:06.199 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.197+0000 7f62d7fff700 1 --2- 172.21.15.203:0/2006650720 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f62cc036880 0x7f62cc038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:06.199 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.197+0000 7f62d7fff700 1 -- 172.21.15.203:0/2006650720 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f62d804a400 con 0x7f62e00fd040 2024-04-12T09:03:06.199 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.198+0000 7f62deffd700 1 --2- 172.21.15.203:0/2006650720 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f62cc036880 0x7f62cc038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:06.199 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.198+0000 7f62deffd700 1 --2- 172.21.15.203:0/2006650720 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f62cc036880 0x7f62cc038d30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f62c8009990 tx=0x7f62c8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:06.202 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.202+0000 7f62d7fff700 1 -- 172.21.15.203:0/2006650720 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f62d802eab0 con 0x7f62e00fd040 2024-04-12T09:03:06.461 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.461+0000 7f62e5b99700 1 -- 172.21.15.203:0/2006650720 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f62e00f7e10 con 0x7f62e00fd040 2024-04-12T09:03:06.462 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.462+0000 7f62d7fff700 1 -- 172.21.15.203:0/2006650720 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f62d8017020 con 0x7f62e00fd040 2024-04-12T09:03:06.462 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T09:03:06.462 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"12161984-f8ab-11ee-bc8c-c7b262605968","modified":"2024-04-12T09:01:20.152816Z","created":"2024-04-12T09:01:20.152816Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi117","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T09:03:06.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.464+0000 7f62e5b99700 1 -- 172.21.15.203:0/2006650720 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f62cc036880 msgr2=0x7f62cc038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:06.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.464+0000 7f62e5b99700 1 --2- 172.21.15.203:0/2006650720 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f62cc036880 0x7f62cc038d30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f62c8009990 tx=0x7f62c8006e40 comp rx=0 tx=0).stop 2024-04-12T09:03:06.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.464+0000 7f62e5b99700 1 -- 172.21.15.203:0/2006650720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62e00fd040 msgr2=0x7f62e00f9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:06.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.464+0000 7f62e5b99700 1 --2- 172.21.15.203:0/2006650720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62e00fd040 0x7f62e00f9050 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009500 tx=0x7f62d8004d10 comp rx=0 tx=0).stop 2024-04-12T09:03:06.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.464+0000 7f62e5b99700 1 -- 172.21.15.203:0/2006650720 shutdown_connections 2024-04-12T09:03:06.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.464+0000 7f62e5b99700 1 --2- 172.21.15.203:0/2006650720 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f62cc036880 0x7f62cc038d30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:06.467 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.464+0000 7f62e5b99700 1 --2- 172.21.15.203:0/2006650720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62e00fd040 0x7f62e00f9050 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:06.467 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.464+0000 7f62e5b99700 1 -- 172.21.15.203:0/2006650720 >> 172.21.15.203:0/2006650720 conn(0x7f62e00f70c0 msgr2=0x7f62e0065900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:06.467 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.464+0000 7f62e5b99700 1 -- 172.21.15.203:0/2006650720 shutdown_connections 2024-04-12T09:03:06.467 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:06.464+0000 7f62e5b99700 1 -- 172.21.15.203:0/2006650720 wait complete. 2024-04-12T09:03:06.467 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-04-12T09:03:06.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:06 smithi117 ceph-mon[29277]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:06.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:06 smithi117 ceph-mon[29277]: from='client.? 172.21.15.203:0/2006650720' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:08.053 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T09:03:08.053 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T09:03:08.303 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:03:08.350 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:03:08.528 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:08 smithi117 ceph-mon[29277]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:08.528 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:08 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:08.528 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:08 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:08.528 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:08 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:08.528 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:08 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:08.528 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:08 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:08.528 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:08 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:09.746 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:09 smithi117 ceph-mon[29277]: Deploying daemon prometheus.smithi117 on smithi117 2024-04-12T09:03:09.749 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.748+0000 7f2e5711b700 1 -- 172.21.15.203:0/4158494304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e500fb960 msgr2=0x7f2e500fbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:09.749 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.748+0000 7f2e5711b700 1 --2- 172.21.15.203:0/4158494304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e500fb960 0x7f2e500fbd70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2e440048c0 tx=0x7f2e44009e30 comp rx=0 tx=0).stop 2024-04-12T09:03:09.749 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.748+0000 7f2e5711b700 1 -- 172.21.15.203:0/4158494304 shutdown_connections 2024-04-12T09:03:09.750 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.748+0000 7f2e5711b700 1 --2- 172.21.15.203:0/4158494304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e500fb960 0x7f2e500fbd70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:09.750 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.748+0000 7f2e5711b700 1 -- 172.21.15.203:0/4158494304 >> 172.21.15.203:0/4158494304 conn(0x7f2e500f70c0 msgr2=0x7f2e500f94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:09.750 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.748+0000 7f2e5711b700 1 -- 172.21.15.203:0/4158494304 shutdown_connections 2024-04-12T09:03:09.750 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.748+0000 7f2e5711b700 1 -- 172.21.15.203:0/4158494304 wait complete. 2024-04-12T09:03:09.750 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.748+0000 7f2e5711b700 1 Processor -- start 2024-04-12T09:03:09.750 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.748+0000 7f2e5711b700 1 -- start start 2024-04-12T09:03:09.751 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.748+0000 7f2e5711b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e500fb960 0x7f2e500668a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:09.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.749+0000 7f2e5711b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5010fde0 con 0x7f2e500fb960 2024-04-12T09:03:09.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.749+0000 7f2e54eb7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e500fb960 0x7f2e500668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:09.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.749+0000 7f2e54eb7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e500fb960 0x7f2e500668a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.203:53848/0 (socket says 172.21.15.203:53848) 2024-04-12T09:03:09.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.749+0000 7f2e54eb7700 1 -- 172.21.15.203:0/2332275951 learned_addr learned my addr 172.21.15.203:0/2332275951 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-12T09:03:09.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.749+0000 7f2e54eb7700 1 -- 172.21.15.203:0/2332275951 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e44005040 con 0x7f2e500fb960 2024-04-12T09:03:09.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.749+0000 7f2e54eb7700 1 --2- 172.21.15.203:0/2332275951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e500fb960 0x7f2e500668a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2e44009300 tx=0x7f2e44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:09.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.749+0000 7f2e4d7fa700 1 -- 172.21.15.203:0/2332275951 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e44004e60 con 0x7f2e500fb960 2024-04-12T09:03:09.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.749+0000 7f2e4d7fa700 1 -- 172.21.15.203:0/2332275951 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2e44009680 con 0x7f2e500fb960 2024-04-12T09:03:09.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.749+0000 7f2e5711b700 1 -- 172.21.15.203:0/2332275951 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5010ff20 con 0x7f2e500fb960 2024-04-12T09:03:09.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.749+0000 7f2e4d7fa700 1 -- 172.21.15.203:0/2332275951 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2e4401c5b0 con 0x7f2e500fb960 2024-04-12T09:03:09.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.749+0000 7f2e5711b700 1 -- 172.21.15.203:0/2332275951 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e50110410 con 0x7f2e500fb960 2024-04-12T09:03:09.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.750+0000 7f2e4d7fa700 1 -- 172.21.15.203:0/2332275951 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f2e4401c870 con 0x7f2e500fb960 2024-04-12T09:03:09.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.750+0000 7f2e5711b700 1 -- 172.21.15.203:0/2332275951 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e50105920 con 0x7f2e500fb960 2024-04-12T09:03:09.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.750+0000 7f2e4d7fa700 1 --2- 172.21.15.203:0/2332275951 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f2e40036880 0x7f2e40038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:09.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.750+0000 7f2e4d7fa700 1 -- 172.21.15.203:0/2332275951 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2e44049d20 con 0x7f2e500fb960 2024-04-12T09:03:09.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.751+0000 7f2e4ffff700 1 --2- 172.21.15.203:0/2332275951 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f2e40036880 0x7f2e40038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:09.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.751+0000 7f2e4ffff700 1 --2- 172.21.15.203:0/2332275951 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f2e40036880 0x7f2e40038d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009990 tx=0x7f2e3c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:09.757 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:09.756+0000 7f2e4d7fa700 1 -- 172.21.15.203:0/2332275951 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f2e44011db0 con 0x7f2e500fb960 2024-04-12T09:03:10.019 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:10.018+0000 7f2e5711b700 1 -- 172.21.15.203:0/2332275951 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2e5005f5f0 con 0x7f2e500fb960 2024-04-12T09:03:10.020 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:10.019+0000 7f2e4d7fa700 1 -- 172.21.15.203:0/2332275951 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f2e44023990 con 0x7f2e500fb960 2024-04-12T09:03:10.020 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T09:03:10.020 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"12161984-f8ab-11ee-bc8c-c7b262605968","modified":"2024-04-12T09:01:20.152816Z","created":"2024-04-12T09:01:20.152816Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi117","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T09:03:10.022 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:10.021+0000 7f2e5711b700 1 -- 172.21.15.203:0/2332275951 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f2e40036880 msgr2=0x7f2e40038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:10.022 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:10.021+0000 7f2e5711b700 1 --2- 172.21.15.203:0/2332275951 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f2e40036880 0x7f2e40038d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009990 tx=0x7f2e3c006e40 comp rx=0 tx=0).stop 2024-04-12T09:03:10.022 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:10.021+0000 7f2e5711b700 1 -- 172.21.15.203:0/2332275951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e500fb960 msgr2=0x7f2e500668a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:10.022 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:10.021+0000 7f2e5711b700 1 --2- 172.21.15.203:0/2332275951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e500fb960 0x7f2e500668a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2e44009300 tx=0x7f2e44009e30 comp rx=0 tx=0).stop 2024-04-12T09:03:10.022 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:10.021+0000 7f2e5711b700 1 -- 172.21.15.203:0/2332275951 shutdown_connections 2024-04-12T09:03:10.022 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:10.021+0000 7f2e5711b700 1 --2- 172.21.15.203:0/2332275951 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f2e40036880 0x7f2e40038d30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:10.023 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:10.021+0000 7f2e5711b700 1 --2- 172.21.15.203:0/2332275951 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e500fb960 0x7f2e500668a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:10.023 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:10.021+0000 7f2e5711b700 1 -- 172.21.15.203:0/2332275951 >> 172.21.15.203:0/2332275951 conn(0x7f2e500f70c0 msgr2=0x7f2e50102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:10.023 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:10.021+0000 7f2e5711b700 1 -- 172.21.15.203:0/2332275951 shutdown_connections 2024-04-12T09:03:10.023 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:10.021+0000 7f2e5711b700 1 -- 172.21.15.203:0/2332275951 wait complete. 2024-04-12T09:03:10.023 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-04-12T09:03:10.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:10 smithi117 ceph-mon[29277]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:10.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:10 smithi117 ceph-mon[29277]: from='client.? 172.21.15.203:0/2332275951' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:11.497 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T09:03:11.498 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T09:03:11.746 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:03:11.793 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:03:12.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:12 smithi117 ceph-mon[29277]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:12.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:12 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:13.136 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.133+0000 7f994cc6d700 1 -- 172.21.15.203:0/4041580793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99480fca40 msgr2=0x7f99480fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:13.136 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.133+0000 7f994cc6d700 1 --2- 172.21.15.203:0/4041580793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99480fca40 0x7f99480fce50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f99300048c0 tx=0x7f9930009e30 comp rx=0 tx=0).stop 2024-04-12T09:03:13.136 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.134+0000 7f994cc6d700 1 -- 172.21.15.203:0/4041580793 shutdown_connections 2024-04-12T09:03:13.136 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.134+0000 7f994cc6d700 1 --2- 172.21.15.203:0/4041580793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99480fca40 0x7f99480fce50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:13.136 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.134+0000 7f994cc6d700 1 -- 172.21.15.203:0/4041580793 >> 172.21.15.203:0/4041580793 conn(0x7f99480f81c0 msgr2=0x7f99480fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:13.136 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.134+0000 7f994cc6d700 1 -- 172.21.15.203:0/4041580793 shutdown_connections 2024-04-12T09:03:13.136 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.134+0000 7f994cc6d700 1 -- 172.21.15.203:0/4041580793 wait complete. 2024-04-12T09:03:13.136 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.134+0000 7f994cc6d700 1 Processor -- start 2024-04-12T09:03:13.137 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.134+0000 7f994cc6d700 1 -- start start 2024-04-12T09:03:13.137 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.134+0000 7f994cc6d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99480fca40 0x7f994810d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:13.137 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.134+0000 7f994cc6d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994810d5d0 con 0x7f99480fca40 2024-04-12T09:03:13.137 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.134+0000 7f994659c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99480fca40 0x7f994810d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:13.137 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.135+0000 7f994659c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99480fca40 0x7f994810d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.203:53870/0 (socket says 172.21.15.203:53870) 2024-04-12T09:03:13.137 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.135+0000 7f994659c700 1 -- 172.21.15.203:0/536015364 learned_addr learned my addr 172.21.15.203:0/536015364 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-12T09:03:13.137 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.135+0000 7f994659c700 1 -- 172.21.15.203:0/536015364 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9930005040 con 0x7f99480fca40 2024-04-12T09:03:13.137 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.135+0000 7f994659c700 1 --2- 172.21.15.203:0/536015364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99480fca40 0x7f994810d090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9930009680 tx=0x7f9930009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:13.139 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.135+0000 7f993effd700 1 -- 172.21.15.203:0/536015364 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f993000b5c0 con 0x7f99480fca40 2024-04-12T09:03:13.139 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.135+0000 7f993effd700 1 -- 172.21.15.203:0/536015364 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f993000be70 con 0x7f99480fca40 2024-04-12T09:03:13.139 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.135+0000 7f994cc6d700 1 -- 172.21.15.203:0/536015364 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f994810d7d0 con 0x7f99480fca40 2024-04-12T09:03:13.139 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.135+0000 7f993effd700 1 -- 172.21.15.203:0/536015364 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f99300135a0 con 0x7f99480fca40 2024-04-12T09:03:13.139 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.135+0000 7f994cc6d700 1 -- 172.21.15.203:0/536015364 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f994810e340 con 0x7f99480fca40 2024-04-12T09:03:13.139 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.136+0000 7f993effd700 1 -- 172.21.15.203:0/536015364 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f993001c430 con 0x7f99480fca40 2024-04-12T09:03:13.139 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.136+0000 7f994cc6d700 1 -- 172.21.15.203:0/536015364 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9948102f50 con 0x7f99480fca40 2024-04-12T09:03:13.139 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.136+0000 7f993effd700 1 --2- 172.21.15.203:0/536015364 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f9934036880 0x7f9934038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:13.139 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.136+0000 7f993effd700 1 -- 172.21.15.203:0/536015364 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9930049410 con 0x7f99480fca40 2024-04-12T09:03:13.139 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.136+0000 7f9945d9b700 1 --2- 172.21.15.203:0/536015364 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f9934036880 0x7f9934038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:13.139 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.137+0000 7f9945d9b700 1 --2- 172.21.15.203:0/536015364 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f9934036880 0x7f9934038d30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9938009990 tx=0x7f9938006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:13.142 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.141+0000 7f993effd700 1 -- 172.21.15.203:0/536015364 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f99300117e0 con 0x7f99480fca40 2024-04-12T09:03:13.400 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.399+0000 7f994cc6d700 1 -- 172.21.15.203:0/536015364 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f994810ed50 con 0x7f99480fca40 2024-04-12T09:03:13.401 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.399+0000 7f993effd700 1 -- 172.21.15.203:0/536015364 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f9930021070 con 0x7f99480fca40 2024-04-12T09:03:13.401 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T09:03:13.401 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"12161984-f8ab-11ee-bc8c-c7b262605968","modified":"2024-04-12T09:01:20.152816Z","created":"2024-04-12T09:01:20.152816Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi117","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T09:03:13.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.402+0000 7f994cc6d700 1 -- 172.21.15.203:0/536015364 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f9934036880 msgr2=0x7f9934038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:13.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.402+0000 7f994cc6d700 1 --2- 172.21.15.203:0/536015364 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f9934036880 0x7f9934038d30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9938009990 tx=0x7f9938006e40 comp rx=0 tx=0).stop 2024-04-12T09:03:13.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.402+0000 7f994cc6d700 1 -- 172.21.15.203:0/536015364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99480fca40 msgr2=0x7f994810d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:13.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.402+0000 7f994cc6d700 1 --2- 172.21.15.203:0/536015364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99480fca40 0x7f994810d090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9930009680 tx=0x7f9930009e30 comp rx=0 tx=0).stop 2024-04-12T09:03:13.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.402+0000 7f994cc6d700 1 -- 172.21.15.203:0/536015364 shutdown_connections 2024-04-12T09:03:13.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.402+0000 7f994cc6d700 1 --2- 172.21.15.203:0/536015364 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f9934036880 0x7f9934038d30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:13.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.402+0000 7f994cc6d700 1 --2- 172.21.15.203:0/536015364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99480fca40 0x7f994810d090 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:13.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.402+0000 7f994cc6d700 1 -- 172.21.15.203:0/536015364 >> 172.21.15.203:0/536015364 conn(0x7f99480f81c0 msgr2=0x7f9948103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:13.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.402+0000 7f994cc6d700 1 -- 172.21.15.203:0/536015364 shutdown_connections 2024-04-12T09:03:13.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:13.402+0000 7f994cc6d700 1 -- 172.21.15.203:0/536015364 wait complete. 2024-04-12T09:03:13.405 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-04-12T09:03:13.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:13 smithi117 ceph-mon[29277]: from='client.? 172.21.15.203:0/536015364' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:14.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:14 smithi117 ceph-mon[29277]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:15.130 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T09:03:15.130 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T09:03:15.380 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:03:15.427 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:03:16.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:16 smithi117 ceph-mon[29277]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:16.833 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.831+0000 7fa81a199700 1 -- 172.21.15.203:0/4186316859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8140fb940 msgr2=0x7fa8140fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:16.833 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.831+0000 7fa81a199700 1 --2- 172.21.15.203:0/4186316859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8140fb940 0x7fa8140fbd50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa804009c60 tx=0x7fa804004d10 comp rx=0 tx=0).stop 2024-04-12T09:03:16.833 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.831+0000 7fa81a199700 1 -- 172.21.15.203:0/4186316859 shutdown_connections 2024-04-12T09:03:16.833 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.831+0000 7fa81a199700 1 --2- 172.21.15.203:0/4186316859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8140fb940 0x7fa8140fbd50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:16.834 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.831+0000 7fa81a199700 1 -- 172.21.15.203:0/4186316859 >> 172.21.15.203:0/4186316859 conn(0x7fa8140f70c0 msgr2=0x7fa8140f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:16.834 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.831+0000 7fa81a199700 1 -- 172.21.15.203:0/4186316859 shutdown_connections 2024-04-12T09:03:16.834 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.831+0000 7fa81a199700 1 -- 172.21.15.203:0/4186316859 wait complete. 2024-04-12T09:03:16.834 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.832+0000 7fa81a199700 1 Processor -- start 2024-04-12T09:03:16.834 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.832+0000 7fa81a199700 1 -- start start 2024-04-12T09:03:16.834 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.832+0000 7fa81a199700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8140fb940 0x7fa8140668e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:16.834 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.832+0000 7fa81a199700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81410fd50 con 0x7fa8140fb940 2024-04-12T09:03:16.836 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.832+0000 7fa8137fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8140fb940 0x7fa8140668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:16.836 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.832+0000 7fa8137fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8140fb940 0x7fa8140668e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.203:36000/0 (socket says 172.21.15.203:36000) 2024-04-12T09:03:16.836 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.832+0000 7fa8137fe700 1 -- 172.21.15.203:0/2073415511 learned_addr learned my addr 172.21.15.203:0/2073415511 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-12T09:03:16.836 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.833+0000 7fa8137fe700 1 -- 172.21.15.203:0/2073415511 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa804009940 con 0x7fa8140fb940 2024-04-12T09:03:16.837 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.833+0000 7fa8137fe700 1 --2- 172.21.15.203:0/2073415511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8140fb940 0x7fa8140668e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa804009500 tx=0x7fa804004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:16.837 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.833+0000 7fa7fbfff700 1 -- 172.21.15.203:0/2073415511 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa804007c80 con 0x7fa8140fb940 2024-04-12T09:03:16.837 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.833+0000 7fa81a199700 1 -- 172.21.15.203:0/2073415511 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa81410fef0 con 0x7fa8140fb940 2024-04-12T09:03:16.837 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.833+0000 7fa7fbfff700 1 -- 172.21.15.203:0/2073415511 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa80401d910 con 0x7fa8140fb940 2024-04-12T09:03:16.837 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.833+0000 7fa7fbfff700 1 -- 172.21.15.203:0/2073415511 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8040129d0 con 0x7fa8140fb940 2024-04-12T09:03:16.837 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.833+0000 7fa81a199700 1 -- 172.21.15.203:0/2073415511 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa814110380 con 0x7fa8140fb940 2024-04-12T09:03:16.837 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.834+0000 7fa81a199700 1 -- 172.21.15.203:0/2073415511 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa814105900 con 0x7fa8140fb940 2024-04-12T09:03:16.837 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.834+0000 7fa7fbfff700 1 -- 172.21.15.203:0/2073415511 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fa804019040 con 0x7fa8140fb940 2024-04-12T09:03:16.837 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.834+0000 7fa7fbfff700 1 --2- 172.21.15.203:0/2073415511 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fa7fc036880 0x7fa7fc038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:16.837 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.834+0000 7fa7fbfff700 1 -- 172.21.15.203:0/2073415511 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa80404a400 con 0x7fa8140fb940 2024-04-12T09:03:16.837 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.834+0000 7fa812ffd700 1 --2- 172.21.15.203:0/2073415511 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fa7fc036880 0x7fa7fc038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:16.837 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.835+0000 7fa812ffd700 1 --2- 172.21.15.203:0/2073415511 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fa7fc036880 0x7fa7fc038d30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa808009990 tx=0x7fa808006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:16.840 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:16.839+0000 7fa7fbfff700 1 -- 172.21.15.203:0/2073415511 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fa80402eb40 con 0x7fa8140fb940 2024-04-12T09:03:17.101 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:17.100+0000 7fa81a199700 1 -- 172.21.15.203:0/2073415511 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa81405f5f0 con 0x7fa8140fb940 2024-04-12T09:03:17.102 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:17.101+0000 7fa7fbfff700 1 -- 172.21.15.203:0/2073415511 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fa804017020 con 0x7fa8140fb940 2024-04-12T09:03:17.102 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T09:03:17.103 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"12161984-f8ab-11ee-bc8c-c7b262605968","modified":"2024-04-12T09:01:20.152816Z","created":"2024-04-12T09:01:20.152816Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi117","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T09:03:17.104 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:17.103+0000 7fa81a199700 1 -- 172.21.15.203:0/2073415511 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fa7fc036880 msgr2=0x7fa7fc038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:17.104 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:17.103+0000 7fa81a199700 1 --2- 172.21.15.203:0/2073415511 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fa7fc036880 0x7fa7fc038d30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa808009990 tx=0x7fa808006e40 comp rx=0 tx=0).stop 2024-04-12T09:03:17.104 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:17.103+0000 7fa81a199700 1 -- 172.21.15.203:0/2073415511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8140fb940 msgr2=0x7fa8140668e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:17.104 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:17.103+0000 7fa81a199700 1 --2- 172.21.15.203:0/2073415511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8140fb940 0x7fa8140668e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa804009500 tx=0x7fa804004d10 comp rx=0 tx=0).stop 2024-04-12T09:03:17.105 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:17.103+0000 7fa81a199700 1 -- 172.21.15.203:0/2073415511 shutdown_connections 2024-04-12T09:03:17.105 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:17.103+0000 7fa81a199700 1 --2- 172.21.15.203:0/2073415511 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fa7fc036880 0x7fa7fc038d30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:17.105 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:17.103+0000 7fa81a199700 1 --2- 172.21.15.203:0/2073415511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8140fb940 0x7fa8140668e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:17.105 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:17.103+0000 7fa81a199700 1 -- 172.21.15.203:0/2073415511 >> 172.21.15.203:0/2073415511 conn(0x7fa8140f70c0 msgr2=0x7fa814102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:17.105 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:17.103+0000 7fa81a199700 1 -- 172.21.15.203:0/2073415511 shutdown_connections 2024-04-12T09:03:17.105 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:17.103+0000 7fa81a199700 1 -- 172.21.15.203:0/2073415511 wait complete. 2024-04-12T09:03:17.105 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-04-12T09:03:17.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:17 smithi117 ceph-mon[29277]: from='client.? 172.21.15.203:0/2073415511' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:18.676 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T09:03:18.676 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T09:03:18.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:18 smithi117 ceph-mon[29277]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:18.925 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:03:18.974 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:03:20.383 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.380+0000 7fa3f89c8700 1 -- 172.21.15.203:0/3502215913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3f40fca60 msgr2=0x7fa3f40fce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:20.383 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.380+0000 7fa3f89c8700 1 --2- 172.21.15.203:0/3502215913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3f40fca60 0x7fa3f40fce70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa3e40048c0 tx=0x7fa3e4009e30 comp rx=0 tx=0).stop 2024-04-12T09:03:20.383 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.380+0000 7fa3f89c8700 1 -- 172.21.15.203:0/3502215913 shutdown_connections 2024-04-12T09:03:20.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.380+0000 7fa3f89c8700 1 --2- 172.21.15.203:0/3502215913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3f40fca60 0x7fa3f40fce70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:20.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.380+0000 7fa3f89c8700 1 -- 172.21.15.203:0/3502215913 >> 172.21.15.203:0/3502215913 conn(0x7fa3f40f81c0 msgr2=0x7fa3f40fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:20.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.380+0000 7fa3f89c8700 1 -- 172.21.15.203:0/3502215913 shutdown_connections 2024-04-12T09:03:20.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.380+0000 7fa3f89c8700 1 -- 172.21.15.203:0/3502215913 wait complete. 2024-04-12T09:03:20.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.381+0000 7fa3f89c8700 1 Processor -- start 2024-04-12T09:03:20.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.381+0000 7fa3f89c8700 1 -- start start 2024-04-12T09:03:20.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.381+0000 7fa3f89c8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3f40fca60 0x7fa3f4071d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:20.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.381+0000 7fa3f89c8700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f40722a0 con 0x7fa3f40fca60 2024-04-12T09:03:20.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.381+0000 7fa3f259c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3f40fca60 0x7fa3f4071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:20.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.381+0000 7fa3f259c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3f40fca60 0x7fa3f4071d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.203:36026/0 (socket says 172.21.15.203:36026) 2024-04-12T09:03:20.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.381+0000 7fa3f259c700 1 -- 172.21.15.203:0/1777529806 learned_addr learned my addr 172.21.15.203:0/1777529806 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-12T09:03:20.385 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.381+0000 7fa3f259c700 1 -- 172.21.15.203:0/1777529806 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e4005040 con 0x7fa3f40fca60 2024-04-12T09:03:20.385 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.382+0000 7fa3f259c700 1 --2- 172.21.15.203:0/1777529806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3f40fca60 0x7fa3f4071d60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4009680 tx=0x7fa3e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:20.385 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.382+0000 7fa3e2ffd700 1 -- 172.21.15.203:0/1777529806 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3e400b5c0 con 0x7fa3f40fca60 2024-04-12T09:03:20.385 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.382+0000 7fa3e2ffd700 1 -- 172.21.15.203:0/1777529806 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa3e400be70 con 0x7fa3f40fca60 2024-04-12T09:03:20.385 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.382+0000 7fa3f89c8700 1 -- 172.21.15.203:0/1777529806 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f4070370 con 0x7fa3f40fca60 2024-04-12T09:03:20.385 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.382+0000 7fa3e2ffd700 1 -- 172.21.15.203:0/1777529806 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3e40135a0 con 0x7fa3f40fca60 2024-04-12T09:03:20.385 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.382+0000 7fa3f89c8700 1 -- 172.21.15.203:0/1777529806 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f4070860 con 0x7fa3f40fca60 2024-04-12T09:03:20.386 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.383+0000 7fa3f89c8700 1 -- 172.21.15.203:0/1777529806 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f405f5f0 con 0x7fa3f40fca60 2024-04-12T09:03:20.386 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.383+0000 7fa3e2ffd700 1 -- 172.21.15.203:0/1777529806 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fa3e4004d30 con 0x7fa3f40fca60 2024-04-12T09:03:20.386 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.383+0000 7fa3e2ffd700 1 --2- 172.21.15.203:0/1777529806 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fa3dc036880 0x7fa3dc038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:20.386 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.383+0000 7fa3e2ffd700 1 -- 172.21.15.203:0/1777529806 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa3e4049460 con 0x7fa3f40fca60 2024-04-12T09:03:20.386 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.383+0000 7fa3f1d9b700 1 --2- 172.21.15.203:0/1777529806 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fa3dc036880 0x7fa3dc038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:20.387 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.384+0000 7fa3f1d9b700 1 --2- 172.21.15.203:0/1777529806 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fa3dc036880 0x7fa3dc038d30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8009990 tx=0x7fa3e8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:20.389 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.388+0000 7fa3e2ffd700 1 -- 172.21.15.203:0/1777529806 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fa3e4011960 con 0x7fa3f40fca60 2024-04-12T09:03:20.650 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.649+0000 7fa3f89c8700 1 -- 172.21.15.203:0/1777529806 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa3f4106440 con 0x7fa3f40fca60 2024-04-12T09:03:20.651 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.649+0000 7fa3e2ffd700 1 -- 172.21.15.203:0/1777529806 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fa3e4021070 con 0x7fa3f40fca60 2024-04-12T09:03:20.651 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T09:03:20.651 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"12161984-f8ab-11ee-bc8c-c7b262605968","modified":"2024-04-12T09:01:20.152816Z","created":"2024-04-12T09:01:20.152816Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi117","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T09:03:20.653 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.651+0000 7fa3f89c8700 1 -- 172.21.15.203:0/1777529806 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fa3dc036880 msgr2=0x7fa3dc038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:20.653 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.651+0000 7fa3f89c8700 1 --2- 172.21.15.203:0/1777529806 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fa3dc036880 0x7fa3dc038d30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8009990 tx=0x7fa3e8006e40 comp rx=0 tx=0).stop 2024-04-12T09:03:20.653 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.651+0000 7fa3f89c8700 1 -- 172.21.15.203:0/1777529806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3f40fca60 msgr2=0x7fa3f4071d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:20.653 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.651+0000 7fa3f89c8700 1 --2- 172.21.15.203:0/1777529806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3f40fca60 0x7fa3f4071d60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4009680 tx=0x7fa3e4009e30 comp rx=0 tx=0).stop 2024-04-12T09:03:20.653 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.651+0000 7fa3f89c8700 1 -- 172.21.15.203:0/1777529806 shutdown_connections 2024-04-12T09:03:20.653 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.651+0000 7fa3f89c8700 1 --2- 172.21.15.203:0/1777529806 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fa3dc036880 0x7fa3dc038d30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:20.653 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.651+0000 7fa3f89c8700 1 --2- 172.21.15.203:0/1777529806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3f40fca60 0x7fa3f4071d60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:20.653 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.651+0000 7fa3f89c8700 1 -- 172.21.15.203:0/1777529806 >> 172.21.15.203:0/1777529806 conn(0x7fa3f40f81c0 msgr2=0x7fa3f4103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:20.653 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.651+0000 7fa3f89c8700 1 -- 172.21.15.203:0/1777529806 shutdown_connections 2024-04-12T09:03:20.653 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:20.651+0000 7fa3f89c8700 1 -- 172.21.15.203:0/1777529806 wait complete. 2024-04-12T09:03:20.654 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-04-12T09:03:20.898 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:20 smithi117 ceph-mon[29277]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:21.901 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:21 smithi117 ceph-mon[29277]: from='client.? 172.21.15.203:0/1777529806' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:22.244 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T09:03:22.245 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T09:03:22.492 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:03:22.539 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:03:22.705 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:22 smithi117 ceph-mon[29277]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:23.873 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.871+0000 7fe8e2f0e700 1 -- 172.21.15.203:0/550836005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8dc0fd050 msgr2=0x7fe8dc0fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:23.873 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.871+0000 7fe8e2f0e700 1 --2- 172.21.15.203:0/550836005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8dc0fd050 0x7fe8dc0fd460 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009c60 tx=0x7fe8d4004d10 comp rx=0 tx=0).stop 2024-04-12T09:03:23.873 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.871+0000 7fe8e2f0e700 1 -- 172.21.15.203:0/550836005 shutdown_connections 2024-04-12T09:03:23.873 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.871+0000 7fe8e2f0e700 1 --2- 172.21.15.203:0/550836005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8dc0fd050 0x7fe8dc0fd460 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:23.873 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.871+0000 7fe8e2f0e700 1 -- 172.21.15.203:0/550836005 >> 172.21.15.203:0/550836005 conn(0x7fe8dc0f70d0 msgr2=0x7fe8dc0f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:23.873 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.871+0000 7fe8e2f0e700 1 -- 172.21.15.203:0/550836005 shutdown_connections 2024-04-12T09:03:23.874 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.871+0000 7fe8e2f0e700 1 -- 172.21.15.203:0/550836005 wait complete. 2024-04-12T09:03:23.874 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.872+0000 7fe8e2f0e700 1 Processor -- start 2024-04-12T09:03:23.874 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.872+0000 7fe8e2f0e700 1 -- start start 2024-04-12T09:03:23.876 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.872+0000 7fe8e2f0e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8dc0fd050 0x7fe8dc065bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:23.876 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.872+0000 7fe8e2f0e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc10fdc0 con 0x7fe8dc0fd050 2024-04-12T09:03:23.876 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.872+0000 7fe8e0caa700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8dc0fd050 0x7fe8dc065bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:23.876 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.872+0000 7fe8e0caa700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8dc0fd050 0x7fe8dc065bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.203:36052/0 (socket says 172.21.15.203:36052) 2024-04-12T09:03:23.876 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.872+0000 7fe8e0caa700 1 -- 172.21.15.203:0/1552612188 learned_addr learned my addr 172.21.15.203:0/1552612188 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-12T09:03:23.876 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.873+0000 7fe8e0caa700 1 -- 172.21.15.203:0/1552612188 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d4009940 con 0x7fe8dc0fd050 2024-04-12T09:03:23.876 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.873+0000 7fe8e0caa700 1 --2- 172.21.15.203:0/1552612188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8dc0fd050 0x7fe8dc065bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4004e60 tx=0x7fe8d4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:23.876 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.873+0000 7fe8d97fa700 1 -- 172.21.15.203:0/1552612188 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8d4012410 con 0x7fe8dc0fd050 2024-04-12T09:03:23.876 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.873+0000 7fe8d97fa700 1 -- 172.21.15.203:0/1552612188 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe8d4012a40 con 0x7fe8dc0fd050 2024-04-12T09:03:23.876 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.873+0000 7fe8d97fa700 1 -- 172.21.15.203:0/1552612188 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe8d401ba40 con 0x7fe8dc0fd050 2024-04-12T09:03:23.876 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.873+0000 7fe8e2f0e700 1 -- 172.21.15.203:0/1552612188 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8dc10ff00 con 0x7fe8dc0fd050 2024-04-12T09:03:23.876 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.873+0000 7fe8e2f0e700 1 -- 172.21.15.203:0/1552612188 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8dc1103f0 con 0x7fe8dc0fd050 2024-04-12T09:03:23.877 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.874+0000 7fe8d97fa700 1 -- 172.21.15.203:0/1552612188 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fe8d4019040 con 0x7fe8dc0fd050 2024-04-12T09:03:23.877 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.874+0000 7fe8e2f0e700 1 -- 172.21.15.203:0/1552612188 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8dc105920 con 0x7fe8dc0fd050 2024-04-12T09:03:23.877 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.874+0000 7fe8d97fa700 1 --2- 172.21.15.203:0/1552612188 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fe8c40368d0 0x7fe8c4038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:23.877 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.874+0000 7fe8d97fa700 1 -- 172.21.15.203:0/1552612188 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe8d4049c10 con 0x7fe8dc0fd050 2024-04-12T09:03:23.877 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.874+0000 7fe8dbfff700 1 --2- 172.21.15.203:0/1552612188 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fe8c40368d0 0x7fe8c4038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:23.877 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.875+0000 7fe8dbfff700 1 --2- 172.21.15.203:0/1552612188 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fe8c40368d0 0x7fe8c4038d80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009990 tx=0x7fe8d0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:23.880 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:23.879+0000 7fe8d97fa700 1 -- 172.21.15.203:0/1552612188 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fe8d401b3f0 con 0x7fe8dc0fd050 2024-04-12T09:03:24.141 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:24.139+0000 7fe8e2f0e700 1 -- 172.21.15.203:0/1552612188 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe8dc101e70 con 0x7fe8dc0fd050 2024-04-12T09:03:24.142 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:24.140+0000 7fe8d97fa700 1 -- 172.21.15.203:0/1552612188 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fe8d4017090 con 0x7fe8dc0fd050 2024-04-12T09:03:24.142 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T09:03:24.142 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"12161984-f8ab-11ee-bc8c-c7b262605968","modified":"2024-04-12T09:01:20.152816Z","created":"2024-04-12T09:01:20.152816Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi117","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T09:03:24.144 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:24.142+0000 7fe8e2f0e700 1 -- 172.21.15.203:0/1552612188 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fe8c40368d0 msgr2=0x7fe8c4038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:24.144 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:24.142+0000 7fe8e2f0e700 1 --2- 172.21.15.203:0/1552612188 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fe8c40368d0 0x7fe8c4038d80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009990 tx=0x7fe8d0006e40 comp rx=0 tx=0).stop 2024-04-12T09:03:24.144 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:24.142+0000 7fe8e2f0e700 1 -- 172.21.15.203:0/1552612188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8dc0fd050 msgr2=0x7fe8dc065bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:24.144 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:24.142+0000 7fe8e2f0e700 1 --2- 172.21.15.203:0/1552612188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8dc0fd050 0x7fe8dc065bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4004e60 tx=0x7fe8d4004d10 comp rx=0 tx=0).stop 2024-04-12T09:03:24.145 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:24.143+0000 7fe8e2f0e700 1 -- 172.21.15.203:0/1552612188 shutdown_connections 2024-04-12T09:03:24.145 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:24.143+0000 7fe8e2f0e700 1 --2- 172.21.15.203:0/1552612188 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7fe8c40368d0 0x7fe8c4038d80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:24.145 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:24.143+0000 7fe8e2f0e700 1 --2- 172.21.15.203:0/1552612188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8dc0fd050 0x7fe8dc065bf0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:24.145 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:24.143+0000 7fe8e2f0e700 1 -- 172.21.15.203:0/1552612188 >> 172.21.15.203:0/1552612188 conn(0x7fe8dc0f70d0 msgr2=0x7fe8dc102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:24.145 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:24.143+0000 7fe8e2f0e700 1 -- 172.21.15.203:0/1552612188 shutdown_connections 2024-04-12T09:03:24.145 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:24.143+0000 7fe8e2f0e700 1 -- 172.21.15.203:0/1552612188 wait complete. 2024-04-12T09:03:24.146 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-04-12T09:03:25.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:24 smithi117 ceph-mon[29277]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:25.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:24 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:25.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:24 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:25.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:24 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:25.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:24 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-04-12T09:03:25.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:24 smithi117 ceph-mon[29277]: from='client.? 172.21.15.203:0/1552612188' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:25.654 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T09:03:25.655 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T09:03:25.895 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:03:25.942 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:03:26.101 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:25 smithi117 ceph-mon[29277]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-04-12T09:03:26.102 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:25 smithi117 ceph-mon[29277]: mgrmap e14: smithi117.oyaxql(active, since 63s) 2024-04-12T09:03:27.355 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.352+0000 7f7866674700 1 -- 172.21.15.203:0/181382664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78600fca60 msgr2=0x7f78600fce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:27.356 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.352+0000 7f7866674700 1 --2- 172.21.15.203:0/181382664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78600fca60 0x7f78600fce70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f78500048c0 tx=0x7f7850009e30 comp rx=0 tx=0).stop 2024-04-12T09:03:27.356 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.352+0000 7f7866674700 1 -- 172.21.15.203:0/181382664 shutdown_connections 2024-04-12T09:03:27.356 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.352+0000 7f7866674700 1 --2- 172.21.15.203:0/181382664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78600fca60 0x7f78600fce70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:27.356 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.352+0000 7f7866674700 1 -- 172.21.15.203:0/181382664 >> 172.21.15.203:0/181382664 conn(0x7f78600f81c0 msgr2=0x7f78600fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:27.356 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.352+0000 7f7866674700 1 -- 172.21.15.203:0/181382664 shutdown_connections 2024-04-12T09:03:27.356 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.352+0000 7f7866674700 1 -- 172.21.15.203:0/181382664 wait complete. 2024-04-12T09:03:27.356 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.353+0000 7f7866674700 1 Processor -- start 2024-04-12T09:03:27.356 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.353+0000 7f7866674700 1 -- start start 2024-04-12T09:03:27.356 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.353+0000 7f7866674700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78600fca60 0x7f7860071d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:27.356 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.353+0000 7f7866674700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78600722a0 con 0x7f78600fca60 2024-04-12T09:03:27.356 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.353+0000 7f785ffff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78600fca60 0x7f7860071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:27.356 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.353+0000 7f785ffff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78600fca60 0x7f7860071d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.203:44950/0 (socket says 172.21.15.203:44950) 2024-04-12T09:03:27.357 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.353+0000 7f785ffff700 1 -- 172.21.15.203:0/1538157143 learned_addr learned my addr 172.21.15.203:0/1538157143 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-12T09:03:27.357 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.353+0000 7f785ffff700 1 -- 172.21.15.203:0/1538157143 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7850005040 con 0x7f78600fca60 2024-04-12T09:03:27.357 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.354+0000 7f785ffff700 1 --2- 172.21.15.203:0/1538157143 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78600fca60 0x7f7860071d60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f78500096b0 tx=0x7f7850009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:27.357 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.354+0000 7f785cff9700 1 -- 172.21.15.203:0/1538157143 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f785000bed0 con 0x7f78600fca60 2024-04-12T09:03:27.357 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.354+0000 7f785cff9700 1 -- 172.21.15.203:0/1538157143 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f785000b5c0 con 0x7f78600fca60 2024-04-12T09:03:27.357 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.354+0000 7f785cff9700 1 -- 172.21.15.203:0/1538157143 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f785001c5b0 con 0x7f78600fca60 2024-04-12T09:03:27.357 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.354+0000 7f7866674700 1 -- 172.21.15.203:0/1538157143 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7860070370 con 0x7f78600fca60 2024-04-12T09:03:27.357 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.354+0000 7f7866674700 1 -- 172.21.15.203:0/1538157143 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7860070860 con 0x7f78600fca60 2024-04-12T09:03:27.358 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.355+0000 7f785cff9700 1 -- 172.21.15.203:0/1538157143 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 14) v1 ==== 43439+0+0 (secure 0 0 0) 0x7f785001c820 con 0x7f78600fca60 2024-04-12T09:03:27.358 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.355+0000 7f785cff9700 1 --2- 172.21.15.203:0/1538157143 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f78480368d0 0x7f7848038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:27.358 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.355+0000 7f785cff9700 1 -- 172.21.15.203:0/1538157143 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7850049b50 con 0x7f78600fca60 2024-04-12T09:03:27.358 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.355+0000 7f785f7fe700 1 -- 172.21.15.203:0/1538157143 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f78480368d0 msgr2=0x7f7848038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:6800/790148838 2024-04-12T09:03:27.358 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.355+0000 7f785f7fe700 1 --2- 172.21.15.203:0/1538157143 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f78480368d0 0x7f7848038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T09:03:27.359 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.355+0000 7f7866674700 1 -- 172.21.15.203:0/1538157143 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f786005f5f0 con 0x7f78600fca60 2024-04-12T09:03:27.361 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.360+0000 7f785cff9700 1 -- 172.21.15.203:0/1538157143 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f7850023300 con 0x7f78600fca60 2024-04-12T09:03:27.557 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.556+0000 7f785f7fe700 1 -- 172.21.15.203:0/1538157143 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f78480368d0 msgr2=0x7f7848038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:6800/790148838 2024-04-12T09:03:27.557 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.556+0000 7f785f7fe700 1 --2- 172.21.15.203:0/1538157143 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f78480368d0 0x7f7848038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T09:03:27.620 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.619+0000 7f7866674700 1 -- 172.21.15.203:0/1538157143 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7860106440 con 0x7f78600fca60 2024-04-12T09:03:27.620 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.619+0000 7f785cff9700 1 -- 172.21.15.203:0/1538157143 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f7850034090 con 0x7f78600fca60 2024-04-12T09:03:27.621 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T09:03:27.621 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"12161984-f8ab-11ee-bc8c-c7b262605968","modified":"2024-04-12T09:01:20.152816Z","created":"2024-04-12T09:01:20.152816Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi117","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T09:03:27.623 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.621+0000 7f7866674700 1 -- 172.21.15.203:0/1538157143 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f78480368d0 msgr2=0x7f7848038d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T09:03:27.623 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.621+0000 7f7866674700 1 --2- 172.21.15.203:0/1538157143 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f78480368d0 0x7f7848038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:27.623 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.621+0000 7f7866674700 1 -- 172.21.15.203:0/1538157143 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78600fca60 msgr2=0x7f7860071d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:27.623 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.621+0000 7f7866674700 1 --2- 172.21.15.203:0/1538157143 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78600fca60 0x7f7860071d60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f78500096b0 tx=0x7f7850009e30 comp rx=0 tx=0).stop 2024-04-12T09:03:27.623 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.621+0000 7f7866674700 1 -- 172.21.15.203:0/1538157143 shutdown_connections 2024-04-12T09:03:27.623 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.621+0000 7f7866674700 1 --2- 172.21.15.203:0/1538157143 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f78480368d0 0x7f7848038d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:27.623 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.621+0000 7f7866674700 1 --2- 172.21.15.203:0/1538157143 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78600fca60 0x7f7860071d60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:27.623 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.621+0000 7f7866674700 1 -- 172.21.15.203:0/1538157143 >> 172.21.15.203:0/1538157143 conn(0x7f78600f81c0 msgr2=0x7f7860103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:27.623 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.621+0000 7f7866674700 1 -- 172.21.15.203:0/1538157143 shutdown_connections 2024-04-12T09:03:27.623 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:27.621+0000 7f7866674700 1 -- 172.21.15.203:0/1538157143 wait complete. 2024-04-12T09:03:27.624 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-04-12T09:03:28.059 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:27 smithi117 ceph-mon[29277]: from='client.? 172.21.15.203:0/1538157143' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:29.157 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T09:03:29.157 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T09:03:29.410 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:03:29.457 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:03:30.838 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.837+0000 7f7215951700 1 -- 172.21.15.203:0/3816289584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72100fd650 msgr2=0x7f72100ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:30.839 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.837+0000 7f7215951700 1 --2- 172.21.15.203:0/3816289584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72100fd650 0x7f72100ffa30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f72000048c0 tx=0x7f7200009e30 comp rx=0 tx=0).stop 2024-04-12T09:03:30.839 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.837+0000 7f7215951700 1 -- 172.21.15.203:0/3816289584 shutdown_connections 2024-04-12T09:03:30.839 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.837+0000 7f7215951700 1 --2- 172.21.15.203:0/3816289584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72100fd650 0x7f72100ffa30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:30.839 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.837+0000 7f7215951700 1 -- 172.21.15.203:0/3816289584 >> 172.21.15.203:0/3816289584 conn(0x7f72100f70d0 msgr2=0x7f72100f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:30.839 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.837+0000 7f7215951700 1 -- 172.21.15.203:0/3816289584 shutdown_connections 2024-04-12T09:03:30.839 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.837+0000 7f7215951700 1 -- 172.21.15.203:0/3816289584 wait complete. 2024-04-12T09:03:30.839 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.837+0000 7f7215951700 1 Processor -- start 2024-04-12T09:03:30.839 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.838+0000 7f7215951700 1 -- start start 2024-04-12T09:03:30.839 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.838+0000 7f7215951700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72100fd650 0x7f721010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:30.839 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.838+0000 7f7215951700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721010d5c0 con 0x7f72100fd650 2024-04-12T09:03:30.839 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.838+0000 7f720effd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72100fd650 0x7f721010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:30.839 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.838+0000 7f720effd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72100fd650 0x7f721010d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.203:44972/0 (socket says 172.21.15.203:44972) 2024-04-12T09:03:30.839 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.838+0000 7f720effd700 1 -- 172.21.15.203:0/850856167 learned_addr learned my addr 172.21.15.203:0/850856167 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-12T09:03:30.840 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.838+0000 7f720effd700 1 -- 172.21.15.203:0/850856167 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7200005040 con 0x7f72100fd650 2024-04-12T09:03:30.840 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.838+0000 7f720effd700 1 --2- 172.21.15.203:0/850856167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72100fd650 0x7f721010d080 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7200009680 tx=0x7f7200009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:30.841 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.839+0000 7f7207fff700 1 -- 172.21.15.203:0/850856167 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f720000bed0 con 0x7f72100fd650 2024-04-12T09:03:30.841 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.839+0000 7f7207fff700 1 -- 172.21.15.203:0/850856167 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f720000b5c0 con 0x7f72100fd650 2024-04-12T09:03:30.841 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.839+0000 7f7215951700 1 -- 172.21.15.203:0/850856167 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721010d7c0 con 0x7f72100fd650 2024-04-12T09:03:30.841 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.839+0000 7f7207fff700 1 -- 172.21.15.203:0/850856167 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f720001c5b0 con 0x7f72100fd650 2024-04-12T09:03:30.841 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.839+0000 7f7215951700 1 -- 172.21.15.203:0/850856167 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721010e330 con 0x7f72100fd650 2024-04-12T09:03:30.841 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.840+0000 7f7207fff700 1 -- 172.21.15.203:0/850856167 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 14) v1 ==== 43439+0+0 (secure 0 0 0) 0x7f720001c710 con 0x7f72100fd650 2024-04-12T09:03:30.841 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.840+0000 7f7207fff700 1 --2- 172.21.15.203:0/850856167 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f71f00368d0 0x7f71f0038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:30.841 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.840+0000 7f7215951700 1 -- 172.21.15.203:0/850856167 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7210102f60 con 0x7f72100fd650 2024-04-12T09:03:30.841 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.840+0000 7f7207fff700 1 -- 172.21.15.203:0/850856167 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7200049a50 con 0x7f72100fd650 2024-04-12T09:03:30.841 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.840+0000 7f71fe7fc700 1 -- 172.21.15.203:0/850856167 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f71f00368d0 msgr2=0x7f71f0038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:6800/790148838 2024-04-12T09:03:30.841 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.840+0000 7f71fe7fc700 1 --2- 172.21.15.203:0/850856167 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f71f00368d0 0x7f71f0038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T09:03:30.845 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:30.845+0000 7f7207fff700 1 -- 172.21.15.203:0/850856167 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f7200025400 con 0x7f72100fd650 2024-04-12T09:03:31.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:31.041+0000 7f71fe7fc700 1 -- 172.21.15.203:0/850856167 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f71f00368d0 msgr2=0x7f71f0038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.117:6800/790148838 2024-04-12T09:03:31.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:31.041+0000 7f71fe7fc700 1 --2- 172.21.15.203:0/850856167 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f71f00368d0 0x7f71f0038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T09:03:31.110 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:31.109+0000 7f7215951700 1 -- 172.21.15.203:0/850856167 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f721010ed40 con 0x7f72100fd650 2024-04-12T09:03:31.110 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:31.109+0000 7f7207fff700 1 -- 172.21.15.203:0/850856167 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f7200011b60 con 0x7f72100fd650 2024-04-12T09:03:31.110 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T09:03:31.110 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"12161984-f8ab-11ee-bc8c-c7b262605968","modified":"2024-04-12T09:01:20.152816Z","created":"2024-04-12T09:01:20.152816Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi117","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T09:03:31.112 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:31.112+0000 7f7215951700 1 -- 172.21.15.203:0/850856167 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f71f00368d0 msgr2=0x7f71f0038d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T09:03:31.112 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:31.112+0000 7f7215951700 1 --2- 172.21.15.203:0/850856167 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f71f00368d0 0x7f71f0038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:31.112 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:31.112+0000 7f7215951700 1 -- 172.21.15.203:0/850856167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72100fd650 msgr2=0x7f721010d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:31.112 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:31.112+0000 7f7215951700 1 --2- 172.21.15.203:0/850856167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72100fd650 0x7f721010d080 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7200009680 tx=0x7f7200009e30 comp rx=0 tx=0).stop 2024-04-12T09:03:31.112 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:31.112+0000 7f7215951700 1 -- 172.21.15.203:0/850856167 shutdown_connections 2024-04-12T09:03:31.112 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:31.112+0000 7f7215951700 1 --2- 172.21.15.203:0/850856167 >> [v2:172.21.15.117:6800/790148838,v1:172.21.15.117:6801/790148838] conn(0x7f71f00368d0 0x7f71f0038d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:31.112 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:31.112+0000 7f7215951700 1 --2- 172.21.15.203:0/850856167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72100fd650 0x7f721010d080 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:31.112 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:31.112+0000 7f7215951700 1 -- 172.21.15.203:0/850856167 >> 172.21.15.203:0/850856167 conn(0x7f72100f70d0 msgr2=0x7f7210103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:31.113 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:31.112+0000 7f7215951700 1 -- 172.21.15.203:0/850856167 shutdown_connections 2024-04-12T09:03:31.113 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:31.112+0000 7f7215951700 1 -- 172.21.15.203:0/850856167 wait complete. 2024-04-12T09:03:31.113 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-04-12T09:03:31.386 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:31 smithi117 ceph-mon[29277]: from='client.? 172.21.15.203:0/850856167' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:32.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:32 smithi117 ceph-mon[29277]: Active manager daemon smithi117.oyaxql restarted 2024-04-12T09:03:32.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:32 smithi117 ceph-mon[29277]: Activating manager daemon smithi117.oyaxql 2024-04-12T09:03:32.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:32 smithi117 ceph-mon[29277]: osdmap e5: 0 total, 0 up, 0 in 2024-04-12T09:03:32.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:32 smithi117 ceph-mon[29277]: mgrmap e15: smithi117.oyaxql(active, starting, since 0.00654168s) 2024-04-12T09:03:32.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:32 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-04-12T09:03:32.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:32 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr metadata", "who": "smithi117.oyaxql", "id": "smithi117.oyaxql"}]: dispatch 2024-04-12T09:03:32.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:32 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-12T09:03:32.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:32 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-12T09:03:32.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:32 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-12T09:03:32.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:32 smithi117 ceph-mon[29277]: Manager daemon smithi117.oyaxql is now available 2024-04-12T09:03:32.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:32 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:03:32.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:32 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:03:32.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:32 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:32.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:32 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:03:32.664 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:32 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.oyaxql/mirror_snapshot_schedule"}]: dispatch 2024-04-12T09:03:32.664 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:32 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.oyaxql/trash_purge_schedule"}]: dispatch 2024-04-12T09:03:32.664 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:32 smithi117 ceph-mon[29277]: [12/Apr/2024:09:03:31] ENGINE Bus STARTING 2024-04-12T09:03:32.664 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:32 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:32.664 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:32 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:32.782 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T09:03:32.782 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T09:03:33.039 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:03:33.088 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:03:33.549 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:33 smithi117 ceph-mon[29277]: [12/Apr/2024:09:03:31] ENGINE Serving on https://172.21.15.117:7150 2024-04-12T09:03:33.549 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:33 smithi117 ceph-mon[29277]: [12/Apr/2024:09:03:31] ENGINE Bus STARTED 2024-04-12T09:03:33.549 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:33 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:33.549 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:33 smithi117 ceph-mon[29277]: mgrmap e16: smithi117.oyaxql(active, since 1.00762s) 2024-04-12T09:03:33.549 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:33 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:34.455 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.451+0000 7f06c81a1700 1 -- 172.21.15.203:0/4226630059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06c00fca60 msgr2=0x7f06c00fce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:34.455 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.451+0000 7f06c81a1700 1 --2- 172.21.15.203:0/4226630059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06c00fca60 0x7f06c00fce70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0048c0 tx=0x7f06bc009e30 comp rx=0 tx=0).stop 2024-04-12T09:03:34.455 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.451+0000 7f06c81a1700 1 -- 172.21.15.203:0/4226630059 shutdown_connections 2024-04-12T09:03:34.455 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.451+0000 7f06c81a1700 1 --2- 172.21.15.203:0/4226630059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06c00fca60 0x7f06c00fce70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:34.455 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.451+0000 7f06c81a1700 1 -- 172.21.15.203:0/4226630059 >> 172.21.15.203:0/4226630059 conn(0x7f06c00f81c0 msgr2=0x7f06c00fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:34.455 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.451+0000 7f06c81a1700 1 -- 172.21.15.203:0/4226630059 shutdown_connections 2024-04-12T09:03:34.456 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.451+0000 7f06c81a1700 1 -- 172.21.15.203:0/4226630059 wait complete. 2024-04-12T09:03:34.456 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.451+0000 7f06c81a1700 1 Processor -- start 2024-04-12T09:03:34.456 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.452+0000 7f06c81a1700 1 -- start start 2024-04-12T09:03:34.456 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.452+0000 7f06c81a1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06c00fca60 0x7f06c010d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:34.456 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.452+0000 7f06c81a1700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c010d5d0 con 0x7f06c00fca60 2024-04-12T09:03:34.456 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.452+0000 7f06c5f3d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06c00fca60 0x7f06c010d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:34.456 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.452+0000 7f06c5f3d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06c00fca60 0x7f06c010d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.203:44988/0 (socket says 172.21.15.203:44988) 2024-04-12T09:03:34.456 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.452+0000 7f06c5f3d700 1 -- 172.21.15.203:0/3141002866 learned_addr learned my addr 172.21.15.203:0/3141002866 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-12T09:03:34.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.452+0000 7f06c5f3d700 1 -- 172.21.15.203:0/3141002866 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06bc005040 con 0x7f06c00fca60 2024-04-12T09:03:34.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.452+0000 7f06c5f3d700 1 --2- 172.21.15.203:0/3141002866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06c00fca60 0x7f06c010d090 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0096b0 tx=0x7f06bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:34.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.453+0000 7f06b67fc700 1 -- 172.21.15.203:0/3141002866 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f06bc00bed0 con 0x7f06c00fca60 2024-04-12T09:03:34.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.453+0000 7f06c81a1700 1 -- 172.21.15.203:0/3141002866 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c010d7d0 con 0x7f06c00fca60 2024-04-12T09:03:34.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.453+0000 7f06b67fc700 1 -- 172.21.15.203:0/3141002866 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f06bc00b5c0 con 0x7f06c00fca60 2024-04-12T09:03:34.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.453+0000 7f06b67fc700 1 -- 172.21.15.203:0/3141002866 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f06bc01c5b0 con 0x7f06c00fca60 2024-04-12T09:03:34.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.453+0000 7f06c81a1700 1 -- 172.21.15.203:0/3141002866 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c010e340 con 0x7f06c00fca60 2024-04-12T09:03:34.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.453+0000 7f06b67fc700 1 -- 172.21.15.203:0/3141002866 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7f06bc01c820 con 0x7f06c00fca60 2024-04-12T09:03:34.457 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.454+0000 7f06b67fc700 1 --2- 172.21.15.203:0/3141002866 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f06ac036970 0x7f06ac038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:34.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.454+0000 7f06b67fc700 1 -- 172.21.15.203:0/3141002866 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f06bc049d20 con 0x7f06c00fca60 2024-04-12T09:03:34.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.454+0000 7f06c81a1700 1 -- 172.21.15.203:0/3141002866 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c0102f70 con 0x7f06c00fca60 2024-04-12T09:03:34.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.454+0000 7f06c573c700 1 --2- 172.21.15.203:0/3141002866 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f06ac036970 0x7f06ac038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:34.458 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.454+0000 7f06c573c700 1 --2- 172.21.15.203:0/3141002866 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f06ac036970 0x7f06ac038e20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f06b0009990 tx=0x7f06b0006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:34.459 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.459+0000 7f06b67fc700 1 -- 172.21.15.203:0/3141002866 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f06bc023300 con 0x7f06c00fca60 2024-04-12T09:03:34.730 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.729+0000 7f06c81a1700 1 -- 172.21.15.203:0/3141002866 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f06c005f5f0 con 0x7f06c00fca60 2024-04-12T09:03:34.731 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.730+0000 7f06b67fc700 1 -- 172.21.15.203:0/3141002866 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f06bc011b60 con 0x7f06c00fca60 2024-04-12T09:03:34.731 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T09:03:34.731 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"12161984-f8ab-11ee-bc8c-c7b262605968","modified":"2024-04-12T09:01:20.152816Z","created":"2024-04-12T09:01:20.152816Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi117","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T09:03:34.732 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.732+0000 7f06c81a1700 1 -- 172.21.15.203:0/3141002866 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f06ac036970 msgr2=0x7f06ac038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:34.733 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.732+0000 7f06c81a1700 1 --2- 172.21.15.203:0/3141002866 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f06ac036970 0x7f06ac038e20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f06b0009990 tx=0x7f06b0006e40 comp rx=0 tx=0).stop 2024-04-12T09:03:34.733 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.732+0000 7f06c81a1700 1 -- 172.21.15.203:0/3141002866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06c00fca60 msgr2=0x7f06c010d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:34.733 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.732+0000 7f06c81a1700 1 --2- 172.21.15.203:0/3141002866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06c00fca60 0x7f06c010d090 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0096b0 tx=0x7f06bc009e30 comp rx=0 tx=0).stop 2024-04-12T09:03:34.733 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.732+0000 7f06c81a1700 1 -- 172.21.15.203:0/3141002866 shutdown_connections 2024-04-12T09:03:34.733 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.732+0000 7f06c81a1700 1 --2- 172.21.15.203:0/3141002866 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f06ac036970 0x7f06ac038e20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:34.733 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.732+0000 7f06c81a1700 1 --2- 172.21.15.203:0/3141002866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06c00fca60 0x7f06c010d090 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:34.733 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.732+0000 7f06c81a1700 1 -- 172.21.15.203:0/3141002866 >> 172.21.15.203:0/3141002866 conn(0x7f06c00f81c0 msgr2=0x7f06c0103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:34.733 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.732+0000 7f06c81a1700 1 -- 172.21.15.203:0/3141002866 shutdown_connections 2024-04-12T09:03:34.733 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:34.732+0000 7f06c81a1700 1 -- 172.21.15.203:0/3141002866 wait complete. 2024-04-12T09:03:34.733 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-04-12T09:03:35.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:35 smithi117 ceph-mon[29277]: mgrmap e17: smithi117.oyaxql(active, since 2s) 2024-04-12T09:03:35.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:35 smithi117 ceph-mon[29277]: from='client.? 172.21.15.203:0/3141002866' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:36.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:36.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:36.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:36.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:36.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd/host:smithi117", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:03:36.954 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T09:03:36.954 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T09:03:37.643 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:03:37.692 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-12T09:03:38.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:38 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:38.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:38 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:38.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:38 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:38.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:38 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:38.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:38 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd/host:smithi203", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:03:38.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:38 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:03:38.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:38 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:03:38.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:38 smithi117 ceph-mon[29277]: Updating smithi117:/etc/ceph/ceph.conf 2024-04-12T09:03:38.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:38 smithi117 ceph-mon[29277]: Updating smithi203:/etc/ceph/ceph.conf 2024-04-12T09:03:39.295 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.294+0000 7f117377c700 1 -- 172.21.15.203:0/1090339518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f116c1019d0 msgr2=0x7f116c101da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:39.295 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.294+0000 7f117377c700 1 --2- 172.21.15.203:0/1090339518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f116c1019d0 0x7f116c101da0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f11680048c0 tx=0x7f1168009e30 comp rx=0 tx=0).stop 2024-04-12T09:03:39.295 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.294+0000 7f117377c700 1 -- 172.21.15.203:0/1090339518 shutdown_connections 2024-04-12T09:03:39.295 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.294+0000 7f117377c700 1 --2- 172.21.15.203:0/1090339518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f116c1019d0 0x7f116c101da0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:39.295 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.294+0000 7f117377c700 1 -- 172.21.15.203:0/1090339518 >> 172.21.15.203:0/1090339518 conn(0x7f116c071800 msgr2=0x7f116c071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:39.295 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.294+0000 7f117377c700 1 -- 172.21.15.203:0/1090339518 shutdown_connections 2024-04-12T09:03:39.295 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.294+0000 7f117377c700 1 -- 172.21.15.203:0/1090339518 wait complete. 2024-04-12T09:03:39.297 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.295+0000 7f117377c700 1 Processor -- start 2024-04-12T09:03:39.297 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.295+0000 7f117377c700 1 -- start start 2024-04-12T09:03:39.297 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.295+0000 7f117377c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f116c1019d0 0x7f116c10e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:39.297 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.295+0000 7f117377c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116c065fe0 con 0x7f116c1019d0 2024-04-12T09:03:39.297 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.296+0000 7f1171518700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f116c1019d0 0x7f116c10e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:39.297 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.296+0000 7f1171518700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f116c1019d0 0x7f116c10e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.203:57158/0 (socket says 172.21.15.203:57158) 2024-04-12T09:03:39.297 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.296+0000 7f1171518700 1 -- 172.21.15.203:0/2672143993 learned_addr learned my addr 172.21.15.203:0/2672143993 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-12T09:03:39.297 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.296+0000 7f1171518700 1 -- 172.21.15.203:0/2672143993 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1168005040 con 0x7f116c1019d0 2024-04-12T09:03:39.297 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.296+0000 7f1171518700 1 --2- 172.21.15.203:0/2672143993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f116c1019d0 0x7f116c10e290 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f116800b820 tx=0x7f1168009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:39.297 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.296+0000 7f1161ffb700 1 -- 172.21.15.203:0/2672143993 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f11680093c0 con 0x7f116c1019d0 2024-04-12T09:03:39.298 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.296+0000 7f117377c700 1 -- 172.21.15.203:0/2672143993 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f116c10e7d0 con 0x7f116c1019d0 2024-04-12T09:03:39.298 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.296+0000 7f1161ffb700 1 -- 172.21.15.203:0/2672143993 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1168013420 con 0x7f116c1019d0 2024-04-12T09:03:39.298 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.296+0000 7f1161ffb700 1 -- 172.21.15.203:0/2672143993 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f116801c5b0 con 0x7f116c1019d0 2024-04-12T09:03:39.298 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.296+0000 7f117377c700 1 -- 172.21.15.203:0/2672143993 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f116c10ecc0 con 0x7f116c1019d0 2024-04-12T09:03:39.299 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.297+0000 7f1161ffb700 1 -- 172.21.15.203:0/2672143993 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7f116801c7f0 con 0x7f116c1019d0 2024-04-12T09:03:39.299 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.297+0000 7f117377c700 1 -- 172.21.15.203:0/2672143993 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f116c10ef00 con 0x7f116c1019d0 2024-04-12T09:03:39.299 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.298+0000 7f1161ffb700 1 --2- 172.21.15.203:0/2672143993 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f1158036970 0x7f1158038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:39.299 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.298+0000 7f1161ffb700 1 -- 172.21.15.203:0/2672143993 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f1168049b70 con 0x7f116c1019d0 2024-04-12T09:03:39.299 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.298+0000 7f1170d17700 1 --2- 172.21.15.203:0/2672143993 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f1158036970 0x7f1158038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:39.299 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.298+0000 7f1170d17700 1 --2- 172.21.15.203:0/2672143993 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f1158036970 0x7f1158038e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f115c009990 tx=0x7f115c006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:39.303 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.303+0000 7f1161ffb700 1 -- 172.21.15.203:0/2672143993 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f1168023300 con 0x7f116c1019d0 2024-04-12T09:03:39.594 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.593+0000 7f117377c700 1 -- 172.21.15.203:0/2672143993 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f116c102ad0 con 0x7f116c1019d0 2024-04-12T09:03:39.594 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.594+0000 7f1161ffb700 1 -- 172.21.15.203:0/2672143993 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f116c102ad0 con 0x7f116c1019d0 2024-04-12T09:03:39.594 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T09:03:39.595 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"12161984-f8ab-11ee-bc8c-c7b262605968","modified":"2024-04-12T09:01:20.152816Z","created":"2024-04-12T09:01:20.152816Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi117","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T09:03:39.596 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.596+0000 7f117377c700 1 -- 172.21.15.203:0/2672143993 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f1158036970 msgr2=0x7f1158038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:39.596 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.596+0000 7f117377c700 1 --2- 172.21.15.203:0/2672143993 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f1158036970 0x7f1158038e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f115c009990 tx=0x7f115c006e40 comp rx=0 tx=0).stop 2024-04-12T09:03:39.596 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.596+0000 7f117377c700 1 -- 172.21.15.203:0/2672143993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f116c1019d0 msgr2=0x7f116c10e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:39.597 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.596+0000 7f117377c700 1 --2- 172.21.15.203:0/2672143993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f116c1019d0 0x7f116c10e290 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f116800b820 tx=0x7f1168009e30 comp rx=0 tx=0).stop 2024-04-12T09:03:39.597 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.596+0000 7f117377c700 1 -- 172.21.15.203:0/2672143993 shutdown_connections 2024-04-12T09:03:39.597 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.596+0000 7f117377c700 1 --2- 172.21.15.203:0/2672143993 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f1158036970 0x7f1158038e20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:39.597 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.596+0000 7f117377c700 1 --2- 172.21.15.203:0/2672143993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f116c1019d0 0x7f116c10e290 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:39.597 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.596+0000 7f117377c700 1 -- 172.21.15.203:0/2672143993 >> 172.21.15.203:0/2672143993 conn(0x7f116c071800 msgr2=0x7f116c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:39.597 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.596+0000 7f117377c700 1 -- 172.21.15.203:0/2672143993 shutdown_connections 2024-04-12T09:03:39.597 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:39.596+0000 7f117377c700 1 -- 172.21.15.203:0/2672143993 wait complete. 2024-04-12T09:03:39.597 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-04-12T09:03:39.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:39 smithi117 ceph-mon[29277]: Updating smithi117:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T09:03:39.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:39 smithi117 ceph-mon[29277]: Updating smithi203:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T09:03:39.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:39 smithi117 ceph-mon[29277]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2024-04-12T09:03:39.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:39 smithi117 ceph-mon[29277]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-04-12T09:03:39.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:39 smithi117 ceph-mon[29277]: Updating smithi117:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T09:03:39.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:39 smithi117 ceph-mon[29277]: Updating smithi203:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T09:03:39.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:39 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:39.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:39 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:39.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:39 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:39.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:39 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:39.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:39 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:39.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:39 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi203", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T09:03:39.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:39 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi203", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-12T09:03:39.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:39 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:03:39.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:39 smithi117 ceph-mon[29277]: Deploying daemon crash.smithi203 on smithi203 2024-04-12T09:03:39.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:39 smithi117 ceph-mon[29277]: from='client.? 172.21.15.203:0/2672143993' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:42.026 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T09:03:42.027 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T09:03:42.305 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T09:03:43.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:42 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:43.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:42 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:43.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:42 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:43.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:42 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:43.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:42 smithi117 ceph-mon[29277]: Deploying daemon node-exporter.smithi203 on smithi203 2024-04-12T09:03:43.790 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.788+0000 7fa07c355700 1 -- 172.21.15.203:0/2047885383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa074102a60 msgr2=0x7fa074102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:43.790 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.788+0000 7fa07c355700 1 --2- 172.21.15.203:0/2047885383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa074102a60 0x7fa074102e30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa0700048c0 tx=0x7fa070009e30 comp rx=0 tx=0).stop 2024-04-12T09:03:43.790 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.788+0000 7fa07c355700 1 -- 172.21.15.203:0/2047885383 shutdown_connections 2024-04-12T09:03:43.790 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.788+0000 7fa07c355700 1 --2- 172.21.15.203:0/2047885383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa074102a60 0x7fa074102e30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:43.790 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.788+0000 7fa07c355700 1 -- 172.21.15.203:0/2047885383 >> 172.21.15.203:0/2047885383 conn(0x7fa0740f85a0 msgr2=0x7fa0740fa9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:43.790 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.788+0000 7fa07c355700 1 -- 172.21.15.203:0/2047885383 shutdown_connections 2024-04-12T09:03:43.790 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.788+0000 7fa07c355700 1 -- 172.21.15.203:0/2047885383 wait complete. 2024-04-12T09:03:43.790 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.788+0000 7fa07c355700 1 Processor -- start 2024-04-12T09:03:43.790 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.788+0000 7fa07c355700 1 -- start start 2024-04-12T09:03:43.790 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.788+0000 7fa07c355700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa074102a60 0x7fa0741130c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:43.790 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.788+0000 7fa07c355700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa074113600 con 0x7fa074102a60 2024-04-12T09:03:43.791 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.789+0000 7fa07a0f1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa074102a60 0x7fa0741130c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:43.791 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.789+0000 7fa07a0f1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa074102a60 0x7fa0741130c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.203:57192/0 (socket says 172.21.15.203:57192) 2024-04-12T09:03:43.791 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.789+0000 7fa07a0f1700 1 -- 172.21.15.203:0/943540718 learned_addr learned my addr 172.21.15.203:0/943540718 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-12T09:03:43.791 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.789+0000 7fa07a0f1700 1 -- 172.21.15.203:0/943540718 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa070005040 con 0x7fa074102a60 2024-04-12T09:03:43.791 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.789+0000 7fa07a0f1700 1 --2- 172.21.15.203:0/943540718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa074102a60 0x7fa0741130c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa07000b820 tx=0x7fa070009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:43.791 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.789+0000 7fa06affd700 1 -- 172.21.15.203:0/943540718 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa0700093c0 con 0x7fa074102a60 2024-04-12T09:03:43.791 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.789+0000 7fa07c355700 1 -- 172.21.15.203:0/943540718 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa074113800 con 0x7fa074102a60 2024-04-12T09:03:43.791 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.789+0000 7fa06affd700 1 -- 172.21.15.203:0/943540718 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa070013420 con 0x7fa074102a60 2024-04-12T09:03:43.791 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.789+0000 7fa06affd700 1 -- 172.21.15.203:0/943540718 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa07001c5b0 con 0x7fa074102a60 2024-04-12T09:03:43.791 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.789+0000 7fa07c355700 1 -- 172.21.15.203:0/943540718 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa074113cf0 con 0x7fa074102a60 2024-04-12T09:03:43.792 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.790+0000 7fa06affd700 1 -- 172.21.15.203:0/943540718 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7fa070009520 con 0x7fa074102a60 2024-04-12T09:03:43.792 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.790+0000 7fa06affd700 1 --2- 172.21.15.203:0/943540718 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fa060036970 0x7fa060038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:43.792 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.791+0000 7fa06affd700 1 -- 172.21.15.203:0/943540718 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fa070049a50 con 0x7fa074102a60 2024-04-12T09:03:43.792 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.791+0000 7fa07c355700 1 -- 172.21.15.203:0/943540718 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0740fe160 con 0x7fa074102a60 2024-04-12T09:03:43.792 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.791+0000 7fa0798f0700 1 --2- 172.21.15.203:0/943540718 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fa060036970 0x7fa060038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:43.792 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.791+0000 7fa0798f0700 1 --2- 172.21.15.203:0/943540718 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fa060036970 0x7fa060038e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa064009990 tx=0x7fa064006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:43.796 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:43.796+0000 7fa06affd700 1 -- 172.21.15.203:0/943540718 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fa070013a90 con 0x7fa074102a60 2024-04-12T09:03:44.114 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T09:03:44.115 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"12161984-f8ab-11ee-bc8c-c7b262605968","modified":"2024-04-12T09:01:20.152816Z","created":"2024-04-12T09:01:20.152816Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi117","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T09:03:44.115 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:44.113+0000 7fa07c355700 1 -- 172.21.15.203:0/943540718 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa074106d50 con 0x7fa074102a60 2024-04-12T09:03:44.115 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:44.114+0000 7fa06affd700 1 -- 172.21.15.203:0/943540718 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fa070011370 con 0x7fa074102a60 2024-04-12T09:03:44.116 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:44.116+0000 7fa07c355700 1 -- 172.21.15.203:0/943540718 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fa060036970 msgr2=0x7fa060038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:44.116 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:44.116+0000 7fa07c355700 1 --2- 172.21.15.203:0/943540718 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fa060036970 0x7fa060038e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa064009990 tx=0x7fa064006e40 comp rx=0 tx=0).stop 2024-04-12T09:03:44.116 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:44.116+0000 7fa07c355700 1 -- 172.21.15.203:0/943540718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa074102a60 msgr2=0x7fa0741130c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:44.116 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:44.116+0000 7fa07c355700 1 --2- 172.21.15.203:0/943540718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa074102a60 0x7fa0741130c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa07000b820 tx=0x7fa070009e30 comp rx=0 tx=0).stop 2024-04-12T09:03:44.117 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:44.116+0000 7fa07c355700 1 -- 172.21.15.203:0/943540718 shutdown_connections 2024-04-12T09:03:44.117 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:44.116+0000 7fa07c355700 1 --2- 172.21.15.203:0/943540718 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fa060036970 0x7fa060038e20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:44.117 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:44.116+0000 7fa07c355700 1 --2- 172.21.15.203:0/943540718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa074102a60 0x7fa0741130c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:44.117 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:44.116+0000 7fa07c355700 1 -- 172.21.15.203:0/943540718 >> 172.21.15.203:0/943540718 conn(0x7fa0740f85a0 msgr2=0x7fa0740f9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:44.117 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:44.116+0000 7fa07c355700 1 -- 172.21.15.203:0/943540718 shutdown_connections 2024-04-12T09:03:44.117 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:44.116+0000 7fa07c355700 1 -- 172.21.15.203:0/943540718 wait complete. 2024-04-12T09:03:44.117 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-04-12T09:03:44.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:44 smithi117 ceph-mon[29277]: from='client.? 172.21.15.203:0/943540718' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:45.667 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T09:03:45.667 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T09:03:46.020 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T09:03:47.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:47 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:47.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:47 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:03:48.335 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.333+0000 7f34ed93f700 1 -- 172.21.15.203:0/3418716095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34e8102ae0 msgr2=0x7f34e8102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:48.335 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.333+0000 7f34ed93f700 1 --2- 172.21.15.203:0/3418716095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34e8102ae0 0x7f34e8102eb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f34d80048c0 tx=0x7f34d8009e30 comp rx=0 tx=0).stop 2024-04-12T09:03:48.335 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.334+0000 7f34ed93f700 1 -- 172.21.15.203:0/3418716095 shutdown_connections 2024-04-12T09:03:48.335 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.334+0000 7f34ed93f700 1 --2- 172.21.15.203:0/3418716095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34e8102ae0 0x7f34e8102eb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:48.335 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.334+0000 7f34ed93f700 1 -- 172.21.15.203:0/3418716095 >> 172.21.15.203:0/3418716095 conn(0x7f34e80f85e0 msgr2=0x7f34e80fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:48.335 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.334+0000 7f34ed93f700 1 -- 172.21.15.203:0/3418716095 shutdown_connections 2024-04-12T09:03:48.336 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.334+0000 7f34ed93f700 1 -- 172.21.15.203:0/3418716095 wait complete. 2024-04-12T09:03:48.336 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.334+0000 7f34ed93f700 1 Processor -- start 2024-04-12T09:03:48.336 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.334+0000 7f34ed93f700 1 -- start start 2024-04-12T09:03:48.336 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.334+0000 7f34ed93f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34e8102ae0 0x7f34e80702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:48.336 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.334+0000 7f34ed93f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e8071f60 con 0x7f34e8102ae0 2024-04-12T09:03:48.336 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.335+0000 7f34e6ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34e8102ae0 0x7f34e80702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:48.336 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.335+0000 7f34e6ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34e8102ae0 0x7f34e80702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.203:38970/0 (socket says 172.21.15.203:38970) 2024-04-12T09:03:48.336 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.335+0000 7f34e6ffd700 1 -- 172.21.15.203:0/4127869223 learned_addr learned my addr 172.21.15.203:0/4127869223 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-12T09:03:48.336 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.335+0000 7f34e6ffd700 1 -- 172.21.15.203:0/4127869223 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d8005040 con 0x7f34e8102ae0 2024-04-12T09:03:48.337 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.335+0000 7f34e6ffd700 1 --2- 172.21.15.203:0/4127869223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34e8102ae0 0x7f34e80702c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f34d800b820 tx=0x7f34d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:48.337 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.335+0000 7f34df7fe700 1 -- 172.21.15.203:0/4127869223 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34d80093c0 con 0x7f34e8102ae0 2024-04-12T09:03:48.338 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.335+0000 7f34df7fe700 1 -- 172.21.15.203:0/4127869223 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f34d8013420 con 0x7f34e8102ae0 2024-04-12T09:03:48.338 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.335+0000 7f34df7fe700 1 -- 172.21.15.203:0/4127869223 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34d801c5b0 con 0x7f34e8102ae0 2024-04-12T09:03:48.338 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.335+0000 7f34ed93f700 1 -- 172.21.15.203:0/4127869223 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e8072160 con 0x7f34e8102ae0 2024-04-12T09:03:48.338 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.336+0000 7f34ed93f700 1 -- 172.21.15.203:0/4127869223 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e80709c0 con 0x7f34e8102ae0 2024-04-12T09:03:48.338 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.336+0000 7f34df7fe700 1 -- 172.21.15.203:0/4127869223 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7f34d8013a90 con 0x7f34e8102ae0 2024-04-12T09:03:48.338 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.336+0000 7f34ed93f700 1 -- 172.21.15.203:0/4127869223 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e8101d50 con 0x7f34e8102ae0 2024-04-12T09:03:48.338 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.337+0000 7f34df7fe700 1 --2- 172.21.15.203:0/4127869223 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f34d4036970 0x7f34d4038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:48.338 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.337+0000 7f34df7fe700 1 -- 172.21.15.203:0/4127869223 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f34d8049ae0 con 0x7f34e8102ae0 2024-04-12T09:03:48.338 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.337+0000 7f34dffff700 1 --2- 172.21.15.203:0/4127869223 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f34d4036970 0x7f34d4038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:48.338 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.337+0000 7f34dffff700 1 --2- 172.21.15.203:0/4127869223 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f34d4036970 0x7f34d4038e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f34d0009990 tx=0x7f34d0006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:48.342 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.342+0000 7f34df7fe700 1 -- 172.21.15.203:0/4127869223 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f34d80098a0 con 0x7f34e8102ae0 2024-04-12T09:03:48.616 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.616+0000 7f34ed93f700 1 -- 172.21.15.203:0/4127869223 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f34e80fe1e0 con 0x7f34e8102ae0 2024-04-12T09:03:48.617 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.616+0000 7f34df7fe700 1 -- 172.21.15.203:0/4127869223 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f34d8011370 con 0x7f34e8102ae0 2024-04-12T09:03:48.617 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T09:03:48.617 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"12161984-f8ab-11ee-bc8c-c7b262605968","modified":"2024-04-12T09:01:20.152816Z","created":"2024-04-12T09:01:20.152816Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi117","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-12T09:03:48.619 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.618+0000 7f34ed93f700 1 -- 172.21.15.203:0/4127869223 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f34d4036970 msgr2=0x7f34d4038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:48.619 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.618+0000 7f34ed93f700 1 --2- 172.21.15.203:0/4127869223 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f34d4036970 0x7f34d4038e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f34d0009990 tx=0x7f34d0006e40 comp rx=0 tx=0).stop 2024-04-12T09:03:48.619 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.618+0000 7f34ed93f700 1 -- 172.21.15.203:0/4127869223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34e8102ae0 msgr2=0x7f34e80702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:48.619 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.618+0000 7f34ed93f700 1 --2- 172.21.15.203:0/4127869223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34e8102ae0 0x7f34e80702c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f34d800b820 tx=0x7f34d8009e30 comp rx=0 tx=0).stop 2024-04-12T09:03:48.619 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.619+0000 7f34ed93f700 1 -- 172.21.15.203:0/4127869223 shutdown_connections 2024-04-12T09:03:48.619 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.619+0000 7f34ed93f700 1 --2- 172.21.15.203:0/4127869223 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f34d4036970 0x7f34d4038e20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:48.619 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.619+0000 7f34ed93f700 1 --2- 172.21.15.203:0/4127869223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f34e8102ae0 0x7f34e80702c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:48.619 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.619+0000 7f34ed93f700 1 -- 172.21.15.203:0/4127869223 >> 172.21.15.203:0/4127869223 conn(0x7f34e80f85e0 msgr2=0x7f34e80f9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:48.620 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.619+0000 7f34ed93f700 1 -- 172.21.15.203:0/4127869223 shutdown_connections 2024-04-12T09:03:48.620 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:48.619+0000 7f34ed93f700 1 -- 172.21.15.203:0/4127869223 wait complete. 2024-04-12T09:03:48.620 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-04-12T09:03:49.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:48 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:49.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:48 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:49.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:48 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:49.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:48 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:49.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:48 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi203.apfqpo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T09:03:49.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:48 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi203.apfqpo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-12T09:03:49.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:48 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T09:03:49.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:48 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:03:49.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:48 smithi117 ceph-mon[29277]: Deploying daemon mgr.smithi203.apfqpo on smithi203 2024-04-12T09:03:49.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:48 smithi117 ceph-mon[29277]: from='client.? 172.21.15.203:0/4127869223' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:51.185 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-12T09:03:51.185 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph mon dump -f json 2024-04-12T09:03:52.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:51 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:52.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:51 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:52.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:51 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:52.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:51 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:52.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:51 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T09:03:52.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:51 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:03:52.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:51 smithi117 ceph-mon[29277]: Deploying daemon mon.smithi203 on smithi203 2024-04-12T09:03:52.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:51 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:52.566 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T09:03:53.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:52 smithi117 ceph-mon[29277]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:54.003 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:53 smithi203 systemd[1]: Starting Ceph mon.smithi203 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:03:54.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 podman[36380]: 2024-04-12 09:03:54.335875944 +0000 UTC m=+0.019018485 image pull 21de9b7369ad8457bc44c6aca16b9dfec25bf172fb7b6ebd80f97d4df2005241 quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe 2024-04-12T09:03:54.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 podman[36380]: 2024-04-12 09:03:54.451386562 +0000 UTC m=+0.134529046 container create 17c0db49bb1672879f170ee9dd6cfe8c66d91093a6407979bdee6cf981f83349 (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi203, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, RELEASE=quincy-d3b5060, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-12T09:03:54.723 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.720+0000 7f79c392a700 1 -- 172.21.15.203:0/4025280939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79bc102a80 msgr2=0x7f79bc102e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:54.723 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.720+0000 7f79c392a700 1 --2- 172.21.15.203:0/4025280939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79bc102a80 0x7f79bc102e50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0048c0 tx=0x7f79ac009e30 comp rx=0 tx=0).stop 2024-04-12T09:03:54.723 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.720+0000 7f79c392a700 1 -- 172.21.15.203:0/4025280939 shutdown_connections 2024-04-12T09:03:54.723 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.720+0000 7f79c392a700 1 --2- 172.21.15.203:0/4025280939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79bc102a80 0x7f79bc102e50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:54.723 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.720+0000 7f79c392a700 1 -- 172.21.15.203:0/4025280939 >> 172.21.15.203:0/4025280939 conn(0x7f79bc0f6c30 msgr2=0x7f79bc0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:54.723 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.720+0000 7f79c392a700 1 -- 172.21.15.203:0/4025280939 shutdown_connections 2024-04-12T09:03:54.723 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.720+0000 7f79c392a700 1 -- 172.21.15.203:0/4025280939 wait complete. 2024-04-12T09:03:54.723 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.721+0000 7f79c392a700 1 Processor -- start 2024-04-12T09:03:54.723 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.721+0000 7f79c392a700 1 -- start start 2024-04-12T09:03:54.723 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.721+0000 7f79c392a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79bc102a80 0x7f79bc1131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:54.724 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.721+0000 7f79c392a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79bc113720 con 0x7f79bc102a80 2024-04-12T09:03:54.724 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.722+0000 7f79c16c6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79bc102a80 0x7f79bc1131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:54.724 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.722+0000 7f79c16c6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79bc102a80 0x7f79bc1131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.203:39020/0 (socket says 172.21.15.203:39020) 2024-04-12T09:03:54.724 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.722+0000 7f79c16c6700 1 -- 172.21.15.203:0/483338650 learned_addr learned my addr 172.21.15.203:0/483338650 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-12T09:03:54.724 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.722+0000 7f79c16c6700 1 -- 172.21.15.203:0/483338650 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac005040 con 0x7f79bc102a80 2024-04-12T09:03:54.725 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.722+0000 7f79c16c6700 1 --2- 172.21.15.203:0/483338650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79bc102a80 0x7f79bc1131e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f79ac00b7f0 tx=0x7f79ac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:54.725 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.722+0000 7f79b1ffb700 1 -- 172.21.15.203:0/483338650 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79ac009370 con 0x7f79bc102a80 2024-04-12T09:03:54.725 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.722+0000 7f79c392a700 1 -- 172.21.15.203:0/483338650 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79bc113920 con 0x7f79bc102a80 2024-04-12T09:03:54.725 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.722+0000 7f79b1ffb700 1 -- 172.21.15.203:0/483338650 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f79ac013420 con 0x7f79bc102a80 2024-04-12T09:03:54.726 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.722+0000 7f79b1ffb700 1 -- 172.21.15.203:0/483338650 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f79ac01c5b0 con 0x7f79bc102a80 2024-04-12T09:03:54.726 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.722+0000 7f79c392a700 1 -- 172.21.15.203:0/483338650 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79bc113d90 con 0x7f79bc102a80 2024-04-12T09:03:54.726 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.723+0000 7f79b1ffb700 1 -- 172.21.15.203:0/483338650 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7f79ac0094d0 con 0x7f79bc102a80 2024-04-12T09:03:54.726 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.723+0000 7f79c392a700 1 -- 172.21.15.203:0/483338650 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79bc0fe200 con 0x7f79bc102a80 2024-04-12T09:03:54.726 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.723+0000 7f79b1ffb700 1 --2- 172.21.15.203:0/483338650 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f79a8036970 0x7f79a8038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:03:54.726 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.724+0000 7f79b1ffb700 1 -- 172.21.15.203:0/483338650 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f79ac049ad0 con 0x7f79bc102a80 2024-04-12T09:03:54.726 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.724+0000 7f79c0ec5700 1 --2- 172.21.15.203:0/483338650 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f79a8036970 0x7f79a8038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:03:54.726 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.724+0000 7f79c0ec5700 1 --2- 172.21.15.203:0/483338650 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f79a8036970 0x7f79a8038e20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009990 tx=0x7f79b8006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:03:54.730 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.729+0000 7f79b1ffb700 1 -- 172.21.15.203:0/483338650 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f79ac013a70 con 0x7f79bc102a80 2024-04-12T09:03:54.841 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 podman[36380]: 2024-04-12 09:03:54.813382862 +0000 UTC m=+0.496525362 container init 17c0db49bb1672879f170ee9dd6cfe8c66d91093a6407979bdee6cf981f83349 (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi203, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, RELEASE=quincy-d3b5060, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-04-12T09:03:54.841 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 podman[36380]: 2024-04-12 09:03:54.816565932 +0000 UTC m=+0.499708417 container start 17c0db49bb1672879f170ee9dd6cfe8c66d91093a6407979bdee6cf981f83349 (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi203, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=quincy-d3b5060, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux ) 2024-04-12T09:03:54.841 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: set uid:gid to 167:167 (ceph:ceph) 2024-04-12T09:03:54.841 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable), process ceph-mon, pid 2 2024-04-12T09:03:54.841 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pidfile_write: ignore empty --pid-file 2024-04-12T09:03:54.841 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: load: jerasure load: lrc 2024-04-12T09:03:54.877 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:54.875+0000 7f79b1ffb700 1 -- 172.21.15.203:0/483338650 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79ac04e020 con 0x7f79bc102a80 2024-04-12T09:03:55.020 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:55.019+0000 7f79c392a700 1 -- 172.21.15.203:0/483338650 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f79bc0fe200 con 0x7f79bc102a80 2024-04-12T09:03:55.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:54 smithi117 ceph-mon[29277]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.223 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: RocksDB version: 6.15.5 2024-04-12T09:03:55.223 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-04-12T09:03:55.223 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Compile date Apr 9 2024 2024-04-12T09:03:55.224 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: DB SUMMARY 2024-04-12T09:03:55.224 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: DB Session ID: 2W9PUE7AOCWAEBDRKKPG 2024-04-12T09:03:55.224 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: CURRENT file: CURRENT 2024-04-12T09:03:55.224 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: IDENTITY file: IDENTITY 2024-04-12T09:03:55.224 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2024-04-12T09:03:55.224 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi203/store.db dir, Total Num: 0, files: 2024-04-12T09:03:55.224 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi203/store.db: 000004.log size: 511 ; 2024-04-12T09:03:55.225 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.error_if_exists: 0 2024-04-12T09:03:55.225 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.create_if_missing: 0 2024-04-12T09:03:55.225 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.paranoid_checks: 1 2024-04-12T09:03:55.225 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-12T09:03:55.225 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.env: 0x55704e540a80 2024-04-12T09:03:55.225 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.fs: Posix File System 2024-04-12T09:03:55.225 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.info_log: 0x55704fb9bc00 2024-04-12T09:03:55.226 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_file_opening_threads: 16 2024-04-12T09:03:55.226 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.statistics: (nil) 2024-04-12T09:03:55.226 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.use_fsync: 0 2024-04-12T09:03:55.226 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_log_file_size: 0 2024-04-12T09:03:55.226 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-12T09:03:55.226 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-12T09:03:55.227 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.keep_log_file_num: 1000 2024-04-12T09:03:55.227 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.recycle_log_file_num: 0 2024-04-12T09:03:55.227 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.allow_fallocate: 1 2024-04-12T09:03:55.227 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.allow_mmap_reads: 0 2024-04-12T09:03:55.227 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.allow_mmap_writes: 0 2024-04-12T09:03:55.227 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.use_direct_reads: 0 2024-04-12T09:03:55.227 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-12T09:03:55.227 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.create_missing_column_families: 0 2024-04-12T09:03:55.228 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.db_log_dir: 2024-04-12T09:03:55.228 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi203/store.db 2024-04-12T09:03:55.228 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-12T09:03:55.228 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-12T09:03:55.228 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-12T09:03:55.228 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-12T09:03:55.228 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-12T09:03:55.228 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-12T09:03:55.228 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.advise_random_on_open: 1 2024-04-12T09:03:55.228 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.db_write_buffer_size: 0 2024-04-12T09:03:55.228 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.write_buffer_manager: 0x557050910990 2024-04-12T09:03:55.229 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-12T09:03:55.229 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-04-12T09:03:55.229 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-12T09:03:55.229 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-12T09:03:55.229 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.rate_limiter: (nil) 2024-04-12T09:03:55.229 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-12T09:03:55.229 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.wal_recovery_mode: 2 2024-04-12T09:03:55.229 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.enable_thread_tracking: 0 2024-04-12T09:03:55.229 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.enable_pipelined_write: 0 2024-04-12T09:03:55.229 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.unordered_write: 0 2024-04-12T09:03:55.229 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-12T09:03:55.230 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-12T09:03:55.230 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-12T09:03:55.230 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-12T09:03:55.230 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.row_cache: None 2024-04-12T09:03:55.230 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.wal_filter: None 2024-04-12T09:03:55.230 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-12T09:03:55.230 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.allow_ingest_behind: 0 2024-04-12T09:03:55.230 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.preserve_deletes: 0 2024-04-12T09:03:55.230 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.two_write_queues: 0 2024-04-12T09:03:55.230 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.manual_wal_flush: 0 2024-04-12T09:03:55.230 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.atomic_flush: 0 2024-04-12T09:03:55.230 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-12T09:03:55.231 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-12T09:03:55.231 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-12T09:03:55.231 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.log_readahead_size: 0 2024-04-12T09:03:55.231 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-12T09:03:55.231 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.best_efforts_recovery: 0 2024-04-12T09:03:55.231 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-12T09:03:55.231 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-12T09:03:55.231 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.allow_data_in_errors: 0 2024-04-12T09:03:55.231 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.db_host_id: __hostname__ 2024-04-12T09:03:55.231 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_background_jobs: 2 2024-04-12T09:03:55.232 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_background_compactions: -1 2024-04-12T09:03:55.232 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_subcompactions: 1 2024-04-12T09:03:55.232 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-12T09:03:55.232 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-12T09:03:55.232 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-12T09:03:55.232 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_total_wal_size: 0 2024-04-12T09:03:55.232 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-12T09:03:55.232 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-12T09:03:55.232 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-12T09:03:55.232 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-12T09:03:55.232 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_open_files: -1 2024-04-12T09:03:55.232 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.bytes_per_sync: 0 2024-04-12T09:03:55.232 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-12T09:03:55.232 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-12T09:03:55.233 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.compaction_readahead_size: 0 2024-04-12T09:03:55.233 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_background_flushes: -1 2024-04-12T09:03:55.233 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Compression algorithms supported: 2024-04-12T09:03:55.233 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-12T09:03:55.233 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: kZSTD supported: 0 2024-04-12T09:03:55.233 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: kXpressCompression supported: 0 2024-04-12T09:03:55.233 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: kLZ4HCCompression supported: 1 2024-04-12T09:03:55.233 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: kZlibCompression supported: 1 2024-04-12T09:03:55.233 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: kSnappyCompression supported: 1 2024-04-12T09:03:55.233 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: kLZ4Compression supported: 1 2024-04-12T09:03:55.233 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: kBZip2Compression supported: 0 2024-04-12T09:03:55.233 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-12T09:03:55.233 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi203/store.db/MANIFEST-000003 2024-04-12T09:03:55.233 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-04-12T09:03:55.234 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-12T09:03:55.234 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.merge_operator: 2024-04-12T09:03:55.234 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.compaction_filter: None 2024-04-12T09:03:55.234 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.compaction_filter_factory: None 2024-04-12T09:03:55.234 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.sst_partitioner_factory: None 2024-04-12T09:03:55.234 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-12T09:03:55.234 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-12T09:03:55.234 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55704fbf0f58) 2024-04-12T09:03:55.234 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: cache_index_and_filter_blocks: 1 2024-04-12T09:03:55.234 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-12T09:03:55.234 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-12T09:03:55.234 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: pin_top_level_index_and_filter: 1 2024-04-12T09:03:55.234 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: index_type: 0 2024-04-12T09:03:55.234 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: data_block_index_type: 0 2024-04-12T09:03:55.234 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: index_shortening: 1 2024-04-12T09:03:55.235 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-12T09:03:55.235 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: hash_index_allow_collision: 1 2024-04-12T09:03:55.235 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: checksum: 1 2024-04-12T09:03:55.235 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: no_block_cache: 0 2024-04-12T09:03:55.237 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_cache: 0x55704fc23090 2024-04-12T09:03:55.237 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_cache_name: BinnedLRUCache 2024-04-12T09:03:55.237 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_cache_options: 2024-04-12T09:03:55.237 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: capacity : 536870912 2024-04-12T09:03:55.237 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: num_shard_bits : 4 2024-04-12T09:03:55.237 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: strict_capacity_limit : 0 2024-04-12T09:03:55.237 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: high_pri_pool_ratio: 0.000 2024-04-12T09:03:55.237 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_cache_compressed: (nil) 2024-04-12T09:03:55.238 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: persistent_cache: (nil) 2024-04-12T09:03:55.238 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_size: 4096 2024-04-12T09:03:55.238 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_size_deviation: 10 2024-04-12T09:03:55.238 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_restart_interval: 16 2024-04-12T09:03:55.238 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: index_block_restart_interval: 1 2024-04-12T09:03:55.238 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: metadata_block_size: 4096 2024-04-12T09:03:55.238 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: partition_filters: 0 2024-04-12T09:03:55.238 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: use_delta_encoding: 1 2024-04-12T09:03:55.238 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-04-12T09:03:55.239 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: whole_key_filtering: 1 2024-04-12T09:03:55.239 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: verify_compression: 0 2024-04-12T09:03:55.239 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: read_amp_bytes_per_bit: 0 2024-04-12T09:03:55.239 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: format_version: 4 2024-04-12T09:03:55.239 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: enable_index_compression: 1 2024-04-12T09:03:55.239 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_align: 0 2024-04-12T09:03:55.240 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.write_buffer_size: 33554432 2024-04-12T09:03:55.240 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_write_buffer_number: 2 2024-04-12T09:03:55.240 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.compression: NoCompression 2024-04-12T09:03:55.240 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.bottommost_compression: Disabled 2024-04-12T09:03:55.240 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.prefix_extractor: nullptr 2024-04-12T09:03:55.240 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-12T09:03:55.240 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.num_levels: 7 2024-04-12T09:03:55.240 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-12T09:03:55.240 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-12T09:03:55.240 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-12T09:03:55.240 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-12T09:03:55.240 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-12T09:03:55.240 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-12T09:03:55.241 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-12T09:03:55.241 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-12T09:03:55.241 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-12T09:03:55.241 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-12T09:03:55.241 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-12T09:03:55.241 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.compression_opts.level: 32767 2024-04-12T09:03:55.242 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.compression_opts.strategy: 0 2024-04-12T09:03:55.242 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-12T09:03:55.242 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-12T09:03:55.242 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-12T09:03:55.242 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.compression_opts.enabled: false 2024-04-12T09:03:55.242 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-12T09:03:55.242 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-12T09:03:55.242 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-12T09:03:55.242 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.target_file_size_base: 67108864 2024-04-12T09:03:55.242 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-12T09:03:55.242 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-12T09:03:55.242 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-12T09:03:55.243 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-12T09:03:55.243 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-12T09:03:55.243 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-12T09:03:55.243 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-12T09:03:55.243 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-12T09:03:55.243 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-12T09:03:55.243 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-12T09:03:55.243 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-12T09:03:55.243 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-12T09:03:55.243 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-12T09:03:55.243 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.arena_block_size: 4194304 2024-04-12T09:03:55.243 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-12T09:03:55.243 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-12T09:03:55.243 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-04-12T09:03:55.243 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.disable_auto_compactions: 0 2024-04-12T09:03:55.244 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-12T09:03:55.244 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-12T09:03:55.244 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-12T09:03:55.244 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-12T09:03:55.244 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-12T09:03:55.244 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-12T09:03:55.244 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-12T09:03:55.244 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-12T09:03:55.244 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-12T09:03:55.244 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-12T09:03:55.244 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.table_properties_collectors: 2024-04-12T09:03:55.244 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.inplace_update_support: 0 2024-04-12T09:03:55.244 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-12T09:03:55.244 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-12T09:03:55.245 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-12T09:03:55.245 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-12T09:03:55.245 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.bloom_locality: 0 2024-04-12T09:03:55.245 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.max_successive_merges: 0 2024-04-12T09:03:55.245 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-12T09:03:55.245 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.paranoid_file_checks: 0 2024-04-12T09:03:55.245 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.force_consistency_checks: 1 2024-04-12T09:03:55.245 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.report_bg_io_stats: 0 2024-04-12T09:03:55.245 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.ttl: 2592000 2024-04-12T09:03:55.245 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-12T09:03:55.245 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.enable_blob_files: false 2024-04-12T09:03:55.245 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.min_blob_size: 0 2024-04-12T09:03:55.246 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.blob_file_size: 268435456 2024-04-12T09:03:55.246 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-12T09:03:55.246 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-12T09:03:55.246 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-12T09:03:55.246 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi203/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-12T09:03:55.246 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2024-04-12T09:03:55.246 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2024-04-12T09:03:55.246 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712912634844099, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-12T09:03:55.246 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2024-04-12T09:03:55.246 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-04-12T09:03:55.246 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712912634844563, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1712912634, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "e26883ec-86ff-4a92-9293-4080f1cee69e", "db_session_id": "2W9PUE7AOCWAEBDRKKPG"}} 2024-04-12T09:03:55.247 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2024-04-12T09:03:55.247 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712912634845000, "job": 1, "event": "recovery_finished"} 2024-04-12T09:03:55.247 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi203/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-12T09:03:55.247 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55704fbb7180 2024-04-12T09:03:55.247 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: DB pointer 0x55704fc8c000 2024-04-12T09:03:55.247 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-04-12T09:03:55.247 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-04-12T09:03:55.247 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ** DB Stats ** 2024-04-12T09:03:55.247 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-12T09:03:55.248 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-12T09:03:55.248 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-12T09:03:55.248 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-12T09:03:55.248 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-12T09:03:55.248 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-04-12T09:03:55.248 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-12T09:03:55.248 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-04-12T09:03:55.248 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ** Compaction Stats [default] ** 2024-04-12T09:03:55.248 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-12T09:03:55.248 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-12T09:03:55.248 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.3 0.00 0.00 1 0.000 0 0 2024-04-12T09:03:55.248 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.3 0.00 0.00 1 0.000 0 0 2024-04-12T09:03:55.248 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.3 0.00 0.00 1 0.000 0 0 2024-04-12T09:03:55.248 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-04-12T09:03:55.249 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ** Compaction Stats [default] ** 2024-04-12T09:03:55.249 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-12T09:03:55.249 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-12T09:03:55.249 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.3 0.00 0.00 1 0.000 0 0 2024-04-12T09:03:55.249 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-12T09:03:55.249 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-12T09:03:55.249 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-12T09:03:55.249 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-12T09:03:55.249 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-12T09:03:55.249 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-12T09:03:55.249 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Cumulative compaction: 0.00 GB write, 0.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-12T09:03:55.249 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Interval compaction: 0.00 GB write, 0.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-12T09:03:55.249 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-12T09:03:55.249 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-04-12T09:03:55.250 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-12T09:03:55.250 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-04-12T09:03:55.250 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ** Compaction Stats [default] ** 2024-04-12T09:03:55.250 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-12T09:03:55.250 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-12T09:03:55.250 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.3 0.00 0.00 1 0.000 0 0 2024-04-12T09:03:55.250 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.3 0.00 0.00 1 0.000 0 0 2024-04-12T09:03:55.250 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-04-12T09:03:55.250 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-04-12T09:03:55.250 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ** Compaction Stats [default] ** 2024-04-12T09:03:55.250 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-12T09:03:55.250 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-12T09:03:55.250 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.3 0.00 0.00 1 0.000 0 0 2024-04-12T09:03:55.250 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-12T09:03:55.251 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-12T09:03:55.251 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-12T09:03:55.251 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-12T09:03:55.251 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-12T09:03:55.251 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-12T09:03:55.251 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Cumulative compaction: 0.00 GB write, 0.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-12T09:03:55.251 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-12T09:03:55.251 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-12T09:03:55.251 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-04-12T09:03:55.251 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-12T09:03:55.251 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: mon.smithi203 does not exist in monmap, will attempt to join an existing cluster 2024-04-12T09:03:55.251 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: using public_addr v2:172.21.15.203:0/0 -> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-04-12T09:03:55.251 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: starting mon.smithi203 rank -1 at public addrs [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] at bind addrs [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi203 fsid 12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:03:55.251 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: mon.smithi203@-1(???) e0 preinit fsid 12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:03:55.251 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: mon.smithi203@-1(synchronizing).mds e1 new map 2024-04-12T09:03:55.252 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: mon.smithi203@-1(synchronizing).mds e1 print_map 2024-04-12T09:03:55.252 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: e1 2024-04-12T09:03:55.252 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T09:03:55.252 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:03:55.252 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: legacy client fscid: -1 2024-04-12T09:03:55.252 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-04-12T09:03:55.252 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: No filesystems configured 2024-04-12T09:03:55.252 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: mon.smithi203@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-12T09:03:55.252 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: mon.smithi203@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-12T09:03:55.252 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: mon.smithi203@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-12T09:03:55.252 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: mon.smithi203@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-12T09:03:55.252 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: mon.smithi203@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-12T09:03:55.252 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: mon.smithi203@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-12T09:03:55.253 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: mon.smithi203@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-04-12T09:03:55.253 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: mon.smithi203@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-12T09:03:55.253 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: mon.smithi203@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-12T09:03:55.253 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: mon.smithi203@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-12T09:03:55.253 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: mon.smithi203@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-12T09:03:55.253 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: Deploying cephadm binary to smithi203 2024-04-12T09:03:55.253 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.253 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.253 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.253 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: Added host smithi203 2024-04-12T09:03:55.253 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.253 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.253 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.254 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.254 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.254 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: Deploying daemon alertmanager.smithi117 on smithi117 2024-04-12T09:03:55.254 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-12T09:03:55.254 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.254 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.255 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.255 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.255 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/2999484496' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-12T09:03:55.255 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/2999484496' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-12T09:03:55.255 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: osdmap e4: 0 total, 0 up, 0 in 2024-04-12T09:03:55.255 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.255 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.255 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi117:172.21.15.117=smithi117;smithi203:172.21.15.203=smithi203", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:03:55.255 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: Saving service mon spec with placement smithi117:172.21.15.117=smithi117;smithi203:172.21.15.203=smithi203;count:2 2024-04-12T09:03:55.255 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.256 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.256 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.256 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.256 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.256 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.256 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.256 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-12T09:03:55.256 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.256 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-12T09:03:55.256 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: Deploying daemon grafana.smithi117 on smithi117 2024-04-12T09:03:55.256 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.256 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='client.? 172.21.15.203:0/766650593' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:55.256 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.257 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.257 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='client.? 172.21.15.203:0/1196688963' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:55.257 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.257 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.257 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='client.? 172.21.15.203:0/1508258401' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:55.257 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.257 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.257 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='client.? 172.21.15.203:0/2006650720' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:55.257 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.257 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.257 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.257 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.257 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.257 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.258 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.258 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: Deploying daemon prometheus.smithi117 on smithi117 2024-04-12T09:03:55.258 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.258 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='client.? 172.21.15.203:0/2332275951' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:55.258 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.258 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.258 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='client.? 172.21.15.203:0/536015364' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:55.258 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.258 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.259 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='client.? 172.21.15.203:0/2073415511' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:55.259 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.259 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.259 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='client.? 172.21.15.203:0/1777529806' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:55.259 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.259 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.259 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.259 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.259 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.259 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-04-12T09:03:55.259 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='client.? 172.21.15.203:0/1552612188' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:55.259 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14162 172.21.15.117:0/3809962115' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-04-12T09:03:55.259 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: mgrmap e14: smithi117.oyaxql(active, since 63s) 2024-04-12T09:03:55.259 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='client.? 172.21.15.203:0/1538157143' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:55.259 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='client.? 172.21.15.203:0/850856167' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:55.260 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: Active manager daemon smithi117.oyaxql restarted 2024-04-12T09:03:55.260 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: Activating manager daemon smithi117.oyaxql 2024-04-12T09:03:55.260 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: osdmap e5: 0 total, 0 up, 0 in 2024-04-12T09:03:55.260 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: mgrmap e15: smithi117.oyaxql(active, starting, since 0.00654168s) 2024-04-12T09:03:55.260 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-04-12T09:03:55.260 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr metadata", "who": "smithi117.oyaxql", "id": "smithi117.oyaxql"}]: dispatch 2024-04-12T09:03:55.260 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-12T09:03:55.260 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-12T09:03:55.260 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-12T09:03:55.260 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: Manager daemon smithi117.oyaxql is now available 2024-04-12T09:03:55.260 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:03:55.260 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:03:55.260 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.260 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:03:55.261 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.oyaxql/mirror_snapshot_schedule"}]: dispatch 2024-04-12T09:03:55.261 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.oyaxql/trash_purge_schedule"}]: dispatch 2024-04-12T09:03:55.261 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: [12/Apr/2024:09:03:31] ENGINE Bus STARTING 2024-04-12T09:03:55.261 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.261 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.261 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: [12/Apr/2024:09:03:31] ENGINE Serving on https://172.21.15.117:7150 2024-04-12T09:03:55.261 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: [12/Apr/2024:09:03:31] ENGINE Bus STARTED 2024-04-12T09:03:55.261 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.261 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: mgrmap e16: smithi117.oyaxql(active, since 1.00762s) 2024-04-12T09:03:55.261 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.261 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: mgrmap e17: smithi117.oyaxql(active, since 2s) 2024-04-12T09:03:55.261 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='client.? 172.21.15.203:0/3141002866' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:55.261 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.261 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.261 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.261 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.262 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd/host:smithi117", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:03:55.262 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.262 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.262 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.262 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.262 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd/host:smithi203", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:03:55.262 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:03:55.262 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:03:55.262 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: Updating smithi117:/etc/ceph/ceph.conf 2024-04-12T09:03:55.262 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: Updating smithi203:/etc/ceph/ceph.conf 2024-04-12T09:03:55.262 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: Updating smithi117:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T09:03:55.262 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: Updating smithi203:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T09:03:55.263 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2024-04-12T09:03:55.263 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-04-12T09:03:55.263 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: Updating smithi117:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T09:03:55.263 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: Updating smithi203:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T09:03:55.263 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.263 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.263 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.263 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.263 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.263 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi203", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T09:03:55.263 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi203", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-12T09:03:55.263 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:03:55.264 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: Deploying daemon crash.smithi203 on smithi203 2024-04-12T09:03:55.264 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='client.? 172.21.15.203:0/2672143993' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:55.264 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.264 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.264 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.264 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.264 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: Deploying daemon node-exporter.smithi203 on smithi203 2024-04-12T09:03:55.264 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='client.? 172.21.15.203:0/943540718' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:55.264 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.264 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:03:55.264 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.264 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.264 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.265 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.265 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi203.apfqpo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T09:03:55.265 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi203.apfqpo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-12T09:03:55.265 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T09:03:55.265 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:03:55.265 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: Deploying daemon mgr.smithi203.apfqpo on smithi203 2024-04-12T09:03:55.265 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='client.? 172.21.15.203:0/4127869223' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:03:55.265 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.265 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.265 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.265 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.265 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T09:03:55.265 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:03:55.266 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: Deploying daemon mon.smithi203 on smithi203 2024-04-12T09:03:55.266 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:03:55.266 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.266 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:03:55.266 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 ceph-mon[36428]: mon.smithi203@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-04-12T09:03:55.266 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 bash[36380]: 17c0db49bb1672879f170ee9dd6cfe8c66d91093a6407979bdee6cf981f83349 2024-04-12T09:03:55.266 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:54 smithi203 systemd[1]: Started Ceph mon.smithi203 for 12161984-f8ab-11ee-bc8c-c7b262605968. 2024-04-12T09:03:59.887 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:59.886+0000 7f79b1ffb700 1 -- 172.21.15.203:0/483338650 <== mon.0 v2:172.21.15.117:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1021 (secure 0 0 0) 0x7f79ac011370 con 0x7f79bc102a80 2024-04-12T09:03:59.888 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-12T09:03:59.888 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":2,"fsid":"12161984-f8ab-11ee-bc8c-c7b262605968","modified":"2024-04-12T09:03:54.876613Z","created":"2024-04-12T09:01:20.152816Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi117","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi203","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:3300","nonce":0},{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-12T09:03:59.890 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:59.889+0000 7f79c392a700 1 -- 172.21.15.203:0/483338650 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f79a8036970 msgr2=0x7f79a8038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:59.890 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:59.889+0000 7f79c392a700 1 --2- 172.21.15.203:0/483338650 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f79a8036970 0x7f79a8038e20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009990 tx=0x7f79b8006e40 comp rx=0 tx=0).stop 2024-04-12T09:03:59.890 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:59.889+0000 7f79c392a700 1 -- 172.21.15.203:0/483338650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79bc102a80 msgr2=0x7f79bc1131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:03:59.890 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:59.889+0000 7f79c392a700 1 --2- 172.21.15.203:0/483338650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79bc102a80 0x7f79bc1131e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f79ac00b7f0 tx=0x7f79ac009e30 comp rx=0 tx=0).stop 2024-04-12T09:03:59.890 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:59.889+0000 7f79c392a700 1 -- 172.21.15.203:0/483338650 shutdown_connections 2024-04-12T09:03:59.891 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:59.889+0000 7f79c392a700 1 --2- 172.21.15.203:0/483338650 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f79a8036970 0x7f79a8038e20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:59.891 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:59.889+0000 7f79c392a700 1 --2- 172.21.15.203:0/483338650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79bc102a80 0x7f79bc1131e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:03:59.891 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:59.889+0000 7f79c392a700 1 -- 172.21.15.203:0/483338650 >> 172.21.15.203:0/483338650 conn(0x7f79bc0f6c30 msgr2=0x7f79bc0f7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:03:59.891 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:59.889+0000 7f79c392a700 1 -- 172.21.15.203:0/483338650 shutdown_connections 2024-04-12T09:03:59.891 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:03:59.889+0000 7f79c392a700 1 -- 172.21.15.203:0/483338650 wait complete. 2024-04-12T09:03:59.891 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 2 2024-04-12T09:04:00.234 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-04-12T09:04:00.234 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:04:00.235 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: mon.smithi117 calling monitor election 2024-04-12T09:04:00.235 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: from='client.? 172.21.15.203:0/483338650' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:04:00.235 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:00.235 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:04:00.235 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:04:00.235 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: mon.smithi203 calling monitor election 2024-04-12T09:04:00.235 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.203:0/1293961444' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.apfqpo/crt"}]: dispatch 2024-04-12T09:04:00.235 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:00.235 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:04:00.235 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:04:00.235 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:00.235 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:04:00.235 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: mon.smithi117 is new leader, mons smithi117,smithi203 in quorum (ranks 0,1) 2024-04-12T09:04:00.235 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: monmap e2: 2 mons at {smithi117=[v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0],smithi203=[v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-12T09:04:00.235 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: fsmap 2024-04-12T09:04:00.236 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: osdmap e5: 0 total, 0 up, 0 in 2024-04-12T09:04:00.236 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: mgrmap e17: smithi117.oyaxql(active, since 28s) 2024-04-12T09:04:00.236 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: overall HEALTH_OK 2024-04-12T09:04:00.236 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: Standby manager daemon smithi203.apfqpo started 2024-04-12T09:04:00.236 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.203:0/1293961444' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T09:04:00.236 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:00.236 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.203:0/1293961444' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.apfqpo/key"}]: dispatch 2024-04-12T09:04:00.236 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.203:0/1293961444' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T09:04:00.236 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:00.236 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:00.236 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:00.236 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:03:59 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:00.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-04-12T09:04:00.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:04:00.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: mon.smithi117 calling monitor election 2024-04-12T09:04:00.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: from='client.? 172.21.15.203:0/483338650' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-12T09:04:00.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:00.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:04:00.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:04:00.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: mon.smithi203 calling monitor election 2024-04-12T09:04:00.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: from='mgr.? 172.21.15.203:0/1293961444' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.apfqpo/crt"}]: dispatch 2024-04-12T09:04:00.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:00.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:04:00.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:04:00.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:00.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:04:00.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: mon.smithi117 is new leader, mons smithi117,smithi203 in quorum (ranks 0,1) 2024-04-12T09:04:00.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: monmap e2: 2 mons at {smithi117=[v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0],smithi203=[v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-12T09:04:00.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: fsmap 2024-04-12T09:04:00.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: osdmap e5: 0 total, 0 up, 0 in 2024-04-12T09:04:00.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: mgrmap e17: smithi117.oyaxql(active, since 28s) 2024-04-12T09:04:00.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: overall HEALTH_OK 2024-04-12T09:04:00.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: Standby manager daemon smithi203.apfqpo started 2024-04-12T09:04:00.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: from='mgr.? 172.21.15.203:0/1293961444' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T09:04:00.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:00.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: from='mgr.? 172.21.15.203:0/1293961444' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.apfqpo/key"}]: dispatch 2024-04-12T09:04:00.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: from='mgr.? 172.21.15.203:0/1293961444' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T09:04:00.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:00.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:00.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:00.413 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:03:59 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:00.516 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-12T09:04:00.516 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph config generate-minimal-conf 2024-04-12T09:04:00.774 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:04:01.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:00 smithi203 ceph-mon[36428]: mgrmap e18: smithi117.oyaxql(active, since 28s), standbys: smithi203.apfqpo 2024-04-12T09:04:01.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:00 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr metadata", "who": "smithi203.apfqpo", "id": "smithi203.apfqpo"}]: dispatch 2024-04-12T09:04:01.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:00 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:04:01.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:00 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:04:01.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:00 smithi117 ceph-mon[29277]: mgrmap e18: smithi117.oyaxql(active, since 28s), standbys: smithi203.apfqpo 2024-04-12T09:04:01.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:00 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr metadata", "who": "smithi203.apfqpo", "id": "smithi203.apfqpo"}]: dispatch 2024-04-12T09:04:01.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:00 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:04:01.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:00 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:04:02.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.078+0000 7fc029705700 1 -- 172.21.15.117:0/1095589392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0241019c0 msgr2=0x7fc024101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:04:02.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.078+0000 7fc029705700 1 --2- 172.21.15.117:0/1095589392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0241019c0 0x7fc024101d90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc0140048c0 tx=0x7fc014009e30 comp rx=0 tx=0).stop 2024-04-12T09:04:02.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.078+0000 7fc029705700 1 -- 172.21.15.117:0/1095589392 shutdown_connections 2024-04-12T09:04:02.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.078+0000 7fc029705700 1 --2- 172.21.15.117:0/1095589392 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0241019c0 0x7fc024101d90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:04:02.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.078+0000 7fc029705700 1 -- 172.21.15.117:0/1095589392 >> 172.21.15.117:0/1095589392 conn(0x7fc0240f74e0 msgr2=0x7fc0240f98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:04:02.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.078+0000 7fc029705700 1 -- 172.21.15.117:0/1095589392 shutdown_connections 2024-04-12T09:04:02.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.078+0000 7fc029705700 1 -- 172.21.15.117:0/1095589392 wait complete. 2024-04-12T09:04:02.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.079+0000 7fc029705700 1 Processor -- start 2024-04-12T09:04:02.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.079+0000 7fc029705700 1 -- start start 2024-04-12T09:04:02.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.079+0000 7fc029705700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0241019c0 0x7fc024112210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:04:02.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.079+0000 7fc029705700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc024112750 0x7fc02410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:04:02.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.079+0000 7fc029705700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc024112d60 con 0x7fc0241019c0 2024-04-12T09:04:02.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.079+0000 7fc029705700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02410c6b0 con 0x7fc024112750 2024-04-12T09:04:02.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.079+0000 7fc022ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0241019c0 0x7fc024112210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:04:02.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.079+0000 7fc022ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0241019c0 0x7fc024112210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33738/0 (socket says 172.21.15.117:33738) 2024-04-12T09:04:02.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.079+0000 7fc022ffd700 1 -- 172.21.15.117:0/1692096958 learned_addr learned my addr 172.21.15.117:0/1692096958 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:04:02.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.079+0000 7fc0227fc700 1 --2- 172.21.15.117:0/1692096958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc024112750 0x7fc02410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:04:02.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.080+0000 7fc0227fc700 1 -- 172.21.15.117:0/1692096958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc024112750 msgr2=0x7fc02410c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-12T09:04:02.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.080+0000 7fc0227fc700 1 -- 172.21.15.117:0/1692096958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc024112750 msgr2=0x7fc02410c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-12T09:04:02.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.080+0000 7fc0227fc700 1 --2- 172.21.15.117:0/1692096958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc024112750 0x7fc02410c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-12T09:04:02.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.080+0000 7fc0227fc700 1 --2- 172.21.15.117:0/1692096958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc024112750 0x7fc02410c170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T09:04:02.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.080+0000 7fc022ffd700 1 -- 172.21.15.117:0/1692096958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc024112750 msgr2=0x7fc02410c170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T09:04:02.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.080+0000 7fc022ffd700 1 --2- 172.21.15.117:0/1692096958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc024112750 0x7fc02410c170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:04:02.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.080+0000 7fc022ffd700 1 -- 172.21.15.117:0/1692096958 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc014005040 con 0x7fc0241019c0 2024-04-12T09:04:02.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.080+0000 7fc022ffd700 1 --2- 172.21.15.117:0/1692096958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0241019c0 0x7fc024112210 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc01400b5c0 tx=0x7fc014009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:04:02.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.080+0000 7fc00b7fe700 1 -- 172.21.15.117:0/1692096958 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc01400e040 con 0x7fc0241019c0 2024-04-12T09:04:02.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.080+0000 7fc00b7fe700 1 -- 172.21.15.117:0/1692096958 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc014009950 con 0x7fc0241019c0 2024-04-12T09:04:02.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.080+0000 7fc029705700 1 -- 172.21.15.117:0/1692096958 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc02410c930 con 0x7fc0241019c0 2024-04-12T09:04:02.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.080+0000 7fc00b7fe700 1 -- 172.21.15.117:0/1692096958 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc01401c3f0 con 0x7fc0241019c0 2024-04-12T09:04:02.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.080+0000 7fc029705700 1 -- 172.21.15.117:0/1692096958 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc02410ce70 con 0x7fc0241019c0 2024-04-12T09:04:02.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.081+0000 7fc029705700 1 -- 172.21.15.117:0/1692096958 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc024100c30 con 0x7fc0241019c0 2024-04-12T09:04:02.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.082+0000 7fc00b7fe700 1 -- 172.21.15.117:0/1692096958 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7fc0140137d0 con 0x7fc0241019c0 2024-04-12T09:04:02.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.082+0000 7fc00b7fe700 1 --2- 172.21.15.117:0/1692096958 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc00c069360 0x7fc00c06b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:04:02.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.082+0000 7fc00b7fe700 1 -- 172.21.15.117:0/1692096958 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fc014087460 con 0x7fc0241019c0 2024-04-12T09:04:02.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.082+0000 7fc0227fc700 1 --2- 172.21.15.117:0/1692096958 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc00c069360 0x7fc00c06b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:04:02.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.082+0000 7fc0227fc700 1 --2- 172.21.15.117:0/1692096958 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc00c069360 0x7fc00c06b810 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc018006f30 tx=0x7fc018008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:04:02.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.087+0000 7fc00b7fe700 1 -- 172.21.15.117:0/1692096958 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fc014058300 con 0x7fc0241019c0 2024-04-12T09:04:02.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:01 smithi117 ceph-mon[29277]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:02.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:01 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:04:02.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:01 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:02.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.294+0000 7fc029705700 1 -- 172.21.15.117:0/1692096958 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fc0240fd0c0 con 0x7fc0241019c0 2024-04-12T09:04:02.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.294+0000 7fc00b7fe700 1 -- 172.21.15.117:0/1692096958 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+227 (secure 0 0 0) 0x7fc014086c10 con 0x7fc0241019c0 2024-04-12T09:04:02.295 INFO:teuthology.orchestra.run.smithi117.stdout:# minimal ceph.conf for 12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:04:02.295 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2024-04-12T09:04:02.295 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = 12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:04:02.295 INFO:teuthology.orchestra.run.smithi117.stdout: mon_host = [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-04-12T09:04:02.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.296+0000 7fc029705700 1 -- 172.21.15.117:0/1692096958 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc00c069360 msgr2=0x7fc00c06b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:04:02.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.296+0000 7fc029705700 1 --2- 172.21.15.117:0/1692096958 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc00c069360 0x7fc00c06b810 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc018006f30 tx=0x7fc018008040 comp rx=0 tx=0).stop 2024-04-12T09:04:02.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.296+0000 7fc029705700 1 -- 172.21.15.117:0/1692096958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0241019c0 msgr2=0x7fc024112210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:04:02.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.296+0000 7fc029705700 1 --2- 172.21.15.117:0/1692096958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0241019c0 0x7fc024112210 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc01400b5c0 tx=0x7fc014009e30 comp rx=0 tx=0).stop 2024-04-12T09:04:02.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.296+0000 7fc029705700 1 -- 172.21.15.117:0/1692096958 shutdown_connections 2024-04-12T09:04:02.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.296+0000 7fc029705700 1 --2- 172.21.15.117:0/1692096958 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc00c069360 0x7fc00c06b810 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:04:02.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.296+0000 7fc029705700 1 --2- 172.21.15.117:0/1692096958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc0241019c0 0x7fc024112210 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:04:02.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.296+0000 7fc029705700 1 --2- 172.21.15.117:0/1692096958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc024112750 0x7fc02410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:04:02.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.296+0000 7fc029705700 1 -- 172.21.15.117:0/1692096958 >> 172.21.15.117:0/1692096958 conn(0x7fc0240f74e0 msgr2=0x7fc0240f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:04:02.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.296+0000 7fc029705700 1 -- 172.21.15.117:0/1692096958 shutdown_connections 2024-04-12T09:04:02.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:02.296+0000 7fc029705700 1 -- 172.21.15.117:0/1692096958 wait complete. 2024-04-12T09:04:02.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:01 smithi203 ceph-mon[36428]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:02.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:01 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:04:02.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:01 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:02.919 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-12T09:04:02.919 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-12T09:04:02.919 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.conf 2024-04-12T09:04:02.949 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-12T09:04:02.950 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-12T09:04:03.016 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-12T09:04:03.017 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/ceph/ceph.conf 2024-04-12T09:04:03.049 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-12T09:04:03.049 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-12T09:04:03.119 INFO:tasks.cephadm:Deploying OSDs... 2024-04-12T09:04:03.119 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-12T09:04:03.119 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2024-04-12T09:04:03.134 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-12T09:04:03.134 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 2024-04-12T09:04:03.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:02 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:03.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:02 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:03.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:02 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:03.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:02 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:04:03.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:02 smithi117 ceph-mon[29277]: Updating smithi117:/etc/ceph/ceph.conf 2024-04-12T09:04:03.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:02 smithi117 ceph-mon[29277]: Updating smithi203:/etc/ceph/ceph.conf 2024-04-12T09:04:03.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:02 smithi117 ceph-mon[29277]: Updating smithi117:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T09:04:03.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:02 smithi117 ceph-mon[29277]: Updating smithi203:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T09:04:03.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:02 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/1692096958' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:03.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:02 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:03.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:02 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:03.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:02 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:03.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:02 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:03.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:02 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:03.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:02 smithi117 ceph-mon[29277]: Reconfiguring mon.smithi117 (unknown last config time)... 2024-04-12T09:04:03.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:02 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T09:04:03.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:02 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-12T09:04:03.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:02 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:03.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:02 smithi117 ceph-mon[29277]: Reconfiguring daemon mon.smithi117 on smithi117 2024-04-12T09:04:03.175 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-12T09:04:03.175 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-12T09:04:03.176 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-12T09:04:03.176 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T09:04:03.176 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-04-12T09:04:03.176 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-04-12 09:03:23.112088657 +0000 2024-04-12T09:04:03.176 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-04-12 08:56:52.384376472 +0000 2024-04-12T09:04:03.176 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-04-12 08:56:52.384376472 +0000 2024-04-12T09:04:03.176 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-04-12 08:56:52.384376472 +0000 2024-04-12T09:04:03.176 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-12T09:04:03.243 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-04-12T09:04:03.243 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-04-12T09:04:03.244 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000192305 s, 2.7 MB/s 2024-04-12T09:04:03.245 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-12T09:04:03.301 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 2024-04-12T09:04:03.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:02 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:03.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:02 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:03.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:02 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:03.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:02 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:04:03.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:02 smithi203 ceph-mon[36428]: Updating smithi117:/etc/ceph/ceph.conf 2024-04-12T09:04:03.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:02 smithi203 ceph-mon[36428]: Updating smithi203:/etc/ceph/ceph.conf 2024-04-12T09:04:03.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:02 smithi203 ceph-mon[36428]: Updating smithi117:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T09:04:03.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:02 smithi203 ceph-mon[36428]: Updating smithi203:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T09:04:03.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:02 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/1692096958' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:03.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:02 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:03.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:02 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:03.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:02 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:03.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:02 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:03.325 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:02 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:03.325 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:02 smithi203 ceph-mon[36428]: Reconfiguring mon.smithi117 (unknown last config time)... 2024-04-12T09:04:03.325 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:02 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T09:04:03.325 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:02 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-12T09:04:03.325 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:02 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:03.325 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:02 smithi203 ceph-mon[36428]: Reconfiguring daemon mon.smithi117 on smithi117 2024-04-12T09:04:03.356 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-12T09:04:03.356 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-12T09:04:03.356 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-12T09:04:03.356 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T09:04:03.357 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-04-12T09:04:03.357 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-04-12 09:03:23.112088657 +0000 2024-04-12T09:04:03.357 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-04-12 08:56:52.736369258 +0000 2024-04-12T09:04:03.357 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-04-12 08:56:52.736369258 +0000 2024-04-12T09:04:03.357 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-04-12 08:56:52.736369258 +0000 2024-04-12T09:04:03.357 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-12T09:04:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-04-12T09:04:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-04-12T09:04:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000200143 s, 2.6 MB/s 2024-04-12T09:04:03.423 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-12T09:04:03.479 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 2024-04-12T09:04:03.535 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-12T09:04:03.535 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-12T09:04:03.535 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-12T09:04:03.535 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T09:04:03.535 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-04-12T09:04:03.536 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-04-12 09:03:23.113088638 +0000 2024-04-12T09:04:03.536 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-04-12 08:56:53.053362760 +0000 2024-04-12T09:04:03.536 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-04-12 08:56:53.053362760 +0000 2024-04-12T09:04:03.536 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-04-12 08:56:53.053362760 +0000 2024-04-12T09:04:03.536 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-12T09:04:03.601 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-04-12T09:04:03.601 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-04-12T09:04:03.601 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000213532 s, 2.4 MB/s 2024-04-12T09:04:03.602 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-12T09:04:03.659 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 2024-04-12T09:04:03.714 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-12T09:04:03.714 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-12T09:04:03.715 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-12T09:04:03.715 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T09:04:03.715 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-04-12T09:04:03.715 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-04-12 09:03:23.113088638 +0000 2024-04-12T09:04:03.715 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-04-12 08:56:53.392355812 +0000 2024-04-12T09:04:03.715 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-04-12 08:56:53.392355812 +0000 2024-04-12T09:04:03.715 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-04-12 08:56:53.392355812 +0000 2024-04-12T09:04:03.715 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-12T09:04:03.781 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-04-12T09:04:03.781 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-04-12T09:04:03.781 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000187204 s, 2.7 MB/s 2024-04-12T09:04:03.782 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-12T09:04:03.837 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-12T09:04:03.838 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/scratch_devs of=/dev/stdout 2024-04-12T09:04:03.856 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-12T09:04:03.857 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_1 2024-04-12T09:04:03.915 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-12T09:04:03.915 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-12T09:04:03.915 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-12T09:04:03.915 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T09:04:03.915 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-04-12T09:04:03.915 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-04-12 09:03:53.816919830 +0000 2024-04-12T09:04:03.915 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-04-12 08:56:52.573523098 +0000 2024-04-12T09:04:03.915 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-04-12 08:56:52.573523098 +0000 2024-04-12T09:04:03.915 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-04-12 08:56:52.573523098 +0000 2024-04-12T09:04:03.916 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-12T09:04:03.986 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-04-12T09:04:03.986 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-04-12T09:04:03.986 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.00027054 s, 1.9 MB/s 2024-04-12T09:04:03.987 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-12T09:04:04.047 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_2 2024-04-12T09:04:04.104 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-12T09:04:04.104 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-12T09:04:04.105 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-12T09:04:04.105 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T09:04:04.105 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-04-12T09:04:04.105 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-04-12 09:03:53.817919805 +0000 2024-04-12T09:04:04.105 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-04-12 08:56:52.900514927 +0000 2024-04-12T09:04:04.105 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-04-12 08:56:52.900514927 +0000 2024-04-12T09:04:04.105 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-04-12 08:56:52.900514927 +0000 2024-04-12T09:04:04.105 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-12T09:04:04.174 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-04-12T09:04:04.174 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-04-12T09:04:04.174 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000233553 s, 2.2 MB/s 2024-04-12T09:04:04.176 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-12T09:04:04.233 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_3 2024-04-12T09:04:04.290 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-12T09:04:04.290 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-12T09:04:04.290 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-12T09:04:04.290 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T09:04:04.290 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-04-12T09:04:04.290 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-04-12 09:03:53.817919805 +0000 2024-04-12T09:04:04.291 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-04-12 08:56:53.242506380 +0000 2024-04-12T09:04:04.291 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-04-12 08:56:53.242506380 +0000 2024-04-12T09:04:04.291 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-04-12 08:56:53.242506380 +0000 2024-04-12T09:04:04.291 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-12T09:04:04.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:03 smithi203 ceph-mon[36428]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:04.350 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-04-12T09:04:04.350 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-04-12T09:04:04.350 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000222849 s, 2.3 MB/s 2024-04-12T09:04:04.351 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-12T09:04:04.409 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_4 2024-04-12T09:04:04.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:03 smithi117 ceph-mon[29277]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:04.465 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-12T09:04:04.465 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-12T09:04:04.465 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-12T09:04:04.465 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T09:04:04.465 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-04-12T09:04:04.465 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-04-12 09:03:53.818919781 +0000 2024-04-12T09:04:04.465 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-04-12 08:56:53.561498407 +0000 2024-04-12T09:04:04.465 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-04-12 08:56:53.561498407 +0000 2024-04-12T09:04:04.465 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-04-12 08:56:53.561498407 +0000 2024-04-12T09:04:04.466 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-12T09:04:04.532 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-04-12T09:04:04.532 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-04-12T09:04:04.532 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000174738 s, 2.9 MB/s 2024-04-12T09:04:04.533 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-12T09:04:04.589 INFO:tasks.cephadm:Deploying osd.0 on smithi117 with /dev/vg_nvme/lv_4... 2024-04-12T09:04:04.589 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-12T09:04:05.071 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:04:05.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:05 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:05.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:05 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:05.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:05 smithi117 ceph-mon[29277]: Reconfiguring mgr.smithi117.oyaxql (unknown last config time)... 2024-04-12T09:04:05.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:05 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi117.oyaxql", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T09:04:05.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:05 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T09:04:05.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:05 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:05.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:05 smithi117 ceph-mon[29277]: Reconfiguring daemon mgr.smithi117.oyaxql on smithi117 2024-04-12T09:04:05.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:05 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:05.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:05 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:05.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:05 smithi203 ceph-mon[36428]: Reconfiguring mgr.smithi117.oyaxql (unknown last config time)... 2024-04-12T09:04:05.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:05 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi117.oyaxql", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T09:04:05.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:05 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T09:04:05.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:05 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:05.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:05 smithi203 ceph-mon[36428]: Reconfiguring daemon mgr.smithi117.oyaxql on smithi117 2024-04-12T09:04:06.459 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:06 smithi117 ceph-mon[29277]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:06.460 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:06 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:06.460 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:06 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:06.460 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:06 smithi117 ceph-mon[29277]: Reconfiguring crash.smithi117 (monmap changed)... 2024-04-12T09:04:06.460 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:06 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi117", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T09:04:06.460 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:06 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:06.460 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:06 smithi117 ceph-mon[29277]: Reconfiguring daemon crash.smithi117 on smithi117 2024-04-12T09:04:06.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:06 smithi203 ceph-mon[36428]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:06.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:06 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:06.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:06 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:06.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:06 smithi203 ceph-mon[36428]: Reconfiguring crash.smithi117 (monmap changed)... 2024-04-12T09:04:06.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:06 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi117", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T09:04:06.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:06 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:06.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:06 smithi203 ceph-mon[36428]: Reconfiguring daemon crash.smithi117 on smithi117 2024-04-12T09:04:07.874 INFO:teuthology.orchestra.run.smithi117.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-12T09:04:07.874 INFO:teuthology.orchestra.run.smithi117.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-12T09:04:07.874 INFO:teuthology.orchestra.run.smithi117.stderr: stderr: 10+0 records in 2024-04-12T09:04:07.874 INFO:teuthology.orchestra.run.smithi117.stderr:10+0 records out 2024-04-12T09:04:07.875 INFO:teuthology.orchestra.run.smithi117.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113866 s, 921 MB/s 2024-04-12T09:04:07.875 INFO:teuthology.orchestra.run.smithi117.stderr:--> Zapping successful for: 2024-04-12T09:04:08.485 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:08 smithi117 ceph-mon[29277]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:08.485 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:08 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:08.485 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:08 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:08.508 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph orch daemon add osd smithi117:vg_nvme/lv_4 2024-04-12T09:04:08.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:08 smithi203 ceph-mon[36428]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:08.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:08 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:08.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:08 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:09.692 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:09 smithi117 ceph-mon[29277]: Reconfiguring alertmanager.smithi117 (dependencies changed)... 2024-04-12T09:04:09.692 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:09 smithi117 ceph-mon[29277]: Reconfiguring daemon alertmanager.smithi117 on smithi117 2024-04-12T09:04:09.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:09 smithi203 ceph-mon[36428]: Reconfiguring alertmanager.smithi117 (dependencies changed)... 2024-04-12T09:04:09.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:09 smithi203 ceph-mon[36428]: Reconfiguring daemon alertmanager.smithi117 on smithi117 2024-04-12T09:04:10.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:10 smithi117 ceph-mon[29277]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:10.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:10 smithi203 ceph-mon[36428]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:11.071 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:04:12.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.466+0000 7f686ce1c700 1 -- 172.21.15.117:0/2504013917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6868066260 msgr2=0x7f68680ffa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:04:12.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.466+0000 7f686ce1c700 1 --2- 172.21.15.117:0/2504013917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6868066260 0x7f68680ffa40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6850004940 tx=0x7f6850009e30 comp rx=0 tx=0).stop 2024-04-12T09:04:12.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.466+0000 7f686ce1c700 1 -- 172.21.15.117:0/2504013917 shutdown_connections 2024-04-12T09:04:12.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.466+0000 7f686ce1c700 1 --2- 172.21.15.117:0/2504013917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68680fff80 0x7f6868102360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:04:12.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.466+0000 7f686ce1c700 1 --2- 172.21.15.117:0/2504013917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6868066260 0x7f68680ffa40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:04:12.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.466+0000 7f686ce1c700 1 -- 172.21.15.117:0/2504013917 >> 172.21.15.117:0/2504013917 conn(0x7f68680f7430 msgr2=0x7f68680f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:04:12.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.466+0000 7f686ce1c700 1 -- 172.21.15.117:0/2504013917 shutdown_connections 2024-04-12T09:04:12.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.466+0000 7f686ce1c700 1 -- 172.21.15.117:0/2504013917 wait complete. 2024-04-12T09:04:12.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.467+0000 7f686ce1c700 1 Processor -- start 2024-04-12T09:04:12.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.467+0000 7f686ce1c700 1 -- start start 2024-04-12T09:04:12.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.467+0000 7f686ce1c700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6868066260 0x7f686810dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:04:12.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.467+0000 7f686ce1c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68680fff80 0x7f686810e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:04:12.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.467+0000 7f686ce1c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686810e690 con 0x7f68680fff80 2024-04-12T09:04:12.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.467+0000 7f686ce1c700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686810ee30 con 0x7f6868066260 2024-04-12T09:04:12.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.467+0000 7f6865d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68680fff80 0x7f686810e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:04:12.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.467+0000 7f6865d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68680fff80 0x7f686810e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42984/0 (socket says 172.21.15.117:42984) 2024-04-12T09:04:12.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.467+0000 7f6865d9b700 1 -- 172.21.15.117:0/32916362 learned_addr learned my addr 172.21.15.117:0/32916362 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:04:12.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.467+0000 7f686659c700 1 --2- 172.21.15.117:0/32916362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6868066260 0x7f686810dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:04:12.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.467+0000 7f6865d9b700 1 -- 172.21.15.117:0/32916362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6868066260 msgr2=0x7f686810dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:04:12.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.467+0000 7f6865d9b700 1 --2- 172.21.15.117:0/32916362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6868066260 0x7f686810dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:04:12.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.467+0000 7f6865d9b700 1 -- 172.21.15.117:0/32916362 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6850005040 con 0x7f68680fff80 2024-04-12T09:04:12.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.467+0000 7f6865d9b700 1 --2- 172.21.15.117:0/32916362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68680fff80 0x7f686810e000 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f685800b790 tx=0x7f6858009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:04:12.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.468+0000 7f685effd700 1 -- 172.21.15.117:0/32916362 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f685800f770 con 0x7f68680fff80 2024-04-12T09:04:12.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.468+0000 7f685effd700 1 -- 172.21.15.117:0/32916362 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f685800fda0 con 0x7f68680fff80 2024-04-12T09:04:12.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.468+0000 7f686ce1c700 1 -- 172.21.15.117:0/32916362 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686810f110 con 0x7f68680fff80 2024-04-12T09:04:12.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.468+0000 7f685effd700 1 -- 172.21.15.117:0/32916362 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f685800d310 con 0x7f68680fff80 2024-04-12T09:04:12.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.468+0000 7f686ce1c700 1 -- 172.21.15.117:0/32916362 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686810f6d0 con 0x7f68680fff80 2024-04-12T09:04:12.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.469+0000 7f686ce1c700 1 -- 172.21.15.117:0/32916362 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686805f5f0 con 0x7f68680fff80 2024-04-12T09:04:12.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.469+0000 7f685effd700 1 -- 172.21.15.117:0/32916362 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7f6858010420 con 0x7f68680fff80 2024-04-12T09:04:12.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.469+0000 7f685effd700 1 --2- 172.21.15.117:0/32916362 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f6854069210 0x7f685406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:04:12.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.469+0000 7f685effd700 1 -- 172.21.15.117:0/32916362 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f68580860a0 con 0x7f68680fff80 2024-04-12T09:04:12.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.470+0000 7f686659c700 1 --2- 172.21.15.117:0/32916362 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f6854069210 0x7f685406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:04:12.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.470+0000 7f686659c700 1 --2- 172.21.15.117:0/32916362 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f6854069210 0x7f685406b6c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f685000b3b0 tx=0x7f6850009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:04:12.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.474+0000 7f685effd700 1 -- 172.21.15.117:0/32916362 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f6858056f40 con 0x7f68680fff80 2024-04-12T09:04:12.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:12.677+0000 7f686ce1c700 1 -- 172.21.15.117:0/32916362 --> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f686810f9c0 con 0x7f6854069210 2024-04-12T09:04:12.694 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:12 smithi117 ceph-mon[29277]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:12.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:12 smithi203 ceph-mon[36428]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:13.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:13 smithi117 ceph-mon[29277]: from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:04:13.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:13 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-12T09:04:13.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:13 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-12T09:04:13.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:13 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:13.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:13 smithi203 ceph-mon[36428]: from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:04:13.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:13 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-12T09:04:13.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:13 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-12T09:04:13.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:13 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:14.514 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:14 smithi117 ceph-mon[29277]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:14.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:14 smithi203 ceph-mon[36428]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:16.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:16 smithi117 ceph-mon[29277]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:16.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:16 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:16.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:16 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:16.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:16 smithi117 ceph-mon[29277]: Reconfiguring grafana.smithi117 (dependencies changed)... 2024-04-12T09:04:16.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:16 smithi117 ceph-mon[29277]: Reconfiguring daemon grafana.smithi117 on smithi117 2024-04-12T09:04:16.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:16 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:04:16.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:16 smithi203 ceph-mon[36428]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:16.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:16 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:16.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:16 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:16.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:16 smithi203 ceph-mon[36428]: Reconfiguring grafana.smithi117 (dependencies changed)... 2024-04-12T09:04:16.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:16 smithi203 ceph-mon[36428]: Reconfiguring daemon grafana.smithi117 on smithi117 2024-04-12T09:04:16.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:16 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:04:17.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:17 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/2090729149' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8bdd258-6f40-440f-b279-038d9b35e791"}]: dispatch 2024-04-12T09:04:17.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:17 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/2090729149' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a8bdd258-6f40-440f-b279-038d9b35e791"}]': finished 2024-04-12T09:04:17.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:17 smithi117 ceph-mon[29277]: osdmap e6: 1 total, 0 up, 1 in 2024-04-12T09:04:17.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:17 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T09:04:17.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:17 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/2739012997' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-12T09:04:17.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:17 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/2090729149' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8bdd258-6f40-440f-b279-038d9b35e791"}]: dispatch 2024-04-12T09:04:17.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:17 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/2090729149' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a8bdd258-6f40-440f-b279-038d9b35e791"}]': finished 2024-04-12T09:04:17.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:17 smithi203 ceph-mon[36428]: osdmap e6: 1 total, 0 up, 1 in 2024-04-12T09:04:17.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:17 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T09:04:17.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:17 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/2739012997' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-12T09:04:18.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:18 smithi203 ceph-mon[36428]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:18.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:18 smithi117 ceph-mon[29277]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:20.773 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:20 smithi117 ceph-mon[29277]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:20.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:20 smithi203 ceph-mon[36428]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:22.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:22 smithi203 ceph-mon[36428]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:22.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:22 smithi117 ceph-mon[29277]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:24.781 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:24 smithi117 ceph-mon[29277]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:24.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:24 smithi203 ceph-mon[36428]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:27.142 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:26 smithi117 ceph-mon[29277]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:27.142 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:26 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:27.142 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:26 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:27.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:26 smithi203 ceph-mon[36428]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:27.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:26 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:27.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:26 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:28.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:27 smithi117 ceph-mon[29277]: Reconfiguring prometheus.smithi117 (dependencies changed)... 2024-04-12T09:04:28.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:27 smithi117 ceph-mon[29277]: Reconfiguring daemon prometheus.smithi117 on smithi117 2024-04-12T09:04:28.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:27 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-12T09:04:28.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:27 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:28.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:27 smithi203 ceph-mon[36428]: Reconfiguring prometheus.smithi117 (dependencies changed)... 2024-04-12T09:04:28.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:27 smithi203 ceph-mon[36428]: Reconfiguring daemon prometheus.smithi117 on smithi117 2024-04-12T09:04:28.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:27 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-12T09:04:28.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:27 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:28.986 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:28 smithi117 ceph-mon[29277]: Deploying daemon osd.0 on smithi117 2024-04-12T09:04:28.986 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:28 smithi117 ceph-mon[29277]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:29.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:28 smithi203 ceph-mon[36428]: Deploying daemon osd.0 on smithi117 2024-04-12T09:04:29.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:28 smithi203 ceph-mon[36428]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:31.118 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:30 smithi117 ceph-mon[29277]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:31.125 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:30 smithi203 ceph-mon[36428]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:31.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:31 smithi117 ceph-mon[29277]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:31.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:31 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:04:31.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:31 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:31.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:31 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:31.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:31 smithi117 ceph-mon[29277]: Reconfiguring crash.smithi203 (monmap changed)... 2024-04-12T09:04:31.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:31 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi203", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T09:04:31.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:31 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:31.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:31 smithi117 ceph-mon[29277]: Reconfiguring daemon crash.smithi203 on smithi203 2024-04-12T09:04:32.177 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:31 smithi203 ceph-mon[36428]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:32.178 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:31 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:04:32.178 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:31 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:32.178 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:31 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:32.178 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:31 smithi203 ceph-mon[36428]: Reconfiguring crash.smithi203 (monmap changed)... 2024-04-12T09:04:32.178 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:31 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi203", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T09:04:32.178 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:31 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:32.178 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:31 smithi203 ceph-mon[36428]: Reconfiguring daemon crash.smithi203 on smithi203 2024-04-12T09:04:34.086 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:33 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:34.086 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:33 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:34.086 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:33 smithi117 ceph-mon[29277]: Reconfiguring mgr.smithi203.apfqpo (monmap changed)... 2024-04-12T09:04:34.086 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:33 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi203.apfqpo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T09:04:34.086 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:33 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T09:04:34.086 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:33 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:34.086 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:33 smithi117 ceph-mon[29277]: Reconfiguring daemon mgr.smithi203.apfqpo on smithi203 2024-04-12T09:04:34.086 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:33 smithi117 ceph-mon[29277]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:34.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:33 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:34.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:33 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:34.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:33 smithi203 ceph-mon[36428]: Reconfiguring mgr.smithi203.apfqpo (monmap changed)... 2024-04-12T09:04:34.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:33 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi203.apfqpo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T09:04:34.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:33 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T09:04:34.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:33 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:34.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:33 smithi203 ceph-mon[36428]: Reconfiguring daemon mgr.smithi203.apfqpo on smithi203 2024-04-12T09:04:34.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:33 smithi203 ceph-mon[36428]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:35.396 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:35 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:35.397 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:35 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:35.397 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:35 smithi203 ceph-mon[36428]: Reconfiguring mon.smithi203 (monmap changed)... 2024-04-12T09:04:35.397 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:35 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T09:04:35.397 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:35 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-12T09:04:35.397 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:35 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:35.397 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:35 smithi203 ceph-mon[36428]: Reconfiguring daemon mon.smithi203 on smithi203 2024-04-12T09:04:35.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:35 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:35.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:35 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:35.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:35 smithi117 ceph-mon[29277]: Reconfiguring mon.smithi203 (monmap changed)... 2024-04-12T09:04:35.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:35 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T09:04:35.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:35 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-12T09:04:35.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:35 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:35.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:35 smithi117 ceph-mon[29277]: Reconfiguring daemon mon.smithi203 on smithi203 2024-04-12T09:04:36.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:36 smithi117 ceph-mon[29277]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:36.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:36.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:36.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-12T09:04:36.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:36 smithi117 ceph-mon[29277]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-12T09:04:36.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi117.front.sepia.ceph.com:9093"}]: dispatch 2024-04-12T09:04:36.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:36 smithi117 ceph-mon[29277]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi117.front.sepia.ceph.com:9093"}]: dispatch 2024-04-12T09:04:36.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:36.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-12T09:04:36.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:36 smithi117 ceph-mon[29277]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-12T09:04:36.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi117.front.sepia.ceph.com:3000"}]: dispatch 2024-04-12T09:04:36.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:36 smithi117 ceph-mon[29277]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi117.front.sepia.ceph.com:3000"}]: dispatch 2024-04-12T09:04:36.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:36.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T09:04:36.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:36 smithi117 ceph-mon[29277]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T09:04:36.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi117.front.sepia.ceph.com:9095"}]: dispatch 2024-04-12T09:04:36.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:36 smithi117 ceph-mon[29277]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi117.front.sepia.ceph.com:9095"}]: dispatch 2024-04-12T09:04:36.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:36.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:04:36.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:36.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:36.736 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:36 smithi203 ceph-mon[36428]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:36.736 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:36 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:36.736 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:36 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:36.736 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:36 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-12T09:04:36.736 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:36 smithi203 ceph-mon[36428]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-12T09:04:36.736 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:36 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi117.front.sepia.ceph.com:9093"}]: dispatch 2024-04-12T09:04:36.736 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:36 smithi203 ceph-mon[36428]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi117.front.sepia.ceph.com:9093"}]: dispatch 2024-04-12T09:04:36.736 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:36 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:36.736 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:36 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-12T09:04:36.736 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:36 smithi203 ceph-mon[36428]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-12T09:04:36.736 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:36 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi117.front.sepia.ceph.com:3000"}]: dispatch 2024-04-12T09:04:36.737 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:36 smithi203 ceph-mon[36428]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi117.front.sepia.ceph.com:3000"}]: dispatch 2024-04-12T09:04:36.737 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:36 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:36.737 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:36 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T09:04:36.737 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:36 smithi203 ceph-mon[36428]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T09:04:36.737 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:36 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi117.front.sepia.ceph.com:9095"}]: dispatch 2024-04-12T09:04:36.737 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:36 smithi203 ceph-mon[36428]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi117.front.sepia.ceph.com:9095"}]: dispatch 2024-04-12T09:04:36.737 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:36 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:36.737 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:36 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:04:36.737 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:36 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:36.737 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:36 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:38.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:38 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:38.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:38 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:38.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:38 smithi117 ceph-mon[29277]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:38.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:38 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:38.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:38 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:38.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:38 smithi203 ceph-mon[36428]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:40.659 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:40 smithi117 ceph-mon[29277]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:40.659 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:40 smithi117 ceph-mon[29277]: from='osd.0 [v2:172.21.15.117:6802/789453361,v1:172.21.15.117:6803/789453361]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-12T09:04:40.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:40 smithi203 ceph-mon[36428]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:40.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:40 smithi203 ceph-mon[36428]: from='osd.0 [v2:172.21.15.117:6802/789453361,v1:172.21.15.117:6803/789453361]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-12T09:04:41.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:41.315+0000 7f685effd700 1 -- 172.21.15.117:0/32916362 <== mgr.14214 v2:172.21.15.117:6800/3945342300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f686810f9c0 con 0x7f6854069210 2024-04-12T09:04:41.316 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 0 on host 'smithi117' 2024-04-12T09:04:41.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:41.317+0000 7f686ce1c700 1 -- 172.21.15.117:0/32916362 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f6854069210 msgr2=0x7f685406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:04:41.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:41.317+0000 7f686ce1c700 1 --2- 172.21.15.117:0/32916362 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f6854069210 0x7f685406b6c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f685000b3b0 tx=0x7f6850009e30 comp rx=0 tx=0).stop 2024-04-12T09:04:41.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:41.317+0000 7f686ce1c700 1 -- 172.21.15.117:0/32916362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68680fff80 msgr2=0x7f686810e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:04:41.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:41.317+0000 7f686ce1c700 1 --2- 172.21.15.117:0/32916362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68680fff80 0x7f686810e000 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f685800b790 tx=0x7f6858009250 comp rx=0 tx=0).stop 2024-04-12T09:04:41.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:41.317+0000 7f686ce1c700 1 -- 172.21.15.117:0/32916362 shutdown_connections 2024-04-12T09:04:41.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:41.317+0000 7f686ce1c700 1 --2- 172.21.15.117:0/32916362 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f6854069210 0x7f685406b6c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:04:41.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:41.317+0000 7f686ce1c700 1 --2- 172.21.15.117:0/32916362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6868066260 0x7f686810dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:04:41.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:41.317+0000 7f686ce1c700 1 --2- 172.21.15.117:0/32916362 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68680fff80 0x7f686810e000 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:04:41.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:41.317+0000 7f686ce1c700 1 -- 172.21.15.117:0/32916362 >> 172.21.15.117:0/32916362 conn(0x7f68680f7430 msgr2=0x7f68680f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:04:41.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:41.318+0000 7f686ce1c700 1 -- 172.21.15.117:0/32916362 shutdown_connections 2024-04-12T09:04:41.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:41.318+0000 7f686ce1c700 1 -- 172.21.15.117:0/32916362 wait complete. 2024-04-12T09:04:41.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:41 smithi117 ceph-mon[29277]: from='osd.0 [v2:172.21.15.117:6802/789453361,v1:172.21.15.117:6803/789453361]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-12T09:04:41.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:41 smithi117 ceph-mon[29277]: osdmap e7: 1 total, 0 up, 1 in 2024-04-12T09:04:41.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:41 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T09:04:41.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:41 smithi117 ceph-mon[29277]: from='osd.0 [v2:172.21.15.117:6802/789453361,v1:172.21.15.117:6803/789453361]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-04-12T09:04:41.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:41 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:41.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:41 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:41.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:41 smithi117 ceph-mon[29277]: from='osd.0 [v2:172.21.15.117:6802/789453361,v1:172.21.15.117:6803/789453361]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-04-12T09:04:41.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:41 smithi117 ceph-mon[29277]: osdmap e8: 1 total, 0 up, 1 in 2024-04-12T09:04:41.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:41 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T09:04:41.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:41 smithi203 ceph-mon[36428]: from='osd.0 [v2:172.21.15.117:6802/789453361,v1:172.21.15.117:6803/789453361]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-12T09:04:41.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:41 smithi203 ceph-mon[36428]: osdmap e7: 1 total, 0 up, 1 in 2024-04-12T09:04:41.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:41 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T09:04:41.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:41 smithi203 ceph-mon[36428]: from='osd.0 [v2:172.21.15.117:6802/789453361,v1:172.21.15.117:6803/789453361]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-04-12T09:04:41.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:41 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:41.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:41 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:41.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:41 smithi203 ceph-mon[36428]: from='osd.0 [v2:172.21.15.117:6802/789453361,v1:172.21.15.117:6803/789453361]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-04-12T09:04:41.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:41 smithi203 ceph-mon[36428]: osdmap e8: 1 total, 0 up, 1 in 2024-04-12T09:04:41.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:41 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T09:04:42.570 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:42 smithi117 ceph-mon[29277]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:42.570 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:42 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T09:04:42.570 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:42 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:42.570 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:42 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:42.570 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:42 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T09:04:42.594 DEBUG:teuthology.orchestra.run.smithi117:osd.0> sudo journalctl -f -n 0 -u ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.0.service 2024-04-12T09:04:42.596 INFO:tasks.cephadm:Deploying osd.1 on smithi117 with /dev/vg_nvme/lv_3... 2024-04-12T09:04:42.597 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-12T09:04:42.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:42 smithi203 ceph-mon[36428]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:42.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:42 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T09:04:42.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:42 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:42.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:42 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:42.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:42 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T09:04:42.908 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:04:43.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:43 smithi117 ceph-mon[29277]: purged_snaps scrub starts 2024-04-12T09:04:43.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:43 smithi117 ceph-mon[29277]: purged_snaps scrub ok 2024-04-12T09:04:43.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:43 smithi117 ceph-mon[29277]: osd.0 [v2:172.21.15.117:6802/789453361,v1:172.21.15.117:6803/789453361] boot 2024-04-12T09:04:43.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:43 smithi117 ceph-mon[29277]: osdmap e9: 1 total, 1 up, 1 in 2024-04-12T09:04:43.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:43 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T09:04:43.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:43 smithi203 ceph-mon[36428]: purged_snaps scrub starts 2024-04-12T09:04:43.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:43 smithi203 ceph-mon[36428]: purged_snaps scrub ok 2024-04-12T09:04:43.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:43 smithi203 ceph-mon[36428]: osd.0 [v2:172.21.15.117:6802/789453361,v1:172.21.15.117:6803/789453361] boot 2024-04-12T09:04:43.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:43 smithi203 ceph-mon[36428]: osdmap e9: 1 total, 1 up, 1 in 2024-04-12T09:04:43.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:43 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T09:04:44.581 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:44 smithi117 ceph-mon[29277]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:44.582 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:44 smithi117 ceph-mon[29277]: osdmap e10: 1 total, 1 up, 1 in 2024-04-12T09:04:44.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:44 smithi203 ceph-mon[36428]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-12T09:04:44.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:44 smithi203 ceph-mon[36428]: osdmap e10: 1 total, 1 up, 1 in 2024-04-12T09:04:44.852 INFO:teuthology.orchestra.run.smithi117.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-12T09:04:44.852 INFO:teuthology.orchestra.run.smithi117.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-12T09:04:44.852 INFO:teuthology.orchestra.run.smithi117.stderr: stderr: 10+0 records in 2024-04-12T09:04:44.852 INFO:teuthology.orchestra.run.smithi117.stderr:10+0 records out 2024-04-12T09:04:44.852 INFO:teuthology.orchestra.run.smithi117.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0126836 s, 827 MB/s 2024-04-12T09:04:44.852 INFO:teuthology.orchestra.run.smithi117.stderr:--> Zapping successful for: 2024-04-12T09:04:46.170 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph orch daemon add osd smithi117:vg_nvme/lv_3 2024-04-12T09:04:46.637 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:04:46.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:46 smithi117 ceph-mon[29277]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:04:46.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:46 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:04:46.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:46 smithi203 ceph-mon[36428]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:04:46.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:46 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:04:48.628 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:48 smithi117 ceph-mon[29277]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:04:48.628 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:48 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:48.628 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:48 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:48.629 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:48 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:04:48.629 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:48 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:48.629 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:48 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:48.629 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:48 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:04:48.629 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:48 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:48.629 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:48 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:04:48.743 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:48 smithi203 ceph-mon[36428]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:04:48.743 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:48 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:48.743 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:48 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:48.743 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:48 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:04:48.743 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:48 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:48.743 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:48 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:48.743 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:48 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:04:48.743 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:48 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:48.743 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:48 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:04:48.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.840+0000 7efef88fb700 1 -- 172.21.15.117:0/3626958980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efef40fce70 msgr2=0x7efef40fd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:04:48.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.840+0000 7efef88fb700 1 --2- 172.21.15.117:0/3626958980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efef40fce70 0x7efef40fd280 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efee4004940 tx=0x7efee4009e30 comp rx=0 tx=0).stop 2024-04-12T09:04:48.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.840+0000 7efef88fb700 1 -- 172.21.15.117:0/3626958980 shutdown_connections 2024-04-12T09:04:48.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.840+0000 7efef88fb700 1 --2- 172.21.15.117:0/3626958980 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efef40fdfe0 0x7efef40fe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:04:48.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.840+0000 7efef88fb700 1 --2- 172.21.15.117:0/3626958980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efef40fce70 0x7efef40fd280 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:04:48.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.840+0000 7efef88fb700 1 -- 172.21.15.117:0/3626958980 >> 172.21.15.117:0/3626958980 conn(0x7efef40f8550 msgr2=0x7efef40fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:04:48.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.840+0000 7efef88fb700 1 -- 172.21.15.117:0/3626958980 shutdown_connections 2024-04-12T09:04:48.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.840+0000 7efef88fb700 1 -- 172.21.15.117:0/3626958980 wait complete. 2024-04-12T09:04:48.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.840+0000 7efef88fb700 1 Processor -- start 2024-04-12T09:04:48.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.840+0000 7efef88fb700 1 -- start start 2024-04-12T09:04:48.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.840+0000 7efef88fb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efef40fce70 0x7efef410d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:04:48.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.840+0000 7efef88fb700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efef40fdfe0 0x7efef410de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:04:48.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.840+0000 7efef88fb700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef410e460 con 0x7efef40fce70 2024-04-12T09:04:48.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.840+0000 7efef88fb700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef410e5d0 con 0x7efef40fdfe0 2024-04-12T09:04:48.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.840+0000 7efef259c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efef40fce70 0x7efef410d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:04:48.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.841+0000 7efef259c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efef40fce70 0x7efef410d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33802/0 (socket says 172.21.15.117:33802) 2024-04-12T09:04:48.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.841+0000 7efef259c700 1 -- 172.21.15.117:0/868126944 learned_addr learned my addr 172.21.15.117:0/868126944 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:04:48.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.841+0000 7efef1d9b700 1 --2- 172.21.15.117:0/868126944 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efef40fdfe0 0x7efef410de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:04:48.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.841+0000 7efef259c700 1 -- 172.21.15.117:0/868126944 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efef40fdfe0 msgr2=0x7efef410de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:04:48.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.841+0000 7efef259c700 1 --2- 172.21.15.117:0/868126944 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efef40fdfe0 0x7efef410de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:04:48.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.841+0000 7efef259c700 1 -- 172.21.15.117:0/868126944 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee4005040 con 0x7efef40fce70 2024-04-12T09:04:48.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.841+0000 7efef1d9b700 1 --2- 172.21.15.117:0/868126944 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efef40fdfe0 0x7efef410de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T09:04:48.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.841+0000 7efef259c700 1 --2- 172.21.15.117:0/868126944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efef40fce70 0x7efef410d920 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efee400b3b0 tx=0x7efee4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:04:48.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.841+0000 7efee2ffd700 1 -- 172.21.15.117:0/868126944 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efee400e040 con 0x7efef40fce70 2024-04-12T09:04:48.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.841+0000 7efee2ffd700 1 -- 172.21.15.117:0/868126944 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efee400bcc0 con 0x7efef40fce70 2024-04-12T09:04:48.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.841+0000 7efef88fb700 1 -- 172.21.15.117:0/868126944 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efef4112fd0 con 0x7efef40fce70 2024-04-12T09:04:48.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.841+0000 7efee2ffd700 1 -- 172.21.15.117:0/868126944 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efee401c630 con 0x7efef40fce70 2024-04-12T09:04:48.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.841+0000 7efef88fb700 1 -- 172.21.15.117:0/868126944 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efef4113500 con 0x7efef40fce70 2024-04-12T09:04:48.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.842+0000 7efef88fb700 1 -- 172.21.15.117:0/868126944 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efef404c710 con 0x7efef40fce70 2024-04-12T09:04:48.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.842+0000 7efee2ffd700 1 -- 172.21.15.117:0/868126944 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7efee4013980 con 0x7efef40fce70 2024-04-12T09:04:48.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.843+0000 7efee2ffd700 1 --2- 172.21.15.117:0/868126944 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7efedc069210 0x7efedc06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:04:48.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.843+0000 7efef1d9b700 1 --2- 172.21.15.117:0/868126944 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7efedc069210 0x7efedc06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:04:48.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.843+0000 7efee2ffd700 1 -- 172.21.15.117:0/868126944 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7efee40870f0 con 0x7efef40fce70 2024-04-12T09:04:48.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.843+0000 7efef1d9b700 1 --2- 172.21.15.117:0/868126944 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7efedc069210 0x7efedc06b6c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efee8009fd0 tx=0x7efee8009ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:04:48.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:48.847+0000 7efee2ffd700 1 -- 172.21.15.117:0/868126944 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7efee4057cb0 con 0x7efef40fce70 2024-04-12T09:04:49.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:04:49.045+0000 7efef88fb700 1 -- 172.21.15.117:0/868126944 --> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7efef4113720 con 0x7efedc069210 2024-04-12T09:04:49.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:49 smithi203 ceph-mon[36428]: Detected new or changed devices on smithi117 2024-04-12T09:04:49.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:49 smithi203 ceph-mon[36428]: Adjusting osd_memory_target on smithi117 to 12864M 2024-04-12T09:04:49.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:49 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-12T09:04:49.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:49 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-12T09:04:49.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:49 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:49.704 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:49 smithi117 ceph-mon[29277]: Detected new or changed devices on smithi117 2024-04-12T09:04:49.704 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:49 smithi117 ceph-mon[29277]: Adjusting osd_memory_target on smithi117 to 12864M 2024-04-12T09:04:49.704 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:49 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-12T09:04:49.704 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:49 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-12T09:04:49.704 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:49 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:50.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:50 smithi117 ceph-mon[29277]: from='client.14262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:04:50.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:50 smithi117 ceph-mon[29277]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:04:50.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:50 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:50.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:50 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:51.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:50 smithi203 ceph-mon[36428]: from='client.14262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:04:51.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:50 smithi203 ceph-mon[36428]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:04:51.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:50 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:51.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:50 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:53.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:52 smithi203 ceph-mon[36428]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:04:53.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:52 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/127661044' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ab723885-9e88-47ad-8e80-cb5871bf0d7c"}]: dispatch 2024-04-12T09:04:53.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:52 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/127661044' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ab723885-9e88-47ad-8e80-cb5871bf0d7c"}]': finished 2024-04-12T09:04:53.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:52 smithi203 ceph-mon[36428]: osdmap e11: 2 total, 1 up, 2 in 2024-04-12T09:04:53.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:52 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T09:04:53.118 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:52 smithi117 ceph-mon[29277]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:04:53.119 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:52 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/127661044' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ab723885-9e88-47ad-8e80-cb5871bf0d7c"}]: dispatch 2024-04-12T09:04:53.119 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:52 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/127661044' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ab723885-9e88-47ad-8e80-cb5871bf0d7c"}]': finished 2024-04-12T09:04:53.119 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:52 smithi117 ceph-mon[29277]: osdmap e11: 2 total, 1 up, 2 in 2024-04-12T09:04:53.119 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:52 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T09:04:54.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:53 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/1505760448' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-12T09:04:54.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:53 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/1505760448' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-12T09:04:55.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:54 smithi117 ceph-mon[29277]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:04:55.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:54 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:55.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:54 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:55.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:54 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:55.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:54 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:04:55.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:54 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:55.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:54 smithi203 ceph-mon[36428]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:04:55.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:55.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:55.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:04:55.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:04:55.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:04:56.958 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:56 smithi117 ceph-mon[29277]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:04:57.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:56 smithi203 ceph-mon[36428]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:04:58.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:58 smithi117 ceph-mon[29277]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:04:59.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:58 smithi203 ceph-mon[36428]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:04:59.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:59 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-12T09:04:59.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:04:59 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:05:00.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:59 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-12T09:05:00.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:04:59 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:05:01.092 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:00 smithi117 ceph-mon[29277]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:05:01.092 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:00 smithi117 ceph-mon[29277]: Deploying daemon osd.1 on smithi117 2024-04-12T09:05:01.225 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:00 smithi203 ceph-mon[36428]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:05:01.225 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:00 smithi203 ceph-mon[36428]: Deploying daemon osd.1 on smithi117 2024-04-12T09:05:02.143 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:01 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:05:02.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:01 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:05:02.988 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:02 smithi117 ceph-mon[29277]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:05:03.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:02 smithi203 ceph-mon[36428]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:05:03.958 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:03 smithi117 ceph-mon[29277]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:05:04.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:03 smithi203 ceph-mon[36428]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:05:06.237 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:05 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:06.237 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:05 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:06.237 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:05 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:05:06.237 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:05 smithi117 ceph-mon[29277]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:05:06.300 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:05 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:06.300 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:05 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:06.300 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:05 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:05:06.300 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:05 smithi203 ceph-mon[36428]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:05:07.944 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:07 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:07.944 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:07 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:08.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:07 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:08.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:07 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:08.758 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:08 smithi117 ceph-mon[29277]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:05:08.798 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 1 on host 'smithi117' 2024-04-12T09:05:08.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:08.797+0000 7efee2ffd700 1 -- 172.21.15.117:0/868126944 <== mgr.14214 v2:172.21.15.117:6800/3945342300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7efef4113720 con 0x7efedc069210 2024-04-12T09:05:08.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:08.799+0000 7efef88fb700 1 -- 172.21.15.117:0/868126944 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7efedc069210 msgr2=0x7efedc06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:05:08.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:08.799+0000 7efef88fb700 1 --2- 172.21.15.117:0/868126944 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7efedc069210 0x7efedc06b6c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efee8009fd0 tx=0x7efee8009ee0 comp rx=0 tx=0).stop 2024-04-12T09:05:08.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:08.799+0000 7efef88fb700 1 -- 172.21.15.117:0/868126944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efef40fce70 msgr2=0x7efef410d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:05:08.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:08.799+0000 7efef88fb700 1 --2- 172.21.15.117:0/868126944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efef40fce70 0x7efef410d920 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efee400b3b0 tx=0x7efee4009e30 comp rx=0 tx=0).stop 2024-04-12T09:05:08.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:08.799+0000 7efef88fb700 1 -- 172.21.15.117:0/868126944 shutdown_connections 2024-04-12T09:05:08.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:08.800+0000 7efef88fb700 1 --2- 172.21.15.117:0/868126944 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7efedc069210 0x7efedc06b6c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:05:08.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:08.800+0000 7efef88fb700 1 --2- 172.21.15.117:0/868126944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efef40fce70 0x7efef410d920 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:05:08.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:08.800+0000 7efef88fb700 1 --2- 172.21.15.117:0/868126944 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efef40fdfe0 0x7efef410de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:05:08.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:08.800+0000 7efef88fb700 1 -- 172.21.15.117:0/868126944 >> 172.21.15.117:0/868126944 conn(0x7efef40f8550 msgr2=0x7efef40f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:05:08.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:08.800+0000 7efef88fb700 1 -- 172.21.15.117:0/868126944 shutdown_connections 2024-04-12T09:05:08.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:08.800+0000 7efef88fb700 1 -- 172.21.15.117:0/868126944 wait complete. 2024-04-12T09:05:09.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:08 smithi203 ceph-mon[36428]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:05:09.414 DEBUG:teuthology.orchestra.run.smithi117:osd.1> sudo journalctl -f -n 0 -u ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.1.service 2024-04-12T09:05:09.417 INFO:tasks.cephadm:Deploying osd.2 on smithi117 with /dev/vg_nvme/lv_2... 2024-04-12T09:05:09.417 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-12T09:05:09.923 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:09 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:09.923 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:09 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:09.923 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:09 smithi117 ceph-mon[29277]: from='osd.1 [v2:172.21.15.117:6810/3995491575,v1:172.21.15.117:6811/3995491575]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-12T09:05:10.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:09 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:10.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:09 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:10.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:09 smithi203 ceph-mon[36428]: from='osd.1 [v2:172.21.15.117:6810/3995491575,v1:172.21.15.117:6811/3995491575]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-12T09:05:10.129 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:05:11.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:10 smithi203 ceph-mon[36428]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:05:11.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:10 smithi203 ceph-mon[36428]: from='osd.1 [v2:172.21.15.117:6810/3995491575,v1:172.21.15.117:6811/3995491575]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-12T09:05:11.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:10 smithi203 ceph-mon[36428]: osdmap e12: 2 total, 1 up, 2 in 2024-04-12T09:05:11.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:10 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T09:05:11.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:10 smithi203 ceph-mon[36428]: from='osd.1 [v2:172.21.15.117:6810/3995491575,v1:172.21.15.117:6811/3995491575]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-04-12T09:05:11.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:10 smithi117 ceph-mon[29277]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:05:11.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:10 smithi117 ceph-mon[29277]: from='osd.1 [v2:172.21.15.117:6810/3995491575,v1:172.21.15.117:6811/3995491575]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-12T09:05:11.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:10 smithi117 ceph-mon[29277]: osdmap e12: 2 total, 1 up, 2 in 2024-04-12T09:05:11.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:10 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T09:05:11.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:10 smithi117 ceph-mon[29277]: from='osd.1 [v2:172.21.15.117:6810/3995491575,v1:172.21.15.117:6811/3995491575]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-04-12T09:05:11.161 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:05:10 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1[55103]: 2024-04-12T09:05:10.799+0000 7f2a47708700 -1 osd.1 0 waiting for initial osdmap 2024-04-12T09:05:11.161 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:05:10 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1[55103]: 2024-04-12T09:05:10.804+0000 7f2a40d00700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T09:05:12.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:11 smithi203 ceph-mon[36428]: from='osd.1 [v2:172.21.15.117:6810/3995491575,v1:172.21.15.117:6811/3995491575]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-04-12T09:05:12.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:11 smithi203 ceph-mon[36428]: osdmap e13: 2 total, 1 up, 2 in 2024-04-12T09:05:12.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:11 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T09:05:12.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:11 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T09:05:12.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:11 smithi117 ceph-mon[29277]: from='osd.1 [v2:172.21.15.117:6810/3995491575,v1:172.21.15.117:6811/3995491575]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-04-12T09:05:12.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:11 smithi117 ceph-mon[29277]: osdmap e13: 2 total, 1 up, 2 in 2024-04-12T09:05:12.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:11 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T09:05:12.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:11 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T09:05:12.707 INFO:teuthology.orchestra.run.smithi117.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-12T09:05:12.707 INFO:teuthology.orchestra.run.smithi117.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-12T09:05:12.707 INFO:teuthology.orchestra.run.smithi117.stderr: stderr: 10+0 records in 2024-04-12T09:05:12.707 INFO:teuthology.orchestra.run.smithi117.stderr:10+0 records out 2024-04-12T09:05:12.707 INFO:teuthology.orchestra.run.smithi117.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113095 s, 927 MB/s 2024-04-12T09:05:12.707 INFO:teuthology.orchestra.run.smithi117.stderr:--> Zapping successful for: 2024-04-12T09:05:12.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:12 smithi117 ceph-mon[29277]: purged_snaps scrub starts 2024-04-12T09:05:12.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:12 smithi117 ceph-mon[29277]: purged_snaps scrub ok 2024-04-12T09:05:12.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:12 smithi117 ceph-mon[29277]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:05:12.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:12 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T09:05:12.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:12 smithi117 ceph-mon[29277]: osd.1 [v2:172.21.15.117:6810/3995491575,v1:172.21.15.117:6811/3995491575] boot 2024-04-12T09:05:12.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:12 smithi117 ceph-mon[29277]: osdmap e14: 2 total, 2 up, 2 in 2024-04-12T09:05:12.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:12 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T09:05:13.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:12 smithi203 ceph-mon[36428]: purged_snaps scrub starts 2024-04-12T09:05:13.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:12 smithi203 ceph-mon[36428]: purged_snaps scrub ok 2024-04-12T09:05:13.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:12 smithi203 ceph-mon[36428]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-12T09:05:13.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:12 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T09:05:13.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:12 smithi203 ceph-mon[36428]: osd.1 [v2:172.21.15.117:6810/3995491575,v1:172.21.15.117:6811/3995491575] boot 2024-04-12T09:05:13.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:12 smithi203 ceph-mon[36428]: osdmap e14: 2 total, 2 up, 2 in 2024-04-12T09:05:13.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:12 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T09:05:13.503 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph orch daemon add osd smithi117:vg_nvme/lv_2 2024-04-12T09:05:13.779 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:05:14.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:13 smithi203 ceph-mon[36428]: osdmap e15: 2 total, 2 up, 2 in 2024-04-12T09:05:14.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:13 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:14.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:13 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:14.138 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:13 smithi117 ceph-mon[29277]: osdmap e15: 2 total, 2 up, 2 in 2024-04-12T09:05:14.138 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:13 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:14.138 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:13 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:14.825 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:14 smithi117 ceph-mon[29277]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:15.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:14 smithi203 ceph-mon[36428]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:16.831 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:16 smithi117 ceph-mon[29277]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:16.831 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:16 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:05:16.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.932+0000 7fa64a826700 1 -- 172.21.15.117:0/3349963529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6440fb390 msgr2=0x7fa644102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:05:16.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.932+0000 7fa64a826700 1 --2- 172.21.15.117:0/3349963529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6440fb390 0x7fa644102610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa638004940 tx=0x7fa638009e30 comp rx=0 tx=0).stop 2024-04-12T09:05:16.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.932+0000 7fa64a826700 1 -- 172.21.15.117:0/3349963529 shutdown_connections 2024-04-12T09:05:16.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.932+0000 7fa64a826700 1 --2- 172.21.15.117:0/3349963529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6440fb390 0x7fa644102610 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:05:16.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.932+0000 7fa64a826700 1 --2- 172.21.15.117:0/3349963529 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6440faa40 0x7fa6440fae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:05:16.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.932+0000 7fa64a826700 1 -- 172.21.15.117:0/3349963529 >> 172.21.15.117:0/3349963529 conn(0x7fa6440f6770 msgr2=0x7fa6440f8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:05:16.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.932+0000 7fa64a826700 1 -- 172.21.15.117:0/3349963529 shutdown_connections 2024-04-12T09:05:16.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.932+0000 7fa64a826700 1 -- 172.21.15.117:0/3349963529 wait complete. 2024-04-12T09:05:16.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.933+0000 7fa64a826700 1 Processor -- start 2024-04-12T09:05:16.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.933+0000 7fa64a826700 1 -- start start 2024-04-12T09:05:16.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.933+0000 7fa64a826700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6440faa40 0x7fa64410d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:05:16.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.933+0000 7fa64a826700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6440fb390 0x7fa64410de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:05:16.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.933+0000 7fa64a826700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64410e520 con 0x7fa6440faa40 2024-04-12T09:05:16.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.933+0000 7fa64a826700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa644112ec0 con 0x7fa6440fb390 2024-04-12T09:05:16.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.933+0000 7fa643fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6440faa40 0x7fa64410d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:05:16.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.933+0000 7fa643fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6440faa40 0x7fa64410d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:48118/0 (socket says 172.21.15.117:48118) 2024-04-12T09:05:16.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.933+0000 7fa643fff700 1 -- 172.21.15.117:0/1394219939 learned_addr learned my addr 172.21.15.117:0/1394219939 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:05:16.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.933+0000 7fa6437fe700 1 --2- 172.21.15.117:0/1394219939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6440fb390 0x7fa64410de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:05:16.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.934+0000 7fa643fff700 1 -- 172.21.15.117:0/1394219939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6440fb390 msgr2=0x7fa64410de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:05:16.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.934+0000 7fa643fff700 1 --2- 172.21.15.117:0/1394219939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6440fb390 0x7fa64410de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:05:16.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.934+0000 7fa643fff700 1 -- 172.21.15.117:0/1394219939 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa638005040 con 0x7fa6440faa40 2024-04-12T09:05:16.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.934+0000 7fa643fff700 1 --2- 172.21.15.117:0/1394219939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6440faa40 0x7fa64410d950 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa63400b790 tx=0x7fa634009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:05:16.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.934+0000 7fa640ff9700 1 -- 172.21.15.117:0/1394219939 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa63400f6f0 con 0x7fa6440faa40 2024-04-12T09:05:16.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.934+0000 7fa640ff9700 1 -- 172.21.15.117:0/1394219939 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa63400fd20 con 0x7fa6440faa40 2024-04-12T09:05:16.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.934+0000 7fa64a826700 1 -- 172.21.15.117:0/1394219939 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa644113120 con 0x7fa6440faa40 2024-04-12T09:05:16.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.934+0000 7fa640ff9700 1 -- 172.21.15.117:0/1394219939 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6340103a0 con 0x7fa6440faa40 2024-04-12T09:05:16.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.934+0000 7fa64a826700 1 -- 172.21.15.117:0/1394219939 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa644113690 con 0x7fa6440faa40 2024-04-12T09:05:16.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.935+0000 7fa64a826700 1 -- 172.21.15.117:0/1394219939 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa64404c710 con 0x7fa6440faa40 2024-04-12T09:05:16.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.936+0000 7fa640ff9700 1 -- 172.21.15.117:0/1394219939 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7fa634010500 con 0x7fa6440faa40 2024-04-12T09:05:16.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.936+0000 7fa640ff9700 1 --2- 172.21.15.117:0/1394219939 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fa62c069210 0x7fa62c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:05:16.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.936+0000 7fa640ff9700 1 -- 172.21.15.117:0/1394219939 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7fa634086190 con 0x7fa6440faa40 2024-04-12T09:05:16.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.936+0000 7fa6437fe700 1 --2- 172.21.15.117:0/1394219939 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fa62c069210 0x7fa62c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:05:16.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.937+0000 7fa6437fe700 1 --2- 172.21.15.117:0/1394219939 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fa62c069210 0x7fa62c06b6c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa638009fd0 tx=0x7fa638009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:05:16.944 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:16.943+0000 7fa640ff9700 1 -- 172.21.15.117:0/1394219939 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fa634056d30 con 0x7fa6440faa40 2024-04-12T09:05:17.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:16 smithi203 ceph-mon[36428]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:17.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:16 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:05:17.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:17.147+0000 7fa64a826700 1 -- 172.21.15.117:0/1394219939 --> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa644101d90 con 0x7fa62c069210 2024-04-12T09:05:18.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:17 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-12T09:05:18.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:17 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-12T09:05:18.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:17 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:05:18.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:17 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:18.124 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:17 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-12T09:05:18.125 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:17 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-12T09:05:18.125 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:17 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:05:18.125 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:17 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:19.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:18 smithi203 ceph-mon[36428]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:05:19.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:18 smithi203 ceph-mon[36428]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:19.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:18 smithi203 ceph-mon[36428]: Detected new or changed devices on smithi117 2024-04-12T09:05:19.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:18 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:19.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:18 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:05:19.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:18 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:05:19.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:18 smithi203 ceph-mon[36428]: Adjusting osd_memory_target on smithi117 to 6432M 2024-04-12T09:05:19.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:18 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:19.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:18 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:05:19.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:18 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:05:19.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:18 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:19.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:18 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:05:19.086 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:18 smithi117 ceph-mon[29277]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:05:19.086 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:18 smithi117 ceph-mon[29277]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:19.086 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:18 smithi117 ceph-mon[29277]: Detected new or changed devices on smithi117 2024-04-12T09:05:19.086 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:18 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:19.087 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:18 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:05:19.087 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:18 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:05:19.087 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:18 smithi117 ceph-mon[29277]: Adjusting osd_memory_target on smithi117 to 6432M 2024-04-12T09:05:19.087 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:18 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:19.087 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:18 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:05:19.087 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:18 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:05:19.087 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:18 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:19.087 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:18 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:05:21.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:20 smithi203 ceph-mon[36428]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:21.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:20 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/1782643039' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14f76ed3-2938-45c1-9cc7-4c0486c602ed"}]: dispatch 2024-04-12T09:05:21.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:20 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/1782643039' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14f76ed3-2938-45c1-9cc7-4c0486c602ed"}]': finished 2024-04-12T09:05:21.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:20 smithi203 ceph-mon[36428]: osdmap e16: 3 total, 2 up, 3 in 2024-04-12T09:05:21.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:20 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T09:05:21.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:20 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/2260403831' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-12T09:05:21.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:20 smithi117 ceph-mon[29277]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:21.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:20 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/1782643039' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14f76ed3-2938-45c1-9cc7-4c0486c602ed"}]: dispatch 2024-04-12T09:05:21.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:20 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/1782643039' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14f76ed3-2938-45c1-9cc7-4c0486c602ed"}]': finished 2024-04-12T09:05:21.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:20 smithi117 ceph-mon[29277]: osdmap e16: 3 total, 2 up, 3 in 2024-04-12T09:05:21.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:20 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T09:05:21.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:20 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/2260403831' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-12T09:05:23.103 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:22 smithi117 ceph-mon[29277]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:23.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:22 smithi203 ceph-mon[36428]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:24.682 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:24 smithi117 ceph-mon[29277]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:24.683 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:24 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:24.683 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:24 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:24.683 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:24 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:05:24.683 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:24 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:05:24.683 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:24 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:24.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:24 smithi203 ceph-mon[36428]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:24.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:24 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:24.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:24 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:24.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:24 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:05:24.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:24 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:05:24.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:24 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:26.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:26 smithi117 ceph-mon[29277]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:26.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:26 smithi203 ceph-mon[36428]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:28.611 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:28 smithi117 ceph-mon[29277]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:28.611 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:28 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-12T09:05:28.611 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:28 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:05:28.611 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:28 smithi117 ceph-mon[29277]: Deploying daemon osd.2 on smithi117 2024-04-12T09:05:28.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:28 smithi203 ceph-mon[36428]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:28.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:28 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-12T09:05:28.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:28 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:05:28.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:28 smithi203 ceph-mon[36428]: Deploying daemon osd.2 on smithi117 2024-04-12T09:05:30.822 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:30 smithi117 ceph-mon[29277]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:30.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:30 smithi203 ceph-mon[36428]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:31.724 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:31 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:05:31.783 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:31 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:05:32.688 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:32 smithi117 ceph-mon[29277]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:32.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:32 smithi203 ceph-mon[36428]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:33.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:33 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:05:33.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:33 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:33.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:33 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:33.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:33 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:05:33.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:33 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:33.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:33 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:34.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:34 smithi117 ceph-mon[29277]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:35.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:34 smithi203 ceph-mon[36428]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:36.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:36.399+0000 7fa640ff9700 1 -- 172.21.15.117:0/1394219939 <== mgr.14214 v2:172.21.15.117:6800/3945342300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa644101d90 con 0x7fa62c069210 2024-04-12T09:05:36.400 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 2 on host 'smithi117' 2024-04-12T09:05:36.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:36.401+0000 7fa64a826700 1 -- 172.21.15.117:0/1394219939 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fa62c069210 msgr2=0x7fa62c06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:05:36.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:36.401+0000 7fa64a826700 1 --2- 172.21.15.117:0/1394219939 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fa62c069210 0x7fa62c06b6c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa638009fd0 tx=0x7fa638009e30 comp rx=0 tx=0).stop 2024-04-12T09:05:36.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:36.401+0000 7fa64a826700 1 -- 172.21.15.117:0/1394219939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6440faa40 msgr2=0x7fa64410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:05:36.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:36.401+0000 7fa64a826700 1 --2- 172.21.15.117:0/1394219939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6440faa40 0x7fa64410d950 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa63400b790 tx=0x7fa634009220 comp rx=0 tx=0).stop 2024-04-12T09:05:36.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:36.401+0000 7fa64a826700 1 -- 172.21.15.117:0/1394219939 shutdown_connections 2024-04-12T09:05:36.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:36.401+0000 7fa64a826700 1 --2- 172.21.15.117:0/1394219939 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fa62c069210 0x7fa62c06b6c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:05:36.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:36.401+0000 7fa64a826700 1 --2- 172.21.15.117:0/1394219939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6440faa40 0x7fa64410d950 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:05:36.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:36.401+0000 7fa64a826700 1 --2- 172.21.15.117:0/1394219939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6440fb390 0x7fa64410de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:05:36.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:36.401+0000 7fa64a826700 1 -- 172.21.15.117:0/1394219939 >> 172.21.15.117:0/1394219939 conn(0x7fa6440f6770 msgr2=0x7fa644100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:05:36.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:36.401+0000 7fa64a826700 1 -- 172.21.15.117:0/1394219939 shutdown_connections 2024-04-12T09:05:36.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:05:36.401+0000 7fa64a826700 1 -- 172.21.15.117:0/1394219939 wait complete. 2024-04-12T09:05:37.005 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:36 smithi117 ceph-mon[29277]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:37.006 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:37.006 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:37.006 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:36 smithi117 ceph-mon[29277]: from='osd.2 [v2:172.21.15.117:6818/3707487846,v1:172.21.15.117:6819/3707487846]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-12T09:05:37.032 DEBUG:teuthology.orchestra.run.smithi117:osd.2> sudo journalctl -f -n 0 -u ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.2.service 2024-04-12T09:05:37.035 INFO:tasks.cephadm:Deploying osd.3 on smithi203 with /dev/vg_nvme/lv_4... 2024-04-12T09:05:37.035 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-12T09:05:37.066 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:36 smithi203 ceph-mon[36428]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:37.067 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:36 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:37.067 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:36 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:37.067 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:36 smithi203 ceph-mon[36428]: from='osd.2 [v2:172.21.15.117:6818/3707487846,v1:172.21.15.117:6819/3707487846]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-12T09:05:37.296 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi203/config 2024-04-12T09:05:38.496 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:38 smithi203 ceph-mon[36428]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:38.496 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:38 smithi203 ceph-mon[36428]: from='osd.2 [v2:172.21.15.117:6818/3707487846,v1:172.21.15.117:6819/3707487846]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-12T09:05:38.496 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:38 smithi203 ceph-mon[36428]: osdmap e17: 3 total, 2 up, 3 in 2024-04-12T09:05:38.496 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:38 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T09:05:38.496 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:38 smithi203 ceph-mon[36428]: from='osd.2 [v2:172.21.15.117:6818/3707487846,v1:172.21.15.117:6819/3707487846]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-04-12T09:05:38.588 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:38 smithi117 ceph-mon[29277]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:38.588 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:38 smithi117 ceph-mon[29277]: from='osd.2 [v2:172.21.15.117:6818/3707487846,v1:172.21.15.117:6819/3707487846]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-12T09:05:38.588 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:38 smithi117 ceph-mon[29277]: osdmap e17: 3 total, 2 up, 3 in 2024-04-12T09:05:38.588 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:38 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T09:05:38.588 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:38 smithi117 ceph-mon[29277]: from='osd.2 [v2:172.21.15.117:6818/3707487846,v1:172.21.15.117:6819/3707487846]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-04-12T09:05:38.589 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:05:38 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2[62861]: 2024-04-12T09:05:38.368+0000 7f689584a700 -1 osd.2 0 waiting for initial osdmap 2024-04-12T09:05:38.589 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:05:38 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2[62861]: 2024-04-12T09:05:38.378+0000 7f6891e48700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T09:05:39.057 INFO:teuthology.orchestra.run.smithi203.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-12T09:05:39.057 INFO:teuthology.orchestra.run.smithi203.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-12T09:05:39.057 INFO:teuthology.orchestra.run.smithi203.stderr: stderr: 10+0 records in 2024-04-12T09:05:39.057 INFO:teuthology.orchestra.run.smithi203.stderr:10+0 records out 2024-04-12T09:05:39.057 INFO:teuthology.orchestra.run.smithi203.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112692 s, 930 MB/s 2024-04-12T09:05:39.057 INFO:teuthology.orchestra.run.smithi203.stderr:--> Zapping successful for: 2024-04-12T09:05:39.634 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:39 smithi203 ceph-mon[36428]: from='osd.2 [v2:172.21.15.117:6818/3707487846,v1:172.21.15.117:6819/3707487846]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-04-12T09:05:39.634 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:39 smithi203 ceph-mon[36428]: osdmap e18: 3 total, 2 up, 3 in 2024-04-12T09:05:39.634 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:39 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T09:05:39.634 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:39 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T09:05:39.658 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph orch daemon add osd smithi203:vg_nvme/lv_4 2024-04-12T09:05:39.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:39 smithi117 ceph-mon[29277]: from='osd.2 [v2:172.21.15.117:6818/3707487846,v1:172.21.15.117:6819/3707487846]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-04-12T09:05:39.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:39 smithi117 ceph-mon[29277]: osdmap e18: 3 total, 2 up, 3 in 2024-04-12T09:05:39.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:39 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T09:05:39.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:39 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T09:05:39.947 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi203/config 2024-04-12T09:05:40.607 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:40 smithi203 ceph-mon[36428]: purged_snaps scrub starts 2024-04-12T09:05:40.607 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:40 smithi203 ceph-mon[36428]: purged_snaps scrub ok 2024-04-12T09:05:40.607 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:40 smithi203 ceph-mon[36428]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:40.607 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:40 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T09:05:40.607 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:40 smithi203 ceph-mon[36428]: osd.2 [v2:172.21.15.117:6818/3707487846,v1:172.21.15.117:6819/3707487846] boot 2024-04-12T09:05:40.607 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:40 smithi203 ceph-mon[36428]: osdmap e19: 3 total, 3 up, 3 in 2024-04-12T09:05:40.608 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:40 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T09:05:40.608 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:40 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-04-12T09:05:40.608 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:40 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:40.608 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:40 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:40.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:40 smithi117 ceph-mon[29277]: purged_snaps scrub starts 2024-04-12T09:05:40.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:40 smithi117 ceph-mon[29277]: purged_snaps scrub ok 2024-04-12T09:05:40.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:40 smithi117 ceph-mon[29277]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-12T09:05:40.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:40 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T09:05:40.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:40 smithi117 ceph-mon[29277]: osd.2 [v2:172.21.15.117:6818/3707487846,v1:172.21.15.117:6819/3707487846] boot 2024-04-12T09:05:40.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:40 smithi117 ceph-mon[29277]: osdmap e19: 3 total, 3 up, 3 in 2024-04-12T09:05:40.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:40 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T09:05:40.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:40 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-04-12T09:05:40.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:40 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:40.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:40 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:41.279 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.276+0000 7fc2b96c6700 1 -- 172.21.15.203:0/2372724037 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2b40fe050 msgr2=0x7fc2b40fe4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:05:41.279 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.276+0000 7fc2b96c6700 1 --2- 172.21.15.203:0/2372724037 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2b40fe050 0x7fc2b40fe4c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4004940 tx=0x7fc2a4009e30 comp rx=0 tx=0).stop 2024-04-12T09:05:41.279 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.276+0000 7fc2b96c6700 1 -- 172.21.15.203:0/2372724037 shutdown_connections 2024-04-12T09:05:41.279 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.276+0000 7fc2b96c6700 1 --2- 172.21.15.203:0/2372724037 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2b40fe050 0x7fc2b40fe4c0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:05:41.279 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.276+0000 7fc2b96c6700 1 --2- 172.21.15.203:0/2372724037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2b40fce50 0x7fc2b40fd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:05:41.279 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.276+0000 7fc2b96c6700 1 -- 172.21.15.203:0/2372724037 >> 172.21.15.203:0/2372724037 conn(0x7fc2b40f8560 msgr2=0x7fc2b40fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:05:41.280 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.276+0000 7fc2b96c6700 1 -- 172.21.15.203:0/2372724037 shutdown_connections 2024-04-12T09:05:41.280 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.276+0000 7fc2b96c6700 1 -- 172.21.15.203:0/2372724037 wait complete. 2024-04-12T09:05:41.280 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.277+0000 7fc2b96c6700 1 Processor -- start 2024-04-12T09:05:41.280 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.277+0000 7fc2b96c6700 1 -- start start 2024-04-12T09:05:41.280 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.277+0000 7fc2b96c6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2b40fce50 0x7fc2b410d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:05:41.280 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.277+0000 7fc2b96c6700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2b40fe050 0x7fc2b410dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:05:41.280 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.277+0000 7fc2b96c6700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b410e4e0 con 0x7fc2b40fce50 2024-04-12T09:05:41.280 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.277+0000 7fc2b96c6700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b410e650 con 0x7fc2b40fe050 2024-04-12T09:05:41.280 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.277+0000 7fc2b27fc700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2b40fe050 0x7fc2b410dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:05:41.281 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.277+0000 7fc2b27fc700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2b40fe050 0x7fc2b410dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:38742/0 (socket says 172.21.15.203:38742) 2024-04-12T09:05:41.281 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.277+0000 7fc2b27fc700 1 -- 172.21.15.203:0/2508363316 learned_addr learned my addr 172.21.15.203:0/2508363316 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-12T09:05:41.281 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.277+0000 7fc2b2ffd700 1 --2- 172.21.15.203:0/2508363316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2b40fce50 0x7fc2b410d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:05:41.281 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.277+0000 7fc2b27fc700 1 -- 172.21.15.203:0/2508363316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2b40fce50 msgr2=0x7fc2b410d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:05:41.281 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.277+0000 7fc2b27fc700 1 --2- 172.21.15.203:0/2508363316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2b40fce50 0x7fc2b410d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:05:41.281 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.277+0000 7fc2b27fc700 1 -- 172.21.15.203:0/2508363316 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a4005040 con 0x7fc2b40fe050 2024-04-12T09:05:41.281 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.278+0000 7fc2b27fc700 1 --2- 172.21.15.203:0/2508363316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2b40fe050 0x7fc2b410dee0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400b3b0 tx=0x7fc2a4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:05:41.281 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.278+0000 7fc29b7fe700 1 -- 172.21.15.203:0/2508363316 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2a400e040 con 0x7fc2b40fe050 2024-04-12T09:05:41.281 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.278+0000 7fc2b96c6700 1 -- 172.21.15.203:0/2508363316 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b4112fb0 con 0x7fc2b40fe050 2024-04-12T09:05:41.281 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.278+0000 7fc29b7fe700 1 -- 172.21.15.203:0/2508363316 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc2a400bbf0 con 0x7fc2b40fe050 2024-04-12T09:05:41.281 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.278+0000 7fc29b7fe700 1 -- 172.21.15.203:0/2508363316 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2a401c630 con 0x7fc2b40fe050 2024-04-12T09:05:41.282 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.278+0000 7fc2b96c6700 1 -- 172.21.15.203:0/2508363316 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b4113540 con 0x7fc2b40fe050 2024-04-12T09:05:41.282 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.279+0000 7fc2b96c6700 1 -- 172.21.15.203:0/2508363316 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b404c710 con 0x7fc2b40fe050 2024-04-12T09:05:41.282 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.280+0000 7fc29b7fe700 1 -- 172.21.15.203:0/2508363316 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7fc2a400bd60 con 0x7fc2b40fe050 2024-04-12T09:05:41.283 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.280+0000 7fc29b7fe700 1 --2- 172.21.15.203:0/2508363316 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc29c069210 0x7fc29c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:05:41.283 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.280+0000 7fc29b7fe700 1 -- 172.21.15.203:0/2508363316 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3217+0+0 (secure 0 0 0) 0x7fc2a40874b0 con 0x7fc2b40fe050 2024-04-12T09:05:41.283 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.280+0000 7fc2b2ffd700 1 --2- 172.21.15.203:0/2508363316 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc29c069210 0x7fc29c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:05:41.283 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.280+0000 7fc2b2ffd700 1 --2- 172.21.15.203:0/2508363316 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc29c069210 0x7fc29c06b6c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc2b40fdbc0 tx=0x7fc2a800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:05:41.285 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.285+0000 7fc29b7fe700 1 -- 172.21.15.203:0/2508363316 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fc2a4057c10 con 0x7fc2b40fe050 2024-04-12T09:05:41.478 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:41.478+0000 7fc2b96c6700 1 -- 172.21.15.203:0/2508363316 --> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2b4102410 con 0x7fc29c069210 2024-04-12T09:05:41.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:41 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-04-12T09:05:41.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:41 smithi203 ceph-mon[36428]: osdmap e20: 3 total, 3 up, 3 in 2024-04-12T09:05:41.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:41 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-12T09:05:41.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:41 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-04-12T09:05:41.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:41 smithi117 ceph-mon[29277]: osdmap e20: 3 total, 3 up, 3 in 2024-04-12T09:05:41.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:41 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-12T09:05:42.526 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:42 smithi117 ceph-mon[29277]: pgmap v73: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-12T09:05:42.526 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:42 smithi117 ceph-mon[29277]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-12T09:05:42.526 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:42 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-12T09:05:42.526 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:42 smithi117 ceph-mon[29277]: osdmap e21: 3 total, 3 up, 3 in 2024-04-12T09:05:42.527 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:42 smithi117 ceph-mon[29277]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:05:42.527 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:42 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-12T09:05:42.527 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:42 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-12T09:05:42.527 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:42 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:05:42.527 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:05:42 smithi117 sudo[67159]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-12T09:05:42.527 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:05:42 smithi117 sudo[67159]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-12T09:05:42.527 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:05:42 smithi117 sudo[67159]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-12T09:05:42.527 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:05:42 smithi117 sudo[67159]: pam_unix(sudo:session): session closed for user root 2024-04-12T09:05:42.528 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:05:42 smithi117 sudo[67165]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-12T09:05:42.533 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:42 smithi203 ceph-mon[36428]: pgmap v73: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-12T09:05:42.534 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:42 smithi203 ceph-mon[36428]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-12T09:05:42.534 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:42 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-12T09:05:42.534 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:42 smithi203 ceph-mon[36428]: osdmap e21: 3 total, 3 up, 3 in 2024-04-12T09:05:42.534 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:42 smithi203 ceph-mon[36428]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:05:42.534 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:42 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-12T09:05:42.534 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:42 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-12T09:05:42.534 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:42 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:05:42.797 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:05:42 smithi117 sudo[67165]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-12T09:05:42.797 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:05:42 smithi117 sudo[67165]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-12T09:05:42.797 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:05:42 smithi117 sudo[67165]: pam_unix(sudo:session): session closed for user root 2024-04-12T09:05:43.065 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:05:42 smithi117 sudo[67168]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-12T09:05:43.065 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:05:42 smithi117 sudo[67168]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-12T09:05:43.065 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:05:42 smithi117 sudo[67168]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-12T09:05:43.065 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:05:42 smithi117 sudo[67168]: pam_unix(sudo:session): session closed for user root 2024-04-12T09:05:43.330 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:05:43 smithi117 sudo[67269]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-12T09:05:43.330 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:05:43 smithi117 sudo[67269]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-12T09:05:43.331 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:05:43 smithi117 sudo[67269]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-12T09:05:43.331 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:05:43 smithi117 sudo[67269]: pam_unix(sudo:session): session closed for user root 2024-04-12T09:05:43.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:43 smithi203 ceph-mon[36428]: osdmap e22: 3 total, 3 up, 3 in 2024-04-12T09:05:43.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:43 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:43.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:43 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:43.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:43 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:43.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:43 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:05:43.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:43 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:05:43.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:43 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:05:43.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:43 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:43.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:43 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:05:43.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:43 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:05:43.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:43 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:43.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:43 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:05:43.596 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:05:43 smithi117 sudo[67332]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-12T09:05:43.596 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:05:43 smithi117 sudo[67332]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-12T09:05:43.597 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:05:43 smithi117 sudo[67332]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-12T09:05:43.597 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:05:43 smithi117 sudo[67332]: pam_unix(sudo:session): session closed for user root 2024-04-12T09:05:43.597 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:43 smithi117 ceph-mon[29277]: osdmap e22: 3 total, 3 up, 3 in 2024-04-12T09:05:43.597 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:43 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:43.597 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:43 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:43.597 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:43 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:43.597 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:43 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:05:43.597 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:43 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:05:43.597 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:43 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:05:43.597 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:43 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:43.597 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:43 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:05:43.597 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:43 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:05:43.598 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:43 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:43.598 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:43 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:05:43.847 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:05:43 smithi117 sudo[67366]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-12T09:05:43.847 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:05:43 smithi117 sudo[67366]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-12T09:05:43.847 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:05:43 smithi117 sudo[67366]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-12T09:05:43.847 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:05:43 smithi117 sudo[67366]: pam_unix(sudo:session): session closed for user root 2024-04-12T09:05:44.114 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:43 smithi117 sudo[67383]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-12T09:05:44.114 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:43 smithi117 sudo[67383]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-12T09:05:44.114 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:43 smithi117 sudo[67383]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-12T09:05:44.114 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:43 smithi117 sudo[67383]: pam_unix(sudo:session): session closed for user root 2024-04-12T09:05:44.380 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:44 smithi117 sudo[67433]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-12T09:05:44.380 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:44 smithi117 sudo[67433]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-12T09:05:44.380 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:44 smithi117 sudo[67433]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-12T09:05:44.380 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:44 smithi117 sudo[67433]: pam_unix(sudo:session): session closed for user root 2024-04-12T09:05:44.616 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:44 smithi203 sudo[39754]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-12T09:05:44.616 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:44 smithi203 sudo[39754]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-12T09:05:44.617 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:44 smithi203 sudo[39754]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-12T09:05:44.617 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:44 smithi203 sudo[39754]: pam_unix(sudo:session): session closed for user root 2024-04-12T09:05:44.622 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:44.622+0000 7fc29b7fe700 1 -- 172.21.15.203:0/2508363316 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fc2a4013980 con 0x7fc2b40fe050 2024-04-12T09:05:44.630 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:44 smithi117 ceph-mon[29277]: Detected new or changed devices on smithi117 2024-04-12T09:05:44.630 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:44 smithi117 ceph-mon[29277]: Adjusting osd_memory_target on smithi117 to 4288M 2024-04-12T09:05:44.630 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:44 smithi117 ceph-mon[29277]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-12T09:05:44.630 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:44 smithi117 ceph-mon[29277]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-12T09:05:44.630 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:44 smithi117 ceph-mon[29277]: from='client.? 172.21.15.203:0/1084329785' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e2bd1672-4153-498a-a20b-838516b0876c"}]: dispatch 2024-04-12T09:05:44.630 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:44 smithi117 ceph-mon[29277]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-12T09:05:44.630 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:44 smithi117 ceph-mon[29277]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-12T09:05:44.630 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:44 smithi117 ceph-mon[29277]: Cluster is now healthy 2024-04-12T09:05:44.630 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:44 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-04-12T09:05:44.630 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:44 smithi117 ceph-mon[29277]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e2bd1672-4153-498a-a20b-838516b0876c"}]: dispatch 2024-04-12T09:05:44.630 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:44 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:05:44.630 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:44 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-04-12T09:05:44.630 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:44 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:05:44.631 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:44 smithi117 ceph-mon[29277]: mgrmap e19: smithi117.oyaxql(active, since 2m), standbys: smithi203.apfqpo 2024-04-12T09:05:44.993 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:44 smithi203 sudo[39757]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-12T09:05:44.993 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:44 smithi203 sudo[39757]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-12T09:05:44.994 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:44 smithi203 sudo[39757]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-12T09:05:44.994 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:44 smithi203 sudo[39757]: pam_unix(sudo:session): session closed for user root 2024-04-12T09:05:44.994 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:44 smithi203 ceph-mon[36428]: Detected new or changed devices on smithi117 2024-04-12T09:05:44.994 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:44 smithi203 ceph-mon[36428]: Adjusting osd_memory_target on smithi117 to 4288M 2024-04-12T09:05:44.994 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:44 smithi203 ceph-mon[36428]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-12T09:05:44.994 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:44 smithi203 ceph-mon[36428]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-12T09:05:44.994 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:44 smithi203 ceph-mon[36428]: from='client.? 172.21.15.203:0/1084329785' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e2bd1672-4153-498a-a20b-838516b0876c"}]: dispatch 2024-04-12T09:05:44.994 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:44 smithi203 ceph-mon[36428]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-12T09:05:44.994 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:44 smithi203 ceph-mon[36428]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-12T09:05:44.994 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:44 smithi203 ceph-mon[36428]: Cluster is now healthy 2024-04-12T09:05:44.995 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:44 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-04-12T09:05:44.995 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:44 smithi203 ceph-mon[36428]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e2bd1672-4153-498a-a20b-838516b0876c"}]: dispatch 2024-04-12T09:05:44.995 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:44 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:05:44.995 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:44 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-04-12T09:05:44.995 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:44 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:05:44.995 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:44 smithi203 ceph-mon[36428]: mgrmap e19: smithi117.oyaxql(active, since 2m), standbys: smithi203.apfqpo 2024-04-12T09:05:45.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:45 smithi117 ceph-mon[29277]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-12T09:05:45.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:45 smithi117 ceph-mon[29277]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-12T09:05:45.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:45 smithi117 ceph-mon[29277]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e2bd1672-4153-498a-a20b-838516b0876c"}]': finished 2024-04-12T09:05:45.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:45 smithi117 ceph-mon[29277]: osdmap e23: 4 total, 3 up, 4 in 2024-04-12T09:05:45.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:45 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T09:05:45.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:45 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:45.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:45 smithi117 ceph-mon[29277]: from='client.? 172.21.15.203:0/2515765990' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-12T09:05:46.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:45 smithi203 ceph-mon[36428]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-12T09:05:46.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:45 smithi203 ceph-mon[36428]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-12T09:05:46.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:45 smithi203 ceph-mon[36428]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e2bd1672-4153-498a-a20b-838516b0876c"}]': finished 2024-04-12T09:05:46.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:45 smithi203 ceph-mon[36428]: osdmap e23: 4 total, 3 up, 4 in 2024-04-12T09:05:46.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:45 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T09:05:46.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:45 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:46.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:45 smithi203 ceph-mon[36428]: from='client.? 172.21.15.203:0/2515765990' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-12T09:05:46.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:46 smithi117 ceph-mon[29277]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-12T09:05:46.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:46 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:05:47.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:46 smithi203 ceph-mon[36428]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-12T09:05:47.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:46 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:05:48.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:48 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:48.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:48 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:48.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:48 smithi203 ceph-mon[36428]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-12T09:05:48.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:48 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:05:48.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:48 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:05:48.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:48 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:48.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:48 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:48.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:48 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:48.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:48 smithi117 ceph-mon[29277]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-12T09:05:48.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:48 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:05:48.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:48 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:05:48.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:48 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:50.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:50 smithi203 ceph-mon[36428]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-04-12T09:05:50.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:50 smithi117 ceph-mon[29277]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-04-12T09:05:52.749 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:52 smithi203 ceph-mon[36428]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-04-12T09:05:52.750 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:52 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-12T09:05:52.750 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:52 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:05:52.750 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:52 smithi203 ceph-mon[36428]: Deploying daemon osd.3 on smithi203 2024-04-12T09:05:52.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:52 smithi117 ceph-mon[29277]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-04-12T09:05:52.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:52 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-12T09:05:52.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:52 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:05:52.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:52 smithi117 ceph-mon[29277]: Deploying daemon osd.3 on smithi203 2024-04-12T09:05:54.457 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:54 smithi203 ceph-mon[36428]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-12T09:05:54.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:54 smithi117 ceph-mon[29277]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-04-12T09:05:56.536 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:56 smithi203 ceph-mon[36428]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.7 KiB/s rd, 73 KiB/s wr, 5 op/s 2024-04-12T09:05:56.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:56 smithi117 ceph-mon[29277]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.7 KiB/s rd, 73 KiB/s wr, 5 op/s 2024-04-12T09:05:57.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:57 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:57.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:57 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:57.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:57 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:05:57.990 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:57 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:57.990 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:57 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:05:57.990 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:57 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:05:58.798 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:05:58 smithi203 ceph-mon[36428]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-12T09:05:58.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:05:58 smithi117 ceph-mon[29277]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-12T09:05:59.436 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 3 on host 'smithi203' 2024-04-12T09:05:59.437 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:59.434+0000 7fc29b7fe700 1 -- 172.21.15.203:0/2508363316 <== mgr.14214 v2:172.21.15.117:6800/3945342300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc2b4102410 con 0x7fc29c069210 2024-04-12T09:05:59.439 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:59.437+0000 7fc2b96c6700 1 -- 172.21.15.203:0/2508363316 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc29c069210 msgr2=0x7fc29c06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:05:59.439 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:59.437+0000 7fc2b96c6700 1 --2- 172.21.15.203:0/2508363316 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc29c069210 0x7fc29c06b6c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc2b40fdbc0 tx=0x7fc2a800b040 comp rx=0 tx=0).stop 2024-04-12T09:05:59.439 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:59.437+0000 7fc2b96c6700 1 -- 172.21.15.203:0/2508363316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2b40fe050 msgr2=0x7fc2b410dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:05:59.439 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:59.437+0000 7fc2b96c6700 1 --2- 172.21.15.203:0/2508363316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2b40fe050 0x7fc2b410dee0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400b3b0 tx=0x7fc2a4009e30 comp rx=0 tx=0).stop 2024-04-12T09:05:59.439 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:59.437+0000 7fc2b96c6700 1 -- 172.21.15.203:0/2508363316 shutdown_connections 2024-04-12T09:05:59.439 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:59.437+0000 7fc2b96c6700 1 --2- 172.21.15.203:0/2508363316 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc29c069210 0x7fc29c06b6c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:05:59.439 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:59.437+0000 7fc2b96c6700 1 --2- 172.21.15.203:0/2508363316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2b40fce50 0x7fc2b410d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:05:59.439 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:59.437+0000 7fc2b96c6700 1 --2- 172.21.15.203:0/2508363316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2b40fe050 0x7fc2b410dee0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:05:59.439 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:59.437+0000 7fc2b96c6700 1 -- 172.21.15.203:0/2508363316 >> 172.21.15.203:0/2508363316 conn(0x7fc2b40f8560 msgr2=0x7fc2b40f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:05:59.439 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:59.437+0000 7fc2b96c6700 1 -- 172.21.15.203:0/2508363316 shutdown_connections 2024-04-12T09:05:59.439 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:05:59.437+0000 7fc2b96c6700 1 -- 172.21.15.203:0/2508363316 wait complete. 2024-04-12T09:06:00.031 DEBUG:teuthology.orchestra.run.smithi203:osd.3> sudo journalctl -f -n 0 -u ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.3.service 2024-04-12T09:06:00.034 INFO:tasks.cephadm:Deploying osd.4 on smithi203 with /dev/vg_nvme/lv_3... 2024-04-12T09:06:00.034 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-12T09:06:00.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:00 smithi203 ceph-mon[36428]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-12T09:06:00.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:00 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:00.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:00 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:00.574 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:06:00 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3[41837]: 2024-04-12T09:06:00.500+0000 7f3258386540 -1 osd.3 0 log_to_monitors true 2024-04-12T09:06:00.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:00 smithi117 ceph-mon[29277]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-04-12T09:06:00.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:00 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:00.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:00 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:00.687 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi203/config 2024-04-12T09:06:01.719 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:01 smithi203 ceph-mon[36428]: from='osd.3 [v2:172.21.15.203:6800/824187707,v1:172.21.15.203:6801/824187707]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-12T09:06:01.719 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:01 smithi203 ceph-mon[36428]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-12T09:06:01.719 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:01 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:06:01.719 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:01 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:01.859 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:01 smithi117 ceph-mon[29277]: from='osd.3 [v2:172.21.15.203:6800/824187707,v1:172.21.15.203:6801/824187707]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-12T09:06:01.859 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:01 smithi117 ceph-mon[29277]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-12T09:06:01.859 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:01 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:06:01.859 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:01 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:02.537 INFO:teuthology.orchestra.run.smithi203.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-12T09:06:02.538 INFO:teuthology.orchestra.run.smithi203.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-12T09:06:02.538 INFO:teuthology.orchestra.run.smithi203.stderr: stderr: 10+0 records in 2024-04-12T09:06:02.538 INFO:teuthology.orchestra.run.smithi203.stderr:10+0 records out 2024-04-12T09:06:02.538 INFO:teuthology.orchestra.run.smithi203.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0125038 s, 839 MB/s 2024-04-12T09:06:02.538 INFO:teuthology.orchestra.run.smithi203.stderr:--> Zapping successful for: 2024-04-12T09:06:02.635 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:06:02 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3[41837]: 2024-04-12T09:06:02.422+0000 7f324eb58700 -1 osd.3 0 waiting for initial osdmap 2024-04-12T09:06:02.635 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:06:02 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3[41837]: 2024-04-12T09:06:02.429+0000 7f324b957700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T09:06:02.635 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:02 smithi203 ceph-mon[36428]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-12T09:06:02.635 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:02 smithi203 ceph-mon[36428]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-12T09:06:02.635 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:02 smithi203 ceph-mon[36428]: osdmap e24: 4 total, 3 up, 4 in 2024-04-12T09:06:02.635 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:02 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:02.635 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:02 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T09:06:02.635 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:02 smithi203 ceph-mon[36428]: from='osd.3 [v2:172.21.15.203:6800/824187707,v1:172.21.15.203:6801/824187707]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-04-12T09:06:02.635 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:02 smithi203 ceph-mon[36428]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-04-12T09:06:02.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:02 smithi117 ceph-mon[29277]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-12T09:06:02.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:02 smithi117 ceph-mon[29277]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-12T09:06:02.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:02 smithi117 ceph-mon[29277]: osdmap e24: 4 total, 3 up, 4 in 2024-04-12T09:06:02.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:02 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:02.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:02 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T09:06:02.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:02 smithi117 ceph-mon[29277]: from='osd.3 [v2:172.21.15.203:6800/824187707,v1:172.21.15.203:6801/824187707]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-04-12T09:06:02.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:02 smithi117 ceph-mon[29277]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-04-12T09:06:03.509 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:03 smithi203 ceph-mon[36428]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-04-12T09:06:03.509 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:03 smithi203 ceph-mon[36428]: osdmap e25: 4 total, 3 up, 4 in 2024-04-12T09:06:03.509 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:03 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T09:06:03.509 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:03 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T09:06:03.752 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph orch daemon add osd smithi203:vg_nvme/lv_3 2024-04-12T09:06:03.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:03 smithi117 ceph-mon[29277]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-04-12T09:06:03.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:03 smithi117 ceph-mon[29277]: osdmap e25: 4 total, 3 up, 4 in 2024-04-12T09:06:03.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:03 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T09:06:03.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:03 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T09:06:04.181 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi203/config 2024-04-12T09:06:04.755 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:04 smithi203 ceph-mon[36428]: purged_snaps scrub starts 2024-04-12T09:06:04.755 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:04 smithi203 ceph-mon[36428]: purged_snaps scrub ok 2024-04-12T09:06:04.755 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:04 smithi203 ceph-mon[36428]: pgmap v89: 1 pgs: 1 peering; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-12T09:06:04.755 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:04 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T09:06:04.756 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:04 smithi203 ceph-mon[36428]: osd.3 [v2:172.21.15.203:6800/824187707,v1:172.21.15.203:6801/824187707] boot 2024-04-12T09:06:04.756 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:04 smithi203 ceph-mon[36428]: osdmap e26: 4 total, 4 up, 4 in 2024-04-12T09:06:04.756 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:04 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T09:06:04.756 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:04 smithi203 ceph-mon[36428]: osdmap e27: 4 total, 4 up, 4 in 2024-04-12T09:06:04.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:04 smithi117 ceph-mon[29277]: purged_snaps scrub starts 2024-04-12T09:06:04.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:04 smithi117 ceph-mon[29277]: purged_snaps scrub ok 2024-04-12T09:06:04.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:04 smithi117 ceph-mon[29277]: pgmap v89: 1 pgs: 1 peering; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-12T09:06:04.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:04 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T09:06:04.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:04 smithi117 ceph-mon[29277]: osd.3 [v2:172.21.15.203:6800/824187707,v1:172.21.15.203:6801/824187707] boot 2024-04-12T09:06:04.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:04 smithi117 ceph-mon[29277]: osdmap e26: 4 total, 4 up, 4 in 2024-04-12T09:06:04.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:04 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T09:06:04.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:04 smithi117 ceph-mon[29277]: osdmap e27: 4 total, 4 up, 4 in 2024-04-12T09:06:06.168 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.166+0000 7fc91e703700 1 -- 172.21.15.203:0/2721697009 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc9180fdfe0 msgr2=0x7fc9180fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:06:06.168 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.166+0000 7fc91e703700 1 --2- 172.21.15.203:0/2721697009 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc9180fdfe0 0x7fc9180fe450 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc90c004940 tx=0x7fc90c009e30 comp rx=0 tx=0).stop 2024-04-12T09:06:06.168 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.166+0000 7fc91e703700 1 -- 172.21.15.203:0/2721697009 shutdown_connections 2024-04-12T09:06:06.168 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.166+0000 7fc91e703700 1 --2- 172.21.15.203:0/2721697009 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc9180fdfe0 0x7fc9180fe450 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:06.168 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.166+0000 7fc91e703700 1 --2- 172.21.15.203:0/2721697009 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9180fce70 0x7fc9180fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:06.168 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.166+0000 7fc91e703700 1 -- 172.21.15.203:0/2721697009 >> 172.21.15.203:0/2721697009 conn(0x7fc9180f8550 msgr2=0x7fc9180fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:06:06.170 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.167+0000 7fc91e703700 1 -- 172.21.15.203:0/2721697009 shutdown_connections 2024-04-12T09:06:06.170 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.167+0000 7fc91e703700 1 -- 172.21.15.203:0/2721697009 wait complete. 2024-04-12T09:06:06.170 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.168+0000 7fc91e703700 1 Processor -- start 2024-04-12T09:06:06.170 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.168+0000 7fc91e703700 1 -- start start 2024-04-12T09:06:06.170 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.168+0000 7fc91e703700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9180fce70 0x7fc918071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:06:06.170 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.168+0000 7fc91e703700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc9180fdfe0 0x7fc918070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:06:06.170 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.168+0000 7fc91e703700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc918070850 con 0x7fc9180fce70 2024-04-12T09:06:06.170 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.168+0000 7fc91e703700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9180709c0 con 0x7fc9180fdfe0 2024-04-12T09:06:06.170 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.168+0000 7fc9177fe700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc9180fdfe0 0x7fc918070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:06:06.170 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.168+0000 7fc9177fe700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc9180fdfe0 0x7fc918070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:46408/0 (socket says 172.21.15.203:46408) 2024-04-12T09:06:06.171 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.168+0000 7fc9177fe700 1 -- 172.21.15.203:0/775865326 learned_addr learned my addr 172.21.15.203:0/775865326 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-12T09:06:06.171 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.168+0000 7fc917fff700 1 --2- 172.21.15.203:0/775865326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9180fce70 0x7fc918071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:06:06.171 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.168+0000 7fc9177fe700 1 -- 172.21.15.203:0/775865326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9180fce70 msgr2=0x7fc918071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:06:06.171 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.168+0000 7fc9177fe700 1 --2- 172.21.15.203:0/775865326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9180fce70 0x7fc918071c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:06.171 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.168+0000 7fc9177fe700 1 -- 172.21.15.203:0/775865326 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c005040 con 0x7fc9180fdfe0 2024-04-12T09:06:06.171 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.168+0000 7fc9177fe700 1 --2- 172.21.15.203:0/775865326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc9180fdfe0 0x7fc918070310 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009150 tx=0x7fc90c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:06:06.171 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.169+0000 7fc914ff9700 1 -- 172.21.15.203:0/775865326 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc90c00e040 con 0x7fc9180fdfe0 2024-04-12T09:06:06.171 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.169+0000 7fc91e703700 1 -- 172.21.15.203:0/775865326 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc918070c40 con 0x7fc9180fdfe0 2024-04-12T09:06:06.171 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.169+0000 7fc914ff9700 1 -- 172.21.15.203:0/775865326 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc90c00bbf0 con 0x7fc9180fdfe0 2024-04-12T09:06:06.171 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.169+0000 7fc914ff9700 1 -- 172.21.15.203:0/775865326 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc90c01c630 con 0x7fc9180fdfe0 2024-04-12T09:06:06.171 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.169+0000 7fc91e703700 1 -- 172.21.15.203:0/775865326 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc918115a50 con 0x7fc9180fdfe0 2024-04-12T09:06:06.172 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.170+0000 7fc91e703700 1 -- 172.21.15.203:0/775865326 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc91804c710 con 0x7fc9180fdfe0 2024-04-12T09:06:06.172 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.170+0000 7fc914ff9700 1 -- 172.21.15.203:0/775865326 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fc90c00bd60 con 0x7fc9180fdfe0 2024-04-12T09:06:06.172 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.170+0000 7fc914ff9700 1 --2- 172.21.15.203:0/775865326 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc9000692a0 0x7fc90006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:06:06.172 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.171+0000 7fc914ff9700 1 -- 172.21.15.203:0/775865326 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3770+0+0 (secure 0 0 0) 0x7fc90c087e20 con 0x7fc9180fdfe0 2024-04-12T09:06:06.172 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.171+0000 7fc917fff700 1 --2- 172.21.15.203:0/775865326 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc9000692a0 0x7fc90006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:06:06.173 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.171+0000 7fc917fff700 1 --2- 172.21.15.203:0/775865326 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc9000692a0 0x7fc90006b750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc908009bf0 tx=0x7fc9080091a0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:06:06.176 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.175+0000 7fc914ff9700 1 -- 172.21.15.203:0/775865326 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fc90c058330 con 0x7fc9180fdfe0 2024-04-12T09:06:06.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:06 smithi203 ceph-mon[36428]: osdmap e28: 4 total, 4 up, 4 in 2024-04-12T09:06:06.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:06 smithi203 ceph-mon[36428]: pgmap v93: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T09:06:06.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:06 smithi203 ceph-mon[36428]: Detected new or changed devices on smithi203 2024-04-12T09:06:06.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:06 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:06.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:06 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:06.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:06 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:06:06.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:06 smithi203 ceph-mon[36428]: Adjusting osd_memory_target on smithi203 to 15936M 2024-04-12T09:06:06.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:06 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:06.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:06 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:06:06.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:06 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:06:06.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:06 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:06.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:06 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:06:06.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:06 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:06:06.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:06 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:06:06.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:06 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:06.368 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:06.366+0000 7fc91e703700 1 -- 172.21.15.203:0/775865326 --> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fc918102280 con 0x7fc9000692a0 2024-04-12T09:06:06.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:06 smithi117 ceph-mon[29277]: osdmap e28: 4 total, 4 up, 4 in 2024-04-12T09:06:06.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:06 smithi117 ceph-mon[29277]: pgmap v93: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T09:06:06.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:06 smithi117 ceph-mon[29277]: Detected new or changed devices on smithi203 2024-04-12T09:06:06.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:06 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:06.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:06 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:06.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:06 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:06:06.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:06 smithi117 ceph-mon[29277]: Adjusting osd_memory_target on smithi203 to 15936M 2024-04-12T09:06:06.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:06 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:06.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:06 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:06:06.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:06 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:06:06.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:06 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:06.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:06 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:06:06.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:06 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:06:06.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:06 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:06:06.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:06 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:07.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:07 smithi203 ceph-mon[36428]: osdmap e29: 4 total, 4 up, 4 in 2024-04-12T09:06:07.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:07 smithi203 ceph-mon[36428]: from='client.24155 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:06:07.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:07 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-12T09:06:07.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:07 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-12T09:06:07.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:07 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:06:07.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:07 smithi117 ceph-mon[29277]: osdmap e29: 4 total, 4 up, 4 in 2024-04-12T09:06:07.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:07 smithi117 ceph-mon[29277]: from='client.24155 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:06:07.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:07 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-12T09:06:07.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:07 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-12T09:06:07.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:07 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:06:08.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:08 smithi117 ceph-mon[29277]: osdmap e30: 4 total, 4 up, 4 in 2024-04-12T09:06:08.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:08 smithi117 ceph-mon[29277]: pgmap v96: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T09:06:08.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:08 smithi203 ceph-mon[36428]: osdmap e30: 4 total, 4 up, 4 in 2024-04-12T09:06:08.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:08 smithi203 ceph-mon[36428]: pgmap v96: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T09:06:09.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:09 smithi203 ceph-mon[36428]: from='client.? 172.21.15.203:0/1548944467' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e8e6b7b8-45c2-4186-aeef-9b2feccf9fe6"}]: dispatch 2024-04-12T09:06:09.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:09 smithi203 ceph-mon[36428]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e8e6b7b8-45c2-4186-aeef-9b2feccf9fe6"}]: dispatch 2024-04-12T09:06:09.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:09 smithi203 ceph-mon[36428]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e8e6b7b8-45c2-4186-aeef-9b2feccf9fe6"}]': finished 2024-04-12T09:06:09.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:09 smithi203 ceph-mon[36428]: osdmap e31: 5 total, 4 up, 5 in 2024-04-12T09:06:09.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:09 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T09:06:09.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:09 smithi117 ceph-mon[29277]: from='client.? 172.21.15.203:0/1548944467' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e8e6b7b8-45c2-4186-aeef-9b2feccf9fe6"}]: dispatch 2024-04-12T09:06:09.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:09 smithi117 ceph-mon[29277]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e8e6b7b8-45c2-4186-aeef-9b2feccf9fe6"}]: dispatch 2024-04-12T09:06:09.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:09 smithi117 ceph-mon[29277]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e8e6b7b8-45c2-4186-aeef-9b2feccf9fe6"}]': finished 2024-04-12T09:06:09.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:09 smithi117 ceph-mon[29277]: osdmap e31: 5 total, 4 up, 5 in 2024-04-12T09:06:09.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:09 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T09:06:10.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:10 smithi117 ceph-mon[29277]: from='client.? 172.21.15.203:0/597622220' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-12T09:06:10.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:10 smithi117 ceph-mon[29277]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 136 KiB/s, 0 objects/s recovering 2024-04-12T09:06:10.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:10 smithi203 ceph-mon[36428]: from='client.? 172.21.15.203:0/597622220' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-12T09:06:10.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:10 smithi203 ceph-mon[36428]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 136 KiB/s, 0 objects/s recovering 2024-04-12T09:06:12.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:12 smithi203 ceph-mon[36428]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-12T09:06:12.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:12 smithi117 ceph-mon[29277]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-12T09:06:14.728 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:14 smithi203 ceph-mon[36428]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-04-12T09:06:14.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:14 smithi117 ceph-mon[29277]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-04-12T09:06:16.532 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:16 smithi203 ceph-mon[36428]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-04-12T09:06:16.532 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:16 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-12T09:06:16.532 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:16 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:06:16.532 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:16 smithi203 ceph-mon[36428]: Deploying daemon osd.4 on smithi203 2024-04-12T09:06:16.532 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:16 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:06:16.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:16 smithi117 ceph-mon[29277]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-04-12T09:06:16.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:16 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-12T09:06:16.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:16 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:06:16.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:16 smithi117 ceph-mon[29277]: Deploying daemon osd.4 on smithi203 2024-04-12T09:06:16.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:16 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:06:18.657 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:18 smithi203 ceph-mon[36428]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-12T09:06:18.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:18 smithi117 ceph-mon[29277]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-12T09:06:20.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:20 smithi203 ceph-mon[36428]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T09:06:20.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:20 smithi117 ceph-mon[29277]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T09:06:22.146 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:21 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:22.146 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:21 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:22.146 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:21 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:06:22.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:21 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:22.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:21 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:22.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:21 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:06:23.125 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:22 smithi203 ceph-mon[36428]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T09:06:23.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:22 smithi117 ceph-mon[29277]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T09:06:23.828 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:23.827+0000 7fc914ff9700 1 -- 172.21.15.203:0/775865326 <== mgr.14214 v2:172.21.15.117:6800/3945342300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc918102280 con 0x7fc9000692a0 2024-04-12T09:06:23.828 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 4 on host 'smithi203' 2024-04-12T09:06:23.829 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:23.829+0000 7fc91e703700 1 -- 172.21.15.203:0/775865326 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc9000692a0 msgr2=0x7fc90006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:06:23.830 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:23.829+0000 7fc91e703700 1 --2- 172.21.15.203:0/775865326 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc9000692a0 0x7fc90006b750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc908009bf0 tx=0x7fc9080091a0 comp rx=0 tx=0).stop 2024-04-12T09:06:23.830 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:23.829+0000 7fc91e703700 1 -- 172.21.15.203:0/775865326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc9180fdfe0 msgr2=0x7fc918070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:06:23.830 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:23.829+0000 7fc91e703700 1 --2- 172.21.15.203:0/775865326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc9180fdfe0 0x7fc918070310 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009150 tx=0x7fc90c009e30 comp rx=0 tx=0).stop 2024-04-12T09:06:23.830 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:23.829+0000 7fc91e703700 1 -- 172.21.15.203:0/775865326 shutdown_connections 2024-04-12T09:06:23.830 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:23.829+0000 7fc91e703700 1 --2- 172.21.15.203:0/775865326 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc9000692a0 0x7fc90006b750 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:23.830 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:23.829+0000 7fc91e703700 1 --2- 172.21.15.203:0/775865326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9180fce70 0x7fc918071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:23.830 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:23.829+0000 7fc91e703700 1 --2- 172.21.15.203:0/775865326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc9180fdfe0 0x7fc918070310 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:23.830 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:23.829+0000 7fc91e703700 1 -- 172.21.15.203:0/775865326 >> 172.21.15.203:0/775865326 conn(0x7fc9180f8550 msgr2=0x7fc9180f9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:06:23.830 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:23.830+0000 7fc91e703700 1 -- 172.21.15.203:0/775865326 shutdown_connections 2024-04-12T09:06:23.830 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:23.830+0000 7fc91e703700 1 -- 172.21.15.203:0/775865326 wait complete. 2024-04-12T09:06:24.410 DEBUG:teuthology.orchestra.run.smithi203:osd.4> sudo journalctl -f -n 0 -u ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.4.service 2024-04-12T09:06:24.412 INFO:tasks.cephadm:Deploying osd.5 on smithi203 with /dev/vg_nvme/lv_2... 2024-04-12T09:06:24.413 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-12T09:06:25.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:24 smithi203 ceph-mon[36428]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T09:06:25.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:24 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:25.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:24 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:25.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:24 smithi203 ceph-mon[36428]: from='osd.4 [v2:172.21.15.203:6808/22684123,v1:172.21.15.203:6809/22684123]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-12T09:06:25.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:24 smithi203 ceph-mon[36428]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-12T09:06:25.074 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:06:24 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4[48448]: 2024-04-12T09:06:24.737+0000 7febb7870540 -1 osd.4 0 log_to_monitors true 2024-04-12T09:06:25.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:24 smithi117 ceph-mon[29277]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T09:06:25.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:24 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:25.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:24 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:25.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:24 smithi117 ceph-mon[29277]: from='osd.4 [v2:172.21.15.203:6808/22684123,v1:172.21.15.203:6809/22684123]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-12T09:06:25.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:24 smithi117 ceph-mon[29277]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-12T09:06:25.270 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi203/config 2024-04-12T09:06:25.946 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:06:25 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4[48448]: 2024-04-12T09:06:25.856+0000 7febae042700 -1 osd.4 0 waiting for initial osdmap 2024-04-12T09:06:25.947 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:06:25 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4[48448]: 2024-04-12T09:06:25.863+0000 7feba8e3d700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T09:06:25.947 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:25 smithi203 ceph-mon[36428]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-12T09:06:25.947 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:25 smithi203 ceph-mon[36428]: osdmap e32: 5 total, 4 up, 5 in 2024-04-12T09:06:25.947 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:25 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T09:06:25.947 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:25 smithi203 ceph-mon[36428]: from='osd.4 [v2:172.21.15.203:6808/22684123,v1:172.21.15.203:6809/22684123]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-04-12T09:06:25.947 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:25 smithi203 ceph-mon[36428]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-04-12T09:06:26.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:25 smithi117 ceph-mon[29277]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-12T09:06:26.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:25 smithi117 ceph-mon[29277]: osdmap e32: 5 total, 4 up, 5 in 2024-04-12T09:06:26.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:25 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T09:06:26.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:25 smithi117 ceph-mon[29277]: from='osd.4 [v2:172.21.15.203:6808/22684123,v1:172.21.15.203:6809/22684123]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-04-12T09:06:26.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:25 smithi117 ceph-mon[29277]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-04-12T09:06:27.034 INFO:teuthology.orchestra.run.smithi203.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-12T09:06:27.034 INFO:teuthology.orchestra.run.smithi203.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-12T09:06:27.034 INFO:teuthology.orchestra.run.smithi203.stderr: stderr: 10+0 records in 2024-04-12T09:06:27.034 INFO:teuthology.orchestra.run.smithi203.stderr:10+0 records out 2024-04-12T09:06:27.034 INFO:teuthology.orchestra.run.smithi203.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0140638 s, 746 MB/s 2024-04-12T09:06:27.035 INFO:teuthology.orchestra.run.smithi203.stderr:--> Zapping successful for: 2024-04-12T09:06:27.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:26 smithi117 ceph-mon[29277]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T09:06:27.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:26 smithi117 ceph-mon[29277]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-04-12T09:06:27.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:26 smithi117 ceph-mon[29277]: osdmap e33: 5 total, 4 up, 5 in 2024-04-12T09:06:27.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:26 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T09:06:27.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:26 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T09:06:27.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:26 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:27.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:26 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:27.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:26 smithi117 ceph-mon[29277]: osd.4 [v2:172.21.15.203:6808/22684123,v1:172.21.15.203:6809/22684123] boot 2024-04-12T09:06:27.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:26 smithi203 ceph-mon[36428]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-12T09:06:27.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:26 smithi203 ceph-mon[36428]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-04-12T09:06:27.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:26 smithi203 ceph-mon[36428]: osdmap e33: 5 total, 4 up, 5 in 2024-04-12T09:06:27.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:26 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T09:06:27.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:26 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T09:06:27.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:26 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:27.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:26 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:27.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:26 smithi203 ceph-mon[36428]: osd.4 [v2:172.21.15.203:6808/22684123,v1:172.21.15.203:6809/22684123] boot 2024-04-12T09:06:27.656 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph orch daemon add osd smithi203:vg_nvme/lv_2 2024-04-12T09:06:27.933 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:27 smithi203 ceph-mon[36428]: purged_snaps scrub starts 2024-04-12T09:06:27.933 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:27 smithi203 ceph-mon[36428]: purged_snaps scrub ok 2024-04-12T09:06:27.933 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:27 smithi203 ceph-mon[36428]: osdmap e34: 5 total, 5 up, 5 in 2024-04-12T09:06:27.933 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:27 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T09:06:28.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:27 smithi117 ceph-mon[29277]: purged_snaps scrub starts 2024-04-12T09:06:28.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:27 smithi117 ceph-mon[29277]: purged_snaps scrub ok 2024-04-12T09:06:28.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:27 smithi117 ceph-mon[29277]: osdmap e34: 5 total, 5 up, 5 in 2024-04-12T09:06:28.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:27 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T09:06:28.578 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi203/config 2024-04-12T09:06:28.957 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:28 smithi203 ceph-mon[36428]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:28.957 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:28 smithi203 ceph-mon[36428]: osdmap e35: 5 total, 5 up, 5 in 2024-04-12T09:06:29.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:28 smithi117 ceph-mon[29277]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:29.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:28 smithi117 ceph-mon[29277]: osdmap e35: 5 total, 5 up, 5 in 2024-04-12T09:06:31.076 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:30 smithi117 ceph-mon[29277]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:31.076 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:30 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:31.076 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:30 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:31.076 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:30 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:06:31.076 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:30 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:06:31.076 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:30 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:31.076 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:30 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:06:31.077 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:30 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:06:31.077 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:30 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:31.123 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:30 smithi203 ceph-mon[36428]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:31.123 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:30 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:31.123 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:30 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:31.123 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:30 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:06:31.123 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:30 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:06:31.123 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:30 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:31.123 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:30 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:06:31.123 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:30 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:06:31.124 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:30 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:31.225 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.223+0000 7f263518d700 1 -- 172.21.15.203:0/1193912685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26300fdfe0 msgr2=0x7f26300fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:06:31.226 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.223+0000 7f263518d700 1 --2- 172.21.15.203:0/1193912685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26300fdfe0 0x7f26300fe450 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2624004940 tx=0x7f2624009e30 comp rx=0 tx=0).stop 2024-04-12T09:06:31.226 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.223+0000 7f263518d700 1 -- 172.21.15.203:0/1193912685 shutdown_connections 2024-04-12T09:06:31.226 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.223+0000 7f263518d700 1 --2- 172.21.15.203:0/1193912685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26300fdfe0 0x7f26300fe450 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:31.226 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.223+0000 7f263518d700 1 --2- 172.21.15.203:0/1193912685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26300fce70 0x7f26300fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:31.226 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.223+0000 7f263518d700 1 -- 172.21.15.203:0/1193912685 >> 172.21.15.203:0/1193912685 conn(0x7f26300f8550 msgr2=0x7f26300fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:06:31.226 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.223+0000 7f263518d700 1 -- 172.21.15.203:0/1193912685 shutdown_connections 2024-04-12T09:06:31.226 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.223+0000 7f263518d700 1 -- 172.21.15.203:0/1193912685 wait complete. 2024-04-12T09:06:31.226 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.224+0000 7f263518d700 1 Processor -- start 2024-04-12T09:06:31.226 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.224+0000 7f263518d700 1 -- start start 2024-04-12T09:06:31.226 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.224+0000 7f263518d700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26300fce70 0x7f2630071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:06:31.226 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.224+0000 7f263518d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26300fdfe0 0x7f2630070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:06:31.226 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.224+0000 7f263518d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2630072260 con 0x7f26300fdfe0 2024-04-12T09:06:31.226 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.224+0000 7f263518d700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2630070850 con 0x7f26300fce70 2024-04-12T09:06:31.226 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.224+0000 7f262ed9d700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26300fce70 0x7f2630071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:06:31.227 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.224+0000 7f262ed9d700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26300fce70 0x7f2630071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:34296/0 (socket says 172.21.15.203:34296) 2024-04-12T09:06:31.227 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.224+0000 7f262ed9d700 1 -- 172.21.15.203:0/504571086 learned_addr learned my addr 172.21.15.203:0/504571086 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-12T09:06:31.227 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.224+0000 7f262e59c700 1 --2- 172.21.15.203:0/504571086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26300fdfe0 0x7f2630070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:06:31.227 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.224+0000 7f262ed9d700 1 -- 172.21.15.203:0/504571086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26300fdfe0 msgr2=0x7f2630070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:06:31.227 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.224+0000 7f262ed9d700 1 --2- 172.21.15.203:0/504571086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26300fdfe0 0x7f2630070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:31.227 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.224+0000 7f262ed9d700 1 -- 172.21.15.203:0/504571086 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2624005040 con 0x7f26300fce70 2024-04-12T09:06:31.227 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.225+0000 7f262ed9d700 1 --2- 172.21.15.203:0/504571086 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26300fce70 0x7f2630071c60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f262000c8c0 tx=0x7f26200044c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:06:31.227 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.225+0000 7f26177fe700 1 -- 172.21.15.203:0/504571086 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f262000a980 con 0x7f26300fce70 2024-04-12T09:06:31.227 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.225+0000 7f263518d700 1 -- 172.21.15.203:0/504571086 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2630070b00 con 0x7f26300fce70 2024-04-12T09:06:31.227 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.225+0000 7f26177fe700 1 -- 172.21.15.203:0/504571086 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f262000ce60 con 0x7f26300fce70 2024-04-12T09:06:31.227 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.225+0000 7f26177fe700 1 -- 172.21.15.203:0/504571086 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26200115e0 con 0x7f26300fce70 2024-04-12T09:06:31.227 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.225+0000 7f263518d700 1 -- 172.21.15.203:0/504571086 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26300710c0 con 0x7f26300fce70 2024-04-12T09:06:31.228 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.226+0000 7f263518d700 1 -- 172.21.15.203:0/504571086 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f263004c710 con 0x7f26300fce70 2024-04-12T09:06:31.228 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.226+0000 7f26177fe700 1 -- 172.21.15.203:0/504571086 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f2620012400 con 0x7f26300fce70 2024-04-12T09:06:31.228 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.227+0000 7f26177fe700 1 --2- 172.21.15.203:0/504571086 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f26180692a0 0x7f261806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:06:31.228 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.227+0000 7f26177fe700 1 -- 172.21.15.203:0/504571086 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f2620086da0 con 0x7f26300fce70 2024-04-12T09:06:31.228 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.227+0000 7f262e59c700 1 --2- 172.21.15.203:0/504571086 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f26180692a0 0x7f261806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:06:31.228 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.227+0000 7f262e59c700 1 --2- 172.21.15.203:0/504571086 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f26180692a0 0x7f261806b750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f262400b3b0 tx=0x7f2624009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:06:31.231 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.231+0000 7f26177fe700 1 -- 172.21.15.203:0/504571086 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f2620057050 con 0x7f26300fce70 2024-04-12T09:06:31.425 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:31.425+0000 7f263518d700 1 -- 172.21.15.203:0/504571086 --> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f26301023a0 con 0x7f26180692a0 2024-04-12T09:06:32.110 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:31 smithi203 ceph-mon[36428]: Detected new or changed devices on smithi203 2024-04-12T09:06:32.110 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:31 smithi203 ceph-mon[36428]: Adjusting osd_memory_target on smithi203 to 7968M 2024-04-12T09:06:32.110 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:31 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:06:32.110 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:31 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:06:32.110 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:31 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:06:32.110 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:31 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:32.111 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:31 smithi203 ceph-mon[36428]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:32.111 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:31 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:06:32.111 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:31 smithi203 ceph-mon[36428]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:06:32.111 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:31 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-12T09:06:32.111 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:31 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-12T09:06:32.111 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:31 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:06:32.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:31 smithi117 ceph-mon[29277]: Detected new or changed devices on smithi203 2024-04-12T09:06:32.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:31 smithi117 ceph-mon[29277]: Adjusting osd_memory_target on smithi203 to 7968M 2024-04-12T09:06:32.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:31 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:06:32.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:31 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:06:32.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:31 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:06:32.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:31 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:32.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:31 smithi117 ceph-mon[29277]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:32.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:31 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:06:32.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:31 smithi117 ceph-mon[29277]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:06:32.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:31 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-12T09:06:32.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:31 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-12T09:06:32.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:31 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:06:34.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:34 smithi203 ceph-mon[36428]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:34.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:34 smithi203 ceph-mon[36428]: from='client.? 172.21.15.203:0/724668373' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abbad141-29e9-4028-9e29-293cc73169fe"}]: dispatch 2024-04-12T09:06:34.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:34 smithi203 ceph-mon[36428]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abbad141-29e9-4028-9e29-293cc73169fe"}]: dispatch 2024-04-12T09:06:34.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:34 smithi203 ceph-mon[36428]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "abbad141-29e9-4028-9e29-293cc73169fe"}]': finished 2024-04-12T09:06:34.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:34 smithi203 ceph-mon[36428]: osdmap e36: 6 total, 5 up, 6 in 2024-04-12T09:06:34.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:34 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T09:06:34.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:34 smithi117 ceph-mon[29277]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:34.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:34 smithi117 ceph-mon[29277]: from='client.? 172.21.15.203:0/724668373' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abbad141-29e9-4028-9e29-293cc73169fe"}]: dispatch 2024-04-12T09:06:34.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:34 smithi117 ceph-mon[29277]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abbad141-29e9-4028-9e29-293cc73169fe"}]: dispatch 2024-04-12T09:06:34.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:34 smithi117 ceph-mon[29277]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "abbad141-29e9-4028-9e29-293cc73169fe"}]': finished 2024-04-12T09:06:34.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:34 smithi117 ceph-mon[29277]: osdmap e36: 6 total, 5 up, 6 in 2024-04-12T09:06:34.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:34 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T09:06:35.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:35 smithi203 ceph-mon[36428]: from='client.? 172.21.15.203:0/3681115668' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-12T09:06:35.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:35 smithi117 ceph-mon[29277]: from='client.? 172.21.15.203:0/3681115668' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-12T09:06:36.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:36 smithi203 ceph-mon[36428]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:36.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:36 smithi117 ceph-mon[29277]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:38.812 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:38 smithi203 ceph-mon[36428]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:38.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:38 smithi117 ceph-mon[29277]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:40.645 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:40 smithi203 ceph-mon[36428]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:40.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:40 smithi117 ceph-mon[29277]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:41.675 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:41 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-12T09:06:41.676 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:41 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:06:41.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:41 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-12T09:06:41.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:41 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:06:42.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:42 smithi203 ceph-mon[36428]: Deploying daemon osd.5 on smithi203 2024-04-12T09:06:42.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:42 smithi203 ceph-mon[36428]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:42.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:42 smithi117 ceph-mon[29277]: Deploying daemon osd.5 on smithi203 2024-04-12T09:06:42.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:42 smithi117 ceph-mon[29277]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:44.805 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:44 smithi203 ceph-mon[36428]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:44.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:44 smithi117 ceph-mon[29277]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:46.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:46 smithi203 ceph-mon[36428]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:46.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:46 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:46.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:46 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:46.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:46 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:06:46.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:46 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:06:46.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:46 smithi117 ceph-mon[29277]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:46.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:46 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:46.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:46 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:46.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:46 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:06:46.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:46 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:06:48.685 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 5 on host 'smithi203' 2024-04-12T09:06:48.686 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:48.683+0000 7f26177fe700 1 -- 172.21.15.203:0/504571086 <== mgr.14214 v2:172.21.15.117:6800/3945342300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f26301023a0 con 0x7f26180692a0 2024-04-12T09:06:48.687 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:48.686+0000 7f263518d700 1 -- 172.21.15.203:0/504571086 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f26180692a0 msgr2=0x7f261806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:06:48.687 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:48.686+0000 7f263518d700 1 --2- 172.21.15.203:0/504571086 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f26180692a0 0x7f261806b750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f262400b3b0 tx=0x7f2624009e30 comp rx=0 tx=0).stop 2024-04-12T09:06:48.687 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:48.686+0000 7f263518d700 1 -- 172.21.15.203:0/504571086 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26300fce70 msgr2=0x7f2630071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:06:48.687 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:48.686+0000 7f263518d700 1 --2- 172.21.15.203:0/504571086 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26300fce70 0x7f2630071c60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f262000c8c0 tx=0x7f26200044c0 comp rx=0 tx=0).stop 2024-04-12T09:06:48.687 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:48.686+0000 7f263518d700 1 -- 172.21.15.203:0/504571086 shutdown_connections 2024-04-12T09:06:48.687 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:48.686+0000 7f263518d700 1 --2- 172.21.15.203:0/504571086 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f26180692a0 0x7f261806b750 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:48.687 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:48.686+0000 7f263518d700 1 --2- 172.21.15.203:0/504571086 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26300fce70 0x7f2630071c60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:48.687 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:48.686+0000 7f263518d700 1 --2- 172.21.15.203:0/504571086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26300fdfe0 0x7f2630070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:48.687 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:48.686+0000 7f263518d700 1 -- 172.21.15.203:0/504571086 >> 172.21.15.203:0/504571086 conn(0x7f26300f8550 msgr2=0x7f26300f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:06:48.688 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:48.686+0000 7f263518d700 1 -- 172.21.15.203:0/504571086 shutdown_connections 2024-04-12T09:06:48.688 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:06:48.686+0000 7f263518d700 1 -- 172.21.15.203:0/504571086 wait complete. 2024-04-12T09:06:48.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:48 smithi203 ceph-mon[36428]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:48.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:48 smithi117 ceph-mon[29277]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:49.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:49 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:49.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:49 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:49.951 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:49 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:49.951 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:49 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:49.974 DEBUG:teuthology.orchestra.run.smithi203:osd.5> sudo journalctl -f -n 0 -u ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.5.service 2024-04-12T09:06:49.977 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-04-12T09:06:49.977 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph osd stat -f json 2024-04-12T09:06:50.250 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:06:50.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:50 smithi117 ceph-mon[29277]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:50.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:50 smithi117 ceph-mon[29277]: from='osd.5 [v2:172.21.15.203:6816/2594776016,v1:172.21.15.203:6817/2594776016]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-12T09:06:50.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:50 smithi117 ceph-mon[29277]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-12T09:06:50.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:50 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:50.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:50 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:50.994 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:50 smithi203 ceph-mon[36428]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:50.994 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:50 smithi203 ceph-mon[36428]: from='osd.5 [v2:172.21.15.203:6816/2594776016,v1:172.21.15.203:6817/2594776016]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-12T09:06:50.995 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:50 smithi203 ceph-mon[36428]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-12T09:06:50.995 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:50 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:50.995 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:50 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:51.843 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:51 smithi117 ceph-mon[29277]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-12T09:06:51.843 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:51 smithi117 ceph-mon[29277]: osdmap e37: 6 total, 5 up, 6 in 2024-04-12T09:06:51.843 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:51 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T09:06:51.843 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:51 smithi117 ceph-mon[29277]: from='osd.5 [v2:172.21.15.203:6816/2594776016,v1:172.21.15.203:6817/2594776016]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-04-12T09:06:51.843 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:51 smithi117 ceph-mon[29277]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-04-12T09:06:51.950 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:51 smithi203 ceph-mon[36428]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-12T09:06:51.950 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:51 smithi203 ceph-mon[36428]: osdmap e37: 6 total, 5 up, 6 in 2024-04-12T09:06:51.950 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:51 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T09:06:51.950 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:51 smithi203 ceph-mon[36428]: from='osd.5 [v2:172.21.15.203:6816/2594776016,v1:172.21.15.203:6817/2594776016]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-04-12T09:06:51.950 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:51 smithi203 ceph-mon[36428]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-04-12T09:06:51.950 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:06:51 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[55368]: 2024-04-12T09:06:51.675+0000 7ff86097f700 -1 osd.5 0 waiting for initial osdmap 2024-04-12T09:06:51.950 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:06:51 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[55368]: 2024-04-12T09:06:51.686+0000 7ff85b77a700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T09:06:52.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.074+0000 7fe4ec755700 1 -- 172.21.15.117:0/3499651322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4e4066ef0 msgr2=0x7fe4e40ffa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:06:52.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.074+0000 7fe4ec755700 1 --2- 172.21.15.117:0/3499651322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4e4066ef0 0x7fe4e40ffa40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0004940 tx=0x7fe4e0009e30 comp rx=0 tx=0).stop 2024-04-12T09:06:52.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.074+0000 7fe4ec755700 1 -- 172.21.15.117:0/3499651322 shutdown_connections 2024-04-12T09:06:52.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.074+0000 7fe4ec755700 1 --2- 172.21.15.117:0/3499651322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4e40fff80 0x7fe4e4102360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:52.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.074+0000 7fe4ec755700 1 --2- 172.21.15.117:0/3499651322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4e4066ef0 0x7fe4e40ffa40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:52.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.074+0000 7fe4ec755700 1 -- 172.21.15.117:0/3499651322 >> 172.21.15.117:0/3499651322 conn(0x7fe4e40f7430 msgr2=0x7fe4e40f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:06:52.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.074+0000 7fe4ec755700 1 -- 172.21.15.117:0/3499651322 shutdown_connections 2024-04-12T09:06:52.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.074+0000 7fe4ec755700 1 -- 172.21.15.117:0/3499651322 wait complete. 2024-04-12T09:06:52.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.075+0000 7fe4ec755700 1 Processor -- start 2024-04-12T09:06:52.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.075+0000 7fe4ec755700 1 -- start start 2024-04-12T09:06:52.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.075+0000 7fe4ec755700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4e4066ef0 0x7fe4e410d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:06:52.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.075+0000 7fe4ec755700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4e40fff80 0x7fe4e410deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:06:52.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.075+0000 7fe4ec755700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e410e4b0 con 0x7fe4e4066ef0 2024-04-12T09:06:52.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.075+0000 7fe4ec755700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e410e620 con 0x7fe4e40fff80 2024-04-12T09:06:52.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.075+0000 7fe4ea4f1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4e4066ef0 0x7fe4e410d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:06:52.079 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.075+0000 7fe4ea4f1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4e4066ef0 0x7fe4e410d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42744/0 (socket says 172.21.15.117:42744) 2024-04-12T09:06:52.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.075+0000 7fe4ea4f1700 1 -- 172.21.15.117:0/2997896074 learned_addr learned my addr 172.21.15.117:0/2997896074 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:06:52.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.075+0000 7fe4e9cf0700 1 --2- 172.21.15.117:0/2997896074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4e40fff80 0x7fe4e410deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:06:52.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.075+0000 7fe4ea4f1700 1 -- 172.21.15.117:0/2997896074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4e40fff80 msgr2=0x7fe4e410deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:06:52.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.075+0000 7fe4ea4f1700 1 --2- 172.21.15.117:0/2997896074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4e40fff80 0x7fe4e410deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:52.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.075+0000 7fe4ea4f1700 1 -- 172.21.15.117:0/2997896074 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e0005040 con 0x7fe4e4066ef0 2024-04-12T09:06:52.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.075+0000 7fe4e9cf0700 1 --2- 172.21.15.117:0/2997896074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4e40fff80 0x7fe4e410deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T09:06:52.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.075+0000 7fe4ea4f1700 1 --2- 172.21.15.117:0/2997896074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4e4066ef0 0x7fe4e410d970 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000b3b0 tx=0x7fe4e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:06:52.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.075+0000 7fe4daffd700 1 -- 172.21.15.117:0/2997896074 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4e000e040 con 0x7fe4e4066ef0 2024-04-12T09:06:52.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.076+0000 7fe4daffd700 1 -- 172.21.15.117:0/2997896074 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe4e000bcc0 con 0x7fe4e4066ef0 2024-04-12T09:06:52.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.076+0000 7fe4ec755700 1 -- 172.21.15.117:0/2997896074 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e4113020 con 0x7fe4e4066ef0 2024-04-12T09:06:52.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.076+0000 7fe4daffd700 1 -- 172.21.15.117:0/2997896074 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4e001c630 con 0x7fe4e4066ef0 2024-04-12T09:06:52.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.076+0000 7fe4ec755700 1 -- 172.21.15.117:0/2997896074 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e41135e0 con 0x7fe4e4066ef0 2024-04-12T09:06:52.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.077+0000 7fe4ec755700 1 -- 172.21.15.117:0/2997896074 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e404c710 con 0x7fe4e4066ef0 2024-04-12T09:06:52.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.077+0000 7fe4daffd700 1 -- 172.21.15.117:0/2997896074 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fe4e00139f0 con 0x7fe4e4066ef0 2024-04-12T09:06:52.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.077+0000 7fe4daffd700 1 --2- 172.21.15.117:0/2997896074 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fe4d00692a0 0x7fe4d006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:06:52.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.078+0000 7fe4daffd700 1 -- 172.21.15.117:0/2997896074 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4354+0+0 (secure 0 0 0) 0x7fe4e0087b40 con 0x7fe4e4066ef0 2024-04-12T09:06:52.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.078+0000 7fe4e9cf0700 1 --2- 172.21.15.117:0/2997896074 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fe4d00692a0 0x7fe4d006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:06:52.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.078+0000 7fe4e9cf0700 1 --2- 172.21.15.117:0/2997896074 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fe4d00692a0 0x7fe4d006b750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009fd0 tx=0x7fe4d4009ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:06:52.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.082+0000 7fe4daffd700 1 -- 172.21.15.117:0/2997896074 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fe4e0057d50 con 0x7fe4e4066ef0 2024-04-12T09:06:52.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.275+0000 7fe4ec755700 1 -- 172.21.15.117:0/2997896074 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fe4e41058b0 con 0x7fe4e4066ef0 2024-04-12T09:06:52.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.276+0000 7fe4daffd700 1 -- 172.21.15.117:0/2997896074 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7fe4e00578e0 con 0x7fe4e4066ef0 2024-04-12T09:06:52.278 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:06:52.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.278+0000 7fe4ec755700 1 -- 172.21.15.117:0/2997896074 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fe4d00692a0 msgr2=0x7fe4d006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:06:52.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.278+0000 7fe4ec755700 1 --2- 172.21.15.117:0/2997896074 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fe4d00692a0 0x7fe4d006b750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009fd0 tx=0x7fe4d4009ee0 comp rx=0 tx=0).stop 2024-04-12T09:06:52.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.278+0000 7fe4ec755700 1 -- 172.21.15.117:0/2997896074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4e4066ef0 msgr2=0x7fe4e410d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:06:52.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.278+0000 7fe4ec755700 1 --2- 172.21.15.117:0/2997896074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4e4066ef0 0x7fe4e410d970 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000b3b0 tx=0x7fe4e0009e30 comp rx=0 tx=0).stop 2024-04-12T09:06:52.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.278+0000 7fe4ec755700 1 -- 172.21.15.117:0/2997896074 shutdown_connections 2024-04-12T09:06:52.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.278+0000 7fe4ec755700 1 --2- 172.21.15.117:0/2997896074 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fe4d00692a0 0x7fe4d006b750 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:52.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.278+0000 7fe4ec755700 1 --2- 172.21.15.117:0/2997896074 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4e4066ef0 0x7fe4e410d970 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:52.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.278+0000 7fe4ec755700 1 --2- 172.21.15.117:0/2997896074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4e40fff80 0x7fe4e410deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:52.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.278+0000 7fe4ec755700 1 -- 172.21.15.117:0/2997896074 >> 172.21.15.117:0/2997896074 conn(0x7fe4e40f7430 msgr2=0x7fe4e40f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:06:52.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.278+0000 7fe4ec755700 1 -- 172.21.15.117:0/2997896074 shutdown_connections 2024-04-12T09:06:52.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:52.278+0000 7fe4ec755700 1 -- 172.21.15.117:0/2997896074 wait complete. 2024-04-12T09:06:52.857 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:52 smithi117 ceph-mon[29277]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:52.857 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:52 smithi117 ceph-mon[29277]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-04-12T09:06:52.858 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:52 smithi117 ceph-mon[29277]: osdmap e38: 6 total, 5 up, 6 in 2024-04-12T09:06:52.858 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:52 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T09:06:52.858 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:52 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T09:06:52.858 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:52 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/2997896074' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-12T09:06:52.882 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":38,"num_osds":6,"num_up_osds":5,"osd_up_since":1712912786,"num_in_osds":6,"osd_in_since":1712912793,"num_remapped_pgs":0} 2024-04-12T09:06:53.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:52 smithi203 ceph-mon[36428]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:53.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:52 smithi203 ceph-mon[36428]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-04-12T09:06:53.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:52 smithi203 ceph-mon[36428]: osdmap e38: 6 total, 5 up, 6 in 2024-04-12T09:06:53.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:52 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T09:06:53.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:52 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T09:06:53.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:52 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/2997896074' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-12T09:06:53.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:53 smithi203 ceph-mon[36428]: purged_snaps scrub starts 2024-04-12T09:06:53.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:53 smithi203 ceph-mon[36428]: purged_snaps scrub ok 2024-04-12T09:06:53.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:53 smithi203 ceph-mon[36428]: osd.5 [v2:172.21.15.203:6816/2594776016,v1:172.21.15.203:6817/2594776016] boot 2024-04-12T09:06:53.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:53 smithi203 ceph-mon[36428]: osdmap e39: 6 total, 6 up, 6 in 2024-04-12T09:06:53.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:53 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T09:06:53.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:53 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:53.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:53 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:53.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:53 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:06:53.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:53 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:06:53.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:53 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:06:53.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:53 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:53.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:53 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:06:53.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:53 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:06:53.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:53 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:53.883 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph osd stat -f json 2024-04-12T09:06:54.149 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:06:54.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:53 smithi117 ceph-mon[29277]: purged_snaps scrub starts 2024-04-12T09:06:54.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:53 smithi117 ceph-mon[29277]: purged_snaps scrub ok 2024-04-12T09:06:54.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:53 smithi117 ceph-mon[29277]: osd.5 [v2:172.21.15.203:6816/2594776016,v1:172.21.15.203:6817/2594776016] boot 2024-04-12T09:06:54.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:53 smithi117 ceph-mon[29277]: osdmap e39: 6 total, 6 up, 6 in 2024-04-12T09:06:54.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:53 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T09:06:54.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:53 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:54.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:53 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:54.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:53 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:06:54.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:53 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:06:54.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:53 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:06:54.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:53 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:54.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:53 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:06:54.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:53 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:06:54.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:53 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:54.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:54 smithi117 ceph-mon[29277]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:54.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:54 smithi117 ceph-mon[29277]: Detected new or changed devices on smithi203 2024-04-12T09:06:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:54 smithi117 ceph-mon[29277]: Adjusting osd_memory_target on smithi203 to 5312M 2024-04-12T09:06:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:54 smithi117 ceph-mon[29277]: osdmap e40: 6 total, 6 up, 6 in 2024-04-12T09:06:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:54 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:06:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:54 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:06:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:54 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:06:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:54 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:55.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:54 smithi203 ceph-mon[36428]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-12T09:06:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:54 smithi203 ceph-mon[36428]: Detected new or changed devices on smithi203 2024-04-12T09:06:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:54 smithi203 ceph-mon[36428]: Adjusting osd_memory_target on smithi203 to 5312M 2024-04-12T09:06:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:54 smithi203 ceph-mon[36428]: osdmap e40: 6 total, 6 up, 6 in 2024-04-12T09:06:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:06:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:06:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:06:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:06:55.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.750+0000 7fb8cc5cd700 1 -- 172.21.15.117:0/1782787316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8c40fcf80 msgr2=0x7fb8c40fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:06:55.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.750+0000 7fb8cc5cd700 1 --2- 172.21.15.117:0/1782787316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8c40fcf80 0x7fb8c40fd3f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4004940 tx=0x7fb8b4009e30 comp rx=0 tx=0).stop 2024-04-12T09:06:55.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.751+0000 7fb8cc5cd700 1 -- 172.21.15.117:0/1782787316 shutdown_connections 2024-04-12T09:06:55.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.751+0000 7fb8cc5cd700 1 --2- 172.21.15.117:0/1782787316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8c40fcf80 0x7fb8c40fd3f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:55.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.751+0000 7fb8cc5cd700 1 --2- 172.21.15.117:0/1782787316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8c40fbcd0 0x7fb8c40fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:55.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.751+0000 7fb8cc5cd700 1 -- 172.21.15.117:0/1782787316 >> 172.21.15.117:0/1782787316 conn(0x7fb8c40f7430 msgr2=0x7fb8c40f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:06:55.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.751+0000 7fb8cc5cd700 1 -- 172.21.15.117:0/1782787316 shutdown_connections 2024-04-12T09:06:55.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.751+0000 7fb8cc5cd700 1 -- 172.21.15.117:0/1782787316 wait complete. 2024-04-12T09:06:55.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.751+0000 7fb8cc5cd700 1 Processor -- start 2024-04-12T09:06:55.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.751+0000 7fb8cc5cd700 1 -- start start 2024-04-12T09:06:55.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.751+0000 7fb8cc5cd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8c40fbcd0 0x7fb8c4066d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:06:55.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.751+0000 7fb8cc5cd700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8c40fcf80 0x7fb8c41126d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:06:55.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.751+0000 7fb8cc5cd700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c4112c10 con 0x7fb8c40fbcd0 2024-04-12T09:06:55.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.751+0000 7fb8cc5cd700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c4112d50 con 0x7fb8c40fcf80 2024-04-12T09:06:55.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.751+0000 7fb8ca369700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8c40fbcd0 0x7fb8c4066d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:06:55.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.751+0000 7fb8ca369700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8c40fbcd0 0x7fb8c4066d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42758/0 (socket says 172.21.15.117:42758) 2024-04-12T09:06:55.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.751+0000 7fb8ca369700 1 -- 172.21.15.117:0/3292891101 learned_addr learned my addr 172.21.15.117:0/3292891101 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:06:55.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.752+0000 7fb8c9b68700 1 --2- 172.21.15.117:0/3292891101 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8c40fcf80 0x7fb8c41126d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:06:55.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.752+0000 7fb8ca369700 1 -- 172.21.15.117:0/3292891101 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8c40fcf80 msgr2=0x7fb8c41126d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:06:55.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.752+0000 7fb8ca369700 1 --2- 172.21.15.117:0/3292891101 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8c40fcf80 0x7fb8c41126d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:55.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.752+0000 7fb8ca369700 1 -- 172.21.15.117:0/3292891101 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b4005040 con 0x7fb8c40fbcd0 2024-04-12T09:06:55.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.752+0000 7fb8ca369700 1 --2- 172.21.15.117:0/3292891101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8c40fbcd0 0x7fb8c4066d50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000c8c0 tx=0x7fb8c00044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:06:55.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.752+0000 7fb8baffd700 1 -- 172.21.15.117:0/3292891101 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8c000a980 con 0x7fb8c40fbcd0 2024-04-12T09:06:55.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.752+0000 7fb8baffd700 1 -- 172.21.15.117:0/3292891101 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb8c000ce60 con 0x7fb8c40fbcd0 2024-04-12T09:06:55.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.752+0000 7fb8cc5cd700 1 -- 172.21.15.117:0/3292891101 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c4112fd0 con 0x7fb8c40fbcd0 2024-04-12T09:06:55.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.752+0000 7fb8baffd700 1 -- 172.21.15.117:0/3292891101 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8c00115e0 con 0x7fb8c40fbcd0 2024-04-12T09:06:55.756 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.752+0000 7fb8cc5cd700 1 -- 172.21.15.117:0/3292891101 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c4113560 con 0x7fb8c40fbcd0 2024-04-12T09:06:55.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.753+0000 7fb8cc5cd700 1 -- 172.21.15.117:0/3292891101 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c404c710 con 0x7fb8c40fbcd0 2024-04-12T09:06:55.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.753+0000 7fb8baffd700 1 -- 172.21.15.117:0/3292891101 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fb8c0012400 con 0x7fb8c40fbcd0 2024-04-12T09:06:55.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.754+0000 7fb8baffd700 1 --2- 172.21.15.117:0/3292891101 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fb8b00692a0 0x7fb8b006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:06:55.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.754+0000 7fb8baffd700 1 -- 172.21.15.117:0/3292891101 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb8c0086f30 con 0x7fb8c40fbcd0 2024-04-12T09:06:55.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.754+0000 7fb8c9b68700 1 --2- 172.21.15.117:0/3292891101 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fb8b00692a0 0x7fb8b006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:06:55.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.754+0000 7fb8c9b68700 1 --2- 172.21.15.117:0/3292891101 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fb8b00692a0 0x7fb8b006b750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb8b400b3b0 tx=0x7fb8b4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:06:55.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.758+0000 7fb8baffd700 1 -- 172.21.15.117:0/3292891101 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fb8c0057030 con 0x7fb8c40fbcd0 2024-04-12T09:06:55.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.943+0000 7fb8cc5cd700 1 -- 172.21.15.117:0/3292891101 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fb8c41047c0 con 0x7fb8c40fbcd0 2024-04-12T09:06:55.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.943+0000 7fb8baffd700 1 -- 172.21.15.117:0/3292891101 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7fb8c00126b0 con 0x7fb8c40fbcd0 2024-04-12T09:06:55.945 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:06:55.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.945+0000 7fb8cc5cd700 1 -- 172.21.15.117:0/3292891101 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fb8b00692a0 msgr2=0x7fb8b006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:06:55.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.945+0000 7fb8cc5cd700 1 --2- 172.21.15.117:0/3292891101 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fb8b00692a0 0x7fb8b006b750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb8b400b3b0 tx=0x7fb8b4009e30 comp rx=0 tx=0).stop 2024-04-12T09:06:55.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.945+0000 7fb8cc5cd700 1 -- 172.21.15.117:0/3292891101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8c40fbcd0 msgr2=0x7fb8c4066d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:06:55.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.945+0000 7fb8cc5cd700 1 --2- 172.21.15.117:0/3292891101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8c40fbcd0 0x7fb8c4066d50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000c8c0 tx=0x7fb8c00044c0 comp rx=0 tx=0).stop 2024-04-12T09:06:55.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.945+0000 7fb8cc5cd700 1 -- 172.21.15.117:0/3292891101 shutdown_connections 2024-04-12T09:06:55.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.945+0000 7fb8cc5cd700 1 --2- 172.21.15.117:0/3292891101 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fb8b00692a0 0x7fb8b006b750 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:55.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.945+0000 7fb8cc5cd700 1 --2- 172.21.15.117:0/3292891101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8c40fbcd0 0x7fb8c4066d50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:55.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.945+0000 7fb8cc5cd700 1 --2- 172.21.15.117:0/3292891101 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8c40fcf80 0x7fb8c41126d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:55.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.945+0000 7fb8cc5cd700 1 -- 172.21.15.117:0/3292891101 >> 172.21.15.117:0/3292891101 conn(0x7fb8c40f7430 msgr2=0x7fb8c40f8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:06:55.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.945+0000 7fb8cc5cd700 1 -- 172.21.15.117:0/3292891101 shutdown_connections 2024-04-12T09:06:55.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:55.945+0000 7fb8cc5cd700 1 -- 172.21.15.117:0/3292891101 wait complete. 2024-04-12T09:06:56.613 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1712912812,"num_in_osds":6,"osd_in_since":1712912793,"num_remapped_pgs":0} 2024-04-12T09:06:56.614 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph osd dump --format=json 2024-04-12T09:06:56.867 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:06:56.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:56 smithi117 ceph-mon[29277]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:06:56.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:56 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/3292891101' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-12T09:06:57.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:56 smithi203 ceph-mon[36428]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:06:57.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:56 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/3292891101' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-12T09:06:58.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.511+0000 7f1e44145700 1 -- 172.21.15.117:0/3236495913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c102710 msgr2=0x7f1e3c0fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:06:58.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.511+0000 7f1e44145700 1 --2- 172.21.15.117:0/3236495913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c102710 0x7f1e3c0fbd80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c004940 tx=0x7f1e2c009e30 comp rx=0 tx=0).stop 2024-04-12T09:06:58.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.512+0000 7f1e44145700 1 -- 172.21.15.117:0/3236495913 shutdown_connections 2024-04-12T09:06:58.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.512+0000 7f1e44145700 1 --2- 172.21.15.117:0/3236495913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c102710 0x7f1e3c0fbd80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:58.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.512+0000 7f1e44145700 1 --2- 172.21.15.117:0/3236495913 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e3c101d70 0x7f1e3c102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:58.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.512+0000 7f1e44145700 1 -- 172.21.15.117:0/3236495913 >> 172.21.15.117:0/3236495913 conn(0x7f1e3c072bc0 msgr2=0x7f1e3c072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:06:58.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.512+0000 7f1e44145700 1 -- 172.21.15.117:0/3236495913 shutdown_connections 2024-04-12T09:06:58.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.512+0000 7f1e44145700 1 -- 172.21.15.117:0/3236495913 wait complete. 2024-04-12T09:06:58.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.512+0000 7f1e44145700 1 Processor -- start 2024-04-12T09:06:58.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.512+0000 7f1e44145700 1 -- start start 2024-04-12T09:06:58.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.512+0000 7f1e44145700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e3c101d70 0x7f1e3c10ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:06:58.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.512+0000 7f1e44145700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c102710 0x7f1e3c10f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:06:58.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.512+0000 7f1e44145700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c10f760 con 0x7f1e3c102710 2024-04-12T09:06:58.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.512+0000 7f1e44145700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c10f8a0 con 0x7f1e3c101d70 2024-04-12T09:06:58.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.513+0000 7f1e416e0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c102710 0x7f1e3c10f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:06:58.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.513+0000 7f1e416e0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c102710 0x7f1e3c10f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42764/0 (socket says 172.21.15.117:42764) 2024-04-12T09:06:58.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.513+0000 7f1e416e0700 1 -- 172.21.15.117:0/3418023666 learned_addr learned my addr 172.21.15.117:0/3418023666 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:06:58.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.513+0000 7f1e41ee1700 1 --2- 172.21.15.117:0/3418023666 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e3c101d70 0x7f1e3c10ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:06:58.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.513+0000 7f1e416e0700 1 -- 172.21.15.117:0/3418023666 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e3c101d70 msgr2=0x7f1e3c10ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:06:58.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.513+0000 7f1e416e0700 1 --2- 172.21.15.117:0/3418023666 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e3c101d70 0x7f1e3c10ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:58.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.513+0000 7f1e416e0700 1 -- 172.21.15.117:0/3418023666 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2c005040 con 0x7f1e3c102710 2024-04-12T09:06:58.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.513+0000 7f1e416e0700 1 --2- 172.21.15.117:0/3418023666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c102710 0x7f1e3c10f220 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c009100 tx=0x7f1e2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:06:58.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.513+0000 7f1e327fc700 1 -- 172.21.15.117:0/3418023666 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e2c00e040 con 0x7f1e3c102710 2024-04-12T09:06:58.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.513+0000 7f1e44145700 1 -- 172.21.15.117:0/3418023666 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3c117b90 con 0x7f1e3c102710 2024-04-12T09:06:58.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.513+0000 7f1e327fc700 1 -- 172.21.15.117:0/3418023666 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1e2c004290 con 0x7f1e3c102710 2024-04-12T09:06:58.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.513+0000 7f1e327fc700 1 -- 172.21.15.117:0/3418023666 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e2c01c3f0 con 0x7f1e3c102710 2024-04-12T09:06:58.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.513+0000 7f1e44145700 1 -- 172.21.15.117:0/3418023666 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3c118120 con 0x7f1e3c102710 2024-04-12T09:06:58.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.514+0000 7f1e44145700 1 -- 172.21.15.117:0/3418023666 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e3c104240 con 0x7f1e3c102710 2024-04-12T09:06:58.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.514+0000 7f1e327fc700 1 -- 172.21.15.117:0/3418023666 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f1e2c013690 con 0x7f1e3c102710 2024-04-12T09:06:58.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.515+0000 7f1e327fc700 1 --2- 172.21.15.117:0/3418023666 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f1e280692b0 0x7f1e2806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:06:58.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.515+0000 7f1e327fc700 1 -- 172.21.15.117:0/3418023666 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1e2c087fc0 con 0x7f1e3c102710 2024-04-12T09:06:58.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.515+0000 7f1e41ee1700 1 --2- 172.21.15.117:0/3418023666 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f1e280692b0 0x7f1e2806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:06:58.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.515+0000 7f1e41ee1700 1 --2- 172.21.15.117:0/3418023666 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f1e280692b0 0x7f1e2806b760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1e38004f40 tx=0x7f1e3800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:06:58.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.519+0000 7f1e327fc700 1 -- 172.21.15.117:0/3418023666 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f1e2c054630 con 0x7f1e3c102710 2024-04-12T09:06:58.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.709+0000 7f1e44145700 1 -- 172.21.15.117:0/3418023666 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e3c0fd4c0 con 0x7f1e3c102710 2024-04-12T09:06:58.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.710+0000 7f1e327fc700 1 -- 172.21.15.117:0/3418023666 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11092 (secure 0 0 0) 0x7f1e2c057c50 con 0x7f1e3c102710 2024-04-12T09:06:58.711 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:06:58.711 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":40,"fsid":"12161984-f8ab-11ee-bc8c-c7b262605968","created":"2024-04-12T09:01:24.210047+0000","modified":"2024-04-12T09:06:53.674987+0000","last_up_change":"2024-04-12T09:06:52.669995+0000","last_in_change":"2024-04-12T09:06:33.833263+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T09:05:39.657213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"a8bdd258-6f40-440f-b279-038d9b35e791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":789453361},{"type":"v1","addr":"172.21.15.117:6803","nonce":789453361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":789453361},{"type":"v1","addr":"172.21.15.117:6805","nonce":789453361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":789453361},{"type":"v1","addr":"172.21.15.117:6809","nonce":789453361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":789453361},{"type":"v1","addr":"172.21.15.117:6807","nonce":789453361}]},"public_addr":"172.21.15.117:6803/789453361","cluster_addr":"172.21.15.117:6805/789453361","heartbeat_back_addr":"172.21.15.117:6809/789453361","heartbeat_front_addr":"172.21.15.117:6807/789453361","state":["exists","up"]},{"osd":1,"uuid":"ab723885-9e88-47ad-8e80-cb5871bf0d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3995491575},{"type":"v1","addr":"172.21.15.117:6811","nonce":3995491575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3995491575},{"type":"v1","addr":"172.21.15.117:6813","nonce":3995491575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3995491575},{"type":"v1","addr":"172.21.15.117:6817","nonce":3995491575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3995491575},{"type":"v1","addr":"172.21.15.117:6815","nonce":3995491575}]},"public_addr":"172.21.15.117:6811/3995491575","cluster_addr":"172.21.15.117:6813/3995491575","heartbeat_back_addr":"172.21.15.117:6817/3995491575","heartbeat_front_addr":"172.21.15.117:6815/3995491575","state":["exists","up"]},{"osd":2,"uuid":"14f76ed3-2938-45c1-9cc7-4c0486c602ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3707487846},{"type":"v1","addr":"172.21.15.117:6819","nonce":3707487846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3707487846},{"type":"v1","addr":"172.21.15.117:6821","nonce":3707487846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3707487846},{"type":"v1","addr":"172.21.15.117:6825","nonce":3707487846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3707487846},{"type":"v1","addr":"172.21.15.117:6823","nonce":3707487846}]},"public_addr":"172.21.15.117:6819/3707487846","cluster_addr":"172.21.15.117:6821/3707487846","heartbeat_back_addr":"172.21.15.117:6825/3707487846","heartbeat_front_addr":"172.21.15.117:6823/3707487846","state":["exists","up"]},{"osd":3,"uuid":"e2bd1672-4153-498a-a20b-838516b0876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":824187707},{"type":"v1","addr":"172.21.15.203:6801","nonce":824187707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":824187707},{"type":"v1","addr":"172.21.15.203:6803","nonce":824187707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":824187707},{"type":"v1","addr":"172.21.15.203:6807","nonce":824187707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":824187707},{"type":"v1","addr":"172.21.15.203:6805","nonce":824187707}]},"public_addr":"172.21.15.203:6801/824187707","cluster_addr":"172.21.15.203:6803/824187707","heartbeat_back_addr":"172.21.15.203:6807/824187707","heartbeat_front_addr":"172.21.15.203:6805/824187707","state":["exists","up"]},{"osd":4,"uuid":"e8e6b7b8-45c2-4186-aeef-9b2feccf9fe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":22684123},{"type":"v1","addr":"172.21.15.203:6809","nonce":22684123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":22684123},{"type":"v1","addr":"172.21.15.203:6811","nonce":22684123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":22684123},{"type":"v1","addr":"172.21.15.203:6815","nonce":22684123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":22684123},{"type":"v1","addr":"172.21.15.203:6813","nonce":22684123}]},"public_addr":"172.21.15.203:6809/22684123","cluster_addr":"172.21.15.203:6811/22684123","heartbeat_back_addr":"172.21.15.203:6815/22684123","heartbeat_front_addr":"172.21.15.203:6813/22684123","state":["exists","up"]},{"osd":5,"uuid":"abbad141-29e9-4028-9e29-293cc73169fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2594776016},{"type":"v1","addr":"172.21.15.203:6817","nonce":2594776016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2594776016},{"type":"v1","addr":"172.21.15.203:6819","nonce":2594776016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2594776016},{"type":"v1","addr":"172.21.15.203:6823","nonce":2594776016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2594776016},{"type":"v1","addr":"172.21.15.203:6821","nonce":2594776016}]},"public_addr":"172.21.15.203:6817/2594776016","cluster_addr":"172.21.15.203:6819/2594776016","heartbeat_back_addr":"172.21.15.203:6823/2594776016","heartbeat_front_addr":"172.21.15.203:6821/2594776016","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:04:41.240834+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:05:09.825336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:05:37.699545+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:06:01.471956+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:06:25.743473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:06:50.806872+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.117:6800/790148838":"2024-04-13T09:03:31.333423+0000","172.21.15.117:0/448067539":"2024-04-13T09:03:31.333423+0000","172.21.15.117:0/2635780056":"2024-04-13T09:02:21.422544+0000","172.21.15.117:6801/791370182":"2024-04-13T09:02:21.422544+0000","172.21.15.117:6800/791370182":"2024-04-13T09:02:21.422544+0000","172.21.15.117:0/4061615302":"2024-04-13T09:03:31.333423+0000","172.21.15.117:0/86407959":"2024-04-13T09:02:21.422544+0000","172.21.15.117:6801/2893585477":"2024-04-13T09:01:50.340337+0000","172.21.15.117:6800/2893585477":"2024-04-13T09:01:50.340337+0000","172.21.15.117:6801/790148838":"2024-04-13T09:03:31.333423+0000","172.21.15.117:0/2514545829":"2024-04-13T09:03:31.333423+0000","172.21.15.117:0/960981120":"2024-04-13T09:01:50.340337+0000","172.21.15.117:0/4018826114":"2024-04-13T09:01:50.340337+0000","172.21.15.117:0/2869338383":"2024-04-13T09:02:21.422544+0000","172.21.15.117:0/2305921992":"2024-04-13T09:01:50.340337+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T09:06:58.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.712+0000 7f1e44145700 1 -- 172.21.15.117:0/3418023666 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f1e280692b0 msgr2=0x7f1e2806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:06:58.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.712+0000 7f1e44145700 1 --2- 172.21.15.117:0/3418023666 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f1e280692b0 0x7f1e2806b760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1e38004f40 tx=0x7f1e3800b040 comp rx=0 tx=0).stop 2024-04-12T09:06:58.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.712+0000 7f1e44145700 1 -- 172.21.15.117:0/3418023666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c102710 msgr2=0x7f1e3c10f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:06:58.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.712+0000 7f1e44145700 1 --2- 172.21.15.117:0/3418023666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c102710 0x7f1e3c10f220 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c009100 tx=0x7f1e2c009e30 comp rx=0 tx=0).stop 2024-04-12T09:06:58.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.712+0000 7f1e44145700 1 -- 172.21.15.117:0/3418023666 shutdown_connections 2024-04-12T09:06:58.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.712+0000 7f1e44145700 1 --2- 172.21.15.117:0/3418023666 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f1e280692b0 0x7f1e2806b760 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:58.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.712+0000 7f1e44145700 1 --2- 172.21.15.117:0/3418023666 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e3c101d70 0x7f1e3c10ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:58.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.712+0000 7f1e44145700 1 --2- 172.21.15.117:0/3418023666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e3c102710 0x7f1e3c10f220 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:06:58.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.712+0000 7f1e44145700 1 -- 172.21.15.117:0/3418023666 >> 172.21.15.117:0/3418023666 conn(0x7f1e3c072bc0 msgr2=0x7f1e3c0fb080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:06:58.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.712+0000 7f1e44145700 1 -- 172.21.15.117:0/3418023666 shutdown_connections 2024-04-12T09:06:58.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:06:58.712+0000 7f1e44145700 1 -- 172.21.15.117:0/3418023666 wait complete. 2024-04-12T09:06:59.069 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:58 smithi117 ceph-mon[29277]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:06:59.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:58 smithi203 ceph-mon[36428]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:06:59.448 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-12T09:05:39.657213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-04-12T09:06:59.448 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-12T09:06:59.706 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:06:59.969 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:06:59 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/3418023666' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T09:07:00.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:06:59 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/3418023666' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T09:07:00.983 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:00 smithi117 ceph-mon[29277]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:01.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:00 smithi203 ceph-mon[36428]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:01.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.346+0000 7f84adf3c700 1 -- 172.21.15.117:0/1415457964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84a80fb0f0 msgr2=0x7f84a80fb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:01.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.346+0000 7f84adf3c700 1 --2- 172.21.15.117:0/1415457964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84a80fb0f0 0x7f84a80fb4c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8498004940 tx=0x7f8498009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:01.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.346+0000 7f84adf3c700 1 -- 172.21.15.117:0/1415457964 shutdown_connections 2024-04-12T09:07:01.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.346+0000 7f84adf3c700 1 --2- 172.21.15.117:0/1415457964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84a80fba90 0x7f84a8101a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:01.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.346+0000 7f84adf3c700 1 --2- 172.21.15.117:0/1415457964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84a80fb0f0 0x7f84a80fb4c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:01.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.346+0000 7f84adf3c700 1 -- 172.21.15.117:0/1415457964 >> 172.21.15.117:0/1415457964 conn(0x7f84a80f6bd0 msgr2=0x7f84a80f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:01.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.346+0000 7f84adf3c700 1 -- 172.21.15.117:0/1415457964 shutdown_connections 2024-04-12T09:07:01.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.346+0000 7f84adf3c700 1 -- 172.21.15.117:0/1415457964 wait complete. 2024-04-12T09:07:01.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.346+0000 7f84adf3c700 1 Processor -- start 2024-04-12T09:07:01.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.347+0000 7f84adf3c700 1 -- start start 2024-04-12T09:07:01.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.347+0000 7f84adf3c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84a80fb0f0 0x7f84a81139a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:01.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.347+0000 7f84adf3c700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84a80fba90 0x7f84a8113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:01.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.347+0000 7f84adf3c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a81145c0 con 0x7f84a80fb0f0 2024-04-12T09:07:01.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.347+0000 7f84adf3c700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a810db50 con 0x7f84a80fba90 2024-04-12T09:07:01.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.347+0000 7f84a77fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84a80fb0f0 0x7f84a81139a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:01.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.347+0000 7f84a77fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84a80fb0f0 0x7f84a81139a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55816/0 (socket says 172.21.15.117:55816) 2024-04-12T09:07:01.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.347+0000 7f84a77fe700 1 -- 172.21.15.117:0/1449400659 learned_addr learned my addr 172.21.15.117:0/1449400659 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:07:01.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.347+0000 7f849effd700 1 --2- 172.21.15.117:0/1449400659 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84a80fba90 0x7f84a8113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:01.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.347+0000 7f84a77fe700 1 -- 172.21.15.117:0/1449400659 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84a80fba90 msgr2=0x7f84a8113ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:01.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.347+0000 7f84a77fe700 1 --2- 172.21.15.117:0/1449400659 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84a80fba90 0x7f84a8113ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:01.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.347+0000 7f84a77fe700 1 -- 172.21.15.117:0/1449400659 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8498005040 con 0x7f84a80fb0f0 2024-04-12T09:07:01.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.347+0000 7f84a77fe700 1 --2- 172.21.15.117:0/1449400659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84a80fb0f0 0x7f84a81139a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f849800b3b0 tx=0x7f8498009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:01.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.348+0000 7f84a4ff9700 1 -- 172.21.15.117:0/1449400659 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f849800e030 con 0x7f84a80fb0f0 2024-04-12T09:07:01.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.348+0000 7f84a4ff9700 1 -- 172.21.15.117:0/1449400659 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f849800bde0 con 0x7f84a80fb0f0 2024-04-12T09:07:01.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.348+0000 7f84adf3c700 1 -- 172.21.15.117:0/1449400659 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a810ddd0 con 0x7f84a80fb0f0 2024-04-12T09:07:01.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.348+0000 7f84a4ff9700 1 -- 172.21.15.117:0/1449400659 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8498013e50 con 0x7f84a80fb0f0 2024-04-12T09:07:01.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.348+0000 7f84adf3c700 1 -- 172.21.15.117:0/1449400659 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a810e310 con 0x7f84a80fb0f0 2024-04-12T09:07:01.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.349+0000 7f84adf3c700 1 -- 172.21.15.117:0/1449400659 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a80fc320 con 0x7f84a80fb0f0 2024-04-12T09:07:01.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.349+0000 7f84a4ff9700 1 -- 172.21.15.117:0/1449400659 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f84980136b0 con 0x7f84a80fb0f0 2024-04-12T09:07:01.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.349+0000 7f84a4ff9700 1 --2- 172.21.15.117:0/1449400659 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f8494069240 0x7f849406b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:01.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.350+0000 7f84a4ff9700 1 -- 172.21.15.117:0/1449400659 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8498088640 con 0x7f84a80fb0f0 2024-04-12T09:07:01.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.350+0000 7f849effd700 1 --2- 172.21.15.117:0/1449400659 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f8494069240 0x7f849406b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:01.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.350+0000 7f849effd700 1 --2- 172.21.15.117:0/1449400659 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f8494069240 0x7f849406b6f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8490006fd0 tx=0x7f8490008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:01.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.354+0000 7f84a4ff9700 1 -- 172.21.15.117:0/1449400659 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f8498054cb0 con 0x7f84a80fb0f0 2024-04-12T09:07:01.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.541+0000 7f84adf3c700 1 -- 172.21.15.117:0/1449400659 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f84a810f020 con 0x7f84a80fb0f0 2024-04-12T09:07:01.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.542+0000 7f84a4ff9700 1 -- 172.21.15.117:0/1449400659 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f84980582d0 con 0x7f84a80fb0f0 2024-04-12T09:07:01.543 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 1 2024-04-12T09:07:01.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.543+0000 7f84adf3c700 1 -- 172.21.15.117:0/1449400659 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f8494069240 msgr2=0x7f849406b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:01.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.543+0000 7f84adf3c700 1 --2- 172.21.15.117:0/1449400659 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f8494069240 0x7f849406b6f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8490006fd0 tx=0x7f8490008040 comp rx=0 tx=0).stop 2024-04-12T09:07:01.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.543+0000 7f84adf3c700 1 -- 172.21.15.117:0/1449400659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84a80fb0f0 msgr2=0x7f84a81139a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:01.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.543+0000 7f84adf3c700 1 --2- 172.21.15.117:0/1449400659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84a80fb0f0 0x7f84a81139a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f849800b3b0 tx=0x7f8498009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:01.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.544+0000 7f84adf3c700 1 -- 172.21.15.117:0/1449400659 shutdown_connections 2024-04-12T09:07:01.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.544+0000 7f84adf3c700 1 --2- 172.21.15.117:0/1449400659 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f8494069240 0x7f849406b6f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:01.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.544+0000 7f84adf3c700 1 --2- 172.21.15.117:0/1449400659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84a80fb0f0 0x7f84a81139a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:01.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.544+0000 7f84adf3c700 1 --2- 172.21.15.117:0/1449400659 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84a80fba90 0x7f84a8113ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:01.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.544+0000 7f84adf3c700 1 -- 172.21.15.117:0/1449400659 >> 172.21.15.117:0/1449400659 conn(0x7f84a80f6bd0 msgr2=0x7f84a80f8040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:01.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.544+0000 7f84adf3c700 1 -- 172.21.15.117:0/1449400659 shutdown_connections 2024-04-12T09:07:01.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:01.544+0000 7f84adf3c700 1 -- 172.21.15.117:0/1449400659 wait complete. 2024-04-12T09:07:01.874 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:01 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:07:01.875 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:01 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/1449400659' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-12T09:07:01.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:01 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:07:01.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:01 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/1449400659' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-12T09:07:02.202 INFO:tasks.cephadm:Setting up client nodes... 2024-04-12T09:07:02.202 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-12T09:07:02.457 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:07:02.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:02 smithi117 ceph-mon[29277]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:03.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:02 smithi203 ceph-mon[36428]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:04.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.177+0000 7f6d695c6700 1 -- 172.21.15.117:0/1247613977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d640fbcd0 msgr2=0x7f6d640fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:04.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.177+0000 7f6d695c6700 1 --2- 172.21.15.117:0/1247613977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d640fbcd0 0x7f6d640fc0e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009ce0 tx=0x7f6d54004d10 comp rx=0 tx=0).stop 2024-04-12T09:07:04.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.177+0000 7f6d695c6700 1 -- 172.21.15.117:0/1247613977 shutdown_connections 2024-04-12T09:07:04.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.177+0000 7f6d695c6700 1 --2- 172.21.15.117:0/1247613977 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d640fcf80 0x7f6d640fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:04.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.177+0000 7f6d695c6700 1 --2- 172.21.15.117:0/1247613977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d640fbcd0 0x7f6d640fc0e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:04.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.177+0000 7f6d695c6700 1 -- 172.21.15.117:0/1247613977 >> 172.21.15.117:0/1247613977 conn(0x7f6d640f7430 msgr2=0x7f6d640f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:04.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.177+0000 7f6d695c6700 1 -- 172.21.15.117:0/1247613977 shutdown_connections 2024-04-12T09:07:04.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.177+0000 7f6d695c6700 1 -- 172.21.15.117:0/1247613977 wait complete. 2024-04-12T09:07:04.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.177+0000 7f6d695c6700 1 Processor -- start 2024-04-12T09:07:04.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.177+0000 7f6d695c6700 1 -- start start 2024-04-12T09:07:04.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.177+0000 7f6d695c6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d640fbcd0 0x7f6d64066d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:04.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.177+0000 7f6d695c6700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d640fcf80 0x7f6d641128c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:04.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.177+0000 7f6d695c6700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d64112e00 con 0x7f6d640fbcd0 2024-04-12T09:07:04.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.177+0000 7f6d695c6700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d64112f70 con 0x7f6d640fcf80 2024-04-12T09:07:04.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.178+0000 7f6d62ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d640fbcd0 0x7f6d64066d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:04.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.178+0000 7f6d62ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d640fbcd0 0x7f6d64066d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55830/0 (socket says 172.21.15.117:55830) 2024-04-12T09:07:04.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.178+0000 7f6d62ffd700 1 -- 172.21.15.117:0/1716474690 learned_addr learned my addr 172.21.15.117:0/1716474690 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:07:04.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.178+0000 7f6d627fc700 1 --2- 172.21.15.117:0/1716474690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d640fcf80 0x7f6d641128c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:04.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.178+0000 7f6d62ffd700 1 -- 172.21.15.117:0/1716474690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d640fcf80 msgr2=0x7f6d641128c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:04.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.178+0000 7f6d62ffd700 1 --2- 172.21.15.117:0/1716474690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d640fcf80 0x7f6d641128c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:04.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.178+0000 7f6d62ffd700 1 -- 172.21.15.117:0/1716474690 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d54009940 con 0x7f6d640fbcd0 2024-04-12T09:07:04.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.178+0000 7f6d627fc700 1 --2- 172.21.15.117:0/1716474690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d640fcf80 0x7f6d641128c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T09:07:04.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.178+0000 7f6d62ffd700 1 --2- 172.21.15.117:0/1716474690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d640fbcd0 0x7f6d64066d10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6d54004740 tx=0x7f6d54004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:04.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.178+0000 7f6d4b7fe700 1 -- 172.21.15.117:0/1716474690 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d5400e040 con 0x7f6d640fbcd0 2024-04-12T09:07:04.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.178+0000 7f6d4b7fe700 1 -- 172.21.15.117:0/1716474690 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d540128e0 con 0x7f6d640fbcd0 2024-04-12T09:07:04.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.178+0000 7f6d4b7fe700 1 -- 172.21.15.117:0/1716474690 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d5401ca80 con 0x7f6d640fbcd0 2024-04-12T09:07:04.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.178+0000 7f6d695c6700 1 -- 172.21.15.117:0/1716474690 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d641131f0 con 0x7f6d640fbcd0 2024-04-12T09:07:04.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.178+0000 7f6d695c6700 1 -- 172.21.15.117:0/1716474690 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d641137b0 con 0x7f6d640fbcd0 2024-04-12T09:07:04.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.179+0000 7f6d695c6700 1 -- 172.21.15.117:0/1716474690 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d6404c710 con 0x7f6d640fbcd0 2024-04-12T09:07:04.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.180+0000 7f6d4b7fe700 1 -- 172.21.15.117:0/1716474690 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f6d54012a50 con 0x7f6d640fbcd0 2024-04-12T09:07:04.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.180+0000 7f6d4b7fe700 1 --2- 172.21.15.117:0/1716474690 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f6d4c0692a0 0x7f6d4c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:04.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.180+0000 7f6d4b7fe700 1 -- 172.21.15.117:0/1716474690 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6d54088b50 con 0x7f6d640fbcd0 2024-04-12T09:07:04.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.180+0000 7f6d627fc700 1 --2- 172.21.15.117:0/1716474690 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f6d4c0692a0 0x7f6d4c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:04.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.180+0000 7f6d627fc700 1 --2- 172.21.15.117:0/1716474690 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f6d4c0692a0 0x7f6d4c06b750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6d58006fd0 tx=0x7f6d58008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:04.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.184+0000 7f6d4b7fe700 1 -- 172.21.15.117:0/1716474690 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f6d54058bd0 con 0x7f6d640fbcd0 2024-04-12T09:07:04.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.446+0000 7f6d695c6700 1 -- 172.21.15.117:0/1716474690 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f6d64104840 con 0x7f6d640fbcd0 2024-04-12T09:07:04.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.450+0000 7f6d4b7fe700 1 -- 172.21.15.117:0/1716474690 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f6d54058760 con 0x7f6d640fbcd0 2024-04-12T09:07:04.451 INFO:teuthology.orchestra.run.smithi117.stdout:[client.0] 2024-04-12T09:07:04.451 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQC4+Rhm3LawGhAA2IRxsjuldBGc6CIcUvDrBQ== 2024-04-12T09:07:04.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.452+0000 7f6d695c6700 1 -- 172.21.15.117:0/1716474690 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f6d4c0692a0 msgr2=0x7f6d4c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:04.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.452+0000 7f6d695c6700 1 --2- 172.21.15.117:0/1716474690 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f6d4c0692a0 0x7f6d4c06b750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6d58006fd0 tx=0x7f6d58008040 comp rx=0 tx=0).stop 2024-04-12T09:07:04.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.452+0000 7f6d695c6700 1 -- 172.21.15.117:0/1716474690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d640fbcd0 msgr2=0x7f6d64066d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:04.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.452+0000 7f6d695c6700 1 --2- 172.21.15.117:0/1716474690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d640fbcd0 0x7f6d64066d10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6d54004740 tx=0x7f6d54004d10 comp rx=0 tx=0).stop 2024-04-12T09:07:04.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.452+0000 7f6d695c6700 1 -- 172.21.15.117:0/1716474690 shutdown_connections 2024-04-12T09:07:04.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.452+0000 7f6d695c6700 1 --2- 172.21.15.117:0/1716474690 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f6d4c0692a0 0x7f6d4c06b750 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:04.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.452+0000 7f6d695c6700 1 --2- 172.21.15.117:0/1716474690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d640fbcd0 0x7f6d64066d10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:04.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.452+0000 7f6d695c6700 1 --2- 172.21.15.117:0/1716474690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d640fcf80 0x7f6d641128c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:04.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.452+0000 7f6d695c6700 1 -- 172.21.15.117:0/1716474690 >> 172.21.15.117:0/1716474690 conn(0x7f6d640f7430 msgr2=0x7f6d640f8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:04.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.452+0000 7f6d695c6700 1 -- 172.21.15.117:0/1716474690 shutdown_connections 2024-04-12T09:07:04.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:04.452+0000 7f6d695c6700 1 -- 172.21.15.117:0/1716474690 wait complete. 2024-04-12T09:07:05.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:04 smithi203 ceph-mon[36428]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:05.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:04 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/1716474690' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-12T09:07:05.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:04 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/1716474690' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-12T09:07:05.139 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:04 smithi117 ceph-mon[29277]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:05.139 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:04 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/1716474690' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-12T09:07:05.139 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:04 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/1716474690' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-12T09:07:05.166 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-12T09:07:05.166 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-12T09:07:05.166 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-12T09:07:05.210 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-12T09:07:05.476 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi203/config 2024-04-12T09:07:06.862 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.860+0000 7fb1b49f6700 1 -- 172.21.15.203:0/1939428353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1b00fbcd0 msgr2=0x7fb1b00fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:06.862 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.860+0000 7fb1b49f6700 1 --2- 172.21.15.203:0/1939428353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1b00fbcd0 0x7fb1b00fc0e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0004940 tx=0x7fb1a0009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:06.862 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.860+0000 7fb1b49f6700 1 -- 172.21.15.203:0/1939428353 shutdown_connections 2024-04-12T09:07:06.862 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.860+0000 7fb1b49f6700 1 --2- 172.21.15.203:0/1939428353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1b00fcf80 0x7fb1b00fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:06.862 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.860+0000 7fb1b49f6700 1 --2- 172.21.15.203:0/1939428353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1b00fbcd0 0x7fb1b00fc0e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:06.862 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.860+0000 7fb1b49f6700 1 -- 172.21.15.203:0/1939428353 >> 172.21.15.203:0/1939428353 conn(0x7fb1b00f7430 msgr2=0x7fb1b00f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:06.862 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.860+0000 7fb1b49f6700 1 -- 172.21.15.203:0/1939428353 shutdown_connections 2024-04-12T09:07:06.862 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.860+0000 7fb1b49f6700 1 -- 172.21.15.203:0/1939428353 wait complete. 2024-04-12T09:07:06.862 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.860+0000 7fb1b49f6700 1 Processor -- start 2024-04-12T09:07:06.862 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.860+0000 7fb1b49f6700 1 -- start start 2024-04-12T09:07:06.862 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.861+0000 7fb1b49f6700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1b00fbcd0 0x7fb1b00ffc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:06.863 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.861+0000 7fb1b49f6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1b00fcf80 0x7fb1b00fe2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:06.863 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.861+0000 7fb1b49f6700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b0100210 con 0x7fb1b00fcf80 2024-04-12T09:07:06.863 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.861+0000 7fb1b49f6700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b00fe800 con 0x7fb1b00fbcd0 2024-04-12T09:07:06.863 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.861+0000 7fb1ae59c700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1b00fbcd0 0x7fb1b00ffc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:06.863 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.861+0000 7fb1ae59c700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1b00fbcd0 0x7fb1b00ffc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:44746/0 (socket says 172.21.15.203:44746) 2024-04-12T09:07:06.863 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.861+0000 7fb1ae59c700 1 -- 172.21.15.203:0/448110699 learned_addr learned my addr 172.21.15.203:0/448110699 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-12T09:07:06.863 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.861+0000 7fb1a5d9b700 1 --2- 172.21.15.203:0/448110699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1b00fcf80 0x7fb1b00fe2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:06.863 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.861+0000 7fb1ae59c700 1 -- 172.21.15.203:0/448110699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1b00fcf80 msgr2=0x7fb1b00fe2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:06.863 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.861+0000 7fb1ae59c700 1 --2- 172.21.15.203:0/448110699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1b00fcf80 0x7fb1b00fe2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:06.863 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.861+0000 7fb1ae59c700 1 -- 172.21.15.203:0/448110699 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a0005040 con 0x7fb1b00fbcd0 2024-04-12T09:07:06.863 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.861+0000 7fb1a5d9b700 1 --2- 172.21.15.203:0/448110699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1b00fcf80 0x7fb1b00fe2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T09:07:06.863 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.861+0000 7fb1ae59c700 1 --2- 172.21.15.203:0/448110699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1b00fbcd0 0x7fb1b00ffc10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb1a000b3b0 tx=0x7fb1a0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:06.865 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.861+0000 7fb1a77fe700 1 -- 172.21.15.203:0/448110699 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1a000e040 con 0x7fb1b00fbcd0 2024-04-12T09:07:06.865 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.861+0000 7fb1a77fe700 1 -- 172.21.15.203:0/448110699 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb1a000bcc0 con 0x7fb1b00fbcd0 2024-04-12T09:07:06.865 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.861+0000 7fb1b49f6700 1 -- 172.21.15.203:0/448110699 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b00fea50 con 0x7fb1b00fbcd0 2024-04-12T09:07:06.865 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.861+0000 7fb1a77fe700 1 -- 172.21.15.203:0/448110699 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1a001c630 con 0x7fb1b00fbcd0 2024-04-12T09:07:06.866 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.861+0000 7fb1b49f6700 1 -- 172.21.15.203:0/448110699 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b00ff010 con 0x7fb1b00fbcd0 2024-04-12T09:07:06.867 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.862+0000 7fb1b49f6700 1 -- 172.21.15.203:0/448110699 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b0101b10 con 0x7fb1b00fbcd0 2024-04-12T09:07:06.867 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.863+0000 7fb1a77fe700 1 -- 172.21.15.203:0/448110699 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fb1a0013980 con 0x7fb1b00fbcd0 2024-04-12T09:07:06.867 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.863+0000 7fb1a77fe700 1 --2- 172.21.15.203:0/448110699 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fb19c0692a0 0x7fb19c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:06.867 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.863+0000 7fb1a77fe700 1 -- 172.21.15.203:0/448110699 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb1a0087c70 con 0x7fb1b00fbcd0 2024-04-12T09:07:06.867 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.863+0000 7fb1a5d9b700 1 --2- 172.21.15.203:0/448110699 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fb19c0692a0 0x7fb19c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:06.867 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.864+0000 7fb1a5d9b700 1 --2- 172.21.15.203:0/448110699 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fb19c0692a0 0x7fb19c06b750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb198009fd0 tx=0x7fb19800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:06.868 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:06.868+0000 7fb1a77fe700 1 -- 172.21.15.203:0/448110699 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fb1a0057cf0 con 0x7fb1b00fbcd0 2024-04-12T09:07:07.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:06 smithi203 ceph-mon[36428]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:07.127 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:07.127+0000 7fb1b49f6700 1 -- 172.21.15.203:0/448110699 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fb1b004c710 con 0x7fb1b00fbcd0 2024-04-12T09:07:07.132 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:07.132+0000 7fb1a77fe700 1 -- 172.21.15.203:0/448110699 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7fb1a0057880 con 0x7fb1b00fbcd0 2024-04-12T09:07:07.132 INFO:teuthology.orchestra.run.smithi203.stdout:[client.1] 2024-04-12T09:07:07.132 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQC7+RhmeqCvBxAAugAW2kKUR3t1OKeNhN0QKQ== 2024-04-12T09:07:07.134 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:07.134+0000 7fb1b49f6700 1 -- 172.21.15.203:0/448110699 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fb19c0692a0 msgr2=0x7fb19c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:07.135 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:07.134+0000 7fb1b49f6700 1 --2- 172.21.15.203:0/448110699 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fb19c0692a0 0x7fb19c06b750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb198009fd0 tx=0x7fb19800b040 comp rx=0 tx=0).stop 2024-04-12T09:07:07.135 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:07.134+0000 7fb1b49f6700 1 -- 172.21.15.203:0/448110699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1b00fbcd0 msgr2=0x7fb1b00ffc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:07.135 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:07.134+0000 7fb1b49f6700 1 --2- 172.21.15.203:0/448110699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1b00fbcd0 0x7fb1b00ffc10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb1a000b3b0 tx=0x7fb1a0009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:07.135 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:07.134+0000 7fb1b49f6700 1 -- 172.21.15.203:0/448110699 shutdown_connections 2024-04-12T09:07:07.135 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:07.134+0000 7fb1b49f6700 1 --2- 172.21.15.203:0/448110699 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fb19c0692a0 0x7fb19c06b750 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:07.135 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:07.134+0000 7fb1b49f6700 1 --2- 172.21.15.203:0/448110699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1b00fbcd0 0x7fb1b00ffc10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:07.135 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:07.134+0000 7fb1b49f6700 1 --2- 172.21.15.203:0/448110699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1b00fcf80 0x7fb1b00fe2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:07.135 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:07.134+0000 7fb1b49f6700 1 -- 172.21.15.203:0/448110699 >> 172.21.15.203:0/448110699 conn(0x7fb1b00f7430 msgr2=0x7fb1b0066860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:07.135 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:07.134+0000 7fb1b49f6700 1 -- 172.21.15.203:0/448110699 shutdown_connections 2024-04-12T09:07:07.135 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:07:07.134+0000 7fb1b49f6700 1 -- 172.21.15.203:0/448110699 wait complete. 2024-04-12T09:07:07.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:06 smithi117 ceph-mon[29277]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:07.697 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-12T09:07:07.697 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-04-12T09:07:07.697 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-12T09:07:07.741 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-12T09:07:07.741 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-12T09:07:07.741 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph mgr dump --format=json 2024-04-12T09:07:08.008 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:07:08.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:07 smithi203 ceph-mon[36428]: from='client.? 172.21.15.203:0/448110699' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-12T09:07:08.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:07 smithi203 ceph-mon[36428]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-12T09:07:08.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:07 smithi203 ceph-mon[36428]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-12T09:07:08.131 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:07 smithi117 ceph-mon[29277]: from='client.? 172.21.15.203:0/448110699' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-12T09:07:08.131 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:07 smithi117 ceph-mon[29277]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-12T09:07:08.131 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:07 smithi117 ceph-mon[29277]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-12T09:07:08.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:08 smithi117 ceph-mon[29277]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:09.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:08 smithi203 ceph-mon[36428]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:09.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.738+0000 7f72e9dd1700 1 -- 172.21.15.117:0/62170720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e40fe830 msgr2=0x7f72e4106f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:09.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.738+0000 7f72e9dd1700 1 --2- 172.21.15.117:0/62170720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e40fe830 0x7f72e4106f00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009ce0 tx=0x7f72d8004d10 comp rx=0 tx=0).stop 2024-04-12T09:07:09.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.738+0000 7f72e9dd1700 1 -- 172.21.15.117:0/62170720 shutdown_connections 2024-04-12T09:07:09.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.738+0000 7f72e9dd1700 1 --2- 172.21.15.117:0/62170720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e40fe830 0x7f72e4106f00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:09.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.738+0000 7f72e9dd1700 1 --2- 172.21.15.117:0/62170720 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72e40fde90 0x7f72e40fe260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:09.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.738+0000 7f72e9dd1700 1 -- 172.21.15.117:0/62170720 >> 172.21.15.117:0/62170720 conn(0x7f72e4072bc0 msgr2=0x7f72e4072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:09.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.738+0000 7f72e9dd1700 1 -- 172.21.15.117:0/62170720 shutdown_connections 2024-04-12T09:07:09.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.738+0000 7f72e9dd1700 1 -- 172.21.15.117:0/62170720 wait complete. 2024-04-12T09:07:09.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.738+0000 7f72e9dd1700 1 Processor -- start 2024-04-12T09:07:09.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.739+0000 7f72e9dd1700 1 -- start start 2024-04-12T09:07:09.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.739+0000 7f72e9dd1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e40fde90 0x7f72e4113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:09.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.739+0000 7f72e9dd1700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72e40fe830 0x7f72e41140d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:09.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.739+0000 7f72e9dd1700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e41147b0 con 0x7f72e40fde90 2024-04-12T09:07:09.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.739+0000 7f72e9dd1700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e410db10 con 0x7f72e40fe830 2024-04-12T09:07:09.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.739+0000 7f72e37fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e40fde90 0x7f72e4113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:09.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.739+0000 7f72e37fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e40fde90 0x7f72e4113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54754/0 (socket says 172.21.15.117:54754) 2024-04-12T09:07:09.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.739+0000 7f72e37fe700 1 -- 172.21.15.117:0/3600881315 learned_addr learned my addr 172.21.15.117:0/3600881315 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:07:09.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.739+0000 7f72e2ffd700 1 --2- 172.21.15.117:0/3600881315 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72e40fe830 0x7f72e41140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:09.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.739+0000 7f72e37fe700 1 -- 172.21.15.117:0/3600881315 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72e40fe830 msgr2=0x7f72e41140d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:09.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.739+0000 7f72e37fe700 1 --2- 172.21.15.117:0/3600881315 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72e40fe830 0x7f72e41140d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:09.750 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.739+0000 7f72e37fe700 1 -- 172.21.15.117:0/3600881315 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d8009940 con 0x7f72e40fde90 2024-04-12T09:07:09.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.739+0000 7f72e37fe700 1 --2- 172.21.15.117:0/3600881315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e40fde90 0x7f72e4113b90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f72dc00b790 tx=0x7f72dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:09.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.739+0000 7f72cbfff700 1 -- 172.21.15.117:0/3600881315 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72dc00f6f0 con 0x7f72e40fde90 2024-04-12T09:07:09.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.739+0000 7f72e9dd1700 1 -- 172.21.15.117:0/3600881315 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e410ddf0 con 0x7f72e40fde90 2024-04-12T09:07:09.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.739+0000 7f72cbfff700 1 -- 172.21.15.117:0/3600881315 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f72dc00fd20 con 0x7f72e40fde90 2024-04-12T09:07:09.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.739+0000 7f72cbfff700 1 -- 172.21.15.117:0/3600881315 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72dc0103a0 con 0x7f72e40fde90 2024-04-12T09:07:09.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.740+0000 7f72e9dd1700 1 -- 172.21.15.117:0/3600881315 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e410e300 con 0x7f72e40fde90 2024-04-12T09:07:09.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.740+0000 7f72e9dd1700 1 -- 172.21.15.117:0/3600881315 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e4065e30 con 0x7f72e40fde90 2024-04-12T09:07:09.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.741+0000 7f72cbfff700 1 -- 172.21.15.117:0/3600881315 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f72dc011400 con 0x7f72e40fde90 2024-04-12T09:07:09.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.741+0000 7f72cbfff700 1 --2- 172.21.15.117:0/3600881315 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f72cc0692a0 0x7f72cc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:09.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.741+0000 7f72cbfff700 1 -- 172.21.15.117:0/3600881315 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f72dc086c30 con 0x7f72e40fde90 2024-04-12T09:07:09.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.741+0000 7f72e2ffd700 1 --2- 172.21.15.117:0/3600881315 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f72cc0692a0 0x7f72cc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:09.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.742+0000 7f72e2ffd700 1 --2- 172.21.15.117:0/3600881315 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f72cc0692a0 0x7f72cc06b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f72e410edf0 tx=0x7f72d8004d10 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:09.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.746+0000 7f72cbfff700 1 -- 172.21.15.117:0/3600881315 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f72dc056d30 con 0x7f72e40fde90 2024-04-12T09:07:09.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.986+0000 7f72e9dd1700 1 -- 172.21.15.117:0/3600881315 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f72e404bed0 con 0x7f72e40fde90 2024-04-12T09:07:09.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.989+0000 7f72cbfff700 1 -- 172.21.15.117:0/3600881315 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+167177 (secure 0 0 0) 0x7f72dc0568c0 con 0x7f72e40fde90 2024-04-12T09:07:09.992 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:07:09.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.991+0000 7f72e9dd1700 1 -- 172.21.15.117:0/3600881315 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f72cc0692a0 msgr2=0x7f72cc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:09.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.991+0000 7f72e9dd1700 1 --2- 172.21.15.117:0/3600881315 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f72cc0692a0 0x7f72cc06b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f72e410edf0 tx=0x7f72d8004d10 comp rx=0 tx=0).stop 2024-04-12T09:07:09.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.991+0000 7f72e9dd1700 1 -- 172.21.15.117:0/3600881315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e40fde90 msgr2=0x7f72e4113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:09.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.991+0000 7f72e9dd1700 1 --2- 172.21.15.117:0/3600881315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e40fde90 0x7f72e4113b90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f72dc00b790 tx=0x7f72dc009250 comp rx=0 tx=0).stop 2024-04-12T09:07:09.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.991+0000 7f72e9dd1700 1 -- 172.21.15.117:0/3600881315 shutdown_connections 2024-04-12T09:07:09.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.991+0000 7f72e9dd1700 1 --2- 172.21.15.117:0/3600881315 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f72cc0692a0 0x7f72cc06b750 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:09.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.991+0000 7f72e9dd1700 1 --2- 172.21.15.117:0/3600881315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e40fde90 0x7f72e4113b90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:09.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.991+0000 7f72e9dd1700 1 --2- 172.21.15.117:0/3600881315 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72e40fe830 0x7f72e41140d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:09.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.991+0000 7f72e9dd1700 1 -- 172.21.15.117:0/3600881315 >> 172.21.15.117:0/3600881315 conn(0x7f72e4072bc0 msgr2=0x7f72e4103740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:09.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.991+0000 7f72e9dd1700 1 -- 172.21.15.117:0/3600881315 shutdown_connections 2024-04-12T09:07:09.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:09.991+0000 7f72e9dd1700 1 -- 172.21.15.117:0/3600881315 wait complete. 2024-04-12T09:07:10.738 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":19,"active_gid":14214,"active_name":"smithi117.oyaxql","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":3945342300},{"type":"v1","addr":"172.21.15.117:6801","nonce":3945342300}]},"active_addr":"172.21.15.117:6801/3945342300","active_change":"2024-04-12T09:03:31.333536+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14234,"name":"smithi203.apfqpo","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.117:8443/","prometheus":"http://172.21.15.117:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":3873562739}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":2084327023}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":3616310373}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":801788487}]}]} 2024-04-12T09:07:11.064 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-12T09:07:11.064 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-12T09:07:11.065 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph osd dump --format=json 2024-04-12T09:07:11.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:10 smithi203 ceph-mon[36428]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:11.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:10 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/3600881315' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-12T09:07:11.096 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:10 smithi117 ceph-mon[29277]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:11.096 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:10 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/3600881315' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-12T09:07:11.333 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:07:13.020 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:12 smithi117 ceph-mon[29277]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:13.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:12 smithi203 ceph-mon[36428]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:13.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.227+0000 7f38c6b4a700 1 -- 172.21.15.117:0/3877758441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c0101d70 msgr2=0x7f38c0102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:13.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.227+0000 7f38c6b4a700 1 --2- 172.21.15.117:0/3877758441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c0101d70 0x7f38c0102140 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f38b4004940 tx=0x7f38b4009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:13.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.227+0000 7f38c6b4a700 1 -- 172.21.15.117:0/3877758441 shutdown_connections 2024-04-12T09:07:13.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.227+0000 7f38c6b4a700 1 --2- 172.21.15.117:0/3877758441 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38c0102710 0x7f38c00fbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:13.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.227+0000 7f38c6b4a700 1 --2- 172.21.15.117:0/3877758441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c0101d70 0x7f38c0102140 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:13.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.227+0000 7f38c6b4a700 1 -- 172.21.15.117:0/3877758441 >> 172.21.15.117:0/3877758441 conn(0x7f38c0072bc0 msgr2=0x7f38c0072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:13.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.227+0000 7f38c6b4a700 1 -- 172.21.15.117:0/3877758441 shutdown_connections 2024-04-12T09:07:13.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.227+0000 7f38c6b4a700 1 -- 172.21.15.117:0/3877758441 wait complete. 2024-04-12T09:07:13.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.227+0000 7f38c6b4a700 1 Processor -- start 2024-04-12T09:07:13.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.227+0000 7f38c6b4a700 1 -- start start 2024-04-12T09:07:13.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.228+0000 7f38c6b4a700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38c0101d70 0x7f38c0112a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:13.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.228+0000 7f38c6b4a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c0102710 0x7f38c0112f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:13.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.228+0000 7f38c6b4a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c01135d0 con 0x7f38c0102710 2024-04-12T09:07:13.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.228+0000 7f38c6b4a700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c010c9c0 con 0x7f38c0101d70 2024-04-12T09:07:13.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.228+0000 7f38bffff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c0102710 0x7f38c0112f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:13.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.228+0000 7f38bffff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c0102710 0x7f38c0112f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54766/0 (socket says 172.21.15.117:54766) 2024-04-12T09:07:13.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.228+0000 7f38bffff700 1 -- 172.21.15.117:0/4116892575 learned_addr learned my addr 172.21.15.117:0/4116892575 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:07:13.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.228+0000 7f38c48e6700 1 --2- 172.21.15.117:0/4116892575 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38c0101d70 0x7f38c0112a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:13.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.228+0000 7f38bffff700 1 -- 172.21.15.117:0/4116892575 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38c0101d70 msgr2=0x7f38c0112a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:13.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.228+0000 7f38bffff700 1 --2- 172.21.15.117:0/4116892575 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38c0101d70 0x7f38c0112a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:13.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.228+0000 7f38bffff700 1 -- 172.21.15.117:0/4116892575 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b4005040 con 0x7f38c0102710 2024-04-12T09:07:13.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.228+0000 7f38bffff700 1 --2- 172.21.15.117:0/4116892575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c0102710 0x7f38c0112f80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f38ac002a50 tx=0x7f38ac004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:13.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.228+0000 7f38bd7fa700 1 -- 172.21.15.117:0/4116892575 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38ac007cc0 con 0x7f38c0102710 2024-04-12T09:07:13.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.228+0000 7f38bd7fa700 1 -- 172.21.15.117:0/4116892575 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f38ac00f040 con 0x7f38c0102710 2024-04-12T09:07:13.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.228+0000 7f38c6b4a700 1 -- 172.21.15.117:0/4116892575 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c010cca0 con 0x7f38c0102710 2024-04-12T09:07:13.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.229+0000 7f38bd7fa700 1 -- 172.21.15.117:0/4116892575 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38ac00d9c0 con 0x7f38c0102710 2024-04-12T09:07:13.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.229+0000 7f38c6b4a700 1 -- 172.21.15.117:0/4116892575 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c010d260 con 0x7f38c0102710 2024-04-12T09:07:13.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.229+0000 7f38c6b4a700 1 -- 172.21.15.117:0/4116892575 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c00ff080 con 0x7f38c0102710 2024-04-12T09:07:13.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.230+0000 7f38bd7fa700 1 -- 172.21.15.117:0/4116892575 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f38ac009730 con 0x7f38c0102710 2024-04-12T09:07:13.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.230+0000 7f38bd7fa700 1 --2- 172.21.15.117:0/4116892575 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f38b00692a0 0x7f38b006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:13.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.230+0000 7f38bd7fa700 1 -- 172.21.15.117:0/4116892575 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f38ac086bf0 con 0x7f38c0102710 2024-04-12T09:07:13.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.230+0000 7f38c48e6700 1 --2- 172.21.15.117:0/4116892575 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f38b00692a0 0x7f38b006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:13.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.231+0000 7f38c48e6700 1 --2- 172.21.15.117:0/4116892575 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f38b00692a0 0x7f38b006b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f38b4004f90 tx=0x7f38b4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:13.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.235+0000 7f38bd7fa700 1 -- 172.21.15.117:0/4116892575 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f38ac056c70 con 0x7f38c0102710 2024-04-12T09:07:13.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.421+0000 7f38c6b4a700 1 -- 172.21.15.117:0/4116892575 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38c010e090 con 0x7f38c0102710 2024-04-12T09:07:13.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.422+0000 7f38bd7fa700 1 -- 172.21.15.117:0/4116892575 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11092 (secure 0 0 0) 0x7f38ac056800 con 0x7f38c0102710 2024-04-12T09:07:13.423 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:07:13.423 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":40,"fsid":"12161984-f8ab-11ee-bc8c-c7b262605968","created":"2024-04-12T09:01:24.210047+0000","modified":"2024-04-12T09:06:53.674987+0000","last_up_change":"2024-04-12T09:06:52.669995+0000","last_in_change":"2024-04-12T09:06:33.833263+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T09:05:39.657213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"a8bdd258-6f40-440f-b279-038d9b35e791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":789453361},{"type":"v1","addr":"172.21.15.117:6803","nonce":789453361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":789453361},{"type":"v1","addr":"172.21.15.117:6805","nonce":789453361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":789453361},{"type":"v1","addr":"172.21.15.117:6809","nonce":789453361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":789453361},{"type":"v1","addr":"172.21.15.117:6807","nonce":789453361}]},"public_addr":"172.21.15.117:6803/789453361","cluster_addr":"172.21.15.117:6805/789453361","heartbeat_back_addr":"172.21.15.117:6809/789453361","heartbeat_front_addr":"172.21.15.117:6807/789453361","state":["exists","up"]},{"osd":1,"uuid":"ab723885-9e88-47ad-8e80-cb5871bf0d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3995491575},{"type":"v1","addr":"172.21.15.117:6811","nonce":3995491575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3995491575},{"type":"v1","addr":"172.21.15.117:6813","nonce":3995491575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3995491575},{"type":"v1","addr":"172.21.15.117:6817","nonce":3995491575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3995491575},{"type":"v1","addr":"172.21.15.117:6815","nonce":3995491575}]},"public_addr":"172.21.15.117:6811/3995491575","cluster_addr":"172.21.15.117:6813/3995491575","heartbeat_back_addr":"172.21.15.117:6817/3995491575","heartbeat_front_addr":"172.21.15.117:6815/3995491575","state":["exists","up"]},{"osd":2,"uuid":"14f76ed3-2938-45c1-9cc7-4c0486c602ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3707487846},{"type":"v1","addr":"172.21.15.117:6819","nonce":3707487846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3707487846},{"type":"v1","addr":"172.21.15.117:6821","nonce":3707487846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3707487846},{"type":"v1","addr":"172.21.15.117:6825","nonce":3707487846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3707487846},{"type":"v1","addr":"172.21.15.117:6823","nonce":3707487846}]},"public_addr":"172.21.15.117:6819/3707487846","cluster_addr":"172.21.15.117:6821/3707487846","heartbeat_back_addr":"172.21.15.117:6825/3707487846","heartbeat_front_addr":"172.21.15.117:6823/3707487846","state":["exists","up"]},{"osd":3,"uuid":"e2bd1672-4153-498a-a20b-838516b0876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":824187707},{"type":"v1","addr":"172.21.15.203:6801","nonce":824187707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":824187707},{"type":"v1","addr":"172.21.15.203:6803","nonce":824187707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":824187707},{"type":"v1","addr":"172.21.15.203:6807","nonce":824187707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":824187707},{"type":"v1","addr":"172.21.15.203:6805","nonce":824187707}]},"public_addr":"172.21.15.203:6801/824187707","cluster_addr":"172.21.15.203:6803/824187707","heartbeat_back_addr":"172.21.15.203:6807/824187707","heartbeat_front_addr":"172.21.15.203:6805/824187707","state":["exists","up"]},{"osd":4,"uuid":"e8e6b7b8-45c2-4186-aeef-9b2feccf9fe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":22684123},{"type":"v1","addr":"172.21.15.203:6809","nonce":22684123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":22684123},{"type":"v1","addr":"172.21.15.203:6811","nonce":22684123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":22684123},{"type":"v1","addr":"172.21.15.203:6815","nonce":22684123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":22684123},{"type":"v1","addr":"172.21.15.203:6813","nonce":22684123}]},"public_addr":"172.21.15.203:6809/22684123","cluster_addr":"172.21.15.203:6811/22684123","heartbeat_back_addr":"172.21.15.203:6815/22684123","heartbeat_front_addr":"172.21.15.203:6813/22684123","state":["exists","up"]},{"osd":5,"uuid":"abbad141-29e9-4028-9e29-293cc73169fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2594776016},{"type":"v1","addr":"172.21.15.203:6817","nonce":2594776016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2594776016},{"type":"v1","addr":"172.21.15.203:6819","nonce":2594776016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2594776016},{"type":"v1","addr":"172.21.15.203:6823","nonce":2594776016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2594776016},{"type":"v1","addr":"172.21.15.203:6821","nonce":2594776016}]},"public_addr":"172.21.15.203:6817/2594776016","cluster_addr":"172.21.15.203:6819/2594776016","heartbeat_back_addr":"172.21.15.203:6823/2594776016","heartbeat_front_addr":"172.21.15.203:6821/2594776016","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:04:41.240834+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:05:09.825336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:05:37.699545+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:06:01.471956+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:06:25.743473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:06:50.806872+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.117:6800/790148838":"2024-04-13T09:03:31.333423+0000","172.21.15.117:0/448067539":"2024-04-13T09:03:31.333423+0000","172.21.15.117:0/2635780056":"2024-04-13T09:02:21.422544+0000","172.21.15.117:6801/791370182":"2024-04-13T09:02:21.422544+0000","172.21.15.117:6800/791370182":"2024-04-13T09:02:21.422544+0000","172.21.15.117:0/4061615302":"2024-04-13T09:03:31.333423+0000","172.21.15.117:0/86407959":"2024-04-13T09:02:21.422544+0000","172.21.15.117:6801/2893585477":"2024-04-13T09:01:50.340337+0000","172.21.15.117:6800/2893585477":"2024-04-13T09:01:50.340337+0000","172.21.15.117:6801/790148838":"2024-04-13T09:03:31.333423+0000","172.21.15.117:0/2514545829":"2024-04-13T09:03:31.333423+0000","172.21.15.117:0/960981120":"2024-04-13T09:01:50.340337+0000","172.21.15.117:0/4018826114":"2024-04-13T09:01:50.340337+0000","172.21.15.117:0/2869338383":"2024-04-13T09:02:21.422544+0000","172.21.15.117:0/2305921992":"2024-04-13T09:01:50.340337+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T09:07:13.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.424+0000 7f38c6b4a700 1 -- 172.21.15.117:0/4116892575 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f38b00692a0 msgr2=0x7f38b006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:13.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.424+0000 7f38c6b4a700 1 --2- 172.21.15.117:0/4116892575 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f38b00692a0 0x7f38b006b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f38b4004f90 tx=0x7f38b4009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:13.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.424+0000 7f38c6b4a700 1 -- 172.21.15.117:0/4116892575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c0102710 msgr2=0x7f38c0112f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:13.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.424+0000 7f38c6b4a700 1 --2- 172.21.15.117:0/4116892575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c0102710 0x7f38c0112f80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f38ac002a50 tx=0x7f38ac004600 comp rx=0 tx=0).stop 2024-04-12T09:07:13.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.424+0000 7f38c6b4a700 1 -- 172.21.15.117:0/4116892575 shutdown_connections 2024-04-12T09:07:13.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.424+0000 7f38c6b4a700 1 --2- 172.21.15.117:0/4116892575 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f38b00692a0 0x7f38b006b750 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:13.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.424+0000 7f38c6b4a700 1 --2- 172.21.15.117:0/4116892575 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38c0101d70 0x7f38c0112a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:13.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.424+0000 7f38c6b4a700 1 --2- 172.21.15.117:0/4116892575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c0102710 0x7f38c0112f80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:13.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.424+0000 7f38c6b4a700 1 -- 172.21.15.117:0/4116892575 >> 172.21.15.117:0/4116892575 conn(0x7f38c0072bc0 msgr2=0x7f38c00fafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:13.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.424+0000 7f38c6b4a700 1 -- 172.21.15.117:0/4116892575 shutdown_connections 2024-04-12T09:07:13.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:13.424+0000 7f38c6b4a700 1 -- 172.21.15.117:0/4116892575 wait complete. 2024-04-12T09:07:14.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:13 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/4116892575' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T09:07:14.100 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:13 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/4116892575' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T09:07:14.126 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-12T09:07:14.126 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph osd dump --format=json 2024-04-12T09:07:14.421 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:07:14.845 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:14 smithi117 ceph-mon[29277]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:15.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:14 smithi203 ceph-mon[36428]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:16.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.108+0000 7fcb6306d700 1 -- 172.21.15.117:0/298205654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb5c101ca0 msgr2=0x7fcb5c102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:16.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.108+0000 7fcb6306d700 1 --2- 172.21.15.117:0/298205654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb5c101ca0 0x7fcb5c102070 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcb50004940 tx=0x7fcb50009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:16.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.108+0000 7fcb6306d700 1 -- 172.21.15.117:0/298205654 shutdown_connections 2024-04-12T09:07:16.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.108+0000 7fcb6306d700 1 --2- 172.21.15.117:0/298205654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb5c102640 0x7fcb5c0fbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:16.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.108+0000 7fcb6306d700 1 --2- 172.21.15.117:0/298205654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb5c101ca0 0x7fcb5c102070 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:16.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.108+0000 7fcb6306d700 1 -- 172.21.15.117:0/298205654 >> 172.21.15.117:0/298205654 conn(0x7fcb5c0f7850 msgr2=0x7fcb5c0f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:16.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.108+0000 7fcb6306d700 1 -- 172.21.15.117:0/298205654 shutdown_connections 2024-04-12T09:07:16.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.108+0000 7fcb6306d700 1 -- 172.21.15.117:0/298205654 wait complete. 2024-04-12T09:07:16.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.109+0000 7fcb6306d700 1 Processor -- start 2024-04-12T09:07:16.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.109+0000 7fcb6306d700 1 -- start start 2024-04-12T09:07:16.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.109+0000 7fcb6306d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb5c101ca0 0x7fcb5c10eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:16.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.109+0000 7fcb6306d700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb5c102640 0x7fcb5c10f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:16.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.109+0000 7fcb6306d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c10f620 con 0x7fcb5c101ca0 2024-04-12T09:07:16.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.109+0000 7fcb6306d700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c10f760 con 0x7fcb5c102640 2024-04-12T09:07:16.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.109+0000 7fcb60e09700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb5c101ca0 0x7fcb5c10eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:16.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.109+0000 7fcb60e09700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb5c101ca0 0x7fcb5c10eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54786/0 (socket says 172.21.15.117:54786) 2024-04-12T09:07:16.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.109+0000 7fcb60e09700 1 -- 172.21.15.117:0/3682928829 learned_addr learned my addr 172.21.15.117:0/3682928829 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:07:16.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.110+0000 7fcb5bfff700 1 --2- 172.21.15.117:0/3682928829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb5c102640 0x7fcb5c10f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:16.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.110+0000 7fcb60e09700 1 -- 172.21.15.117:0/3682928829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb5c102640 msgr2=0x7fcb5c10f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:16.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.110+0000 7fcb60e09700 1 --2- 172.21.15.117:0/3682928829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb5c102640 0x7fcb5c10f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:16.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.110+0000 7fcb60e09700 1 -- 172.21.15.117:0/3682928829 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb50005040 con 0x7fcb5c101ca0 2024-04-12T09:07:16.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.110+0000 7fcb60e09700 1 --2- 172.21.15.117:0/3682928829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb5c101ca0 0x7fcb5c10eba0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcb50009b30 tx=0x7fcb50009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:16.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.110+0000 7fcb597fa700 1 -- 172.21.15.117:0/3682928829 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb50021070 con 0x7fcb5c101ca0 2024-04-12T09:07:16.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.110+0000 7fcb6306d700 1 -- 172.21.15.117:0/3682928829 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb5c117a50 con 0x7fcb5c101ca0 2024-04-12T09:07:16.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.110+0000 7fcb597fa700 1 -- 172.21.15.117:0/3682928829 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcb50013c00 con 0x7fcb5c101ca0 2024-04-12T09:07:16.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.110+0000 7fcb597fa700 1 -- 172.21.15.117:0/3682928829 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb5000e070 con 0x7fcb5c101ca0 2024-04-12T09:07:16.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.110+0000 7fcb6306d700 1 -- 172.21.15.117:0/3682928829 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5c117ee0 con 0x7fcb5c101ca0 2024-04-12T09:07:16.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.111+0000 7fcb6306d700 1 -- 172.21.15.117:0/3682928829 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb5c0fd3f0 con 0x7fcb5c101ca0 2024-04-12T09:07:16.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.112+0000 7fcb597fa700 1 -- 172.21.15.117:0/3682928829 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fcb5001cad0 con 0x7fcb5c101ca0 2024-04-12T09:07:16.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.112+0000 7fcb597fa700 1 --2- 172.21.15.117:0/3682928829 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fcb4c0692a0 0x7fcb4c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:16.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.112+0000 7fcb597fa700 1 -- 172.21.15.117:0/3682928829 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcb50088310 con 0x7fcb5c101ca0 2024-04-12T09:07:16.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.112+0000 7fcb5bfff700 1 --2- 172.21.15.117:0/3682928829 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fcb4c0692a0 0x7fcb4c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:16.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.112+0000 7fcb5bfff700 1 --2- 172.21.15.117:0/3682928829 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fcb4c0692a0 0x7fcb4c06b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c066b90 tx=0x7fcb4800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:16.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.116+0000 7fcb597fa700 1 -- 172.21.15.117:0/3682928829 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fcb50054980 con 0x7fcb5c101ca0 2024-04-12T09:07:16.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.302+0000 7fcb6306d700 1 -- 172.21.15.117:0/3682928829 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb5c0fb450 con 0x7fcb5c101ca0 2024-04-12T09:07:16.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.302+0000 7fcb597fa700 1 -- 172.21.15.117:0/3682928829 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11092 (secure 0 0 0) 0x7fcb50004490 con 0x7fcb5c101ca0 2024-04-12T09:07:16.303 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:07:16.303 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":40,"fsid":"12161984-f8ab-11ee-bc8c-c7b262605968","created":"2024-04-12T09:01:24.210047+0000","modified":"2024-04-12T09:06:53.674987+0000","last_up_change":"2024-04-12T09:06:52.669995+0000","last_in_change":"2024-04-12T09:06:33.833263+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T09:05:39.657213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"a8bdd258-6f40-440f-b279-038d9b35e791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":789453361},{"type":"v1","addr":"172.21.15.117:6803","nonce":789453361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":789453361},{"type":"v1","addr":"172.21.15.117:6805","nonce":789453361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":789453361},{"type":"v1","addr":"172.21.15.117:6809","nonce":789453361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":789453361},{"type":"v1","addr":"172.21.15.117:6807","nonce":789453361}]},"public_addr":"172.21.15.117:6803/789453361","cluster_addr":"172.21.15.117:6805/789453361","heartbeat_back_addr":"172.21.15.117:6809/789453361","heartbeat_front_addr":"172.21.15.117:6807/789453361","state":["exists","up"]},{"osd":1,"uuid":"ab723885-9e88-47ad-8e80-cb5871bf0d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3995491575},{"type":"v1","addr":"172.21.15.117:6811","nonce":3995491575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3995491575},{"type":"v1","addr":"172.21.15.117:6813","nonce":3995491575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3995491575},{"type":"v1","addr":"172.21.15.117:6817","nonce":3995491575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3995491575},{"type":"v1","addr":"172.21.15.117:6815","nonce":3995491575}]},"public_addr":"172.21.15.117:6811/3995491575","cluster_addr":"172.21.15.117:6813/3995491575","heartbeat_back_addr":"172.21.15.117:6817/3995491575","heartbeat_front_addr":"172.21.15.117:6815/3995491575","state":["exists","up"]},{"osd":2,"uuid":"14f76ed3-2938-45c1-9cc7-4c0486c602ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3707487846},{"type":"v1","addr":"172.21.15.117:6819","nonce":3707487846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3707487846},{"type":"v1","addr":"172.21.15.117:6821","nonce":3707487846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3707487846},{"type":"v1","addr":"172.21.15.117:6825","nonce":3707487846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3707487846},{"type":"v1","addr":"172.21.15.117:6823","nonce":3707487846}]},"public_addr":"172.21.15.117:6819/3707487846","cluster_addr":"172.21.15.117:6821/3707487846","heartbeat_back_addr":"172.21.15.117:6825/3707487846","heartbeat_front_addr":"172.21.15.117:6823/3707487846","state":["exists","up"]},{"osd":3,"uuid":"e2bd1672-4153-498a-a20b-838516b0876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":824187707},{"type":"v1","addr":"172.21.15.203:6801","nonce":824187707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":824187707},{"type":"v1","addr":"172.21.15.203:6803","nonce":824187707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":824187707},{"type":"v1","addr":"172.21.15.203:6807","nonce":824187707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":824187707},{"type":"v1","addr":"172.21.15.203:6805","nonce":824187707}]},"public_addr":"172.21.15.203:6801/824187707","cluster_addr":"172.21.15.203:6803/824187707","heartbeat_back_addr":"172.21.15.203:6807/824187707","heartbeat_front_addr":"172.21.15.203:6805/824187707","state":["exists","up"]},{"osd":4,"uuid":"e8e6b7b8-45c2-4186-aeef-9b2feccf9fe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":22684123},{"type":"v1","addr":"172.21.15.203:6809","nonce":22684123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":22684123},{"type":"v1","addr":"172.21.15.203:6811","nonce":22684123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":22684123},{"type":"v1","addr":"172.21.15.203:6815","nonce":22684123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":22684123},{"type":"v1","addr":"172.21.15.203:6813","nonce":22684123}]},"public_addr":"172.21.15.203:6809/22684123","cluster_addr":"172.21.15.203:6811/22684123","heartbeat_back_addr":"172.21.15.203:6815/22684123","heartbeat_front_addr":"172.21.15.203:6813/22684123","state":["exists","up"]},{"osd":5,"uuid":"abbad141-29e9-4028-9e29-293cc73169fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2594776016},{"type":"v1","addr":"172.21.15.203:6817","nonce":2594776016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2594776016},{"type":"v1","addr":"172.21.15.203:6819","nonce":2594776016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2594776016},{"type":"v1","addr":"172.21.15.203:6823","nonce":2594776016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2594776016},{"type":"v1","addr":"172.21.15.203:6821","nonce":2594776016}]},"public_addr":"172.21.15.203:6817/2594776016","cluster_addr":"172.21.15.203:6819/2594776016","heartbeat_back_addr":"172.21.15.203:6823/2594776016","heartbeat_front_addr":"172.21.15.203:6821/2594776016","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:04:41.240834+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:05:09.825336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:05:37.699545+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:06:01.471956+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:06:25.743473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:06:50.806872+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.117:6800/790148838":"2024-04-13T09:03:31.333423+0000","172.21.15.117:0/448067539":"2024-04-13T09:03:31.333423+0000","172.21.15.117:0/2635780056":"2024-04-13T09:02:21.422544+0000","172.21.15.117:6801/791370182":"2024-04-13T09:02:21.422544+0000","172.21.15.117:6800/791370182":"2024-04-13T09:02:21.422544+0000","172.21.15.117:0/4061615302":"2024-04-13T09:03:31.333423+0000","172.21.15.117:0/86407959":"2024-04-13T09:02:21.422544+0000","172.21.15.117:6801/2893585477":"2024-04-13T09:01:50.340337+0000","172.21.15.117:6800/2893585477":"2024-04-13T09:01:50.340337+0000","172.21.15.117:6801/790148838":"2024-04-13T09:03:31.333423+0000","172.21.15.117:0/2514545829":"2024-04-13T09:03:31.333423+0000","172.21.15.117:0/960981120":"2024-04-13T09:01:50.340337+0000","172.21.15.117:0/4018826114":"2024-04-13T09:01:50.340337+0000","172.21.15.117:0/2869338383":"2024-04-13T09:02:21.422544+0000","172.21.15.117:0/2305921992":"2024-04-13T09:01:50.340337+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T09:07:16.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.304+0000 7fcb6306d700 1 -- 172.21.15.117:0/3682928829 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fcb4c0692a0 msgr2=0x7fcb4c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:16.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.304+0000 7fcb6306d700 1 --2- 172.21.15.117:0/3682928829 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fcb4c0692a0 0x7fcb4c06b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c066b90 tx=0x7fcb4800b040 comp rx=0 tx=0).stop 2024-04-12T09:07:16.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.304+0000 7fcb6306d700 1 -- 172.21.15.117:0/3682928829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb5c101ca0 msgr2=0x7fcb5c10eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:16.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.304+0000 7fcb6306d700 1 --2- 172.21.15.117:0/3682928829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb5c101ca0 0x7fcb5c10eba0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcb50009b30 tx=0x7fcb50009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:16.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.304+0000 7fcb6306d700 1 -- 172.21.15.117:0/3682928829 shutdown_connections 2024-04-12T09:07:16.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.304+0000 7fcb6306d700 1 --2- 172.21.15.117:0/3682928829 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fcb4c0692a0 0x7fcb4c06b750 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:16.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.304+0000 7fcb6306d700 1 --2- 172.21.15.117:0/3682928829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb5c101ca0 0x7fcb5c10eba0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:16.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.304+0000 7fcb6306d700 1 --2- 172.21.15.117:0/3682928829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb5c102640 0x7fcb5c10f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:16.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.304+0000 7fcb6306d700 1 -- 172.21.15.117:0/3682928829 >> 172.21.15.117:0/3682928829 conn(0x7fcb5c0f7850 msgr2=0x7fcb5c0f8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:16.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.304+0000 7fcb6306d700 1 -- 172.21.15.117:0/3682928829 shutdown_connections 2024-04-12T09:07:16.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:16.304+0000 7fcb6306d700 1 -- 172.21.15.117:0/3682928829 wait complete. 2024-04-12T09:07:16.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:16 smithi117 ceph-mon[29277]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:16.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:16 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/3682928829' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T09:07:16.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:16 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:07:17.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:16 smithi203 ceph-mon[36428]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:17.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:16 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/3682928829' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T09:07:17.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:16 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:07:17.092 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-12T09:07:17.093 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-12T09:07:17.093 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-12T09:07:17.093 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-12T09:07:17.094 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-12T09:07:17.094 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-12T09:07:17.411 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:07:17.412 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:07:19.026 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:18 smithi117 ceph-mon[29277]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:19.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:18 smithi203 ceph-mon[36428]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:19.711 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:07:19.711 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:07:20.841 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:07:20.842 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:07:20.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:20 smithi117 ceph-mon[29277]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:21.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:20 smithi203 ceph-mon[36428]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:22.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.840+0000 7faa24e8d700 1 -- 172.21.15.117:0/2224770299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa20102710 msgr2=0x7faa200fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:22.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.840+0000 7faa24e8d700 1 --2- 172.21.15.117:0/2224770299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa20102710 0x7faa200fbd80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faa14004940 tx=0x7faa14009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:22.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.840+0000 7faa24e8d700 1 -- 172.21.15.117:0/2224770299 shutdown_connections 2024-04-12T09:07:22.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.840+0000 7faa24e8d700 1 --2- 172.21.15.117:0/2224770299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa20102710 0x7faa200fbd80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:22.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.840+0000 7faa24e8d700 1 --2- 172.21.15.117:0/2224770299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa20101d70 0x7faa20102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:22.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.840+0000 7faa24e8d700 1 -- 172.21.15.117:0/2224770299 >> 172.21.15.117:0/2224770299 conn(0x7faa20072bc0 msgr2=0x7faa20072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:22.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.840+0000 7faa24e8d700 1 -- 172.21.15.117:0/2224770299 shutdown_connections 2024-04-12T09:07:22.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.840+0000 7faa24e8d700 1 -- 172.21.15.117:0/2224770299 wait complete. 2024-04-12T09:07:22.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.840+0000 7faa24e8d700 1 Processor -- start 2024-04-12T09:07:22.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.840+0000 7faa24e8d700 1 -- start start 2024-04-12T09:07:22.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.841+0000 7faa24e8d700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa20101d70 0x7faa20113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:22.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.841+0000 7faa24e8d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa20102710 0x7faa201140d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:22.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.841+0000 7faa24e8d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa201147b0 con 0x7faa20102710 2024-04-12T09:07:22.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.841+0000 7faa24e8d700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2010db10 con 0x7faa20101d70 2024-04-12T09:07:22.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.841+0000 7faa1dd9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa20102710 0x7faa201140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:22.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.841+0000 7faa1dd9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa20102710 0x7faa201140d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54796/0 (socket says 172.21.15.117:54796) 2024-04-12T09:07:22.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.841+0000 7faa1dd9b700 1 -- 172.21.15.117:0/685089049 learned_addr learned my addr 172.21.15.117:0/685089049 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:07:22.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.841+0000 7faa1e59c700 1 --2- 172.21.15.117:0/685089049 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa20101d70 0x7faa20113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:22.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.841+0000 7faa1dd9b700 1 -- 172.21.15.117:0/685089049 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa20101d70 msgr2=0x7faa20113b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:22.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.841+0000 7faa1dd9b700 1 --2- 172.21.15.117:0/685089049 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa20101d70 0x7faa20113b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:22.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.841+0000 7faa1dd9b700 1 -- 172.21.15.117:0/685089049 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa14005040 con 0x7faa20102710 2024-04-12T09:07:22.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.841+0000 7faa1e59c700 1 --2- 172.21.15.117:0/685089049 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa20101d70 0x7faa20113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T09:07:22.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.841+0000 7faa1dd9b700 1 --2- 172.21.15.117:0/685089049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa20102710 0x7faa201140d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7faa14009100 tx=0x7faa14009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:22.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.841+0000 7faa0effd700 1 -- 172.21.15.117:0/685089049 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa1400e040 con 0x7faa20102710 2024-04-12T09:07:22.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.841+0000 7faa0effd700 1 -- 172.21.15.117:0/685089049 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faa14013420 con 0x7faa20102710 2024-04-12T09:07:22.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.841+0000 7faa24e8d700 1 -- 172.21.15.117:0/685089049 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa2010dd90 con 0x7faa20102710 2024-04-12T09:07:22.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.841+0000 7faa0effd700 1 -- 172.21.15.117:0/685089049 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa1401c610 con 0x7faa20102710 2024-04-12T09:07:22.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.841+0000 7faa24e8d700 1 -- 172.21.15.117:0/685089049 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa2010e350 con 0x7faa20102710 2024-04-12T09:07:22.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.842+0000 7faa24e8d700 1 -- 172.21.15.117:0/685089049 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faa2010e8c0 con 0x7faa20102710 2024-04-12T09:07:22.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.843+0000 7faa0effd700 1 -- 172.21.15.117:0/685089049 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7faa14013590 con 0x7faa20102710 2024-04-12T09:07:22.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.843+0000 7faa0effd700 1 --2- 172.21.15.117:0/685089049 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7faa080692a0 0x7faa0806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:22.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.843+0000 7faa0effd700 1 -- 172.21.15.117:0/685089049 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7faa14087ff0 con 0x7faa20102710 2024-04-12T09:07:22.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.843+0000 7faa1e59c700 1 --2- 172.21.15.117:0/685089049 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7faa080692a0 0x7faa0806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:22.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.843+0000 7faa0effd700 1 --2- 172.21.15.117:0/685089049 >> [v2:172.21.15.203:6800/824187707,v1:172.21.15.203:6801/824187707] conn(0x7faa0806ef70 0x7faa08071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:22.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.843+0000 7faa0effd700 1 -- 172.21.15.117:0/685089049 --> [v2:172.21.15.203:6800/824187707,v1:172.21.15.203:6801/824187707] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa08071a30 con 0x7faa0806ef70 2024-04-12T09:07:22.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.843+0000 7faa0effd700 1 -- 172.21.15.117:0/685089049 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa1408a660 con 0x7faa20102710 2024-04-12T09:07:22.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.844+0000 7faa1e59c700 1 --2- 172.21.15.117:0/685089049 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7faa080692a0 0x7faa0806b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faa10006fd0 tx=0x7faa10008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:22.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.844+0000 7faa1ed9d700 1 --2- 172.21.15.117:0/685089049 >> [v2:172.21.15.203:6800/824187707,v1:172.21.15.203:6801/824187707] conn(0x7faa0806ef70 0x7faa08071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:22.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.844+0000 7faa1ed9d700 1 --2- 172.21.15.117:0/685089049 >> [v2:172.21.15.203:6800/824187707,v1:172.21.15.203:6801/824187707] conn(0x7faa0806ef70 0x7faa08071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:22.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.845+0000 7faa0effd700 1 -- 172.21.15.117:0/685089049 <== osd.3 v2:172.21.15.203:6800/824187707 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7faa08071a30 con 0x7faa0806ef70 2024-04-12T09:07:22.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.860+0000 7faa24e8d700 1 -- 172.21.15.117:0/685089049 --> [v2:172.21.15.203:6800/824187707,v1:172.21.15.203:6801/824187707] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faa2005e6c0 con 0x7faa0806ef70 2024-04-12T09:07:22.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.860+0000 7faa0effd700 1 -- 172.21.15.117:0/685089049 <== osd.3 v2:172.21.15.203:6800/824187707 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7faa2005e6c0 con 0x7faa0806ef70 2024-04-12T09:07:22.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.861+0000 7faa24e8d700 1 -- 172.21.15.117:0/685089049 >> [v2:172.21.15.203:6800/824187707,v1:172.21.15.203:6801/824187707] conn(0x7faa0806ef70 msgr2=0x7faa08071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:22.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.861+0000 7faa24e8d700 1 --2- 172.21.15.117:0/685089049 >> [v2:172.21.15.203:6800/824187707,v1:172.21.15.203:6801/824187707] conn(0x7faa0806ef70 0x7faa08071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:22.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.861+0000 7faa24e8d700 1 -- 172.21.15.117:0/685089049 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7faa080692a0 msgr2=0x7faa0806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:22.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.861+0000 7faa24e8d700 1 --2- 172.21.15.117:0/685089049 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7faa080692a0 0x7faa0806b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faa10006fd0 tx=0x7faa10008040 comp rx=0 tx=0).stop 2024-04-12T09:07:22.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.861+0000 7faa24e8d700 1 -- 172.21.15.117:0/685089049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa20102710 msgr2=0x7faa201140d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:22.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.861+0000 7faa24e8d700 1 --2- 172.21.15.117:0/685089049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa20102710 0x7faa201140d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7faa14009100 tx=0x7faa14009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:22.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.861+0000 7faa24e8d700 1 -- 172.21.15.117:0/685089049 shutdown_connections 2024-04-12T09:07:22.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.861+0000 7faa24e8d700 1 --2- 172.21.15.117:0/685089049 >> [v2:172.21.15.203:6800/824187707,v1:172.21.15.203:6801/824187707] conn(0x7faa0806ef70 0x7faa08071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:22.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.861+0000 7faa24e8d700 1 --2- 172.21.15.117:0/685089049 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7faa080692a0 0x7faa0806b750 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:22.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.861+0000 7faa24e8d700 1 --2- 172.21.15.117:0/685089049 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa20101d70 0x7faa20113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:22.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.861+0000 7faa24e8d700 1 --2- 172.21.15.117:0/685089049 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa20102710 0x7faa201140d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:22.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.861+0000 7faa24e8d700 1 -- 172.21.15.117:0/685089049 >> 172.21.15.117:0/685089049 conn(0x7faa20072bc0 msgr2=0x7faa200faf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:22.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.861+0000 7faa24e8d700 1 -- 172.21.15.117:0/685089049 shutdown_connections 2024-04-12T09:07:22.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:22.861+0000 7faa24e8d700 1 -- 172.21.15.117:0/685089049 wait complete. 2024-04-12T09:07:22.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:22 smithi117 ceph-mon[29277]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:23.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:22 smithi203 ceph-mon[36428]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:23.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.968+0000 7fc3fbb55700 1 -- 172.21.15.117:0/3682165187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3f40fbc00 msgr2=0x7fc3f40fbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:23.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.968+0000 7fc3fbb55700 1 --2- 172.21.15.117:0/3682165187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3f40fbc00 0x7fc3f40fbfd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0004940 tx=0x7fc3f0009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:23.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.968+0000 7fc3fbb55700 1 -- 172.21.15.117:0/3682165187 shutdown_connections 2024-04-12T09:07:23.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.968+0000 7fc3fbb55700 1 --2- 172.21.15.117:0/3682165187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3f40fc510 0x7fc3f4109270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:23.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.968+0000 7fc3fbb55700 1 --2- 172.21.15.117:0/3682165187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3f40fbc00 0x7fc3f40fbfd0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:23.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.968+0000 7fc3fbb55700 1 -- 172.21.15.117:0/3682165187 >> 172.21.15.117:0/3682165187 conn(0x7fc3f40f78d0 msgr2=0x7fc3f40f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:23.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.968+0000 7fc3fbb55700 1 -- 172.21.15.117:0/3682165187 shutdown_connections 2024-04-12T09:07:23.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.968+0000 7fc3fbb55700 1 -- 172.21.15.117:0/3682165187 wait complete. 2024-04-12T09:07:23.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.968+0000 7fc3fbb55700 1 Processor -- start 2024-04-12T09:07:23.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.968+0000 7fc3fbb55700 1 -- start start 2024-04-12T09:07:23.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.968+0000 7fc3fbb55700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3f40fbc00 0x7fc3f4115ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:23.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.968+0000 7fc3fbb55700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3f40fc510 0x7fc3f4116220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:23.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.968+0000 7fc3fbb55700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f4116870 con 0x7fc3f40fbc00 2024-04-12T09:07:23.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.968+0000 7fc3fbb55700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f410fcf0 con 0x7fc3f40fc510 2024-04-12T09:07:23.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.969+0000 7fc3f98f1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3f40fbc00 0x7fc3f4115ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:23.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.969+0000 7fc3f98f1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3f40fbc00 0x7fc3f4115ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54812/0 (socket says 172.21.15.117:54812) 2024-04-12T09:07:23.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.969+0000 7fc3f98f1700 1 -- 172.21.15.117:0/353024711 learned_addr learned my addr 172.21.15.117:0/353024711 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:07:23.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.969+0000 7fc3f90f0700 1 --2- 172.21.15.117:0/353024711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3f40fc510 0x7fc3f4116220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:23.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.969+0000 7fc3f98f1700 1 -- 172.21.15.117:0/353024711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3f40fc510 msgr2=0x7fc3f4116220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:23.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.969+0000 7fc3f98f1700 1 --2- 172.21.15.117:0/353024711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3f40fc510 0x7fc3f4116220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:23.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.969+0000 7fc3f98f1700 1 -- 172.21.15.117:0/353024711 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f0005040 con 0x7fc3f40fbc00 2024-04-12T09:07:23.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.969+0000 7fc3f98f1700 1 --2- 172.21.15.117:0/353024711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3f40fbc00 0x7fc3f4115ce0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0000c00 tx=0x7fc3f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:23.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.969+0000 7fc3ea7fc700 1 -- 172.21.15.117:0/353024711 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3f000e040 con 0x7fc3f40fbc00 2024-04-12T09:07:23.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.969+0000 7fc3fbb55700 1 -- 172.21.15.117:0/353024711 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f410ff70 con 0x7fc3f40fbc00 2024-04-12T09:07:23.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.969+0000 7fc3ea7fc700 1 -- 172.21.15.117:0/353024711 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc3f0013420 con 0x7fc3f40fbc00 2024-04-12T09:07:23.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.969+0000 7fc3ea7fc700 1 -- 172.21.15.117:0/353024711 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3f001c610 con 0x7fc3f40fbc00 2024-04-12T09:07:23.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.969+0000 7fc3fbb55700 1 -- 172.21.15.117:0/353024711 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f4110530 con 0x7fc3f40fbc00 2024-04-12T09:07:23.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.970+0000 7fc3fbb55700 1 -- 172.21.15.117:0/353024711 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc3f4110a50 con 0x7fc3f40fbc00 2024-04-12T09:07:23.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.971+0000 7fc3ea7fc700 1 -- 172.21.15.117:0/353024711 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fc3f0013590 con 0x7fc3f40fbc00 2024-04-12T09:07:23.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.972+0000 7fc3ea7fc700 1 --2- 172.21.15.117:0/353024711 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc3e00692b0 0x7fc3e006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:23.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.972+0000 7fc3ea7fc700 1 -- 172.21.15.117:0/353024711 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc3f00880d0 con 0x7fc3f40fbc00 2024-04-12T09:07:23.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.972+0000 7fc3f90f0700 1 --2- 172.21.15.117:0/353024711 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc3e00692b0 0x7fc3e006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:23.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.972+0000 7fc3ea7fc700 1 --2- 172.21.15.117:0/353024711 >> [v2:172.21.15.117:6810/3995491575,v1:172.21.15.117:6811/3995491575] conn(0x7fc3e006ef80 0x7fc3e0071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:23.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.972+0000 7fc3ea7fc700 1 -- 172.21.15.117:0/353024711 --> [v2:172.21.15.117:6810/3995491575,v1:172.21.15.117:6811/3995491575] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc3e0071a40 con 0x7fc3e006ef80 2024-04-12T09:07:23.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.972+0000 7fc3ea7fc700 1 -- 172.21.15.117:0/353024711 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3f008a6c0 con 0x7fc3f40fbc00 2024-04-12T09:07:23.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.972+0000 7fc3fa0f2700 1 --2- 172.21.15.117:0/353024711 >> [v2:172.21.15.117:6810/3995491575,v1:172.21.15.117:6811/3995491575] conn(0x7fc3e006ef80 0x7fc3e0071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:23.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.972+0000 7fc3f90f0700 1 --2- 172.21.15.117:0/353024711 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc3e00692b0 0x7fc3e006b760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4007fd0 tx=0x7fc3e4009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:23.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.972+0000 7fc3fa0f2700 1 --2- 172.21.15.117:0/353024711 >> [v2:172.21.15.117:6810/3995491575,v1:172.21.15.117:6811/3995491575] conn(0x7fc3e006ef80 0x7fc3e0071390 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:23.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:23.973+0000 7fc3ea7fc700 1 -- 172.21.15.117:0/353024711 <== osd.1 v2:172.21.15.117:6810/3995491575 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fc3e0071a40 con 0x7fc3e006ef80 2024-04-12T09:07:24.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:24.004+0000 7fc3fbb55700 1 -- 172.21.15.117:0/353024711 --> [v2:172.21.15.117:6810/3995491575,v1:172.21.15.117:6811/3995491575] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc3f40f8750 con 0x7fc3e006ef80 2024-04-12T09:07:24.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:24.005+0000 7fc3ea7fc700 1 -- 172.21.15.117:0/353024711 <== osd.1 v2:172.21.15.117:6810/3995491575 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc3f40f8750 con 0x7fc3e006ef80 2024-04-12T09:07:24.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:24.005+0000 7fc3fbb55700 1 -- 172.21.15.117:0/353024711 >> [v2:172.21.15.117:6810/3995491575,v1:172.21.15.117:6811/3995491575] conn(0x7fc3e006ef80 msgr2=0x7fc3e0071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:24.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:24.005+0000 7fc3fbb55700 1 --2- 172.21.15.117:0/353024711 >> [v2:172.21.15.117:6810/3995491575,v1:172.21.15.117:6811/3995491575] conn(0x7fc3e006ef80 0x7fc3e0071390 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:24.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:24.005+0000 7fc3fbb55700 1 -- 172.21.15.117:0/353024711 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc3e00692b0 msgr2=0x7fc3e006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:24.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:24.005+0000 7fc3fbb55700 1 --2- 172.21.15.117:0/353024711 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc3e00692b0 0x7fc3e006b760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4007fd0 tx=0x7fc3e4009040 comp rx=0 tx=0).stop 2024-04-12T09:07:24.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:24.005+0000 7fc3fbb55700 1 -- 172.21.15.117:0/353024711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3f40fbc00 msgr2=0x7fc3f4115ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:24.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:24.005+0000 7fc3fbb55700 1 --2- 172.21.15.117:0/353024711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3f40fbc00 0x7fc3f4115ce0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0000c00 tx=0x7fc3f0009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:24.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:24.005+0000 7fc3fbb55700 1 -- 172.21.15.117:0/353024711 shutdown_connections 2024-04-12T09:07:24.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:24.005+0000 7fc3fbb55700 1 --2- 172.21.15.117:0/353024711 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc3e00692b0 0x7fc3e006b760 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:24.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:24.005+0000 7fc3fbb55700 1 --2- 172.21.15.117:0/353024711 >> [v2:172.21.15.117:6810/3995491575,v1:172.21.15.117:6811/3995491575] conn(0x7fc3e006ef80 0x7fc3e0071390 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:24.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:24.005+0000 7fc3fbb55700 1 --2- 172.21.15.117:0/353024711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3f40fbc00 0x7fc3f4115ce0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:24.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:24.005+0000 7fc3fbb55700 1 --2- 172.21.15.117:0/353024711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3f40fc510 0x7fc3f4116220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:24.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:24.005+0000 7fc3fbb55700 1 -- 172.21.15.117:0/353024711 >> 172.21.15.117:0/353024711 conn(0x7fc3f40f78d0 msgr2=0x7fc3f40f7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:24.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:24.005+0000 7fc3fbb55700 1 -- 172.21.15.117:0/353024711 shutdown_connections 2024-04-12T09:07:24.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:24.005+0000 7fc3fbb55700 1 -- 172.21.15.117:0/353024711 wait complete. 2024-04-12T09:07:24.687 INFO:teuthology.orchestra.run.smithi117.stdout:111669149715 2024-04-12T09:07:24.687 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-12T09:07:24.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:24 smithi117 ceph-mon[29277]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:25.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:24 smithi203 ceph-mon[36428]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:26.264 INFO:teuthology.orchestra.run.smithi117.stdout:60129542174 2024-04-12T09:07:26.264 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-12T09:07:26.816 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:26 smithi117 ceph-mon[29277]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.009+0000 7fec71bb8700 1 -- 172.21.15.117:0/858301047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec6c0fb4d0 msgr2=0x7fec6c0fb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.009+0000 7fec71bb8700 1 --2- 172.21.15.117:0/858301047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec6c0fb4d0 0x7fec6c0fb940 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fec5c004940 tx=0x7fec5c009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.009+0000 7fec71bb8700 1 -- 172.21.15.117:0/858301047 shutdown_connections 2024-04-12T09:07:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.009+0000 7fec71bb8700 1 --2- 172.21.15.117:0/858301047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec6c0fb4d0 0x7fec6c0fb940 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.009+0000 7fec71bb8700 1 --2- 172.21.15.117:0/858301047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec6c102f50 0x7fec6c103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.009+0000 7fec71bb8700 1 -- 172.21.15.117:0/858301047 >> 172.21.15.117:0/858301047 conn(0x7fec6c0714c0 msgr2=0x7fec6c0718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.009+0000 7fec71bb8700 1 -- 172.21.15.117:0/858301047 shutdown_connections 2024-04-12T09:07:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.010+0000 7fec71bb8700 1 -- 172.21.15.117:0/858301047 wait complete. 2024-04-12T09:07:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.010+0000 7fec71bb8700 1 Processor -- start 2024-04-12T09:07:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.010+0000 7fec71bb8700 1 -- start start 2024-04-12T09:07:27.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.010+0000 7fec71bb8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec6c0fb4d0 0x7fec6c113aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:27.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.010+0000 7fec71bb8700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec6c102f50 0x7fec6c113fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:27.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.010+0000 7fec71bb8700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c1146c0 con 0x7fec6c0fb4d0 2024-04-12T09:07:27.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.010+0000 7fec71bb8700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c10dc10 con 0x7fec6c102f50 2024-04-12T09:07:27.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.010+0000 7fec6b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec6c0fb4d0 0x7fec6c113aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:27.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.010+0000 7fec6b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec6c0fb4d0 0x7fec6c113aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54856/0 (socket says 172.21.15.117:54856) 2024-04-12T09:07:27.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.010+0000 7fec6b7fe700 1 -- 172.21.15.117:0/1915455331 learned_addr learned my addr 172.21.15.117:0/1915455331 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:07:27.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.011+0000 7fec6affd700 1 --2- 172.21.15.117:0/1915455331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec6c102f50 0x7fec6c113fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:27.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.011+0000 7fec6b7fe700 1 -- 172.21.15.117:0/1915455331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec6c102f50 msgr2=0x7fec6c113fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:27.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.011+0000 7fec6b7fe700 1 --2- 172.21.15.117:0/1915455331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec6c102f50 0x7fec6c113fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:27.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.011+0000 7fec6b7fe700 1 -- 172.21.15.117:0/1915455331 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c005040 con 0x7fec6c0fb4d0 2024-04-12T09:07:27.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.011+0000 7fec6affd700 1 --2- 172.21.15.117:0/1915455331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec6c102f50 0x7fec6c113fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T09:07:27.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.011+0000 7fec6b7fe700 1 --2- 172.21.15.117:0/1915455331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec6c0fb4d0 0x7fec6c113aa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fec6000b790 tx=0x7fec60009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:27.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.011+0000 7fec53fff700 1 -- 172.21.15.117:0/1915455331 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec6000f6f0 con 0x7fec6c0fb4d0 2024-04-12T09:07:27.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.011+0000 7fec71bb8700 1 -- 172.21.15.117:0/1915455331 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec6c10de90 con 0x7fec6c0fb4d0 2024-04-12T09:07:27.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.011+0000 7fec53fff700 1 -- 172.21.15.117:0/1915455331 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec6000fd20 con 0x7fec6c0fb4d0 2024-04-12T09:07:27.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.011+0000 7fec53fff700 1 -- 172.21.15.117:0/1915455331 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec600103a0 con 0x7fec6c0fb4d0 2024-04-12T09:07:27.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.011+0000 7fec71bb8700 1 -- 172.21.15.117:0/1915455331 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6c10e3d0 con 0x7fec6c0fb4d0 2024-04-12T09:07:27.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.012+0000 7fec71bb8700 1 -- 172.21.15.117:0/1915455331 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fec6c10e890 con 0x7fec6c0fb4d0 2024-04-12T09:07:27.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.013+0000 7fec53fff700 1 -- 172.21.15.117:0/1915455331 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fec60011400 con 0x7fec6c0fb4d0 2024-04-12T09:07:27.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.013+0000 7fec53fff700 1 --2- 172.21.15.117:0/1915455331 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fec540692a0 0x7fec5406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:27.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.013+0000 7fec53fff700 1 -- 172.21.15.117:0/1915455331 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fec600876f0 con 0x7fec6c0fb4d0 2024-04-12T09:07:27.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.013+0000 7fec6affd700 1 --2- 172.21.15.117:0/1915455331 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fec540692a0 0x7fec5406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:27.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.013+0000 7fec53fff700 1 --2- 172.21.15.117:0/1915455331 >> [v2:172.21.15.117:6818/3707487846,v1:172.21.15.117:6819/3707487846] conn(0x7fec5406ef70 0x7fec54071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:27.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.013+0000 7fec53fff700 1 -- 172.21.15.117:0/1915455331 --> [v2:172.21.15.117:6818/3707487846,v1:172.21.15.117:6819/3707487846] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fec54071a30 con 0x7fec5406ef70 2024-04-12T09:07:27.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.013+0000 7fec53fff700 1 -- 172.21.15.117:0/1915455331 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec60087ad0 con 0x7fec6c0fb4d0 2024-04-12T09:07:27.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.013+0000 7fec6bfff700 1 --2- 172.21.15.117:0/1915455331 >> [v2:172.21.15.117:6818/3707487846,v1:172.21.15.117:6819/3707487846] conn(0x7fec5406ef70 0x7fec54071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:27.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.013+0000 7fec6affd700 1 --2- 172.21.15.117:0/1915455331 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fec540692a0 0x7fec5406b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fec5c000c00 tx=0x7fec5c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:27.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.014+0000 7fec6bfff700 1 --2- 172.21.15.117:0/1915455331 >> [v2:172.21.15.117:6818/3707487846,v1:172.21.15.117:6819/3707487846] conn(0x7fec5406ef70 0x7fec54071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:27.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.014+0000 7fec53fff700 1 -- 172.21.15.117:0/1915455331 <== osd.2 v2:172.21.15.117:6818/3707487846 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fec54071a30 con 0x7fec5406ef70 2024-04-12T09:07:27.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.030+0000 7fec71bb8700 1 -- 172.21.15.117:0/1915455331 --> [v2:172.21.15.117:6818/3707487846,v1:172.21.15.117:6819/3707487846] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fec6c10ea50 con 0x7fec5406ef70 2024-04-12T09:07:27.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.031+0000 7fec53fff700 1 -- 172.21.15.117:0/1915455331 <== osd.2 v2:172.21.15.117:6818/3707487846 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fec6c10ea50 con 0x7fec5406ef70 2024-04-12T09:07:27.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.031+0000 7fec71bb8700 1 -- 172.21.15.117:0/1915455331 >> [v2:172.21.15.117:6818/3707487846,v1:172.21.15.117:6819/3707487846] conn(0x7fec5406ef70 msgr2=0x7fec54071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:27.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.031+0000 7fec71bb8700 1 --2- 172.21.15.117:0/1915455331 >> [v2:172.21.15.117:6818/3707487846,v1:172.21.15.117:6819/3707487846] conn(0x7fec5406ef70 0x7fec54071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:27.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.031+0000 7fec71bb8700 1 -- 172.21.15.117:0/1915455331 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fec540692a0 msgr2=0x7fec5406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:27.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.031+0000 7fec71bb8700 1 --2- 172.21.15.117:0/1915455331 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fec540692a0 0x7fec5406b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fec5c000c00 tx=0x7fec5c009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:27.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.031+0000 7fec71bb8700 1 -- 172.21.15.117:0/1915455331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec6c0fb4d0 msgr2=0x7fec6c113aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:27.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.031+0000 7fec71bb8700 1 --2- 172.21.15.117:0/1915455331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec6c0fb4d0 0x7fec6c113aa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fec6000b790 tx=0x7fec60009220 comp rx=0 tx=0).stop 2024-04-12T09:07:27.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.031+0000 7fec71bb8700 1 -- 172.21.15.117:0/1915455331 shutdown_connections 2024-04-12T09:07:27.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.031+0000 7fec71bb8700 1 --2- 172.21.15.117:0/1915455331 >> [v2:172.21.15.117:6818/3707487846,v1:172.21.15.117:6819/3707487846] conn(0x7fec5406ef70 0x7fec54071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:27.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.031+0000 7fec71bb8700 1 --2- 172.21.15.117:0/1915455331 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fec540692a0 0x7fec5406b750 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:27.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.031+0000 7fec71bb8700 1 --2- 172.21.15.117:0/1915455331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec6c0fb4d0 0x7fec6c113aa0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:27.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.031+0000 7fec71bb8700 1 --2- 172.21.15.117:0/1915455331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec6c102f50 0x7fec6c113fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:27.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.031+0000 7fec71bb8700 1 -- 172.21.15.117:0/1915455331 >> 172.21.15.117:0/1915455331 conn(0x7fec6c0714c0 msgr2=0x7fec6c0fa650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:27.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.031+0000 7fec71bb8700 1 -- 172.21.15.117:0/1915455331 shutdown_connections 2024-04-12T09:07:27.033 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.031+0000 7fec71bb8700 1 -- 172.21.15.117:0/1915455331 wait complete. 2024-04-12T09:07:27.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:26 smithi203 ceph-mon[36428]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:27.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.498+0000 7ff6f9620700 1 -- 172.21.15.117:0/3080750175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6f4101d10 msgr2=0x7ff6f41020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:27.499 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.498+0000 7ff6f9620700 1 --2- 172.21.15.117:0/3080750175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6f4101d10 0x7ff6f41020e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4004940 tx=0x7ff6e4009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:27.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.498+0000 7ff6f9620700 1 -- 172.21.15.117:0/3080750175 shutdown_connections 2024-04-12T09:07:27.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.498+0000 7ff6f9620700 1 --2- 172.21.15.117:0/3080750175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6f41026b0 0x7ff6f40fbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:27.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.498+0000 7ff6f9620700 1 --2- 172.21.15.117:0/3080750175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6f4101d10 0x7ff6f41020e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:27.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.498+0000 7ff6f9620700 1 -- 172.21.15.117:0/3080750175 >> 172.21.15.117:0/3080750175 conn(0x7ff6f40f7880 msgr2=0x7ff6f40f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:27.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.498+0000 7ff6f9620700 1 -- 172.21.15.117:0/3080750175 shutdown_connections 2024-04-12T09:07:27.500 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.498+0000 7ff6f9620700 1 -- 172.21.15.117:0/3080750175 wait complete. 2024-04-12T09:07:27.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.499+0000 7ff6f9620700 1 Processor -- start 2024-04-12T09:07:27.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.499+0000 7ff6f9620700 1 -- start start 2024-04-12T09:07:27.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.499+0000 7ff6f9620700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6f4101d10 0x7ff6f410eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:27.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.499+0000 7ff6f9620700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6f41026b0 0x7ff6f410f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:27.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.500+0000 7ff6f9620700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f410f570 con 0x7ff6f4101d10 2024-04-12T09:07:27.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.500+0000 7ff6f9620700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f410f6b0 con 0x7ff6f41026b0 2024-04-12T09:07:27.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.500+0000 7ff6f2ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6f4101d10 0x7ff6f410eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:27.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.500+0000 7ff6f2ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6f4101d10 0x7ff6f410eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54878/0 (socket says 172.21.15.117:54878) 2024-04-12T09:07:27.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.500+0000 7ff6f2ffd700 1 -- 172.21.15.117:0/2730786287 learned_addr learned my addr 172.21.15.117:0/2730786287 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:07:27.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.500+0000 7ff6f2ffd700 1 -- 172.21.15.117:0/2730786287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6f41026b0 msgr2=0x7ff6f410f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:27.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.500+0000 7ff6f27fc700 1 --2- 172.21.15.117:0/2730786287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6f41026b0 0x7ff6f410f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:27.502 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.500+0000 7ff6f2ffd700 1 --2- 172.21.15.117:0/2730786287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6f41026b0 0x7ff6f410f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:27.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.500+0000 7ff6f2ffd700 1 -- 172.21.15.117:0/2730786287 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e4005040 con 0x7ff6f4101d10 2024-04-12T09:07:27.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.500+0000 7ff6f2ffd700 1 --2- 172.21.15.117:0/2730786287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6f4101d10 0x7ff6f410eaf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff6e400b3b0 tx=0x7ff6e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:27.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.500+0000 7ff6db7fe700 1 -- 172.21.15.117:0/2730786287 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6e400e040 con 0x7ff6f4101d10 2024-04-12T09:07:27.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.500+0000 7ff6f9620700 1 -- 172.21.15.117:0/2730786287 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f410f930 con 0x7ff6f4101d10 2024-04-12T09:07:27.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.500+0000 7ff6db7fe700 1 -- 172.21.15.117:0/2730786287 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff6e400bbc0 con 0x7ff6f4101d10 2024-04-12T09:07:27.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.500+0000 7ff6db7fe700 1 -- 172.21.15.117:0/2730786287 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6e401c3f0 con 0x7ff6f4101d10 2024-04-12T09:07:27.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.500+0000 7ff6f9620700 1 -- 172.21.15.117:0/2730786287 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f4117e60 con 0x7ff6f4101d10 2024-04-12T09:07:27.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.501+0000 7ff6f9620700 1 -- 172.21.15.117:0/2730786287 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff6f40f91d0 con 0x7ff6f4101d10 2024-04-12T09:07:27.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.502+0000 7ff6db7fe700 1 -- 172.21.15.117:0/2730786287 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ff6e400bd30 con 0x7ff6f4101d10 2024-04-12T09:07:27.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.502+0000 7ff6db7fe700 1 --2- 172.21.15.117:0/2730786287 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7ff6dc0692a0 0x7ff6dc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:27.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.502+0000 7ff6db7fe700 1 -- 172.21.15.117:0/2730786287 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff6e4088b60 con 0x7ff6f4101d10 2024-04-12T09:07:27.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.502+0000 7ff6f27fc700 1 --2- 172.21.15.117:0/2730786287 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7ff6dc0692a0 0x7ff6dc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:27.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.502+0000 7ff6db7fe700 1 --2- 172.21.15.117:0/2730786287 >> [v2:172.21.15.117:6802/789453361,v1:172.21.15.117:6803/789453361] conn(0x7ff6dc06ef70 0x7ff6dc071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:27.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.502+0000 7ff6db7fe700 1 -- 172.21.15.117:0/2730786287 --> [v2:172.21.15.117:6802/789453361,v1:172.21.15.117:6803/789453361] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6dc071a30 con 0x7ff6dc06ef70 2024-04-12T09:07:27.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.502+0000 7ff6db7fe700 1 -- 172.21.15.117:0/2730786287 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6e4088f40 con 0x7ff6f4101d10 2024-04-12T09:07:27.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.502+0000 7ff6f37fe700 1 --2- 172.21.15.117:0/2730786287 >> [v2:172.21.15.117:6802/789453361,v1:172.21.15.117:6803/789453361] conn(0x7ff6dc06ef70 0x7ff6dc071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:27.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.503+0000 7ff6f27fc700 1 --2- 172.21.15.117:0/2730786287 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7ff6dc0692a0 0x7ff6dc06b750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4066aa0 tx=0x7ff6e800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:27.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.503+0000 7ff6f37fe700 1 --2- 172.21.15.117:0/2730786287 >> [v2:172.21.15.117:6802/789453361,v1:172.21.15.117:6803/789453361] conn(0x7ff6dc06ef70 0x7ff6dc071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:27.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.503+0000 7ff6db7fe700 1 -- 172.21.15.117:0/2730786287 <== osd.0 v2:172.21.15.117:6802/789453361 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ff6dc071a30 con 0x7ff6dc06ef70 2024-04-12T09:07:27.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.518+0000 7ff6f9620700 1 -- 172.21.15.117:0/2730786287 --> [v2:172.21.15.117:6802/789453361,v1:172.21.15.117:6803/789453361] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff6f40fd460 con 0x7ff6dc06ef70 2024-04-12T09:07:27.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.518+0000 7ff6db7fe700 1 -- 172.21.15.117:0/2730786287 <== osd.0 v2:172.21.15.117:6802/789453361 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff6f40fd460 con 0x7ff6dc06ef70 2024-04-12T09:07:27.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.518+0000 7ff6f9620700 1 -- 172.21.15.117:0/2730786287 >> [v2:172.21.15.117:6802/789453361,v1:172.21.15.117:6803/789453361] conn(0x7ff6dc06ef70 msgr2=0x7ff6dc071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:27.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.518+0000 7ff6f9620700 1 --2- 172.21.15.117:0/2730786287 >> [v2:172.21.15.117:6802/789453361,v1:172.21.15.117:6803/789453361] conn(0x7ff6dc06ef70 0x7ff6dc071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:27.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.519+0000 7ff6f9620700 1 -- 172.21.15.117:0/2730786287 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7ff6dc0692a0 msgr2=0x7ff6dc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:27.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.519+0000 7ff6f9620700 1 --2- 172.21.15.117:0/2730786287 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7ff6dc0692a0 0x7ff6dc06b750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4066aa0 tx=0x7ff6e800b040 comp rx=0 tx=0).stop 2024-04-12T09:07:27.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.519+0000 7ff6f9620700 1 -- 172.21.15.117:0/2730786287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6f4101d10 msgr2=0x7ff6f410eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:27.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.519+0000 7ff6f9620700 1 --2- 172.21.15.117:0/2730786287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6f4101d10 0x7ff6f410eaf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff6e400b3b0 tx=0x7ff6e4009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:27.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.519+0000 7ff6f9620700 1 -- 172.21.15.117:0/2730786287 shutdown_connections 2024-04-12T09:07:27.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.519+0000 7ff6f9620700 1 --2- 172.21.15.117:0/2730786287 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7ff6dc0692a0 0x7ff6dc06b750 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:27.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.519+0000 7ff6f9620700 1 --2- 172.21.15.117:0/2730786287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6f4101d10 0x7ff6f410eaf0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:27.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.519+0000 7ff6f9620700 1 --2- 172.21.15.117:0/2730786287 >> [v2:172.21.15.117:6802/789453361,v1:172.21.15.117:6803/789453361] conn(0x7ff6dc06ef70 0x7ff6dc071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:27.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.519+0000 7ff6f9620700 1 --2- 172.21.15.117:0/2730786287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6f41026b0 0x7ff6f410f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:27.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.519+0000 7ff6f9620700 1 -- 172.21.15.117:0/2730786287 >> 172.21.15.117:0/2730786287 conn(0x7ff6f40f7880 msgr2=0x7ff6f40f8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:27.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.519+0000 7ff6f9620700 1 -- 172.21.15.117:0/2730786287 shutdown_connections 2024-04-12T09:07:27.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:27.519+0000 7ff6f9620700 1 -- 172.21.15.117:0/2730786287 wait complete. 2024-04-12T09:07:28.705 INFO:teuthology.orchestra.run.smithi117.stdout:81604378649 2024-04-12T09:07:28.705 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-12T09:07:28.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.882+0000 7fbcab0b3700 1 -- 172.21.15.117:0/3510113949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbca40fe7b0 msgr2=0x7fbca4106df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:28.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.882+0000 7fbcab0b3700 1 --2- 172.21.15.117:0/3510113949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbca40fe7b0 0x7fbca4106df0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbc90004940 tx=0x7fbc90009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:28.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.882+0000 7fbcab0b3700 1 -- 172.21.15.117:0/3510113949 shutdown_connections 2024-04-12T09:07:28.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.882+0000 7fbcab0b3700 1 --2- 172.21.15.117:0/3510113949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbca40fe7b0 0x7fbca4106df0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:28.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.882+0000 7fbcab0b3700 1 --2- 172.21.15.117:0/3510113949 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbca40fde10 0x7fbca40fe1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:28.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.882+0000 7fbcab0b3700 1 -- 172.21.15.117:0/3510113949 >> 172.21.15.117:0/3510113949 conn(0x7fbca40f7860 msgr2=0x7fbca40f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:28.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.882+0000 7fbcab0b3700 1 -- 172.21.15.117:0/3510113949 shutdown_connections 2024-04-12T09:07:28.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.882+0000 7fbcab0b3700 1 -- 172.21.15.117:0/3510113949 wait complete. 2024-04-12T09:07:28.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.882+0000 7fbcab0b3700 1 Processor -- start 2024-04-12T09:07:28.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.882+0000 7fbcab0b3700 1 -- start start 2024-04-12T09:07:28.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.883+0000 7fbcab0b3700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbca40fde10 0x7fbca4113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:28.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.883+0000 7fbcab0b3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbca40fe7b0 0x7fbca4113ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:28.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.883+0000 7fbcab0b3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca4114520 con 0x7fbca40fe7b0 2024-04-12T09:07:28.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.883+0000 7fbcab0b3700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca410db20 con 0x7fbca40fde10 2024-04-12T09:07:28.886 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.883+0000 7fbca3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbca40fe7b0 0x7fbca4113ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:28.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.883+0000 7fbca3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbca40fe7b0 0x7fbca4113ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54902/0 (socket says 172.21.15.117:54902) 2024-04-12T09:07:28.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.883+0000 7fbca3fff700 1 -- 172.21.15.117:0/233237054 learned_addr learned my addr 172.21.15.117:0/233237054 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:07:28.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.883+0000 7fbca8e4f700 1 --2- 172.21.15.117:0/233237054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbca40fde10 0x7fbca4113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:28.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.883+0000 7fbca3fff700 1 -- 172.21.15.117:0/233237054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbca40fde10 msgr2=0x7fbca4113990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:28.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.883+0000 7fbca3fff700 1 --2- 172.21.15.117:0/233237054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbca40fde10 0x7fbca4113990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:28.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.883+0000 7fbca3fff700 1 -- 172.21.15.117:0/233237054 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc90005040 con 0x7fbca40fe7b0 2024-04-12T09:07:28.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.883+0000 7fbca3fff700 1 --2- 172.21.15.117:0/233237054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbca40fe7b0 0x7fbca4113ed0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbc9000b3b0 tx=0x7fbc90009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:28.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.884+0000 7fbca17fa700 1 -- 172.21.15.117:0/233237054 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc9000e040 con 0x7fbca40fe7b0 2024-04-12T09:07:28.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.884+0000 7fbca17fa700 1 -- 172.21.15.117:0/233237054 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbc90013420 con 0x7fbca40fe7b0 2024-04-12T09:07:28.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.884+0000 7fbcab0b3700 1 -- 172.21.15.117:0/233237054 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca410dda0 con 0x7fbca40fe7b0 2024-04-12T09:07:28.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.884+0000 7fbca17fa700 1 -- 172.21.15.117:0/233237054 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc9001c630 con 0x7fbca40fe7b0 2024-04-12T09:07:28.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.884+0000 7fbcab0b3700 1 -- 172.21.15.117:0/233237054 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca410e2e0 con 0x7fbca40fe7b0 2024-04-12T09:07:28.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.884+0000 7fbcab0b3700 1 -- 172.21.15.117:0/233237054 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbca410e910 con 0x7fbca40fe7b0 2024-04-12T09:07:28.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.885+0000 7fbca17fa700 1 -- 172.21.15.117:0/233237054 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fbc9000baf0 con 0x7fbca40fe7b0 2024-04-12T09:07:28.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.885+0000 7fbca17fa700 1 --2- 172.21.15.117:0/233237054 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fbc940692a0 0x7fbc9406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:28.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.886+0000 7fbca17fa700 1 -- 172.21.15.117:0/233237054 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fbc90088aa0 con 0x7fbca40fe7b0 2024-04-12T09:07:28.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.886+0000 7fbca8e4f700 1 --2- 172.21.15.117:0/233237054 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fbc940692a0 0x7fbc9406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:28.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.886+0000 7fbca17fa700 1 --2- 172.21.15.117:0/233237054 >> [v2:172.21.15.203:6816/2594776016,v1:172.21.15.203:6817/2594776016] conn(0x7fbc9406ef70 0x7fbc94071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:28.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.886+0000 7fbca17fa700 1 -- 172.21.15.117:0/233237054 --> [v2:172.21.15.203:6816/2594776016,v1:172.21.15.203:6817/2594776016] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc94071a30 con 0x7fbc9406ef70 2024-04-12T09:07:28.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.886+0000 7fbca17fa700 1 -- 172.21.15.117:0/233237054 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc90088ea0 con 0x7fbca40fe7b0 2024-04-12T09:07:28.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.886+0000 7fbca9650700 1 --2- 172.21.15.117:0/233237054 >> [v2:172.21.15.203:6816/2594776016,v1:172.21.15.203:6817/2594776016] conn(0x7fbc9406ef70 0x7fbc94071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:28.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.886+0000 7fbca8e4f700 1 --2- 172.21.15.117:0/233237054 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fbc940692a0 0x7fbc9406b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbc980041d0 tx=0x7fbc98009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:28.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.886+0000 7fbca9650700 1 --2- 172.21.15.117:0/233237054 >> [v2:172.21.15.203:6816/2594776016,v1:172.21.15.203:6817/2594776016] conn(0x7fbc9406ef70 0x7fbc94071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:28.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.887+0000 7fbca17fa700 1 -- 172.21.15.117:0/233237054 <== osd.5 v2:172.21.15.203:6816/2594776016 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fbc94071a30 con 0x7fbc9406ef70 2024-04-12T09:07:28.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.913+0000 7fbcab0b3700 1 -- 172.21.15.117:0/233237054 --> [v2:172.21.15.203:6816/2594776016,v1:172.21.15.203:6817/2594776016] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbca40f9730 con 0x7fbc9406ef70 2024-04-12T09:07:28.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.914+0000 7fbca17fa700 1 -- 172.21.15.117:0/233237054 <== osd.5 v2:172.21.15.203:6816/2594776016 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fbca40f9730 con 0x7fbc9406ef70 2024-04-12T09:07:28.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.914+0000 7fbcab0b3700 1 -- 172.21.15.117:0/233237054 >> [v2:172.21.15.203:6816/2594776016,v1:172.21.15.203:6817/2594776016] conn(0x7fbc9406ef70 msgr2=0x7fbc94071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:28.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.914+0000 7fbcab0b3700 1 --2- 172.21.15.117:0/233237054 >> [v2:172.21.15.203:6816/2594776016,v1:172.21.15.203:6817/2594776016] conn(0x7fbc9406ef70 0x7fbc94071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:28.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.914+0000 7fbcab0b3700 1 -- 172.21.15.117:0/233237054 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fbc940692a0 msgr2=0x7fbc9406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:28.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.914+0000 7fbcab0b3700 1 --2- 172.21.15.117:0/233237054 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fbc940692a0 0x7fbc9406b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbc980041d0 tx=0x7fbc98009040 comp rx=0 tx=0).stop 2024-04-12T09:07:28.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.914+0000 7fbcab0b3700 1 -- 172.21.15.117:0/233237054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbca40fe7b0 msgr2=0x7fbca4113ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:28.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.914+0000 7fbcab0b3700 1 --2- 172.21.15.117:0/233237054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbca40fe7b0 0x7fbca4113ed0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbc9000b3b0 tx=0x7fbc90009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:28.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.914+0000 7fbcab0b3700 1 -- 172.21.15.117:0/233237054 shutdown_connections 2024-04-12T09:07:28.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.914+0000 7fbcab0b3700 1 --2- 172.21.15.117:0/233237054 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fbc940692a0 0x7fbc9406b750 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:28.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.914+0000 7fbcab0b3700 1 --2- 172.21.15.117:0/233237054 >> [v2:172.21.15.203:6816/2594776016,v1:172.21.15.203:6817/2594776016] conn(0x7fbc9406ef70 0x7fbc94071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:28.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.914+0000 7fbcab0b3700 1 --2- 172.21.15.117:0/233237054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbca40fde10 0x7fbca4113990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:28.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.914+0000 7fbcab0b3700 1 --2- 172.21.15.117:0/233237054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbca40fe7b0 0x7fbca4113ed0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:28.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.914+0000 7fbcab0b3700 1 -- 172.21.15.117:0/233237054 >> 172.21.15.117:0/233237054 conn(0x7fbca40f7860 msgr2=0x7fbca40f8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:28.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.915+0000 7fbcab0b3700 1 -- 172.21.15.117:0/233237054 shutdown_connections 2024-04-12T09:07:28.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:28.915+0000 7fbcab0b3700 1 -- 172.21.15.117:0/233237054 wait complete. 2024-04-12T09:07:29.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:28 smithi203 ceph-mon[36428]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:29.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:28 smithi117 ceph-mon[29277]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:29.600 INFO:teuthology.orchestra.run.smithi117.stdout:167503724555 2024-04-12T09:07:29.601 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-12T09:07:29.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.915+0000 7fc2d62c3700 1 -- 172.21.15.117:0/484575650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2d01026c0 msgr2=0x7fc2d00fbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:29.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.915+0000 7fc2d62c3700 1 --2- 172.21.15.117:0/484575650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2d01026c0 0x7fc2d00fbd30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4004940 tx=0x7fc2c4009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:29.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.915+0000 7fc2d62c3700 1 -- 172.21.15.117:0/484575650 shutdown_connections 2024-04-12T09:07:29.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.915+0000 7fc2d62c3700 1 --2- 172.21.15.117:0/484575650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2d01026c0 0x7fc2d00fbd30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:29.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.915+0000 7fc2d62c3700 1 --2- 172.21.15.117:0/484575650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2d0101d20 0x7fc2d01020f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:29.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.915+0000 7fc2d62c3700 1 -- 172.21.15.117:0/484575650 >> 172.21.15.117:0/484575650 conn(0x7fc2d00f78d0 msgr2=0x7fc2d00f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:29.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.915+0000 7fc2d62c3700 1 -- 172.21.15.117:0/484575650 shutdown_connections 2024-04-12T09:07:29.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.915+0000 7fc2d62c3700 1 -- 172.21.15.117:0/484575650 wait complete. 2024-04-12T09:07:29.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.916+0000 7fc2d62c3700 1 Processor -- start 2024-04-12T09:07:29.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.916+0000 7fc2d62c3700 1 -- start start 2024-04-12T09:07:29.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.916+0000 7fc2d62c3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2d0101d20 0x7fc2d0115de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:29.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.916+0000 7fc2d62c3700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2d01026c0 0x7fc2d0116320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:29.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.916+0000 7fc2d62c3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d0116a00 con 0x7fc2d0101d20 2024-04-12T09:07:29.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.916+0000 7fc2d62c3700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d010fd40 con 0x7fc2d01026c0 2024-04-12T09:07:29.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.916+0000 7fc2cffff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2d0101d20 0x7fc2d0115de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:29.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.916+0000 7fc2cffff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2d0101d20 0x7fc2d0115de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:54834/0 (socket says 172.21.15.117:54834) 2024-04-12T09:07:29.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.916+0000 7fc2cffff700 1 -- 172.21.15.117:0/694170793 learned_addr learned my addr 172.21.15.117:0/694170793 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:07:29.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.916+0000 7fc2cf7fe700 1 --2- 172.21.15.117:0/694170793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2d01026c0 0x7fc2d0116320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:29.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.916+0000 7fc2cffff700 1 -- 172.21.15.117:0/694170793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2d01026c0 msgr2=0x7fc2d0116320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:29.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.916+0000 7fc2cffff700 1 --2- 172.21.15.117:0/694170793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2d01026c0 0x7fc2d0116320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:29.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.916+0000 7fc2cffff700 1 -- 172.21.15.117:0/694170793 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c4005040 con 0x7fc2d0101d20 2024-04-12T09:07:29.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.917+0000 7fc2cf7fe700 1 --2- 172.21.15.117:0/694170793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2d01026c0 0x7fc2d0116320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T09:07:29.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.917+0000 7fc2cffff700 1 --2- 172.21.15.117:0/694170793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2d0101d20 0x7fc2d0115de0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000b790 tx=0x7fc2c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:29.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.917+0000 7fc2ccff9700 1 -- 172.21.15.117:0/694170793 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2c000f770 con 0x7fc2d0101d20 2024-04-12T09:07:29.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.917+0000 7fc2d62c3700 1 -- 172.21.15.117:0/694170793 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d010ffc0 con 0x7fc2d0101d20 2024-04-12T09:07:29.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.917+0000 7fc2ccff9700 1 -- 172.21.15.117:0/694170793 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc2c000fda0 con 0x7fc2d0101d20 2024-04-12T09:07:29.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.917+0000 7fc2ccff9700 1 -- 172.21.15.117:0/694170793 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2c000d310 con 0x7fc2d0101d20 2024-04-12T09:07:29.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.917+0000 7fc2d62c3700 1 -- 172.21.15.117:0/694170793 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d0110580 con 0x7fc2d0101d20 2024-04-12T09:07:29.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.918+0000 7fc2d62c3700 1 -- 172.21.15.117:0/694170793 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc2d0110b70 con 0x7fc2d0101d20 2024-04-12T09:07:29.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.918+0000 7fc2ccff9700 1 -- 172.21.15.117:0/694170793 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fc2c0010420 con 0x7fc2d0101d20 2024-04-12T09:07:29.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.919+0000 7fc2ccff9700 1 --2- 172.21.15.117:0/694170793 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc2b80692b0 0x7fc2b806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:29.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.919+0000 7fc2ccff9700 1 -- 172.21.15.117:0/694170793 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc2c0086e70 con 0x7fc2d0101d20 2024-04-12T09:07:29.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.919+0000 7fc2cf7fe700 1 --2- 172.21.15.117:0/694170793 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc2b80692b0 0x7fc2b806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:29.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.919+0000 7fc2ccff9700 1 --2- 172.21.15.117:0/694170793 >> [v2:172.21.15.203:6808/22684123,v1:172.21.15.203:6809/22684123] conn(0x7fc2b806ef80 0x7fc2b8071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:29.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.919+0000 7fc2ccff9700 1 -- 172.21.15.117:0/694170793 --> [v2:172.21.15.203:6808/22684123,v1:172.21.15.203:6809/22684123] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2b8071a40 con 0x7fc2b806ef80 2024-04-12T09:07:29.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.919+0000 7fc2ccff9700 1 -- 172.21.15.117:0/694170793 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2c008c4d0 con 0x7fc2d0101d20 2024-04-12T09:07:29.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.919+0000 7fc2cf7fe700 1 --2- 172.21.15.117:0/694170793 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc2b80692b0 0x7fc2b806b760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4009fd0 tx=0x7fc2c4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:29.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.919+0000 7fc2d4860700 1 --2- 172.21.15.117:0/694170793 >> [v2:172.21.15.203:6808/22684123,v1:172.21.15.203:6809/22684123] conn(0x7fc2b806ef80 0x7fc2b8071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:29.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.920+0000 7fc2d4860700 1 --2- 172.21.15.117:0/694170793 >> [v2:172.21.15.203:6808/22684123,v1:172.21.15.203:6809/22684123] conn(0x7fc2b806ef80 0x7fc2b8071390 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:29.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.921+0000 7fc2ccff9700 1 -- 172.21.15.117:0/694170793 <== osd.4 v2:172.21.15.203:6808/22684123 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fc2b8071a40 con 0x7fc2b806ef80 2024-04-12T09:07:29.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.935+0000 7fc2d62c3700 1 -- 172.21.15.117:0/694170793 --> [v2:172.21.15.203:6808/22684123,v1:172.21.15.203:6809/22684123] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc2d00fd470 con 0x7fc2b806ef80 2024-04-12T09:07:29.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.936+0000 7fc2ccff9700 1 -- 172.21.15.117:0/694170793 <== osd.4 v2:172.21.15.203:6808/22684123 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc2d00fd470 con 0x7fc2b806ef80 2024-04-12T09:07:29.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.936+0000 7fc2d62c3700 1 -- 172.21.15.117:0/694170793 >> [v2:172.21.15.203:6808/22684123,v1:172.21.15.203:6809/22684123] conn(0x7fc2b806ef80 msgr2=0x7fc2b8071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:29.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.936+0000 7fc2d62c3700 1 --2- 172.21.15.117:0/694170793 >> [v2:172.21.15.203:6808/22684123,v1:172.21.15.203:6809/22684123] conn(0x7fc2b806ef80 0x7fc2b8071390 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:29.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.936+0000 7fc2d62c3700 1 -- 172.21.15.117:0/694170793 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc2b80692b0 msgr2=0x7fc2b806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:29.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.936+0000 7fc2d62c3700 1 --2- 172.21.15.117:0/694170793 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc2b80692b0 0x7fc2b806b760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4009fd0 tx=0x7fc2c4009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:29.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.936+0000 7fc2d62c3700 1 -- 172.21.15.117:0/694170793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2d0101d20 msgr2=0x7fc2d0115de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:29.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.936+0000 7fc2d62c3700 1 --2- 172.21.15.117:0/694170793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2d0101d20 0x7fc2d0115de0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000b790 tx=0x7fc2c0009250 comp rx=0 tx=0).stop 2024-04-12T09:07:29.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.936+0000 7fc2d62c3700 1 -- 172.21.15.117:0/694170793 shutdown_connections 2024-04-12T09:07:29.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.936+0000 7fc2d62c3700 1 --2- 172.21.15.117:0/694170793 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc2b80692b0 0x7fc2b806b760 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:29.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.936+0000 7fc2d62c3700 1 --2- 172.21.15.117:0/694170793 >> [v2:172.21.15.203:6808/22684123,v1:172.21.15.203:6809/22684123] conn(0x7fc2b806ef80 0x7fc2b8071390 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:29.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.936+0000 7fc2d62c3700 1 --2- 172.21.15.117:0/694170793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2d0101d20 0x7fc2d0115de0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:29.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.936+0000 7fc2d62c3700 1 --2- 172.21.15.117:0/694170793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2d01026c0 0x7fc2d0116320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:29.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.936+0000 7fc2d62c3700 1 -- 172.21.15.117:0/694170793 >> 172.21.15.117:0/694170793 conn(0x7fc2d00f78d0 msgr2=0x7fc2d0065ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:29.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.936+0000 7fc2d62c3700 1 -- 172.21.15.117:0/694170793 shutdown_connections 2024-04-12T09:07:29.856 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:26.936+0000 7fc2d62c3700 1 -- 172.21.15.117:0/694170793 wait complete. 2024-04-12T09:07:30.498 INFO:teuthology.orchestra.run.smithi117.stdout:146028888079 2024-04-12T09:07:30.499 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-12T09:07:30.803 INFO:teuthology.orchestra.run.smithi117.stdout:38654705700 2024-04-12T09:07:30.803 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-12T09:07:30.825 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:07:30.829 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:07:30.835 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:07:31.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:30 smithi203 ceph-mon[36428]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:31.098 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:30 smithi117 ceph-mon[29277]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:32.015 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:31 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:07:32.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:31 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:07:32.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:32 smithi117 ceph-mon[29277]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:32.926 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:07:32.968 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:07:33.020 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:32 smithi203 ceph-mon[36428]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:33.157 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:07:35.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:34 smithi203 ceph-mon[36428]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:35.125 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:34 smithi117 ceph-mon[29277]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:36.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.173+0000 7fd335360700 1 -- 172.21.15.117:0/2710820914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3300fde90 msgr2=0x7fd3300fe260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:36.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.173+0000 7fd335360700 1 --2- 172.21.15.117:0/2710820914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3300fde90 0x7fd3300fe260 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd324004940 tx=0x7fd324009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:36.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.173+0000 7fd335360700 1 -- 172.21.15.117:0/2710820914 shutdown_connections 2024-04-12T09:07:36.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.173+0000 7fd335360700 1 --2- 172.21.15.117:0/2710820914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3300fe830 0x7fd330106f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:36.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.173+0000 7fd335360700 1 --2- 172.21.15.117:0/2710820914 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3300fde90 0x7fd3300fe260 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:36.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.173+0000 7fd335360700 1 -- 172.21.15.117:0/2710820914 >> 172.21.15.117:0/2710820914 conn(0x7fd330072bc0 msgr2=0x7fd330072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:36.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.173+0000 7fd335360700 1 -- 172.21.15.117:0/2710820914 shutdown_connections 2024-04-12T09:07:36.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.173+0000 7fd335360700 1 -- 172.21.15.117:0/2710820914 wait complete. 2024-04-12T09:07:36.176 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.174+0000 7fd335360700 1 Processor -- start 2024-04-12T09:07:36.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.174+0000 7fd335360700 1 -- start start 2024-04-12T09:07:36.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.174+0000 7fd335360700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3300fde90 0x7fd3300fbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:36.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.174+0000 7fd335360700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3300fe830 0x7fd3300fc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:36.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.174+0000 7fd335360700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3300fc820 con 0x7fd3300fde90 2024-04-12T09:07:36.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.174+0000 7fd335360700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3300fc960 con 0x7fd3300fe830 2024-04-12T09:07:36.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.174+0000 7fd32effd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3300fde90 0x7fd3300fbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:36.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.174+0000 7fd32effd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3300fde90 0x7fd3300fbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:36814/0 (socket says 172.21.15.117:36814) 2024-04-12T09:07:36.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.174+0000 7fd32effd700 1 -- 172.21.15.117:0/26135400 learned_addr learned my addr 172.21.15.117:0/26135400 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:07:36.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.174+0000 7fd32e7fc700 1 --2- 172.21.15.117:0/26135400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3300fe830 0x7fd3300fc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:36.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.174+0000 7fd32effd700 1 -- 172.21.15.117:0/26135400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3300fe830 msgr2=0x7fd3300fc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:36.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.174+0000 7fd32effd700 1 --2- 172.21.15.117:0/26135400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3300fe830 0x7fd3300fc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:36.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.174+0000 7fd32effd700 1 -- 172.21.15.117:0/26135400 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd324005040 con 0x7fd3300fde90 2024-04-12T09:07:36.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.175+0000 7fd32effd700 1 --2- 172.21.15.117:0/26135400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3300fde90 0x7fd3300fbd50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd324009390 tx=0x7fd324009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:36.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.175+0000 7fd3177fe700 1 -- 172.21.15.117:0/26135400 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd32400e040 con 0x7fd3300fde90 2024-04-12T09:07:36.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.175+0000 7fd335360700 1 -- 172.21.15.117:0/26135400 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3300fcbb0 con 0x7fd3300fde90 2024-04-12T09:07:36.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.175+0000 7fd3177fe700 1 -- 172.21.15.117:0/26135400 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd324009af0 con 0x7fd3300fde90 2024-04-12T09:07:36.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.175+0000 7fd3177fe700 1 -- 172.21.15.117:0/26135400 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd32401c3f0 con 0x7fd3300fde90 2024-04-12T09:07:36.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.175+0000 7fd335360700 1 -- 172.21.15.117:0/26135400 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd33011a280 con 0x7fd3300fde90 2024-04-12T09:07:36.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.176+0000 7fd335360700 1 -- 172.21.15.117:0/26135400 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd330065e30 con 0x7fd3300fde90 2024-04-12T09:07:36.178 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.176+0000 7fd3177fe700 1 -- 172.21.15.117:0/26135400 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fd324013420 con 0x7fd3300fde90 2024-04-12T09:07:36.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.176+0000 7fd3177fe700 1 --2- 172.21.15.117:0/26135400 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fd3180692a0 0x7fd31806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:36.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.177+0000 7fd32e7fc700 1 --2- 172.21.15.117:0/26135400 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fd3180692a0 0x7fd31806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:36.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.177+0000 7fd3177fe700 1 -- 172.21.15.117:0/26135400 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd324088030 con 0x7fd3300fde90 2024-04-12T09:07:36.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.177+0000 7fd32e7fc700 1 --2- 172.21.15.117:0/26135400 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fd3180692a0 0x7fd31806b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd3300fd690 tx=0x7fd32000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:36.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.181+0000 7fd3177fe700 1 -- 172.21.15.117:0/26135400 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fd3240546a0 con 0x7fd3300fde90 2024-04-12T09:07:36.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.378+0000 7fd335360700 1 -- 172.21.15.117:0/26135400 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd3300fd490 con 0x7fd3300fde90 2024-04-12T09:07:36.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.378+0000 7fd3177fe700 1 -- 172.21.15.117:0/26135400 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd324057cc0 con 0x7fd3300fde90 2024-04-12T09:07:36.380 INFO:teuthology.orchestra.run.smithi117.stdout:60129542176 2024-04-12T09:07:36.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.380+0000 7fd335360700 1 -- 172.21.15.117:0/26135400 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fd3180692a0 msgr2=0x7fd31806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:36.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.380+0000 7fd335360700 1 --2- 172.21.15.117:0/26135400 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fd3180692a0 0x7fd31806b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd3300fd690 tx=0x7fd32000b040 comp rx=0 tx=0).stop 2024-04-12T09:07:36.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.380+0000 7fd335360700 1 -- 172.21.15.117:0/26135400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3300fde90 msgr2=0x7fd3300fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:36.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.380+0000 7fd335360700 1 --2- 172.21.15.117:0/26135400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3300fde90 0x7fd3300fbd50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd324009390 tx=0x7fd324009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:36.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.380+0000 7fd335360700 1 -- 172.21.15.117:0/26135400 shutdown_connections 2024-04-12T09:07:36.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.380+0000 7fd335360700 1 --2- 172.21.15.117:0/26135400 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fd3180692a0 0x7fd31806b750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:36.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.380+0000 7fd335360700 1 --2- 172.21.15.117:0/26135400 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3300fde90 0x7fd3300fbd50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:36.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.380+0000 7fd335360700 1 --2- 172.21.15.117:0/26135400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3300fe830 0x7fd3300fc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:36.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.380+0000 7fd335360700 1 -- 172.21.15.117:0/26135400 >> 172.21.15.117:0/26135400 conn(0x7fd330072bc0 msgr2=0x7fd3300ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:36.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.380+0000 7fd335360700 1 -- 172.21.15.117:0/26135400 shutdown_connections 2024-04-12T09:07:36.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:36.380+0000 7fd335360700 1 -- 172.21.15.117:0/26135400 wait complete. 2024-04-12T09:07:36.887 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:36 smithi117 ceph-mon[29277]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:36.888 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:36 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/26135400' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-12T09:07:37.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:36 smithi203 ceph-mon[36428]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:37.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:36 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/26135400' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-12T09:07:37.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.319+0000 7f991d8a1700 1 -- 172.21.15.117:0/1685840531 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9918101e60 msgr2=0x7f9918102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:37.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.319+0000 7f991d8a1700 1 --2- 172.21.15.117:0/1685840531 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9918101e60 0x7f9918102230 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9908004940 tx=0x7f9908009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:37.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.319+0000 7f991d8a1700 1 -- 172.21.15.117:0/1685840531 shutdown_connections 2024-04-12T09:07:37.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.319+0000 7f991d8a1700 1 --2- 172.21.15.117:0/1685840531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9918102800 0x7f99180fc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:37.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.319+0000 7f991d8a1700 1 --2- 172.21.15.117:0/1685840531 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9918101e60 0x7f9918102230 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:37.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.319+0000 7f991d8a1700 1 -- 172.21.15.117:0/1685840531 >> 172.21.15.117:0/1685840531 conn(0x7f9918071530 msgr2=0x7f9918071930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:37.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.319+0000 7f991d8a1700 1 -- 172.21.15.117:0/1685840531 shutdown_connections 2024-04-12T09:07:37.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.320+0000 7f991d8a1700 1 -- 172.21.15.117:0/1685840531 wait complete. 2024-04-12T09:07:37.321 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.320+0000 7f991d8a1700 1 Processor -- start 2024-04-12T09:07:37.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.320+0000 7f991d8a1700 1 -- start start 2024-04-12T09:07:37.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.320+0000 7f991d8a1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9918101e60 0x7f99181139a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:37.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.320+0000 7f991d8a1700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9918102800 0x7f9918113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:37.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.320+0000 7f991d8a1700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9918114530 con 0x7f9918101e60 2024-04-12T09:07:37.322 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.320+0000 7f991d8a1700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991810db30 con 0x7f9918102800 2024-04-12T09:07:37.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.320+0000 7f9916ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9918101e60 0x7f99181139a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:37.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.321+0000 7f9916ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9918101e60 0x7f99181139a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:36824/0 (socket says 172.21.15.117:36824) 2024-04-12T09:07:37.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.321+0000 7f9916ffd700 1 -- 172.21.15.117:0/658125674 learned_addr learned my addr 172.21.15.117:0/658125674 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:07:37.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.321+0000 7f99167fc700 1 --2- 172.21.15.117:0/658125674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9918102800 0x7f9918113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:37.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.321+0000 7f9916ffd700 1 -- 172.21.15.117:0/658125674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9918102800 msgr2=0x7f9918113ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:37.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.321+0000 7f9916ffd700 1 --2- 172.21.15.117:0/658125674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9918102800 0x7f9918113ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:37.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.321+0000 7f9916ffd700 1 -- 172.21.15.117:0/658125674 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9908005040 con 0x7f9918101e60 2024-04-12T09:07:37.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.321+0000 7f9916ffd700 1 --2- 172.21.15.117:0/658125674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9918101e60 0x7f99181139a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9908009b30 tx=0x7f9908009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:37.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.321+0000 7f990f7fe700 1 -- 172.21.15.117:0/658125674 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9908021070 con 0x7f9918101e60 2024-04-12T09:07:37.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.321+0000 7f990f7fe700 1 -- 172.21.15.117:0/658125674 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9908013c00 con 0x7f9918101e60 2024-04-12T09:07:37.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.321+0000 7f991d8a1700 1 -- 172.21.15.117:0/658125674 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991810ddb0 con 0x7f9918101e60 2024-04-12T09:07:37.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.321+0000 7f990f7fe700 1 -- 172.21.15.117:0/658125674 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f990800e070 con 0x7f9918101e60 2024-04-12T09:07:37.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.321+0000 7f991d8a1700 1 -- 172.21.15.117:0/658125674 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991810e290 con 0x7f9918101e60 2024-04-12T09:07:37.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.322+0000 7f991d8a1700 1 -- 172.21.15.117:0/658125674 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99180fd660 con 0x7f9918101e60 2024-04-12T09:07:37.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.323+0000 7f990f7fe700 1 -- 172.21.15.117:0/658125674 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f990801cad0 con 0x7f9918101e60 2024-04-12T09:07:37.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.323+0000 7f990f7fe700 1 --2- 172.21.15.117:0/658125674 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f99040692a0 0x7f990406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:37.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.323+0000 7f990f7fe700 1 -- 172.21.15.117:0/658125674 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9908088210 con 0x7f9918101e60 2024-04-12T09:07:37.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.323+0000 7f99167fc700 1 --2- 172.21.15.117:0/658125674 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f99040692a0 0x7f990406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:37.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.323+0000 7f99167fc700 1 --2- 172.21.15.117:0/658125674 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f99040692a0 0x7f990406b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f991810ecf0 tx=0x7f990000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:37.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.327+0000 7f990f7fe700 1 -- 172.21.15.117:0/658125674 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f99080583b0 con 0x7f9918101e60 2024-04-12T09:07:37.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.517+0000 7f991d8a1700 1 -- 172.21.15.117:0/658125674 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9918108f60 con 0x7f9918101e60 2024-04-12T09:07:37.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.517+0000 7f990f7fe700 1 -- 172.21.15.117:0/658125674 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9908004490 con 0x7f9918101e60 2024-04-12T09:07:37.518 INFO:teuthology.orchestra.run.smithi117.stdout:167503724556 2024-04-12T09:07:37.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.519+0000 7f991d8a1700 1 -- 172.21.15.117:0/658125674 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f99040692a0 msgr2=0x7f990406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:37.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.519+0000 7f991d8a1700 1 --2- 172.21.15.117:0/658125674 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f99040692a0 0x7f990406b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f991810ecf0 tx=0x7f990000b040 comp rx=0 tx=0).stop 2024-04-12T09:07:37.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.519+0000 7f991d8a1700 1 -- 172.21.15.117:0/658125674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9918101e60 msgr2=0x7f99181139a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:37.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.519+0000 7f991d8a1700 1 --2- 172.21.15.117:0/658125674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9918101e60 0x7f99181139a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9908009b30 tx=0x7f9908009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:37.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.519+0000 7f991d8a1700 1 -- 172.21.15.117:0/658125674 shutdown_connections 2024-04-12T09:07:37.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.519+0000 7f991d8a1700 1 --2- 172.21.15.117:0/658125674 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f99040692a0 0x7f990406b750 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:37.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.519+0000 7f991d8a1700 1 --2- 172.21.15.117:0/658125674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9918101e60 0x7f99181139a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:37.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.519+0000 7f991d8a1700 1 --2- 172.21.15.117:0/658125674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9918102800 0x7f9918113ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:37.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.519+0000 7f991d8a1700 1 -- 172.21.15.117:0/658125674 >> 172.21.15.117:0/658125674 conn(0x7f9918071530 msgr2=0x7f99181056c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:37.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.519+0000 7f991d8a1700 1 -- 172.21.15.117:0/658125674 shutdown_connections 2024-04-12T09:07:37.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:37.519+0000 7f991d8a1700 1 -- 172.21.15.117:0/658125674 wait complete. 2024-04-12T09:07:37.792 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:37 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/658125674' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-12T09:07:38.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:37 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/658125674' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-12T09:07:39.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:38 smithi203 ceph-mon[36428]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:39.074 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:38 smithi117 ceph-mon[29277]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:39.552 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542174 got 60129542176 for osd.1 2024-04-12T09:07:39.553 DEBUG:teuthology.parallel:result is None 2024-04-12T09:07:40.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.009+0000 7f70ddb72700 1 -- 172.21.15.117:0/4103443993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d80fde20 msgr2=0x7f70d80fe1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:40.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.009+0000 7f70ddb72700 1 --2- 172.21.15.117:0/4103443993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d80fde20 0x7f70d80fe1f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f70c8004940 tx=0x7f70c8009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:40.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.009+0000 7f70ddb72700 1 -- 172.21.15.117:0/4103443993 shutdown_connections 2024-04-12T09:07:40.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.009+0000 7f70ddb72700 1 --2- 172.21.15.117:0/4103443993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70d80fe7c0 0x7f70d8106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:40.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.009+0000 7f70ddb72700 1 --2- 172.21.15.117:0/4103443993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d80fde20 0x7f70d80fe1f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:40.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.009+0000 7f70ddb72700 1 -- 172.21.15.117:0/4103443993 >> 172.21.15.117:0/4103443993 conn(0x7f70d80f7870 msgr2=0x7f70d80f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:40.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.009+0000 7f70ddb72700 1 -- 172.21.15.117:0/4103443993 shutdown_connections 2024-04-12T09:07:40.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.009+0000 7f70ddb72700 1 -- 172.21.15.117:0/4103443993 wait complete. 2024-04-12T09:07:40.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.010+0000 7f70ddb72700 1 Processor -- start 2024-04-12T09:07:40.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.010+0000 7f70ddb72700 1 -- start start 2024-04-12T09:07:40.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.010+0000 7f70ddb72700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70d80fde20 0x7f70d8113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:40.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.010+0000 7f70ddb72700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d80fe7c0 0x7f70d8113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:40.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.010+0000 7f70ddb72700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d8114500 con 0x7f70d80fe7c0 2024-04-12T09:07:40.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.010+0000 7f70ddb72700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d810db20 con 0x7f70d80fde20 2024-04-12T09:07:40.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.010+0000 7f70d6ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d80fe7c0 0x7f70d8113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:40.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.010+0000 7f70d6ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d80fe7c0 0x7f70d8113eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44970/0 (socket says 172.21.15.117:44970) 2024-04-12T09:07:40.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.010+0000 7f70d6ffd700 1 -- 172.21.15.117:0/2471327223 learned_addr learned my addr 172.21.15.117:0/2471327223 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:07:40.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.010+0000 7f70d77fe700 1 --2- 172.21.15.117:0/2471327223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70d80fde20 0x7f70d8113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:40.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.010+0000 7f70d6ffd700 1 -- 172.21.15.117:0/2471327223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70d80fde20 msgr2=0x7f70d8113970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:40.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.010+0000 7f70d6ffd700 1 --2- 172.21.15.117:0/2471327223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70d80fde20 0x7f70d8113970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:40.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.010+0000 7f70d6ffd700 1 -- 172.21.15.117:0/2471327223 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c8005040 con 0x7f70d80fe7c0 2024-04-12T09:07:40.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.011+0000 7f70d6ffd700 1 --2- 172.21.15.117:0/2471327223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d80fe7c0 0x7f70d8113eb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f70cc002a50 tx=0x7f70cc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:40.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.011+0000 7f70bffff700 1 -- 172.21.15.117:0/2471327223 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70cc007cc0 con 0x7f70d80fe7c0 2024-04-12T09:07:40.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.011+0000 7f70bffff700 1 -- 172.21.15.117:0/2471327223 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f70cc00f040 con 0x7f70d80fe7c0 2024-04-12T09:07:40.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.011+0000 7f70ddb72700 1 -- 172.21.15.117:0/2471327223 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d810de00 con 0x7f70d80fe7c0 2024-04-12T09:07:40.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.011+0000 7f70bffff700 1 -- 172.21.15.117:0/2471327223 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70cc00da70 con 0x7f70d80fe7c0 2024-04-12T09:07:40.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.011+0000 7f70ddb72700 1 -- 172.21.15.117:0/2471327223 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d810e340 con 0x7f70d80fe7c0 2024-04-12T09:07:40.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.012+0000 7f70ddb72700 1 -- 172.21.15.117:0/2471327223 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d8066b90 con 0x7f70d80fe7c0 2024-04-12T09:07:40.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.012+0000 7f70bffff700 1 -- 172.21.15.117:0/2471327223 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f70cc00dc10 con 0x7f70d80fe7c0 2024-04-12T09:07:40.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.012+0000 7f70bffff700 1 --2- 172.21.15.117:0/2471327223 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f70c00692a0 0x7f70c006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:40.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.013+0000 7f70bffff700 1 -- 172.21.15.117:0/2471327223 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f70cc0864e0 con 0x7f70d80fe7c0 2024-04-12T09:07:40.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.013+0000 7f70d77fe700 1 --2- 172.21.15.117:0/2471327223 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f70c00692a0 0x7f70c006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:40.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.013+0000 7f70d77fe700 1 --2- 172.21.15.117:0/2471327223 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f70c00692a0 0x7f70c006b750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f70c8004f90 tx=0x7f70c8009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:40.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.017+0000 7f70bffff700 1 -- 172.21.15.117:0/2471327223 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f70cc052ad0 con 0x7f70d80fe7c0 2024-04-12T09:07:40.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.207+0000 7f70ddb72700 1 -- 172.21.15.117:0/2471327223 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f70d8109ed0 con 0x7f70d80fe7c0 2024-04-12T09:07:40.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.207+0000 7f70bffff700 1 -- 172.21.15.117:0/2471327223 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f70cc0560f0 con 0x7f70d80fe7c0 2024-04-12T09:07:40.210 INFO:teuthology.orchestra.run.smithi117.stdout:111669149718 2024-04-12T09:07:40.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.209+0000 7f70ddb72700 1 -- 172.21.15.117:0/2471327223 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f70c00692a0 msgr2=0x7f70c006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:40.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.209+0000 7f70ddb72700 1 --2- 172.21.15.117:0/2471327223 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f70c00692a0 0x7f70c006b750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f70c8004f90 tx=0x7f70c8009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:40.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.209+0000 7f70ddb72700 1 -- 172.21.15.117:0/2471327223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d80fe7c0 msgr2=0x7f70d8113eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:40.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.209+0000 7f70ddb72700 1 --2- 172.21.15.117:0/2471327223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d80fe7c0 0x7f70d8113eb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f70cc002a50 tx=0x7f70cc0046b0 comp rx=0 tx=0).stop 2024-04-12T09:07:40.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.209+0000 7f70ddb72700 1 -- 172.21.15.117:0/2471327223 shutdown_connections 2024-04-12T09:07:40.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.209+0000 7f70ddb72700 1 --2- 172.21.15.117:0/2471327223 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f70c00692a0 0x7f70c006b750 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:40.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.209+0000 7f70ddb72700 1 --2- 172.21.15.117:0/2471327223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70d80fde20 0x7f70d8113970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:40.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.209+0000 7f70ddb72700 1 --2- 172.21.15.117:0/2471327223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70d80fe7c0 0x7f70d8113eb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:40.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.209+0000 7f70ddb72700 1 -- 172.21.15.117:0/2471327223 >> 172.21.15.117:0/2471327223 conn(0x7f70d80f7870 msgr2=0x7f70d80f8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:40.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.209+0000 7f70ddb72700 1 -- 172.21.15.117:0/2471327223 shutdown_connections 2024-04-12T09:07:40.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.209+0000 7f70ddb72700 1 -- 172.21.15.117:0/2471327223 wait complete. 2024-04-12T09:07:40.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.630+0000 7f6dbd4fc700 1 -- 172.21.15.117:0/1556954417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6db8102710 msgr2=0x7f6db80fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:40.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.630+0000 7f6dbd4fc700 1 --2- 172.21.15.117:0/1556954417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6db8102710 0x7f6db80fbd80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6da8004940 tx=0x7f6da8009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:40.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.630+0000 7f6dbd4fc700 1 -- 172.21.15.117:0/1556954417 shutdown_connections 2024-04-12T09:07:40.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.630+0000 7f6dbd4fc700 1 --2- 172.21.15.117:0/1556954417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6db8102710 0x7f6db80fbd80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:40.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.630+0000 7f6dbd4fc700 1 --2- 172.21.15.117:0/1556954417 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6db8101d70 0x7f6db8102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:40.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.630+0000 7f6dbd4fc700 1 -- 172.21.15.117:0/1556954417 >> 172.21.15.117:0/1556954417 conn(0x7f6db8072bc0 msgr2=0x7f6db8072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:40.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.630+0000 7f6dbd4fc700 1 -- 172.21.15.117:0/1556954417 shutdown_connections 2024-04-12T09:07:40.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.630+0000 7f6dbd4fc700 1 -- 172.21.15.117:0/1556954417 wait complete. 2024-04-12T09:07:40.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.631+0000 7f6dbd4fc700 1 Processor -- start 2024-04-12T09:07:40.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.631+0000 7f6dbd4fc700 1 -- start start 2024-04-12T09:07:40.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.631+0000 7f6dbd4fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6db8101d70 0x7f6db8112aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:40.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.631+0000 7f6dbd4fc700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6db8102710 0x7f6db8112fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:40.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.631+0000 7f6dbd4fc700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db8113630 con 0x7f6db8101d70 2024-04-12T09:07:40.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.631+0000 7f6dbd4fc700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db810ca20 con 0x7f6db8102710 2024-04-12T09:07:40.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.631+0000 7f6db6ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6db8101d70 0x7f6db8112aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:40.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.631+0000 7f6db6ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6db8101d70 0x7f6db8112aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44978/0 (socket says 172.21.15.117:44978) 2024-04-12T09:07:40.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.631+0000 7f6db6ffd700 1 -- 172.21.15.117:0/2934822421 learned_addr learned my addr 172.21.15.117:0/2934822421 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:07:40.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.632+0000 7f6db6ffd700 1 -- 172.21.15.117:0/2934822421 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6db8102710 msgr2=0x7f6db8112fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:40.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.632+0000 7f6db6ffd700 1 --2- 172.21.15.117:0/2934822421 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6db8102710 0x7f6db8112fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:40.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.632+0000 7f6db6ffd700 1 -- 172.21.15.117:0/2934822421 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da8005040 con 0x7f6db8101d70 2024-04-12T09:07:40.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.632+0000 7f6db6ffd700 1 --2- 172.21.15.117:0/2934822421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6db8101d70 0x7f6db8112aa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6dac00fce0 tx=0x7f6dac0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:40.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.632+0000 7f6d9f7fe700 1 -- 172.21.15.117:0/2934822421 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dac00fe90 con 0x7f6db8101d70 2024-04-12T09:07:40.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.632+0000 7f6d9f7fe700 1 -- 172.21.15.117:0/2934822421 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6dac0090d0 con 0x7f6db8101d70 2024-04-12T09:07:40.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.632+0000 7f6dbd4fc700 1 -- 172.21.15.117:0/2934822421 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db810cca0 con 0x7f6db8101d70 2024-04-12T09:07:40.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.632+0000 7f6d9f7fe700 1 -- 172.21.15.117:0/2934822421 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6dac0126a0 con 0x7f6db8101d70 2024-04-12T09:07:40.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.632+0000 7f6dbd4fc700 1 -- 172.21.15.117:0/2934822421 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db810d260 con 0x7f6db8101d70 2024-04-12T09:07:40.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.633+0000 7f6dbd4fc700 1 -- 172.21.15.117:0/2934822421 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db80fd4c0 con 0x7f6db8101d70 2024-04-12T09:07:40.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.633+0000 7f6d9f7fe700 1 -- 172.21.15.117:0/2934822421 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f6dac009240 con 0x7f6db8101d70 2024-04-12T09:07:40.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.634+0000 7f6d9f7fe700 1 --2- 172.21.15.117:0/2934822421 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f6da00692a0 0x7f6da006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:40.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.634+0000 7f6d9f7fe700 1 -- 172.21.15.117:0/2934822421 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6dac089570 con 0x7f6db8101d70 2024-04-12T09:07:40.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.634+0000 7f6db67fc700 1 --2- 172.21.15.117:0/2934822421 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f6da00692a0 0x7f6da006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:40.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.634+0000 7f6db67fc700 1 --2- 172.21.15.117:0/2934822421 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f6da00692a0 0x7f6da006b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6da800b3b0 tx=0x7f6da8009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:40.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.638+0000 7f6d9f7fe700 1 -- 172.21.15.117:0/2934822421 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f6dac059670 con 0x7f6db8101d70 2024-04-12T09:07:40.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.831+0000 7f6dbd4fc700 1 -- 172.21.15.117:0/2934822421 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6db8108e80 con 0x7f6db8101d70 2024-04-12T09:07:40.832 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:40 smithi117 ceph-mon[29277]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:40.833 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:40 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/2471327223' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-12T09:07:40.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.832+0000 7f6d9f7fe700 1 -- 172.21.15.117:0/2934822421 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6dac059200 con 0x7f6db8101d70 2024-04-12T09:07:40.833 INFO:teuthology.orchestra.run.smithi117.stdout:38654705703 2024-04-12T09:07:40.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.833+0000 7f6dbd4fc700 1 -- 172.21.15.117:0/2934822421 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f6da00692a0 msgr2=0x7f6da006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:40.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.833+0000 7f6dbd4fc700 1 --2- 172.21.15.117:0/2934822421 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f6da00692a0 0x7f6da006b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6da800b3b0 tx=0x7f6da8009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:40.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.833+0000 7f6dbd4fc700 1 -- 172.21.15.117:0/2934822421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6db8101d70 msgr2=0x7f6db8112aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:40.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.833+0000 7f6dbd4fc700 1 --2- 172.21.15.117:0/2934822421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6db8101d70 0x7f6db8112aa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6dac00fce0 tx=0x7f6dac0046b0 comp rx=0 tx=0).stop 2024-04-12T09:07:40.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.833+0000 7f6dbd4fc700 1 -- 172.21.15.117:0/2934822421 shutdown_connections 2024-04-12T09:07:40.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.833+0000 7f6dbd4fc700 1 --2- 172.21.15.117:0/2934822421 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f6da00692a0 0x7f6da006b750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:40.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.833+0000 7f6dbd4fc700 1 --2- 172.21.15.117:0/2934822421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6db8101d70 0x7f6db8112aa0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:40.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.834+0000 7f6dbd4fc700 1 --2- 172.21.15.117:0/2934822421 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6db8102710 0x7f6db8112fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:40.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.834+0000 7f6dbd4fc700 1 -- 172.21.15.117:0/2934822421 >> 172.21.15.117:0/2934822421 conn(0x7f6db8072bc0 msgr2=0x7f6db80fb080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:40.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.834+0000 7f6dbd4fc700 1 -- 172.21.15.117:0/2934822421 shutdown_connections 2024-04-12T09:07:40.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:40.834+0000 7f6dbd4fc700 1 -- 172.21.15.117:0/2934822421 wait complete. 2024-04-12T09:07:41.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:40 smithi203 ceph-mon[36428]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:41.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:40 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/2471327223' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-12T09:07:41.685 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724555 got 167503724556 for osd.5 2024-04-12T09:07:41.685 DEBUG:teuthology.parallel:result is None 2024-04-12T09:07:41.853 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:41 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/2934822421' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-12T09:07:41.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.868+0000 7fee3b8e7700 1 -- 172.21.15.117:0/946575369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee340fb4a0 msgr2=0x7fee340fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:41.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.868+0000 7fee3b8e7700 1 --2- 172.21.15.117:0/946575369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee340fb4a0 0x7fee340fb910 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fee24004940 tx=0x7fee24009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:41.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.868+0000 7fee3b8e7700 1 -- 172.21.15.117:0/946575369 shutdown_connections 2024-04-12T09:07:41.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.868+0000 7fee3b8e7700 1 --2- 172.21.15.117:0/946575369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee340fb4a0 0x7fee340fb910 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:41.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.868+0000 7fee3b8e7700 1 --2- 172.21.15.117:0/946575369 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee34102e70 0x7fee34103240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:41.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.868+0000 7fee3b8e7700 1 -- 172.21.15.117:0/946575369 >> 172.21.15.117:0/946575369 conn(0x7fee340714c0 msgr2=0x7fee340718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:41.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.868+0000 7fee3b8e7700 1 -- 172.21.15.117:0/946575369 shutdown_connections 2024-04-12T09:07:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.868+0000 7fee3b8e7700 1 -- 172.21.15.117:0/946575369 wait complete. 2024-04-12T09:07:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.868+0000 7fee3b8e7700 1 Processor -- start 2024-04-12T09:07:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.869+0000 7fee3b8e7700 1 -- start start 2024-04-12T09:07:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.869+0000 7fee3b8e7700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee340fb4a0 0x7fee34113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.869+0000 7fee3b8e7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee34102e70 0x7fee34114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.869+0000 7fee3b8e7700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee34114730 con 0x7fee34102e70 2024-04-12T09:07:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.869+0000 7fee3b8e7700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3410da90 con 0x7fee340fb4a0 2024-04-12T09:07:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.869+0000 7fee38e82700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee34102e70 0x7fee34114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.869+0000 7fee38e82700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee34102e70 0x7fee34114050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44994/0 (socket says 172.21.15.117:44994) 2024-04-12T09:07:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.869+0000 7fee38e82700 1 -- 172.21.15.117:0/780543569 learned_addr learned my addr 172.21.15.117:0/780543569 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:07:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.869+0000 7fee39683700 1 --2- 172.21.15.117:0/780543569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee340fb4a0 0x7fee34113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.869+0000 7fee38e82700 1 -- 172.21.15.117:0/780543569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee340fb4a0 msgr2=0x7fee34113b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.869+0000 7fee38e82700 1 --2- 172.21.15.117:0/780543569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee340fb4a0 0x7fee34113b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:41.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.869+0000 7fee38e82700 1 -- 172.21.15.117:0/780543569 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee24005040 con 0x7fee34102e70 2024-04-12T09:07:41.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.869+0000 7fee38e82700 1 --2- 172.21.15.117:0/780543569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee34102e70 0x7fee34114050 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fee2400b3b0 tx=0x7fee24009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:41.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.869+0000 7fee29ffb700 1 -- 172.21.15.117:0/780543569 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee2400e040 con 0x7fee34102e70 2024-04-12T09:07:41.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.869+0000 7fee29ffb700 1 -- 172.21.15.117:0/780543569 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee24013420 con 0x7fee34102e70 2024-04-12T09:07:41.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.870+0000 7fee29ffb700 1 -- 172.21.15.117:0/780543569 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee2401c630 con 0x7fee34102e70 2024-04-12T09:07:41.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.870+0000 7fee3b8e7700 1 -- 172.21.15.117:0/780543569 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee3410dd10 con 0x7fee34102e70 2024-04-12T09:07:41.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.870+0000 7fee3b8e7700 1 -- 172.21.15.117:0/780543569 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee3410e2d0 con 0x7fee34102e70 2024-04-12T09:07:41.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.871+0000 7fee3b8e7700 1 -- 172.21.15.117:0/780543569 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee34100110 con 0x7fee34102e70 2024-04-12T09:07:41.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.871+0000 7fee29ffb700 1 -- 172.21.15.117:0/780543569 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fee24013590 con 0x7fee34102e70 2024-04-12T09:07:41.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.871+0000 7fee29ffb700 1 --2- 172.21.15.117:0/780543569 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fee200692a0 0x7fee2006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:41.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.872+0000 7fee29ffb700 1 -- 172.21.15.117:0/780543569 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fee24088030 con 0x7fee34102e70 2024-04-12T09:07:41.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.872+0000 7fee39683700 1 --2- 172.21.15.117:0/780543569 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fee200692a0 0x7fee2006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:41.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.872+0000 7fee39683700 1 --2- 172.21.15.117:0/780543569 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fee200692a0 0x7fee2006b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fee30009bf0 tx=0x7fee300091a0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:41.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:41.876+0000 7fee29ffb700 1 -- 172.21.15.117:0/780543569 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fee24058130 con 0x7fee34102e70 2024-04-12T09:07:42.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.067+0000 7fee3b8e7700 1 -- 172.21.15.117:0/780543569 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fee3410f160 con 0x7fee34102e70 2024-04-12T09:07:42.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.067+0000 7fee29ffb700 1 -- 172.21.15.117:0/780543569 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fee24057cc0 con 0x7fee34102e70 2024-04-12T09:07:42.068 INFO:teuthology.orchestra.run.smithi117.stdout:81604378652 2024-04-12T09:07:42.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.069+0000 7fee3b8e7700 1 -- 172.21.15.117:0/780543569 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fee200692a0 msgr2=0x7fee2006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:42.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.069+0000 7fee3b8e7700 1 --2- 172.21.15.117:0/780543569 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fee200692a0 0x7fee2006b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fee30009bf0 tx=0x7fee300091a0 comp rx=0 tx=0).stop 2024-04-12T09:07:42.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.069+0000 7fee3b8e7700 1 -- 172.21.15.117:0/780543569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee34102e70 msgr2=0x7fee34114050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:42.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.069+0000 7fee3b8e7700 1 --2- 172.21.15.117:0/780543569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee34102e70 0x7fee34114050 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fee2400b3b0 tx=0x7fee24009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:42.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.069+0000 7fee3b8e7700 1 -- 172.21.15.117:0/780543569 shutdown_connections 2024-04-12T09:07:42.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.069+0000 7fee3b8e7700 1 --2- 172.21.15.117:0/780543569 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fee200692a0 0x7fee2006b750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:42.070 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.069+0000 7fee3b8e7700 1 --2- 172.21.15.117:0/780543569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee340fb4a0 0x7fee34113b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:42.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.069+0000 7fee3b8e7700 1 --2- 172.21.15.117:0/780543569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee34102e70 0x7fee34114050 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:42.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.069+0000 7fee3b8e7700 1 -- 172.21.15.117:0/780543569 >> 172.21.15.117:0/780543569 conn(0x7fee340714c0 msgr2=0x7fee340fa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:42.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.069+0000 7fee3b8e7700 1 -- 172.21.15.117:0/780543569 shutdown_connections 2024-04-12T09:07:42.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.069+0000 7fee3b8e7700 1 -- 172.21.15.117:0/780543569 wait complete. 2024-04-12T09:07:42.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:41 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/2934822421' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-12T09:07:42.633 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378649 got 81604378652 for osd.2 2024-04-12T09:07:42.633 DEBUG:teuthology.parallel:result is None 2024-04-12T09:07:42.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.824+0000 7f269b7b0700 1 -- 172.21.15.117:0/4211993451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26941026c0 msgr2=0x7f26940fbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:42.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.824+0000 7f269b7b0700 1 --2- 172.21.15.117:0/4211993451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26941026c0 0x7f26940fbd30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2690004940 tx=0x7f2690009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:42.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.824+0000 7f269b7b0700 1 -- 172.21.15.117:0/4211993451 shutdown_connections 2024-04-12T09:07:42.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.824+0000 7f269b7b0700 1 --2- 172.21.15.117:0/4211993451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26941026c0 0x7f26940fbd30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:42.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.824+0000 7f269b7b0700 1 --2- 172.21.15.117:0/4211993451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2694101d20 0x7f26941020f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:42.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.824+0000 7f269b7b0700 1 -- 172.21.15.117:0/4211993451 >> 172.21.15.117:0/4211993451 conn(0x7f26940f7870 msgr2=0x7f26940f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:42.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.824+0000 7f269b7b0700 1 -- 172.21.15.117:0/4211993451 shutdown_connections 2024-04-12T09:07:42.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.824+0000 7f269b7b0700 1 -- 172.21.15.117:0/4211993451 wait complete. 2024-04-12T09:07:42.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.825+0000 7f269b7b0700 1 Processor -- start 2024-04-12T09:07:42.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.825+0000 7f269b7b0700 1 -- start start 2024-04-12T09:07:42.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.825+0000 7f269b7b0700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2694101d20 0x7f26941128b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:42.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.825+0000 7f269b7b0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26941026c0 0x7f2694112df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:42.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.825+0000 7f269b7b0700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2694113440 con 0x7f26941026c0 2024-04-12T09:07:42.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.825+0000 7f269b7b0700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269410ca40 con 0x7f2694101d20 2024-04-12T09:07:42.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.825+0000 7f2698d4b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26941026c0 0x7f2694112df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:42.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.825+0000 7f2698d4b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26941026c0 0x7f2694112df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45006/0 (socket says 172.21.15.117:45006) 2024-04-12T09:07:42.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.825+0000 7f2698d4b700 1 -- 172.21.15.117:0/2871159114 learned_addr learned my addr 172.21.15.117:0/2871159114 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:07:42.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.825+0000 7f2698d4b700 1 -- 172.21.15.117:0/2871159114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2694101d20 msgr2=0x7f26941128b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:42.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.825+0000 7f269954c700 1 --2- 172.21.15.117:0/2871159114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2694101d20 0x7f26941128b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:42.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.825+0000 7f2698d4b700 1 --2- 172.21.15.117:0/2871159114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2694101d20 0x7f26941128b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:42.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.825+0000 7f2698d4b700 1 -- 172.21.15.117:0/2871159114 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2690005040 con 0x7f26941026c0 2024-04-12T09:07:42.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.825+0000 7f269954c700 1 --2- 172.21.15.117:0/2871159114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2694101d20 0x7f26941128b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T09:07:42.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.826+0000 7f2698d4b700 1 --2- 172.21.15.117:0/2871159114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26941026c0 0x7f2694112df0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2690009100 tx=0x7f2690009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:42.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.826+0000 7f2689ffb700 1 -- 172.21.15.117:0/2871159114 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f269000e040 con 0x7f26941026c0 2024-04-12T09:07:42.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.826+0000 7f269b7b0700 1 -- 172.21.15.117:0/2871159114 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f269410cbe0 con 0x7f26941026c0 2024-04-12T09:07:42.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.826+0000 7f2689ffb700 1 -- 172.21.15.117:0/2871159114 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2690013420 con 0x7f26941026c0 2024-04-12T09:07:42.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.826+0000 7f2689ffb700 1 -- 172.21.15.117:0/2871159114 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f269001c610 con 0x7f26941026c0 2024-04-12T09:07:42.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.826+0000 7f269b7b0700 1 -- 172.21.15.117:0/2871159114 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269410d1a0 con 0x7f26941026c0 2024-04-12T09:07:42.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.827+0000 7f269b7b0700 1 -- 172.21.15.117:0/2871159114 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26940fd470 con 0x7f26941026c0 2024-04-12T09:07:42.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.827+0000 7f2689ffb700 1 -- 172.21.15.117:0/2871159114 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f2690013590 con 0x7f26941026c0 2024-04-12T09:07:42.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.828+0000 7f2689ffb700 1 --2- 172.21.15.117:0/2871159114 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f26800692a0 0x7f268006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:42.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.828+0000 7f269954c700 1 --2- 172.21.15.117:0/2871159114 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f26800692a0 0x7f268006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:42.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.828+0000 7f2689ffb700 1 -- 172.21.15.117:0/2871159114 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f26900880d0 con 0x7f26941026c0 2024-04-12T09:07:42.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.828+0000 7f269954c700 1 --2- 172.21.15.117:0/2871159114 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f26800692a0 0x7f268006b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f26840041d0 tx=0x7f2684009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:42.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:42.832+0000 7f2689ffb700 1 -- 172.21.15.117:0/2871159114 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f26900581d0 con 0x7f26941026c0 2024-04-12T09:07:42.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:42 smithi117 ceph-mon[29277]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:42.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:42 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/780543569' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-12T09:07:43.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:43.025+0000 7f269b7b0700 1 -- 172.21.15.117:0/2871159114 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f269404c710 con 0x7f26941026c0 2024-04-12T09:07:43.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:43.026+0000 7f2689ffb700 1 -- 172.21.15.117:0/2871159114 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2690057d60 con 0x7f26941026c0 2024-04-12T09:07:43.027 INFO:teuthology.orchestra.run.smithi117.stdout:146028888081 2024-04-12T09:07:43.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:43.028+0000 7f269b7b0700 1 -- 172.21.15.117:0/2871159114 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f26800692a0 msgr2=0x7f268006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:43.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:43.028+0000 7f269b7b0700 1 --2- 172.21.15.117:0/2871159114 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f26800692a0 0x7f268006b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f26840041d0 tx=0x7f2684009040 comp rx=0 tx=0).stop 2024-04-12T09:07:43.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:43.028+0000 7f269b7b0700 1 -- 172.21.15.117:0/2871159114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26941026c0 msgr2=0x7f2694112df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:43.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:43.028+0000 7f269b7b0700 1 --2- 172.21.15.117:0/2871159114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26941026c0 0x7f2694112df0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2690009100 tx=0x7f2690009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:43.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:43.028+0000 7f269b7b0700 1 -- 172.21.15.117:0/2871159114 shutdown_connections 2024-04-12T09:07:43.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:43.028+0000 7f269b7b0700 1 --2- 172.21.15.117:0/2871159114 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f26800692a0 0x7f268006b750 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:43.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:43.028+0000 7f269b7b0700 1 --2- 172.21.15.117:0/2871159114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2694101d20 0x7f26941128b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:43.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:43.028+0000 7f269b7b0700 1 --2- 172.21.15.117:0/2871159114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26941026c0 0x7f2694112df0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:43.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:43.028+0000 7f269b7b0700 1 -- 172.21.15.117:0/2871159114 >> 172.21.15.117:0/2871159114 conn(0x7f26940f7870 msgr2=0x7f26940f8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:43.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:43.028+0000 7f269b7b0700 1 -- 172.21.15.117:0/2871159114 shutdown_connections 2024-04-12T09:07:43.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:43.028+0000 7f269b7b0700 1 -- 172.21.15.117:0/2871159114 wait complete. 2024-04-12T09:07:43.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:42 smithi203 ceph-mon[36428]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:43.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:42 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/780543569' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-12T09:07:43.479 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705700 got 38654705703 for osd.0 2024-04-12T09:07:43.479 DEBUG:teuthology.parallel:result is None 2024-04-12T09:07:44.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:43 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/2871159114' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-12T09:07:44.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:43 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/2871159114' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-12T09:07:44.285 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888079 got 146028888081 for osd.4 2024-04-12T09:07:44.286 DEBUG:teuthology.parallel:result is None 2024-04-12T09:07:44.725 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149715 got 111669149718 for osd.3 2024-04-12T09:07:44.725 DEBUG:teuthology.parallel:result is None 2024-04-12T09:07:44.726 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-12T09:07:44.726 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph pg dump --format=json 2024-04-12T09:07:44.988 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:07:45.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:44 smithi203 ceph-mon[36428]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:45.110 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:44 smithi117 ceph-mon[29277]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:46.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.601+0000 7f11d61d7700 1 -- 172.21.15.117:0/1440058737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11d00fe830 msgr2=0x7f11d0106f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:46.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.601+0000 7f11d61d7700 1 --2- 172.21.15.117:0/1440058737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11d00fe830 0x7f11d0106f00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f11c4004880 tx=0x7f11c4009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:46.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.601+0000 7f11d61d7700 1 -- 172.21.15.117:0/1440058737 shutdown_connections 2024-04-12T09:07:46.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.601+0000 7f11d61d7700 1 --2- 172.21.15.117:0/1440058737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11d00fe830 0x7f11d0106f00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:46.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.601+0000 7f11d61d7700 1 --2- 172.21.15.117:0/1440058737 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11d00fde90 0x7f11d00fe260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:46.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.601+0000 7f11d61d7700 1 -- 172.21.15.117:0/1440058737 >> 172.21.15.117:0/1440058737 conn(0x7f11d0072bc0 msgr2=0x7f11d0072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:46.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.601+0000 7f11d61d7700 1 -- 172.21.15.117:0/1440058737 shutdown_connections 2024-04-12T09:07:46.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.601+0000 7f11d61d7700 1 -- 172.21.15.117:0/1440058737 wait complete. 2024-04-12T09:07:46.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.602+0000 7f11d61d7700 1 Processor -- start 2024-04-12T09:07:46.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.602+0000 7f11d61d7700 1 -- start start 2024-04-12T09:07:46.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.602+0000 7f11d61d7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11d00fde90 0x7f11d0113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:46.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.602+0000 7f11d61d7700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11d00fe830 0x7f11d01140e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:46.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.602+0000 7f11d61d7700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d0114730 con 0x7f11d00fde90 2024-04-12T09:07:46.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.602+0000 7f11d61d7700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d010db20 con 0x7f11d00fe830 2024-04-12T09:07:46.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.602+0000 7f11cf7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11d00fde90 0x7f11d0113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:46.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.602+0000 7f11cf7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11d00fde90 0x7f11d0113ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45020/0 (socket says 172.21.15.117:45020) 2024-04-12T09:07:46.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.602+0000 7f11cf7fe700 1 -- 172.21.15.117:0/3091188849 learned_addr learned my addr 172.21.15.117:0/3091188849 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:07:46.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.602+0000 7f11ceffd700 1 --2- 172.21.15.117:0/3091188849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11d00fe830 0x7f11d01140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:46.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.602+0000 7f11cf7fe700 1 -- 172.21.15.117:0/3091188849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11d00fe830 msgr2=0x7f11d01140e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:46.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.602+0000 7f11cf7fe700 1 --2- 172.21.15.117:0/3091188849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11d00fe830 0x7f11d01140e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:46.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.602+0000 7f11cf7fe700 1 -- 172.21.15.117:0/3091188849 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c4005040 con 0x7f11d00fde90 2024-04-12T09:07:46.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.602+0000 7f11ceffd700 1 --2- 172.21.15.117:0/3091188849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11d00fe830 0x7f11d01140e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T09:07:46.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.602+0000 7f11cf7fe700 1 --2- 172.21.15.117:0/3091188849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11d00fde90 0x7f11d0113ba0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f11c00041d0 tx=0x7f11c000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:46.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.603+0000 7f11b7fff700 1 -- 172.21.15.117:0/3091188849 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11c0007cc0 con 0x7f11d00fde90 2024-04-12T09:07:46.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.603+0000 7f11b7fff700 1 -- 172.21.15.117:0/3091188849 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f11c000f040 con 0x7f11d00fde90 2024-04-12T09:07:46.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.603+0000 7f11d61d7700 1 -- 172.21.15.117:0/3091188849 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d010dda0 con 0x7f11d00fde90 2024-04-12T09:07:46.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.603+0000 7f11b7fff700 1 -- 172.21.15.117:0/3091188849 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11c000cb50 con 0x7f11d00fde90 2024-04-12T09:07:46.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.603+0000 7f11d61d7700 1 -- 172.21.15.117:0/3091188849 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d010e2e0 con 0x7f11d00fde90 2024-04-12T09:07:46.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.603+0000 7f11d61d7700 1 -- 172.21.15.117:0/3091188849 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d0065e30 con 0x7f11d00fde90 2024-04-12T09:07:46.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.604+0000 7f11b7fff700 1 -- 172.21.15.117:0/3091188849 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f11c00090d0 con 0x7f11d00fde90 2024-04-12T09:07:46.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.604+0000 7f11b7fff700 1 --2- 172.21.15.117:0/3091188849 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f11b80692a0 0x7f11b806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:46.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.604+0000 7f11b7fff700 1 -- 172.21.15.117:0/3091188849 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f11c0086a10 con 0x7f11d00fde90 2024-04-12T09:07:46.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.604+0000 7f11ceffd700 1 --2- 172.21.15.117:0/3091188849 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f11b80692a0 0x7f11b806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:46.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.605+0000 7f11ceffd700 1 --2- 172.21.15.117:0/3091188849 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f11b80692a0 0x7f11b806b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f11d010ece0 tx=0x7f11c4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:46.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.609+0000 7f11b7fff700 1 -- 172.21.15.117:0/3091188849 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f11c004e190 con 0x7f11d00fde90 2024-04-12T09:07:46.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.793+0000 7f11d61d7700 1 -- 172.21.15.117:0/3091188849 --> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11d0109f10 con 0x7f11b80692a0 2024-04-12T09:07:46.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.794+0000 7f11b7fff700 1 -- 172.21.15.117:0/3091188849 <== mgr.14214 v2:172.21.15.117:6800/3945342300 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27793 (secure 0 0 0) 0x7f11d0109f10 con 0x7f11b80692a0 2024-04-12T09:07:46.796 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:07:46.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.796+0000 7f11d61d7700 1 -- 172.21.15.117:0/3091188849 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f11b80692a0 msgr2=0x7f11b806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:46.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.796+0000 7f11d61d7700 1 --2- 172.21.15.117:0/3091188849 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f11b80692a0 0x7f11b806b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f11d010ece0 tx=0x7f11c4009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:46.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.796+0000 7f11d61d7700 1 -- 172.21.15.117:0/3091188849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11d00fde90 msgr2=0x7f11d0113ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:46.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.796+0000 7f11d61d7700 1 --2- 172.21.15.117:0/3091188849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11d00fde90 0x7f11d0113ba0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f11c00041d0 tx=0x7f11c000b040 comp rx=0 tx=0).stop 2024-04-12T09:07:46.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.796+0000 7f11d61d7700 1 -- 172.21.15.117:0/3091188849 shutdown_connections 2024-04-12T09:07:46.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.796+0000 7f11d61d7700 1 --2- 172.21.15.117:0/3091188849 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f11b80692a0 0x7f11b806b750 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:46.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.796+0000 7f11d61d7700 1 --2- 172.21.15.117:0/3091188849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11d00fde90 0x7f11d0113ba0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:46.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.796+0000 7f11d61d7700 1 --2- 172.21.15.117:0/3091188849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11d00fe830 0x7f11d01140e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:46.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.796+0000 7f11d61d7700 1 -- 172.21.15.117:0/3091188849 >> 172.21.15.117:0/3091188849 conn(0x7f11d0072bc0 msgr2=0x7f11d01037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:46.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.797+0000 7f11d61d7700 1 -- 172.21.15.117:0/3091188849 shutdown_connections 2024-04-12T09:07:46.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:46.797+0000 7f11d61d7700 1 -- 172.21.15.117:0/3091188849 wait complete. 2024-04-12T09:07:46.799 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-04-12T09:07:47.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:46 smithi203 ceph-mon[36428]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:47.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:46 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:07:47.107 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:46 smithi117 ceph-mon[29277]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:47.107 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:46 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:07:47.537 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-04-12T09:07:45.383942+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788032,"kb_used_data":3876,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682880,"statfs":{"total":575970213888,"available":574139269120,"internally_reserved":0,"allocated":3969024,"data_stored":2606262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002246"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":190,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-12T09:06:52.673054+0000","last_change":"2024-04-12T09:06:26.855442+0000","last_active":"2024-04-12T09:06:52.673054+0000","last_peered":"2024-04-12T09:06:52.673054+0000","last_clean":"2024-04-12T09:06:52.673054+0000","last_became_active":"2024-04-12T09:06:26.855038+0000","last_became_peered":"2024-04-12T09:06:26.855038+0000","last_unstale":"2024-04-12T09:06:52.673054+0000","last_undegraded":"2024-04-12T09:06:52.673054+0000","last_fullsized":"2024-04-12T09:06:52.673054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T09:05:40.375556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T09:05:40.375556+0000","last_clean_scrub_stamp":"2024-04-12T09:05:40.375556+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:22:20.885410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297712,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]}]},{"osd":4,"up_from":34,"seq":146028888082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297716,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447436,"statfs":{"total":95995035648,"available":95690174464,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 12 09:07:31 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.46300000000000002}]},{"osd":1,"last update":"Fri Apr 12 09:07:31 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.371},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.47399999999999998}]},{"osd":2,"last update":"Fri Apr 12 09:07:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.442}]},{"osd":3,"last update":"Fri Apr 12 09:07:31 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 12 09:07:05 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.497},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.54600000000000004}]},{"osd":1,"last update":"Fri Apr 12 09:07:05 2024","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":17.619,"5min":17.619,"15min":17.619},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.60599999999999998}]},{"osd":2,"last update":"Fri Apr 12 09:07:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.626},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.47099999999999997}]},{"osd":4,"last update":"Fri Apr 12 09:07:28 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.372}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297712,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 12 09:07:42 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.35099999999999998,"15min":0.35499999999999998},"min":{"1min":0.158,"5min":0.158,"15min":0.158},"max":{"1min":0.48699999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.158},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.36299999999999999,"15min":0.36699999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.41899999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.219}]},{"osd":1,"last update":"Fri Apr 12 09:07:42 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.36699999999999999,"15min":0.37},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.48099999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.193},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.36699999999999999,"15min":0.36899999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.46600000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.252}]},{"osd":3,"last update":"Fri Apr 12 09:07:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri Apr 12 09:07:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298296,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446856,"statfs":{"total":95995035648,"available":95689580544,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 12 09:07:15 2024","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.24199999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.31},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.34599999999999997,"15min":0.34399999999999997},"min":{"1min":0.251,"5min":0.223,"15min":0.223},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.34200000000000003}]},{"osd":2,"last update":"Fri Apr 12 09:06:44 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.35599999999999998}]},{"osd":3,"last update":"Fri Apr 12 09:07:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Apr 12 09:07:27 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298296,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446856,"statfs":{"total":95995035648,"available":95689580544,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 12 09:07:14 2024","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.29999999999999999,"15min":0.29599999999999999},"min":{"1min":0.248,"5min":0.191,"15min":0.191},"max":{"1min":0.40799999999999997,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.313,"15min":0.31},"min":{"1min":0.251,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.46200000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.47299999999999998}]},{"osd":2,"last update":"Fri Apr 12 09:06:42 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.499}]},{"osd":3,"last update":"Fri Apr 12 09:07:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.67400000000000004}]},{"osd":4,"last update":"Fri Apr 12 09:07:27 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":13.651,"5min":13.651,"15min":13.651},"last":0.61799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-12T09:07:47.538 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph pg dump --format=json 2024-04-12T09:07:47.801 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:07:48.042 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:47 smithi117 ceph-mon[29277]: from='client.14414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-12T09:07:48.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:47 smithi203 ceph-mon[36428]: from='client.14414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-12T09:07:49.057 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:48 smithi117 ceph-mon[29277]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:49.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:48 smithi203 ceph-mon[36428]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:49.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.388+0000 7fd2e8153700 1 -- 172.21.15.117:0/4061024865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2e0102f50 msgr2=0x7fd2e0103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:49.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.388+0000 7fd2e8153700 1 --2- 172.21.15.117:0/4061024865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2e0102f50 0x7fd2e0103320 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8004940 tx=0x7fd2d8009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:49.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.388+0000 7fd2e8153700 1 -- 172.21.15.117:0/4061024865 shutdown_connections 2024-04-12T09:07:49.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.388+0000 7fd2e8153700 1 --2- 172.21.15.117:0/4061024865 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2e00fb4d0 0x7fd2e00fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:49.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.388+0000 7fd2e8153700 1 --2- 172.21.15.117:0/4061024865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2e0102f50 0x7fd2e0103320 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:49.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.388+0000 7fd2e8153700 1 -- 172.21.15.117:0/4061024865 >> 172.21.15.117:0/4061024865 conn(0x7fd2e00714c0 msgr2=0x7fd2e00718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:49.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.388+0000 7fd2e8153700 1 -- 172.21.15.117:0/4061024865 shutdown_connections 2024-04-12T09:07:49.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.388+0000 7fd2e8153700 1 -- 172.21.15.117:0/4061024865 wait complete. 2024-04-12T09:07:49.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.389+0000 7fd2e8153700 1 Processor -- start 2024-04-12T09:07:49.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.389+0000 7fd2e8153700 1 -- start start 2024-04-12T09:07:49.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.389+0000 7fd2e8153700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2e00fb4d0 0x7fd2e0113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:49.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.389+0000 7fd2e8153700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2e0102f50 0x7fd2e0113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:49.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.389+0000 7fd2e8153700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e0114670 con 0x7fd2e00fb4d0 2024-04-12T09:07:49.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.389+0000 7fd2e8153700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e010dc10 con 0x7fd2e0102f50 2024-04-12T09:07:49.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.389+0000 7fd2e5eef700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2e00fb4d0 0x7fd2e0113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:49.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.389+0000 7fd2e5eef700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2e00fb4d0 0x7fd2e0113a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45030/0 (socket says 172.21.15.117:45030) 2024-04-12T09:07:49.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.389+0000 7fd2e5eef700 1 -- 172.21.15.117:0/1058929448 learned_addr learned my addr 172.21.15.117:0/1058929448 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:07:49.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.389+0000 7fd2e56ee700 1 --2- 172.21.15.117:0/1058929448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2e0102f50 0x7fd2e0113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:49.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.390+0000 7fd2e5eef700 1 -- 172.21.15.117:0/1058929448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2e0102f50 msgr2=0x7fd2e0113f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:49.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.390+0000 7fd2e5eef700 1 --2- 172.21.15.117:0/1058929448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2e0102f50 0x7fd2e0113f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:49.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.390+0000 7fd2e5eef700 1 -- 172.21.15.117:0/1058929448 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d8005040 con 0x7fd2e00fb4d0 2024-04-12T09:07:49.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.390+0000 7fd2e5eef700 1 --2- 172.21.15.117:0/1058929448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2e00fb4d0 0x7fd2e0113a50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8009100 tx=0x7fd2d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:49.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.390+0000 7fd2d67fc700 1 -- 172.21.15.117:0/1058929448 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2d800e040 con 0x7fd2e00fb4d0 2024-04-12T09:07:49.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.390+0000 7fd2d67fc700 1 -- 172.21.15.117:0/1058929448 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd2d8009af0 con 0x7fd2e00fb4d0 2024-04-12T09:07:49.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.390+0000 7fd2e8153700 1 -- 172.21.15.117:0/1058929448 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e010de30 con 0x7fd2e00fb4d0 2024-04-12T09:07:49.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.390+0000 7fd2d67fc700 1 -- 172.21.15.117:0/1058929448 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2d801c3f0 con 0x7fd2e00fb4d0 2024-04-12T09:07:49.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.390+0000 7fd2e8153700 1 -- 172.21.15.117:0/1058929448 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e010e370 con 0x7fd2e00fb4d0 2024-04-12T09:07:49.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.391+0000 7fd2e8153700 1 -- 172.21.15.117:0/1058929448 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e0100200 con 0x7fd2e00fb4d0 2024-04-12T09:07:49.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.391+0000 7fd2d67fc700 1 -- 172.21.15.117:0/1058929448 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fd2d800baf0 con 0x7fd2e00fb4d0 2024-04-12T09:07:49.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.392+0000 7fd2d67fc700 1 --2- 172.21.15.117:0/1058929448 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fd2cc0692a0 0x7fd2cc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:49.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.392+0000 7fd2d67fc700 1 -- 172.21.15.117:0/1058929448 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd2d8088120 con 0x7fd2e00fb4d0 2024-04-12T09:07:49.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.392+0000 7fd2e56ee700 1 --2- 172.21.15.117:0/1058929448 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fd2cc0692a0 0x7fd2cc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:49.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.392+0000 7fd2e56ee700 1 --2- 172.21.15.117:0/1058929448 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fd2cc0692a0 0x7fd2cc06b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd2e010f2f0 tx=0x7fd2d00091a0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:49.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.396+0000 7fd2d67fc700 1 -- 172.21.15.117:0/1058929448 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fd2d8058220 con 0x7fd2e00fb4d0 2024-04-12T09:07:49.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.580+0000 7fd2e8153700 1 -- 172.21.15.117:0/1058929448 --> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2e010a120 con 0x7fd2cc0692a0 2024-04-12T09:07:49.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.581+0000 7fd2d67fc700 1 -- 172.21.15.117:0/1058929448 <== mgr.14214 v2:172.21.15.117:6800/3945342300 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27752 (secure 0 0 0) 0x7fd2e010a120 con 0x7fd2cc0692a0 2024-04-12T09:07:49.582 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:07:49.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.583+0000 7fd2e8153700 1 -- 172.21.15.117:0/1058929448 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fd2cc0692a0 msgr2=0x7fd2cc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:49.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.583+0000 7fd2e8153700 1 --2- 172.21.15.117:0/1058929448 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fd2cc0692a0 0x7fd2cc06b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd2e010f2f0 tx=0x7fd2d00091a0 comp rx=0 tx=0).stop 2024-04-12T09:07:49.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.583+0000 7fd2e8153700 1 -- 172.21.15.117:0/1058929448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2e00fb4d0 msgr2=0x7fd2e0113a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:49.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.583+0000 7fd2e8153700 1 --2- 172.21.15.117:0/1058929448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2e00fb4d0 0x7fd2e0113a50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8009100 tx=0x7fd2d8009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:49.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.583+0000 7fd2e8153700 1 -- 172.21.15.117:0/1058929448 shutdown_connections 2024-04-12T09:07:49.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.583+0000 7fd2e8153700 1 --2- 172.21.15.117:0/1058929448 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fd2cc0692a0 0x7fd2cc06b750 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:49.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.583+0000 7fd2e8153700 1 --2- 172.21.15.117:0/1058929448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2e00fb4d0 0x7fd2e0113a50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:49.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.583+0000 7fd2e8153700 1 --2- 172.21.15.117:0/1058929448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd2e0102f50 0x7fd2e0113f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:49.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.583+0000 7fd2e8153700 1 -- 172.21.15.117:0/1058929448 >> 172.21.15.117:0/1058929448 conn(0x7fd2e00714c0 msgr2=0x7fd2e00fa710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:49.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.583+0000 7fd2e8153700 1 -- 172.21.15.117:0/1058929448 shutdown_connections 2024-04-12T09:07:49.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:49.583+0000 7fd2e8153700 1 -- 172.21.15.117:0/1058929448 wait complete. 2024-04-12T09:07:49.585 INFO:teuthology.orchestra.run.smithi117.stderr:dumped all 2024-04-12T09:07:50.321 INFO:teuthology.orchestra.run.smithi117.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-04-12T09:07:49.384621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788032,"kb_used_data":3876,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682880,"statfs":{"total":575970213888,"available":574139269120,"internally_reserved":0,"allocated":3969024,"data_stored":2606262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002282"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":190,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-12T09:06:52.673054+0000","last_change":"2024-04-12T09:06:26.855442+0000","last_active":"2024-04-12T09:06:52.673054+0000","last_peered":"2024-04-12T09:06:52.673054+0000","last_clean":"2024-04-12T09:06:52.673054+0000","last_became_active":"2024-04-12T09:06:26.855038+0000","last_became_peered":"2024-04-12T09:06:26.855038+0000","last_unstale":"2024-04-12T09:06:52.673054+0000","last_undegraded":"2024-04-12T09:06:52.673054+0000","last_fullsized":"2024-04-12T09:06:52.673054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T09:05:40.375556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T09:05:40.375556+0000","last_clean_scrub_stamp":"2024-04-12T09:05:40.375556+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:22:20.885410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297712,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":4,"up_from":34,"seq":146028888083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297716,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447436,"statfs":{"total":95995035648,"available":95690174464,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 12 09:07:31 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.72299999999999998}]},{"osd":1,"last update":"Fri Apr 12 09:07:31 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.65900000000000003}]},{"osd":2,"last update":"Fri Apr 12 09:07:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.65100000000000002}]},{"osd":3,"last update":"Fri Apr 12 09:07:31 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 12 09:07:05 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.497},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.54600000000000004}]},{"osd":1,"last update":"Fri Apr 12 09:07:05 2024","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":17.619,"5min":17.619,"15min":17.619},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.60599999999999998}]},{"osd":2,"last update":"Fri Apr 12 09:07:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.626},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.47099999999999997}]},{"osd":4,"last update":"Fri Apr 12 09:07:28 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.372}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297712,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447440,"statfs":{"total":95995035648,"available":95690178560,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 12 09:07:42 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.35099999999999998,"15min":0.35499999999999998},"min":{"1min":0.158,"5min":0.158,"15min":0.158},"max":{"1min":0.48699999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.158},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.36299999999999999,"15min":0.36699999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.41899999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.219}]},{"osd":1,"last update":"Fri Apr 12 09:07:42 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.36699999999999999,"15min":0.37},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.48099999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.193},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.36699999999999999,"15min":0.36899999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.46600000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.252}]},{"osd":3,"last update":"Fri Apr 12 09:07:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri Apr 12 09:07:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705705,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298296,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446856,"statfs":{"total":95995035648,"available":95689580544,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 12 09:07:15 2024","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.24199999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.373},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.34599999999999997,"15min":0.34399999999999997},"min":{"1min":0.251,"5min":0.223,"15min":0.223},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.436}]},{"osd":2,"last update":"Fri Apr 12 09:07:48 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.371,"15min":0.374},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.38500000000000001,"15min":0.38900000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.498,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.41099999999999998}]},{"osd":3,"last update":"Fri Apr 12 09:07:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.73899999999999999}]},{"osd":4,"last update":"Fri Apr 12 09:07:27 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298296,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446856,"statfs":{"total":95995035648,"available":95689580544,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 12 09:07:14 2024","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.29999999999999999,"15min":0.29599999999999999},"min":{"1min":0.248,"5min":0.191,"15min":0.191},"max":{"1min":0.40799999999999997,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.313,"15min":0.31},"min":{"1min":0.251,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.46200000000000002,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.28699999999999998}]},{"osd":2,"last update":"Fri Apr 12 09:07:45 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.374,"15min":0.38100000000000001},"min":{"1min":0.25900000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.46200000000000002,"5min":0.498,"15min":0.498},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.377,"15min":0.38400000000000001},"min":{"1min":0.27300000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.499,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.313}]},{"osd":3,"last update":"Fri Apr 12 09:07:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.66400000000000003}]},{"osd":4,"last update":"Fri Apr 12 09:07:27 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":13.651,"5min":13.651,"15min":13.651},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-12T09:07:50.322 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-12T09:07:50.322 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-12T09:07:50.322 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-12T09:07:50.322 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph health --format=json 2024-04-12T09:07:50.575 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:07:50.983 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:50 smithi117 ceph-mon[29277]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:50.983 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:50 smithi117 ceph-mon[29277]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-12T09:07:51.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:50 smithi203 ceph-mon[36428]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:51.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:50 smithi203 ceph-mon[36428]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-12T09:07:52.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.127+0000 7f2e9d82f700 1 -- 172.21.15.117:0/3390226562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e98103780 msgr2=0x7f2e980fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:52.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.127+0000 7f2e9d82f700 1 --2- 172.21.15.117:0/3390226562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e98103780 0x7f2e980fcdf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c004940 tx=0x7f2e8c009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:52.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.127+0000 7f2e9d82f700 1 -- 172.21.15.117:0/3390226562 shutdown_connections 2024-04-12T09:07:52.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.127+0000 7f2e9d82f700 1 --2- 172.21.15.117:0/3390226562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e98103780 0x7f2e980fcdf0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:52.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.127+0000 7f2e9d82f700 1 --2- 172.21.15.117:0/3390226562 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e98102de0 0x7f2e981031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:52.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.127+0000 7f2e9d82f700 1 -- 172.21.15.117:0/3390226562 >> 172.21.15.117:0/3390226562 conn(0x7f2e980f8950 msgr2=0x7f2e980fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:52.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.127+0000 7f2e9d82f700 1 -- 172.21.15.117:0/3390226562 shutdown_connections 2024-04-12T09:07:52.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.127+0000 7f2e9d82f700 1 -- 172.21.15.117:0/3390226562 wait complete. 2024-04-12T09:07:52.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.128+0000 7f2e9d82f700 1 Processor -- start 2024-04-12T09:07:52.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.128+0000 7f2e9d82f700 1 -- start start 2024-04-12T09:07:52.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.128+0000 7f2e9d82f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e98102de0 0x7f2e98113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:52.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.128+0000 7f2e9d82f700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e98103780 0x7f2e98113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:52.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.128+0000 7f2e9d82f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e98114500 con 0x7f2e98102de0 2024-04-12T09:07:52.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.128+0000 7f2e9d82f700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9810db00 con 0x7f2e98103780 2024-04-12T09:07:52.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.128+0000 7f2e96ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e98102de0 0x7f2e98113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:52.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.128+0000 7f2e96ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e98102de0 0x7f2e98113970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39276/0 (socket says 172.21.15.117:39276) 2024-04-12T09:07:52.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.128+0000 7f2e96ffd700 1 -- 172.21.15.117:0/747996268 learned_addr learned my addr 172.21.15.117:0/747996268 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:07:52.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.128+0000 7f2e967fc700 1 --2- 172.21.15.117:0/747996268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e98103780 0x7f2e98113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:52.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.129+0000 7f2e96ffd700 1 -- 172.21.15.117:0/747996268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e98103780 msgr2=0x7f2e98113eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:52.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.129+0000 7f2e96ffd700 1 --2- 172.21.15.117:0/747996268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e98103780 0x7f2e98113eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:52.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.129+0000 7f2e96ffd700 1 -- 172.21.15.117:0/747996268 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c005040 con 0x7f2e98102de0 2024-04-12T09:07:52.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.129+0000 7f2e96ffd700 1 --2- 172.21.15.117:0/747996268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e98102de0 0x7f2e98113970 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800c8c0 tx=0x7f2e880044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:52.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.129+0000 7f2e7f7fe700 1 -- 172.21.15.117:0/747996268 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e8800a980 con 0x7f2e98102de0 2024-04-12T09:07:52.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.129+0000 7f2e7f7fe700 1 -- 172.21.15.117:0/747996268 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2e8800ce60 con 0x7f2e98102de0 2024-04-12T09:07:52.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.129+0000 7f2e7f7fe700 1 -- 172.21.15.117:0/747996268 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e880115e0 con 0x7f2e98102de0 2024-04-12T09:07:52.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.129+0000 7f2e9d82f700 1 -- 172.21.15.117:0/747996268 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9810dde0 con 0x7f2e98102de0 2024-04-12T09:07:52.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.129+0000 7f2e9d82f700 1 -- 172.21.15.117:0/747996268 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9810e350 con 0x7f2e98102de0 2024-04-12T09:07:52.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.130+0000 7f2e9d82f700 1 -- 172.21.15.117:0/747996268 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e980fe530 con 0x7f2e98102de0 2024-04-12T09:07:52.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.130+0000 7f2e7f7fe700 1 -- 172.21.15.117:0/747996268 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f2e88011740 con 0x7f2e98102de0 2024-04-12T09:07:52.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.131+0000 7f2e7f7fe700 1 --2- 172.21.15.117:0/747996268 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f2e800692a0 0x7f2e8006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:52.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.131+0000 7f2e7f7fe700 1 -- 172.21.15.117:0/747996268 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2e88086f30 con 0x7f2e98102de0 2024-04-12T09:07:52.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.131+0000 7f2e967fc700 1 --2- 172.21.15.117:0/747996268 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f2e800692a0 0x7f2e8006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:52.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.131+0000 7f2e967fc700 1 --2- 172.21.15.117:0/747996268 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f2e800692a0 0x7f2e8006b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2e9810ecc0 tx=0x7f2e8c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:52.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.135+0000 7f2e7f7fe700 1 -- 172.21.15.117:0/747996268 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f2e88057030 con 0x7f2e98102de0 2024-04-12T09:07:52.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.361+0000 7f2e9d82f700 1 -- 172.21.15.117:0/747996268 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2e98109ec0 con 0x7f2e98102de0 2024-04-12T09:07:52.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.361+0000 7f2e7f7fe700 1 -- 172.21.15.117:0/747996268 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f2e88056bc0 con 0x7f2e98102de0 2024-04-12T09:07:52.363 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:07:52.363 INFO:teuthology.orchestra.run.smithi117.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-12T09:07:52.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.363+0000 7f2e9d82f700 1 -- 172.21.15.117:0/747996268 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f2e800692a0 msgr2=0x7f2e8006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:52.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.363+0000 7f2e9d82f700 1 --2- 172.21.15.117:0/747996268 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f2e800692a0 0x7f2e8006b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2e9810ecc0 tx=0x7f2e8c009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:52.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.363+0000 7f2e9d82f700 1 -- 172.21.15.117:0/747996268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e98102de0 msgr2=0x7f2e98113970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:52.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.363+0000 7f2e9d82f700 1 --2- 172.21.15.117:0/747996268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e98102de0 0x7f2e98113970 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800c8c0 tx=0x7f2e880044c0 comp rx=0 tx=0).stop 2024-04-12T09:07:52.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.363+0000 7f2e9d82f700 1 -- 172.21.15.117:0/747996268 shutdown_connections 2024-04-12T09:07:52.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.363+0000 7f2e9d82f700 1 --2- 172.21.15.117:0/747996268 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f2e800692a0 0x7f2e8006b750 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:52.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.363+0000 7f2e9d82f700 1 --2- 172.21.15.117:0/747996268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e98102de0 0x7f2e98113970 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:52.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.363+0000 7f2e9d82f700 1 --2- 172.21.15.117:0/747996268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e98103780 0x7f2e98113eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:52.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.363+0000 7f2e9d82f700 1 -- 172.21.15.117:0/747996268 >> 172.21.15.117:0/747996268 conn(0x7f2e980f8950 msgr2=0x7f2e980f98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:52.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.363+0000 7f2e9d82f700 1 -- 172.21.15.117:0/747996268 shutdown_connections 2024-04-12T09:07:52.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:52.363+0000 7f2e9d82f700 1 -- 172.21.15.117:0/747996268 wait complete. 2024-04-12T09:07:52.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:52 smithi117 ceph-mon[29277]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:52.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:52 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/747996268' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-12T09:07:53.060 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-12T09:07:53.060 INFO:tasks.cephadm:Setup complete, yielding 2024-04-12T09:07:53.060 INFO:teuthology.run_tasks:Running task print... 2024-04-12T09:07:53.075 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-04-12T09:07:53.075 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-12T09:07:53.100 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi117.front.sepia.ceph.com 2024-04-12T09:07:53.101 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-04-12T09:07:53.102 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:52 smithi203 ceph-mon[36428]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:53.102 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:52 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/747996268' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-12T09:07:53.369 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:07:54.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.947+0000 7f84a1e40700 1 -- 172.21.15.117:0/1167899885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f849c0fcf80 msgr2=0x7f849c0fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:54.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.947+0000 7f84a1e40700 1 --2- 172.21.15.117:0/1167899885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f849c0fcf80 0x7f849c0fd3f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f848c004940 tx=0x7f848c009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:54.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.947+0000 7f84a1e40700 1 -- 172.21.15.117:0/1167899885 shutdown_connections 2024-04-12T09:07:54.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.947+0000 7f84a1e40700 1 --2- 172.21.15.117:0/1167899885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f849c0fcf80 0x7f849c0fd3f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:54.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.947+0000 7f84a1e40700 1 --2- 172.21.15.117:0/1167899885 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f849c0fbcd0 0x7f849c0fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:54.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.947+0000 7f84a1e40700 1 -- 172.21.15.117:0/1167899885 >> 172.21.15.117:0/1167899885 conn(0x7f849c0f7430 msgr2=0x7f849c0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:54.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.947+0000 7f84a1e40700 1 -- 172.21.15.117:0/1167899885 shutdown_connections 2024-04-12T09:07:54.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.947+0000 7f84a1e40700 1 -- 172.21.15.117:0/1167899885 wait complete. 2024-04-12T09:07:54.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.948+0000 7f84a1e40700 1 Processor -- start 2024-04-12T09:07:54.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.948+0000 7f84a1e40700 1 -- start start 2024-04-12T09:07:54.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.948+0000 7f84a1e40700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f849c0fbcd0 0x7f849c110730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:54.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.948+0000 7f84a1e40700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f849c0fcf80 0x7f849c112c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:54.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.948+0000 7f84a1e40700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c0663e0 con 0x7f849c0fbcd0 2024-04-12T09:07:54.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.948+0000 7f84a1e40700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c066520 con 0x7f849c0fcf80 2024-04-12T09:07:54.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.948+0000 7f849b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f849c0fbcd0 0x7f849c110730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:54.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.948+0000 7f849b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f849c0fbcd0 0x7f849c110730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39290/0 (socket says 172.21.15.117:39290) 2024-04-12T09:07:54.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.948+0000 7f849b7fe700 1 -- 172.21.15.117:0/1305090244 learned_addr learned my addr 172.21.15.117:0/1305090244 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:07:54.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.948+0000 7f849affd700 1 --2- 172.21.15.117:0/1305090244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f849c0fcf80 0x7f849c112c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:54.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.949+0000 7f849b7fe700 1 -- 172.21.15.117:0/1305090244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f849c0fcf80 msgr2=0x7f849c112c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:54.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.949+0000 7f849b7fe700 1 --2- 172.21.15.117:0/1305090244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f849c0fcf80 0x7f849c112c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:54.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.949+0000 7f849b7fe700 1 -- 172.21.15.117:0/1305090244 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848c005040 con 0x7f849c0fbcd0 2024-04-12T09:07:54.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.949+0000 7f849b7fe700 1 --2- 172.21.15.117:0/1305090244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f849c0fbcd0 0x7f849c110730 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f849000b790 tx=0x7f8490009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:54.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.949+0000 7f8483fff700 1 -- 172.21.15.117:0/1305090244 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f849000f6f0 con 0x7f849c0fbcd0 2024-04-12T09:07:54.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.949+0000 7f84a1e40700 1 -- 172.21.15.117:0/1305090244 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f849c1132e0 con 0x7f849c0fbcd0 2024-04-12T09:07:54.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.949+0000 7f8483fff700 1 -- 172.21.15.117:0/1305090244 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f849000fd20 con 0x7f849c0fbcd0 2024-04-12T09:07:54.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.949+0000 7f8483fff700 1 -- 172.21.15.117:0/1305090244 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84900103a0 con 0x7f849c0fbcd0 2024-04-12T09:07:54.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.949+0000 7f84a1e40700 1 -- 172.21.15.117:0/1305090244 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849c113870 con 0x7f849c0fbcd0 2024-04-12T09:07:54.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.950+0000 7f84a1e40700 1 -- 172.21.15.117:0/1305090244 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f849c05f5f0 con 0x7f849c0fbcd0 2024-04-12T09:07:54.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.950+0000 7f8483fff700 1 -- 172.21.15.117:0/1305090244 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f8490011400 con 0x7f849c0fbcd0 2024-04-12T09:07:54.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.951+0000 7f8483fff700 1 --2- 172.21.15.117:0/1305090244 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f84840692a0 0x7f848406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:54.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.951+0000 7f849affd700 1 --2- 172.21.15.117:0/1305090244 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f84840692a0 0x7f848406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:54.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.951+0000 7f8483fff700 1 -- 172.21.15.117:0/1305090244 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8490086c30 con 0x7f849c0fbcd0 2024-04-12T09:07:54.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.951+0000 7f849affd700 1 --2- 172.21.15.117:0/1305090244 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f84840692a0 0x7f848406b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f848c00b970 tx=0x7f848c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:54.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:54.955+0000 7f8483fff700 1 -- 172.21.15.117:0/1305090244 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f84900532a0 con 0x7f849c0fbcd0 2024-04-12T09:07:55.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:54 smithi203 ceph-mon[36428]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:07:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:07:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:07:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:54 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:07:55.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:55.139+0000 7f84a1e40700 1 -- 172.21.15.117:0/1305090244 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f849c04bed0 con 0x7f849c0fbcd0 2024-04-12T09:07:55.140 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:54 smithi117 ceph-mon[29277]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:55.141 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:54 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:07:55.141 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:54 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:07:55.141 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:54 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:07:55.141 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:54 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:07:55.144 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:55.144+0000 7f8483fff700 1 -- 172.21.15.117:0/1305090244 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f84900568c0 con 0x7f849c0fbcd0 2024-04-12T09:07:55.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:55.146+0000 7f84a1e40700 1 -- 172.21.15.117:0/1305090244 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f84840692a0 msgr2=0x7f848406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:55.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:55.146+0000 7f84a1e40700 1 --2- 172.21.15.117:0/1305090244 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f84840692a0 0x7f848406b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f848c00b970 tx=0x7f848c009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:55.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:55.146+0000 7f84a1e40700 1 -- 172.21.15.117:0/1305090244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f849c0fbcd0 msgr2=0x7f849c110730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:55.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:55.146+0000 7f84a1e40700 1 --2- 172.21.15.117:0/1305090244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f849c0fbcd0 0x7f849c110730 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f849000b790 tx=0x7f8490009250 comp rx=0 tx=0).stop 2024-04-12T09:07:55.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:55.146+0000 7f84a1e40700 1 -- 172.21.15.117:0/1305090244 shutdown_connections 2024-04-12T09:07:55.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:55.146+0000 7f84a1e40700 1 --2- 172.21.15.117:0/1305090244 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f84840692a0 0x7f848406b750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:55.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:55.146+0000 7f84a1e40700 1 --2- 172.21.15.117:0/1305090244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f849c0fbcd0 0x7f849c110730 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:55.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:55.146+0000 7f84a1e40700 1 --2- 172.21.15.117:0/1305090244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f849c0fcf80 0x7f849c112c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:55.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:55.146+0000 7f84a1e40700 1 -- 172.21.15.117:0/1305090244 >> 172.21.15.117:0/1305090244 conn(0x7f849c0f7430 msgr2=0x7f849c0f8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:55.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:55.146+0000 7f84a1e40700 1 -- 172.21.15.117:0/1305090244 shutdown_connections 2024-04-12T09:07:55.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:55.146+0000 7f84a1e40700 1 -- 172.21.15.117:0/1305090244 wait complete. 2024-04-12T09:07:55.765 INFO:teuthology.run_tasks:Running task print... 2024-04-12T09:07:55.774 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-04-12T09:07:55.774 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-12T09:07:55.789 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi117.front.sepia.ceph.com 2024-04-12T09:07:55.790 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- bash -c 'ceph orch status' 2024-04-12T09:07:56.044 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:07:56.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:56 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/1305090244' entity='client.admin' 2024-04-12T09:07:56.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:56 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:07:56.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:56 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:07:56.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:56 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:07:56.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:56 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:07:56.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:56 smithi117 ceph-mon[29277]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:56.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:56 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/1305090244' entity='client.admin' 2024-04-12T09:07:56.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:56 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:07:56.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:56 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:07:56.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:56 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:07:56.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:56 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:07:56.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:56 smithi203 ceph-mon[36428]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:57.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.605+0000 7fc6aaac9700 1 -- 172.21.15.117:0/3077252083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a40fdfe0 msgr2=0x7fc6a40fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:57.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.605+0000 7fc6aaac9700 1 --2- 172.21.15.117:0/3077252083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a40fdfe0 0x7fc6a40fe450 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc690004940 tx=0x7fc690009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:57.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.605+0000 7fc6aaac9700 1 -- 172.21.15.117:0/3077252083 shutdown_connections 2024-04-12T09:07:57.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.605+0000 7fc6aaac9700 1 --2- 172.21.15.117:0/3077252083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a40fdfe0 0x7fc6a40fe450 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:57.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.605+0000 7fc6aaac9700 1 --2- 172.21.15.117:0/3077252083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6a40fce70 0x7fc6a40fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:57.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.605+0000 7fc6aaac9700 1 -- 172.21.15.117:0/3077252083 >> 172.21.15.117:0/3077252083 conn(0x7fc6a40f8550 msgr2=0x7fc6a40fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:57.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.605+0000 7fc6aaac9700 1 -- 172.21.15.117:0/3077252083 shutdown_connections 2024-04-12T09:07:57.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.605+0000 7fc6aaac9700 1 -- 172.21.15.117:0/3077252083 wait complete. 2024-04-12T09:07:57.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.606+0000 7fc6aaac9700 1 Processor -- start 2024-04-12T09:07:57.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.606+0000 7fc6aaac9700 1 -- start start 2024-04-12T09:07:57.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.606+0000 7fc6aaac9700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6a40fce70 0x7fc6a410d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:57.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.606+0000 7fc6aaac9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a40fdfe0 0x7fc6a410de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:57.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.606+0000 7fc6aaac9700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a410e460 con 0x7fc6a40fdfe0 2024-04-12T09:07:57.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.606+0000 7fc6aaac9700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a410e5d0 con 0x7fc6a40fce70 2024-04-12T09:07:57.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.606+0000 7fc6a3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a40fdfe0 0x7fc6a410de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:57.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.606+0000 7fc6a3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a40fdfe0 0x7fc6a410de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39296/0 (socket says 172.21.15.117:39296) 2024-04-12T09:07:57.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.606+0000 7fc6a3fff700 1 -- 172.21.15.117:0/2875252085 learned_addr learned my addr 172.21.15.117:0/2875252085 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:07:57.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.606+0000 7fc6a8865700 1 --2- 172.21.15.117:0/2875252085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6a40fce70 0x7fc6a410d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:57.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.606+0000 7fc6a3fff700 1 -- 172.21.15.117:0/2875252085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6a40fce70 msgr2=0x7fc6a410d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:57.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.606+0000 7fc6a3fff700 1 --2- 172.21.15.117:0/2875252085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6a40fce70 0x7fc6a410d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:57.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.606+0000 7fc6a3fff700 1 -- 172.21.15.117:0/2875252085 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc690005040 con 0x7fc6a40fdfe0 2024-04-12T09:07:57.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.607+0000 7fc6a3fff700 1 --2- 172.21.15.117:0/2875252085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a40fdfe0 0x7fc6a410de60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc69000b3b0 tx=0x7fc690009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:57.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.607+0000 7fc6a17fa700 1 -- 172.21.15.117:0/2875252085 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc69000e040 con 0x7fc6a40fdfe0 2024-04-12T09:07:57.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.607+0000 7fc6aaac9700 1 -- 172.21.15.117:0/2875252085 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a4112fd0 con 0x7fc6a40fdfe0 2024-04-12T09:07:57.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.607+0000 7fc6a17fa700 1 -- 172.21.15.117:0/2875252085 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc69000bbf0 con 0x7fc6a40fdfe0 2024-04-12T09:07:57.609 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.607+0000 7fc6a17fa700 1 -- 172.21.15.117:0/2875252085 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc69001c630 con 0x7fc6a40fdfe0 2024-04-12T09:07:57.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.607+0000 7fc6aaac9700 1 -- 172.21.15.117:0/2875252085 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a4113560 con 0x7fc6a40fdfe0 2024-04-12T09:07:57.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.608+0000 7fc6aaac9700 1 -- 172.21.15.117:0/2875252085 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a404c710 con 0x7fc6a40fdfe0 2024-04-12T09:07:57.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.608+0000 7fc6a17fa700 1 -- 172.21.15.117:0/2875252085 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fc69000bd60 con 0x7fc6a40fdfe0 2024-04-12T09:07:57.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.609+0000 7fc6a17fa700 1 --2- 172.21.15.117:0/2875252085 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc6940692a0 0x7fc69406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:07:57.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.609+0000 7fc6a17fa700 1 -- 172.21.15.117:0/2875252085 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc690087b40 con 0x7fc6a40fdfe0 2024-04-12T09:07:57.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.609+0000 7fc6a8865700 1 --2- 172.21.15.117:0/2875252085 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc6940692a0 0x7fc69406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:07:57.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.609+0000 7fc6a8865700 1 --2- 172.21.15.117:0/2875252085 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc6940692a0 0x7fc69406b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc698004f40 tx=0x7fc69800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:07:57.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.613+0000 7fc6a17fa700 1 -- 172.21.15.117:0/2875252085 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fc690057c40 con 0x7fc6a40fdfe0 2024-04-12T09:07:57.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.815+0000 7fc6aaac9700 1 -- 172.21.15.117:0/2875252085 --> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6a41023a0 con 0x7fc6940692a0 2024-04-12T09:07:57.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.816+0000 7fc6a17fa700 1 -- 172.21.15.117:0/2875252085 <== mgr.14214 v2:172.21.15.117:6800/3945342300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fc6a41023a0 con 0x7fc6940692a0 2024-04-12T09:07:57.817 INFO:teuthology.orchestra.run.smithi117.stdout:Backend: cephadm 2024-04-12T09:07:57.817 INFO:teuthology.orchestra.run.smithi117.stdout:Available: Yes 2024-04-12T09:07:57.818 INFO:teuthology.orchestra.run.smithi117.stdout:Paused: No 2024-04-12T09:07:57.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.818+0000 7fc6aaac9700 1 -- 172.21.15.117:0/2875252085 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc6940692a0 msgr2=0x7fc69406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:57.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.818+0000 7fc6aaac9700 1 --2- 172.21.15.117:0/2875252085 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc6940692a0 0x7fc69406b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc698004f40 tx=0x7fc69800b040 comp rx=0 tx=0).stop 2024-04-12T09:07:57.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.818+0000 7fc6aaac9700 1 -- 172.21.15.117:0/2875252085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a40fdfe0 msgr2=0x7fc6a410de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:07:57.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.818+0000 7fc6aaac9700 1 --2- 172.21.15.117:0/2875252085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a40fdfe0 0x7fc6a410de60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc69000b3b0 tx=0x7fc690009e30 comp rx=0 tx=0).stop 2024-04-12T09:07:57.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.818+0000 7fc6aaac9700 1 -- 172.21.15.117:0/2875252085 shutdown_connections 2024-04-12T09:07:57.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.818+0000 7fc6aaac9700 1 --2- 172.21.15.117:0/2875252085 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc6940692a0 0x7fc69406b750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:57.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.818+0000 7fc6aaac9700 1 --2- 172.21.15.117:0/2875252085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6a40fce70 0x7fc6a410d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:57.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.818+0000 7fc6aaac9700 1 --2- 172.21.15.117:0/2875252085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6a40fdfe0 0x7fc6a410de60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:07:57.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.818+0000 7fc6aaac9700 1 -- 172.21.15.117:0/2875252085 >> 172.21.15.117:0/2875252085 conn(0x7fc6a40f8550 msgr2=0x7fc6a40f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:07:57.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.818+0000 7fc6aaac9700 1 -- 172.21.15.117:0/2875252085 shutdown_connections 2024-04-12T09:07:57.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:07:57.818+0000 7fc6aaac9700 1 -- 172.21.15.117:0/2875252085 wait complete. 2024-04-12T09:07:58.471 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-12T09:07:58.727 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:07:58.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:58 smithi203 ceph-mon[36428]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:58.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:07:58 smithi203 ceph-mon[36428]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:07:58.849 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:58 smithi117 ceph-mon[29277]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:07:58.849 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:07:58 smithi117 ceph-mon[29277]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:08:00.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.278+0000 7fcde6b72700 1 -- 172.21.15.117:0/1997029354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcde00fcf90 msgr2=0x7fcde00fd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:00.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.278+0000 7fcde6b72700 1 --2- 172.21.15.117:0/1997029354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcde00fcf90 0x7fcde00fd400 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc004940 tx=0x7fcdcc009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:00.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.278+0000 7fcde6b72700 1 -- 172.21.15.117:0/1997029354 shutdown_connections 2024-04-12T09:08:00.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.278+0000 7fcde6b72700 1 --2- 172.21.15.117:0/1997029354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcde00fcf90 0x7fcde00fd400 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:00.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.278+0000 7fcde6b72700 1 --2- 172.21.15.117:0/1997029354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcde00fbce0 0x7fcde00fc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:00.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.278+0000 7fcde6b72700 1 -- 172.21.15.117:0/1997029354 >> 172.21.15.117:0/1997029354 conn(0x7fcde00f7440 msgr2=0x7fcde00f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:00.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.278+0000 7fcde6b72700 1 -- 172.21.15.117:0/1997029354 shutdown_connections 2024-04-12T09:08:00.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.278+0000 7fcde6b72700 1 -- 172.21.15.117:0/1997029354 wait complete. 2024-04-12T09:08:00.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.278+0000 7fcde6b72700 1 Processor -- start 2024-04-12T09:08:00.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.278+0000 7fcde6b72700 1 -- start start 2024-04-12T09:08:00.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.279+0000 7fcde6b72700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcde00fbce0 0x7fcde010c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:00.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.279+0000 7fcde6b72700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcde00fcf90 0x7fcde010cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.279+0000 7fcde6b72700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde010d420 con 0x7fcde00fbce0 2024-04-12T09:08:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.279+0000 7fcde6b72700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde0111dc0 con 0x7fcde00fcf90 2024-04-12T09:08:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.279+0000 7fcde490e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcde00fbce0 0x7fcde010c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.279+0000 7fcde490e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcde00fbce0 0x7fcde010c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52242/0 (socket says 172.21.15.117:52242) 2024-04-12T09:08:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.279+0000 7fcde490e700 1 -- 172.21.15.117:0/4045074419 learned_addr learned my addr 172.21.15.117:0/4045074419 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:08:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.279+0000 7fcddffff700 1 --2- 172.21.15.117:0/4045074419 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcde00fcf90 0x7fcde010cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.279+0000 7fcde490e700 1 -- 172.21.15.117:0/4045074419 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcde00fcf90 msgr2=0x7fcde010cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.279+0000 7fcde490e700 1 --2- 172.21.15.117:0/4045074419 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcde00fcf90 0x7fcde010cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.279+0000 7fcde490e700 1 -- 172.21.15.117:0/4045074419 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc005040 con 0x7fcde00fbce0 2024-04-12T09:08:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.279+0000 7fcddffff700 1 --2- 172.21.15.117:0/4045074419 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcde00fcf90 0x7fcde010cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T09:08:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.279+0000 7fcde490e700 1 --2- 172.21.15.117:0/4045074419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcde00fbce0 0x7fcde010c850 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcdd400daf0 tx=0x7fcdd400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.280+0000 7fcddd7fa700 1 -- 172.21.15.117:0/4045074419 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdd400ed80 con 0x7fcde00fbce0 2024-04-12T09:08:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.280+0000 7fcddd7fa700 1 -- 172.21.15.117:0/4045074419 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcdd4017940 con 0x7fcde00fbce0 2024-04-12T09:08:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.280+0000 7fcddd7fa700 1 -- 172.21.15.117:0/4045074419 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdd4016a80 con 0x7fcde00fbce0 2024-04-12T09:08:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.280+0000 7fcde6b72700 1 -- 172.21.15.117:0/4045074419 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde0066350 con 0x7fcde00fbce0 2024-04-12T09:08:00.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.280+0000 7fcde6b72700 1 -- 172.21.15.117:0/4045074419 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde00668c0 con 0x7fcde00fbce0 2024-04-12T09:08:00.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.281+0000 7fcde6b72700 1 -- 172.21.15.117:0/4045074419 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde004c710 con 0x7fcde00fbce0 2024-04-12T09:08:00.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.281+0000 7fcddd7fa700 1 -- 172.21.15.117:0/4045074419 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fcdd4014070 con 0x7fcde00fbce0 2024-04-12T09:08:00.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.281+0000 7fcddd7fa700 1 --2- 172.21.15.117:0/4045074419 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fcdd00692a0 0x7fcdd006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:00.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.282+0000 7fcddd7fa700 1 -- 172.21.15.117:0/4045074419 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcdd4089030 con 0x7fcde00fbce0 2024-04-12T09:08:00.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.282+0000 7fcddffff700 1 --2- 172.21.15.117:0/4045074419 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fcdd00692a0 0x7fcdd006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:00.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.282+0000 7fcddffff700 1 --2- 172.21.15.117:0/4045074419 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fcdd00692a0 0x7fcdd006b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc00b970 tx=0x7fcdcc009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:00.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.286+0000 7fcddd7fa700 1 -- 172.21.15.117:0/4045074419 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fcdd40591e0 con 0x7fcde00fbce0 2024-04-12T09:08:00.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.484+0000 7fcde6b72700 1 -- 172.21.15.117:0/4045074419 --> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcde0067080 con 0x7fcdd00692a0 2024-04-12T09:08:00.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.492+0000 7fcddd7fa700 1 -- 172.21.15.117:0/4045074419 <== mgr.14214 v2:172.21.15.117:6800/3945342300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2700 (secure 0 0 0) 0x7fcde0067080 con 0x7fcdd00692a0 2024-04-12T09:08:00.493 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:08:00.493 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 running (3m) 2m ago 5m 25.7M - 0.25.0 c8568f914cd2 8fdf255143c1 2024-04-12T09:08:00.494 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (5m) 2m ago 5m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad 1e9f2c6a4491 2024-04-12T09:08:00.494 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (4m) 70s ago 4m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad e42da3f6e517 2024-04-12T09:08:00.494 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 running (3m) 2m ago 4m 78.4M - 9.4.7 954c08fa6188 80596fd1f615 2024-04-12T09:08:00.494 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:9283 running (6m) 2m ago 6m 472M - 17.2.7-827-gd3b5060a 21de9b7369ad cd0beaa7ece1 2024-04-12T09:08:00.494 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283 running (4m) 70s ago 4m 434M - 17.2.7-827-gd3b5060a 21de9b7369ad 2a913ba26232 2024-04-12T09:08:00.494 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (6m) 2m ago 6m 40.6M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad f9d5f7ac5270 2024-04-12T09:08:00.494 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (4m) 70s ago 4m 38.5M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad 17c0db49bb16 2024-04-12T09:08:00.494 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 running (5m) 2m ago 5m 15.6M - 1.5.0 0da6a335fe13 9fb7eb0eaa72 2024-04-12T09:08:00.494 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (4m) 70s ago 4m 17.2M - 1.5.0 0da6a335fe13 be0daeda3393 2024-04-12T09:08:00.494 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (3m) 2m ago 3m 39.9M 4288M 17.2.7-827-gd3b5060a 21de9b7369ad 77040a2498f3 2024-04-12T09:08:00.494 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (2m) 2m ago 2m 39.3M 4288M 17.2.7-827-gd3b5060a 21de9b7369ad 8f9dbf0274ed 2024-04-12T09:08:00.494 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (2m) 2m ago 2m 41.4M 4288M 17.2.7-827-gd3b5060a 21de9b7369ad 339c5a80d1dd 2024-04-12T09:08:00.495 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (2m) 70s ago 2m 41.3M 5312M 17.2.7-827-gd3b5060a 21de9b7369ad fb87d616bae3 2024-04-12T09:08:00.495 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (100s) 70s ago 99s 38.8M 5312M 17.2.7-827-gd3b5060a 21de9b7369ad c873826a2dea 2024-04-12T09:08:00.495 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (75s) 70s ago 74s 12.7M 5312M 17.2.7-827-gd3b5060a 21de9b7369ad 69cb7c22f002 2024-04-12T09:08:00.495 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 running (3m) 2m ago 4m 37.9M - 2.43.0 a07b618ecd1d 2799a65eed76 2024-04-12T09:08:00.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.494+0000 7fcde6b72700 1 -- 172.21.15.117:0/4045074419 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fcdd00692a0 msgr2=0x7fcdd006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:00.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.494+0000 7fcde6b72700 1 --2- 172.21.15.117:0/4045074419 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fcdd00692a0 0x7fcdd006b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc00b970 tx=0x7fcdcc009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:00.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.494+0000 7fcde6b72700 1 -- 172.21.15.117:0/4045074419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcde00fbce0 msgr2=0x7fcde010c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:00.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.494+0000 7fcde6b72700 1 --2- 172.21.15.117:0/4045074419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcde00fbce0 0x7fcde010c850 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcdd400daf0 tx=0x7fcdd400b4f0 comp rx=0 tx=0).stop 2024-04-12T09:08:00.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.495+0000 7fcde6b72700 1 -- 172.21.15.117:0/4045074419 shutdown_connections 2024-04-12T09:08:00.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.495+0000 7fcde6b72700 1 --2- 172.21.15.117:0/4045074419 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fcdd00692a0 0x7fcdd006b750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:00.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.495+0000 7fcde6b72700 1 --2- 172.21.15.117:0/4045074419 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcde00fbce0 0x7fcde010c850 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:00.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.495+0000 7fcde6b72700 1 --2- 172.21.15.117:0/4045074419 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcde00fcf90 0x7fcde010cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:00.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.495+0000 7fcde6b72700 1 -- 172.21.15.117:0/4045074419 >> 172.21.15.117:0/4045074419 conn(0x7fcde00f7440 msgr2=0x7fcde00f8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:00.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.495+0000 7fcde6b72700 1 -- 172.21.15.117:0/4045074419 shutdown_connections 2024-04-12T09:08:00.496 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:00.495+0000 7fcde6b72700 1 -- 172.21.15.117:0/4045074419 wait complete. 2024-04-12T09:08:00.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:00 smithi117 ceph-mon[29277]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:08:00.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:00 smithi203 ceph-mon[36428]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:08:01.159 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-12T09:08:01.419 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:08:01.725 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:01 smithi203 ceph-mon[36428]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:08:01.725 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:01 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:08:01.736 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:01 smithi117 ceph-mon[29277]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:08:01.737 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:01 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:08:02.731 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:02 smithi117 ceph-mon[29277]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:08:02.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:02 smithi203 ceph-mon[36428]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:08:02.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.932+0000 7fd388a4c700 1 -- 172.21.15.117:0/2520124002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3840fbcd0 msgr2=0x7fd3840fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:02.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.932+0000 7fd388a4c700 1 --2- 172.21.15.117:0/2520124002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3840fbcd0 0x7fd3840fc0e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd37c009ce0 tx=0x7fd37c004d10 comp rx=0 tx=0).stop 2024-04-12T09:08:02.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.932+0000 7fd388a4c700 1 -- 172.21.15.117:0/2520124002 shutdown_connections 2024-04-12T09:08:02.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.932+0000 7fd388a4c700 1 --2- 172.21.15.117:0/2520124002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3840fcf80 0x7fd3840fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:02.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.932+0000 7fd388a4c700 1 --2- 172.21.15.117:0/2520124002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3840fbcd0 0x7fd3840fc0e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:02.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.932+0000 7fd388a4c700 1 -- 172.21.15.117:0/2520124002 >> 172.21.15.117:0/2520124002 conn(0x7fd3840f7430 msgr2=0x7fd3840f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:02.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.932+0000 7fd388a4c700 1 -- 172.21.15.117:0/2520124002 shutdown_connections 2024-04-12T09:08:02.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.932+0000 7fd388a4c700 1 -- 172.21.15.117:0/2520124002 wait complete. 2024-04-12T09:08:02.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.933+0000 7fd388a4c700 1 Processor -- start 2024-04-12T09:08:02.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.933+0000 7fd388a4c700 1 -- start start 2024-04-12T09:08:02.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.933+0000 7fd388a4c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3840fbcd0 0x7fd38410ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:02.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.933+0000 7fd388a4c700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3840fcf80 0x7fd38410cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:02.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.933+0000 7fd388a4c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38410d5b0 con 0x7fd3840fbcd0 2024-04-12T09:08:02.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.933+0000 7fd388a4c700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38410de00 con 0x7fd3840fcf80 2024-04-12T09:08:02.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.933+0000 7fd38259c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3840fbcd0 0x7fd38410ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:02.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.933+0000 7fd38259c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3840fbcd0 0x7fd38410ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52260/0 (socket says 172.21.15.117:52260) 2024-04-12T09:08:02.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.933+0000 7fd38259c700 1 -- 172.21.15.117:0/2759595081 learned_addr learned my addr 172.21.15.117:0/2759595081 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:08:02.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.933+0000 7fd381d9b700 1 --2- 172.21.15.117:0/2759595081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3840fcf80 0x7fd38410cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:02.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.933+0000 7fd38259c700 1 -- 172.21.15.117:0/2759595081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3840fcf80 msgr2=0x7fd38410cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:02.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.933+0000 7fd38259c700 1 --2- 172.21.15.117:0/2759595081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3840fcf80 0x7fd38410cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:02.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.933+0000 7fd38259c700 1 -- 172.21.15.117:0/2759595081 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c009940 con 0x7fd3840fbcd0 2024-04-12T09:08:02.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.933+0000 7fd38259c700 1 --2- 172.21.15.117:0/2759595081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3840fbcd0 0x7fd38410ca70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd37c009380 tx=0x7fd37c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:02.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.934+0000 7fd372ffd700 1 -- 172.21.15.117:0/2759595081 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd37c00e040 con 0x7fd3840fbcd0 2024-04-12T09:08:02.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.934+0000 7fd388a4c700 1 -- 172.21.15.117:0/2759595081 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd38410e080 con 0x7fd3840fbcd0 2024-04-12T09:08:02.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.934+0000 7fd372ffd700 1 -- 172.21.15.117:0/2759595081 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd37c0128e0 con 0x7fd3840fbcd0 2024-04-12T09:08:02.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.934+0000 7fd372ffd700 1 -- 172.21.15.117:0/2759595081 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd37c01c930 con 0x7fd3840fbcd0 2024-04-12T09:08:02.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.934+0000 7fd388a4c700 1 -- 172.21.15.117:0/2759595081 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38410e5c0 con 0x7fd3840fbcd0 2024-04-12T09:08:02.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.935+0000 7fd388a4c700 1 -- 172.21.15.117:0/2759595081 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd38405f5f0 con 0x7fd3840fbcd0 2024-04-12T09:08:02.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.935+0000 7fd372ffd700 1 -- 172.21.15.117:0/2759595081 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fd37c012a50 con 0x7fd3840fbcd0 2024-04-12T09:08:02.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.935+0000 7fd372ffd700 1 --2- 172.21.15.117:0/2759595081 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fd36c0692a0 0x7fd36c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:02.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.935+0000 7fd372ffd700 1 -- 172.21.15.117:0/2759595081 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd37c0889c0 con 0x7fd3840fbcd0 2024-04-12T09:08:02.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.935+0000 7fd381d9b700 1 --2- 172.21.15.117:0/2759595081 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fd36c0692a0 0x7fd36c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:02.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.936+0000 7fd381d9b700 1 --2- 172.21.15.117:0/2759595081 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fd36c0692a0 0x7fd36c06b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd378004f40 tx=0x7fd37800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:02.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:02.940+0000 7fd372ffd700 1 -- 172.21.15.117:0/2759595081 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fd37c058a40 con 0x7fd3840fbcd0 2024-04-12T09:08:03.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:03.135+0000 7fd388a4c700 1 -- 172.21.15.117:0/2759595081 --> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd38410e8a0 con 0x7fd36c0692a0 2024-04-12T09:08:03.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:03.139+0000 7fd372ffd700 1 -- 172.21.15.117:0/2759595081 <== mgr.14214 v2:172.21.15.117:6800/3945342300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1179 (secure 0 0 0) 0x7fd38410e8a0 con 0x7fd36c0692a0 2024-04-12T09:08:03.140 INFO:teuthology.orchestra.run.smithi117.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-12T09:08:03.140 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-04-12T09:08:03.140 INFO:teuthology.orchestra.run.smithi117.stdout:crash 2/2 2m ago 5m * 2024-04-12T09:08:03.140 INFO:teuthology.orchestra.run.smithi117.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-04-12T09:08:03.140 INFO:teuthology.orchestra.run.smithi117.stdout:mgr 2/2 2m ago 6m count:2 2024-04-12T09:08:03.140 INFO:teuthology.orchestra.run.smithi117.stdout:mon 2/2 2m ago 5m smithi117:172.21.15.117=smithi117;smithi203:172.21.15.203=smithi203;count:2 2024-04-12T09:08:03.140 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-04-12T09:08:03.140 INFO:teuthology.orchestra.run.smithi117.stdout:osd 6 2m ago - 2024-04-12T09:08:03.140 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-04-12T09:08:03.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:03.141+0000 7fd388a4c700 1 -- 172.21.15.117:0/2759595081 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fd36c0692a0 msgr2=0x7fd36c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:03.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:03.141+0000 7fd388a4c700 1 --2- 172.21.15.117:0/2759595081 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fd36c0692a0 0x7fd36c06b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd378004f40 tx=0x7fd37800b040 comp rx=0 tx=0).stop 2024-04-12T09:08:03.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:03.141+0000 7fd388a4c700 1 -- 172.21.15.117:0/2759595081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3840fbcd0 msgr2=0x7fd38410ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:03.142 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:03.141+0000 7fd388a4c700 1 --2- 172.21.15.117:0/2759595081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3840fbcd0 0x7fd38410ca70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd37c009380 tx=0x7fd37c004d10 comp rx=0 tx=0).stop 2024-04-12T09:08:03.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:03.141+0000 7fd388a4c700 1 -- 172.21.15.117:0/2759595081 shutdown_connections 2024-04-12T09:08:03.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:03.141+0000 7fd388a4c700 1 --2- 172.21.15.117:0/2759595081 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fd36c0692a0 0x7fd36c06b750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:03.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:03.141+0000 7fd388a4c700 1 --2- 172.21.15.117:0/2759595081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3840fbcd0 0x7fd38410ca70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:03.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:03.141+0000 7fd388a4c700 1 --2- 172.21.15.117:0/2759595081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3840fcf80 0x7fd38410cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:03.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:03.141+0000 7fd388a4c700 1 -- 172.21.15.117:0/2759595081 >> 172.21.15.117:0/2759595081 conn(0x7fd3840f7430 msgr2=0x7fd3840f8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:03.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:03.141+0000 7fd388a4c700 1 -- 172.21.15.117:0/2759595081 shutdown_connections 2024-04-12T09:08:03.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:03.141+0000 7fd388a4c700 1 -- 172.21.15.117:0/2759595081 wait complete. 2024-04-12T09:08:03.755 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-12T09:08:04.009 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:08:04.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:04 smithi117 ceph-mon[29277]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:08:04.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:04 smithi117 ceph-mon[29277]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:08:04.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:04 smithi203 ceph-mon[36428]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:08:04.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:04 smithi203 ceph-mon[36428]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:08:05.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.554+0000 7f49bffaf700 1 -- 172.21.15.117:0/647981654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49b80fc170 msgr2=0x7f49b80fc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:05.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.554+0000 7f49bffaf700 1 --2- 172.21.15.117:0/647981654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49b80fc170 0x7f49b80fc580 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f49b4004940 tx=0x7f49b4009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:05.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.554+0000 7f49bffaf700 1 -- 172.21.15.117:0/647981654 shutdown_connections 2024-04-12T09:08:05.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.554+0000 7f49bffaf700 1 --2- 172.21.15.117:0/647981654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49b80fcac0 0x7f49b80faed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:05.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.554+0000 7f49bffaf700 1 --2- 172.21.15.117:0/647981654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49b80fc170 0x7f49b80fc580 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:05.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.554+0000 7f49bffaf700 1 -- 172.21.15.117:0/647981654 >> 172.21.15.117:0/647981654 conn(0x7f49b80f6be0 msgr2=0x7f49b80f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:05.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.554+0000 7f49bffaf700 1 -- 172.21.15.117:0/647981654 shutdown_connections 2024-04-12T09:08:05.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.554+0000 7f49bffaf700 1 -- 172.21.15.117:0/647981654 wait complete. 2024-04-12T09:08:05.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.554+0000 7f49bffaf700 1 Processor -- start 2024-04-12T09:08:05.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.554+0000 7f49bffaf700 1 -- start start 2024-04-12T09:08:05.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.555+0000 7f49bffaf700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49b80fc170 0x7f49b8113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:05.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.555+0000 7f49bffaf700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49b80fcac0 0x7f49b81144e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:05.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.555+0000 7f49bffaf700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b8114ae0 con 0x7f49b80fc170 2024-04-12T09:08:05.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.555+0000 7f49bffaf700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b8114c50 con 0x7f49b80fcac0 2024-04-12T09:08:05.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.555+0000 7f49bdd4b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49b80fc170 0x7f49b8113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:05.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.555+0000 7f49bdd4b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49b80fc170 0x7f49b8113fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52286/0 (socket says 172.21.15.117:52286) 2024-04-12T09:08:05.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.555+0000 7f49bdd4b700 1 -- 172.21.15.117:0/1961744812 learned_addr learned my addr 172.21.15.117:0/1961744812 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:08:05.557 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.555+0000 7f49bd54a700 1 --2- 172.21.15.117:0/1961744812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49b80fcac0 0x7f49b81144e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:05.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.555+0000 7f49bdd4b700 1 -- 172.21.15.117:0/1961744812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49b80fcac0 msgr2=0x7f49b81144e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:05.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.555+0000 7f49bdd4b700 1 --2- 172.21.15.117:0/1961744812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49b80fcac0 0x7f49b81144e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:05.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.555+0000 7f49bdd4b700 1 -- 172.21.15.117:0/1961744812 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b4005040 con 0x7f49b80fc170 2024-04-12T09:08:05.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.555+0000 7f49bdd4b700 1 --2- 172.21.15.117:0/1961744812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49b80fc170 0x7f49b8113fa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f49b400b3b0 tx=0x7f49b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:05.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.555+0000 7f49ae7fc700 1 -- 172.21.15.117:0/1961744812 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49b400e040 con 0x7f49b80fc170 2024-04-12T09:08:05.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.555+0000 7f49ae7fc700 1 -- 172.21.15.117:0/1961744812 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f49b400bcc0 con 0x7f49b80fc170 2024-04-12T09:08:05.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.555+0000 7f49bffaf700 1 -- 172.21.15.117:0/1961744812 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b8119600 con 0x7f49b80fc170 2024-04-12T09:08:05.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.555+0000 7f49ae7fc700 1 -- 172.21.15.117:0/1961744812 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49b401c630 con 0x7f49b80fc170 2024-04-12T09:08:05.558 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.555+0000 7f49bffaf700 1 -- 172.21.15.117:0/1961744812 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b8119bc0 con 0x7f49b80fc170 2024-04-12T09:08:05.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.556+0000 7f49bffaf700 1 -- 172.21.15.117:0/1961744812 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b804c710 con 0x7f49b80fc170 2024-04-12T09:08:05.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.557+0000 7f49ae7fc700 1 -- 172.21.15.117:0/1961744812 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f49b4013420 con 0x7f49b80fc170 2024-04-12T09:08:05.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.557+0000 7f49ae7fc700 1 --2- 172.21.15.117:0/1961744812 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f49a40692a0 0x7f49a406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:05.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.557+0000 7f49ae7fc700 1 -- 172.21.15.117:0/1961744812 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f49b4087c90 con 0x7f49b80fc170 2024-04-12T09:08:05.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.557+0000 7f49bd54a700 1 --2- 172.21.15.117:0/1961744812 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f49a40692a0 0x7f49a406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:05.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.557+0000 7f49bd54a700 1 --2- 172.21.15.117:0/1961744812 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f49a40692a0 0x7f49a406b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f49a8004990 tx=0x7f49a8009ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:05.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.562+0000 7f49ae7fc700 1 -- 172.21.15.117:0/1961744812 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f49b4057d10 con 0x7f49b80fc170 2024-04-12T09:08:05.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.754+0000 7f49bffaf700 1 -- 172.21.15.117:0/1961744812 --> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f49b8100250 con 0x7f49a40692a0 2024-04-12T09:08:05.759 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.756+0000 7f49ae7fc700 1 -- 172.21.15.117:0/1961744812 <== mgr.14214 v2:172.21.15.117:6800/3945342300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f49b8100250 con 0x7f49a40692a0 2024-04-12T09:08:05.760 INFO:teuthology.orchestra.run.smithi117.stdout:HOST ADDR LABELS STATUS 2024-04-12T09:08:05.760 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117 172.21.15.117 2024-04-12T09:08:05.760 INFO:teuthology.orchestra.run.smithi117.stdout:smithi203 172.21.15.203 2024-04-12T09:08:05.760 INFO:teuthology.orchestra.run.smithi117.stdout:2 hosts in cluster 2024-04-12T09:08:05.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.758+0000 7f49bffaf700 1 -- 172.21.15.117:0/1961744812 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f49a40692a0 msgr2=0x7f49a406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:05.760 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.758+0000 7f49bffaf700 1 --2- 172.21.15.117:0/1961744812 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f49a40692a0 0x7f49a406b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f49a8004990 tx=0x7f49a8009ee0 comp rx=0 tx=0).stop 2024-04-12T09:08:05.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.758+0000 7f49bffaf700 1 -- 172.21.15.117:0/1961744812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49b80fc170 msgr2=0x7f49b8113fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:05.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.758+0000 7f49bffaf700 1 --2- 172.21.15.117:0/1961744812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49b80fc170 0x7f49b8113fa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f49b400b3b0 tx=0x7f49b4009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:05.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.758+0000 7f49bffaf700 1 -- 172.21.15.117:0/1961744812 shutdown_connections 2024-04-12T09:08:05.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.758+0000 7f49bffaf700 1 --2- 172.21.15.117:0/1961744812 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f49a40692a0 0x7f49a406b750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:05.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.758+0000 7f49bffaf700 1 --2- 172.21.15.117:0/1961744812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49b80fc170 0x7f49b8113fa0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:05.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.758+0000 7f49bffaf700 1 --2- 172.21.15.117:0/1961744812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49b80fcac0 0x7f49b81144e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:05.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.758+0000 7f49bffaf700 1 -- 172.21.15.117:0/1961744812 >> 172.21.15.117:0/1961744812 conn(0x7f49b80f6be0 msgr2=0x7f49b80f8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:05.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.758+0000 7f49bffaf700 1 -- 172.21.15.117:0/1961744812 shutdown_connections 2024-04-12T09:08:05.761 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:05.758+0000 7f49bffaf700 1 -- 172.21.15.117:0/1961744812 wait complete. 2024-04-12T09:08:06.470 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-12T09:08:06.723 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:08:06.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:06 smithi203 ceph-mon[36428]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:08:06.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:06 smithi203 ceph-mon[36428]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:08:06.844 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:06 smithi117 ceph-mon[29277]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:08:06.844 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:06 smithi117 ceph-mon[29277]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:08:08.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.335+0000 7fec9fcc7700 1 -- 172.21.15.117:0/357399606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec980fcc20 msgr2=0x7fec980fd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:08.337 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.335+0000 7fec9fcc7700 1 --2- 172.21.15.117:0/357399606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec980fcc20 0x7fec980fd090 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fec94004940 tx=0x7fec94009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:08.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.335+0000 7fec9fcc7700 1 -- 172.21.15.117:0/357399606 shutdown_connections 2024-04-12T09:08:08.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.335+0000 7fec9fcc7700 1 --2- 172.21.15.117:0/357399606 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec980fcc20 0x7fec980fd090 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:08.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.335+0000 7fec9fcc7700 1 --2- 172.21.15.117:0/357399606 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec980fc2d0 0x7fec980fc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:08.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.335+0000 7fec9fcc7700 1 -- 172.21.15.117:0/357399606 >> 172.21.15.117:0/357399606 conn(0x7fec980f6ba0 msgr2=0x7fec980f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:08.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.335+0000 7fec9fcc7700 1 -- 172.21.15.117:0/357399606 shutdown_connections 2024-04-12T09:08:08.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.335+0000 7fec9fcc7700 1 -- 172.21.15.117:0/357399606 wait complete. 2024-04-12T09:08:08.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.335+0000 7fec9fcc7700 1 Processor -- start 2024-04-12T09:08:08.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.335+0000 7fec9fcc7700 1 -- start start 2024-04-12T09:08:08.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.336+0000 7fec9fcc7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec980fc2d0 0x7fec9810da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:08.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.336+0000 7fec9fcc7700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec980fcc20 0x7fec9810df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:08.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.336+0000 7fec9fcc7700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9810e570 con 0x7fec980fc2d0 2024-04-12T09:08:08.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.336+0000 7fec9fcc7700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9810edc0 con 0x7fec980fcc20 2024-04-12T09:08:08.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.336+0000 7fec9da63700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec980fc2d0 0x7fec9810da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:08.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.336+0000 7fec9da63700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec980fc2d0 0x7fec9810da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:52308/0 (socket says 172.21.15.117:52308) 2024-04-12T09:08:08.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.336+0000 7fec9da63700 1 -- 172.21.15.117:0/1955017581 learned_addr learned my addr 172.21.15.117:0/1955017581 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:08:08.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.336+0000 7fec9d262700 1 --2- 172.21.15.117:0/1955017581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec980fcc20 0x7fec9810df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:08.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.336+0000 7fec9da63700 1 -- 172.21.15.117:0/1955017581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec980fcc20 msgr2=0x7fec9810df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:08.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.336+0000 7fec9da63700 1 --2- 172.21.15.117:0/1955017581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec980fcc20 0x7fec9810df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:08.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.336+0000 7fec9da63700 1 -- 172.21.15.117:0/1955017581 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec94005040 con 0x7fec980fc2d0 2024-04-12T09:08:08.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.336+0000 7fec9da63700 1 --2- 172.21.15.117:0/1955017581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec980fc2d0 0x7fec9810da30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fec8800c830 tx=0x7fec88004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:08.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.336+0000 7fec8e7fc700 1 -- 172.21.15.117:0/1955017581 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec8800a760 con 0x7fec980fc2d0 2024-04-12T09:08:08.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.336+0000 7fec8e7fc700 1 -- 172.21.15.117:0/1955017581 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec8800ad90 con 0x7fec980fc2d0 2024-04-12T09:08:08.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.336+0000 7fec9fcc7700 1 -- 172.21.15.117:0/1955017581 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9810f0a0 con 0x7fec980fc2d0 2024-04-12T09:08:08.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.336+0000 7fec8e7fc700 1 -- 172.21.15.117:0/1955017581 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec880113a0 con 0x7fec980fc2d0 2024-04-12T09:08:08.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.336+0000 7fec9fcc7700 1 -- 172.21.15.117:0/1955017581 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9810f5e0 con 0x7fec980fc2d0 2024-04-12T09:08:08.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.337+0000 7fec9fcc7700 1 -- 172.21.15.117:0/1955017581 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec98101c20 con 0x7fec980fc2d0 2024-04-12T09:08:08.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.338+0000 7fec8e7fc700 1 -- 172.21.15.117:0/1955017581 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fec88012400 con 0x7fec980fc2d0 2024-04-12T09:08:08.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.338+0000 7fec8e7fc700 1 --2- 172.21.15.117:0/1955017581 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fec840692a0 0x7fec8406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:08.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.338+0000 7fec8e7fc700 1 -- 172.21.15.117:0/1955017581 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fec88086e90 con 0x7fec980fc2d0 2024-04-12T09:08:08.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.338+0000 7fec9d262700 1 --2- 172.21.15.117:0/1955017581 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fec840692a0 0x7fec8406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:08.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.339+0000 7fec9d262700 1 --2- 172.21.15.117:0/1955017581 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fec840692a0 0x7fec8406b750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fec94000c00 tx=0x7fec94009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:08.343 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.342+0000 7fec8e7fc700 1 -- 172.21.15.117:0/1955017581 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fec88056f90 con 0x7fec980fc2d0 2024-04-12T09:08:08.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.535+0000 7fec9fcc7700 1 -- 172.21.15.117:0/1955017581 --> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fec9810f860 con 0x7fec840692a0 2024-04-12T09:08:08.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.537+0000 7fec8e7fc700 1 -- 172.21.15.117:0/1955017581 <== mgr.14214 v2:172.21.15.117:6800/3945342300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7fec9810f860 con 0x7fec840692a0 2024-04-12T09:08:08.538 INFO:teuthology.orchestra.run.smithi117.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-12T09:08:08.538 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400V6400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-04-12T09:08:08.538 INFO:teuthology.orchestra.run.smithi117.stdout:smithi203 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GK400BGN 372G No 74s ago Has a FileSystem, LVM detected 2024-04-12T09:08:08.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.539+0000 7fec9fcc7700 1 -- 172.21.15.117:0/1955017581 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fec840692a0 msgr2=0x7fec8406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:08.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.539+0000 7fec9fcc7700 1 --2- 172.21.15.117:0/1955017581 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fec840692a0 0x7fec8406b750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fec94000c00 tx=0x7fec94009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:08.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.539+0000 7fec9fcc7700 1 -- 172.21.15.117:0/1955017581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec980fc2d0 msgr2=0x7fec9810da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:08.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.539+0000 7fec9fcc7700 1 --2- 172.21.15.117:0/1955017581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec980fc2d0 0x7fec9810da30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fec8800c830 tx=0x7fec88004470 comp rx=0 tx=0).stop 2024-04-12T09:08:08.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.539+0000 7fec9fcc7700 1 -- 172.21.15.117:0/1955017581 shutdown_connections 2024-04-12T09:08:08.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.539+0000 7fec9fcc7700 1 --2- 172.21.15.117:0/1955017581 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fec840692a0 0x7fec8406b750 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:08.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.539+0000 7fec9fcc7700 1 --2- 172.21.15.117:0/1955017581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec980fc2d0 0x7fec9810da30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:08.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.539+0000 7fec9fcc7700 1 --2- 172.21.15.117:0/1955017581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec980fcc20 0x7fec9810df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:08.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.539+0000 7fec9fcc7700 1 -- 172.21.15.117:0/1955017581 >> 172.21.15.117:0/1955017581 conn(0x7fec980f6ba0 msgr2=0x7fec980fb570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:08.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.539+0000 7fec9fcc7700 1 -- 172.21.15.117:0/1955017581 shutdown_connections 2024-04-12T09:08:08.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:08.539+0000 7fec9fcc7700 1 -- 172.21.15.117:0/1955017581 wait complete. 2024-04-12T09:08:08.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:08 smithi203 ceph-mon[36428]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:08:08.890 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:08 smithi117 ceph-mon[29277]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:08:09.181 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-12T09:08:09.192 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi117.front.sepia.ceph.com 2024-04-12T09:08:09.193 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-04-12T09:08:09.446 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:08:09.809 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:09 smithi117 ceph-mon[29277]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:08:09.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:09 smithi203 ceph-mon[36428]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:08:10.497 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:10 smithi117 ceph-mon[29277]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:08:10.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:10 smithi203 ceph-mon[36428]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:08:10.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.974+0000 7ffa6d2bb700 1 -- 172.21.15.117:0/2945461023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa680fce70 msgr2=0x7ffa680fd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:10.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.974+0000 7ffa6d2bb700 1 --2- 172.21.15.117:0/2945461023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa680fce70 0x7ffa680fd280 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ffa58004940 tx=0x7ffa58009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:10.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.974+0000 7ffa6d2bb700 1 -- 172.21.15.117:0/2945461023 shutdown_connections 2024-04-12T09:08:10.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.974+0000 7ffa6d2bb700 1 --2- 172.21.15.117:0/2945461023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa680fdfe0 0x7ffa680fe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:10.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.974+0000 7ffa6d2bb700 1 --2- 172.21.15.117:0/2945461023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa680fce70 0x7ffa680fd280 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:10.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.974+0000 7ffa6d2bb700 1 -- 172.21.15.117:0/2945461023 >> 172.21.15.117:0/2945461023 conn(0x7ffa680f8550 msgr2=0x7ffa680fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:10.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.974+0000 7ffa6d2bb700 1 -- 172.21.15.117:0/2945461023 shutdown_connections 2024-04-12T09:08:10.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.974+0000 7ffa6d2bb700 1 -- 172.21.15.117:0/2945461023 wait complete. 2024-04-12T09:08:10.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.975+0000 7ffa6d2bb700 1 Processor -- start 2024-04-12T09:08:10.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.975+0000 7ffa6d2bb700 1 -- start start 2024-04-12T09:08:10.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.975+0000 7ffa6d2bb700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa680fce70 0x7ffa6810d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:10.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.975+0000 7ffa6d2bb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa680fdfe0 0x7ffa6810de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:10.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.975+0000 7ffa6d2bb700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6810e4f0 con 0x7ffa680fdfe0 2024-04-12T09:08:10.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.975+0000 7ffa6d2bb700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa68112e90 con 0x7ffa680fce70 2024-04-12T09:08:10.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.975+0000 7ffa667fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa680fdfe0 0x7ffa6810de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:10.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.975+0000 7ffa667fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa680fdfe0 0x7ffa6810de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58726/0 (socket says 172.21.15.117:58726) 2024-04-12T09:08:10.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.975+0000 7ffa667fc700 1 -- 172.21.15.117:0/4214967831 learned_addr learned my addr 172.21.15.117:0/4214967831 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:08:10.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.975+0000 7ffa66ffd700 1 --2- 172.21.15.117:0/4214967831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa680fce70 0x7ffa6810d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:10.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.975+0000 7ffa667fc700 1 -- 172.21.15.117:0/4214967831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa680fce70 msgr2=0x7ffa6810d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:10.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.975+0000 7ffa667fc700 1 --2- 172.21.15.117:0/4214967831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa680fce70 0x7ffa6810d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:10.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.975+0000 7ffa667fc700 1 -- 172.21.15.117:0/4214967831 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa58005040 con 0x7ffa680fdfe0 2024-04-12T09:08:10.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.975+0000 7ffa667fc700 1 --2- 172.21.15.117:0/4214967831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa680fdfe0 0x7ffa6810de60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00b790 tx=0x7ffa5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:10.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.976+0000 7ffa4f7fe700 1 -- 172.21.15.117:0/4214967831 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa5c00f6f0 con 0x7ffa680fdfe0 2024-04-12T09:08:10.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.976+0000 7ffa6d2bb700 1 -- 172.21.15.117:0/4214967831 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa681130f0 con 0x7ffa680fdfe0 2024-04-12T09:08:10.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.976+0000 7ffa4f7fe700 1 -- 172.21.15.117:0/4214967831 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa5c00fd20 con 0x7ffa680fdfe0 2024-04-12T09:08:10.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.976+0000 7ffa4f7fe700 1 -- 172.21.15.117:0/4214967831 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa5c0103a0 con 0x7ffa680fdfe0 2024-04-12T09:08:10.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.976+0000 7ffa6d2bb700 1 -- 172.21.15.117:0/4214967831 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa68113660 con 0x7ffa680fdfe0 2024-04-12T09:08:10.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.977+0000 7ffa6d2bb700 1 -- 172.21.15.117:0/4214967831 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6804c710 con 0x7ffa680fdfe0 2024-04-12T09:08:10.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.977+0000 7ffa4f7fe700 1 -- 172.21.15.117:0/4214967831 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ffa5c011400 con 0x7ffa680fdfe0 2024-04-12T09:08:10.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.977+0000 7ffa4f7fe700 1 --2- 172.21.15.117:0/4214967831 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7ffa500692a0 0x7ffa5006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:10.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.977+0000 7ffa4f7fe700 1 -- 172.21.15.117:0/4214967831 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ffa5c086c30 con 0x7ffa680fdfe0 2024-04-12T09:08:10.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.977+0000 7ffa66ffd700 1 --2- 172.21.15.117:0/4214967831 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7ffa500692a0 0x7ffa5006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:10.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.978+0000 7ffa66ffd700 1 --2- 172.21.15.117:0/4214967831 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7ffa500692a0 0x7ffa5006b750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffa5800b970 tx=0x7ffa58009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:10.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:10.982+0000 7ffa4f7fe700 1 -- 172.21.15.117:0/4214967831 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7ffa5c056d30 con 0x7ffa680fdfe0 2024-04-12T09:08:11.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:11.195+0000 7ffa6d2bb700 1 -- 172.21.15.117:0/4214967831 --> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa681022b0 con 0x7ffa500692a0 2024-04-12T09:08:11.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:11 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-12T09:08:11.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:11 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-12T09:08:12.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:12.506+0000 7ffa4f7fe700 1 -- 172.21.15.117:0/4214967831 <== mgr.14214 v2:172.21.15.117:6800/3945342300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ffa681022b0 con 0x7ffa500692a0 2024-04-12T09:08:12.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:12.509+0000 7ffa6d2bb700 1 -- 172.21.15.117:0/4214967831 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7ffa500692a0 msgr2=0x7ffa5006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:12.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:12.509+0000 7ffa6d2bb700 1 --2- 172.21.15.117:0/4214967831 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7ffa500692a0 0x7ffa5006b750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffa5800b970 tx=0x7ffa58009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:12.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:12.509+0000 7ffa6d2bb700 1 -- 172.21.15.117:0/4214967831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa680fdfe0 msgr2=0x7ffa6810de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:12.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:12.509+0000 7ffa6d2bb700 1 --2- 172.21.15.117:0/4214967831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa680fdfe0 0x7ffa6810de60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00b790 tx=0x7ffa5c009250 comp rx=0 tx=0).stop 2024-04-12T09:08:12.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:12.509+0000 7ffa6d2bb700 1 -- 172.21.15.117:0/4214967831 shutdown_connections 2024-04-12T09:08:12.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:12.509+0000 7ffa6d2bb700 1 --2- 172.21.15.117:0/4214967831 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7ffa500692a0 0x7ffa5006b750 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:12.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:12.509+0000 7ffa6d2bb700 1 --2- 172.21.15.117:0/4214967831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa680fce70 0x7ffa6810d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:12.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:12.509+0000 7ffa6d2bb700 1 --2- 172.21.15.117:0/4214967831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa680fdfe0 0x7ffa6810de60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:12.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:12.509+0000 7ffa6d2bb700 1 -- 172.21.15.117:0/4214967831 >> 172.21.15.117:0/4214967831 conn(0x7ffa680f8550 msgr2=0x7ffa680f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:12.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:12.509+0000 7ffa6d2bb700 1 -- 172.21.15.117:0/4214967831 shutdown_connections 2024-04-12T09:08:12.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:12.509+0000 7ffa6d2bb700 1 -- 172.21.15.117:0/4214967831 wait complete. 2024-04-12T09:08:12.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:12 smithi203 ceph-mon[36428]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:08:12.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:12 smithi203 ceph-mon[36428]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:08:12.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:12 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-12T09:08:12.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:12 smithi203 ceph-mon[36428]: osdmap e41: 6 total, 6 up, 6 in 2024-04-12T09:08:12.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:12 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-12T09:08:12.854 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:12 smithi117 ceph-mon[29277]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:08:12.854 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:12 smithi117 ceph-mon[29277]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:08:12.855 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:12 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-12T09:08:12.855 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:12 smithi117 ceph-mon[29277]: osdmap e41: 6 total, 6 up, 6 in 2024-04-12T09:08:12.855 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:12 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-12T09:08:12.855 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:12 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117[29273]: 2024-04-12T09:08:12.487+0000 7ff131c7a700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T09:08:13.130 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-12T09:08:13.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:13 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-12T09:08:13.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:13 smithi203 ceph-mon[36428]: osdmap e42: 6 total, 6 up, 6 in 2024-04-12T09:08:13.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:13 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-12T09:08:13.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:13 smithi203 ceph-mon[36428]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T09:08:13.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:13 smithi203 ceph-mon[36428]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-12T09:08:13.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:13 smithi203 ceph-mon[36428]: osdmap e43: 6 total, 6 up, 6 in 2024-04-12T09:08:13.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:13 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-12T09:08:13.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:13 smithi203 ceph-mon[36428]: fsmap cephfs:0 2024-04-12T09:08:13.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:13 smithi203 ceph-mon[36428]: Saving service mds.cephfs spec with placement count:4 2024-04-12T09:08:13.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:13 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:13.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:13 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:08:13.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:13 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:08:13.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:13 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:08:13.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:13 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:13.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:13 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.wddsgt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T09:08:13.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:13 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.wddsgt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-12T09:08:13.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:13 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:08:13.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:13 smithi203 ceph-mon[36428]: Deploying daemon mds.cephfs.smithi117.wddsgt on smithi117 2024-04-12T09:08:13.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:13 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-12T09:08:13.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:13 smithi117 ceph-mon[29277]: osdmap e42: 6 total, 6 up, 6 in 2024-04-12T09:08:13.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:13 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-12T09:08:13.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:13 smithi117 ceph-mon[29277]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T09:08:13.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:13 smithi117 ceph-mon[29277]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-12T09:08:13.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:13 smithi117 ceph-mon[29277]: osdmap e43: 6 total, 6 up, 6 in 2024-04-12T09:08:13.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:13 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-12T09:08:13.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:13 smithi117 ceph-mon[29277]: fsmap cephfs:0 2024-04-12T09:08:13.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:13 smithi117 ceph-mon[29277]: Saving service mds.cephfs spec with placement count:4 2024-04-12T09:08:13.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:13 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:13.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:13 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:08:13.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:13 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:08:13.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:13 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:08:13.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:13 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:13.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:13 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.wddsgt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T09:08:13.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:13 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.wddsgt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-12T09:08:13.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:13 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:08:13.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:13 smithi117 ceph-mon[29277]: Deploying daemon mds.cephfs.smithi117.wddsgt on smithi117 2024-04-12T09:08:14.371 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:08:14.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:14 smithi117 ceph-mon[29277]: pgmap v172: 65 pgs: 8 creating+peering, 8 active+clean, 49 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:08:14.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:14 smithi117 ceph-mon[29277]: osdmap e44: 6 total, 6 up, 6 in 2024-04-12T09:08:14.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:14 smithi203 ceph-mon[36428]: pgmap v172: 65 pgs: 8 creating+peering, 8 active+clean, 49 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:08:14.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:14 smithi203 ceph-mon[36428]: osdmap e44: 6 total, 6 up, 6 in 2024-04-12T09:08:15.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:15 smithi117 ceph-mon[29277]: osdmap e45: 6 total, 6 up, 6 in 2024-04-12T09:08:15.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:15 smithi203 ceph-mon[36428]: osdmap e45: 6 total, 6 up, 6 in 2024-04-12T09:08:16.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.228+0000 7f6dfafb7700 1 -- 172.21.15.117:0/4159624726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6df40fce70 msgr2=0x7f6df40fd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:16.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.228+0000 7f6dfafb7700 1 --2- 172.21.15.117:0/4159624726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6df40fce70 0x7f6df40fd280 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6de4004940 tx=0x7f6de4009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:16.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.228+0000 7f6dfafb7700 1 -- 172.21.15.117:0/4159624726 shutdown_connections 2024-04-12T09:08:16.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.228+0000 7f6dfafb7700 1 --2- 172.21.15.117:0/4159624726 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6df40fdfe0 0x7f6df40fe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:16.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.228+0000 7f6dfafb7700 1 --2- 172.21.15.117:0/4159624726 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6df40fce70 0x7f6df40fd280 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:16.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.228+0000 7f6dfafb7700 1 -- 172.21.15.117:0/4159624726 >> 172.21.15.117:0/4159624726 conn(0x7f6df40f8550 msgr2=0x7f6df40fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:16.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.228+0000 7f6dfafb7700 1 -- 172.21.15.117:0/4159624726 shutdown_connections 2024-04-12T09:08:16.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.228+0000 7f6dfafb7700 1 -- 172.21.15.117:0/4159624726 wait complete. 2024-04-12T09:08:16.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.228+0000 7f6dfafb7700 1 Processor -- start 2024-04-12T09:08:16.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.229+0000 7f6dfafb7700 1 -- start start 2024-04-12T09:08:16.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.229+0000 7f6dfafb7700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6df40fce70 0x7f6df410d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:16.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.229+0000 7f6dfafb7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6df40fdfe0 0x7f6df410de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:16.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.229+0000 7f6dfafb7700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df410e490 con 0x7f6df40fdfe0 2024-04-12T09:08:16.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.229+0000 7f6dfafb7700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df410e600 con 0x7f6df40fce70 2024-04-12T09:08:16.231 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.229+0000 7f6df3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6df40fdfe0 0x7f6df410de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:16.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.229+0000 7f6df3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6df40fdfe0 0x7f6df410de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58740/0 (socket says 172.21.15.117:58740) 2024-04-12T09:08:16.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.229+0000 7f6df3fff700 1 -- 172.21.15.117:0/2598394336 learned_addr learned my addr 172.21.15.117:0/2598394336 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:08:16.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.229+0000 7f6df8d53700 1 --2- 172.21.15.117:0/2598394336 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6df40fce70 0x7f6df410d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:16.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.229+0000 7f6df3fff700 1 -- 172.21.15.117:0/2598394336 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6df40fce70 msgr2=0x7f6df410d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:16.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.229+0000 7f6df3fff700 1 --2- 172.21.15.117:0/2598394336 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6df40fce70 0x7f6df410d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:16.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.229+0000 7f6df3fff700 1 -- 172.21.15.117:0/2598394336 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de4005040 con 0x7f6df40fdfe0 2024-04-12T09:08:16.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.229+0000 7f6df8d53700 1 --2- 172.21.15.117:0/2598394336 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6df40fce70 0x7f6df410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T09:08:16.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.230+0000 7f6df3fff700 1 --2- 172.21.15.117:0/2598394336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6df40fdfe0 0x7f6df410de90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6de8002a50 tx=0x7f6de80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:16.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.230+0000 7f6df17fa700 1 -- 172.21.15.117:0/2598394336 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6de8007cc0 con 0x7f6df40fdfe0 2024-04-12T09:08:16.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.230+0000 7f6df17fa700 1 -- 172.21.15.117:0/2598394336 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6de800f040 con 0x7f6df40fdfe0 2024-04-12T09:08:16.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.230+0000 7f6dfafb7700 1 -- 172.21.15.117:0/2598394336 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df4113060 con 0x7f6df40fdfe0 2024-04-12T09:08:16.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.230+0000 7f6df17fa700 1 -- 172.21.15.117:0/2598394336 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6de8009640 con 0x7f6df40fdfe0 2024-04-12T09:08:16.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.230+0000 7f6dfafb7700 1 -- 172.21.15.117:0/2598394336 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df4113620 con 0x7f6df40fdfe0 2024-04-12T09:08:16.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.231+0000 7f6dfafb7700 1 -- 172.21.15.117:0/2598394336 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df404c710 con 0x7f6df40fdfe0 2024-04-12T09:08:16.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.231+0000 7f6df17fa700 1 -- 172.21.15.117:0/2598394336 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f6de80097a0 con 0x7f6df40fdfe0 2024-04-12T09:08:16.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.232+0000 7f6df17fa700 1 --2- 172.21.15.117:0/2598394336 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f6ddc0692a0 0x7f6ddc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:16.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.232+0000 7f6df17fa700 1 -- 172.21.15.117:0/2598394336 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f6de8086ce0 con 0x7f6df40fdfe0 2024-04-12T09:08:16.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.232+0000 7f6df8d53700 1 --2- 172.21.15.117:0/2598394336 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f6ddc0692a0 0x7f6ddc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:16.233 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.232+0000 7f6df8d53700 1 --2- 172.21.15.117:0/2598394336 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f6ddc0692a0 0x7f6ddc06b750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6de400b3b0 tx=0x7f6de4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:16.237 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.236+0000 7f6df17fa700 1 -- 172.21.15.117:0/2598394336 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f6de8056a20 con 0x7f6df40fdfe0 2024-04-12T09:08:16.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.486+0000 7f6dfafb7700 1 -- 172.21.15.117:0/2598394336 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6df4113a70 con 0x7f6df40fdfe0 2024-04-12T09:08:16.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.486+0000 7f6df17fa700 1 -- 172.21.15.117:0/2598394336 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7f6de80565b0 con 0x7f6df40fdfe0 2024-04-12T09:08:16.487 INFO:teuthology.orchestra.run.smithi117.stdout:e2 2024-04-12T09:08:16.487 INFO:teuthology.orchestra.run.smithi117.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T09:08:16.487 INFO:teuthology.orchestra.run.smithi117.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:08:16.487 INFO:teuthology.orchestra.run.smithi117.stdout:legacy client fscid: 1 2024-04-12T09:08:16.487 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:08:16.487 INFO:teuthology.orchestra.run.smithi117.stdout:Filesystem 'cephfs' (1) 2024-04-12T09:08:16.488 INFO:teuthology.orchestra.run.smithi117.stdout:fs_name cephfs 2024-04-12T09:08:16.488 INFO:teuthology.orchestra.run.smithi117.stdout:epoch 2 2024-04-12T09:08:16.488 INFO:teuthology.orchestra.run.smithi117.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T09:08:16.488 INFO:teuthology.orchestra.run.smithi117.stdout:created 2024-04-12T09:08:12.488144+0000 2024-04-12T09:08:16.488 INFO:teuthology.orchestra.run.smithi117.stdout:modified 2024-04-12T09:08:12.488190+0000 2024-04-12T09:08:16.488 INFO:teuthology.orchestra.run.smithi117.stdout:tableserver 0 2024-04-12T09:08:16.488 INFO:teuthology.orchestra.run.smithi117.stdout:root 0 2024-04-12T09:08:16.488 INFO:teuthology.orchestra.run.smithi117.stdout:session_timeout 60 2024-04-12T09:08:16.488 INFO:teuthology.orchestra.run.smithi117.stdout:session_autoclose 300 2024-04-12T09:08:16.488 INFO:teuthology.orchestra.run.smithi117.stdout:max_file_size 1099511627776 2024-04-12T09:08:16.488 INFO:teuthology.orchestra.run.smithi117.stdout:required_client_features {} 2024-04-12T09:08:16.488 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure 0 2024-04-12T09:08:16.488 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure_osd_epoch 0 2024-04-12T09:08:16.488 INFO:teuthology.orchestra.run.smithi117.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:08:16.489 INFO:teuthology.orchestra.run.smithi117.stdout:max_mds 1 2024-04-12T09:08:16.489 INFO:teuthology.orchestra.run.smithi117.stdout:in 2024-04-12T09:08:16.489 INFO:teuthology.orchestra.run.smithi117.stdout:up {} 2024-04-12T09:08:16.489 INFO:teuthology.orchestra.run.smithi117.stdout:failed 2024-04-12T09:08:16.489 INFO:teuthology.orchestra.run.smithi117.stdout:damaged 2024-04-12T09:08:16.489 INFO:teuthology.orchestra.run.smithi117.stdout:stopped 2024-04-12T09:08:16.489 INFO:teuthology.orchestra.run.smithi117.stdout:data_pools [3] 2024-04-12T09:08:16.489 INFO:teuthology.orchestra.run.smithi117.stdout:metadata_pool 2 2024-04-12T09:08:16.489 INFO:teuthology.orchestra.run.smithi117.stdout:inline_data disabled 2024-04-12T09:08:16.489 INFO:teuthology.orchestra.run.smithi117.stdout:balancer 2024-04-12T09:08:16.489 INFO:teuthology.orchestra.run.smithi117.stdout:standby_count_wanted 0 2024-04-12T09:08:16.489 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:08:16.489 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:08:16.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.488+0000 7f6dfafb7700 1 -- 172.21.15.117:0/2598394336 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f6ddc0692a0 msgr2=0x7f6ddc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:16.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.488+0000 7f6dfafb7700 1 --2- 172.21.15.117:0/2598394336 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f6ddc0692a0 0x7f6ddc06b750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6de400b3b0 tx=0x7f6de4009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:16.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.488+0000 7f6dfafb7700 1 -- 172.21.15.117:0/2598394336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6df40fdfe0 msgr2=0x7f6df410de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:16.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.488+0000 7f6dfafb7700 1 --2- 172.21.15.117:0/2598394336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6df40fdfe0 0x7f6df410de90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6de8002a50 tx=0x7f6de80046b0 comp rx=0 tx=0).stop 2024-04-12T09:08:16.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.488+0000 7f6dfafb7700 1 -- 172.21.15.117:0/2598394336 shutdown_connections 2024-04-12T09:08:16.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.488+0000 7f6dfafb7700 1 --2- 172.21.15.117:0/2598394336 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f6ddc0692a0 0x7f6ddc06b750 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:16.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.488+0000 7f6dfafb7700 1 --2- 172.21.15.117:0/2598394336 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6df40fce70 0x7f6df410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:16.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.488+0000 7f6dfafb7700 1 --2- 172.21.15.117:0/2598394336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6df40fdfe0 0x7f6df410de90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:16.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.488+0000 7f6dfafb7700 1 -- 172.21.15.117:0/2598394336 >> 172.21.15.117:0/2598394336 conn(0x7f6df40f8550 msgr2=0x7f6df40f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:16.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.488+0000 7f6dfafb7700 1 -- 172.21.15.117:0/2598394336 shutdown_connections 2024-04-12T09:08:16.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:16.488+0000 7f6dfafb7700 1 -- 172.21.15.117:0/2598394336 wait complete. 2024-04-12T09:08:16.491 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 2 2024-04-12T09:08:16.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:16 smithi117 ceph-mon[29277]: pgmap v175: 65 pgs: 14 creating+peering, 48 active+clean, 3 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:08:16.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:16 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:16.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:16 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:08:16.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:16 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/2598394336' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:08:16.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:16 smithi203 ceph-mon[36428]: pgmap v175: 65 pgs: 14 creating+peering, 48 active+clean, 3 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:08:16.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:16 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:16.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:16 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:08:16.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:16 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/2598394336' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:08:17.411 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-12T09:08:17.425 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi117.front.sepia.ceph.com 2024-04-12T09:08:17.425 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-04-12T09:08:17.689 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:08:18.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:17 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:18.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:17 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:18.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:17 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:18.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:17 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.fbeixl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T09:08:18.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:17 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.fbeixl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-12T09:08:18.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:17 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:08:18.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:17 smithi117 ceph-mon[29277]: Deploying daemon mds.cephfs.smithi203.fbeixl on smithi203 2024-04-12T09:08:18.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:17 smithi117 ceph-mon[29277]: pgmap v176: 65 pgs: 11 creating+peering, 54 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:08:18.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:17 smithi117 ceph-mon[29277]: mds.? [v2:172.21.15.117:6826/1717609783,v1:172.21.15.117:6827/1717609783] up:boot 2024-04-12T09:08:18.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:17 smithi117 ceph-mon[29277]: daemon mds.cephfs.smithi117.wddsgt assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-12T09:08:18.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:17 smithi117 ceph-mon[29277]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-12T09:08:18.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:17 smithi117 ceph-mon[29277]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-12T09:08:18.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:17 smithi117 ceph-mon[29277]: Cluster is now healthy 2024-04-12T09:08:18.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:17 smithi117 ceph-mon[29277]: fsmap cephfs:0 1 up:standby 2024-04-12T09:08:18.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:17 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.wddsgt"}]: dispatch 2024-04-12T09:08:18.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:17 smithi117 ceph-mon[29277]: fsmap cephfs:1 {0=cephfs.smithi117.wddsgt=up:creating} 2024-04-12T09:08:18.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:17 smithi117 ceph-mon[29277]: daemon mds.cephfs.smithi117.wddsgt is now active in filesystem cephfs as rank 0 2024-04-12T09:08:18.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:17 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:18.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:17 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:18.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:17 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:18.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:17 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.fbeixl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T09:08:18.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:17 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.fbeixl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-12T09:08:18.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:17 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:08:18.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:17 smithi203 ceph-mon[36428]: Deploying daemon mds.cephfs.smithi203.fbeixl on smithi203 2024-04-12T09:08:18.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:17 smithi203 ceph-mon[36428]: pgmap v176: 65 pgs: 11 creating+peering, 54 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:08:18.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:17 smithi203 ceph-mon[36428]: mds.? [v2:172.21.15.117:6826/1717609783,v1:172.21.15.117:6827/1717609783] up:boot 2024-04-12T09:08:18.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:17 smithi203 ceph-mon[36428]: daemon mds.cephfs.smithi117.wddsgt assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-12T09:08:18.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:17 smithi203 ceph-mon[36428]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-12T09:08:18.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:17 smithi203 ceph-mon[36428]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-12T09:08:18.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:17 smithi203 ceph-mon[36428]: Cluster is now healthy 2024-04-12T09:08:18.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:17 smithi203 ceph-mon[36428]: fsmap cephfs:0 1 up:standby 2024-04-12T09:08:18.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:17 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.wddsgt"}]: dispatch 2024-04-12T09:08:18.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:17 smithi203 ceph-mon[36428]: fsmap cephfs:1 {0=cephfs.smithi117.wddsgt=up:creating} 2024-04-12T09:08:18.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:17 smithi203 ceph-mon[36428]: daemon mds.cephfs.smithi117.wddsgt is now active in filesystem cephfs as rank 0 2024-04-12T09:08:19.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.254+0000 7f79428fa700 1 -- 172.21.15.117:0/120808360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f793c0fce70 msgr2=0x7f793c0fd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:19.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.254+0000 7f79428fa700 1 --2- 172.21.15.117:0/120808360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f793c0fce70 0x7f793c0fd280 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f792c004940 tx=0x7f792c009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:19.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.254+0000 7f79428fa700 1 -- 172.21.15.117:0/120808360 shutdown_connections 2024-04-12T09:08:19.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.254+0000 7f79428fa700 1 --2- 172.21.15.117:0/120808360 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f793c0fdfe0 0x7f793c0fe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:19.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.254+0000 7f79428fa700 1 --2- 172.21.15.117:0/120808360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f793c0fce70 0x7f793c0fd280 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:19.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.254+0000 7f79428fa700 1 -- 172.21.15.117:0/120808360 >> 172.21.15.117:0/120808360 conn(0x7f793c0f8550 msgr2=0x7f793c0fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:19.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.254+0000 7f79428fa700 1 -- 172.21.15.117:0/120808360 shutdown_connections 2024-04-12T09:08:19.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.254+0000 7f79428fa700 1 -- 172.21.15.117:0/120808360 wait complete. 2024-04-12T09:08:19.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.255+0000 7f79428fa700 1 Processor -- start 2024-04-12T09:08:19.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.255+0000 7f79428fa700 1 -- start start 2024-04-12T09:08:19.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.255+0000 7f79428fa700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f793c0fce70 0x7f793c10fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:19.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.255+0000 7f79428fa700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f793c0fdfe0 0x7f793c110020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:19.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.255+0000 7f79428fa700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793c110620 con 0x7f793c0fdfe0 2024-04-12T09:08:19.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.255+0000 7f79428fa700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793c110790 con 0x7f793c0fce70 2024-04-12T09:08:19.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.255+0000 7f793b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f793c0fdfe0 0x7f793c110020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:19.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.255+0000 7f793b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f793c0fdfe0 0x7f793c110020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58790/0 (socket says 172.21.15.117:58790) 2024-04-12T09:08:19.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.255+0000 7f793b7fe700 1 -- 172.21.15.117:0/436323697 learned_addr learned my addr 172.21.15.117:0/436323697 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:08:19.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.256+0000 7f793b7fe700 1 -- 172.21.15.117:0/436323697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f793c0fce70 msgr2=0x7f793c10fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:19.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.256+0000 7f793b7fe700 1 --2- 172.21.15.117:0/436323697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f793c0fce70 0x7f793c10fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:19.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.256+0000 7f793b7fe700 1 -- 172.21.15.117:0/436323697 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c005040 con 0x7f793c0fdfe0 2024-04-12T09:08:19.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.256+0000 7f793b7fe700 1 --2- 172.21.15.117:0/436323697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f793c0fdfe0 0x7f793c110020 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f793000eb40 tx=0x7f793000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:19.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.256+0000 7f7938ff9700 1 -- 172.21.15.117:0/436323697 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7930007cc0 con 0x7f793c0fdfe0 2024-04-12T09:08:19.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.256+0000 7f7938ff9700 1 -- 172.21.15.117:0/436323697 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f793000f040 con 0x7f793c0fdfe0 2024-04-12T09:08:19.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.256+0000 7f7938ff9700 1 -- 172.21.15.117:0/436323697 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7930009620 con 0x7f793c0fdfe0 2024-04-12T09:08:19.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.256+0000 7f79428fa700 1 -- 172.21.15.117:0/436323697 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f793c115190 con 0x7f793c0fdfe0 2024-04-12T09:08:19.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.256+0000 7f79428fa700 1 -- 172.21.15.117:0/436323697 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f793c1156d0 con 0x7f793c0fdfe0 2024-04-12T09:08:19.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.257+0000 7f79428fa700 1 -- 172.21.15.117:0/436323697 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f793c101970 con 0x7f793c0fdfe0 2024-04-12T09:08:19.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.257+0000 7f7938ff9700 1 -- 172.21.15.117:0/436323697 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f7930009780 con 0x7f793c0fdfe0 2024-04-12T09:08:19.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.258+0000 7f7938ff9700 1 --2- 172.21.15.117:0/436323697 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f79240692a0 0x7f792406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:19.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.258+0000 7f7938ff9700 1 -- 172.21.15.117:0/436323697 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f7930086d00 con 0x7f793c0fdfe0 2024-04-12T09:08:19.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.258+0000 7f793bfff700 1 --2- 172.21.15.117:0/436323697 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f79240692a0 0x7f792406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:19.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.258+0000 7f793bfff700 1 --2- 172.21.15.117:0/436323697 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f79240692a0 0x7f792406b750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f792c009b30 tx=0x7f792c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:19.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.262+0000 7f7938ff9700 1 -- 172.21.15.117:0/436323697 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f793004e190 con 0x7f793c0fdfe0 2024-04-12T09:08:19.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.492+0000 7f79428fa700 1 -- 172.21.15.117:0/436323697 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f793c04c710 con 0x7f793c0fdfe0 2024-04-12T09:08:19.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.523+0000 7f7938ff9700 1 -- 172.21.15.117:0/436323697 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f793008a030 con 0x7f793c0fdfe0 2024-04-12T09:08:19.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.526+0000 7f79428fa700 1 -- 172.21.15.117:0/436323697 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f79240692a0 msgr2=0x7f792406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:19.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.526+0000 7f79428fa700 1 --2- 172.21.15.117:0/436323697 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f79240692a0 0x7f792406b750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f792c009b30 tx=0x7f792c009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:19.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.526+0000 7f79428fa700 1 -- 172.21.15.117:0/436323697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f793c0fdfe0 msgr2=0x7f793c110020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:19.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.526+0000 7f79428fa700 1 --2- 172.21.15.117:0/436323697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f793c0fdfe0 0x7f793c110020 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f793000eb40 tx=0x7f793000b040 comp rx=0 tx=0).stop 2024-04-12T09:08:19.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.526+0000 7f79428fa700 1 -- 172.21.15.117:0/436323697 shutdown_connections 2024-04-12T09:08:19.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.526+0000 7f79428fa700 1 --2- 172.21.15.117:0/436323697 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f79240692a0 0x7f792406b750 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:19.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.526+0000 7f79428fa700 1 --2- 172.21.15.117:0/436323697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f793c0fce70 0x7f793c10fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:19.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.526+0000 7f79428fa700 1 --2- 172.21.15.117:0/436323697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f793c0fdfe0 0x7f793c110020 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:19.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.526+0000 7f79428fa700 1 -- 172.21.15.117:0/436323697 >> 172.21.15.117:0/436323697 conn(0x7f793c0f8550 msgr2=0x7f793c0f9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:19.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.526+0000 7f79428fa700 1 -- 172.21.15.117:0/436323697 shutdown_connections 2024-04-12T09:08:19.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:19.526+0000 7f79428fa700 1 -- 172.21.15.117:0/436323697 wait complete. 2024-04-12T09:08:19.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:19 smithi203 ceph-mon[36428]: mds.? [v2:172.21.15.117:6826/1717609783,v1:172.21.15.117:6827/1717609783] up:active 2024-04-12T09:08:19.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:19 smithi203 ceph-mon[36428]: fsmap cephfs:1 {0=cephfs.smithi117.wddsgt=up:active} 2024-04-12T09:08:19.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:19 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:19.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:19 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/436323697' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-12T09:08:19.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:19 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:19.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:19 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:19.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:19 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.eslmxh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T09:08:19.824 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:19 smithi117 ceph-mon[29277]: mds.? [v2:172.21.15.117:6826/1717609783,v1:172.21.15.117:6827/1717609783] up:active 2024-04-12T09:08:19.824 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:19 smithi117 ceph-mon[29277]: fsmap cephfs:1 {0=cephfs.smithi117.wddsgt=up:active} 2024-04-12T09:08:19.825 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:19 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:19.825 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:19 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/436323697' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-12T09:08:19.825 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:19 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:19.825 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:19 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:19.825 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:19 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.eslmxh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T09:08:20.138 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-12T09:08:20.147 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi117.front.sepia.ceph.com 2024-04-12T09:08:20.147 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-04-12T09:08:20.757 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:20 smithi203 ceph-mon[36428]: pgmap v177: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 1 op/s 2024-04-12T09:08:20.758 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:20 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.eslmxh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-12T09:08:20.758 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:20 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:08:20.758 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:20 smithi203 ceph-mon[36428]: Deploying daemon mds.cephfs.smithi117.eslmxh on smithi117 2024-04-12T09:08:20.758 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:20 smithi203 ceph-mon[36428]: mds.? [v2:172.21.15.203:6824/840607003,v1:172.21.15.203:6825/840607003] up:boot 2024-04-12T09:08:20.758 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:20 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/436323697' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-12T09:08:20.758 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:20 smithi203 ceph-mon[36428]: fsmap cephfs:1 {0=cephfs.smithi117.wddsgt=up:active} 1 up:standby 2024-04-12T09:08:20.758 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:20 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.fbeixl"}]: dispatch 2024-04-12T09:08:20.758 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:20 smithi203 ceph-mon[36428]: fsmap cephfs:1 {0=cephfs.smithi117.wddsgt=up:active} 1 up:standby 2024-04-12T09:08:20.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:20 smithi117 ceph-mon[29277]: pgmap v177: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 1 op/s 2024-04-12T09:08:20.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:20 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.eslmxh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-12T09:08:20.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:20 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:08:20.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:20 smithi117 ceph-mon[29277]: Deploying daemon mds.cephfs.smithi117.eslmxh on smithi117 2024-04-12T09:08:20.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:20 smithi117 ceph-mon[29277]: mds.? [v2:172.21.15.203:6824/840607003,v1:172.21.15.203:6825/840607003] up:boot 2024-04-12T09:08:20.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:20 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/436323697' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-12T09:08:20.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:20 smithi117 ceph-mon[29277]: fsmap cephfs:1 {0=cephfs.smithi117.wddsgt=up:active} 1 up:standby 2024-04-12T09:08:20.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:20 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.fbeixl"}]: dispatch 2024-04-12T09:08:20.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:20 smithi117 ceph-mon[29277]: fsmap cephfs:1 {0=cephfs.smithi117.wddsgt=up:active} 1 up:standby 2024-04-12T09:08:21.372 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:08:22.802 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:22 smithi117 ceph-mon[29277]: pgmap v178: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 4 op/s 2024-04-12T09:08:22.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:22 smithi203 ceph-mon[36428]: pgmap v178: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 4 op/s 2024-04-12T09:08:23.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.349+0000 7f030a68f700 1 -- 172.21.15.117:0/4073646502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0304066280 msgr2=0x7f03040ffa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:23.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.349+0000 7f030a68f700 1 --2- 172.21.15.117:0/4073646502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0304066280 0x7f03040ffa20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f02f8004940 tx=0x7f02f8009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:23.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.349+0000 7f030a68f700 1 -- 172.21.15.117:0/4073646502 shutdown_connections 2024-04-12T09:08:23.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.349+0000 7f030a68f700 1 --2- 172.21.15.117:0/4073646502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f03040fff60 0x7f0304102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:23.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.349+0000 7f030a68f700 1 --2- 172.21.15.117:0/4073646502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0304066280 0x7f03040ffa20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:23.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.349+0000 7f030a68f700 1 -- 172.21.15.117:0/4073646502 >> 172.21.15.117:0/4073646502 conn(0x7f03040f7430 msgr2=0x7f03040f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:23.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.349+0000 7f030a68f700 1 -- 172.21.15.117:0/4073646502 shutdown_connections 2024-04-12T09:08:23.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.349+0000 7f030a68f700 1 -- 172.21.15.117:0/4073646502 wait complete. 2024-04-12T09:08:23.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.349+0000 7f030a68f700 1 Processor -- start 2024-04-12T09:08:23.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.349+0000 7f030a68f700 1 -- start start 2024-04-12T09:08:23.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.349+0000 7f030a68f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0304066280 0x7f030410dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:23.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.349+0000 7f030a68f700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f03040fff60 0x7f030410e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:23.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.350+0000 7f030a68f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030410e690 con 0x7f0304066280 2024-04-12T09:08:23.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.350+0000 7f030a68f700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030410ee30 con 0x7f03040fff60 2024-04-12T09:08:23.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.350+0000 7f0303fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0304066280 0x7f030410dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:23.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.350+0000 7f0303fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0304066280 0x7f030410dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57128/0 (socket says 172.21.15.117:57128) 2024-04-12T09:08:23.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.350+0000 7f0303fff700 1 -- 172.21.15.117:0/437758250 learned_addr learned my addr 172.21.15.117:0/437758250 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:08:23.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.350+0000 7f03037fe700 1 --2- 172.21.15.117:0/437758250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f03040fff60 0x7f030410e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:23.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.350+0000 7f0303fff700 1 -- 172.21.15.117:0/437758250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f03040fff60 msgr2=0x7f030410e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:23.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.350+0000 7f0303fff700 1 --2- 172.21.15.117:0/437758250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f03040fff60 0x7f030410e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:23.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.350+0000 7f0303fff700 1 -- 172.21.15.117:0/437758250 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f8005040 con 0x7f0304066280 2024-04-12T09:08:23.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.350+0000 7f03037fe700 1 --2- 172.21.15.117:0/437758250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f03040fff60 0x7f030410e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T09:08:23.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.350+0000 7f0303fff700 1 --2- 172.21.15.117:0/437758250 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0304066280 0x7f030410dac0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f02f800b3b0 tx=0x7f02f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:23.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.350+0000 7f0300ff9700 1 -- 172.21.15.117:0/437758250 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02f800e040 con 0x7f0304066280 2024-04-12T09:08:23.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.350+0000 7f030a68f700 1 -- 172.21.15.117:0/437758250 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f030410f0b0 con 0x7f0304066280 2024-04-12T09:08:23.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.350+0000 7f0300ff9700 1 -- 172.21.15.117:0/437758250 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f02f800bcc0 con 0x7f0304066280 2024-04-12T09:08:23.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.350+0000 7f030a68f700 1 -- 172.21.15.117:0/437758250 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f030410f670 con 0x7f0304066280 2024-04-12T09:08:23.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.350+0000 7f0300ff9700 1 -- 172.21.15.117:0/437758250 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02f801c5d0 con 0x7f0304066280 2024-04-12T09:08:23.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.351+0000 7f030a68f700 1 -- 172.21.15.117:0/437758250 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030405f5f0 con 0x7f0304066280 2024-04-12T09:08:23.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.352+0000 7f0300ff9700 1 -- 172.21.15.117:0/437758250 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f02f80139f0 con 0x7f0304066280 2024-04-12T09:08:23.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.352+0000 7f0300ff9700 1 --2- 172.21.15.117:0/437758250 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f02ec0692a0 0x7f02ec06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:23.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.352+0000 7f0300ff9700 1 -- 172.21.15.117:0/437758250 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f02f8087e20 con 0x7f0304066280 2024-04-12T09:08:23.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.352+0000 7f03037fe700 1 --2- 172.21.15.117:0/437758250 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f02ec0692a0 0x7f02ec06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:23.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.353+0000 7f03037fe700 1 --2- 172.21.15.117:0/437758250 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f02ec0692a0 0x7f02ec06b750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f02f4006fd0 tx=0x7f02f4008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:23.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.360+0000 7f0300ff9700 1 -- 172.21.15.117:0/437758250 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f02f8057c90 con 0x7f0304066280 2024-04-12T09:08:23.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:23.625+0000 7f030a68f700 1 -- 172.21.15.117:0/437758250 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f030404bed0 con 0x7f0304066280 2024-04-12T09:08:24.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:24.527+0000 7f0300ff9700 1 -- 172.21.15.117:0/437758250 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f02f8057820 con 0x7f0304066280 2024-04-12T09:08:24.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:24.530+0000 7f030a68f700 1 -- 172.21.15.117:0/437758250 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f02ec0692a0 msgr2=0x7f02ec06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:24.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:24.530+0000 7f030a68f700 1 --2- 172.21.15.117:0/437758250 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f02ec0692a0 0x7f02ec06b750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f02f4006fd0 tx=0x7f02f4008040 comp rx=0 tx=0).stop 2024-04-12T09:08:24.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:24.530+0000 7f030a68f700 1 -- 172.21.15.117:0/437758250 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0304066280 msgr2=0x7f030410dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:24.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:24.530+0000 7f030a68f700 1 --2- 172.21.15.117:0/437758250 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0304066280 0x7f030410dac0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f02f800b3b0 tx=0x7f02f8009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:24.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:24.530+0000 7f030a68f700 1 -- 172.21.15.117:0/437758250 shutdown_connections 2024-04-12T09:08:24.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:24.530+0000 7f030a68f700 1 --2- 172.21.15.117:0/437758250 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f02ec0692a0 0x7f02ec06b750 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:24.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:24.530+0000 7f030a68f700 1 --2- 172.21.15.117:0/437758250 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0304066280 0x7f030410dac0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:24.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:24.530+0000 7f030a68f700 1 --2- 172.21.15.117:0/437758250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f03040fff60 0x7f030410e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:24.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:24.530+0000 7f030a68f700 1 -- 172.21.15.117:0/437758250 >> 172.21.15.117:0/437758250 conn(0x7f03040f7430 msgr2=0x7f03040f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:24.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:24.530+0000 7f030a68f700 1 -- 172.21.15.117:0/437758250 shutdown_connections 2024-04-12T09:08:24.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:24.530+0000 7f030a68f700 1 -- 172.21.15.117:0/437758250 wait complete. 2024-04-12T09:08:24.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:24 smithi117 ceph-mon[29277]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-04-12T09:08:24.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:24 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/437758250' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-04-12T09:08:24.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:24 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:24.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:24 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:24.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:24 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:24.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:24 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.bszhxz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T09:08:24.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:24 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.bszhxz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-12T09:08:24.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:24 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:08:24.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:24 smithi117 ceph-mon[29277]: Deploying daemon mds.cephfs.smithi203.bszhxz on smithi203 2024-04-12T09:08:24.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:24 smithi203 ceph-mon[36428]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-04-12T09:08:24.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:24 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/437758250' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-04-12T09:08:24.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:24 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:24.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:24 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:24.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:24 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:24.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:24 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.bszhxz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T09:08:24.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:24 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.bszhxz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-12T09:08:24.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:24 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:08:24.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:24 smithi203 ceph-mon[36428]: Deploying daemon mds.cephfs.smithi203.bszhxz on smithi203 2024-04-12T09:08:25.158 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-12T09:08:25.168 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi117.front.sepia.ceph.com 2024-04-12T09:08:25.168 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-04-12T09:08:25.428 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:08:25.806 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:25 smithi203 ceph-mon[36428]: mds.? [v2:172.21.15.117:6828/2248590199,v1:172.21.15.117:6829/2248590199] up:boot 2024-04-12T09:08:25.806 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:25 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/437758250' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-04-12T09:08:25.806 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:25 smithi203 ceph-mon[36428]: fsmap cephfs:1 {0=cephfs.smithi117.wddsgt=up:active} 2 up:standby 2024-04-12T09:08:25.807 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:25 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.eslmxh"}]: dispatch 2024-04-12T09:08:25.853 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:25 smithi117 ceph-mon[29277]: mds.? [v2:172.21.15.117:6828/2248590199,v1:172.21.15.117:6829/2248590199] up:boot 2024-04-12T09:08:25.853 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:25 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/437758250' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-04-12T09:08:25.853 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:25 smithi117 ceph-mon[29277]: fsmap cephfs:1 {0=cephfs.smithi117.wddsgt=up:active} 2 up:standby 2024-04-12T09:08:25.853 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:25 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.eslmxh"}]: dispatch 2024-04-12T09:08:26.786 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:26 smithi117 ceph-mon[29277]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 4 op/s 2024-04-12T09:08:26.786 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:26 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:26.786 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:26 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:26.786 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:26 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:26.786 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:26 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:26.786 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:26 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:26.786 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:26 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:08:26.786 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:26 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:26.817 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:26 smithi203 ceph-mon[36428]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 4 op/s 2024-04-12T09:08:26.817 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:26 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:26.817 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:26 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:26.817 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:26 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:26.817 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:26 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:26.817 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:26 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:26.817 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:26 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:08:26.817 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:26 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:27.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.010+0000 7f62cac55700 1 -- 172.21.15.117:0/255298266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62c40fcf80 msgr2=0x7f62c40fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:27.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.010+0000 7f62cac55700 1 --2- 172.21.15.117:0/255298266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62c40fcf80 0x7f62c40fd3f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f62b0004940 tx=0x7f62b0009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:27.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.010+0000 7f62cac55700 1 -- 172.21.15.117:0/255298266 shutdown_connections 2024-04-12T09:08:27.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.010+0000 7f62cac55700 1 --2- 172.21.15.117:0/255298266 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62c40fcf80 0x7f62c40fd3f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:27.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.010+0000 7f62cac55700 1 --2- 172.21.15.117:0/255298266 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62c40fbcd0 0x7f62c40fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:27.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.010+0000 7f62cac55700 1 -- 172.21.15.117:0/255298266 >> 172.21.15.117:0/255298266 conn(0x7f62c40f7430 msgr2=0x7f62c40f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:27.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.010+0000 7f62cac55700 1 -- 172.21.15.117:0/255298266 shutdown_connections 2024-04-12T09:08:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.010+0000 7f62cac55700 1 -- 172.21.15.117:0/255298266 wait complete. 2024-04-12T09:08:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.010+0000 7f62cac55700 1 Processor -- start 2024-04-12T09:08:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.010+0000 7f62cac55700 1 -- start start 2024-04-12T09:08:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.011+0000 7f62cac55700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62c40fbcd0 0x7f62c410daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.011+0000 7f62cac55700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62c40fcf80 0x7f62c410dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.011+0000 7f62cac55700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c410e5e0 con 0x7f62c40fbcd0 2024-04-12T09:08:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.011+0000 7f62cac55700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c410ede0 con 0x7f62c40fcf80 2024-04-12T09:08:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.011+0000 7f62c89f1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62c40fbcd0 0x7f62c410daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.011+0000 7f62c89f1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62c40fbcd0 0x7f62c410daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57168/0 (socket says 172.21.15.117:57168) 2024-04-12T09:08:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.011+0000 7f62c89f1700 1 -- 172.21.15.117:0/4253542506 learned_addr learned my addr 172.21.15.117:0/4253542506 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:08:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.011+0000 7f62c3fff700 1 --2- 172.21.15.117:0/4253542506 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62c40fcf80 0x7f62c410dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.011+0000 7f62c89f1700 1 -- 172.21.15.117:0/4253542506 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62c40fcf80 msgr2=0x7f62c410dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.011+0000 7f62c89f1700 1 --2- 172.21.15.117:0/4253542506 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62c40fcf80 0x7f62c410dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.011+0000 7f62c89f1700 1 -- 172.21.15.117:0/4253542506 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b0005040 con 0x7f62c40fbcd0 2024-04-12T09:08:27.013 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.011+0000 7f62c89f1700 1 --2- 172.21.15.117:0/4253542506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62c40fbcd0 0x7f62c410daa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f62b8002a50 tx=0x7f62b80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:27.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.011+0000 7f62c17fa700 1 -- 172.21.15.117:0/4253542506 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62b8007cc0 con 0x7f62c40fbcd0 2024-04-12T09:08:27.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.012+0000 7f62c17fa700 1 -- 172.21.15.117:0/4253542506 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f62b800f040 con 0x7f62c40fbcd0 2024-04-12T09:08:27.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.012+0000 7f62cac55700 1 -- 172.21.15.117:0/4253542506 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c410f0c0 con 0x7f62c40fbcd0 2024-04-12T09:08:27.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.012+0000 7f62c17fa700 1 -- 172.21.15.117:0/4253542506 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62b800da30 con 0x7f62c40fbcd0 2024-04-12T09:08:27.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.012+0000 7f62cac55700 1 -- 172.21.15.117:0/4253542506 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c410f600 con 0x7f62c40fbcd0 2024-04-12T09:08:27.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.013+0000 7f62cac55700 1 -- 172.21.15.117:0/4253542506 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c4101b10 con 0x7f62c40fbcd0 2024-04-12T09:08:27.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.014+0000 7f62c17fa700 1 -- 172.21.15.117:0/4253542506 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f62b800db90 con 0x7f62c40fbcd0 2024-04-12T09:08:27.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.014+0000 7f62c17fa700 1 --2- 172.21.15.117:0/4253542506 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f62b40692a0 0x7f62b406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:27.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.015+0000 7f62c17fa700 1 -- 172.21.15.117:0/4253542506 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f62b8086e90 con 0x7f62c40fbcd0 2024-04-12T09:08:27.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.015+0000 7f62c3fff700 1 --2- 172.21.15.117:0/4253542506 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f62b40692a0 0x7f62b406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:27.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.015+0000 7f62c3fff700 1 --2- 172.21.15.117:0/4253542506 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f62b40692a0 0x7f62b406b750 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f62b000b970 tx=0x7f62b0009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:27.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.019+0000 7f62c17fa700 1 -- 172.21.15.117:0/4253542506 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f62b8056c50 con 0x7f62c40fbcd0 2024-04-12T09:08:27.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.256+0000 7f62cac55700 1 -- 172.21.15.117:0/4253542506 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f62c405f5f0 con 0x7f62c40fbcd0 2024-04-12T09:08:27.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.548+0000 7f62c17fa700 1 -- 172.21.15.117:0/4253542506 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v10) v1 ==== 133+0+0 (secure 0 0 0) 0x7f62b80567e0 con 0x7f62c40fbcd0 2024-04-12T09:08:27.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.551+0000 7f62cac55700 1 -- 172.21.15.117:0/4253542506 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f62b40692a0 msgr2=0x7f62b406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:27.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.551+0000 7f62cac55700 1 --2- 172.21.15.117:0/4253542506 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f62b40692a0 0x7f62b406b750 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f62b000b970 tx=0x7f62b0009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:27.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.551+0000 7f62cac55700 1 -- 172.21.15.117:0/4253542506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62c40fbcd0 msgr2=0x7f62c410daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:27.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.551+0000 7f62cac55700 1 --2- 172.21.15.117:0/4253542506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62c40fbcd0 0x7f62c410daa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f62b8002a50 tx=0x7f62b80046b0 comp rx=0 tx=0).stop 2024-04-12T09:08:27.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.551+0000 7f62cac55700 1 -- 172.21.15.117:0/4253542506 shutdown_connections 2024-04-12T09:08:27.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.551+0000 7f62cac55700 1 --2- 172.21.15.117:0/4253542506 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f62b40692a0 0x7f62b406b750 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:27.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.551+0000 7f62cac55700 1 --2- 172.21.15.117:0/4253542506 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62c40fbcd0 0x7f62c410daa0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:27.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.551+0000 7f62cac55700 1 --2- 172.21.15.117:0/4253542506 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62c40fcf80 0x7f62c410dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:27.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.551+0000 7f62cac55700 1 -- 172.21.15.117:0/4253542506 >> 172.21.15.117:0/4253542506 conn(0x7f62c40f7430 msgr2=0x7f62c4065b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:27.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.551+0000 7f62cac55700 1 -- 172.21.15.117:0/4253542506 shutdown_connections 2024-04-12T09:08:27.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:27.551+0000 7f62cac55700 1 -- 172.21.15.117:0/4253542506 wait complete. 2024-04-12T09:08:27.553 INFO:teuthology.orchestra.run.smithi117.stderr:inline data disabled 2024-04-12T09:08:27.743 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:27 smithi203 ceph-mon[36428]: mds.? [v2:172.21.15.203:6826/2731911290,v1:172.21.15.203:6827/2731911290] up:boot 2024-04-12T09:08:27.743 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:27 smithi203 ceph-mon[36428]: fsmap cephfs:1 {0=cephfs.smithi117.wddsgt=up:active} 3 up:standby 2024-04-12T09:08:27.743 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:27 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.bszhxz"}]: dispatch 2024-04-12T09:08:27.743 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:27 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/4253542506' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-04-12T09:08:27.899 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:27 smithi117 ceph-mon[29277]: mds.? [v2:172.21.15.203:6826/2731911290,v1:172.21.15.203:6827/2731911290] up:boot 2024-04-12T09:08:27.899 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:27 smithi117 ceph-mon[29277]: fsmap cephfs:1 {0=cephfs.smithi117.wddsgt=up:active} 3 up:standby 2024-04-12T09:08:27.899 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:27 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.bszhxz"}]: dispatch 2024-04-12T09:08:27.900 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:27 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/4253542506' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-04-12T09:08:28.271 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-12T09:08:28.282 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi117.front.sepia.ceph.com 2024-04-12T09:08:28.282 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-12T09:08:28.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:28 smithi203 ceph-mon[36428]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-04-12T09:08:28.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:28 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/4253542506' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-04-12T09:08:28.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:28 smithi203 ceph-mon[36428]: mds.? [v2:172.21.15.203:6824/840607003,v1:172.21.15.203:6825/840607003] up:standby 2024-04-12T09:08:28.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:28 smithi203 ceph-mon[36428]: mds.? [v2:172.21.15.117:6828/2248590199,v1:172.21.15.117:6829/2248590199] up:standby 2024-04-12T09:08:28.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:28 smithi203 ceph-mon[36428]: Dropping low affinity active daemon mds.cephfs.smithi117.wddsgt in favor of higher affinity standby. 2024-04-12T09:08:28.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:28 smithi203 ceph-mon[36428]: Replacing daemon mds.cephfs.smithi117.wddsgt as rank 0 with standby daemon mds.cephfs.smithi117.eslmxh 2024-04-12T09:08:28.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:28 smithi203 ceph-mon[36428]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-12T09:08:28.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:28 smithi203 ceph-mon[36428]: fsmap cephfs:1 {0=cephfs.smithi117.wddsgt=up:active} 3 up:standby 2024-04-12T09:08:28.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:28 smithi203 ceph-mon[36428]: osdmap e46: 6 total, 6 up, 6 in 2024-04-12T09:08:28.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:28 smithi203 ceph-mon[36428]: fsmap cephfs:1/1 {0=cephfs.smithi117.eslmxh=up:replay} 2 up:standby 2024-04-12T09:08:28.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:28 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:28.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:28 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:28.854 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:28 smithi117 ceph-mon[29277]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-04-12T09:08:28.854 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:28 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/4253542506' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-04-12T09:08:28.854 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:28 smithi117 ceph-mon[29277]: mds.? [v2:172.21.15.203:6824/840607003,v1:172.21.15.203:6825/840607003] up:standby 2024-04-12T09:08:28.854 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:28 smithi117 ceph-mon[29277]: mds.? [v2:172.21.15.117:6828/2248590199,v1:172.21.15.117:6829/2248590199] up:standby 2024-04-12T09:08:28.854 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:28 smithi117 ceph-mon[29277]: Dropping low affinity active daemon mds.cephfs.smithi117.wddsgt in favor of higher affinity standby. 2024-04-12T09:08:28.854 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:28 smithi117 ceph-mon[29277]: Replacing daemon mds.cephfs.smithi117.wddsgt as rank 0 with standby daemon mds.cephfs.smithi117.eslmxh 2024-04-12T09:08:28.854 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:28 smithi117 ceph-mon[29277]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-12T09:08:28.854 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:28 smithi117 ceph-mon[29277]: fsmap cephfs:1 {0=cephfs.smithi117.wddsgt=up:active} 3 up:standby 2024-04-12T09:08:28.854 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:28 smithi117 ceph-mon[29277]: osdmap e46: 6 total, 6 up, 6 in 2024-04-12T09:08:28.854 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:28 smithi117 ceph-mon[29277]: fsmap cephfs:1/1 {0=cephfs.smithi117.eslmxh=up:replay} 2 up:standby 2024-04-12T09:08:28.854 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:28 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:28.854 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:28 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:29.187 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:08:29.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:29 smithi117 ceph-mon[29277]: mds.? [v2:172.21.15.117:6828/2248590199,v1:172.21.15.117:6829/2248590199] up:reconnect 2024-04-12T09:08:29.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:29 smithi117 ceph-mon[29277]: mds.? [v2:172.21.15.117:6826/4010127141,v1:172.21.15.117:6827/4010127141] up:boot 2024-04-12T09:08:29.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:29 smithi117 ceph-mon[29277]: fsmap cephfs:1/1 {0=cephfs.smithi117.eslmxh=up:reconnect} 3 up:standby 2024-04-12T09:08:29.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:29 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.wddsgt"}]: dispatch 2024-04-12T09:08:29.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:29 smithi203 ceph-mon[36428]: mds.? [v2:172.21.15.117:6828/2248590199,v1:172.21.15.117:6829/2248590199] up:reconnect 2024-04-12T09:08:29.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:29 smithi203 ceph-mon[36428]: mds.? [v2:172.21.15.117:6826/4010127141,v1:172.21.15.117:6827/4010127141] up:boot 2024-04-12T09:08:29.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:29 smithi203 ceph-mon[36428]: fsmap cephfs:1/1 {0=cephfs.smithi117.eslmxh=up:reconnect} 3 up:standby 2024-04-12T09:08:29.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:29 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.wddsgt"}]: dispatch 2024-04-12T09:08:30.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:30 smithi117 ceph-mon[29277]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 614 B/s rd, 409 B/s wr, 3 op/s 2024-04-12T09:08:30.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:30 smithi117 ceph-mon[29277]: mds.? [v2:172.21.15.117:6828/2248590199,v1:172.21.15.117:6829/2248590199] up:rejoin 2024-04-12T09:08:30.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:30 smithi117 ceph-mon[29277]: fsmap cephfs:1/1 {0=cephfs.smithi117.eslmxh=up:rejoin} 3 up:standby 2024-04-12T09:08:30.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:30 smithi117 ceph-mon[29277]: daemon mds.cephfs.smithi117.eslmxh is now active in filesystem cephfs as rank 0 2024-04-12T09:08:30.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:30 smithi203 ceph-mon[36428]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 614 B/s rd, 409 B/s wr, 3 op/s 2024-04-12T09:08:30.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:30 smithi203 ceph-mon[36428]: mds.? [v2:172.21.15.117:6828/2248590199,v1:172.21.15.117:6829/2248590199] up:rejoin 2024-04-12T09:08:30.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:30 smithi203 ceph-mon[36428]: fsmap cephfs:1/1 {0=cephfs.smithi117.eslmxh=up:rejoin} 3 up:standby 2024-04-12T09:08:30.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:30 smithi203 ceph-mon[36428]: daemon mds.cephfs.smithi117.eslmxh is now active in filesystem cephfs as rank 0 2024-04-12T09:08:31.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:31 smithi203 ceph-mon[36428]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-12T09:08:31.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:31 smithi203 ceph-mon[36428]: Cluster is now healthy 2024-04-12T09:08:31.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:31 smithi203 ceph-mon[36428]: mds.? [v2:172.21.15.117:6828/2248590199,v1:172.21.15.117:6829/2248590199] up:active 2024-04-12T09:08:31.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:31 smithi203 ceph-mon[36428]: mds.? [v2:172.21.15.203:6826/2731911290,v1:172.21.15.203:6827/2731911290] up:standby 2024-04-12T09:08:31.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:31 smithi203 ceph-mon[36428]: fsmap cephfs:1 {0=cephfs.smithi117.eslmxh=up:active} 3 up:standby 2024-04-12T09:08:31.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:31 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:31.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:31 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:08:31.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:31 smithi117 ceph-mon[29277]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-12T09:08:31.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:31 smithi117 ceph-mon[29277]: Cluster is now healthy 2024-04-12T09:08:31.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:31 smithi117 ceph-mon[29277]: mds.? [v2:172.21.15.117:6828/2248590199,v1:172.21.15.117:6829/2248590199] up:active 2024-04-12T09:08:31.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:31 smithi117 ceph-mon[29277]: mds.? [v2:172.21.15.203:6826/2731911290,v1:172.21.15.203:6827/2731911290] up:standby 2024-04-12T09:08:31.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:31 smithi117 ceph-mon[29277]: fsmap cephfs:1 {0=cephfs.smithi117.eslmxh=up:active} 3 up:standby 2024-04-12T09:08:31.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:31 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:31.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:31 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:08:32.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:32 smithi117 ceph-mon[29277]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 102 B/s wr, 1 op/s 2024-04-12T09:08:32.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.674+0000 7f1918b1e700 1 -- 172.21.15.117:0/1840568001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19140fe050 msgr2=0x7f19140fe4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:32.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.674+0000 7f1918b1e700 1 --2- 172.21.15.117:0/1840568001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19140fe050 0x7f19140fe4c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1908004940 tx=0x7f1908009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:32.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.674+0000 7f1918b1e700 1 -- 172.21.15.117:0/1840568001 shutdown_connections 2024-04-12T09:08:32.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.674+0000 7f1918b1e700 1 --2- 172.21.15.117:0/1840568001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19140fe050 0x7f19140fe4c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:32.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.674+0000 7f1918b1e700 1 --2- 172.21.15.117:0/1840568001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19140fce50 0x7f19140fd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:32.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.674+0000 7f1918b1e700 1 -- 172.21.15.117:0/1840568001 >> 172.21.15.117:0/1840568001 conn(0x7f19140f8580 msgr2=0x7f19140fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:32.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.674+0000 7f1918b1e700 1 -- 172.21.15.117:0/1840568001 shutdown_connections 2024-04-12T09:08:32.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.674+0000 7f1918b1e700 1 -- 172.21.15.117:0/1840568001 wait complete. 2024-04-12T09:08:32.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.675+0000 7f1918b1e700 1 Processor -- start 2024-04-12T09:08:32.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.675+0000 7f1918b1e700 1 -- start start 2024-04-12T09:08:32.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.675+0000 7f1918b1e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19140fce50 0x7f191410d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:32.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.675+0000 7f1918b1e700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19140fe050 0x7f191410de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:32.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.675+0000 7f1918b1e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191410e470 con 0x7f19140fce50 2024-04-12T09:08:32.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.675+0000 7f1918b1e700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191410e5e0 con 0x7f19140fe050 2024-04-12T09:08:32.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.675+0000 7f191259c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19140fce50 0x7f191410d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:32.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.675+0000 7f191259c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19140fce50 0x7f191410d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38362/0 (socket says 172.21.15.117:38362) 2024-04-12T09:08:32.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.675+0000 7f191259c700 1 -- 172.21.15.117:0/2422868339 learned_addr learned my addr 172.21.15.117:0/2422868339 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:08:32.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.675+0000 7f1911d9b700 1 --2- 172.21.15.117:0/2422868339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19140fe050 0x7f191410de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:32.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.675+0000 7f191259c700 1 -- 172.21.15.117:0/2422868339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19140fe050 msgr2=0x7f191410de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:32.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.675+0000 7f191259c700 1 --2- 172.21.15.117:0/2422868339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19140fe050 0x7f191410de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:32.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.675+0000 7f191259c700 1 -- 172.21.15.117:0/2422868339 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1908005040 con 0x7f19140fce50 2024-04-12T09:08:32.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.675+0000 7f191259c700 1 --2- 172.21.15.117:0/2422868339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19140fce50 0x7f191410d930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1904002a80 tx=0x7f1904004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:32.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.676+0000 7f1902ffd700 1 -- 172.21.15.117:0/2422868339 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1904007cc0 con 0x7f19140fce50 2024-04-12T09:08:32.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.676+0000 7f1902ffd700 1 -- 172.21.15.117:0/2422868339 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f190400f040 con 0x7f19140fce50 2024-04-12T09:08:32.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.676+0000 7f1918b1e700 1 -- 172.21.15.117:0/2422868339 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1914112fe0 con 0x7f19140fce50 2024-04-12T09:08:32.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.676+0000 7f1902ffd700 1 -- 172.21.15.117:0/2422868339 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f190400da30 con 0x7f19140fce50 2024-04-12T09:08:32.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.676+0000 7f1918b1e700 1 -- 172.21.15.117:0/2422868339 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1914113570 con 0x7f19140fce50 2024-04-12T09:08:32.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.677+0000 7f1918b1e700 1 -- 172.21.15.117:0/2422868339 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f191404c710 con 0x7f19140fce50 2024-04-12T09:08:32.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.677+0000 7f1902ffd700 1 -- 172.21.15.117:0/2422868339 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f190400db90 con 0x7f19140fce50 2024-04-12T09:08:32.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.677+0000 7f1902ffd700 1 --2- 172.21.15.117:0/2422868339 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f18fc0692a0 0x7f18fc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:32.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.678+0000 7f1911d9b700 1 --2- 172.21.15.117:0/2422868339 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f18fc0692a0 0x7f18fc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:32.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.678+0000 7f1902ffd700 1 -- 172.21.15.117:0/2422868339 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1904086f10 con 0x7f19140fce50 2024-04-12T09:08:32.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.678+0000 7f1911d9b700 1 --2- 172.21.15.117:0/2422868339 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f18fc0692a0 0x7f18fc06b750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1908009fd0 tx=0x7f1908009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:32.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.682+0000 7f1902ffd700 1 -- 172.21.15.117:0/2422868339 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f1904056c00 con 0x7f19140fce50 2024-04-12T09:08:32.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:32 smithi203 ceph-mon[36428]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 102 B/s wr, 1 op/s 2024-04-12T09:08:32.931 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.930+0000 7f1918b1e700 1 -- 172.21.15.117:0/2422868339 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1914113ad0 con 0x7f19140fce50 2024-04-12T09:08:32.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.931+0000 7f1902ffd700 1 -- 172.21.15.117:0/2422868339 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1814 (secure 0 0 0) 0x7f1904056790 con 0x7f19140fce50 2024-04-12T09:08:32.932 INFO:teuthology.orchestra.run.smithi117.stdout:e14 2024-04-12T09:08:32.932 INFO:teuthology.orchestra.run.smithi117.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T09:08:32.932 INFO:teuthology.orchestra.run.smithi117.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:08:32.932 INFO:teuthology.orchestra.run.smithi117.stdout:legacy client fscid: 1 2024-04-12T09:08:32.932 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:08:32.932 INFO:teuthology.orchestra.run.smithi117.stdout:Filesystem 'cephfs' (1) 2024-04-12T09:08:32.932 INFO:teuthology.orchestra.run.smithi117.stdout:fs_name cephfs 2024-04-12T09:08:32.932 INFO:teuthology.orchestra.run.smithi117.stdout:epoch 14 2024-04-12T09:08:32.933 INFO:teuthology.orchestra.run.smithi117.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T09:08:32.933 INFO:teuthology.orchestra.run.smithi117.stdout:created 2024-04-12T09:08:12.488144+0000 2024-04-12T09:08:32.933 INFO:teuthology.orchestra.run.smithi117.stdout:modified 2024-04-12T09:08:30.563184+0000 2024-04-12T09:08:32.933 INFO:teuthology.orchestra.run.smithi117.stdout:tableserver 0 2024-04-12T09:08:32.933 INFO:teuthology.orchestra.run.smithi117.stdout:root 0 2024-04-12T09:08:32.933 INFO:teuthology.orchestra.run.smithi117.stdout:session_timeout 60 2024-04-12T09:08:32.933 INFO:teuthology.orchestra.run.smithi117.stdout:session_autoclose 300 2024-04-12T09:08:32.933 INFO:teuthology.orchestra.run.smithi117.stdout:max_file_size 1099511627776 2024-04-12T09:08:32.933 INFO:teuthology.orchestra.run.smithi117.stdout:required_client_features {} 2024-04-12T09:08:32.933 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure 0 2024-04-12T09:08:32.933 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure_osd_epoch 46 2024-04-12T09:08:32.933 INFO:teuthology.orchestra.run.smithi117.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:08:32.934 INFO:teuthology.orchestra.run.smithi117.stdout:max_mds 1 2024-04-12T09:08:32.934 INFO:teuthology.orchestra.run.smithi117.stdout:in 0 2024-04-12T09:08:32.934 INFO:teuthology.orchestra.run.smithi117.stdout:up {0=14474} 2024-04-12T09:08:32.934 INFO:teuthology.orchestra.run.smithi117.stdout:failed 2024-04-12T09:08:32.934 INFO:teuthology.orchestra.run.smithi117.stdout:damaged 2024-04-12T09:08:32.934 INFO:teuthology.orchestra.run.smithi117.stdout:stopped 2024-04-12T09:08:32.934 INFO:teuthology.orchestra.run.smithi117.stdout:data_pools [3] 2024-04-12T09:08:32.934 INFO:teuthology.orchestra.run.smithi117.stdout:metadata_pool 2 2024-04-12T09:08:32.934 INFO:teuthology.orchestra.run.smithi117.stdout:inline_data disabled 2024-04-12T09:08:32.934 INFO:teuthology.orchestra.run.smithi117.stdout:balancer 2024-04-12T09:08:32.934 INFO:teuthology.orchestra.run.smithi117.stdout:standby_count_wanted 1 2024-04-12T09:08:32.934 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.eslmxh{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.117:6828/2248590199,v1:172.21.15.117:6829/2248590199] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:08:32.934 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:08:32.934 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:08:32.935 INFO:teuthology.orchestra.run.smithi117.stdout:Standby daemons: 2024-04-12T09:08:32.935 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:08:32.935 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.wddsgt{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/4010127141,v1:172.21.15.117:6827/4010127141] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:08:32.935 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.fbeixl{-1:24265} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.203:6824/840607003,v1:172.21.15.203:6825/840607003] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:08:32.935 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.bszhxz{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/2731911290,v1:172.21.15.203:6827/2731911290] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:08:32.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.934+0000 7f1918b1e700 1 -- 172.21.15.117:0/2422868339 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f18fc0692a0 msgr2=0x7f18fc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:32.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.934+0000 7f1918b1e700 1 --2- 172.21.15.117:0/2422868339 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f18fc0692a0 0x7f18fc06b750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1908009fd0 tx=0x7f1908009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:32.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.934+0000 7f1918b1e700 1 -- 172.21.15.117:0/2422868339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19140fce50 msgr2=0x7f191410d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:32.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.934+0000 7f1918b1e700 1 --2- 172.21.15.117:0/2422868339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19140fce50 0x7f191410d930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1904002a80 tx=0x7f1904004600 comp rx=0 tx=0).stop 2024-04-12T09:08:32.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.934+0000 7f1918b1e700 1 -- 172.21.15.117:0/2422868339 shutdown_connections 2024-04-12T09:08:32.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.934+0000 7f1918b1e700 1 --2- 172.21.15.117:0/2422868339 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f18fc0692a0 0x7f18fc06b750 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:32.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.934+0000 7f1918b1e700 1 --2- 172.21.15.117:0/2422868339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19140fce50 0x7f191410d930 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:32.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.934+0000 7f1918b1e700 1 --2- 172.21.15.117:0/2422868339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19140fe050 0x7f191410de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:32.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.934+0000 7f1918b1e700 1 -- 172.21.15.117:0/2422868339 >> 172.21.15.117:0/2422868339 conn(0x7f19140f8580 msgr2=0x7f19140f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:32.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.934+0000 7f1918b1e700 1 -- 172.21.15.117:0/2422868339 shutdown_connections 2024-04-12T09:08:32.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:32.934+0000 7f1918b1e700 1 -- 172.21.15.117:0/2422868339 wait complete. 2024-04-12T09:08:32.936 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 14 2024-04-12T09:08:33.589 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-04-12T09:08:33.873 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:33 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/2422868339' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:08:33.873 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:33 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:33.874 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:33 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:33.874 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:33 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:08:33.874 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:33 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:08:33.874 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:33 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:33.874 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:33 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:08:33.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:33 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/2422868339' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:08:33.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:33 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:33.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:33 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:33.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:33 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:08:33.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:33 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:08:33.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:33 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:33.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:33 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:08:34.380 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:08:34.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:34 smithi203 ceph-mon[36428]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-04-12T09:08:34.836 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:34 smithi117 ceph-mon[29277]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-04-12T09:08:36.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:36.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:36.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:36 smithi117 ceph-mon[29277]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 4 op/s 2024-04-12T09:08:36.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:36 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:36.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:36 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:36.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:36 smithi203 ceph-mon[36428]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 4 op/s 2024-04-12T09:08:36.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.687+0000 7f593e7c4700 1 -- 172.21.15.117:0/2634998223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59380fbce0 msgr2=0x7f59380fc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:36.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.687+0000 7f593e7c4700 1 --2- 172.21.15.117:0/2634998223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59380fbce0 0x7f59380fc0f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5928004940 tx=0x7f5928009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:36.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.687+0000 7f593e7c4700 1 -- 172.21.15.117:0/2634998223 shutdown_connections 2024-04-12T09:08:36.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.687+0000 7f593e7c4700 1 --2- 172.21.15.117:0/2634998223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59380fcf90 0x7f59380fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:36.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.687+0000 7f593e7c4700 1 --2- 172.21.15.117:0/2634998223 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59380fbce0 0x7f59380fc0f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:36.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.687+0000 7f593e7c4700 1 -- 172.21.15.117:0/2634998223 >> 172.21.15.117:0/2634998223 conn(0x7f59380f7480 msgr2=0x7f59380f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:36.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.687+0000 7f593e7c4700 1 -- 172.21.15.117:0/2634998223 shutdown_connections 2024-04-12T09:08:36.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.687+0000 7f593e7c4700 1 -- 172.21.15.117:0/2634998223 wait complete. 2024-04-12T09:08:36.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.687+0000 7f593e7c4700 1 Processor -- start 2024-04-12T09:08:36.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.687+0000 7f593e7c4700 1 -- start start 2024-04-12T09:08:36.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.687+0000 7f593e7c4700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59380fbce0 0x7f593810da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:36.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.687+0000 7f593e7c4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59380fcf90 0x7f593810df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:36.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.687+0000 7f593e7c4700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593810e560 con 0x7f59380fcf90 2024-04-12T09:08:36.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.687+0000 7f593e7c4700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593810edb0 con 0x7f59380fbce0 2024-04-12T09:08:36.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.688+0000 7f59377fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59380fcf90 0x7f593810df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:36.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.688+0000 7f59377fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59380fcf90 0x7f593810df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38382/0 (socket says 172.21.15.117:38382) 2024-04-12T09:08:36.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.688+0000 7f59377fe700 1 -- 172.21.15.117:0/4212496346 learned_addr learned my addr 172.21.15.117:0/4212496346 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:08:36.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.688+0000 7f5937fff700 1 --2- 172.21.15.117:0/4212496346 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59380fbce0 0x7f593810da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:36.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.688+0000 7f5937fff700 1 -- 172.21.15.117:0/4212496346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59380fcf90 msgr2=0x7f593810df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:36.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.688+0000 7f5937fff700 1 --2- 172.21.15.117:0/4212496346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59380fcf90 0x7f593810df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:36.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.688+0000 7f5937fff700 1 -- 172.21.15.117:0/4212496346 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5928005040 con 0x7f59380fbce0 2024-04-12T09:08:36.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.689+0000 7f5937fff700 1 --2- 172.21.15.117:0/4212496346 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59380fbce0 0x7f593810da20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f592800b3b0 tx=0x7f5928009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:36.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.689+0000 7f5934ff9700 1 -- 172.21.15.117:0/4212496346 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f592800e040 con 0x7f59380fbce0 2024-04-12T09:08:36.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.689+0000 7f593e7c4700 1 -- 172.21.15.117:0/4212496346 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593810f030 con 0x7f59380fbce0 2024-04-12T09:08:36.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.689+0000 7f593e7c4700 1 -- 172.21.15.117:0/4212496346 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593810f570 con 0x7f59380fbce0 2024-04-12T09:08:36.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.689+0000 7f5934ff9700 1 -- 172.21.15.117:0/4212496346 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f592800bbf0 con 0x7f59380fbce0 2024-04-12T09:08:36.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.689+0000 7f5934ff9700 1 -- 172.21.15.117:0/4212496346 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5928013420 con 0x7f59380fbce0 2024-04-12T09:08:36.692 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.690+0000 7f593e7c4700 1 -- 172.21.15.117:0/4212496346 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5938101b20 con 0x7f59380fbce0 2024-04-12T09:08:36.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.691+0000 7f5934ff9700 1 -- 172.21.15.117:0/4212496346 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f592801d440 con 0x7f59380fbce0 2024-04-12T09:08:36.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.691+0000 7f5934ff9700 1 --2- 172.21.15.117:0/4212496346 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f59200692a0 0x7f592006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:36.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.691+0000 7f59377fe700 1 --2- 172.21.15.117:0/4212496346 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f59200692a0 0x7f592006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:36.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.691+0000 7f5934ff9700 1 -- 172.21.15.117:0/4212496346 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f5928088490 con 0x7f59380fbce0 2024-04-12T09:08:36.693 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.692+0000 7f59377fe700 1 --2- 172.21.15.117:0/4212496346 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f59200692a0 0x7f592006b750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f592c0041d0 tx=0x7f592c00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:36.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.696+0000 7f5934ff9700 1 -- 172.21.15.117:0/4212496346 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f5928058200 con 0x7f59380fbce0 2024-04-12T09:08:36.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.931+0000 7f593e7c4700 1 -- 172.21.15.117:0/4212496346 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f593805f5f0 con 0x7f59380fbce0 2024-04-12T09:08:36.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.932+0000 7f5934ff9700 1 -- 172.21.15.117:0/4212496346 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4697 (secure 0 0 0) 0x7f5928057d90 con 0x7f59380fbce0 2024-04-12T09:08:36.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.934+0000 7f593e7c4700 1 -- 172.21.15.117:0/4212496346 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f59200692a0 msgr2=0x7f592006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:36.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.934+0000 7f593e7c4700 1 --2- 172.21.15.117:0/4212496346 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f59200692a0 0x7f592006b750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f592c0041d0 tx=0x7f592c00b040 comp rx=0 tx=0).stop 2024-04-12T09:08:36.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.934+0000 7f593e7c4700 1 -- 172.21.15.117:0/4212496346 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59380fbce0 msgr2=0x7f593810da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:36.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.934+0000 7f593e7c4700 1 --2- 172.21.15.117:0/4212496346 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59380fbce0 0x7f593810da20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f592800b3b0 tx=0x7f5928009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:36.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.935+0000 7f593e7c4700 1 -- 172.21.15.117:0/4212496346 shutdown_connections 2024-04-12T09:08:36.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.935+0000 7f593e7c4700 1 --2- 172.21.15.117:0/4212496346 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f59200692a0 0x7f592006b750 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:36.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.935+0000 7f593e7c4700 1 --2- 172.21.15.117:0/4212496346 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59380fbce0 0x7f593810da20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:36.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.935+0000 7f593e7c4700 1 --2- 172.21.15.117:0/4212496346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f59380fcf90 0x7f593810df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:36.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.935+0000 7f593e7c4700 1 -- 172.21.15.117:0/4212496346 >> 172.21.15.117:0/4212496346 conn(0x7f59380f7480 msgr2=0x7f59380f8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:36.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.935+0000 7f593e7c4700 1 -- 172.21.15.117:0/4212496346 shutdown_connections 2024-04-12T09:08:36.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:36.935+0000 7f593e7c4700 1 -- 172.21.15.117:0/4212496346 wait complete. 2024-04-12T09:08:36.937 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 14 2024-04-12T09:08:36.946 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:08:37.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:37 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/4212496346' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-12T09:08:37.646 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:37 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/4212496346' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-12T09:08:37.963 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-04-12T09:08:38.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:38 smithi203 ceph-mon[36428]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 4 op/s 2024-04-12T09:08:38.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:38 smithi117 ceph-mon[29277]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 4 op/s 2024-04-12T09:08:39.430 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:08:40.759 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:40 smithi117 ceph-mon[29277]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.3 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-12T09:08:40.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:40 smithi203 ceph-mon[36428]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.3 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-12T09:08:40.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.953+0000 7ff90a95b700 1 -- 172.21.15.117:0/3933112107 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9040fce40 msgr2=0x7ff9040fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:40.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.953+0000 7ff90a95b700 1 --2- 172.21.15.117:0/3933112107 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9040fce40 0x7ff9040fd250 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4004940 tx=0x7ff8f4009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.953+0000 7ff90a95b700 1 -- 172.21.15.117:0/3933112107 shutdown_connections 2024-04-12T09:08:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.953+0000 7ff90a95b700 1 --2- 172.21.15.117:0/3933112107 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9040fe040 0x7ff9040fe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.953+0000 7ff90a95b700 1 --2- 172.21.15.117:0/3933112107 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9040fce40 0x7ff9040fd250 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.953+0000 7ff90a95b700 1 -- 172.21.15.117:0/3933112107 >> 172.21.15.117:0/3933112107 conn(0x7ff9040f8550 msgr2=0x7ff9040fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.953+0000 7ff90a95b700 1 -- 172.21.15.117:0/3933112107 shutdown_connections 2024-04-12T09:08:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.953+0000 7ff90a95b700 1 -- 172.21.15.117:0/3933112107 wait complete. 2024-04-12T09:08:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.953+0000 7ff90a95b700 1 Processor -- start 2024-04-12T09:08:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.954+0000 7ff90a95b700 1 -- start start 2024-04-12T09:08:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.954+0000 7ff90a95b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9040fce40 0x7ff90410da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.954+0000 7ff90a95b700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9040fe040 0x7ff90410df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.954+0000 7ff90a95b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90410e580 con 0x7ff9040fce40 2024-04-12T09:08:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.954+0000 7ff90a95b700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90410edd0 con 0x7ff9040fe040 2024-04-12T09:08:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.954+0000 7ff903fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9040fce40 0x7ff90410da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.954+0000 7ff903fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9040fce40 0x7ff90410da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58090/0 (socket says 172.21.15.117:58090) 2024-04-12T09:08:40.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.954+0000 7ff903fff700 1 -- 172.21.15.117:0/3279771157 learned_addr learned my addr 172.21.15.117:0/3279771157 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:08:40.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.954+0000 7ff9037fe700 1 --2- 172.21.15.117:0/3279771157 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9040fe040 0x7ff90410df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:40.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.954+0000 7ff903fff700 1 -- 172.21.15.117:0/3279771157 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9040fe040 msgr2=0x7ff90410df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:40.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.954+0000 7ff903fff700 1 --2- 172.21.15.117:0/3279771157 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9040fe040 0x7ff90410df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:40.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.954+0000 7ff903fff700 1 -- 172.21.15.117:0/3279771157 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f4005040 con 0x7ff9040fce40 2024-04-12T09:08:40.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.954+0000 7ff903fff700 1 --2- 172.21.15.117:0/3279771157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9040fce40 0x7ff90410da40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff8f400b3b0 tx=0x7ff8f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:40.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.955+0000 7ff900ff9700 1 -- 172.21.15.117:0/3279771157 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8f400e040 con 0x7ff9040fce40 2024-04-12T09:08:40.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.955+0000 7ff90a95b700 1 -- 172.21.15.117:0/3279771157 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff90410f050 con 0x7ff9040fce40 2024-04-12T09:08:40.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.955+0000 7ff900ff9700 1 -- 172.21.15.117:0/3279771157 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff8f400bcc0 con 0x7ff9040fce40 2024-04-12T09:08:40.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.955+0000 7ff900ff9700 1 -- 172.21.15.117:0/3279771157 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8f401c630 con 0x7ff9040fce40 2024-04-12T09:08:40.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.955+0000 7ff90a95b700 1 -- 172.21.15.117:0/3279771157 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff90410f590 con 0x7ff9040fce40 2024-04-12T09:08:40.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.956+0000 7ff90a95b700 1 -- 172.21.15.117:0/3279771157 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff90405f5f0 con 0x7ff9040fce40 2024-04-12T09:08:40.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.956+0000 7ff900ff9700 1 -- 172.21.15.117:0/3279771157 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ff8f4013420 con 0x7ff9040fce40 2024-04-12T09:08:40.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.956+0000 7ff900ff9700 1 --2- 172.21.15.117:0/3279771157 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7ff8ec0692a0 0x7ff8ec06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:40.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.956+0000 7ff900ff9700 1 -- 172.21.15.117:0/3279771157 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff8f4087ed0 con 0x7ff9040fce40 2024-04-12T09:08:40.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.956+0000 7ff9037fe700 1 --2- 172.21.15.117:0/3279771157 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7ff8ec0692a0 0x7ff8ec06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:40.958 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.957+0000 7ff9037fe700 1 --2- 172.21.15.117:0/3279771157 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7ff8ec0692a0 0x7ff8ec06b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8007fd0 tx=0x7ff8f8009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:40.961 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:40.961+0000 7ff900ff9700 1 -- 172.21.15.117:0/3279771157 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7ff8f4057ce0 con 0x7ff9040fce40 2024-04-12T09:08:41.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.238+0000 7ff90a95b700 1 -- 172.21.15.117:0/3279771157 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7ff90404bed0 con 0x7ff9040fce40 2024-04-12T09:08:41.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.239+0000 7ff900ff9700 1 -- 172.21.15.117:0/3279771157 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v14) v1 ==== 78+0+99 (secure 0 0 0) 0x7ff8f4057870 con 0x7ff9040fce40 2024-04-12T09:08:41.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.240+0000 7ff90a95b700 1 -- 172.21.15.117:0/3279771157 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7ff8ec0692a0 msgr2=0x7ff8ec06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:41.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.240+0000 7ff90a95b700 1 --2- 172.21.15.117:0/3279771157 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7ff8ec0692a0 0x7ff8ec06b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8007fd0 tx=0x7ff8f8009040 comp rx=0 tx=0).stop 2024-04-12T09:08:41.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.240+0000 7ff90a95b700 1 -- 172.21.15.117:0/3279771157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9040fce40 msgr2=0x7ff90410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:41.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.240+0000 7ff90a95b700 1 --2- 172.21.15.117:0/3279771157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9040fce40 0x7ff90410da40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff8f400b3b0 tx=0x7ff8f4009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:41.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.241+0000 7ff90a95b700 1 -- 172.21.15.117:0/3279771157 shutdown_connections 2024-04-12T09:08:41.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.241+0000 7ff90a95b700 1 --2- 172.21.15.117:0/3279771157 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7ff8ec0692a0 0x7ff8ec06b750 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:41.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.241+0000 7ff90a95b700 1 --2- 172.21.15.117:0/3279771157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9040fce40 0x7ff90410da40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:41.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.241+0000 7ff90a95b700 1 --2- 172.21.15.117:0/3279771157 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9040fe040 0x7ff90410df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:41.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.241+0000 7ff90a95b700 1 -- 172.21.15.117:0/3279771157 >> 172.21.15.117:0/3279771157 conn(0x7ff9040f8550 msgr2=0x7ff9040f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:41.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.241+0000 7ff90a95b700 1 -- 172.21.15.117:0/3279771157 shutdown_connections 2024-04-12T09:08:41.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.241+0000 7ff90a95b700 1 -- 172.21.15.117:0/3279771157 wait complete. 2024-04-12T09:08:41.251 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:08:41.842 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-04-12T09:08:41.855 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T09:08:41.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.961+0000 7f686739d640 1 -- 172.21.15.117:0/160859603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f686006fd80 msgr2=0x7f68600701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:41.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.961+0000 7f686739d640 1 --2- 172.21.15.117:0/160859603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f686006fd80 0x7f68600701f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f68500048d0 tx=0x7f6850009da0 comp rx=0 tx=0).stop 2024-04-12T09:08:41.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.962+0000 7f686739d640 1 -- 172.21.15.117:0/160859603 shutdown_connections 2024-04-12T09:08:41.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.962+0000 7f686739d640 1 --2- 172.21.15.117:0/160859603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f686006fd80 0x7f68600701f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:41.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.962+0000 7f686739d640 1 --2- 172.21.15.117:0/160859603 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6860071310 0x7f686006f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:41.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.962+0000 7f686739d640 1 -- 172.21.15.117:0/160859603 >> 172.21.15.117:0/160859603 conn(0x7f68600f77a0 msgr2=0x7f68600f9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:41.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.962+0000 7f686739d640 1 -- 172.21.15.117:0/160859603 shutdown_connections 2024-04-12T09:08:41.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.962+0000 7f686739d640 1 -- 172.21.15.117:0/160859603 wait complete. 2024-04-12T09:08:41.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.962+0000 7f686739d640 1 Processor -- start 2024-04-12T09:08:41.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.962+0000 7f686739d640 1 -- start start 2024-04-12T09:08:41.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.962+0000 7f686739d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f686006fd80 0x7f686010edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:41.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.962+0000 7f686739d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6860071310 0x7f686010f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:41.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.962+0000 7f686739d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686010f9f0 con 0x7f686006fd80 2024-04-12T09:08:41.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.962+0000 7f686739d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6860114320 con 0x7f6860071310 2024-04-12T09:08:41.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.962+0000 7f686639b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f686006fd80 0x7f686010edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:41.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.962+0000 7f686639b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f686006fd80 0x7f686010edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58112/0 (socket says 172.21.15.117:58112) 2024-04-12T09:08:41.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.962+0000 7f686639b640 1 -- 172.21.15.117:0/2904540864 learned_addr learned my addr 172.21.15.117:0/2904540864 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:08:41.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.962+0000 7f6865b9a640 1 --2- 172.21.15.117:0/2904540864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6860071310 0x7f686010f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:41.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.963+0000 7f686639b640 1 -- 172.21.15.117:0/2904540864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6860071310 msgr2=0x7f686010f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:41.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.963+0000 7f686639b640 1 --2- 172.21.15.117:0/2904540864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6860071310 0x7f686010f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:41.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.963+0000 7f686639b640 1 -- 172.21.15.117:0/2904540864 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6850005040 con 0x7f686006fd80 2024-04-12T09:08:41.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.963+0000 7f686639b640 1 --2- 172.21.15.117:0/2904540864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f686006fd80 0x7f686010edd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f685c00b580 tx=0x7f685c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:41.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.963+0000 7f6856ffd640 1 -- 172.21.15.117:0/2904540864 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f685c00f570 con 0x7f686006fd80 2024-04-12T09:08:41.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.963+0000 7f6856ffd640 1 -- 172.21.15.117:0/2904540864 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f685c00fba0 con 0x7f686006fd80 2024-04-12T09:08:41.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.963+0000 7f686739d640 1 -- 172.21.15.117:0/2904540864 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6860114520 con 0x7f686006fd80 2024-04-12T09:08:41.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.963+0000 7f6856ffd640 1 -- 172.21.15.117:0/2904540864 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f685c010dd0 con 0x7f686006fd80 2024-04-12T09:08:41.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.963+0000 7f686739d640 1 -- 172.21.15.117:0/2904540864 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6860114a40 con 0x7f686006fd80 2024-04-12T09:08:41.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.964+0000 7f686739d640 1 -- 172.21.15.117:0/2904540864 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686004bcc0 con 0x7f686006fd80 2024-04-12T09:08:41.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.964+0000 7f6856ffd640 1 -- 172.21.15.117:0/2904540864 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f685c00f6d0 con 0x7f686006fd80 2024-04-12T09:08:41.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.965+0000 7f6856ffd640 1 --2- 172.21.15.117:0/2904540864 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f684c069210 0x7f684c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:41.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.965+0000 7f6865b9a640 1 --2- 172.21.15.117:0/2904540864 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f684c069210 0x7f684c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:41.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.965+0000 7f6856ffd640 1 -- 172.21.15.117:0/2904540864 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f685c087090 con 0x7f686006fd80 2024-04-12T09:08:41.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.965+0000 7f6865b9a640 1 --2- 172.21.15.117:0/2904540864 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f684c069210 0x7f684c06b6c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f68500317e0 tx=0x7f6850009da0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:41.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:41.969+0000 7f6856ffd640 1 -- 172.21.15.117:0/2904540864 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f685c053370 con 0x7f686006fd80 2024-04-12T09:08:42.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.137+0000 7f686739d640 1 -- 172.21.15.117:0/2904540864 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6860114e30 con 0x7f686006fd80 2024-04-12T09:08:42.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.137+0000 7f6856ffd640 1 -- 172.21.15.117:0/2904540864 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+14409 (secure 0 0 0) 0x7f685c056990 con 0x7f686006fd80 2024-04-12T09:08:42.138 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:08:42.138 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":46,"fsid":"12161984-f8ab-11ee-bc8c-c7b262605968","created":"2024-04-12T09:01:24.210047+0000","modified":"2024-04-12T09:08:27.549595+0000","last_up_change":"2024-04-12T09:06:52.669995+0000","last_in_change":"2024-04-12T09:06:33.833263+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T09:05:39.657213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-12T09:08:11.435513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-12T09:08:11.715605+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a8bdd258-6f40-440f-b279-038d9b35e791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":789453361},{"type":"v1","addr":"172.21.15.117:6803","nonce":789453361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":789453361},{"type":"v1","addr":"172.21.15.117:6805","nonce":789453361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":789453361},{"type":"v1","addr":"172.21.15.117:6809","nonce":789453361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":789453361},{"type":"v1","addr":"172.21.15.117:6807","nonce":789453361}]},"public_addr":"172.21.15.117:6803/789453361","cluster_addr":"172.21.15.117:6805/789453361","heartbeat_back_addr":"172.21.15.117:6809/789453361","heartbeat_front_addr":"172.21.15.117:6807/789453361","state":["exists","up"]},{"osd":1,"uuid":"ab723885-9e88-47ad-8e80-cb5871bf0d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":3995491575},{"type":"v1","addr":"172.21.15.117:6811","nonce":3995491575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":3995491575},{"type":"v1","addr":"172.21.15.117:6813","nonce":3995491575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":3995491575},{"type":"v1","addr":"172.21.15.117:6817","nonce":3995491575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":3995491575},{"type":"v1","addr":"172.21.15.117:6815","nonce":3995491575}]},"public_addr":"172.21.15.117:6811/3995491575","cluster_addr":"172.21.15.117:6813/3995491575","heartbeat_back_addr":"172.21.15.117:6817/3995491575","heartbeat_front_addr":"172.21.15.117:6815/3995491575","state":["exists","up"]},{"osd":2,"uuid":"14f76ed3-2938-45c1-9cc7-4c0486c602ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":3707487846},{"type":"v1","addr":"172.21.15.117:6819","nonce":3707487846}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":3707487846},{"type":"v1","addr":"172.21.15.117:6821","nonce":3707487846}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3707487846},{"type":"v1","addr":"172.21.15.117:6825","nonce":3707487846}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":3707487846},{"type":"v1","addr":"172.21.15.117:6823","nonce":3707487846}]},"public_addr":"172.21.15.117:6819/3707487846","cluster_addr":"172.21.15.117:6821/3707487846","heartbeat_back_addr":"172.21.15.117:6825/3707487846","heartbeat_front_addr":"172.21.15.117:6823/3707487846","state":["exists","up"]},{"osd":3,"uuid":"e2bd1672-4153-498a-a20b-838516b0876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":824187707},{"type":"v1","addr":"172.21.15.203:6801","nonce":824187707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":824187707},{"type":"v1","addr":"172.21.15.203:6803","nonce":824187707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":824187707},{"type":"v1","addr":"172.21.15.203:6807","nonce":824187707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":824187707},{"type":"v1","addr":"172.21.15.203:6805","nonce":824187707}]},"public_addr":"172.21.15.203:6801/824187707","cluster_addr":"172.21.15.203:6803/824187707","heartbeat_back_addr":"172.21.15.203:6807/824187707","heartbeat_front_addr":"172.21.15.203:6805/824187707","state":["exists","up"]},{"osd":4,"uuid":"e8e6b7b8-45c2-4186-aeef-9b2feccf9fe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":22684123},{"type":"v1","addr":"172.21.15.203:6809","nonce":22684123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":22684123},{"type":"v1","addr":"172.21.15.203:6811","nonce":22684123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":22684123},{"type":"v1","addr":"172.21.15.203:6815","nonce":22684123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":22684123},{"type":"v1","addr":"172.21.15.203:6813","nonce":22684123}]},"public_addr":"172.21.15.203:6809/22684123","cluster_addr":"172.21.15.203:6811/22684123","heartbeat_back_addr":"172.21.15.203:6815/22684123","heartbeat_front_addr":"172.21.15.203:6813/22684123","state":["exists","up"]},{"osd":5,"uuid":"abbad141-29e9-4028-9e29-293cc73169fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2594776016},{"type":"v1","addr":"172.21.15.203:6817","nonce":2594776016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2594776016},{"type":"v1","addr":"172.21.15.203:6819","nonce":2594776016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2594776016},{"type":"v1","addr":"172.21.15.203:6823","nonce":2594776016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2594776016},{"type":"v1","addr":"172.21.15.203:6821","nonce":2594776016}]},"public_addr":"172.21.15.203:6817/2594776016","cluster_addr":"172.21.15.203:6819/2594776016","heartbeat_back_addr":"172.21.15.203:6823/2594776016","heartbeat_front_addr":"172.21.15.203:6821/2594776016","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:04:41.240834+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:05:09.825336+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:05:37.699545+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:06:01.471956+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:06:25.743473+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:06:50.806872+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.117:6827/1717609783":"2024-04-13T09:08:27.549563+0000","172.21.15.117:0/2305921992":"2024-04-13T09:01:50.340337+0000","172.21.15.117:0/2869338383":"2024-04-13T09:02:21.422544+0000","172.21.15.117:6826/1717609783":"2024-04-13T09:08:27.549563+0000","172.21.15.117:0/960981120":"2024-04-13T09:01:50.340337+0000","172.21.15.117:0/2514545829":"2024-04-13T09:03:31.333423+0000","172.21.15.117:6801/790148838":"2024-04-13T09:03:31.333423+0000","172.21.15.117:0/4018826114":"2024-04-13T09:01:50.340337+0000","172.21.15.117:6800/2893585477":"2024-04-13T09:01:50.340337+0000","172.21.15.117:0/86407959":"2024-04-13T09:02:21.422544+0000","172.21.15.117:0/4061615302":"2024-04-13T09:03:31.333423+0000","172.21.15.117:6800/791370182":"2024-04-13T09:02:21.422544+0000","172.21.15.117:6801/2893585477":"2024-04-13T09:01:50.340337+0000","172.21.15.117:6801/791370182":"2024-04-13T09:02:21.422544+0000","172.21.15.117:0/2635780056":"2024-04-13T09:02:21.422544+0000","172.21.15.117:0/448067539":"2024-04-13T09:03:31.333423+0000","172.21.15.117:6800/790148838":"2024-04-13T09:03:31.333423+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T09:08:42.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.139+0000 7f686739d640 1 -- 172.21.15.117:0/2904540864 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f684c069210 msgr2=0x7f684c06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:42.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.139+0000 7f686739d640 1 --2- 172.21.15.117:0/2904540864 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f684c069210 0x7f684c06b6c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f68500317e0 tx=0x7f6850009da0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.139+0000 7f686739d640 1 -- 172.21.15.117:0/2904540864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f686006fd80 msgr2=0x7f686010edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:42.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.139+0000 7f686739d640 1 --2- 172.21.15.117:0/2904540864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f686006fd80 0x7f686010edd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f685c00b580 tx=0x7f685c0091a0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.139+0000 7f686739d640 1 -- 172.21.15.117:0/2904540864 shutdown_connections 2024-04-12T09:08:42.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.139+0000 7f686739d640 1 --2- 172.21.15.117:0/2904540864 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f684c069210 0x7f684c06b6c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.139+0000 7f686739d640 1 --2- 172.21.15.117:0/2904540864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6860071310 0x7f686010f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.139+0000 7f686739d640 1 --2- 172.21.15.117:0/2904540864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f686006fd80 0x7f686010edd0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.139+0000 7f686739d640 1 -- 172.21.15.117:0/2904540864 >> 172.21.15.117:0/2904540864 conn(0x7f68600f77a0 msgr2=0x7f68600f8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:42.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.139+0000 7f686739d640 1 -- 172.21.15.117:0/2904540864 shutdown_connections 2024-04-12T09:08:42.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.139+0000 7f686739d640 1 -- 172.21.15.117:0/2904540864 wait complete. 2024-04-12T09:08:42.150 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:42 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:42.150 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:42 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:42.150 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:42 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:08:42.150 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:42 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:08:42.150 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:42 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:42.150 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:42 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/3279771157' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-12T09:08:42.150 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:42 smithi117 ceph-mon[29277]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-12T09:08:42.152 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-12T09:05:39.657213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-12T09:08:11.435513+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-12T09:08:11.715605+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-12T09:08:42.152 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-12T09:08:42.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.251+0000 7ff73219d640 1 -- 172.21.15.117:0/2350383611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff72c0fc1d0 msgr2=0x7ff72c0fc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:42.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.251+0000 7ff73219d640 1 --2- 172.21.15.117:0/2350383611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff72c0fc1d0 0x7ff72c0fc640 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0048d0 tx=0x7ff71c009da0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.251+0000 7ff73219d640 1 -- 172.21.15.117:0/2350383611 shutdown_connections 2024-04-12T09:08:42.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.251+0000 7ff73219d640 1 --2- 172.21.15.117:0/2350383611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff72c0fc1d0 0x7ff72c0fc640 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.251+0000 7ff73219d640 1 --2- 172.21.15.117:0/2350383611 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff72c0faf00 0x7ff72c0fb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.251+0000 7ff73219d640 1 -- 172.21.15.117:0/2350383611 >> 172.21.15.117:0/2350383611 conn(0x7ff72c0f66e0 msgr2=0x7ff72c0f8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:42.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.251+0000 7ff73219d640 1 -- 172.21.15.117:0/2350383611 shutdown_connections 2024-04-12T09:08:42.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.251+0000 7ff73219d640 1 -- 172.21.15.117:0/2350383611 wait complete. 2024-04-12T09:08:42.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.252+0000 7ff73219d640 1 Processor -- start 2024-04-12T09:08:42.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.252+0000 7ff73219d640 1 -- start start 2024-04-12T09:08:42.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.252+0000 7ff73219d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff72c0faf00 0x7ff72c065f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:42.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.252+0000 7ff73219d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff72c0fc1d0 0x7ff72c1119b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:42.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.252+0000 7ff73219d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c111ef0 con 0x7ff72c0faf00 2024-04-12T09:08:42.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.252+0000 7ff73219d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c112030 con 0x7ff72c0fc1d0 2024-04-12T09:08:42.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.252+0000 7ff73119b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff72c0faf00 0x7ff72c065f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:42.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.252+0000 7ff73119b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff72c0faf00 0x7ff72c065f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58130/0 (socket says 172.21.15.117:58130) 2024-04-12T09:08:42.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.252+0000 7ff73119b640 1 -- 172.21.15.117:0/344391955 learned_addr learned my addr 172.21.15.117:0/344391955 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:08:42.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.252+0000 7ff73119b640 1 -- 172.21.15.117:0/344391955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff72c0fc1d0 msgr2=0x7ff72c1119b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:42.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.252+0000 7ff73099a640 1 --2- 172.21.15.117:0/344391955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff72c0fc1d0 0x7ff72c1119b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:42.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.252+0000 7ff73119b640 1 --2- 172.21.15.117:0/344391955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff72c0fc1d0 0x7ff72c1119b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.252+0000 7ff73119b640 1 -- 172.21.15.117:0/344391955 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71c005040 con 0x7ff72c0faf00 2024-04-12T09:08:42.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.252+0000 7ff73119b640 1 --2- 172.21.15.117:0/344391955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff72c0faf00 0x7ff72c065f70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff72800db00 tx=0x7ff728004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:42.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.253+0000 7ff721ffb640 1 -- 172.21.15.117:0/344391955 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff728017070 con 0x7ff72c0faf00 2024-04-12T09:08:42.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.253+0000 7ff721ffb640 1 -- 172.21.15.117:0/344391955 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff72800f040 con 0x7ff72c0faf00 2024-04-12T09:08:42.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.253+0000 7ff73219d640 1 -- 172.21.15.117:0/344391955 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72c112290 con 0x7ff72c0faf00 2024-04-12T09:08:42.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.253+0000 7ff721ffb640 1 -- 172.21.15.117:0/344391955 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff728003ae0 con 0x7ff72c0faf00 2024-04-12T09:08:42.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.253+0000 7ff73219d640 1 -- 172.21.15.117:0/344391955 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72c112780 con 0x7ff72c0faf00 2024-04-12T09:08:42.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.254+0000 7ff73219d640 1 -- 172.21.15.117:0/344391955 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff72c04bcc0 con 0x7ff72c0faf00 2024-04-12T09:08:42.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.254+0000 7ff721ffb640 1 -- 172.21.15.117:0/344391955 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ff728003c40 con 0x7ff72c0faf00 2024-04-12T09:08:42.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.255+0000 7ff721ffb640 1 --2- 172.21.15.117:0/344391955 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7ff718069210 0x7ff71806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:42.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.255+0000 7ff721ffb640 1 -- 172.21.15.117:0/344391955 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff7280873a0 con 0x7ff72c0faf00 2024-04-12T09:08:42.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.255+0000 7ff73099a640 1 --2- 172.21.15.117:0/344391955 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7ff718069210 0x7ff71806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:42.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.255+0000 7ff73099a640 1 --2- 172.21.15.117:0/344391955 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7ff718069210 0x7ff71806b6c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff71c02bda0 tx=0x7ff71c009da0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:42.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.259+0000 7ff721ffb640 1 -- 172.21.15.117:0/344391955 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7ff7280536c0 con 0x7ff72c0faf00 2024-04-12T09:08:42.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:42 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:42.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:42 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:42.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:42 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:08:42.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:42 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:08:42.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:42 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:08:42.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:42 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/3279771157' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-12T09:08:42.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:42 smithi203 ceph-mon[36428]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-12T09:08:42.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.424+0000 7ff73219d640 1 -- 172.21.15.117:0/344391955 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff72c1129a0 con 0x7ff72c0faf00 2024-04-12T09:08:42.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.425+0000 7ff721ffb640 1 -- 172.21.15.117:0/344391955 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff728056ce0 con 0x7ff72c0faf00 2024-04-12T09:08:42.426 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 1 2024-04-12T09:08:42.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.427+0000 7ff73219d640 1 -- 172.21.15.117:0/344391955 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7ff718069210 msgr2=0x7ff71806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:42.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.427+0000 7ff73219d640 1 --2- 172.21.15.117:0/344391955 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7ff718069210 0x7ff71806b6c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff71c02bda0 tx=0x7ff71c009da0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.427+0000 7ff73219d640 1 -- 172.21.15.117:0/344391955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff72c0faf00 msgr2=0x7ff72c065f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:42.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.427+0000 7ff73219d640 1 --2- 172.21.15.117:0/344391955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff72c0faf00 0x7ff72c065f70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff72800db00 tx=0x7ff728004e60 comp rx=0 tx=0).stop 2024-04-12T09:08:42.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.427+0000 7ff73219d640 1 -- 172.21.15.117:0/344391955 shutdown_connections 2024-04-12T09:08:42.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.427+0000 7ff73219d640 1 --2- 172.21.15.117:0/344391955 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7ff718069210 0x7ff71806b6c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.427+0000 7ff73219d640 1 --2- 172.21.15.117:0/344391955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff72c0fc1d0 0x7ff72c1119b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.427+0000 7ff73219d640 1 --2- 172.21.15.117:0/344391955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff72c0faf00 0x7ff72c065f70 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.427+0000 7ff73219d640 1 -- 172.21.15.117:0/344391955 >> 172.21.15.117:0/344391955 conn(0x7ff72c0f66e0 msgr2=0x7ff72c0f7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:42.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.427+0000 7ff73219d640 1 -- 172.21.15.117:0/344391955 shutdown_connections 2024-04-12T09:08:42.428 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.427+0000 7ff73219d640 1 -- 172.21.15.117:0/344391955 wait complete. 2024-04-12T09:08:42.438 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-12T09:08:42.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.537+0000 7fc2366ee640 1 -- 172.21.15.117:0/3054708116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2300fc360 msgr2=0x7fc2300fc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:42.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.537+0000 7fc2366ee640 1 --2- 172.21.15.117:0/3054708116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2300fc360 0x7fc2300fc7d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc2240048d0 tx=0x7fc224009da0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.537+0000 7fc2366ee640 1 -- 172.21.15.117:0/3054708116 shutdown_connections 2024-04-12T09:08:42.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.537+0000 7fc2366ee640 1 --2- 172.21.15.117:0/3054708116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2300fc360 0x7fc2300fc7d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.537+0000 7fc2366ee640 1 --2- 172.21.15.117:0/3054708116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2300fb090 0x7fc2300fb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.537+0000 7fc2366ee640 1 -- 172.21.15.117:0/3054708116 >> 172.21.15.117:0/3054708116 conn(0x7fc2300f6870 msgr2=0x7fc2300f8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:42.540 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.537+0000 7fc2366ee640 1 -- 172.21.15.117:0/3054708116 shutdown_connections 2024-04-12T09:08:42.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.537+0000 7fc2366ee640 1 -- 172.21.15.117:0/3054708116 wait complete. 2024-04-12T09:08:42.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.538+0000 7fc2366ee640 1 Processor -- start 2024-04-12T09:08:42.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.538+0000 7fc2366ee640 1 -- start start 2024-04-12T09:08:42.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.538+0000 7fc2366ee640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2300fb090 0x7fc2300ff490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:42.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.538+0000 7fc2366ee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2300fc360 0x7fc2300fdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:42.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.538+0000 7fc2366ee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2300ffae0 con 0x7fc2300fc360 2024-04-12T09:08:42.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.538+0000 7fc2366ee640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2300fe0f0 con 0x7fc2300fb090 2024-04-12T09:08:42.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.538+0000 7fc22f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2300fc360 0x7fc2300fdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:42.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.538+0000 7fc22f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2300fc360 0x7fc2300fdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58156/0 (socket says 172.21.15.117:58156) 2024-04-12T09:08:42.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.538+0000 7fc22f7fe640 1 -- 172.21.15.117:0/1911914123 learned_addr learned my addr 172.21.15.117:0/1911914123 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:08:42.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.538+0000 7fc22ffff640 1 --2- 172.21.15.117:0/1911914123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2300fb090 0x7fc2300ff490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:42.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.539+0000 7fc22f7fe640 1 -- 172.21.15.117:0/1911914123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2300fb090 msgr2=0x7fc2300ff490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:42.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.539+0000 7fc22f7fe640 1 --2- 172.21.15.117:0/1911914123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2300fb090 0x7fc2300ff490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.539+0000 7fc22f7fe640 1 -- 172.21.15.117:0/1911914123 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc224005040 con 0x7fc2300fc360 2024-04-12T09:08:42.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.539+0000 7fc22ffff640 1 --2- 172.21.15.117:0/1911914123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2300fb090 0x7fc2300ff490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T09:08:42.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.539+0000 7fc22f7fe640 1 --2- 172.21.15.117:0/1911914123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2300fc360 0x7fc2300fdbb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc224007da0 tx=0x7fc224009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:42.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.539+0000 7fc22cff9640 1 -- 172.21.15.117:0/1911914123 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2240094c0 con 0x7fc2300fc360 2024-04-12T09:08:42.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.539+0000 7fc22cff9640 1 -- 172.21.15.117:0/1911914123 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc224009620 con 0x7fc2300fc360 2024-04-12T09:08:42.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.539+0000 7fc2366ee640 1 -- 172.21.15.117:0/1911914123 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2300fe320 con 0x7fc2300fc360 2024-04-12T09:08:42.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.539+0000 7fc22cff9640 1 -- 172.21.15.117:0/1911914123 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc22403b620 con 0x7fc2300fc360 2024-04-12T09:08:42.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.539+0000 7fc2366ee640 1 -- 172.21.15.117:0/1911914123 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2300fe840 con 0x7fc2300fc360 2024-04-12T09:08:42.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.540+0000 7fc2366ee640 1 -- 172.21.15.117:0/1911914123 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc23004bcc0 con 0x7fc2300fc360 2024-04-12T09:08:42.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.540+0000 7fc22cff9640 1 -- 172.21.15.117:0/1911914123 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fc22402f070 con 0x7fc2300fc360 2024-04-12T09:08:42.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.541+0000 7fc22cff9640 1 --2- 172.21.15.117:0/1911914123 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc218069210 0x7fc21806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:42.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.541+0000 7fc22ffff640 1 --2- 172.21.15.117:0/1911914123 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc218069210 0x7fc21806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:42.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.541+0000 7fc22cff9640 1 -- 172.21.15.117:0/1911914123 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc2240a97f0 con 0x7fc2300fc360 2024-04-12T09:08:42.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.541+0000 7fc22ffff640 1 --2- 172.21.15.117:0/1911914123 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc218069210 0x7fc21806b6c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc220007fd0 tx=0x7fc220009e90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:42.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.545+0000 7fc22cff9640 1 -- 172.21.15.117:0/1911914123 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fc224075a50 con 0x7fc2300fc360 2024-04-12T09:08:42.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.709+0000 7fc2366ee640 1 -- 172.21.15.117:0/1911914123 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fc2300fe9d0 con 0x7fc2300fc360 2024-04-12T09:08:42.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.710+0000 7fc22cff9640 1 -- 172.21.15.117:0/1911914123 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7fc224079070 con 0x7fc2300fc360 2024-04-12T09:08:42.711 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 32 2024-04-12T09:08:42.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.711+0000 7fc2366ee640 1 -- 172.21.15.117:0/1911914123 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc218069210 msgr2=0x7fc21806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:42.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.711+0000 7fc2366ee640 1 --2- 172.21.15.117:0/1911914123 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc218069210 0x7fc21806b6c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc220007fd0 tx=0x7fc220009e90 comp rx=0 tx=0).stop 2024-04-12T09:08:42.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.711+0000 7fc2366ee640 1 -- 172.21.15.117:0/1911914123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2300fc360 msgr2=0x7fc2300fdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:42.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.711+0000 7fc2366ee640 1 --2- 172.21.15.117:0/1911914123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2300fc360 0x7fc2300fdbb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc224007da0 tx=0x7fc224009da0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.711+0000 7fc2366ee640 1 -- 172.21.15.117:0/1911914123 shutdown_connections 2024-04-12T09:08:42.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.711+0000 7fc2366ee640 1 --2- 172.21.15.117:0/1911914123 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc218069210 0x7fc21806b6c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.711+0000 7fc2366ee640 1 --2- 172.21.15.117:0/1911914123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2300fc360 0x7fc2300fdbb0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.711+0000 7fc2366ee640 1 --2- 172.21.15.117:0/1911914123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2300fb090 0x7fc2300ff490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.711+0000 7fc2366ee640 1 -- 172.21.15.117:0/1911914123 >> 172.21.15.117:0/1911914123 conn(0x7fc2300f6870 msgr2=0x7fc230064370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:42.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.712+0000 7fc2366ee640 1 -- 172.21.15.117:0/1911914123 shutdown_connections 2024-04-12T09:08:42.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.712+0000 7fc2366ee640 1 -- 172.21.15.117:0/1911914123 wait complete. 2024-04-12T09:08:42.723 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-12T09:08:42.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.823+0000 7fc75cb9d640 1 -- 172.21.15.117:0/301204680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7580fc1d0 msgr2=0x7fc7580fc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:42.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.823+0000 7fc75cb9d640 1 --2- 172.21.15.117:0/301204680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7580fc1d0 0x7fc7580fc640 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc7400048d0 tx=0x7fc740009da0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.823+0000 7fc75cb9d640 1 -- 172.21.15.117:0/301204680 shutdown_connections 2024-04-12T09:08:42.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.823+0000 7fc75cb9d640 1 --2- 172.21.15.117:0/301204680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7580fc1d0 0x7fc7580fc640 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.823+0000 7fc75cb9d640 1 --2- 172.21.15.117:0/301204680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7580faf00 0x7fc7580fb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.823+0000 7fc75cb9d640 1 -- 172.21.15.117:0/301204680 >> 172.21.15.117:0/301204680 conn(0x7fc7580f66e0 msgr2=0x7fc7580f8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:42.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.823+0000 7fc75cb9d640 1 -- 172.21.15.117:0/301204680 shutdown_connections 2024-04-12T09:08:42.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.823+0000 7fc75cb9d640 1 -- 172.21.15.117:0/301204680 wait complete. 2024-04-12T09:08:42.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.823+0000 7fc75cb9d640 1 Processor -- start 2024-04-12T09:08:42.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.823+0000 7fc75cb9d640 1 -- start start 2024-04-12T09:08:42.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.823+0000 7fc75cb9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7580faf00 0x7fc75810ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:42.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.823+0000 7fc75cb9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7580fc1d0 0x7fc75810f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:42.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.823+0000 7fc75cb9d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75810f910 con 0x7fc7580fc1d0 2024-04-12T09:08:42.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.823+0000 7fc75cb9d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc758114310 con 0x7fc7580faf00 2024-04-12T09:08:42.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.824+0000 7fc74ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7580fc1d0 0x7fc75810f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:42.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.824+0000 7fc74ffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7580fc1d0 0x7fc75810f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58172/0 (socket says 172.21.15.117:58172) 2024-04-12T09:08:42.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.824+0000 7fc74ffff640 1 -- 172.21.15.117:0/1121945446 learned_addr learned my addr 172.21.15.117:0/1121945446 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:08:42.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.824+0000 7fc7577fe640 1 --2- 172.21.15.117:0/1121945446 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7580faf00 0x7fc75810ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:42.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.824+0000 7fc74ffff640 1 -- 172.21.15.117:0/1121945446 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7580faf00 msgr2=0x7fc75810ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:42.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.824+0000 7fc74ffff640 1 --2- 172.21.15.117:0/1121945446 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7580faf00 0x7fc75810ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:42.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.824+0000 7fc74ffff640 1 -- 172.21.15.117:0/1121945446 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc740005040 con 0x7fc7580fc1d0 2024-04-12T09:08:42.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.824+0000 7fc74ffff640 1 --2- 172.21.15.117:0/1121945446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7580fc1d0 0x7fc75810f2c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc740000c00 tx=0x7fc740009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:42.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.824+0000 7fc754ff9640 1 -- 172.21.15.117:0/1121945446 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7400094c0 con 0x7fc7580fc1d0 2024-04-12T09:08:42.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.824+0000 7fc754ff9640 1 -- 172.21.15.117:0/1121945446 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc740032e90 con 0x7fc7580fc1d0 2024-04-12T09:08:42.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.824+0000 7fc75cb9d640 1 -- 172.21.15.117:0/1121945446 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc758114450 con 0x7fc7580fc1d0 2024-04-12T09:08:42.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.824+0000 7fc754ff9640 1 -- 172.21.15.117:0/1121945446 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7400435f0 con 0x7fc7580fc1d0 2024-04-12T09:08:42.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.824+0000 7fc75cb9d640 1 -- 172.21.15.117:0/1121945446 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7581148e0 con 0x7fc7580fc1d0 2024-04-12T09:08:42.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.825+0000 7fc75cb9d640 1 -- 172.21.15.117:0/1121945446 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc75804bcc0 con 0x7fc7580fc1d0 2024-04-12T09:08:42.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.826+0000 7fc754ff9640 1 -- 172.21.15.117:0/1121945446 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fc74002f070 con 0x7fc7580fc1d0 2024-04-12T09:08:42.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.826+0000 7fc754ff9640 1 --2- 172.21.15.117:0/1121945446 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc744069220 0x7fc74406b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:42.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.826+0000 7fc754ff9640 1 -- 172.21.15.117:0/1121945446 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc7400a9020 con 0x7fc7580fc1d0 2024-04-12T09:08:42.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.826+0000 7fc7577fe640 1 --2- 172.21.15.117:0/1121945446 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc744069220 0x7fc74406b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:42.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.826+0000 7fc7577fe640 1 --2- 172.21.15.117:0/1121945446 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc744069220 0x7fc74406b6d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc748004ed0 tx=0x7fc74800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:42.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.830+0000 7fc754ff9640 1 -- 172.21.15.117:0/1121945446 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fc740075330 con 0x7fc7580fc1d0 2024-04-12T09:08:42.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.996+0000 7fc75cb9d640 1 -- 172.21.15.117:0/1121945446 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fc758100ad0 con 0x7fc7580fc1d0 2024-04-12T09:08:42.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.996+0000 7fc754ff9640 1 -- 172.21.15.117:0/1121945446 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7fc740078950 con 0x7fc7580fc1d0 2024-04-12T09:08:42.997 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 32 2024-04-12T09:08:43.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.998+0000 7fc75cb9d640 1 -- 172.21.15.117:0/1121945446 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc744069220 msgr2=0x7fc74406b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:43.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.998+0000 7fc75cb9d640 1 --2- 172.21.15.117:0/1121945446 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc744069220 0x7fc74406b6d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc748004ed0 tx=0x7fc74800b040 comp rx=0 tx=0).stop 2024-04-12T09:08:43.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.998+0000 7fc75cb9d640 1 -- 172.21.15.117:0/1121945446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7580fc1d0 msgr2=0x7fc75810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:43.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.998+0000 7fc75cb9d640 1 --2- 172.21.15.117:0/1121945446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7580fc1d0 0x7fc75810f2c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc740000c00 tx=0x7fc740009da0 comp rx=0 tx=0).stop 2024-04-12T09:08:43.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.998+0000 7fc75cb9d640 1 -- 172.21.15.117:0/1121945446 shutdown_connections 2024-04-12T09:08:43.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.998+0000 7fc75cb9d640 1 --2- 172.21.15.117:0/1121945446 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fc744069220 0x7fc74406b6d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:43.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.998+0000 7fc75cb9d640 1 --2- 172.21.15.117:0/1121945446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7580fc1d0 0x7fc75810f2c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:43.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.998+0000 7fc75cb9d640 1 --2- 172.21.15.117:0/1121945446 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7580faf00 0x7fc75810ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:43.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.999+0000 7fc75cb9d640 1 -- 172.21.15.117:0/1121945446 >> 172.21.15.117:0/1121945446 conn(0x7fc7580f66e0 msgr2=0x7fc758064920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:43.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.999+0000 7fc75cb9d640 1 -- 172.21.15.117:0/1121945446 shutdown_connections 2024-04-12T09:08:43.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:42.999+0000 7fc75cb9d640 1 -- 172.21.15.117:0/1121945446 wait complete. 2024-04-12T09:08:43.010 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-12T09:08:43.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.107+0000 7fd0ab59d640 1 -- 172.21.15.117:0/736132110 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0a40fc1b0 msgr2=0x7fd0a40fc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:43.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.107+0000 7fd0ab59d640 1 --2- 172.21.15.117:0/736132110 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0a40fc1b0 0x7fd0a40fc620 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd0940048d0 tx=0x7fd094009da0 comp rx=0 tx=0).stop 2024-04-12T09:08:43.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.107+0000 7fd0ab59d640 1 -- 172.21.15.117:0/736132110 shutdown_connections 2024-04-12T09:08:43.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.107+0000 7fd0ab59d640 1 --2- 172.21.15.117:0/736132110 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0a40fc1b0 0x7fd0a40fc620 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:43.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.107+0000 7fd0ab59d640 1 --2- 172.21.15.117:0/736132110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0a40faee0 0x7fd0a40fb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:43.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.107+0000 7fd0ab59d640 1 -- 172.21.15.117:0/736132110 >> 172.21.15.117:0/736132110 conn(0x7fd0a40f66e0 msgr2=0x7fd0a40f8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:43.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.107+0000 7fd0ab59d640 1 -- 172.21.15.117:0/736132110 shutdown_connections 2024-04-12T09:08:43.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.107+0000 7fd0ab59d640 1 -- 172.21.15.117:0/736132110 wait complete. 2024-04-12T09:08:43.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.108+0000 7fd0ab59d640 1 Processor -- start 2024-04-12T09:08:43.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.108+0000 7fd0ab59d640 1 -- start start 2024-04-12T09:08:43.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.108+0000 7fd0ab59d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0a40faee0 0x7fd0a4065f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:43.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.108+0000 7fd0ab59d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0a40fc1b0 0x7fd0a4111900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:43.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.108+0000 7fd0ab59d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a4111e40 con 0x7fd0a40fc1b0 2024-04-12T09:08:43.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.108+0000 7fd0ab59d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a4111f80 con 0x7fd0a40faee0 2024-04-12T09:08:43.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.108+0000 7fd0a9d9a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0a40fc1b0 0x7fd0a4111900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:43.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.108+0000 7fd0a9d9a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0a40fc1b0 0x7fd0a4111900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58184/0 (socket says 172.21.15.117:58184) 2024-04-12T09:08:43.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.108+0000 7fd0a9d9a640 1 -- 172.21.15.117:0/808813276 learned_addr learned my addr 172.21.15.117:0/808813276 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:08:43.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.108+0000 7fd0aa59b640 1 --2- 172.21.15.117:0/808813276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0a40faee0 0x7fd0a4065f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:43.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.108+0000 7fd0a9d9a640 1 -- 172.21.15.117:0/808813276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0a40faee0 msgr2=0x7fd0a4065f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:43.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.108+0000 7fd0a9d9a640 1 --2- 172.21.15.117:0/808813276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0a40faee0 0x7fd0a4065f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:43.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.108+0000 7fd0a9d9a640 1 -- 172.21.15.117:0/808813276 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd094005040 con 0x7fd0a40fc1b0 2024-04-12T09:08:43.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.108+0000 7fd0aa59b640 1 --2- 172.21.15.117:0/808813276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0a40faee0 0x7fd0a4065f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T09:08:43.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.108+0000 7fd0a9d9a640 1 --2- 172.21.15.117:0/808813276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0a40fc1b0 0x7fd0a4111900 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd094007da0 tx=0x7fd094009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:43.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.108+0000 7fd09affd640 1 -- 172.21.15.117:0/808813276 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0940094c0 con 0x7fd0a40fc1b0 2024-04-12T09:08:43.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.108+0000 7fd09affd640 1 -- 172.21.15.117:0/808813276 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd094009620 con 0x7fd0a40fc1b0 2024-04-12T09:08:43.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.108+0000 7fd0ab59d640 1 -- 172.21.15.117:0/808813276 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a4112180 con 0x7fd0a40fc1b0 2024-04-12T09:08:43.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.108+0000 7fd09affd640 1 -- 172.21.15.117:0/808813276 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd09403b620 con 0x7fd0a40fc1b0 2024-04-12T09:08:43.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.109+0000 7fd0ab59d640 1 -- 172.21.15.117:0/808813276 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a4112670 con 0x7fd0a40fc1b0 2024-04-12T09:08:43.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.109+0000 7fd0ab59d640 1 -- 172.21.15.117:0/808813276 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a404bcc0 con 0x7fd0a40fc1b0 2024-04-12T09:08:43.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.110+0000 7fd09affd640 1 -- 172.21.15.117:0/808813276 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fd09402f070 con 0x7fd0a40fc1b0 2024-04-12T09:08:43.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.110+0000 7fd09affd640 1 --2- 172.21.15.117:0/808813276 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fd090069210 0x7fd09006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:43.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.110+0000 7fd09affd640 1 -- 172.21.15.117:0/808813276 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd0940a9730 con 0x7fd0a40fc1b0 2024-04-12T09:08:43.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.110+0000 7fd0aa59b640 1 --2- 172.21.15.117:0/808813276 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fd090069210 0x7fd09006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:43.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.111+0000 7fd0aa59b640 1 --2- 172.21.15.117:0/808813276 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fd090069210 0x7fd09006b6c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00093f0 tx=0x7fd0a0009ed0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:43.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.114+0000 7fd09affd640 1 -- 172.21.15.117:0/808813276 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fd094075990 con 0x7fd0a40fc1b0 2024-04-12T09:08:43.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.316+0000 7fd0ab59d640 1 -- 172.21.15.117:0/808813276 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0a4103a30 con 0x7fd0a40fc1b0 2024-04-12T09:08:43.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.317+0000 7fd09affd640 1 -- 172.21.15.117:0/808813276 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4697 (secure 0 0 0) 0x7fd094078fb0 con 0x7fd0a40fc1b0 2024-04-12T09:08:43.318 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:08:43.318 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14484,"name":"cephfs.smithi117.wddsgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6827/4010127141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4010127141},{"type":"v1","addr":"172.21.15.117:6827","nonce":4010127141}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24265,"name":"cephfs.smithi203.fbeixl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.203:6825/840607003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":840607003},{"type":"v1","addr":"172.21.15.203:6825","nonce":840607003}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24273,"name":"cephfs.smithi203.bszhxz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.203:6827/2731911290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2731911290},{"type":"v1","addr":"172.21.15.203:6827","nonce":2731911290}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T09:08:12.488144+0000","modified":"2024-04-12T09:08:30.563184+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14474":{"gid":14474,"name":"cephfs.smithi117.eslmxh","rank":0,"incarnation":11,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6829/2248590199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":2248590199},{"type":"v1","addr":"172.21.15.117:6829","nonce":2248590199}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-04-12T09:08:43.318 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 14 2024-04-12T09:08:43.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.318+0000 7fd0ab59d640 1 -- 172.21.15.117:0/808813276 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fd090069210 msgr2=0x7fd09006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:43.319 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.318+0000 7fd0ab59d640 1 --2- 172.21.15.117:0/808813276 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fd090069210 0x7fd09006b6c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00093f0 tx=0x7fd0a0009ed0 comp rx=0 tx=0).stop 2024-04-12T09:08:43.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.318+0000 7fd0ab59d640 1 -- 172.21.15.117:0/808813276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0a40fc1b0 msgr2=0x7fd0a4111900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:43.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.318+0000 7fd0ab59d640 1 --2- 172.21.15.117:0/808813276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0a40fc1b0 0x7fd0a4111900 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd094007da0 tx=0x7fd094009da0 comp rx=0 tx=0).stop 2024-04-12T09:08:43.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.318+0000 7fd0ab59d640 1 -- 172.21.15.117:0/808813276 shutdown_connections 2024-04-12T09:08:43.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.318+0000 7fd0ab59d640 1 --2- 172.21.15.117:0/808813276 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fd090069210 0x7fd09006b6c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:43.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.318+0000 7fd0ab59d640 1 --2- 172.21.15.117:0/808813276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0a40fc1b0 0x7fd0a4111900 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:43.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.318+0000 7fd0ab59d640 1 --2- 172.21.15.117:0/808813276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0a40faee0 0x7fd0a4065f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:43.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.318+0000 7fd0ab59d640 1 -- 172.21.15.117:0/808813276 >> 172.21.15.117:0/808813276 conn(0x7fd0a40f66e0 msgr2=0x7fd0a40f7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:43.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.318+0000 7fd0ab59d640 1 -- 172.21.15.117:0/808813276 shutdown_connections 2024-04-12T09:08:43.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:43.319+0000 7fd0ab59d640 1 -- 172.21.15.117:0/808813276 wait complete. 2024-04-12T09:08:43.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:43 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/2904540864' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T09:08:43.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:43 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/344391955' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-12T09:08:43.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:43 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/1911914123' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-12T09:08:43.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:43 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/1121945446' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-12T09:08:43.329 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:43 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/2904540864' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T09:08:43.329 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:43 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/344391955' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-12T09:08:43.329 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:43 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/1911914123' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-12T09:08:43.329 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:43 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/1121945446' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-12T09:08:43.330 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 14, 'max_mds': 1, 'flags': 18} 2024-04-12T09:08:43.330 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-12T09:08:43.356 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-12T09:08:43.357 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-04-12T09:08:43.357 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-12T09:08:43.357 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-12T09:08:43.357 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-12T09:08:43.357 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-12T09:08:43.357 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-12T09:08:43.357 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-12T09:08:43.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:08:43.358 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2024-04-12T09:08:43.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:08:43.378 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link delete ceph-brx 2024-04-12T09:08:43.455 INFO:teuthology.orchestra.run.smithi203.stderr:Cannot find device "ceph-brx" 2024-04-12T09:08:43.456 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T09:08:43.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:08:43.457 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-04-12T09:08:43.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:08:43.472 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2024-04-12T09:08:43.541 INFO:teuthology.orchestra.run.smithi117.stderr:Cannot find device "ceph-brx" 2024-04-12T09:08:43.542 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T09:08:43.543 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-12T09:08:43.543 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph fs ls 2024-04-12T09:08:43.835 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:08:44.270 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:44 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/808813276' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-12T09:08:44.270 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:44 smithi117 ceph-mon[29277]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-12T09:08:44.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:44 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/808813276' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-12T09:08:44.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:44 smithi203 ceph-mon[36428]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-12T09:08:45.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.374+0000 7f24c4981700 1 -- 172.21.15.117:0/926730057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24c0102f50 msgr2=0x7f24c0103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:45.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.374+0000 7f24c4981700 1 --2- 172.21.15.117:0/926730057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24c0102f50 0x7f24c0103320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f24b0004940 tx=0x7f24b0009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:45.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.374+0000 7f24c4981700 1 -- 172.21.15.117:0/926730057 shutdown_connections 2024-04-12T09:08:45.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.374+0000 7f24c4981700 1 --2- 172.21.15.117:0/926730057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24c00fb4d0 0x7f24c00fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:45.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.374+0000 7f24c4981700 1 --2- 172.21.15.117:0/926730057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24c0102f50 0x7f24c0103320 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:45.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.374+0000 7f24c4981700 1 -- 172.21.15.117:0/926730057 >> 172.21.15.117:0/926730057 conn(0x7f24c00714c0 msgr2=0x7f24c00718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:45.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.374+0000 7f24c4981700 1 -- 172.21.15.117:0/926730057 shutdown_connections 2024-04-12T09:08:45.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.374+0000 7f24c4981700 1 -- 172.21.15.117:0/926730057 wait complete. 2024-04-12T09:08:45.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.374+0000 7f24c4981700 1 Processor -- start 2024-04-12T09:08:45.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.374+0000 7f24c4981700 1 -- start start 2024-04-12T09:08:45.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.375+0000 7f24c4981700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24c00fb4d0 0x7f24c00fc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:45.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.375+0000 7f24c4981700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24c0102f50 0x7f24c00fcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:45.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.375+0000 7f24c4981700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00fe600 con 0x7f24c0102f50 2024-04-12T09:08:45.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.375+0000 7f24c4981700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00fd130 con 0x7f24c00fb4d0 2024-04-12T09:08:45.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.375+0000 7f24b5d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24c0102f50 0x7f24c00fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:45.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.375+0000 7f24b5d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24c0102f50 0x7f24c00fcbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58200/0 (socket says 172.21.15.117:58200) 2024-04-12T09:08:45.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.375+0000 7f24b5d9b700 1 -- 172.21.15.117:0/1565154809 learned_addr learned my addr 172.21.15.117:0/1565154809 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:08:45.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.375+0000 7f24be59c700 1 --2- 172.21.15.117:0/1565154809 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24c00fb4d0 0x7f24c00fc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:45.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.375+0000 7f24b5d9b700 1 -- 172.21.15.117:0/1565154809 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24c00fb4d0 msgr2=0x7f24c00fc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:45.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.375+0000 7f24b5d9b700 1 --2- 172.21.15.117:0/1565154809 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24c00fb4d0 0x7f24c00fc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:45.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.375+0000 7f24b5d9b700 1 -- 172.21.15.117:0/1565154809 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b0005040 con 0x7f24c0102f50 2024-04-12T09:08:45.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.375+0000 7f24b5d9b700 1 --2- 172.21.15.117:0/1565154809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24c0102f50 0x7f24c00fcbf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f24a800c830 tx=0x7f24a8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:45.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.375+0000 7f24b77fe700 1 -- 172.21.15.117:0/1565154809 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24a800a760 con 0x7f24c0102f50 2024-04-12T09:08:45.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.375+0000 7f24c4981700 1 -- 172.21.15.117:0/1565154809 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c00fd410 con 0x7f24c0102f50 2024-04-12T09:08:45.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.375+0000 7f24b77fe700 1 -- 172.21.15.117:0/1565154809 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f24a800ad90 con 0x7f24c0102f50 2024-04-12T09:08:45.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.375+0000 7f24b77fe700 1 -- 172.21.15.117:0/1565154809 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24a80113a0 con 0x7f24c0102f50 2024-04-12T09:08:45.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.375+0000 7f24c4981700 1 -- 172.21.15.117:0/1565154809 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c011a150 con 0x7f24c0102f50 2024-04-12T09:08:45.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.376+0000 7f24c4981700 1 -- 172.21.15.117:0/1565154809 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c0100200 con 0x7f24c0102f50 2024-04-12T09:08:45.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.377+0000 7f24b77fe700 1 -- 172.21.15.117:0/1565154809 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f24a8012400 con 0x7f24c0102f50 2024-04-12T09:08:45.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.377+0000 7f24b77fe700 1 --2- 172.21.15.117:0/1565154809 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f24ac0692a0 0x7f24ac06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:45.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.377+0000 7f24b77fe700 1 -- 172.21.15.117:0/1565154809 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f24a8087220 con 0x7f24c0102f50 2024-04-12T09:08:45.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.377+0000 7f24be59c700 1 --2- 172.21.15.117:0/1565154809 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f24ac0692a0 0x7f24ac06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:45.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.378+0000 7f24be59c700 1 --2- 172.21.15.117:0/1565154809 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f24ac0692a0 0x7f24ac06b750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f24b0004f90 tx=0x7f24b0009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:45.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.382+0000 7f24b77fe700 1 -- 172.21.15.117:0/1565154809 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f24a8053500 con 0x7f24c0102f50 2024-04-12T09:08:45.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.616+0000 7f24c4981700 1 -- 172.21.15.117:0/1565154809 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f24c00fe7f0 con 0x7f24c0102f50 2024-04-12T09:08:45.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.616+0000 7f24b77fe700 1 -- 172.21.15.117:0/1565154809 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+83 (secure 0 0 0) 0x7f24a8056b20 con 0x7f24c0102f50 2024-04-12T09:08:45.617 INFO:teuthology.orchestra.run.smithi117.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-12T09:08:45.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.618+0000 7f24c4981700 1 -- 172.21.15.117:0/1565154809 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f24ac0692a0 msgr2=0x7f24ac06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:45.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.618+0000 7f24c4981700 1 --2- 172.21.15.117:0/1565154809 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f24ac0692a0 0x7f24ac06b750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f24b0004f90 tx=0x7f24b0009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:45.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.618+0000 7f24c4981700 1 -- 172.21.15.117:0/1565154809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24c0102f50 msgr2=0x7f24c00fcbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:45.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.618+0000 7f24c4981700 1 --2- 172.21.15.117:0/1565154809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24c0102f50 0x7f24c00fcbf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f24a800c830 tx=0x7f24a8004470 comp rx=0 tx=0).stop 2024-04-12T09:08:45.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.618+0000 7f24c4981700 1 -- 172.21.15.117:0/1565154809 shutdown_connections 2024-04-12T09:08:45.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.618+0000 7f24c4981700 1 --2- 172.21.15.117:0/1565154809 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f24ac0692a0 0x7f24ac06b750 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:45.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.618+0000 7f24c4981700 1 --2- 172.21.15.117:0/1565154809 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24c00fb4d0 0x7f24c00fc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:45.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.618+0000 7f24c4981700 1 --2- 172.21.15.117:0/1565154809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24c0102f50 0x7f24c00fcbf0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:45.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.618+0000 7f24c4981700 1 -- 172.21.15.117:0/1565154809 >> 172.21.15.117:0/1565154809 conn(0x7f24c00714c0 msgr2=0x7f24c00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:45.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.619+0000 7f24c4981700 1 -- 172.21.15.117:0/1565154809 shutdown_connections 2024-04-12T09:08:45.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:45.619+0000 7f24c4981700 1 -- 172.21.15.117:0/1565154809 wait complete. 2024-04-12T09:08:46.423 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-12T09:08:46.423 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-12T09:08:46.423 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2024-04-12T09:08:46.424 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-12T09:08:46.424 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-12T09:08:46.424 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-12T09:08:46.424 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-12T09:08:46.424 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-12T09:08:46.424 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-12T09:08:46.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:08:46.424 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2024-04-12T09:08:46.440 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-12T09:08:46.440 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-12T09:08:46.440 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-04-12T09:08:46.440 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-04-12T09:08:46.440 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-04-12T09:08:46.440 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-04-12T09:08:46.440 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-12T09:08:46.441 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2024-04-12T09:08:46.441 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2024-04-12T09:08:46.441 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-12T09:08:46.441 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2024-04-12T09:08:46.441 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2024-04-12T09:08:46.441 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-12T09:08:46.441 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2024-04-12T09:08:46.441 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-12T09:08:46.441 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2024-04-12T09:08:46.441 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-12T09:08:46.441 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42230sec preferred_lft 42230sec 2024-04-12T09:08:46.441 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2024-04-12T09:08:46.442 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-04-12T09:08:46.442 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-12T09:08:46.442 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T09:08:46.442 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-04-12T09:08:46.442 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add name ceph-brx type bridge 2024-04-12T09:08:46.443 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr flush dev ceph-brx 2024-04-12T09:08:46.443 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set ceph-brx up 2024-04-12T09:08:46.443 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-12T09:08:46.443 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-04-12T09:08:46.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T09:08:46.641 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:46 smithi117 ceph-mon[29277]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-12T09:08:46.641 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:46 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/1565154809' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-12T09:08:46.641 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:46 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:08:46.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T09:08:46.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:08:46.677 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-12T09:08:46.705 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-04-12T09:08:46.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:08:46.707 DEBUG:teuthology.orchestra.run.smithi117:> route 2024-04-12T09:08:46.779 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2024-04-12T09:08:46.779 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-12T09:08:46.780 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-12T09:08:46.780 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-12T09:08:46.780 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-12T09:08:46.780 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T09:08:46.780 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-04-12T09:08:46.780 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-12T09:08:46.780 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-12T09:08:46.780 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-12T09:08:46.780 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-04-12T09:08:46.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:46 smithi203 ceph-mon[36428]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-04-12T09:08:46.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:46 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/1565154809' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-12T09:08:46.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:46 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:08:46.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T09:08:47.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T09:08:47.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:08:47.074 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-04-12T09:08:47.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:08:47.090 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list-id 2024-04-12T09:08:47.145 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T09:08:47.145 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-04-12T09:08:47.145 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-12T09:08:47.145 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-12T09:08:47.146 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-04-12T09:08:47.232 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T09:08:47.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T09:08:47.267 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-12T09:08:47.267 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T09:08:47.267 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-04-12T09:08:47.267 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-12T09:08:47.267 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-12T09:08:47.267 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-12T09:08:47.267 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-12T09:08:47.267 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-12T09:08:47.267 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-04-12T09:08:47.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T09:08:47.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T09:08:47.407 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T09:08:47.407 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-04-12T09:08:47.407 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2024-04-12T09:08:47.407 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set dev brx.0 master ceph-brx 2024-04-12T09:08:47.408 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-04-12T09:08:47.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T09:08:47.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T09:08:47.489 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-12T09:08:47.489 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-12T09:08:47.489 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-12T09:08:47.503 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-12T09:08:47.504 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-12T09:08:47.504 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-12T09:08:47.557 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-04-12T09:08:47.625 DEBUG:teuthology.orchestra.run.smithi117:> cat /proc/self/mounts | awk '{print $2}' 2024-04-12T09:08:47.681 INFO:teuthology.orchestra.run.smithi117.stdout:/proc 2024-04-12T09:08:47.681 INFO:teuthology.orchestra.run.smithi117.stdout:/sys 2024-04-12T09:08:47.681 INFO:teuthology.orchestra.run.smithi117.stdout:/dev 2024-04-12T09:08:47.681 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/security 2024-04-12T09:08:47.681 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/shm 2024-04-12T09:08:47.681 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/pts 2024-04-12T09:08:47.681 INFO:teuthology.orchestra.run.smithi117.stdout:/run 2024-04-12T09:08:47.681 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/cgroup 2024-04-12T09:08:47.681 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/pstore 2024-04-12T09:08:47.682 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/bpf 2024-04-12T09:08:47.682 INFO:teuthology.orchestra.run.smithi117.stdout:/ 2024-04-12T09:08:47.682 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/selinux 2024-04-12T09:08:47.682 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-04-12T09:08:47.682 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/mqueue 2024-04-12T09:08:47.682 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/debug 2024-04-12T09:08:47.682 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/hugepages 2024-04-12T09:08:47.682 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/tracing 2024-04-12T09:08:47.682 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/fuse/connections 2024-04-12T09:08:47.682 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/config 2024-04-12T09:08:47.682 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-sysctl.service 2024-04-12T09:08:47.682 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-12T09:08:47.682 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-12T09:08:47.682 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/nfs/rpc_pipefs 2024-04-12T09:08:47.683 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/1000 2024-04-12T09:08:47.683 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph 2024-04-12T09:08:47.683 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay 2024-04-12T09:08:47.683 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/62527511964f5b48517bc4bd5c506473aedc98c3333389250503d892abb0b1be/merged 2024-04-12T09:08:47.683 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/3785454d2c8576e55415bfbf55b52252f9a684ac89880afff216a679c42f2a32/merged 2024-04-12T09:08:47.683 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/0 2024-04-12T09:08:47.683 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-04-12T09:08:47.683 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/c5cc1f8c72ce8d0918b5447c3e3023c54c49ee2069a1352c34dded829c83a1c9/merged 2024-04-12T09:08:47.683 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/225fe282c8f6988b5e789db6a4d4e2177a8dad58896607b346f1d6e38233147a/merged 2024-04-12T09:08:47.683 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/605bfe79b0298b67011403f5acf256fb9e228a1541d9a2cb880611cf1631149f/merged 2024-04-12T09:08:47.683 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/9b267df1cfbaf63f524c4d28e8ed01d47fa1d407e8c188bc196feb23e2d257e4/merged 2024-04-12T09:08:47.683 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/39090ce35b7b92f0fc048738db4cd031029dbe6cd75fe15b1063d70391f33231/merged 2024-04-12T09:08:47.683 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/8df222df5a79dc966914339f04ae088ef2fdbbe9c3dbae8c6180941e63e4c86a/merged 2024-04-12T09:08:47.683 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/755181bf0386244d6aa9c320da929ceb046ab7b37bce6f3fddb57312a54cc5fd/merged 2024-04-12T09:08:47.683 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/3e253702daeee088dc16c8389a1232fd376e558f32d65a993e05c89058f0a9de/merged 2024-04-12T09:08:47.684 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/132cfb17be8b29423b815827b4b93ef17e9f2c436b962426e15a3abd30999ce5/merged 2024-04-12T09:08:47.684 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/7a7fc2209005e34ba592948511fcc15b3d253ffe8029b7c7b37ae7933c0a0926/merged 2024-04-12T09:08:47.684 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns 2024-04-12T09:08:47.684 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-12T09:08:47.684 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-12T09:08:47.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:08:47.684 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-04-12T09:08:47.736 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-12T09:08:47.736 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-12T09:08:47.779 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-04-12T09:08:47.805 DEBUG:teuthology.orchestra.run.smithi117:> cat /proc/self/mounts | awk '{print $2}' 2024-04-12T09:08:47.862 INFO:teuthology.orchestra.run.smithi117.stdout:/proc 2024-04-12T09:08:47.862 INFO:teuthology.orchestra.run.smithi117.stdout:/sys 2024-04-12T09:08:47.862 INFO:teuthology.orchestra.run.smithi117.stdout:/dev 2024-04-12T09:08:47.862 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/security 2024-04-12T09:08:47.862 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/shm 2024-04-12T09:08:47.862 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/pts 2024-04-12T09:08:47.862 INFO:teuthology.orchestra.run.smithi117.stdout:/run 2024-04-12T09:08:47.862 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/cgroup 2024-04-12T09:08:47.862 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/pstore 2024-04-12T09:08:47.862 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/bpf 2024-04-12T09:08:47.862 INFO:teuthology.orchestra.run.smithi117.stdout:/ 2024-04-12T09:08:47.863 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/selinux 2024-04-12T09:08:47.863 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-04-12T09:08:47.863 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/mqueue 2024-04-12T09:08:47.863 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/debug 2024-04-12T09:08:47.863 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/hugepages 2024-04-12T09:08:47.863 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/tracing 2024-04-12T09:08:47.863 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/fuse/connections 2024-04-12T09:08:47.863 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/config 2024-04-12T09:08:47.863 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-sysctl.service 2024-04-12T09:08:47.863 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-12T09:08:47.863 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-12T09:08:47.863 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/nfs/rpc_pipefs 2024-04-12T09:08:47.863 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/1000 2024-04-12T09:08:47.863 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph 2024-04-12T09:08:47.863 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay 2024-04-12T09:08:47.864 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/62527511964f5b48517bc4bd5c506473aedc98c3333389250503d892abb0b1be/merged 2024-04-12T09:08:47.864 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/3785454d2c8576e55415bfbf55b52252f9a684ac89880afff216a679c42f2a32/merged 2024-04-12T09:08:47.864 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/0 2024-04-12T09:08:47.864 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-04-12T09:08:47.864 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/c5cc1f8c72ce8d0918b5447c3e3023c54c49ee2069a1352c34dded829c83a1c9/merged 2024-04-12T09:08:47.864 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/225fe282c8f6988b5e789db6a4d4e2177a8dad58896607b346f1d6e38233147a/merged 2024-04-12T09:08:47.864 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/605bfe79b0298b67011403f5acf256fb9e228a1541d9a2cb880611cf1631149f/merged 2024-04-12T09:08:47.864 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/9b267df1cfbaf63f524c4d28e8ed01d47fa1d407e8c188bc196feb23e2d257e4/merged 2024-04-12T09:08:47.864 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/39090ce35b7b92f0fc048738db4cd031029dbe6cd75fe15b1063d70391f33231/merged 2024-04-12T09:08:47.864 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/8df222df5a79dc966914339f04ae088ef2fdbbe9c3dbae8c6180941e63e4c86a/merged 2024-04-12T09:08:47.864 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/755181bf0386244d6aa9c320da929ceb046ab7b37bce6f3fddb57312a54cc5fd/merged 2024-04-12T09:08:47.864 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/3e253702daeee088dc16c8389a1232fd376e558f32d65a993e05c89058f0a9de/merged 2024-04-12T09:08:47.864 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/132cfb17be8b29423b815827b4b93ef17e9f2c436b962426e15a3abd30999ce5/merged 2024-04-12T09:08:47.864 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/7a7fc2209005e34ba592948511fcc15b3d253ffe8029b7c7b37ae7933c0a0926/merged 2024-04-12T09:08:47.864 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns 2024-04-12T09:08:47.864 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-12T09:08:47.865 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-12T09:08:47.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:08:47.865 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-04-12T09:08:47.899 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi117.stderr:2024-04-12T09:08:47.896+0000 7fbf56eca300 -1 init, newargv = 0x5557d5b467e0 newargc=15 2024-04-12T09:08:47.899 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi117.stderr:ceph-fuse[77011]: starting ceph client 2024-04-12T09:08:47.901 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi117.stderr:ceph-fuse[77011]: starting fuse 2024-04-12T09:08:47.914 INFO:teuthology.orchestra.run.smithi117.stdout:114 2024-04-12T09:08:47.914 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [114] 2024-04-12T09:08:47.914 DEBUG:teuthology.orchestra.run.smithi117:> sudo stdin-killer -- python3 -c ' 2024-04-12T09:08:47.914 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2024-04-12T09:08:47.914 DEBUG:teuthology.orchestra.run.smithi117:> import re 2024-04-12T09:08:47.914 DEBUG:teuthology.orchestra.run.smithi117:> import os 2024-04-12T09:08:47.915 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2024-04-12T09:08:47.915 DEBUG:teuthology.orchestra.run.smithi117:> 2024-04-12T09:08:47.915 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2024-04-12T09:08:47.915 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-12T09:08:47.915 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2024-04-12T09:08:47.915 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-12T09:08:47.915 DEBUG:teuthology.orchestra.run.smithi117:> 2024-04-12T09:08:47.915 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2024-04-12T09:08:47.915 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2024-04-12T09:08:47.915 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2024-04-12T09:08:47.915 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2024-04-12T09:08:47.915 DEBUG:teuthology.orchestra.run.smithi117:> 2024-04-12T09:08:47.915 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2024-04-12T09:08:47.915 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-12T09:08:47.915 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-12T09:08:47.916 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-12T09:08:47.916 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2024-04-12T09:08:47.916 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2024-04-12T09:08:47.916 DEBUG:teuthology.orchestra.run.smithi117:> return f 2024-04-12T09:08:47.916 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-12T09:08:47.916 DEBUG:teuthology.orchestra.run.smithi117:> 2024-04-12T09:08:47.916 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.0")) 2024-04-12T09:08:47.916 DEBUG:teuthology.orchestra.run.smithi117:> ' 2024-04-12T09:08:48.035 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.0.77011.asok 2024-04-12T09:08:48.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T09:08:48.046 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.77011.asok 2024-04-12T09:08:48.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:08:48.046 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.77011.asok status 2024-04-12T09:08:48.178 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:08:48.178 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2024-04-12T09:08:48.178 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "d3b5060a17449edfae9385cdf792afec109fca5d", 2024-04-12T09:08:48.178 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)", 2024-04-12T09:08:48.178 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "0", 2024-04-12T09:08:48.178 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2024-04-12T09:08:48.178 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-12T09:08:48.178 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "77011", 2024-04-12T09:08:48.178 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2024-04-12T09:08:48.178 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:08:48.179 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2024-04-12T09:08:48.179 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2024-04-12T09:08:48.179 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 14524, 2024-04-12T09:08:48.179 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2024-04-12T09:08:48.179 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2024-04-12T09:08:48.179 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2024-04-12T09:08:48.179 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 14524 2024-04-12T09:08:48.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:08:48.179 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-04-12T09:08:48.179 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-04-12T09:08:48.179 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2024-04-12T09:08:48.179 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 32098587 2024-04-12T09:08:48.179 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:08:48.179 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:08:48.180 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-04-12T09:08:48.180 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-04-12T09:08:48.180 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2024-04-12T09:08:48.180 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 32098587 2024-04-12T09:08:48.180 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:08:48.180 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.14524 192.168.0.1:0/32098587", 2024-04-12T09:08:48.180 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/32098587", 2024-04-12T09:08:48.180 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2024-04-12T09:08:48.180 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 14, 2024-04-12T09:08:48.180 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 46, 2024-04-12T09:08:48.180 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2024-04-12T09:08:48.180 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2024-04-12T09:08:48.180 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2024-04-12T09:08:48.180 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:08:48.186 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- ceph fs ls 2024-04-12T09:08:48.442 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:08:48.709 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:48 smithi117 ceph-mon[29277]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-04-12T09:08:48.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:48 smithi203 ceph-mon[36428]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-04-12T09:08:50.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.030+0000 7f5ef620c700 1 -- 172.21.15.117:0/2739782686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ef0101d70 msgr2=0x7f5ef0102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:50.034 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.030+0000 7f5ef620c700 1 --2- 172.21.15.117:0/2739782686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ef0101d70 0x7f5ef0102140 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009ce0 tx=0x7f5ee8004d10 comp rx=0 tx=0).stop 2024-04-12T09:08:50.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.030+0000 7f5ef620c700 1 -- 172.21.15.117:0/2739782686 shutdown_connections 2024-04-12T09:08:50.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.030+0000 7f5ef620c700 1 --2- 172.21.15.117:0/2739782686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ef0102710 0x7f5ef00fbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:50.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.030+0000 7f5ef620c700 1 --2- 172.21.15.117:0/2739782686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ef0101d70 0x7f5ef0102140 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:50.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.030+0000 7f5ef620c700 1 -- 172.21.15.117:0/2739782686 >> 172.21.15.117:0/2739782686 conn(0x7f5ef0072bc0 msgr2=0x7f5ef0072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:50.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.030+0000 7f5ef620c700 1 -- 172.21.15.117:0/2739782686 shutdown_connections 2024-04-12T09:08:50.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.030+0000 7f5ef620c700 1 -- 172.21.15.117:0/2739782686 wait complete. 2024-04-12T09:08:50.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.031+0000 7f5ef620c700 1 Processor -- start 2024-04-12T09:08:50.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.031+0000 7f5ef620c700 1 -- start start 2024-04-12T09:08:50.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.031+0000 7f5ef620c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ef0101d70 0x7f5ef010ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:50.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.031+0000 7f5ef620c700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ef0102710 0x7f5ef010f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:50.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.031+0000 7f5ef620c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef010f860 con 0x7f5ef0101d70 2024-04-12T09:08:50.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.031+0000 7f5ef620c700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef010f9a0 con 0x7f5ef0102710 2024-04-12T09:08:50.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.031+0000 7f5eef7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ef0101d70 0x7f5ef010ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:50.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.031+0000 7f5eef7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ef0101d70 0x7f5ef010ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:59628/0 (socket says 172.21.15.117:59628) 2024-04-12T09:08:50.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.031+0000 7f5eef7fe700 1 -- 172.21.15.117:0/1429733668 learned_addr learned my addr 172.21.15.117:0/1429733668 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:08:50.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.031+0000 7f5eeeffd700 1 --2- 172.21.15.117:0/1429733668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ef0102710 0x7f5ef010f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:50.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.031+0000 7f5eef7fe700 1 -- 172.21.15.117:0/1429733668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ef0102710 msgr2=0x7f5ef010f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:50.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.031+0000 7f5eef7fe700 1 --2- 172.21.15.117:0/1429733668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ef0102710 0x7f5ef010f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:50.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.031+0000 7f5eef7fe700 1 -- 172.21.15.117:0/1429733668 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee8009940 con 0x7f5ef0101d70 2024-04-12T09:08:50.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.032+0000 7f5eef7fe700 1 --2- 172.21.15.117:0/1429733668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ef0101d70 0x7f5ef010ede0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8003400 tx=0x7f5ee8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:50.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.032+0000 7f5ee7fff700 1 -- 172.21.15.117:0/1429733668 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ee800e040 con 0x7f5ef0101d70 2024-04-12T09:08:50.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.032+0000 7f5ef620c700 1 -- 172.21.15.117:0/1429733668 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef0117c90 con 0x7f5ef0101d70 2024-04-12T09:08:50.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.032+0000 7f5ee7fff700 1 -- 172.21.15.117:0/1429733668 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ee8004610 con 0x7f5ef0101d70 2024-04-12T09:08:50.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.032+0000 7f5ee7fff700 1 -- 172.21.15.117:0/1429733668 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ee801c640 con 0x7f5ef0101d70 2024-04-12T09:08:50.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.032+0000 7f5ef620c700 1 -- 172.21.15.117:0/1429733668 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef0118220 con 0x7f5ef0101d70 2024-04-12T09:08:50.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.033+0000 7f5ef620c700 1 -- 172.21.15.117:0/1429733668 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef00ff080 con 0x7f5ef0101d70 2024-04-12T09:08:50.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.033+0000 7f5ee7fff700 1 -- 172.21.15.117:0/1429733668 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f5ee8012a70 con 0x7f5ef0101d70 2024-04-12T09:08:50.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.034+0000 7f5ee7fff700 1 --2- 172.21.15.117:0/1429733668 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f5edc0692a0 0x7f5edc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:50.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.034+0000 7f5ee7fff700 1 -- 172.21.15.117:0/1429733668 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f5ee8088ca0 con 0x7f5ef0101d70 2024-04-12T09:08:50.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.034+0000 7f5eeeffd700 1 --2- 172.21.15.117:0/1429733668 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f5edc0692a0 0x7f5edc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:50.037 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.034+0000 7f5eeeffd700 1 --2- 172.21.15.117:0/1429733668 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f5edc0692a0 0x7f5edc06b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0066020 tx=0x7f5ed800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:50.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.038+0000 7f5ee7fff700 1 -- 172.21.15.117:0/1429733668 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f5ee808d070 con 0x7f5ef0101d70 2024-04-12T09:08:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.267+0000 7f5ef620c700 1 -- 172.21.15.117:0/1429733668 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5ef004bed0 con 0x7f5ef0101d70 2024-04-12T09:08:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.267+0000 7f5ee7fff700 1 -- 172.21.15.117:0/1429733668 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+83 (secure 0 0 0) 0x7f5ee8054f00 con 0x7f5ef0101d70 2024-04-12T09:08:50.268 INFO:teuthology.orchestra.run.smithi117.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-12T09:08:50.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.269+0000 7f5ef620c700 1 -- 172.21.15.117:0/1429733668 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f5edc0692a0 msgr2=0x7f5edc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:50.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.269+0000 7f5ef620c700 1 --2- 172.21.15.117:0/1429733668 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f5edc0692a0 0x7f5edc06b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0066020 tx=0x7f5ed800b040 comp rx=0 tx=0).stop 2024-04-12T09:08:50.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.269+0000 7f5ef620c700 1 -- 172.21.15.117:0/1429733668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ef0101d70 msgr2=0x7f5ef010ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:50.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.269+0000 7f5ef620c700 1 --2- 172.21.15.117:0/1429733668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ef0101d70 0x7f5ef010ede0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8003400 tx=0x7f5ee8004d10 comp rx=0 tx=0).stop 2024-04-12T09:08:50.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.269+0000 7f5ef620c700 1 -- 172.21.15.117:0/1429733668 shutdown_connections 2024-04-12T09:08:50.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.269+0000 7f5ef620c700 1 --2- 172.21.15.117:0/1429733668 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f5edc0692a0 0x7f5edc06b750 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:50.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.269+0000 7f5ef620c700 1 --2- 172.21.15.117:0/1429733668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ef0101d70 0x7f5ef010ede0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:50.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.269+0000 7f5ef620c700 1 --2- 172.21.15.117:0/1429733668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ef0102710 0x7f5ef010f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:50.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.269+0000 7f5ef620c700 1 -- 172.21.15.117:0/1429733668 >> 172.21.15.117:0/1429733668 conn(0x7f5ef0072bc0 msgr2=0x7f5ef00faec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:50.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.269+0000 7f5ef620c700 1 -- 172.21.15.117:0/1429733668 shutdown_connections 2024-04-12T09:08:50.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:50.269+0000 7f5ef620c700 1 -- 172.21.15.117:0/1429733668 wait complete. 2024-04-12T09:08:50.611 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:50 smithi117 ceph-mon[29277]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-04-12T09:08:50.612 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:50 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/1429733668' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-12T09:08:50.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:50 smithi203 ceph-mon[36428]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-04-12T09:08:50.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:50 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/1429733668' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-12T09:08:50.870 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-12T09:08:50.871 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-12T09:08:50.871 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi203.front.sepia.ceph.com 2024-04-12T09:08:50.871 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-12T09:08:50.871 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-12T09:08:50.871 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-12T09:08:50.871 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-12T09:08:50.871 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-12T09:08:50.871 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-12T09:08:50.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:08:50.871 DEBUG:teuthology.orchestra.run.smithi203:> ip addr 2024-04-12T09:08:50.892 INFO:teuthology.orchestra.run.smithi203.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-12T09:08:50.892 INFO:teuthology.orchestra.run.smithi203.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-12T09:08:50.892 INFO:teuthology.orchestra.run.smithi203.stdout: inet 127.0.0.1/8 scope host lo 2024-04-12T09:08:50.892 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-12T09:08:50.892 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 ::1/128 scope host 2024-04-12T09:08:50.892 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-12T09:08:50.892 INFO:teuthology.orchestra.run.smithi203.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-12T09:08:50.892 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:d9:19:44 brd ff:ff:ff:ff:ff:ff 2024-04-12T09:08:50.892 INFO:teuthology.orchestra.run.smithi203.stdout: altname enp7s0f0 2024-04-12T09:08:50.892 INFO:teuthology.orchestra.run.smithi203.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-12T09:08:50.892 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:d9:19:45 brd ff:ff:ff:ff:ff:ff 2024-04-12T09:08:50.892 INFO:teuthology.orchestra.run.smithi203.stdout: altname enp7s0f1 2024-04-12T09:08:50.893 INFO:teuthology.orchestra.run.smithi203.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-12T09:08:50.893 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:8f:4a:22 brd ff:ff:ff:ff:ff:ff 2024-04-12T09:08:50.893 INFO:teuthology.orchestra.run.smithi203.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-12T09:08:50.893 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:8f:4a:23 brd ff:ff:ff:ff:ff:ff 2024-04-12T09:08:50.893 INFO:teuthology.orchestra.run.smithi203.stdout: inet 172.21.15.203/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-12T09:08:50.893 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft 42243sec preferred_lft 42243sec 2024-04-12T09:08:50.893 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::ec4:7aff:fe8f:4a23/64 scope link 2024-04-12T09:08:50.893 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-12T09:08:50.893 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-12T09:08:50.893 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T09:08:50.893 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-12T09:08:50.894 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link add name ceph-brx type bridge 2024-04-12T09:08:50.894 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip addr flush dev ceph-brx 2024-04-12T09:08:50.894 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set ceph-brx up 2024-04-12T09:08:50.894 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-12T09:08:50.894 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-12T09:08:50.987 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:08:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T09:08:51.111 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:08:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T09:08:51.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:08:51.119 DEBUG:teuthology.orchestra.run.smithi203:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-12T09:08:51.146 INFO:teuthology.orchestra.run.smithi203.stdout:1 2024-04-12T09:08:51.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:08:51.148 DEBUG:teuthology.orchestra.run.smithi203:> route 2024-04-12T09:08:51.217 INFO:teuthology.orchestra.run.smithi203.stdout:Kernel IP routing table 2024-04-12T09:08:51.217 INFO:teuthology.orchestra.run.smithi203.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-12T09:08:51.217 INFO:teuthology.orchestra.run.smithi203.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-12T09:08:51.217 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-12T09:08:51.217 INFO:teuthology.orchestra.run.smithi203.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-12T09:08:51.218 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T09:08:51.218 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-12T09:08:51.218 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-12T09:08:51.218 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-12T09:08:51.218 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-12T09:08:51.218 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-12T09:08:51.305 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:08:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T09:08:51.538 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:08:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T09:08:51.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:08:51.545 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2024-04-12T09:08:51.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:08:51.560 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list-id 2024-04-12T09:08:51.615 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T09:08:51.615 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-12T09:08:51.615 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-12T09:08:51.615 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-12T09:08:51.615 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-12T09:08:51.704 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:08:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T09:08:51.735 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:08:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T09:08:51.741 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-12T09:08:51.741 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T09:08:51.742 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-12T09:08:51.742 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-12T09:08:51.742 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-12T09:08:51.742 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-12T09:08:51.742 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-12T09:08:51.742 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-12T09:08:51.742 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-12T09:08:51.790 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:08:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T09:08:51.876 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:08:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T09:08:51.883 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T09:08:51.883 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-12T09:08:51.883 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set brx.0 up 2024-04-12T09:08:51.884 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set dev brx.0 master ceph-brx 2024-04-12T09:08:51.884 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-12T09:08:51.932 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:08:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T09:08:51.960 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:08:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T09:08:51.966 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-12T09:08:51.967 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-12T09:08:51.967 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-12T09:08:51.982 INFO:teuthology.orchestra.run.smithi203.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-12T09:08:51.983 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-12T09:08:51.983 DEBUG:teuthology.orchestra.run.smithi203:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-12T09:08:52.038 DEBUG:teuthology.orchestra.run.smithi203:> sudo modprobe fuse 2024-04-12T09:08:52.106 DEBUG:teuthology.orchestra.run.smithi203:> cat /proc/self/mounts | awk '{print $2}' 2024-04-12T09:08:52.161 INFO:teuthology.orchestra.run.smithi203.stdout:/proc 2024-04-12T09:08:52.161 INFO:teuthology.orchestra.run.smithi203.stdout:/sys 2024-04-12T09:08:52.161 INFO:teuthology.orchestra.run.smithi203.stdout:/dev 2024-04-12T09:08:52.162 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/security 2024-04-12T09:08:52.162 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/shm 2024-04-12T09:08:52.162 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/pts 2024-04-12T09:08:52.162 INFO:teuthology.orchestra.run.smithi203.stdout:/run 2024-04-12T09:08:52.162 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/cgroup 2024-04-12T09:08:52.162 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/pstore 2024-04-12T09:08:52.162 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/bpf 2024-04-12T09:08:52.162 INFO:teuthology.orchestra.run.smithi203.stdout:/ 2024-04-12T09:08:52.162 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/selinux 2024-04-12T09:08:52.162 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/sys/fs/binfmt_misc 2024-04-12T09:08:52.163 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/mqueue 2024-04-12T09:08:52.163 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/hugepages 2024-04-12T09:08:52.163 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/debug 2024-04-12T09:08:52.163 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/tracing 2024-04-12T09:08:52.163 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-12T09:08:52.163 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/fuse/connections 2024-04-12T09:08:52.163 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-sysctl.service 2024-04-12T09:08:52.163 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/config 2024-04-12T09:08:52.163 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-12T09:08:52.163 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/nfs/rpc_pipefs 2024-04-12T09:08:52.163 INFO:teuthology.orchestra.run.smithi203.stdout:/run/user/1000 2024-04-12T09:08:52.163 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph 2024-04-12T09:08:52.163 INFO:teuthology.orchestra.run.smithi203.stdout:/run/user/0 2024-04-12T09:08:52.163 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/sys/fs/binfmt_misc 2024-04-12T09:08:52.164 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay 2024-04-12T09:08:52.164 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/ab79028b86409951a1c66dd840cb85ed2288e33679fc287bd40eecae271d6a34/merged 2024-04-12T09:08:52.164 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/b7a6baca901c63088969fc72e7616bdccdb6456f6e7e53f84cefd3b76f3407e3/merged 2024-04-12T09:08:52.164 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/8a796dccb1370af5891744a83f3741f428ae6106e31e3eb732399592f1833766/merged 2024-04-12T09:08:52.164 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/e5669fef2e1ff1310b492e5f3ced94a9a70a5fe94c1fd8ebbdd48b0caf915df7/merged 2024-04-12T09:08:52.164 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/40ba76d2d7cd0c5e962d159d39e1b679d8e3e03eb6e6cc7ce3a06f344cc4c6e2/merged 2024-04-12T09:08:52.164 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/243a86314c31a910d67bebde3b349c5667c2363f5a5aad066cf739eecc8afcde/merged 2024-04-12T09:08:52.164 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/8271f61024d8ff531da4381b6c2bba3ea594e73cde496219dff0d1abee54bd16/merged 2024-04-12T09:08:52.164 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/727ad7630d764899c94f39971e8c0f603f6b39b48556d0ec0d1ead7cec0c252f/merged 2024-04-12T09:08:52.164 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/927ad7a78fdb83d1ee11918268047c95ae56225582eef7b31605af1127633503/merged 2024-04-12T09:08:52.164 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns 2024-04-12T09:08:52.164 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-12T09:08:52.164 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-12T09:08:52.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:08:52.165 DEBUG:teuthology.orchestra.run.smithi203:> ls /sys/fs/fuse/connections 2024-04-12T09:08:52.217 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-12T09:08:52.217 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-12T09:08:52.259 DEBUG:teuthology.orchestra.run.smithi203:> sudo modprobe fuse 2024-04-12T09:08:52.285 DEBUG:teuthology.orchestra.run.smithi203:> cat /proc/self/mounts | awk '{print $2}' 2024-04-12T09:08:52.341 INFO:teuthology.orchestra.run.smithi203.stdout:/proc 2024-04-12T09:08:52.341 INFO:teuthology.orchestra.run.smithi203.stdout:/sys 2024-04-12T09:08:52.341 INFO:teuthology.orchestra.run.smithi203.stdout:/dev 2024-04-12T09:08:52.341 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/security 2024-04-12T09:08:52.341 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/shm 2024-04-12T09:08:52.342 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/pts 2024-04-12T09:08:52.342 INFO:teuthology.orchestra.run.smithi203.stdout:/run 2024-04-12T09:08:52.342 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/cgroup 2024-04-12T09:08:52.342 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/pstore 2024-04-12T09:08:52.342 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/bpf 2024-04-12T09:08:52.342 INFO:teuthology.orchestra.run.smithi203.stdout:/ 2024-04-12T09:08:52.342 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/selinux 2024-04-12T09:08:52.342 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/sys/fs/binfmt_misc 2024-04-12T09:08:52.342 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/mqueue 2024-04-12T09:08:52.342 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/hugepages 2024-04-12T09:08:52.342 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/debug 2024-04-12T09:08:52.342 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/tracing 2024-04-12T09:08:52.342 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-12T09:08:52.342 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/fuse/connections 2024-04-12T09:08:52.343 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-sysctl.service 2024-04-12T09:08:52.343 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/config 2024-04-12T09:08:52.343 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-12T09:08:52.343 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/nfs/rpc_pipefs 2024-04-12T09:08:52.343 INFO:teuthology.orchestra.run.smithi203.stdout:/run/user/1000 2024-04-12T09:08:52.343 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph 2024-04-12T09:08:52.343 INFO:teuthology.orchestra.run.smithi203.stdout:/run/user/0 2024-04-12T09:08:52.343 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/sys/fs/binfmt_misc 2024-04-12T09:08:52.343 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay 2024-04-12T09:08:52.343 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/ab79028b86409951a1c66dd840cb85ed2288e33679fc287bd40eecae271d6a34/merged 2024-04-12T09:08:52.343 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/b7a6baca901c63088969fc72e7616bdccdb6456f6e7e53f84cefd3b76f3407e3/merged 2024-04-12T09:08:52.343 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/8a796dccb1370af5891744a83f3741f428ae6106e31e3eb732399592f1833766/merged 2024-04-12T09:08:52.343 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/e5669fef2e1ff1310b492e5f3ced94a9a70a5fe94c1fd8ebbdd48b0caf915df7/merged 2024-04-12T09:08:52.343 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/40ba76d2d7cd0c5e962d159d39e1b679d8e3e03eb6e6cc7ce3a06f344cc4c6e2/merged 2024-04-12T09:08:52.344 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/243a86314c31a910d67bebde3b349c5667c2363f5a5aad066cf739eecc8afcde/merged 2024-04-12T09:08:52.344 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/8271f61024d8ff531da4381b6c2bba3ea594e73cde496219dff0d1abee54bd16/merged 2024-04-12T09:08:52.344 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/727ad7630d764899c94f39971e8c0f603f6b39b48556d0ec0d1ead7cec0c252f/merged 2024-04-12T09:08:52.344 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/containers/storage/overlay/927ad7a78fdb83d1ee11918268047c95ae56225582eef7b31605af1127633503/merged 2024-04-12T09:08:52.344 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns 2024-04-12T09:08:52.344 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-12T09:08:52.344 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-12T09:08:52.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:08:52.344 DEBUG:teuthology.orchestra.run.smithi203:> ls /sys/fs/fuse/connections 2024-04-12T09:08:52.369 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi203.stderr:2024-04-12T09:08:52.368+0000 7fbbb68ee300 -1 init, newargv = 0x555f9e931670 newargc=15 2024-04-12T09:08:52.369 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi203.stderr:ceph-fuse[61780]: starting ceph client 2024-04-12T09:08:52.374 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi203.stderr:ceph-fuse[61780]: starting fuse 2024-04-12T09:08:52.385 INFO:teuthology.orchestra.run.smithi203.stdout:115 2024-04-12T09:08:52.385 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [115] 2024-04-12T09:08:52.385 DEBUG:teuthology.orchestra.run.smithi203:> sudo stdin-killer -- python3 -c ' 2024-04-12T09:08:52.386 DEBUG:teuthology.orchestra.run.smithi203:> import glob 2024-04-12T09:08:52.386 DEBUG:teuthology.orchestra.run.smithi203:> import re 2024-04-12T09:08:52.386 DEBUG:teuthology.orchestra.run.smithi203:> import os 2024-04-12T09:08:52.386 DEBUG:teuthology.orchestra.run.smithi203:> import subprocess 2024-04-12T09:08:52.386 DEBUG:teuthology.orchestra.run.smithi203:> 2024-04-12T09:08:52.386 DEBUG:teuthology.orchestra.run.smithi203:> def _find_admin_socket(client_name): 2024-04-12T09:08:52.386 DEBUG:teuthology.orchestra.run.smithi203:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-12T09:08:52.386 DEBUG:teuthology.orchestra.run.smithi203:> files = glob.glob(asok_path) 2024-04-12T09:08:52.386 DEBUG:teuthology.orchestra.run.smithi203:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-12T09:08:52.386 DEBUG:teuthology.orchestra.run.smithi203:> 2024-04-12T09:08:52.386 DEBUG:teuthology.orchestra.run.smithi203:> # Given a non-glob path, it better be there 2024-04-12T09:08:52.386 DEBUG:teuthology.orchestra.run.smithi203:> if "*" not in asok_path: 2024-04-12T09:08:52.386 DEBUG:teuthology.orchestra.run.smithi203:> assert(len(files) == 1) 2024-04-12T09:08:52.386 DEBUG:teuthology.orchestra.run.smithi203:> return files[0] 2024-04-12T09:08:52.386 DEBUG:teuthology.orchestra.run.smithi203:> 2024-04-12T09:08:52.386 DEBUG:teuthology.orchestra.run.smithi203:> for f in files: 2024-04-12T09:08:52.387 DEBUG:teuthology.orchestra.run.smithi203:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-12T09:08:52.387 DEBUG:teuthology.orchestra.run.smithi203:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-12T09:08:52.387 DEBUG:teuthology.orchestra.run.smithi203:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-12T09:08:52.387 DEBUG:teuthology.orchestra.run.smithi203:> contents = proc_f.read() 2024-04-12T09:08:52.387 DEBUG:teuthology.orchestra.run.smithi203:> if mountpoint in contents: 2024-04-12T09:08:52.387 DEBUG:teuthology.orchestra.run.smithi203:> return f 2024-04-12T09:08:52.387 DEBUG:teuthology.orchestra.run.smithi203:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-12T09:08:52.387 DEBUG:teuthology.orchestra.run.smithi203:> 2024-04-12T09:08:52.387 DEBUG:teuthology.orchestra.run.smithi203:> print(_find_admin_socket("client.1")) 2024-04-12T09:08:52.387 DEBUG:teuthology.orchestra.run.smithi203:> ' 2024-04-12T09:08:52.508 INFO:teuthology.orchestra.run.smithi203.stdout:/var/run/ceph/ceph-client.1.61780.asok 2024-04-12T09:08:52.511 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-12T09:08:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T09:08:52.519 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.61780.asok 2024-04-12T09:08:52.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:08:52.519 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.61780.asok status 2024-04-12T09:08:52.651 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-04-12T09:08:52.651 INFO:teuthology.orchestra.run.smithi203.stdout: "metadata": { 2024-04-12T09:08:52.651 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_sha1": "d3b5060a17449edfae9385cdf792afec109fca5d", 2024-04-12T09:08:52.651 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_version": "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)", 2024-04-12T09:08:52.651 INFO:teuthology.orchestra.run.smithi203.stdout: "entity_id": "1", 2024-04-12T09:08:52.651 INFO:teuthology.orchestra.run.smithi203.stdout: "hostname": "smithi203", 2024-04-12T09:08:52.651 INFO:teuthology.orchestra.run.smithi203.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-12T09:08:52.651 INFO:teuthology.orchestra.run.smithi203.stdout: "pid": "61780", 2024-04-12T09:08:52.651 INFO:teuthology.orchestra.run.smithi203.stdout: "root": "/" 2024-04-12T09:08:52.651 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-04-12T09:08:52.651 INFO:teuthology.orchestra.run.smithi203.stdout: "dentry_count": 0, 2024-04-12T09:08:52.651 INFO:teuthology.orchestra.run.smithi203.stdout: "dentry_pinned_count": 0, 2024-04-12T09:08:52.652 INFO:teuthology.orchestra.run.smithi203.stdout: "id": 24317, 2024-04-12T09:08:52.652 INFO:teuthology.orchestra.run.smithi203.stdout: "inst": { 2024-04-12T09:08:52.652 INFO:teuthology.orchestra.run.smithi203.stdout: "name": { 2024-04-12T09:08:52.652 INFO:teuthology.orchestra.run.smithi203.stdout: "type": "client", 2024-04-12T09:08:52.652 INFO:teuthology.orchestra.run.smithi203.stdout: "num": 24317 2024-04-12T09:08:52.652 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-04-12T09:08:52.652 INFO:teuthology.orchestra.run.smithi203.stdout: "addr": { 2024-04-12T09:08:52.652 INFO:teuthology.orchestra.run.smithi203.stdout: "type": "v1", 2024-04-12T09:08:52.652 INFO:teuthology.orchestra.run.smithi203.stdout: "addr": "192.168.0.1:0", 2024-04-12T09:08:52.652 INFO:teuthology.orchestra.run.smithi203.stdout: "nonce": 3670805323 2024-04-12T09:08:52.652 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-04-12T09:08:52.652 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-04-12T09:08:52.652 INFO:teuthology.orchestra.run.smithi203.stdout: "addr": { 2024-04-12T09:08:52.652 INFO:teuthology.orchestra.run.smithi203.stdout: "type": "v1", 2024-04-12T09:08:52.652 INFO:teuthology.orchestra.run.smithi203.stdout: "addr": "192.168.0.1:0", 2024-04-12T09:08:52.652 INFO:teuthology.orchestra.run.smithi203.stdout: "nonce": 3670805323 2024-04-12T09:08:52.653 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-04-12T09:08:52.653 INFO:teuthology.orchestra.run.smithi203.stdout: "inst_str": "client.24317 192.168.0.1:0/3670805323", 2024-04-12T09:08:52.653 INFO:teuthology.orchestra.run.smithi203.stdout: "addr_str": "192.168.0.1:0/3670805323", 2024-04-12T09:08:52.653 INFO:teuthology.orchestra.run.smithi203.stdout: "inode_count": 1, 2024-04-12T09:08:52.653 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_epoch": 14, 2024-04-12T09:08:52.653 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_epoch": 46, 2024-04-12T09:08:52.653 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_epoch_barrier": 0, 2024-04-12T09:08:52.653 INFO:teuthology.orchestra.run.smithi203.stdout: "blocklisted": false, 2024-04-12T09:08:52.653 INFO:teuthology.orchestra.run.smithi203.stdout: "fs_name": "cephfs" 2024-04-12T09:08:52.653 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-04-12T09:08:52.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:08:52.659 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2024-04-12T09:08:52.659 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-12T09:08:52.679 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2024-04-12T09:08:52.679 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-12T09:08:52.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:08:52.679 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-12T09:08:52.748 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:52 smithi117 ceph-mon[29277]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-12T09:08:52.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:08:52.756 DEBUG:teuthology.orchestra.run.smithi203:> stat --file-system '--printf=%T 2024-04-12T09:08:52.756 DEBUG:teuthology.orchestra.run.smithi203:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-12T09:08:52.771 INFO:teuthology.orchestra.run.smithi203.stdout:fuseblk 2024-04-12T09:08:52.771 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-12T09:08:52.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:08:52.771 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-12T09:08:52.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:52 smithi203 ceph-mon[36428]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-12T09:08:52.841 INFO:teuthology.run_tasks:Running task print... 2024-04-12T09:08:52.851 INFO:teuthology.task.print:**** done client 2024-04-12T09:08:52.851 INFO:teuthology.run_tasks:Running task parallel... 2024-04-12T09:08:52.867 INFO:teuthology.task.parallel:starting parallel... 2024-04-12T09:08:52.867 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-12T09:08:52.868 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-12T09:08:52.868 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi117.front.sepia.ceph.com 2024-04-12T09:08:52.869 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-04-12T09:08:52.869 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-12T09:08:52.869 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-04-12T09:08:52.873 INFO:tasks.workunit:Pulling workunits from ref dea717a37c7849ca8459c02fb965020aedcc0a9a 2024-04-12T09:08:52.873 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-12T09:08:52.873 INFO:tasks.workunit:timeout=3h 2024-04-12T09:08:52.873 INFO:tasks.workunit:cleanup=True 2024-04-12T09:08:52.873 DEBUG:teuthology.orchestra.run.smithi117:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-12T09:08:52.893 INFO:teuthology.orchestra.run.smithi117.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-12T09:08:52.893 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-12T09:08:52.894 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 72h/114d Inode: 1 Links: 2 2024-04-12T09:08:52.894 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T09:08:52.894 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-12T09:08:52.894 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-12T09:08:52.894 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-04-12 09:08:17.508600736 +0000 2024-04-12T09:08:52.894 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-04-12 09:08:52.753402418 +0000 2024-04-12T09:08:52.895 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2024-04-12T09:08:52.895 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-12T09:08:52.895 DEBUG:teuthology.orchestra.run.smithi117:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-12T09:08:52.967 DEBUG:teuthology.orchestra.run.smithi203:> stat -- /home/ubuntu/cephtest/mnt.1 2024-04-12T09:08:52.984 INFO:teuthology.orchestra.run.smithi203.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-04-12T09:08:52.984 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-12T09:08:52.984 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 73h/115d Inode: 1 Links: 3 2024-04-12T09:08:52.984 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T09:08:52.984 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-12T09:08:52.984 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-12T09:08:52.984 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-04-12 09:08:52.961812178 +0000 2024-04-12T09:08:52.984 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-04-12 09:08:52.961812178 +0000 2024-04-12T09:08:52.985 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: - 2024-04-12T09:08:52.985 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-04-12T09:08:52.985 DEBUG:teuthology.orchestra.run.smithi203:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-04-12T09:08:53.056 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout dea717a37c7849ca8459c02fb965020aedcc0a9a 2024-04-12T09:08:53.057 DEBUG:teuthology.orchestra.run.smithi203:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout dea717a37c7849ca8459c02fb965020aedcc0a9a 2024-04-12T09:08:53.073 INFO:tasks.workunit.client.0.smithi117.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-12T09:08:53.111 INFO:tasks.workunit.client.1.smithi203.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-04-12T09:08:53.143 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:08:54.642 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:54 smithi117 ceph-mon[29277]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-12T09:08:54.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.643+0000 7f220fc6d700 1 -- 172.21.15.117:0/3549497643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2208066280 msgr2=0x7f22080ffa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:54.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.643+0000 7f220fc6d700 1 --2- 172.21.15.117:0/3549497643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2208066280 0x7f22080ffa20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2204004940 tx=0x7f2204009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:54.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.643+0000 7f220fc6d700 1 -- 172.21.15.117:0/3549497643 shutdown_connections 2024-04-12T09:08:54.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.643+0000 7f220fc6d700 1 --2- 172.21.15.117:0/3549497643 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22080fff60 0x7f2208102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:54.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.643+0000 7f220fc6d700 1 --2- 172.21.15.117:0/3549497643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2208066280 0x7f22080ffa20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:54.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.643+0000 7f220fc6d700 1 -- 172.21.15.117:0/3549497643 >> 172.21.15.117:0/3549497643 conn(0x7f22080f7430 msgr2=0x7f22080f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:54.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.643+0000 7f220fc6d700 1 -- 172.21.15.117:0/3549497643 shutdown_connections 2024-04-12T09:08:54.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.644+0000 7f220fc6d700 1 -- 172.21.15.117:0/3549497643 wait complete. 2024-04-12T09:08:54.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.644+0000 7f220fc6d700 1 Processor -- start 2024-04-12T09:08:54.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.644+0000 7f220fc6d700 1 -- start start 2024-04-12T09:08:54.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.644+0000 7f220fc6d700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2208066280 0x7f220810da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:54.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.644+0000 7f220fc6d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22080fff60 0x7f220810dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:54.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.644+0000 7f220fc6d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220810e5c0 con 0x7f22080fff60 2024-04-12T09:08:54.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.644+0000 7f220fc6d700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220810ee10 con 0x7f2208066280 2024-04-12T09:08:54.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.644+0000 7f220d208700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22080fff60 0x7f220810dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:54.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.644+0000 7f220d208700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22080fff60 0x7f220810dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:59644/0 (socket says 172.21.15.117:59644) 2024-04-12T09:08:54.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.644+0000 7f220d208700 1 -- 172.21.15.117:0/4037889402 learned_addr learned my addr 172.21.15.117:0/4037889402 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:08:54.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.644+0000 7f220da09700 1 --2- 172.21.15.117:0/4037889402 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2208066280 0x7f220810da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:54.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.645+0000 7f220d208700 1 -- 172.21.15.117:0/4037889402 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2208066280 msgr2=0x7f220810da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:54.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.645+0000 7f220d208700 1 --2- 172.21.15.117:0/4037889402 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2208066280 0x7f220810da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:54.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.645+0000 7f220d208700 1 -- 172.21.15.117:0/4037889402 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2204005040 con 0x7f22080fff60 2024-04-12T09:08:54.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.645+0000 7f220d208700 1 --2- 172.21.15.117:0/4037889402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22080fff60 0x7f220810dfc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f21f8002a50 tx=0x7f21f80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:54.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.645+0000 7f21fe7fc700 1 -- 172.21.15.117:0/4037889402 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21f8007cc0 con 0x7f22080fff60 2024-04-12T09:08:54.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.645+0000 7f220fc6d700 1 -- 172.21.15.117:0/4037889402 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220810f0f0 con 0x7f22080fff60 2024-04-12T09:08:54.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.645+0000 7f21fe7fc700 1 -- 172.21.15.117:0/4037889402 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f21f800f040 con 0x7f22080fff60 2024-04-12T09:08:54.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.645+0000 7f21fe7fc700 1 -- 172.21.15.117:0/4037889402 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21f800da70 con 0x7f22080fff60 2024-04-12T09:08:54.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.645+0000 7f220fc6d700 1 -- 172.21.15.117:0/4037889402 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220810f630 con 0x7f22080fff60 2024-04-12T09:08:54.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.646+0000 7f220fc6d700 1 -- 172.21.15.117:0/4037889402 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f220805f5f0 con 0x7f22080fff60 2024-04-12T09:08:54.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.646+0000 7f21fe7fc700 1 -- 172.21.15.117:0/4037889402 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f21f800dc10 con 0x7f22080fff60 2024-04-12T09:08:54.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.647+0000 7f21fe7fc700 1 --2- 172.21.15.117:0/4037889402 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f21f40692a0 0x7f21f406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:54.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.647+0000 7f21fe7fc700 1 -- 172.21.15.117:0/4037889402 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f21f8086870 con 0x7f22080fff60 2024-04-12T09:08:54.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.647+0000 7f220da09700 1 --2- 172.21.15.117:0/4037889402 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f21f40692a0 0x7f21f406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:54.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.647+0000 7f220da09700 1 --2- 172.21.15.117:0/4037889402 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f21f40692a0 0x7f21f406b750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2204004890 tx=0x7f2204009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:54.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.651+0000 7f21fe7fc700 1 -- 172.21.15.117:0/4037889402 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f21f8056560 con 0x7f22080fff60 2024-04-12T09:08:54.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:54 smithi203 ceph-mon[36428]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-12T09:08:54.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.839+0000 7f220fc6d700 1 -- 172.21.15.117:0/4037889402 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f220804bed0 con 0x7f22080fff60 2024-04-12T09:08:54.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.840+0000 7f21fe7fc700 1 -- 172.21.15.117:0/4037889402 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f21f80560f0 con 0x7f22080fff60 2024-04-12T09:08:54.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.842+0000 7f220fc6d700 1 -- 172.21.15.117:0/4037889402 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f21f40692a0 msgr2=0x7f21f406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:54.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.842+0000 7f220fc6d700 1 --2- 172.21.15.117:0/4037889402 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f21f40692a0 0x7f21f406b750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2204004890 tx=0x7f2204009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:54.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.842+0000 7f220fc6d700 1 -- 172.21.15.117:0/4037889402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22080fff60 msgr2=0x7f220810dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:54.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.842+0000 7f220fc6d700 1 --2- 172.21.15.117:0/4037889402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22080fff60 0x7f220810dfc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f21f8002a50 tx=0x7f21f80046b0 comp rx=0 tx=0).stop 2024-04-12T09:08:54.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.842+0000 7f220fc6d700 1 -- 172.21.15.117:0/4037889402 shutdown_connections 2024-04-12T09:08:54.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.842+0000 7f220fc6d700 1 --2- 172.21.15.117:0/4037889402 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f21f40692a0 0x7f21f406b750 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:54.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.842+0000 7f220fc6d700 1 --2- 172.21.15.117:0/4037889402 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2208066280 0x7f220810da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:54.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.842+0000 7f220fc6d700 1 --2- 172.21.15.117:0/4037889402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22080fff60 0x7f220810dfc0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:54.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.842+0000 7f220fc6d700 1 -- 172.21.15.117:0/4037889402 >> 172.21.15.117:0/4037889402 conn(0x7f22080f7430 msgr2=0x7f22080f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:54.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.842+0000 7f220fc6d700 1 -- 172.21.15.117:0/4037889402 shutdown_connections 2024-04-12T09:08:54.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:54.842+0000 7f220fc6d700 1 -- 172.21.15.117:0/4037889402 wait complete. 2024-04-12T09:08:55.509 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-04-12T09:08:55.813 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:08:56.635 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:56 smithi117 ceph-mon[29277]: pgmap v196: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-12T09:08:56.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:56 smithi203 ceph-mon[36428]: pgmap v196: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-12T09:08:57.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.431+0000 7fe09a34c700 1 -- 172.21.15.117:0/1729493788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0940fbcd0 msgr2=0x7fe0940fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:57.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.431+0000 7fe09a34c700 1 --2- 172.21.15.117:0/1729493788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0940fbcd0 0x7fe0940fc0e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe07c004940 tx=0x7fe07c009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:57.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.431+0000 7fe09a34c700 1 -- 172.21.15.117:0/1729493788 shutdown_connections 2024-04-12T09:08:57.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.431+0000 7fe09a34c700 1 --2- 172.21.15.117:0/1729493788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0940fcf80 0x7fe0940fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:57.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.431+0000 7fe09a34c700 1 --2- 172.21.15.117:0/1729493788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0940fbcd0 0x7fe0940fc0e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:57.432 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.431+0000 7fe09a34c700 1 -- 172.21.15.117:0/1729493788 >> 172.21.15.117:0/1729493788 conn(0x7fe0940f7430 msgr2=0x7fe0940f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:57.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.431+0000 7fe09a34c700 1 -- 172.21.15.117:0/1729493788 shutdown_connections 2024-04-12T09:08:57.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.431+0000 7fe09a34c700 1 -- 172.21.15.117:0/1729493788 wait complete. 2024-04-12T09:08:57.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.431+0000 7fe09a34c700 1 Processor -- start 2024-04-12T09:08:57.433 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.431+0000 7fe09a34c700 1 -- start start 2024-04-12T09:08:57.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.432+0000 7fe09a34c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0940fbcd0 0x7fe09410daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:57.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.432+0000 7fe09a34c700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0940fcf80 0x7fe09410e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:57.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.432+0000 7fe09a34c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09410e6c0 con 0x7fe0940fbcd0 2024-04-12T09:08:57.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.432+0000 7fe09a34c700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09410ee10 con 0x7fe0940fcf80 2024-04-12T09:08:57.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.432+0000 7fe093fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0940fbcd0 0x7fe09410daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:57.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.432+0000 7fe093fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0940fbcd0 0x7fe09410daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:59664/0 (socket says 172.21.15.117:59664) 2024-04-12T09:08:57.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.432+0000 7fe093fff700 1 -- 172.21.15.117:0/869382669 learned_addr learned my addr 172.21.15.117:0/869382669 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:08:57.435 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.432+0000 7fe0937fe700 1 --2- 172.21.15.117:0/869382669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0940fcf80 0x7fe09410e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:57.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.432+0000 7fe093fff700 1 -- 172.21.15.117:0/869382669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0940fcf80 msgr2=0x7fe09410e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:57.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.432+0000 7fe093fff700 1 --2- 172.21.15.117:0/869382669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0940fcf80 0x7fe09410e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:57.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.432+0000 7fe093fff700 1 -- 172.21.15.117:0/869382669 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c005040 con 0x7fe0940fbcd0 2024-04-12T09:08:57.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.432+0000 7fe093fff700 1 --2- 172.21.15.117:0/869382669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0940fbcd0 0x7fe09410daf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00b970 tx=0x7fe07c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:57.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.432+0000 7fe090ff9700 1 -- 172.21.15.117:0/869382669 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe07c00e040 con 0x7fe0940fbcd0 2024-04-12T09:08:57.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.432+0000 7fe090ff9700 1 -- 172.21.15.117:0/869382669 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe07c00bcc0 con 0x7fe0940fbcd0 2024-04-12T09:08:57.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.432+0000 7fe09a34c700 1 -- 172.21.15.117:0/869382669 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09410f090 con 0x7fe0940fbcd0 2024-04-12T09:08:57.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.432+0000 7fe090ff9700 1 -- 172.21.15.117:0/869382669 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe07c013660 con 0x7fe0940fbcd0 2024-04-12T09:08:57.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.432+0000 7fe09a34c700 1 -- 172.21.15.117:0/869382669 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09410f650 con 0x7fe0940fbcd0 2024-04-12T09:08:57.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.433+0000 7fe09a34c700 1 -- 172.21.15.117:0/869382669 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe094101b10 con 0x7fe0940fbcd0 2024-04-12T09:08:57.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.434+0000 7fe090ff9700 1 -- 172.21.15.117:0/869382669 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fe07c01ca00 con 0x7fe0940fbcd0 2024-04-12T09:08:57.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.434+0000 7fe090ff9700 1 --2- 172.21.15.117:0/869382669 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fe0800692a0 0x7fe08006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:08:57.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.435+0000 7fe090ff9700 1 -- 172.21.15.117:0/869382669 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe07c087f00 con 0x7fe0940fbcd0 2024-04-12T09:08:57.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.435+0000 7fe0937fe700 1 --2- 172.21.15.117:0/869382669 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fe0800692a0 0x7fe08006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:08:57.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.435+0000 7fe0937fe700 1 --2- 172.21.15.117:0/869382669 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fe0800692a0 0x7fe08006b750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe084006fd0 tx=0x7fe084008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:08:57.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.439+0000 7fe090ff9700 1 -- 172.21.15.117:0/869382669 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fe07c057d20 con 0x7fe0940fbcd0 2024-04-12T09:08:57.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.627+0000 7fe09a34c700 1 -- 172.21.15.117:0/869382669 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fe09405f5f0 con 0x7fe0940fbcd0 2024-04-12T09:08:57.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.627+0000 7fe090ff9700 1 -- 172.21.15.117:0/869382669 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fe07c0578b0 con 0x7fe0940fbcd0 2024-04-12T09:08:57.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.630+0000 7fe09a34c700 1 -- 172.21.15.117:0/869382669 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fe0800692a0 msgr2=0x7fe08006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:57.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.630+0000 7fe09a34c700 1 --2- 172.21.15.117:0/869382669 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fe0800692a0 0x7fe08006b750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe084006fd0 tx=0x7fe084008040 comp rx=0 tx=0).stop 2024-04-12T09:08:57.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.630+0000 7fe09a34c700 1 -- 172.21.15.117:0/869382669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0940fbcd0 msgr2=0x7fe09410daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:08:57.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.630+0000 7fe09a34c700 1 --2- 172.21.15.117:0/869382669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0940fbcd0 0x7fe09410daf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00b970 tx=0x7fe07c009e30 comp rx=0 tx=0).stop 2024-04-12T09:08:57.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.630+0000 7fe09a34c700 1 -- 172.21.15.117:0/869382669 shutdown_connections 2024-04-12T09:08:57.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.630+0000 7fe09a34c700 1 --2- 172.21.15.117:0/869382669 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fe0800692a0 0x7fe08006b750 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:57.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.630+0000 7fe09a34c700 1 --2- 172.21.15.117:0/869382669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0940fbcd0 0x7fe09410daf0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:57.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.630+0000 7fe09a34c700 1 --2- 172.21.15.117:0/869382669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0940fcf80 0x7fe09410e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:08:57.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.630+0000 7fe09a34c700 1 -- 172.21.15.117:0/869382669 >> 172.21.15.117:0/869382669 conn(0x7fe0940f7430 msgr2=0x7fe094065b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:08:57.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.630+0000 7fe09a34c700 1 -- 172.21.15.117:0/869382669 shutdown_connections 2024-04-12T09:08:57.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:08:57.630+0000 7fe09a34c700 1 -- 172.21.15.117:0/869382669 wait complete. 2024-04-12T09:08:58.222 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'ceph config set global log_to_journald false --force' 2024-04-12T09:08:58.479 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:08:58.732 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:08:58 smithi117 ceph-mon[29277]: pgmap v197: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-12T09:08:58.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:08:58 smithi203 ceph-mon[36428]: pgmap v197: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-12T09:09:00.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.118+0000 7f999d384700 1 -- 172.21.15.117:0/697516352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99980fdfe0 msgr2=0x7f99980fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:00.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.118+0000 7f999d384700 1 --2- 172.21.15.117:0/697516352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99980fdfe0 0x7f99980fe450 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f998c004940 tx=0x7f998c009e30 comp rx=0 tx=0).stop 2024-04-12T09:09:00.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.119+0000 7f999d384700 1 -- 172.21.15.117:0/697516352 shutdown_connections 2024-04-12T09:09:00.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.119+0000 7f999d384700 1 --2- 172.21.15.117:0/697516352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99980fdfe0 0x7f99980fe450 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:00.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.119+0000 7f999d384700 1 --2- 172.21.15.117:0/697516352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99980fce70 0x7f99980fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:00.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.119+0000 7f999d384700 1 -- 172.21.15.117:0/697516352 >> 172.21.15.117:0/697516352 conn(0x7f99980f8550 msgr2=0x7f99980fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:09:00.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.119+0000 7f999d384700 1 -- 172.21.15.117:0/697516352 shutdown_connections 2024-04-12T09:09:00.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.119+0000 7f999d384700 1 -- 172.21.15.117:0/697516352 wait complete. 2024-04-12T09:09:00.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.119+0000 7f999d384700 1 Processor -- start 2024-04-12T09:09:00.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.119+0000 7f999d384700 1 -- start start 2024-04-12T09:09:00.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.119+0000 7f999d384700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99980fce70 0x7f999810d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:09:00.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.119+0000 7f999d384700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99980fdfe0 0x7f999810de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:09:00.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.119+0000 7f999d384700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999810e510 con 0x7f99980fdfe0 2024-04-12T09:09:00.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.119+0000 7f999d384700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9998112eb0 con 0x7f99980fce70 2024-04-12T09:09:00.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.120+0000 7f99967fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99980fdfe0 0x7f999810de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:09:00.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.120+0000 7f99967fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99980fdfe0 0x7f999810de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33516/0 (socket says 172.21.15.117:33516) 2024-04-12T09:09:00.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.120+0000 7f99967fc700 1 -- 172.21.15.117:0/190731585 learned_addr learned my addr 172.21.15.117:0/190731585 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:09:00.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.120+0000 7f9996ffd700 1 --2- 172.21.15.117:0/190731585 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99980fce70 0x7f999810d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:09:00.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.120+0000 7f99967fc700 1 -- 172.21.15.117:0/190731585 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99980fce70 msgr2=0x7f999810d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:00.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.120+0000 7f99967fc700 1 --2- 172.21.15.117:0/190731585 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99980fce70 0x7f999810d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:00.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.120+0000 7f99967fc700 1 -- 172.21.15.117:0/190731585 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c005040 con 0x7f99980fdfe0 2024-04-12T09:09:00.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.120+0000 7f9996ffd700 1 --2- 172.21.15.117:0/190731585 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99980fce70 0x7f999810d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T09:09:00.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.120+0000 7f99967fc700 1 --2- 172.21.15.117:0/190731585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99980fdfe0 0x7f999810de80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f998c00b970 tx=0x7f998c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:09:00.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.120+0000 7f997f7fe700 1 -- 172.21.15.117:0/190731585 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f998c00e040 con 0x7f99980fdfe0 2024-04-12T09:09:00.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.120+0000 7f997f7fe700 1 -- 172.21.15.117:0/190731585 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f998c00bcc0 con 0x7f99980fdfe0 2024-04-12T09:09:00.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.120+0000 7f999d384700 1 -- 172.21.15.117:0/190731585 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99981130b0 con 0x7f99980fdfe0 2024-04-12T09:09:00.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.120+0000 7f997f7fe700 1 -- 172.21.15.117:0/190731585 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f998c013660 con 0x7f99980fdfe0 2024-04-12T09:09:00.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.120+0000 7f999d384700 1 -- 172.21.15.117:0/190731585 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9998113620 con 0x7f99980fdfe0 2024-04-12T09:09:00.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.122+0000 7f999d384700 1 -- 172.21.15.117:0/190731585 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99840052e0 con 0x7f99980fdfe0 2024-04-12T09:09:00.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.122+0000 7f997f7fe700 1 -- 172.21.15.117:0/190731585 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f998c0137c0 con 0x7f99980fdfe0 2024-04-12T09:09:00.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.122+0000 7f997f7fe700 1 --2- 172.21.15.117:0/190731585 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f99800692a0 0x7f998006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:09:00.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.122+0000 7f997f7fe700 1 -- 172.21.15.117:0/190731585 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f998c087d10 con 0x7f99980fdfe0 2024-04-12T09:09:00.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.122+0000 7f9996ffd700 1 --2- 172.21.15.117:0/190731585 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f99800692a0 0x7f998006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:09:00.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.123+0000 7f9996ffd700 1 --2- 172.21.15.117:0/190731585 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f99800692a0 0x7f998006b750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9988009b10 tx=0x7f9988008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:09:00.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.128+0000 7f997f7fe700 1 -- 172.21.15.117:0/190731585 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f998c057bd0 con 0x7f99980fdfe0 2024-04-12T09:09:00.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.314+0000 7f999d384700 1 -- 172.21.15.117:0/190731585 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f9984005b10 con 0x7f99980fdfe0 2024-04-12T09:09:00.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.314+0000 7f997f7fe700 1 -- 172.21.15.117:0/190731585 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f998c057760 con 0x7f99980fdfe0 2024-04-12T09:09:00.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.316+0000 7f999d384700 1 -- 172.21.15.117:0/190731585 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f99800692a0 msgr2=0x7f998006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:00.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.316+0000 7f999d384700 1 --2- 172.21.15.117:0/190731585 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f99800692a0 0x7f998006b750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9988009b10 tx=0x7f9988008040 comp rx=0 tx=0).stop 2024-04-12T09:09:00.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.316+0000 7f999d384700 1 -- 172.21.15.117:0/190731585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99980fdfe0 msgr2=0x7f999810de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:00.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.316+0000 7f999d384700 1 --2- 172.21.15.117:0/190731585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99980fdfe0 0x7f999810de80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f998c00b970 tx=0x7f998c009e30 comp rx=0 tx=0).stop 2024-04-12T09:09:00.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.316+0000 7f999d384700 1 -- 172.21.15.117:0/190731585 shutdown_connections 2024-04-12T09:09:00.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.316+0000 7f999d384700 1 --2- 172.21.15.117:0/190731585 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f99800692a0 0x7f998006b750 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:00.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.316+0000 7f999d384700 1 --2- 172.21.15.117:0/190731585 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99980fce70 0x7f999810d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:00.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.316+0000 7f999d384700 1 --2- 172.21.15.117:0/190731585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99980fdfe0 0x7f999810de80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:00.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.316+0000 7f999d384700 1 -- 172.21.15.117:0/190731585 >> 172.21.15.117:0/190731585 conn(0x7f99980f8550 msgr2=0x7f99980f9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:09:00.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.316+0000 7f999d384700 1 -- 172.21.15.117:0/190731585 shutdown_connections 2024-04-12T09:09:00.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:00.317+0000 7f999d384700 1 -- 172.21.15.117:0/190731585 wait complete. 2024-04-12T09:09:00.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:00 smithi203 ceph-mon[36428]: pgmap v198: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-04-12T09:09:00.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:00 smithi117 ceph-mon[29277]: pgmap v198: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-04-12T09:09:01.047 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-04-12T09:09:01.302 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:09:01.775 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:01 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:09:01.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:01 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:09:02.760 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:02 smithi117 ceph-mon[29277]: pgmap v199: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-04-12T09:09:02.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:02 smithi203 ceph-mon[36428]: pgmap v199: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-04-12T09:09:02.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.986+0000 7f8caaf2c700 1 -- 172.21.15.117:0/2874602518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ca40fe500 msgr2=0x7f8ca40fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:02.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.986+0000 7f8caaf2c700 1 --2- 172.21.15.117:0/2874602518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ca40fe500 0x7f8ca40fe910 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8c98004940 tx=0x7f8c98009e30 comp rx=0 tx=0).stop 2024-04-12T09:09:02.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.986+0000 7f8caaf2c700 1 -- 172.21.15.117:0/2874602518 shutdown_connections 2024-04-12T09:09:02.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.986+0000 7f8caaf2c700 1 --2- 172.21.15.117:0/2874602518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8ca40fee50 0x7f8ca40faf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:02.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.986+0000 7f8caaf2c700 1 --2- 172.21.15.117:0/2874602518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ca40fe500 0x7f8ca40fe910 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:02.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.986+0000 7f8caaf2c700 1 -- 172.21.15.117:0/2874602518 >> 172.21.15.117:0/2874602518 conn(0x7f8ca40f6be0 msgr2=0x7f8ca40f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:09:02.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.986+0000 7f8caaf2c700 1 -- 172.21.15.117:0/2874602518 shutdown_connections 2024-04-12T09:09:02.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.986+0000 7f8caaf2c700 1 -- 172.21.15.117:0/2874602518 wait complete. 2024-04-12T09:09:02.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.986+0000 7f8caaf2c700 1 Processor -- start 2024-04-12T09:09:02.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.986+0000 7f8caaf2c700 1 -- start start 2024-04-12T09:09:02.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.986+0000 7f8caaf2c700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8ca40fe500 0x7f8ca40fdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:09:02.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.987+0000 7f8caaf2c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ca40fee50 0x7f8ca40fc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:09:02.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.987+0000 7f8caaf2c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca40fe110 con 0x7f8ca40fee50 2024-04-12T09:09:02.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.987+0000 7f8caaf2c700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca40fc700 con 0x7f8ca40fe500 2024-04-12T09:09:02.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.987+0000 7f8ca3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ca40fee50 0x7f8ca40fc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:09:02.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.987+0000 7f8ca3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ca40fee50 0x7f8ca40fc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33538/0 (socket says 172.21.15.117:33538) 2024-04-12T09:09:02.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.987+0000 7f8ca3fff700 1 -- 172.21.15.117:0/1088358785 learned_addr learned my addr 172.21.15.117:0/1088358785 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:09:02.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.987+0000 7f8ca8cc8700 1 --2- 172.21.15.117:0/1088358785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8ca40fe500 0x7f8ca40fdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:09:02.989 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.987+0000 7f8ca3fff700 1 -- 172.21.15.117:0/1088358785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8ca40fe500 msgr2=0x7f8ca40fdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:02.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.987+0000 7f8ca3fff700 1 --2- 172.21.15.117:0/1088358785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8ca40fe500 0x7f8ca40fdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:02.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.987+0000 7f8ca3fff700 1 -- 172.21.15.117:0/1088358785 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c98005040 con 0x7f8ca40fee50 2024-04-12T09:09:02.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.987+0000 7f8ca3fff700 1 --2- 172.21.15.117:0/1088358785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ca40fee50 0x7f8ca40fc1c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8c90002a50 tx=0x7f8c900046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:09:02.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.987+0000 7f8ca17fa700 1 -- 172.21.15.117:0/1088358785 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c90007cc0 con 0x7f8ca40fee50 2024-04-12T09:09:02.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.987+0000 7f8caaf2c700 1 -- 172.21.15.117:0/1088358785 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca40fc9b0 con 0x7f8ca40fee50 2024-04-12T09:09:02.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.987+0000 7f8ca17fa700 1 -- 172.21.15.117:0/1088358785 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c9000f040 con 0x7f8ca40fee50 2024-04-12T09:09:02.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.987+0000 7f8ca17fa700 1 -- 172.21.15.117:0/1088358785 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c9000da70 con 0x7f8ca40fee50 2024-04-12T09:09:02.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.987+0000 7f8caaf2c700 1 -- 172.21.15.117:0/1088358785 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca40fcf70 con 0x7f8ca40fee50 2024-04-12T09:09:02.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.988+0000 7f8caaf2c700 1 -- 172.21.15.117:0/1088358785 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca404c710 con 0x7f8ca40fee50 2024-04-12T09:09:02.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.989+0000 7f8ca17fa700 1 -- 172.21.15.117:0/1088358785 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f8c9000dc10 con 0x7f8ca40fee50 2024-04-12T09:09:02.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.989+0000 7f8ca17fa700 1 --2- 172.21.15.117:0/1088358785 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f8c940692a0 0x7f8c9406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:09:02.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.989+0000 7f8ca17fa700 1 -- 172.21.15.117:0/1088358785 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8c90086870 con 0x7f8ca40fee50 2024-04-12T09:09:02.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.989+0000 7f8ca8cc8700 1 --2- 172.21.15.117:0/1088358785 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f8c940692a0 0x7f8c9406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:09:02.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.990+0000 7f8ca8cc8700 1 --2- 172.21.15.117:0/1088358785 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f8c940692a0 0x7f8c9406b750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800b970 tx=0x7f8c98009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:09:02.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:02.993+0000 7f8ca17fa700 1 -- 172.21.15.117:0/1088358785 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f8c90056560 con 0x7f8ca40fee50 2024-04-12T09:09:03.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:03.196+0000 7f8caaf2c700 1 -- 172.21.15.117:0/1088358785 --> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b277feb2c7beb4597d8ecc39d58d5c36b81f613a", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ca4102610 con 0x7f8c940692a0 2024-04-12T09:09:04.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:04 smithi203 ceph-mon[36428]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b277feb2c7beb4597d8ecc39d58d5c36b81f613a", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:09:04.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:04 smithi203 ceph-mon[36428]: pgmap v200: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-04-12T09:09:04.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:04 smithi117 ceph-mon[29277]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b277feb2c7beb4597d8ecc39d58d5c36b81f613a", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:09:04.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:04 smithi117 ceph-mon[29277]: pgmap v200: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-04-12T09:09:06.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:06 smithi203 ceph-mon[36428]: pgmap v201: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-04-12T09:09:06.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:06 smithi117 ceph-mon[29277]: pgmap v201: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-04-12T09:09:08.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:08 smithi203 ceph-mon[36428]: pgmap v202: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-12T09:09:08.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:08 smithi117 ceph-mon[29277]: pgmap v202: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-12T09:09:10.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:10 smithi117 ceph-mon[29277]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-12T09:09:10.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:10 smithi203 ceph-mon[36428]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-04-12T09:09:12.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:12 smithi203 ceph-mon[36428]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-12T09:09:12.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:12 smithi117 ceph-mon[29277]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-04-12T09:09:14.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:14 smithi203 ceph-mon[36428]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-04-12T09:09:14.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:14 smithi117 ceph-mon[29277]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-04-12T09:09:16.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:16 smithi203 ceph-mon[36428]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-04-12T09:09:16.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:16 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:09:16.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:16 smithi117 ceph-mon[29277]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-04-12T09:09:16.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:16 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:09:18.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:18 smithi203 ceph-mon[36428]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-04-12T09:09:18.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:18 smithi117 ceph-mon[29277]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-04-12T09:09:20.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:20 smithi117 ceph-mon[29277]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-04-12T09:09:20.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:20 smithi203 ceph-mon[36428]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-04-12T09:09:22.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:22 smithi203 ceph-mon[36428]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:22.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:22 smithi117 ceph-mon[29277]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:24.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:24 smithi203 ceph-mon[36428]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:24.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:24 smithi117 ceph-mon[29277]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:26.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:26 smithi203 ceph-mon[36428]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:26.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:26 smithi117 ceph-mon[29277]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:28.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:28 smithi203 ceph-mon[36428]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:28.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:28 smithi117 ceph-mon[29277]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:30.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:30 smithi203 ceph-mon[36428]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:30.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:30 smithi117 ceph-mon[29277]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:31.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:31 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:09:31.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:31 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:09:32.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:32 smithi203 ceph-mon[36428]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:32.888 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:32 smithi117 ceph-mon[29277]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:34.711 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:34 smithi117 ceph-mon[29277]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:34.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:34 smithi203 ceph-mon[36428]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:36.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:36.110+0000 7f8ca17fa700 1 -- 172.21.15.117:0/1088358785 <== mgr.14214 v2:172.21.15.117:6800/3945342300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f8ca4102610 con 0x7f8c940692a0 2024-04-12T09:09:36.111 INFO:teuthology.orchestra.run.smithi117.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:b277feb2c7beb4597d8ecc39d58d5c36b81f613a 2024-04-12T09:09:36.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:36.112+0000 7f8caaf2c700 1 -- 172.21.15.117:0/1088358785 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f8c940692a0 msgr2=0x7f8c9406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:36.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:36.112+0000 7f8caaf2c700 1 --2- 172.21.15.117:0/1088358785 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f8c940692a0 0x7f8c9406b750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800b970 tx=0x7f8c98009e30 comp rx=0 tx=0).stop 2024-04-12T09:09:36.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:36.112+0000 7f8caaf2c700 1 -- 172.21.15.117:0/1088358785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ca40fee50 msgr2=0x7f8ca40fc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:36.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:36.112+0000 7f8caaf2c700 1 --2- 172.21.15.117:0/1088358785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ca40fee50 0x7f8ca40fc1c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8c90002a50 tx=0x7f8c900046b0 comp rx=0 tx=0).stop 2024-04-12T09:09:36.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:36.112+0000 7f8caaf2c700 1 -- 172.21.15.117:0/1088358785 shutdown_connections 2024-04-12T09:09:36.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:36.112+0000 7f8caaf2c700 1 --2- 172.21.15.117:0/1088358785 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f8c940692a0 0x7f8c9406b750 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:36.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:36.112+0000 7f8caaf2c700 1 --2- 172.21.15.117:0/1088358785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8ca40fe500 0x7f8ca40fdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:36.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:36.112+0000 7f8caaf2c700 1 --2- 172.21.15.117:0/1088358785 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ca40fee50 0x7f8ca40fc1c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:36.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:36.112+0000 7f8caaf2c700 1 -- 172.21.15.117:0/1088358785 >> 172.21.15.117:0/1088358785 conn(0x7f8ca40f6be0 msgr2=0x7f8ca40f82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:09:36.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:36.112+0000 7f8caaf2c700 1 -- 172.21.15.117:0/1088358785 shutdown_connections 2024-04-12T09:09:36.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:36.112+0000 7f8caaf2c700 1 -- 172.21.15.117:0/1088358785 wait complete. 2024-04-12T09:09:36.730 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:36 smithi117 ceph-mon[29277]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:36.730 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:09:36.730 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:36 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:09:36.757 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-04-12T09:09:36.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:36 smithi203 ceph-mon[36428]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:36.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:36 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:09:36.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:36 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:09:37.040 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:09:37.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:37 smithi203 ceph-mon[36428]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:b277feb2c7beb4597d8ecc39d58d5c36b81f613a 2024-04-12T09:09:37.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:37 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:09:37.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:37 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:09:37.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:37 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:09:37.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:37 smithi117 ceph-mon[29277]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:b277feb2c7beb4597d8ecc39d58d5c36b81f613a 2024-04-12T09:09:37.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:37 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:09:37.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:37 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:09:37.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:37 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:09:38.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:38 smithi203 ceph-mon[36428]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b277feb2c7beb4597d8ecc39d58d5c36b81f613a 2024-04-12T09:09:38.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:38 smithi203 ceph-mon[36428]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:38.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:38 smithi117 ceph-mon[29277]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b277feb2c7beb4597d8ecc39d58d5c36b81f613a 2024-04-12T09:09:38.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:38 smithi117 ceph-mon[29277]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:40.647 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:40 smithi117 ceph-mon[29277]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:40.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:40 smithi203 ceph-mon[36428]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:42.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:42 smithi117 ceph-mon[29277]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:42.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:42 smithi203 ceph-mon[36428]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:44.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.598+0000 7f5111539700 1 -- 172.21.15.117:0/3741775087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f510c0fcf90 msgr2=0x7f510c0fd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:44.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.598+0000 7f5111539700 1 --2- 172.21.15.117:0/3741775087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f510c0fcf90 0x7f510c0fd400 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f51000049c0 tx=0x7f5100009e30 comp rx=0 tx=0).stop 2024-04-12T09:09:44.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.598+0000 7f5111539700 1 -- 172.21.15.117:0/3741775087 shutdown_connections 2024-04-12T09:09:44.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.598+0000 7f5111539700 1 --2- 172.21.15.117:0/3741775087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f510c0fcf90 0x7f510c0fd400 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:44.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.598+0000 7f5111539700 1 --2- 172.21.15.117:0/3741775087 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f510c0fbce0 0x7f510c0fc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:44.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.598+0000 7f5111539700 1 -- 172.21.15.117:0/3741775087 >> 172.21.15.117:0/3741775087 conn(0x7f510c0f7480 msgr2=0x7f510c0f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:09:44.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.598+0000 7f5111539700 1 -- 172.21.15.117:0/3741775087 shutdown_connections 2024-04-12T09:09:44.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.598+0000 7f5111539700 1 -- 172.21.15.117:0/3741775087 wait complete. 2024-04-12T09:09:44.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.599+0000 7f5111539700 1 Processor -- start 2024-04-12T09:09:44.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.599+0000 7f5111539700 1 -- start start 2024-04-12T09:09:44.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.600+0000 7f5111539700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f510c0fbce0 0x7f510c10b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:09:44.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.600+0000 7f5111539700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f510c0fcf90 0x7f510c10bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:09:44.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.600+0000 7f5111539700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c10c2a0 con 0x7f510c0fbce0 2024-04-12T09:09:44.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.600+0000 7f5111539700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c10caf0 con 0x7f510c0fcf90 2024-04-12T09:09:44.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.600+0000 7f510affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f510c0fbce0 0x7f510c10b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:09:44.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.600+0000 7f510affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f510c0fbce0 0x7f510c10b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33088/0 (socket says 172.21.15.117:33088) 2024-04-12T09:09:44.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.600+0000 7f510affd700 1 -- 172.21.15.117:0/3986870495 learned_addr learned my addr 172.21.15.117:0/3986870495 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:09:44.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.600+0000 7f510a7fc700 1 --2- 172.21.15.117:0/3986870495 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f510c0fcf90 0x7f510c10bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:09:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.600+0000 7f510affd700 1 -- 172.21.15.117:0/3986870495 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f510c0fcf90 msgr2=0x7f510c10bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.600+0000 7f510affd700 1 --2- 172.21.15.117:0/3986870495 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f510c0fcf90 0x7f510c10bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.601+0000 7f510affd700 1 -- 172.21.15.117:0/3986870495 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5100005040 con 0x7f510c0fbce0 2024-04-12T09:09:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.601+0000 7f510a7fc700 1 --2- 172.21.15.117:0/3986870495 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f510c0fcf90 0x7f510c10bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T09:09:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.601+0000 7f510affd700 1 --2- 172.21.15.117:0/3986870495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f510c0fbce0 0x7f510c10b760 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00eb40 tx=0x7f50fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:09:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.601+0000 7f50f37fe700 1 -- 172.21.15.117:0/3986870495 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50fc007cc0 con 0x7f510c0fbce0 2024-04-12T09:09:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.601+0000 7f50f37fe700 1 -- 172.21.15.117:0/3986870495 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f50fc00f040 con 0x7f510c0fbce0 2024-04-12T09:09:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.601+0000 7f50f37fe700 1 -- 172.21.15.117:0/3986870495 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50fc009620 con 0x7f510c0fbce0 2024-04-12T09:09:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.601+0000 7f5111539700 1 -- 172.21.15.117:0/3986870495 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f510c10cd70 con 0x7f510c0fbce0 2024-04-12T09:09:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.602+0000 7f5111539700 1 -- 172.21.15.117:0/3986870495 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f510c10d2b0 con 0x7f510c0fbce0 2024-04-12T09:09:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.603+0000 7f5111539700 1 -- 172.21.15.117:0/3986870495 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f510c05f5f0 con 0x7f510c0fbce0 2024-04-12T09:09:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.604+0000 7f50f37fe700 1 -- 172.21.15.117:0/3986870495 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f50fc009780 con 0x7f510c0fbce0 2024-04-12T09:09:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.604+0000 7f50f37fe700 1 --2- 172.21.15.117:0/3986870495 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f50f406d6b0 0x7f50f406fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:09:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.604+0000 7f50f37fe700 1 -- 172.21.15.117:0/3986870495 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f50fc086d00 con 0x7f510c0fbce0 2024-04-12T09:09:44.372 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.605+0000 7f510a7fc700 1 --2- 172.21.15.117:0/3986870495 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f50f406d6b0 0x7f50f406fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:09:44.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.605+0000 7f510a7fc700 1 --2- 172.21.15.117:0/3986870495 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f50f406d6b0 0x7f50f406fb60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f510000d5c0 tx=0x7f510000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:09:44.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:43.613+0000 7f50f37fe700 1 -- 172.21.15.117:0/3986870495 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f50fc08a030 con 0x7f510c0fbce0 2024-04-12T09:09:44.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.030+0000 7f5111539700 1 -- 172.21.15.117:0/3986870495 --> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f510c10d650 con 0x7f50f406d6b0 2024-04-12T09:09:44.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.032+0000 7f50f37fe700 1 -- 172.21.15.117:0/3986870495 <== mgr.14214 v2:172.21.15.117:6800/3945342300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f510c10d650 con 0x7f50f406d6b0 2024-04-12T09:09:44.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.034+0000 7f5111539700 1 -- 172.21.15.117:0/3986870495 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f50f406d6b0 msgr2=0x7f50f406fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:44.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.035+0000 7f5111539700 1 --2- 172.21.15.117:0/3986870495 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f50f406d6b0 0x7f50f406fb60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f510000d5c0 tx=0x7f510000b040 comp rx=0 tx=0).stop 2024-04-12T09:09:44.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.035+0000 7f5111539700 1 -- 172.21.15.117:0/3986870495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f510c0fbce0 msgr2=0x7f510c10b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:44.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.035+0000 7f5111539700 1 --2- 172.21.15.117:0/3986870495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f510c0fbce0 0x7f510c10b760 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f50fc00eb40 tx=0x7f50fc00b040 comp rx=0 tx=0).stop 2024-04-12T09:09:44.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.035+0000 7f5111539700 1 -- 172.21.15.117:0/3986870495 shutdown_connections 2024-04-12T09:09:44.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.035+0000 7f5111539700 1 --2- 172.21.15.117:0/3986870495 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f50f406d6b0 0x7f50f406fb60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:44.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.035+0000 7f5111539700 1 --2- 172.21.15.117:0/3986870495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f510c0fbce0 0x7f510c10b760 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:44.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.035+0000 7f5111539700 1 --2- 172.21.15.117:0/3986870495 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f510c0fcf90 0x7f510c10bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:44.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.035+0000 7f5111539700 1 -- 172.21.15.117:0/3986870495 >> 172.21.15.117:0/3986870495 conn(0x7f510c0f7480 msgr2=0x7f510c0f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:09:44.374 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:09:44.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.035+0000 7f5111539700 1 -- 172.21.15.117:0/3986870495 shutdown_connections 2024-04-12T09:09:44.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.036+0000 7f5111539700 1 -- 172.21.15.117:0/3986870495 wait complete. 2024-04-12T09:09:44.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.143+0000 7f873a1e2700 1 -- 172.21.15.117:0/1355713663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87340fe4c0 msgr2=0x7f87340fe8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:44.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.143+0000 7f873a1e2700 1 --2- 172.21.15.117:0/1355713663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87340fe4c0 0x7f87340fe8d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8724004940 tx=0x7f8724009e30 comp rx=0 tx=0).stop 2024-04-12T09:09:44.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.143+0000 7f873a1e2700 1 -- 172.21.15.117:0/1355713663 shutdown_connections 2024-04-12T09:09:44.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.143+0000 7f873a1e2700 1 --2- 172.21.15.117:0/1355713663 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f87340fee10 0x7f87340faf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:44.374 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.143+0000 7f873a1e2700 1 --2- 172.21.15.117:0/1355713663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87340fe4c0 0x7f87340fe8d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.143+0000 7f873a1e2700 1 -- 172.21.15.117:0/1355713663 >> 172.21.15.117:0/1355713663 conn(0x7f87340f6ba0 msgr2=0x7f87340f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:09:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.143+0000 7f873a1e2700 1 -- 172.21.15.117:0/1355713663 shutdown_connections 2024-04-12T09:09:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.143+0000 7f873a1e2700 1 -- 172.21.15.117:0/1355713663 wait complete. 2024-04-12T09:09:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.144+0000 7f873a1e2700 1 Processor -- start 2024-04-12T09:09:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.144+0000 7f873a1e2700 1 -- start start 2024-04-12T09:09:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.144+0000 7f873a1e2700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f87340fee10 0x7f87340fdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:09:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.144+0000 7f873a1e2700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87340fc180 0x7f87340fc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:09:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.144+0000 7f873a1e2700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87341117c0 con 0x7f87340fc180 2024-04-12T09:09:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.144+0000 7f873a1e2700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8734111900 con 0x7f87340fee10 2024-04-12T09:09:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.145+0000 7f8732ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87340fc180 0x7f87340fc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:09:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.145+0000 7f8732ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87340fc180 0x7f87340fc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33108/0 (socket says 172.21.15.117:33108) 2024-04-12T09:09:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.145+0000 7f8732ffd700 1 -- 172.21.15.117:0/3439606884 learned_addr learned my addr 172.21.15.117:0/3439606884 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:09:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.145+0000 7f8732ffd700 1 -- 172.21.15.117:0/3439606884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f87340fee10 msgr2=0x7f87340fdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.145+0000 7f87337fe700 1 --2- 172.21.15.117:0/3439606884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f87340fee10 0x7f87340fdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:09:44.375 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.145+0000 7f8732ffd700 1 --2- 172.21.15.117:0/3439606884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f87340fee10 0x7f87340fdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:44.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.145+0000 7f8732ffd700 1 -- 172.21.15.117:0/3439606884 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8724005040 con 0x7f87340fc180 2024-04-12T09:09:44.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.145+0000 7f8732ffd700 1 --2- 172.21.15.117:0/3439606884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87340fc180 0x7f87340fc5f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f872800eb70 tx=0x7f872800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:09:44.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.145+0000 7f871bfff700 1 -- 172.21.15.117:0/3439606884 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8728007cc0 con 0x7f87340fc180 2024-04-12T09:09:44.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.146+0000 7f871bfff700 1 -- 172.21.15.117:0/3439606884 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f872800f040 con 0x7f87340fc180 2024-04-12T09:09:44.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.146+0000 7f871bfff700 1 -- 172.21.15.117:0/3439606884 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8728009620 con 0x7f87340fc180 2024-04-12T09:09:44.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.146+0000 7f873a1e2700 1 -- 172.21.15.117:0/3439606884 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87340fcb30 con 0x7f87340fc180 2024-04-12T09:09:44.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.146+0000 7f873a1e2700 1 -- 172.21.15.117:0/3439606884 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873411a3c0 con 0x7f87340fc180 2024-04-12T09:09:44.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.147+0000 7f873a1e2700 1 -- 172.21.15.117:0/3439606884 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f873405f5f0 con 0x7f87340fc180 2024-04-12T09:09:44.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.148+0000 7f871bfff700 1 -- 172.21.15.117:0/3439606884 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f8728009780 con 0x7f87340fc180 2024-04-12T09:09:44.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.148+0000 7f871bfff700 1 --2- 172.21.15.117:0/3439606884 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f871c0693b0 0x7f871c06b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:09:44.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.148+0000 7f871bfff700 1 -- 172.21.15.117:0/3439606884 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8728086b80 con 0x7f87340fc180 2024-04-12T09:09:44.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.148+0000 7f87337fe700 1 --2- 172.21.15.117:0/3439606884 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f871c0693b0 0x7f871c06b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:09:44.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.149+0000 7f87337fe700 1 --2- 172.21.15.117:0/3439606884 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f871c0693b0 0x7f871c06b860 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f87340fda40 tx=0x7f8724009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:09:44.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.157+0000 7f871bfff700 1 -- 172.21.15.117:0/3439606884 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f8728052f00 con 0x7f87340fc180 2024-04-12T09:09:44.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.569+0000 7f873a1e2700 1 -- 172.21.15.117:0/3439606884 --> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8734102710 con 0x7f871c0693b0 2024-04-12T09:09:44.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.570+0000 7f871bfff700 1 -- 172.21.15.117:0/3439606884 <== mgr.14214 v2:172.21.15.117:6800/3945342300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f8734102710 con 0x7f871c0693b0 2024-04-12T09:09:44.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.573+0000 7f873a1e2700 1 -- 172.21.15.117:0/3439606884 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f871c0693b0 msgr2=0x7f871c06b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:44.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.573+0000 7f873a1e2700 1 --2- 172.21.15.117:0/3439606884 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f871c0693b0 0x7f871c06b860 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f87340fda40 tx=0x7f8724009e30 comp rx=0 tx=0).stop 2024-04-12T09:09:44.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.573+0000 7f873a1e2700 1 -- 172.21.15.117:0/3439606884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87340fc180 msgr2=0x7f87340fc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:44.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.573+0000 7f873a1e2700 1 --2- 172.21.15.117:0/3439606884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87340fc180 0x7f87340fc5f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f872800eb70 tx=0x7f872800b040 comp rx=0 tx=0).stop 2024-04-12T09:09:44.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.573+0000 7f873a1e2700 1 -- 172.21.15.117:0/3439606884 shutdown_connections 2024-04-12T09:09:44.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.573+0000 7f873a1e2700 1 --2- 172.21.15.117:0/3439606884 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f871c0693b0 0x7f871c06b860 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:44.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.573+0000 7f873a1e2700 1 --2- 172.21.15.117:0/3439606884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f87340fee10 0x7f87340fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:44.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.573+0000 7f873a1e2700 1 --2- 172.21.15.117:0/3439606884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87340fc180 0x7f87340fc5f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:44.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.573+0000 7f873a1e2700 1 -- 172.21.15.117:0/3439606884 >> 172.21.15.117:0/3439606884 conn(0x7f87340f6ba0 msgr2=0x7f87340f8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:09:44.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.574+0000 7f873a1e2700 1 -- 172.21.15.117:0/3439606884 shutdown_connections 2024-04-12T09:09:44.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.574+0000 7f873a1e2700 1 -- 172.21.15.117:0/3439606884 wait complete. 2024-04-12T09:09:44.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:44 smithi117 ceph-mon[29277]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:44.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.733+0000 7fe4e1b7f700 1 -- 172.21.15.117:0/204876760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4dc0fcf80 msgr2=0x7fe4dc0fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:44.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.733+0000 7fe4e1b7f700 1 --2- 172.21.15.117:0/204876760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4dc0fcf80 0x7fe4dc0fd3f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0004940 tx=0x7fe4d0009e30 comp rx=0 tx=0).stop 2024-04-12T09:09:44.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.734+0000 7fe4e1b7f700 1 -- 172.21.15.117:0/204876760 shutdown_connections 2024-04-12T09:09:44.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.734+0000 7fe4e1b7f700 1 --2- 172.21.15.117:0/204876760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4dc0fcf80 0x7fe4dc0fd3f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:44.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.734+0000 7fe4e1b7f700 1 --2- 172.21.15.117:0/204876760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4dc0fbcd0 0x7fe4dc0fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:44.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.734+0000 7fe4e1b7f700 1 -- 172.21.15.117:0/204876760 >> 172.21.15.117:0/204876760 conn(0x7fe4dc0f7430 msgr2=0x7fe4dc0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:09:44.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.734+0000 7fe4e1b7f700 1 -- 172.21.15.117:0/204876760 shutdown_connections 2024-04-12T09:09:44.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.734+0000 7fe4e1b7f700 1 -- 172.21.15.117:0/204876760 wait complete. 2024-04-12T09:09:44.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.735+0000 7fe4e1b7f700 1 Processor -- start 2024-04-12T09:09:44.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.736+0000 7fe4e1b7f700 1 -- start start 2024-04-12T09:09:44.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.736+0000 7fe4e1b7f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4dc0fbcd0 0x7fe4dc10c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:09:44.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.736+0000 7fe4e1b7f700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4dc0fcf80 0x7fe4dc10cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:09:44.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.736+0000 7fe4e1b7f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc10d320 con 0x7fe4dc0fbcd0 2024-04-12T09:09:44.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.736+0000 7fe4e1b7f700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc10d490 con 0x7fe4dc0fcf80 2024-04-12T09:09:44.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.736+0000 7fe4daffd700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4dc0fcf80 0x7fe4dc10cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:09:44.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.736+0000 7fe4db7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4dc0fbcd0 0x7fe4dc10c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:09:44.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.736+0000 7fe4daffd700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4dc0fcf80 0x7fe4dc10cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.117:45790/0 (socket says 172.21.15.117:45790) 2024-04-12T09:09:44.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.736+0000 7fe4daffd700 1 -- 172.21.15.117:0/3637882994 learned_addr learned my addr 172.21.15.117:0/3637882994 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:09:44.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.736+0000 7fe4db7fe700 1 -- 172.21.15.117:0/3637882994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4dc0fcf80 msgr2=0x7fe4dc10cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:44.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.736+0000 7fe4db7fe700 1 --2- 172.21.15.117:0/3637882994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4dc0fcf80 0x7fe4dc10cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:44.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.737+0000 7fe4db7fe700 1 -- 172.21.15.117:0/3637882994 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d0005040 con 0x7fe4dc0fbcd0 2024-04-12T09:09:44.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.737+0000 7fe4daffd700 1 --2- 172.21.15.117:0/3637882994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4dc0fcf80 0x7fe4dc10cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T09:09:44.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.737+0000 7fe4db7fe700 1 --2- 172.21.15.117:0/3637882994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4dc0fbcd0 0x7fe4dc10c7e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc002b00 tx=0x7fe4cc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:09:44.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.737+0000 7fe4c3fff700 1 -- 172.21.15.117:0/3637882994 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4cc007ab0 con 0x7fe4dc0fbcd0 2024-04-12T09:09:44.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.737+0000 7fe4e1b7f700 1 -- 172.21.15.117:0/3637882994 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4dc0663b0 con 0x7fe4dc0fbcd0 2024-04-12T09:09:44.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.737+0000 7fe4c3fff700 1 -- 172.21.15.117:0/3637882994 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe4cc00f040 con 0x7fe4dc0fbcd0 2024-04-12T09:09:44.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.737+0000 7fe4e1b7f700 1 -- 172.21.15.117:0/3637882994 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4dc066970 con 0x7fe4dc0fbcd0 2024-04-12T09:09:44.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.737+0000 7fe4c3fff700 1 -- 172.21.15.117:0/3637882994 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4cc009590 con 0x7fe4dc0fbcd0 2024-04-12T09:09:44.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.738+0000 7fe4e1b7f700 1 -- 172.21.15.117:0/3637882994 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c80052e0 con 0x7fe4dc0fbcd0 2024-04-12T09:09:44.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.739+0000 7fe4c3fff700 1 -- 172.21.15.117:0/3637882994 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fe4cc007c10 con 0x7fe4dc0fbcd0 2024-04-12T09:09:44.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.740+0000 7fe4c3fff700 1 --2- 172.21.15.117:0/3637882994 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fe4c40692a0 0x7fe4c406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:09:44.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.740+0000 7fe4daffd700 1 --2- 172.21.15.117:0/3637882994 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fe4c40692a0 0x7fe4c406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:09:44.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.740+0000 7fe4c3fff700 1 -- 172.21.15.117:0/3637882994 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe4cc086e30 con 0x7fe4dc0fbcd0 2024-04-12T09:09:44.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.741+0000 7fe4daffd700 1 --2- 172.21.15.117:0/3637882994 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fe4c40692a0 0x7fe4c406b750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0004f90 tx=0x7fe4d0009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:09:44.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:44.749+0000 7fe4c3fff700 1 -- 172.21.15.117:0/3637882994 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fe4cc056ba0 con 0x7fe4dc0fbcd0 2024-04-12T09:09:44.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:44 smithi203 ceph-mon[36428]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:45.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.132+0000 7fe4e1b7f700 1 -- 172.21.15.117:0/3637882994 --> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4c8000bf0 con 0x7fe4c40692a0 2024-04-12T09:09:45.150 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.149+0000 7fe4c3fff700 1 -- 172.21.15.117:0/3637882994 <== mgr.14214 v2:172.21.15.117:6800/3945342300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7fe4c8000bf0 con 0x7fe4c40692a0 2024-04-12T09:09:45.150 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:09:45.150 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 running (5m) 64s ago 6m 24.7M - 0.25.0 c8568f914cd2 8fdf255143c1 2024-04-12T09:09:45.150 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (7m) 64s ago 7m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad 1e9f2c6a4491 2024-04-12T09:09:45.150 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (6m) 69s ago 6m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad e42da3f6e517 2024-04-12T09:09:45.150 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 running (5m) 64s ago 6m 83.0M - 9.4.7 954c08fa6188 80596fd1f615 2024-04-12T09:09:45.150 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (82s) 64s ago 81s 14.3M - 17.2.7-827-gd3b5060a 21de9b7369ad de062e2c10e7 2024-04-12T09:09:45.151 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 running (88s) 64s ago 88s 10.5M - 17.2.7-827-gd3b5060a 21de9b7369ad 1e82c6241a18 2024-04-12T09:09:45.151 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (79s) 69s ago 79s 13.4M - 17.2.7-827-gd3b5060a 21de9b7369ad b05228e997f7 2024-04-12T09:09:45.151 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (86s) 69s ago 85s 13.7M - 17.2.7-827-gd3b5060a 21de9b7369ad 6d7f82c072c7 2024-04-12T09:09:45.151 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:9283 running (8m) 64s ago 8m 481M - 17.2.7-827-gd3b5060a 21de9b7369ad cd0beaa7ece1 2024-04-12T09:09:45.151 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283 running (5m) 69s ago 5m 435M - 17.2.7-827-gd3b5060a 21de9b7369ad 2a913ba26232 2024-04-12T09:09:45.151 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (8m) 64s ago 8m 41.4M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad f9d5f7ac5270 2024-04-12T09:09:45.151 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (5m) 69s ago 5m 32.7M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad 17c0db49bb16 2024-04-12T09:09:45.151 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 running (7m) 64s ago 7m 15.9M - 1.5.0 0da6a335fe13 9fb7eb0eaa72 2024-04-12T09:09:45.151 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (5m) 69s ago 5m 16.8M - 1.5.0 0da6a335fe13 be0daeda3393 2024-04-12T09:09:45.151 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (5m) 64s ago 5m 45.8M 4288M 17.2.7-827-gd3b5060a 21de9b7369ad 77040a2498f3 2024-04-12T09:09:45.151 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (4m) 64s ago 4m 45.4M 4288M 17.2.7-827-gd3b5060a 21de9b7369ad 8f9dbf0274ed 2024-04-12T09:09:45.151 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (4m) 64s ago 4m 47.0M 4288M 17.2.7-827-gd3b5060a 21de9b7369ad 339c5a80d1dd 2024-04-12T09:09:45.151 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (3m) 69s ago 3m 46.5M 5312M 17.2.7-827-gd3b5060a 21de9b7369ad fb87d616bae3 2024-04-12T09:09:45.151 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (3m) 69s ago 3m 44.5M 5312M 17.2.7-827-gd3b5060a 21de9b7369ad c873826a2dea 2024-04-12T09:09:45.152 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (2m) 69s ago 2m 41.0M 5312M 17.2.7-827-gd3b5060a 21de9b7369ad 69cb7c22f002 2024-04-12T09:09:45.152 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 running (5m) 64s ago 6m 53.0M - 2.43.0 a07b618ecd1d 2799a65eed76 2024-04-12T09:09:45.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.152+0000 7fe4e1b7f700 1 -- 172.21.15.117:0/3637882994 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fe4c40692a0 msgr2=0x7fe4c406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:45.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.152+0000 7fe4e1b7f700 1 --2- 172.21.15.117:0/3637882994 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fe4c40692a0 0x7fe4c406b750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0004f90 tx=0x7fe4d0009e30 comp rx=0 tx=0).stop 2024-04-12T09:09:45.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.152+0000 7fe4e1b7f700 1 -- 172.21.15.117:0/3637882994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4dc0fbcd0 msgr2=0x7fe4dc10c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:45.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.152+0000 7fe4e1b7f700 1 --2- 172.21.15.117:0/3637882994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4dc0fbcd0 0x7fe4dc10c7e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc002b00 tx=0x7fe4cc004600 comp rx=0 tx=0).stop 2024-04-12T09:09:45.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.152+0000 7fe4e1b7f700 1 -- 172.21.15.117:0/3637882994 shutdown_connections 2024-04-12T09:09:45.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.152+0000 7fe4e1b7f700 1 --2- 172.21.15.117:0/3637882994 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fe4c40692a0 0x7fe4c406b750 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:45.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.152+0000 7fe4e1b7f700 1 --2- 172.21.15.117:0/3637882994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4dc0fbcd0 0x7fe4dc10c7e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:45.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.152+0000 7fe4e1b7f700 1 --2- 172.21.15.117:0/3637882994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4dc0fcf80 0x7fe4dc10cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:45.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.152+0000 7fe4e1b7f700 1 -- 172.21.15.117:0/3637882994 >> 172.21.15.117:0/3637882994 conn(0x7fe4dc0f7430 msgr2=0x7fe4dc0f8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:09:45.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.152+0000 7fe4e1b7f700 1 -- 172.21.15.117:0/3637882994 shutdown_connections 2024-04-12T09:09:45.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.152+0000 7fe4e1b7f700 1 -- 172.21.15.117:0/3637882994 wait complete. 2024-04-12T09:09:45.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.298+0000 7f15121c3700 1 -- 172.21.15.117:0/3331096775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f150c0fcf80 msgr2=0x7f150c0fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:45.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.298+0000 7f15121c3700 1 --2- 172.21.15.117:0/3331096775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f150c0fcf80 0x7f150c0fd3f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1500004940 tx=0x7f1500009e30 comp rx=0 tx=0).stop 2024-04-12T09:09:45.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.298+0000 7f15121c3700 1 -- 172.21.15.117:0/3331096775 shutdown_connections 2024-04-12T09:09:45.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.298+0000 7f15121c3700 1 --2- 172.21.15.117:0/3331096775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f150c0fcf80 0x7f150c0fd3f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:45.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.298+0000 7f15121c3700 1 --2- 172.21.15.117:0/3331096775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f150c0fbcd0 0x7f150c0fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:45.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.298+0000 7f15121c3700 1 -- 172.21.15.117:0/3331096775 >> 172.21.15.117:0/3331096775 conn(0x7f150c0f7430 msgr2=0x7f150c0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:09:45.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.298+0000 7f15121c3700 1 -- 172.21.15.117:0/3331096775 shutdown_connections 2024-04-12T09:09:45.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.298+0000 7f15121c3700 1 -- 172.21.15.117:0/3331096775 wait complete. 2024-04-12T09:09:45.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.299+0000 7f15121c3700 1 Processor -- start 2024-04-12T09:09:45.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.299+0000 7f15121c3700 1 -- start start 2024-04-12T09:09:45.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.299+0000 7f15121c3700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f150c0fbcd0 0x7f150c10c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:09:45.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.300+0000 7f15121c3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f150c0fcf80 0x7f150c10cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:09:45.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.300+0000 7f15121c3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c10d3c0 con 0x7f150c0fcf80 2024-04-12T09:09:45.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.300+0000 7f15121c3700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c10dc10 con 0x7f150c0fbcd0 2024-04-12T09:09:45.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.300+0000 7f150affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f150c0fcf80 0x7f150c10cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:09:45.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.300+0000 7f150b7fe700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f150c0fbcd0 0x7f150c10c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:09:45.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.300+0000 7f150affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f150c0fcf80 0x7f150c10cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33142/0 (socket says 172.21.15.117:33142) 2024-04-12T09:09:45.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.300+0000 7f150affd700 1 -- 172.21.15.117:0/3586072503 learned_addr learned my addr 172.21.15.117:0/3586072503 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:09:45.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.300+0000 7f150b7fe700 1 -- 172.21.15.117:0/3586072503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f150c0fcf80 msgr2=0x7f150c10cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:45.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.300+0000 7f150b7fe700 1 --2- 172.21.15.117:0/3586072503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f150c0fcf80 0x7f150c10cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:45.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.300+0000 7f150b7fe700 1 -- 172.21.15.117:0/3586072503 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1500005040 con 0x7f150c0fbcd0 2024-04-12T09:09:45.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.300+0000 7f150affd700 1 --2- 172.21.15.117:0/3586072503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f150c0fcf80 0x7f150c10cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T09:09:45.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.300+0000 7f150b7fe700 1 --2- 172.21.15.117:0/3586072503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f150c0fbcd0 0x7f150c10c880 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f14fc009fd0 tx=0x7f14fc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:09:45.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.301+0000 7f14f3fff700 1 -- 172.21.15.117:0/3586072503 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14fc007ea0 con 0x7f150c0fbcd0 2024-04-12T09:09:45.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.301+0000 7f14f3fff700 1 -- 172.21.15.117:0/3586072503 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f14fc00f040 con 0x7f150c0fbcd0 2024-04-12T09:09:45.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.301+0000 7f15121c3700 1 -- 172.21.15.117:0/3586072503 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150c10de90 con 0x7f150c0fbcd0 2024-04-12T09:09:45.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.301+0000 7f15121c3700 1 -- 172.21.15.117:0/3586072503 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150c10e3d0 con 0x7f150c0fbcd0 2024-04-12T09:09:45.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.301+0000 7f14f3fff700 1 -- 172.21.15.117:0/3586072503 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14fc0092b0 con 0x7f150c0fbcd0 2024-04-12T09:09:45.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.302+0000 7f15121c3700 1 -- 172.21.15.117:0/3586072503 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150c05f5f0 con 0x7f150c0fbcd0 2024-04-12T09:09:45.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.303+0000 7f14f3fff700 1 -- 172.21.15.117:0/3586072503 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f14fc018030 con 0x7f150c0fbcd0 2024-04-12T09:09:45.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.304+0000 7f14f3fff700 1 --2- 172.21.15.117:0/3586072503 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f14f4069300 0x7f14f406b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:09:45.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.304+0000 7f14f3fff700 1 -- 172.21.15.117:0/3586072503 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f14fc016070 con 0x7f150c0fbcd0 2024-04-12T09:09:45.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.304+0000 7f150affd700 1 --2- 172.21.15.117:0/3586072503 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f14f4069300 0x7f14f406b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:09:45.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.304+0000 7f150affd700 1 --2- 172.21.15.117:0/3586072503 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f14f4069300 0x7f14f406b7b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1500013740 tx=0x7f1500009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:09:45.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.311+0000 7f14f3fff700 1 -- 172.21.15.117:0/3586072503 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f14fc0592c0 con 0x7f150c0fbcd0 2024-04-12T09:09:45.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.685+0000 7f15121c3700 1 -- 172.21.15.117:0/3586072503 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f150c1047c0 con 0x7f150c0fbcd0 2024-04-12T09:09:45.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.685+0000 7f14f3fff700 1 -- 172.21.15.117:0/3586072503 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f14fc058e50 con 0x7f150c0fbcd0 2024-04-12T09:09:45.686 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:09:45.686 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": { 2024-04-12T09:09:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 2 2024-04-12T09:09:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:09:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": { 2024-04-12T09:09:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 2 2024-04-12T09:09:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:09:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": { 2024-04-12T09:09:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 6 2024-04-12T09:09:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:09:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-04-12T09:09:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 4 2024-04-12T09:09:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:09:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: "overall": { 2024-04-12T09:09:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 14 2024-04-12T09:09:45.687 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:09:45.688 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:09:45.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.688+0000 7f15121c3700 1 -- 172.21.15.117:0/3586072503 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f14f4069300 msgr2=0x7f14f406b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:45.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.688+0000 7f15121c3700 1 --2- 172.21.15.117:0/3586072503 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f14f4069300 0x7f14f406b7b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1500013740 tx=0x7f1500009e30 comp rx=0 tx=0).stop 2024-04-12T09:09:45.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.688+0000 7f15121c3700 1 -- 172.21.15.117:0/3586072503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f150c0fbcd0 msgr2=0x7f150c10c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:45.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.688+0000 7f15121c3700 1 --2- 172.21.15.117:0/3586072503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f150c0fbcd0 0x7f150c10c880 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f14fc009fd0 tx=0x7f14fc00b040 comp rx=0 tx=0).stop 2024-04-12T09:09:45.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.688+0000 7f15121c3700 1 -- 172.21.15.117:0/3586072503 shutdown_connections 2024-04-12T09:09:45.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.688+0000 7f15121c3700 1 --2- 172.21.15.117:0/3586072503 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f14f4069300 0x7f14f406b7b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:45.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.688+0000 7f15121c3700 1 --2- 172.21.15.117:0/3586072503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f150c0fbcd0 0x7f150c10c880 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:45.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.688+0000 7f15121c3700 1 --2- 172.21.15.117:0/3586072503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f150c0fcf80 0x7f150c10cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:45.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.688+0000 7f15121c3700 1 -- 172.21.15.117:0/3586072503 >> 172.21.15.117:0/3586072503 conn(0x7f150c0f7430 msgr2=0x7f150c0f8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:09:45.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.690+0000 7f15121c3700 1 -- 172.21.15.117:0/3586072503 shutdown_connections 2024-04-12T09:09:45.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.690+0000 7f15121c3700 1 -- 172.21.15.117:0/3586072503 wait complete. 2024-04-12T09:09:45.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:45 smithi203 ceph-mon[36428]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:09:45.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:45 smithi203 ceph-mon[36428]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:09:45.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.834+0000 7f7c8b77a700 1 -- 172.21.15.117:0/410611288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c840fff00 msgr2=0x7f7c84102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:45.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.834+0000 7f7c8b77a700 1 --2- 172.21.15.117:0/410611288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c840fff00 0x7f7c84102320 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7c74004940 tx=0x7f7c74009e30 comp rx=0 tx=0).stop 2024-04-12T09:09:45.835 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:45 smithi117 ceph-mon[29277]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:09:45.835 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:45 smithi117 ceph-mon[29277]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:09:45.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.834+0000 7f7c8b77a700 1 -- 172.21.15.117:0/410611288 shutdown_connections 2024-04-12T09:09:45.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.834+0000 7f7c8b77a700 1 --2- 172.21.15.117:0/410611288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c840fff00 0x7f7c84102320 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:45.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.834+0000 7f7c8b77a700 1 --2- 172.21.15.117:0/410611288 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c840662e0 0x7f7c840ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:45.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.834+0000 7f7c8b77a700 1 -- 172.21.15.117:0/410611288 >> 172.21.15.117:0/410611288 conn(0x7f7c840f7430 msgr2=0x7f7c840f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:09:45.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.834+0000 7f7c8b77a700 1 -- 172.21.15.117:0/410611288 shutdown_connections 2024-04-12T09:09:45.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.834+0000 7f7c8b77a700 1 -- 172.21.15.117:0/410611288 wait complete. 2024-04-12T09:09:45.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.835+0000 7f7c8b77a700 1 Processor -- start 2024-04-12T09:09:45.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.835+0000 7f7c8b77a700 1 -- start start 2024-04-12T09:09:45.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.835+0000 7f7c8b77a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c840662e0 0x7f7c8410da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:09:45.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.835+0000 7f7c8b77a700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c840fff00 0x7f7c8410df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:09:45.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.835+0000 7f7c8b77a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8410e580 con 0x7f7c840662e0 2024-04-12T09:09:45.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.835+0000 7f7c8b77a700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8410ed80 con 0x7f7c840fff00 2024-04-12T09:09:45.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.836+0000 7f7c89516700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c840662e0 0x7f7c8410da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:09:45.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.836+0000 7f7c89516700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c840662e0 0x7f7c8410da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33160/0 (socket says 172.21.15.117:33160) 2024-04-12T09:09:45.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.836+0000 7f7c89516700 1 -- 172.21.15.117:0/375870064 learned_addr learned my addr 172.21.15.117:0/375870064 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:09:45.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.836+0000 7f7c88d15700 1 --2- 172.21.15.117:0/375870064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c840fff00 0x7f7c8410df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:09:45.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.836+0000 7f7c89516700 1 -- 172.21.15.117:0/375870064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c840fff00 msgr2=0x7f7c8410df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:45.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.836+0000 7f7c89516700 1 --2- 172.21.15.117:0/375870064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c840fff00 0x7f7c8410df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:45.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.836+0000 7f7c89516700 1 -- 172.21.15.117:0/375870064 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c74005040 con 0x7f7c840662e0 2024-04-12T09:09:45.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.836+0000 7f7c89516700 1 --2- 172.21.15.117:0/375870064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c840662e0 0x7f7c8410da40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000eb40 tx=0x7f7c8000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:09:45.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.836+0000 7f7c79ffb700 1 -- 172.21.15.117:0/375870064 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c80007cc0 con 0x7f7c840662e0 2024-04-12T09:09:45.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.836+0000 7f7c8b77a700 1 -- 172.21.15.117:0/375870064 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c8410f000 con 0x7f7c840662e0 2024-04-12T09:09:45.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.836+0000 7f7c79ffb700 1 -- 172.21.15.117:0/375870064 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7c8000f040 con 0x7f7c840662e0 2024-04-12T09:09:45.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.836+0000 7f7c79ffb700 1 -- 172.21.15.117:0/375870064 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c8000c970 con 0x7f7c840662e0 2024-04-12T09:09:45.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.837+0000 7f7c8b77a700 1 -- 172.21.15.117:0/375870064 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c8410f540 con 0x7f7c840662e0 2024-04-12T09:09:45.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.838+0000 7f7c8b77a700 1 -- 172.21.15.117:0/375870064 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c8405f5f0 con 0x7f7c840662e0 2024-04-12T09:09:45.839 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.839+0000 7f7c79ffb700 1 -- 172.21.15.117:0/375870064 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f7c8000cad0 con 0x7f7c840662e0 2024-04-12T09:09:45.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.839+0000 7f7c79ffb700 1 --2- 172.21.15.117:0/375870064 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f7c70069310 0x7f7c7006b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:09:45.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.839+0000 7f7c88d15700 1 --2- 172.21.15.117:0/375870064 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f7c70069310 0x7f7c7006b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:09:45.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.839+0000 7f7c79ffb700 1 -- 172.21.15.117:0/375870064 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f7c80086b40 con 0x7f7c840662e0 2024-04-12T09:09:45.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.840+0000 7f7c88d15700 1 --2- 172.21.15.117:0/375870064 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f7c70069310 0x7f7c7006b7c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7c74009b30 tx=0x7f7c74009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:09:45.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:45.848+0000 7f7c79ffb700 1 -- 172.21.15.117:0/375870064 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f7c8004e190 con 0x7f7c840662e0 2024-04-12T09:09:46.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:46.254+0000 7f7c8b77a700 1 -- 172.21.15.117:0/375870064 --> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c8410f7d0 con 0x7f7c70069310 2024-04-12T09:09:46.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:46.256+0000 7f7c79ffb700 1 -- 172.21.15.117:0/375870064 <== mgr.14214 v2:172.21.15.117:6800/3945342300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f7c8410f7d0 con 0x7f7c70069310 2024-04-12T09:09:46.257 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:09:46.257 INFO:teuthology.orchestra.run.smithi117.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:b277feb2c7beb4597d8ecc39d58d5c36b81f613a", 2024-04-12T09:09:46.257 INFO:teuthology.orchestra.run.smithi117.stdout: "in_progress": true, 2024-04-12T09:09:46.257 INFO:teuthology.orchestra.run.smithi117.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-12T09:09:46.257 INFO:teuthology.orchestra.run.smithi117.stdout: "services_complete": [], 2024-04-12T09:09:46.257 INFO:teuthology.orchestra.run.smithi117.stdout: "progress": "", 2024-04-12T09:09:46.257 INFO:teuthology.orchestra.run.smithi117.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:b277feb2c7beb4597d8ecc39d58d5c36b81f613a image", 2024-04-12T09:09:46.257 INFO:teuthology.orchestra.run.smithi117.stdout: "is_paused": false 2024-04-12T09:09:46.257 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:09:46.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:46.259+0000 7f7c8b77a700 1 -- 172.21.15.117:0/375870064 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f7c70069310 msgr2=0x7f7c7006b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:46.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:46.259+0000 7f7c8b77a700 1 --2- 172.21.15.117:0/375870064 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f7c70069310 0x7f7c7006b7c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7c74009b30 tx=0x7f7c74009e30 comp rx=0 tx=0).stop 2024-04-12T09:09:46.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:46.259+0000 7f7c8b77a700 1 -- 172.21.15.117:0/375870064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c840662e0 msgr2=0x7f7c8410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:09:46.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:46.259+0000 7f7c8b77a700 1 --2- 172.21.15.117:0/375870064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c840662e0 0x7f7c8410da40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000eb40 tx=0x7f7c8000b040 comp rx=0 tx=0).stop 2024-04-12T09:09:46.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:46.259+0000 7f7c8b77a700 1 -- 172.21.15.117:0/375870064 shutdown_connections 2024-04-12T09:09:46.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:46.259+0000 7f7c8b77a700 1 --2- 172.21.15.117:0/375870064 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f7c70069310 0x7f7c7006b7c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:46.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:46.259+0000 7f7c8b77a700 1 --2- 172.21.15.117:0/375870064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c840662e0 0x7f7c8410da40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:46.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:46.259+0000 7f7c8b77a700 1 --2- 172.21.15.117:0/375870064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c840fff00 0x7f7c8410df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:09:46.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:46.259+0000 7f7c8b77a700 1 -- 172.21.15.117:0/375870064 >> 172.21.15.117:0/375870064 conn(0x7f7c840f7430 msgr2=0x7f7c840f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:09:46.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:46.259+0000 7f7c8b77a700 1 -- 172.21.15.117:0/375870064 shutdown_connections 2024-04-12T09:09:46.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:09:46.259+0000 7f7c8b77a700 1 -- 172.21.15.117:0/375870064 wait complete. 2024-04-12T09:09:46.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:46 smithi117 ceph-mon[29277]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:09:46.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:46 smithi117 ceph-mon[29277]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:46.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:46 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/3586072503' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:09:46.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:46 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:09:46.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:46 smithi203 ceph-mon[36428]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:09:46.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:46 smithi203 ceph-mon[36428]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:46.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:46 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/3586072503' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:09:46.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:46 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:09:47.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:47 smithi117 ceph-mon[29277]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:09:47.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:47 smithi203 ceph-mon[36428]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:09:48.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:48 smithi203 ceph-mon[36428]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:48.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:48 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:09:48.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:48 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:09:48.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:48 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:09:48.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:48 smithi117 ceph-mon[29277]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:48.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:48 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:09:48.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:48 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:09:48.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:48 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:09:49.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:49 smithi203 ceph-mon[36428]: Upgrade: Target is version 19.0.0-2053-gb277feb2 (unknown) 2024-04-12T09:09:49.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:49 smithi203 ceph-mon[36428]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, digests ['quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec'] 2024-04-12T09:09:49.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:49 smithi203 ceph-mon[36428]: Upgrade: Need to upgrade myself (mgr.smithi117.oyaxql) 2024-04-12T09:09:49.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:49 smithi203 ceph-mon[36428]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec on smithi203 2024-04-12T09:09:49.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:49 smithi117 ceph-mon[29277]: Upgrade: Target is version 19.0.0-2053-gb277feb2 (unknown) 2024-04-12T09:09:49.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:49 smithi117 ceph-mon[29277]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, digests ['quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec'] 2024-04-12T09:09:49.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:49 smithi117 ceph-mon[29277]: Upgrade: Need to upgrade myself (mgr.smithi117.oyaxql) 2024-04-12T09:09:49.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:49 smithi117 ceph-mon[29277]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec on smithi203 2024-04-12T09:09:50.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:50 smithi117 ceph-mon[29277]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:50.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:50 smithi203 ceph-mon[36428]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:52.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:52 smithi203 ceph-mon[36428]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:52.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:52 smithi117 ceph-mon[29277]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:54.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:54 smithi203 ceph-mon[36428]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:54.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:54 smithi117 ceph-mon[29277]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:56.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:56 smithi203 ceph-mon[36428]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:56.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:56 smithi117 ceph-mon[29277]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:58.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:09:58 smithi203 ceph-mon[36428]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:09:58.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:09:58 smithi117 ceph-mon[29277]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:10:00.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:00 smithi117 ceph-mon[29277]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:10:00.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:00 smithi117 ceph-mon[29277]: overall HEALTH_OK 2024-04-12T09:10:00.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:00 smithi203 ceph-mon[36428]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:10:00.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:00 smithi203 ceph-mon[36428]: overall HEALTH_OK 2024-04-12T09:10:01.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:01 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:10:01.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:01 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:10:02.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:02 smithi117 ceph-mon[29277]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:10:02.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:02 smithi203 ceph-mon[36428]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:10:04.706 INFO:tasks.workunit.client.1.smithi203.stderr:Updating files: 94% (11820/12462) Updating files: 95% (11839/12462) Updating files: 96% (11964/12462) Updating files: 97% (12089/12462) Updating files: 98% (12213/12462) Updating files: 99% (12338/12462) Updating files: 100% (12462/12462) Updating files: 100% (12462/12462), done. 2024-04-12T09:10:04.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:04 smithi203 ceph-mon[36428]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:10:04.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:04 smithi117 ceph-mon[29277]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:10:05.307 INFO:tasks.workunit.client.0.smithi117.stderr:Note: switching to 'dea717a37c7849ca8459c02fb965020aedcc0a9a'. 2024-04-12T09:10:05.308 INFO:tasks.workunit.client.0.smithi117.stderr: 2024-04-12T09:10:05.308 INFO:tasks.workunit.client.0.smithi117.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-12T09:10:05.308 INFO:tasks.workunit.client.0.smithi117.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-12T09:10:05.308 INFO:tasks.workunit.client.0.smithi117.stderr:state without impacting any branches by switching back to a branch. 2024-04-12T09:10:05.308 INFO:tasks.workunit.client.0.smithi117.stderr: 2024-04-12T09:10:05.308 INFO:tasks.workunit.client.0.smithi117.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-12T09:10:05.308 INFO:tasks.workunit.client.0.smithi117.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-12T09:10:05.308 INFO:tasks.workunit.client.0.smithi117.stderr: 2024-04-12T09:10:05.308 INFO:tasks.workunit.client.0.smithi117.stderr: git switch -c 2024-04-12T09:10:05.308 INFO:tasks.workunit.client.0.smithi117.stderr: 2024-04-12T09:10:05.308 INFO:tasks.workunit.client.0.smithi117.stderr:Or undo this operation with: 2024-04-12T09:10:05.308 INFO:tasks.workunit.client.0.smithi117.stderr: 2024-04-12T09:10:05.308 INFO:tasks.workunit.client.0.smithi117.stderr: git switch - 2024-04-12T09:10:05.308 INFO:tasks.workunit.client.0.smithi117.stderr: 2024-04-12T09:10:05.309 INFO:tasks.workunit.client.0.smithi117.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-12T09:10:05.309 INFO:tasks.workunit.client.0.smithi117.stderr: 2024-04-12T09:10:05.309 INFO:tasks.workunit.client.0.smithi117.stderr:HEAD is now at dea717a37c7 Merge pull request #56778 from epuertat/wip-65368-squid 2024-04-12T09:10:05.311 DEBUG:teuthology.orchestra.run.smithi117:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-12T09:10:05.337 INFO:tasks.workunit.client.0.smithi117.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-12T09:10:05.339 INFO:tasks.workunit.client.0.smithi117.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-12T09:10:05.339 INFO:tasks.workunit.client.0.smithi117.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-12T09:10:05.397 INFO:tasks.workunit.client.1.smithi203.stderr:Note: switching to 'dea717a37c7849ca8459c02fb965020aedcc0a9a'. 2024-04-12T09:10:05.398 INFO:tasks.workunit.client.1.smithi203.stderr: 2024-04-12T09:10:05.398 INFO:tasks.workunit.client.1.smithi203.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-12T09:10:05.398 INFO:tasks.workunit.client.1.smithi203.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-12T09:10:05.398 INFO:tasks.workunit.client.1.smithi203.stderr:state without impacting any branches by switching back to a branch. 2024-04-12T09:10:05.398 INFO:tasks.workunit.client.1.smithi203.stderr: 2024-04-12T09:10:05.398 INFO:tasks.workunit.client.1.smithi203.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-12T09:10:05.398 INFO:tasks.workunit.client.1.smithi203.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-12T09:10:05.398 INFO:tasks.workunit.client.1.smithi203.stderr: 2024-04-12T09:10:05.398 INFO:tasks.workunit.client.1.smithi203.stderr: git switch -c 2024-04-12T09:10:05.398 INFO:tasks.workunit.client.1.smithi203.stderr: 2024-04-12T09:10:05.398 INFO:tasks.workunit.client.1.smithi203.stderr:Or undo this operation with: 2024-04-12T09:10:05.398 INFO:tasks.workunit.client.1.smithi203.stderr: 2024-04-12T09:10:05.398 INFO:tasks.workunit.client.1.smithi203.stderr: git switch - 2024-04-12T09:10:05.399 INFO:tasks.workunit.client.1.smithi203.stderr: 2024-04-12T09:10:05.399 INFO:tasks.workunit.client.1.smithi203.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-12T09:10:05.399 INFO:tasks.workunit.client.1.smithi203.stderr: 2024-04-12T09:10:05.399 INFO:tasks.workunit.client.1.smithi203.stderr:HEAD is now at dea717a37c7 Merge pull request #56778 from epuertat/wip-65368-squid 2024-04-12T09:10:05.401 DEBUG:teuthology.orchestra.run.smithi203:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-04-12T09:10:05.466 INFO:tasks.workunit.client.1.smithi203.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-12T09:10:05.468 INFO:tasks.workunit.client.1.smithi203.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-12T09:10:05.469 INFO:tasks.workunit.client.1.smithi203.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-12T09:10:06.070 INFO:tasks.workunit.client.0.smithi117.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-12T09:10:06.133 INFO:tasks.workunit.client.0.smithi117.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-12T09:10:06.173 INFO:tasks.workunit.client.0.smithi117.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-12T09:10:06.174 INFO:tasks.workunit.client.0.smithi117.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-12T09:10:06.174 INFO:tasks.workunit.client.0.smithi117.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-12T09:10:06.213 INFO:tasks.workunit.client.0.smithi117.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-12T09:10:06.216 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-12T09:10:06.216 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-12T09:10:06.225 INFO:tasks.workunit.client.1.smithi203.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-12T09:10:06.272 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-12T09:10:06.274 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-12T09:10:06.274 DEBUG:teuthology.orchestra.run.smithi117:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=dea717a37c7849ca8459c02fb965020aedcc0a9a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-12T09:10:06.307 INFO:tasks.workunit.client.1.smithi203.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-12T09:10:06.336 INFO:tasks.workunit.client.0.smithi117.stderr:+ mkdir -p fsstress 2024-04-12T09:10:06.338 INFO:tasks.workunit.client.0.smithi117.stderr:+ pushd fsstress 2024-04-12T09:10:06.339 INFO:tasks.workunit.client.0.smithi117.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-12T09:10:06.340 INFO:tasks.workunit.client.0.smithi117.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-12T09:10:06.347 INFO:tasks.workunit.client.1.smithi203.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-12T09:10:06.349 INFO:tasks.workunit.client.1.smithi203.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-12T09:10:06.349 INFO:tasks.workunit.client.1.smithi203.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-12T09:10:06.390 INFO:tasks.workunit.client.1.smithi203.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-12T09:10:06.393 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-12T09:10:06.393 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-04-12T09:10:06.449 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-04-12T09:10:06.450 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-12T09:10:06.450 DEBUG:teuthology.orchestra.run.smithi203:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=dea717a37c7849ca8459c02fb965020aedcc0a9a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-04-12T09:10:06.514 INFO:tasks.workunit.client.1.smithi203.stderr:+ mkdir -p fsstress 2024-04-12T09:10:06.516 INFO:tasks.workunit.client.1.smithi203.stderr:+ pushd fsstress 2024-04-12T09:10:06.518 INFO:tasks.workunit.client.1.smithi203.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-12T09:10:06.518 INFO:tasks.workunit.client.1.smithi203.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-12T09:10:06.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:06 smithi203 ceph-mon[36428]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:10:06.880 INFO:tasks.workunit.client.0.smithi117.stderr:+ tar xzf ltp-full.tgz 2024-04-12T09:10:06.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:06 smithi117 ceph-mon[29277]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:10:08.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:08 smithi203 ceph-mon[36428]: pgmap v232: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:10:08.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:08 smithi117 ceph-mon[29277]: pgmap v232: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:10:10.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:10 smithi117 ceph-mon[29277]: pgmap v233: 65 pgs: 65 active+clean; 10 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 824 KiB/s wr, 29 op/s 2024-04-12T09:10:10.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:10 smithi203 ceph-mon[36428]: pgmap v233: 65 pgs: 65 active+clean; 10 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 824 KiB/s wr, 29 op/s 2024-04-12T09:10:12.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:12 smithi203 ceph-mon[36428]: pgmap v234: 65 pgs: 65 active+clean; 15 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s wr, 58 op/s 2024-04-12T09:10:12.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:12 smithi117 ceph-mon[29277]: pgmap v234: 65 pgs: 65 active+clean; 15 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s wr, 58 op/s 2024-04-12T09:10:14.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:14 smithi203 ceph-mon[36428]: pgmap v235: 65 pgs: 65 active+clean; 16 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s wr, 99 op/s 2024-04-12T09:10:14.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:14 smithi117 ceph-mon[29277]: pgmap v235: 65 pgs: 65 active+clean; 16 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s wr, 99 op/s 2024-04-12T09:10:16.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.394+0000 7febaa0c6700 1 -- 172.21.15.117:0/2326431197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feba40fe400 msgr2=0x7feba40fe810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:16.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.394+0000 7febaa0c6700 1 --2- 172.21.15.117:0/2326431197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feba40fe400 0x7feba40fe810 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7feb94004940 tx=0x7feb94009e30 comp rx=0 tx=0).stop 2024-04-12T09:10:16.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.394+0000 7febaa0c6700 1 -- 172.21.15.117:0/2326431197 shutdown_connections 2024-04-12T09:10:16.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.394+0000 7febaa0c6700 1 --2- 172.21.15.117:0/2326431197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feba40fed50 0x7feba40fae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:16.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.394+0000 7febaa0c6700 1 --2- 172.21.15.117:0/2326431197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feba40fe400 0x7feba40fe810 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:16.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.394+0000 7febaa0c6700 1 -- 172.21.15.117:0/2326431197 >> 172.21.15.117:0/2326431197 conn(0x7feba40f6ba0 msgr2=0x7feba40f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:10:16.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.394+0000 7febaa0c6700 1 -- 172.21.15.117:0/2326431197 shutdown_connections 2024-04-12T09:10:16.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.394+0000 7febaa0c6700 1 -- 172.21.15.117:0/2326431197 wait complete. 2024-04-12T09:10:16.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.395+0000 7febaa0c6700 1 Processor -- start 2024-04-12T09:10:16.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.395+0000 7febaa0c6700 1 -- start start 2024-04-12T09:10:16.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.395+0000 7febaa0c6700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feba40fe400 0x7feba40fdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:16.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.395+0000 7febaa0c6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feba40fed50 0x7feba40fc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:16.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.395+0000 7febaa0c6700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba4111610 con 0x7feba40fed50 2024-04-12T09:10:16.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.395+0000 7febaa0c6700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba4111780 con 0x7feba40fe400 2024-04-12T09:10:16.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.395+0000 7feba2ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feba40fed50 0x7feba40fc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:16.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.395+0000 7feba2ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feba40fed50 0x7feba40fc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47698/0 (socket says 172.21.15.117:47698) 2024-04-12T09:10:16.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.395+0000 7feba2ffd700 1 -- 172.21.15.117:0/2472484974 learned_addr learned my addr 172.21.15.117:0/2472484974 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:10:16.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.395+0000 7feba37fe700 1 --2- 172.21.15.117:0/2472484974 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feba40fe400 0x7feba40fdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:16.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.396+0000 7feba2ffd700 1 -- 172.21.15.117:0/2472484974 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feba40fe400 msgr2=0x7feba40fdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:16.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.396+0000 7feba2ffd700 1 --2- 172.21.15.117:0/2472484974 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feba40fe400 0x7feba40fdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:16.399 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.396+0000 7feba2ffd700 1 -- 172.21.15.117:0/2472484974 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb94005040 con 0x7feba40fed50 2024-04-12T09:10:16.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.396+0000 7feba2ffd700 1 --2- 172.21.15.117:0/2472484974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feba40fed50 0x7feba40fc0c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7feb9800eb40 tx=0x7feb9800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:10:16.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.397+0000 7feb8bfff700 1 -- 172.21.15.117:0/2472484974 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb98007cc0 con 0x7feba40fed50 2024-04-12T09:10:16.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.397+0000 7feb8bfff700 1 -- 172.21.15.117:0/2472484974 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb9800f040 con 0x7feba40fed50 2024-04-12T09:10:16.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.397+0000 7febaa0c6700 1 -- 172.21.15.117:0/2472484974 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba4111a00 con 0x7feba40fed50 2024-04-12T09:10:16.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.397+0000 7febaa0c6700 1 -- 172.21.15.117:0/2472484974 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba4111fc0 con 0x7feba40fed50 2024-04-12T09:10:16.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.397+0000 7feb8bfff700 1 -- 172.21.15.117:0/2472484974 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb9800ca10 con 0x7feba40fed50 2024-04-12T09:10:16.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.398+0000 7febaa0c6700 1 -- 172.21.15.117:0/2472484974 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba405f5f0 con 0x7feba40fed50 2024-04-12T09:10:16.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.399+0000 7feb8bfff700 1 -- 172.21.15.117:0/2472484974 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7feb9800cb70 con 0x7feba40fed50 2024-04-12T09:10:16.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.399+0000 7feb8bfff700 1 --2- 172.21.15.117:0/2472484974 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7feb8c069360 0x7feb8c06b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:16.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.399+0000 7feb8bfff700 1 -- 172.21.15.117:0/2472484974 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7feb98086c90 con 0x7feba40fed50 2024-04-12T09:10:16.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.400+0000 7feba37fe700 1 --2- 172.21.15.117:0/2472484974 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7feb8c069360 0x7feb8c06b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:16.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.401+0000 7feba37fe700 1 --2- 172.21.15.117:0/2472484974 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7feb8c069360 0x7feb8c06b810 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7feb94013870 tx=0x7feb94009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:10:16.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.405+0000 7feb8bfff700 1 -- 172.21.15.117:0/2472484974 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7feb9804e190 con 0x7feba40fed50 2024-04-12T09:10:16.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:16 smithi117 ceph-mon[29277]: pgmap v236: 65 pgs: 65 active+clean; 24 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s wr, 213 op/s 2024-04-12T09:10:16.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:16 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:10:16.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.697+0000 7febaa0c6700 1 -- 172.21.15.117:0/2472484974 --> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feba4102450 con 0x7feb8c069360 2024-04-12T09:10:16.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.699+0000 7feb8bfff700 1 -- 172.21.15.117:0/2472484974 <== mgr.14214 v2:172.21.15.117:6800/3945342300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7feba4102450 con 0x7feb8c069360 2024-04-12T09:10:16.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.701+0000 7febaa0c6700 1 -- 172.21.15.117:0/2472484974 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7feb8c069360 msgr2=0x7feb8c06b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:16.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.701+0000 7febaa0c6700 1 --2- 172.21.15.117:0/2472484974 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7feb8c069360 0x7feb8c06b810 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7feb94013870 tx=0x7feb94009e30 comp rx=0 tx=0).stop 2024-04-12T09:10:16.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.701+0000 7febaa0c6700 1 -- 172.21.15.117:0/2472484974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feba40fed50 msgr2=0x7feba40fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:16.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.701+0000 7febaa0c6700 1 --2- 172.21.15.117:0/2472484974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feba40fed50 0x7feba40fc0c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7feb9800eb40 tx=0x7feb9800b040 comp rx=0 tx=0).stop 2024-04-12T09:10:16.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.701+0000 7febaa0c6700 1 -- 172.21.15.117:0/2472484974 shutdown_connections 2024-04-12T09:10:16.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.701+0000 7febaa0c6700 1 --2- 172.21.15.117:0/2472484974 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7feb8c069360 0x7feb8c06b810 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:16.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.701+0000 7febaa0c6700 1 --2- 172.21.15.117:0/2472484974 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feba40fe400 0x7feba40fdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:16.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.701+0000 7febaa0c6700 1 --2- 172.21.15.117:0/2472484974 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feba40fed50 0x7feba40fc0c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:16.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.701+0000 7febaa0c6700 1 -- 172.21.15.117:0/2472484974 >> 172.21.15.117:0/2472484974 conn(0x7feba40f6ba0 msgr2=0x7feba40f81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:10:16.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.701+0000 7febaa0c6700 1 -- 172.21.15.117:0/2472484974 shutdown_connections 2024-04-12T09:10:16.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.701+0000 7febaa0c6700 1 -- 172.21.15.117:0/2472484974 wait complete. 2024-04-12T09:10:16.718 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:10:16.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:16 smithi203 ceph-mon[36428]: pgmap v236: 65 pgs: 65 active+clean; 24 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s wr, 213 op/s 2024-04-12T09:10:16.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:16 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:10:16.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.839+0000 7f0311301700 1 -- 172.21.15.117:0/1598027594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f030c0fcf80 msgr2=0x7f030c0fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:16.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.839+0000 7f0311301700 1 --2- 172.21.15.117:0/1598027594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f030c0fcf80 0x7f030c0fd3f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0300004940 tx=0x7f0300009e30 comp rx=0 tx=0).stop 2024-04-12T09:10:16.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.839+0000 7f0311301700 1 -- 172.21.15.117:0/1598027594 shutdown_connections 2024-04-12T09:10:16.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.839+0000 7f0311301700 1 --2- 172.21.15.117:0/1598027594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f030c0fcf80 0x7f030c0fd3f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:16.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.839+0000 7f0311301700 1 --2- 172.21.15.117:0/1598027594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f030c0fbcd0 0x7f030c0fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:16.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.839+0000 7f0311301700 1 -- 172.21.15.117:0/1598027594 >> 172.21.15.117:0/1598027594 conn(0x7f030c0f7430 msgr2=0x7f030c0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:10:16.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.839+0000 7f0311301700 1 -- 172.21.15.117:0/1598027594 shutdown_connections 2024-04-12T09:10:16.841 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.839+0000 7f0311301700 1 -- 172.21.15.117:0/1598027594 wait complete. 2024-04-12T09:10:16.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.840+0000 7f0311301700 1 Processor -- start 2024-04-12T09:10:16.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.840+0000 7f0311301700 1 -- start start 2024-04-12T09:10:16.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.841+0000 7f0311301700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f030c0fbcd0 0x7f030c10c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:16.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.841+0000 7f0311301700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f030c0fcf80 0x7f030c10ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:16.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.841+0000 7f0311301700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030c10d440 con 0x7f030c0fbcd0 2024-04-12T09:10:16.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.841+0000 7f0311301700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030c10dc90 con 0x7f030c0fcf80 2024-04-12T09:10:16.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.841+0000 7f030affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f030c0fbcd0 0x7f030c10c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:16.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.841+0000 7f030affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f030c0fbcd0 0x7f030c10c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47716/0 (socket says 172.21.15.117:47716) 2024-04-12T09:10:16.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.841+0000 7f030a7fc700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f030c0fcf80 0x7f030c10ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:16.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.841+0000 7f030a7fc700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f030c0fcf80 0x7f030c10ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.117:53584/0 (socket says 172.21.15.117:53584) 2024-04-12T09:10:16.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.841+0000 7f030a7fc700 1 -- 172.21.15.117:0/4220865925 learned_addr learned my addr 172.21.15.117:0/4220865925 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:10:16.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.842+0000 7f030a7fc700 1 -- 172.21.15.117:0/4220865925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f030c0fbcd0 msgr2=0x7f030c10c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:16.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.842+0000 7f030a7fc700 1 --2- 172.21.15.117:0/4220865925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f030c0fbcd0 0x7f030c10c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:16.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.842+0000 7f030a7fc700 1 -- 172.21.15.117:0/4220865925 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0300005040 con 0x7f030c0fcf80 2024-04-12T09:10:16.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.842+0000 7f030a7fc700 1 --2- 172.21.15.117:0/4220865925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f030c0fcf80 0x7f030c10ce40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f030000b3b0 tx=0x7f0300009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:10:16.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.842+0000 7f02f37fe700 1 -- 172.21.15.117:0/4220865925 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f030000e040 con 0x7f030c0fcf80 2024-04-12T09:10:16.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.842+0000 7f0311301700 1 -- 172.21.15.117:0/4220865925 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f030c10df10 con 0x7f030c0fcf80 2024-04-12T09:10:16.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.842+0000 7f02f37fe700 1 -- 172.21.15.117:0/4220865925 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f030000bbf0 con 0x7f030c0fcf80 2024-04-12T09:10:16.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.842+0000 7f02f37fe700 1 -- 172.21.15.117:0/4220865925 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f030001c630 con 0x7f030c0fcf80 2024-04-12T09:10:16.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.842+0000 7f0311301700 1 -- 172.21.15.117:0/4220865925 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f030c10e450 con 0x7f030c0fcf80 2024-04-12T09:10:16.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.843+0000 7f0311301700 1 -- 172.21.15.117:0/4220865925 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030c05f5f0 con 0x7f030c0fcf80 2024-04-12T09:10:16.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.844+0000 7f02f37fe700 1 -- 172.21.15.117:0/4220865925 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f0300013420 con 0x7f030c0fcf80 2024-04-12T09:10:16.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.844+0000 7f02f37fe700 1 --2- 172.21.15.117:0/4220865925 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f02f40692a0 0x7f02f406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:16.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.844+0000 7f02f37fe700 1 -- 172.21.15.117:0/4220865925 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0300087eb0 con 0x7f030c0fcf80 2024-04-12T09:10:16.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.844+0000 7f030affd700 1 --2- 172.21.15.117:0/4220865925 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f02f40692a0 0x7f02f406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:16.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.845+0000 7f030affd700 1 --2- 172.21.15.117:0/4220865925 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f02f40692a0 0x7f02f406b750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f02fc004f40 tx=0x7f02fc00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:10:16.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:16.850+0000 7f02f37fe700 1 -- 172.21.15.117:0/4220865925 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f0300057c20 con 0x7f030c0fcf80 2024-04-12T09:10:17.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.130+0000 7f0311301700 1 -- 172.21.15.117:0/4220865925 --> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f030c10e730 con 0x7f02f40692a0 2024-04-12T09:10:17.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.131+0000 7f02f37fe700 1 -- 172.21.15.117:0/4220865925 <== mgr.14214 v2:172.21.15.117:6800/3945342300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f030c10e730 con 0x7f02f40692a0 2024-04-12T09:10:17.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.134+0000 7f0311301700 1 -- 172.21.15.117:0/4220865925 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f02f40692a0 msgr2=0x7f02f406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:17.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.134+0000 7f0311301700 1 --2- 172.21.15.117:0/4220865925 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f02f40692a0 0x7f02f406b750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f02fc004f40 tx=0x7f02fc00b040 comp rx=0 tx=0).stop 2024-04-12T09:10:17.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.134+0000 7f0311301700 1 -- 172.21.15.117:0/4220865925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f030c0fcf80 msgr2=0x7f030c10ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:17.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.134+0000 7f0311301700 1 --2- 172.21.15.117:0/4220865925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f030c0fcf80 0x7f030c10ce40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f030000b3b0 tx=0x7f0300009e30 comp rx=0 tx=0).stop 2024-04-12T09:10:17.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.134+0000 7f0311301700 1 -- 172.21.15.117:0/4220865925 shutdown_connections 2024-04-12T09:10:17.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.134+0000 7f0311301700 1 --2- 172.21.15.117:0/4220865925 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f02f40692a0 0x7f02f406b750 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:17.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.134+0000 7f0311301700 1 --2- 172.21.15.117:0/4220865925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f030c0fbcd0 0x7f030c10c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:17.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.134+0000 7f0311301700 1 --2- 172.21.15.117:0/4220865925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f030c0fcf80 0x7f030c10ce40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:17.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.134+0000 7f0311301700 1 -- 172.21.15.117:0/4220865925 >> 172.21.15.117:0/4220865925 conn(0x7f030c0f7430 msgr2=0x7f030c0f8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:10:17.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.135+0000 7f0311301700 1 -- 172.21.15.117:0/4220865925 shutdown_connections 2024-04-12T09:10:17.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.135+0000 7f0311301700 1 -- 172.21.15.117:0/4220865925 wait complete. 2024-04-12T09:10:17.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.253+0000 7f5dd032a700 1 -- 172.21.15.117:0/3396162309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dc8066280 msgr2=0x7f5dc80ffa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:17.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.253+0000 7f5dd032a700 1 --2- 172.21.15.117:0/3396162309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dc8066280 0x7f5dc80ffa20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4004940 tx=0x7f5dc4009e30 comp rx=0 tx=0).stop 2024-04-12T09:10:17.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.253+0000 7f5dd032a700 1 -- 172.21.15.117:0/3396162309 shutdown_connections 2024-04-12T09:10:17.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.253+0000 7f5dd032a700 1 --2- 172.21.15.117:0/3396162309 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5dc80fff60 0x7f5dc8102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:17.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.253+0000 7f5dd032a700 1 --2- 172.21.15.117:0/3396162309 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dc8066280 0x7f5dc80ffa20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:17.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.253+0000 7f5dd032a700 1 -- 172.21.15.117:0/3396162309 >> 172.21.15.117:0/3396162309 conn(0x7f5dc80f7430 msgr2=0x7f5dc80f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:10:17.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.253+0000 7f5dd032a700 1 -- 172.21.15.117:0/3396162309 shutdown_connections 2024-04-12T09:10:17.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.254+0000 7f5dd032a700 1 -- 172.21.15.117:0/3396162309 wait complete. 2024-04-12T09:10:17.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.254+0000 7f5dd032a700 1 Processor -- start 2024-04-12T09:10:17.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.254+0000 7f5dd032a700 1 -- start start 2024-04-12T09:10:17.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.254+0000 7f5dd032a700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5dc8066280 0x7f5dc80fd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:17.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.254+0000 7f5dd032a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dc80fff60 0x7f5dc80fb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:17.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.254+0000 7f5dd032a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc80fbeb0 con 0x7f5dc80fff60 2024-04-12T09:10:17.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.254+0000 7f5dd032a700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc80fbff0 con 0x7f5dc8066280 2024-04-12T09:10:17.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.255+0000 7f5dcd8c5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dc80fff60 0x7f5dc80fb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:17.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.255+0000 7f5dcd8c5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dc80fff60 0x7f5dc80fb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47732/0 (socket says 172.21.15.117:47732) 2024-04-12T09:10:17.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.255+0000 7f5dcd8c5700 1 -- 172.21.15.117:0/1957468418 learned_addr learned my addr 172.21.15.117:0/1957468418 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:10:17.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.255+0000 7f5dce0c6700 1 --2- 172.21.15.117:0/1957468418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5dc8066280 0x7f5dc80fd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:17.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.255+0000 7f5dce0c6700 1 -- 172.21.15.117:0/1957468418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dc80fff60 msgr2=0x7f5dc80fb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:17.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.255+0000 7f5dce0c6700 1 --2- 172.21.15.117:0/1957468418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dc80fff60 0x7f5dc80fb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:17.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.255+0000 7f5dce0c6700 1 -- 172.21.15.117:0/1957468418 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc4005040 con 0x7f5dc8066280 2024-04-12T09:10:17.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.255+0000 7f5dcd8c5700 1 --2- 172.21.15.117:0/1957468418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dc80fff60 0x7f5dc80fb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T09:10:17.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.255+0000 7f5dce0c6700 1 --2- 172.21.15.117:0/1957468418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5dc8066280 0x7f5dc80fd400 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009fd0 tx=0x7f5dc4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:10:17.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.255+0000 7f5dbeffd700 1 -- 172.21.15.117:0/1957468418 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5dc4021070 con 0x7f5dc8066280 2024-04-12T09:10:17.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.255+0000 7f5dbeffd700 1 -- 172.21.15.117:0/1957468418 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5dc401c400 con 0x7f5dc8066280 2024-04-12T09:10:17.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.255+0000 7f5dd032a700 1 -- 172.21.15.117:0/1957468418 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc80fc270 con 0x7f5dc8066280 2024-04-12T09:10:17.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.255+0000 7f5dbeffd700 1 -- 172.21.15.117:0/1957468418 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5dc400e070 con 0x7f5dc8066280 2024-04-12T09:10:17.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.256+0000 7f5dd032a700 1 -- 172.21.15.117:0/1957468418 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc8115ab0 con 0x7f5dc8066280 2024-04-12T09:10:17.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.256+0000 7f5dd032a700 1 -- 172.21.15.117:0/1957468418 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc805f5f0 con 0x7f5dc8066280 2024-04-12T09:10:17.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.257+0000 7f5dbeffd700 1 -- 172.21.15.117:0/1957468418 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f5dc401ca20 con 0x7f5dc8066280 2024-04-12T09:10:17.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.258+0000 7f5dbeffd700 1 --2- 172.21.15.117:0/1957468418 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f5db40692b0 0x7f5db406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:17.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.258+0000 7f5dbeffd700 1 -- 172.21.15.117:0/1957468418 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f5dc40883f0 con 0x7f5dc8066280 2024-04-12T09:10:17.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.258+0000 7f5dcd8c5700 1 --2- 172.21.15.117:0/1957468418 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f5db40692b0 0x7f5db406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:17.260 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.258+0000 7f5dcd8c5700 1 --2- 172.21.15.117:0/1957468418 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f5db40692b0 0x7f5db406b760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5dc80fd9e0 tx=0x7f5db800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:10:17.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.263+0000 7f5dbeffd700 1 -- 172.21.15.117:0/1957468418 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7f5dc4054650 con 0x7f5dc8066280 2024-04-12T09:10:17.518 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.517+0000 7f5dd032a700 1 -- 172.21.15.117:0/1957468418 --> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5dc80f8f70 con 0x7f5db40692b0 2024-04-12T09:10:17.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.528+0000 7f5dbeffd700 1 -- 172.21.15.117:0/1957468418 <== mgr.14214 v2:172.21.15.117:6800/3945342300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f5dc80f8f70 con 0x7f5db40692b0 2024-04-12T09:10:17.530 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:10:17.530 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 running (6m) 96s ago 7m 24.7M - 0.25.0 c8568f914cd2 8fdf255143c1 2024-04-12T09:10:17.530 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (7m) 96s ago 7m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad 1e9f2c6a4491 2024-04-12T09:10:17.530 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (6m) 102s ago 6m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad e42da3f6e517 2024-04-12T09:10:17.530 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 running (5m) 96s ago 7m 83.0M - 9.4.7 954c08fa6188 80596fd1f615 2024-04-12T09:10:17.530 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (114s) 96s ago 113s 14.3M - 17.2.7-827-gd3b5060a 21de9b7369ad de062e2c10e7 2024-04-12T09:10:17.530 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 running (2m) 96s ago 2m 10.5M - 17.2.7-827-gd3b5060a 21de9b7369ad 1e82c6241a18 2024-04-12T09:10:17.530 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (111s) 102s ago 111s 13.4M - 17.2.7-827-gd3b5060a 21de9b7369ad b05228e997f7 2024-04-12T09:10:17.530 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (118s) 102s ago 118s 13.7M - 17.2.7-827-gd3b5060a 21de9b7369ad 6d7f82c072c7 2024-04-12T09:10:17.530 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:9283 running (8m) 96s ago 8m 481M - 17.2.7-827-gd3b5060a 21de9b7369ad cd0beaa7ece1 2024-04-12T09:10:17.531 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283 running (6m) 102s ago 6m 435M - 17.2.7-827-gd3b5060a 21de9b7369ad 2a913ba26232 2024-04-12T09:10:17.531 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (8m) 96s ago 8m 41.4M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad f9d5f7ac5270 2024-04-12T09:10:17.531 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (6m) 102s ago 6m 32.7M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad 17c0db49bb16 2024-04-12T09:10:17.531 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 running (7m) 96s ago 7m 15.9M - 1.5.0 0da6a335fe13 9fb7eb0eaa72 2024-04-12T09:10:17.531 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (6m) 102s ago 6m 16.8M - 1.5.0 0da6a335fe13 be0daeda3393 2024-04-12T09:10:17.531 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (5m) 96s ago 5m 45.8M 4288M 17.2.7-827-gd3b5060a 21de9b7369ad 77040a2498f3 2024-04-12T09:10:17.531 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (5m) 96s ago 5m 45.4M 4288M 17.2.7-827-gd3b5060a 21de9b7369ad 8f9dbf0274ed 2024-04-12T09:10:17.531 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (4m) 96s ago 4m 47.0M 4288M 17.2.7-827-gd3b5060a 21de9b7369ad 339c5a80d1dd 2024-04-12T09:10:17.531 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (4m) 102s ago 4m 46.5M 5312M 17.2.7-827-gd3b5060a 21de9b7369ad fb87d616bae3 2024-04-12T09:10:17.531 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (3m) 102s ago 3m 44.5M 5312M 17.2.7-827-gd3b5060a 21de9b7369ad c873826a2dea 2024-04-12T09:10:17.531 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (3m) 102s ago 3m 41.0M 5312M 17.2.7-827-gd3b5060a 21de9b7369ad 69cb7c22f002 2024-04-12T09:10:17.531 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 running (5m) 96s ago 6m 53.0M - 2.43.0 a07b618ecd1d 2799a65eed76 2024-04-12T09:10:17.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.531+0000 7f5dd032a700 1 -- 172.21.15.117:0/1957468418 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f5db40692b0 msgr2=0x7f5db406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:17.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.531+0000 7f5dd032a700 1 --2- 172.21.15.117:0/1957468418 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f5db40692b0 0x7f5db406b760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5dc80fd9e0 tx=0x7f5db800b040 comp rx=0 tx=0).stop 2024-04-12T09:10:17.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.531+0000 7f5dd032a700 1 -- 172.21.15.117:0/1957468418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5dc8066280 msgr2=0x7f5dc80fd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:17.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.531+0000 7f5dd032a700 1 --2- 172.21.15.117:0/1957468418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5dc8066280 0x7f5dc80fd400 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009fd0 tx=0x7f5dc4009e30 comp rx=0 tx=0).stop 2024-04-12T09:10:17.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.531+0000 7f5dd032a700 1 -- 172.21.15.117:0/1957468418 shutdown_connections 2024-04-12T09:10:17.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.531+0000 7f5dd032a700 1 --2- 172.21.15.117:0/1957468418 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7f5db40692b0 0x7f5db406b760 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:17.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.531+0000 7f5dd032a700 1 --2- 172.21.15.117:0/1957468418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5dc8066280 0x7f5dc80fd400 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:17.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.531+0000 7f5dd032a700 1 --2- 172.21.15.117:0/1957468418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5dc80fff60 0x7f5dc80fb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:17.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.531+0000 7f5dd032a700 1 -- 172.21.15.117:0/1957468418 >> 172.21.15.117:0/1957468418 conn(0x7f5dc80f7430 msgr2=0x7f5dc80f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:10:17.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.531+0000 7f5dd032a700 1 -- 172.21.15.117:0/1957468418 shutdown_connections 2024-04-12T09:10:17.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.531+0000 7f5dd032a700 1 -- 172.21.15.117:0/1957468418 wait complete. 2024-04-12T09:10:17.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.664+0000 7fbdf777a700 1 -- 172.21.15.117:0/3040051771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdf00fdff0 msgr2=0x7fbdf00fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:17.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.664+0000 7fbdf777a700 1 --2- 172.21.15.117:0/3040051771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdf00fdff0 0x7fbdf00fe460 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbde0004940 tx=0x7fbde0009e30 comp rx=0 tx=0).stop 2024-04-12T09:10:17.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.664+0000 7fbdf777a700 1 -- 172.21.15.117:0/3040051771 shutdown_connections 2024-04-12T09:10:17.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.664+0000 7fbdf777a700 1 --2- 172.21.15.117:0/3040051771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdf00fdff0 0x7fbdf00fe460 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:17.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.664+0000 7fbdf777a700 1 --2- 172.21.15.117:0/3040051771 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdf00fce80 0x7fbdf00fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:17.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.664+0000 7fbdf777a700 1 -- 172.21.15.117:0/3040051771 >> 172.21.15.117:0/3040051771 conn(0x7fbdf00f8540 msgr2=0x7fbdf00fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:10:17.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.664+0000 7fbdf777a700 1 -- 172.21.15.117:0/3040051771 shutdown_connections 2024-04-12T09:10:17.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.664+0000 7fbdf777a700 1 -- 172.21.15.117:0/3040051771 wait complete. 2024-04-12T09:10:17.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.665+0000 7fbdf777a700 1 Processor -- start 2024-04-12T09:10:17.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.665+0000 7fbdf777a700 1 -- start start 2024-04-12T09:10:17.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.665+0000 7fbdf777a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdf00fce80 0x7fbdf010d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:17.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.665+0000 7fbdf777a700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdf00fdff0 0x7fbdf010dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:17.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.665+0000 7fbdf777a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf010e370 con 0x7fbdf00fce80 2024-04-12T09:10:17.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.665+0000 7fbdf777a700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf010eb70 con 0x7fbdf00fdff0 2024-04-12T09:10:17.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.665+0000 7fbdf4d15700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdf00fdff0 0x7fbdf010dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:17.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.665+0000 7fbdf5516700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdf00fce80 0x7fbdf010d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:17.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.665+0000 7fbdf4d15700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdf00fdff0 0x7fbdf010dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.117:53624/0 (socket says 172.21.15.117:53624) 2024-04-12T09:10:17.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.665+0000 7fbdf4d15700 1 -- 172.21.15.117:0/724908573 learned_addr learned my addr 172.21.15.117:0/724908573 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:10:17.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.666+0000 7fbdf5516700 1 -- 172.21.15.117:0/724908573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdf00fdff0 msgr2=0x7fbdf010dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:17.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.666+0000 7fbdf5516700 1 --2- 172.21.15.117:0/724908573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdf00fdff0 0x7fbdf010dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:17.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.666+0000 7fbdf5516700 1 -- 172.21.15.117:0/724908573 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde0005040 con 0x7fbdf00fce80 2024-04-12T09:10:17.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.666+0000 7fbdf4d15700 1 --2- 172.21.15.117:0/724908573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdf00fdff0 0x7fbdf010dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T09:10:17.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.666+0000 7fbdf5516700 1 --2- 172.21.15.117:0/724908573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdf00fce80 0x7fbdf010d830 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009fd0 tx=0x7fbdec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:10:17.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.666+0000 7fbde5ffb700 1 -- 172.21.15.117:0/724908573 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdec004e90 con 0x7fbdf00fce80 2024-04-12T09:10:17.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.666+0000 7fbde5ffb700 1 -- 172.21.15.117:0/724908573 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbdec00f040 con 0x7fbdf00fce80 2024-04-12T09:10:17.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.666+0000 7fbde5ffb700 1 -- 172.21.15.117:0/724908573 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdec00ca50 con 0x7fbdf00fce80 2024-04-12T09:10:17.670 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.666+0000 7fbdf777a700 1 -- 172.21.15.117:0/724908573 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf010edf0 con 0x7fbdf00fce80 2024-04-12T09:10:17.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.666+0000 7fbdf777a700 1 -- 172.21.15.117:0/724908573 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf010f330 con 0x7fbdf00fce80 2024-04-12T09:10:17.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.669+0000 7fbde5ffb700 1 -- 172.21.15.117:0/724908573 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fbdec00cbb0 con 0x7fbdf00fce80 2024-04-12T09:10:17.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.669+0000 7fbde5ffb700 1 --2- 172.21.15.117:0/724908573 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fbddc0692a0 0x7fbddc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:17.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.669+0000 7fbde5ffb700 1 -- 172.21.15.117:0/724908573 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fbdec086b60 con 0x7fbdf00fce80 2024-04-12T09:10:17.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.669+0000 7fbdf4d15700 1 --2- 172.21.15.117:0/724908573 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fbddc0692a0 0x7fbddc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:17.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.670+0000 7fbdf777a700 1 -- 172.21.15.117:0/724908573 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf005f5f0 con 0x7fbdf00fce80 2024-04-12T09:10:17.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.670+0000 7fbdf4d15700 1 --2- 172.21.15.117:0/724908573 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fbddc0692a0 0x7fbddc06b750 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbde000b0d0 tx=0x7fbde0009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:10:17.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:17.676+0000 7fbde5ffb700 1 -- 172.21.15.117:0/724908573 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fbdec04e190 con 0x7fbdf00fce80 2024-04-12T09:10:17.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:17 smithi203 ceph-mon[36428]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:10:17.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:17 smithi117 ceph-mon[29277]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:10:18.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.072+0000 7fbdf777a700 1 -- 172.21.15.117:0/724908573 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbdf0105a80 con 0x7fbdf00fce80 2024-04-12T09:10:18.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.072+0000 7fbde5ffb700 1 -- 172.21.15.117:0/724908573 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fbdec019020 con 0x7fbdf00fce80 2024-04-12T09:10:18.074 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:10:18.074 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": { 2024-04-12T09:10:18.074 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 2 2024-04-12T09:10:18.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:10:18.075 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": { 2024-04-12T09:10:18.075 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 2 2024-04-12T09:10:18.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:10:18.075 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": { 2024-04-12T09:10:18.075 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 6 2024-04-12T09:10:18.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:10:18.075 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-04-12T09:10:18.075 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 4 2024-04-12T09:10:18.075 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:10:18.075 INFO:teuthology.orchestra.run.smithi117.stdout: "overall": { 2024-04-12T09:10:18.075 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 14 2024-04-12T09:10:18.075 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:10:18.075 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:10:18.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.075+0000 7fbdf777a700 1 -- 172.21.15.117:0/724908573 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fbddc0692a0 msgr2=0x7fbddc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:18.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.075+0000 7fbdf777a700 1 --2- 172.21.15.117:0/724908573 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fbddc0692a0 0x7fbddc06b750 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbde000b0d0 tx=0x7fbde0009e30 comp rx=0 tx=0).stop 2024-04-12T09:10:18.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.075+0000 7fbdf777a700 1 -- 172.21.15.117:0/724908573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdf00fce80 msgr2=0x7fbdf010d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:18.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.075+0000 7fbdf777a700 1 --2- 172.21.15.117:0/724908573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdf00fce80 0x7fbdf010d830 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009fd0 tx=0x7fbdec00b040 comp rx=0 tx=0).stop 2024-04-12T09:10:18.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.076+0000 7fbdf777a700 1 -- 172.21.15.117:0/724908573 shutdown_connections 2024-04-12T09:10:18.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.076+0000 7fbdf777a700 1 --2- 172.21.15.117:0/724908573 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fbddc0692a0 0x7fbddc06b750 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:18.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.076+0000 7fbdf777a700 1 --2- 172.21.15.117:0/724908573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdf00fce80 0x7fbdf010d830 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:18.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.076+0000 7fbdf777a700 1 --2- 172.21.15.117:0/724908573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdf00fdff0 0x7fbdf010dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:18.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.076+0000 7fbdf777a700 1 -- 172.21.15.117:0/724908573 >> 172.21.15.117:0/724908573 conn(0x7fbdf00f8540 msgr2=0x7fbdf00f8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:10:18.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.076+0000 7fbdf777a700 1 -- 172.21.15.117:0/724908573 shutdown_connections 2024-04-12T09:10:18.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.076+0000 7fbdf777a700 1 -- 172.21.15.117:0/724908573 wait complete. 2024-04-12T09:10:18.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.183+0000 7fe01752a700 1 -- 172.21.15.117:0/2365202177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe010066280 msgr2=0x7fe0100ffa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:18.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.183+0000 7fe01752a700 1 --2- 172.21.15.117:0/2365202177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe010066280 0x7fe0100ffa20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe00c004940 tx=0x7fe00c009e30 comp rx=0 tx=0).stop 2024-04-12T09:10:18.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.183+0000 7fe01752a700 1 -- 172.21.15.117:0/2365202177 shutdown_connections 2024-04-12T09:10:18.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.183+0000 7fe01752a700 1 --2- 172.21.15.117:0/2365202177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0100fff60 0x7fe010102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:18.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.183+0000 7fe01752a700 1 --2- 172.21.15.117:0/2365202177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe010066280 0x7fe0100ffa20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:18.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.183+0000 7fe01752a700 1 -- 172.21.15.117:0/2365202177 >> 172.21.15.117:0/2365202177 conn(0x7fe0100f7430 msgr2=0x7fe0100f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:10:18.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.183+0000 7fe01752a700 1 -- 172.21.15.117:0/2365202177 shutdown_connections 2024-04-12T09:10:18.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.183+0000 7fe01752a700 1 -- 172.21.15.117:0/2365202177 wait complete. 2024-04-12T09:10:18.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.184+0000 7fe01752a700 1 Processor -- start 2024-04-12T09:10:18.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.184+0000 7fe01752a700 1 -- start start 2024-04-12T09:10:18.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.184+0000 7fe01752a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe010066280 0x7fe01010da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:18.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.184+0000 7fe01752a700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0100fff60 0x7fe01010dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:18.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.184+0000 7fe01752a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01010e5c0 con 0x7fe010066280 2024-04-12T09:10:18.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.184+0000 7fe01752a700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01010edc0 con 0x7fe0100fff60 2024-04-12T09:10:18.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.184+0000 7fe0152c6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe010066280 0x7fe01010da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:18.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.184+0000 7fe0152c6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe010066280 0x7fe01010da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47764/0 (socket says 172.21.15.117:47764) 2024-04-12T09:10:18.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.184+0000 7fe0152c6700 1 -- 172.21.15.117:0/3740192907 learned_addr learned my addr 172.21.15.117:0/3740192907 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:10:18.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.184+0000 7fe014ac5700 1 --2- 172.21.15.117:0/3740192907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0100fff60 0x7fe01010dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:18.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.184+0000 7fe0152c6700 1 -- 172.21.15.117:0/3740192907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0100fff60 msgr2=0x7fe01010dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:18.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.184+0000 7fe0152c6700 1 --2- 172.21.15.117:0/3740192907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0100fff60 0x7fe01010dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:18.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.184+0000 7fe0152c6700 1 -- 172.21.15.117:0/3740192907 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00c005040 con 0x7fe010066280 2024-04-12T09:10:18.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.185+0000 7fe0152c6700 1 --2- 172.21.15.117:0/3740192907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe010066280 0x7fe01010da80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00b3b0 tx=0x7fe00c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:10:18.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.185+0000 7fe005ffb700 1 -- 172.21.15.117:0/3740192907 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe00c00e040 con 0x7fe010066280 2024-04-12T09:10:18.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.185+0000 7fe005ffb700 1 -- 172.21.15.117:0/3740192907 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe00c00bbf0 con 0x7fe010066280 2024-04-12T09:10:18.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.185+0000 7fe01752a700 1 -- 172.21.15.117:0/3740192907 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01010f040 con 0x7fe010066280 2024-04-12T09:10:18.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.185+0000 7fe005ffb700 1 -- 172.21.15.117:0/3740192907 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe00c01c630 con 0x7fe010066280 2024-04-12T09:10:18.189 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.185+0000 7fe01752a700 1 -- 172.21.15.117:0/3740192907 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01010f580 con 0x7fe010066280 2024-04-12T09:10:18.190 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.186+0000 7fe01752a700 1 -- 172.21.15.117:0/3740192907 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01005f5f0 con 0x7fe010066280 2024-04-12T09:10:18.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.187+0000 7fe005ffb700 1 -- 172.21.15.117:0/3740192907 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fe00c00bd60 con 0x7fe010066280 2024-04-12T09:10:18.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.187+0000 7fe005ffb700 1 --2- 172.21.15.117:0/3740192907 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fdffc0692a0 0x7fdffc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:18.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.187+0000 7fe005ffb700 1 -- 172.21.15.117:0/3740192907 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe00c087df0 con 0x7fe010066280 2024-04-12T09:10:18.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.187+0000 7fe014ac5700 1 --2- 172.21.15.117:0/3740192907 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fdffc0692a0 0x7fdffc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:18.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.188+0000 7fe014ac5700 1 --2- 172.21.15.117:0/3740192907 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fdffc0692a0 0x7fdffc06b750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe000009fd0 tx=0x7fe00000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:10:18.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.191+0000 7fe005ffb700 1 -- 172.21.15.117:0/3740192907 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176504 (secure 0 0 0) 0x7fe00c057c00 con 0x7fe010066280 2024-04-12T09:10:18.390 INFO:tasks.workunit.client.1.smithi203.stderr:+ tar xzf ltp-full.tgz 2024-04-12T09:10:18.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.472+0000 7fe01752a700 1 -- 172.21.15.117:0/3740192907 --> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe01010f920 con 0x7fdffc0692a0 2024-04-12T09:10:18.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.473+0000 7fe005ffb700 1 -- 172.21.15.117:0/3740192907 <== mgr.14214 v2:172.21.15.117:6800/3945342300 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fe01010f920 con 0x7fdffc0692a0 2024-04-12T09:10:18.475 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:10:18.475 INFO:teuthology.orchestra.run.smithi117.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec", 2024-04-12T09:10:18.475 INFO:teuthology.orchestra.run.smithi117.stdout: "in_progress": true, 2024-04-12T09:10:18.476 INFO:teuthology.orchestra.run.smithi117.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-12T09:10:18.476 INFO:teuthology.orchestra.run.smithi117.stdout: "services_complete": [], 2024-04-12T09:10:18.476 INFO:teuthology.orchestra.run.smithi117.stdout: "progress": "0/2 daemons upgraded", 2024-04-12T09:10:18.476 INFO:teuthology.orchestra.run.smithi117.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec image on host smithi203", 2024-04-12T09:10:18.476 INFO:teuthology.orchestra.run.smithi117.stdout: "is_paused": false 2024-04-12T09:10:18.476 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:10:18.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.476+0000 7fe01752a700 1 -- 172.21.15.117:0/3740192907 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fdffc0692a0 msgr2=0x7fdffc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:18.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.476+0000 7fe01752a700 1 --2- 172.21.15.117:0/3740192907 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fdffc0692a0 0x7fdffc06b750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe000009fd0 tx=0x7fe00000b040 comp rx=0 tx=0).stop 2024-04-12T09:10:18.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.477+0000 7fe01752a700 1 -- 172.21.15.117:0/3740192907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe010066280 msgr2=0x7fe01010da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:18.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.477+0000 7fe01752a700 1 --2- 172.21.15.117:0/3740192907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe010066280 0x7fe01010da80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00b3b0 tx=0x7fe00c009e30 comp rx=0 tx=0).stop 2024-04-12T09:10:18.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.477+0000 7fe01752a700 1 -- 172.21.15.117:0/3740192907 shutdown_connections 2024-04-12T09:10:18.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.477+0000 7fe01752a700 1 --2- 172.21.15.117:0/3740192907 >> [v2:172.21.15.117:6800/3945342300,v1:172.21.15.117:6801/3945342300] conn(0x7fdffc0692a0 0x7fdffc06b750 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:18.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.477+0000 7fe01752a700 1 --2- 172.21.15.117:0/3740192907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe010066280 0x7fe01010da80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:18.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.477+0000 7fe01752a700 1 --2- 172.21.15.117:0/3740192907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0100fff60 0x7fe01010dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:18.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.477+0000 7fe01752a700 1 -- 172.21.15.117:0/3740192907 >> 172.21.15.117:0/3740192907 conn(0x7fe0100f7430 msgr2=0x7fe0100f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:10:18.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.477+0000 7fe01752a700 1 -- 172.21.15.117:0/3740192907 shutdown_connections 2024-04-12T09:10:18.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:18.477+0000 7fe01752a700 1 -- 172.21.15.117:0/3740192907 wait complete. 2024-04-12T09:10:18.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:18 smithi203 ceph-mon[36428]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:10:18.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:18 smithi203 ceph-mon[36428]: pgmap v237: 65 pgs: 65 active+clean; 25 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s wr, 228 op/s 2024-04-12T09:10:18.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:18 smithi203 ceph-mon[36428]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:10:18.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:18 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/724908573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:10:18.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:18 smithi117 ceph-mon[29277]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:10:18.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:18 smithi117 ceph-mon[29277]: pgmap v237: 65 pgs: 65 active+clean; 25 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s wr, 228 op/s 2024-04-12T09:10:18.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:18 smithi117 ceph-mon[29277]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:10:18.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:18 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/724908573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:10:19.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:19 smithi203 ceph-mon[36428]: from='client.14584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:10:19.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:19 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:10:19.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:19 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi203.apfqpo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T09:10:19.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:19 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T09:10:19.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:19 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:10:19.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:19 smithi117 ceph-mon[29277]: from='client.14584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:10:19.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:19 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:10:19.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:19 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi203.apfqpo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T09:10:19.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:19 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T09:10:19.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:19 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:10:20.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:20 smithi117 ceph-mon[29277]: pgmap v238: 65 pgs: 65 active+clean; 45 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.9 MiB/s wr, 301 op/s 2024-04-12T09:10:20.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:20 smithi117 ceph-mon[29277]: Upgrade: Updating mgr.smithi203.apfqpo 2024-04-12T09:10:20.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:20 smithi117 ceph-mon[29277]: Deploying daemon mgr.smithi203.apfqpo on smithi203 2024-04-12T09:10:20.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:20 smithi203 ceph-mon[36428]: pgmap v238: 65 pgs: 65 active+clean; 45 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.9 MiB/s wr, 301 op/s 2024-04-12T09:10:20.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:20 smithi203 ceph-mon[36428]: Upgrade: Updating mgr.smithi203.apfqpo 2024-04-12T09:10:20.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:20 smithi203 ceph-mon[36428]: Deploying daemon mgr.smithi203.apfqpo on smithi203 2024-04-12T09:10:22.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:22 smithi203 ceph-mon[36428]: pgmap v239: 65 pgs: 65 active+clean; 53 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s wr, 316 op/s 2024-04-12T09:10:22.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:22 smithi117 ceph-mon[29277]: pgmap v239: 65 pgs: 65 active+clean; 53 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s wr, 316 op/s 2024-04-12T09:10:24.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:24 smithi203 ceph-mon[36428]: pgmap v240: 65 pgs: 65 active+clean; 57 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.7 MiB/s wr, 338 op/s 2024-04-12T09:10:24.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:24 smithi117 ceph-mon[29277]: pgmap v240: 65 pgs: 65 active+clean; 57 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.7 MiB/s wr, 338 op/s 2024-04-12T09:10:26.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:26 smithi203 ceph-mon[36428]: pgmap v241: 65 pgs: 65 active+clean; 74 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 5.0 MiB/s wr, 459 op/s 2024-04-12T09:10:26.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:26 smithi117 ceph-mon[29277]: pgmap v241: 65 pgs: 65 active+clean; 74 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 5.0 MiB/s wr, 459 op/s 2024-04-12T09:10:28.804 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:28 smithi203 ceph-mon[36428]: pgmap v242: 65 pgs: 65 active+clean; 74 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.4 MiB/s wr, 363 op/s 2024-04-12T09:10:28.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:28 smithi117 ceph-mon[29277]: pgmap v242: 65 pgs: 65 active+clean; 74 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.4 MiB/s wr, 363 op/s 2024-04-12T09:10:30.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:30 smithi117 ceph-mon[29277]: pgmap v243: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.7 MiB/s wr, 457 op/s 2024-04-12T09:10:30.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:30 smithi203 ceph-mon[36428]: pgmap v243: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.7 MiB/s wr, 457 op/s 2024-04-12T09:10:31.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:31 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:10:31.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:31 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:10:32.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:32 smithi203 ceph-mon[36428]: pgmap v244: 65 pgs: 65 active+clean; 89 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.9 MiB/s wr, 444 op/s 2024-04-12T09:10:32.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:32 smithi117 ceph-mon[29277]: pgmap v244: 65 pgs: 65 active+clean; 89 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.9 MiB/s wr, 444 op/s 2024-04-12T09:10:34.905 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:34 smithi203 ceph-mon[36428]: pgmap v245: 65 pgs: 65 active+clean; 92 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.5 MiB/s wr, 444 op/s 2024-04-12T09:10:34.905 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:34 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:10:34.905 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:34 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:10:34.905 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:34 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:10:34.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:34 smithi117 ceph-mon[29277]: pgmap v245: 65 pgs: 65 active+clean; 92 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.5 MiB/s wr, 444 op/s 2024-04-12T09:10:34.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:34 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:10:34.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:34 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:10:34.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:34 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:10:36.745 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:36 smithi203 ceph-mon[36428]: pgmap v246: 65 pgs: 65 active+clean; 115 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.1 MiB/s wr, 535 op/s 2024-04-12T09:10:36.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:36 smithi117 ceph-mon[29277]: pgmap v246: 65 pgs: 65 active+clean; 115 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.1 MiB/s wr, 535 op/s 2024-04-12T09:10:38.839 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:38 smithi203 ceph-mon[36428]: pgmap v247: 65 pgs: 65 active+clean; 116 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s wr, 389 op/s 2024-04-12T09:10:38.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:38 smithi117 ceph-mon[29277]: pgmap v247: 65 pgs: 65 active+clean; 116 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s wr, 389 op/s 2024-04-12T09:10:40.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:40 smithi117 ceph-mon[29277]: pgmap v248: 65 pgs: 65 active+clean; 124 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.4 MiB/s wr, 476 op/s 2024-04-12T09:10:40.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:40 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:10:40.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:40 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:10:40.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:40 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:10:40.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:40 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:10:40.781 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:40 smithi203 ceph-mon[36428]: pgmap v248: 65 pgs: 65 active+clean; 124 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.4 MiB/s wr, 476 op/s 2024-04-12T09:10:40.781 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:40 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:10:40.781 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:40 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:10:40.781 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:40 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:10:40.781 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:40 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:10:41.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:41 smithi203 ceph-mon[36428]: Standby manager daemon smithi203.apfqpo restarted 2024-04-12T09:10:41.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:41 smithi203 ceph-mon[36428]: Standby manager daemon smithi203.apfqpo started 2024-04-12T09:10:41.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:41 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.apfqpo/crt"}]: dispatch 2024-04-12T09:10:41.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:41 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T09:10:41.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:41 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.apfqpo/key"}]: dispatch 2024-04-12T09:10:41.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:41 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T09:10:41.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:41 smithi117 ceph-mon[29277]: Standby manager daemon smithi203.apfqpo restarted 2024-04-12T09:10:41.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:41 smithi117 ceph-mon[29277]: Standby manager daemon smithi203.apfqpo started 2024-04-12T09:10:41.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:41 smithi117 ceph-mon[29277]: from='mgr.? 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.apfqpo/crt"}]: dispatch 2024-04-12T09:10:41.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:41 smithi117 ceph-mon[29277]: from='mgr.? 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T09:10:41.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:41 smithi117 ceph-mon[29277]: from='mgr.? 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.apfqpo/key"}]: dispatch 2024-04-12T09:10:41.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:41 smithi117 ceph-mon[29277]: from='mgr.? 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T09:10:42.685 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:42 smithi203 ceph-mon[36428]: pgmap v249: 65 pgs: 65 active+clean; 130 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.5 MiB/s wr, 417 op/s 2024-04-12T09:10:42.685 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:42 smithi203 ceph-mon[36428]: mgrmap e20: smithi117.oyaxql(active, since 7m), standbys: smithi203.apfqpo 2024-04-12T09:10:42.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:42 smithi117 ceph-mon[29277]: pgmap v249: 65 pgs: 65 active+clean; 130 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.5 MiB/s wr, 417 op/s 2024-04-12T09:10:42.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:42 smithi117 ceph-mon[29277]: mgrmap e20: smithi117.oyaxql(active, since 7m), standbys: smithi203.apfqpo 2024-04-12T09:10:44.755 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:44 smithi203 ceph-mon[36428]: pgmap v250: 65 pgs: 65 active+clean; 132 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s wr, 399 op/s 2024-04-12T09:10:44.784 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:44 smithi117 ceph-mon[29277]: pgmap v250: 65 pgs: 65 active+clean; 132 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s wr, 399 op/s 2024-04-12T09:10:45.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:10:45.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:10:45.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:10:45.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:10:45.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:10:45.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:10:45.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr fail", "who": "smithi117.oyaxql"}]: dispatch 2024-04-12T09:10:45.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-04-12T09:10:45.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:10:45.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.eslmxh"}]: dispatch 2024-04-12T09:10:45.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.wddsgt"}]: dispatch 2024-04-12T09:10:45.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.fbeixl"}]: dispatch 2024-04-12T09:10:45.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.bszhxz"}]: dispatch 2024-04-12T09:10:45.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mgr metadata", "who": "smithi203.apfqpo", "id": "smithi203.apfqpo"}]: dispatch 2024-04-12T09:10:45.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T09:10:45.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T09:10:45.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T09:10:45.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T09:10:45.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T09:10:45.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T09:10:45.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-12T09:10:45.913 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-12T09:10:45.913 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-12T09:10:45.913 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: osdmap e47: 6 total, 6 up, 6 in 2024-04-12T09:10:45.913 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "mgr fail", "who": "smithi117.oyaxql"}]': finished 2024-04-12T09:10:45.913 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: mgrmap e21: smithi203.apfqpo(active, starting, since 0.0121369s) 2024-04-12T09:10:45.913 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: Manager daemon smithi203.apfqpo is now available 2024-04-12T09:10:45.913 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:10:45.913 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:10:45.913 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi203.apfqpo/mirror_snapshot_schedule"}]: dispatch 2024-04-12T09:10:45.913 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi203.apfqpo/mirror_snapshot_schedule"}]: dispatch 2024-04-12T09:10:45.913 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi203.apfqpo/trash_purge_schedule"}]: dispatch 2024-04-12T09:10:45.913 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi203.apfqpo/trash_purge_schedule"}]: dispatch 2024-04-12T09:10:45.913 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: Deploying cephadm binary to smithi203 2024-04-12T09:10:45.913 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: Deploying cephadm binary to smithi117 2024-04-12T09:10:45.914 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:10:45.914 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:45 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:10:46.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:10:46.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:10:46.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:10:46.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:10:46.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' 2024-04-12T09:10:46.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:10:46.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr fail", "who": "smithi117.oyaxql"}]: dispatch 2024-04-12T09:10:46.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-04-12T09:10:46.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:10:46.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.eslmxh"}]: dispatch 2024-04-12T09:10:46.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.wddsgt"}]: dispatch 2024-04-12T09:10:46.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.fbeixl"}]: dispatch 2024-04-12T09:10:46.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.bszhxz"}]: dispatch 2024-04-12T09:10:46.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mgr metadata", "who": "smithi203.apfqpo", "id": "smithi203.apfqpo"}]: dispatch 2024-04-12T09:10:46.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T09:10:46.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T09:10:46.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T09:10:46.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T09:10:46.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T09:10:46.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T09:10:46.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-12T09:10:46.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-12T09:10:46.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-12T09:10:46.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: osdmap e47: 6 total, 6 up, 6 in 2024-04-12T09:10:46.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.14214 172.21.15.117:0/3872884799' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "mgr fail", "who": "smithi117.oyaxql"}]': finished 2024-04-12T09:10:46.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: mgrmap e21: smithi203.apfqpo(active, starting, since 0.0121369s) 2024-04-12T09:10:46.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: Manager daemon smithi203.apfqpo is now available 2024-04-12T09:10:46.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:10:46.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:10:46.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi203.apfqpo/mirror_snapshot_schedule"}]: dispatch 2024-04-12T09:10:46.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi203.apfqpo/mirror_snapshot_schedule"}]: dispatch 2024-04-12T09:10:46.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi203.apfqpo/trash_purge_schedule"}]: dispatch 2024-04-12T09:10:46.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi203.apfqpo/trash_purge_schedule"}]: dispatch 2024-04-12T09:10:46.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: Deploying cephadm binary to smithi203 2024-04-12T09:10:46.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: Deploying cephadm binary to smithi117 2024-04-12T09:10:46.077 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:10:46.077 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:45 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:10:46.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:46 smithi117 ceph-mon[29277]: mgrmap e22: smithi203.apfqpo(active, since 1.00953s) 2024-04-12T09:10:46.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:46 smithi117 ceph-mon[29277]: pgmap v3: 65 pgs: 65 active+clean; 153 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:10:46.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:46 smithi117 ceph-mon[29277]: [12/Apr/2024:09:10:46] ENGINE Bus STARTING 2024-04-12T09:10:47.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:46 smithi203 ceph-mon[36428]: mgrmap e22: smithi203.apfqpo(active, since 1.00953s) 2024-04-12T09:10:47.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:46 smithi203 ceph-mon[36428]: pgmap v3: 65 pgs: 65 active+clean; 153 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:10:47.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:46 smithi203 ceph-mon[36428]: [12/Apr/2024:09:10:46] ENGINE Bus STARTING 2024-04-12T09:10:47.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:47 smithi117 ceph-mon[29277]: [12/Apr/2024:09:10:46] ENGINE Serving on https://172.21.15.203:7150 2024-04-12T09:10:47.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:47 smithi117 ceph-mon[29277]: [12/Apr/2024:09:10:46] ENGINE Serving on http://172.21.15.203:8765 2024-04-12T09:10:47.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:47 smithi117 ceph-mon[29277]: [12/Apr/2024:09:10:46] ENGINE Bus STARTED 2024-04-12T09:10:47.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:47 smithi117 ceph-mon[29277]: pgmap v4: 65 pgs: 65 active+clean; 153 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:10:48.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:47 smithi203 ceph-mon[36428]: [12/Apr/2024:09:10:46] ENGINE Serving on https://172.21.15.203:7150 2024-04-12T09:10:48.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:47 smithi203 ceph-mon[36428]: [12/Apr/2024:09:10:46] ENGINE Serving on http://172.21.15.203:8765 2024-04-12T09:10:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:47 smithi203 ceph-mon[36428]: [12/Apr/2024:09:10:46] ENGINE Bus STARTED 2024-04-12T09:10:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:47 smithi203 ceph-mon[36428]: pgmap v4: 65 pgs: 65 active+clean; 153 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:10:48.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.638+0000 7f01de421700 1 -- 172.21.15.117:0/1121433459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01d80fbcd0 msgr2=0x7f01d80fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:48.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.638+0000 7f01de421700 1 --2- 172.21.15.117:0/1121433459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01d80fbcd0 0x7f01d80fc0e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f01c8004940 tx=0x7f01c8009e30 comp rx=0 tx=0).stop 2024-04-12T09:10:48.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.638+0000 7f01de421700 1 -- 172.21.15.117:0/1121433459 shutdown_connections 2024-04-12T09:10:48.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.638+0000 7f01de421700 1 --2- 172.21.15.117:0/1121433459 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01d80fcf80 0x7f01d80fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:48.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.638+0000 7f01de421700 1 --2- 172.21.15.117:0/1121433459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01d80fbcd0 0x7f01d80fc0e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:48.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.638+0000 7f01de421700 1 -- 172.21.15.117:0/1121433459 >> 172.21.15.117:0/1121433459 conn(0x7f01d80f7430 msgr2=0x7f01d80f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:10:48.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.639+0000 7f01de421700 1 -- 172.21.15.117:0/1121433459 shutdown_connections 2024-04-12T09:10:48.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.639+0000 7f01de421700 1 -- 172.21.15.117:0/1121433459 wait complete. 2024-04-12T09:10:48.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.639+0000 7f01de421700 1 Processor -- start 2024-04-12T09:10:48.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.640+0000 7f01de421700 1 -- start start 2024-04-12T09:10:48.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.640+0000 7f01de421700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01d80fbcd0 0x7f01d8113fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:48.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.640+0000 7f01de421700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01d80fcf80 0x7f01d8114520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:48.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.640+0000 7f01de421700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d8114b20 con 0x7f01d80fbcd0 2024-04-12T09:10:48.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.640+0000 7f01de421700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d8115320 con 0x7f01d80fcf80 2024-04-12T09:10:48.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.640+0000 7f01d7fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01d80fbcd0 0x7f01d8113fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:48.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.640+0000 7f01d77fe700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01d80fcf80 0x7f01d8114520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:48.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.640+0000 7f01d7fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01d80fbcd0 0x7f01d8113fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:36740/0 (socket says 172.21.15.117:36740) 2024-04-12T09:10:48.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.640+0000 7f01d7fff700 1 -- 172.21.15.117:0/3953881654 learned_addr learned my addr 172.21.15.117:0/3953881654 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:10:48.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.640+0000 7f01d77fe700 1 -- 172.21.15.117:0/3953881654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01d80fbcd0 msgr2=0x7f01d8113fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:48.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.640+0000 7f01d77fe700 1 --2- 172.21.15.117:0/3953881654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01d80fbcd0 0x7f01d8113fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:48.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.640+0000 7f01d77fe700 1 -- 172.21.15.117:0/3953881654 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c8005040 con 0x7f01d80fcf80 2024-04-12T09:10:48.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.641+0000 7f01d77fe700 1 --2- 172.21.15.117:0/3953881654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01d80fcf80 0x7f01d8114520 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009fd0 tx=0x7f01cc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:10:48.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.641+0000 7f01d4ff9700 1 -- 172.21.15.117:0/3953881654 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01cc004e90 con 0x7f01d80fcf80 2024-04-12T09:10:48.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.641+0000 7f01d4ff9700 1 -- 172.21.15.117:0/3953881654 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f01cc00f040 con 0x7f01d80fcf80 2024-04-12T09:10:48.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.641+0000 7f01d4ff9700 1 -- 172.21.15.117:0/3953881654 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01cc00ca50 con 0x7f01d80fcf80 2024-04-12T09:10:48.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.641+0000 7f01de421700 1 -- 172.21.15.117:0/3953881654 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d81155a0 con 0x7f01d80fcf80 2024-04-12T09:10:48.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.641+0000 7f01de421700 1 -- 172.21.15.117:0/3953881654 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d8115ae0 con 0x7f01d80fcf80 2024-04-12T09:10:48.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.642+0000 7f01d4ff9700 1 -- 172.21.15.117:0/3953881654 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 23) v1 ==== 46061+0+0 (secure 0 0 0) 0x7f01cc00cbb0 con 0x7f01d80fcf80 2024-04-12T09:10:48.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.642+0000 7f01d4ff9700 1 --2- 172.21.15.117:0/3953881654 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f01c0038c90 0x7f01c003b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:48.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.642+0000 7f01de421700 1 -- 172.21.15.117:0/3953881654 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d8101910 con 0x7f01d80fcf80 2024-04-12T09:10:48.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.642+0000 7f01d4ff9700 1 -- 172.21.15.117:0/3953881654 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f01cc04d270 con 0x7f01d80fcf80 2024-04-12T09:10:48.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.643+0000 7f01d7fff700 1 --2- 172.21.15.117:0/3953881654 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f01c0038c90 0x7f01c003b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:48.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.643+0000 7f01d7fff700 1 --2- 172.21.15.117:0/3953881654 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f01c0038c90 0x7f01c003b140 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009b30 tx=0x7f01c8009e30 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:10:48.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.648+0000 7f01d4ff9700 1 -- 172.21.15.117:0/3953881654 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f01cc019020 con 0x7f01d80fcf80 2024-04-12T09:10:48.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:48 smithi117 ceph-mon[29277]: mgrmap e23: smithi203.apfqpo(active, since 3s) 2024-04-12T09:10:48.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:48.994+0000 7f01de421700 1 -- 172.21.15.117:0/3953881654 --> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f01d8115d50 con 0x7f01c0038c90 2024-04-12T09:10:49.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.005+0000 7f01d4ff9700 1 -- 172.21.15.117:0/3953881654 <== mgr.24371 v2:172.21.15.203:6828/2773660052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f01d8115d50 con 0x7f01c0038c90 2024-04-12T09:10:49.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.007+0000 7f01de421700 1 -- 172.21.15.117:0/3953881654 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f01c0038c90 msgr2=0x7f01c003b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:49.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.007+0000 7f01de421700 1 --2- 172.21.15.117:0/3953881654 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f01c0038c90 0x7f01c003b140 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009b30 tx=0x7f01c8009e30 comp rx=0 tx=0).stop 2024-04-12T09:10:49.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.007+0000 7f01de421700 1 -- 172.21.15.117:0/3953881654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01d80fcf80 msgr2=0x7f01d8114520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:49.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.007+0000 7f01de421700 1 --2- 172.21.15.117:0/3953881654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01d80fcf80 0x7f01d8114520 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009fd0 tx=0x7f01cc00b040 comp rx=0 tx=0).stop 2024-04-12T09:10:49.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.007+0000 7f01de421700 1 -- 172.21.15.117:0/3953881654 shutdown_connections 2024-04-12T09:10:49.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.007+0000 7f01de421700 1 --2- 172.21.15.117:0/3953881654 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f01c0038c90 0x7f01c003b140 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:49.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.007+0000 7f01de421700 1 --2- 172.21.15.117:0/3953881654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f01d80fbcd0 0x7f01d8113fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:49.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.007+0000 7f01de421700 1 --2- 172.21.15.117:0/3953881654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01d80fcf80 0x7f01d8114520 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:49.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.007+0000 7f01de421700 1 -- 172.21.15.117:0/3953881654 >> 172.21.15.117:0/3953881654 conn(0x7f01d80f7430 msgr2=0x7f01d8065b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:10:49.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.008+0000 7f01de421700 1 -- 172.21.15.117:0/3953881654 shutdown_connections 2024-04-12T09:10:49.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.008+0000 7f01de421700 1 -- 172.21.15.117:0/3953881654 wait complete. 2024-04-12T09:10:49.022 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:10:49.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:48 smithi203 ceph-mon[36428]: mgrmap e23: smithi203.apfqpo(active, since 3s) 2024-04-12T09:10:49.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.150+0000 7f55e3b96700 1 -- 172.21.15.117:0/2890028446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55dc0fbc60 msgr2=0x7f55dc0fc070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:49.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.150+0000 7f55e3b96700 1 --2- 172.21.15.117:0/2890028446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55dc0fbc60 0x7f55dc0fc070 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f55d8004940 tx=0x7f55d8009e30 comp rx=0 tx=0).stop 2024-04-12T09:10:49.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.150+0000 7f55e3b96700 1 -- 172.21.15.117:0/2890028446 shutdown_connections 2024-04-12T09:10:49.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.150+0000 7f55e3b96700 1 --2- 172.21.15.117:0/2890028446 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f55dc0fcf10 0x7f55dc0fd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:49.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.150+0000 7f55e3b96700 1 --2- 172.21.15.117:0/2890028446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55dc0fbc60 0x7f55dc0fc070 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:49.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.150+0000 7f55e3b96700 1 -- 172.21.15.117:0/2890028446 >> 172.21.15.117:0/2890028446 conn(0x7f55dc0f73e0 msgr2=0x7f55dc0f97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:10:49.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.150+0000 7f55e3b96700 1 -- 172.21.15.117:0/2890028446 shutdown_connections 2024-04-12T09:10:49.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.150+0000 7f55e3b96700 1 -- 172.21.15.117:0/2890028446 wait complete. 2024-04-12T09:10:49.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.151+0000 7f55e3b96700 1 Processor -- start 2024-04-12T09:10:49.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.151+0000 7f55e3b96700 1 -- start start 2024-04-12T09:10:49.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.151+0000 7f55e3b96700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f55dc0fbc60 0x7f55dc1105b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:49.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.151+0000 7f55e3b96700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55dc0fcf10 0x7f55dc112b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:49.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.151+0000 7f55e3b96700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc066e80 con 0x7f55dc0fcf10 2024-04-12T09:10:49.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.151+0000 7f55e3b96700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc066fc0 con 0x7f55dc0fbc60 2024-04-12T09:10:49.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.151+0000 7f55e1131700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55dc0fcf10 0x7f55dc112b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:49.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.151+0000 7f55e1932700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f55dc0fbc60 0x7f55dc1105b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:49.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.151+0000 7f55e1131700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55dc0fcf10 0x7f55dc112b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:36746/0 (socket says 172.21.15.117:36746) 2024-04-12T09:10:49.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.151+0000 7f55e1131700 1 -- 172.21.15.117:0/3299797541 learned_addr learned my addr 172.21.15.117:0/3299797541 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:10:49.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.152+0000 7f55e1131700 1 -- 172.21.15.117:0/3299797541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f55dc0fbc60 msgr2=0x7f55dc1105b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:49.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.152+0000 7f55e1131700 1 --2- 172.21.15.117:0/3299797541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f55dc0fbc60 0x7f55dc1105b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:49.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.152+0000 7f55e1131700 1 -- 172.21.15.117:0/3299797541 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d8005040 con 0x7f55dc0fcf10 2024-04-12T09:10:49.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.152+0000 7f55e1131700 1 --2- 172.21.15.117:0/3299797541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55dc0fcf10 0x7f55dc112b00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f55cc00eb40 tx=0x7f55cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:10:49.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.153+0000 7f55d27fc700 1 -- 172.21.15.117:0/3299797541 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55cc007cc0 con 0x7f55dc0fcf10 2024-04-12T09:10:49.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.153+0000 7f55d27fc700 1 -- 172.21.15.117:0/3299797541 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f55cc00f040 con 0x7f55dc0fcf10 2024-04-12T09:10:49.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.153+0000 7f55e3b96700 1 -- 172.21.15.117:0/3299797541 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55dc1130a0 con 0x7f55dc0fcf10 2024-04-12T09:10:49.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.153+0000 7f55e3b96700 1 -- 172.21.15.117:0/3299797541 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55dc1135e0 con 0x7f55dc0fcf10 2024-04-12T09:10:49.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.154+0000 7f55d27fc700 1 -- 172.21.15.117:0/3299797541 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55cc00ca10 con 0x7f55dc0fcf10 2024-04-12T09:10:49.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.154+0000 7f55d27fc700 1 -- 172.21.15.117:0/3299797541 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 23) v1 ==== 46061+0+0 (secure 0 0 0) 0x7f55cc00cc80 con 0x7f55dc0fcf10 2024-04-12T09:10:49.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.155+0000 7f55d27fc700 1 --2- 172.21.15.117:0/3299797541 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f55c8038c90 0x7f55c803b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:49.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.155+0000 7f55d27fc700 1 -- 172.21.15.117:0/3299797541 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f55cc04c480 con 0x7f55dc0fcf10 2024-04-12T09:10:49.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.155+0000 7f55e1932700 1 --2- 172.21.15.117:0/3299797541 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f55c8038c90 0x7f55c803b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:49.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.155+0000 7f55e3b96700 1 -- 172.21.15.117:0/3299797541 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55dc0fb060 con 0x7f55dc0fcf10 2024-04-12T09:10:49.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.156+0000 7f55e1932700 1 --2- 172.21.15.117:0/3299797541 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f55c8038c90 0x7f55c803b140 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f55d8013870 tx=0x7f55d8009e30 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:10:49.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.165+0000 7f55d27fc700 1 -- 172.21.15.117:0/3299797541 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f55cc01b6d0 con 0x7f55dc0fcf10 2024-04-12T09:10:49.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.533+0000 7f55e3b96700 1 -- 172.21.15.117:0/3299797541 --> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f55dc1011b0 con 0x7f55c8038c90 2024-04-12T09:10:49.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.540+0000 7f55d27fc700 1 -- 172.21.15.117:0/3299797541 <== mgr.24371 v2:172.21.15.203:6828/2773660052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f55dc1011b0 con 0x7f55c8038c90 2024-04-12T09:10:49.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.543+0000 7f55e3b96700 1 -- 172.21.15.117:0/3299797541 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f55c8038c90 msgr2=0x7f55c803b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:49.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.543+0000 7f55e3b96700 1 --2- 172.21.15.117:0/3299797541 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f55c8038c90 0x7f55c803b140 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f55d8013870 tx=0x7f55d8009e30 comp rx=0 tx=0).stop 2024-04-12T09:10:49.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.543+0000 7f55e3b96700 1 -- 172.21.15.117:0/3299797541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55dc0fcf10 msgr2=0x7f55dc112b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:49.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.543+0000 7f55e3b96700 1 --2- 172.21.15.117:0/3299797541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55dc0fcf10 0x7f55dc112b00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f55cc00eb40 tx=0x7f55cc00b040 comp rx=0 tx=0).stop 2024-04-12T09:10:49.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.544+0000 7f55e3b96700 1 -- 172.21.15.117:0/3299797541 shutdown_connections 2024-04-12T09:10:49.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.544+0000 7f55e3b96700 1 --2- 172.21.15.117:0/3299797541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f55dc0fbc60 0x7f55dc1105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:49.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.544+0000 7f55e3b96700 1 --2- 172.21.15.117:0/3299797541 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f55c8038c90 0x7f55c803b140 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:49.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.544+0000 7f55e3b96700 1 --2- 172.21.15.117:0/3299797541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f55dc0fcf10 0x7f55dc112b00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:49.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.544+0000 7f55e3b96700 1 -- 172.21.15.117:0/3299797541 >> 172.21.15.117:0/3299797541 conn(0x7f55dc0f73e0 msgr2=0x7f55dc0f8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:10:49.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.544+0000 7f55e3b96700 1 -- 172.21.15.117:0/3299797541 shutdown_connections 2024-04-12T09:10:49.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.544+0000 7f55e3b96700 1 -- 172.21.15.117:0/3299797541 wait complete. 2024-04-12T09:10:49.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.694+0000 7fc999496700 1 -- 172.21.15.117:0/3088697480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc994104fc0 msgr2=0x7fc9941073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:49.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.694+0000 7fc999496700 1 --2- 172.21.15.117:0/3088697480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc994104fc0 0x7fc9941073a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc984004940 tx=0x7fc984009e30 comp rx=0 tx=0).stop 2024-04-12T09:10:49.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.694+0000 7fc999496700 1 -- 172.21.15.117:0/3088697480 shutdown_connections 2024-04-12T09:10:49.695 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.694+0000 7fc999496700 1 --2- 172.21.15.117:0/3088697480 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc9941078e0 0x7fc994109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:49.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.694+0000 7fc999496700 1 --2- 172.21.15.117:0/3088697480 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc994104fc0 0x7fc9941073a0 secure :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc984004940 tx=0x7fc984009e30 comp rx=0 tx=0).stop 2024-04-12T09:10:49.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.694+0000 7fc999496700 1 -- 172.21.15.117:0/3088697480 >> 172.21.15.117:0/3088697480 conn(0x7fc994069de0 msgr2=0x7fc99406c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:10:49.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.694+0000 7fc999496700 1 -- 172.21.15.117:0/3088697480 shutdown_connections 2024-04-12T09:10:49.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.694+0000 7fc999496700 1 -- 172.21.15.117:0/3088697480 wait complete. 2024-04-12T09:10:49.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.695+0000 7fc999496700 1 Processor -- start 2024-04-12T09:10:49.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.695+0000 7fc999496700 1 -- start start 2024-04-12T09:10:49.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.696+0000 7fc999496700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc9941078e0 0x7fc994116260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:49.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.696+0000 7fc999496700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9941167a0 0x7fc99411b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:49.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.696+0000 7fc999496700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc994116c60 con 0x7fc9941167a0 2024-04-12T09:10:49.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.696+0000 7fc999496700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc994116da0 con 0x7fc9941078e0 2024-04-12T09:10:49.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.696+0000 7fc9927fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9941167a0 0x7fc99411b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:49.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.696+0000 7fc9927fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9941167a0 0x7fc99411b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38306/0 (socket says 172.21.15.117:38306) 2024-04-12T09:10:49.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.696+0000 7fc9927fc700 1 -- 172.21.15.117:0/2682529084 learned_addr learned my addr 172.21.15.117:0/2682529084 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:10:49.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.696+0000 7fc992ffd700 1 --2- 172.21.15.117:0/2682529084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc9941078e0 0x7fc994116260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:49.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.696+0000 7fc992ffd700 1 -- 172.21.15.117:0/2682529084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9941167a0 msgr2=0x7fc99411b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:49.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.696+0000 7fc992ffd700 1 --2- 172.21.15.117:0/2682529084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9941167a0 0x7fc99411b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:49.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.696+0000 7fc992ffd700 1 -- 172.21.15.117:0/2682529084 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc984005040 con 0x7fc9941078e0 2024-04-12T09:10:49.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.697+0000 7fc992ffd700 1 --2- 172.21.15.117:0/2682529084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc9941078e0 0x7fc994116260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc984008000 tx=0x7fc984009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:10:49.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.697+0000 7fc97b7fe700 1 -- 172.21.15.117:0/2682529084 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc984020070 con 0x7fc9941078e0 2024-04-12T09:10:49.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.697+0000 7fc97b7fe700 1 -- 172.21.15.117:0/2682529084 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc984013de0 con 0x7fc9941078e0 2024-04-12T09:10:49.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.697+0000 7fc999496700 1 -- 172.21.15.117:0/2682529084 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99411bd10 con 0x7fc9941078e0 2024-04-12T09:10:49.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.697+0000 7fc97b7fe700 1 -- 172.21.15.117:0/2682529084 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc98400e070 con 0x7fc9941078e0 2024-04-12T09:10:49.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.697+0000 7fc999496700 1 -- 172.21.15.117:0/2682529084 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99411c170 con 0x7fc9941078e0 2024-04-12T09:10:49.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.698+0000 7fc97b7fe700 1 -- 172.21.15.117:0/2682529084 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 23) v1 ==== 46061+0+0 (secure 0 0 0) 0x7fc98401cc70 con 0x7fc9941078e0 2024-04-12T09:10:49.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.698+0000 7fc999496700 1 -- 172.21.15.117:0/2682529084 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc99410fb60 con 0x7fc9941078e0 2024-04-12T09:10:49.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.698+0000 7fc97b7fe700 1 --2- 172.21.15.117:0/2682529084 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fc97c038c90 0x7fc97c03b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:49.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.698+0000 7fc97b7fe700 1 -- 172.21.15.117:0/2682529084 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc98401c500 con 0x7fc9941078e0 2024-04-12T09:10:49.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.698+0000 7fc9927fc700 1 --2- 172.21.15.117:0/2682529084 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fc97c038c90 0x7fc97c03b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:49.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.699+0000 7fc9927fc700 1 --2- 172.21.15.117:0/2682529084 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fc97c038c90 0x7fc97c03b140 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc988009b80 tx=0x7fc98800b040 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:10:49.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.704+0000 7fc97b7fe700 1 -- 172.21.15.117:0/2682529084 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7fc98400b410 con 0x7fc9941078e0 2024-04-12T09:10:49.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.762+0000 7fc97b7fe700 1 -- 172.21.15.117:0/2682529084 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mgrmap(e 24) v1 ==== 46117+0+0 (secure 0 0 0) 0x7fc98402bd40 con 0x7fc9941078e0 2024-04-12T09:10:49.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.975+0000 7fc999496700 1 -- 172.21.15.117:0/2682529084 --> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc99402b460 con 0x7fc97c038c90 2024-04-12T09:10:49.976 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:49 smithi117 ceph-mon[29277]: pgmap v5: 65 pgs: 65 active+clean; 153 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:10:49.976 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:49 smithi117 ceph-mon[29277]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:10:49.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.996+0000 7fc97b7fe700 1 -- 172.21.15.117:0/2682529084 <== mgr.24371 v2:172.21.15.203:6828/2773660052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fc99402b460 con 0x7fc97c038c90 2024-04-12T09:10:49.997 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:10:49.997 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 running (6m) 2m ago 7m 24.7M - 0.25.0 c8568f914cd2 8fdf255143c1 2024-04-12T09:10:49.997 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (8m) 2m ago 8m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad 1e9f2c6a4491 2024-04-12T09:10:49.997 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (7m) 10s ago 7m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad e42da3f6e517 2024-04-12T09:10:49.997 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 running (6m) 2m ago 7m 83.0M - 9.4.7 954c08fa6188 80596fd1f615 2024-04-12T09:10:49.997 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (2m) 2m ago 2m 14.3M - 17.2.7-827-gd3b5060a 21de9b7369ad de062e2c10e7 2024-04-12T09:10:49.997 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 running (2m) 2m ago 2m 10.5M - 17.2.7-827-gd3b5060a 21de9b7369ad 1e82c6241a18 2024-04-12T09:10:49.997 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (2m) 10s ago 2m 14.1M - 17.2.7-827-gd3b5060a 21de9b7369ad b05228e997f7 2024-04-12T09:10:49.997 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (2m) 10s ago 2m 14.4M - 17.2.7-827-gd3b5060a 21de9b7369ad 6d7f82c072c7 2024-04-12T09:10:49.997 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:9283 running (9m) 2m ago 9m 481M - 17.2.7-827-gd3b5060a 21de9b7369ad cd0beaa7ece1 2024-04-12T09:10:49.997 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283 running (20s) 10s ago 6m 96.2M - 19.0.0-2053-gb277feb2 668895944f0e bce98e99ffe8 2024-04-12T09:10:49.997 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (9m) 2m ago 9m 41.4M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad f9d5f7ac5270 2024-04-12T09:10:49.998 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (6m) 10s ago 6m 34.0M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad 17c0db49bb16 2024-04-12T09:10:49.998 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 running (8m) 2m ago 8m 15.9M - 1.5.0 0da6a335fe13 9fb7eb0eaa72 2024-04-12T09:10:49.998 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (7m) 10s ago 7m 16.7M - 1.5.0 0da6a335fe13 be0daeda3393 2024-04-12T09:10:49.998 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (6m) 2m ago 6m 45.8M 4288M 17.2.7-827-gd3b5060a 21de9b7369ad 77040a2498f3 2024-04-12T09:10:49.998 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (5m) 2m ago 5m 45.4M 4288M 17.2.7-827-gd3b5060a 21de9b7369ad 8f9dbf0274ed 2024-04-12T09:10:49.998 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (5m) 2m ago 5m 47.0M 4288M 17.2.7-827-gd3b5060a 21de9b7369ad 339c5a80d1dd 2024-04-12T09:10:49.998 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (4m) 10s ago 4m 102M 5312M 17.2.7-827-gd3b5060a 21de9b7369ad fb87d616bae3 2024-04-12T09:10:49.998 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (4m) 10s ago 4m 94.5M 5312M 17.2.7-827-gd3b5060a 21de9b7369ad c873826a2dea 2024-04-12T09:10:49.998 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (4m) 10s ago 4m 87.9M 5312M 17.2.7-827-gd3b5060a 21de9b7369ad 69cb7c22f002 2024-04-12T09:10:49.998 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 running (6m) 2m ago 7m 53.0M - 2.43.0 a07b618ecd1d 2799a65eed76 2024-04-12T09:10:50.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.999+0000 7fc999496700 1 -- 172.21.15.117:0/2682529084 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fc97c038c90 msgr2=0x7fc97c03b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:50.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.999+0000 7fc999496700 1 --2- 172.21.15.117:0/2682529084 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fc97c038c90 0x7fc97c03b140 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc988009b80 tx=0x7fc98800b040 comp rx=0 tx=0).stop 2024-04-12T09:10:50.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.999+0000 7fc999496700 1 -- 172.21.15.117:0/2682529084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc9941078e0 msgr2=0x7fc994116260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:50.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.999+0000 7fc999496700 1 --2- 172.21.15.117:0/2682529084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc9941078e0 0x7fc994116260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc984008000 tx=0x7fc984009e30 comp rx=0 tx=0).stop 2024-04-12T09:10:50.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.999+0000 7fc999496700 1 -- 172.21.15.117:0/2682529084 shutdown_connections 2024-04-12T09:10:50.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.999+0000 7fc999496700 1 --2- 172.21.15.117:0/2682529084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc9941078e0 0x7fc994116260 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:50.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.999+0000 7fc999496700 1 --2- 172.21.15.117:0/2682529084 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fc97c038c90 0x7fc97c03b140 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc988009b80 tx=0x7fc98800b040 comp rx=0 tx=0).stop 2024-04-12T09:10:50.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.999+0000 7fc999496700 1 --2- 172.21.15.117:0/2682529084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9941167a0 0x7fc99411b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:50.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.999+0000 7fc999496700 1 -- 172.21.15.117:0/2682529084 >> 172.21.15.117:0/2682529084 conn(0x7fc994069de0 msgr2=0x7fc99406c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:10:50.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.999+0000 7fc999496700 1 -- 172.21.15.117:0/2682529084 shutdown_connections 2024-04-12T09:10:50.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:49.999+0000 7fc999496700 1 -- 172.21.15.117:0/2682529084 wait complete. 2024-04-12T09:10:50.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:49 smithi203 ceph-mon[36428]: pgmap v5: 65 pgs: 65 active+clean; 153 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:10:50.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:49 smithi203 ceph-mon[36428]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:10:50.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.163+0000 7fc2d02eb700 1 -- 172.21.15.117:0/3376579270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2c80fdd20 msgr2=0x7fc2c8104670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:50.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.163+0000 7fc2d02eb700 1 --2- 172.21.15.117:0/3376579270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2c80fdd20 0x7fc2c8104670 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8004880 tx=0x7fc2b8009e30 comp rx=0 tx=0).stop 2024-04-12T09:10:50.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.163+0000 7fc2d02eb700 1 -- 172.21.15.117:0/3376579270 shutdown_connections 2024-04-12T09:10:50.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.163+0000 7fc2d02eb700 1 --2- 172.21.15.117:0/3376579270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2c80fdd20 0x7fc2c8104670 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:50.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.163+0000 7fc2d02eb700 1 --2- 172.21.15.117:0/3376579270 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2c80fd3d0 0x7fc2c80fd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:50.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.163+0000 7fc2d02eb700 1 -- 172.21.15.117:0/3376579270 >> 172.21.15.117:0/3376579270 conn(0x7fc2c80f6ba0 msgr2=0x7fc2c80f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:10:50.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.163+0000 7fc2d02eb700 1 -- 172.21.15.117:0/3376579270 shutdown_connections 2024-04-12T09:10:50.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.163+0000 7fc2d02eb700 1 -- 172.21.15.117:0/3376579270 wait complete. 2024-04-12T09:10:50.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.164+0000 7fc2d02eb700 1 Processor -- start 2024-04-12T09:10:50.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.164+0000 7fc2d02eb700 1 -- start start 2024-04-12T09:10:50.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.164+0000 7fc2d02eb700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2c80fd3d0 0x7fc2c810f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:50.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.164+0000 7fc2d02eb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2c80fdd20 0x7fc2c810ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:50.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.164+0000 7fc2d02eb700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c8110500 con 0x7fc2c80fdd20 2024-04-12T09:10:50.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.165+0000 7fc2ce087700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2c80fd3d0 0x7fc2c810f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:50.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.165+0000 7fc2d02eb700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c8110d50 con 0x7fc2c80fd3d0 2024-04-12T09:10:50.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.165+0000 7fc2cd886700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2c80fdd20 0x7fc2c810ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:50.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.165+0000 7fc2cd886700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2c80fdd20 0x7fc2c810ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38332/0 (socket says 172.21.15.117:38332) 2024-04-12T09:10:50.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.165+0000 7fc2cd886700 1 -- 172.21.15.117:0/403495401 learned_addr learned my addr 172.21.15.117:0/403495401 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:10:50.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.165+0000 7fc2cd886700 1 -- 172.21.15.117:0/403495401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2c80fd3d0 msgr2=0x7fc2c810f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:50.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.165+0000 7fc2cd886700 1 --2- 172.21.15.117:0/403495401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2c80fd3d0 0x7fc2c810f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:50.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.165+0000 7fc2cd886700 1 -- 172.21.15.117:0/403495401 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b8005040 con 0x7fc2c80fdd20 2024-04-12T09:10:50.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.166+0000 7fc2cd886700 1 --2- 172.21.15.117:0/403495401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2c80fdd20 0x7fc2c810ff00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8009380 tx=0x7fc2b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:10:50.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.166+0000 7fc2beffd700 1 -- 172.21.15.117:0/403495401 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2b800e040 con 0x7fc2c80fdd20 2024-04-12T09:10:50.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.166+0000 7fc2beffd700 1 -- 172.21.15.117:0/403495401 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc2b801caa0 con 0x7fc2c80fdd20 2024-04-12T09:10:50.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.166+0000 7fc2d02eb700 1 -- 172.21.15.117:0/403495401 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c8110fd0 con 0x7fc2c80fdd20 2024-04-12T09:10:50.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.166+0000 7fc2beffd700 1 -- 172.21.15.117:0/403495401 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2b8012b10 con 0x7fc2c80fdd20 2024-04-12T09:10:50.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.166+0000 7fc2d02eb700 1 -- 172.21.15.117:0/403495401 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c8111450 con 0x7fc2c80fdd20 2024-04-12T09:10:50.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.168+0000 7fc2beffd700 1 -- 172.21.15.117:0/403495401 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 24) v1 ==== 46117+0+0 (secure 0 0 0) 0x7fc2b8012c70 con 0x7fc2c80fdd20 2024-04-12T09:10:50.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.168+0000 7fc2d02eb700 1 -- 172.21.15.117:0/403495401 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c805f5f0 con 0x7fc2c80fdd20 2024-04-12T09:10:50.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.168+0000 7fc2beffd700 1 --2- 172.21.15.117:0/403495401 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fc2b4038cc0 0x7fc2b403b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:50.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.168+0000 7fc2beffd700 1 -- 172.21.15.117:0/403495401 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc2b804e890 con 0x7fc2c80fdd20 2024-04-12T09:10:50.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.168+0000 7fc2ce087700 1 --2- 172.21.15.117:0/403495401 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fc2b4038cc0 0x7fc2b403b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:50.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.169+0000 7fc2ce087700 1 --2- 172.21.15.117:0/403495401 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fc2b4038cc0 0x7fc2b403b170 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4009b80 tx=0x7fc2c400b040 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:10:50.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.174+0000 7fc2beffd700 1 -- 172.21.15.117:0/403495401 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7fc2b802c2f0 con 0x7fc2c80fdd20 2024-04-12T09:10:50.658 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.657+0000 7fc2d02eb700 1 -- 172.21.15.117:0/403495401 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc2c804bed0 con 0x7fc2c80fdd20 2024-04-12T09:10:50.659 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.658+0000 7fc2beffd700 1 -- 172.21.15.117:0/403495401 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fc2b802ce60 con 0x7fc2c80fdd20 2024-04-12T09:10:50.659 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:10:50.659 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": { 2024-04-12T09:10:50.659 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 2 2024-04-12T09:10:50.659 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:10:50.659 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": { 2024-04-12T09:10:50.659 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 1 2024-04-12T09:10:50.659 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:10:50.659 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": { 2024-04-12T09:10:50.660 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 6 2024-04-12T09:10:50.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:10:50.660 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-04-12T09:10:50.660 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 4 2024-04-12T09:10:50.660 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:10:50.660 INFO:teuthology.orchestra.run.smithi117.stdout: "overall": { 2024-04-12T09:10:50.660 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 12, 2024-04-12T09:10:50.660 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 1 2024-04-12T09:10:50.660 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:10:50.660 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:10:50.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.661+0000 7fc2d02eb700 1 -- 172.21.15.117:0/403495401 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fc2b4038cc0 msgr2=0x7fc2b403b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:50.662 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.661+0000 7fc2d02eb700 1 --2- 172.21.15.117:0/403495401 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fc2b4038cc0 0x7fc2b403b170 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4009b80 tx=0x7fc2c400b040 comp rx=0 tx=0).stop 2024-04-12T09:10:50.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.661+0000 7fc2d02eb700 1 -- 172.21.15.117:0/403495401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2c80fdd20 msgr2=0x7fc2c810ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:50.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.661+0000 7fc2d02eb700 1 --2- 172.21.15.117:0/403495401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2c80fdd20 0x7fc2c810ff00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8009380 tx=0x7fc2b8009e30 comp rx=0 tx=0).stop 2024-04-12T09:10:50.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.661+0000 7fc2d02eb700 1 -- 172.21.15.117:0/403495401 shutdown_connections 2024-04-12T09:10:50.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.661+0000 7fc2d02eb700 1 --2- 172.21.15.117:0/403495401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2c80fd3d0 0x7fc2c810f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:50.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.661+0000 7fc2d02eb700 1 --2- 172.21.15.117:0/403495401 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fc2b4038cc0 0x7fc2b403b170 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:50.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.661+0000 7fc2d02eb700 1 --2- 172.21.15.117:0/403495401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2c80fdd20 0x7fc2c810ff00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:50.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.661+0000 7fc2d02eb700 1 -- 172.21.15.117:0/403495401 >> 172.21.15.117:0/403495401 conn(0x7fc2c80f6ba0 msgr2=0x7fc2c80f6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:10:50.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.662+0000 7fc2d02eb700 1 -- 172.21.15.117:0/403495401 shutdown_connections 2024-04-12T09:10:50.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.662+0000 7fc2d02eb700 1 -- 172.21.15.117:0/403495401 wait complete. 2024-04-12T09:10:50.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.802+0000 7f6c59e8a700 1 -- 172.21.15.117:0/1686625498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c540fdff0 msgr2=0x7f6c540fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:50.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.802+0000 7f6c59e8a700 1 --2- 172.21.15.117:0/1686625498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c540fdff0 0x7f6c540fe460 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6c48004940 tx=0x7f6c48009e30 comp rx=0 tx=0).stop 2024-04-12T09:10:50.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.803+0000 7f6c59e8a700 1 -- 172.21.15.117:0/1686625498 shutdown_connections 2024-04-12T09:10:50.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.803+0000 7f6c59e8a700 1 --2- 172.21.15.117:0/1686625498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c540fdff0 0x7f6c540fe460 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:50.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.803+0000 7f6c59e8a700 1 --2- 172.21.15.117:0/1686625498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c540fce80 0x7f6c540fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:50.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.803+0000 7f6c59e8a700 1 -- 172.21.15.117:0/1686625498 >> 172.21.15.117:0/1686625498 conn(0x7f6c540f8560 msgr2=0x7f6c540fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:10:50.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.803+0000 7f6c59e8a700 1 -- 172.21.15.117:0/1686625498 shutdown_connections 2024-04-12T09:10:50.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.803+0000 7f6c59e8a700 1 -- 172.21.15.117:0/1686625498 wait complete. 2024-04-12T09:10:50.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.803+0000 7f6c59e8a700 1 Processor -- start 2024-04-12T09:10:50.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.804+0000 7f6c59e8a700 1 -- start start 2024-04-12T09:10:50.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.804+0000 7f6c59e8a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c540fce80 0x7f6c5410fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:50.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.804+0000 7f6c59e8a700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c540fdff0 0x7f6c54110160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:50.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.804+0000 7f6c59e8a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54110760 con 0x7f6c540fce80 2024-04-12T09:10:50.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.804+0000 7f6c59e8a700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54110fb0 con 0x7f6c540fdff0 2024-04-12T09:10:50.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.804+0000 7f6c537fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c540fce80 0x7f6c5410fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:50.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.804+0000 7f6c537fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c540fce80 0x7f6c5410fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38362/0 (socket says 172.21.15.117:38362) 2024-04-12T09:10:50.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.804+0000 7f6c537fe700 1 -- 172.21.15.117:0/1179851394 learned_addr learned my addr 172.21.15.117:0/1179851394 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:10:50.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.804+0000 7f6c52ffd700 1 --2- 172.21.15.117:0/1179851394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c540fdff0 0x7f6c54110160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:50.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.804+0000 7f6c52ffd700 1 -- 172.21.15.117:0/1179851394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c540fce80 msgr2=0x7f6c5410fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:50.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.804+0000 7f6c52ffd700 1 --2- 172.21.15.117:0/1179851394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c540fce80 0x7f6c5410fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:50.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.804+0000 7f6c52ffd700 1 -- 172.21.15.117:0/1179851394 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c48005040 con 0x7f6c540fdff0 2024-04-12T09:10:50.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.804+0000 7f6c52ffd700 1 --2- 172.21.15.117:0/1179851394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c540fdff0 0x7f6c54110160 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800b3b0 tx=0x7f6c48009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:10:50.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.805+0000 7f6c3bfff700 1 -- 172.21.15.117:0/1179851394 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c4800e040 con 0x7f6c540fdff0 2024-04-12T09:10:50.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.805+0000 7f6c3bfff700 1 -- 172.21.15.117:0/1179851394 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c4800bbf0 con 0x7f6c540fdff0 2024-04-12T09:10:50.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.805+0000 7f6c59e8a700 1 -- 172.21.15.117:0/1179851394 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c54111230 con 0x7f6c540fdff0 2024-04-12T09:10:50.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.805+0000 7f6c3bfff700 1 -- 172.21.15.117:0/1179851394 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c48013660 con 0x7f6c540fdff0 2024-04-12T09:10:50.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.805+0000 7f6c59e8a700 1 -- 172.21.15.117:0/1179851394 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c54111770 con 0x7f6c540fdff0 2024-04-12T09:10:50.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.806+0000 7f6c3bfff700 1 -- 172.21.15.117:0/1179851394 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 24) v1 ==== 46117+0+0 (secure 0 0 0) 0x7f6c48013920 con 0x7f6c540fdff0 2024-04-12T09:10:50.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.806+0000 7f6c59e8a700 1 -- 172.21.15.117:0/1179851394 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c54101980 con 0x7f6c540fdff0 2024-04-12T09:10:50.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.806+0000 7f6c3bfff700 1 --2- 172.21.15.117:0/1179851394 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f6c3c038cc0 0x7f6c3c03b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:10:50.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.806+0000 7f6c3bfff700 1 -- 172.21.15.117:0/1179851394 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f6c4804dc00 con 0x7f6c540fdff0 2024-04-12T09:10:50.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.806+0000 7f6c537fe700 1 --2- 172.21.15.117:0/1179851394 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f6c3c038cc0 0x7f6c3c03b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:10:50.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.807+0000 7f6c537fe700 1 --2- 172.21.15.117:0/1179851394 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f6c3c038cc0 0x7f6c3c03b170 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6c440041d0 tx=0x7f6c4400b040 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:10:50.811 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:50.811+0000 7f6c3bfff700 1 -- 172.21.15.117:0/1179851394 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f6c48027440 con 0x7f6c540fdff0 2024-04-12T09:10:51.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:50 smithi203 ceph-mon[36428]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:10:51.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:50 smithi203 ceph-mon[36428]: mgrmap e24: smithi203.apfqpo(active, since 5s) 2024-04-12T09:10:51.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:50 smithi203 ceph-mon[36428]: from='client.24411 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:10:51.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:50 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/403495401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:10:51.130 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:50 smithi117 ceph-mon[29277]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:10:51.130 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:50 smithi117 ceph-mon[29277]: mgrmap e24: smithi203.apfqpo(active, since 5s) 2024-04-12T09:10:51.130 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:50 smithi117 ceph-mon[29277]: from='client.24411 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:10:51.130 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:50 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/403495401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:10:51.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:51.180+0000 7f6c59e8a700 1 -- 172.21.15.117:0/1179851394 --> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c54111930 con 0x7f6c3c038cc0 2024-04-12T09:10:51.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:51.182+0000 7f6c3bfff700 1 -- 172.21.15.117:0/1179851394 <== mgr.24371 v2:172.21.15.203:6828/2773660052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f6c54111930 con 0x7f6c3c038cc0 2024-04-12T09:10:51.183 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:10:51.183 INFO:teuthology.orchestra.run.smithi117.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec", 2024-04-12T09:10:51.183 INFO:teuthology.orchestra.run.smithi117.stdout: "in_progress": true, 2024-04-12T09:10:51.183 INFO:teuthology.orchestra.run.smithi117.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-12T09:10:51.183 INFO:teuthology.orchestra.run.smithi117.stdout: "services_complete": [], 2024-04-12T09:10:51.183 INFO:teuthology.orchestra.run.smithi117.stdout: "progress": "1/2 daemons upgraded", 2024-04-12T09:10:51.183 INFO:teuthology.orchestra.run.smithi117.stdout: "message": "", 2024-04-12T09:10:51.183 INFO:teuthology.orchestra.run.smithi117.stdout: "is_paused": false 2024-04-12T09:10:51.183 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:10:51.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:51.185+0000 7f6c59e8a700 1 -- 172.21.15.117:0/1179851394 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f6c3c038cc0 msgr2=0x7f6c3c03b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:51.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:51.185+0000 7f6c59e8a700 1 --2- 172.21.15.117:0/1179851394 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f6c3c038cc0 0x7f6c3c03b170 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6c440041d0 tx=0x7f6c4400b040 comp rx=0 tx=0).stop 2024-04-12T09:10:51.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:51.185+0000 7f6c59e8a700 1 -- 172.21.15.117:0/1179851394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c540fdff0 msgr2=0x7f6c54110160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:10:51.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:51.185+0000 7f6c59e8a700 1 --2- 172.21.15.117:0/1179851394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c540fdff0 0x7f6c54110160 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800b3b0 tx=0x7f6c48009e30 comp rx=0 tx=0).stop 2024-04-12T09:10:51.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:51.186+0000 7f6c59e8a700 1 -- 172.21.15.117:0/1179851394 shutdown_connections 2024-04-12T09:10:51.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:51.186+0000 7f6c59e8a700 1 --2- 172.21.15.117:0/1179851394 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f6c3c038cc0 0x7f6c3c03b170 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:51.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:51.186+0000 7f6c59e8a700 1 --2- 172.21.15.117:0/1179851394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c540fce80 0x7f6c5410fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:51.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:51.186+0000 7f6c59e8a700 1 --2- 172.21.15.117:0/1179851394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c540fdff0 0x7f6c54110160 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:10:51.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:51.186+0000 7f6c59e8a700 1 -- 172.21.15.117:0/1179851394 >> 172.21.15.117:0/1179851394 conn(0x7f6c540f8560 msgr2=0x7f6c540f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:10:51.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:51.186+0000 7f6c59e8a700 1 -- 172.21.15.117:0/1179851394 shutdown_connections 2024-04-12T09:10:51.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:10:51.186+0000 7f6c59e8a700 1 -- 172.21.15.117:0/1179851394 wait complete. 2024-04-12T09:10:51.378 INFO:tasks.workunit.client.0.smithi117.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-12T09:10:51.385 INFO:tasks.workunit.client.0.smithi117.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-12T09:10:51.385 INFO:tasks.workunit.client.0.smithi117.stderr:+ make 2024-04-12T09:10:51.920 INFO:tasks.workunit.client.0.smithi117.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-12T09:10:52.026 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:51 smithi203 ceph-mon[36428]: pgmap v6: 65 pgs: 65 active+clean; 158 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1002 KiB/s wr, 75 op/s 2024-04-12T09:10:52.026 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:51 smithi203 ceph-mon[36428]: from='client.24419 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:10:52.068 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:51 smithi117 ceph-mon[29277]: pgmap v6: 65 pgs: 65 active+clean; 158 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1002 KiB/s wr, 75 op/s 2024-04-12T09:10:52.069 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:51 smithi117 ceph-mon[29277]: from='client.24419 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:10:52.836 INFO:tasks.workunit.client.0.smithi117.stderr:++ readlink -f fsstress 2024-04-12T09:10:52.839 INFO:tasks.workunit.client.0.smithi117.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-12T09:10:52.839 INFO:tasks.workunit.client.0.smithi117.stderr:+ popd 2024-04-12T09:10:52.840 INFO:tasks.workunit.client.0.smithi117.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-12T09:10:52.840 INFO:tasks.workunit.client.0.smithi117.stderr:+ popd 2024-04-12T09:10:52.841 INFO:tasks.workunit.client.0.smithi117.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-12T09:10:52.841 INFO:tasks.workunit.client.0.smithi117.stderr:++ mktemp -d -p . 2024-04-12T09:10:52.845 INFO:tasks.workunit.client.0.smithi117.stderr:+ T=./tmp.ImjvkznEsQ 2024-04-12T09:10:52.845 INFO:tasks.workunit.client.0.smithi117.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.ImjvkznEsQ -l 1 -n 1000 -p 10 -v 2024-04-12T09:10:52.853 INFO:tasks.workunit.client.0.smithi117.stdout:seed = 1712717185 2024-04-12T09:10:52.864 INFO:tasks.workunit.client.0.smithi117.stdout:1/0: truncate - no filename 2024-04-12T09:10:52.864 INFO:tasks.workunit.client.0.smithi117.stdout:1/1: stat - no entries 2024-04-12T09:10:52.864 INFO:tasks.workunit.client.0.smithi117.stdout:1/2: chown . 21853 1 2024-04-12T09:10:52.867 INFO:tasks.workunit.client.0.smithi117.stdout:2/0: chown . 1865034 1 2024-04-12T09:10:52.869 INFO:tasks.workunit.client.0.smithi117.stdout:0/0: getdents . 0 2024-04-12T09:10:52.869 INFO:tasks.workunit.client.0.smithi117.stdout:0/1: rename - no filename 2024-04-12T09:10:52.869 INFO:tasks.workunit.client.0.smithi117.stdout:0/2: dwrite - no filename 2024-04-12T09:10:52.869 INFO:tasks.workunit.client.0.smithi117.stdout:0/3: rename - no filename 2024-04-12T09:10:52.869 INFO:tasks.workunit.client.0.smithi117.stdout:0/4: write - no filename 2024-04-12T09:10:52.874 INFO:tasks.workunit.client.0.smithi117.stdout:1/3: creat f0 x:0 0 0 2024-04-12T09:10:52.878 INFO:tasks.workunit.client.0.smithi117.stdout:4/0: chown . 57434 1 2024-04-12T09:10:52.878 INFO:tasks.workunit.client.0.smithi117.stdout:4/1: dread - no filename 2024-04-12T09:10:52.878 INFO:tasks.workunit.client.0.smithi117.stdout:4/2: unlink - no file 2024-04-12T09:10:52.878 INFO:tasks.workunit.client.0.smithi117.stdout:4/3: dwrite - no filename 2024-04-12T09:10:52.879 INFO:tasks.workunit.client.0.smithi117.stdout:2/1: mkdir d0 0 2024-04-12T09:10:52.881 INFO:tasks.workunit.client.0.smithi117.stdout:1/4: mkdir d1 0 2024-04-12T09:10:52.883 INFO:tasks.workunit.client.0.smithi117.stdout:0/5: creat f0 x:0 0 0 2024-04-12T09:10:52.885 INFO:tasks.workunit.client.0.smithi117.stdout:5/0: rename - no filename 2024-04-12T09:10:52.885 INFO:tasks.workunit.client.0.smithi117.stdout:5/1: dwrite - no filename 2024-04-12T09:10:52.889 INFO:tasks.workunit.client.0.smithi117.stdout:0/6: symlink l1 0 2024-04-12T09:10:52.891 INFO:tasks.workunit.client.0.smithi117.stdout:6/0: write - no filename 2024-04-12T09:10:52.892 INFO:tasks.workunit.client.0.smithi117.stdout:6/1: dread - no filename 2024-04-12T09:10:52.892 INFO:tasks.workunit.client.0.smithi117.stdout:6/2: dread - no filename 2024-04-12T09:10:52.892 INFO:tasks.workunit.client.0.smithi117.stdout:6/3: chown . 2 1 2024-04-12T09:10:52.892 INFO:tasks.workunit.client.0.smithi117.stdout:4/4: mkdir d0 0 2024-04-12T09:10:52.896 INFO:tasks.workunit.client.0.smithi117.stdout:2/2: mkdir d0/d1 0 2024-04-12T09:10:52.898 INFO:tasks.workunit.client.0.smithi117.stdout:0/7: rename l1 to l2 0 2024-04-12T09:10:52.898 INFO:tasks.workunit.client.0.smithi117.stdout:0/8: rmdir - no directory 2024-04-12T09:10:52.898 INFO:tasks.workunit.client.0.smithi117.stdout:0/9: fdatasync f0 0 2024-04-12T09:10:52.900 INFO:tasks.workunit.client.0.smithi117.stdout:7/0: dwrite - no filename 2024-04-12T09:10:52.904 INFO:tasks.workunit.client.0.smithi117.stdout:5/2: creat f0 x:0 0 0 2024-04-12T09:10:52.906 INFO:tasks.workunit.client.0.smithi117.stdout:0/10: mkdir d3 0 2024-04-12T09:10:52.908 INFO:tasks.workunit.client.0.smithi117.stdout:9/0: write - no filename 2024-04-12T09:10:52.908 INFO:tasks.workunit.client.0.smithi117.stdout:9/1: dread - no filename 2024-04-12T09:10:52.908 INFO:tasks.workunit.client.0.smithi117.stdout:9/2: rmdir - no directory 2024-04-12T09:10:52.908 INFO:tasks.workunit.client.0.smithi117.stdout:9/3: dread - no filename 2024-04-12T09:10:52.909 INFO:tasks.workunit.client.0.smithi117.stdout:9/4: read - no filename 2024-04-12T09:10:52.909 INFO:tasks.workunit.client.0.smithi117.stdout:6/4: mknod c0 0 2024-04-12T09:10:52.909 INFO:tasks.workunit.client.0.smithi117.stdout:6/5: fsync - no filename 2024-04-12T09:10:52.910 INFO:tasks.workunit.client.0.smithi117.stdout:6/6: chown c0 200806 1 2024-04-12T09:10:52.910 INFO:tasks.workunit.client.0.smithi117.stdout:6/7: truncate - no filename 2024-04-12T09:10:52.913 INFO:tasks.workunit.client.0.smithi117.stdout:4/5: mkdir d0/d1 0 2024-04-12T09:10:52.914 INFO:tasks.workunit.client.0.smithi117.stdout:5/3: creat f1 x:0 0 0 2024-04-12T09:10:52.918 INFO:tasks.workunit.client.0.smithi117.stdout:8/0: dwrite - no filename 2024-04-12T09:10:52.920 INFO:tasks.workunit.client.0.smithi117.stdout:7/1: mkdir d0 0 2024-04-12T09:10:52.920 INFO:tasks.workunit.client.0.smithi117.stdout:7/2: dread - no filename 2024-04-12T09:10:52.921 INFO:tasks.workunit.client.0.smithi117.stdout:7/3: fdatasync - no filename 2024-04-12T09:10:52.921 INFO:tasks.workunit.client.0.smithi117.stdout:7/4: chown d0 58531 1 2024-04-12T09:10:52.921 INFO:tasks.workunit.client.0.smithi117.stdout:7/5: dread - no filename 2024-04-12T09:10:52.922 INFO:tasks.workunit.client.0.smithi117.stdout:6/8: rename c0 to c1 0 2024-04-12T09:10:52.923 INFO:tasks.workunit.client.0.smithi117.stdout:5/4: dwrite f0 [0,4194304] 0 2024-04-12T09:10:52.924 INFO:tasks.workunit.client.0.smithi117.stdout:0/11: symlink d3/l4 0 2024-04-12T09:10:52.925 INFO:tasks.workunit.client.0.smithi117.stdout:5/5: write f1 [89681,73761] 0 2024-04-12T09:10:52.926 INFO:tasks.workunit.client.0.smithi117.stdout:0/12: truncate f0 374663 0 2024-04-12T09:10:52.926 INFO:tasks.workunit.client.0.smithi117.stdout:5/6: write f1 [790679,79494] 0 2024-04-12T09:10:52.926 INFO:tasks.workunit.client.0.smithi117.stdout:9/5: creat f0 x:0 0 0 2024-04-12T09:10:52.927 INFO:tasks.workunit.client.0.smithi117.stdout:9/6: chown f0 6973 1 2024-04-12T09:10:52.933 INFO:tasks.workunit.client.0.smithi117.stdout:6/9: creat f2 x:0 0 0 2024-04-12T09:10:52.933 INFO:tasks.workunit.client.0.smithi117.stdout:4/6: mkdir d0/d1/d2 0 2024-04-12T09:10:52.933 INFO:tasks.workunit.client.0.smithi117.stdout:4/7: read - no filename 2024-04-12T09:10:52.933 INFO:tasks.workunit.client.0.smithi117.stdout:4/8: write - no filename 2024-04-12T09:10:52.934 INFO:tasks.workunit.client.0.smithi117.stdout:6/10: write f2 [706238,105013] 0 2024-04-12T09:10:52.936 INFO:tasks.workunit.client.0.smithi117.stdout:5/7: mkdir d2 0 2024-04-12T09:10:52.937 INFO:tasks.workunit.client.0.smithi117.stdout:8/1: mkdir d0 0 2024-04-12T09:10:52.937 INFO:tasks.workunit.client.0.smithi117.stdout:8/2: write - no filename 2024-04-12T09:10:52.938 INFO:tasks.workunit.client.0.smithi117.stdout:8/3: rename d0 to d0/d1 22 2024-04-12T09:10:52.939 INFO:tasks.workunit.client.0.smithi117.stdout:0/13: creat d3/f5 x:0 0 0 2024-04-12T09:10:52.941 INFO:tasks.workunit.client.0.smithi117.stdout:9/7: mkdir d1 0 2024-04-12T09:10:52.941 INFO:tasks.workunit.client.0.smithi117.stdout:9/8: dread - f0 zero size 2024-04-12T09:10:52.942 INFO:tasks.workunit.client.0.smithi117.stdout:9/9: chown f0 5553 1 2024-04-12T09:10:52.943 INFO:tasks.workunit.client.0.smithi117.stdout:7/6: creat d0/f1 x:0 0 0 2024-04-12T09:10:52.944 INFO:tasks.workunit.client.0.smithi117.stdout:6/11: creat f3 x:0 0 0 2024-04-12T09:10:52.949 INFO:tasks.workunit.client.0.smithi117.stdout:0/14: creat d3/f6 x:0 0 0 2024-04-12T09:10:52.953 INFO:tasks.workunit.client.0.smithi117.stdout:6/12: dwrite f3 [0,4194304] 0 2024-04-12T09:10:52.953 INFO:tasks.workunit.client.0.smithi117.stdout:7/7: mkdir d0/d2 0 2024-04-12T09:10:52.962 INFO:tasks.workunit.client.0.smithi117.stdout:6/13: dwrite f3 [0,4194304] 0 2024-04-12T09:10:52.963 INFO:tasks.workunit.client.0.smithi117.stdout:6/14: read f3 [2803992,5986] 0 2024-04-12T09:10:52.970 INFO:tasks.workunit.client.0.smithi117.stdout:8/4: rmdir d0 0 2024-04-12T09:10:52.970 INFO:tasks.workunit.client.0.smithi117.stdout:8/5: read - no filename 2024-04-12T09:10:52.970 INFO:tasks.workunit.client.0.smithi117.stdout:8/6: rmdir - no directory 2024-04-12T09:10:52.970 INFO:tasks.workunit.client.0.smithi117.stdout:8/7: read - no filename 2024-04-12T09:10:52.971 INFO:tasks.workunit.client.0.smithi117.stdout:8/8: rename - no filename 2024-04-12T09:10:52.971 INFO:tasks.workunit.client.0.smithi117.stdout:8/9: dwrite - no filename 2024-04-12T09:10:52.971 INFO:tasks.workunit.client.0.smithi117.stdout:8/10: chown . 3066438 1 2024-04-12T09:10:52.971 INFO:tasks.workunit.client.0.smithi117.stdout:8/11: unlink - no file 2024-04-12T09:10:52.971 INFO:tasks.workunit.client.0.smithi117.stdout:8/12: dwrite - no filename 2024-04-12T09:10:52.972 INFO:tasks.workunit.client.0.smithi117.stdout:0/15: link d3/f5 d3/f7 0 2024-04-12T09:10:52.975 INFO:tasks.workunit.client.0.smithi117.stdout:6/15: mknod c4 0 2024-04-12T09:10:52.977 INFO:tasks.workunit.client.0.smithi117.stdout:7/8: creat d0/d2/f3 x:0 0 0 2024-04-12T09:10:53.015 INFO:tasks.workunit.client.0.smithi117.stdout:8/13: mkdir d2 0 2024-04-12T09:10:53.015 INFO:tasks.workunit.client.0.smithi117.stdout:8/14: dwrite - no filename 2024-04-12T09:10:53.016 INFO:tasks.workunit.client.0.smithi117.stdout:8/15: rename d2 to d2/d3 22 2024-04-12T09:10:53.016 INFO:tasks.workunit.client.0.smithi117.stdout:8/16: write - no filename 2024-04-12T09:10:53.016 INFO:tasks.workunit.client.0.smithi117.stdout:8/17: write - no filename 2024-04-12T09:10:53.020 INFO:tasks.workunit.client.0.smithi117.stdout:6/16: symlink l5 0 2024-04-12T09:10:53.023 INFO:tasks.workunit.client.0.smithi117.stdout:7/9: creat d0/d2/f4 x:0 0 0 2024-04-12T09:10:53.028 INFO:tasks.workunit.client.0.smithi117.stdout:7/10: rename d0/f1 to d0/d2/f5 0 2024-04-12T09:10:53.037 INFO:tasks.workunit.client.0.smithi117.stdout:8/18: rmdir d2 0 2024-04-12T09:10:53.037 INFO:tasks.workunit.client.0.smithi117.stdout:8/19: dread - no filename 2024-04-12T09:10:53.037 INFO:tasks.workunit.client.0.smithi117.stdout:8/20: rename - no filename 2024-04-12T09:10:53.038 INFO:tasks.workunit.client.0.smithi117.stdout:8/21: write - no filename 2024-04-12T09:10:53.038 INFO:tasks.workunit.client.0.smithi117.stdout:8/22: read - no filename 2024-04-12T09:10:53.040 INFO:tasks.workunit.client.0.smithi117.stdout:8/23: symlink l4 0 2024-04-12T09:10:53.042 INFO:tasks.workunit.client.0.smithi117.stdout:8/24: symlink l5 0 2024-04-12T09:10:53.045 INFO:tasks.workunit.client.0.smithi117.stdout:8/25: rename l4 to l6 0 2024-04-12T09:10:53.237 INFO:tasks.workunit.client.0.smithi117.stdout:6/17: stat c1 0 2024-04-12T09:10:53.237 INFO:tasks.workunit.client.0.smithi117.stdout:6/18: chown c4 1021920 1 2024-04-12T09:10:53.241 INFO:tasks.workunit.client.0.smithi117.stdout:9/10: fsync f0 0 2024-04-12T09:10:53.241 INFO:tasks.workunit.client.0.smithi117.stdout:9/11: readlink - no filename 2024-04-12T09:10:53.243 INFO:tasks.workunit.client.0.smithi117.stdout:6/19: dwrite f2 [0,4194304] 0 2024-04-12T09:10:53.246 INFO:tasks.workunit.client.0.smithi117.stdout:9/12: symlink d1/l2 0 2024-04-12T09:10:53.255 INFO:tasks.workunit.client.0.smithi117.stdout:9/13: dwrite f0 [0,4194304] 0 2024-04-12T09:10:53.255 INFO:tasks.workunit.client.0.smithi117.stdout:9/14: chown f0 487146 1 2024-04-12T09:10:53.257 INFO:tasks.workunit.client.0.smithi117.stdout:9/15: rmdir d1 39 2024-04-12T09:10:53.262 INFO:tasks.workunit.client.0.smithi117.stdout:6/20: fdatasync f2 0 2024-04-12T09:10:53.262 INFO:tasks.workunit.client.0.smithi117.stdout:9/16: creat d1/f3 x:0 0 0 2024-04-12T09:10:53.265 INFO:tasks.workunit.client.0.smithi117.stdout:6/21: creat f6 x:0 0 0 2024-04-12T09:10:53.267 INFO:tasks.workunit.client.0.smithi117.stdout:6/22: chown c4 613098 1 2024-04-12T09:10:53.272 INFO:tasks.workunit.client.0.smithi117.stdout:9/17: dwrite d1/f3 [0,4194304] 0 2024-04-12T09:10:53.283 INFO:tasks.workunit.client.0.smithi117.stdout:0/16: rmdir d3 39 2024-04-12T09:10:53.283 INFO:tasks.workunit.client.0.smithi117.stdout:0/17: fsync f0 0 2024-04-12T09:10:53.287 INFO:tasks.workunit.client.0.smithi117.stdout:0/18: symlink d3/l8 0 2024-04-12T09:10:53.296 INFO:tasks.workunit.client.0.smithi117.stdout:0/19: dwrite f0 [0,4194304] 0 2024-04-12T09:10:53.296 INFO:tasks.workunit.client.0.smithi117.stdout:7/11: rmdir d0 39 2024-04-12T09:10:53.297 INFO:tasks.workunit.client.0.smithi117.stdout:0/20: symlink d3/l9 0 2024-04-12T09:10:53.302 INFO:tasks.workunit.client.0.smithi117.stdout:7/12: mknod d0/d2/c6 0 2024-04-12T09:10:53.305 INFO:tasks.workunit.client.0.smithi117.stdout:7/13: mknod d0/d2/c7 0 2024-04-12T09:10:53.307 INFO:tasks.workunit.client.0.smithi117.stdout:7/14: creat d0/d2/f8 x:0 0 0 2024-04-12T09:10:53.307 INFO:tasks.workunit.client.0.smithi117.stdout:7/15: dread - d0/d2/f4 zero size 2024-04-12T09:10:53.311 INFO:tasks.workunit.client.0.smithi117.stdout:7/16: getdents d0 0 2024-04-12T09:10:53.315 INFO:tasks.workunit.client.0.smithi117.stdout:8/26: rename l6 to l7 0 2024-04-12T09:10:53.315 INFO:tasks.workunit.client.0.smithi117.stdout:8/27: write - no filename 2024-04-12T09:10:53.318 INFO:tasks.workunit.client.0.smithi117.stdout:7/17: dwrite d0/d2/f4 [0,4194304] 0 2024-04-12T09:10:53.702 INFO:tasks.workunit.client.0.smithi117.stdout:9/18: getdents d1 0 2024-04-12T09:10:53.720 INFO:tasks.workunit.client.0.smithi117.stdout:7/18: rmdir d0/d2 39 2024-04-12T09:10:53.720 INFO:tasks.workunit.client.0.smithi117.stdout:0/21: dwrite d3/f7 [0,4194304] 0 2024-04-12T09:10:53.729 INFO:tasks.workunit.client.0.smithi117.stdout:0/22: dwrite d3/f6 [0,4194304] 0 2024-04-12T09:10:53.730 INFO:tasks.workunit.client.0.smithi117.stdout:0/23: read d3/f7 [3598430,80292] 0 2024-04-12T09:10:53.731 INFO:tasks.workunit.client.0.smithi117.stdout:0/24: write d3/f5 [383461,126878] 0 2024-04-12T09:10:53.740 INFO:tasks.workunit.client.0.smithi117.stdout:0/25: dwrite d3/f6 [0,4194304] 0 2024-04-12T09:10:53.749 INFO:tasks.workunit.client.0.smithi117.stdout:0/26: dwrite f0 [0,4194304] 0 2024-04-12T09:10:53.750 INFO:tasks.workunit.client.0.smithi117.stdout:0/27: write d3/f6 [2672440,6559] 0 2024-04-12T09:10:53.844 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:53 smithi203 ceph-mon[36428]: pgmap v7: 65 pgs: 65 active+clean; 174 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 3.2 MiB/s wr, 287 op/s 2024-04-12T09:10:53.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:53 smithi117 ceph-mon[29277]: pgmap v7: 65 pgs: 65 active+clean; 174 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 3.2 MiB/s wr, 287 op/s 2024-04-12T09:10:53.997 INFO:tasks.workunit.client.0.smithi117.stdout:9/19: unlink d1/l2 0 2024-04-12T09:10:54.001 INFO:tasks.workunit.client.0.smithi117.stdout:9/20: dread d1/f3 [0,4194304] 0 2024-04-12T09:10:54.001 INFO:tasks.workunit.client.0.smithi117.stdout:7/19: truncate d0/d2/f4 4826577 0 2024-04-12T09:10:54.002 INFO:tasks.workunit.client.0.smithi117.stdout:8/28: stat l7 0 2024-04-12T09:10:54.002 INFO:tasks.workunit.client.0.smithi117.stdout:7/20: dread - d0/d2/f5 zero size 2024-04-12T09:10:54.003 INFO:tasks.workunit.client.0.smithi117.stdout:7/21: dread - d0/d2/f5 zero size 2024-04-12T09:10:54.017 INFO:tasks.workunit.client.0.smithi117.stdout:9/21: creat d1/f4 x:0 0 0 2024-04-12T09:10:54.018 INFO:tasks.workunit.client.0.smithi117.stdout:9/22: write d1/f4 [564141,53865] 0 2024-04-12T09:10:54.018 INFO:tasks.workunit.client.0.smithi117.stdout:8/29: symlink l8 0 2024-04-12T09:10:54.025 INFO:tasks.workunit.client.0.smithi117.stdout:8/30: rename l5 to l9 0 2024-04-12T09:10:54.026 INFO:tasks.workunit.client.0.smithi117.stdout:9/23: dread d1/f3 [0,4194304] 0 2024-04-12T09:10:54.027 INFO:tasks.workunit.client.0.smithi117.stdout:7/22: symlink d0/l9 0 2024-04-12T09:10:54.030 INFO:tasks.workunit.client.0.smithi117.stdout:9/24: creat d1/f5 x:0 0 0 2024-04-12T09:10:54.031 INFO:tasks.workunit.client.0.smithi117.stdout:9/25: truncate d1/f5 253355 0 2024-04-12T09:10:54.032 INFO:tasks.workunit.client.0.smithi117.stdout:9/26: chown d1/f4 852709 1 2024-04-12T09:10:54.032 INFO:tasks.workunit.client.0.smithi117.stdout:9/27: stat d1/f5 0 2024-04-12T09:10:54.034 INFO:tasks.workunit.client.0.smithi117.stdout:7/23: mkdir d0/da 0 2024-04-12T09:10:54.036 INFO:tasks.workunit.client.0.smithi117.stdout:9/28: mkdir d1/d6 0 2024-04-12T09:10:54.038 INFO:tasks.workunit.client.0.smithi117.stdout:7/24: rename d0/d2/c7 to d0/d2/cb 0 2024-04-12T09:10:54.039 INFO:tasks.workunit.client.0.smithi117.stdout:7/25: write d0/d2/f3 [155861,33941] 0 2024-04-12T09:10:54.040 INFO:tasks.workunit.client.0.smithi117.stdout:7/26: dread - d0/d2/f5 zero size 2024-04-12T09:10:54.042 INFO:tasks.workunit.client.0.smithi117.stdout:9/29: link d1/f5 d1/f7 0 2024-04-12T09:10:54.046 INFO:tasks.workunit.client.0.smithi117.stdout:9/30: dread f0 [0,4194304] 0 2024-04-12T09:10:54.051 INFO:tasks.workunit.client.0.smithi117.stdout:9/31: dwrite f0 [0,4194304] 0 2024-04-12T09:10:54.060 INFO:tasks.workunit.client.0.smithi117.stdout:9/32: rmdir d1/d6 0 2024-04-12T09:10:54.064 INFO:tasks.workunit.client.0.smithi117.stdout:9/33: write d1/f3 [1120549,116715] 0 2024-04-12T09:10:54.064 INFO:tasks.workunit.client.0.smithi117.stdout:9/34: chown f0 1430 1 2024-04-12T09:10:54.066 INFO:tasks.workunit.client.0.smithi117.stdout:9/35: write f0 [2521529,127819] 0 2024-04-12T09:10:54.066 INFO:tasks.workunit.client.0.smithi117.stdout:9/36: readlink - no filename 2024-04-12T09:10:54.073 INFO:tasks.workunit.client.0.smithi117.stdout:9/37: dwrite d1/f4 [0,4194304] 0 2024-04-12T09:10:54.073 INFO:tasks.workunit.client.0.smithi117.stdout:9/38: chown d1/f3 28850310 1 2024-04-12T09:10:54.076 INFO:tasks.workunit.client.0.smithi117.stdout:9/39: mkdir d1/d8 0 2024-04-12T09:10:54.077 INFO:tasks.workunit.client.0.smithi117.stdout:9/40: chown d1/f7 537081 1 2024-04-12T09:10:54.079 INFO:tasks.workunit.client.0.smithi117.stdout:9/41: dread d1/f5 [0,4194304] 0 2024-04-12T09:10:54.085 INFO:tasks.workunit.client.0.smithi117.stdout:9/42: getdents d1/d8 0 2024-04-12T09:10:54.094 INFO:tasks.workunit.client.0.smithi117.stdout:9/43: dwrite d1/f5 [0,4194304] 0 2024-04-12T09:10:54.098 INFO:tasks.workunit.client.0.smithi117.stdout:9/44: creat d1/f9 x:0 0 0 2024-04-12T09:10:54.102 INFO:tasks.workunit.client.0.smithi117.stdout:9/45: rename d1/f5 to d1/d8/fa 0 2024-04-12T09:10:54.108 INFO:tasks.workunit.client.0.smithi117.stdout:9/46: mknod d1/cb 0 2024-04-12T09:10:54.110 INFO:tasks.workunit.client.0.smithi117.stdout:9/47: creat d1/fc x:0 0 0 2024-04-12T09:10:54.112 INFO:tasks.workunit.client.0.smithi117.stdout:9/48: symlink d1/d8/ld 0 2024-04-12T09:10:54.115 INFO:tasks.workunit.client.0.smithi117.stdout:9/49: mkdir d1/d8/de 0 2024-04-12T09:10:54.115 INFO:tasks.workunit.client.0.smithi117.stdout:9/50: readlink d1/d8/ld 0 2024-04-12T09:10:54.120 INFO:tasks.workunit.client.0.smithi117.stdout:9/51: dwrite f0 [0,4194304] 0 2024-04-12T09:10:54.305 INFO:tasks.workunit.client.0.smithi117.stdout:0/28: dwrite d3/f5 [4194304,4194304] 0 2024-04-12T09:10:54.306 INFO:tasks.workunit.client.0.smithi117.stdout:0/29: read f0 [321590,114859] 0 2024-04-12T09:10:54.311 INFO:tasks.workunit.client.0.smithi117.stdout:0/30: dread d3/f5 [0,4194304] 0 2024-04-12T09:10:54.315 INFO:tasks.workunit.client.0.smithi117.stdout:0/31: dread d3/f6 [0,4194304] 0 2024-04-12T09:10:54.315 INFO:tasks.workunit.client.0.smithi117.stdout:0/32: chown d3/l4 789937970 1 2024-04-12T09:10:54.318 INFO:tasks.workunit.client.0.smithi117.stdout:0/33: mknod d3/ca 0 2024-04-12T09:10:54.320 INFO:tasks.workunit.client.0.smithi117.stdout:0/34: creat d3/fb x:0 0 0 2024-04-12T09:10:54.321 INFO:tasks.workunit.client.0.smithi117.stdout:8/31: readlink l9 0 2024-04-12T09:10:54.325 INFO:tasks.workunit.client.0.smithi117.stdout:8/32: creat fa x:0 0 0 2024-04-12T09:10:54.326 INFO:tasks.workunit.client.0.smithi117.stdout:8/33: read - fa zero size 2024-04-12T09:10:54.329 INFO:tasks.workunit.client.0.smithi117.stdout:0/35: dwrite d3/f7 [8388608,4194304] 0 2024-04-12T09:10:54.329 INFO:tasks.workunit.client.0.smithi117.stdout:0/36: chown d3/l8 157 1 2024-04-12T09:10:54.335 INFO:tasks.workunit.client.0.smithi117.stdout:7/27: chown d0/d2/cb 2406 1 2024-04-12T09:10:54.338 INFO:tasks.workunit.client.0.smithi117.stdout:0/37: dwrite d3/f7 [0,4194304] 0 2024-04-12T09:10:54.342 INFO:tasks.workunit.client.0.smithi117.stdout:0/38: mkdir d3/dc 0 2024-04-12T09:10:54.343 INFO:tasks.workunit.client.0.smithi117.stdout:7/28: creat d0/fc x:0 0 0 2024-04-12T09:10:54.348 INFO:tasks.workunit.client.0.smithi117.stdout:7/29: unlink d0/fc 0 2024-04-12T09:10:54.349 INFO:tasks.workunit.client.0.smithi117.stdout:0/39: creat d3/dc/fd x:0 0 0 2024-04-12T09:10:54.352 INFO:tasks.workunit.client.0.smithi117.stdout:0/40: dread d3/f5 [4194304,4194304] 0 2024-04-12T09:10:54.353 INFO:tasks.workunit.client.0.smithi117.stdout:7/30: creat d0/d2/fd x:0 0 0 2024-04-12T09:10:54.353 INFO:tasks.workunit.client.0.smithi117.stdout:0/41: dread - d3/fb zero size 2024-04-12T09:10:54.354 INFO:tasks.workunit.client.0.smithi117.stdout:0/42: dread - d3/fb zero size 2024-04-12T09:10:54.355 INFO:tasks.workunit.client.0.smithi117.stdout:7/31: read d0/d2/f3 [126410,78967] 0 2024-04-12T09:10:54.358 INFO:tasks.workunit.client.0.smithi117.stdout:0/43: creat d3/fe x:0 0 0 2024-04-12T09:10:54.368 INFO:tasks.workunit.client.0.smithi117.stdout:0/44: dwrite d3/f7 [8388608,4194304] 0 2024-04-12T09:10:54.371 INFO:tasks.workunit.client.0.smithi117.stdout:0/45: rename d3/l8 to d3/lf 0 2024-04-12T09:10:54.376 INFO:tasks.workunit.client.0.smithi117.stdout:0/46: link d3/f7 d3/f10 0 2024-04-12T09:10:54.378 INFO:tasks.workunit.client.0.smithi117.stdout:0/47: symlink d3/l11 0 2024-04-12T09:10:54.385 INFO:tasks.workunit.client.0.smithi117.stdout:0/48: dwrite d3/f5 [8388608,4194304] 0 2024-04-12T09:10:54.390 INFO:tasks.workunit.client.0.smithi117.stdout:0/49: link d3/l9 d3/l12 0 2024-04-12T09:10:54.398 INFO:tasks.workunit.client.0.smithi117.stdout:9/52: getdents d1/d8 0 2024-04-12T09:10:54.402 INFO:tasks.workunit.client.0.smithi117.stdout:9/53: rename d1/d8/de to d1/d8/df 0 2024-04-12T09:10:54.406 INFO:tasks.workunit.client.0.smithi117.stdout:9/54: rename d1/f9 to d1/d8/f10 0 2024-04-12T09:10:54.413 INFO:tasks.workunit.client.0.smithi117.stdout:9/55: dwrite d1/d8/f10 [0,4194304] 0 2024-04-12T09:10:54.418 INFO:tasks.workunit.client.0.smithi117.stdout:9/56: link d1/d8/fa d1/f11 0 2024-04-12T09:10:54.420 INFO:tasks.workunit.client.0.smithi117.stdout:9/57: mkdir d1/d8/d12 0 2024-04-12T09:10:54.421 INFO:tasks.workunit.client.0.smithi117.stdout:9/58: write d1/d8/f10 [3916587,102675] 0 2024-04-12T09:10:54.426 INFO:tasks.workunit.client.0.smithi117.stdout:9/59: dread d1/d8/f10 [0,4194304] 0 2024-04-12T09:10:54.434 INFO:tasks.workunit.client.0.smithi117.stdout:8/34: getdents . 0 2024-04-12T09:10:54.436 INFO:tasks.workunit.client.0.smithi117.stdout:8/35: mkdir db 0 2024-04-12T09:10:54.438 INFO:tasks.workunit.client.0.smithi117.stdout:8/36: creat db/fc x:0 0 0 2024-04-12T09:10:54.439 INFO:tasks.workunit.client.0.smithi117.stdout:8/37: stat l8 0 2024-04-12T09:10:54.440 INFO:tasks.workunit.client.0.smithi117.stdout:8/38: mkdir db/dd 0 2024-04-12T09:10:54.441 INFO:tasks.workunit.client.0.smithi117.stdout:8/39: truncate db/fc 596558 0 2024-04-12T09:10:54.443 INFO:tasks.workunit.client.0.smithi117.stdout:8/40: unlink l9 0 2024-04-12T09:10:54.444 INFO:tasks.workunit.client.0.smithi117.stdout:8/41: stat db/dd 0 2024-04-12T09:10:54.445 INFO:tasks.workunit.client.0.smithi117.stdout:7/32: fsync d0/d2/fd 0 2024-04-12T09:10:54.446 INFO:tasks.workunit.client.0.smithi117.stdout:7/33: chown d0 783174 1 2024-04-12T09:10:54.453 INFO:tasks.workunit.client.0.smithi117.stdout:0/50: rmdir d3 39 2024-04-12T09:10:54.455 INFO:tasks.workunit.client.0.smithi117.stdout:0/51: truncate f0 1367578 0 2024-04-12T09:10:54.459 INFO:tasks.workunit.client.0.smithi117.stdout:0/52: creat d3/dc/f13 x:0 0 0 2024-04-12T09:10:54.459 INFO:tasks.workunit.client.0.smithi117.stdout:0/53: stat d3/dc 0 2024-04-12T09:10:54.461 INFO:tasks.workunit.client.0.smithi117.stdout:0/54: creat d3/f14 x:0 0 0 2024-04-12T09:10:54.465 INFO:tasks.workunit.client.0.smithi117.stdout:0/55: dread d3/f6 [0,4194304] 0 2024-04-12T09:10:54.467 INFO:tasks.workunit.client.0.smithi117.stdout:9/60: truncate d1/f4 3416399 0 2024-04-12T09:10:54.468 INFO:tasks.workunit.client.0.smithi117.stdout:9/61: write d1/fc [797640,49833] 0 2024-04-12T09:10:54.469 INFO:tasks.workunit.client.0.smithi117.stdout:9/62: truncate d1/fc 1161383 0 2024-04-12T09:10:54.473 INFO:tasks.workunit.client.0.smithi117.stdout:9/63: dread d1/d8/f10 [0,4194304] 0 2024-04-12T09:10:54.474 INFO:tasks.workunit.client.0.smithi117.stdout:9/64: chown d1/f3 1566723 1 2024-04-12T09:10:54.477 INFO:tasks.workunit.client.0.smithi117.stdout:9/65: dread d1/f3 [0,4194304] 0 2024-04-12T09:10:54.488 INFO:tasks.workunit.client.0.smithi117.stdout:0/56: truncate d3/f10 825918 0 2024-04-12T09:10:54.493 INFO:tasks.workunit.client.0.smithi117.stdout:0/57: getdents d3 0 2024-04-12T09:10:54.499 INFO:tasks.workunit.client.0.smithi117.stdout:9/66: dwrite d1/f4 [0,4194304] 0 2024-04-12T09:10:54.500 INFO:tasks.workunit.client.0.smithi117.stdout:0/58: fdatasync d3/f5 0 2024-04-12T09:10:54.504 INFO:tasks.workunit.client.0.smithi117.stdout:9/67: creat d1/d8/df/f13 x:0 0 0 2024-04-12T09:10:54.505 INFO:tasks.workunit.client.0.smithi117.stdout:0/59: mknod d3/c15 0 2024-04-12T09:10:54.509 INFO:tasks.workunit.client.0.smithi117.stdout:9/68: rename d1/f11 to d1/d8/f14 0 2024-04-12T09:10:54.510 INFO:tasks.workunit.client.0.smithi117.stdout:0/60: creat d3/dc/f16 x:0 0 0 2024-04-12T09:10:54.513 INFO:tasks.workunit.client.0.smithi117.stdout:9/69: dread d1/f7 [0,4194304] 0 2024-04-12T09:10:54.514 INFO:tasks.workunit.client.0.smithi117.stdout:0/61: mknod d3/c17 0 2024-04-12T09:10:54.514 INFO:tasks.workunit.client.0.smithi117.stdout:0/62: fsync d3/f7 0 2024-04-12T09:10:54.521 INFO:tasks.workunit.client.0.smithi117.stdout:0/63: dwrite d3/dc/fd [0,4194304] 0 2024-04-12T09:10:54.523 INFO:tasks.workunit.client.0.smithi117.stdout:0/64: read d3/f7 [309450,72292] 0 2024-04-12T09:10:54.523 INFO:tasks.workunit.client.0.smithi117.stdout:0/65: chown d3/dc/f16 133 1 2024-04-12T09:10:54.524 INFO:tasks.workunit.client.0.smithi117.stdout:0/66: dread d3/f5 [0,4194304] 0 2024-04-12T09:10:54.529 INFO:tasks.workunit.client.0.smithi117.stdout:9/70: dwrite d1/f7 [0,4194304] 0 2024-04-12T09:10:54.529 INFO:tasks.workunit.client.0.smithi117.stdout:0/67: truncate f0 1491200 0 2024-04-12T09:10:54.530 INFO:tasks.workunit.client.0.smithi117.stdout:9/71: write d1/f3 [1295189,120882] 0 2024-04-12T09:10:54.532 INFO:tasks.workunit.client.0.smithi117.stdout:0/68: symlink d3/dc/l18 0 2024-04-12T09:10:54.533 INFO:tasks.workunit.client.0.smithi117.stdout:9/72: write d1/d8/f10 [492537,103474] 0 2024-04-12T09:10:54.534 INFO:tasks.workunit.client.0.smithi117.stdout:0/69: mkdir d3/d19 0 2024-04-12T09:10:54.535 INFO:tasks.workunit.client.0.smithi117.stdout:9/73: creat d1/f15 x:0 0 0 2024-04-12T09:10:54.536 INFO:tasks.workunit.client.0.smithi117.stdout:0/70: unlink d3/f10 0 2024-04-12T09:10:54.538 INFO:tasks.workunit.client.0.smithi117.stdout:0/71: symlink d3/dc/l1a 0 2024-04-12T09:10:54.541 INFO:tasks.workunit.client.0.smithi117.stdout:9/74: dwrite d1/fc [0,4194304] 0 2024-04-12T09:10:54.618 INFO:tasks.workunit.client.0.smithi117.stdout:9/75: symlink d1/d8/df/l16 0 2024-04-12T09:10:54.619 INFO:tasks.workunit.client.0.smithi117.stdout:0/72: rmdir d3/d19 0 2024-04-12T09:10:54.622 INFO:tasks.workunit.client.0.smithi117.stdout:9/76: dread d1/d8/f14 [0,4194304] 0 2024-04-12T09:10:54.630 INFO:tasks.workunit.client.0.smithi117.stdout:0/73: rename d3/c15 to d3/c1b 0 2024-04-12T09:10:54.630 INFO:tasks.workunit.client.0.smithi117.stdout:9/77: symlink d1/d8/df/l17 0 2024-04-12T09:10:54.633 INFO:tasks.workunit.client.0.smithi117.stdout:9/78: creat d1/f18 x:0 0 0 2024-04-12T09:10:54.633 INFO:tasks.workunit.client.0.smithi117.stdout:9/79: chown d1/fc 830358 1 2024-04-12T09:10:54.634 INFO:tasks.workunit.client.0.smithi117.stdout:9/80: read - d1/f15 zero size 2024-04-12T09:10:54.635 INFO:tasks.workunit.client.0.smithi117.stdout:9/81: write d1/f18 [420068,98257] 0 2024-04-12T09:10:54.635 INFO:tasks.workunit.client.0.smithi117.stdout:0/74: link d3/ca d3/dc/c1c 0 2024-04-12T09:10:54.638 INFO:tasks.workunit.client.0.smithi117.stdout:0/75: link d3/fe d3/dc/f1d 0 2024-04-12T09:10:54.646 INFO:tasks.workunit.client.0.smithi117.stdout:0/76: dwrite d3/fe [0,4194304] 0 2024-04-12T09:10:54.651 INFO:tasks.workunit.client.0.smithi117.stdout:0/77: dread f0 [0,4194304] 0 2024-04-12T09:10:54.654 INFO:tasks.workunit.client.0.smithi117.stdout:0/78: symlink d3/dc/l1e 0 2024-04-12T09:10:54.656 INFO:tasks.workunit.client.0.smithi117.stdout:0/79: chown d3/f7 332709 1 2024-04-12T09:10:54.656 INFO:tasks.workunit.client.0.smithi117.stdout:0/80: dread - d3/f14 zero size 2024-04-12T09:10:54.657 INFO:tasks.workunit.client.0.smithi117.stdout:0/81: fdatasync d3/dc/fd 0 2024-04-12T09:10:54.661 INFO:tasks.workunit.client.0.smithi117.stdout:0/82: fsync d3/f7 0 2024-04-12T09:10:54.667 INFO:tasks.workunit.client.0.smithi117.stdout:0/83: rename d3/ca to d3/c1f 0 2024-04-12T09:10:54.670 INFO:tasks.workunit.client.0.smithi117.stdout:0/84: creat d3/f20 x:0 0 0 2024-04-12T09:10:54.676 INFO:tasks.workunit.client.0.smithi117.stdout:0/85: rmdir d3 39 2024-04-12T09:10:54.679 INFO:tasks.workunit.client.0.smithi117.stdout:0/86: read d3/f7 [470590,127494] 0 2024-04-12T09:10:54.679 INFO:tasks.workunit.client.0.smithi117.stdout:0/87: fsync d3/f14 0 2024-04-12T09:10:54.681 INFO:tasks.workunit.client.0.smithi117.stdout:0/88: creat d3/f21 x:0 0 0 2024-04-12T09:10:54.681 INFO:tasks.workunit.client.0.smithi117.stdout:0/89: write d3/f21 [95026,80988] 0 2024-04-12T09:10:54.682 INFO:tasks.workunit.client.0.smithi117.stdout:0/90: dread - d3/dc/f16 zero size 2024-04-12T09:10:54.683 INFO:tasks.workunit.client.0.smithi117.stdout:0/91: mkdir d3/d22 0 2024-04-12T09:10:54.685 INFO:tasks.workunit.client.0.smithi117.stdout:0/92: creat d3/f23 x:0 0 0 2024-04-12T09:10:54.685 INFO:tasks.workunit.client.0.smithi117.stdout:0/93: write d3/f14 [488409,374] 0 2024-04-12T09:10:54.690 INFO:tasks.workunit.client.0.smithi117.stdout:0/94: link d3/l11 d3/l24 0 2024-04-12T09:10:54.692 INFO:tasks.workunit.client.0.smithi117.stdout:0/95: unlink d3/fb 0 2024-04-12T09:10:54.693 INFO:tasks.workunit.client.0.smithi117.stdout:0/96: creat d3/f25 x:0 0 0 2024-04-12T09:10:54.695 INFO:tasks.workunit.client.0.smithi117.stdout:0/97: symlink d3/dc/l26 0 2024-04-12T09:10:54.696 INFO:tasks.workunit.client.0.smithi117.stdout:0/98: read d3/f5 [244244,12396] 0 2024-04-12T09:10:54.713 INFO:tasks.workunit.client.0.smithi117.stdout:0/99: dwrite d3/dc/fd [0,4194304] 0 2024-04-12T09:10:54.814 INFO:tasks.workunit.client.0.smithi117.stdout:0/100: creat d3/d22/f27 x:0 0 0 2024-04-12T09:10:54.816 INFO:tasks.workunit.client.0.smithi117.stdout:0/101: mknod d3/c28 0 2024-04-12T09:10:54.817 INFO:tasks.workunit.client.0.smithi117.stdout:0/102: chown d3/c1b 20 1 2024-04-12T09:10:54.818 INFO:tasks.workunit.client.0.smithi117.stdout:0/103: truncate d3/f20 908903 0 2024-04-12T09:10:54.819 INFO:tasks.workunit.client.0.smithi117.stdout:0/104: dread - d3/f25 zero size 2024-04-12T09:10:54.819 INFO:tasks.workunit.client.0.smithi117.stdout:0/105: dread - d3/f25 zero size 2024-04-12T09:10:54.820 INFO:tasks.workunit.client.0.smithi117.stdout:0/106: creat d3/d22/f29 x:0 0 0 2024-04-12T09:10:54.821 INFO:tasks.workunit.client.0.smithi117.stdout:0/107: symlink d3/dc/l2a 0 2024-04-12T09:10:54.827 INFO:tasks.workunit.client.0.smithi117.stdout:0/108: dwrite d3/f23 [0,4194304] 0 2024-04-12T09:10:54.830 INFO:tasks.workunit.client.0.smithi117.stdout:0/109: rename d3/l4 to d3/l2b 0 2024-04-12T09:10:54.833 INFO:tasks.workunit.client.0.smithi117.stdout:0/110: rmdir d3/dc 39 2024-04-12T09:10:54.838 INFO:tasks.workunit.client.0.smithi117.stdout:0/111: stat d3/dc/l18 0 2024-04-12T09:10:54.838 INFO:tasks.workunit.client.0.smithi117.stdout:0/112: stat d3/f7 0 2024-04-12T09:10:54.994 INFO:tasks.workunit.client.0.smithi117.stdout:0/113: rmdir d3/d22 39 2024-04-12T09:10:54.994 INFO:tasks.workunit.client.0.smithi117.stdout:0/114: dread - d3/dc/f16 zero size 2024-04-12T09:10:55.052 INFO:tasks.workunit.client.0.smithi117.stdout:0/115: write d3/f7 [1606996,82542] 0 2024-04-12T09:10:55.060 INFO:tasks.workunit.client.0.smithi117.stdout:0/116: dwrite d3/d22/f29 [0,4194304] 0 2024-04-12T09:10:55.061 INFO:tasks.workunit.client.0.smithi117.stdout:0/117: write d3/d22/f27 [35574,92436] 0 2024-04-12T09:10:55.063 INFO:tasks.workunit.client.0.smithi117.stdout:0/118: rmdir d3/d22 39 2024-04-12T09:10:55.064 INFO:tasks.workunit.client.0.smithi117.stdout:0/119: write d3/f14 [533956,38942] 0 2024-04-12T09:10:55.069 INFO:tasks.workunit.client.0.smithi117.stdout:0/120: creat d3/dc/f2c x:0 0 0 2024-04-12T09:10:55.073 INFO:tasks.workunit.client.0.smithi117.stdout:0/121: creat d3/d22/f2d x:0 0 0 2024-04-12T09:10:55.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:54 smithi203 ceph-mon[36428]: Standby manager daemon smithi117.oyaxql started 2024-04-12T09:10:55.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:54 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.117:0/2011294864' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.oyaxql/crt"}]: dispatch 2024-04-12T09:10:55.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:54 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.117:0/2011294864' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T09:10:55.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:54 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.117:0/2011294864' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.oyaxql/key"}]: dispatch 2024-04-12T09:10:55.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:54 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.117:0/2011294864' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T09:10:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:54 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:10:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:54 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:10:55.075 INFO:tasks.workunit.client.0.smithi117.stdout:0/122: creat d3/dc/f2e x:0 0 0 2024-04-12T09:10:55.075 INFO:tasks.workunit.client.0.smithi117.stdout:0/123: read d3/dc/fd [2226846,21762] 0 2024-04-12T09:10:55.077 INFO:tasks.workunit.client.0.smithi117.stdout:0/124: truncate d3/dc/f2e 109471 0 2024-04-12T09:10:55.077 INFO:tasks.workunit.client.0.smithi117.stdout:0/125: write d3/dc/f16 [86380,35685] 0 2024-04-12T09:10:55.078 INFO:tasks.workunit.client.0.smithi117.stdout:0/126: chown d3/dc/f16 71258 1 2024-04-12T09:10:55.085 INFO:tasks.workunit.client.0.smithi117.stdout:0/127: rmdir d3/d22 39 2024-04-12T09:10:55.086 INFO:tasks.workunit.client.0.smithi117.stdout:0/128: write d3/dc/f16 [509494,78047] 0 2024-04-12T09:10:55.087 INFO:tasks.workunit.client.0.smithi117.stdout:0/129: write d3/f7 [2500775,18352] 0 2024-04-12T09:10:55.091 INFO:tasks.workunit.client.0.smithi117.stdout:0/130: symlink d3/d22/l2f 0 2024-04-12T09:10:55.097 INFO:tasks.workunit.client.0.smithi117.stdout:0/131: dwrite d3/f21 [0,4194304] 0 2024-04-12T09:10:55.098 INFO:tasks.workunit.client.0.smithi117.stdout:0/132: dread - d3/dc/f2c zero size 2024-04-12T09:10:55.098 INFO:tasks.workunit.client.0.smithi117.stdout:0/133: readlink d3/dc/l26 0 2024-04-12T09:10:55.099 INFO:tasks.workunit.client.0.smithi117.stdout:0/134: write d3/dc/f2c [1023649,106701] 0 2024-04-12T09:10:55.102 INFO:tasks.workunit.client.0.smithi117.stdout:0/135: mkdir d3/d30 0 2024-04-12T09:10:55.105 INFO:tasks.workunit.client.0.smithi117.stdout:0/136: dread d3/f23 [0,4194304] 0 2024-04-12T09:10:55.106 INFO:tasks.workunit.client.0.smithi117.stdout:0/137: write d3/d22/f2d [296467,65242] 0 2024-04-12T09:10:55.108 INFO:tasks.workunit.client.0.smithi117.stdout:0/138: chown d3/c1f 0 1 2024-04-12T09:10:55.111 INFO:tasks.workunit.client.0.smithi117.stdout:0/139: creat d3/d30/f31 x:0 0 0 2024-04-12T09:10:55.113 INFO:tasks.workunit.client.0.smithi117.stdout:0/140: chown d3/l9 1 1 2024-04-12T09:10:55.114 INFO:tasks.workunit.client.0.smithi117.stdout:0/141: stat d3/c28 0 2024-04-12T09:10:55.120 INFO:tasks.workunit.client.0.smithi117.stdout:0/142: dwrite d3/dc/f1d [0,4194304] 0 2024-04-12T09:10:55.125 INFO:tasks.workunit.client.0.smithi117.stdout:0/143: mkdir d3/d30/d32 0 2024-04-12T09:10:55.125 INFO:tasks.workunit.client.0.smithi117.stdout:0/144: fsync d3/d22/f29 0 2024-04-12T09:10:55.129 INFO:tasks.workunit.client.0.smithi117.stdout:0/145: dread d3/f14 [0,4194304] 0 2024-04-12T09:10:55.131 INFO:tasks.workunit.client.0.smithi117.stdout:0/146: unlink d3/d22/f27 0 2024-04-12T09:10:55.132 INFO:tasks.workunit.client.0.smithi117.stdout:0/147: write d3/d22/f2d [993328,109191] 0 2024-04-12T09:10:55.136 INFO:tasks.workunit.client.0.smithi117.stdout:0/148: creat d3/d22/f33 x:0 0 0 2024-04-12T09:10:55.136 INFO:tasks.workunit.client.0.smithi117.stdout:0/149: chown d3/d30/f31 1636918 1 2024-04-12T09:10:55.140 INFO:tasks.workunit.client.0.smithi117.stdout:0/150: dread d3/f5 [0,4194304] 0 2024-04-12T09:10:55.142 INFO:tasks.workunit.client.0.smithi117.stdout:0/151: fdatasync d3/f5 0 2024-04-12T09:10:55.145 INFO:tasks.workunit.client.0.smithi117.stdout:0/152: link d3/f7 d3/dc/f34 0 2024-04-12T09:10:55.147 INFO:tasks.workunit.client.0.smithi117.stdout:0/153: dread d3/f20 [0,4194304] 0 2024-04-12T09:10:55.151 INFO:tasks.workunit.client.0.smithi117.stdout:0/154: dread d3/dc/f1d [0,4194304] 0 2024-04-12T09:10:55.152 INFO:tasks.workunit.client.0.smithi117.stdout:0/155: creat d3/d22/f35 x:0 0 0 2024-04-12T09:10:55.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:54 smithi117 ceph-mon[29277]: Standby manager daemon smithi117.oyaxql started 2024-04-12T09:10:55.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:54 smithi117 ceph-mon[29277]: from='mgr.? 172.21.15.117:0/2011294864' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.oyaxql/crt"}]: dispatch 2024-04-12T09:10:55.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:54 smithi117 ceph-mon[29277]: from='mgr.? 172.21.15.117:0/2011294864' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T09:10:55.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:54 smithi117 ceph-mon[29277]: from='mgr.? 172.21.15.117:0/2011294864' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.oyaxql/key"}]: dispatch 2024-04-12T09:10:55.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:54 smithi117 ceph-mon[29277]: from='mgr.? 172.21.15.117:0/2011294864' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T09:10:55.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:54 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:10:55.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:54 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:10:56.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:55 smithi203 ceph-mon[36428]: pgmap v8: 65 pgs: 65 active+clean; 174 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 2.5 MiB/s wr, 223 op/s 2024-04-12T09:10:56.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:55 smithi203 ceph-mon[36428]: mgrmap e25: smithi203.apfqpo(active, since 10s), standbys: smithi117.oyaxql 2024-04-12T09:10:56.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:55 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mgr metadata", "who": "smithi117.oyaxql", "id": "smithi117.oyaxql"}]: dispatch 2024-04-12T09:10:56.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:55 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:10:56.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:55 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:10:56.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:55 smithi117 ceph-mon[29277]: pgmap v8: 65 pgs: 65 active+clean; 174 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 2.5 MiB/s wr, 223 op/s 2024-04-12T09:10:56.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:55 smithi117 ceph-mon[29277]: mgrmap e25: smithi203.apfqpo(active, since 10s), standbys: smithi117.oyaxql 2024-04-12T09:10:56.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:55 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mgr metadata", "who": "smithi117.oyaxql", "id": "smithi117.oyaxql"}]: dispatch 2024-04-12T09:10:56.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:55 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:10:56.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:55 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:10:57.878 INFO:tasks.workunit.client.0.smithi117.stdout:3/0: sync 2024-04-12T09:10:57.878 INFO:tasks.workunit.client.0.smithi117.stdout:3/1: fsync - no filename 2024-04-12T09:10:57.879 INFO:tasks.workunit.client.0.smithi117.stdout:3/2: chown . 5143 1 2024-04-12T09:10:57.879 INFO:tasks.workunit.client.0.smithi117.stdout:3/3: stat - no entries 2024-04-12T09:10:57.879 INFO:tasks.workunit.client.0.smithi117.stdout:3/4: read - no filename 2024-04-12T09:10:57.879 INFO:tasks.workunit.client.0.smithi117.stdout:3/5: dwrite - no filename 2024-04-12T09:10:57.879 INFO:tasks.workunit.client.0.smithi117.stdout:3/6: write - no filename 2024-04-12T09:10:57.879 INFO:tasks.workunit.client.0.smithi117.stdout:3/7: dread - no filename 2024-04-12T09:10:57.881 INFO:tasks.workunit.client.0.smithi117.stdout:3/8: mknod c0 0 2024-04-12T09:10:57.883 INFO:tasks.workunit.client.0.smithi117.stdout:3/9: symlink l1 0 2024-04-12T09:10:57.884 INFO:tasks.workunit.client.0.smithi117.stdout:3/10: creat f2 x:0 0 0 2024-04-12T09:10:57.890 INFO:tasks.workunit.client.0.smithi117.stdout:3/11: dwrite f2 [0,4194304] 0 2024-04-12T09:10:57.892 INFO:tasks.workunit.client.0.smithi117.stdout:3/12: creat f3 x:0 0 0 2024-04-12T09:10:57.895 INFO:tasks.workunit.client.0.smithi117.stdout:3/13: rename l1 to l4 0 2024-04-12T09:10:57.898 INFO:tasks.workunit.client.0.smithi117.stdout:3/14: rename f3 to f5 0 2024-04-12T09:10:57.901 INFO:tasks.workunit.client.0.smithi117.stdout:3/15: mknod c6 0 2024-04-12T09:10:57.951 INFO:tasks.workunit.client.0.smithi117.stdout:2/3: sync 2024-04-12T09:10:57.951 INFO:tasks.workunit.client.0.smithi117.stdout:1/5: sync 2024-04-12T09:10:57.956 INFO:tasks.workunit.client.0.smithi117.stdout:1/6: symlink d1/l2 0 2024-04-12T09:10:57.957 INFO:tasks.workunit.client.0.smithi117.stdout:2/4: mknod d0/d1/c2 0 2024-04-12T09:10:57.959 INFO:tasks.workunit.client.0.smithi117.stdout:1/7: rename d1/l2 to d1/l3 0 2024-04-12T09:10:57.961 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:57 smithi203 ceph-mon[36428]: pgmap v9: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 211 KiB/s rd, 15 MiB/s wr, 295 op/s 2024-04-12T09:10:57.962 INFO:tasks.workunit.client.0.smithi117.stdout:2/5: creat d0/f3 x:0 0 0 2024-04-12T09:10:57.962 INFO:tasks.workunit.client.0.smithi117.stdout:2/6: write d0/f3 [295784,107355] 0 2024-04-12T09:10:57.963 INFO:tasks.workunit.client.0.smithi117.stdout:2/7: write d0/f3 [1386412,15045] 0 2024-04-12T09:10:57.963 INFO:tasks.workunit.client.0.smithi117.stdout:2/8: readlink - no filename 2024-04-12T09:10:57.963 INFO:tasks.workunit.client.0.smithi117.stdout:1/8: fsync f0 0 2024-04-12T09:10:57.964 INFO:tasks.workunit.client.0.smithi117.stdout:1/9: dread - f0 zero size 2024-04-12T09:10:57.968 INFO:tasks.workunit.client.0.smithi117.stdout:1/10: rmdir d1 39 2024-04-12T09:10:57.970 INFO:tasks.workunit.client.0.smithi117.stdout:1/11: chown d1 297719 1 2024-04-12T09:10:57.971 INFO:tasks.workunit.client.0.smithi117.stdout:1/12: fdatasync f0 0 2024-04-12T09:10:57.973 INFO:tasks.workunit.client.0.smithi117.stdout:1/13: rmdir d1 39 2024-04-12T09:10:57.973 INFO:tasks.workunit.client.0.smithi117.stdout:1/14: dread - f0 zero size 2024-04-12T09:10:57.974 INFO:tasks.workunit.client.0.smithi117.stdout:1/15: truncate f0 534801 0 2024-04-12T09:10:57.976 INFO:tasks.workunit.client.0.smithi117.stdout:1/16: chown d1 872917449 1 2024-04-12T09:10:57.977 INFO:tasks.workunit.client.0.smithi117.stdout:1/17: truncate f0 1465991 0 2024-04-12T09:10:57.979 INFO:tasks.workunit.client.0.smithi117.stdout:1/18: mkdir d1/d4 0 2024-04-12T09:10:58.000 INFO:tasks.workunit.client.0.smithi117.stdout:5/8: sync 2024-04-12T09:10:58.000 INFO:tasks.workunit.client.0.smithi117.stdout:4/9: sync 2024-04-12T09:10:58.000 INFO:tasks.workunit.client.0.smithi117.stdout:4/10: write - no filename 2024-04-12T09:10:58.000 INFO:tasks.workunit.client.0.smithi117.stdout:4/11: write - no filename 2024-04-12T09:10:58.003 INFO:tasks.workunit.client.0.smithi117.stdout:5/9: dread f0 [0,4194304] 0 2024-04-12T09:10:58.008 INFO:tasks.workunit.client.0.smithi117.stdout:4/12: mkdir d0/d1/d2/d3 0 2024-04-12T09:10:58.010 INFO:tasks.workunit.client.0.smithi117.stdout:5/10: mkdir d2/d3 0 2024-04-12T09:10:58.012 INFO:tasks.workunit.client.0.smithi117.stdout:4/13: creat d0/f4 x:0 0 0 2024-04-12T09:10:58.012 INFO:tasks.workunit.client.0.smithi117.stdout:4/14: chown d0 651614 1 2024-04-12T09:10:58.013 INFO:tasks.workunit.client.0.smithi117.stdout:5/11: write f0 [3385658,18406] 0 2024-04-12T09:10:58.014 INFO:tasks.workunit.client.0.smithi117.stdout:5/12: write f0 [217653,6030] 0 2024-04-12T09:10:58.039 INFO:tasks.workunit.client.0.smithi117.stdout:8/42: sync 2024-04-12T09:10:58.039 INFO:tasks.workunit.client.0.smithi117.stdout:0/156: sync 2024-04-12T09:10:58.039 INFO:tasks.workunit.client.0.smithi117.stdout:6/23: sync 2024-04-12T09:10:58.039 INFO:tasks.workunit.client.0.smithi117.stdout:7/34: sync 2024-04-12T09:10:58.039 INFO:tasks.workunit.client.0.smithi117.stdout:6/24: rmdir - no directory 2024-04-12T09:10:58.039 INFO:tasks.workunit.client.0.smithi117.stdout:9/82: sync 2024-04-12T09:10:58.040 INFO:tasks.workunit.client.0.smithi117.stdout:8/43: stat db/fc 0 2024-04-12T09:10:58.041 INFO:tasks.workunit.client.0.smithi117.stdout:0/157: dread f0 [0,4194304] 0 2024-04-12T09:10:58.042 INFO:tasks.workunit.client.0.smithi117.stdout:6/25: creat f7 x:0 0 0 2024-04-12T09:10:58.042 INFO:tasks.workunit.client.0.smithi117.stdout:6/26: dread - f6 zero size 2024-04-12T09:10:58.044 INFO:tasks.workunit.client.0.smithi117.stdout:9/83: write d1/d8/f14 [1134768,72403] 0 2024-04-12T09:10:58.047 INFO:tasks.workunit.client.0.smithi117.stdout:7/35: fsync d0/d2/f3 0 2024-04-12T09:10:58.050 INFO:tasks.workunit.client.0.smithi117.stdout:6/27: dwrite f2 [4194304,4194304] 0 2024-04-12T09:10:58.052 INFO:tasks.workunit.client.0.smithi117.stdout:9/84: dread f0 [0,4194304] 0 2024-04-12T09:10:58.055 INFO:tasks.workunit.client.0.smithi117.stdout:8/44: creat db/dd/fe x:0 0 0 2024-04-12T09:10:58.056 INFO:tasks.workunit.client.0.smithi117.stdout:8/45: write fa [857065,4338] 0 2024-04-12T09:10:58.058 INFO:tasks.workunit.client.0.smithi117.stdout:7/36: symlink d0/d2/le 0 2024-04-12T09:10:58.060 INFO:tasks.workunit.client.0.smithi117.stdout:0/158: mkdir d3/d36 0 2024-04-12T09:10:58.061 INFO:tasks.workunit.client.0.smithi117.stdout:0/159: read d3/dc/f2c [286070,41665] 0 2024-04-12T09:10:58.062 INFO:tasks.workunit.client.0.smithi117.stdout:0/160: chown d3/lf 1 1 2024-04-12T09:10:58.065 INFO:tasks.workunit.client.0.smithi117.stdout:6/28: write f3 [4604279,19852] 0 2024-04-12T09:10:58.066 INFO:tasks.workunit.client.0.smithi117.stdout:6/29: write f6 [62031,124283] 0 2024-04-12T09:10:58.067 INFO:tasks.workunit.client.0.smithi117.stdout:6/30: write f7 [675061,37775] 0 2024-04-12T09:10:58.070 INFO:tasks.workunit.client.0.smithi117.stdout:9/85: mkdir d1/d8/df/d19 0 2024-04-12T09:10:58.071 INFO:tasks.workunit.client.0.smithi117.stdout:9/86: write d1/fc [3423385,87084] 0 2024-04-12T09:10:58.075 INFO:tasks.workunit.client.0.smithi117.stdout:0/161: write d3/dc/f1d [1016142,56761] 0 2024-04-12T09:10:58.079 INFO:tasks.workunit.client.0.smithi117.stdout:7/37: mknod d0/cf 0 2024-04-12T09:10:58.080 INFO:tasks.workunit.client.0.smithi117.stdout:7/38: write d0/d2/f4 [5529801,71571] 0 2024-04-12T09:10:58.081 INFO:tasks.workunit.client.0.smithi117.stdout:7/39: readlink d0/d2/le 0 2024-04-12T09:10:58.081 INFO:tasks.workunit.client.0.smithi117.stdout:9/87: symlink d1/d8/l1a 0 2024-04-12T09:10:58.087 INFO:tasks.workunit.client.0.smithi117.stdout:9/88: mkdir d1/d8/df/d1b 0 2024-04-12T09:10:58.088 INFO:tasks.workunit.client.0.smithi117.stdout:9/89: fdatasync d1/f7 0 2024-04-12T09:10:58.089 INFO:tasks.workunit.client.0.smithi117.stdout:7/40: dwrite d0/d2/fd [0,4194304] 0 2024-04-12T09:10:58.090 INFO:tasks.workunit.client.0.smithi117.stdout:7/41: chown d0/d2/fd 190608614 1 2024-04-12T09:10:58.101 INFO:tasks.workunit.client.0.smithi117.stdout:7/42: dwrite d0/d2/f5 [0,4194304] 0 2024-04-12T09:10:58.105 INFO:tasks.workunit.client.0.smithi117.stdout:7/43: unlink d0/cf 0 2024-04-12T09:10:58.107 INFO:tasks.workunit.client.0.smithi117.stdout:7/44: fdatasync d0/d2/f3 0 2024-04-12T09:10:58.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:57 smithi117 ceph-mon[29277]: pgmap v9: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 211 KiB/s rd, 15 MiB/s wr, 295 op/s 2024-04-12T09:10:58.247 INFO:tasks.workunit.client.0.smithi117.stdout:3/16: readlink l4 0 2024-04-12T09:10:58.248 INFO:tasks.workunit.client.0.smithi117.stdout:3/17: write f5 [484703,108590] 0 2024-04-12T09:10:58.251 INFO:tasks.workunit.client.0.smithi117.stdout:3/18: creat f7 x:0 0 0 2024-04-12T09:10:58.253 INFO:tasks.workunit.client.0.smithi117.stdout:3/19: symlink l8 0 2024-04-12T09:10:58.254 INFO:tasks.workunit.client.0.smithi117.stdout:3/20: symlink l9 0 2024-04-12T09:10:58.256 INFO:tasks.workunit.client.0.smithi117.stdout:3/21: creat fa x:0 0 0 2024-04-12T09:10:58.257 INFO:tasks.workunit.client.0.smithi117.stdout:3/22: creat fb x:0 0 0 2024-04-12T09:10:58.259 INFO:tasks.workunit.client.0.smithi117.stdout:3/23: creat fc x:0 0 0 2024-04-12T09:10:58.260 INFO:tasks.workunit.client.0.smithi117.stdout:3/24: creat fd x:0 0 0 2024-04-12T09:10:58.262 INFO:tasks.workunit.client.0.smithi117.stdout:3/25: unlink fd 0 2024-04-12T09:10:58.263 INFO:tasks.workunit.client.0.smithi117.stdout:3/26: fdatasync f2 0 2024-04-12T09:10:58.263 INFO:tasks.workunit.client.0.smithi117.stdout:3/27: rmdir - no directory 2024-04-12T09:10:58.266 INFO:tasks.workunit.client.0.smithi117.stdout:3/28: mkdir de 0 2024-04-12T09:10:58.268 INFO:tasks.workunit.client.0.smithi117.stdout:3/29: creat de/ff x:0 0 0 2024-04-12T09:10:58.284 INFO:tasks.workunit.client.0.smithi117.stdout:2/9: rename d0/d1 to d0/d4 0 2024-04-12T09:10:58.284 INFO:tasks.workunit.client.0.smithi117.stdout:2/10: chown d0 1623 1 2024-04-12T09:10:58.284 INFO:tasks.workunit.client.0.smithi117.stdout:2/11: readlink - no filename 2024-04-12T09:10:58.295 INFO:tasks.workunit.client.0.smithi117.stdout:1/19: truncate f0 1297189 0 2024-04-12T09:10:58.296 INFO:tasks.workunit.client.0.smithi117.stdout:2/12: dread d0/f3 [0,4194304] 0 2024-04-12T09:10:58.296 INFO:tasks.workunit.client.0.smithi117.stdout:2/13: chown d0 8 1 2024-04-12T09:10:58.297 INFO:tasks.workunit.client.0.smithi117.stdout:1/20: rmdir d1 39 2024-04-12T09:10:58.299 INFO:tasks.workunit.client.0.smithi117.stdout:2/14: write d0/f3 [1314069,80787] 0 2024-04-12T09:10:58.303 INFO:tasks.workunit.client.0.smithi117.stdout:2/15: mkdir d0/d4/d5 0 2024-04-12T09:10:58.304 INFO:tasks.workunit.client.0.smithi117.stdout:2/16: write d0/f3 [2059731,47690] 0 2024-04-12T09:10:58.304 INFO:tasks.workunit.client.0.smithi117.stdout:2/17: readlink - no filename 2024-04-12T09:10:58.309 INFO:tasks.workunit.client.0.smithi117.stdout:2/18: rmdir d0/d4/d5 0 2024-04-12T09:10:58.309 INFO:tasks.workunit.client.0.smithi117.stdout:2/19: chown d0/f3 1017 1 2024-04-12T09:10:58.310 INFO:tasks.workunit.client.0.smithi117.stdout:2/20: truncate d0/f3 2326304 0 2024-04-12T09:10:58.314 INFO:tasks.workunit.client.0.smithi117.stdout:2/21: dread d0/f3 [0,4194304] 0 2024-04-12T09:10:58.315 INFO:tasks.workunit.client.0.smithi117.stdout:2/22: chown d0/f3 55 1 2024-04-12T09:10:58.315 INFO:tasks.workunit.client.0.smithi117.stdout:2/23: chown d0 1816 1 2024-04-12T09:10:58.318 INFO:tasks.workunit.client.0.smithi117.stdout:4/15: rename d0/d1/d2 to d0/d5 0 2024-04-12T09:10:58.319 INFO:tasks.workunit.client.0.smithi117.stdout:5/13: rename d2 to d2/d3/d4 22 2024-04-12T09:10:58.319 INFO:tasks.workunit.client.0.smithi117.stdout:4/16: dread - d0/f4 zero size 2024-04-12T09:10:58.323 INFO:tasks.workunit.client.0.smithi117.stdout:8/46: rename l7 to db/dd/lf 0 2024-04-12T09:10:58.323 INFO:tasks.workunit.client.0.smithi117.stdout:5/14: dread f1 [0,4194304] 0 2024-04-12T09:10:58.327 INFO:tasks.workunit.client.0.smithi117.stdout:8/47: mknod db/c10 0 2024-04-12T09:10:58.328 INFO:tasks.workunit.client.0.smithi117.stdout:4/17: dwrite d0/f4 [0,4194304] 0 2024-04-12T09:10:58.333 INFO:tasks.workunit.client.0.smithi117.stdout:0/162: rename d3/l2b to d3/dc/l37 0 2024-04-12T09:10:58.337 INFO:tasks.workunit.client.0.smithi117.stdout:8/48: dwrite db/fc [0,4194304] 0 2024-04-12T09:10:58.338 INFO:tasks.workunit.client.0.smithi117.stdout:5/15: creat d2/d3/f5 x:0 0 0 2024-04-12T09:10:58.342 INFO:tasks.workunit.client.0.smithi117.stdout:8/49: dread db/fc [0,4194304] 0 2024-04-12T09:10:58.343 INFO:tasks.workunit.client.0.smithi117.stdout:5/16: dread f0 [0,4194304] 0 2024-04-12T09:10:58.343 INFO:tasks.workunit.client.0.smithi117.stdout:3/30: rename fc to de/f10 0 2024-04-12T09:10:58.343 INFO:tasks.workunit.client.0.smithi117.stdout:2/24: rename d0 to d0/d6 22 2024-04-12T09:10:58.345 INFO:tasks.workunit.client.0.smithi117.stdout:5/17: truncate d2/d3/f5 105348 0 2024-04-12T09:10:58.348 INFO:tasks.workunit.client.0.smithi117.stdout:0/163: unlink d3/dc/l26 0 2024-04-12T09:10:58.351 INFO:tasks.workunit.client.0.smithi117.stdout:0/164: truncate d3/dc/f13 441574 0 2024-04-12T09:10:58.351 INFO:tasks.workunit.client.0.smithi117.stdout:3/31: dwrite f5 [0,4194304] 0 2024-04-12T09:10:58.352 INFO:tasks.workunit.client.0.smithi117.stdout:3/32: dread - de/f10 zero size 2024-04-12T09:10:58.355 INFO:tasks.workunit.client.0.smithi117.stdout:8/50: creat db/dd/f11 x:0 0 0 2024-04-12T09:10:58.358 INFO:tasks.workunit.client.0.smithi117.stdout:2/25: fsync d0/f3 0 2024-04-12T09:10:58.359 INFO:tasks.workunit.client.0.smithi117.stdout:8/51: truncate fa 1396947 0 2024-04-12T09:10:58.363 INFO:tasks.workunit.client.0.smithi117.stdout:2/26: chown d0/d4/c2 1901007 1 2024-04-12T09:10:58.366 INFO:tasks.workunit.client.0.smithi117.stdout:2/27: chown d0/d4 40 1 2024-04-12T09:10:58.366 INFO:tasks.workunit.client.0.smithi117.stdout:0/165: dwrite d3/dc/f16 [0,4194304] 0 2024-04-12T09:10:58.368 INFO:tasks.workunit.client.0.smithi117.stdout:3/33: dwrite de/ff [0,4194304] 0 2024-04-12T09:10:58.368 INFO:tasks.workunit.client.0.smithi117.stdout:2/28: chown d0/d4 14625198 1 2024-04-12T09:10:58.369 INFO:tasks.workunit.client.0.smithi117.stdout:5/18: getdents d2 0 2024-04-12T09:10:58.371 INFO:tasks.workunit.client.0.smithi117.stdout:0/166: readlink l2 0 2024-04-12T09:10:58.372 INFO:tasks.workunit.client.0.smithi117.stdout:3/34: write f2 [2233638,31766] 0 2024-04-12T09:10:58.378 INFO:tasks.workunit.client.0.smithi117.stdout:3/35: mknod de/c11 0 2024-04-12T09:10:58.378 INFO:tasks.workunit.client.0.smithi117.stdout:0/167: creat d3/d30/f38 x:0 0 0 2024-04-12T09:10:58.380 INFO:tasks.workunit.client.0.smithi117.stdout:8/52: dwrite db/dd/f11 [0,4194304] 0 2024-04-12T09:10:58.381 INFO:tasks.workunit.client.0.smithi117.stdout:3/36: write de/ff [2567618,100562] 0 2024-04-12T09:10:58.388 INFO:tasks.workunit.client.0.smithi117.stdout:2/29: link d0/d4/c2 d0/d4/c7 0 2024-04-12T09:10:58.388 INFO:tasks.workunit.client.0.smithi117.stdout:5/19: dwrite f1 [0,4194304] 0 2024-04-12T09:10:58.392 INFO:tasks.workunit.client.0.smithi117.stdout:3/37: link f2 de/f12 0 2024-04-12T09:10:58.394 INFO:tasks.workunit.client.0.smithi117.stdout:0/168: dwrite d3/dc/f13 [0,4194304] 0 2024-04-12T09:10:58.397 INFO:tasks.workunit.client.0.smithi117.stdout:5/20: fdatasync f0 0 2024-04-12T09:10:58.400 INFO:tasks.workunit.client.0.smithi117.stdout:3/38: mkdir de/d13 0 2024-04-12T09:10:58.401 INFO:tasks.workunit.client.0.smithi117.stdout:0/169: write d3/dc/f2c [813103,121467] 0 2024-04-12T09:10:58.403 INFO:tasks.workunit.client.0.smithi117.stdout:0/170: write d3/d22/f2d [1278798,23486] 0 2024-04-12T09:10:58.406 INFO:tasks.workunit.client.0.smithi117.stdout:3/39: creat de/f14 x:0 0 0 2024-04-12T09:10:58.406 INFO:tasks.workunit.client.0.smithi117.stdout:3/40: stat de/ff 0 2024-04-12T09:10:58.409 INFO:tasks.workunit.client.0.smithi117.stdout:0/171: chown d3/l24 13 1 2024-04-12T09:10:58.414 INFO:tasks.workunit.client.0.smithi117.stdout:0/172: rename d3/f7 to d3/f39 0 2024-04-12T09:10:58.415 INFO:tasks.workunit.client.0.smithi117.stdout:5/21: fdatasync f1 0 2024-04-12T09:10:58.417 INFO:tasks.workunit.client.0.smithi117.stdout:3/41: dwrite de/f12 [4194304,4194304] 0 2024-04-12T09:10:58.417 INFO:tasks.workunit.client.0.smithi117.stdout:5/22: write f0 [2987997,88580] 0 2024-04-12T09:10:58.418 INFO:tasks.workunit.client.0.smithi117.stdout:5/23: chown f1 384484811 1 2024-04-12T09:10:58.423 INFO:tasks.workunit.client.0.smithi117.stdout:5/24: creat d2/f6 x:0 0 0 2024-04-12T09:10:58.428 INFO:tasks.workunit.client.0.smithi117.stdout:3/42: link f7 de/f15 0 2024-04-12T09:10:58.429 INFO:tasks.workunit.client.0.smithi117.stdout:6/31: sync 2024-04-12T09:10:58.429 INFO:tasks.workunit.client.0.smithi117.stdout:6/32: stat f6 0 2024-04-12T09:10:58.429 INFO:tasks.workunit.client.0.smithi117.stdout:5/25: chown f1 80500 1 2024-04-12T09:10:58.433 INFO:tasks.workunit.client.0.smithi117.stdout:6/33: dread f3 [0,4194304] 0 2024-04-12T09:10:58.434 INFO:tasks.workunit.client.0.smithi117.stdout:5/26: symlink d2/l7 0 2024-04-12T09:10:58.434 INFO:tasks.workunit.client.0.smithi117.stdout:5/27: fdatasync d2/f6 0 2024-04-12T09:10:58.435 INFO:tasks.workunit.client.0.smithi117.stdout:5/28: truncate f0 4685948 0 2024-04-12T09:10:58.436 INFO:tasks.workunit.client.0.smithi117.stdout:3/43: mknod de/d13/c16 0 2024-04-12T09:10:58.436 INFO:tasks.workunit.client.0.smithi117.stdout:7/45: rmdir d0 39 2024-04-12T09:10:58.443 INFO:tasks.workunit.client.0.smithi117.stdout:3/44: rename de/d13/c16 to de/d13/c17 0 2024-04-12T09:10:58.448 INFO:tasks.workunit.client.0.smithi117.stdout:3/45: symlink de/d13/l18 0 2024-04-12T09:10:58.449 INFO:tasks.workunit.client.0.smithi117.stdout:7/46: creat d0/da/f10 x:0 0 0 2024-04-12T09:10:58.451 INFO:tasks.workunit.client.0.smithi117.stdout:3/46: mkdir de/d13/d19 0 2024-04-12T09:10:58.452 INFO:tasks.workunit.client.0.smithi117.stdout:3/47: readlink l4 0 2024-04-12T09:10:58.455 INFO:tasks.workunit.client.0.smithi117.stdout:3/48: creat de/d13/f1a x:0 0 0 2024-04-12T09:10:58.456 INFO:tasks.workunit.client.0.smithi117.stdout:3/49: readlink de/d13/l18 0 2024-04-12T09:10:58.456 INFO:tasks.workunit.client.0.smithi117.stdout:7/47: getdents d0 0 2024-04-12T09:10:58.457 INFO:tasks.workunit.client.0.smithi117.stdout:7/48: chown d0 0 1 2024-04-12T09:10:58.459 INFO:tasks.workunit.client.0.smithi117.stdout:3/50: creat de/d13/f1b x:0 0 0 2024-04-12T09:10:58.460 INFO:tasks.workunit.client.0.smithi117.stdout:3/51: write de/d13/f1a [753545,67914] 0 2024-04-12T09:10:58.461 INFO:tasks.workunit.client.0.smithi117.stdout:7/49: dread d0/d2/f4 [0,4194304] 0 2024-04-12T09:10:58.461 INFO:tasks.workunit.client.0.smithi117.stdout:3/52: readlink de/d13/l18 0 2024-04-12T09:10:58.462 INFO:tasks.workunit.client.0.smithi117.stdout:7/50: fdatasync d0/d2/f8 0 2024-04-12T09:10:58.462 INFO:tasks.workunit.client.0.smithi117.stdout:3/53: chown de/f15 14 1 2024-04-12T09:10:58.462 INFO:tasks.workunit.client.0.smithi117.stdout:3/54: stat de/c11 0 2024-04-12T09:10:58.466 INFO:tasks.workunit.client.0.smithi117.stdout:3/55: symlink de/d13/d19/l1c 0 2024-04-12T09:10:58.467 INFO:tasks.workunit.client.0.smithi117.stdout:3/56: chown de/d13/f1b 364583 1 2024-04-12T09:10:58.468 INFO:tasks.workunit.client.0.smithi117.stdout:3/57: write de/f12 [2980858,48516] 0 2024-04-12T09:10:58.469 INFO:tasks.workunit.client.0.smithi117.stdout:3/58: truncate de/d13/f1a 1514261 0 2024-04-12T09:10:58.472 INFO:tasks.workunit.client.0.smithi117.stdout:3/59: dread f5 [0,4194304] 0 2024-04-12T09:10:58.475 INFO:tasks.workunit.client.0.smithi117.stdout:3/60: symlink de/d13/l1d 0 2024-04-12T09:10:58.475 INFO:tasks.workunit.client.0.smithi117.stdout:3/61: stat de/c11 0 2024-04-12T09:10:58.477 INFO:tasks.workunit.client.0.smithi117.stdout:3/62: rename l4 to de/d13/l1e 0 2024-04-12T09:10:58.482 INFO:tasks.workunit.client.0.smithi117.stdout:3/63: dwrite de/f12 [4194304,4194304] 0 2024-04-12T09:10:58.483 INFO:tasks.workunit.client.0.smithi117.stdout:3/64: dread - de/f14 zero size 2024-04-12T09:10:58.487 INFO:tasks.workunit.client.0.smithi117.stdout:3/65: rename c0 to de/d13/d19/c1f 0 2024-04-12T09:10:58.494 INFO:tasks.workunit.client.0.smithi117.stdout:3/66: dwrite de/f12 [4194304,4194304] 0 2024-04-12T09:10:58.495 INFO:tasks.workunit.client.0.smithi117.stdout:3/67: chown de/c11 889 1 2024-04-12T09:10:58.496 INFO:tasks.workunit.client.0.smithi117.stdout:3/68: fdatasync f5 0 2024-04-12T09:10:58.499 INFO:tasks.workunit.client.0.smithi117.stdout:3/69: unlink l8 0 2024-04-12T09:10:58.500 INFO:tasks.workunit.client.0.smithi117.stdout:3/70: truncate de/d13/f1b 929221 0 2024-04-12T09:10:58.502 INFO:tasks.workunit.client.0.smithi117.stdout:3/71: symlink de/d13/l20 0 2024-04-12T09:10:58.526 INFO:tasks.workunit.client.0.smithi117.stdout:4/18: write d0/f4 [4199645,90779] 0 2024-04-12T09:10:58.526 INFO:tasks.workunit.client.0.smithi117.stdout:8/53: link db/dd/lf db/dd/l12 0 2024-04-12T09:10:58.527 INFO:tasks.workunit.client.0.smithi117.stdout:4/19: write d0/f4 [489644,107774] 0 2024-04-12T09:10:58.530 INFO:tasks.workunit.client.0.smithi117.stdout:8/54: dread db/dd/f11 [0,4194304] 0 2024-04-12T09:10:58.551 INFO:tasks.workunit.client.0.smithi117.stdout:0/173: write d3/f20 [1910694,6764] 0 2024-04-12T09:10:58.554 INFO:tasks.workunit.client.0.smithi117.stdout:0/174: mknod d3/d30/d32/c3a 0 2024-04-12T09:10:58.557 INFO:tasks.workunit.client.0.smithi117.stdout:0/175: creat d3/dc/f3b x:0 0 0 2024-04-12T09:10:58.559 INFO:tasks.workunit.client.0.smithi117.stdout:0/176: dread d3/f23 [0,4194304] 0 2024-04-12T09:10:58.561 INFO:tasks.workunit.client.0.smithi117.stdout:0/177: truncate d3/dc/f1d 4672341 0 2024-04-12T09:10:58.563 INFO:tasks.workunit.client.0.smithi117.stdout:6/34: truncate f3 2753740 0 2024-04-12T09:10:58.564 INFO:tasks.workunit.client.0.smithi117.stdout:0/178: creat d3/d30/d32/f3c x:0 0 0 2024-04-12T09:10:58.565 INFO:tasks.workunit.client.0.smithi117.stdout:5/29: truncate f0 1592310 0 2024-04-12T09:10:58.565 INFO:tasks.workunit.client.0.smithi117.stdout:0/179: chown d3/fe 23352332 1 2024-04-12T09:10:58.566 INFO:tasks.workunit.client.0.smithi117.stdout:5/30: dread - d2/f6 zero size 2024-04-12T09:10:58.566 INFO:tasks.workunit.client.0.smithi117.stdout:5/31: rename d2 to d2/d8 22 2024-04-12T09:10:58.566 INFO:tasks.workunit.client.0.smithi117.stdout:6/35: mkdir d8 0 2024-04-12T09:10:58.566 INFO:tasks.workunit.client.0.smithi117.stdout:6/36: readlink l5 0 2024-04-12T09:10:58.568 INFO:tasks.workunit.client.0.smithi117.stdout:7/51: rmdir d0/da 39 2024-04-12T09:10:58.574 INFO:tasks.workunit.client.0.smithi117.stdout:7/52: readlink d0/d2/le 0 2024-04-12T09:10:58.574 INFO:tasks.workunit.client.0.smithi117.stdout:7/53: chown d0/d2/c6 14 1 2024-04-12T09:10:58.577 INFO:tasks.workunit.client.0.smithi117.stdout:7/54: symlink d0/d2/l11 0 2024-04-12T09:10:58.577 INFO:tasks.workunit.client.0.smithi117.stdout:7/55: stat d0/d2/f8 0 2024-04-12T09:10:58.579 INFO:tasks.workunit.client.0.smithi117.stdout:7/56: mkdir d0/d2/d12 0 2024-04-12T09:10:58.581 INFO:tasks.workunit.client.0.smithi117.stdout:7/57: readlink d0/l9 0 2024-04-12T09:10:58.659 INFO:tasks.workunit.client.0.smithi117.stdout:9/90: sync 2024-04-12T09:10:58.660 INFO:tasks.workunit.client.0.smithi117.stdout:3/72: getdents de/d13 0 2024-04-12T09:10:58.660 INFO:tasks.workunit.client.0.smithi117.stdout:9/91: write d1/d8/f14 [2940243,116595] 0 2024-04-12T09:10:58.661 INFO:tasks.workunit.client.0.smithi117.stdout:4/20: truncate d0/f4 3116254 0 2024-04-12T09:10:58.663 INFO:tasks.workunit.client.0.smithi117.stdout:3/73: truncate de/f10 180588 0 2024-04-12T09:10:58.664 INFO:tasks.workunit.client.0.smithi117.stdout:9/92: write d1/f15 [202530,55012] 0 2024-04-12T09:10:58.665 INFO:tasks.workunit.client.0.smithi117.stdout:6/37: truncate f2 1418457 0 2024-04-12T09:10:58.666 INFO:tasks.workunit.client.0.smithi117.stdout:5/32: dread f0 [0,4194304] 0 2024-04-12T09:10:58.668 INFO:tasks.workunit.client.0.smithi117.stdout:3/74: chown de/d13/d19/l1c 6921 1 2024-04-12T09:10:58.668 INFO:tasks.workunit.client.0.smithi117.stdout:1/21: dwrite f0 [0,4194304] 0 2024-04-12T09:10:58.669 INFO:tasks.workunit.client.0.smithi117.stdout:6/38: unlink l5 0 2024-04-12T09:10:58.675 INFO:tasks.workunit.client.0.smithi117.stdout:9/93: dread d1/d8/f10 [0,4194304] 0 2024-04-12T09:10:58.677 INFO:tasks.workunit.client.0.smithi117.stdout:3/75: dwrite de/ff [0,4194304] 0 2024-04-12T09:10:58.677 INFO:tasks.workunit.client.0.smithi117.stdout:9/94: read d1/f3 [47951,81463] 0 2024-04-12T09:10:58.678 INFO:tasks.workunit.client.0.smithi117.stdout:5/33: symlink d2/d3/l9 0 2024-04-12T09:10:58.679 INFO:tasks.workunit.client.0.smithi117.stdout:9/95: fsync d1/f18 0 2024-04-12T09:10:58.679 INFO:tasks.workunit.client.0.smithi117.stdout:6/39: dread f7 [0,4194304] 0 2024-04-12T09:10:58.680 INFO:tasks.workunit.client.0.smithi117.stdout:5/34: write d2/f6 [1010308,121638] 0 2024-04-12T09:10:58.687 INFO:tasks.workunit.client.0.smithi117.stdout:3/76: rmdir de/d13 39 2024-04-12T09:10:58.691 INFO:tasks.workunit.client.0.smithi117.stdout:5/35: rename d2/d3/l9 to d2/d3/la 0 2024-04-12T09:10:58.696 INFO:tasks.workunit.client.0.smithi117.stdout:6/40: mkdir d8/d9 0 2024-04-12T09:10:58.699 INFO:tasks.workunit.client.0.smithi117.stdout:9/96: mknod d1/d8/d12/c1c 0 2024-04-12T09:10:58.700 INFO:tasks.workunit.client.0.smithi117.stdout:7/58: mkdir d0/d13 0 2024-04-12T09:10:58.702 INFO:tasks.workunit.client.0.smithi117.stdout:5/36: symlink d2/lb 0 2024-04-12T09:10:58.708 INFO:tasks.workunit.client.0.smithi117.stdout:7/59: unlink d0/d2/f4 0 2024-04-12T09:10:58.710 INFO:tasks.workunit.client.0.smithi117.stdout:5/37: creat d2/fc x:0 0 0 2024-04-12T09:10:58.713 INFO:tasks.workunit.client.0.smithi117.stdout:9/97: link d1/d8/f10 d1/d8/df/d19/f1d 0 2024-04-12T09:10:58.716 INFO:tasks.workunit.client.0.smithi117.stdout:5/38: mkdir d2/d3/dd 0 2024-04-12T09:10:58.718 INFO:tasks.workunit.client.0.smithi117.stdout:3/77: getdents de/d13 0 2024-04-12T09:10:58.718 INFO:tasks.workunit.client.0.smithi117.stdout:3/78: dread - f7 zero size 2024-04-12T09:10:58.721 INFO:tasks.workunit.client.0.smithi117.stdout:1/22: write f0 [4651542,32096] 0 2024-04-12T09:10:58.722 INFO:tasks.workunit.client.0.smithi117.stdout:7/60: mkdir d0/d2/d12/d14 0 2024-04-12T09:10:58.724 INFO:tasks.workunit.client.0.smithi117.stdout:5/39: mkdir d2/d3/de 0 2024-04-12T09:10:58.725 INFO:tasks.workunit.client.0.smithi117.stdout:5/40: write d2/d3/f5 [447486,93896] 0 2024-04-12T09:10:58.726 INFO:tasks.workunit.client.0.smithi117.stdout:5/41: write d2/fc [319107,73435] 0 2024-04-12T09:10:58.729 INFO:tasks.workunit.client.0.smithi117.stdout:6/41: dread f3 [0,4194304] 0 2024-04-12T09:10:58.736 INFO:tasks.workunit.client.0.smithi117.stdout:4/21: dwrite d0/f4 [0,4194304] 0 2024-04-12T09:10:58.745 INFO:tasks.workunit.client.0.smithi117.stdout:3/79: rename fb to de/f21 0 2024-04-12T09:10:58.746 INFO:tasks.workunit.client.0.smithi117.stdout:1/23: mknod d1/d4/c5 0 2024-04-12T09:10:58.747 INFO:tasks.workunit.client.0.smithi117.stdout:1/24: stat d1/d4/c5 0 2024-04-12T09:10:58.747 INFO:tasks.workunit.client.0.smithi117.stdout:1/25: write f0 [3459009,20925] 0 2024-04-12T09:10:58.748 INFO:tasks.workunit.client.0.smithi117.stdout:1/26: read f0 [4669617,12275] 0 2024-04-12T09:10:58.748 INFO:tasks.workunit.client.0.smithi117.stdout:1/27: read f0 [2321702,49018] 0 2024-04-12T09:10:58.749 INFO:tasks.workunit.client.0.smithi117.stdout:4/22: link d0/f4 d0/d5/f6 0 2024-04-12T09:10:58.752 INFO:tasks.workunit.client.0.smithi117.stdout:5/42: rename d2/fc to d2/d3/ff 0 2024-04-12T09:10:58.753 INFO:tasks.workunit.client.0.smithi117.stdout:1/28: fsync f0 0 2024-04-12T09:10:58.753 INFO:tasks.workunit.client.0.smithi117.stdout:5/43: truncate d2/f6 1678138 0 2024-04-12T09:10:58.754 INFO:tasks.workunit.client.0.smithi117.stdout:5/44: rename d2/d3 to d2/d3/d10 22 2024-04-12T09:10:58.756 INFO:tasks.workunit.client.0.smithi117.stdout:3/80: mkdir de/d13/d19/d22 0 2024-04-12T09:10:58.759 INFO:tasks.workunit.client.0.smithi117.stdout:1/29: dwrite f0 [0,4194304] 0 2024-04-12T09:10:58.761 INFO:tasks.workunit.client.0.smithi117.stdout:4/23: unlink d0/d5/f6 0 2024-04-12T09:10:58.762 INFO:tasks.workunit.client.0.smithi117.stdout:4/24: stat d0/d5 0 2024-04-12T09:10:58.767 INFO:tasks.workunit.client.0.smithi117.stdout:3/81: creat de/d13/f23 x:0 0 0 2024-04-12T09:10:58.767 INFO:tasks.workunit.client.0.smithi117.stdout:3/82: dread - f7 zero size 2024-04-12T09:10:58.769 INFO:tasks.workunit.client.0.smithi117.stdout:1/30: rmdir d1/d4 39 2024-04-12T09:10:58.772 INFO:tasks.workunit.client.0.smithi117.stdout:4/25: chown d0/f4 30902 1 2024-04-12T09:10:58.773 INFO:tasks.workunit.client.0.smithi117.stdout:6/42: write f2 [397977,76054] 0 2024-04-12T09:10:58.778 INFO:tasks.workunit.client.0.smithi117.stdout:3/83: rename f5 to de/d13/f24 0 2024-04-12T09:10:58.779 INFO:tasks.workunit.client.0.smithi117.stdout:3/84: dread - de/f15 zero size 2024-04-12T09:10:58.783 INFO:tasks.workunit.client.0.smithi117.stdout:9/98: truncate d1/d8/fa 2086806 0 2024-04-12T09:10:58.785 INFO:tasks.workunit.client.0.smithi117.stdout:1/31: dwrite f0 [0,4194304] 0 2024-04-12T09:10:58.785 INFO:tasks.workunit.client.0.smithi117.stdout:1/32: chown f0 22 1 2024-04-12T09:10:58.787 INFO:tasks.workunit.client.0.smithi117.stdout:3/85: symlink de/d13/d19/l25 0 2024-04-12T09:10:58.790 INFO:tasks.workunit.client.0.smithi117.stdout:4/26: link d0/f4 d0/d1/f7 0 2024-04-12T09:10:58.791 INFO:tasks.workunit.client.0.smithi117.stdout:6/43: creat d8/d9/fa x:0 0 0 2024-04-12T09:10:58.794 INFO:tasks.workunit.client.0.smithi117.stdout:6/44: dread f3 [0,4194304] 0 2024-04-12T09:10:58.795 INFO:tasks.workunit.client.0.smithi117.stdout:1/33: readlink d1/l3 0 2024-04-12T09:10:58.796 INFO:tasks.workunit.client.0.smithi117.stdout:1/34: read f0 [1650879,15422] 0 2024-04-12T09:10:58.797 INFO:tasks.workunit.client.0.smithi117.stdout:3/86: unlink de/f21 0 2024-04-12T09:10:58.801 INFO:tasks.workunit.client.0.smithi117.stdout:6/45: creat d8/d9/fb x:0 0 0 2024-04-12T09:10:58.806 INFO:tasks.workunit.client.0.smithi117.stdout:4/27: link d0/f4 d0/d5/f8 0 2024-04-12T09:10:58.807 INFO:tasks.workunit.client.0.smithi117.stdout:6/46: creat d8/fc x:0 0 0 2024-04-12T09:10:58.809 INFO:tasks.workunit.client.0.smithi117.stdout:5/45: truncate d2/f6 805408 0 2024-04-12T09:10:58.811 INFO:tasks.workunit.client.0.smithi117.stdout:1/35: mkdir d1/d6 0 2024-04-12T09:10:58.811 INFO:tasks.workunit.client.0.smithi117.stdout:5/46: dread f0 [0,4194304] 0 2024-04-12T09:10:58.812 INFO:tasks.workunit.client.0.smithi117.stdout:3/87: mknod de/c26 0 2024-04-12T09:10:58.817 INFO:tasks.workunit.client.0.smithi117.stdout:6/47: symlink d8/d9/ld 0 2024-04-12T09:10:58.818 INFO:tasks.workunit.client.0.smithi117.stdout:6/48: chown d8/fc 14012580 1 2024-04-12T09:10:58.820 INFO:tasks.workunit.client.0.smithi117.stdout:5/47: mknod d2/c11 0 2024-04-12T09:10:58.821 INFO:tasks.workunit.client.0.smithi117.stdout:3/88: mkdir de/d13/d19/d27 0 2024-04-12T09:10:58.823 INFO:tasks.workunit.client.0.smithi117.stdout:9/99: write d1/d8/f10 [3093794,64657] 0 2024-04-12T09:10:58.824 INFO:tasks.workunit.client.0.smithi117.stdout:1/36: dwrite f0 [0,4194304] 0 2024-04-12T09:10:58.825 INFO:tasks.workunit.client.0.smithi117.stdout:9/100: fdatasync d1/d8/df/f13 0 2024-04-12T09:10:58.826 INFO:tasks.workunit.client.0.smithi117.stdout:6/49: mknod d8/ce 0 2024-04-12T09:10:58.827 INFO:tasks.workunit.client.0.smithi117.stdout:6/50: truncate d8/d9/fa 11732 0 2024-04-12T09:10:58.832 INFO:tasks.workunit.client.0.smithi117.stdout:5/48: dwrite f0 [0,4194304] 0 2024-04-12T09:10:58.832 INFO:tasks.workunit.client.0.smithi117.stdout:9/101: unlink d1/cb 0 2024-04-12T09:10:58.833 INFO:tasks.workunit.client.0.smithi117.stdout:5/49: chown d2/d3/f5 2 1 2024-04-12T09:10:58.833 INFO:tasks.workunit.client.0.smithi117.stdout:5/50: chown d2/l7 130494 1 2024-04-12T09:10:58.839 INFO:tasks.workunit.client.0.smithi117.stdout:3/89: creat de/d13/d19/d22/f28 x:0 0 0 2024-04-12T09:10:58.840 INFO:tasks.workunit.client.0.smithi117.stdout:1/37: mkdir d1/d4/d7 0 2024-04-12T09:10:58.842 INFO:tasks.workunit.client.0.smithi117.stdout:1/38: rename d1/d4 to d1/d4/d8 22 2024-04-12T09:10:58.844 INFO:tasks.workunit.client.0.smithi117.stdout:9/102: creat d1/d8/d12/f1e x:0 0 0 2024-04-12T09:10:58.846 INFO:tasks.workunit.client.0.smithi117.stdout:9/103: truncate d1/d8/df/f13 280241 0 2024-04-12T09:10:58.848 INFO:tasks.workunit.client.0.smithi117.stdout:4/28: dwrite d0/d5/f8 [0,4194304] 0 2024-04-12T09:10:58.848 INFO:tasks.workunit.client.0.smithi117.stdout:3/90: creat de/d13/d19/f29 x:0 0 0 2024-04-12T09:10:58.849 INFO:tasks.workunit.client.0.smithi117.stdout:3/91: chown de/c11 6 1 2024-04-12T09:10:58.850 INFO:tasks.workunit.client.0.smithi117.stdout:3/92: truncate de/f10 918920 0 2024-04-12T09:10:58.850 INFO:tasks.workunit.client.0.smithi117.stdout:5/51: getdents d2/d3/dd 0 2024-04-12T09:10:58.851 INFO:tasks.workunit.client.0.smithi117.stdout:2/30: sync 2024-04-12T09:10:58.854 INFO:tasks.workunit.client.0.smithi117.stdout:4/29: mknod d0/d5/c9 0 2024-04-12T09:10:58.858 INFO:tasks.workunit.client.0.smithi117.stdout:2/31: dread d0/f3 [0,4194304] 0 2024-04-12T09:10:58.859 INFO:tasks.workunit.client.0.smithi117.stdout:2/32: chown d0/d4 7 1 2024-04-12T09:10:58.859 INFO:tasks.workunit.client.0.smithi117.stdout:1/39: rename d1/d4/d7 to d1/d9 0 2024-04-12T09:10:58.859 INFO:tasks.workunit.client.0.smithi117.stdout:3/93: dwrite f2 [0,4194304] 0 2024-04-12T09:10:58.860 INFO:tasks.workunit.client.0.smithi117.stdout:2/33: fdatasync d0/f3 0 2024-04-12T09:10:58.860 INFO:tasks.workunit.client.0.smithi117.stdout:1/40: stat f0 0 2024-04-12T09:10:58.861 INFO:tasks.workunit.client.0.smithi117.stdout:3/94: dread - de/d13/f23 zero size 2024-04-12T09:10:58.861 INFO:tasks.workunit.client.0.smithi117.stdout:5/52: creat d2/d3/dd/f12 x:0 0 0 2024-04-12T09:10:58.862 INFO:tasks.workunit.client.0.smithi117.stdout:2/34: write d0/f3 [1615851,68641] 0 2024-04-12T09:10:58.862 INFO:tasks.workunit.client.0.smithi117.stdout:1/41: write f0 [2787831,32323] 0 2024-04-12T09:10:58.867 INFO:tasks.workunit.client.0.smithi117.stdout:4/30: fsync d0/d5/f8 0 2024-04-12T09:10:58.868 INFO:tasks.workunit.client.0.smithi117.stdout:2/35: fdatasync d0/f3 0 2024-04-12T09:10:58.869 INFO:tasks.workunit.client.0.smithi117.stdout:5/53: dread d2/d3/ff [0,4194304] 0 2024-04-12T09:10:58.870 INFO:tasks.workunit.client.0.smithi117.stdout:4/31: write d0/d5/f8 [1414310,50144] 0 2024-04-12T09:10:58.872 INFO:tasks.workunit.client.0.smithi117.stdout:3/95: dread f2 [0,4194304] 0 2024-04-12T09:10:58.878 INFO:tasks.workunit.client.0.smithi117.stdout:1/42: dwrite f0 [4194304,4194304] 0 2024-04-12T09:10:58.879 INFO:tasks.workunit.client.0.smithi117.stdout:3/96: write de/d13/d19/d22/f28 [968742,88026] 0 2024-04-12T09:10:58.881 INFO:tasks.workunit.client.0.smithi117.stdout:1/43: write f0 [2566449,49279] 0 2024-04-12T09:10:58.883 INFO:tasks.workunit.client.0.smithi117.stdout:6/51: dwrite f7 [0,4194304] 0 2024-04-12T09:10:58.884 INFO:tasks.workunit.client.0.smithi117.stdout:2/36: dwrite d0/f3 [0,4194304] 0 2024-04-12T09:10:58.898 INFO:tasks.workunit.client.0.smithi117.stdout:2/37: dwrite d0/f3 [0,4194304] 0 2024-04-12T09:10:58.899 INFO:tasks.workunit.client.0.smithi117.stdout:6/52: creat d8/ff x:0 0 0 2024-04-12T09:10:58.900 INFO:tasks.workunit.client.0.smithi117.stdout:5/54: rmdir d2/d3 39 2024-04-12T09:10:58.900 INFO:tasks.workunit.client.0.smithi117.stdout:6/53: fsync f6 0 2024-04-12T09:10:58.906 INFO:tasks.workunit.client.0.smithi117.stdout:3/97: creat de/d13/d19/d27/f2a x:0 0 0 2024-04-12T09:10:58.908 INFO:tasks.workunit.client.0.smithi117.stdout:6/54: dwrite f6 [0,4194304] 0 2024-04-12T09:10:58.909 INFO:tasks.workunit.client.0.smithi117.stdout:6/55: read - d8/fc zero size 2024-04-12T09:10:58.909 INFO:tasks.workunit.client.0.smithi117.stdout:3/98: read de/d13/d19/d22/f28 [491957,83851] 0 2024-04-12T09:10:58.912 INFO:tasks.workunit.client.0.smithi117.stdout:6/56: dread f3 [0,4194304] 0 2024-04-12T09:10:58.913 INFO:tasks.workunit.client.0.smithi117.stdout:2/38: symlink d0/l8 0 2024-04-12T09:10:58.913 INFO:tasks.workunit.client.0.smithi117.stdout:2/39: stat d0/f3 0 2024-04-12T09:10:58.919 INFO:tasks.workunit.client.0.smithi117.stdout:3/99: dread de/d13/f1a [0,4194304] 0 2024-04-12T09:10:58.920 INFO:tasks.workunit.client.0.smithi117.stdout:3/100: chown de/d13/f23 3245522 1 2024-04-12T09:10:58.922 INFO:tasks.workunit.client.0.smithi117.stdout:2/40: fsync d0/f3 0 2024-04-12T09:10:58.923 INFO:tasks.workunit.client.0.smithi117.stdout:4/32: truncate d0/f4 1144173 0 2024-04-12T09:10:58.925 INFO:tasks.workunit.client.0.smithi117.stdout:5/55: unlink d2/d3/f5 0 2024-04-12T09:10:58.930 INFO:tasks.workunit.client.0.smithi117.stdout:1/44: truncate f0 3683031 0 2024-04-12T09:10:58.931 INFO:tasks.workunit.client.0.smithi117.stdout:2/41: mknod d0/c9 0 2024-04-12T09:10:58.937 INFO:tasks.workunit.client.0.smithi117.stdout:2/42: dwrite d0/f3 [4194304,4194304] 0 2024-04-12T09:10:58.938 INFO:tasks.workunit.client.0.smithi117.stdout:2/43: truncate d0/f3 8439627 0 2024-04-12T09:10:58.939 INFO:tasks.workunit.client.0.smithi117.stdout:3/101: symlink de/l2b 0 2024-04-12T09:10:58.940 INFO:tasks.workunit.client.0.smithi117.stdout:3/102: chown de/d13/d19/d27/f2a 8088 1 2024-04-12T09:10:58.942 INFO:tasks.workunit.client.0.smithi117.stdout:2/44: dread d0/f3 [4194304,4194304] 0 2024-04-12T09:10:58.942 INFO:tasks.workunit.client.0.smithi117.stdout:1/45: rmdir d1 39 2024-04-12T09:10:58.947 INFO:tasks.workunit.client.0.smithi117.stdout:2/45: dread d0/f3 [0,4194304] 0 2024-04-12T09:10:58.949 INFO:tasks.workunit.client.0.smithi117.stdout:6/57: dwrite f3 [0,4194304] 0 2024-04-12T09:10:58.950 INFO:tasks.workunit.client.0.smithi117.stdout:6/58: fsync d8/ff 0 2024-04-12T09:10:58.951 INFO:tasks.workunit.client.0.smithi117.stdout:6/59: write d8/d9/fa [375430,54841] 0 2024-04-12T09:10:58.960 INFO:tasks.workunit.client.0.smithi117.stdout:2/46: mknod d0/d4/ca 0 2024-04-12T09:10:58.962 INFO:tasks.workunit.client.0.smithi117.stdout:3/103: mkdir de/d2c 0 2024-04-12T09:10:58.963 INFO:tasks.workunit.client.0.smithi117.stdout:3/104: dread - de/f14 zero size 2024-04-12T09:10:58.963 INFO:tasks.workunit.client.0.smithi117.stdout:3/105: chown de/d13/l18 5 1 2024-04-12T09:10:58.972 INFO:tasks.workunit.client.0.smithi117.stdout:1/46: mkdir d1/d6/da 0 2024-04-12T09:10:58.975 INFO:tasks.workunit.client.0.smithi117.stdout:3/106: mknod de/d2c/c2d 0 2024-04-12T09:10:58.975 INFO:tasks.workunit.client.0.smithi117.stdout:2/47: dwrite d0/f3 [0,4194304] 0 2024-04-12T09:10:58.975 INFO:tasks.workunit.client.0.smithi117.stdout:7/61: sync 2024-04-12T09:10:58.975 INFO:tasks.workunit.client.0.smithi117.stdout:0/180: sync 2024-04-12T09:10:58.975 INFO:tasks.workunit.client.0.smithi117.stdout:8/55: sync 2024-04-12T09:10:58.977 INFO:tasks.workunit.client.0.smithi117.stdout:7/62: dread - d0/d2/f8 zero size 2024-04-12T09:10:58.978 INFO:tasks.workunit.client.0.smithi117.stdout:1/47: unlink d1/d4/c5 0 2024-04-12T09:10:58.980 INFO:tasks.workunit.client.0.smithi117.stdout:7/63: write d0/d2/f5 [2761579,102210] 0 2024-04-12T09:10:58.981 INFO:tasks.workunit.client.0.smithi117.stdout:8/56: mkdir db/d13 0 2024-04-12T09:10:58.981 INFO:tasks.workunit.client.0.smithi117.stdout:5/56: dwrite d2/f6 [0,4194304] 0 2024-04-12T09:10:58.983 INFO:tasks.workunit.client.0.smithi117.stdout:5/57: dread d2/d3/ff [0,4194304] 0 2024-04-12T09:10:58.984 INFO:tasks.workunit.client.0.smithi117.stdout:0/181: fdatasync d3/f6 0 2024-04-12T09:10:58.987 INFO:tasks.workunit.client.0.smithi117.stdout:2/48: creat d0/d4/fb x:0 0 0 2024-04-12T09:10:58.989 INFO:tasks.workunit.client.0.smithi117.stdout:2/49: write d0/f3 [5856074,45715] 0 2024-04-12T09:10:58.991 INFO:tasks.workunit.client.0.smithi117.stdout:5/58: dwrite d2/f6 [0,4194304] 0 2024-04-12T09:10:58.991 INFO:tasks.workunit.client.0.smithi117.stdout:4/33: truncate d0/d1/f7 2064823 0 2024-04-12T09:10:58.991 INFO:tasks.workunit.client.0.smithi117.stdout:5/59: fdatasync f1 0 2024-04-12T09:10:58.992 INFO:tasks.workunit.client.0.smithi117.stdout:5/60: stat d2/l7 0 2024-04-12T09:10:58.998 INFO:tasks.workunit.client.0.smithi117.stdout:8/57: rename db/c10 to db/dd/c14 0 2024-04-12T09:10:59.001 INFO:tasks.workunit.client.0.smithi117.stdout:7/64: dwrite d0/da/f10 [0,4194304] 0 2024-04-12T09:10:59.004 INFO:tasks.workunit.client.0.smithi117.stdout:0/182: creat d3/d30/f3d x:0 0 0 2024-04-12T09:10:59.012 INFO:tasks.workunit.client.0.smithi117.stdout:0/183: dwrite d3/d22/f33 [0,4194304] 0 2024-04-12T09:10:59.013 INFO:tasks.workunit.client.0.smithi117.stdout:1/48: mkdir d1/d6/da/db 0 2024-04-12T09:10:59.019 INFO:tasks.workunit.client.0.smithi117.stdout:2/50: rename d0/l8 to d0/d4/lc 0 2024-04-12T09:10:59.021 INFO:tasks.workunit.client.0.smithi117.stdout:8/58: read db/fc [2681860,93425] 0 2024-04-12T09:10:59.026 INFO:tasks.workunit.client.0.smithi117.stdout:4/34: symlink d0/d5/d3/la 0 2024-04-12T09:10:59.031 INFO:tasks.workunit.client.0.smithi117.stdout:0/184: rename d3/c17 to d3/d36/c3e 0 2024-04-12T09:10:59.032 INFO:tasks.workunit.client.0.smithi117.stdout:1/49: write f0 [1428895,79252] 0 2024-04-12T09:10:59.127 INFO:tasks.workunit.client.0.smithi117.stdout:5/61: getdents d2 0 2024-04-12T09:10:59.127 INFO:tasks.workunit.client.0.smithi117.stdout:7/65: dwrite d0/d2/f3 [0,4194304] 0 2024-04-12T09:10:59.129 INFO:tasks.workunit.client.0.smithi117.stdout:1/50: symlink d1/lc 0 2024-04-12T09:10:59.129 INFO:tasks.workunit.client.0.smithi117.stdout:1/51: fdatasync f0 0 2024-04-12T09:10:59.130 INFO:tasks.workunit.client.0.smithi117.stdout:1/52: fdatasync f0 0 2024-04-12T09:10:59.131 INFO:tasks.workunit.client.0.smithi117.stdout:7/66: dread d0/d2/f3 [0,4194304] 0 2024-04-12T09:10:59.131 INFO:tasks.workunit.client.0.smithi117.stdout:1/53: rename d1 to d1/d6/da/dd 22 2024-04-12T09:10:59.133 INFO:tasks.workunit.client.0.smithi117.stdout:2/51: link d0/d4/ca d0/d4/cd 0 2024-04-12T09:10:59.133 INFO:tasks.workunit.client.0.smithi117.stdout:2/52: stat d0/d4 0 2024-04-12T09:10:59.134 INFO:tasks.workunit.client.0.smithi117.stdout:2/53: stat d0 0 2024-04-12T09:10:59.137 INFO:tasks.workunit.client.0.smithi117.stdout:2/54: read d0/f3 [1068500,119534] 0 2024-04-12T09:10:59.137 INFO:tasks.workunit.client.0.smithi117.stdout:7/67: dread d0/d2/fd [0,4194304] 0 2024-04-12T09:10:59.137 INFO:tasks.workunit.client.0.smithi117.stdout:4/35: dread d0/d1/f7 [0,4194304] 0 2024-04-12T09:10:59.138 INFO:tasks.workunit.client.0.smithi117.stdout:7/68: truncate d0/d2/f8 309159 0 2024-04-12T09:10:59.138 INFO:tasks.workunit.client.0.smithi117.stdout:7/69: write d0/da/f10 [4172966,86228] 0 2024-04-12T09:10:59.140 INFO:tasks.workunit.client.0.smithi117.stdout:7/70: write d0/d2/f5 [2369773,66668] 0 2024-04-12T09:10:59.144 INFO:tasks.workunit.client.0.smithi117.stdout:2/55: symlink d0/d4/le 0 2024-04-12T09:10:59.145 INFO:tasks.workunit.client.0.smithi117.stdout:2/56: write d0/d4/fb [57928,64523] 0 2024-04-12T09:10:59.146 INFO:tasks.workunit.client.0.smithi117.stdout:4/36: symlink d0/d5/lb 0 2024-04-12T09:10:59.150 INFO:tasks.workunit.client.0.smithi117.stdout:2/57: dread d0/d4/fb [0,4194304] 0 2024-04-12T09:10:59.159 INFO:tasks.workunit.client.0.smithi117.stdout:4/37: symlink d0/d5/lc 0 2024-04-12T09:10:59.159 INFO:tasks.workunit.client.0.smithi117.stdout:4/38: chown d0/d5/c9 5 1 2024-04-12T09:10:59.160 INFO:tasks.workunit.client.0.smithi117.stdout:5/62: link d2/c11 d2/d3/dd/c13 0 2024-04-12T09:10:59.161 INFO:tasks.workunit.client.0.smithi117.stdout:5/63: dread - d2/d3/dd/f12 zero size 2024-04-12T09:10:59.165 INFO:tasks.workunit.client.0.smithi117.stdout:1/54: rmdir d1/d9 0 2024-04-12T09:10:59.166 INFO:tasks.workunit.client.0.smithi117.stdout:7/71: mkdir d0/d2/d12/d14/d15 0 2024-04-12T09:10:59.167 INFO:tasks.workunit.client.0.smithi117.stdout:7/72: read d0/da/f10 [496979,79412] 0 2024-04-12T09:10:59.170 INFO:tasks.workunit.client.0.smithi117.stdout:7/73: dread d0/d2/f3 [0,4194304] 0 2024-04-12T09:10:59.171 INFO:tasks.workunit.client.0.smithi117.stdout:4/39: creat d0/d1/fd x:0 0 0 2024-04-12T09:10:59.172 INFO:tasks.workunit.client.0.smithi117.stdout:7/74: write d0/d2/f8 [1353734,108592] 0 2024-04-12T09:10:59.172 INFO:tasks.workunit.client.0.smithi117.stdout:4/40: truncate d0/d1/fd 958004 0 2024-04-12T09:10:59.173 INFO:tasks.workunit.client.0.smithi117.stdout:4/41: write d0/d1/fd [516219,52334] 0 2024-04-12T09:10:59.174 INFO:tasks.workunit.client.0.smithi117.stdout:4/42: stat d0/d1/f7 0 2024-04-12T09:10:59.176 INFO:tasks.workunit.client.0.smithi117.stdout:5/64: mknod d2/d3/de/c14 0 2024-04-12T09:10:59.177 INFO:tasks.workunit.client.0.smithi117.stdout:5/65: dread - d2/d3/dd/f12 zero size 2024-04-12T09:10:59.182 INFO:tasks.workunit.client.0.smithi117.stdout:4/43: fdatasync d0/f4 0 2024-04-12T09:10:59.185 INFO:tasks.workunit.client.0.smithi117.stdout:5/66: creat d2/d3/f15 x:0 0 0 2024-04-12T09:10:59.187 INFO:tasks.workunit.client.0.smithi117.stdout:2/58: getdents d0 0 2024-04-12T09:10:59.192 INFO:tasks.workunit.client.0.smithi117.stdout:9/104: sync 2024-04-12T09:10:59.193 INFO:tasks.workunit.client.0.smithi117.stdout:9/105: write d1/f4 [3880895,107737] 0 2024-04-12T09:10:59.194 INFO:tasks.workunit.client.0.smithi117.stdout:1/55: getdents d1/d4 0 2024-04-12T09:10:59.202 INFO:tasks.workunit.client.0.smithi117.stdout:5/67: getdents d2/d3/dd 0 2024-04-12T09:10:59.205 INFO:tasks.workunit.client.0.smithi117.stdout:5/68: symlink d2/l16 0 2024-04-12T09:10:59.210 INFO:tasks.workunit.client.0.smithi117.stdout:4/44: truncate d0/d1/f7 455009 0 2024-04-12T09:10:59.212 INFO:tasks.workunit.client.0.smithi117.stdout:4/45: symlink d0/d5/d3/le 0 2024-04-12T09:10:59.215 INFO:tasks.workunit.client.0.smithi117.stdout:9/106: write d1/f7 [2031551,92407] 0 2024-04-12T09:10:59.217 INFO:tasks.workunit.client.0.smithi117.stdout:2/59: dwrite d0/f3 [0,4194304] 0 2024-04-12T09:10:59.222 INFO:tasks.workunit.client.0.smithi117.stdout:2/60: fsync d0/d4/fb 0 2024-04-12T09:10:59.224 INFO:tasks.workunit.client.0.smithi117.stdout:4/46: dread d0/d1/f7 [0,4194304] 0 2024-04-12T09:10:59.225 INFO:tasks.workunit.client.0.smithi117.stdout:5/69: readlink d2/d3/la 0 2024-04-12T09:10:59.226 INFO:tasks.workunit.client.0.smithi117.stdout:4/47: dread d0/d5/f8 [0,4194304] 0 2024-04-12T09:10:59.228 INFO:tasks.workunit.client.0.smithi117.stdout:2/61: stat d0/d4/c2 0 2024-04-12T09:10:59.230 INFO:tasks.workunit.client.0.smithi117.stdout:5/70: read d2/f6 [2631253,92441] 0 2024-04-12T09:10:59.233 INFO:tasks.workunit.client.0.smithi117.stdout:2/62: mkdir d0/df 0 2024-04-12T09:10:59.236 INFO:tasks.workunit.client.0.smithi117.stdout:5/71: creat d2/d3/dd/f17 x:0 0 0 2024-04-12T09:10:59.238 INFO:tasks.workunit.client.0.smithi117.stdout:5/72: chown d2/d3/f15 52103341 1 2024-04-12T09:10:59.238 INFO:tasks.workunit.client.0.smithi117.stdout:4/48: dwrite d0/d1/f7 [0,4194304] 0 2024-04-12T09:10:59.239 INFO:tasks.workunit.client.0.smithi117.stdout:4/49: readlink d0/d5/lc 0 2024-04-12T09:10:59.246 INFO:tasks.workunit.client.0.smithi117.stdout:4/50: mkdir d0/d5/df 0 2024-04-12T09:10:59.246 INFO:tasks.workunit.client.0.smithi117.stdout:4/51: readlink d0/d5/lb 0 2024-04-12T09:10:59.249 INFO:tasks.workunit.client.0.smithi117.stdout:4/52: unlink d0/d1/f7 0 2024-04-12T09:10:59.250 INFO:tasks.workunit.client.0.smithi117.stdout:4/53: write d0/d1/fd [127217,114645] 0 2024-04-12T09:10:59.254 INFO:tasks.workunit.client.0.smithi117.stdout:4/54: mkdir d0/d1/d10 0 2024-04-12T09:10:59.255 INFO:tasks.workunit.client.0.smithi117.stdout:2/63: dwrite d0/d4/fb [0,4194304] 0 2024-04-12T09:10:59.257 INFO:tasks.workunit.client.0.smithi117.stdout:2/64: mkdir d0/d4/d10 0 2024-04-12T09:10:59.258 INFO:tasks.workunit.client.0.smithi117.stdout:4/55: getdents d0 0 2024-04-12T09:10:59.259 INFO:tasks.workunit.client.0.smithi117.stdout:4/56: rename d0 to d0/d1/d11 22 2024-04-12T09:10:59.261 INFO:tasks.workunit.client.0.smithi117.stdout:4/57: creat d0/d1/d10/f12 x:0 0 0 2024-04-12T09:10:59.261 INFO:tasks.workunit.client.0.smithi117.stdout:2/65: dread d0/d4/fb [0,4194304] 0 2024-04-12T09:10:59.262 INFO:tasks.workunit.client.0.smithi117.stdout:2/66: write d0/f3 [4541541,100815] 0 2024-04-12T09:10:59.263 INFO:tasks.workunit.client.0.smithi117.stdout:2/67: chown d0/d4 14646900 1 2024-04-12T09:10:59.265 INFO:tasks.workunit.client.0.smithi117.stdout:4/58: dread d0/d5/f8 [0,4194304] 0 2024-04-12T09:10:59.266 INFO:tasks.workunit.client.0.smithi117.stdout:2/68: getdents d0 0 2024-04-12T09:10:59.266 INFO:tasks.workunit.client.0.smithi117.stdout:4/59: write d0/d1/d10/f12 [125254,53396] 0 2024-04-12T09:10:59.267 INFO:tasks.workunit.client.0.smithi117.stdout:2/69: write d0/d4/fb [3691809,7700] 0 2024-04-12T09:10:59.269 INFO:tasks.workunit.client.0.smithi117.stdout:2/70: symlink d0/df/l11 0 2024-04-12T09:10:59.270 INFO:tasks.workunit.client.0.smithi117.stdout:4/60: dread d0/d5/f8 [0,4194304] 0 2024-04-12T09:10:59.271 INFO:tasks.workunit.client.0.smithi117.stdout:4/61: chown d0/d1/fd 5902076 1 2024-04-12T09:10:59.272 INFO:tasks.workunit.client.0.smithi117.stdout:4/62: symlink d0/d5/l13 0 2024-04-12T09:10:59.278 INFO:tasks.workunit.client.0.smithi117.stdout:4/63: dwrite d0/f4 [0,4194304] 0 2024-04-12T09:10:59.282 INFO:tasks.workunit.client.0.smithi117.stdout:4/64: dread d0/f4 [0,4194304] 0 2024-04-12T09:10:59.284 INFO:tasks.workunit.client.0.smithi117.stdout:4/65: creat d0/f14 x:0 0 0 2024-04-12T09:10:59.285 INFO:tasks.workunit.client.0.smithi117.stdout:4/66: readlink d0/d5/d3/le 0 2024-04-12T09:10:59.341 INFO:tasks.workunit.client.0.smithi117.stdout:6/60: sync 2024-04-12T09:10:59.342 INFO:tasks.workunit.client.0.smithi117.stdout:6/61: fdatasync d8/fc 0 2024-04-12T09:10:59.343 INFO:tasks.workunit.client.0.smithi117.stdout:6/62: truncate d8/d9/fa 1352820 0 2024-04-12T09:10:59.343 INFO:tasks.workunit.client.0.smithi117.stdout:6/63: dread - d8/d9/fb zero size 2024-04-12T09:10:59.346 INFO:tasks.workunit.client.0.smithi117.stdout:6/64: getdents d8 0 2024-04-12T09:10:59.348 INFO:tasks.workunit.client.0.smithi117.stdout:6/65: mknod d8/d9/c10 0 2024-04-12T09:10:59.355 INFO:tasks.workunit.client.0.smithi117.stdout:6/66: symlink d8/d9/l11 0 2024-04-12T09:10:59.356 INFO:tasks.workunit.client.0.smithi117.stdout:6/67: fsync f3 0 2024-04-12T09:10:59.358 INFO:tasks.workunit.client.0.smithi117.stdout:6/68: mknod d8/d9/c12 0 2024-04-12T09:10:59.360 INFO:tasks.workunit.client.0.smithi117.stdout:4/67: getdents d0/d1 0 2024-04-12T09:10:59.360 INFO:tasks.workunit.client.0.smithi117.stdout:4/68: fdatasync d0/d1/fd 0 2024-04-12T09:10:59.361 INFO:tasks.workunit.client.0.smithi117.stdout:6/69: creat d8/d9/f13 x:0 0 0 2024-04-12T09:10:59.366 INFO:tasks.workunit.client.0.smithi117.stdout:6/70: dread d8/d9/fa [0,4194304] 0 2024-04-12T09:10:59.369 INFO:tasks.workunit.client.0.smithi117.stdout:6/71: creat d8/f14 x:0 0 0 2024-04-12T09:10:59.370 INFO:tasks.workunit.client.0.smithi117.stdout:6/72: dread - d8/ff zero size 2024-04-12T09:10:59.371 INFO:tasks.workunit.client.0.smithi117.stdout:4/69: rmdir d0/d5/df 0 2024-04-12T09:10:59.377 INFO:tasks.workunit.client.0.smithi117.stdout:6/73: dwrite d8/fc [0,4194304] 0 2024-04-12T09:10:59.378 INFO:tasks.workunit.client.0.smithi117.stdout:6/74: chown d8/fc 1 1 2024-04-12T09:10:59.378 INFO:tasks.workunit.client.0.smithi117.stdout:6/75: dread - d8/f14 zero size 2024-04-12T09:10:59.379 INFO:tasks.workunit.client.0.smithi117.stdout:4/70: truncate d0/d1/fd 535524 0 2024-04-12T09:10:59.388 INFO:tasks.workunit.client.0.smithi117.stdout:6/76: truncate d8/d9/fa 640971 0 2024-04-12T09:10:59.391 INFO:tasks.workunit.client.0.smithi117.stdout:6/77: link d8/d9/c10 d8/c15 0 2024-04-12T09:10:59.393 INFO:tasks.workunit.client.0.smithi117.stdout:6/78: chown d8/d9/fa 2123 1 2024-04-12T09:10:59.395 INFO:tasks.workunit.client.0.smithi117.stdout:4/71: write d0/d1/fd [649470,94573] 0 2024-04-12T09:10:59.396 INFO:tasks.workunit.client.0.smithi117.stdout:6/79: mkdir d8/d16 0 2024-04-12T09:10:59.399 INFO:tasks.workunit.client.0.smithi117.stdout:4/72: mknod d0/c15 0 2024-04-12T09:10:59.402 INFO:tasks.workunit.client.0.smithi117.stdout:6/80: rename d8/d16 to d8/d9/d17 0 2024-04-12T09:10:59.404 INFO:tasks.workunit.client.0.smithi117.stdout:6/81: symlink d8/l18 0 2024-04-12T09:10:59.411 INFO:tasks.workunit.client.0.smithi117.stdout:4/73: truncate d0/d5/f8 811232 0 2024-04-12T09:10:59.411 INFO:tasks.workunit.client.0.smithi117.stdout:6/82: dwrite f3 [0,4194304] 0 2024-04-12T09:10:59.412 INFO:tasks.workunit.client.0.smithi117.stdout:6/83: fsync f2 0 2024-04-12T09:10:59.416 INFO:tasks.workunit.client.0.smithi117.stdout:6/84: creat d8/d9/f19 x:0 0 0 2024-04-12T09:10:59.417 INFO:tasks.workunit.client.0.smithi117.stdout:6/85: read f3 [1101494,120816] 0 2024-04-12T09:10:59.421 INFO:tasks.workunit.client.0.smithi117.stdout:6/86: rename d8/d9/f13 to d8/f1a 0 2024-04-12T09:10:59.423 INFO:tasks.workunit.client.0.smithi117.stdout:6/87: unlink d8/l18 0 2024-04-12T09:10:59.425 INFO:tasks.workunit.client.0.smithi117.stdout:6/88: mkdir d8/d1b 0 2024-04-12T09:10:59.425 INFO:tasks.workunit.client.0.smithi117.stdout:6/89: write f7 [3948767,86656] 0 2024-04-12T09:10:59.428 INFO:tasks.workunit.client.0.smithi117.stdout:6/90: symlink d8/d9/l1c 0 2024-04-12T09:10:59.428 INFO:tasks.workunit.client.0.smithi117.stdout:6/91: chown f2 11294004 1 2024-04-12T09:10:59.429 INFO:tasks.workunit.client.0.smithi117.stdout:6/92: fsync d8/f14 0 2024-04-12T09:10:59.429 INFO:tasks.workunit.client.0.smithi117.stdout:6/93: readlink d8/d9/l11 0 2024-04-12T09:10:59.430 INFO:tasks.workunit.client.0.smithi117.stdout:4/74: truncate d0/d5/f8 1722388 0 2024-04-12T09:10:59.432 INFO:tasks.workunit.client.0.smithi117.stdout:6/94: rename d8/d9/c12 to d8/d9/d17/c1d 0 2024-04-12T09:10:59.436 INFO:tasks.workunit.client.0.smithi117.stdout:6/95: dread f6 [0,4194304] 0 2024-04-12T09:10:59.441 INFO:tasks.workunit.client.0.smithi117.stdout:4/75: link d0/d5/d3/la d0/d1/d10/l16 0 2024-04-12T09:10:59.441 INFO:tasks.workunit.client.0.smithi117.stdout:4/76: chown d0/f14 41877759 1 2024-04-12T09:10:59.446 INFO:tasks.workunit.client.0.smithi117.stdout:4/77: rename d0/d1/fd to d0/d5/d3/f17 0 2024-04-12T09:10:59.449 INFO:tasks.workunit.client.0.smithi117.stdout:6/96: rmdir d8/d1b 0 2024-04-12T09:10:59.453 INFO:tasks.workunit.client.0.smithi117.stdout:4/78: dwrite d0/d1/d10/f12 [0,4194304] 0 2024-04-12T09:10:59.454 INFO:tasks.workunit.client.0.smithi117.stdout:6/97: chown d8/d9/d17/c1d 676 1 2024-04-12T09:10:59.457 INFO:tasks.workunit.client.0.smithi117.stdout:6/98: link d8/d9/fb d8/f1e 0 2024-04-12T09:10:59.460 INFO:tasks.workunit.client.0.smithi117.stdout:6/99: creat d8/d9/f1f x:0 0 0 2024-04-12T09:10:59.465 INFO:tasks.workunit.client.0.smithi117.stdout:6/100: rename d8/d9/l1c to d8/l20 0 2024-04-12T09:10:59.466 INFO:tasks.workunit.client.0.smithi117.stdout:6/101: chown d8/d9/l11 6 1 2024-04-12T09:10:59.468 INFO:tasks.workunit.client.0.smithi117.stdout:6/102: unlink d8/f14 0 2024-04-12T09:10:59.470 INFO:tasks.workunit.client.0.smithi117.stdout:6/103: fsync f3 0 2024-04-12T09:10:59.471 INFO:tasks.workunit.client.0.smithi117.stdout:6/104: chown d8 51396036 1 2024-04-12T09:10:59.471 INFO:tasks.workunit.client.0.smithi117.stdout:6/105: chown c4 7105 1 2024-04-12T09:10:59.472 INFO:tasks.workunit.client.0.smithi117.stdout:6/106: truncate d8/d9/fb 298651 0 2024-04-12T09:10:59.474 INFO:tasks.workunit.client.0.smithi117.stdout:6/107: creat d8/f21 x:0 0 0 2024-04-12T09:10:59.475 INFO:tasks.workunit.client.0.smithi117.stdout:6/108: mknod d8/d9/c22 0 2024-04-12T09:10:59.477 INFO:tasks.workunit.client.0.smithi117.stdout:6/109: rmdir d8/d9/d17 39 2024-04-12T09:10:59.481 INFO:tasks.workunit.client.0.smithi117.stdout:6/110: creat d8/d9/d17/f23 x:0 0 0 2024-04-12T09:10:59.489 INFO:tasks.workunit.client.0.smithi117.stdout:6/111: rmdir d8/d9/d17 39 2024-04-12T09:10:59.493 INFO:tasks.workunit.client.0.smithi117.stdout:4/79: dwrite d0/f4 [0,4194304] 0 2024-04-12T09:10:59.493 INFO:tasks.workunit.client.0.smithi117.stdout:6/112: mknod d8/d9/d17/c24 0 2024-04-12T09:10:59.494 INFO:tasks.workunit.client.0.smithi117.stdout:6/113: fdatasync d8/ff 0 2024-04-12T09:10:59.495 INFO:tasks.workunit.client.0.smithi117.stdout:4/80: mknod d0/d5/d3/c18 0 2024-04-12T09:10:59.500 INFO:tasks.workunit.client.0.smithi117.stdout:6/114: mknod d8/d9/c25 0 2024-04-12T09:10:59.501 INFO:tasks.workunit.client.0.smithi117.stdout:4/81: dread d0/d5/d3/f17 [0,4194304] 0 2024-04-12T09:10:59.502 INFO:tasks.workunit.client.0.smithi117.stdout:6/115: mknod d8/d9/d17/c26 0 2024-04-12T09:10:59.503 INFO:tasks.workunit.client.0.smithi117.stdout:6/116: symlink d8/l27 0 2024-04-12T09:10:59.504 INFO:tasks.workunit.client.0.smithi117.stdout:4/82: symlink d0/d1/d10/l19 0 2024-04-12T09:10:59.505 INFO:tasks.workunit.client.0.smithi117.stdout:6/117: symlink d8/l28 0 2024-04-12T09:10:59.506 INFO:tasks.workunit.client.0.smithi117.stdout:6/118: chown d8/l27 6728 1 2024-04-12T09:10:59.511 INFO:tasks.workunit.client.0.smithi117.stdout:4/83: dread d0/f4 [0,4194304] 0 2024-04-12T09:10:59.513 INFO:tasks.workunit.client.0.smithi117.stdout:4/84: fdatasync d0/d5/d3/f17 0 2024-04-12T09:10:59.514 INFO:tasks.workunit.client.0.smithi117.stdout:6/119: creat d8/d9/f29 x:0 0 0 2024-04-12T09:10:59.515 INFO:tasks.workunit.client.0.smithi117.stdout:6/120: write d8/f21 [667342,83000] 0 2024-04-12T09:10:59.516 INFO:tasks.workunit.client.0.smithi117.stdout:6/121: truncate d8/ff 365283 0 2024-04-12T09:10:59.517 INFO:tasks.workunit.client.0.smithi117.stdout:6/122: chown d8/ce 2 1 2024-04-12T09:10:59.521 INFO:tasks.workunit.client.0.smithi117.stdout:6/123: mkdir d8/d2a 0 2024-04-12T09:10:59.523 INFO:tasks.workunit.client.0.smithi117.stdout:6/124: chown d8/c15 240050128 1 2024-04-12T09:10:59.526 INFO:tasks.workunit.client.0.smithi117.stdout:4/85: truncate d0/f4 1165805 0 2024-04-12T09:10:59.526 INFO:tasks.workunit.client.0.smithi117.stdout:6/125: dread f7 [0,4194304] 0 2024-04-12T09:10:59.527 INFO:tasks.workunit.client.0.smithi117.stdout:4/86: fdatasync d0/d5/d3/f17 0 2024-04-12T09:10:59.527 INFO:tasks.workunit.client.0.smithi117.stdout:6/126: chown d8/f21 16465777 1 2024-04-12T09:10:59.529 INFO:tasks.workunit.client.0.smithi117.stdout:4/87: mkdir d0/d5/d3/d1a 0 2024-04-12T09:10:59.531 INFO:tasks.workunit.client.0.smithi117.stdout:3/107: sync 2024-04-12T09:10:59.531 INFO:tasks.workunit.client.0.smithi117.stdout:8/59: sync 2024-04-12T09:10:59.533 INFO:tasks.workunit.client.0.smithi117.stdout:3/108: symlink de/d13/d19/d22/l2e 0 2024-04-12T09:10:59.534 INFO:tasks.workunit.client.0.smithi117.stdout:3/109: stat de/d13/f24 0 2024-04-12T09:10:59.537 INFO:tasks.workunit.client.0.smithi117.stdout:8/60: dwrite fa [0,4194304] 0 2024-04-12T09:10:59.539 INFO:tasks.workunit.client.0.smithi117.stdout:3/110: dread de/f12 [0,4194304] 0 2024-04-12T09:10:59.541 INFO:tasks.workunit.client.0.smithi117.stdout:3/111: creat de/d13/d19/d22/f2f x:0 0 0 2024-04-12T09:10:59.549 INFO:tasks.workunit.client.0.smithi117.stdout:8/61: write db/fc [1720546,90309] 0 2024-04-12T09:10:59.605 INFO:tasks.workunit.client.0.smithi117.stdout:3/112: write de/d13/d19/d22/f28 [1030797,46767] 0 2024-04-12T09:10:59.607 INFO:tasks.workunit.client.0.smithi117.stdout:3/113: write de/d13/d19/d22/f28 [922143,111370] 0 2024-04-12T09:10:59.609 INFO:tasks.workunit.client.0.smithi117.stdout:3/114: rmdir de/d13/d19/d22 39 2024-04-12T09:10:59.615 INFO:tasks.workunit.client.0.smithi117.stdout:3/115: dwrite f2 [0,4194304] 0 2024-04-12T09:10:59.622 INFO:tasks.workunit.client.0.smithi117.stdout:3/116: dwrite de/f12 [0,4194304] 0 2024-04-12T09:10:59.624 INFO:tasks.workunit.client.0.smithi117.stdout:3/117: write de/d13/f24 [3285440,118998] 0 2024-04-12T09:10:59.626 INFO:tasks.workunit.client.0.smithi117.stdout:8/62: fdatasync db/fc 0 2024-04-12T09:10:59.627 INFO:tasks.workunit.client.0.smithi117.stdout:3/118: chown de/d13/d19/d22/f28 4945 1 2024-04-12T09:10:59.628 INFO:tasks.workunit.client.0.smithi117.stdout:8/63: stat db/dd/c14 0 2024-04-12T09:10:59.629 INFO:tasks.workunit.client.0.smithi117.stdout:8/64: fsync db/fc 0 2024-04-12T09:10:59.631 INFO:tasks.workunit.client.0.smithi117.stdout:8/65: creat db/dd/f15 x:0 0 0 2024-04-12T09:10:59.635 INFO:tasks.workunit.client.0.smithi117.stdout:3/119: dwrite de/d13/d19/f29 [0,4194304] 0 2024-04-12T09:10:59.636 INFO:tasks.workunit.client.0.smithi117.stdout:3/120: fdatasync de/d13/f1b 0 2024-04-12T09:10:59.638 INFO:tasks.workunit.client.0.smithi117.stdout:8/66: dread fa [0,4194304] 0 2024-04-12T09:10:59.640 INFO:tasks.workunit.client.0.smithi117.stdout:3/121: unlink de/ff 0 2024-04-12T09:10:59.641 INFO:tasks.workunit.client.0.smithi117.stdout:8/67: symlink db/dd/l16 0 2024-04-12T09:10:59.642 INFO:tasks.workunit.client.0.smithi117.stdout:8/68: dread - db/dd/f15 zero size 2024-04-12T09:10:59.647 INFO:tasks.workunit.client.0.smithi117.stdout:8/69: symlink db/dd/l17 0 2024-04-12T09:10:59.650 INFO:tasks.workunit.client.0.smithi117.stdout:8/70: creat db/d13/f18 x:0 0 0 2024-04-12T09:10:59.657 INFO:tasks.workunit.client.0.smithi117.stdout:0/185: sync 2024-04-12T09:10:59.661 INFO:tasks.workunit.client.0.smithi117.stdout:8/71: dwrite db/dd/fe [0,4194304] 0 2024-04-12T09:10:59.664 INFO:tasks.workunit.client.0.smithi117.stdout:3/122: dwrite de/d13/f1a [0,4194304] 0 2024-04-12T09:10:59.667 INFO:tasks.workunit.client.0.smithi117.stdout:8/72: dread db/dd/f11 [0,4194304] 0 2024-04-12T09:10:59.667 INFO:tasks.workunit.client.0.smithi117.stdout:3/123: write de/f10 [60531,9836] 0 2024-04-12T09:10:59.668 INFO:tasks.workunit.client.0.smithi117.stdout:8/73: chown db/dd/f15 0 1 2024-04-12T09:10:59.669 INFO:tasks.workunit.client.0.smithi117.stdout:8/74: fdatasync db/fc 0 2024-04-12T09:10:59.673 INFO:tasks.workunit.client.0.smithi117.stdout:8/75: mkdir db/d19 0 2024-04-12T09:10:59.675 INFO:tasks.workunit.client.0.smithi117.stdout:8/76: write db/dd/f15 [175340,31244] 0 2024-04-12T09:10:59.677 INFO:tasks.workunit.client.0.smithi117.stdout:0/186: dwrite d3/dc/f34 [0,4194304] 0 2024-04-12T09:10:59.677 INFO:tasks.workunit.client.0.smithi117.stdout:3/124: dread de/d13/f1a [0,4194304] 0 2024-04-12T09:10:59.680 INFO:tasks.workunit.client.0.smithi117.stdout:0/187: creat d3/d30/f3f x:0 0 0 2024-04-12T09:10:59.682 INFO:tasks.workunit.client.0.smithi117.stdout:3/125: mkdir de/d13/d30 0 2024-04-12T09:10:59.683 INFO:tasks.workunit.client.0.smithi117.stdout:3/126: dread - de/f14 zero size 2024-04-12T09:10:59.684 INFO:tasks.workunit.client.0.smithi117.stdout:3/127: chown de/d13/d19 93239 1 2024-04-12T09:10:59.686 INFO:tasks.workunit.client.0.smithi117.stdout:8/77: dwrite db/dd/fe [4194304,4194304] 0 2024-04-12T09:10:59.687 INFO:tasks.workunit.client.0.smithi117.stdout:3/128: write de/d13/d19/d27/f2a [539748,67329] 0 2024-04-12T09:10:59.687 INFO:tasks.workunit.client.0.smithi117.stdout:8/78: chown db/dd/l16 69560660 1 2024-04-12T09:10:59.693 INFO:tasks.workunit.client.0.smithi117.stdout:6/127: sync 2024-04-12T09:10:59.693 INFO:tasks.workunit.client.0.smithi117.stdout:2/71: sync 2024-04-12T09:10:59.693 INFO:tasks.workunit.client.0.smithi117.stdout:5/73: sync 2024-04-12T09:10:59.693 INFO:tasks.workunit.client.0.smithi117.stdout:7/75: sync 2024-04-12T09:10:59.694 INFO:tasks.workunit.client.0.smithi117.stdout:1/56: sync 2024-04-12T09:10:59.694 INFO:tasks.workunit.client.0.smithi117.stdout:9/107: sync 2024-04-12T09:10:59.694 INFO:tasks.workunit.client.0.smithi117.stdout:4/88: sync 2024-04-12T09:10:59.697 INFO:tasks.workunit.client.0.smithi117.stdout:1/57: truncate f0 4279942 0 2024-04-12T09:10:59.697 INFO:tasks.workunit.client.0.smithi117.stdout:6/128: chown d8/d9/f29 374689 1 2024-04-12T09:10:59.700 INFO:tasks.workunit.client.0.smithi117.stdout:4/89: fsync d0/f4 0 2024-04-12T09:10:59.704 INFO:tasks.workunit.client.0.smithi117.stdout:1/58: write f0 [3310471,73643] 0 2024-04-12T09:10:59.708 INFO:tasks.workunit.client.0.smithi117.stdout:3/129: dwrite de/d13/d19/d22/f2f [0,4194304] 0 2024-04-12T09:10:59.708 INFO:tasks.workunit.client.0.smithi117.stdout:8/79: dwrite fa [0,4194304] 0 2024-04-12T09:10:59.709 INFO:tasks.workunit.client.0.smithi117.stdout:2/72: link d0/c9 d0/df/c12 0 2024-04-12T09:10:59.711 INFO:tasks.workunit.client.0.smithi117.stdout:1/59: write f0 [4363118,20872] 0 2024-04-12T09:10:59.712 INFO:tasks.workunit.client.0.smithi117.stdout:0/188: truncate d3/d22/f33 1664277 0 2024-04-12T09:10:59.712 INFO:tasks.workunit.client.0.smithi117.stdout:2/73: rename d0/df to d0/df/d13 22 2024-04-12T09:10:59.714 INFO:tasks.workunit.client.0.smithi117.stdout:9/108: creat d1/d8/df/d1b/f1f x:0 0 0 2024-04-12T09:10:59.715 INFO:tasks.workunit.client.0.smithi117.stdout:0/189: dread - d3/d30/f31 zero size 2024-04-12T09:10:59.715 INFO:tasks.workunit.client.0.smithi117.stdout:0/190: stat d3/d22 0 2024-04-12T09:10:59.716 INFO:tasks.workunit.client.0.smithi117.stdout:9/109: chown d1/d8/ld 1922080 1 2024-04-12T09:10:59.717 INFO:tasks.workunit.client.0.smithi117.stdout:4/90: creat d0/d1/f1b x:0 0 0 2024-04-12T09:10:59.717 INFO:tasks.workunit.client.0.smithi117.stdout:6/129: dwrite d8/d9/f29 [0,4194304] 0 2024-04-12T09:10:59.722 INFO:tasks.workunit.client.0.smithi117.stdout:3/130: creat de/d2c/f31 x:0 0 0 2024-04-12T09:10:59.726 INFO:tasks.workunit.client.0.smithi117.stdout:1/60: mknod d1/d6/da/ce 0 2024-04-12T09:10:59.727 INFO:tasks.workunit.client.0.smithi117.stdout:4/91: dwrite d0/d5/d3/f17 [0,4194304] 0 2024-04-12T09:10:59.728 INFO:tasks.workunit.client.0.smithi117.stdout:7/76: truncate d0/d2/f5 3125074 0 2024-04-12T09:10:59.729 INFO:tasks.workunit.client.0.smithi117.stdout:2/74: mknod d0/d4/c14 0 2024-04-12T09:10:59.736 INFO:tasks.workunit.client.0.smithi117.stdout:9/110: rmdir d1 39 2024-04-12T09:10:59.736 INFO:tasks.workunit.client.0.smithi117.stdout:2/75: dread d0/d4/fb [0,4194304] 0 2024-04-12T09:10:59.738 INFO:tasks.workunit.client.0.smithi117.stdout:6/130: rename d8/d9/d17/c24 to d8/d9/d17/c2b 0 2024-04-12T09:10:59.740 INFO:tasks.workunit.client.0.smithi117.stdout:8/80: mkdir db/d19/d1a 0 2024-04-12T09:10:59.744 INFO:tasks.workunit.client.0.smithi117.stdout:1/61: creat d1/d6/ff x:0 0 0 2024-04-12T09:10:59.751 INFO:tasks.workunit.client.0.smithi117.stdout:4/92: creat d0/d5/d3/f1c x:0 0 0 2024-04-12T09:10:59.754 INFO:tasks.workunit.client.0.smithi117.stdout:4/93: chown d0/d5/f8 194325 1 2024-04-12T09:10:59.758 INFO:tasks.workunit.client.0.smithi117.stdout:7/77: dwrite d0/d2/f3 [0,4194304] 0 2024-04-12T09:10:59.760 INFO:tasks.workunit.client.0.smithi117.stdout:2/76: symlink d0/d4/d10/l15 0 2024-04-12T09:10:59.763 INFO:tasks.workunit.client.0.smithi117.stdout:9/111: rename d1/d8/f14 to d1/d8/d12/f20 0 2024-04-12T09:10:59.766 INFO:tasks.workunit.client.0.smithi117.stdout:4/94: mknod d0/d1/c1d 0 2024-04-12T09:10:59.769 INFO:tasks.workunit.client.0.smithi117.stdout:8/81: truncate db/fc 2840482 0 2024-04-12T09:10:59.770 INFO:tasks.workunit.client.0.smithi117.stdout:8/82: write db/dd/fe [8835906,2950] 0 2024-04-12T09:10:59.778 INFO:tasks.workunit.client.0.smithi117.stdout:3/131: getdents de/d13/d19/d22 0 2024-04-12T09:10:59.778 INFO:tasks.workunit.client.0.smithi117.stdout:3/132: readlink de/d13/l1e 0 2024-04-12T09:10:59.779 INFO:tasks.workunit.client.0.smithi117.stdout:8/83: rename db/dd to db/d1b 0 2024-04-12T09:10:59.782 INFO:tasks.workunit.client.0.smithi117.stdout:1/62: link f0 d1/f10 0 2024-04-12T09:10:59.783 INFO:tasks.workunit.client.0.smithi117.stdout:6/131: truncate d8/fc 3836790 0 2024-04-12T09:10:59.783 INFO:tasks.workunit.client.0.smithi117.stdout:1/63: truncate d1/d6/ff 932814 0 2024-04-12T09:10:59.784 INFO:tasks.workunit.client.0.smithi117.stdout:6/132: chown d8/l27 6 1 2024-04-12T09:10:59.784 INFO:tasks.workunit.client.0.smithi117.stdout:6/133: fsync d8/d9/f1f 0 2024-04-12T09:10:59.785 INFO:tasks.workunit.client.0.smithi117.stdout:6/134: dread - d8/d9/f19 zero size 2024-04-12T09:10:59.785 INFO:tasks.workunit.client.0.smithi117.stdout:6/135: readlink d8/l28 0 2024-04-12T09:10:59.788 INFO:tasks.workunit.client.0.smithi117.stdout:9/112: link d1/d8/df/f13 d1/d8/df/f21 0 2024-04-12T09:10:59.789 INFO:tasks.workunit.client.0.smithi117.stdout:0/191: write d3/d22/f33 [12195,115297] 0 2024-04-12T09:10:59.792 INFO:tasks.workunit.client.0.smithi117.stdout:7/78: dread d0/d2/f5 [0,4194304] 0 2024-04-12T09:10:59.794 INFO:tasks.workunit.client.0.smithi117.stdout:1/64: write d1/f10 [4818391,99805] 0 2024-04-12T09:10:59.801 INFO:tasks.workunit.client.0.smithi117.stdout:9/113: rename d1/d8/df/d19 to d1/d8/d12/d22 0 2024-04-12T09:10:59.805 INFO:tasks.workunit.client.0.smithi117.stdout:2/77: truncate d0/f3 8366829 0 2024-04-12T09:10:59.806 INFO:tasks.workunit.client.0.smithi117.stdout:7/79: rename d0/d2/f3 to d0/d2/f16 0 2024-04-12T09:10:59.806 INFO:tasks.workunit.client.0.smithi117.stdout:7/80: chown d0/d2/d12/d14 1907706 1 2024-04-12T09:10:59.812 INFO:tasks.workunit.client.0.smithi117.stdout:4/95: getdents d0/d1 0 2024-04-12T09:10:59.816 INFO:tasks.workunit.client.0.smithi117.stdout:8/84: link db/d1b/l16 db/d19/l1c 0 2024-04-12T09:10:59.818 INFO:tasks.workunit.client.0.smithi117.stdout:6/136: dwrite d8/d9/fb [0,4194304] 0 2024-04-12T09:10:59.819 INFO:tasks.workunit.client.0.smithi117.stdout:2/78: symlink d0/l16 0 2024-04-12T09:10:59.820 INFO:tasks.workunit.client.0.smithi117.stdout:7/81: rmdir d0/d2/d12 39 2024-04-12T09:10:59.824 INFO:tasks.workunit.client.0.smithi117.stdout:4/96: truncate d0/d5/f8 637479 0 2024-04-12T09:10:59.826 INFO:tasks.workunit.client.0.smithi117.stdout:8/85: mknod db/d1b/c1d 0 2024-04-12T09:10:59.829 INFO:tasks.workunit.client.0.smithi117.stdout:2/79: symlink d0/d4/l17 0 2024-04-12T09:10:59.830 INFO:tasks.workunit.client.0.smithi117.stdout:1/65: rmdir d1/d4 0 2024-04-12T09:10:59.831 INFO:tasks.workunit.client.0.smithi117.stdout:1/66: read d1/f10 [2602994,83768] 0 2024-04-12T09:10:59.832 INFO:tasks.workunit.client.0.smithi117.stdout:1/67: chown d1/l3 105670370 1 2024-04-12T09:10:59.834 INFO:tasks.workunit.client.0.smithi117.stdout:7/82: dread d0/da/f10 [0,4194304] 0 2024-04-12T09:10:59.837 INFO:tasks.workunit.client.0.smithi117.stdout:8/86: mknod db/d19/c1e 0 2024-04-12T09:10:59.838 INFO:tasks.workunit.client.0.smithi117.stdout:7/83: dread d0/d2/f16 [0,4194304] 0 2024-04-12T09:10:59.872 INFO:tasks.workunit.client.0.smithi117.stdout:6/137: symlink d8/d2a/l2c 0 2024-04-12T09:10:59.874 INFO:tasks.workunit.client.0.smithi117.stdout:6/138: write d8/d9/f1f [810089,50421] 0 2024-04-12T09:10:59.874 INFO:tasks.workunit.client.0.smithi117.stdout:1/68: mknod d1/d6/da/c11 0 2024-04-12T09:10:59.874 INFO:tasks.workunit.client.0.smithi117.stdout:9/114: getdents d1/d8/d12/d22 0 2024-04-12T09:10:59.875 INFO:tasks.workunit.client.0.smithi117.stdout:1/69: chown d1/d6 19473179 1 2024-04-12T09:10:59.875 INFO:tasks.workunit.client.0.smithi117.stdout:4/97: mknod d0/d5/d3/d1a/c1e 0 2024-04-12T09:10:59.875 INFO:tasks.workunit.client.0.smithi117.stdout:8/87: mkdir db/d1f 0 2024-04-12T09:10:59.876 INFO:tasks.workunit.client.0.smithi117.stdout:1/70: chown d1/l3 5674 1 2024-04-12T09:10:59.877 INFO:tasks.workunit.client.0.smithi117.stdout:1/71: chown d1/f10 11890392 1 2024-04-12T09:10:59.878 INFO:tasks.workunit.client.0.smithi117.stdout:1/72: readlink d1/l3 0 2024-04-12T09:10:59.878 INFO:tasks.workunit.client.0.smithi117.stdout:6/139: mkdir d8/d9/d17/d2d 0 2024-04-12T09:10:59.882 INFO:tasks.workunit.client.0.smithi117.stdout:9/115: dread d1/d8/d12/d22/f1d [0,4194304] 0 2024-04-12T09:10:59.885 INFO:tasks.workunit.client.0.smithi117.stdout:1/73: dwrite d1/d6/ff [0,4194304] 0 2024-04-12T09:10:59.886 INFO:tasks.workunit.client.0.smithi117.stdout:4/98: rename d0/d5/d3/f17 to d0/d1/f1f 0 2024-04-12T09:10:59.886 INFO:tasks.workunit.client.0.smithi117.stdout:4/99: write d0/f14 [90224,52486] 0 2024-04-12T09:10:59.892 INFO:tasks.workunit.client.0.smithi117.stdout:8/88: creat db/d1f/f20 x:0 0 0 2024-04-12T09:10:59.892 INFO:tasks.workunit.client.0.smithi117.stdout:8/89: stat db/d1b/l17 0 2024-04-12T09:10:59.893 INFO:tasks.workunit.client.0.smithi117.stdout:8/90: fdatasync db/d1f/f20 0 2024-04-12T09:10:59.893 INFO:tasks.workunit.client.0.smithi117.stdout:8/91: read - db/d1f/f20 zero size 2024-04-12T09:10:59.894 INFO:tasks.workunit.client.0.smithi117.stdout:9/116: mkdir d1/d23 0 2024-04-12T09:10:59.897 INFO:tasks.workunit.client.0.smithi117.stdout:7/84: write d0/d2/fd [4816,128379] 0 2024-04-12T09:10:59.900 INFO:tasks.workunit.client.0.smithi117.stdout:1/74: creat d1/d6/f12 x:0 0 0 2024-04-12T09:10:59.903 INFO:tasks.workunit.client.0.smithi117.stdout:4/100: rmdir d0/d5 39 2024-04-12T09:10:59.907 INFO:tasks.workunit.client.0.smithi117.stdout:2/80: dread d0/f3 [4194304,4194304] 0 2024-04-12T09:10:59.911 INFO:tasks.workunit.client.0.smithi117.stdout:9/117: mkdir d1/d24 0 2024-04-12T09:10:59.914 INFO:tasks.workunit.client.0.smithi117.stdout:9/118: dread d1/d8/f10 [0,4194304] 0 2024-04-12T09:10:59.915 INFO:tasks.workunit.client.0.smithi117.stdout:9/119: chown d1/fc 11788 1 2024-04-12T09:10:59.919 INFO:tasks.workunit.client.0.smithi117.stdout:8/92: creat db/d19/d1a/f21 x:0 0 0 2024-04-12T09:10:59.920 INFO:tasks.workunit.client.0.smithi117.stdout:6/140: dwrite d8/d9/fa [0,4194304] 0 2024-04-12T09:10:59.921 INFO:tasks.workunit.client.0.smithi117.stdout:7/85: mkdir d0/d2/d12/d14/d17 0 2024-04-12T09:10:59.922 INFO:tasks.workunit.client.0.smithi117.stdout:6/141: write d8/d9/f29 [65918,30183] 0 2024-04-12T09:10:59.922 INFO:tasks.workunit.client.0.smithi117.stdout:7/86: read d0/d2/f5 [1211301,58203] 0 2024-04-12T09:10:59.925 INFO:tasks.workunit.client.0.smithi117.stdout:9/120: unlink d1/f7 0 2024-04-12T09:10:59.927 INFO:tasks.workunit.client.0.smithi117.stdout:4/101: mkdir d0/d5/d3/d1a/d20 0 2024-04-12T09:10:59.933 INFO:tasks.workunit.client.0.smithi117.stdout:1/75: creat d1/f13 x:0 0 0 2024-04-12T09:10:59.933 INFO:tasks.workunit.client.0.smithi117.stdout:1/76: chown f0 183802281 1 2024-04-12T09:10:59.934 INFO:tasks.workunit.client.0.smithi117.stdout:4/102: dwrite d0/d1/d10/f12 [0,4194304] 0 2024-04-12T09:10:59.935 INFO:tasks.workunit.client.0.smithi117.stdout:4/103: fsync d0/f14 0 2024-04-12T09:10:59.937 INFO:tasks.workunit.client.0.smithi117.stdout:6/142: rename d8/d9/d17/c26 to d8/d2a/c2e 0 2024-04-12T09:10:59.939 INFO:tasks.workunit.client.0.smithi117.stdout:9/121: symlink d1/d8/d12/l25 0 2024-04-12T09:10:59.947 INFO:tasks.workunit.client.0.smithi117.stdout:7/87: mknod d0/d13/c18 0 2024-04-12T09:10:59.949 INFO:tasks.workunit.client.0.smithi117.stdout:1/77: dread f0 [0,4194304] 0 2024-04-12T09:10:59.955 INFO:tasks.workunit.client.0.smithi117.stdout:2/81: getdents d0/d4/d10 0 2024-04-12T09:10:59.956 INFO:tasks.workunit.client.0.smithi117.stdout:9/122: dread d1/f3 [0,4194304] 0 2024-04-12T09:10:59.957 INFO:tasks.workunit.client.0.smithi117.stdout:8/93: link db/d19/c1e db/d19/d1a/c22 0 2024-04-12T09:10:59.958 INFO:tasks.workunit.client.0.smithi117.stdout:8/94: dread - db/d13/f18 zero size 2024-04-12T09:10:59.959 INFO:tasks.workunit.client.0.smithi117.stdout:7/88: creat d0/d13/f19 x:0 0 0 2024-04-12T09:10:59.962 INFO:tasks.workunit.client.0.smithi117.stdout:6/143: link f3 d8/d2a/f2f 0 2024-04-12T09:10:59.965 INFO:tasks.workunit.client.0.smithi117.stdout:9/123: mkdir d1/d8/df/d26 0 2024-04-12T09:10:59.967 INFO:tasks.workunit.client.0.smithi117.stdout:2/82: dread d0/d4/fb [0,4194304] 0 2024-04-12T09:10:59.967 INFO:tasks.workunit.client.0.smithi117.stdout:8/95: mknod db/d19/c23 0 2024-04-12T09:10:59.968 INFO:tasks.workunit.client.0.smithi117.stdout:8/96: fdatasync db/d19/d1a/f21 0 2024-04-12T09:10:59.970 INFO:tasks.workunit.client.0.smithi117.stdout:6/144: symlink d8/l30 0 2024-04-12T09:10:59.971 INFO:tasks.workunit.client.0.smithi117.stdout:9/124: unlink d1/d8/df/l17 0 2024-04-12T09:10:59.972 INFO:tasks.workunit.client.0.smithi117.stdout:2/83: truncate d0/f3 4635153 0 2024-04-12T09:10:59.973 INFO:tasks.workunit.client.0.smithi117.stdout:2/84: readlink d0/d4/d10/l15 0 2024-04-12T09:10:59.973 INFO:tasks.workunit.client.0.smithi117.stdout:7/89: mkdir d0/d2/d1a 0 2024-04-12T09:10:59.977 INFO:tasks.workunit.client.0.smithi117.stdout:9/125: unlink d1/f3 0 2024-04-12T09:10:59.978 INFO:tasks.workunit.client.0.smithi117.stdout:2/85: truncate d0/d4/fb 1598288 0 2024-04-12T09:10:59.981 INFO:tasks.workunit.client.0.smithi117.stdout:6/145: mknod d8/d9/c31 0 2024-04-12T09:10:59.983 INFO:tasks.workunit.client.0.smithi117.stdout:2/86: rename d0/d4/l17 to d0/df/l18 0 2024-04-12T09:11:00.026 INFO:tasks.workunit.client.0.smithi117.stdout:7/90: creat d0/f1b x:0 0 0 2024-04-12T09:11:00.041 INFO:tasks.workunit.client.0.smithi117.stdout:2/87: getdents d0 0 2024-04-12T09:11:00.041 INFO:tasks.workunit.client.0.smithi117.stdout:2/88: chown d0/d4/le 1 1 2024-04-12T09:11:00.053 INFO:tasks.workunit.client.0.smithi117.stdout:2/89: dread d0/d4/fb [0,4194304] 0 2024-04-12T09:11:00.054 INFO:tasks.workunit.client.0.smithi117.stdout:8/97: truncate db/d1b/f11 1684819 0 2024-04-12T09:11:00.057 INFO:tasks.workunit.client.0.smithi117.stdout:2/90: chown d0/d4/lc 1570856692 1 2024-04-12T09:11:00.059 INFO:tasks.workunit.client.0.smithi117.stdout:8/98: readlink db/d1b/lf 0 2024-04-12T09:11:00.064 INFO:tasks.workunit.client.0.smithi117.stdout:6/146: write d8/fc [2369724,87211] 0 2024-04-12T09:11:00.065 INFO:tasks.workunit.client.0.smithi117.stdout:8/99: truncate db/fc 2918617 0 2024-04-12T09:11:00.067 INFO:tasks.workunit.client.0.smithi117.stdout:6/147: fsync d8/d2a/f2f 0 2024-04-12T09:11:00.070 INFO:tasks.workunit.client.0.smithi117.stdout:7/91: truncate d0/d2/fd 2016101 0 2024-04-12T09:11:00.073 INFO:tasks.workunit.client.0.smithi117.stdout:6/148: creat d8/d9/d17/f32 x:0 0 0 2024-04-12T09:11:00.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:10:59 smithi203 ceph-mon[36428]: pgmap v10: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 193 KiB/s rd, 14 MiB/s wr, 270 op/s 2024-04-12T09:11:00.074 INFO:tasks.workunit.client.0.smithi117.stdout:6/149: dread d8/ff [0,4194304] 0 2024-04-12T09:11:00.082 INFO:tasks.workunit.client.0.smithi117.stdout:2/91: write d0/d4/fb [2115689,61264] 0 2024-04-12T09:11:00.083 INFO:tasks.workunit.client.0.smithi117.stdout:2/92: chown d0/d4/fb 10089458 1 2024-04-12T09:11:00.092 INFO:tasks.workunit.client.0.smithi117.stdout:2/93: dwrite d0/d4/fb [0,4194304] 0 2024-04-12T09:11:00.097 INFO:tasks.workunit.client.0.smithi117.stdout:8/100: dread db/fc [0,4194304] 0 2024-04-12T09:11:00.104 INFO:tasks.workunit.client.0.smithi117.stdout:6/150: rmdir d8/d9 39 2024-04-12T09:11:00.107 INFO:tasks.workunit.client.0.smithi117.stdout:7/92: write d0/da/f10 [1142209,32347] 0 2024-04-12T09:11:00.108 INFO:tasks.workunit.client.0.smithi117.stdout:2/94: getdents d0/d4 0 2024-04-12T09:11:00.116 INFO:tasks.workunit.client.0.smithi117.stdout:6/151: mkdir d8/d9/d17/d33 0 2024-04-12T09:11:00.117 INFO:tasks.workunit.client.0.smithi117.stdout:8/101: link db/d19/c23 db/d19/d1a/c24 0 2024-04-12T09:11:00.119 INFO:tasks.workunit.client.0.smithi117.stdout:2/95: rename d0/f3 to d0/d4/d10/f19 0 2024-04-12T09:11:00.126 INFO:tasks.workunit.client.0.smithi117.stdout:7/93: link d0/d13/c18 d0/d2/d12/d14/d17/c1c 0 2024-04-12T09:11:00.126 INFO:tasks.workunit.client.0.smithi117.stdout:6/152: dread f7 [0,4194304] 0 2024-04-12T09:11:00.128 INFO:tasks.workunit.client.0.smithi117.stdout:6/153: symlink d8/d2a/l34 0 2024-04-12T09:11:00.129 INFO:tasks.workunit.client.0.smithi117.stdout:6/154: dread - d8/d9/d17/f32 zero size 2024-04-12T09:11:00.130 INFO:tasks.workunit.client.0.smithi117.stdout:6/155: read d8/d9/fb [4028834,75311] 0 2024-04-12T09:11:00.130 INFO:tasks.workunit.client.0.smithi117.stdout:6/156: fsync d8/d9/f1f 0 2024-04-12T09:11:00.131 INFO:tasks.workunit.client.0.smithi117.stdout:7/94: creat d0/d2/d12/d14/f1d x:0 0 0 2024-04-12T09:11:00.134 INFO:tasks.workunit.client.0.smithi117.stdout:7/95: dread d0/da/f10 [0,4194304] 0 2024-04-12T09:11:00.134 INFO:tasks.workunit.client.0.smithi117.stdout:6/157: dread d8/d9/fb [0,4194304] 0 2024-04-12T09:11:00.135 INFO:tasks.workunit.client.0.smithi117.stdout:6/158: fdatasync d8/d9/f19 0 2024-04-12T09:11:00.138 INFO:tasks.workunit.client.0.smithi117.stdout:7/96: dread d0/d2/f5 [0,4194304] 0 2024-04-12T09:11:00.144 INFO:tasks.workunit.client.0.smithi117.stdout:6/159: mknod d8/d9/c35 0 2024-04-12T09:11:00.144 INFO:tasks.workunit.client.0.smithi117.stdout:7/97: dwrite d0/f1b [0,4194304] 0 2024-04-12T09:11:00.145 INFO:tasks.workunit.client.0.smithi117.stdout:6/160: readlink d8/d2a/l2c 0 2024-04-12T09:11:00.150 INFO:tasks.workunit.client.0.smithi117.stdout:7/98: creat d0/d2/d12/f1e x:0 0 0 2024-04-12T09:11:00.154 INFO:tasks.workunit.client.0.smithi117.stdout:7/99: symlink d0/da/l1f 0 2024-04-12T09:11:00.155 INFO:tasks.workunit.client.0.smithi117.stdout:6/161: symlink d8/d9/d17/d33/l36 0 2024-04-12T09:11:00.159 INFO:tasks.workunit.client.0.smithi117.stdout:6/162: rename d8/d9/c31 to d8/d9/d17/d2d/c37 0 2024-04-12T09:11:00.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:10:59 smithi117 ceph-mon[29277]: pgmap v10: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 193 KiB/s rd, 14 MiB/s wr, 270 op/s 2024-04-12T09:11:00.160 INFO:tasks.workunit.client.0.smithi117.stdout:6/163: write d8/d9/d17/f32 [641602,4103] 0 2024-04-12T09:11:00.162 INFO:tasks.workunit.client.0.smithi117.stdout:6/164: truncate f3 2908471 0 2024-04-12T09:11:00.163 INFO:tasks.workunit.client.0.smithi117.stdout:7/100: dwrite d0/d2/f16 [0,4194304] 0 2024-04-12T09:11:00.163 INFO:tasks.workunit.client.0.smithi117.stdout:3/133: sync 2024-04-12T09:11:00.163 INFO:tasks.workunit.client.0.smithi117.stdout:0/192: sync 2024-04-12T09:11:00.163 INFO:tasks.workunit.client.0.smithi117.stdout:5/74: sync 2024-04-12T09:11:00.164 INFO:tasks.workunit.client.0.smithi117.stdout:3/134: fdatasync de/f10 0 2024-04-12T09:11:00.164 INFO:tasks.workunit.client.0.smithi117.stdout:5/75: dread - d2/d3/dd/f12 zero size 2024-04-12T09:11:00.166 INFO:tasks.workunit.client.0.smithi117.stdout:5/76: write d2/d3/dd/f12 [225200,7092] 0 2024-04-12T09:11:00.169 INFO:tasks.workunit.client.0.smithi117.stdout:3/135: dread de/d13/f1a [0,4194304] 0 2024-04-12T09:11:00.169 INFO:tasks.workunit.client.0.smithi117.stdout:0/193: mknod d3/dc/c40 0 2024-04-12T09:11:00.170 INFO:tasks.workunit.client.0.smithi117.stdout:0/194: truncate d3/d22/f35 701556 0 2024-04-12T09:11:00.171 INFO:tasks.workunit.client.0.smithi117.stdout:0/195: write d3/dc/f34 [760537,129617] 0 2024-04-12T09:11:00.171 INFO:tasks.workunit.client.0.smithi117.stdout:6/165: symlink d8/d9/l38 0 2024-04-12T09:11:00.173 INFO:tasks.workunit.client.0.smithi117.stdout:5/77: mknod d2/d3/c18 0 2024-04-12T09:11:00.175 INFO:tasks.workunit.client.0.smithi117.stdout:3/136: unlink de/f10 0 2024-04-12T09:11:00.180 INFO:tasks.workunit.client.0.smithi117.stdout:2/96: dwrite d0/d4/d10/f19 [4194304,4194304] 0 2024-04-12T09:11:00.182 INFO:tasks.workunit.client.0.smithi117.stdout:7/101: getdents d0/d2/d12 0 2024-04-12T09:11:00.184 INFO:tasks.workunit.client.0.smithi117.stdout:0/196: dwrite d3/d30/f3f [0,4194304] 0 2024-04-12T09:11:00.186 INFO:tasks.workunit.client.0.smithi117.stdout:7/102: dread - d0/d2/d12/d14/f1d zero size 2024-04-12T09:11:00.186 INFO:tasks.workunit.client.0.smithi117.stdout:5/78: creat d2/f19 x:0 0 0 2024-04-12T09:11:00.189 INFO:tasks.workunit.client.0.smithi117.stdout:7/103: readlink d0/d2/le 0 2024-04-12T09:11:00.189 INFO:tasks.workunit.client.0.smithi117.stdout:3/137: dwrite de/d2c/f31 [0,4194304] 0 2024-04-12T09:11:00.191 INFO:tasks.workunit.client.0.smithi117.stdout:7/104: chown d0/d13 4 1 2024-04-12T09:11:00.193 INFO:tasks.workunit.client.0.smithi117.stdout:3/138: truncate de/d13/f23 45582 0 2024-04-12T09:11:00.193 INFO:tasks.workunit.client.0.smithi117.stdout:2/97: dread d0/d4/d10/f19 [0,4194304] 0 2024-04-12T09:11:00.196 INFO:tasks.workunit.client.0.smithi117.stdout:0/197: mknod d3/c41 0 2024-04-12T09:11:00.199 INFO:tasks.workunit.client.0.smithi117.stdout:3/139: rename de/d13/d19/d22/f2f to de/d13/d19/d22/f32 0 2024-04-12T09:11:00.199 INFO:tasks.workunit.client.0.smithi117.stdout:3/140: chown de 202241700 1 2024-04-12T09:11:00.200 INFO:tasks.workunit.client.0.smithi117.stdout:5/79: symlink d2/d3/dd/l1a 0 2024-04-12T09:11:00.203 INFO:tasks.workunit.client.0.smithi117.stdout:7/105: mkdir d0/d20 0 2024-04-12T09:11:00.204 INFO:tasks.workunit.client.0.smithi117.stdout:6/166: write d8/ff [574839,89745] 0 2024-04-12T09:11:00.206 INFO:tasks.workunit.client.0.smithi117.stdout:3/141: dwrite de/d2c/f31 [0,4194304] 0 2024-04-12T09:11:00.207 INFO:tasks.workunit.client.0.smithi117.stdout:5/80: fdatasync d2/d3/ff 0 2024-04-12T09:11:00.207 INFO:tasks.workunit.client.0.smithi117.stdout:2/98: getdents d0/d4 0 2024-04-12T09:11:00.208 INFO:tasks.workunit.client.0.smithi117.stdout:6/167: rmdir d8/d9/d17/d33 39 2024-04-12T09:11:00.210 INFO:tasks.workunit.client.0.smithi117.stdout:3/142: creat de/d13/d19/d22/f33 x:0 0 0 2024-04-12T09:11:00.212 INFO:tasks.workunit.client.0.smithi117.stdout:6/168: mkdir d8/d9/d39 0 2024-04-12T09:11:00.213 INFO:tasks.workunit.client.0.smithi117.stdout:6/169: readlink d8/d2a/l2c 0 2024-04-12T09:11:00.214 INFO:tasks.workunit.client.0.smithi117.stdout:6/170: dread - d8/f1a zero size 2024-04-12T09:11:00.215 INFO:tasks.workunit.client.0.smithi117.stdout:3/143: getdents de 0 2024-04-12T09:11:00.216 INFO:tasks.workunit.client.0.smithi117.stdout:2/99: dwrite d0/d4/d10/f19 [4194304,4194304] 0 2024-04-12T09:11:00.217 INFO:tasks.workunit.client.0.smithi117.stdout:3/144: write de/d13/f1b [616694,56889] 0 2024-04-12T09:11:00.218 INFO:tasks.workunit.client.0.smithi117.stdout:2/100: mkdir d0/df/d1a 0 2024-04-12T09:11:00.219 INFO:tasks.workunit.client.0.smithi117.stdout:3/145: creat de/d13/f34 x:0 0 0 2024-04-12T09:11:00.219 INFO:tasks.workunit.client.0.smithi117.stdout:2/101: chown d0/d4/c2 4348 1 2024-04-12T09:11:00.219 INFO:tasks.workunit.client.0.smithi117.stdout:3/146: stat de/f14 0 2024-04-12T09:11:00.219 INFO:tasks.workunit.client.0.smithi117.stdout:3/147: chown de/d13/l18 3 1 2024-04-12T09:11:00.221 INFO:tasks.workunit.client.0.smithi117.stdout:2/102: creat d0/d4/d10/f1b x:0 0 0 2024-04-12T09:11:00.223 INFO:tasks.workunit.client.0.smithi117.stdout:3/148: rename de/d13/d19/l1c to de/d13/d19/d27/l35 0 2024-04-12T09:11:00.243 INFO:tasks.workunit.client.0.smithi117.stdout:6/171: stat d8/d2a/f2f 0 2024-04-12T09:11:00.244 INFO:tasks.workunit.client.0.smithi117.stdout:6/172: dread - d8/d9/d17/f23 zero size 2024-04-12T09:11:00.245 INFO:tasks.workunit.client.0.smithi117.stdout:6/173: read - d8/d9/d17/f23 zero size 2024-04-12T09:11:00.245 INFO:tasks.workunit.client.0.smithi117.stdout:6/174: chown d8/c15 8 1 2024-04-12T09:11:00.248 INFO:tasks.workunit.client.0.smithi117.stdout:5/81: getdents d2/d3/dd 0 2024-04-12T09:11:00.250 INFO:tasks.workunit.client.0.smithi117.stdout:5/82: creat d2/d3/f1b x:0 0 0 2024-04-12T09:11:00.251 INFO:tasks.workunit.client.0.smithi117.stdout:6/175: mkdir d8/d3a 0 2024-04-12T09:11:00.252 INFO:tasks.workunit.client.0.smithi117.stdout:5/83: write d2/d3/f15 [509023,54641] 0 2024-04-12T09:11:00.254 INFO:tasks.workunit.client.0.smithi117.stdout:0/198: dwrite d3/f21 [4194304,4194304] 0 2024-04-12T09:11:00.255 INFO:tasks.workunit.client.0.smithi117.stdout:0/199: fdatasync d3/d22/f29 0 2024-04-12T09:11:00.259 INFO:tasks.workunit.client.0.smithi117.stdout:6/176: link d8/d9/f1f d8/d3a/f3b 0 2024-04-12T09:11:00.259 INFO:tasks.workunit.client.0.smithi117.stdout:7/106: write d0/da/f10 [1830893,50389] 0 2024-04-12T09:11:00.263 INFO:tasks.workunit.client.0.smithi117.stdout:6/177: write d8/d9/d17/f23 [231909,663] 0 2024-04-12T09:11:00.264 INFO:tasks.workunit.client.0.smithi117.stdout:0/200: dwrite d3/f39 [0,4194304] 0 2024-04-12T09:11:00.264 INFO:tasks.workunit.client.0.smithi117.stdout:3/149: getdents de/d13/d19/d27 0 2024-04-12T09:11:00.265 INFO:tasks.workunit.client.0.smithi117.stdout:7/107: write d0/d2/d12/f1e [188806,76411] 0 2024-04-12T09:11:00.267 INFO:tasks.workunit.client.0.smithi117.stdout:0/201: chown d3/dc/f13 630656453 1 2024-04-12T09:11:00.268 INFO:tasks.workunit.client.0.smithi117.stdout:7/108: write d0/d2/f8 [2272049,111759] 0 2024-04-12T09:11:00.269 INFO:tasks.workunit.client.0.smithi117.stdout:3/150: symlink de/d2c/l36 0 2024-04-12T09:11:00.270 INFO:tasks.workunit.client.0.smithi117.stdout:3/151: dread - de/d13/f34 zero size 2024-04-12T09:11:00.273 INFO:tasks.workunit.client.0.smithi117.stdout:0/202: dread d3/d22/f2d [0,4194304] 0 2024-04-12T09:11:00.274 INFO:tasks.workunit.client.0.smithi117.stdout:6/178: mkdir d8/d9/d39/d3c 0 2024-04-12T09:11:00.278 INFO:tasks.workunit.client.0.smithi117.stdout:3/152: creat de/d13/d19/d22/f37 x:0 0 0 2024-04-12T09:11:00.279 INFO:tasks.workunit.client.0.smithi117.stdout:3/153: write de/d13/f1b [1745373,109291] 0 2024-04-12T09:11:00.281 INFO:tasks.workunit.client.0.smithi117.stdout:0/203: rename d3/f5 to d3/d36/f42 0 2024-04-12T09:11:00.284 INFO:tasks.workunit.client.0.smithi117.stdout:7/109: creat d0/d2/d12/d14/d17/f21 x:0 0 0 2024-04-12T09:11:00.285 INFO:tasks.workunit.client.0.smithi117.stdout:3/154: dread de/d13/d19/d22/f28 [0,4194304] 0 2024-04-12T09:11:00.288 INFO:tasks.workunit.client.0.smithi117.stdout:6/179: dwrite f6 [0,4194304] 0 2024-04-12T09:11:00.289 INFO:tasks.workunit.client.0.smithi117.stdout:0/204: rmdir d3/d30/d32 39 2024-04-12T09:11:00.290 INFO:tasks.workunit.client.0.smithi117.stdout:3/155: creat de/d13/d19/d27/f38 x:0 0 0 2024-04-12T09:11:00.291 INFO:tasks.workunit.client.0.smithi117.stdout:3/156: write de/d13/f34 [785938,25146] 0 2024-04-12T09:11:00.292 INFO:tasks.workunit.client.0.smithi117.stdout:3/157: truncate fa 618731 0 2024-04-12T09:11:00.295 INFO:tasks.workunit.client.0.smithi117.stdout:0/205: symlink d3/d36/l43 0 2024-04-12T09:11:00.296 INFO:tasks.workunit.client.0.smithi117.stdout:0/206: chown d3/f20 7 1 2024-04-12T09:11:00.297 INFO:tasks.workunit.client.0.smithi117.stdout:6/180: symlink d8/d9/d39/d3c/l3d 0 2024-04-12T09:11:00.298 INFO:tasks.workunit.client.0.smithi117.stdout:6/181: chown d8/d3a 1366 1 2024-04-12T09:11:00.301 INFO:tasks.workunit.client.0.smithi117.stdout:0/207: rename d3/dc/fd to d3/dc/f44 0 2024-04-12T09:11:00.301 INFO:tasks.workunit.client.0.smithi117.stdout:0/208: chown d3/f14 102 1 2024-04-12T09:11:00.303 INFO:tasks.workunit.client.0.smithi117.stdout:3/158: link de/c26 de/d13/d19/d27/c39 0 2024-04-12T09:11:00.304 INFO:tasks.workunit.client.0.smithi117.stdout:3/159: write de/f14 [22042,114077] 0 2024-04-12T09:11:00.307 INFO:tasks.workunit.client.0.smithi117.stdout:3/160: mkdir de/d2c/d3a 0 2024-04-12T09:11:00.310 INFO:tasks.workunit.client.0.smithi117.stdout:3/161: mknod de/d13/d19/c3b 0 2024-04-12T09:11:00.317 INFO:tasks.workunit.client.0.smithi117.stdout:3/162: dwrite de/d13/f23 [0,4194304] 0 2024-04-12T09:11:00.320 INFO:tasks.workunit.client.0.smithi117.stdout:3/163: creat de/d13/d19/d27/f3c x:0 0 0 2024-04-12T09:11:00.323 INFO:tasks.workunit.client.0.smithi117.stdout:3/164: mkdir de/d13/d19/d22/d3d 0 2024-04-12T09:11:00.327 INFO:tasks.workunit.client.0.smithi117.stdout:6/182: dwrite d8/d9/f1f [0,4194304] 0 2024-04-12T09:11:00.334 INFO:tasks.workunit.client.0.smithi117.stdout:6/183: dread d8/d2a/f2f [0,4194304] 0 2024-04-12T09:11:00.335 INFO:tasks.workunit.client.0.smithi117.stdout:3/165: write de/f15 [29900,91720] 0 2024-04-12T09:11:00.338 INFO:tasks.workunit.client.0.smithi117.stdout:3/166: unlink de/d13/d19/d27/f2a 0 2024-04-12T09:11:00.342 INFO:tasks.workunit.client.0.smithi117.stdout:4/104: sync 2024-04-12T09:11:00.343 INFO:tasks.workunit.client.0.smithi117.stdout:6/184: getdents d8 0 2024-04-12T09:11:00.344 INFO:tasks.workunit.client.0.smithi117.stdout:3/167: mkdir de/d13/d19/d22/d3e 0 2024-04-12T09:11:00.346 INFO:tasks.workunit.client.0.smithi117.stdout:4/105: mknod d0/d1/c21 0 2024-04-12T09:11:00.346 INFO:tasks.workunit.client.0.smithi117.stdout:6/185: stat d8/d9/d17/d33 0 2024-04-12T09:11:00.385 INFO:tasks.workunit.client.0.smithi117.stdout:3/168: mkdir de/d13/d19/d22/d3e/d3f 0 2024-04-12T09:11:00.385 INFO:tasks.workunit.client.0.smithi117.stdout:3/169: chown de/d13/l1d 626630 1 2024-04-12T09:11:00.386 INFO:tasks.workunit.client.0.smithi117.stdout:6/186: symlink d8/d9/d17/d33/l3e 0 2024-04-12T09:11:00.386 INFO:tasks.workunit.client.0.smithi117.stdout:3/170: write de/f12 [5825925,9522] 0 2024-04-12T09:11:00.387 INFO:tasks.workunit.client.0.smithi117.stdout:4/106: truncate d0/f4 461982 0 2024-04-12T09:11:00.387 INFO:tasks.workunit.client.0.smithi117.stdout:6/187: chown d8/d9/d17/d33 0 1 2024-04-12T09:11:00.389 INFO:tasks.workunit.client.0.smithi117.stdout:6/188: mkdir d8/d3f 0 2024-04-12T09:11:00.392 INFO:tasks.workunit.client.0.smithi117.stdout:3/171: mkdir de/d13/d19/d22/d40 0 2024-04-12T09:11:00.393 INFO:tasks.workunit.client.0.smithi117.stdout:4/107: dwrite d0/d1/d10/f12 [0,4194304] 0 2024-04-12T09:11:00.394 INFO:tasks.workunit.client.0.smithi117.stdout:4/108: read - d0/d5/d3/f1c zero size 2024-04-12T09:11:00.395 INFO:tasks.workunit.client.0.smithi117.stdout:3/172: creat de/d13/d19/d22/d3e/f41 x:0 0 0 2024-04-12T09:11:00.395 INFO:tasks.workunit.client.0.smithi117.stdout:4/109: chown d0/d1/d10 19314277 1 2024-04-12T09:11:00.397 INFO:tasks.workunit.client.0.smithi117.stdout:3/173: truncate de/d13/d19/d22/d3e/f41 1046177 0 2024-04-12T09:11:00.397 INFO:tasks.workunit.client.0.smithi117.stdout:4/110: fsync d0/d1/f1f 0 2024-04-12T09:11:00.400 INFO:tasks.workunit.client.0.smithi117.stdout:3/174: creat de/d13/f42 x:0 0 0 2024-04-12T09:11:00.405 INFO:tasks.workunit.client.0.smithi117.stdout:3/175: rename de/d13/d19/d22/f37 to de/d13/d19/d22/d3e/d3f/f43 0 2024-04-12T09:11:00.406 INFO:tasks.workunit.client.0.smithi117.stdout:3/176: dread - de/d13/d19/d27/f38 zero size 2024-04-12T09:11:00.407 INFO:tasks.workunit.client.0.smithi117.stdout:3/177: write f7 [21491,5446] 0 2024-04-12T09:11:00.411 INFO:tasks.workunit.client.0.smithi117.stdout:3/178: creat de/d13/d19/d27/f44 x:0 0 0 2024-04-12T09:11:00.414 INFO:tasks.workunit.client.0.smithi117.stdout:3/179: creat de/d2c/f45 x:0 0 0 2024-04-12T09:11:00.414 INFO:tasks.workunit.client.0.smithi117.stdout:6/189: rmdir d8/d9/d17 39 2024-04-12T09:11:00.415 INFO:tasks.workunit.client.0.smithi117.stdout:3/180: creat de/d2c/d3a/f46 x:0 0 0 2024-04-12T09:11:00.416 INFO:tasks.workunit.client.0.smithi117.stdout:3/181: write f7 [769706,41349] 0 2024-04-12T09:11:00.417 INFO:tasks.workunit.client.0.smithi117.stdout:6/190: creat d8/d9/f40 x:0 0 0 2024-04-12T09:11:00.418 INFO:tasks.workunit.client.0.smithi117.stdout:6/191: symlink d8/d9/d39/d3c/l41 0 2024-04-12T09:11:00.419 INFO:tasks.workunit.client.0.smithi117.stdout:6/192: stat d8/l27 0 2024-04-12T09:11:00.419 INFO:tasks.workunit.client.0.smithi117.stdout:6/193: read f3 [2458920,22741] 0 2024-04-12T09:11:00.424 INFO:tasks.workunit.client.0.smithi117.stdout:6/194: dwrite d8/d9/f40 [0,4194304] 0 2024-04-12T09:11:00.426 INFO:tasks.workunit.client.0.smithi117.stdout:6/195: dread - d8/f1a zero size 2024-04-12T09:11:00.427 INFO:tasks.workunit.client.0.smithi117.stdout:6/196: truncate f7 1984168 0 2024-04-12T09:11:00.430 INFO:tasks.workunit.client.0.smithi117.stdout:6/197: rename d8/d9/d17/d33/l3e to d8/d9/d17/d2d/l42 0 2024-04-12T09:11:00.455 INFO:tasks.workunit.client.0.smithi117.stdout:3/182: fsync f7 0 2024-04-12T09:11:00.458 INFO:tasks.workunit.client.0.smithi117.stdout:4/111: write d0/f4 [179032,90279] 0 2024-04-12T09:11:00.459 INFO:tasks.workunit.client.0.smithi117.stdout:4/112: dread - d0/d5/d3/f1c zero size 2024-04-12T09:11:00.463 INFO:tasks.workunit.client.0.smithi117.stdout:4/113: creat d0/d5/d3/d1a/d20/f22 x:0 0 0 2024-04-12T09:11:00.470 INFO:tasks.workunit.client.0.smithi117.stdout:4/114: dwrite d0/d5/d3/d1a/d20/f22 [0,4194304] 0 2024-04-12T09:11:00.471 INFO:tasks.workunit.client.0.smithi117.stdout:4/115: readlink d0/d5/lc 0 2024-04-12T09:11:00.474 INFO:tasks.workunit.client.0.smithi117.stdout:3/183: truncate de/d13/f24 2160807 0 2024-04-12T09:11:00.475 INFO:tasks.workunit.client.0.smithi117.stdout:4/116: readlink d0/d1/d10/l16 0 2024-04-12T09:11:00.475 INFO:tasks.workunit.client.0.smithi117.stdout:6/198: dwrite d8/d9/fb [0,4194304] 0 2024-04-12T09:11:00.486 INFO:tasks.workunit.client.0.smithi117.stdout:3/184: dwrite de/d13/f34 [0,4194304] 0 2024-04-12T09:11:00.486 INFO:tasks.workunit.client.0.smithi117.stdout:6/199: rename c1 to d8/d2a/c43 0 2024-04-12T09:11:00.487 INFO:tasks.workunit.client.0.smithi117.stdout:1/78: sync 2024-04-12T09:11:00.487 INFO:tasks.workunit.client.0.smithi117.stdout:4/117: dwrite d0/d5/d3/d1a/d20/f22 [0,4194304] 0 2024-04-12T09:11:00.488 INFO:tasks.workunit.client.0.smithi117.stdout:1/79: dread - d1/d6/f12 zero size 2024-04-12T09:11:00.490 INFO:tasks.workunit.client.0.smithi117.stdout:1/80: chown d1/l3 3342 1 2024-04-12T09:11:00.492 INFO:tasks.workunit.client.0.smithi117.stdout:3/185: creat de/f47 x:0 0 0 2024-04-12T09:11:00.492 INFO:tasks.workunit.client.0.smithi117.stdout:6/200: rmdir d8/d9/d17/d2d 39 2024-04-12T09:11:00.499 INFO:tasks.workunit.client.0.smithi117.stdout:1/81: rename d1/d6/ff to d1/d6/f14 0 2024-04-12T09:11:00.499 INFO:tasks.workunit.client.0.smithi117.stdout:1/82: chown d1/d6 305947181 1 2024-04-12T09:11:00.499 INFO:tasks.workunit.client.0.smithi117.stdout:1/83: rename d1 to d1/d6/d15 22 2024-04-12T09:11:00.503 INFO:tasks.workunit.client.0.smithi117.stdout:1/84: mkdir d1/d6/da/db/d16 0 2024-04-12T09:11:00.511 INFO:tasks.workunit.client.0.smithi117.stdout:6/201: write f3 [3512464,93789] 0 2024-04-12T09:11:00.511 INFO:tasks.workunit.client.0.smithi117.stdout:3/186: chown de/d2c/c2d 1696390 1 2024-04-12T09:11:00.512 INFO:tasks.workunit.client.0.smithi117.stdout:1/85: dwrite d1/d6/f14 [0,4194304] 0 2024-04-12T09:11:00.516 INFO:tasks.workunit.client.0.smithi117.stdout:3/187: truncate de/d13/f1b 2466548 0 2024-04-12T09:11:00.517 INFO:tasks.workunit.client.0.smithi117.stdout:3/188: chown de/d13/d19/d27/f3c 901 1 2024-04-12T09:11:00.518 INFO:tasks.workunit.client.0.smithi117.stdout:1/86: mkdir d1/d6/da/db/d17 0 2024-04-12T09:11:00.518 INFO:tasks.workunit.client.0.smithi117.stdout:1/87: chown d1/f10 10 1 2024-04-12T09:11:00.522 INFO:tasks.workunit.client.0.smithi117.stdout:1/88: unlink d1/d6/f12 0 2024-04-12T09:11:00.522 INFO:tasks.workunit.client.0.smithi117.stdout:6/202: symlink d8/d3a/l44 0 2024-04-12T09:11:00.523 INFO:tasks.workunit.client.0.smithi117.stdout:6/203: chown d8/d9/d39/d3c/l3d 25788 1 2024-04-12T09:11:00.525 INFO:tasks.workunit.client.0.smithi117.stdout:1/89: unlink d1/lc 0 2024-04-12T09:11:00.526 INFO:tasks.workunit.client.0.smithi117.stdout:1/90: chown f0 3 1 2024-04-12T09:11:00.527 INFO:tasks.workunit.client.0.smithi117.stdout:6/204: unlink d8/d9/c22 0 2024-04-12T09:11:00.527 INFO:tasks.workunit.client.0.smithi117.stdout:1/91: truncate d1/f13 8475 0 2024-04-12T09:11:00.527 INFO:tasks.workunit.client.0.smithi117.stdout:6/205: chown d8/d3f 0 1 2024-04-12T09:11:00.527 INFO:tasks.workunit.client.0.smithi117.stdout:1/92: chown d1/d6/da 24751833 1 2024-04-12T09:11:00.529 INFO:tasks.workunit.client.0.smithi117.stdout:6/206: write d8/d9/d17/f23 [1134345,108541] 0 2024-04-12T09:11:00.530 INFO:tasks.workunit.client.0.smithi117.stdout:1/93: symlink d1/l18 0 2024-04-12T09:11:00.531 INFO:tasks.workunit.client.0.smithi117.stdout:6/207: symlink d8/d9/d39/d3c/l45 0 2024-04-12T09:11:00.533 INFO:tasks.workunit.client.0.smithi117.stdout:1/94: dread d1/d6/f14 [0,4194304] 0 2024-04-12T09:11:00.536 INFO:tasks.workunit.client.0.smithi117.stdout:6/208: creat d8/d9/f46 x:0 0 0 2024-04-12T09:11:00.538 INFO:tasks.workunit.client.0.smithi117.stdout:6/209: write d8/d2a/f2f [1903253,63045] 0 2024-04-12T09:11:00.539 INFO:tasks.workunit.client.0.smithi117.stdout:6/210: fdatasync f6 0 2024-04-12T09:11:00.541 INFO:tasks.workunit.client.0.smithi117.stdout:1/95: dwrite d1/f13 [0,4194304] 0 2024-04-12T09:11:00.543 INFO:tasks.workunit.client.0.smithi117.stdout:6/211: symlink d8/d9/d39/d3c/l47 0 2024-04-12T09:11:00.544 INFO:tasks.workunit.client.0.smithi117.stdout:6/212: read f3 [671669,31780] 0 2024-04-12T09:11:00.548 INFO:tasks.workunit.client.0.smithi117.stdout:1/96: creat d1/d6/da/db/d16/f19 x:0 0 0 2024-04-12T09:11:00.549 INFO:tasks.workunit.client.0.smithi117.stdout:6/213: write d8/f21 [832213,33336] 0 2024-04-12T09:11:00.555 INFO:tasks.workunit.client.0.smithi117.stdout:6/214: chown d8/ce 1187 1 2024-04-12T09:11:00.556 INFO:tasks.workunit.client.0.smithi117.stdout:6/215: truncate d8/d9/f46 577904 0 2024-04-12T09:11:00.556 INFO:tasks.workunit.client.0.smithi117.stdout:6/216: read f6 [1602809,52722] 0 2024-04-12T09:11:00.559 INFO:tasks.workunit.client.0.smithi117.stdout:6/217: mkdir d8/d9/d17/d33/d48 0 2024-04-12T09:11:00.561 INFO:tasks.workunit.client.0.smithi117.stdout:6/218: mkdir d8/d3a/d49 0 2024-04-12T09:11:00.565 INFO:tasks.workunit.client.0.smithi117.stdout:6/219: dread d8/d9/f29 [0,4194304] 0 2024-04-12T09:11:00.567 INFO:tasks.workunit.client.0.smithi117.stdout:6/220: creat d8/d9/d17/d33/f4a x:0 0 0 2024-04-12T09:11:00.574 INFO:tasks.workunit.client.0.smithi117.stdout:1/97: write d1/f10 [3887366,25839] 0 2024-04-12T09:11:00.574 INFO:tasks.workunit.client.0.smithi117.stdout:6/221: dwrite d8/d9/f29 [0,4194304] 0 2024-04-12T09:11:00.577 INFO:tasks.workunit.client.0.smithi117.stdout:6/222: creat d8/d3a/f4b x:0 0 0 2024-04-12T09:11:00.580 INFO:tasks.workunit.client.0.smithi117.stdout:1/98: rmdir d1/d6/da/db/d17 0 2024-04-12T09:11:00.592 INFO:tasks.workunit.client.0.smithi117.stdout:1/99: truncate d1/f10 4317044 0 2024-04-12T09:11:00.594 INFO:tasks.workunit.client.0.smithi117.stdout:1/100: truncate d1/d6/da/db/d16/f19 399094 0 2024-04-12T09:11:00.595 INFO:tasks.workunit.client.0.smithi117.stdout:1/101: stat f0 0 2024-04-12T09:11:00.599 INFO:tasks.workunit.client.0.smithi117.stdout:1/102: dread d1/f13 [0,4194304] 0 2024-04-12T09:11:00.601 INFO:tasks.workunit.client.0.smithi117.stdout:1/103: unlink d1/l3 0 2024-04-12T09:11:00.603 INFO:tasks.workunit.client.0.smithi117.stdout:1/104: creat d1/d6/f1a x:0 0 0 2024-04-12T09:11:00.603 INFO:tasks.workunit.client.0.smithi117.stdout:1/105: readlink d1/l18 0 2024-04-12T09:11:00.659 INFO:tasks.workunit.client.0.smithi117.stdout:9/126: sync 2024-04-12T09:11:00.660 INFO:tasks.workunit.client.0.smithi117.stdout:9/127: rmdir d1/d8/df/d1b 39 2024-04-12T09:11:00.661 INFO:tasks.workunit.client.0.smithi117.stdout:9/128: rmdir d1/d8 39 2024-04-12T09:11:00.664 INFO:tasks.workunit.client.0.smithi117.stdout:9/129: getdents d1/d8/df/d26 0 2024-04-12T09:11:00.665 INFO:tasks.workunit.client.0.smithi117.stdout:9/130: fdatasync d1/d8/fa 0 2024-04-12T09:11:00.666 INFO:tasks.workunit.client.0.smithi117.stdout:9/131: write d1/fc [3715911,9913] 0 2024-04-12T09:11:00.667 INFO:tasks.workunit.client.0.smithi117.stdout:9/132: dread d1/d8/df/f13 [0,4194304] 0 2024-04-12T09:11:00.683 INFO:tasks.workunit.client.0.smithi117.stdout:9/133: mkdir d1/d23/d27 0 2024-04-12T09:11:00.684 INFO:tasks.workunit.client.0.smithi117.stdout:9/134: write d1/d8/d12/f20 [1999814,29602] 0 2024-04-12T09:11:00.741 INFO:tasks.workunit.client.0.smithi117.stdout:9/135: getdents d1/d23 0 2024-04-12T09:11:00.744 INFO:tasks.workunit.client.0.smithi117.stdout:9/136: write d1/d8/df/d1b/f1f [772940,11207] 0 2024-04-12T09:11:00.744 INFO:tasks.workunit.client.0.smithi117.stdout:9/137: stat d1/f4 0 2024-04-12T09:11:00.747 INFO:tasks.workunit.client.0.smithi117.stdout:9/138: rename d1/d8/df/f21 to d1/d23/f28 0 2024-04-12T09:11:00.748 INFO:tasks.workunit.client.0.smithi117.stdout:9/139: chown d1/d8/d12/l25 183 1 2024-04-12T09:11:00.748 INFO:tasks.workunit.client.0.smithi117.stdout:9/140: stat d1/d8/d12/c1c 0 2024-04-12T09:11:00.750 INFO:tasks.workunit.client.0.smithi117.stdout:9/141: rename f0 to d1/d8/d12/f29 0 2024-04-12T09:11:00.763 INFO:tasks.workunit.client.0.smithi117.stdout:9/142: dread d1/f4 [0,4194304] 0 2024-04-12T09:11:00.777 INFO:tasks.workunit.client.0.smithi117.stdout:9/143: rename d1/d8/d12/f29 to d1/d24/f2a 0 2024-04-12T09:11:00.780 INFO:tasks.workunit.client.0.smithi117.stdout:9/144: creat d1/d8/d12/d22/f2b x:0 0 0 2024-04-12T09:11:00.782 INFO:tasks.workunit.client.0.smithi117.stdout:9/145: symlink d1/d23/d27/l2c 0 2024-04-12T09:11:00.788 INFO:tasks.workunit.client.0.smithi117.stdout:9/146: dwrite d1/d8/d12/d22/f2b [0,4194304] 0 2024-04-12T09:11:00.796 INFO:tasks.workunit.client.0.smithi117.stdout:9/147: rename d1/d8/df/l16 to d1/d8/df/d1b/l2d 0 2024-04-12T09:11:00.799 INFO:tasks.workunit.client.0.smithi117.stdout:9/148: rmdir d1/d24 39 2024-04-12T09:11:00.800 INFO:tasks.workunit.client.0.smithi117.stdout:9/149: dread - d1/d8/d12/f1e zero size 2024-04-12T09:11:00.806 INFO:tasks.workunit.client.0.smithi117.stdout:9/150: rename d1/f18 to d1/d24/f2e 0 2024-04-12T09:11:00.806 INFO:tasks.workunit.client.0.smithi117.stdout:8/102: sync 2024-04-12T09:11:00.808 INFO:tasks.workunit.client.0.smithi117.stdout:8/103: chown db/d1b/f15 4053 1 2024-04-12T09:11:00.812 INFO:tasks.workunit.client.0.smithi117.stdout:9/151: dwrite d1/d8/d12/f1e [0,4194304] 0 2024-04-12T09:11:00.817 INFO:tasks.workunit.client.0.smithi117.stdout:8/104: dwrite db/d19/d1a/f21 [0,4194304] 0 2024-04-12T09:11:00.820 INFO:tasks.workunit.client.0.smithi117.stdout:9/152: symlink d1/d24/l2f 0 2024-04-12T09:11:00.821 INFO:tasks.workunit.client.0.smithi117.stdout:8/105: dread fa [0,4194304] 0 2024-04-12T09:11:00.828 INFO:tasks.workunit.client.0.smithi117.stdout:8/106: creat db/d13/f25 x:0 0 0 2024-04-12T09:11:00.830 INFO:tasks.workunit.client.0.smithi117.stdout:9/153: link d1/d8/d12/d22/f1d d1/d24/f30 0 2024-04-12T09:11:00.832 INFO:tasks.workunit.client.0.smithi117.stdout:8/107: dread db/d1b/fe [0,4194304] 0 2024-04-12T09:11:00.835 INFO:tasks.workunit.client.0.smithi117.stdout:8/108: creat db/d19/d1a/f26 x:0 0 0 2024-04-12T09:11:00.837 INFO:tasks.workunit.client.0.smithi117.stdout:5/84: sync 2024-04-12T09:11:00.837 INFO:tasks.workunit.client.0.smithi117.stdout:2/103: sync 2024-04-12T09:11:00.839 INFO:tasks.workunit.client.0.smithi117.stdout:9/154: dwrite d1/d8/d12/d22/f2b [0,4194304] 0 2024-04-12T09:11:00.841 INFO:tasks.workunit.client.0.smithi117.stdout:2/104: symlink d0/l1c 0 2024-04-12T09:11:00.844 INFO:tasks.workunit.client.0.smithi117.stdout:9/155: dread d1/f4 [0,4194304] 0 2024-04-12T09:11:00.845 INFO:tasks.workunit.client.0.smithi117.stdout:5/85: symlink d2/d3/dd/l1c 0 2024-04-12T09:11:00.848 INFO:tasks.workunit.client.0.smithi117.stdout:8/109: rename db/d19/c1e to db/d13/c27 0 2024-04-12T09:11:00.850 INFO:tasks.workunit.client.0.smithi117.stdout:2/105: creat d0/df/f1d x:0 0 0 2024-04-12T09:11:00.850 INFO:tasks.workunit.client.0.smithi117.stdout:2/106: readlink d0/l1c 0 2024-04-12T09:11:00.850 INFO:tasks.workunit.client.0.smithi117.stdout:2/107: chown d0/d4/fb 4338117 1 2024-04-12T09:11:00.852 INFO:tasks.workunit.client.0.smithi117.stdout:9/156: symlink d1/d8/d12/d22/l31 0 2024-04-12T09:11:00.856 INFO:tasks.workunit.client.0.smithi117.stdout:9/157: dread d1/d24/f30 [0,4194304] 0 2024-04-12T09:11:00.857 INFO:tasks.workunit.client.0.smithi117.stdout:8/110: creat db/d1f/f28 x:0 0 0 2024-04-12T09:11:00.862 INFO:tasks.workunit.client.0.smithi117.stdout:5/86: rmdir d2/d3 39 2024-04-12T09:11:00.864 INFO:tasks.workunit.client.0.smithi117.stdout:8/111: dwrite db/d1f/f28 [0,4194304] 0 2024-04-12T09:11:00.864 INFO:tasks.workunit.client.0.smithi117.stdout:5/87: read f1 [3143341,125873] 0 2024-04-12T09:11:00.868 INFO:tasks.workunit.client.0.smithi117.stdout:2/108: unlink d0/d4/cd 0 2024-04-12T09:11:00.876 INFO:tasks.workunit.client.0.smithi117.stdout:8/112: rename db/d13/f18 to db/d1b/f29 0 2024-04-12T09:11:00.880 INFO:tasks.workunit.client.0.smithi117.stdout:9/158: getdents d1/d24 0 2024-04-12T09:11:00.881 INFO:tasks.workunit.client.0.smithi117.stdout:5/88: dwrite d2/d3/ff [0,4194304] 0 2024-04-12T09:11:00.883 INFO:tasks.workunit.client.0.smithi117.stdout:2/109: rename d0/d4/d10/f1b to d0/d4/f1e 0 2024-04-12T09:11:00.886 INFO:tasks.workunit.client.0.smithi117.stdout:5/89: dread d2/d3/ff [0,4194304] 0 2024-04-12T09:11:00.889 INFO:tasks.workunit.client.0.smithi117.stdout:9/159: creat d1/d8/d12/d22/f32 x:0 0 0 2024-04-12T09:11:00.895 INFO:tasks.workunit.client.0.smithi117.stdout:2/110: rename d0/df/l18 to d0/df/d1a/l1f 0 2024-04-12T09:11:00.896 INFO:tasks.workunit.client.0.smithi117.stdout:2/111: fdatasync d0/df/f1d 0 2024-04-12T09:11:00.900 INFO:tasks.workunit.client.0.smithi117.stdout:8/113: link db/fc db/d1f/f2a 0 2024-04-12T09:11:00.901 INFO:tasks.workunit.client.0.smithi117.stdout:8/114: fsync db/d1f/f20 0 2024-04-12T09:11:00.902 INFO:tasks.workunit.client.0.smithi117.stdout:8/115: write db/d13/f25 [5577,34907] 0 2024-04-12T09:11:00.903 INFO:tasks.workunit.client.0.smithi117.stdout:8/116: fsync db/d1f/f28 0 2024-04-12T09:11:00.903 INFO:tasks.workunit.client.0.smithi117.stdout:5/90: truncate d2/d3/ff 3990459 0 2024-04-12T09:11:00.908 INFO:tasks.workunit.client.0.smithi117.stdout:2/112: rmdir d0/df/d1a 39 2024-04-12T09:11:00.909 INFO:tasks.workunit.client.0.smithi117.stdout:5/91: dwrite f1 [0,4194304] 0 2024-04-12T09:11:00.910 INFO:tasks.workunit.client.0.smithi117.stdout:5/92: write f0 [898986,95915] 0 2024-04-12T09:11:00.910 INFO:tasks.workunit.client.0.smithi117.stdout:1/106: sync 2024-04-12T09:11:00.911 INFO:tasks.workunit.client.0.smithi117.stdout:7/110: sync 2024-04-12T09:11:00.911 INFO:tasks.workunit.client.0.smithi117.stdout:3/189: sync 2024-04-12T09:11:00.911 INFO:tasks.workunit.client.0.smithi117.stdout:4/118: sync 2024-04-12T09:11:00.911 INFO:tasks.workunit.client.0.smithi117.stdout:0/209: sync 2024-04-12T09:11:00.911 INFO:tasks.workunit.client.0.smithi117.stdout:6/223: sync 2024-04-12T09:11:00.914 INFO:tasks.workunit.client.0.smithi117.stdout:5/93: write f0 [1925979,13247] 0 2024-04-12T09:11:00.914 INFO:tasks.workunit.client.0.smithi117.stdout:4/119: stat d0/d5/d3/d1a 0 2024-04-12T09:11:00.918 INFO:tasks.workunit.client.0.smithi117.stdout:4/120: dread d0/f4 [0,4194304] 0 2024-04-12T09:11:00.920 INFO:tasks.workunit.client.0.smithi117.stdout:5/94: write f1 [4269309,65710] 0 2024-04-12T09:11:00.921 INFO:tasks.workunit.client.0.smithi117.stdout:1/107: dread d1/d6/f14 [0,4194304] 0 2024-04-12T09:11:00.925 INFO:tasks.workunit.client.0.smithi117.stdout:5/95: dread f1 [0,4194304] 0 2024-04-12T09:11:00.928 INFO:tasks.workunit.client.0.smithi117.stdout:3/190: mknod de/d2c/d3a/c48 0 2024-04-12T09:11:00.932 INFO:tasks.workunit.client.0.smithi117.stdout:5/96: dwrite d2/d3/f1b [0,4194304] 0 2024-04-12T09:11:00.936 INFO:tasks.workunit.client.0.smithi117.stdout:9/160: getdents d1/d8/df 0 2024-04-12T09:11:00.938 INFO:tasks.workunit.client.0.smithi117.stdout:9/161: read d1/fc [1584356,121156] 0 2024-04-12T09:11:00.944 INFO:tasks.workunit.client.0.smithi117.stdout:4/121: creat d0/d1/d10/f23 x:0 0 0 2024-04-12T09:11:00.944 INFO:tasks.workunit.client.0.smithi117.stdout:8/117: write db/d1b/f11 [389315,11176] 0 2024-04-12T09:11:00.948 INFO:tasks.workunit.client.0.smithi117.stdout:9/162: dwrite d1/fc [0,4194304] 0 2024-04-12T09:11:00.950 INFO:tasks.workunit.client.0.smithi117.stdout:4/122: chown d0/d1/f1f 2865 1 2024-04-12T09:11:00.953 INFO:tasks.workunit.client.0.smithi117.stdout:6/224: symlink d8/d9/d17/d2d/l4c 0 2024-04-12T09:11:00.959 INFO:tasks.workunit.client.0.smithi117.stdout:8/118: dwrite db/d1f/f28 [0,4194304] 0 2024-04-12T09:11:00.959 INFO:tasks.workunit.client.0.smithi117.stdout:1/108: dwrite d1/d6/f14 [0,4194304] 0 2024-04-12T09:11:00.960 INFO:tasks.workunit.client.0.smithi117.stdout:3/191: write de/d13/f1a [661965,2444] 0 2024-04-12T09:11:00.965 INFO:tasks.workunit.client.0.smithi117.stdout:4/123: dread d0/d1/f1f [0,4194304] 0 2024-04-12T09:11:00.965 INFO:tasks.workunit.client.0.smithi117.stdout:6/225: readlink d8/d9/d39/d3c/l3d 0 2024-04-12T09:11:00.973 INFO:tasks.workunit.client.0.smithi117.stdout:3/192: dwrite f2 [8388608,4194304] 0 2024-04-12T09:11:00.978 INFO:tasks.workunit.client.0.smithi117.stdout:2/113: creat d0/df/f20 x:0 0 0 2024-04-12T09:11:00.979 INFO:tasks.workunit.client.0.smithi117.stdout:2/114: chown d0/df/f20 4572 1 2024-04-12T09:11:00.982 INFO:tasks.workunit.client.0.smithi117.stdout:9/163: mknod d1/d8/c33 0 2024-04-12T09:11:00.983 INFO:tasks.workunit.client.0.smithi117.stdout:2/115: dread d0/d4/fb [0,4194304] 0 2024-04-12T09:11:00.988 INFO:tasks.workunit.client.0.smithi117.stdout:4/124: fsync d0/f4 0 2024-04-12T09:11:00.990 INFO:tasks.workunit.client.0.smithi117.stdout:1/109: write d1/f13 [5153629,67730] 0 2024-04-12T09:11:00.995 INFO:tasks.workunit.client.0.smithi117.stdout:0/210: truncate d3/d36/f42 1691922 0 2024-04-12T09:11:00.999 INFO:tasks.workunit.client.0.smithi117.stdout:6/226: stat d8/d9/d17/d2d/c37 0 2024-04-12T09:11:00.999 INFO:tasks.workunit.client.0.smithi117.stdout:4/125: dwrite d0/d1/f1f [0,4194304] 0 2024-04-12T09:11:01.000 INFO:tasks.workunit.client.0.smithi117.stdout:4/126: stat d0/f4 0 2024-04-12T09:11:01.001 INFO:tasks.workunit.client.0.smithi117.stdout:4/127: read - d0/d1/f1b zero size 2024-04-12T09:11:01.003 INFO:tasks.workunit.client.0.smithi117.stdout:1/110: dwrite d1/d6/f1a [0,4194304] 0 2024-04-12T09:11:01.008 INFO:tasks.workunit.client.0.smithi117.stdout:7/111: rename d0/d2/d12/d14 to d0/d2/d22 0 2024-04-12T09:11:01.015 INFO:tasks.workunit.client.0.smithi117.stdout:0/211: fsync d3/f23 0 2024-04-12T09:11:01.017 INFO:tasks.workunit.client.0.smithi117.stdout:3/193: mkdir de/d13/d19/d22/d40/d49 0 2024-04-12T09:11:01.021 INFO:tasks.workunit.client.0.smithi117.stdout:6/227: fsync d8/d2a/f2f 0 2024-04-12T09:11:01.022 INFO:tasks.workunit.client.0.smithi117.stdout:0/212: dread d3/dc/f2c [0,4194304] 0 2024-04-12T09:11:01.024 INFO:tasks.workunit.client.0.smithi117.stdout:4/128: unlink d0/c15 0 2024-04-12T09:11:01.031 INFO:tasks.workunit.client.0.smithi117.stdout:8/119: rename db/d1f/f20 to db/d19/f2b 0 2024-04-12T09:11:01.032 INFO:tasks.workunit.client.0.smithi117.stdout:7/112: mkdir d0/d2/d22/d17/d23 0 2024-04-12T09:11:01.038 INFO:tasks.workunit.client.0.smithi117.stdout:2/116: creat d0/df/d1a/f21 x:0 0 0 2024-04-12T09:11:01.042 INFO:tasks.workunit.client.0.smithi117.stdout:5/97: getdents d2 0 2024-04-12T09:11:01.042 INFO:tasks.workunit.client.0.smithi117.stdout:5/98: chown f0 98454598 1 2024-04-12T09:11:01.051 INFO:tasks.workunit.client.0.smithi117.stdout:4/129: unlink d0/d1/f1f 0 2024-04-12T09:11:01.053 INFO:tasks.workunit.client.0.smithi117.stdout:1/111: mknod d1/c1b 0 2024-04-12T09:11:01.055 INFO:tasks.workunit.client.0.smithi117.stdout:9/164: rename d1/d8/ld to d1/d8/df/d1b/l34 0 2024-04-12T09:11:01.055 INFO:tasks.workunit.client.0.smithi117.stdout:4/130: dread d0/d5/d3/d1a/d20/f22 [0,4194304] 0 2024-04-12T09:11:01.057 INFO:tasks.workunit.client.0.smithi117.stdout:8/120: mknod db/d19/d1a/c2c 0 2024-04-12T09:11:01.057 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:00 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:11:01.058 INFO:tasks.workunit.client.0.smithi117.stdout:4/131: dread - d0/d5/d3/f1c zero size 2024-04-12T09:11:01.059 INFO:tasks.workunit.client.0.smithi117.stdout:5/99: mkdir d2/d3/d1d 0 2024-04-12T09:11:01.061 INFO:tasks.workunit.client.0.smithi117.stdout:3/194: symlink de/d13/d19/l4a 0 2024-04-12T09:11:01.066 INFO:tasks.workunit.client.0.smithi117.stdout:0/213: creat d3/d30/d32/f45 x:0 0 0 2024-04-12T09:11:01.072 INFO:tasks.workunit.client.0.smithi117.stdout:2/117: rename d0/d4/f1e to d0/df/d1a/f22 0 2024-04-12T09:11:01.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:00 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:11:01.073 INFO:tasks.workunit.client.0.smithi117.stdout:7/113: creat d0/d2/d1a/f24 x:0 0 0 2024-04-12T09:11:01.075 INFO:tasks.workunit.client.0.smithi117.stdout:8/121: symlink db/d13/l2d 0 2024-04-12T09:11:01.076 INFO:tasks.workunit.client.0.smithi117.stdout:4/132: mknod d0/d5/d3/d1a/d20/c24 0 2024-04-12T09:11:01.077 INFO:tasks.workunit.client.0.smithi117.stdout:4/133: write d0/f4 [748487,76470] 0 2024-04-12T09:11:01.078 INFO:tasks.workunit.client.0.smithi117.stdout:5/100: mkdir d2/d3/de/d1e 0 2024-04-12T09:11:01.079 INFO:tasks.workunit.client.0.smithi117.stdout:4/134: chown d0/d5/d3/d1a 314408 1 2024-04-12T09:11:01.080 INFO:tasks.workunit.client.0.smithi117.stdout:4/135: write d0/d1/d10/f12 [2367580,7855] 0 2024-04-12T09:11:01.082 INFO:tasks.workunit.client.0.smithi117.stdout:4/136: write d0/d1/d10/f12 [4067948,110771] 0 2024-04-12T09:11:01.083 INFO:tasks.workunit.client.0.smithi117.stdout:0/214: rmdir d3/dc 39 2024-04-12T09:11:01.094 INFO:tasks.workunit.client.0.smithi117.stdout:2/118: mknod d0/c23 0 2024-04-12T09:11:01.095 INFO:tasks.workunit.client.0.smithi117.stdout:2/119: write d0/df/d1a/f21 [70034,83283] 0 2024-04-12T09:11:01.097 INFO:tasks.workunit.client.0.smithi117.stdout:5/101: dread f0 [0,4194304] 0 2024-04-12T09:11:01.105 INFO:tasks.workunit.client.0.smithi117.stdout:6/228: link d8/d2a/l34 d8/d9/l4d 0 2024-04-12T09:11:01.108 INFO:tasks.workunit.client.0.smithi117.stdout:4/137: mkdir d0/d5/d25 0 2024-04-12T09:11:01.113 INFO:tasks.workunit.client.0.smithi117.stdout:7/114: creat d0/d2/d22/d15/f25 x:0 0 0 2024-04-12T09:11:01.115 INFO:tasks.workunit.client.0.smithi117.stdout:2/120: symlink d0/l24 0 2024-04-12T09:11:01.116 INFO:tasks.workunit.client.0.smithi117.stdout:2/121: write d0/df/f1d [860857,15536] 0 2024-04-12T09:11:01.120 INFO:tasks.workunit.client.0.smithi117.stdout:7/115: dwrite d0/d2/f8 [0,4194304] 0 2024-04-12T09:11:01.120 INFO:tasks.workunit.client.0.smithi117.stdout:6/229: chown d8/l30 743 1 2024-04-12T09:11:01.123 INFO:tasks.workunit.client.0.smithi117.stdout:4/138: creat d0/d5/d3/d1a/d20/f26 x:0 0 0 2024-04-12T09:11:01.125 INFO:tasks.workunit.client.0.smithi117.stdout:7/116: dread d0/d2/f8 [0,4194304] 0 2024-04-12T09:11:01.126 INFO:tasks.workunit.client.0.smithi117.stdout:7/117: read d0/d2/f16 [374145,74624] 0 2024-04-12T09:11:01.126 INFO:tasks.workunit.client.0.smithi117.stdout:7/118: readlink d0/l9 0 2024-04-12T09:11:01.128 INFO:tasks.workunit.client.0.smithi117.stdout:0/215: rename d3/d36/c3e to d3/d22/c46 0 2024-04-12T09:11:01.131 INFO:tasks.workunit.client.0.smithi117.stdout:2/122: mknod d0/df/d1a/c25 0 2024-04-12T09:11:01.132 INFO:tasks.workunit.client.0.smithi117.stdout:2/123: dread d0/df/d1a/f21 [0,4194304] 0 2024-04-12T09:11:01.143 INFO:tasks.workunit.client.0.smithi117.stdout:7/119: rename d0/d2/c6 to d0/d20/c26 0 2024-04-12T09:11:01.147 INFO:tasks.workunit.client.0.smithi117.stdout:2/124: mkdir d0/d26 0 2024-04-12T09:11:01.150 INFO:tasks.workunit.client.0.smithi117.stdout:6/230: creat d8/d3a/d49/f4e x:0 0 0 2024-04-12T09:11:01.150 INFO:tasks.workunit.client.0.smithi117.stdout:2/125: dread d0/d4/d10/f19 [0,4194304] 0 2024-04-12T09:11:01.151 INFO:tasks.workunit.client.0.smithi117.stdout:1/112: truncate d1/d6/f1a 2029998 0 2024-04-12T09:11:01.156 INFO:tasks.workunit.client.0.smithi117.stdout:0/216: fdatasync d3/dc/f2c 0 2024-04-12T09:11:01.158 INFO:tasks.workunit.client.0.smithi117.stdout:9/165: dwrite d1/d23/f28 [0,4194304] 0 2024-04-12T09:11:01.160 INFO:tasks.workunit.client.0.smithi117.stdout:7/120: creat d0/d2/d22/f27 x:0 0 0 2024-04-12T09:11:01.160 INFO:tasks.workunit.client.0.smithi117.stdout:3/195: truncate de/d13/f34 1206877 0 2024-04-12T09:11:01.163 INFO:tasks.workunit.client.0.smithi117.stdout:7/121: dread d0/d2/d12/f1e [0,4194304] 0 2024-04-12T09:11:01.166 INFO:tasks.workunit.client.0.smithi117.stdout:6/231: creat d8/d9/d39/f4f x:0 0 0 2024-04-12T09:11:01.177 INFO:tasks.workunit.client.0.smithi117.stdout:9/166: creat d1/d8/df/d1b/f35 x:0 0 0 2024-04-12T09:11:01.188 INFO:tasks.workunit.client.0.smithi117.stdout:4/139: getdents d0/d5 0 2024-04-12T09:11:01.190 INFO:tasks.workunit.client.0.smithi117.stdout:0/217: mkdir d3/d47 0 2024-04-12T09:11:01.190 INFO:tasks.workunit.client.0.smithi117.stdout:0/218: dread - d3/d30/f3d zero size 2024-04-12T09:11:01.192 INFO:tasks.workunit.client.0.smithi117.stdout:9/167: write d1/d24/f2e [1237683,81580] 0 2024-04-12T09:11:01.193 INFO:tasks.workunit.client.0.smithi117.stdout:9/168: fdatasync d1/d8/d12/d22/f32 0 2024-04-12T09:11:01.194 INFO:tasks.workunit.client.0.smithi117.stdout:9/169: write d1/d8/d12/f1e [4668241,93602] 0 2024-04-12T09:11:01.198 INFO:tasks.workunit.client.0.smithi117.stdout:7/122: rename d0/d2/d12/f1e to d0/d2/d22/f28 0 2024-04-12T09:11:01.198 INFO:tasks.workunit.client.0.smithi117.stdout:7/123: dread - d0/d2/d22/d15/f25 zero size 2024-04-12T09:11:01.207 INFO:tasks.workunit.client.0.smithi117.stdout:9/170: creat d1/d8/d12/d22/f36 x:0 0 0 2024-04-12T09:11:01.209 INFO:tasks.workunit.client.0.smithi117.stdout:7/124: creat d0/d2/d22/d17/f29 x:0 0 0 2024-04-12T09:11:01.210 INFO:tasks.workunit.client.0.smithi117.stdout:7/125: dread - d0/d2/d22/d17/f21 zero size 2024-04-12T09:11:01.212 INFO:tasks.workunit.client.0.smithi117.stdout:0/219: fsync d3/dc/f34 0 2024-04-12T09:11:01.215 INFO:tasks.workunit.client.0.smithi117.stdout:9/171: fdatasync d1/d24/f2a 0 2024-04-12T09:11:01.217 INFO:tasks.workunit.client.0.smithi117.stdout:4/140: creat d0/f27 x:0 0 0 2024-04-12T09:11:01.219 INFO:tasks.workunit.client.0.smithi117.stdout:4/141: dread d0/f14 [0,4194304] 0 2024-04-12T09:11:01.224 INFO:tasks.workunit.client.0.smithi117.stdout:7/126: dwrite d0/d2/f8 [0,4194304] 0 2024-04-12T09:11:01.237 INFO:tasks.workunit.client.0.smithi117.stdout:9/172: getdents d1/d8/df/d26 0 2024-04-12T09:11:01.237 INFO:tasks.workunit.client.0.smithi117.stdout:1/113: write f0 [2804667,94386] 0 2024-04-12T09:11:01.241 INFO:tasks.workunit.client.0.smithi117.stdout:7/127: mkdir d0/d2/d22/d17/d23/d2a 0 2024-04-12T09:11:01.242 INFO:tasks.workunit.client.0.smithi117.stdout:7/128: chown d0/d2/d22/d17/f29 163809074 1 2024-04-12T09:11:01.244 INFO:tasks.workunit.client.0.smithi117.stdout:1/114: creat d1/d6/da/db/f1c x:0 0 0 2024-04-12T09:11:01.246 INFO:tasks.workunit.client.0.smithi117.stdout:1/115: read d1/d6/da/db/d16/f19 [101556,120728] 0 2024-04-12T09:11:01.247 INFO:tasks.workunit.client.0.smithi117.stdout:1/116: dread d1/d6/da/db/d16/f19 [0,4194304] 0 2024-04-12T09:11:01.255 INFO:tasks.workunit.client.0.smithi117.stdout:1/117: mkdir d1/d6/da/db/d1d 0 2024-04-12T09:11:01.255 INFO:tasks.workunit.client.0.smithi117.stdout:1/118: chown d1/c1b 56146804 1 2024-04-12T09:11:01.258 INFO:tasks.workunit.client.0.smithi117.stdout:1/119: dread d1/d6/f14 [0,4194304] 0 2024-04-12T09:11:01.261 INFO:tasks.workunit.client.0.smithi117.stdout:7/129: creat d0/f2b x:0 0 0 2024-04-12T09:11:01.268 INFO:tasks.workunit.client.0.smithi117.stdout:7/130: symlink d0/d2/d12/l2c 0 2024-04-12T09:11:01.269 INFO:tasks.workunit.client.0.smithi117.stdout:7/131: write d0/f1b [1434279,111269] 0 2024-04-12T09:11:01.271 INFO:tasks.workunit.client.0.smithi117.stdout:9/173: truncate d1/d24/f2a 221405 0 2024-04-12T09:11:01.272 INFO:tasks.workunit.client.0.smithi117.stdout:9/174: write d1/d23/f28 [4211319,48265] 0 2024-04-12T09:11:01.275 INFO:tasks.workunit.client.0.smithi117.stdout:4/142: write d0/d5/d3/d1a/d20/f22 [1670383,21843] 0 2024-04-12T09:11:01.277 INFO:tasks.workunit.client.0.smithi117.stdout:0/220: write d3/dc/f44 [3813499,50869] 0 2024-04-12T09:11:01.280 INFO:tasks.workunit.client.0.smithi117.stdout:9/175: creat d1/d8/d12/f37 x:0 0 0 2024-04-12T09:11:01.285 INFO:tasks.workunit.client.0.smithi117.stdout:4/143: rename d0/d5/d3/d1a/d20/f22 to d0/d5/d3/d1a/f28 0 2024-04-12T09:11:01.292 INFO:tasks.workunit.client.0.smithi117.stdout:4/144: dwrite d0/d5/f8 [0,4194304] 0 2024-04-12T09:11:01.293 INFO:tasks.workunit.client.0.smithi117.stdout:4/145: dread - d0/d1/f1b zero size 2024-04-12T09:11:01.294 INFO:tasks.workunit.client.0.smithi117.stdout:9/176: rename d1/d24/f30 to d1/d8/d12/f38 0 2024-04-12T09:11:01.300 INFO:tasks.workunit.client.0.smithi117.stdout:4/146: dwrite d0/d1/d10/f23 [0,4194304] 0 2024-04-12T09:11:01.302 INFO:tasks.workunit.client.0.smithi117.stdout:4/147: stat d0/d5/lc 0 2024-04-12T09:11:01.303 INFO:tasks.workunit.client.0.smithi117.stdout:1/120: truncate d1/d6/da/db/d16/f19 183337 0 2024-04-12T09:11:01.318 INFO:tasks.workunit.client.0.smithi117.stdout:7/132: write d0/d2/f16 [2118298,105920] 0 2024-04-12T09:11:01.319 INFO:tasks.workunit.client.0.smithi117.stdout:7/133: truncate d0/d2/d22/f28 912116 0 2024-04-12T09:11:01.322 INFO:tasks.workunit.client.0.smithi117.stdout:7/134: creat d0/da/f2d x:0 0 0 2024-04-12T09:11:01.326 INFO:tasks.workunit.client.0.smithi117.stdout:0/221: write d3/dc/f34 [546961,53309] 0 2024-04-12T09:11:01.332 INFO:tasks.workunit.client.0.smithi117.stdout:0/222: mkdir d3/d30/d48 0 2024-04-12T09:11:01.339 INFO:tasks.workunit.client.0.smithi117.stdout:4/148: dwrite d0/d1/d10/f23 [4194304,4194304] 0 2024-04-12T09:11:01.343 INFO:tasks.workunit.client.0.smithi117.stdout:0/223: rmdir d3/d30/d48 0 2024-04-12T09:11:01.345 INFO:tasks.workunit.client.0.smithi117.stdout:4/149: dwrite d0/f14 [0,4194304] 0 2024-04-12T09:11:01.355 INFO:tasks.workunit.client.0.smithi117.stdout:4/150: dwrite d0/d5/d3/d1a/d20/f26 [0,4194304] 0 2024-04-12T09:11:01.360 INFO:tasks.workunit.client.0.smithi117.stdout:4/151: symlink d0/d5/l29 0 2024-04-12T09:11:01.364 INFO:tasks.workunit.client.0.smithi117.stdout:4/152: fdatasync d0/f14 0 2024-04-12T09:11:01.370 INFO:tasks.workunit.client.0.smithi117.stdout:4/153: symlink d0/d5/d25/l2a 0 2024-04-12T09:11:01.371 INFO:tasks.workunit.client.0.smithi117.stdout:4/154: write d0/f14 [3518947,10655] 0 2024-04-12T09:11:01.377 INFO:tasks.workunit.client.0.smithi117.stdout:4/155: dwrite d0/d5/f8 [0,4194304] 0 2024-04-12T09:11:01.381 INFO:tasks.workunit.client.0.smithi117.stdout:4/156: creat d0/d5/d3/d1a/f2b x:0 0 0 2024-04-12T09:11:01.457 INFO:tasks.workunit.client.0.smithi117.stdout:4/157: unlink d0/d1/d10/f12 0 2024-04-12T09:11:01.465 INFO:tasks.workunit.client.0.smithi117.stdout:4/158: mkdir d0/d2c 0 2024-04-12T09:11:01.465 INFO:tasks.workunit.client.0.smithi117.stdout:4/159: write d0/f4 [2053934,21657] 0 2024-04-12T09:11:01.466 INFO:tasks.workunit.client.0.smithi117.stdout:4/160: chown d0/d1/d10 5773 1 2024-04-12T09:11:01.470 INFO:tasks.workunit.client.0.smithi117.stdout:4/161: unlink d0/d5/d3/d1a/f2b 0 2024-04-12T09:11:01.477 INFO:tasks.workunit.client.0.smithi117.stdout:4/162: link d0/d5/d3/d1a/c1e d0/d5/d3/d1a/d20/c2d 0 2024-04-12T09:11:01.506 INFO:tasks.workunit.client.0.smithi117.stdout:4/163: truncate d0/f4 89416 0 2024-04-12T09:11:01.508 INFO:tasks.workunit.client.0.smithi117.stdout:4/164: symlink d0/d5/d3/d1a/d20/l2e 0 2024-04-12T09:11:01.521 INFO:tasks.workunit.client.0.smithi117.stdout:4/165: write d0/d5/f8 [991714,125503] 0 2024-04-12T09:11:01.529 INFO:tasks.workunit.client.0.smithi117.stdout:4/166: dwrite d0/d5/d3/d1a/f28 [0,4194304] 0 2024-04-12T09:11:01.531 INFO:tasks.workunit.client.0.smithi117.stdout:4/167: chown d0/d5/d3/d1a/f28 883606 1 2024-04-12T09:11:01.533 INFO:tasks.workunit.client.0.smithi117.stdout:4/168: rmdir d0/d1 39 2024-04-12T09:11:01.534 INFO:tasks.workunit.client.0.smithi117.stdout:4/169: truncate d0/d5/d3/d1a/f28 4315467 0 2024-04-12T09:11:01.535 INFO:tasks.workunit.client.0.smithi117.stdout:4/170: chown d0/d5/d3 112769 1 2024-04-12T09:11:01.613 INFO:tasks.workunit.client.0.smithi117.stdout:8/122: sync 2024-04-12T09:11:01.616 INFO:tasks.workunit.client.0.smithi117.stdout:8/123: dread db/d1f/f28 [0,4194304] 0 2024-04-12T09:11:01.618 INFO:tasks.workunit.client.0.smithi117.stdout:8/124: symlink db/d19/d1a/l2e 0 2024-04-12T09:11:01.806 INFO:tasks.workunit.client.0.smithi117.stdout:5/102: sync 2024-04-12T09:11:01.807 INFO:tasks.workunit.client.0.smithi117.stdout:2/126: sync 2024-04-12T09:11:01.808 INFO:tasks.workunit.client.0.smithi117.stdout:2/127: mkdir d0/d4/d10/d27 0 2024-04-12T09:11:01.812 INFO:tasks.workunit.client.0.smithi117.stdout:5/103: dwrite d2/d3/ff [0,4194304] 0 2024-04-12T09:11:01.814 INFO:tasks.workunit.client.0.smithi117.stdout:2/128: dread d0/d4/fb [0,4194304] 0 2024-04-12T09:11:01.817 INFO:tasks.workunit.client.0.smithi117.stdout:5/104: rename f0 to d2/d3/dd/f1f 0 2024-04-12T09:11:01.818 INFO:tasks.workunit.client.0.smithi117.stdout:2/129: mknod d0/df/d1a/c28 0 2024-04-12T09:11:01.821 INFO:tasks.workunit.client.0.smithi117.stdout:5/105: creat d2/d3/de/d1e/f20 x:0 0 0 2024-04-12T09:11:01.825 INFO:tasks.workunit.client.0.smithi117.stdout:2/130: dwrite d0/df/f20 [0,4194304] 0 2024-04-12T09:11:01.827 INFO:tasks.workunit.client.0.smithi117.stdout:5/106: getdents d2/d3/de 0 2024-04-12T09:11:01.830 INFO:tasks.workunit.client.0.smithi117.stdout:5/107: truncate d2/d3/dd/f17 440216 0 2024-04-12T09:11:01.834 INFO:tasks.workunit.client.0.smithi117.stdout:5/108: creat d2/f21 x:0 0 0 2024-04-12T09:11:01.891 INFO:tasks.workunit.client.0.smithi117.stdout:2/131: dwrite d0/df/d1a/f21 [0,4194304] 0 2024-04-12T09:11:01.897 INFO:tasks.workunit.client.0.smithi117.stdout:5/109: dread d2/d3/ff [0,4194304] 0 2024-04-12T09:11:01.901 INFO:tasks.workunit.client.0.smithi117.stdout:2/132: dwrite d0/df/d1a/f21 [0,4194304] 0 2024-04-12T09:11:01.901 INFO:tasks.workunit.client.0.smithi117.stdout:5/110: rmdir d2 39 2024-04-12T09:11:01.908 INFO:tasks.workunit.client.0.smithi117.stdout:2/133: symlink d0/df/d1a/l29 0 2024-04-12T09:11:01.913 INFO:tasks.workunit.client.0.smithi117.stdout:2/134: readlink d0/df/d1a/l1f 0 2024-04-12T09:11:01.917 INFO:tasks.workunit.client.0.smithi117.stdout:5/111: dwrite d2/f19 [0,4194304] 0 2024-04-12T09:11:01.921 INFO:tasks.workunit.client.0.smithi117.stdout:2/135: mkdir d0/d4/d10/d2a 0 2024-04-12T09:11:01.921 INFO:tasks.workunit.client.0.smithi117.stdout:5/112: dread d2/d3/ff [0,4194304] 0 2024-04-12T09:11:01.923 INFO:tasks.workunit.client.0.smithi117.stdout:5/113: fsync d2/d3/de/d1e/f20 0 2024-04-12T09:11:01.929 INFO:tasks.workunit.client.0.smithi117.stdout:5/114: symlink d2/d3/l22 0 2024-04-12T09:11:01.932 INFO:tasks.workunit.client.0.smithi117.stdout:2/136: dwrite d0/df/d1a/f22 [0,4194304] 0 2024-04-12T09:11:01.937 INFO:tasks.workunit.client.0.smithi117.stdout:2/137: rename d0/l24 to d0/d4/d10/d27/l2b 0 2024-04-12T09:11:01.950 INFO:tasks.workunit.client.0.smithi117.stdout:5/115: write d2/f6 [389956,59083] 0 2024-04-12T09:11:01.957 INFO:tasks.workunit.client.0.smithi117.stdout:5/116: dwrite d2/d3/dd/f17 [0,4194304] 0 2024-04-12T09:11:01.958 INFO:tasks.workunit.client.0.smithi117.stdout:5/117: rename d2 to d2/d3/de/d1e/d23 22 2024-04-12T09:11:01.962 INFO:tasks.workunit.client.0.smithi117.stdout:5/118: mknod d2/d3/de/c24 0 2024-04-12T09:11:01.962 INFO:tasks.workunit.client.0.smithi117.stdout:3/196: sync 2024-04-12T09:11:01.962 INFO:tasks.workunit.client.0.smithi117.stdout:9/177: sync 2024-04-12T09:11:01.962 INFO:tasks.workunit.client.0.smithi117.stdout:6/232: sync 2024-04-12T09:11:01.962 INFO:tasks.workunit.client.0.smithi117.stdout:1/121: sync 2024-04-12T09:11:01.963 INFO:tasks.workunit.client.0.smithi117.stdout:5/119: chown d2/d3/de/d1e 7089 1 2024-04-12T09:11:01.965 INFO:tasks.workunit.client.0.smithi117.stdout:5/120: dread d2/d3/dd/f12 [0,4194304] 0 2024-04-12T09:11:01.966 INFO:tasks.workunit.client.0.smithi117.stdout:3/197: rmdir de/d2c 39 2024-04-12T09:11:01.967 INFO:tasks.workunit.client.0.smithi117.stdout:9/178: dread d1/d23/f28 [0,4194304] 0 2024-04-12T09:11:01.970 INFO:tasks.workunit.client.0.smithi117.stdout:5/121: dread d2/d3/f1b [0,4194304] 0 2024-04-12T09:11:01.980 INFO:tasks.workunit.client.0.smithi117.stdout:9/179: mkdir d1/d8/df/d39 0 2024-04-12T09:11:01.992 INFO:tasks.workunit.client.0.smithi117.stdout:1/122: write d1/d6/f14 [229408,38987] 0 2024-04-12T09:11:01.993 INFO:tasks.workunit.client.0.smithi117.stdout:9/180: creat d1/d8/df/f3a x:0 0 0 2024-04-12T09:11:01.998 INFO:tasks.workunit.client.0.smithi117.stdout:5/122: symlink d2/d3/d1d/l25 0 2024-04-12T09:11:01.998 INFO:tasks.workunit.client.0.smithi117.stdout:3/198: dwrite de/d2c/d3a/f46 [0,4194304] 0 2024-04-12T09:11:01.998 INFO:tasks.workunit.client.0.smithi117.stdout:5/123: fsync d2/d3/f15 0 2024-04-12T09:11:02.003 INFO:tasks.workunit.client.0.smithi117.stdout:1/123: unlink d1/d6/da/db/f1c 0 2024-04-12T09:11:02.008 INFO:tasks.workunit.client.0.smithi117.stdout:3/199: stat de/l2b 0 2024-04-12T09:11:02.009 INFO:tasks.workunit.client.0.smithi117.stdout:3/200: chown de/d2c/d3a/c48 18776600 1 2024-04-12T09:11:02.010 INFO:tasks.workunit.client.0.smithi117.stdout:5/124: mknod d2/d3/dd/c26 0 2024-04-12T09:11:02.014 INFO:tasks.workunit.client.0.smithi117.stdout:1/124: creat d1/d6/da/db/f1e x:0 0 0 2024-04-12T09:11:02.017 INFO:tasks.workunit.client.0.smithi117.stdout:9/181: mkdir d1/d8/df/d39/d3b 0 2024-04-12T09:11:02.020 INFO:tasks.workunit.client.0.smithi117.stdout:5/125: mknod d2/d3/dd/c27 0 2024-04-12T09:11:02.023 INFO:tasks.workunit.client.0.smithi117.stdout:9/182: rename d1/d8/fa to d1/d8/df/d26/f3c 0 2024-04-12T09:11:02.026 INFO:tasks.workunit.client.0.smithi117.stdout:1/125: getdents d1/d6/da/db/d1d 0 2024-04-12T09:11:02.026 INFO:tasks.workunit.client.0.smithi117.stdout:1/126: rename d1/d6/da to d1/d6/da/d1f 22 2024-04-12T09:11:02.027 INFO:tasks.workunit.client.0.smithi117.stdout:1/127: write d1/f13 [4619340,56705] 0 2024-04-12T09:11:02.029 INFO:tasks.workunit.client.0.smithi117.stdout:9/183: mknod d1/d23/c3d 0 2024-04-12T09:11:02.034 INFO:tasks.workunit.client.0.smithi117.stdout:5/126: dread d2/f6 [0,4194304] 0 2024-04-12T09:11:02.035 INFO:tasks.workunit.client.0.smithi117.stdout:9/184: read d1/d8/d12/f38 [112006,46418] 0 2024-04-12T09:11:02.036 INFO:tasks.workunit.client.0.smithi117.stdout:3/201: link de/d2c/c2d de/c4b 0 2024-04-12T09:11:02.037 INFO:tasks.workunit.client.0.smithi117.stdout:9/185: write d1/d8/d12/d22/f36 [49604,128272] 0 2024-04-12T09:11:02.037 INFO:tasks.workunit.client.0.smithi117.stdout:1/128: truncate d1/d6/da/db/d16/f19 1148674 0 2024-04-12T09:11:02.039 INFO:tasks.workunit.client.0.smithi117.stdout:5/127: rmdir d2/d3/de/d1e 39 2024-04-12T09:11:02.041 INFO:tasks.workunit.client.0.smithi117.stdout:3/202: chown de/d13/d19 52 1 2024-04-12T09:11:02.042 INFO:tasks.workunit.client.0.smithi117.stdout:3/203: fdatasync de/d13/d19/d27/f3c 0 2024-04-12T09:11:02.042 INFO:tasks.workunit.client.0.smithi117.stdout:3/204: dread - de/d2c/f45 zero size 2024-04-12T09:11:02.045 INFO:tasks.workunit.client.0.smithi117.stdout:9/186: rename d1/d8/d12/d22 to d1/d8/df/d3e 0 2024-04-12T09:11:02.046 INFO:tasks.workunit.client.0.smithi117.stdout:3/205: dread f7 [0,4194304] 0 2024-04-12T09:11:02.047 INFO:tasks.workunit.client.0.smithi117.stdout:1/129: creat d1/d6/da/f20 x:0 0 0 2024-04-12T09:11:02.050 INFO:tasks.workunit.client.0.smithi117.stdout:9/187: creat d1/d8/df/d1b/f3f x:0 0 0 2024-04-12T09:11:02.060 INFO:tasks.workunit.client.0.smithi117.stdout:3/206: dread de/d13/f24 [0,4194304] 0 2024-04-12T09:11:02.060 INFO:tasks.workunit.client.0.smithi117.stdout:3/207: stat de/d13/d19/f29 0 2024-04-12T09:11:02.063 INFO:tasks.workunit.client.0.smithi117.stdout:5/128: link d2/d3/dd/f12 d2/f28 0 2024-04-12T09:11:02.066 INFO:tasks.workunit.client.0.smithi117.stdout:3/208: mkdir de/d13/d4c 0 2024-04-12T09:11:02.068 INFO:tasks.workunit.client.0.smithi117.stdout:5/129: truncate d2/d3/de/d1e/f20 630768 0 2024-04-12T09:11:02.069 INFO:tasks.workunit.client.0.smithi117.stdout:3/209: chown de/d13/d19/d27/c39 1 1 2024-04-12T09:11:02.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:01 smithi203 ceph-mon[36428]: pgmap v11: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 428 KiB/s rd, 22 MiB/s wr, 288 op/s 2024-04-12T09:11:02.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:01 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:02.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:01 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:02.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:01 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:11:02.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:01 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:11:02.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:01 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:11:02.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:01 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:11:02.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:01 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:11:02.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:01 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:11:02.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:01 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:02.077 INFO:tasks.workunit.client.0.smithi117.stdout:3/210: mknod de/c4d 0 2024-04-12T09:11:02.083 INFO:tasks.workunit.client.0.smithi117.stdout:3/211: mknod de/c4e 0 2024-04-12T09:11:02.084 INFO:tasks.workunit.client.0.smithi117.stdout:3/212: chown de/d2c/d3a/c48 49625282 1 2024-04-12T09:11:02.084 INFO:tasks.workunit.client.0.smithi117.stdout:3/213: chown de/d13/c17 14 1 2024-04-12T09:11:02.090 INFO:tasks.workunit.client.0.smithi117.stdout:3/214: dwrite f2 [12582912,4194304] 0 2024-04-12T09:11:02.097 INFO:tasks.workunit.client.0.smithi117.stdout:9/188: write d1/d23/f28 [1466798,68014] 0 2024-04-12T09:11:02.099 INFO:tasks.workunit.client.0.smithi117.stdout:3/215: dwrite de/d13/f1a [0,4194304] 0 2024-04-12T09:11:02.101 INFO:tasks.workunit.client.0.smithi117.stdout:3/216: write de/d13/d19/d22/d3e/f41 [1183681,5162] 0 2024-04-12T09:11:02.102 INFO:tasks.workunit.client.0.smithi117.stdout:9/189: symlink d1/d8/df/d1b/l40 0 2024-04-12T09:11:02.103 INFO:tasks.workunit.client.0.smithi117.stdout:9/190: chown d1/d24 19260 1 2024-04-12T09:11:02.103 INFO:tasks.workunit.client.0.smithi117.stdout:9/191: chown d1 296 1 2024-04-12T09:11:02.106 INFO:tasks.workunit.client.0.smithi117.stdout:9/192: dread d1/d8/df/d3e/f1d [0,4194304] 0 2024-04-12T09:11:02.110 INFO:tasks.workunit.client.0.smithi117.stdout:3/217: mkdir de/d13/d19/d4f 0 2024-04-12T09:11:02.112 INFO:tasks.workunit.client.0.smithi117.stdout:3/218: dread - de/d13/f42 zero size 2024-04-12T09:11:02.113 INFO:tasks.workunit.client.0.smithi117.stdout:9/193: mkdir d1/d8/df/d26/d41 0 2024-04-12T09:11:02.113 INFO:tasks.workunit.client.0.smithi117.stdout:5/130: dwrite f1 [0,4194304] 0 2024-04-12T09:11:02.114 INFO:tasks.workunit.client.0.smithi117.stdout:9/194: read d1/fc [1933531,62699] 0 2024-04-12T09:11:02.116 INFO:tasks.workunit.client.0.smithi117.stdout:3/219: dread de/d13/f24 [0,4194304] 0 2024-04-12T09:11:02.119 INFO:tasks.workunit.client.0.smithi117.stdout:5/131: unlink d2/d3/ff 0 2024-04-12T09:11:02.124 INFO:tasks.workunit.client.0.smithi117.stdout:5/132: symlink d2/d3/l29 0 2024-04-12T09:11:02.126 INFO:tasks.workunit.client.0.smithi117.stdout:9/195: creat d1/d8/df/d39/d3b/f42 x:0 0 0 2024-04-12T09:11:02.129 INFO:tasks.workunit.client.0.smithi117.stdout:9/196: dread d1/d8/df/f13 [0,4194304] 0 2024-04-12T09:11:02.132 INFO:tasks.workunit.client.0.smithi117.stdout:3/220: link de/f15 de/d13/d19/d22/d3e/f50 0 2024-04-12T09:11:02.135 INFO:tasks.workunit.client.0.smithi117.stdout:3/221: dread de/d2c/f31 [0,4194304] 0 2024-04-12T09:11:02.136 INFO:tasks.workunit.client.0.smithi117.stdout:9/197: rename d1/d8/d12/l25 to d1/d8/df/d39/l43 0 2024-04-12T09:11:02.136 INFO:tasks.workunit.client.0.smithi117.stdout:3/222: stat de/d13/d19/l25 0 2024-04-12T09:11:02.137 INFO:tasks.workunit.client.0.smithi117.stdout:3/223: dread - de/d13/d19/d27/f38 zero size 2024-04-12T09:11:02.137 INFO:tasks.workunit.client.0.smithi117.stdout:9/198: truncate d1/d8/df/f3a 13910 0 2024-04-12T09:11:02.142 INFO:tasks.workunit.client.0.smithi117.stdout:9/199: symlink d1/d8/df/l44 0 2024-04-12T09:11:02.144 INFO:tasks.workunit.client.0.smithi117.stdout:3/224: creat de/d13/d19/d22/d3e/d3f/f51 x:0 0 0 2024-04-12T09:11:02.146 INFO:tasks.workunit.client.0.smithi117.stdout:9/200: symlink d1/d8/df/d39/l45 0 2024-04-12T09:11:02.147 INFO:tasks.workunit.client.0.smithi117.stdout:9/201: write d1/d8/df/d1b/f35 [733449,42781] 0 2024-04-12T09:11:02.152 INFO:tasks.workunit.client.0.smithi117.stdout:9/202: creat d1/d8/df/d26/f46 x:0 0 0 2024-04-12T09:11:02.154 INFO:tasks.workunit.client.0.smithi117.stdout:3/225: link de/d13/d19/d27/f3c de/d13/d19/f52 0 2024-04-12T09:11:02.157 INFO:tasks.workunit.client.0.smithi117.stdout:3/226: fdatasync de/f14 0 2024-04-12T09:11:02.158 INFO:tasks.workunit.client.0.smithi117.stdout:9/203: dwrite d1/d8/d12/f37 [0,4194304] 0 2024-04-12T09:11:02.158 INFO:tasks.workunit.client.0.smithi117.stdout:3/227: readlink de/d13/l18 0 2024-04-12T09:11:02.159 INFO:tasks.workunit.client.0.smithi117.stdout:3/228: chown de/d2c/f31 3520 1 2024-04-12T09:11:02.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:01 smithi117 ceph-mon[29277]: pgmap v11: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 428 KiB/s rd, 22 MiB/s wr, 288 op/s 2024-04-12T09:11:02.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:01 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:02.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:01 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:02.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:01 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:11:02.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:01 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:11:02.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:01 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:11:02.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:01 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:11:02.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:01 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:11:02.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:01 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:11:02.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:01 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:02.162 INFO:tasks.workunit.client.0.smithi117.stdout:9/204: symlink d1/d24/l47 0 2024-04-12T09:11:02.169 INFO:tasks.workunit.client.0.smithi117.stdout:7/135: sync 2024-04-12T09:11:02.169 INFO:tasks.workunit.client.0.smithi117.stdout:0/224: sync 2024-04-12T09:11:02.169 INFO:tasks.workunit.client.0.smithi117.stdout:4/171: sync 2024-04-12T09:11:02.169 INFO:tasks.workunit.client.0.smithi117.stdout:8/125: sync 2024-04-12T09:11:02.170 INFO:tasks.workunit.client.0.smithi117.stdout:8/126: chown db/d1b/f29 10118436 1 2024-04-12T09:11:02.173 INFO:tasks.workunit.client.0.smithi117.stdout:9/205: dwrite d1/fc [0,4194304] 0 2024-04-12T09:11:02.173 INFO:tasks.workunit.client.0.smithi117.stdout:8/127: truncate db/d19/f2b 984795 0 2024-04-12T09:11:02.174 INFO:tasks.workunit.client.0.smithi117.stdout:8/128: chown db 2013507 1 2024-04-12T09:11:02.175 INFO:tasks.workunit.client.0.smithi117.stdout:9/206: write d1/d8/df/f3a [361904,114481] 0 2024-04-12T09:11:02.179 INFO:tasks.workunit.client.0.smithi117.stdout:4/172: dwrite d0/f4 [0,4194304] 0 2024-04-12T09:11:02.182 INFO:tasks.workunit.client.0.smithi117.stdout:7/136: mknod d0/da/c2e 0 2024-04-12T09:11:02.186 INFO:tasks.workunit.client.0.smithi117.stdout:7/137: dread d0/d2/f16 [0,4194304] 0 2024-04-12T09:11:02.188 INFO:tasks.workunit.client.0.smithi117.stdout:7/138: write d0/d2/f16 [464661,108976] 0 2024-04-12T09:11:02.189 INFO:tasks.workunit.client.0.smithi117.stdout:7/139: dread - d0/d2/d22/d17/f29 zero size 2024-04-12T09:11:02.189 INFO:tasks.workunit.client.0.smithi117.stdout:0/225: symlink d3/d47/l49 0 2024-04-12T09:11:02.190 INFO:tasks.workunit.client.0.smithi117.stdout:7/140: fdatasync d0/f2b 0 2024-04-12T09:11:02.193 INFO:tasks.workunit.client.0.smithi117.stdout:8/129: write db/d19/f2b [23346,83999] 0 2024-04-12T09:11:02.194 INFO:tasks.workunit.client.0.smithi117.stdout:8/130: dread - db/d1b/f29 zero size 2024-04-12T09:11:02.196 INFO:tasks.workunit.client.0.smithi117.stdout:0/226: dwrite d3/fe [0,4194304] 0 2024-04-12T09:11:02.202 INFO:tasks.workunit.client.0.smithi117.stdout:9/207: symlink d1/d8/df/l48 0 2024-04-12T09:11:02.202 INFO:tasks.workunit.client.0.smithi117.stdout:9/208: dread - d1/d8/df/d39/d3b/f42 zero size 2024-04-12T09:11:02.206 INFO:tasks.workunit.client.0.smithi117.stdout:7/141: mknod d0/d2/d1a/c2f 0 2024-04-12T09:11:02.208 INFO:tasks.workunit.client.0.smithi117.stdout:9/209: dwrite d1/d8/df/d26/f46 [0,4194304] 0 2024-04-12T09:11:02.209 INFO:tasks.workunit.client.0.smithi117.stdout:9/210: stat d1/d24/l47 0 2024-04-12T09:11:02.216 INFO:tasks.workunit.client.0.smithi117.stdout:7/142: dwrite d0/d2/d22/f27 [0,4194304] 0 2024-04-12T09:11:02.224 INFO:tasks.workunit.client.0.smithi117.stdout:4/173: link d0/d1/f1b d0/d2c/f2f 0 2024-04-12T09:11:02.234 INFO:tasks.workunit.client.0.smithi117.stdout:3/229: getdents de/d13/d19 0 2024-04-12T09:11:02.234 INFO:tasks.workunit.client.0.smithi117.stdout:3/230: dread - de/f47 zero size 2024-04-12T09:11:02.240 INFO:tasks.workunit.client.0.smithi117.stdout:8/131: getdents db/d1f 0 2024-04-12T09:11:02.241 INFO:tasks.workunit.client.0.smithi117.stdout:8/132: fdatasync db/d19/d1a/f21 0 2024-04-12T09:11:02.242 INFO:tasks.workunit.client.0.smithi117.stdout:3/231: mknod de/d13/d19/d27/c53 0 2024-04-12T09:11:02.244 INFO:tasks.workunit.client.0.smithi117.stdout:4/174: creat d0/d2c/f30 x:0 0 0 2024-04-12T09:11:02.244 INFO:tasks.workunit.client.0.smithi117.stdout:4/175: chown d0/d1/f1b 1723 1 2024-04-12T09:11:02.245 INFO:tasks.workunit.client.0.smithi117.stdout:4/176: stat d0/d5 0 2024-04-12T09:11:02.246 INFO:tasks.workunit.client.0.smithi117.stdout:4/177: write d0/d2c/f30 [691045,74047] 0 2024-04-12T09:11:02.247 INFO:tasks.workunit.client.0.smithi117.stdout:4/178: write d0/d2c/f30 [1081854,119700] 0 2024-04-12T09:11:02.249 INFO:tasks.workunit.client.0.smithi117.stdout:7/143: creat d0/f30 x:0 0 0 2024-04-12T09:11:02.253 INFO:tasks.workunit.client.0.smithi117.stdout:8/133: creat db/f2f x:0 0 0 2024-04-12T09:11:02.255 INFO:tasks.workunit.client.0.smithi117.stdout:3/232: mkdir de/d13/d19/d54 0 2024-04-12T09:11:02.257 INFO:tasks.workunit.client.0.smithi117.stdout:9/211: getdents d1/d8/df/d39/d3b 0 2024-04-12T09:11:02.262 INFO:tasks.workunit.client.0.smithi117.stdout:4/179: creat d0/d2c/f31 x:0 0 0 2024-04-12T09:11:02.264 INFO:tasks.workunit.client.0.smithi117.stdout:7/144: creat d0/d2/d22/d17/f31 x:0 0 0 2024-04-12T09:11:02.268 INFO:tasks.workunit.client.0.smithi117.stdout:4/180: dwrite d0/d2c/f30 [0,4194304] 0 2024-04-12T09:11:02.269 INFO:tasks.workunit.client.0.smithi117.stdout:4/181: write d0/f14 [1605901,34111] 0 2024-04-12T09:11:02.278 INFO:tasks.workunit.client.0.smithi117.stdout:0/227: dwrite d3/dc/f2e [0,4194304] 0 2024-04-12T09:11:02.288 INFO:tasks.workunit.client.0.smithi117.stdout:4/182: creat d0/d5/d3/f32 x:0 0 0 2024-04-12T09:11:02.295 INFO:tasks.workunit.client.0.smithi117.stdout:0/228: creat d3/d30/d32/f4a x:0 0 0 2024-04-12T09:11:02.296 INFO:tasks.workunit.client.0.smithi117.stdout:0/229: fdatasync d3/dc/f44 0 2024-04-12T09:11:02.297 INFO:tasks.workunit.client.0.smithi117.stdout:0/230: chown d3/d30/f3f 2796 1 2024-04-12T09:11:02.297 INFO:tasks.workunit.client.0.smithi117.stdout:3/233: creat de/d13/d19/d22/d40/d49/f55 x:0 0 0 2024-04-12T09:11:02.301 INFO:tasks.workunit.client.0.smithi117.stdout:4/183: mknod d0/d5/c33 0 2024-04-12T09:11:02.305 INFO:tasks.workunit.client.0.smithi117.stdout:8/134: getdents db/d13 0 2024-04-12T09:11:02.311 INFO:tasks.workunit.client.0.smithi117.stdout:9/212: getdents d1 0 2024-04-12T09:11:02.315 INFO:tasks.workunit.client.0.smithi117.stdout:4/184: rename d0/d5/d3/d1a to d0/d1/d34 0 2024-04-12T09:11:02.316 INFO:tasks.workunit.client.0.smithi117.stdout:4/185: fdatasync d0/d5/d3/f1c 0 2024-04-12T09:11:02.317 INFO:tasks.workunit.client.0.smithi117.stdout:7/145: getdents d0/da 0 2024-04-12T09:11:02.318 INFO:tasks.workunit.client.0.smithi117.stdout:7/146: fdatasync d0/d2/f8 0 2024-04-12T09:11:02.320 INFO:tasks.workunit.client.0.smithi117.stdout:8/135: creat db/f30 x:0 0 0 2024-04-12T09:11:02.322 INFO:tasks.workunit.client.0.smithi117.stdout:3/234: creat de/d13/d30/f56 x:0 0 0 2024-04-12T09:11:02.325 INFO:tasks.workunit.client.0.smithi117.stdout:9/213: symlink d1/d8/df/d26/l49 0 2024-04-12T09:11:02.331 INFO:tasks.workunit.client.0.smithi117.stdout:7/147: rmdir d0 39 2024-04-12T09:11:02.333 INFO:tasks.workunit.client.0.smithi117.stdout:8/136: fdatasync db/d1b/f29 0 2024-04-12T09:11:02.383 INFO:tasks.workunit.client.0.smithi117.stdout:2/138: sync 2024-04-12T09:11:02.386 INFO:tasks.workunit.client.0.smithi117.stdout:3/235: rmdir de/d2c/d3a 39 2024-04-12T09:11:02.393 INFO:tasks.workunit.client.0.smithi117.stdout:0/231: link d3/c41 d3/c4b 0 2024-04-12T09:11:02.402 INFO:tasks.workunit.client.0.smithi117.stdout:0/232: mknod d3/d22/c4c 0 2024-04-12T09:11:02.405 INFO:tasks.workunit.client.0.smithi117.stdout:3/236: rmdir de/d2c/d3a 39 2024-04-12T09:11:02.411 INFO:tasks.workunit.client.0.smithi117.stdout:9/214: write d1/d24/f2a [352269,102907] 0 2024-04-12T09:11:02.411 INFO:tasks.workunit.client.0.smithi117.stdout:3/237: dread de/d13/f1b [0,4194304] 0 2024-04-12T09:11:02.412 INFO:tasks.workunit.client.0.smithi117.stdout:9/215: dread - d1/d8/df/d39/d3b/f42 zero size 2024-04-12T09:11:02.412 INFO:tasks.workunit.client.0.smithi117.stdout:3/238: fdatasync de/d13/d19/d22/d3e/d3f/f51 0 2024-04-12T09:11:02.415 INFO:tasks.workunit.client.0.smithi117.stdout:9/216: read d1/d8/df/d26/f3c [1799006,32418] 0 2024-04-12T09:11:02.416 INFO:tasks.workunit.client.0.smithi117.stdout:9/217: chown d1/d24/l2f 1073155412 1 2024-04-12T09:11:02.416 INFO:tasks.workunit.client.0.smithi117.stdout:2/139: link d0/df/l11 d0/df/l2c 0 2024-04-12T09:11:02.419 INFO:tasks.workunit.client.0.smithi117.stdout:8/137: dwrite db/d1f/f2a [0,4194304] 0 2024-04-12T09:11:02.424 INFO:tasks.workunit.client.0.smithi117.stdout:2/140: dwrite d0/df/d1a/f21 [0,4194304] 0 2024-04-12T09:11:02.425 INFO:tasks.workunit.client.0.smithi117.stdout:8/138: dread db/d1f/f2a [0,4194304] 0 2024-04-12T09:11:02.425 INFO:tasks.workunit.client.0.smithi117.stdout:2/141: chown d0/df/d1a/l29 3 1 2024-04-12T09:11:02.426 INFO:tasks.workunit.client.0.smithi117.stdout:7/148: getdents d0/d2/d12 0 2024-04-12T09:11:02.426 INFO:tasks.workunit.client.0.smithi117.stdout:2/142: chown d0/df/f20 1653 1 2024-04-12T09:11:02.433 INFO:tasks.workunit.client.0.smithi117.stdout:0/233: creat d3/f4d x:0 0 0 2024-04-12T09:11:02.437 INFO:tasks.workunit.client.0.smithi117.stdout:3/239: creat de/d13/d4c/f57 x:0 0 0 2024-04-12T09:11:02.437 INFO:tasks.workunit.client.0.smithi117.stdout:0/234: dread d3/fe [0,4194304] 0 2024-04-12T09:11:02.438 INFO:tasks.workunit.client.0.smithi117.stdout:8/139: creat db/d13/f31 x:0 0 0 2024-04-12T09:11:02.439 INFO:tasks.workunit.client.0.smithi117.stdout:7/149: mkdir d0/d2/d22/d32 0 2024-04-12T09:11:02.441 INFO:tasks.workunit.client.0.smithi117.stdout:7/150: write d0/d2/d22/d17/f29 [149452,119337] 0 2024-04-12T09:11:02.445 INFO:tasks.workunit.client.0.smithi117.stdout:7/151: fdatasync d0/d2/d22/d17/f29 0 2024-04-12T09:11:02.447 INFO:tasks.workunit.client.0.smithi117.stdout:3/240: read - de/d13/d19/d27/f44 zero size 2024-04-12T09:11:02.452 INFO:tasks.workunit.client.0.smithi117.stdout:2/143: creat d0/d4/d10/d2a/f2d x:0 0 0 2024-04-12T09:11:02.453 INFO:tasks.workunit.client.0.smithi117.stdout:2/144: write d0/df/f1d [848550,39384] 0 2024-04-12T09:11:02.458 INFO:tasks.workunit.client.0.smithi117.stdout:8/140: rmdir db 39 2024-04-12T09:11:02.464 INFO:tasks.workunit.client.0.smithi117.stdout:3/241: rename de/d13/d19/d22/f28 to de/d13/d19/d22/d3e/d3f/f58 0 2024-04-12T09:11:02.467 INFO:tasks.workunit.client.0.smithi117.stdout:2/145: creat d0/d4/d10/d27/f2e x:0 0 0 2024-04-12T09:11:02.468 INFO:tasks.workunit.client.0.smithi117.stdout:2/146: fdatasync d0/d4/d10/d2a/f2d 0 2024-04-12T09:11:02.469 INFO:tasks.workunit.client.0.smithi117.stdout:9/218: getdents d1/d8/d12 0 2024-04-12T09:11:02.475 INFO:tasks.workunit.client.0.smithi117.stdout:2/147: dwrite d0/d4/d10/d27/f2e [0,4194304] 0 2024-04-12T09:11:02.475 INFO:tasks.workunit.client.0.smithi117.stdout:7/152: write d0/d2/f16 [3683883,32841] 0 2024-04-12T09:11:02.476 INFO:tasks.workunit.client.0.smithi117.stdout:2/148: write d0/d4/d10/d2a/f2d [225351,25631] 0 2024-04-12T09:11:02.477 INFO:tasks.workunit.client.0.smithi117.stdout:9/219: creat d1/d8/df/d39/d3b/f4a x:0 0 0 2024-04-12T09:11:02.478 INFO:tasks.workunit.client.0.smithi117.stdout:8/141: rmdir db 39 2024-04-12T09:11:02.481 INFO:tasks.workunit.client.0.smithi117.stdout:0/235: getdents d3/d47 0 2024-04-12T09:11:02.484 INFO:tasks.workunit.client.0.smithi117.stdout:2/149: symlink d0/d4/d10/d2a/l2f 0 2024-04-12T09:11:02.484 INFO:tasks.workunit.client.0.smithi117.stdout:7/153: dwrite d0/d2/d22/d15/f25 [0,4194304] 0 2024-04-12T09:11:02.485 INFO:tasks.workunit.client.0.smithi117.stdout:7/154: write d0/d13/f19 [926160,38261] 0 2024-04-12T09:11:02.486 INFO:tasks.workunit.client.0.smithi117.stdout:2/150: write d0/df/d1a/f21 [433217,7204] 0 2024-04-12T09:11:02.487 INFO:tasks.workunit.client.0.smithi117.stdout:9/220: mkdir d1/d4b 0 2024-04-12T09:11:02.493 INFO:tasks.workunit.client.0.smithi117.stdout:0/236: creat d3/dc/f4e x:0 0 0 2024-04-12T09:11:02.494 INFO:tasks.workunit.client.0.smithi117.stdout:0/237: truncate d3/d30/f31 491177 0 2024-04-12T09:11:02.495 INFO:tasks.workunit.client.0.smithi117.stdout:0/238: write d3/f23 [4436315,85505] 0 2024-04-12T09:11:02.498 INFO:tasks.workunit.client.0.smithi117.stdout:3/242: rename de/d13 to de/d2c/d59 0 2024-04-12T09:11:02.500 INFO:tasks.workunit.client.0.smithi117.stdout:3/243: write f2 [13646842,35858] 0 2024-04-12T09:11:02.503 INFO:tasks.workunit.client.0.smithi117.stdout:7/155: unlink d0/d2/d22/f1d 0 2024-04-12T09:11:02.504 INFO:tasks.workunit.client.0.smithi117.stdout:6/233: sync 2024-04-12T09:11:02.504 INFO:tasks.workunit.client.0.smithi117.stdout:1/130: sync 2024-04-12T09:11:02.504 INFO:tasks.workunit.client.0.smithi117.stdout:5/133: sync 2024-04-12T09:11:02.504 INFO:tasks.workunit.client.0.smithi117.stdout:7/156: chown d0/d2/l11 114424662 1 2024-04-12T09:11:02.505 INFO:tasks.workunit.client.0.smithi117.stdout:1/131: truncate d1/d6/da/f20 1015682 0 2024-04-12T09:11:02.508 INFO:tasks.workunit.client.0.smithi117.stdout:8/142: write db/d1b/fe [335449,46304] 0 2024-04-12T09:11:02.509 INFO:tasks.workunit.client.0.smithi117.stdout:0/239: fsync d3/fe 0 2024-04-12T09:11:02.514 INFO:tasks.workunit.client.0.smithi117.stdout:3/244: creat de/d2c/d59/d19/d22/d3e/f5a x:0 0 0 2024-04-12T09:11:02.514 INFO:tasks.workunit.client.0.smithi117.stdout:3/245: read f2 [14814101,14920] 0 2024-04-12T09:11:02.515 INFO:tasks.workunit.client.0.smithi117.stdout:3/246: fdatasync de/d2c/d59/d4c/f57 0 2024-04-12T09:11:02.519 INFO:tasks.workunit.client.0.smithi117.stdout:5/134: unlink d2/d3/l22 0 2024-04-12T09:11:02.521 INFO:tasks.workunit.client.0.smithi117.stdout:2/151: mkdir d0/d26/d30 0 2024-04-12T09:11:02.522 INFO:tasks.workunit.client.0.smithi117.stdout:8/143: mkdir db/d1b/d32 0 2024-04-12T09:11:02.523 INFO:tasks.workunit.client.0.smithi117.stdout:8/144: stat db/d19/d1a/f26 0 2024-04-12T09:11:02.527 INFO:tasks.workunit.client.0.smithi117.stdout:3/247: creat de/d2c/d59/f5b x:0 0 0 2024-04-12T09:11:02.529 INFO:tasks.workunit.client.0.smithi117.stdout:5/135: rmdir d2/d3/de 39 2024-04-12T09:11:02.529 INFO:tasks.workunit.client.0.smithi117.stdout:9/221: dread d1/d24/f2a [0,4194304] 0 2024-04-12T09:11:02.530 INFO:tasks.workunit.client.0.smithi117.stdout:7/157: mknod d0/d2/d22/d32/c33 0 2024-04-12T09:11:02.533 INFO:tasks.workunit.client.0.smithi117.stdout:8/145: mkdir db/d1f/d33 0 2024-04-12T09:11:02.535 INFO:tasks.workunit.client.0.smithi117.stdout:3/248: chown de/c11 49850510 1 2024-04-12T09:11:02.535 INFO:tasks.workunit.client.0.smithi117.stdout:6/234: creat d8/d9/f50 x:0 0 0 2024-04-12T09:11:02.536 INFO:tasks.workunit.client.0.smithi117.stdout:3/249: write de/d2c/d59/f23 [2124919,90676] 0 2024-04-12T09:11:02.538 INFO:tasks.workunit.client.0.smithi117.stdout:9/222: dread d1/d8/df/d3e/f36 [0,4194304] 0 2024-04-12T09:11:02.539 INFO:tasks.workunit.client.0.smithi117.stdout:2/152: mknod d0/df/c31 0 2024-04-12T09:11:02.540 INFO:tasks.workunit.client.0.smithi117.stdout:9/223: chown d1/d8/df/d3e/f32 46602 1 2024-04-12T09:11:02.542 INFO:tasks.workunit.client.0.smithi117.stdout:1/132: rename d1/d6/da/db/f1e to d1/f21 0 2024-04-12T09:11:02.545 INFO:tasks.workunit.client.0.smithi117.stdout:8/146: creat db/d1b/f34 x:0 0 0 2024-04-12T09:11:02.546 INFO:tasks.workunit.client.0.smithi117.stdout:9/224: dwrite d1/d8/df/d26/f46 [0,4194304] 0 2024-04-12T09:11:02.553 INFO:tasks.workunit.client.0.smithi117.stdout:9/225: dwrite d1/d8/d12/f1e [0,4194304] 0 2024-04-12T09:11:02.556 INFO:tasks.workunit.client.0.smithi117.stdout:3/250: symlink de/d2c/d59/d19/d22/d3e/d3f/l5c 0 2024-04-12T09:11:02.557 INFO:tasks.workunit.client.0.smithi117.stdout:3/251: fsync de/d2c/d59/f42 0 2024-04-12T09:11:02.557 INFO:tasks.workunit.client.0.smithi117.stdout:4/186: sync 2024-04-12T09:11:02.558 INFO:tasks.workunit.client.0.smithi117.stdout:3/252: readlink de/d2c/d59/l1e 0 2024-04-12T09:11:02.565 INFO:tasks.workunit.client.0.smithi117.stdout:0/240: getdents d3 0 2024-04-12T09:11:02.565 INFO:tasks.workunit.client.0.smithi117.stdout:0/241: fsync d3/dc/f16 0 2024-04-12T09:11:02.570 INFO:tasks.workunit.client.0.smithi117.stdout:6/235: mkdir d8/d3f/d51 0 2024-04-12T09:11:02.573 INFO:tasks.workunit.client.0.smithi117.stdout:9/226: creat d1/d8/df/d39/d3b/f4c x:0 0 0 2024-04-12T09:11:02.574 INFO:tasks.workunit.client.0.smithi117.stdout:9/227: fdatasync d1/d8/df/f3a 0 2024-04-12T09:11:02.575 INFO:tasks.workunit.client.0.smithi117.stdout:4/187: mknod d0/d1/c35 0 2024-04-12T09:11:02.579 INFO:tasks.workunit.client.0.smithi117.stdout:2/153: link d0/df/f1d d0/d4/d10/f32 0 2024-04-12T09:11:02.580 INFO:tasks.workunit.client.0.smithi117.stdout:4/188: dwrite d0/d2c/f31 [0,4194304] 0 2024-04-12T09:11:02.585 INFO:tasks.workunit.client.0.smithi117.stdout:1/133: mkdir d1/d22 0 2024-04-12T09:11:02.586 INFO:tasks.workunit.client.0.smithi117.stdout:0/242: creat d3/d36/f4f x:0 0 0 2024-04-12T09:11:02.589 INFO:tasks.workunit.client.0.smithi117.stdout:5/136: dwrite d2/f28 [0,4194304] 0 2024-04-12T09:11:02.591 INFO:tasks.workunit.client.0.smithi117.stdout:6/236: creat d8/d3a/d49/f52 x:0 0 0 2024-04-12T09:11:02.593 INFO:tasks.workunit.client.0.smithi117.stdout:6/237: read d8/d9/d17/f23 [41015,97966] 0 2024-04-12T09:11:02.594 INFO:tasks.workunit.client.0.smithi117.stdout:7/158: getdents d0/d2/d1a 0 2024-04-12T09:11:02.596 INFO:tasks.workunit.client.0.smithi117.stdout:9/228: fdatasync d1/d8/df/d3e/f36 0 2024-04-12T09:11:02.600 INFO:tasks.workunit.client.0.smithi117.stdout:2/154: fsync d0/d4/fb 0 2024-04-12T09:11:02.602 INFO:tasks.workunit.client.0.smithi117.stdout:4/189: creat d0/d1/d10/f36 x:0 0 0 2024-04-12T09:11:02.604 INFO:tasks.workunit.client.0.smithi117.stdout:9/229: dwrite d1/d8/df/d39/d3b/f4c [0,4194304] 0 2024-04-12T09:11:02.605 INFO:tasks.workunit.client.0.smithi117.stdout:4/190: write d0/f27 [1841,58041] 0 2024-04-12T09:11:02.605 INFO:tasks.workunit.client.0.smithi117.stdout:0/243: mknod d3/dc/c50 0 2024-04-12T09:11:02.610 INFO:tasks.workunit.client.0.smithi117.stdout:8/147: rmdir db/d1b/d32 0 2024-04-12T09:11:02.613 INFO:tasks.workunit.client.0.smithi117.stdout:0/244: dwrite d3/f20 [0,4194304] 0 2024-04-12T09:11:02.616 INFO:tasks.workunit.client.0.smithi117.stdout:6/238: unlink f6 0 2024-04-12T09:11:02.618 INFO:tasks.workunit.client.0.smithi117.stdout:6/239: dread - d8/d9/f19 zero size 2024-04-12T09:11:02.621 INFO:tasks.workunit.client.0.smithi117.stdout:0/245: dwrite d3/f4d [0,4194304] 0 2024-04-12T09:11:02.622 INFO:tasks.workunit.client.0.smithi117.stdout:0/246: dread - d3/d30/d32/f4a zero size 2024-04-12T09:11:02.623 INFO:tasks.workunit.client.0.smithi117.stdout:0/247: dread - d3/d36/f4f zero size 2024-04-12T09:11:02.626 INFO:tasks.workunit.client.0.smithi117.stdout:2/155: rename d0/d4/le to d0/d4/d10/d27/l33 0 2024-04-12T09:11:02.628 INFO:tasks.workunit.client.0.smithi117.stdout:9/230: write d1/d8/df/f13 [2483515,126985] 0 2024-04-12T09:11:02.631 INFO:tasks.workunit.client.0.smithi117.stdout:8/148: unlink db/d1b/c14 0 2024-04-12T09:11:02.632 INFO:tasks.workunit.client.0.smithi117.stdout:8/149: truncate db/f2f 808890 0 2024-04-12T09:11:02.635 INFO:tasks.workunit.client.0.smithi117.stdout:7/159: symlink d0/d2/d22/d17/d23/d2a/l34 0 2024-04-12T09:11:02.637 INFO:tasks.workunit.client.0.smithi117.stdout:3/253: getdents de/d2c/d59/d19/d22/d40 0 2024-04-12T09:11:02.640 INFO:tasks.workunit.client.0.smithi117.stdout:8/150: dwrite db/d1b/fe [8388608,4194304] 0 2024-04-12T09:11:02.640 INFO:tasks.workunit.client.0.smithi117.stdout:3/254: write de/d2c/d59/d19/d22/d3e/d3f/f51 [161781,37412] 0 2024-04-12T09:11:02.644 INFO:tasks.workunit.client.0.smithi117.stdout:9/231: stat d1/d8/df/d39/l43 0 2024-04-12T09:11:02.645 INFO:tasks.workunit.client.0.smithi117.stdout:8/151: dread db/d1f/f2a [0,4194304] 0 2024-04-12T09:11:02.646 INFO:tasks.workunit.client.0.smithi117.stdout:8/152: truncate db/d19/f2b 1179200 0 2024-04-12T09:11:02.657 INFO:tasks.workunit.client.0.smithi117.stdout:4/191: creat d0/f37 x:0 0 0 2024-04-12T09:11:02.658 INFO:tasks.workunit.client.0.smithi117.stdout:1/134: getdents d1/d6/da/db/d16 0 2024-04-12T09:11:02.661 INFO:tasks.workunit.client.0.smithi117.stdout:4/192: dread d0/d1/d34/f28 [0,4194304] 0 2024-04-12T09:11:02.661 INFO:tasks.workunit.client.0.smithi117.stdout:4/193: read d0/d1/d34/f28 [4093414,108182] 0 2024-04-12T09:11:02.662 INFO:tasks.workunit.client.0.smithi117.stdout:5/137: creat d2/d3/de/f2a x:0 0 0 2024-04-12T09:11:02.663 INFO:tasks.workunit.client.0.smithi117.stdout:5/138: chown d2/d3/la 6642 1 2024-04-12T09:11:02.668 INFO:tasks.workunit.client.0.smithi117.stdout:7/160: dwrite d0/d2/d22/f28 [0,4194304] 0 2024-04-12T09:11:02.669 INFO:tasks.workunit.client.0.smithi117.stdout:3/255: rename de/d2c/d3a to de/d2c/d59/d19/d22/d3e/d5d 0 2024-04-12T09:11:02.671 INFO:tasks.workunit.client.0.smithi117.stdout:7/161: dread d0/d2/d22/d17/f29 [0,4194304] 0 2024-04-12T09:11:02.672 INFO:tasks.workunit.client.0.smithi117.stdout:1/135: symlink d1/d6/da/l23 0 2024-04-12T09:11:02.673 INFO:tasks.workunit.client.0.smithi117.stdout:8/153: creat db/d1f/d33/f35 x:0 0 0 2024-04-12T09:11:02.676 INFO:tasks.workunit.client.0.smithi117.stdout:0/248: getdents d3/d30 0 2024-04-12T09:11:02.676 INFO:tasks.workunit.client.0.smithi117.stdout:7/162: dread d0/d2/f16 [0,4194304] 0 2024-04-12T09:11:02.678 INFO:tasks.workunit.client.0.smithi117.stdout:7/163: read d0/d13/f19 [838187,51414] 0 2024-04-12T09:11:02.681 INFO:tasks.workunit.client.0.smithi117.stdout:2/156: getdents d0/df 0 2024-04-12T09:11:02.685 INFO:tasks.workunit.client.0.smithi117.stdout:3/256: read f2 [9452182,46298] 0 2024-04-12T09:11:02.688 INFO:tasks.workunit.client.0.smithi117.stdout:3/257: stat de/d2c/d59/d30 0 2024-04-12T09:11:02.692 INFO:tasks.workunit.client.0.smithi117.stdout:2/157: dwrite d0/d4/d10/d2a/f2d [0,4194304] 0 2024-04-12T09:11:02.696 INFO:tasks.workunit.client.0.smithi117.stdout:4/194: dwrite d0/d1/f1b [0,4194304] 0 2024-04-12T09:11:02.697 INFO:tasks.workunit.client.0.smithi117.stdout:8/154: dread db/d19/d1a/f21 [0,4194304] 0 2024-04-12T09:11:02.702 INFO:tasks.workunit.client.0.smithi117.stdout:1/136: mkdir d1/d6/da/db/d1d/d24 0 2024-04-12T09:11:02.703 INFO:tasks.workunit.client.0.smithi117.stdout:5/139: creat d2/d3/de/f2b x:0 0 0 2024-04-12T09:11:02.705 INFO:tasks.workunit.client.0.smithi117.stdout:1/137: write d1/f10 [308827,67294] 0 2024-04-12T09:11:02.706 INFO:tasks.workunit.client.0.smithi117.stdout:3/258: symlink de/d2c/d59/d19/d22/l5e 0 2024-04-12T09:11:02.706 INFO:tasks.workunit.client.0.smithi117.stdout:2/158: dwrite d0/d4/d10/d2a/f2d [0,4194304] 0 2024-04-12T09:11:02.707 INFO:tasks.workunit.client.0.smithi117.stdout:5/140: write d2/d3/de/f2a [384110,52078] 0 2024-04-12T09:11:02.709 INFO:tasks.workunit.client.0.smithi117.stdout:3/259: chown de/d2c/d59/d19/d22/l2e 956260 1 2024-04-12T09:11:02.711 INFO:tasks.workunit.client.0.smithi117.stdout:3/260: write de/f14 [432841,123705] 0 2024-04-12T09:11:02.713 INFO:tasks.workunit.client.0.smithi117.stdout:1/138: write d1/f21 [104331,11921] 0 2024-04-12T09:11:02.716 INFO:tasks.workunit.client.0.smithi117.stdout:2/159: creat d0/d26/f34 x:0 0 0 2024-04-12T09:11:02.720 INFO:tasks.workunit.client.0.smithi117.stdout:5/141: dwrite d2/d3/de/f2a [0,4194304] 0 2024-04-12T09:11:02.720 INFO:tasks.workunit.client.0.smithi117.stdout:7/164: getdents d0/d2 0 2024-04-12T09:11:02.722 INFO:tasks.workunit.client.0.smithi117.stdout:3/261: chown de/d2c/d59/d19/c3b 0 1 2024-04-12T09:11:02.727 INFO:tasks.workunit.client.0.smithi117.stdout:2/160: dread d0/d4/d10/d27/f2e [0,4194304] 0 2024-04-12T09:11:02.730 INFO:tasks.workunit.client.0.smithi117.stdout:3/262: symlink de/d2c/d59/d19/d22/l5f 0 2024-04-12T09:11:02.731 INFO:tasks.workunit.client.0.smithi117.stdout:7/165: dwrite d0/d2/d22/d17/f31 [0,4194304] 0 2024-04-12T09:11:02.736 INFO:tasks.workunit.client.0.smithi117.stdout:3/263: creat de/d2c/d59/d30/f60 x:0 0 0 2024-04-12T09:11:02.737 INFO:tasks.workunit.client.0.smithi117.stdout:3/264: write de/d2c/f45 [952964,117089] 0 2024-04-12T09:11:02.738 INFO:tasks.workunit.client.0.smithi117.stdout:2/161: getdents d0/d26/d30 0 2024-04-12T09:11:02.741 INFO:tasks.workunit.client.0.smithi117.stdout:7/166: truncate d0/d2/f8 3120857 0 2024-04-12T09:11:02.742 INFO:tasks.workunit.client.0.smithi117.stdout:0/249: truncate d3/dc/f34 21785 0 2024-04-12T09:11:02.750 INFO:tasks.workunit.client.0.smithi117.stdout:7/167: truncate d0/d2/fd 1085319 0 2024-04-12T09:11:02.750 INFO:tasks.workunit.client.0.smithi117.stdout:8/155: write fa [4522527,61903] 0 2024-04-12T09:11:02.750 INFO:tasks.workunit.client.0.smithi117.stdout:7/168: chown d0/d2/d22/d32 32535 1 2024-04-12T09:11:02.750 INFO:tasks.workunit.client.0.smithi117.stdout:8/156: read - db/f30 zero size 2024-04-12T09:11:02.750 INFO:tasks.workunit.client.0.smithi117.stdout:0/250: rename d3/dc/f4e to d3/dc/f51 0 2024-04-12T09:11:02.750 INFO:tasks.workunit.client.0.smithi117.stdout:8/157: read - db/d13/f31 zero size 2024-04-12T09:11:02.750 INFO:tasks.workunit.client.0.smithi117.stdout:7/169: chown d0/da/f2d 0 1 2024-04-12T09:11:02.751 INFO:tasks.workunit.client.0.smithi117.stdout:4/195: truncate d0/d2c/f30 584049 0 2024-04-12T09:11:02.751 INFO:tasks.workunit.client.0.smithi117.stdout:4/196: write d0/f14 [1009674,122736] 0 2024-04-12T09:11:02.752 INFO:tasks.workunit.client.0.smithi117.stdout:0/251: creat d3/dc/f52 x:0 0 0 2024-04-12T09:11:02.754 INFO:tasks.workunit.client.0.smithi117.stdout:8/158: symlink db/d1b/l36 0 2024-04-12T09:11:02.757 INFO:tasks.workunit.client.0.smithi117.stdout:8/159: write db/d1b/fe [6988788,91022] 0 2024-04-12T09:11:02.757 INFO:tasks.workunit.client.0.smithi117.stdout:7/170: rename d0/d2/d1a/c2f to d0/d2/d22/c35 0 2024-04-12T09:11:02.758 INFO:tasks.workunit.client.0.smithi117.stdout:7/171: write d0/d2/d1a/f24 [535741,64290] 0 2024-04-12T09:11:02.759 INFO:tasks.workunit.client.0.smithi117.stdout:4/197: mkdir d0/d5/d3/d38 0 2024-04-12T09:11:02.761 INFO:tasks.workunit.client.0.smithi117.stdout:5/142: truncate d2/f6 718910 0 2024-04-12T09:11:02.763 INFO:tasks.workunit.client.0.smithi117.stdout:5/143: chown d2/d3/dd/f12 593241909 1 2024-04-12T09:11:02.763 INFO:tasks.workunit.client.0.smithi117.stdout:1/139: dwrite d1/d6/f1a [0,4194304] 0 2024-04-12T09:11:02.765 INFO:tasks.workunit.client.0.smithi117.stdout:8/160: symlink db/d1f/l37 0 2024-04-12T09:11:02.765 INFO:tasks.workunit.client.0.smithi117.stdout:3/265: fsync de/d2c/d59/d30/f60 0 2024-04-12T09:11:02.770 INFO:tasks.workunit.client.0.smithi117.stdout:4/198: rename d0/d1/d10 to d0/d5/d39 0 2024-04-12T09:11:02.775 INFO:tasks.workunit.client.0.smithi117.stdout:0/252: link d3/d22/f29 d3/d47/f53 0 2024-04-12T09:11:02.776 INFO:tasks.workunit.client.0.smithi117.stdout:5/144: chown d2/c11 28195 1 2024-04-12T09:11:02.780 INFO:tasks.workunit.client.0.smithi117.stdout:1/140: symlink d1/d6/da/db/d16/l25 0 2024-04-12T09:11:02.781 INFO:tasks.workunit.client.0.smithi117.stdout:2/162: dwrite d0/d4/fb [0,4194304] 0 2024-04-12T09:11:02.782 INFO:tasks.workunit.client.0.smithi117.stdout:2/163: chown d0/df/d1a 157 1 2024-04-12T09:11:02.791 INFO:tasks.workunit.client.0.smithi117.stdout:8/161: dwrite db/d1f/f28 [4194304,4194304] 0 2024-04-12T09:11:02.792 INFO:tasks.workunit.client.0.smithi117.stdout:1/141: dwrite d1/d6/f1a [0,4194304] 0 2024-04-12T09:11:02.792 INFO:tasks.workunit.client.0.smithi117.stdout:3/266: dread de/d2c/d59/f23 [0,4194304] 0 2024-04-12T09:11:02.793 INFO:tasks.workunit.client.0.smithi117.stdout:4/199: symlink d0/d5/d25/l3a 0 2024-04-12T09:11:02.795 INFO:tasks.workunit.client.0.smithi117.stdout:3/267: chown de/d2c/d59/d19/d27 2109 1 2024-04-12T09:11:02.797 INFO:tasks.workunit.client.0.smithi117.stdout:0/253: write d3/d22/f29 [1110554,7427] 0 2024-04-12T09:11:02.800 INFO:tasks.workunit.client.0.smithi117.stdout:2/164: mknod d0/d4/d10/c35 0 2024-04-12T09:11:02.805 INFO:tasks.workunit.client.0.smithi117.stdout:4/200: dwrite d0/f14 [0,4194304] 0 2024-04-12T09:11:02.805 INFO:tasks.workunit.client.0.smithi117.stdout:4/201: stat d0/d5/lc 0 2024-04-12T09:11:02.808 INFO:tasks.workunit.client.0.smithi117.stdout:8/162: mkdir db/d13/d38 0 2024-04-12T09:11:02.814 INFO:tasks.workunit.client.0.smithi117.stdout:1/142: symlink d1/d6/da/db/l26 0 2024-04-12T09:11:02.815 INFO:tasks.workunit.client.0.smithi117.stdout:1/143: dread d1/d6/da/f20 [0,4194304] 0 2024-04-12T09:11:02.816 INFO:tasks.workunit.client.0.smithi117.stdout:1/144: write d1/d6/da/f20 [1470446,25541] 0 2024-04-12T09:11:02.818 INFO:tasks.workunit.client.0.smithi117.stdout:3/268: dread de/d2c/f31 [0,4194304] 0 2024-04-12T09:11:02.818 INFO:tasks.workunit.client.0.smithi117.stdout:0/254: rename d3/dc/l1e to d3/d47/l54 0 2024-04-12T09:11:02.819 INFO:tasks.workunit.client.0.smithi117.stdout:0/255: write d3/f23 [2300951,59732] 0 2024-04-12T09:11:02.820 INFO:tasks.workunit.client.0.smithi117.stdout:3/269: dread fa [0,4194304] 0 2024-04-12T09:11:02.821 INFO:tasks.workunit.client.0.smithi117.stdout:2/165: creat d0/f36 x:0 0 0 2024-04-12T09:11:02.822 INFO:tasks.workunit.client.0.smithi117.stdout:7/172: getdents d0/d2/d22/d15 0 2024-04-12T09:11:02.823 INFO:tasks.workunit.client.0.smithi117.stdout:7/173: fsync d0/d2/d22/d17/f21 0 2024-04-12T09:11:02.826 INFO:tasks.workunit.client.0.smithi117.stdout:8/163: mknod db/d1f/d33/c39 0 2024-04-12T09:11:02.827 INFO:tasks.workunit.client.0.smithi117.stdout:8/164: fsync db/d19/d1a/f21 0 2024-04-12T09:11:02.834 INFO:tasks.workunit.client.0.smithi117.stdout:8/165: dwrite db/d1b/f34 [0,4194304] 0 2024-04-12T09:11:02.836 INFO:tasks.workunit.client.0.smithi117.stdout:8/166: read db/d1b/f11 [1165179,125597] 0 2024-04-12T09:11:02.838 INFO:tasks.workunit.client.0.smithi117.stdout:8/167: write fa [2079060,37553] 0 2024-04-12T09:11:02.839 INFO:tasks.workunit.client.0.smithi117.stdout:8/168: write db/f2f [1456323,17494] 0 2024-04-12T09:11:02.840 INFO:tasks.workunit.client.0.smithi117.stdout:3/270: creat de/d2c/d59/d19/d22/f61 x:0 0 0 2024-04-12T09:11:02.841 INFO:tasks.workunit.client.0.smithi117.stdout:1/145: dread d1/d6/f14 [0,4194304] 0 2024-04-12T09:11:02.842 INFO:tasks.workunit.client.0.smithi117.stdout:8/169: chown db/d1f/d33 862257 1 2024-04-12T09:11:02.843 INFO:tasks.workunit.client.0.smithi117.stdout:3/271: readlink de/d2c/d59/l1d 0 2024-04-12T09:11:02.843 INFO:tasks.workunit.client.0.smithi117.stdout:1/146: write d1/f10 [5255943,22439] 0 2024-04-12T09:11:02.848 INFO:tasks.workunit.client.0.smithi117.stdout:2/166: mknod d0/d26/d30/c37 0 2024-04-12T09:11:02.852 INFO:tasks.workunit.client.0.smithi117.stdout:8/170: stat db/d1b/l16 0 2024-04-12T09:11:02.855 INFO:tasks.workunit.client.0.smithi117.stdout:3/272: mkdir de/d2c/d59/d4c/d62 0 2024-04-12T09:11:02.856 INFO:tasks.workunit.client.0.smithi117.stdout:1/147: creat d1/d6/da/db/f27 x:0 0 0 2024-04-12T09:11:02.859 INFO:tasks.workunit.client.0.smithi117.stdout:0/256: getdents d3/d30 0 2024-04-12T09:11:02.859 INFO:tasks.workunit.client.0.smithi117.stdout:2/167: mknod d0/d26/c38 0 2024-04-12T09:11:02.861 INFO:tasks.workunit.client.0.smithi117.stdout:4/202: getdents d0/d2c 0 2024-04-12T09:11:02.863 INFO:tasks.workunit.client.0.smithi117.stdout:8/171: unlink db/d13/l2d 0 2024-04-12T09:11:02.865 INFO:tasks.workunit.client.0.smithi117.stdout:8/172: truncate db/d1b/f34 5197381 0 2024-04-12T09:11:02.866 INFO:tasks.workunit.client.0.smithi117.stdout:8/173: fsync db/d1f/f28 0 2024-04-12T09:11:02.867 INFO:tasks.workunit.client.0.smithi117.stdout:1/148: mknod d1/d6/da/db/d1d/c28 0 2024-04-12T09:11:02.868 INFO:tasks.workunit.client.0.smithi117.stdout:1/149: chown d1/d6/da/l23 15142570 1 2024-04-12T09:11:02.871 INFO:tasks.workunit.client.0.smithi117.stdout:4/203: rename d0/d5/d3 to d0/d5/d3b 0 2024-04-12T09:11:02.873 INFO:tasks.workunit.client.0.smithi117.stdout:7/174: link d0/d2/d22/c35 d0/d2/d22/c36 0 2024-04-12T09:11:02.875 INFO:tasks.workunit.client.0.smithi117.stdout:8/174: symlink db/l3a 0 2024-04-12T09:11:02.876 INFO:tasks.workunit.client.0.smithi117.stdout:8/175: dread - db/d13/f31 zero size 2024-04-12T09:11:02.881 INFO:tasks.workunit.client.0.smithi117.stdout:4/204: mkdir d0/d2c/d3c 0 2024-04-12T09:11:02.884 INFO:tasks.workunit.client.0.smithi117.stdout:8/176: rename db/d1b/c1d to db/d13/c3b 0 2024-04-12T09:11:02.885 INFO:tasks.workunit.client.0.smithi117.stdout:8/177: chown db/d1b 24 1 2024-04-12T09:11:02.888 INFO:tasks.workunit.client.0.smithi117.stdout:7/175: chown d0/d2/d22/c35 1606079 1 2024-04-12T09:11:02.889 INFO:tasks.workunit.client.0.smithi117.stdout:8/178: creat db/d1b/f3c x:0 0 0 2024-04-12T09:11:02.890 INFO:tasks.workunit.client.0.smithi117.stdout:8/179: stat db/d1b/f15 0 2024-04-12T09:11:02.892 INFO:tasks.workunit.client.0.smithi117.stdout:8/180: write db/d19/f2b [2102178,62458] 0 2024-04-12T09:11:02.893 INFO:tasks.workunit.client.0.smithi117.stdout:7/176: creat d0/d2/d1a/f37 x:0 0 0 2024-04-12T09:11:02.895 INFO:tasks.workunit.client.0.smithi117.stdout:3/273: dwrite f2 [4194304,4194304] 0 2024-04-12T09:11:02.895 INFO:tasks.workunit.client.0.smithi117.stdout:8/181: write db/f30 [31121,72362] 0 2024-04-12T09:11:02.900 INFO:tasks.workunit.client.0.smithi117.stdout:7/177: fsync d0/d2/d22/d15/f25 0 2024-04-12T09:11:02.901 INFO:tasks.workunit.client.0.smithi117.stdout:1/150: write d1/d6/da/f20 [1794208,110077] 0 2024-04-12T09:11:02.901 INFO:tasks.workunit.client.0.smithi117.stdout:3/274: readlink de/d2c/l36 0 2024-04-12T09:11:02.901 INFO:tasks.workunit.client.0.smithi117.stdout:8/182: chown db/d1f/f2a 10478 1 2024-04-12T09:11:02.906 INFO:tasks.workunit.client.0.smithi117.stdout:2/168: dwrite d0/df/f1d [0,4194304] 0 2024-04-12T09:11:02.907 INFO:tasks.workunit.client.0.smithi117.stdout:4/205: write d0/d2c/f30 [186376,52302] 0 2024-04-12T09:11:02.912 INFO:tasks.workunit.client.0.smithi117.stdout:2/169: write d0/d26/f34 [592500,81213] 0 2024-04-12T09:11:02.915 INFO:tasks.workunit.client.0.smithi117.stdout:4/206: symlink d0/d2c/l3d 0 2024-04-12T09:11:02.916 INFO:tasks.workunit.client.0.smithi117.stdout:0/257: dwrite d3/d36/f42 [0,4194304] 0 2024-04-12T09:11:02.919 INFO:tasks.workunit.client.0.smithi117.stdout:3/275: mkdir de/d2c/d59/d19/d22/d3d/d63 0 2024-04-12T09:11:02.919 INFO:tasks.workunit.client.0.smithi117.stdout:1/151: dwrite d1/f10 [4194304,4194304] 0 2024-04-12T09:11:02.922 INFO:tasks.workunit.client.0.smithi117.stdout:4/207: chown d0/d2c/f2f 899858 1 2024-04-12T09:11:02.923 INFO:tasks.workunit.client.0.smithi117.stdout:1/152: readlink d1/d6/da/l23 0 2024-04-12T09:11:02.924 INFO:tasks.workunit.client.0.smithi117.stdout:8/183: dwrite db/d1b/f34 [4194304,4194304] 0 2024-04-12T09:11:02.933 INFO:tasks.workunit.client.0.smithi117.stdout:2/170: dread d0/d4/d10/d2a/f2d [0,4194304] 0 2024-04-12T09:11:02.939 INFO:tasks.workunit.client.0.smithi117.stdout:4/208: dwrite d0/d1/f1b [0,4194304] 0 2024-04-12T09:11:02.939 INFO:tasks.workunit.client.0.smithi117.stdout:2/171: chown d0/f36 56758 1 2024-04-12T09:11:02.945 INFO:tasks.workunit.client.0.smithi117.stdout:3/276: truncate de/d2c/d59/d19/f52 736809 0 2024-04-12T09:11:02.947 INFO:tasks.workunit.client.0.smithi117.stdout:8/184: rename db/d1f to db/d19/d1a/d3d 0 2024-04-12T09:11:02.949 INFO:tasks.workunit.client.0.smithi117.stdout:7/178: dwrite d0/d2/fd [0,4194304] 0 2024-04-12T09:11:02.950 INFO:tasks.workunit.client.0.smithi117.stdout:8/185: fdatasync db/d19/f2b 0 2024-04-12T09:11:02.955 INFO:tasks.workunit.client.0.smithi117.stdout:2/172: dwrite d0/df/d1a/f21 [0,4194304] 0 2024-04-12T09:11:02.955 INFO:tasks.workunit.client.0.smithi117.stdout:4/209: dread d0/f4 [0,4194304] 0 2024-04-12T09:11:02.956 INFO:tasks.workunit.client.0.smithi117.stdout:2/173: chown d0/d26 859 1 2024-04-12T09:11:02.956 INFO:tasks.workunit.client.0.smithi117.stdout:4/210: fsync d0/f14 0 2024-04-12T09:11:02.961 INFO:tasks.workunit.client.0.smithi117.stdout:1/153: rmdir d1/d22 0 2024-04-12T09:11:02.964 INFO:tasks.workunit.client.0.smithi117.stdout:8/186: dwrite db/d19/d1a/f26 [0,4194304] 0 2024-04-12T09:11:02.966 INFO:tasks.workunit.client.0.smithi117.stdout:3/277: creat de/d2c/d59/d19/d22/d3e/d5d/f64 x:0 0 0 2024-04-12T09:11:02.972 INFO:tasks.workunit.client.0.smithi117.stdout:2/174: rename d0/df/d1a/f22 to d0/d4/d10/d27/f39 0 2024-04-12T09:11:02.972 INFO:tasks.workunit.client.0.smithi117.stdout:2/175: write d0/f36 [211066,95406] 0 2024-04-12T09:11:02.975 INFO:tasks.workunit.client.0.smithi117.stdout:1/154: creat d1/d6/da/f29 x:0 0 0 2024-04-12T09:11:02.980 INFO:tasks.workunit.client.0.smithi117.stdout:7/179: unlink d0/d2/d22/d17/c1c 0 2024-04-12T09:11:02.983 INFO:tasks.workunit.client.0.smithi117.stdout:3/278: mknod de/d2c/d59/d19/d22/d3d/c65 0 2024-04-12T09:11:02.986 INFO:tasks.workunit.client.0.smithi117.stdout:7/180: dwrite d0/da/f2d [0,4194304] 0 2024-04-12T09:11:02.990 INFO:tasks.workunit.client.0.smithi117.stdout:2/176: mknod d0/d4/d10/c3a 0 2024-04-12T09:11:02.996 INFO:tasks.workunit.client.0.smithi117.stdout:2/177: dwrite d0/d26/f34 [0,4194304] 0 2024-04-12T09:11:02.997 INFO:tasks.workunit.client.0.smithi117.stdout:1/155: mknod d1/d6/da/db/d16/c2a 0 2024-04-12T09:11:02.999 INFO:tasks.workunit.client.0.smithi117.stdout:8/187: link db/d19/d1a/f21 db/f3e 0 2024-04-12T09:11:03.001 INFO:tasks.workunit.client.0.smithi117.stdout:8/188: write db/d1b/f34 [5357283,34494] 0 2024-04-12T09:11:03.001 INFO:tasks.workunit.client.0.smithi117.stdout:7/181: dread d0/f1b [0,4194304] 0 2024-04-12T09:11:03.009 INFO:tasks.workunit.client.0.smithi117.stdout:0/258: getdents d3 0 2024-04-12T09:11:03.011 INFO:tasks.workunit.client.0.smithi117.stdout:2/178: mknod d0/d26/c3b 0 2024-04-12T09:11:03.014 INFO:tasks.workunit.client.0.smithi117.stdout:1/156: symlink d1/d6/da/db/l2b 0 2024-04-12T09:11:03.019 INFO:tasks.workunit.client.0.smithi117.stdout:1/157: dwrite d1/f10 [4194304,4194304] 0 2024-04-12T09:11:03.028 INFO:tasks.workunit.client.0.smithi117.stdout:0/259: mkdir d3/d22/d55 0 2024-04-12T09:11:03.032 INFO:tasks.workunit.client.0.smithi117.stdout:7/182: dread d0/d2/f8 [0,4194304] 0 2024-04-12T09:11:03.036 INFO:tasks.workunit.client.0.smithi117.stdout:4/211: truncate d0/d1/d34/d20/f26 1258084 0 2024-04-12T09:11:03.038 INFO:tasks.workunit.client.0.smithi117.stdout:0/260: rmdir d3 39 2024-04-12T09:11:03.044 INFO:tasks.workunit.client.0.smithi117.stdout:4/212: creat d0/d5/d39/f3e x:0 0 0 2024-04-12T09:11:03.048 INFO:tasks.workunit.client.0.smithi117.stdout:8/189: getdents db 0 2024-04-12T09:11:03.051 INFO:tasks.workunit.client.0.smithi117.stdout:1/158: creat d1/f2c x:0 0 0 2024-04-12T09:11:03.051 INFO:tasks.workunit.client.0.smithi117.stdout:4/213: dwrite d0/d5/d39/f3e [0,4194304] 0 2024-04-12T09:11:03.052 INFO:tasks.workunit.client.0.smithi117.stdout:1/159: dread - d1/d6/da/db/f27 zero size 2024-04-12T09:11:03.053 INFO:tasks.workunit.client.0.smithi117.stdout:0/261: creat d3/dc/f56 x:0 0 0 2024-04-12T09:11:03.058 INFO:tasks.workunit.client.0.smithi117.stdout:8/190: symlink db/d19/d1a/d3d/l3f 0 2024-04-12T09:11:03.058 INFO:tasks.workunit.client.0.smithi117.stdout:4/214: dwrite d0/d2c/f31 [0,4194304] 0 2024-04-12T09:11:03.065 INFO:tasks.workunit.client.0.smithi117.stdout:3/279: write de/d2c/d59/d19/d22/d3e/d3f/f58 [1251843,9178] 0 2024-04-12T09:11:03.066 INFO:tasks.workunit.client.0.smithi117.stdout:0/262: symlink d3/d47/l57 0 2024-04-12T09:11:03.067 INFO:tasks.workunit.client.0.smithi117.stdout:8/191: dwrite db/f30 [0,4194304] 0 2024-04-12T09:11:03.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:02 smithi203 ceph-mon[36428]: Adjusting osd_memory_target on smithi203 to 2581M 2024-04-12T09:11:03.077 INFO:tasks.workunit.client.0.smithi117.stdout:0/263: rename d3/l11 to d3/d36/l58 0 2024-04-12T09:11:03.077 INFO:tasks.workunit.client.0.smithi117.stdout:0/264: read d3/dc/f2e [3622346,15751] 0 2024-04-12T09:11:03.077 INFO:tasks.workunit.client.0.smithi117.stdout:0/265: readlink d3/d22/l2f 0 2024-04-12T09:11:03.078 INFO:tasks.workunit.client.0.smithi117.stdout:0/266: chown d3/d30/d32/f4a 499814 1 2024-04-12T09:11:03.078 INFO:tasks.workunit.client.0.smithi117.stdout:8/192: creat db/d1b/f40 x:0 0 0 2024-04-12T09:11:03.086 INFO:tasks.workunit.client.0.smithi117.stdout:0/267: mkdir d3/d59 0 2024-04-12T09:11:03.089 INFO:tasks.workunit.client.0.smithi117.stdout:3/280: link de/l2b de/d2c/d59/d30/l66 0 2024-04-12T09:11:03.093 INFO:tasks.workunit.client.0.smithi117.stdout:3/281: dread f7 [0,4194304] 0 2024-04-12T09:11:03.098 INFO:tasks.workunit.client.0.smithi117.stdout:1/160: dwrite d1/d6/da/db/d16/f19 [0,4194304] 0 2024-04-12T09:11:03.098 INFO:tasks.workunit.client.0.smithi117.stdout:0/268: mkdir d3/d22/d55/d5a 0 2024-04-12T09:11:03.099 INFO:tasks.workunit.client.0.smithi117.stdout:1/161: fsync f0 0 2024-04-12T09:11:03.099 INFO:tasks.workunit.client.0.smithi117.stdout:0/269: stat d3/d22/f29 0 2024-04-12T09:11:03.101 INFO:tasks.workunit.client.0.smithi117.stdout:1/162: read - d1/d6/da/f29 zero size 2024-04-12T09:11:03.103 INFO:tasks.workunit.client.0.smithi117.stdout:1/163: dread - d1/d6/da/f29 zero size 2024-04-12T09:11:03.104 INFO:tasks.workunit.client.0.smithi117.stdout:3/282: mknod de/d2c/d59/d19/d22/c67 0 2024-04-12T09:11:03.106 INFO:tasks.workunit.client.0.smithi117.stdout:4/215: dwrite d0/d1/d34/f28 [4194304,4194304] 0 2024-04-12T09:11:03.113 INFO:tasks.workunit.client.0.smithi117.stdout:0/270: truncate d3/dc/f2c 1835481 0 2024-04-12T09:11:03.116 INFO:tasks.workunit.client.0.smithi117.stdout:1/164: creat d1/d6/f2d x:0 0 0 2024-04-12T09:11:03.117 INFO:tasks.workunit.client.0.smithi117.stdout:1/165: dread - d1/d6/da/db/f27 zero size 2024-04-12T09:11:03.118 INFO:tasks.workunit.client.0.smithi117.stdout:8/193: getdents db/d13 0 2024-04-12T09:11:03.119 INFO:tasks.workunit.client.0.smithi117.stdout:1/166: readlink d1/d6/da/db/l26 0 2024-04-12T09:11:03.119 INFO:tasks.workunit.client.0.smithi117.stdout:0/271: dwrite d3/f4d [0,4194304] 0 2024-04-12T09:11:03.121 INFO:tasks.workunit.client.0.smithi117.stdout:1/167: write d1/d6/da/db/f27 [1048562,29369] 0 2024-04-12T09:11:03.126 INFO:tasks.workunit.client.0.smithi117.stdout:4/216: dread d0/d5/f8 [0,4194304] 0 2024-04-12T09:11:03.127 INFO:tasks.workunit.client.0.smithi117.stdout:3/283: mkdir de/d2c/d59/d19/d54/d68 0 2024-04-12T09:11:03.129 INFO:tasks.workunit.client.0.smithi117.stdout:8/194: symlink db/d19/d1a/d3d/l41 0 2024-04-12T09:11:03.130 INFO:tasks.workunit.client.0.smithi117.stdout:8/195: dread - db/d13/f31 zero size 2024-04-12T09:11:03.135 INFO:tasks.workunit.client.0.smithi117.stdout:4/217: creat d0/d5/f3f x:0 0 0 2024-04-12T09:11:03.137 INFO:tasks.workunit.client.0.smithi117.stdout:3/284: symlink de/d2c/d59/d19/d54/l69 0 2024-04-12T09:11:03.139 INFO:tasks.workunit.client.0.smithi117.stdout:8/196: mknod db/d19/d1a/d3d/c42 0 2024-04-12T09:11:03.142 INFO:tasks.workunit.client.0.smithi117.stdout:0/272: rename d3/d47/l54 to d3/d22/d55/d5a/l5b 0 2024-04-12T09:11:03.144 INFO:tasks.workunit.client.0.smithi117.stdout:0/273: write d3/d22/f33 [1111979,93524] 0 2024-04-12T09:11:03.145 INFO:tasks.workunit.client.0.smithi117.stdout:1/168: creat d1/d6/da/db/d1d/d24/f2e x:0 0 0 2024-04-12T09:11:03.146 INFO:tasks.workunit.client.0.smithi117.stdout:1/169: stat d1/d6/da/db/l26 0 2024-04-12T09:11:03.148 INFO:tasks.workunit.client.0.smithi117.stdout:4/218: creat d0/d1/d34/d20/f40 x:0 0 0 2024-04-12T09:11:03.148 INFO:tasks.workunit.client.0.smithi117.stdout:4/219: chown d0/d5/lb 183 1 2024-04-12T09:11:03.149 INFO:tasks.workunit.client.0.smithi117.stdout:4/220: chown d0/d5/d3b/c18 86 1 2024-04-12T09:11:03.150 INFO:tasks.workunit.client.0.smithi117.stdout:3/285: unlink de/c4d 0 2024-04-12T09:11:03.155 INFO:tasks.workunit.client.0.smithi117.stdout:1/170: creat d1/d6/da/db/d16/f2f x:0 0 0 2024-04-12T09:11:03.157 INFO:tasks.workunit.client.0.smithi117.stdout:3/286: dread fa [0,4194304] 0 2024-04-12T09:11:03.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:02 smithi117 ceph-mon[29277]: Adjusting osd_memory_target on smithi203 to 2581M 2024-04-12T09:11:03.166 INFO:tasks.workunit.client.0.smithi117.stdout:4/221: link d0/d5/d25/l3a d0/d5/d3b/d38/l41 0 2024-04-12T09:11:03.172 INFO:tasks.workunit.client.0.smithi117.stdout:4/222: creat d0/d5/d3b/f42 x:0 0 0 2024-04-12T09:11:03.174 INFO:tasks.workunit.client.0.smithi117.stdout:1/171: getdents d1 0 2024-04-12T09:11:03.176 INFO:tasks.workunit.client.0.smithi117.stdout:4/223: mkdir d0/d5/d43 0 2024-04-12T09:11:03.177 INFO:tasks.workunit.client.0.smithi117.stdout:4/224: read - d0/d5/f3f zero size 2024-04-12T09:11:03.179 INFO:tasks.workunit.client.0.smithi117.stdout:1/172: dread f0 [4194304,4194304] 0 2024-04-12T09:11:03.179 INFO:tasks.workunit.client.0.smithi117.stdout:0/274: dwrite d3/f6 [0,4194304] 0 2024-04-12T09:11:03.181 INFO:tasks.workunit.client.0.smithi117.stdout:4/225: symlink d0/d1/d34/d20/l44 0 2024-04-12T09:11:03.184 INFO:tasks.workunit.client.0.smithi117.stdout:1/173: mknod d1/d6/c30 0 2024-04-12T09:11:03.186 INFO:tasks.workunit.client.0.smithi117.stdout:0/275: rename d3/d22/f35 to d3/d59/f5c 0 2024-04-12T09:11:03.189 INFO:tasks.workunit.client.0.smithi117.stdout:3/287: truncate de/d2c/d59/d19/d22/d3e/d5d/f46 3981492 0 2024-04-12T09:11:03.190 INFO:tasks.workunit.client.0.smithi117.stdout:1/174: creat d1/d6/da/db/f31 x:0 0 0 2024-04-12T09:11:03.195 INFO:tasks.workunit.client.0.smithi117.stdout:1/175: dwrite f0 [4194304,4194304] 0 2024-04-12T09:11:03.196 INFO:tasks.workunit.client.0.smithi117.stdout:4/226: creat d0/d2c/d3c/f45 x:0 0 0 2024-04-12T09:11:03.197 INFO:tasks.workunit.client.0.smithi117.stdout:4/227: fsync d0/d5/d39/f36 0 2024-04-12T09:11:03.199 INFO:tasks.workunit.client.0.smithi117.stdout:0/276: unlink d3/d22/d55/d5a/l5b 0 2024-04-12T09:11:03.200 INFO:tasks.workunit.client.0.smithi117.stdout:0/277: chown d3/dc/c40 28 1 2024-04-12T09:11:03.201 INFO:tasks.workunit.client.0.smithi117.stdout:4/228: dread d0/f14 [0,4194304] 0 2024-04-12T09:11:03.201 INFO:tasks.workunit.client.0.smithi117.stdout:3/288: mknod de/d2c/d59/d19/c6a 0 2024-04-12T09:11:03.205 INFO:tasks.workunit.client.0.smithi117.stdout:1/176: rename d1/d6/da/db/f27 to d1/d6/da/db/d1d/d24/f32 0 2024-04-12T09:11:03.208 INFO:tasks.workunit.client.0.smithi117.stdout:0/278: creat d3/d22/d55/d5a/f5d x:0 0 0 2024-04-12T09:11:03.210 INFO:tasks.workunit.client.0.smithi117.stdout:4/229: mknod d0/d2c/c46 0 2024-04-12T09:11:03.210 INFO:tasks.workunit.client.0.smithi117.stdout:4/230: read d0/d2c/f2f [3115485,75650] 0 2024-04-12T09:11:03.211 INFO:tasks.workunit.client.0.smithi117.stdout:4/231: chown d0/f27 1185194 1 2024-04-12T09:11:03.211 INFO:tasks.workunit.client.0.smithi117.stdout:3/289: creat de/d2c/d59/d30/f6b x:0 0 0 2024-04-12T09:11:03.212 INFO:tasks.workunit.client.0.smithi117.stdout:4/232: chown d0/d1/d34/d20/f40 1525067635 1 2024-04-12T09:11:03.213 INFO:tasks.workunit.client.0.smithi117.stdout:4/233: write d0/d5/d3b/f32 [717299,71445] 0 2024-04-12T09:11:03.216 INFO:tasks.workunit.client.0.smithi117.stdout:1/177: rename d1/d6/f2d to d1/d6/da/db/f33 0 2024-04-12T09:11:03.222 INFO:tasks.workunit.client.0.smithi117.stdout:3/290: mknod de/d2c/d59/d19/d22/d3e/d5d/c6c 0 2024-04-12T09:11:03.241 INFO:tasks.workunit.client.0.smithi117.stdout:6/240: sync 2024-04-12T09:11:03.242 INFO:tasks.workunit.client.0.smithi117.stdout:6/241: stat d8/d3a/d49/f52 0 2024-04-12T09:11:03.243 INFO:tasks.workunit.client.0.smithi117.stdout:6/242: fsync d8/d3a/d49/f52 0 2024-04-12T09:11:03.248 INFO:tasks.workunit.client.0.smithi117.stdout:1/178: creat d1/d6/f34 x:0 0 0 2024-04-12T09:11:03.253 INFO:tasks.workunit.client.0.smithi117.stdout:1/179: dwrite d1/d6/da/f29 [0,4194304] 0 2024-04-12T09:11:03.260 INFO:tasks.workunit.client.0.smithi117.stdout:3/291: symlink de/d2c/d59/d4c/d62/l6d 0 2024-04-12T09:11:03.262 INFO:tasks.workunit.client.0.smithi117.stdout:1/180: creat d1/d6/da/f35 x:0 0 0 2024-04-12T09:11:03.263 INFO:tasks.workunit.client.0.smithi117.stdout:0/279: write d3/f20 [4412307,17302] 0 2024-04-12T09:11:03.264 INFO:tasks.workunit.client.0.smithi117.stdout:6/243: symlink d8/d9/l53 0 2024-04-12T09:11:03.265 INFO:tasks.workunit.client.0.smithi117.stdout:6/244: dread - d8/d9/d39/f4f zero size 2024-04-12T09:11:03.266 INFO:tasks.workunit.client.0.smithi117.stdout:3/292: truncate de/d2c/d59/f1b 1193409 0 2024-04-12T09:11:03.269 INFO:tasks.workunit.client.0.smithi117.stdout:0/280: creat d3/d47/f5e x:0 0 0 2024-04-12T09:11:03.271 INFO:tasks.workunit.client.0.smithi117.stdout:1/181: write d1/d6/da/db/d1d/d24/f32 [1746309,128038] 0 2024-04-12T09:11:03.271 INFO:tasks.workunit.client.0.smithi117.stdout:4/234: write d0/f4 [1794863,128421] 0 2024-04-12T09:11:03.272 INFO:tasks.workunit.client.0.smithi117.stdout:1/182: chown d1/d6/da/f35 1492 1 2024-04-12T09:11:03.272 INFO:tasks.workunit.client.0.smithi117.stdout:4/235: dread - d0/d2c/d3c/f45 zero size 2024-04-12T09:11:03.273 INFO:tasks.workunit.client.0.smithi117.stdout:4/236: read d0/f27 [20265,21490] 0 2024-04-12T09:11:03.275 INFO:tasks.workunit.client.0.smithi117.stdout:3/293: rmdir de/d2c/d59/d19 39 2024-04-12T09:11:03.279 INFO:tasks.workunit.client.0.smithi117.stdout:1/183: creat d1/d6/da/f36 x:0 0 0 2024-04-12T09:11:03.282 INFO:tasks.workunit.client.0.smithi117.stdout:4/237: creat d0/d2c/d3c/f47 x:0 0 0 2024-04-12T09:11:03.282 INFO:tasks.workunit.client.0.smithi117.stdout:0/281: dwrite d3/dc/f51 [0,4194304] 0 2024-04-12T09:11:03.283 INFO:tasks.workunit.client.0.smithi117.stdout:0/282: chown d3/f39 377732 1 2024-04-12T09:11:03.289 INFO:tasks.workunit.client.0.smithi117.stdout:1/184: creat d1/d6/da/db/f37 x:0 0 0 2024-04-12T09:11:03.290 INFO:tasks.workunit.client.0.smithi117.stdout:1/185: readlink d1/d6/da/db/d16/l25 0 2024-04-12T09:11:03.292 INFO:tasks.workunit.client.0.smithi117.stdout:1/186: truncate d1/d6/da/db/d16/f19 4398966 0 2024-04-12T09:11:03.293 INFO:tasks.workunit.client.0.smithi117.stdout:1/187: fdatasync d1/f21 0 2024-04-12T09:11:03.293 INFO:tasks.workunit.client.0.smithi117.stdout:1/188: readlink d1/l18 0 2024-04-12T09:11:03.294 INFO:tasks.workunit.client.0.smithi117.stdout:1/189: write d1/d6/f34 [820326,115258] 0 2024-04-12T09:11:03.296 INFO:tasks.workunit.client.0.smithi117.stdout:4/238: dread d0/d1/f1b [0,4194304] 0 2024-04-12T09:11:03.297 INFO:tasks.workunit.client.0.smithi117.stdout:6/245: link d8/l27 d8/d9/d17/d2d/l54 0 2024-04-12T09:11:03.298 INFO:tasks.workunit.client.0.smithi117.stdout:6/246: write d8/d9/fb [2873027,99820] 0 2024-04-12T09:11:03.300 INFO:tasks.workunit.client.0.smithi117.stdout:3/294: creat de/d2c/d59/d19/d22/d40/d49/f6e x:0 0 0 2024-04-12T09:11:03.301 INFO:tasks.workunit.client.0.smithi117.stdout:1/190: dread d1/f13 [4194304,4194304] 0 2024-04-12T09:11:03.309 INFO:tasks.workunit.client.0.smithi117.stdout:1/191: fsync d1/d6/da/f36 0 2024-04-12T09:11:03.310 INFO:tasks.workunit.client.0.smithi117.stdout:6/247: mknod d8/d3a/d49/c55 0 2024-04-12T09:11:03.318 INFO:tasks.workunit.client.0.smithi117.stdout:4/239: link d0/d2c/f30 d0/d1/f48 0 2024-04-12T09:11:03.324 INFO:tasks.workunit.client.0.smithi117.stdout:3/295: symlink de/l6f 0 2024-04-12T09:11:03.332 INFO:tasks.workunit.client.0.smithi117.stdout:0/283: dwrite d3/dc/f2c [0,4194304] 0 2024-04-12T09:11:03.340 INFO:tasks.workunit.client.0.smithi117.stdout:0/284: dwrite d3/d30/d32/f45 [0,4194304] 0 2024-04-12T09:11:03.344 INFO:tasks.workunit.client.0.smithi117.stdout:4/240: link d0/d5/d39/f36 d0/f49 0 2024-04-12T09:11:03.345 INFO:tasks.workunit.client.0.smithi117.stdout:1/192: getdents d1/d6/da/db/d1d/d24 0 2024-04-12T09:11:03.345 INFO:tasks.workunit.client.0.smithi117.stdout:1/193: fdatasync f0 0 2024-04-12T09:11:03.346 INFO:tasks.workunit.client.0.smithi117.stdout:1/194: chown d1/d6/da/db/d16 4088676 1 2024-04-12T09:11:03.348 INFO:tasks.workunit.client.0.smithi117.stdout:6/248: write d8/d9/d17/f23 [243848,74025] 0 2024-04-12T09:11:03.349 INFO:tasks.workunit.client.0.smithi117.stdout:6/249: write d8/d9/fa [2399058,62523] 0 2024-04-12T09:11:03.350 INFO:tasks.workunit.client.0.smithi117.stdout:6/250: chown d8/d9/f40 484875 1 2024-04-12T09:11:03.351 INFO:tasks.workunit.client.0.smithi117.stdout:3/296: rename de/d2c/d59/d19/d22 to de/d2c/d59/d70 0 2024-04-12T09:11:03.351 INFO:tasks.workunit.client.0.smithi117.stdout:3/297: chown de/d2c/d59/d19 45342 1 2024-04-12T09:11:03.353 INFO:tasks.workunit.client.0.smithi117.stdout:0/285: mknod d3/d22/c5f 0 2024-04-12T09:11:03.354 INFO:tasks.workunit.client.0.smithi117.stdout:4/241: mknod d0/d2c/d3c/c4a 0 2024-04-12T09:11:03.358 INFO:tasks.workunit.client.0.smithi117.stdout:1/195: mkdir d1/d6/da/db/d1d/d24/d38 0 2024-04-12T09:11:03.360 INFO:tasks.workunit.client.0.smithi117.stdout:4/242: dwrite d0/d1/d34/d20/f40 [0,4194304] 0 2024-04-12T09:11:03.362 INFO:tasks.workunit.client.0.smithi117.stdout:6/251: rmdir d8/d9/d17/d2d 39 2024-04-12T09:11:03.367 INFO:tasks.workunit.client.0.smithi117.stdout:0/286: creat d3/d47/f60 x:0 0 0 2024-04-12T09:11:03.367 INFO:tasks.workunit.client.0.smithi117.stdout:0/287: read - d3/d47/f60 zero size 2024-04-12T09:11:03.372 INFO:tasks.workunit.client.0.smithi117.stdout:1/196: creat d1/d6/da/db/f39 x:0 0 0 2024-04-12T09:11:03.372 INFO:tasks.workunit.client.0.smithi117.stdout:0/288: dread d3/f4d [0,4194304] 0 2024-04-12T09:11:03.374 INFO:tasks.workunit.client.0.smithi117.stdout:0/289: dread - d3/d30/f3d zero size 2024-04-12T09:11:03.374 INFO:tasks.workunit.client.0.smithi117.stdout:0/290: stat d3/d47/l57 0 2024-04-12T09:11:03.374 INFO:tasks.workunit.client.0.smithi117.stdout:4/243: mknod d0/d2c/c4b 0 2024-04-12T09:11:03.375 INFO:tasks.workunit.client.0.smithi117.stdout:4/244: write d0/d5/d3b/f1c [129825,4557] 0 2024-04-12T09:11:03.377 INFO:tasks.workunit.client.0.smithi117.stdout:4/245: chown d0/d5/d3b/c18 5211489 1 2024-04-12T09:11:03.378 INFO:tasks.workunit.client.0.smithi117.stdout:4/246: write d0/d2c/d3c/f47 [331557,63956] 0 2024-04-12T09:11:03.384 INFO:tasks.workunit.client.0.smithi117.stdout:1/197: symlink d1/d6/da/db/d1d/l3a 0 2024-04-12T09:11:03.386 INFO:tasks.workunit.client.0.smithi117.stdout:0/291: truncate d3/dc/f2e 4412550 0 2024-04-12T09:11:03.387 INFO:tasks.workunit.client.0.smithi117.stdout:3/298: dread de/d2c/d59/d19/f29 [0,4194304] 0 2024-04-12T09:11:03.387 INFO:tasks.workunit.client.0.smithi117.stdout:3/299: chown de/f14 28 1 2024-04-12T09:11:03.389 INFO:tasks.workunit.client.0.smithi117.stdout:3/300: chown de/d2c/d59/d4c/d62/l6d 50 1 2024-04-12T09:11:03.392 INFO:tasks.workunit.client.0.smithi117.stdout:4/247: symlink d0/d1/d34/d20/l4c 0 2024-04-12T09:11:03.397 INFO:tasks.workunit.client.0.smithi117.stdout:1/198: unlink d1/d6/da/f36 0 2024-04-12T09:11:03.398 INFO:tasks.workunit.client.0.smithi117.stdout:1/199: stat d1/d6/da/db/f31 0 2024-04-12T09:11:03.405 INFO:tasks.workunit.client.0.smithi117.stdout:6/252: truncate d8/d9/f1f 2545195 0 2024-04-12T09:11:03.406 INFO:tasks.workunit.client.0.smithi117.stdout:1/200: mkdir d1/d3b 0 2024-04-12T09:11:03.408 INFO:tasks.workunit.client.0.smithi117.stdout:0/292: link d3/dc/f51 d3/d30/f61 0 2024-04-12T09:11:03.409 INFO:tasks.workunit.client.0.smithi117.stdout:4/248: truncate d0/d1/d34/d20/f26 879191 0 2024-04-12T09:11:03.411 INFO:tasks.workunit.client.0.smithi117.stdout:4/249: truncate d0/d1/d34/d20/f40 4354972 0 2024-04-12T09:11:03.411 INFO:tasks.workunit.client.0.smithi117.stdout:6/253: rename d8/d9 to d8/d9/d17/d56 22 2024-04-12T09:11:03.411 INFO:tasks.workunit.client.0.smithi117.stdout:4/250: readlink d0/d5/l13 0 2024-04-12T09:11:03.418 INFO:tasks.workunit.client.0.smithi117.stdout:4/251: creat d0/d2c/f4d x:0 0 0 2024-04-12T09:11:03.419 INFO:tasks.workunit.client.0.smithi117.stdout:4/252: write d0/d5/d3b/f42 [151158,108501] 0 2024-04-12T09:11:03.422 INFO:tasks.workunit.client.0.smithi117.stdout:3/301: getdents de 0 2024-04-12T09:11:03.422 INFO:tasks.workunit.client.0.smithi117.stdout:9/232: sync 2024-04-12T09:11:03.422 INFO:tasks.workunit.client.0.smithi117.stdout:3/302: fdatasync de/d2c/d59/f1a 0 2024-04-12T09:11:03.426 INFO:tasks.workunit.client.0.smithi117.stdout:3/303: chown de/d2c/d59/d19/d54/d68 0 1 2024-04-12T09:11:03.426 INFO:tasks.workunit.client.0.smithi117.stdout:9/233: truncate d1/d8/df/d39/d3b/f4a 786591 0 2024-04-12T09:11:03.426 INFO:tasks.workunit.client.0.smithi117.stdout:6/254: mkdir d8/d9/d57 0 2024-04-12T09:11:03.426 INFO:tasks.workunit.client.0.smithi117.stdout:3/304: dread - de/d2c/d59/d70/d3e/f5a zero size 2024-04-12T09:11:03.428 INFO:tasks.workunit.client.0.smithi117.stdout:4/253: mkdir d0/d5/d39/d4e 0 2024-04-12T09:11:03.429 INFO:tasks.workunit.client.0.smithi117.stdout:4/254: fdatasync d0/f4 0 2024-04-12T09:11:03.434 INFO:tasks.workunit.client.0.smithi117.stdout:6/255: unlink d8/d9/d17/f32 0 2024-04-12T09:11:03.436 INFO:tasks.workunit.client.0.smithi117.stdout:9/234: write d1/d8/df/d26/f3c [1709366,53818] 0 2024-04-12T09:11:03.439 INFO:tasks.workunit.client.0.smithi117.stdout:0/293: getdents d3/dc 0 2024-04-12T09:11:03.441 INFO:tasks.workunit.client.0.smithi117.stdout:3/305: write de/d2c/d59/d70/f32 [1143830,60427] 0 2024-04-12T09:11:03.443 INFO:tasks.workunit.client.0.smithi117.stdout:0/294: dread d3/dc/f51 [0,4194304] 0 2024-04-12T09:11:03.447 INFO:tasks.workunit.client.0.smithi117.stdout:1/201: truncate d1/d6/da/db/f33 405091 0 2024-04-12T09:11:03.449 INFO:tasks.workunit.client.0.smithi117.stdout:9/235: fdatasync d1/d8/f10 0 2024-04-12T09:11:03.457 INFO:tasks.workunit.client.0.smithi117.stdout:0/295: mkdir d3/d22/d55/d5a/d62 0 2024-04-12T09:11:03.459 INFO:tasks.workunit.client.0.smithi117.stdout:4/255: mkdir d0/d5/d3b/d38/d4f 0 2024-04-12T09:11:03.460 INFO:tasks.workunit.client.0.smithi117.stdout:4/256: chown d0/d5/d3b/f42 479 1 2024-04-12T09:11:03.466 INFO:tasks.workunit.client.0.smithi117.stdout:4/257: dwrite d0/d5/d3b/f32 [0,4194304] 0 2024-04-12T09:11:03.467 INFO:tasks.workunit.client.0.smithi117.stdout:0/296: mknod d3/d36/c63 0 2024-04-12T09:11:03.473 INFO:tasks.workunit.client.0.smithi117.stdout:9/236: mknod d1/d23/c4d 0 2024-04-12T09:11:03.474 INFO:tasks.workunit.client.0.smithi117.stdout:9/237: write d1/d8/df/d1b/f35 [425872,92695] 0 2024-04-12T09:11:03.475 INFO:tasks.workunit.client.0.smithi117.stdout:9/238: chown d1/d8/d12 633461 1 2024-04-12T09:11:03.475 INFO:tasks.workunit.client.0.smithi117.stdout:4/258: unlink d0/d5/d3b/f32 0 2024-04-12T09:11:03.477 INFO:tasks.workunit.client.0.smithi117.stdout:0/297: write d3/d30/f61 [3829908,36148] 0 2024-04-12T09:11:03.479 INFO:tasks.workunit.client.0.smithi117.stdout:3/306: rename de/d2c/d59/f34 to de/d2c/f71 0 2024-04-12T09:11:03.481 INFO:tasks.workunit.client.0.smithi117.stdout:3/307: write de/d2c/d59/d70/f32 [237184,34668] 0 2024-04-12T09:11:03.493 INFO:tasks.workunit.client.0.smithi117.stdout:3/308: rmdir de 39 2024-04-12T09:11:03.494 INFO:tasks.workunit.client.0.smithi117.stdout:9/239: link d1/d8/df/d3e/f32 d1/d8/f4e 0 2024-04-12T09:11:03.498 INFO:tasks.workunit.client.0.smithi117.stdout:1/202: rename d1/c1b to d1/d6/da/db/d1d/d24/c3c 0 2024-04-12T09:11:03.500 INFO:tasks.workunit.client.0.smithi117.stdout:9/240: truncate d1/d8/df/d3e/f36 794470 0 2024-04-12T09:11:03.500 INFO:tasks.workunit.client.0.smithi117.stdout:9/241: readlink d1/d8/l1a 0 2024-04-12T09:11:03.501 INFO:tasks.workunit.client.0.smithi117.stdout:9/242: truncate d1/d8/df/d1b/f35 1360629 0 2024-04-12T09:11:03.504 INFO:tasks.workunit.client.0.smithi117.stdout:3/309: readlink de/d2c/d59/d19/l25 0 2024-04-12T09:11:03.505 INFO:tasks.workunit.client.0.smithi117.stdout:3/310: write de/d2c/d59/d19/d27/f44 [682754,68206] 0 2024-04-12T09:11:03.506 INFO:tasks.workunit.client.0.smithi117.stdout:9/243: fdatasync d1/d8/d12/f38 0 2024-04-12T09:11:03.513 INFO:tasks.workunit.client.0.smithi117.stdout:9/244: dwrite d1/d8/df/d39/d3b/f4a [0,4194304] 0 2024-04-12T09:11:03.515 INFO:tasks.workunit.client.0.smithi117.stdout:3/311: mknod de/d2c/d59/d19/d4f/c72 0 2024-04-12T09:11:03.516 INFO:tasks.workunit.client.0.smithi117.stdout:3/312: fdatasync de/d2c/d59/f42 0 2024-04-12T09:11:03.519 INFO:tasks.workunit.client.0.smithi117.stdout:9/245: creat d1/d23/d27/f4f x:0 0 0 2024-04-12T09:11:03.521 INFO:tasks.workunit.client.0.smithi117.stdout:3/313: chown de/d2c/c2d 1 1 2024-04-12T09:11:03.522 INFO:tasks.workunit.client.0.smithi117.stdout:3/314: write de/f47 [379810,33949] 0 2024-04-12T09:11:03.525 INFO:tasks.workunit.client.0.smithi117.stdout:9/246: rename d1/d8/df/d1b/f35 to d1/d8/df/d26/d41/f50 0 2024-04-12T09:11:03.526 INFO:tasks.workunit.client.0.smithi117.stdout:9/247: dread - d1/d23/d27/f4f zero size 2024-04-12T09:11:03.527 INFO:tasks.workunit.client.0.smithi117.stdout:0/298: dwrite d3/f4d [0,4194304] 0 2024-04-12T09:11:03.528 INFO:tasks.workunit.client.0.smithi117.stdout:0/299: stat d3/d22/f29 0 2024-04-12T09:11:03.532 INFO:tasks.workunit.client.0.smithi117.stdout:3/315: mkdir de/d2c/d59/d70/d3e/d3f/d73 0 2024-04-12T09:11:03.534 INFO:tasks.workunit.client.0.smithi117.stdout:3/316: chown de/d2c/d59/d19/d27/c39 391927310 1 2024-04-12T09:11:03.534 INFO:tasks.workunit.client.0.smithi117.stdout:9/248: mknod d1/d8/df/d1b/c51 0 2024-04-12T09:11:03.538 INFO:tasks.workunit.client.0.smithi117.stdout:0/300: unlink d3/c1b 0 2024-04-12T09:11:03.542 INFO:tasks.workunit.client.0.smithi117.stdout:3/317: dwrite de/d2c/d59/d70/d3e/d5d/f64 [0,4194304] 0 2024-04-12T09:11:03.548 INFO:tasks.workunit.client.0.smithi117.stdout:3/318: dread de/d2c/d59/d70/d3e/d5d/f64 [0,4194304] 0 2024-04-12T09:11:03.553 INFO:tasks.workunit.client.0.smithi117.stdout:1/203: dwrite d1/d6/da/db/f33 [0,4194304] 0 2024-04-12T09:11:03.554 INFO:tasks.workunit.client.0.smithi117.stdout:1/204: chown d1/d6/da 1326 1 2024-04-12T09:11:03.556 INFO:tasks.workunit.client.0.smithi117.stdout:0/301: mkdir d3/d22/d55/d5a/d62/d64 0 2024-04-12T09:11:03.558 INFO:tasks.workunit.client.0.smithi117.stdout:0/302: truncate d3/dc/f44 4369834 0 2024-04-12T09:11:03.562 INFO:tasks.workunit.client.0.smithi117.stdout:1/205: creat d1/d6/da/db/d1d/f3d x:0 0 0 2024-04-12T09:11:03.562 INFO:tasks.workunit.client.0.smithi117.stdout:9/249: truncate d1/d8/df/d39/d3b/f4a 3816981 0 2024-04-12T09:11:03.564 INFO:tasks.workunit.client.0.smithi117.stdout:9/250: chown d1/d8/df/d3e/f32 2 1 2024-04-12T09:11:03.567 INFO:tasks.workunit.client.0.smithi117.stdout:3/319: getdents de/d2c/d59/d70/d40 0 2024-04-12T09:11:03.568 INFO:tasks.workunit.client.0.smithi117.stdout:3/320: write de/d2c/f45 [1454018,48141] 0 2024-04-12T09:11:03.569 INFO:tasks.workunit.client.0.smithi117.stdout:3/321: dread - de/d2c/d59/d30/f60 zero size 2024-04-12T09:11:03.570 INFO:tasks.workunit.client.0.smithi117.stdout:1/206: mkdir d1/d6/da/db/d1d/d24/d38/d3e 0 2024-04-12T09:11:03.573 INFO:tasks.workunit.client.0.smithi117.stdout:1/207: truncate d1/f2c 1020723 0 2024-04-12T09:11:03.574 INFO:tasks.workunit.client.0.smithi117.stdout:3/322: symlink de/d2c/d59/d19/d27/l74 0 2024-04-12T09:11:03.575 INFO:tasks.workunit.client.0.smithi117.stdout:1/208: write d1/d6/da/f35 [60500,126245] 0 2024-04-12T09:11:03.576 INFO:tasks.workunit.client.0.smithi117.stdout:3/323: write de/d2c/d59/d70/d3e/d3f/f58 [1985502,104800] 0 2024-04-12T09:11:03.577 INFO:tasks.workunit.client.0.smithi117.stdout:0/303: truncate d3/dc/f13 3565070 0 2024-04-12T09:11:03.578 INFO:tasks.workunit.client.0.smithi117.stdout:1/209: truncate d1/d6/da/db/d1d/d24/f2e 289800 0 2024-04-12T09:11:03.579 INFO:tasks.workunit.client.0.smithi117.stdout:0/304: read d3/f39 [1853825,33889] 0 2024-04-12T09:11:03.583 INFO:tasks.workunit.client.0.smithi117.stdout:3/324: dwrite de/d2c/d59/d70/d3e/f41 [0,4194304] 0 2024-04-12T09:11:03.586 INFO:tasks.workunit.client.0.smithi117.stdout:1/210: rename d1/d6/da to d1/d6/d3f 0 2024-04-12T09:11:03.590 INFO:tasks.workunit.client.0.smithi117.stdout:0/305: rename d3/d30/d32/f3c to d3/d22/d55/d5a/d62/f65 0 2024-04-12T09:11:03.594 INFO:tasks.workunit.client.0.smithi117.stdout:3/325: rename de/d2c/d59/d19/c3b to de/d2c/d59/d70/d3e/d3f/d73/c75 0 2024-04-12T09:11:03.598 INFO:tasks.workunit.client.0.smithi117.stdout:0/306: rename d3/d22/d55/d5a/d62/d64 to d3/d22/d55/d5a/d62/d66 0 2024-04-12T09:11:03.599 INFO:tasks.workunit.client.0.smithi117.stdout:0/307: read - d3/dc/f3b zero size 2024-04-12T09:11:03.603 INFO:tasks.workunit.client.0.smithi117.stdout:1/211: link d1/d6/d3f/f35 d1/f40 0 2024-04-12T09:11:03.614 INFO:tasks.workunit.client.0.smithi117.stdout:5/145: sync 2024-04-12T09:11:03.646 INFO:tasks.workunit.client.0.smithi117.stdout:0/308: dread d3/d36/f42 [0,4194304] 0 2024-04-12T09:11:03.649 INFO:tasks.workunit.client.0.smithi117.stdout:1/212: fdatasync d1/d6/d3f/db/d1d/f3d 0 2024-04-12T09:11:03.650 INFO:tasks.workunit.client.0.smithi117.stdout:5/146: mkdir d2/d3/de/d1e/d2c 0 2024-04-12T09:11:03.650 INFO:tasks.workunit.client.0.smithi117.stdout:1/213: write d1/d6/d3f/db/d1d/d24/f2e [960125,102085] 0 2024-04-12T09:11:03.651 INFO:tasks.workunit.client.0.smithi117.stdout:1/214: truncate d1/d6/f34 1788872 0 2024-04-12T09:11:03.652 INFO:tasks.workunit.client.0.smithi117.stdout:1/215: chown d1/d6/f34 6 1 2024-04-12T09:11:03.653 INFO:tasks.workunit.client.0.smithi117.stdout:1/216: rename d1/d3b to d1/d3b/d41 22 2024-04-12T09:11:03.653 INFO:tasks.workunit.client.0.smithi117.stdout:3/326: write de/d2c/d59/d19/f52 [796604,22108] 0 2024-04-12T09:11:03.654 INFO:tasks.workunit.client.0.smithi117.stdout:1/217: chown d1/d6/d3f/db 1 1 2024-04-12T09:11:03.654 INFO:tasks.workunit.client.0.smithi117.stdout:3/327: chown de/d2c/d59/f23 7 1 2024-04-12T09:11:03.658 INFO:tasks.workunit.client.0.smithi117.stdout:5/147: unlink d2/d3/de/f2b 0 2024-04-12T09:11:03.659 INFO:tasks.workunit.client.0.smithi117.stdout:5/148: chown d2/d3/de/d1e/d2c 366292 1 2024-04-12T09:11:03.660 INFO:tasks.workunit.client.0.smithi117.stdout:5/149: chown d2/d3 13755330 1 2024-04-12T09:11:03.660 INFO:tasks.workunit.client.0.smithi117.stdout:1/218: dwrite d1/d6/f1a [4194304,4194304] 0 2024-04-12T09:11:03.662 INFO:tasks.workunit.client.0.smithi117.stdout:1/219: write d1/d6/f34 [524689,39975] 0 2024-04-12T09:11:03.663 INFO:tasks.workunit.client.0.smithi117.stdout:3/328: creat de/d2c/d59/d19/d27/f76 x:0 0 0 2024-04-12T09:11:03.666 INFO:tasks.workunit.client.0.smithi117.stdout:5/150: creat d2/d3/de/d1e/f2d x:0 0 0 2024-04-12T09:11:03.666 INFO:tasks.workunit.client.0.smithi117.stdout:1/220: dread d1/d6/f1a [0,4194304] 0 2024-04-12T09:11:03.671 INFO:tasks.workunit.client.0.smithi117.stdout:3/329: rmdir de/d2c/d59/d70/d3e/d5d 39 2024-04-12T09:11:03.672 INFO:tasks.workunit.client.0.smithi117.stdout:3/330: fsync de/d2c/d59/d30/f60 0 2024-04-12T09:11:03.676 INFO:tasks.workunit.client.0.smithi117.stdout:1/221: stat d1/f2c 0 2024-04-12T09:11:03.680 INFO:tasks.workunit.client.0.smithi117.stdout:5/151: mkdir d2/d3/d2e 0 2024-04-12T09:11:03.681 INFO:tasks.workunit.client.0.smithi117.stdout:1/222: mknod d1/d6/d3f/db/d16/c42 0 2024-04-12T09:11:03.684 INFO:tasks.workunit.client.0.smithi117.stdout:5/152: rename d2/d3/dd/l1a to d2/d3/de/d1e/l2f 0 2024-04-12T09:11:03.686 INFO:tasks.workunit.client.0.smithi117.stdout:1/223: rmdir d1/d6/d3f/db/d1d/d24/d38 39 2024-04-12T09:11:03.690 INFO:tasks.workunit.client.0.smithi117.stdout:3/331: getdents de/d2c 0 2024-04-12T09:11:03.694 INFO:tasks.workunit.client.0.smithi117.stdout:3/332: creat de/d2c/d59/d19/d54/f77 x:0 0 0 2024-04-12T09:11:03.710 INFO:tasks.workunit.client.0.smithi117.stdout:1/224: dread d1/f13 [0,4194304] 0 2024-04-12T09:11:03.712 INFO:tasks.workunit.client.0.smithi117.stdout:1/225: truncate d1/d6/d3f/db/f39 204738 0 2024-04-12T09:11:03.714 INFO:tasks.workunit.client.0.smithi117.stdout:1/226: unlink d1/d6/d3f/db/d16/c2a 0 2024-04-12T09:11:03.715 INFO:tasks.workunit.client.0.smithi117.stdout:1/227: fsync d1/d6/d3f/db/d16/f19 0 2024-04-12T09:11:03.721 INFO:tasks.workunit.client.0.smithi117.stdout:1/228: dwrite f0 [4194304,4194304] 0 2024-04-12T09:11:03.721 INFO:tasks.workunit.client.0.smithi117.stdout:1/229: chown d1/f2c 223 1 2024-04-12T09:11:03.727 INFO:tasks.workunit.client.0.smithi117.stdout:1/230: rename d1/d6/d3f/db/d1d/f3d to d1/d6/d3f/db/d1d/d24/d38/f43 0 2024-04-12T09:11:03.728 INFO:tasks.workunit.client.0.smithi117.stdout:1/231: fdatasync d1/d6/d3f/db/f31 0 2024-04-12T09:11:03.728 INFO:tasks.workunit.client.0.smithi117.stdout:1/232: fsync d1/d6/f34 0 2024-04-12T09:11:03.732 INFO:tasks.workunit.client.0.smithi117.stdout:1/233: creat d1/d6/d3f/db/d1d/d24/f44 x:0 0 0 2024-04-12T09:11:03.736 INFO:tasks.workunit.client.0.smithi117.stdout:5/153: dwrite d2/d3/f1b [0,4194304] 0 2024-04-12T09:11:03.740 INFO:tasks.workunit.client.0.smithi117.stdout:3/333: link de/d2c/d59/d19/d27/l35 de/l78 0 2024-04-12T09:11:03.741 INFO:tasks.workunit.client.0.smithi117.stdout:5/154: creat d2/d3/d2e/f30 x:0 0 0 2024-04-12T09:11:03.743 INFO:tasks.workunit.client.0.smithi117.stdout:3/334: mkdir de/d2c/d59/d70/d40/d79 0 2024-04-12T09:11:03.743 INFO:tasks.workunit.client.0.smithi117.stdout:5/155: write d2/d3/de/d1e/f20 [1038277,118714] 0 2024-04-12T09:11:03.748 INFO:tasks.workunit.client.0.smithi117.stdout:0/309: symlink d3/l67 0 2024-04-12T09:11:03.749 INFO:tasks.workunit.client.0.smithi117.stdout:0/310: dread - d3/d30/f3d zero size 2024-04-12T09:11:03.750 INFO:tasks.workunit.client.0.smithi117.stdout:3/335: unlink de/d2c/d59/d30/l66 0 2024-04-12T09:11:03.750 INFO:tasks.workunit.client.0.smithi117.stdout:5/156: dwrite d2/d3/dd/f17 [0,4194304] 0 2024-04-12T09:11:03.756 INFO:tasks.workunit.client.0.smithi117.stdout:5/157: read d2/d3/f15 [115674,124559] 0 2024-04-12T09:11:03.758 INFO:tasks.workunit.client.0.smithi117.stdout:0/311: dwrite d3/d30/f61 [0,4194304] 0 2024-04-12T09:11:03.759 INFO:tasks.workunit.client.0.smithi117.stdout:0/312: write d3/d30/f61 [695454,68885] 0 2024-04-12T09:11:03.760 INFO:tasks.workunit.client.0.smithi117.stdout:3/336: mknod de/d2c/d59/c7a 0 2024-04-12T09:11:03.762 INFO:tasks.workunit.client.0.smithi117.stdout:1/234: rmdir d1/d6/d3f/db/d1d/d24 39 2024-04-12T09:11:03.768 INFO:tasks.workunit.client.0.smithi117.stdout:3/337: truncate de/f15 244565 0 2024-04-12T09:11:03.769 INFO:tasks.workunit.client.0.smithi117.stdout:0/313: creat d3/d22/d55/d5a/d62/d66/f68 x:0 0 0 2024-04-12T09:11:03.773 INFO:tasks.workunit.client.0.smithi117.stdout:3/338: creat de/d2c/d59/d4c/f7b x:0 0 0 2024-04-12T09:11:03.775 INFO:tasks.workunit.client.0.smithi117.stdout:1/235: mkdir d1/d6/d3f/db/d1d/d24/d38/d45 0 2024-04-12T09:11:03.776 INFO:tasks.workunit.client.0.smithi117.stdout:5/158: link d2/d3/dd/c13 d2/d3/c31 0 2024-04-12T09:11:03.778 INFO:tasks.workunit.client.0.smithi117.stdout:1/236: mknod d1/d6/d3f/db/d1d/d24/d38/c46 0 2024-04-12T09:11:03.779 INFO:tasks.workunit.client.0.smithi117.stdout:1/237: dread - d1/d6/d3f/db/f37 zero size 2024-04-12T09:11:03.779 INFO:tasks.workunit.client.0.smithi117.stdout:5/159: symlink d2/d3/d2e/l32 0 2024-04-12T09:11:03.781 INFO:tasks.workunit.client.0.smithi117.stdout:3/339: fsync de/d2c/d59/f1b 0 2024-04-12T09:11:03.786 INFO:tasks.workunit.client.0.smithi117.stdout:5/160: dread d2/d3/de/f2a [0,4194304] 0 2024-04-12T09:11:03.786 INFO:tasks.workunit.client.0.smithi117.stdout:1/238: dwrite d1/d6/d3f/f29 [0,4194304] 0 2024-04-12T09:11:03.787 INFO:tasks.workunit.client.0.smithi117.stdout:5/161: chown d2/d3/de/d1e 1497353 1 2024-04-12T09:11:03.794 INFO:tasks.workunit.client.0.smithi117.stdout:3/340: fdatasync de/d2c/d59/d70/d3e/f50 0 2024-04-12T09:11:03.796 INFO:tasks.workunit.client.0.smithi117.stdout:5/162: mknod d2/d3/de/d1e/d2c/c33 0 2024-04-12T09:11:03.801 INFO:tasks.workunit.client.0.smithi117.stdout:5/163: truncate d2/d3/f1b 4274533 0 2024-04-12T09:11:03.803 INFO:tasks.workunit.client.0.smithi117.stdout:3/341: dwrite de/f14 [0,4194304] 0 2024-04-12T09:11:03.803 INFO:tasks.workunit.client.0.smithi117.stdout:5/164: write d2/d3/d2e/f30 [402691,30832] 0 2024-04-12T09:11:03.804 INFO:tasks.workunit.client.0.smithi117.stdout:0/314: dwrite d3/f39 [0,4194304] 0 2024-04-12T09:11:03.805 INFO:tasks.workunit.client.0.smithi117.stdout:5/165: chown d2/d3/l29 41 1 2024-04-12T09:11:03.813 INFO:tasks.workunit.client.0.smithi117.stdout:0/315: creat d3/dc/f69 x:0 0 0 2024-04-12T09:11:03.816 INFO:tasks.workunit.client.0.smithi117.stdout:3/342: dwrite de/d2c/d59/d70/d40/d49/f55 [0,4194304] 0 2024-04-12T09:11:03.818 INFO:tasks.workunit.client.0.smithi117.stdout:1/239: dwrite d1/f40 [0,4194304] 0 2024-04-12T09:11:03.821 INFO:tasks.workunit.client.0.smithi117.stdout:1/240: write d1/d6/d3f/db/d1d/d24/f2e [125219,80198] 0 2024-04-12T09:11:03.823 INFO:tasks.workunit.client.0.smithi117.stdout:0/316: mkdir d3/d59/d6a 0 2024-04-12T09:11:03.825 INFO:tasks.workunit.client.0.smithi117.stdout:1/241: chown d1/f21 129 1 2024-04-12T09:11:03.826 INFO:tasks.workunit.client.0.smithi117.stdout:1/242: write d1/d6/d3f/f20 [1061099,91841] 0 2024-04-12T09:11:03.826 INFO:tasks.workunit.client.0.smithi117.stdout:0/317: creat d3/f6b x:0 0 0 2024-04-12T09:11:03.827 INFO:tasks.workunit.client.0.smithi117.stdout:0/318: chown d3/dc/f51 1 1 2024-04-12T09:11:03.828 INFO:tasks.workunit.client.0.smithi117.stdout:3/343: creat de/d2c/d59/f7c x:0 0 0 2024-04-12T09:11:03.834 INFO:tasks.workunit.client.0.smithi117.stdout:1/243: creat d1/d6/d3f/db/d16/f47 x:0 0 0 2024-04-12T09:11:03.834 INFO:tasks.workunit.client.0.smithi117.stdout:1/244: write d1/d6/d3f/db/f31 [779793,89534] 0 2024-04-12T09:11:03.835 INFO:tasks.workunit.client.0.smithi117.stdout:1/245: read d1/f2c [141102,91547] 0 2024-04-12T09:11:03.835 INFO:tasks.workunit.client.0.smithi117.stdout:0/319: rename d3/d47/f53 to d3/d36/f6c 0 2024-04-12T09:11:03.836 INFO:tasks.workunit.client.0.smithi117.stdout:0/320: chown d3/d30/f61 12938 1 2024-04-12T09:11:03.837 INFO:tasks.workunit.client.0.smithi117.stdout:3/344: creat de/f7d x:0 0 0 2024-04-12T09:11:03.838 INFO:tasks.workunit.client.0.smithi117.stdout:3/345: readlink de/d2c/d59/d19/d54/l69 0 2024-04-12T09:11:03.841 INFO:tasks.workunit.client.0.smithi117.stdout:1/246: mknod d1/d6/d3f/c48 0 2024-04-12T09:11:03.841 INFO:tasks.workunit.client.0.smithi117.stdout:5/166: truncate d2/d3/f1b 1807749 0 2024-04-12T09:11:03.842 INFO:tasks.workunit.client.0.smithi117.stdout:1/247: write d1/d6/d3f/db/f39 [331768,66740] 0 2024-04-12T09:11:03.844 INFO:tasks.workunit.client.0.smithi117.stdout:0/321: creat d3/d59/f6d x:0 0 0 2024-04-12T09:11:03.845 INFO:tasks.workunit.client.0.smithi117.stdout:3/346: readlink de/l78 0 2024-04-12T09:11:03.845 INFO:tasks.workunit.client.0.smithi117.stdout:0/322: dread - d3/d30/f3d zero size 2024-04-12T09:11:03.846 INFO:tasks.workunit.client.0.smithi117.stdout:0/323: chown d3/d22/d55/d5a/d62 10180 1 2024-04-12T09:11:03.848 INFO:tasks.workunit.client.0.smithi117.stdout:0/324: fdatasync d3/d59/f5c 0 2024-04-12T09:11:03.849 INFO:tasks.workunit.client.0.smithi117.stdout:3/347: truncate de/d2c/d59/d70/d3e/d5d/f64 4589598 0 2024-04-12T09:11:03.851 INFO:tasks.workunit.client.0.smithi117.stdout:5/167: creat d2/f34 x:0 0 0 2024-04-12T09:11:03.852 INFO:tasks.workunit.client.0.smithi117.stdout:0/325: symlink d3/d22/d55/d5a/d62/d66/l6e 0 2024-04-12T09:11:03.853 INFO:tasks.workunit.client.0.smithi117.stdout:5/168: write d2/d3/dd/f12 [5178349,52443] 0 2024-04-12T09:11:03.854 INFO:tasks.workunit.client.0.smithi117.stdout:5/169: fdatasync d2/d3/de/d1e/f2d 0 2024-04-12T09:11:03.855 INFO:tasks.workunit.client.0.smithi117.stdout:1/248: creat d1/f49 x:0 0 0 2024-04-12T09:11:03.857 INFO:tasks.workunit.client.0.smithi117.stdout:1/249: write d1/d6/d3f/f29 [826234,76394] 0 2024-04-12T09:11:03.859 INFO:tasks.workunit.client.0.smithi117.stdout:0/326: rename d3/f39 to d3/d59/d6a/f6f 0 2024-04-12T09:11:03.860 INFO:tasks.workunit.client.0.smithi117.stdout:5/170: dwrite d2/d3/dd/f17 [0,4194304] 0 2024-04-12T09:11:03.860 INFO:tasks.workunit.client.0.smithi117.stdout:5/171: dread - d2/f34 zero size 2024-04-12T09:11:03.869 INFO:tasks.workunit.client.0.smithi117.stdout:0/327: creat d3/d22/d55/d5a/d62/f70 x:0 0 0 2024-04-12T09:11:03.886 INFO:tasks.workunit.client.0.smithi117.stdout:7/183: sync 2024-04-12T09:11:03.886 INFO:tasks.workunit.client.0.smithi117.stdout:8/197: sync 2024-04-12T09:11:03.887 INFO:tasks.workunit.client.0.smithi117.stdout:2/179: sync 2024-04-12T09:11:03.899 INFO:tasks.workunit.client.0.smithi117.stdout:0/328: symlink d3/d59/l71 0 2024-04-12T09:11:03.903 INFO:tasks.workunit.client.0.smithi117.stdout:3/348: write de/d2c/f71 [2037176,35769] 0 2024-04-12T09:11:03.904 INFO:tasks.workunit.client.0.smithi117.stdout:5/172: truncate d2/f19 1487177 0 2024-04-12T09:11:03.905 INFO:tasks.workunit.client.0.smithi117.stdout:1/250: link d1/f10 d1/d3b/f4a 0 2024-04-12T09:11:03.906 INFO:tasks.workunit.client.0.smithi117.stdout:7/184: creat d0/d2/d1a/f38 x:0 0 0 2024-04-12T09:11:03.906 INFO:tasks.workunit.client.0.smithi117.stdout:8/198: truncate db/d19/d1a/f21 4570398 0 2024-04-12T09:11:03.907 INFO:tasks.workunit.client.0.smithi117.stdout:0/329: mknod d3/d36/c72 0 2024-04-12T09:11:03.910 INFO:tasks.workunit.client.0.smithi117.stdout:2/180: dread d0/d4/d10/f32 [0,4194304] 0 2024-04-12T09:11:03.910 INFO:tasks.workunit.client.0.smithi117.stdout:0/330: write d3/d22/d55/d5a/f5d [553275,91294] 0 2024-04-12T09:11:03.913 INFO:tasks.workunit.client.0.smithi117.stdout:5/173: dread d2/f6 [0,4194304] 0 2024-04-12T09:11:03.915 INFO:tasks.workunit.client.0.smithi117.stdout:8/199: creat db/d13/f43 x:0 0 0 2024-04-12T09:11:03.916 INFO:tasks.workunit.client.0.smithi117.stdout:5/174: dread - d2/f21 zero size 2024-04-12T09:11:03.917 INFO:tasks.workunit.client.0.smithi117.stdout:5/175: dread - d2/f21 zero size 2024-04-12T09:11:03.918 INFO:tasks.workunit.client.0.smithi117.stdout:7/185: dwrite d0/d2/d22/f28 [4194304,4194304] 0 2024-04-12T09:11:03.921 INFO:tasks.workunit.client.0.smithi117.stdout:2/181: dwrite d0/df/f20 [0,4194304] 0 2024-04-12T09:11:03.922 INFO:tasks.workunit.client.0.smithi117.stdout:2/182: chown d0/df/d1a/c28 3566778 1 2024-04-12T09:11:03.923 INFO:tasks.workunit.client.0.smithi117.stdout:3/349: creat de/d2c/d59/d70/d3d/d63/f7e x:0 0 0 2024-04-12T09:11:03.926 INFO:tasks.workunit.client.0.smithi117.stdout:0/331: unlink d3/dc/l37 0 2024-04-12T09:11:03.931 INFO:tasks.workunit.client.0.smithi117.stdout:3/350: dwrite de/d2c/d59/d70/d3d/d63/f7e [0,4194304] 0 2024-04-12T09:11:03.934 INFO:tasks.workunit.client.0.smithi117.stdout:5/176: rename d2/d3/d1d to d2/d3/de/d1e/d35 0 2024-04-12T09:11:03.935 INFO:tasks.workunit.client.0.smithi117.stdout:5/177: write d2/d3/dd/f17 [2230743,36954] 0 2024-04-12T09:11:03.935 INFO:tasks.workunit.client.0.smithi117.stdout:2/183: creat d0/f3c x:0 0 0 2024-04-12T09:11:03.937 INFO:tasks.workunit.client.0.smithi117.stdout:5/178: truncate d2/d3/de/d1e/f2d 880112 0 2024-04-12T09:11:03.937 INFO:tasks.workunit.client.0.smithi117.stdout:2/184: write d0/f3c [264889,117612] 0 2024-04-12T09:11:03.939 INFO:tasks.workunit.client.0.smithi117.stdout:0/332: mkdir d3/d22/d55/d5a/d62/d66/d73 0 2024-04-12T09:11:03.946 INFO:tasks.workunit.client.0.smithi117.stdout:1/251: creat d1/d6/d3f/db/d1d/d24/f4b x:0 0 0 2024-04-12T09:11:03.947 INFO:tasks.workunit.client.0.smithi117.stdout:1/252: read d1/d6/d3f/f35 [3486024,2270] 0 2024-04-12T09:11:03.948 INFO:tasks.workunit.client.0.smithi117.stdout:1/253: truncate d1/f49 962049 0 2024-04-12T09:11:03.951 INFO:tasks.workunit.client.0.smithi117.stdout:2/185: stat d0/df/l11 0 2024-04-12T09:11:03.954 INFO:tasks.workunit.client.0.smithi117.stdout:0/333: symlink d3/d59/d6a/l74 0 2024-04-12T09:11:03.957 INFO:tasks.workunit.client.0.smithi117.stdout:8/200: link db/d13/c3b db/c44 0 2024-04-12T09:11:03.959 INFO:tasks.workunit.client.0.smithi117.stdout:5/179: dread d2/d3/dd/f12 [0,4194304] 0 2024-04-12T09:11:03.963 INFO:tasks.workunit.client.0.smithi117.stdout:2/186: dread d0/d4/d10/d27/f39 [0,4194304] 0 2024-04-12T09:11:03.970 INFO:tasks.workunit.client.0.smithi117.stdout:8/201: creat db/d19/d1a/d3d/f45 x:0 0 0 2024-04-12T09:11:03.975 INFO:tasks.workunit.client.0.smithi117.stdout:3/351: creat de/d2c/d59/d19/f7f x:0 0 0 2024-04-12T09:11:03.976 INFO:tasks.workunit.client.0.smithi117.stdout:2/187: symlink d0/df/l3d 0 2024-04-12T09:11:03.978 INFO:tasks.workunit.client.0.smithi117.stdout:1/254: mkdir d1/d6/d3f/db/d1d/d24/d38/d45/d4c 0 2024-04-12T09:11:03.983 INFO:tasks.workunit.client.0.smithi117.stdout:5/180: write d2/f6 [364597,69810] 0 2024-04-12T09:11:03.984 INFO:tasks.workunit.client.0.smithi117.stdout:5/181: readlink d2/d3/la 0 2024-04-12T09:11:03.985 INFO:tasks.workunit.client.0.smithi117.stdout:3/352: unlink de/d2c/d59/f1a 0 2024-04-12T09:11:03.987 INFO:tasks.workunit.client.0.smithi117.stdout:2/188: write d0/d4/d10/d27/f39 [783982,26319] 0 2024-04-12T09:11:03.992 INFO:tasks.workunit.client.0.smithi117.stdout:2/189: dwrite d0/d4/fb [0,4194304] 0 2024-04-12T09:11:03.994 INFO:tasks.workunit.client.0.smithi117.stdout:2/190: read d0/df/d1a/f21 [2313579,54141] 0 2024-04-12T09:11:03.994 INFO:tasks.workunit.client.0.smithi117.stdout:0/334: truncate d3/f6 748672 0 2024-04-12T09:11:03.995 INFO:tasks.workunit.client.0.smithi117.stdout:0/335: chown d3/d22/f2d 150639 1 2024-04-12T09:11:04.002 INFO:tasks.workunit.client.0.smithi117.stdout:8/202: truncate db/fc 2165222 0 2024-04-12T09:11:04.005 INFO:tasks.workunit.client.0.smithi117.stdout:2/191: rmdir d0/df 39 2024-04-12T09:11:04.007 INFO:tasks.workunit.client.0.smithi117.stdout:0/336: creat d3/d59/d6a/f75 x:0 0 0 2024-04-12T09:11:04.010 INFO:tasks.workunit.client.0.smithi117.stdout:1/255: rename d1/d6/d3f/db/f37 to d1/f4d 0 2024-04-12T09:11:04.013 INFO:tasks.workunit.client.0.smithi117.stdout:8/203: rmdir db/d19 39 2024-04-12T09:11:04.015 INFO:tasks.workunit.client.0.smithi117.stdout:8/204: chown db/l3a 1759 1 2024-04-12T09:11:04.017 INFO:tasks.workunit.client.0.smithi117.stdout:5/182: dwrite d2/f19 [0,4194304] 0 2024-04-12T09:11:04.017 INFO:tasks.workunit.client.0.smithi117.stdout:1/256: dwrite d1/f49 [0,4194304] 0 2024-04-12T09:11:04.018 INFO:tasks.workunit.client.0.smithi117.stdout:5/183: fsync f1 0 2024-04-12T09:11:04.021 INFO:tasks.workunit.client.0.smithi117.stdout:1/257: chown d1/d6/d3f/db/d1d/d24/f44 275026526 1 2024-04-12T09:11:04.022 INFO:tasks.workunit.client.0.smithi117.stdout:0/337: mkdir d3/d22/d76 0 2024-04-12T09:11:04.024 INFO:tasks.workunit.client.0.smithi117.stdout:0/338: chown d3/d22/d55/d5a/d62/d66/d73 2 1 2024-04-12T09:11:04.027 INFO:tasks.workunit.client.0.smithi117.stdout:5/184: dread d2/d3/de/f2a [0,4194304] 0 2024-04-12T09:11:04.028 INFO:tasks.workunit.client.0.smithi117.stdout:2/192: dwrite d0/d4/d10/d27/f2e [0,4194304] 0 2024-04-12T09:11:04.029 INFO:tasks.workunit.client.0.smithi117.stdout:3/353: rename de/d2c/d59/d70/d3e/d3f/d73 to de/d2c/d59/d70/d3e/d5d/d80 0 2024-04-12T09:11:04.035 INFO:tasks.workunit.client.0.smithi117.stdout:5/185: dwrite d2/d3/de/d1e/f2d [0,4194304] 0 2024-04-12T09:11:04.049 INFO:tasks.workunit.client.0.smithi117.stdout:3/354: mknod de/d2c/d59/d70/d3e/d3f/c81 0 2024-04-12T09:11:04.050 INFO:tasks.workunit.client.0.smithi117.stdout:3/355: read - de/d2c/d59/d70/f61 zero size 2024-04-12T09:11:04.055 INFO:tasks.workunit.client.0.smithi117.stdout:8/205: write db/f3e [5016094,23602] 0 2024-04-12T09:11:04.061 INFO:tasks.workunit.client.0.smithi117.stdout:8/206: dread db/f2f [0,4194304] 0 2024-04-12T09:11:04.062 INFO:tasks.workunit.client.0.smithi117.stdout:2/193: fdatasync d0/df/d1a/f21 0 2024-04-12T09:11:04.064 INFO:tasks.workunit.client.0.smithi117.stdout:1/258: dwrite d1/d6/d3f/f35 [0,4194304] 0 2024-04-12T09:11:04.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:03 smithi203 ceph-mon[36428]: pgmap v12: 65 pgs: 65 active+clean; 442 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 1.3 MiB/s rd, 43 MiB/s wr, 361 op/s 2024-04-12T09:11:04.075 INFO:tasks.workunit.client.0.smithi117.stdout:0/339: truncate d3/d30/d32/f45 986300 0 2024-04-12T09:11:04.077 INFO:tasks.workunit.client.0.smithi117.stdout:5/186: creat d2/f36 x:0 0 0 2024-04-12T09:11:04.079 INFO:tasks.workunit.client.0.smithi117.stdout:8/207: mkdir db/d13/d38/d46 0 2024-04-12T09:11:04.080 INFO:tasks.workunit.client.0.smithi117.stdout:8/208: write db/d1b/fe [3279381,67668] 0 2024-04-12T09:11:04.081 INFO:tasks.workunit.client.0.smithi117.stdout:1/259: symlink d1/d3b/l4e 0 2024-04-12T09:11:04.083 INFO:tasks.workunit.client.0.smithi117.stdout:5/187: dwrite d2/f19 [0,4194304] 0 2024-04-12T09:11:04.083 INFO:tasks.workunit.client.0.smithi117.stdout:5/188: fsync f1 0 2024-04-12T09:11:04.090 INFO:tasks.workunit.client.0.smithi117.stdout:1/260: dwrite d1/d6/d3f/f35 [0,4194304] 0 2024-04-12T09:11:04.091 INFO:tasks.workunit.client.0.smithi117.stdout:1/261: truncate d1/f4d 562617 0 2024-04-12T09:11:04.092 INFO:tasks.workunit.client.0.smithi117.stdout:8/209: read db/d19/d1a/f26 [3532479,34390] 0 2024-04-12T09:11:04.094 INFO:tasks.workunit.client.0.smithi117.stdout:3/356: write f7 [236577,84483] 0 2024-04-12T09:11:04.095 INFO:tasks.workunit.client.0.smithi117.stdout:0/340: mkdir d3/d22/d55/d5a/d62/d66/d73/d77 0 2024-04-12T09:11:04.102 INFO:tasks.workunit.client.0.smithi117.stdout:1/262: mknod d1/d6/d3f/db/d1d/d24/d38/c4f 0 2024-04-12T09:11:04.105 INFO:tasks.workunit.client.0.smithi117.stdout:8/210: rename db/d1b/f29 to db/d19/d1a/d3d/f47 0 2024-04-12T09:11:04.107 INFO:tasks.workunit.client.0.smithi117.stdout:3/357: rmdir de/d2c/d59/d70/d3e/d3f 39 2024-04-12T09:11:04.109 INFO:tasks.workunit.client.0.smithi117.stdout:3/358: read de/d2c/d59/d70/d3d/d63/f7e [1661620,13682] 0 2024-04-12T09:11:04.111 INFO:tasks.workunit.client.0.smithi117.stdout:8/211: dwrite db/d13/f31 [0,4194304] 0 2024-04-12T09:11:04.113 INFO:tasks.workunit.client.0.smithi117.stdout:8/212: read - db/d13/f43 zero size 2024-04-12T09:11:04.113 INFO:tasks.workunit.client.0.smithi117.stdout:8/213: chown db/d13/d38 30 1 2024-04-12T09:11:04.116 INFO:tasks.workunit.client.0.smithi117.stdout:0/341: dread d3/dc/f1d [0,4194304] 0 2024-04-12T09:11:04.117 INFO:tasks.workunit.client.0.smithi117.stdout:1/263: creat d1/d6/d3f/db/d1d/d24/d38/d45/f50 x:0 0 0 2024-04-12T09:11:04.120 INFO:tasks.workunit.client.0.smithi117.stdout:8/214: dwrite db/d1b/f15 [0,4194304] 0 2024-04-12T09:11:04.126 INFO:tasks.workunit.client.0.smithi117.stdout:3/359: rmdir de/d2c/d59/d19/d54 39 2024-04-12T09:11:04.129 INFO:tasks.workunit.client.0.smithi117.stdout:3/360: read de/d2c/d59/d70/f32 [3338632,111706] 0 2024-04-12T09:11:04.130 INFO:tasks.workunit.client.0.smithi117.stdout:3/361: write de/d2c/d59/d19/d27/f3c [1027942,96412] 0 2024-04-12T09:11:04.131 INFO:tasks.workunit.client.0.smithi117.stdout:0/342: rename d3/dc/c50 to d3/d22/c78 0 2024-04-12T09:11:04.134 INFO:tasks.workunit.client.0.smithi117.stdout:1/264: mkdir d1/d6/d51 0 2024-04-12T09:11:04.136 INFO:tasks.workunit.client.0.smithi117.stdout:5/189: truncate d2/d3/dd/f17 2107816 0 2024-04-12T09:11:04.143 INFO:tasks.workunit.client.0.smithi117.stdout:0/343: chown d3/f6 27324 1 2024-04-12T09:11:04.145 INFO:tasks.workunit.client.0.smithi117.stdout:3/362: mkdir de/d2c/d59/d70/d3e/d5d/d80/d82 0 2024-04-12T09:11:04.155 INFO:tasks.workunit.client.0.smithi117.stdout:8/215: write db/d1b/f11 [1115369,17234] 0 2024-04-12T09:11:04.157 INFO:tasks.workunit.client.0.smithi117.stdout:3/363: mknod de/d2c/d59/d19/d54/c83 0 2024-04-12T09:11:04.160 INFO:tasks.workunit.client.0.smithi117.stdout:1/265: rename d1/d6/d3f/f29 to d1/d6/d3f/db/d1d/f52 0 2024-04-12T09:11:04.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:03 smithi117 ceph-mon[29277]: pgmap v12: 65 pgs: 65 active+clean; 442 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 1.3 MiB/s rd, 43 MiB/s wr, 361 op/s 2024-04-12T09:11:04.162 INFO:tasks.workunit.client.0.smithi117.stdout:3/364: truncate de/d2c/d59/d70/d3e/d3f/f43 540834 0 2024-04-12T09:11:04.167 INFO:tasks.workunit.client.0.smithi117.stdout:0/344: write d3/dc/f2e [1809149,115622] 0 2024-04-12T09:11:04.168 INFO:tasks.workunit.client.0.smithi117.stdout:5/190: rename d2/d3/f1b to d2/d3/d2e/f37 0 2024-04-12T09:11:04.169 INFO:tasks.workunit.client.0.smithi117.stdout:3/365: mkdir de/d2c/d59/d70/d3e/d84 0 2024-04-12T09:11:04.170 INFO:tasks.workunit.client.0.smithi117.stdout:3/366: fdatasync de/d2c/f71 0 2024-04-12T09:11:04.172 INFO:tasks.workunit.client.0.smithi117.stdout:5/191: mknod d2/d3/de/d1e/d35/c38 0 2024-04-12T09:11:04.175 INFO:tasks.workunit.client.0.smithi117.stdout:0/345: getdents d3/d22/d55/d5a/d62/d66/d73/d77 0 2024-04-12T09:11:04.176 INFO:tasks.workunit.client.0.smithi117.stdout:5/192: dread d2/d3/de/f2a [0,4194304] 0 2024-04-12T09:11:04.178 INFO:tasks.workunit.client.0.smithi117.stdout:3/367: link de/f14 de/d2c/d59/d70/f85 0 2024-04-12T09:11:04.179 INFO:tasks.workunit.client.0.smithi117.stdout:0/346: creat d3/d47/f79 x:0 0 0 2024-04-12T09:11:04.180 INFO:tasks.workunit.client.0.smithi117.stdout:5/193: mkdir d2/d3/dd/d39 0 2024-04-12T09:11:04.185 INFO:tasks.workunit.client.0.smithi117.stdout:5/194: dread d2/d3/de/d1e/f20 [0,4194304] 0 2024-04-12T09:11:04.185 INFO:tasks.workunit.client.0.smithi117.stdout:3/368: creat de/d2c/d59/d70/d3e/f86 x:0 0 0 2024-04-12T09:11:04.186 INFO:tasks.workunit.client.0.smithi117.stdout:5/195: truncate d2/f19 4366736 0 2024-04-12T09:11:04.187 INFO:tasks.workunit.client.0.smithi117.stdout:3/369: write de/d2c/d59/d70/d3e/d3f/f58 [656517,101057] 0 2024-04-12T09:11:04.189 INFO:tasks.workunit.client.0.smithi117.stdout:3/370: truncate de/d2c/d59/d70/d3e/d5d/f64 4960227 0 2024-04-12T09:11:04.190 INFO:tasks.workunit.client.0.smithi117.stdout:5/196: creat d2/d3/dd/f3a x:0 0 0 2024-04-12T09:11:04.193 INFO:tasks.workunit.client.0.smithi117.stdout:3/371: rename de/d2c/d59/d70/l5f to de/d2c/d59/d70/d40/d49/l87 0 2024-04-12T09:11:04.194 INFO:tasks.workunit.client.0.smithi117.stdout:5/197: creat d2/d3/de/d1e/d35/f3b x:0 0 0 2024-04-12T09:11:04.197 INFO:tasks.workunit.client.0.smithi117.stdout:3/372: creat de/d2c/d59/d70/d3e/d84/f88 x:0 0 0 2024-04-12T09:11:04.199 INFO:tasks.workunit.client.0.smithi117.stdout:5/198: truncate f1 1699470 0 2024-04-12T09:11:04.205 INFO:tasks.workunit.client.0.smithi117.stdout:3/373: rename de/d2c/d59/d19/d54 to de/d2c/d59/d70/d3e/d5d/d89 0 2024-04-12T09:11:04.210 INFO:tasks.workunit.client.0.smithi117.stdout:3/374: creat de/d2c/d59/d70/d40/d79/f8a x:0 0 0 2024-04-12T09:11:04.212 INFO:tasks.workunit.client.0.smithi117.stdout:5/199: getdents d2/d3 0 2024-04-12T09:11:04.213 INFO:tasks.workunit.client.0.smithi117.stdout:5/200: dread - d2/f21 zero size 2024-04-12T09:11:04.213 INFO:tasks.workunit.client.0.smithi117.stdout:5/201: dread - d2/d3/dd/f3a zero size 2024-04-12T09:11:04.214 INFO:tasks.workunit.client.0.smithi117.stdout:5/202: chown d2/f36 217071081 1 2024-04-12T09:11:04.218 INFO:tasks.workunit.client.0.smithi117.stdout:5/203: creat d2/d3/dd/f3c x:0 0 0 2024-04-12T09:11:04.222 INFO:tasks.workunit.client.0.smithi117.stdout:3/375: rename f7 to de/d2c/d59/d70/d3e/f8b 0 2024-04-12T09:11:04.226 INFO:tasks.workunit.client.0.smithi117.stdout:3/376: unlink de/d2c/d59/d19/d27/c39 0 2024-04-12T09:11:04.231 INFO:tasks.workunit.client.0.smithi117.stdout:5/204: creat d2/f3d x:0 0 0 2024-04-12T09:11:04.233 INFO:tasks.workunit.client.0.smithi117.stdout:3/377: dwrite de/d2c/d59/d70/d40/d49/f6e [0,4194304] 0 2024-04-12T09:11:04.239 INFO:tasks.workunit.client.0.smithi117.stdout:5/205: rename d2/d3/d2e/f37 to d2/d3/dd/d39/f3e 0 2024-04-12T09:11:04.242 INFO:tasks.workunit.client.0.smithi117.stdout:3/378: rename de/d2c/f71 to de/d2c/d59/d70/d3d/f8c 0 2024-04-12T09:11:04.251 INFO:tasks.workunit.client.0.smithi117.stdout:5/206: getdents d2/d3/de/d1e 0 2024-04-12T09:11:04.255 INFO:tasks.workunit.client.0.smithi117.stdout:5/207: readlink d2/l7 0 2024-04-12T09:11:04.256 INFO:tasks.workunit.client.0.smithi117.stdout:5/208: truncate d2/f36 169016 0 2024-04-12T09:11:04.261 INFO:tasks.workunit.client.0.smithi117.stdout:5/209: rename d2/d3/de/c24 to d2/d3/de/d1e/d35/c3f 0 2024-04-12T09:11:04.265 INFO:tasks.workunit.client.0.smithi117.stdout:5/210: truncate d2/d3/dd/f17 3131702 0 2024-04-12T09:11:04.267 INFO:tasks.workunit.client.0.smithi117.stdout:5/211: mknod d2/d3/de/d1e/d2c/c40 0 2024-04-12T09:11:04.268 INFO:tasks.workunit.client.0.smithi117.stdout:5/212: stat d2/d3/de/d1e/f2d 0 2024-04-12T09:11:04.281 INFO:tasks.workunit.client.0.smithi117.stdout:3/379: mkdir de/d2c/d59/d70/d3e/d5d/d89/d8d 0 2024-04-12T09:11:04.283 INFO:tasks.workunit.client.0.smithi117.stdout:3/380: write de/d2c/d59/d70/d3e/f8b [333901,20335] 0 2024-04-12T09:11:04.286 INFO:tasks.workunit.client.0.smithi117.stdout:3/381: rename de/d2c/d59/d30/f6b to de/f8e 0 2024-04-12T09:11:04.295 INFO:tasks.workunit.client.0.smithi117.stdout:5/213: dwrite d2/d3/dd/d39/f3e [0,4194304] 0 2024-04-12T09:11:04.367 INFO:tasks.workunit.client.0.smithi117.stdout:5/214: dread d2/d3/dd/f1f [0,4194304] 0 2024-04-12T09:11:04.372 INFO:tasks.workunit.client.0.smithi117.stdout:5/215: dwrite d2/f36 [0,4194304] 0 2024-04-12T09:11:04.378 INFO:tasks.workunit.client.0.smithi117.stdout:5/216: rename d2/d3/dd/c27 to d2/c41 0 2024-04-12T09:11:04.381 INFO:tasks.workunit.client.0.smithi117.stdout:5/217: mknod d2/d3/c42 0 2024-04-12T09:11:04.397 INFO:tasks.workunit.client.0.smithi117.stdout:5/218: link d2/d3/d2e/f30 d2/f43 0 2024-04-12T09:11:04.404 INFO:tasks.workunit.client.0.smithi117.stdout:5/219: dwrite d2/d3/f15 [0,4194304] 0 2024-04-12T09:11:04.408 INFO:tasks.workunit.client.0.smithi117.stdout:5/220: dread d2/f19 [0,4194304] 0 2024-04-12T09:11:04.410 INFO:tasks.workunit.client.0.smithi117.stdout:5/221: write d2/f28 [6099115,125181] 0 2024-04-12T09:11:04.415 INFO:tasks.workunit.client.0.smithi117.stdout:5/222: unlink d2/d3/la 0 2024-04-12T09:11:04.421 INFO:tasks.workunit.client.0.smithi117.stdout:5/223: link d2/d3/dd/f12 d2/d3/de/d1e/f44 0 2024-04-12T09:11:04.422 INFO:tasks.workunit.client.0.smithi117.stdout:5/224: chown d2/c11 1591 1 2024-04-12T09:11:04.424 INFO:tasks.workunit.client.0.smithi117.stdout:5/225: write d2/d3/f15 [3664827,29381] 0 2024-04-12T09:11:04.431 INFO:tasks.workunit.client.0.smithi117.stdout:5/226: dwrite d2/f19 [0,4194304] 0 2024-04-12T09:11:04.432 INFO:tasks.workunit.client.0.smithi117.stdout:5/227: read d2/d3/dd/f1f [690902,119138] 0 2024-04-12T09:11:04.433 INFO:tasks.workunit.client.0.smithi117.stdout:5/228: stat d2/f19 0 2024-04-12T09:11:04.434 INFO:tasks.workunit.client.0.smithi117.stdout:5/229: read d2/d3/dd/d39/f3e [1770008,116121] 0 2024-04-12T09:11:04.435 INFO:tasks.workunit.client.0.smithi117.stdout:5/230: chown d2/d3/c42 510 1 2024-04-12T09:11:04.439 INFO:tasks.workunit.client.0.smithi117.stdout:5/231: symlink d2/d3/de/l45 0 2024-04-12T09:11:04.441 INFO:tasks.workunit.client.0.smithi117.stdout:5/232: mkdir d2/d3/de/d1e/d46 0 2024-04-12T09:11:04.445 INFO:tasks.workunit.client.0.smithi117.stdout:5/233: creat d2/d3/de/f47 x:0 0 0 2024-04-12T09:11:04.448 INFO:tasks.workunit.client.0.smithi117.stdout:5/234: link d2/d3/dd/f3a d2/d3/de/d1e/d46/f48 0 2024-04-12T09:11:04.477 INFO:tasks.workunit.client.0.smithi117.stdout:6/256: sync 2024-04-12T09:11:04.479 INFO:tasks.workunit.client.0.smithi117.stdout:6/257: rmdir d8/d9/d17/d2d 39 2024-04-12T09:11:04.482 INFO:tasks.workunit.client.0.smithi117.stdout:6/258: getdents d8/d9/d17/d33 0 2024-04-12T09:11:04.483 INFO:tasks.workunit.client.0.smithi117.stdout:6/259: symlink d8/l58 0 2024-04-12T09:11:04.491 INFO:tasks.workunit.client.0.smithi117.stdout:6/260: rmdir d8/d9/d57 0 2024-04-12T09:11:04.492 INFO:tasks.workunit.client.0.smithi117.stdout:6/261: fsync d8/d9/d17/d33/f4a 0 2024-04-12T09:11:04.494 INFO:tasks.workunit.client.0.smithi117.stdout:6/262: fsync d8/f1e 0 2024-04-12T09:11:04.497 INFO:tasks.workunit.client.0.smithi117.stdout:6/263: unlink d8/d9/d17/c1d 0 2024-04-12T09:11:04.503 INFO:tasks.workunit.client.0.smithi117.stdout:6/264: link d8/l58 d8/d2a/l59 0 2024-04-12T09:11:04.505 INFO:tasks.workunit.client.0.smithi117.stdout:6/265: chown d8/l30 2134368585 1 2024-04-12T09:11:04.508 INFO:tasks.workunit.client.0.smithi117.stdout:6/266: creat d8/d9/d17/f5a x:0 0 0 2024-04-12T09:11:04.510 INFO:tasks.workunit.client.0.smithi117.stdout:6/267: link d8/d9/f19 d8/d9/d17/d33/f5b 0 2024-04-12T09:11:04.512 INFO:tasks.workunit.client.0.smithi117.stdout:6/268: chown d8/d9/d17/d2d/l42 40 1 2024-04-12T09:11:04.516 INFO:tasks.workunit.client.0.smithi117.stdout:6/269: link d8/d9/c35 d8/d9/c5c 0 2024-04-12T09:11:04.516 INFO:tasks.workunit.client.0.smithi117.stdout:6/270: chown f2 1 1 2024-04-12T09:11:04.517 INFO:tasks.workunit.client.0.smithi117.stdout:6/271: dread - d8/f1a zero size 2024-04-12T09:11:04.518 INFO:tasks.workunit.client.0.smithi117.stdout:6/272: fdatasync d8/ff 0 2024-04-12T09:11:04.524 INFO:tasks.workunit.client.0.smithi117.stdout:6/273: rmdir d8/d9/d17/d33/d48 0 2024-04-12T09:11:04.526 INFO:tasks.workunit.client.0.smithi117.stdout:6/274: symlink d8/d2a/l5d 0 2024-04-12T09:11:04.528 INFO:tasks.workunit.client.0.smithi117.stdout:6/275: symlink d8/d2a/l5e 0 2024-04-12T09:11:04.530 INFO:tasks.workunit.client.0.smithi117.stdout:6/276: mknod d8/d9/d17/d33/c5f 0 2024-04-12T09:11:04.531 INFO:tasks.workunit.client.0.smithi117.stdout:6/277: mkdir d8/d2a/d60 0 2024-04-12T09:11:04.533 INFO:tasks.workunit.client.0.smithi117.stdout:6/278: mkdir d8/d9/d61 0 2024-04-12T09:11:04.534 INFO:tasks.workunit.client.0.smithi117.stdout:6/279: chown d8/d9/d39/f4f 1310 1 2024-04-12T09:11:04.534 INFO:tasks.workunit.client.0.smithi117.stdout:6/280: write f2 [2458610,11646] 0 2024-04-12T09:11:04.538 INFO:tasks.workunit.client.0.smithi117.stdout:6/281: symlink d8/d3a/d49/l62 0 2024-04-12T09:11:04.538 INFO:tasks.workunit.client.0.smithi117.stdout:6/282: stat d8/d2a/l5e 0 2024-04-12T09:11:04.545 INFO:tasks.workunit.client.0.smithi117.stdout:6/283: dwrite d8/fc [0,4194304] 0 2024-04-12T09:11:04.546 INFO:tasks.workunit.client.0.smithi117.stdout:6/284: write d8/d9/fa [3324536,24517] 0 2024-04-12T09:11:04.550 INFO:tasks.workunit.client.0.smithi117.stdout:6/285: chown d8/d9/c5c 32220681 1 2024-04-12T09:11:04.556 INFO:tasks.workunit.client.0.smithi117.stdout:6/286: dwrite d8/d3a/d49/f4e [0,4194304] 0 2024-04-12T09:11:04.559 INFO:tasks.workunit.client.0.smithi117.stdout:6/287: stat d8/f21 0 2024-04-12T09:11:04.593 INFO:tasks.workunit.client.0.smithi117.stdout:9/251: sync 2024-04-12T09:11:04.593 INFO:tasks.workunit.client.0.smithi117.stdout:4/259: sync 2024-04-12T09:11:04.595 INFO:tasks.workunit.client.0.smithi117.stdout:4/260: creat d0/d5/f50 x:0 0 0 2024-04-12T09:11:04.599 INFO:tasks.workunit.client.0.smithi117.stdout:9/252: dwrite d1/d8/df/f13 [0,4194304] 0 2024-04-12T09:11:04.604 INFO:tasks.workunit.client.0.smithi117.stdout:4/261: dwrite d0/d5/d3b/f42 [0,4194304] 0 2024-04-12T09:11:04.606 INFO:tasks.workunit.client.0.smithi117.stdout:4/262: write d0/d5/d3b/f42 [1225555,14135] 0 2024-04-12T09:11:04.609 INFO:tasks.workunit.client.0.smithi117.stdout:9/253: dwrite d1/d8/df/d39/d3b/f4c [4194304,4194304] 0 2024-04-12T09:11:04.611 INFO:tasks.workunit.client.0.smithi117.stdout:6/288: write d8/d3a/f3b [2555222,123046] 0 2024-04-12T09:11:04.612 INFO:tasks.workunit.client.0.smithi117.stdout:4/263: mkdir d0/d5/d39/d4e/d51 0 2024-04-12T09:11:04.614 INFO:tasks.workunit.client.0.smithi117.stdout:4/264: write d0/d5/d39/f3e [702722,58109] 0 2024-04-12T09:11:04.617 INFO:tasks.workunit.client.0.smithi117.stdout:6/289: truncate f3 2482586 0 2024-04-12T09:11:04.622 INFO:tasks.workunit.client.0.smithi117.stdout:4/265: creat d0/d5/f52 x:0 0 0 2024-04-12T09:11:04.622 INFO:tasks.workunit.client.0.smithi117.stdout:4/266: read d0/f14 [113521,44285] 0 2024-04-12T09:11:04.629 INFO:tasks.workunit.client.0.smithi117.stdout:4/267: rename d0/d2c/d3c/f47 to d0/d5/d25/f53 0 2024-04-12T09:11:04.633 INFO:tasks.workunit.client.0.smithi117.stdout:3/382: sync 2024-04-12T09:11:04.633 INFO:tasks.workunit.client.0.smithi117.stdout:2/194: sync 2024-04-12T09:11:04.633 INFO:tasks.workunit.client.0.smithi117.stdout:0/347: sync 2024-04-12T09:11:04.633 INFO:tasks.workunit.client.0.smithi117.stdout:5/235: sync 2024-04-12T09:11:04.633 INFO:tasks.workunit.client.0.smithi117.stdout:7/186: sync 2024-04-12T09:11:04.634 INFO:tasks.workunit.client.0.smithi117.stdout:1/266: sync 2024-04-12T09:11:04.634 INFO:tasks.workunit.client.0.smithi117.stdout:8/216: sync 2024-04-12T09:11:04.634 INFO:tasks.workunit.client.0.smithi117.stdout:7/187: readlink d0/l9 0 2024-04-12T09:11:04.635 INFO:tasks.workunit.client.0.smithi117.stdout:1/267: stat d1/d3b/f4a 0 2024-04-12T09:11:04.638 INFO:tasks.workunit.client.0.smithi117.stdout:9/254: dread d1/d8/df/d26/f46 [0,4194304] 0 2024-04-12T09:11:04.640 INFO:tasks.workunit.client.0.smithi117.stdout:2/195: write d0/d4/d10/f32 [3038596,45837] 0 2024-04-12T09:11:04.641 INFO:tasks.workunit.client.0.smithi117.stdout:9/255: chown d1/d8/df/d3e/l31 0 1 2024-04-12T09:11:04.642 INFO:tasks.workunit.client.0.smithi117.stdout:7/188: dread d0/d2/d1a/f24 [0,4194304] 0 2024-04-12T09:11:04.643 INFO:tasks.workunit.client.0.smithi117.stdout:8/217: dread db/d13/f31 [0,4194304] 0 2024-04-12T09:11:04.645 INFO:tasks.workunit.client.0.smithi117.stdout:8/218: write db/d1b/fe [10158583,62259] 0 2024-04-12T09:11:04.650 INFO:tasks.workunit.client.0.smithi117.stdout:4/268: getdents d0/d1/d34 0 2024-04-12T09:11:04.654 INFO:tasks.workunit.client.0.smithi117.stdout:3/383: rename de/d2c/d59/d70/f32 to de/d2c/d59/d70/d3e/d5d/d89/d68/f8f 0 2024-04-12T09:11:04.654 INFO:tasks.workunit.client.0.smithi117.stdout:3/384: dread - de/f7d zero size 2024-04-12T09:11:04.655 INFO:tasks.workunit.client.0.smithi117.stdout:2/196: write d0/d4/d10/d2a/f2d [3581553,53289] 0 2024-04-12T09:11:04.656 INFO:tasks.workunit.client.0.smithi117.stdout:2/197: write d0/f36 [172519,79463] 0 2024-04-12T09:11:04.657 INFO:tasks.workunit.client.0.smithi117.stdout:2/198: chown d0/df/c31 128 1 2024-04-12T09:11:04.658 INFO:tasks.workunit.client.0.smithi117.stdout:2/199: write d0/df/f20 [2363670,79584] 0 2024-04-12T09:11:04.658 INFO:tasks.workunit.client.0.smithi117.stdout:7/189: mkdir d0/d2/d22/d17/d23/d39 0 2024-04-12T09:11:04.659 INFO:tasks.workunit.client.0.smithi117.stdout:5/236: write d2/d3/dd/f3a [121046,9641] 0 2024-04-12T09:11:04.660 INFO:tasks.workunit.client.0.smithi117.stdout:7/190: readlink d0/d2/le 0 2024-04-12T09:11:04.661 INFO:tasks.workunit.client.0.smithi117.stdout:5/237: read d2/d3/de/d1e/f2d [4189529,12080] 0 2024-04-12T09:11:04.664 INFO:tasks.workunit.client.0.smithi117.stdout:8/219: unlink db/d13/f43 0 2024-04-12T09:11:04.665 INFO:tasks.workunit.client.0.smithi117.stdout:0/348: write d3/dc/f13 [898514,35209] 0 2024-04-12T09:11:04.665 INFO:tasks.workunit.client.0.smithi117.stdout:8/220: fsync db/f30 0 2024-04-12T09:11:04.666 INFO:tasks.workunit.client.0.smithi117.stdout:6/290: dwrite d8/d2a/f2f [0,4194304] 0 2024-04-12T09:11:04.668 INFO:tasks.workunit.client.0.smithi117.stdout:1/268: truncate d1/f10 8303470 0 2024-04-12T09:11:04.671 INFO:tasks.workunit.client.0.smithi117.stdout:1/269: dread - d1/d6/d3f/db/d1d/d24/f44 zero size 2024-04-12T09:11:04.674 INFO:tasks.workunit.client.0.smithi117.stdout:6/291: dread d8/fc [0,4194304] 0 2024-04-12T09:11:04.677 INFO:tasks.workunit.client.0.smithi117.stdout:6/292: write d8/d9/fa [2407794,13858] 0 2024-04-12T09:11:04.679 INFO:tasks.workunit.client.0.smithi117.stdout:5/238: dread d2/d3/d2e/f30 [0,4194304] 0 2024-04-12T09:11:04.680 INFO:tasks.workunit.client.0.smithi117.stdout:6/293: write d8/d3a/f4b [395157,71205] 0 2024-04-12T09:11:04.680 INFO:tasks.workunit.client.0.smithi117.stdout:1/270: dwrite d1/d6/d3f/db/d1d/d24/f44 [0,4194304] 0 2024-04-12T09:11:04.684 INFO:tasks.workunit.client.0.smithi117.stdout:0/349: unlink d3/d22/c4c 0 2024-04-12T09:11:04.685 INFO:tasks.workunit.client.0.smithi117.stdout:8/221: creat db/d13/d38/f48 x:0 0 0 2024-04-12T09:11:04.686 INFO:tasks.workunit.client.0.smithi117.stdout:8/222: readlink db/d19/d1a/d3d/l37 0 2024-04-12T09:11:04.696 INFO:tasks.workunit.client.0.smithi117.stdout:3/385: mkdir de/d2c/d59/d90 0 2024-04-12T09:11:04.697 INFO:tasks.workunit.client.0.smithi117.stdout:3/386: read - de/d2c/d59/d19/f7f zero size 2024-04-12T09:11:04.708 INFO:tasks.workunit.client.0.smithi117.stdout:1/271: mknod d1/d6/d3f/db/d16/c53 0 2024-04-12T09:11:04.709 INFO:tasks.workunit.client.0.smithi117.stdout:4/269: truncate d0/d1/d34/f28 8015528 0 2024-04-12T09:11:04.711 INFO:tasks.workunit.client.0.smithi117.stdout:6/294: rename d8/d3a/d49/c55 to d8/d3a/c63 0 2024-04-12T09:11:04.713 INFO:tasks.workunit.client.0.smithi117.stdout:8/223: creat db/d19/d1a/d3d/d33/f49 x:0 0 0 2024-04-12T09:11:04.713 INFO:tasks.workunit.client.0.smithi117.stdout:2/200: link d0/d4/d10/c3a d0/d4/d10/d27/c3e 0 2024-04-12T09:11:04.715 INFO:tasks.workunit.client.0.smithi117.stdout:3/387: symlink de/d2c/d59/d70/d40/d49/l91 0 2024-04-12T09:11:04.716 INFO:tasks.workunit.client.0.smithi117.stdout:3/388: chown de/d2c/d59/d70/d3e/d3f/f51 560 1 2024-04-12T09:11:04.716 INFO:tasks.workunit.client.0.smithi117.stdout:3/389: readlink de/l6f 0 2024-04-12T09:11:04.723 INFO:tasks.workunit.client.0.smithi117.stdout:4/270: dread d0/f27 [0,4194304] 0 2024-04-12T09:11:04.724 INFO:tasks.workunit.client.0.smithi117.stdout:0/350: rename d3/d36 to d3/d30/d32/d7a 0 2024-04-12T09:11:04.724 INFO:tasks.workunit.client.0.smithi117.stdout:3/390: dwrite de/d2c/d59/d30/f56 [0,4194304] 0 2024-04-12T09:11:04.727 INFO:tasks.workunit.client.0.smithi117.stdout:6/295: dread d8/d9/f1f [0,4194304] 0 2024-04-12T09:11:04.729 INFO:tasks.workunit.client.0.smithi117.stdout:7/191: truncate d0/d2/d22/d17/f31 2116704 0 2024-04-12T09:11:04.730 INFO:tasks.workunit.client.0.smithi117.stdout:8/224: symlink db/d13/l4a 0 2024-04-12T09:11:04.733 INFO:tasks.workunit.client.0.smithi117.stdout:2/201: mknod d0/d26/d30/c3f 0 2024-04-12T09:11:04.733 INFO:tasks.workunit.client.0.smithi117.stdout:4/271: dread d0/d2c/f30 [0,4194304] 0 2024-04-12T09:11:04.735 INFO:tasks.workunit.client.0.smithi117.stdout:5/239: creat d2/f49 x:0 0 0 2024-04-12T09:11:04.741 INFO:tasks.workunit.client.0.smithi117.stdout:3/391: rmdir de/d2c/d59/d70/d3e/d3f 39 2024-04-12T09:11:04.743 INFO:tasks.workunit.client.0.smithi117.stdout:3/392: chown de/d2c/d59/d70/d3e/d5d/d89/c83 0 1 2024-04-12T09:11:04.745 INFO:tasks.workunit.client.0.smithi117.stdout:0/351: rename d3/d22/c5f to d3/d22/d55/d5a/d62/c7b 0 2024-04-12T09:11:04.748 INFO:tasks.workunit.client.0.smithi117.stdout:7/192: creat d0/d2/d22/d17/f3a x:0 0 0 2024-04-12T09:11:04.750 INFO:tasks.workunit.client.0.smithi117.stdout:0/352: dwrite d3/dc/f2c [0,4194304] 0 2024-04-12T09:11:04.753 INFO:tasks.workunit.client.0.smithi117.stdout:4/272: mknod d0/d5/d39/d4e/c54 0 2024-04-12T09:11:04.759 INFO:tasks.workunit.client.0.smithi117.stdout:0/353: dwrite d3/dc/f44 [0,4194304] 0 2024-04-12T09:11:04.760 INFO:tasks.workunit.client.0.smithi117.stdout:0/354: write d3/d59/f5c [1311192,99083] 0 2024-04-12T09:11:04.761 INFO:tasks.workunit.client.0.smithi117.stdout:3/393: creat de/d2c/d59/d70/d3e/d5d/d89/d68/f92 x:0 0 0 2024-04-12T09:11:04.767 INFO:tasks.workunit.client.0.smithi117.stdout:0/355: dwrite d3/f4d [0,4194304] 0 2024-04-12T09:11:04.769 INFO:tasks.workunit.client.0.smithi117.stdout:5/240: symlink d2/l4a 0 2024-04-12T09:11:04.775 INFO:tasks.workunit.client.0.smithi117.stdout:3/394: mknod de/d2c/d59/d70/d3d/c93 0 2024-04-12T09:11:04.775 INFO:tasks.workunit.client.0.smithi117.stdout:1/272: write d1/f10 [1552623,82010] 0 2024-04-12T09:11:04.776 INFO:tasks.workunit.client.0.smithi117.stdout:3/395: stat de/d2c/d59/d70/d3d/c93 0 2024-04-12T09:11:04.777 INFO:tasks.workunit.client.0.smithi117.stdout:2/202: link d0/df/l3d d0/d4/d10/l40 0 2024-04-12T09:11:04.779 INFO:tasks.workunit.client.0.smithi117.stdout:2/203: write d0/d4/d10/d27/f39 [674912,119854] 0 2024-04-12T09:11:04.779 INFO:tasks.workunit.client.0.smithi117.stdout:4/273: symlink d0/d5/d39/d4e/d51/l55 0 2024-04-12T09:11:04.779 INFO:tasks.workunit.client.0.smithi117.stdout:4/274: readlink d0/d5/d3b/la 0 2024-04-12T09:11:04.780 INFO:tasks.workunit.client.0.smithi117.stdout:4/275: fdatasync d0/d1/d34/d20/f40 0 2024-04-12T09:11:04.782 INFO:tasks.workunit.client.0.smithi117.stdout:6/296: rename d8/d9/fa to d8/f64 0 2024-04-12T09:11:04.823 INFO:tasks.workunit.client.0.smithi117.stdout:4/276: mkdir d0/d2c/d56 0 2024-04-12T09:11:04.823 INFO:tasks.workunit.client.0.smithi117.stdout:6/297: chown d8/d3f 267 1 2024-04-12T09:11:04.823 INFO:tasks.workunit.client.0.smithi117.stdout:5/241: link d2/d3/de/d1e/d35/f3b d2/d3/dd/f4b 0 2024-04-12T09:11:04.823 INFO:tasks.workunit.client.0.smithi117.stdout:3/396: mknod de/d2c/d59/d4c/c94 0 2024-04-12T09:11:04.823 INFO:tasks.workunit.client.0.smithi117.stdout:1/273: chown d1/d6/d3f/db/d1d/d24/c3c 59822 1 2024-04-12T09:11:04.824 INFO:tasks.workunit.client.0.smithi117.stdout:4/277: write d0/d2c/d3c/f45 [1007214,608] 0 2024-04-12T09:11:04.825 INFO:tasks.workunit.client.0.smithi117.stdout:1/274: read d1/d6/d3f/db/f31 [506136,121700] 0 2024-04-12T09:11:04.826 INFO:tasks.workunit.client.0.smithi117.stdout:2/204: rename d0/df/d1a to d0/d26/d30/d41 0 2024-04-12T09:11:04.828 INFO:tasks.workunit.client.0.smithi117.stdout:5/242: readlink d2/lb 0 2024-04-12T09:11:04.832 INFO:tasks.workunit.client.0.smithi117.stdout:3/397: dwrite de/d2c/d59/f5b [0,4194304] 0 2024-04-12T09:11:04.833 INFO:tasks.workunit.client.0.smithi117.stdout:1/275: dread d1/d3b/f4a [4194304,4194304] 0 2024-04-12T09:11:04.835 INFO:tasks.workunit.client.0.smithi117.stdout:2/205: mknod d0/d26/c42 0 2024-04-12T09:11:04.836 INFO:tasks.workunit.client.0.smithi117.stdout:2/206: write d0/f3c [161621,79033] 0 2024-04-12T09:11:04.837 INFO:tasks.workunit.client.0.smithi117.stdout:2/207: fdatasync d0/df/f1d 0 2024-04-12T09:11:04.838 INFO:tasks.workunit.client.0.smithi117.stdout:1/276: dread d1/f10 [4194304,4194304] 0 2024-04-12T09:11:04.855 INFO:tasks.workunit.client.0.smithi117.stdout:5/243: creat d2/d3/de/d1e/d46/f4c x:0 0 0 2024-04-12T09:11:04.855 INFO:tasks.workunit.client.0.smithi117.stdout:1/277: mkdir d1/d6/d3f/db/d1d/d24/d54 0 2024-04-12T09:11:04.857 INFO:tasks.workunit.client.0.smithi117.stdout:1/278: chown d1/d6/d3f/db/d1d/d24/f2e 2942 1 2024-04-12T09:11:04.858 INFO:tasks.workunit.client.0.smithi117.stdout:1/279: chown d1/d6/d3f/db 3809744 1 2024-04-12T09:11:04.858 INFO:tasks.workunit.client.0.smithi117.stdout:5/244: unlink d2/lb 0 2024-04-12T09:11:04.859 INFO:tasks.workunit.client.0.smithi117.stdout:5/245: readlink d2/l4a 0 2024-04-12T09:11:04.860 INFO:tasks.workunit.client.0.smithi117.stdout:4/278: dwrite d0/d1/d34/f28 [0,4194304] 0 2024-04-12T09:11:04.862 INFO:tasks.workunit.client.0.smithi117.stdout:3/398: getdents de/d2c/d59/d70/d3d 0 2024-04-12T09:11:04.864 INFO:tasks.workunit.client.0.smithi117.stdout:5/246: mkdir d2/d3/d2e/d4d 0 2024-04-12T09:11:04.864 INFO:tasks.workunit.client.0.smithi117.stdout:2/208: truncate d0/d26/f34 1808704 0 2024-04-12T09:11:04.867 INFO:tasks.workunit.client.0.smithi117.stdout:1/280: dwrite d1/d6/f34 [0,4194304] 0 2024-04-12T09:11:04.870 INFO:tasks.workunit.client.0.smithi117.stdout:4/279: dwrite d0/d5/d39/f3e [0,4194304] 0 2024-04-12T09:11:04.871 INFO:tasks.workunit.client.0.smithi117.stdout:4/280: stat d0/d5/d39/f23 0 2024-04-12T09:11:04.873 INFO:tasks.workunit.client.0.smithi117.stdout:1/281: fdatasync d1/d6/f14 0 2024-04-12T09:11:04.875 INFO:tasks.workunit.client.0.smithi117.stdout:1/282: write d1/d6/d3f/db/f39 [369794,27284] 0 2024-04-12T09:11:04.876 INFO:tasks.workunit.client.0.smithi117.stdout:4/281: creat d0/d1/d34/f57 x:0 0 0 2024-04-12T09:11:04.879 INFO:tasks.workunit.client.0.smithi117.stdout:5/247: rmdir d2/d3/d2e 39 2024-04-12T09:11:04.880 INFO:tasks.workunit.client.0.smithi117.stdout:5/248: write d2/f3d [413793,17451] 0 2024-04-12T09:11:04.883 INFO:tasks.workunit.client.0.smithi117.stdout:2/209: rename d0/d26 to d0/d43 0 2024-04-12T09:11:04.885 INFO:tasks.workunit.client.0.smithi117.stdout:1/283: dwrite d1/d6/d3f/db/d1d/d24/f2e [0,4194304] 0 2024-04-12T09:11:04.889 INFO:tasks.workunit.client.0.smithi117.stdout:5/249: dread d2/d3/d2e/f30 [0,4194304] 0 2024-04-12T09:11:04.889 INFO:tasks.workunit.client.0.smithi117.stdout:2/210: rename d0/df/c31 to d0/d43/d30/c44 0 2024-04-12T09:11:04.891 INFO:tasks.workunit.client.0.smithi117.stdout:4/282: truncate d0/d5/f8 346786 0 2024-04-12T09:11:04.895 INFO:tasks.workunit.client.0.smithi117.stdout:2/211: mknod d0/d4/c45 0 2024-04-12T09:11:04.899 INFO:tasks.workunit.client.0.smithi117.stdout:1/284: rename d1/f2c to d1/d6/d3f/db/d1d/d24/d38/d3e/f55 0 2024-04-12T09:11:04.904 INFO:tasks.workunit.client.0.smithi117.stdout:2/212: dwrite d0/df/f1d [0,4194304] 0 2024-04-12T09:11:04.904 INFO:tasks.workunit.client.0.smithi117.stdout:4/283: symlink d0/d5/d39/d4e/d51/l58 0 2024-04-12T09:11:04.908 INFO:tasks.workunit.client.0.smithi117.stdout:5/250: rename d2/f21 to d2/d3/dd/f4e 0 2024-04-12T09:11:04.910 INFO:tasks.workunit.client.0.smithi117.stdout:4/284: symlink d0/d2c/l59 0 2024-04-12T09:11:04.911 INFO:tasks.workunit.client.0.smithi117.stdout:1/285: creat d1/d6/d51/f56 x:0 0 0 2024-04-12T09:11:04.912 INFO:tasks.workunit.client.0.smithi117.stdout:5/251: creat d2/d3/de/d1e/d46/f4f x:0 0 0 2024-04-12T09:11:04.914 INFO:tasks.workunit.client.0.smithi117.stdout:2/213: link d0/d4/fb d0/df/f46 0 2024-04-12T09:11:04.919 INFO:tasks.workunit.client.0.smithi117.stdout:2/214: creat d0/d43/d30/f47 x:0 0 0 2024-04-12T09:11:04.921 INFO:tasks.workunit.client.0.smithi117.stdout:4/285: dwrite d0/d1/d34/f57 [0,4194304] 0 2024-04-12T09:11:04.925 INFO:tasks.workunit.client.0.smithi117.stdout:4/286: chown d0/d5/d25/f53 31777783 1 2024-04-12T09:11:04.927 INFO:tasks.workunit.client.0.smithi117.stdout:5/252: dwrite d2/f6 [0,4194304] 0 2024-04-12T09:11:04.928 INFO:tasks.workunit.client.0.smithi117.stdout:1/286: dwrite d1/f49 [0,4194304] 0 2024-04-12T09:11:04.931 INFO:tasks.workunit.client.0.smithi117.stdout:5/253: chown d2/d3/d2e/f30 317 1 2024-04-12T09:11:04.932 INFO:tasks.workunit.client.0.smithi117.stdout:1/287: write d1/f40 [4034950,4911] 0 2024-04-12T09:11:04.932 INFO:tasks.workunit.client.0.smithi117.stdout:5/254: stat d2/d3/dd/f1f 0 2024-04-12T09:11:04.938 INFO:tasks.workunit.client.0.smithi117.stdout:1/288: symlink d1/d6/d3f/db/d1d/d24/d38/d3e/l57 0 2024-04-12T09:11:04.944 INFO:tasks.workunit.client.0.smithi117.stdout:1/289: creat d1/d6/d3f/db/d1d/d24/d38/d3e/f58 x:0 0 0 2024-04-12T09:11:04.946 INFO:tasks.workunit.client.0.smithi117.stdout:1/290: read d1/d6/d3f/db/d1d/f52 [1203918,130023] 0 2024-04-12T09:11:04.947 INFO:tasks.workunit.client.0.smithi117.stdout:1/291: truncate d1/f21 384501 0 2024-04-12T09:11:04.948 INFO:tasks.workunit.client.0.smithi117.stdout:1/292: chown d1/d6/d3f/db/d1d/d24/d54 3065558 1 2024-04-12T09:11:04.948 INFO:tasks.workunit.client.0.smithi117.stdout:5/255: getdents d2/d3/d2e 0 2024-04-12T09:11:04.955 INFO:tasks.workunit.client.0.smithi117.stdout:5/256: dwrite d2/d3/dd/f3a [0,4194304] 0 2024-04-12T09:11:04.959 INFO:tasks.workunit.client.0.smithi117.stdout:4/287: dread d0/d2c/f31 [0,4194304] 0 2024-04-12T09:11:04.961 INFO:tasks.workunit.client.0.smithi117.stdout:5/257: creat d2/d3/de/d1e/d46/f50 x:0 0 0 2024-04-12T09:11:04.963 INFO:tasks.workunit.client.0.smithi117.stdout:1/293: getdents d1/d6/d3f/db/d1d/d24 0 2024-04-12T09:11:04.965 INFO:tasks.workunit.client.0.smithi117.stdout:2/215: truncate d0/d4/d10/d2a/f2d 1530541 0 2024-04-12T09:11:04.966 INFO:tasks.workunit.client.0.smithi117.stdout:5/258: dread d2/f36 [0,4194304] 0 2024-04-12T09:11:04.966 INFO:tasks.workunit.client.0.smithi117.stdout:4/288: rename d0/d2c/c46 to d0/d1/d34/d20/c5a 0 2024-04-12T09:11:04.971 INFO:tasks.workunit.client.0.smithi117.stdout:9/256: sync 2024-04-12T09:11:04.972 INFO:tasks.workunit.client.0.smithi117.stdout:4/289: dwrite d0/d5/d3b/f42 [0,4194304] 0 2024-04-12T09:11:04.975 INFO:tasks.workunit.client.0.smithi117.stdout:5/259: creat d2/d3/de/d1e/d46/f51 x:0 0 0 2024-04-12T09:11:04.979 INFO:tasks.workunit.client.0.smithi117.stdout:9/257: dwrite d1/d8/df/d3e/f2b [0,4194304] 0 2024-04-12T09:11:04.982 INFO:tasks.workunit.client.0.smithi117.stdout:1/294: creat d1/d6/d3f/db/d1d/d24/d38/d45/d4c/f59 x:0 0 0 2024-04-12T09:11:04.987 INFO:tasks.workunit.client.0.smithi117.stdout:9/258: dwrite d1/d8/d12/f20 [0,4194304] 0 2024-04-12T09:11:05.004 INFO:tasks.workunit.client.0.smithi117.stdout:4/290: dread d0/d1/f1b [0,4194304] 0 2024-04-12T09:11:05.011 INFO:tasks.workunit.client.0.smithi117.stdout:4/291: dwrite d0/d5/f52 [0,4194304] 0 2024-04-12T09:11:05.013 INFO:tasks.workunit.client.0.smithi117.stdout:2/216: write d0/d43/d30/d41/f21 [5017167,90410] 0 2024-04-12T09:11:05.016 INFO:tasks.workunit.client.0.smithi117.stdout:5/260: mkdir d2/d3/d2e/d4d/d52 0 2024-04-12T09:11:05.019 INFO:tasks.workunit.client.0.smithi117.stdout:4/292: chown d0/d5/d3b/d38/l41 78197 1 2024-04-12T09:11:05.023 INFO:tasks.workunit.client.0.smithi117.stdout:4/293: dread d0/d2c/f2f [0,4194304] 0 2024-04-12T09:11:05.023 INFO:tasks.workunit.client.0.smithi117.stdout:5/261: mknod d2/d3/de/d1e/c53 0 2024-04-12T09:11:05.024 INFO:tasks.workunit.client.0.smithi117.stdout:4/294: chown d0/d5/d25/l2a 12023 1 2024-04-12T09:11:05.025 INFO:tasks.workunit.client.0.smithi117.stdout:4/295: stat d0/d1 0 2024-04-12T09:11:05.030 INFO:tasks.workunit.client.0.smithi117.stdout:9/259: getdents d1/d8/df/d26/d41 0 2024-04-12T09:11:05.031 INFO:tasks.workunit.client.0.smithi117.stdout:5/262: dwrite d2/d3/de/d1e/d46/f48 [0,4194304] 0 2024-04-12T09:11:05.032 INFO:tasks.workunit.client.0.smithi117.stdout:4/296: creat d0/d1/d34/f5b x:0 0 0 2024-04-12T09:11:05.036 INFO:tasks.workunit.client.0.smithi117.stdout:9/260: unlink d1/d8/df/d26/l49 0 2024-04-12T09:11:05.037 INFO:tasks.workunit.client.0.smithi117.stdout:9/261: read d1/d8/df/f3a [391304,85193] 0 2024-04-12T09:11:05.038 INFO:tasks.workunit.client.0.smithi117.stdout:5/263: creat d2/d3/de/d1e/d46/f54 x:0 0 0 2024-04-12T09:11:05.040 INFO:tasks.workunit.client.0.smithi117.stdout:4/297: creat d0/d5/d3b/f5c x:0 0 0 2024-04-12T09:11:05.041 INFO:tasks.workunit.client.0.smithi117.stdout:4/298: fdatasync d0/d5/f3f 0 2024-04-12T09:11:05.042 INFO:tasks.workunit.client.0.smithi117.stdout:9/262: dread d1/d8/df/d3e/f2b [0,4194304] 0 2024-04-12T09:11:05.045 INFO:tasks.workunit.client.0.smithi117.stdout:9/263: read d1/d8/df/f3a [354929,20174] 0 2024-04-12T09:11:05.045 INFO:tasks.workunit.client.0.smithi117.stdout:5/264: rename d2/d3/de/c14 to d2/d3/de/d1e/d35/c55 0 2024-04-12T09:11:05.048 INFO:tasks.workunit.client.0.smithi117.stdout:1/295: write d1/d6/d3f/db/f31 [374516,75355] 0 2024-04-12T09:11:05.060 INFO:tasks.workunit.client.0.smithi117.stdout:5/265: creat d2/d3/de/f56 x:0 0 0 2024-04-12T09:11:05.061 INFO:tasks.workunit.client.0.smithi117.stdout:5/266: chown d2/d3/dd/f12 59 1 2024-04-12T09:11:05.063 INFO:tasks.workunit.client.0.smithi117.stdout:5/267: creat d2/d3/dd/d39/f57 x:0 0 0 2024-04-12T09:11:05.065 INFO:tasks.workunit.client.0.smithi117.stdout:5/268: write d2/d3/de/d1e/d46/f48 [4281840,46221] 0 2024-04-12T09:11:05.066 INFO:tasks.workunit.client.0.smithi117.stdout:5/269: dread d2/f43 [0,4194304] 0 2024-04-12T09:11:05.072 INFO:tasks.workunit.client.0.smithi117.stdout:5/270: dwrite d2/f3d [0,4194304] 0 2024-04-12T09:11:05.077 INFO:tasks.workunit.client.0.smithi117.stdout:5/271: mknod d2/d3/de/d1e/d35/c58 0 2024-04-12T09:11:05.077 INFO:tasks.workunit.client.0.smithi117.stdout:4/299: dwrite d0/d1/f48 [0,4194304] 0 2024-04-12T09:11:05.080 INFO:tasks.workunit.client.0.smithi117.stdout:4/300: truncate d0/d5/f50 669794 0 2024-04-12T09:11:05.080 INFO:tasks.workunit.client.0.smithi117.stdout:5/272: rmdir d2/d3/d2e 39 2024-04-12T09:11:05.084 INFO:tasks.workunit.client.0.smithi117.stdout:4/301: symlink d0/d5/d39/d4e/d51/l5d 0 2024-04-12T09:11:05.087 INFO:tasks.workunit.client.0.smithi117.stdout:5/273: write d2/d3/dd/f4e [32351,67699] 0 2024-04-12T09:11:05.093 INFO:tasks.workunit.client.0.smithi117.stdout:5/274: symlink d2/l59 0 2024-04-12T09:11:05.095 INFO:tasks.workunit.client.0.smithi117.stdout:4/302: creat d0/f5e x:0 0 0 2024-04-12T09:11:05.097 INFO:tasks.workunit.client.0.smithi117.stdout:5/275: truncate d2/d3/dd/f1f 4473932 0 2024-04-12T09:11:05.100 INFO:tasks.workunit.client.0.smithi117.stdout:4/303: rename d0/d2c/l3d to d0/d5/d3b/l5f 0 2024-04-12T09:11:05.104 INFO:tasks.workunit.client.0.smithi117.stdout:4/304: mknod d0/d5/c60 0 2024-04-12T09:11:05.106 INFO:tasks.workunit.client.0.smithi117.stdout:5/276: rmdir d2/d3/d2e/d4d 39 2024-04-12T09:11:05.108 INFO:tasks.workunit.client.0.smithi117.stdout:4/305: dread d0/d1/f1b [0,4194304] 0 2024-04-12T09:11:05.112 INFO:tasks.workunit.client.0.smithi117.stdout:4/306: symlink d0/d5/d25/l61 0 2024-04-12T09:11:05.112 INFO:tasks.workunit.client.0.smithi117.stdout:2/217: dwrite d0/d4/d10/d2a/f2d [0,4194304] 0 2024-04-12T09:11:05.118 INFO:tasks.workunit.client.0.smithi117.stdout:4/307: unlink d0/d1/c1d 0 2024-04-12T09:11:05.121 INFO:tasks.workunit.client.0.smithi117.stdout:2/218: symlink d0/d4/d10/d27/l48 0 2024-04-12T09:11:05.125 INFO:tasks.workunit.client.0.smithi117.stdout:2/219: mknod d0/d43/c49 0 2024-04-12T09:11:05.125 INFO:tasks.workunit.client.0.smithi117.stdout:4/308: dwrite d0/d1/d34/d20/f40 [4194304,4194304] 0 2024-04-12T09:11:05.127 INFO:tasks.workunit.client.0.smithi117.stdout:2/220: fdatasync d0/d43/d30/d41/f21 0 2024-04-12T09:11:05.128 INFO:tasks.workunit.client.0.smithi117.stdout:2/221: write d0/d4/d10/d2a/f2d [2293367,48696] 0 2024-04-12T09:11:05.138 INFO:tasks.workunit.client.0.smithi117.stdout:2/222: mknod d0/d4/d10/c4a 0 2024-04-12T09:11:05.140 INFO:tasks.workunit.client.0.smithi117.stdout:2/223: stat d0/d43/d30/d41/l29 0 2024-04-12T09:11:05.140 INFO:tasks.workunit.client.0.smithi117.stdout:4/309: mknod d0/d5/d3b/d38/d4f/c62 0 2024-04-12T09:11:05.141 INFO:tasks.workunit.client.0.smithi117.stdout:5/277: dwrite d2/d3/de/d1e/f44 [4194304,4194304] 0 2024-04-12T09:11:05.143 INFO:tasks.workunit.client.0.smithi117.stdout:2/224: mkdir d0/d43/d4b 0 2024-04-12T09:11:05.144 INFO:tasks.workunit.client.0.smithi117.stdout:2/225: write d0/f36 [319839,46323] 0 2024-04-12T09:11:05.146 INFO:tasks.workunit.client.0.smithi117.stdout:2/226: rename d0 to d0/d4/d10/d2a/d4c 22 2024-04-12T09:11:05.146 INFO:tasks.workunit.client.0.smithi117.stdout:4/310: creat d0/d5/f63 x:0 0 0 2024-04-12T09:11:05.147 INFO:tasks.workunit.client.0.smithi117.stdout:2/227: stat d0/d43/d30/d41/f21 0 2024-04-12T09:11:05.147 INFO:tasks.workunit.client.0.smithi117.stdout:2/228: write d0/df/f1d [2145386,80645] 0 2024-04-12T09:11:05.153 INFO:tasks.workunit.client.0.smithi117.stdout:5/278: dwrite d2/d3/de/f2a [0,4194304] 0 2024-04-12T09:11:05.156 INFO:tasks.workunit.client.0.smithi117.stdout:2/229: creat d0/d4/f4d x:0 0 0 2024-04-12T09:11:05.162 INFO:tasks.workunit.client.0.smithi117.stdout:2/230: symlink d0/d43/d4b/l4e 0 2024-04-12T09:11:05.165 INFO:tasks.workunit.client.0.smithi117.stdout:4/311: dread d0/f4 [0,4194304] 0 2024-04-12T09:11:05.165 INFO:tasks.workunit.client.0.smithi117.stdout:2/231: symlink d0/d4/d10/l4f 0 2024-04-12T09:11:05.166 INFO:tasks.workunit.client.0.smithi117.stdout:4/312: dread - d0/f49 zero size 2024-04-12T09:11:05.171 INFO:tasks.workunit.client.0.smithi117.stdout:4/313: symlink d0/d5/d3b/l64 0 2024-04-12T09:11:05.172 INFO:tasks.workunit.client.0.smithi117.stdout:5/279: dread f1 [0,4194304] 0 2024-04-12T09:11:05.174 INFO:tasks.workunit.client.0.smithi117.stdout:2/232: link d0/d4/c14 d0/d43/d4b/c50 0 2024-04-12T09:11:05.177 INFO:tasks.workunit.client.0.smithi117.stdout:5/280: rename d2/d3/de/d1e/d35/c38 to d2/d3/dd/c5a 0 2024-04-12T09:11:05.178 INFO:tasks.workunit.client.0.smithi117.stdout:4/314: dwrite d0/f37 [0,4194304] 0 2024-04-12T09:11:05.180 INFO:tasks.workunit.client.0.smithi117.stdout:2/233: unlink d0/d4/d10/d2a/l2f 0 2024-04-12T09:11:05.182 INFO:tasks.workunit.client.0.smithi117.stdout:2/234: read d0/d4/d10/f32 [1083767,77052] 0 2024-04-12T09:11:05.182 INFO:tasks.workunit.client.0.smithi117.stdout:4/315: dread d0/f14 [0,4194304] 0 2024-04-12T09:11:05.188 INFO:tasks.workunit.client.0.smithi117.stdout:5/281: symlink d2/d3/d2e/l5b 0 2024-04-12T09:11:05.189 INFO:tasks.workunit.client.0.smithi117.stdout:5/282: readlink d2/l16 0 2024-04-12T09:11:05.192 INFO:tasks.workunit.client.0.smithi117.stdout:5/283: unlink d2/d3/dd/f12 0 2024-04-12T09:11:05.193 INFO:tasks.workunit.client.0.smithi117.stdout:5/284: chown d2/f6 0 1 2024-04-12T09:11:05.205 INFO:tasks.workunit.client.0.smithi117.stdout:4/316: write d0/d2c/f2f [2568004,67534] 0 2024-04-12T09:11:05.209 INFO:tasks.workunit.client.0.smithi117.stdout:4/317: link d0/d5/d25/f53 d0/d1/f65 0 2024-04-12T09:11:05.210 INFO:tasks.workunit.client.0.smithi117.stdout:4/318: dread - d0/d2c/f4d zero size 2024-04-12T09:11:05.214 INFO:tasks.workunit.client.0.smithi117.stdout:4/319: mkdir d0/d2c/d66 0 2024-04-12T09:11:05.219 INFO:tasks.workunit.client.0.smithi117.stdout:4/320: mkdir d0/d2c/d67 0 2024-04-12T09:11:05.223 INFO:tasks.workunit.client.0.smithi117.stdout:4/321: symlink d0/d5/d39/d4e/l68 0 2024-04-12T09:11:05.227 INFO:tasks.workunit.client.0.smithi117.stdout:5/285: dwrite d2/d3/de/d1e/f44 [0,4194304] 0 2024-04-12T09:11:05.231 INFO:tasks.workunit.client.0.smithi117.stdout:4/322: dwrite d0/d5/f52 [4194304,4194304] 0 2024-04-12T09:11:05.237 INFO:tasks.workunit.client.0.smithi117.stdout:4/323: mkdir d0/d5/d25/d69 0 2024-04-12T09:11:05.238 INFO:tasks.workunit.client.0.smithi117.stdout:5/286: read - d2/d3/de/d1e/d46/f4c zero size 2024-04-12T09:11:05.239 INFO:tasks.workunit.client.0.smithi117.stdout:4/324: creat d0/d5/f6a x:0 0 0 2024-04-12T09:11:05.241 INFO:tasks.workunit.client.0.smithi117.stdout:4/325: dread d0/f4 [0,4194304] 0 2024-04-12T09:11:05.242 INFO:tasks.workunit.client.0.smithi117.stdout:4/326: fsync d0/d5/d3b/f42 0 2024-04-12T09:11:05.242 INFO:tasks.workunit.client.0.smithi117.stdout:5/287: creat d2/d3/d2e/d4d/f5c x:0 0 0 2024-04-12T09:11:05.243 INFO:tasks.workunit.client.0.smithi117.stdout:5/288: write d2/d3/dd/d39/f57 [872434,62316] 0 2024-04-12T09:11:05.245 INFO:tasks.workunit.client.0.smithi117.stdout:4/327: mkdir d0/d5/d39/d4e/d6b 0 2024-04-12T09:11:05.245 INFO:tasks.workunit.client.0.smithi117.stdout:5/289: write d2/d3/dd/f3a [4829797,41950] 0 2024-04-12T09:11:05.248 INFO:tasks.workunit.client.0.smithi117.stdout:4/328: creat d0/d5/d39/d4e/f6c x:0 0 0 2024-04-12T09:11:05.251 INFO:tasks.workunit.client.0.smithi117.stdout:5/290: creat d2/f5d x:0 0 0 2024-04-12T09:11:05.252 INFO:tasks.workunit.client.0.smithi117.stdout:4/329: symlink d0/d5/d3b/d38/d4f/l6d 0 2024-04-12T09:11:05.252 INFO:tasks.workunit.client.0.smithi117.stdout:5/291: dread - d2/d3/de/d1e/d46/f54 zero size 2024-04-12T09:11:05.256 INFO:tasks.workunit.client.0.smithi117.stdout:5/292: stat d2/d3/de/d1e/d35/c3f 0 2024-04-12T09:11:05.256 INFO:tasks.workunit.client.0.smithi117.stdout:5/293: chown d2/f36 26187 1 2024-04-12T09:11:05.259 INFO:tasks.workunit.client.0.smithi117.stdout:5/294: rename d2/d3/dd/l1c to d2/d3/dd/l5e 0 2024-04-12T09:11:05.264 INFO:tasks.workunit.client.0.smithi117.stdout:5/295: creat d2/d3/f5f x:0 0 0 2024-04-12T09:11:05.268 INFO:tasks.workunit.client.0.smithi117.stdout:5/296: dread d2/d3/dd/d39/f3e [0,4194304] 0 2024-04-12T09:11:05.270 INFO:tasks.workunit.client.0.smithi117.stdout:4/330: truncate d0/d1/d34/f28 5149201 0 2024-04-12T09:11:05.270 INFO:tasks.workunit.client.0.smithi117.stdout:5/297: write d2/d3/de/d1e/d46/f48 [3714368,84991] 0 2024-04-12T09:11:05.271 INFO:tasks.workunit.client.0.smithi117.stdout:4/331: truncate d0/d2c/f30 4408465 0 2024-04-12T09:11:05.272 INFO:tasks.workunit.client.0.smithi117.stdout:4/332: chown d0/d5/d25/f53 629 1 2024-04-12T09:11:05.273 INFO:tasks.workunit.client.0.smithi117.stdout:4/333: chown d0/d2c/l59 3282 1 2024-04-12T09:11:05.277 INFO:tasks.workunit.client.0.smithi117.stdout:5/298: rename d2/c41 to d2/d3/de/d1e/c60 0 2024-04-12T09:11:05.278 INFO:tasks.workunit.client.0.smithi117.stdout:5/299: chown d2/d3/de 1275 1 2024-04-12T09:11:05.279 INFO:tasks.workunit.client.0.smithi117.stdout:4/334: dwrite d0/d1/d34/f5b [0,4194304] 0 2024-04-12T09:11:05.300 INFO:tasks.workunit.client.0.smithi117.stdout:4/335: dwrite d0/d1/f65 [0,4194304] 0 2024-04-12T09:11:05.301 INFO:tasks.workunit.client.0.smithi117.stdout:4/336: fsync d0/d5/d3b/f42 0 2024-04-12T09:11:05.314 INFO:tasks.workunit.client.0.smithi117.stdout:4/337: dwrite d0/d5/f8 [0,4194304] 0 2024-04-12T09:11:05.315 INFO:tasks.workunit.client.0.smithi117.stdout:4/338: dread d0/f27 [0,4194304] 0 2024-04-12T09:11:05.316 INFO:tasks.workunit.client.0.smithi117.stdout:4/339: write d0/d2c/f4d [534264,5000] 0 2024-04-12T09:11:05.321 INFO:tasks.workunit.client.0.smithi117.stdout:4/340: dread d0/d1/d34/f5b [0,4194304] 0 2024-04-12T09:11:05.323 INFO:tasks.workunit.client.0.smithi117.stdout:4/341: dread - d0/d5/d39/d4e/f6c zero size 2024-04-12T09:11:05.326 INFO:tasks.workunit.client.0.smithi117.stdout:4/342: link d0/f37 d0/d5/f6e 0 2024-04-12T09:11:05.329 INFO:tasks.workunit.client.0.smithi117.stdout:4/343: link d0/f49 d0/d5/d39/f6f 0 2024-04-12T09:11:05.330 INFO:tasks.workunit.client.0.smithi117.stdout:4/344: chown d0/d2c/f2f 228320 1 2024-04-12T09:11:05.331 INFO:tasks.workunit.client.0.smithi117.stdout:4/345: chown d0/d1/d34/d20/f40 32838 1 2024-04-12T09:11:05.331 INFO:tasks.workunit.client.0.smithi117.stdout:4/346: write d0/d5/d25/f53 [3387152,49279] 0 2024-04-12T09:11:05.334 INFO:tasks.workunit.client.0.smithi117.stdout:4/347: unlink d0/d5/d3b/c18 0 2024-04-12T09:11:05.338 INFO:tasks.workunit.client.0.smithi117.stdout:4/348: symlink d0/d5/d43/l70 0 2024-04-12T09:11:05.340 INFO:tasks.workunit.client.0.smithi117.stdout:4/349: stat d0/d5/d39/f6f 0 2024-04-12T09:11:05.347 INFO:tasks.workunit.client.0.smithi117.stdout:4/350: getdents d0/d5/d3b 0 2024-04-12T09:11:05.352 INFO:tasks.workunit.client.0.smithi117.stdout:4/351: dwrite d0/d5/f63 [0,4194304] 0 2024-04-12T09:11:05.355 INFO:tasks.workunit.client.0.smithi117.stdout:4/352: symlink d0/d5/d3b/l71 0 2024-04-12T09:11:05.355 INFO:tasks.workunit.client.0.smithi117.stdout:4/353: readlink d0/d5/d3b/l64 0 2024-04-12T09:11:05.357 INFO:tasks.workunit.client.0.smithi117.stdout:4/354: chown d0/d1/d34/d20/f26 459524 1 2024-04-12T09:11:05.361 INFO:tasks.workunit.client.0.smithi117.stdout:4/355: rename d0/d1/d34/d20 to d0/d72 0 2024-04-12T09:11:05.377 INFO:tasks.workunit.client.0.smithi117.stdout:4/356: dwrite d0/d5/d39/f6f [0,4194304] 0 2024-04-12T09:11:05.427 INFO:tasks.workunit.client.0.smithi117.stdout:7/193: sync 2024-04-12T09:11:05.427 INFO:tasks.workunit.client.0.smithi117.stdout:8/225: sync 2024-04-12T09:11:05.429 INFO:tasks.workunit.client.0.smithi117.stdout:4/357: creat d0/d1/f73 x:0 0 0 2024-04-12T09:11:05.431 INFO:tasks.workunit.client.0.smithi117.stdout:7/194: rename d0/d2/f8 to d0/d2/d22/d17/d23/d2a/f3b 0 2024-04-12T09:11:05.432 INFO:tasks.workunit.client.0.smithi117.stdout:8/226: mkdir db/d4b 0 2024-04-12T09:11:05.433 INFO:tasks.workunit.client.0.smithi117.stdout:8/227: write db/d1b/fe [772075,107603] 0 2024-04-12T09:11:05.433 INFO:tasks.workunit.client.0.smithi117.stdout:4/358: creat d0/d5/d3b/d38/d4f/f74 x:0 0 0 2024-04-12T09:11:05.434 INFO:tasks.workunit.client.0.smithi117.stdout:4/359: readlink d0/d2c/l59 0 2024-04-12T09:11:05.435 INFO:tasks.workunit.client.0.smithi117.stdout:7/195: mknod d0/d13/c3c 0 2024-04-12T09:11:05.437 INFO:tasks.workunit.client.0.smithi117.stdout:8/228: rmdir db/d19/d1a/d3d/d33 39 2024-04-12T09:11:05.441 INFO:tasks.workunit.client.0.smithi117.stdout:7/196: unlink d0/d2/cb 0 2024-04-12T09:11:05.445 INFO:tasks.workunit.client.0.smithi117.stdout:7/197: fdatasync d0/d2/f16 0 2024-04-12T09:11:05.450 INFO:tasks.workunit.client.0.smithi117.stdout:8/229: rename db/d1b/lf to db/d19/d1a/d3d/l4c 0 2024-04-12T09:11:05.451 INFO:tasks.workunit.client.0.smithi117.stdout:7/198: creat d0/d2/d22/d17/d23/d2a/f3d x:0 0 0 2024-04-12T09:11:05.453 INFO:tasks.workunit.client.0.smithi117.stdout:8/230: creat db/d13/f4d x:0 0 0 2024-04-12T09:11:05.458 INFO:tasks.workunit.client.0.smithi117.stdout:7/199: dwrite d0/d2/d22/d17/f3a [0,4194304] 0 2024-04-12T09:11:05.459 INFO:tasks.workunit.client.0.smithi117.stdout:8/231: getdents db/d13/d38 0 2024-04-12T09:11:05.465 INFO:tasks.workunit.client.0.smithi117.stdout:7/200: rename d0/d2/d1a/f37 to d0/d13/f3e 0 2024-04-12T09:11:05.469 INFO:tasks.workunit.client.0.smithi117.stdout:7/201: unlink d0/d13/f19 0 2024-04-12T09:11:05.472 INFO:tasks.workunit.client.0.smithi117.stdout:7/202: chown d0/d2/d22/d17/d23/d2a/f3b 276001 1 2024-04-12T09:11:05.472 INFO:tasks.workunit.client.0.smithi117.stdout:8/232: dread db/d1b/f11 [0,4194304] 0 2024-04-12T09:11:05.475 INFO:tasks.workunit.client.0.smithi117.stdout:8/233: creat db/d13/d38/f4e x:0 0 0 2024-04-12T09:11:05.476 INFO:tasks.workunit.client.0.smithi117.stdout:8/234: dread - db/d1b/f3c zero size 2024-04-12T09:11:05.478 INFO:tasks.workunit.client.0.smithi117.stdout:8/235: mkdir db/d13/d38/d4f 0 2024-04-12T09:11:05.478 INFO:tasks.workunit.client.0.smithi117.stdout:7/203: fsync d0/d13/f3e 0 2024-04-12T09:11:05.488 INFO:tasks.workunit.client.0.smithi117.stdout:8/236: dwrite db/d19/d1a/f26 [0,4194304] 0 2024-04-12T09:11:05.499 INFO:tasks.workunit.client.0.smithi117.stdout:8/237: dwrite db/f2f [0,4194304] 0 2024-04-12T09:11:05.502 INFO:tasks.workunit.client.0.smithi117.stdout:8/238: creat db/d13/f50 x:0 0 0 2024-04-12T09:11:05.503 INFO:tasks.workunit.client.0.smithi117.stdout:8/239: truncate db/d1b/f3c 279567 0 2024-04-12T09:11:05.505 INFO:tasks.workunit.client.0.smithi117.stdout:8/240: mknod db/d13/d38/d46/c51 0 2024-04-12T09:11:05.507 INFO:tasks.workunit.client.0.smithi117.stdout:8/241: creat db/d19/f52 x:0 0 0 2024-04-12T09:11:05.511 INFO:tasks.workunit.client.0.smithi117.stdout:8/242: link db/d1b/f3c db/f53 0 2024-04-12T09:11:05.512 INFO:tasks.workunit.client.0.smithi117.stdout:8/243: write db/d13/f4d [803970,29615] 0 2024-04-12T09:11:05.513 INFO:tasks.workunit.client.0.smithi117.stdout:8/244: stat db/d19/l1c 0 2024-04-12T09:11:05.518 INFO:tasks.workunit.client.0.smithi117.stdout:8/245: dwrite db/d19/f52 [0,4194304] 0 2024-04-12T09:11:05.521 INFO:tasks.workunit.client.0.smithi117.stdout:8/246: creat db/d13/f54 x:0 0 0 2024-04-12T09:11:05.529 INFO:tasks.workunit.client.0.smithi117.stdout:8/247: dwrite db/d19/d1a/d3d/f47 [0,4194304] 0 2024-04-12T09:11:05.533 INFO:tasks.workunit.client.0.smithi117.stdout:8/248: mkdir db/d1b/d55 0 2024-04-12T09:11:05.539 INFO:tasks.workunit.client.0.smithi117.stdout:8/249: dwrite db/d13/f4d [0,4194304] 0 2024-04-12T09:11:05.542 INFO:tasks.workunit.client.0.smithi117.stdout:8/250: creat db/d1b/d55/f56 x:0 0 0 2024-04-12T09:11:05.543 INFO:tasks.workunit.client.0.smithi117.stdout:8/251: fdatasync db/d19/d1a/d3d/f28 0 2024-04-12T09:11:05.543 INFO:tasks.workunit.client.0.smithi117.stdout:8/252: read db/d13/f31 [1029476,84331] 0 2024-04-12T09:11:05.545 INFO:tasks.workunit.client.0.smithi117.stdout:8/253: creat db/d1b/d55/f57 x:0 0 0 2024-04-12T09:11:05.548 INFO:tasks.workunit.client.0.smithi117.stdout:8/254: creat db/d13/d38/f58 x:0 0 0 2024-04-12T09:11:05.548 INFO:tasks.workunit.client.0.smithi117.stdout:8/255: dread - db/d13/d38/f4e zero size 2024-04-12T09:11:05.552 INFO:tasks.workunit.client.0.smithi117.stdout:8/256: rmdir db/d13/d38/d4f 0 2024-04-12T09:11:05.558 INFO:tasks.workunit.client.0.smithi117.stdout:8/257: dwrite db/d19/d1a/d3d/f45 [0,4194304] 0 2024-04-12T09:11:05.562 INFO:tasks.workunit.client.0.smithi117.stdout:8/258: chown db/d13/c27 957364 1 2024-04-12T09:11:05.580 INFO:tasks.workunit.client.0.smithi117.stdout:8/259: dread db/d19/d1a/d3d/f2a [0,4194304] 0 2024-04-12T09:11:05.581 INFO:tasks.workunit.client.0.smithi117.stdout:8/260: write db/d1b/f40 [91966,92487] 0 2024-04-12T09:11:05.582 INFO:tasks.workunit.client.0.smithi117.stdout:8/261: chown db/d19/d1a/c2c 73386 1 2024-04-12T09:11:05.583 INFO:tasks.workunit.client.0.smithi117.stdout:8/262: readlink db/d1b/l12 0 2024-04-12T09:11:05.586 INFO:tasks.workunit.client.0.smithi117.stdout:8/263: rename db/d19/l1c to db/d4b/l59 0 2024-04-12T09:11:05.587 INFO:tasks.workunit.client.0.smithi117.stdout:8/264: truncate db/d13/f50 832636 0 2024-04-12T09:11:05.588 INFO:tasks.workunit.client.0.smithi117.stdout:8/265: rmdir db/d19/d1a/d3d 39 2024-04-12T09:11:05.588 INFO:tasks.workunit.client.0.smithi117.stdout:0/356: sync 2024-04-12T09:11:05.589 INFO:tasks.workunit.client.0.smithi117.stdout:6/298: sync 2024-04-12T09:11:05.594 INFO:tasks.workunit.client.0.smithi117.stdout:8/266: dwrite db/d1b/f40 [0,4194304] 0 2024-04-12T09:11:05.601 INFO:tasks.workunit.client.0.smithi117.stdout:0/357: truncate d3/d59/f5c 449220 0 2024-04-12T09:11:05.602 INFO:tasks.workunit.client.0.smithi117.stdout:8/267: dread db/d19/d1a/d3d/f45 [0,4194304] 0 2024-04-12T09:11:05.605 INFO:tasks.workunit.client.0.smithi117.stdout:8/268: symlink db/d1b/l5a 0 2024-04-12T09:11:05.618 INFO:tasks.workunit.client.0.smithi117.stdout:0/358: dread d3/dc/f2e [0,4194304] 0 2024-04-12T09:11:05.627 INFO:tasks.workunit.client.0.smithi117.stdout:0/359: write d3/d30/f38 [206081,72086] 0 2024-04-12T09:11:05.631 INFO:tasks.workunit.client.0.smithi117.stdout:0/360: rename d3/d30/f3f to d3/dc/f7c 0 2024-04-12T09:11:05.634 INFO:tasks.workunit.client.0.smithi117.stdout:0/361: dread d3/f14 [0,4194304] 0 2024-04-12T09:11:05.637 INFO:tasks.workunit.client.0.smithi117.stdout:0/362: creat d3/d30/d32/f7d x:0 0 0 2024-04-12T09:11:05.639 INFO:tasks.workunit.client.0.smithi117.stdout:0/363: symlink d3/d59/l7e 0 2024-04-12T09:11:05.642 INFO:tasks.workunit.client.0.smithi117.stdout:0/364: rename d3/d22/d55/d5a/d62/f65 to d3/d22/d55/d5a/d62/d66/f7f 0 2024-04-12T09:11:05.642 INFO:tasks.workunit.client.0.smithi117.stdout:0/365: chown d3 13937 1 2024-04-12T09:11:05.646 INFO:tasks.workunit.client.0.smithi117.stdout:0/366: rmdir d3/d22/d55/d5a/d62/d66/d73/d77 0 2024-04-12T09:11:05.652 INFO:tasks.workunit.client.0.smithi117.stdout:0/367: dwrite d3/dc/f34 [0,4194304] 0 2024-04-12T09:11:05.667 INFO:tasks.workunit.client.0.smithi117.stdout:0/368: truncate d3/f23 1847229 0 2024-04-12T09:11:05.669 INFO:tasks.workunit.client.0.smithi117.stdout:0/369: rmdir d3/d47 39 2024-04-12T09:11:05.676 INFO:tasks.workunit.client.0.smithi117.stdout:0/370: dwrite d3/dc/f3b [0,4194304] 0 2024-04-12T09:11:05.787 INFO:tasks.workunit.client.0.smithi117.stdout:9/264: sync 2024-04-12T09:11:05.788 INFO:tasks.workunit.client.0.smithi117.stdout:3/399: sync 2024-04-12T09:11:05.793 INFO:tasks.workunit.client.0.smithi117.stdout:9/265: getdents d1/d8/df/d1b 0 2024-04-12T09:11:05.796 INFO:tasks.workunit.client.0.smithi117.stdout:9/266: mkdir d1/d8/d52 0 2024-04-12T09:11:05.816 INFO:tasks.workunit.client.0.smithi117.stdout:3/400: write de/d2c/d59/f24 [2151566,26377] 0 2024-04-12T09:11:05.821 INFO:tasks.workunit.client.0.smithi117.stdout:3/401: unlink de/d2c/d59/d19/l4a 0 2024-04-12T09:11:05.825 INFO:tasks.workunit.client.0.smithi117.stdout:3/402: creat de/d2c/d59/d70/d40/d49/f95 x:0 0 0 2024-04-12T09:11:05.826 INFO:tasks.workunit.client.0.smithi117.stdout:9/267: dwrite d1/f15 [0,4194304] 0 2024-04-12T09:11:05.830 INFO:tasks.workunit.client.0.smithi117.stdout:3/403: creat de/d2c/f96 x:0 0 0 2024-04-12T09:11:05.834 INFO:tasks.workunit.client.0.smithi117.stdout:9/268: dwrite d1/d8/df/d1b/f3f [0,4194304] 0 2024-04-12T09:11:05.836 INFO:tasks.workunit.client.0.smithi117.stdout:3/404: write de/d2c/d59/d70/d3e/f86 [705126,80405] 0 2024-04-12T09:11:05.836 INFO:tasks.workunit.client.0.smithi117.stdout:9/269: chown d1/d8/df/d1b/f3f 596259 1 2024-04-12T09:11:05.839 INFO:tasks.workunit.client.0.smithi117.stdout:9/270: read d1/f4 [3008904,30176] 0 2024-04-12T09:11:05.841 INFO:tasks.workunit.client.0.smithi117.stdout:3/405: mkdir de/d2c/d59/d70/d3e/d5d/d80/d97 0 2024-04-12T09:11:05.846 INFO:tasks.workunit.client.0.smithi117.stdout:9/271: mknod d1/c53 0 2024-04-12T09:11:05.847 INFO:tasks.workunit.client.0.smithi117.stdout:3/406: creat de/d2c/d59/d90/f98 x:0 0 0 2024-04-12T09:11:05.849 INFO:tasks.workunit.client.0.smithi117.stdout:3/407: readlink de/d2c/d59/d70/d40/d49/l87 0 2024-04-12T09:11:05.854 INFO:tasks.workunit.client.0.smithi117.stdout:3/408: rename de/d2c/d59/d70/f33 to de/d2c/f99 0 2024-04-12T09:11:05.855 INFO:tasks.workunit.client.0.smithi117.stdout:9/272: dwrite d1/d23/f28 [0,4194304] 0 2024-04-12T09:11:05.857 INFO:tasks.workunit.client.0.smithi117.stdout:9/273: symlink d1/d23/l54 0 2024-04-12T09:11:05.859 INFO:tasks.workunit.client.0.smithi117.stdout:3/409: mkdir de/d2c/d59/d70/d3e/d5d/d80/d97/d9a 0 2024-04-12T09:11:05.860 INFO:tasks.workunit.client.0.smithi117.stdout:3/410: readlink de/d2c/d59/d19/d27/l35 0 2024-04-12T09:11:05.860 INFO:tasks.workunit.client.0.smithi117.stdout:9/274: write d1/d8/d12/f20 [3857361,25908] 0 2024-04-12T09:11:05.863 INFO:tasks.workunit.client.0.smithi117.stdout:9/275: creat d1/d4b/f55 x:0 0 0 2024-04-12T09:11:05.877 INFO:tasks.workunit.client.0.smithi117.stdout:3/411: truncate de/d2c/d59/d30/f56 3683056 0 2024-04-12T09:11:05.879 INFO:tasks.workunit.client.0.smithi117.stdout:3/412: mkdir de/d2c/d59/d90/d9b 0 2024-04-12T09:11:05.880 INFO:tasks.workunit.client.0.smithi117.stdout:3/413: dread - de/f7d zero size 2024-04-12T09:11:05.882 INFO:tasks.workunit.client.0.smithi117.stdout:9/276: dwrite d1/d8/df/d39/d3b/f4a [0,4194304] 0 2024-04-12T09:11:05.884 INFO:tasks.workunit.client.0.smithi117.stdout:9/277: truncate d1/d8/f4e 483445 0 2024-04-12T09:11:05.885 INFO:tasks.workunit.client.0.smithi117.stdout:3/414: rename de/d2c/d59/d70/l5e to de/d2c/l9c 0 2024-04-12T09:11:05.889 INFO:tasks.workunit.client.0.smithi117.stdout:9/278: mknod d1/d24/c56 0 2024-04-12T09:11:05.892 INFO:tasks.workunit.client.0.smithi117.stdout:3/415: getdents de/d2c/d59/d4c/d62 0 2024-04-12T09:11:05.893 INFO:tasks.workunit.client.0.smithi117.stdout:3/416: read - de/d2c/d59/d70/d40/d49/f95 zero size 2024-04-12T09:11:05.897 INFO:tasks.workunit.client.0.smithi117.stdout:9/279: link d1/d8/df/d3e/f36 d1/d24/f57 0 2024-04-12T09:11:05.898 INFO:tasks.workunit.client.0.smithi117.stdout:9/280: chown d1/d8/df/l48 0 1 2024-04-12T09:11:05.902 INFO:tasks.workunit.client.0.smithi117.stdout:3/417: dread de/d2c/d59/f23 [0,4194304] 0 2024-04-12T09:11:05.903 INFO:tasks.workunit.client.0.smithi117.stdout:3/418: chown de/d2c/d59/d70/d40/d49 12933928 1 2024-04-12T09:11:05.912 INFO:tasks.workunit.client.0.smithi117.stdout:3/419: dwrite de/f15 [0,4194304] 0 2024-04-12T09:11:05.913 INFO:tasks.workunit.client.0.smithi117.stdout:3/420: write de/f47 [1253768,40269] 0 2024-04-12T09:11:05.923 INFO:tasks.workunit.client.0.smithi117.stdout:3/421: creat de/d2c/d59/d70/d3e/d84/f9d x:0 0 0 2024-04-12T09:11:05.926 INFO:tasks.workunit.client.0.smithi117.stdout:9/281: dwrite d1/d8/df/d3e/f2b [4194304,4194304] 0 2024-04-12T09:11:05.936 INFO:tasks.workunit.client.0.smithi117.stdout:9/282: dwrite d1/d8/df/d26/f46 [0,4194304] 0 2024-04-12T09:11:05.941 INFO:tasks.workunit.client.0.smithi117.stdout:9/283: dread d1/d8/df/d39/d3b/f4a [0,4194304] 0 2024-04-12T09:11:05.943 INFO:tasks.workunit.client.0.smithi117.stdout:9/284: truncate d1/d8/df/f3a 993872 0 2024-04-12T09:11:05.946 INFO:tasks.workunit.client.0.smithi117.stdout:2/235: sync 2024-04-12T09:11:05.946 INFO:tasks.workunit.client.0.smithi117.stdout:1/296: sync 2024-04-12T09:11:05.947 INFO:tasks.workunit.client.0.smithi117.stdout:9/285: rename d1/d8/df/d1b/l34 to d1/d8/df/d26/d41/l58 0 2024-04-12T09:11:05.950 INFO:tasks.workunit.client.0.smithi117.stdout:1/297: truncate d1/d6/d51/f56 846096 0 2024-04-12T09:11:05.951 INFO:tasks.workunit.client.0.smithi117.stdout:9/286: write d1/d8/df/d39/d3b/f42 [876081,62843] 0 2024-04-12T09:11:05.954 INFO:tasks.workunit.client.0.smithi117.stdout:3/422: dwrite fa [0,4194304] 0 2024-04-12T09:11:05.955 INFO:tasks.workunit.client.0.smithi117.stdout:1/298: write d1/d6/d3f/db/d1d/d24/f44 [2307328,20949] 0 2024-04-12T09:11:05.958 INFO:tasks.workunit.client.0.smithi117.stdout:2/236: getdents d0/d4 0 2024-04-12T09:11:05.962 INFO:tasks.workunit.client.0.smithi117.stdout:9/287: dwrite d1/d8/df/f13 [0,4194304] 0 2024-04-12T09:11:05.964 INFO:tasks.workunit.client.0.smithi117.stdout:3/423: dwrite de/d2c/d59/d70/d3e/f41 [0,4194304] 0 2024-04-12T09:11:05.970 INFO:tasks.workunit.client.0.smithi117.stdout:3/424: read de/d2c/d59/d70/f85 [3822612,33184] 0 2024-04-12T09:11:05.970 INFO:tasks.workunit.client.0.smithi117.stdout:1/299: creat d1/d6/d51/f5a x:0 0 0 2024-04-12T09:11:05.973 INFO:tasks.workunit.client.0.smithi117.stdout:3/425: truncate de/d2c/d59/d19/d27/f3c 2064085 0 2024-04-12T09:11:05.973 INFO:tasks.workunit.client.0.smithi117.stdout:2/237: rename d0/d4/d10/d27/l48 to d0/d4/d10/d27/l51 0 2024-04-12T09:11:05.975 INFO:tasks.workunit.client.0.smithi117.stdout:3/426: fdatasync de/d2c/d59/d30/f60 0 2024-04-12T09:11:05.976 INFO:tasks.workunit.client.0.smithi117.stdout:2/238: write d0/d43/d30/f47 [831884,113345] 0 2024-04-12T09:11:05.979 INFO:tasks.workunit.client.0.smithi117.stdout:1/300: dwrite d1/d6/d3f/db/d16/f19 [0,4194304] 0 2024-04-12T09:11:05.987 INFO:tasks.workunit.client.0.smithi117.stdout:3/427: rmdir de/d2c 39 2024-04-12T09:11:06.000 INFO:tasks.workunit.client.0.smithi117.stdout:9/288: getdents d1/d8/df 0 2024-04-12T09:11:06.002 INFO:tasks.workunit.client.0.smithi117.stdout:3/428: dwrite de/d2c/d59/d19/d27/f3c [0,4194304] 0 2024-04-12T09:11:06.003 INFO:tasks.workunit.client.0.smithi117.stdout:2/239: dread d0/d4/fb [0,4194304] 0 2024-04-12T09:11:06.004 INFO:tasks.workunit.client.0.smithi117.stdout:1/301: creat d1/d6/d3f/db/d1d/f5b x:0 0 0 2024-04-12T09:11:06.005 INFO:tasks.workunit.client.0.smithi117.stdout:9/289: creat d1/d8/d12/f59 x:0 0 0 2024-04-12T09:11:06.008 INFO:tasks.workunit.client.0.smithi117.stdout:1/302: unlink f0 0 2024-04-12T09:11:06.011 INFO:tasks.workunit.client.0.smithi117.stdout:1/303: truncate d1/d6/d3f/db/d1d/d24/d38/f43 285419 0 2024-04-12T09:11:06.012 INFO:tasks.workunit.client.0.smithi117.stdout:9/290: read d1/f4 [1710174,9382] 0 2024-04-12T09:11:06.013 INFO:tasks.workunit.client.0.smithi117.stdout:7/204: sync 2024-04-12T09:11:06.013 INFO:tasks.workunit.client.0.smithi117.stdout:6/299: sync 2024-04-12T09:11:06.013 INFO:tasks.workunit.client.0.smithi117.stdout:4/360: sync 2024-04-12T09:11:06.013 INFO:tasks.workunit.client.0.smithi117.stdout:8/269: sync 2024-04-12T09:11:06.014 INFO:tasks.workunit.client.0.smithi117.stdout:0/371: sync 2024-04-12T09:11:06.014 INFO:tasks.workunit.client.0.smithi117.stdout:5/300: sync 2024-04-12T09:11:06.015 INFO:tasks.workunit.client.0.smithi117.stdout:4/361: fsync d0/d1/f65 0 2024-04-12T09:11:06.015 INFO:tasks.workunit.client.0.smithi117.stdout:3/429: creat de/d2c/d59/d19/f9e x:0 0 0 2024-04-12T09:11:06.017 INFO:tasks.workunit.client.0.smithi117.stdout:9/291: mkdir d1/d8/d5a 0 2024-04-12T09:11:06.017 INFO:tasks.workunit.client.0.smithi117.stdout:2/240: link d0/d4/d10/l4f d0/d43/d4b/l52 0 2024-04-12T09:11:06.019 INFO:tasks.workunit.client.0.smithi117.stdout:7/205: mknod d0/d13/c3f 0 2024-04-12T09:11:06.020 INFO:tasks.workunit.client.0.smithi117.stdout:3/430: chown de/d2c/d59/d70/d40/d49/f95 3 1 2024-04-12T09:11:06.021 INFO:tasks.workunit.client.0.smithi117.stdout:7/206: readlink d0/d2/le 0 2024-04-12T09:11:06.021 INFO:tasks.workunit.client.0.smithi117.stdout:1/304: dwrite d1/d6/d3f/db/d1d/d24/d38/d45/f50 [0,4194304] 0 2024-04-12T09:11:06.023 INFO:tasks.workunit.client.0.smithi117.stdout:1/305: fsync d1/d6/f34 0 2024-04-12T09:11:06.024 INFO:tasks.workunit.client.0.smithi117.stdout:4/362: dread d0/d72/f40 [4194304,4194304] 0 2024-04-12T09:11:06.025 INFO:tasks.workunit.client.0.smithi117.stdout:5/301: creat d2/d3/dd/d39/f61 x:0 0 0 2024-04-12T09:11:06.026 INFO:tasks.workunit.client.0.smithi117.stdout:5/302: write d2/f34 [302114,49364] 0 2024-04-12T09:11:06.027 INFO:tasks.workunit.client.0.smithi117.stdout:5/303: dread - d2/d3/de/f56 zero size 2024-04-12T09:11:06.027 INFO:tasks.workunit.client.0.smithi117.stdout:5/304: readlink d2/l4a 0 2024-04-12T09:11:06.028 INFO:tasks.workunit.client.0.smithi117.stdout:5/305: read d2/d3/dd/f3a [169133,107122] 0 2024-04-12T09:11:06.030 INFO:tasks.workunit.client.0.smithi117.stdout:9/292: mknod d1/d8/df/d39/c5b 0 2024-04-12T09:11:06.031 INFO:tasks.workunit.client.0.smithi117.stdout:9/293: write d1/d24/f2e [449834,77625] 0 2024-04-12T09:11:06.032 INFO:tasks.workunit.client.0.smithi117.stdout:2/241: fdatasync d0/d4/d10/f32 0 2024-04-12T09:11:06.034 INFO:tasks.workunit.client.0.smithi117.stdout:3/431: write de/d2c/f45 [1050694,46398] 0 2024-04-12T09:11:06.036 INFO:tasks.workunit.client.0.smithi117.stdout:8/270: symlink db/d13/d38/l5b 0 2024-04-12T09:11:06.037 INFO:tasks.workunit.client.0.smithi117.stdout:8/271: fdatasync db/d1b/f15 0 2024-04-12T09:11:06.039 INFO:tasks.workunit.client.0.smithi117.stdout:7/207: creat d0/d13/f40 x:0 0 0 2024-04-12T09:11:06.044 INFO:tasks.workunit.client.0.smithi117.stdout:6/300: creat d8/d9/d61/f65 x:0 0 0 2024-04-12T09:11:06.049 INFO:tasks.workunit.client.0.smithi117.stdout:4/363: creat d0/d5/d43/f75 x:0 0 0 2024-04-12T09:11:06.053 INFO:tasks.workunit.client.0.smithi117.stdout:5/306: write d2/d3/de/d1e/f44 [7303884,40464] 0 2024-04-12T09:11:06.054 INFO:tasks.workunit.client.0.smithi117.stdout:5/307: write d2/f19 [4223449,2333] 0 2024-04-12T09:11:06.061 INFO:tasks.workunit.client.0.smithi117.stdout:3/432: creat de/d2c/d59/d70/d3d/f9f x:0 0 0 2024-04-12T09:11:06.065 INFO:tasks.workunit.client.0.smithi117.stdout:0/372: link d3/fe d3/d30/f80 0 2024-04-12T09:11:06.065 INFO:tasks.workunit.client.0.smithi117.stdout:0/373: stat d3/c1f 0 2024-04-12T09:11:06.073 INFO:tasks.workunit.client.0.smithi117.stdout:4/364: rename d0/f49 to d0/d5/d3b/d38/d4f/f76 0 2024-04-12T09:11:06.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:05 smithi203 ceph-mon[36428]: pgmap v13: 65 pgs: 65 active+clean; 442 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 1.3 MiB/s rd, 42 MiB/s wr, 225 op/s 2024-04-12T09:11:06.074 INFO:tasks.workunit.client.0.smithi117.stdout:4/365: readlink d0/d72/l44 0 2024-04-12T09:11:06.080 INFO:tasks.workunit.client.0.smithi117.stdout:2/242: unlink d0/d43/f34 0 2024-04-12T09:11:06.081 INFO:tasks.workunit.client.0.smithi117.stdout:3/433: rmdir de/d2c/d59/d70/d40 39 2024-04-12T09:11:06.082 INFO:tasks.workunit.client.0.smithi117.stdout:3/434: fsync de/d2c/d59/d19/d27/f44 0 2024-04-12T09:11:06.083 INFO:tasks.workunit.client.0.smithi117.stdout:7/208: symlink d0/l41 0 2024-04-12T09:11:06.093 INFO:tasks.workunit.client.0.smithi117.stdout:5/308: mknod d2/c62 0 2024-04-12T09:11:06.094 INFO:tasks.workunit.client.0.smithi117.stdout:5/309: stat d2/d3/d2e/l32 0 2024-04-12T09:11:06.097 INFO:tasks.workunit.client.0.smithi117.stdout:3/435: mkdir de/d2c/d59/d4c/da0 0 2024-04-12T09:11:06.099 INFO:tasks.workunit.client.0.smithi117.stdout:7/209: truncate d0/d2/d1a/f24 614937 0 2024-04-12T09:11:06.102 INFO:tasks.workunit.client.0.smithi117.stdout:4/366: dread d0/d72/f40 [0,4194304] 0 2024-04-12T09:11:06.103 INFO:tasks.workunit.client.0.smithi117.stdout:5/310: creat d2/d3/de/d1e/d35/f63 x:0 0 0 2024-04-12T09:11:06.105 INFO:tasks.workunit.client.0.smithi117.stdout:4/367: dread d0/d5/f6e [0,4194304] 0 2024-04-12T09:11:06.105 INFO:tasks.workunit.client.0.smithi117.stdout:3/436: mkdir de/d2c/d59/d70/d3e/d84/da1 0 2024-04-12T09:11:06.107 INFO:tasks.workunit.client.0.smithi117.stdout:3/437: fsync de/d2c/d59/d19/d27/f3c 0 2024-04-12T09:11:06.107 INFO:tasks.workunit.client.0.smithi117.stdout:7/210: creat d0/d2/d22/f42 x:0 0 0 2024-04-12T09:11:06.109 INFO:tasks.workunit.client.0.smithi117.stdout:1/306: write d1/f10 [5571706,72050] 0 2024-04-12T09:11:06.113 INFO:tasks.workunit.client.0.smithi117.stdout:0/374: creat d3/f81 x:0 0 0 2024-04-12T09:11:06.128 INFO:tasks.workunit.client.0.smithi117.stdout:0/375: rename d3/d30/d32/f7d to d3/d22/d55/d5a/f82 0 2024-04-12T09:11:06.130 INFO:tasks.workunit.client.0.smithi117.stdout:5/311: mknod d2/d3/de/c64 0 2024-04-12T09:11:06.134 INFO:tasks.workunit.client.0.smithi117.stdout:3/438: write de/d2c/d59/f1b [651185,88040] 0 2024-04-12T09:11:06.140 INFO:tasks.workunit.client.0.smithi117.stdout:7/211: dwrite d0/d2/d22/d17/d23/d2a/f3b [0,4194304] 0 2024-04-12T09:11:06.142 INFO:tasks.workunit.client.0.smithi117.stdout:1/307: truncate d1/d6/d3f/db/d1d/f5b 1047343 0 2024-04-12T09:11:06.143 INFO:tasks.workunit.client.0.smithi117.stdout:4/368: truncate d0/d5/f52 1813084 0 2024-04-12T09:11:06.143 INFO:tasks.workunit.client.0.smithi117.stdout:1/308: fdatasync d1/d6/f14 0 2024-04-12T09:11:06.147 INFO:tasks.workunit.client.0.smithi117.stdout:5/312: rename d2/d3/dd/c13 to d2/d3/dd/c65 0 2024-04-12T09:11:06.149 INFO:tasks.workunit.client.0.smithi117.stdout:4/369: dwrite d0/d5/d3b/f42 [0,4194304] 0 2024-04-12T09:11:06.150 INFO:tasks.workunit.client.0.smithi117.stdout:3/439: dread - de/d2c/d59/d70/d40/d49/f95 zero size 2024-04-12T09:11:06.157 INFO:tasks.workunit.client.0.smithi117.stdout:1/309: dread d1/d6/d3f/db/d1d/d24/d38/d3e/f55 [0,4194304] 0 2024-04-12T09:11:06.159 INFO:tasks.workunit.client.0.smithi117.stdout:3/440: dwrite de/d2c/d59/f24 [0,4194304] 0 2024-04-12T09:11:06.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:05 smithi117 ceph-mon[29277]: pgmap v13: 65 pgs: 65 active+clean; 442 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 1.3 MiB/s rd, 42 MiB/s wr, 225 op/s 2024-04-12T09:11:06.160 INFO:tasks.workunit.client.0.smithi117.stdout:4/370: unlink d0/d2c/d3c/c4a 0 2024-04-12T09:11:06.163 INFO:tasks.workunit.client.0.smithi117.stdout:5/313: mkdir d2/d3/de/d1e/d66 0 2024-04-12T09:11:06.164 INFO:tasks.workunit.client.0.smithi117.stdout:5/314: fdatasync d2/d3/dd/d39/f57 0 2024-04-12T09:11:06.165 INFO:tasks.workunit.client.0.smithi117.stdout:5/315: dread - d2/d3/dd/d39/f61 zero size 2024-04-12T09:11:06.166 INFO:tasks.workunit.client.0.smithi117.stdout:1/310: symlink d1/d6/d3f/db/d1d/d24/d38/d45/d4c/l5c 0 2024-04-12T09:11:06.169 INFO:tasks.workunit.client.0.smithi117.stdout:0/376: getdents d3/d30 0 2024-04-12T09:11:06.169 INFO:tasks.workunit.client.0.smithi117.stdout:3/441: dread de/d2c/d59/d70/d3e/d3f/f43 [0,4194304] 0 2024-04-12T09:11:06.171 INFO:tasks.workunit.client.0.smithi117.stdout:7/212: getdents d0/d20 0 2024-04-12T09:11:06.172 INFO:tasks.workunit.client.0.smithi117.stdout:7/213: truncate d0/f30 412165 0 2024-04-12T09:11:06.177 INFO:tasks.workunit.client.0.smithi117.stdout:3/442: symlink de/d2c/d59/d90/la2 0 2024-04-12T09:11:06.180 INFO:tasks.workunit.client.0.smithi117.stdout:7/214: creat d0/d2/f43 x:0 0 0 2024-04-12T09:11:06.187 INFO:tasks.workunit.client.0.smithi117.stdout:3/443: creat de/d2c/d59/d4c/d62/fa3 x:0 0 0 2024-04-12T09:11:06.190 INFO:tasks.workunit.client.0.smithi117.stdout:0/377: dread d3/d22/f29 [0,4194304] 0 2024-04-12T09:11:06.193 INFO:tasks.workunit.client.0.smithi117.stdout:1/311: rename d1/d6/d3f/db/d1d/d24/f32 to d1/d3b/f5d 0 2024-04-12T09:11:06.202 INFO:tasks.workunit.client.0.smithi117.stdout:3/444: rename de/d2c/d59/d70/c67 to de/d2c/d59/d90/ca4 0 2024-04-12T09:11:06.203 INFO:tasks.workunit.client.0.smithi117.stdout:3/445: truncate de/d2c/d59/d70/d3e/d3f/f43 664423 0 2024-04-12T09:11:06.209 INFO:tasks.workunit.client.0.smithi117.stdout:5/316: dwrite d2/d3/de/d1e/d46/f48 [4194304,4194304] 0 2024-04-12T09:11:06.213 INFO:tasks.workunit.client.0.smithi117.stdout:3/446: dwrite de/d2c/d59/d70/d40/d79/f8a [0,4194304] 0 2024-04-12T09:11:06.215 INFO:tasks.workunit.client.0.smithi117.stdout:7/215: getdents d0/d2 0 2024-04-12T09:11:06.235 INFO:tasks.workunit.client.0.smithi117.stdout:5/317: rename d2/d3/dd/d39/f57 to d2/d3/de/d1e/f67 0 2024-04-12T09:11:06.236 INFO:tasks.workunit.client.0.smithi117.stdout:1/312: dwrite d1/d3b/f4a [4194304,4194304] 0 2024-04-12T09:11:06.241 INFO:tasks.workunit.client.0.smithi117.stdout:0/378: dwrite d3/d30/d32/f45 [0,4194304] 0 2024-04-12T09:11:06.245 INFO:tasks.workunit.client.0.smithi117.stdout:1/313: rmdir d1/d6 39 2024-04-12T09:11:06.251 INFO:tasks.workunit.client.0.smithi117.stdout:7/216: write d0/f1b [3804736,124978] 0 2024-04-12T09:11:06.252 INFO:tasks.workunit.client.0.smithi117.stdout:7/217: truncate d0/f2b 877104 0 2024-04-12T09:11:06.255 INFO:tasks.workunit.client.0.smithi117.stdout:3/447: dwrite de/d2c/d59/d70/d3d/d63/f7e [4194304,4194304] 0 2024-04-12T09:11:06.255 INFO:tasks.workunit.client.0.smithi117.stdout:7/218: dread d0/f30 [0,4194304] 0 2024-04-12T09:11:06.257 INFO:tasks.workunit.client.0.smithi117.stdout:5/318: creat d2/d3/d2e/f68 x:0 0 0 2024-04-12T09:11:06.259 INFO:tasks.workunit.client.0.smithi117.stdout:5/319: write d2/d3/f15 [2487588,109241] 0 2024-04-12T09:11:06.259 INFO:tasks.workunit.client.0.smithi117.stdout:0/379: mkdir d3/d22/d76/d83 0 2024-04-12T09:11:06.264 INFO:tasks.workunit.client.0.smithi117.stdout:1/314: write d1/f4d [185517,121582] 0 2024-04-12T09:11:06.266 INFO:tasks.workunit.client.0.smithi117.stdout:7/219: dwrite d0/d2/d22/f42 [0,4194304] 0 2024-04-12T09:11:06.266 INFO:tasks.workunit.client.0.smithi117.stdout:7/220: readlink d0/d2/l11 0 2024-04-12T09:11:06.272 INFO:tasks.workunit.client.0.smithi117.stdout:0/380: write d3/d22/d55/d5a/f82 [716156,14928] 0 2024-04-12T09:11:06.274 INFO:tasks.workunit.client.0.smithi117.stdout:7/221: dwrite d0/d2/d22/f42 [0,4194304] 0 2024-04-12T09:11:06.275 INFO:tasks.workunit.client.0.smithi117.stdout:7/222: readlink d0/l9 0 2024-04-12T09:11:06.275 INFO:tasks.workunit.client.0.smithi117.stdout:1/315: write d1/d6/f34 [2224131,80555] 0 2024-04-12T09:11:06.278 INFO:tasks.workunit.client.0.smithi117.stdout:3/448: mkdir de/d2c/d59/d70/da5 0 2024-04-12T09:11:06.280 INFO:tasks.workunit.client.0.smithi117.stdout:5/320: mkdir d2/d3/de/d1e/d2c/d69 0 2024-04-12T09:11:06.281 INFO:tasks.workunit.client.0.smithi117.stdout:0/381: mkdir d3/d59/d6a/d84 0 2024-04-12T09:11:06.284 INFO:tasks.workunit.client.0.smithi117.stdout:7/223: creat d0/d2/d22/d17/f44 x:0 0 0 2024-04-12T09:11:06.286 INFO:tasks.workunit.client.0.smithi117.stdout:3/449: unlink de/f14 0 2024-04-12T09:11:06.289 INFO:tasks.workunit.client.0.smithi117.stdout:5/321: mknod d2/d3/d2e/d4d/c6a 0 2024-04-12T09:11:06.289 INFO:tasks.workunit.client.0.smithi117.stdout:5/322: chown d2/f28 226278449 1 2024-04-12T09:11:06.290 INFO:tasks.workunit.client.0.smithi117.stdout:5/323: chown d2/d3/d2e/d4d/c6a 634 1 2024-04-12T09:11:06.290 INFO:tasks.workunit.client.0.smithi117.stdout:0/382: mkdir d3/d22/d76/d85 0 2024-04-12T09:11:06.296 INFO:tasks.workunit.client.0.smithi117.stdout:5/324: mkdir d2/d3/d2e/d4d/d6b 0 2024-04-12T09:11:06.299 INFO:tasks.workunit.client.0.smithi117.stdout:0/383: rename d3/dc/f56 to d3/d30/d32/f86 0 2024-04-12T09:11:06.301 INFO:tasks.workunit.client.0.smithi117.stdout:1/316: mknod d1/d6/d3f/db/d1d/d24/d54/c5e 0 2024-04-12T09:11:06.302 INFO:tasks.workunit.client.0.smithi117.stdout:1/317: fdatasync d1/d6/d3f/db/f31 0 2024-04-12T09:11:06.303 INFO:tasks.workunit.client.0.smithi117.stdout:5/325: creat d2/d3/d2e/d4d/f6c x:0 0 0 2024-04-12T09:11:06.304 INFO:tasks.workunit.client.0.smithi117.stdout:7/224: rename d0/d2/d22 to d0/d2/d45 0 2024-04-12T09:11:06.308 INFO:tasks.workunit.client.0.smithi117.stdout:0/384: symlink d3/d59/l87 0 2024-04-12T09:11:06.309 INFO:tasks.workunit.client.0.smithi117.stdout:3/450: link de/d2c/d59/d70/d3e/d3f/c81 de/d2c/d59/d70/d3d/ca6 0 2024-04-12T09:11:06.309 INFO:tasks.workunit.client.0.smithi117.stdout:7/225: dwrite d0/f1b [0,4194304] 0 2024-04-12T09:11:06.311 INFO:tasks.workunit.client.0.smithi117.stdout:1/318: write d1/f49 [4558953,33345] 0 2024-04-12T09:11:06.312 INFO:tasks.workunit.client.0.smithi117.stdout:5/326: creat d2/d3/dd/f6d x:0 0 0 2024-04-12T09:11:06.316 INFO:tasks.workunit.client.0.smithi117.stdout:0/385: symlink d3/d59/d6a/l88 0 2024-04-12T09:11:06.319 INFO:tasks.workunit.client.0.smithi117.stdout:7/226: unlink d0/d2/d45/c36 0 2024-04-12T09:11:06.322 INFO:tasks.workunit.client.0.smithi117.stdout:7/227: read d0/d2/d45/f28 [1705812,51458] 0 2024-04-12T09:11:06.324 INFO:tasks.workunit.client.0.smithi117.stdout:1/319: unlink d1/d6/f34 0 2024-04-12T09:11:06.326 INFO:tasks.workunit.client.0.smithi117.stdout:5/327: symlink d2/d3/dd/d39/l6e 0 2024-04-12T09:11:06.326 INFO:tasks.workunit.client.0.smithi117.stdout:3/451: dwrite de/d2c/d59/d19/f29 [4194304,4194304] 0 2024-04-12T09:11:06.327 INFO:tasks.workunit.client.0.smithi117.stdout:1/320: write d1/d6/d3f/f35 [4016641,73576] 0 2024-04-12T09:11:06.331 INFO:tasks.workunit.client.0.smithi117.stdout:0/386: mkdir d3/d22/d55/d89 0 2024-04-12T09:11:06.341 INFO:tasks.workunit.client.0.smithi117.stdout:1/321: mknod d1/d6/d3f/c5f 0 2024-04-12T09:11:06.345 INFO:tasks.workunit.client.0.smithi117.stdout:7/228: dread d0/d2/f16 [0,4194304] 0 2024-04-12T09:11:06.346 INFO:tasks.workunit.client.0.smithi117.stdout:7/229: stat d0/d2/d45/d17 0 2024-04-12T09:11:06.348 INFO:tasks.workunit.client.0.smithi117.stdout:5/328: creat d2/d3/de/d1e/d2c/d69/f6f x:0 0 0 2024-04-12T09:11:06.350 INFO:tasks.workunit.client.0.smithi117.stdout:1/322: symlink d1/d6/d51/l60 0 2024-04-12T09:11:06.353 INFO:tasks.workunit.client.0.smithi117.stdout:0/387: creat d3/d47/f8a x:0 0 0 2024-04-12T09:11:06.354 INFO:tasks.workunit.client.0.smithi117.stdout:3/452: chown de/d2c/d59/d70/d3e/d5d/d80 0 1 2024-04-12T09:11:06.357 INFO:tasks.workunit.client.0.smithi117.stdout:7/230: creat d0/d2/d45/d17/d23/d2a/f46 x:0 0 0 2024-04-12T09:11:06.359 INFO:tasks.workunit.client.0.smithi117.stdout:5/329: rename d2/d3/de/d1e/d46/f50 to d2/d3/d2e/d4d/d52/f70 0 2024-04-12T09:11:06.362 INFO:tasks.workunit.client.0.smithi117.stdout:0/388: symlink d3/d30/l8b 0 2024-04-12T09:11:06.366 INFO:tasks.workunit.client.0.smithi117.stdout:1/323: link d1/d6/d3f/db/f31 d1/d6/d3f/f61 0 2024-04-12T09:11:06.366 INFO:tasks.workunit.client.0.smithi117.stdout:5/330: dwrite d2/d3/dd/d39/f61 [0,4194304] 0 2024-04-12T09:11:06.370 INFO:tasks.workunit.client.0.smithi117.stdout:0/389: mknod d3/d22/d55/d5a/d62/d66/c8c 0 2024-04-12T09:11:06.371 INFO:tasks.workunit.client.0.smithi117.stdout:3/453: creat de/d2c/fa7 x:0 0 0 2024-04-12T09:11:06.372 INFO:tasks.workunit.client.0.smithi117.stdout:3/454: dread - de/d2c/f96 zero size 2024-04-12T09:11:06.374 INFO:tasks.workunit.client.0.smithi117.stdout:1/324: symlink d1/d6/d3f/db/d16/l62 0 2024-04-12T09:11:06.375 INFO:tasks.workunit.client.0.smithi117.stdout:5/331: creat d2/d3/de/d1e/d2c/d69/f71 x:0 0 0 2024-04-12T09:11:06.377 INFO:tasks.workunit.client.0.smithi117.stdout:7/231: link d0/d2/d45/d17/f44 d0/f47 0 2024-04-12T09:11:06.381 INFO:tasks.workunit.client.0.smithi117.stdout:3/455: chown de/c26 4904836 1 2024-04-12T09:11:06.386 INFO:tasks.workunit.client.0.smithi117.stdout:5/332: symlink d2/d3/de/d1e/d2c/d69/l72 0 2024-04-12T09:11:06.387 INFO:tasks.workunit.client.0.smithi117.stdout:5/333: readlink d2/d3/de/d1e/d35/l25 0 2024-04-12T09:11:06.390 INFO:tasks.workunit.client.0.smithi117.stdout:3/456: mkdir de/d2c/d59/d4c/da0/da8 0 2024-04-12T09:11:06.393 INFO:tasks.workunit.client.0.smithi117.stdout:0/390: rmdir d3/d22/d55/d5a 39 2024-04-12T09:11:06.394 INFO:tasks.workunit.client.0.smithi117.stdout:0/391: chown d3/d30/f61 48164061 1 2024-04-12T09:11:06.394 INFO:tasks.workunit.client.0.smithi117.stdout:1/325: dread d1/f13 [0,4194304] 0 2024-04-12T09:11:06.394 INFO:tasks.workunit.client.0.smithi117.stdout:3/457: symlink de/d2c/d59/d90/la9 0 2024-04-12T09:11:06.400 INFO:tasks.workunit.client.0.smithi117.stdout:0/392: dread d3/d22/d55/d5a/f82 [0,4194304] 0 2024-04-12T09:11:06.403 INFO:tasks.workunit.client.0.smithi117.stdout:3/458: dread de/d2c/d59/d70/d3e/f8b [0,4194304] 0 2024-04-12T09:11:06.404 INFO:tasks.workunit.client.0.smithi117.stdout:3/459: dread - de/d2c/d59/d19/f7f zero size 2024-04-12T09:11:06.405 INFO:tasks.workunit.client.0.smithi117.stdout:0/393: creat d3/d30/d32/f8d x:0 0 0 2024-04-12T09:11:06.406 INFO:tasks.workunit.client.0.smithi117.stdout:0/394: write d3/d30/d32/f8d [74700,81505] 0 2024-04-12T09:11:06.407 INFO:tasks.workunit.client.0.smithi117.stdout:5/334: rename d2/d3/de/d1e/c60 to d2/d3/c73 0 2024-04-12T09:11:06.408 INFO:tasks.workunit.client.0.smithi117.stdout:5/335: read - d2/d3/de/d1e/d2c/d69/f71 zero size 2024-04-12T09:11:06.409 INFO:tasks.workunit.client.0.smithi117.stdout:5/336: fdatasync d2/d3/de/d1e/d46/f48 0 2024-04-12T09:11:06.410 INFO:tasks.workunit.client.0.smithi117.stdout:5/337: chown d2/d3/de/d1e/d35/f3b 215780210 1 2024-04-12T09:11:06.410 INFO:tasks.workunit.client.0.smithi117.stdout:5/338: chown d2/d3 0 1 2024-04-12T09:11:06.413 INFO:tasks.workunit.client.0.smithi117.stdout:3/460: mkdir de/d2c/d59/d4c/da0/daa 0 2024-04-12T09:11:06.416 INFO:tasks.workunit.client.0.smithi117.stdout:1/326: getdents d1 0 2024-04-12T09:11:06.417 INFO:tasks.workunit.client.0.smithi117.stdout:3/461: symlink de/d2c/d59/d19/d4f/lab 0 2024-04-12T09:11:06.419 INFO:tasks.workunit.client.0.smithi117.stdout:3/462: truncate de/d2c/d59/d90/f98 252736 0 2024-04-12T09:11:06.420 INFO:tasks.workunit.client.0.smithi117.stdout:5/339: mkdir d2/d3/d2e/d74 0 2024-04-12T09:11:06.420 INFO:tasks.workunit.client.0.smithi117.stdout:3/463: truncate de/d2c/d59/f23 4443752 0 2024-04-12T09:11:06.421 INFO:tasks.workunit.client.0.smithi117.stdout:5/340: dread - d2/d3/de/d1e/d35/f63 zero size 2024-04-12T09:11:06.422 INFO:tasks.workunit.client.0.smithi117.stdout:3/464: write de/d2c/d59/d70/d3e/f41 [3800083,118313] 0 2024-04-12T09:11:06.425 INFO:tasks.workunit.client.0.smithi117.stdout:0/395: getdents d3/d47 0 2024-04-12T09:11:06.427 INFO:tasks.workunit.client.0.smithi117.stdout:5/341: unlink d2/d3/dd/d39/l6e 0 2024-04-12T09:11:06.431 INFO:tasks.workunit.client.0.smithi117.stdout:1/327: mkdir d1/d6/d3f/db/d1d/d24/d38/d45/d4c/d63 0 2024-04-12T09:11:06.432 INFO:tasks.workunit.client.0.smithi117.stdout:0/396: creat d3/dc/f8e x:0 0 0 2024-04-12T09:11:06.433 INFO:tasks.workunit.client.0.smithi117.stdout:1/328: write d1/d6/d3f/f20 [1473018,50259] 0 2024-04-12T09:11:06.437 INFO:tasks.workunit.client.0.smithi117.stdout:0/397: fdatasync d3/d22/d55/d5a/f82 0 2024-04-12T09:11:06.439 INFO:tasks.workunit.client.0.smithi117.stdout:1/329: dread d1/d6/d3f/db/f31 [0,4194304] 0 2024-04-12T09:11:06.440 INFO:tasks.workunit.client.0.smithi117.stdout:3/465: dread de/d2c/d59/f5b [0,4194304] 0 2024-04-12T09:11:06.440 INFO:tasks.workunit.client.0.smithi117.stdout:1/330: read d1/d6/d3f/f61 [645437,109340] 0 2024-04-12T09:11:06.443 INFO:tasks.workunit.client.0.smithi117.stdout:1/331: rmdir d1/d6/d3f/db/d1d/d24/d38/d45/d4c 39 2024-04-12T09:11:06.444 INFO:tasks.workunit.client.0.smithi117.stdout:1/332: chown d1/d6/d3f/db/f31 47429323 1 2024-04-12T09:11:06.445 INFO:tasks.workunit.client.0.smithi117.stdout:1/333: stat d1/d6/d3f/db/d1d/d24 0 2024-04-12T09:11:06.447 INFO:tasks.workunit.client.0.smithi117.stdout:3/466: getdents de/d2c/d59/d19 0 2024-04-12T09:11:06.448 INFO:tasks.workunit.client.0.smithi117.stdout:3/467: chown de/d2c/d59/d70/d3e/d84/f88 3 1 2024-04-12T09:11:06.448 INFO:tasks.workunit.client.0.smithi117.stdout:1/334: rename d1/d6/d3f/db/d1d/d24/d38 to d1/d64 0 2024-04-12T09:11:06.455 INFO:tasks.workunit.client.0.smithi117.stdout:3/468: dwrite de/d2c/d59/d30/f60 [0,4194304] 0 2024-04-12T09:11:06.456 INFO:tasks.workunit.client.0.smithi117.stdout:1/335: fsync d1/d6/d3f/f35 0 2024-04-12T09:11:06.459 INFO:tasks.workunit.client.0.smithi117.stdout:3/469: mkdir de/d2c/d59/d4c/da0/da8/dac 0 2024-04-12T09:11:06.460 INFO:tasks.workunit.client.0.smithi117.stdout:1/336: creat d1/f65 x:0 0 0 2024-04-12T09:11:06.461 INFO:tasks.workunit.client.0.smithi117.stdout:3/470: mknod de/d2c/d59/d19/d27/cad 0 2024-04-12T09:11:06.462 INFO:tasks.workunit.client.0.smithi117.stdout:3/471: readlink de/l78 0 2024-04-12T09:11:06.464 INFO:tasks.workunit.client.0.smithi117.stdout:1/337: truncate d1/d6/d3f/db/d16/f2f 380630 0 2024-04-12T09:11:06.465 INFO:tasks.workunit.client.0.smithi117.stdout:3/472: mkdir de/d2c/d59/d70/d3e/d3f/dae 0 2024-04-12T09:11:06.468 INFO:tasks.workunit.client.0.smithi117.stdout:3/473: getdents de/d2c/d59/d70/d3e/d5d/d89/d8d 0 2024-04-12T09:11:06.469 INFO:tasks.workunit.client.0.smithi117.stdout:3/474: dread - de/d2c/d59/d4c/f7b zero size 2024-04-12T09:11:06.471 INFO:tasks.workunit.client.0.smithi117.stdout:3/475: fsync de/d2c/d59/d70/d3e/f50 0 2024-04-12T09:11:06.474 INFO:tasks.workunit.client.0.smithi117.stdout:3/476: symlink de/d2c/d59/d4c/da0/daa/laf 0 2024-04-12T09:11:06.480 INFO:tasks.workunit.client.0.smithi117.stdout:3/477: link de/d2c/d59/f23 de/d2c/d59/d70/d3e/d5d/d80/d82/fb0 0 2024-04-12T09:11:06.480 INFO:tasks.workunit.client.0.smithi117.stdout:3/478: readlink de/l6f 0 2024-04-12T09:11:06.481 INFO:tasks.workunit.client.0.smithi117.stdout:1/338: dread d1/d6/d3f/db/f33 [0,4194304] 0 2024-04-12T09:11:06.486 INFO:tasks.workunit.client.0.smithi117.stdout:3/479: truncate de/d2c/d59/d19/d27/f44 1545001 0 2024-04-12T09:11:06.486 INFO:tasks.workunit.client.0.smithi117.stdout:1/339: rename d1/d6/d3f/db/d1d/l3a to d1/d6/l66 0 2024-04-12T09:11:06.486 INFO:tasks.workunit.client.0.smithi117.stdout:3/480: symlink de/d2c/d59/d19/d27/lb1 0 2024-04-12T09:11:06.487 INFO:tasks.workunit.client.0.smithi117.stdout:1/340: creat d1/d6/d51/f67 x:0 0 0 2024-04-12T09:11:06.488 INFO:tasks.workunit.client.0.smithi117.stdout:1/341: fdatasync d1/d6/f14 0 2024-04-12T09:11:06.488 INFO:tasks.workunit.client.0.smithi117.stdout:3/481: creat de/d2c/d59/d19/d27/fb2 x:0 0 0 2024-04-12T09:11:06.493 INFO:tasks.workunit.client.0.smithi117.stdout:1/342: creat d1/d64/d45/d4c/f68 x:0 0 0 2024-04-12T09:11:06.496 INFO:tasks.workunit.client.0.smithi117.stdout:3/482: dwrite de/d2c/d59/d70/d40/d49/f6e [0,4194304] 0 2024-04-12T09:11:06.497 INFO:tasks.workunit.client.0.smithi117.stdout:1/343: creat d1/d64/d45/d4c/d63/f69 x:0 0 0 2024-04-12T09:11:06.501 INFO:tasks.workunit.client.0.smithi117.stdout:3/483: creat de/d2c/d59/d70/d3e/d5d/d80/fb3 x:0 0 0 2024-04-12T09:11:06.508 INFO:tasks.workunit.client.0.smithi117.stdout:3/484: link de/d2c/d59/d19/c6a de/d2c/d59/d70/d3e/d5d/d80/d82/cb4 0 2024-04-12T09:11:06.509 INFO:tasks.workunit.client.0.smithi117.stdout:1/344: rmdir d1/d6 39 2024-04-12T09:11:06.509 INFO:tasks.workunit.client.0.smithi117.stdout:3/485: fdatasync de/d2c/d59/d4c/d62/fa3 0 2024-04-12T09:11:06.510 INFO:tasks.workunit.client.0.smithi117.stdout:3/486: dread - de/d2c/f96 zero size 2024-04-12T09:11:06.511 INFO:tasks.workunit.client.0.smithi117.stdout:1/345: symlink d1/d64/d3e/l6a 0 2024-04-12T09:11:06.512 INFO:tasks.workunit.client.0.smithi117.stdout:3/487: mkdir de/d2c/d59/d70/d3e/d5d/db5 0 2024-04-12T09:11:06.517 INFO:tasks.workunit.client.0.smithi117.stdout:3/488: creat de/d2c/d59/d70/d3e/d84/fb6 x:0 0 0 2024-04-12T09:11:06.597 INFO:tasks.workunit.client.0.smithi117.stdout:9/294: sync 2024-04-12T09:11:06.609 INFO:tasks.workunit.client.0.smithi117.stdout:9/295: read - d1/d8/d12/f59 zero size 2024-04-12T09:11:06.609 INFO:tasks.workunit.client.0.smithi117.stdout:1/346: write d1/f13 [2582767,37912] 0 2024-04-12T09:11:06.611 INFO:tasks.workunit.client.0.smithi117.stdout:3/489: creat de/d2c/d59/d30/fb7 x:0 0 0 2024-04-12T09:11:06.614 INFO:tasks.workunit.client.0.smithi117.stdout:1/347: symlink d1/l6b 0 2024-04-12T09:11:06.620 INFO:tasks.workunit.client.0.smithi117.stdout:3/490: dwrite de/d2c/d59/d30/fb7 [0,4194304] 0 2024-04-12T09:11:06.622 INFO:tasks.workunit.client.0.smithi117.stdout:1/348: getdents d1/d64/d3e 0 2024-04-12T09:11:06.627 INFO:tasks.workunit.client.0.smithi117.stdout:3/491: creat de/d2c/d59/d4c/da0/da8/fb8 x:0 0 0 2024-04-12T09:11:06.632 INFO:tasks.workunit.client.0.smithi117.stdout:3/492: rename de/d2c/d59/d19/d27/f44 to de/d2c/d59/d4c/da0/fb9 0 2024-04-12T09:11:06.632 INFO:tasks.workunit.client.0.smithi117.stdout:9/296: dread d1/d8/df/d3e/f2b [0,4194304] 0 2024-04-12T09:11:06.634 INFO:tasks.workunit.client.0.smithi117.stdout:1/349: symlink d1/d6/d3f/db/d1d/d24/l6c 0 2024-04-12T09:11:06.634 INFO:tasks.workunit.client.0.smithi117.stdout:9/297: truncate d1/d8/d12/f59 428940 0 2024-04-12T09:11:06.637 INFO:tasks.workunit.client.0.smithi117.stdout:3/493: write de/d2c/d59/d4c/da0/fb9 [1144324,8758] 0 2024-04-12T09:11:06.638 INFO:tasks.workunit.client.0.smithi117.stdout:9/298: mknod d1/d8/df/d1b/c5c 0 2024-04-12T09:11:06.642 INFO:tasks.workunit.client.0.smithi117.stdout:3/494: creat de/d2c/d59/d70/d3e/d3f/dae/fba x:0 0 0 2024-04-12T09:11:06.648 INFO:tasks.workunit.client.0.smithi117.stdout:3/495: getdents de/d2c 0 2024-04-12T09:11:06.649 INFO:tasks.workunit.client.0.smithi117.stdout:3/496: write de/d2c/fa7 [141426,106358] 0 2024-04-12T09:11:06.651 INFO:tasks.workunit.client.0.smithi117.stdout:3/497: write de/d2c/d59/d70/d3e/d3f/f58 [432137,58945] 0 2024-04-12T09:11:06.651 INFO:tasks.workunit.client.0.smithi117.stdout:3/498: readlink de/d2c/d59/l18 0 2024-04-12T09:11:06.655 INFO:tasks.workunit.client.0.smithi117.stdout:3/499: creat de/d2c/d59/d4c/da0/da8/dac/fbb x:0 0 0 2024-04-12T09:11:06.672 INFO:tasks.workunit.client.0.smithi117.stdout:3/500: dwrite de/d2c/d59/d70/d3e/f50 [0,4194304] 0 2024-04-12T09:11:06.677 INFO:tasks.workunit.client.0.smithi117.stdout:3/501: rename de/d2c/d59/d30/f60 to de/d2c/d59/d70/d40/d49/fbc 0 2024-04-12T09:11:06.678 INFO:tasks.workunit.client.0.smithi117.stdout:3/502: readlink de/d2c/d59/d19/l25 0 2024-04-12T09:11:06.679 INFO:tasks.workunit.client.0.smithi117.stdout:3/503: write de/f7d [368551,35366] 0 2024-04-12T09:11:06.681 INFO:tasks.workunit.client.0.smithi117.stdout:3/504: creat de/d2c/d59/d4c/da0/daa/fbd x:0 0 0 2024-04-12T09:11:06.688 INFO:tasks.workunit.client.0.smithi117.stdout:3/505: link de/d2c/d59/d70/d3d/c65 de/d2c/d59/d70/d3e/d5d/d80/cbe 0 2024-04-12T09:11:06.691 INFO:tasks.workunit.client.0.smithi117.stdout:3/506: creat de/d2c/d59/d4c/da0/da8/dac/fbf x:0 0 0 2024-04-12T09:11:06.699 INFO:tasks.workunit.client.0.smithi117.stdout:3/507: dwrite de/d2c/d59/d19/f9e [0,4194304] 0 2024-04-12T09:11:06.702 INFO:tasks.workunit.client.0.smithi117.stdout:3/508: dread de/d2c/d59/d19/f9e [0,4194304] 0 2024-04-12T09:11:06.702 INFO:tasks.workunit.client.0.smithi117.stdout:3/509: readlink l9 0 2024-04-12T09:11:06.703 INFO:tasks.workunit.client.0.smithi117.stdout:8/272: sync 2024-04-12T09:11:06.704 INFO:tasks.workunit.client.0.smithi117.stdout:3/510: truncate de/d2c/d59/d4c/f7b 124483 0 2024-04-12T09:11:06.707 INFO:tasks.workunit.client.0.smithi117.stdout:8/273: creat db/d13/d38/f5c x:0 0 0 2024-04-12T09:11:06.708 INFO:tasks.workunit.client.0.smithi117.stdout:3/511: mkdir de/d2c/dc0 0 2024-04-12T09:11:06.713 INFO:tasks.workunit.client.0.smithi117.stdout:8/274: getdents db/d19 0 2024-04-12T09:11:06.718 INFO:tasks.workunit.client.0.smithi117.stdout:8/275: getdents db/d13 0 2024-04-12T09:11:06.722 INFO:tasks.workunit.client.0.smithi117.stdout:3/512: rmdir de/d2c/d59/d70/d3d/d63 39 2024-04-12T09:11:06.724 INFO:tasks.workunit.client.0.smithi117.stdout:3/513: fsync de/d2c/fa7 0 2024-04-12T09:11:06.725 INFO:tasks.workunit.client.0.smithi117.stdout:3/514: write fa [4306612,33793] 0 2024-04-12T09:11:06.725 INFO:tasks.workunit.client.0.smithi117.stdout:3/515: dread - de/d2c/d59/d4c/f57 zero size 2024-04-12T09:11:06.727 INFO:tasks.workunit.client.0.smithi117.stdout:3/516: write de/d2c/fa7 [528216,58646] 0 2024-04-12T09:11:06.729 INFO:tasks.workunit.client.0.smithi117.stdout:3/517: mknod de/d2c/d59/d4c/d62/cc1 0 2024-04-12T09:11:06.730 INFO:tasks.workunit.client.0.smithi117.stdout:3/518: chown de/d2c/d59/f24 51871 1 2024-04-12T09:11:06.741 INFO:tasks.workunit.client.0.smithi117.stdout:3/519: dread de/d2c/d59/d70/d3e/d5d/f46 [0,4194304] 0 2024-04-12T09:11:06.746 INFO:tasks.workunit.client.0.smithi117.stdout:3/520: dwrite fa [4194304,4194304] 0 2024-04-12T09:11:06.747 INFO:tasks.workunit.client.0.smithi117.stdout:3/521: chown de/d2c/d59/d70/d40/d49/l87 5562090 1 2024-04-12T09:11:06.748 INFO:tasks.workunit.client.0.smithi117.stdout:3/522: dread - de/d2c/d59/d19/d27/fb2 zero size 2024-04-12T09:11:06.786 INFO:tasks.workunit.client.0.smithi117.stdout:3/523: symlink de/d2c/d59/d70/d3d/d63/lc2 0 2024-04-12T09:11:06.787 INFO:tasks.workunit.client.0.smithi117.stdout:3/524: dread - de/d2c/d59/d70/d3e/f5a zero size 2024-04-12T09:11:06.792 INFO:tasks.workunit.client.0.smithi117.stdout:3/525: link de/d2c/d59/d70/d3e/d5d/d80/c75 de/d2c/d59/d19/d27/cc3 0 2024-04-12T09:11:06.798 INFO:tasks.workunit.client.0.smithi117.stdout:3/526: dwrite de/d2c/d59/f42 [0,4194304] 0 2024-04-12T09:11:06.800 INFO:tasks.workunit.client.0.smithi117.stdout:3/527: write de/d2c/d59/d4c/f7b [500384,97576] 0 2024-04-12T09:11:06.804 INFO:tasks.workunit.client.0.smithi117.stdout:3/528: mknod de/d2c/d59/cc4 0 2024-04-12T09:11:06.806 INFO:tasks.workunit.client.0.smithi117.stdout:3/529: rename de/d2c/d59/d4c/c94 to de/d2c/d59/d90/cc5 0 2024-04-12T09:11:06.808 INFO:tasks.workunit.client.0.smithi117.stdout:3/530: mkdir de/d2c/d59/d4c/da0/dc6 0 2024-04-12T09:11:06.809 INFO:tasks.workunit.client.0.smithi117.stdout:3/531: fdatasync de/d2c/d59/d70/d3e/d3f/f58 0 2024-04-12T09:11:06.810 INFO:tasks.workunit.client.0.smithi117.stdout:3/532: chown de/d2c/d59/d90/f98 2 1 2024-04-12T09:11:06.813 INFO:tasks.workunit.client.0.smithi117.stdout:3/533: truncate de/d2c/d59/d70/d3e/d5d/d89/d68/f92 336535 0 2024-04-12T09:11:06.815 INFO:tasks.workunit.client.0.smithi117.stdout:3/534: chown de/d2c/d59/d70/d3e/d5d/d89/d68/f8f 6932763 1 2024-04-12T09:11:06.817 INFO:tasks.workunit.client.0.smithi117.stdout:3/535: mknod de/d2c/d59/d70/cc7 0 2024-04-12T09:11:06.827 INFO:tasks.workunit.client.0.smithi117.stdout:3/536: truncate de/d2c/d59/d70/d3e/d5d/f64 1528689 0 2024-04-12T09:11:06.830 INFO:tasks.workunit.client.0.smithi117.stdout:6/301: sync 2024-04-12T09:11:06.837 INFO:tasks.workunit.client.0.smithi117.stdout:3/537: write de/d2c/d59/f23 [553699,16205] 0 2024-04-12T09:11:06.838 INFO:tasks.workunit.client.0.smithi117.stdout:6/302: dwrite d8/f64 [0,4194304] 0 2024-04-12T09:11:06.839 INFO:tasks.workunit.client.0.smithi117.stdout:6/303: readlink d8/d3a/l44 0 2024-04-12T09:11:06.841 INFO:tasks.workunit.client.0.smithi117.stdout:3/538: mkdir de/d2c/d59/d70/d3d/d63/dc8 0 2024-04-12T09:11:06.842 INFO:tasks.workunit.client.0.smithi117.stdout:3/539: chown de/d2c/d59/d70/d3d/f9f 8435 1 2024-04-12T09:11:06.844 INFO:tasks.workunit.client.0.smithi117.stdout:3/540: write de/d2c/d59/d19/f9e [578089,108117] 0 2024-04-12T09:11:06.846 INFO:tasks.workunit.client.0.smithi117.stdout:3/541: readlink de/d2c/d59/d90/la9 0 2024-04-12T09:11:06.848 INFO:tasks.workunit.client.0.smithi117.stdout:3/542: symlink de/d2c/d59/d70/d3d/d63/lc9 0 2024-04-12T09:11:06.850 INFO:tasks.workunit.client.0.smithi117.stdout:3/543: mknod de/d2c/d59/d70/d3d/d63/cca 0 2024-04-12T09:11:06.853 INFO:tasks.workunit.client.0.smithi117.stdout:3/544: getdents de/d2c/d59/d70/d3e/d3f 0 2024-04-12T09:11:06.856 INFO:tasks.workunit.client.0.smithi117.stdout:3/545: symlink de/d2c/d59/d70/lcb 0 2024-04-12T09:11:06.856 INFO:tasks.workunit.client.0.smithi117.stdout:3/546: chown de/d2c/d59/d19 15480668 1 2024-04-12T09:11:06.859 INFO:tasks.workunit.client.0.smithi117.stdout:6/304: dread d8/d3a/d49/f4e [0,4194304] 0 2024-04-12T09:11:06.861 INFO:tasks.workunit.client.0.smithi117.stdout:6/305: mknod d8/d9/d17/d33/c66 0 2024-04-12T09:11:06.868 INFO:tasks.workunit.client.0.smithi117.stdout:6/306: write d8/d9/f29 [2430210,21644] 0 2024-04-12T09:11:06.869 INFO:tasks.workunit.client.0.smithi117.stdout:6/307: chown d8/d9/f1f 23 1 2024-04-12T09:11:06.871 INFO:tasks.workunit.client.0.smithi117.stdout:6/308: write f2 [3028306,21814] 0 2024-04-12T09:11:06.871 INFO:tasks.workunit.client.0.smithi117.stdout:3/547: dwrite de/d2c/d59/d70/d3e/d5d/f64 [0,4194304] 0 2024-04-12T09:11:06.872 INFO:tasks.workunit.client.0.smithi117.stdout:4/371: sync 2024-04-12T09:11:06.872 INFO:tasks.workunit.client.0.smithi117.stdout:2/243: sync 2024-04-12T09:11:06.874 INFO:tasks.workunit.client.0.smithi117.stdout:6/309: write d8/d9/f1f [548566,5784] 0 2024-04-12T09:11:06.878 INFO:tasks.workunit.client.0.smithi117.stdout:2/244: unlink d0/df/c12 0 2024-04-12T09:11:06.879 INFO:tasks.workunit.client.0.smithi117.stdout:4/372: creat d0/d5/d39/f77 x:0 0 0 2024-04-12T09:11:06.882 INFO:tasks.workunit.client.0.smithi117.stdout:6/310: rename d8/d9/d17/f5a to d8/d3f/d51/f67 0 2024-04-12T09:11:06.883 INFO:tasks.workunit.client.0.smithi117.stdout:2/245: mkdir d0/d43/d53 0 2024-04-12T09:11:06.885 INFO:tasks.workunit.client.0.smithi117.stdout:3/548: write de/d2c/d59/d70/d3e/d5d/f46 [514874,1742] 0 2024-04-12T09:11:06.887 INFO:tasks.workunit.client.0.smithi117.stdout:4/373: symlink d0/d1/d34/l78 0 2024-04-12T09:11:06.888 INFO:tasks.workunit.client.0.smithi117.stdout:3/549: write de/d2c/d59/d70/d3e/f41 [1138528,103560] 0 2024-04-12T09:11:06.888 INFO:tasks.workunit.client.0.smithi117.stdout:2/246: dread d0/df/f46 [0,4194304] 0 2024-04-12T09:11:06.894 INFO:tasks.workunit.client.0.smithi117.stdout:2/247: rmdir d0/d43/d4b 39 2024-04-12T09:11:06.894 INFO:tasks.workunit.client.0.smithi117.stdout:6/311: dread d8/d3a/f3b [0,4194304] 0 2024-04-12T09:11:06.894 INFO:tasks.workunit.client.0.smithi117.stdout:3/550: creat de/d2c/d59/d4c/d62/fcc x:0 0 0 2024-04-12T09:11:06.896 INFO:tasks.workunit.client.0.smithi117.stdout:2/248: creat d0/d4/f54 x:0 0 0 2024-04-12T09:11:06.898 INFO:tasks.workunit.client.0.smithi117.stdout:3/551: stat de/d2c/f99 0 2024-04-12T09:11:06.901 INFO:tasks.workunit.client.0.smithi117.stdout:2/249: symlink d0/d43/d30/l55 0 2024-04-12T09:11:06.902 INFO:tasks.workunit.client.0.smithi117.stdout:2/250: fdatasync d0/d4/d10/d27/f2e 0 2024-04-12T09:11:06.904 INFO:tasks.workunit.client.0.smithi117.stdout:6/312: creat d8/d9/d17/f68 x:0 0 0 2024-04-12T09:11:06.907 INFO:tasks.workunit.client.0.smithi117.stdout:4/374: write d0/d1/d34/f28 [4245439,63648] 0 2024-04-12T09:11:06.911 INFO:tasks.workunit.client.0.smithi117.stdout:6/313: symlink d8/l69 0 2024-04-12T09:11:06.913 INFO:tasks.workunit.client.0.smithi117.stdout:3/552: dwrite de/f8e [0,4194304] 0 2024-04-12T09:11:06.914 INFO:tasks.workunit.client.0.smithi117.stdout:2/251: creat d0/d43/f56 x:0 0 0 2024-04-12T09:11:06.915 INFO:tasks.workunit.client.0.smithi117.stdout:4/375: unlink d0/d72/l2e 0 2024-04-12T09:11:06.916 INFO:tasks.workunit.client.0.smithi117.stdout:4/376: chown d0/d5/d43/f75 29 1 2024-04-12T09:11:06.919 INFO:tasks.workunit.client.0.smithi117.stdout:6/314: mknod d8/c6a 0 2024-04-12T09:11:06.920 INFO:tasks.workunit.client.0.smithi117.stdout:6/315: chown d8/d3a/d49 1 1 2024-04-12T09:11:06.920 INFO:tasks.workunit.client.0.smithi117.stdout:3/553: mkdir de/d2c/dc0/dcd 0 2024-04-12T09:11:06.923 INFO:tasks.workunit.client.0.smithi117.stdout:4/377: rename d0/d2c/d66 to d0/d5/d3b/d38/d4f/d79 0 2024-04-12T09:11:06.924 INFO:tasks.workunit.client.0.smithi117.stdout:1/350: sync 2024-04-12T09:11:06.924 INFO:tasks.workunit.client.0.smithi117.stdout:0/398: sync 2024-04-12T09:11:06.924 INFO:tasks.workunit.client.0.smithi117.stdout:8/276: sync 2024-04-12T09:11:06.924 INFO:tasks.workunit.client.0.smithi117.stdout:7/232: sync 2024-04-12T09:11:06.924 INFO:tasks.workunit.client.0.smithi117.stdout:9/299: sync 2024-04-12T09:11:06.924 INFO:tasks.workunit.client.0.smithi117.stdout:5/342: sync 2024-04-12T09:11:06.924 INFO:tasks.workunit.client.0.smithi117.stdout:2/252: mknod d0/d43/d4b/c57 0 2024-04-12T09:11:06.925 INFO:tasks.workunit.client.0.smithi117.stdout:6/316: fdatasync d8/f1a 0 2024-04-12T09:11:06.927 INFO:tasks.workunit.client.0.smithi117.stdout:3/554: creat de/d2c/d59/d70/d3e/d5d/d89/fce x:0 0 0 2024-04-12T09:11:06.927 INFO:tasks.workunit.client.0.smithi117.stdout:4/378: creat d0/d5/d3b/d38/d4f/f7a x:0 0 0 2024-04-12T09:11:06.930 INFO:tasks.workunit.client.0.smithi117.stdout:8/277: mknod db/d1b/d55/c5d 0 2024-04-12T09:11:06.932 INFO:tasks.workunit.client.0.smithi117.stdout:8/278: chown db/d13/f54 108 1 2024-04-12T09:11:06.932 INFO:tasks.workunit.client.0.smithi117.stdout:2/253: dread d0/d43/d30/f47 [0,4194304] 0 2024-04-12T09:11:06.935 INFO:tasks.workunit.client.0.smithi117.stdout:5/343: creat d2/d3/de/d1e/d2c/f75 x:0 0 0 2024-04-12T09:11:06.935 INFO:tasks.workunit.client.0.smithi117.stdout:5/344: write d2/d3/f5f [673136,62374] 0 2024-04-12T09:11:06.939 INFO:tasks.workunit.client.0.smithi117.stdout:4/379: write d0/d5/d3b/d38/d4f/f76 [3891303,94804] 0 2024-04-12T09:11:06.941 INFO:tasks.workunit.client.0.smithi117.stdout:9/300: mknod d1/d8/d52/c5d 0 2024-04-12T09:11:06.942 INFO:tasks.workunit.client.0.smithi117.stdout:0/399: rename d3/d22/d55/d5a/d62/d66/c8c to d3/d59/d6a/d84/c8f 0 2024-04-12T09:11:06.943 INFO:tasks.workunit.client.0.smithi117.stdout:0/400: write d3/d30/f3d [358529,42911] 0 2024-04-12T09:11:06.944 INFO:tasks.workunit.client.0.smithi117.stdout:0/401: stat d3/d22/d55/d5a 0 2024-04-12T09:11:06.947 INFO:tasks.workunit.client.0.smithi117.stdout:2/254: creat d0/d43/d30/f58 x:0 0 0 2024-04-12T09:11:06.948 INFO:tasks.workunit.client.0.smithi117.stdout:1/351: write d1/d64/d3e/f55 [524863,27663] 0 2024-04-12T09:11:06.949 INFO:tasks.workunit.client.0.smithi117.stdout:8/279: write db/d19/d1a/d3d/f45 [994040,110929] 0 2024-04-12T09:11:06.950 INFO:tasks.workunit.client.0.smithi117.stdout:7/233: creat d0/d2/d45/d17/d23/d39/f48 x:0 0 0 2024-04-12T09:11:06.951 INFO:tasks.workunit.client.0.smithi117.stdout:1/352: stat d1/d64/d45/d4c/d63/f69 0 2024-04-12T09:11:06.951 INFO:tasks.workunit.client.0.smithi117.stdout:4/380: creat d0/d2c/f7b x:0 0 0 2024-04-12T09:11:06.952 INFO:tasks.workunit.client.0.smithi117.stdout:4/381: fdatasync d0/d2c/d3c/f45 0 2024-04-12T09:11:06.953 INFO:tasks.workunit.client.0.smithi117.stdout:9/301: mkdir d1/d8/d5e 0 2024-04-12T09:11:06.954 INFO:tasks.workunit.client.0.smithi117.stdout:0/402: mknod d3/d22/d76/c90 0 2024-04-12T09:11:06.955 INFO:tasks.workunit.client.0.smithi117.stdout:3/555: symlink de/d2c/d59/d70/d3e/d84/da1/lcf 0 2024-04-12T09:11:06.957 INFO:tasks.workunit.client.0.smithi117.stdout:6/317: creat d8/d9/f6b x:0 0 0 2024-04-12T09:11:06.958 INFO:tasks.workunit.client.0.smithi117.stdout:2/255: symlink d0/d4/d10/d27/l59 0 2024-04-12T09:11:06.960 INFO:tasks.workunit.client.0.smithi117.stdout:1/353: symlink d1/d6/d3f/l6d 0 2024-04-12T09:11:06.962 INFO:tasks.workunit.client.0.smithi117.stdout:7/234: rename d0/d2/d45/d32 to d0/d2/d1a/d49 0 2024-04-12T09:11:06.963 INFO:tasks.workunit.client.0.smithi117.stdout:4/382: mknod d0/d2c/d3c/c7c 0 2024-04-12T09:11:06.964 INFO:tasks.workunit.client.0.smithi117.stdout:7/235: chown d0/d2/d45/d17/f29 50 1 2024-04-12T09:11:06.965 INFO:tasks.workunit.client.0.smithi117.stdout:3/556: creat de/d2c/d59/d4c/da0/fd0 x:0 0 0 2024-04-12T09:11:06.967 INFO:tasks.workunit.client.0.smithi117.stdout:8/280: link db/d13/d38/f5c db/d1b/f5e 0 2024-04-12T09:11:06.968 INFO:tasks.workunit.client.0.smithi117.stdout:8/281: dread - db/d13/d38/f58 zero size 2024-04-12T09:11:06.969 INFO:tasks.workunit.client.0.smithi117.stdout:0/403: rename d3/d30/d32 to d3/d59/d6a/d91 0 2024-04-12T09:11:06.971 INFO:tasks.workunit.client.0.smithi117.stdout:0/404: write d3/d22/d55/d5a/f5d [925698,105862] 0 2024-04-12T09:11:06.974 INFO:tasks.workunit.client.0.smithi117.stdout:4/383: mkdir d0/d1/d34/d7d 0 2024-04-12T09:11:06.978 INFO:tasks.workunit.client.0.smithi117.stdout:0/405: dwrite d3/d47/f60 [0,4194304] 0 2024-04-12T09:11:06.978 INFO:tasks.workunit.client.0.smithi117.stdout:8/282: creat db/d19/f5f x:0 0 0 2024-04-12T09:11:06.982 INFO:tasks.workunit.client.0.smithi117.stdout:2/256: rename d0/d43/c42 to d0/d43/d4b/c5a 0 2024-04-12T09:11:06.985 INFO:tasks.workunit.client.0.smithi117.stdout:2/257: write d0/d4/d10/d2a/f2d [3112100,119760] 0 2024-04-12T09:11:06.986 INFO:tasks.workunit.client.0.smithi117.stdout:2/258: fdatasync d0/d4/f4d 0 2024-04-12T09:11:06.988 INFO:tasks.workunit.client.0.smithi117.stdout:2/259: dread - d0/d43/f56 zero size 2024-04-12T09:11:06.990 INFO:tasks.workunit.client.0.smithi117.stdout:3/557: mkdir de/d2c/dc0/dcd/dd1 0 2024-04-12T09:11:06.992 INFO:tasks.workunit.client.0.smithi117.stdout:3/558: read de/d2c/d59/f5b [2796459,111108] 0 2024-04-12T09:11:06.994 INFO:tasks.workunit.client.0.smithi117.stdout:8/283: dread db/d19/d1a/f26 [0,4194304] 0 2024-04-12T09:11:06.994 INFO:tasks.workunit.client.0.smithi117.stdout:3/559: write de/d2c/fa7 [535207,38980] 0 2024-04-12T09:11:06.995 INFO:tasks.workunit.client.0.smithi117.stdout:0/406: dread d3/dc/f16 [0,4194304] 0 2024-04-12T09:11:06.996 INFO:tasks.workunit.client.0.smithi117.stdout:8/284: fsync db/d19/d1a/d3d/f45 0 2024-04-12T09:11:07.000 INFO:tasks.workunit.client.0.smithi117.stdout:4/384: rename d0/d5/d39/l16 to d0/d5/d25/d69/l7e 0 2024-04-12T09:11:07.002 INFO:tasks.workunit.client.0.smithi117.stdout:3/560: dwrite de/d2c/d59/d19/d27/f3c [0,4194304] 0 2024-04-12T09:11:07.007 INFO:tasks.workunit.client.0.smithi117.stdout:2/260: creat d0/d43/d30/d41/f5b x:0 0 0 2024-04-12T09:11:07.008 INFO:tasks.workunit.client.0.smithi117.stdout:2/261: chown d0/d43/d30/d41 2108993 1 2024-04-12T09:11:07.020 INFO:tasks.workunit.client.0.smithi117.stdout:7/236: getdents d0 0 2024-04-12T09:11:07.025 INFO:tasks.workunit.client.0.smithi117.stdout:8/285: mkdir db/d19/d1a/d3d/d60 0 2024-04-12T09:11:07.025 INFO:tasks.workunit.client.0.smithi117.stdout:2/262: dread d0/df/f1d [0,4194304] 0 2024-04-12T09:11:07.026 INFO:tasks.workunit.client.0.smithi117.stdout:8/286: dread - db/d13/d38/f5c zero size 2024-04-12T09:11:07.027 INFO:tasks.workunit.client.0.smithi117.stdout:8/287: read db/d1b/f34 [6251776,63336] 0 2024-04-12T09:11:07.029 INFO:tasks.workunit.client.0.smithi117.stdout:8/288: read db/d13/f31 [3076051,118403] 0 2024-04-12T09:11:07.029 INFO:tasks.workunit.client.0.smithi117.stdout:7/237: mkdir d0/d20/d4a 0 2024-04-12T09:11:07.030 INFO:tasks.workunit.client.0.smithi117.stdout:7/238: write d0/d2/f43 [994940,9133] 0 2024-04-12T09:11:07.031 INFO:tasks.workunit.client.0.smithi117.stdout:7/239: chown d0/d2/d45/d17 695 1 2024-04-12T09:11:07.034 INFO:tasks.workunit.client.0.smithi117.stdout:3/561: creat de/d2c/d59/d70/d3e/d5d/db5/fd2 x:0 0 0 2024-04-12T09:11:07.035 INFO:tasks.workunit.client.0.smithi117.stdout:3/562: chown de/f15 179 1 2024-04-12T09:11:07.036 INFO:tasks.workunit.client.0.smithi117.stdout:3/563: dread - de/d2c/d59/d4c/da0/da8/dac/fbf zero size 2024-04-12T09:11:07.039 INFO:tasks.workunit.client.0.smithi117.stdout:2/263: fsync d0/d4/d10/f32 0 2024-04-12T09:11:07.044 INFO:tasks.workunit.client.0.smithi117.stdout:4/385: link d0/d5/l13 d0/d5/d3b/d38/d4f/l7f 0 2024-04-12T09:11:07.048 INFO:tasks.workunit.client.0.smithi117.stdout:7/240: rename d0/l9 to d0/d2/d45/d17/l4b 0 2024-04-12T09:11:07.054 INFO:tasks.workunit.client.0.smithi117.stdout:0/407: truncate d3/d59/d6a/d91/f45 912481 0 2024-04-12T09:11:07.054 INFO:tasks.workunit.client.0.smithi117.stdout:2/264: fsync d0/d4/fb 0 2024-04-12T09:11:07.056 INFO:tasks.workunit.client.0.smithi117.stdout:4/386: dread d0/d2c/f30 [0,4194304] 0 2024-04-12T09:11:07.064 INFO:tasks.workunit.client.0.smithi117.stdout:3/564: truncate de/d2c/d59/d70/d3e/d3f/f58 783198 0 2024-04-12T09:11:07.070 INFO:tasks.workunit.client.0.smithi117.stdout:8/289: creat db/f61 x:0 0 0 2024-04-12T09:11:07.074 INFO:tasks.workunit.client.0.smithi117.stdout:3/565: creat de/d2c/d59/d70/d3e/d3f/fd3 x:0 0 0 2024-04-12T09:11:07.078 INFO:tasks.workunit.client.0.smithi117.stdout:0/408: rename d3/l24 to d3/d59/l92 0 2024-04-12T09:11:07.081 INFO:tasks.workunit.client.0.smithi117.stdout:3/566: dwrite de/d2c/d59/d19/d27/f76 [0,4194304] 0 2024-04-12T09:11:07.081 INFO:tasks.workunit.client.0.smithi117.stdout:8/290: mkdir db/d1b/d62 0 2024-04-12T09:11:07.082 INFO:tasks.workunit.client.0.smithi117.stdout:3/567: dread - de/d2c/d59/d19/f7f zero size 2024-04-12T09:11:07.083 INFO:tasks.workunit.client.0.smithi117.stdout:8/291: write db/d13/f54 [391452,930] 0 2024-04-12T09:11:07.084 INFO:tasks.workunit.client.0.smithi117.stdout:7/241: chown d0/d2/d45/d17/f3a 2068841 1 2024-04-12T09:11:07.089 INFO:tasks.workunit.client.0.smithi117.stdout:2/265: rename d0/d4/d10/d2a/f2d to d0/d43/d30/f5c 0 2024-04-12T09:11:07.090 INFO:tasks.workunit.client.0.smithi117.stdout:8/292: dwrite db/d13/d38/f58 [0,4194304] 0 2024-04-12T09:11:07.093 INFO:tasks.workunit.client.0.smithi117.stdout:0/409: mknod d3/dc/c93 0 2024-04-12T09:11:07.095 INFO:tasks.workunit.client.0.smithi117.stdout:4/387: write d0/f27 [988901,25167] 0 2024-04-12T09:11:07.096 INFO:tasks.workunit.client.0.smithi117.stdout:3/568: creat de/d2c/d59/d4c/fd4 x:0 0 0 2024-04-12T09:11:07.099 INFO:tasks.workunit.client.0.smithi117.stdout:7/242: rmdir d0/d2/d45/d17 39 2024-04-12T09:11:07.101 INFO:tasks.workunit.client.0.smithi117.stdout:3/569: dread de/f15 [0,4194304] 0 2024-04-12T09:11:07.103 INFO:tasks.workunit.client.0.smithi117.stdout:3/570: truncate de/d2c/d59/d4c/fd4 11397 0 2024-04-12T09:11:07.104 INFO:tasks.workunit.client.0.smithi117.stdout:3/571: chown de/d2c/d59/d70/d3e/d3f/dae 380158557 1 2024-04-12T09:11:07.110 INFO:tasks.workunit.client.0.smithi117.stdout:8/293: mknod db/d1b/c63 0 2024-04-12T09:11:07.113 INFO:tasks.workunit.client.0.smithi117.stdout:0/410: rename d3/d22/d55 to d3/d59/d6a/d91/d94 0 2024-04-12T09:11:07.114 INFO:tasks.workunit.client.0.smithi117.stdout:3/572: rename de/d2c/d59/d4c to de/d2c/d59/d4c/d62/dd5 22 2024-04-12T09:11:07.115 INFO:tasks.workunit.client.0.smithi117.stdout:3/573: dread - de/d2c/f99 zero size 2024-04-12T09:11:07.115 INFO:tasks.workunit.client.0.smithi117.stdout:2/266: dread d0/d4/d10/d27/f39 [0,4194304] 0 2024-04-12T09:11:07.119 INFO:tasks.workunit.client.0.smithi117.stdout:0/411: dwrite d3/f20 [0,4194304] 0 2024-04-12T09:11:07.127 INFO:tasks.workunit.client.0.smithi117.stdout:8/294: mknod db/d13/c64 0 2024-04-12T09:11:07.130 INFO:tasks.workunit.client.0.smithi117.stdout:4/388: link d0/f5e d0/d1/d34/f80 0 2024-04-12T09:11:07.130 INFO:tasks.workunit.client.0.smithi117.stdout:4/389: chown d0/f14 1377787 1 2024-04-12T09:11:07.132 INFO:tasks.workunit.client.0.smithi117.stdout:2/267: creat d0/d4/f5d x:0 0 0 2024-04-12T09:11:07.135 INFO:tasks.workunit.client.0.smithi117.stdout:7/243: mknod d0/da/c4c 0 2024-04-12T09:11:07.136 INFO:tasks.workunit.client.0.smithi117.stdout:0/412: mknod d3/d59/d6a/d91/d7a/c95 0 2024-04-12T09:11:07.139 INFO:tasks.workunit.client.0.smithi117.stdout:2/268: dwrite d0/d4/d10/d27/f2e [0,4194304] 0 2024-04-12T09:11:07.140 INFO:tasks.workunit.client.0.smithi117.stdout:2/269: rename d0/d43 to d0/d43/d30/d41/d5e 22 2024-04-12T09:11:07.141 INFO:tasks.workunit.client.0.smithi117.stdout:4/390: unlink d0/d5/d43/l70 0 2024-04-12T09:11:07.141 INFO:tasks.workunit.client.0.smithi117.stdout:4/391: dread - d0/d5/f6a zero size 2024-04-12T09:11:07.143 INFO:tasks.workunit.client.0.smithi117.stdout:8/295: mknod db/d19/d1a/d3d/d33/c65 0 2024-04-12T09:11:07.144 INFO:tasks.workunit.client.0.smithi117.stdout:0/413: symlink d3/d59/d6a/d91/d94/d5a/d62/l96 0 2024-04-12T09:11:07.145 INFO:tasks.workunit.client.0.smithi117.stdout:3/574: creat de/fd6 x:0 0 0 2024-04-12T09:11:07.146 INFO:tasks.workunit.client.0.smithi117.stdout:2/270: rmdir d0/d43/d4b 39 2024-04-12T09:11:07.149 INFO:tasks.workunit.client.0.smithi117.stdout:7/244: mknod d0/d2/d45/d17/d23/c4d 0 2024-04-12T09:11:07.150 INFO:tasks.workunit.client.0.smithi117.stdout:8/296: rmdir db/d13/d38/d46 39 2024-04-12T09:11:07.150 INFO:tasks.workunit.client.0.smithi117.stdout:7/245: dread - d0/d2/d45/d17/d23/d2a/f46 zero size 2024-04-12T09:11:07.152 INFO:tasks.workunit.client.0.smithi117.stdout:0/414: fdatasync f0 0 2024-04-12T09:11:07.155 INFO:tasks.workunit.client.0.smithi117.stdout:4/392: mknod d0/c81 0 2024-04-12T09:11:07.158 INFO:tasks.workunit.client.0.smithi117.stdout:4/393: write d0/d5/d25/f53 [728403,129631] 0 2024-04-12T09:11:07.159 INFO:tasks.workunit.client.0.smithi117.stdout:0/415: dwrite d3/d59/f6d [0,4194304] 0 2024-04-12T09:11:07.159 INFO:tasks.workunit.client.0.smithi117.stdout:7/246: creat d0/d2/d1a/d49/f4e x:0 0 0 2024-04-12T09:11:07.161 INFO:tasks.workunit.client.0.smithi117.stdout:0/416: dread - d3/d59/d6a/d91/f86 zero size 2024-04-12T09:11:07.161 INFO:tasks.workunit.client.0.smithi117.stdout:4/394: write d0/d5/f3f [515344,43325] 0 2024-04-12T09:11:07.162 INFO:tasks.workunit.client.0.smithi117.stdout:0/417: readlink d3/lf 0 2024-04-12T09:11:07.166 INFO:tasks.workunit.client.0.smithi117.stdout:3/575: mkdir de/d2c/dd7 0 2024-04-12T09:11:07.169 INFO:tasks.workunit.client.0.smithi117.stdout:7/247: dwrite d0/d2/d45/d15/f25 [4194304,4194304] 0 2024-04-12T09:11:07.170 INFO:tasks.workunit.client.0.smithi117.stdout:7/248: chown d0/d2/d45/d15/f25 14 1 2024-04-12T09:11:07.176 INFO:tasks.workunit.client.0.smithi117.stdout:4/395: creat d0/d5/d3b/f82 x:0 0 0 2024-04-12T09:11:07.180 INFO:tasks.workunit.client.0.smithi117.stdout:3/576: fsync de/d2c/d59/d19/f52 0 2024-04-12T09:11:07.181 INFO:tasks.workunit.client.0.smithi117.stdout:3/577: chown de/d2c/d59/d19/d4f/c72 265 1 2024-04-12T09:11:07.189 INFO:tasks.workunit.client.0.smithi117.stdout:0/418: mkdir d3/d59/d6a/d91/d94/d89/d97 0 2024-04-12T09:11:07.191 INFO:tasks.workunit.client.0.smithi117.stdout:2/271: getdents d0/d4/d10/d2a 0 2024-04-12T09:11:07.197 INFO:tasks.workunit.client.0.smithi117.stdout:2/272: dwrite d0/d43/d30/f58 [0,4194304] 0 2024-04-12T09:11:07.204 INFO:tasks.workunit.client.0.smithi117.stdout:2/273: dread d0/d4/d10/d27/f39 [0,4194304] 0 2024-04-12T09:11:07.206 INFO:tasks.workunit.client.0.smithi117.stdout:0/419: dwrite d3/d22/f29 [0,4194304] 0 2024-04-12T09:11:07.211 INFO:tasks.workunit.client.0.smithi117.stdout:3/578: rmdir de/d2c/dd7 0 2024-04-12T09:11:07.217 INFO:tasks.workunit.client.0.smithi117.stdout:3/579: creat de/d2c/d59/d70/d3e/d84/fd8 x:0 0 0 2024-04-12T09:11:07.222 INFO:tasks.workunit.client.0.smithi117.stdout:2/274: truncate d0/d4/fb 2569004 0 2024-04-12T09:11:07.223 INFO:tasks.workunit.client.0.smithi117.stdout:8/297: dwrite db/d19/d1a/f26 [0,4194304] 0 2024-04-12T09:11:07.225 INFO:tasks.workunit.client.0.smithi117.stdout:3/580: readlink de/d2c/l36 0 2024-04-12T09:11:07.228 INFO:tasks.workunit.client.0.smithi117.stdout:2/275: symlink d0/d4/d10/l5f 0 2024-04-12T09:11:07.230 INFO:tasks.workunit.client.0.smithi117.stdout:2/276: readlink d0/d4/d10/d27/l59 0 2024-04-12T09:11:07.231 INFO:tasks.workunit.client.0.smithi117.stdout:8/298: dwrite db/f3e [0,4194304] 0 2024-04-12T09:11:07.232 INFO:tasks.workunit.client.0.smithi117.stdout:8/299: dread - db/d13/d38/f48 zero size 2024-04-12T09:11:07.233 INFO:tasks.workunit.client.0.smithi117.stdout:8/300: chown db/d1b/f5e 33 1 2024-04-12T09:11:07.236 INFO:tasks.workunit.client.0.smithi117.stdout:2/277: fdatasync d0/d4/fb 0 2024-04-12T09:11:07.239 INFO:tasks.workunit.client.0.smithi117.stdout:8/301: write db/d13/f31 [1482233,110675] 0 2024-04-12T09:11:07.243 INFO:tasks.workunit.client.0.smithi117.stdout:2/278: creat d0/d4/d10/f60 x:0 0 0 2024-04-12T09:11:07.245 INFO:tasks.workunit.client.0.smithi117.stdout:3/581: creat de/d2c/d59/d70/d3d/fd9 x:0 0 0 2024-04-12T09:11:07.248 INFO:tasks.workunit.client.0.smithi117.stdout:2/279: readlink d0/d43/d4b/l4e 0 2024-04-12T09:11:07.248 INFO:tasks.workunit.client.0.smithi117.stdout:4/396: dwrite d0/d72/f40 [0,4194304] 0 2024-04-12T09:11:07.248 INFO:tasks.workunit.client.0.smithi117.stdout:8/302: dwrite db/f61 [0,4194304] 0 2024-04-12T09:11:07.249 INFO:tasks.workunit.client.0.smithi117.stdout:7/249: write d0/d2/d1a/f24 [340336,10075] 0 2024-04-12T09:11:07.250 INFO:tasks.workunit.client.0.smithi117.stdout:8/303: fsync db/f30 0 2024-04-12T09:11:07.252 INFO:tasks.workunit.client.0.smithi117.stdout:2/280: read d0/d4/d10/d27/f39 [2039813,32316] 0 2024-04-12T09:11:07.252 INFO:tasks.workunit.client.0.smithi117.stdout:8/304: stat db/d19/d1a/d3d/c42 0 2024-04-12T09:11:07.256 INFO:tasks.workunit.client.0.smithi117.stdout:8/305: write db/d13/f50 [669200,44469] 0 2024-04-12T09:11:07.260 INFO:tasks.workunit.client.0.smithi117.stdout:7/250: mkdir d0/d2/d1a/d4f 0 2024-04-12T09:11:07.264 INFO:tasks.workunit.client.0.smithi117.stdout:3/582: rename de/d2c/d59/d4c/da0/dc6 to de/d2c/d59/d70/d3e/d5d/d89/dda 0 2024-04-12T09:11:07.268 INFO:tasks.workunit.client.0.smithi117.stdout:4/397: mkdir d0/d5/d39/d4e/d6b/d83 0 2024-04-12T09:11:07.271 INFO:tasks.workunit.client.0.smithi117.stdout:3/583: dwrite de/d2c/d59/d90/f98 [0,4194304] 0 2024-04-12T09:11:07.274 INFO:tasks.workunit.client.0.smithi117.stdout:7/251: rename d0/d2/d45/d17/d23/d2a to d0/d2/d45/d17/d23/d50 0 2024-04-12T09:11:07.275 INFO:tasks.workunit.client.0.smithi117.stdout:2/281: mkdir d0/d43/d53/d61 0 2024-04-12T09:11:07.278 INFO:tasks.workunit.client.0.smithi117.stdout:8/306: creat db/d1b/d62/f66 x:0 0 0 2024-04-12T09:11:07.281 INFO:tasks.workunit.client.0.smithi117.stdout:4/398: mknod d0/d5/d25/d69/c84 0 2024-04-12T09:11:07.281 INFO:tasks.workunit.client.0.smithi117.stdout:0/420: dwrite d3/d30/f80 [0,4194304] 0 2024-04-12T09:11:07.283 INFO:tasks.workunit.client.0.smithi117.stdout:3/584: rmdir de/d2c/d59/d70/d3e/d84/da1 39 2024-04-12T09:11:07.284 INFO:tasks.workunit.client.0.smithi117.stdout:0/421: truncate d3/d59/d6a/d91/d94/d5a/d62/f70 74447 0 2024-04-12T09:11:07.285 INFO:tasks.workunit.client.0.smithi117.stdout:7/252: mkdir d0/d2/d45/d17/d23/d51 0 2024-04-12T09:11:07.286 INFO:tasks.workunit.client.0.smithi117.stdout:0/422: write d3/fe [187788,50324] 0 2024-04-12T09:11:07.286 INFO:tasks.workunit.client.0.smithi117.stdout:7/253: chown d0/d2/d45/d17/f29 9327 1 2024-04-12T09:11:07.287 INFO:tasks.workunit.client.0.smithi117.stdout:7/254: fdatasync d0/d2/d45/f42 0 2024-04-12T09:11:07.288 INFO:tasks.workunit.client.0.smithi117.stdout:0/423: chown d3/fe 1 1 2024-04-12T09:11:07.288 INFO:tasks.workunit.client.0.smithi117.stdout:5/345: sync 2024-04-12T09:11:07.289 INFO:tasks.workunit.client.0.smithi117.stdout:2/282: rename d0/d4/d10/f60 to d0/d43/d30/f62 0 2024-04-12T09:11:07.293 INFO:tasks.workunit.client.0.smithi117.stdout:7/255: dread d0/d2/f43 [0,4194304] 0 2024-04-12T09:11:07.297 INFO:tasks.workunit.client.0.smithi117.stdout:0/424: dwrite d3/f20 [0,4194304] 0 2024-04-12T09:11:07.298 INFO:tasks.workunit.client.0.smithi117.stdout:5/346: dwrite d2/f28 [4194304,4194304] 0 2024-04-12T09:11:07.299 INFO:tasks.workunit.client.0.smithi117.stdout:5/347: write d2/f28 [3423525,16346] 0 2024-04-12T09:11:07.309 INFO:tasks.workunit.client.0.smithi117.stdout:8/307: creat db/d13/d38/d46/f67 x:0 0 0 2024-04-12T09:11:07.310 INFO:tasks.workunit.client.0.smithi117.stdout:8/308: chown db/d1b/f34 125870 1 2024-04-12T09:11:07.311 INFO:tasks.workunit.client.0.smithi117.stdout:8/309: write db/d19/f5f [394545,22319] 0 2024-04-12T09:11:07.311 INFO:tasks.workunit.client.0.smithi117.stdout:8/310: fdatasync fa 0 2024-04-12T09:11:07.313 INFO:tasks.workunit.client.0.smithi117.stdout:8/311: stat db/d19/f52 0 2024-04-12T09:11:07.314 INFO:tasks.workunit.client.0.smithi117.stdout:7/256: unlink d0/d2/d1a/f38 0 2024-04-12T09:11:07.321 INFO:tasks.workunit.client.0.smithi117.stdout:2/283: link d0/df/f46 d0/d4/d10/f63 0 2024-04-12T09:11:07.324 INFO:tasks.workunit.client.0.smithi117.stdout:8/312: creat db/d1b/d55/f68 x:0 0 0 2024-04-12T09:11:07.326 INFO:tasks.workunit.client.0.smithi117.stdout:7/257: dread - d0/d13/f3e zero size 2024-04-12T09:11:07.327 INFO:tasks.workunit.client.0.smithi117.stdout:0/425: mknod d3/d59/d6a/d91/d94/c98 0 2024-04-12T09:11:07.327 INFO:tasks.workunit.client.0.smithi117.stdout:7/258: truncate d0/d13/f3e 956921 0 2024-04-12T09:11:07.334 INFO:tasks.workunit.client.0.smithi117.stdout:0/426: mknod d3/d59/d6a/c99 0 2024-04-12T09:11:07.335 INFO:tasks.workunit.client.0.smithi117.stdout:5/348: creat d2/d3/de/d1e/f76 x:0 0 0 2024-04-12T09:11:07.337 INFO:tasks.workunit.client.0.smithi117.stdout:2/284: rename d0/d4/d10/l40 to d0/d43/d30/l64 0 2024-04-12T09:11:07.337 INFO:tasks.workunit.client.0.smithi117.stdout:2/285: dread - d0/d43/f56 zero size 2024-04-12T09:11:07.339 INFO:tasks.workunit.client.0.smithi117.stdout:8/313: mknod db/c69 0 2024-04-12T09:11:07.339 INFO:tasks.workunit.client.0.smithi117.stdout:3/585: truncate de/f12 10918727 0 2024-04-12T09:11:07.341 INFO:tasks.workunit.client.0.smithi117.stdout:0/427: unlink d3/dc/l18 0 2024-04-12T09:11:07.342 INFO:tasks.workunit.client.0.smithi117.stdout:0/428: dread - d3/d47/f5e zero size 2024-04-12T09:11:07.343 INFO:tasks.workunit.client.0.smithi117.stdout:7/259: symlink d0/d20/d4a/l52 0 2024-04-12T09:11:07.345 INFO:tasks.workunit.client.0.smithi117.stdout:3/586: rmdir de/d2c/dc0/dcd 39 2024-04-12T09:11:07.346 INFO:tasks.workunit.client.0.smithi117.stdout:5/349: symlink d2/d3/d2e/d4d/d6b/l77 0 2024-04-12T09:11:07.347 INFO:tasks.workunit.client.0.smithi117.stdout:3/587: chown de/d2c/d59/d70/d40/d49/l87 226 1 2024-04-12T09:11:07.348 INFO:tasks.workunit.client.0.smithi117.stdout:7/260: dread d0/d2/d45/f42 [0,4194304] 0 2024-04-12T09:11:07.348 INFO:tasks.workunit.client.0.smithi117.stdout:0/429: mkdir d3/d59/d6a/d91/d94/d89/d9a 0 2024-04-12T09:11:07.349 INFO:tasks.workunit.client.0.smithi117.stdout:8/314: creat db/d19/d1a/d3d/d60/f6a x:0 0 0 2024-04-12T09:11:07.353 INFO:tasks.workunit.client.0.smithi117.stdout:7/261: write d0/d2/f43 [463766,41841] 0 2024-04-12T09:11:07.358 INFO:tasks.workunit.client.0.smithi117.stdout:2/286: rename d0/d43/d4b/c50 to d0/c65 0 2024-04-12T09:11:07.360 INFO:tasks.workunit.client.0.smithi117.stdout:7/262: dwrite d0/d13/f40 [0,4194304] 0 2024-04-12T09:11:07.365 INFO:tasks.workunit.client.0.smithi117.stdout:8/315: symlink db/d19/d1a/d3d/l6b 0 2024-04-12T09:11:07.368 INFO:tasks.workunit.client.0.smithi117.stdout:3/588: link de/d2c/d59/d70/d3e/d3f/f43 de/d2c/d59/d70/d3e/d5d/d80/d97/fdb 0 2024-04-12T09:11:07.372 INFO:tasks.workunit.client.0.smithi117.stdout:8/316: symlink db/d4b/l6c 0 2024-04-12T09:11:07.374 INFO:tasks.workunit.client.0.smithi117.stdout:3/589: creat de/d2c/d59/d70/d3e/d5d/d80/fdc x:0 0 0 2024-04-12T09:11:07.376 INFO:tasks.workunit.client.0.smithi117.stdout:0/430: getdents d3/d59/d6a/d91/d94/d5a/d62 0 2024-04-12T09:11:07.378 INFO:tasks.workunit.client.0.smithi117.stdout:0/431: read d3/dc/f3b [1980473,96147] 0 2024-04-12T09:11:07.378 INFO:tasks.workunit.client.0.smithi117.stdout:0/432: chown d3/d59 2580 1 2024-04-12T09:11:07.401 INFO:tasks.workunit.client.0.smithi117.stdout:8/317: symlink db/d13/d38/l6d 0 2024-04-12T09:11:07.401 INFO:tasks.workunit.client.0.smithi117.stdout:3/590: write de/d2c/fa7 [846495,4816] 0 2024-04-12T09:11:07.405 INFO:tasks.workunit.client.0.smithi117.stdout:8/318: symlink db/d1b/d55/l6e 0 2024-04-12T09:11:07.406 INFO:tasks.workunit.client.0.smithi117.stdout:0/433: getdents d3/d59/d6a/d91/d94/d89/d97 0 2024-04-12T09:11:07.408 INFO:tasks.workunit.client.0.smithi117.stdout:3/591: mknod de/d2c/d59/d70/d3e/d5d/d89/dda/cdd 0 2024-04-12T09:11:07.410 INFO:tasks.workunit.client.0.smithi117.stdout:5/350: dwrite d2/d3/de/d1e/d35/f3b [0,4194304] 0 2024-04-12T09:11:07.413 INFO:tasks.workunit.client.0.smithi117.stdout:0/434: write d3/d59/d6a/d91/f86 [323955,101668] 0 2024-04-12T09:11:07.414 INFO:tasks.workunit.client.0.smithi117.stdout:2/287: dwrite d0/d4/fb [0,4194304] 0 2024-04-12T09:11:07.417 INFO:tasks.workunit.client.0.smithi117.stdout:2/288: truncate d0/d43/d30/d41/f5b 998606 0 2024-04-12T09:11:07.419 INFO:tasks.workunit.client.0.smithi117.stdout:5/351: symlink d2/d3/dd/d39/l78 0 2024-04-12T09:11:07.419 INFO:tasks.workunit.client.0.smithi117.stdout:5/352: fdatasync d2/f5d 0 2024-04-12T09:11:07.420 INFO:tasks.workunit.client.0.smithi117.stdout:5/353: chown d2/f49 25 1 2024-04-12T09:11:07.423 INFO:tasks.workunit.client.0.smithi117.stdout:3/592: rename de/d2c/d59/cc4 to de/d2c/d59/d70/d3e/d5d/d80/d97/cde 0 2024-04-12T09:11:07.427 INFO:tasks.workunit.client.0.smithi117.stdout:3/593: mknod de/d2c/d59/d19/d27/cdf 0 2024-04-12T09:11:07.428 INFO:tasks.workunit.client.0.smithi117.stdout:2/289: mkdir d0/d43/d53/d61/d66 0 2024-04-12T09:11:07.431 INFO:tasks.workunit.client.0.smithi117.stdout:5/354: mkdir d2/d3/de/d1e/d79 0 2024-04-12T09:11:07.433 INFO:tasks.workunit.client.0.smithi117.stdout:8/319: truncate db/d19/f52 1891314 0 2024-04-12T09:11:07.433 INFO:tasks.workunit.client.0.smithi117.stdout:5/355: fsync d2/d3/de/d1e/f44 0 2024-04-12T09:11:07.436 INFO:tasks.workunit.client.0.smithi117.stdout:2/290: dwrite d0/d4/f5d [0,4194304] 0 2024-04-12T09:11:07.436 INFO:tasks.workunit.client.0.smithi117.stdout:0/435: write f0 [1938479,38771] 0 2024-04-12T09:11:07.443 INFO:tasks.workunit.client.0.smithi117.stdout:2/291: rmdir d0/d43/d30 39 2024-04-12T09:11:07.447 INFO:tasks.workunit.client.0.smithi117.stdout:2/292: dread d0/df/f1d [0,4194304] 0 2024-04-12T09:11:07.448 INFO:tasks.workunit.client.0.smithi117.stdout:5/356: rename d2/d3/de/d1e/d2c/d69 to d2/d3/dd/d39/d7a 0 2024-04-12T09:11:07.454 INFO:tasks.workunit.client.0.smithi117.stdout:3/594: getdents de/d2c/d59/d70/d3d 0 2024-04-12T09:11:07.455 INFO:tasks.workunit.client.0.smithi117.stdout:3/595: write de/d2c/d59/d70/d3e/d5d/db5/fd2 [990828,90429] 0 2024-04-12T09:11:07.456 INFO:tasks.workunit.client.0.smithi117.stdout:3/596: stat de/d2c/d59/d19/d27/fb2 0 2024-04-12T09:11:07.457 INFO:tasks.workunit.client.0.smithi117.stdout:0/436: creat d3/d22/d76/d85/f9b x:0 0 0 2024-04-12T09:11:07.461 INFO:tasks.workunit.client.0.smithi117.stdout:5/357: rename d2/d3/de/d1e/d46/f4c to d2/d3/de/d1e/d2c/f7b 0 2024-04-12T09:11:07.463 INFO:tasks.workunit.client.0.smithi117.stdout:2/293: write d0/d43/d30/f47 [276513,677] 0 2024-04-12T09:11:07.464 INFO:tasks.workunit.client.0.smithi117.stdout:0/437: fsync d3/dc/f3b 0 2024-04-12T09:11:07.465 INFO:tasks.workunit.client.0.smithi117.stdout:0/438: write d3/d47/f5e [384709,36543] 0 2024-04-12T09:11:07.468 INFO:tasks.workunit.client.0.smithi117.stdout:8/320: getdents db/d19/d1a/d3d 0 2024-04-12T09:11:07.468 INFO:tasks.workunit.client.0.smithi117.stdout:9/302: sync 2024-04-12T09:11:07.468 INFO:tasks.workunit.client.0.smithi117.stdout:6/318: sync 2024-04-12T09:11:07.472 INFO:tasks.workunit.client.0.smithi117.stdout:6/319: read d8/d9/d17/f23 [134244,126531] 0 2024-04-12T09:11:07.472 INFO:tasks.workunit.client.0.smithi117.stdout:0/439: creat d3/d22/d76/f9c x:0 0 0 2024-04-12T09:11:07.473 INFO:tasks.workunit.client.0.smithi117.stdout:3/597: mknod de/d2c/dc0/dcd/dd1/ce0 0 2024-04-12T09:11:07.474 INFO:tasks.workunit.client.0.smithi117.stdout:6/320: dread - d8/d9/d17/d33/f5b zero size 2024-04-12T09:11:07.475 INFO:tasks.workunit.client.0.smithi117.stdout:6/321: chown d8/c6a 0 1 2024-04-12T09:11:07.476 INFO:tasks.workunit.client.0.smithi117.stdout:9/303: dwrite d1/d23/f28 [0,4194304] 0 2024-04-12T09:11:07.478 INFO:tasks.workunit.client.0.smithi117.stdout:8/321: creat db/d1b/d62/f6f x:0 0 0 2024-04-12T09:11:07.480 INFO:tasks.workunit.client.0.smithi117.stdout:8/322: dread - db/d1b/f5e zero size 2024-04-12T09:11:07.480 INFO:tasks.workunit.client.0.smithi117.stdout:5/358: dread d2/d3/dd/f3a [4194304,4194304] 0 2024-04-12T09:11:07.482 INFO:tasks.workunit.client.0.smithi117.stdout:2/294: write d0/d4/d10/f32 [858730,5337] 0 2024-04-12T09:11:07.484 INFO:tasks.workunit.client.0.smithi117.stdout:5/359: chown d2/d3/d2e/d4d 22 1 2024-04-12T09:11:07.484 INFO:tasks.workunit.client.0.smithi117.stdout:3/598: mkdir de/d2c/d59/d70/d3d/d63/de1 0 2024-04-12T09:11:07.486 INFO:tasks.workunit.client.0.smithi117.stdout:2/295: write d0/df/f1d [1559428,10685] 0 2024-04-12T09:11:07.487 INFO:tasks.workunit.client.0.smithi117.stdout:9/304: dwrite d1/d8/df/d39/d3b/f42 [0,4194304] 0 2024-04-12T09:11:07.488 INFO:tasks.workunit.client.0.smithi117.stdout:2/296: fdatasync d0/f3c 0 2024-04-12T09:11:07.490 INFO:tasks.workunit.client.0.smithi117.stdout:2/297: chown d0/d4/c45 0 1 2024-04-12T09:11:07.493 INFO:tasks.workunit.client.0.smithi117.stdout:8/323: mkdir db/d19/d1a/d3d/d60/d70 0 2024-04-12T09:11:07.494 INFO:tasks.workunit.client.0.smithi117.stdout:3/599: dwrite de/f8e [0,4194304] 0 2024-04-12T09:11:07.497 INFO:tasks.workunit.client.0.smithi117.stdout:5/360: unlink f1 0 2024-04-12T09:11:07.505 INFO:tasks.workunit.client.0.smithi117.stdout:2/298: write d0/d43/d30/f62 [714133,38358] 0 2024-04-12T09:11:07.505 INFO:tasks.workunit.client.0.smithi117.stdout:5/361: dwrite d2/d3/dd/f4b [0,4194304] 0 2024-04-12T09:11:07.507 INFO:tasks.workunit.client.0.smithi117.stdout:3/600: mkdir de/d2c/d59/d70/d40/d79/de2 0 2024-04-12T09:11:07.509 INFO:tasks.workunit.client.0.smithi117.stdout:3/601: read - de/d2c/d59/d70/d3e/f5a zero size 2024-04-12T09:11:07.510 INFO:tasks.workunit.client.0.smithi117.stdout:6/322: link d8/d3a/l44 d8/d9/d17/d33/l6c 0 2024-04-12T09:11:07.514 INFO:tasks.workunit.client.0.smithi117.stdout:6/323: read d8/d9/f1f [116362,85994] 0 2024-04-12T09:11:07.514 INFO:tasks.workunit.client.0.smithi117.stdout:8/324: getdents db/d19/d1a/d3d/d60/d70 0 2024-04-12T09:11:07.515 INFO:tasks.workunit.client.0.smithi117.stdout:2/299: dwrite d0/df/f20 [0,4194304] 0 2024-04-12T09:11:07.518 INFO:tasks.workunit.client.0.smithi117.stdout:3/602: stat de/d2c/f96 0 2024-04-12T09:11:07.521 INFO:tasks.workunit.client.0.smithi117.stdout:8/325: unlink db/d13/f31 0 2024-04-12T09:11:07.522 INFO:tasks.workunit.client.0.smithi117.stdout:2/300: dwrite d0/d4/f5d [0,4194304] 0 2024-04-12T09:11:07.523 INFO:tasks.workunit.client.0.smithi117.stdout:8/326: chown db/d19 529508539 1 2024-04-12T09:11:07.523 INFO:tasks.workunit.client.0.smithi117.stdout:5/362: mknod d2/d3/d2e/c7c 0 2024-04-12T09:11:07.524 INFO:tasks.workunit.client.0.smithi117.stdout:2/301: chown d0/l16 3 1 2024-04-12T09:11:07.524 INFO:tasks.workunit.client.0.smithi117.stdout:5/363: dread - d2/d3/d2e/d4d/f5c zero size 2024-04-12T09:11:07.525 INFO:tasks.workunit.client.0.smithi117.stdout:8/327: read db/d13/d38/f58 [117799,3254] 0 2024-04-12T09:11:07.527 INFO:tasks.workunit.client.0.smithi117.stdout:8/328: chown db/d1b/l36 150284 1 2024-04-12T09:11:07.534 INFO:tasks.workunit.client.0.smithi117.stdout:2/302: creat d0/df/f67 x:0 0 0 2024-04-12T09:11:07.534 INFO:tasks.workunit.client.0.smithi117.stdout:8/329: dwrite db/d1b/f40 [0,4194304] 0 2024-04-12T09:11:07.540 INFO:tasks.workunit.client.0.smithi117.stdout:9/305: dwrite d1/d8/d12/f38 [4194304,4194304] 0 2024-04-12T09:11:07.546 INFO:tasks.workunit.client.0.smithi117.stdout:2/303: mknod d0/d43/d53/c68 0 2024-04-12T09:11:07.548 INFO:tasks.workunit.client.0.smithi117.stdout:5/364: dwrite d2/d3/de/d1e/f67 [0,4194304] 0 2024-04-12T09:11:07.549 INFO:tasks.workunit.client.0.smithi117.stdout:8/330: rename db/d1b/l17 to db/d1b/d62/l71 0 2024-04-12T09:11:07.553 INFO:tasks.workunit.client.0.smithi117.stdout:9/306: symlink d1/d23/d27/l5f 0 2024-04-12T09:11:07.554 INFO:tasks.workunit.client.0.smithi117.stdout:9/307: readlink d1/d23/d27/l5f 0 2024-04-12T09:11:07.555 INFO:tasks.workunit.client.0.smithi117.stdout:9/308: fdatasync d1/d8/df/d26/f3c 0 2024-04-12T09:11:07.557 INFO:tasks.workunit.client.0.smithi117.stdout:2/304: mknod d0/d4/d10/d27/c69 0 2024-04-12T09:11:07.558 INFO:tasks.workunit.client.0.smithi117.stdout:5/365: truncate d2/d3/dd/d39/f3e 3957117 0 2024-04-12T09:11:07.559 INFO:tasks.workunit.client.0.smithi117.stdout:5/366: dread - d2/f5d zero size 2024-04-12T09:11:07.561 INFO:tasks.workunit.client.0.smithi117.stdout:6/324: truncate f3 4039016 0 2024-04-12T09:11:07.562 INFO:tasks.workunit.client.0.smithi117.stdout:6/325: read - d8/d9/d17/d33/f5b zero size 2024-04-12T09:11:07.564 INFO:tasks.workunit.client.0.smithi117.stdout:2/305: write d0/d43/d30/f5c [762190,4828] 0 2024-04-12T09:11:07.567 INFO:tasks.workunit.client.0.smithi117.stdout:2/306: symlink d0/d43/d53/l6a 0 2024-04-12T09:11:07.570 INFO:tasks.workunit.client.0.smithi117.stdout:3/603: truncate de/d2c/d59/d4c/da0/fb9 585623 0 2024-04-12T09:11:07.571 INFO:tasks.workunit.client.0.smithi117.stdout:3/604: readlink de/d2c/d59/d70/d3e/d3f/l5c 0 2024-04-12T09:11:07.573 INFO:tasks.workunit.client.0.smithi117.stdout:5/367: getdents d2/d3/de/d1e/d46 0 2024-04-12T09:11:07.577 INFO:tasks.workunit.client.0.smithi117.stdout:3/605: mkdir de/d2c/d59/d70/d3e/d84/de3 0 2024-04-12T09:11:07.580 INFO:tasks.workunit.client.0.smithi117.stdout:5/368: creat d2/d3/de/d1e/d66/f7d x:0 0 0 2024-04-12T09:11:07.583 INFO:tasks.workunit.client.0.smithi117.stdout:9/309: dread d1/d8/df/d39/d3b/f4c [4194304,4194304] 0 2024-04-12T09:11:07.585 INFO:tasks.workunit.client.0.smithi117.stdout:3/606: mknod de/d2c/d59/d70/ce4 0 2024-04-12T09:11:07.587 INFO:tasks.workunit.client.0.smithi117.stdout:9/310: fsync d1/f15 0 2024-04-12T09:11:07.590 INFO:tasks.workunit.client.0.smithi117.stdout:5/369: dwrite d2/d3/d2e/d4d/f5c [0,4194304] 0 2024-04-12T09:11:07.593 INFO:tasks.workunit.client.0.smithi117.stdout:3/607: dread de/d2c/d59/f42 [0,4194304] 0 2024-04-12T09:11:07.599 INFO:tasks.workunit.client.0.smithi117.stdout:9/311: write d1/d8/df/d39/d3b/f4c [4992868,9128] 0 2024-04-12T09:11:07.600 INFO:tasks.workunit.client.0.smithi117.stdout:9/312: write d1/d4b/f55 [44587,82492] 0 2024-04-12T09:11:07.601 INFO:tasks.workunit.client.0.smithi117.stdout:9/313: write d1/d8/d12/f37 [2797704,11407] 0 2024-04-12T09:11:07.602 INFO:tasks.workunit.client.0.smithi117.stdout:9/314: write d1/d8/df/f13 [3713894,78415] 0 2024-04-12T09:11:07.608 INFO:tasks.workunit.client.0.smithi117.stdout:1/354: sync 2024-04-12T09:11:07.608 INFO:tasks.workunit.client.0.smithi117.stdout:4/399: sync 2024-04-12T09:11:07.613 INFO:tasks.workunit.client.0.smithi117.stdout:5/370: rmdir d2 39 2024-04-12T09:11:07.616 INFO:tasks.workunit.client.0.smithi117.stdout:3/608: creat de/d2c/d59/d70/d40/d79/de2/fe5 x:0 0 0 2024-04-12T09:11:07.618 INFO:tasks.workunit.client.0.smithi117.stdout:9/315: unlink d1/d23/c4d 0 2024-04-12T09:11:07.619 INFO:tasks.workunit.client.0.smithi117.stdout:3/609: truncate de/d2c/d59/d70/d3e/d3f/dae/fba 455868 0 2024-04-12T09:11:07.619 INFO:tasks.workunit.client.0.smithi117.stdout:1/355: rmdir d1/d3b 39 2024-04-12T09:11:07.624 INFO:tasks.workunit.client.0.smithi117.stdout:6/326: dwrite d8/d2a/f2f [0,4194304] 0 2024-04-12T09:11:07.628 INFO:tasks.workunit.client.0.smithi117.stdout:9/316: symlink d1/d8/d12/l60 0 2024-04-12T09:11:07.630 INFO:tasks.workunit.client.0.smithi117.stdout:9/317: fdatasync d1/d8/df/f13 0 2024-04-12T09:11:07.633 INFO:tasks.workunit.client.0.smithi117.stdout:5/371: dwrite d2/d3/de/d1e/d46/f51 [0,4194304] 0 2024-04-12T09:11:07.635 INFO:tasks.workunit.client.0.smithi117.stdout:5/372: write d2/d3/d2e/f68 [641943,21464] 0 2024-04-12T09:11:07.638 INFO:tasks.workunit.client.0.smithi117.stdout:6/327: stat d8/d2a/c2e 0 2024-04-12T09:11:07.643 INFO:tasks.workunit.client.0.smithi117.stdout:9/318: fsync d1/f4 0 2024-04-12T09:11:07.654 INFO:tasks.workunit.client.0.smithi117.stdout:9/319: dwrite d1/d8/df/f3a [0,4194304] 0 2024-04-12T09:11:07.662 INFO:tasks.workunit.client.0.smithi117.stdout:4/400: getdents d0/d5/d39/d4e 0 2024-04-12T09:11:07.664 INFO:tasks.workunit.client.0.smithi117.stdout:6/328: dread f2 [0,4194304] 0 2024-04-12T09:11:07.665 INFO:tasks.workunit.client.0.smithi117.stdout:4/401: write d0/d1/f65 [4162763,99281] 0 2024-04-12T09:11:07.667 INFO:tasks.workunit.client.0.smithi117.stdout:1/356: dread d1/d3b/f4a [4194304,4194304] 0 2024-04-12T09:11:07.670 INFO:tasks.workunit.client.0.smithi117.stdout:3/610: dwrite de/d2c/d59/d70/d3e/d5d/d80/d97/fdb [0,4194304] 0 2024-04-12T09:11:07.670 INFO:tasks.workunit.client.0.smithi117.stdout:9/320: unlink d1/d24/l2f 0 2024-04-12T09:11:07.675 INFO:tasks.workunit.client.0.smithi117.stdout:5/373: truncate d2/f19 2152053 0 2024-04-12T09:11:07.678 INFO:tasks.workunit.client.0.smithi117.stdout:6/329: truncate d8/d9/f40 3714654 0 2024-04-12T09:11:07.685 INFO:tasks.workunit.client.0.smithi117.stdout:3/611: creat de/d2c/d59/d19/fe6 x:0 0 0 2024-04-12T09:11:07.687 INFO:tasks.workunit.client.0.smithi117.stdout:5/374: readlink d2/d3/l29 0 2024-04-12T09:11:07.688 INFO:tasks.workunit.client.0.smithi117.stdout:5/375: dread - d2/d3/dd/d39/d7a/f71 zero size 2024-04-12T09:11:07.689 INFO:tasks.workunit.client.0.smithi117.stdout:5/376: write d2/f34 [813010,79131] 0 2024-04-12T09:11:07.696 INFO:tasks.workunit.client.0.smithi117.stdout:4/402: truncate d0/d2c/d3c/f45 432684 0 2024-04-12T09:11:07.697 INFO:tasks.workunit.client.0.smithi117.stdout:4/403: chown d0/d1/d34/d7d 452 1 2024-04-12T09:11:07.699 INFO:tasks.workunit.client.0.smithi117.stdout:3/612: symlink de/d2c/d59/d70/d3d/le7 0 2024-04-12T09:11:07.701 INFO:tasks.workunit.client.0.smithi117.stdout:9/321: creat d1/f61 x:0 0 0 2024-04-12T09:11:07.702 INFO:tasks.workunit.client.0.smithi117.stdout:9/322: fdatasync d1/d8/d12/f59 0 2024-04-12T09:11:07.705 INFO:tasks.workunit.client.0.smithi117.stdout:3/613: dwrite de/d2c/d59/d90/f98 [0,4194304] 0 2024-04-12T09:11:07.706 INFO:tasks.workunit.client.0.smithi117.stdout:1/357: rename d1/d6/d51/l60 to d1/d64/d45/l6e 0 2024-04-12T09:11:07.708 INFO:tasks.workunit.client.0.smithi117.stdout:1/358: truncate d1/d64/f43 1070425 0 2024-04-12T09:11:07.709 INFO:tasks.workunit.client.0.smithi117.stdout:5/377: unlink d2/d3/dd/f3a 0 2024-04-12T09:11:07.716 INFO:tasks.workunit.client.0.smithi117.stdout:5/378: dwrite d2/d3/d2e/d4d/f6c [0,4194304] 0 2024-04-12T09:11:07.717 INFO:tasks.workunit.client.0.smithi117.stdout:9/323: mknod d1/d8/df/d39/c62 0 2024-04-12T09:11:07.719 INFO:tasks.workunit.client.0.smithi117.stdout:3/614: symlink de/d2c/d59/d4c/da0/daa/le8 0 2024-04-12T09:11:07.720 INFO:tasks.workunit.client.0.smithi117.stdout:6/330: rename d8 to d8/d9/d17/d6d 22 2024-04-12T09:11:07.722 INFO:tasks.workunit.client.0.smithi117.stdout:1/359: write d1/d6/d3f/db/d1d/d24/f4b [309870,47796] 0 2024-04-12T09:11:07.725 INFO:tasks.workunit.client.0.smithi117.stdout:4/404: link d0/d5/d39/f36 d0/d5/d39/d4e/d6b/d83/f85 0 2024-04-12T09:11:07.726 INFO:tasks.workunit.client.0.smithi117.stdout:9/324: creat d1/d24/f63 x:0 0 0 2024-04-12T09:11:07.729 INFO:tasks.workunit.client.0.smithi117.stdout:6/331: mkdir d8/d2a/d6e 0 2024-04-12T09:11:07.735 INFO:tasks.workunit.client.0.smithi117.stdout:1/360: getdents d1/d6/d3f/db/d16 0 2024-04-12T09:11:07.738 INFO:tasks.workunit.client.0.smithi117.stdout:6/332: rename d8/l20 to d8/d2a/l6f 0 2024-04-12T09:11:07.743 INFO:tasks.workunit.client.0.smithi117.stdout:9/325: dwrite d1/d8/df/d26/d41/f50 [0,4194304] 0 2024-04-12T09:11:07.749 INFO:tasks.workunit.client.0.smithi117.stdout:4/405: dread d0/d5/d25/f53 [0,4194304] 0 2024-04-12T09:11:07.751 INFO:tasks.workunit.client.0.smithi117.stdout:9/326: rmdir d1/d8/d12 39 2024-04-12T09:11:07.752 INFO:tasks.workunit.client.0.smithi117.stdout:0/440: sync 2024-04-12T09:11:07.755 INFO:tasks.workunit.client.0.smithi117.stdout:7/263: sync 2024-04-12T09:11:07.759 INFO:tasks.workunit.client.0.smithi117.stdout:1/361: dread d1/d64/d45/f50 [0,4194304] 0 2024-04-12T09:11:07.759 INFO:tasks.workunit.client.0.smithi117.stdout:4/406: dwrite d0/d1/d34/f28 [4194304,4194304] 0 2024-04-12T09:11:07.762 INFO:tasks.workunit.client.0.smithi117.stdout:0/441: rename d3/d22/f29 to d3/d30/f9d 0 2024-04-12T09:11:07.769 INFO:tasks.workunit.client.0.smithi117.stdout:6/333: getdents d8/d9/d17 0 2024-04-12T09:11:07.770 INFO:tasks.workunit.client.0.smithi117.stdout:6/334: stat d8/d9/d39/d3c/l47 0 2024-04-12T09:11:07.772 INFO:tasks.workunit.client.0.smithi117.stdout:4/407: mknod d0/d5/c86 0 2024-04-12T09:11:07.773 INFO:tasks.workunit.client.0.smithi117.stdout:1/362: dread d1/f21 [0,4194304] 0 2024-04-12T09:11:07.776 INFO:tasks.workunit.client.0.smithi117.stdout:0/442: mknod d3/d59/d6a/d84/c9e 0 2024-04-12T09:11:07.777 INFO:tasks.workunit.client.0.smithi117.stdout:0/443: stat d3/d59/d6a/d91 0 2024-04-12T09:11:07.778 INFO:tasks.workunit.client.0.smithi117.stdout:3/615: dwrite de/d2c/d59/d70/d3e/d5d/d89/d68/f8f [0,4194304] 0 2024-04-12T09:11:07.781 INFO:tasks.workunit.client.0.smithi117.stdout:4/408: creat d0/d2c/d3c/f87 x:0 0 0 2024-04-12T09:11:07.784 INFO:tasks.workunit.client.0.smithi117.stdout:1/363: write d1/d64/f43 [1213988,3556] 0 2024-04-12T09:11:07.786 INFO:tasks.workunit.client.0.smithi117.stdout:9/327: getdents d1/d8/df/d1b 0 2024-04-12T09:11:07.789 INFO:tasks.workunit.client.0.smithi117.stdout:6/335: dwrite d8/d9/f1f [0,4194304] 0 2024-04-12T09:11:07.791 INFO:tasks.workunit.client.0.smithi117.stdout:9/328: write d1/d8/df/d39/d3b/f42 [1728161,11223] 0 2024-04-12T09:11:07.793 INFO:tasks.workunit.client.0.smithi117.stdout:9/329: chown d1/d8/df/l44 1223414243 1 2024-04-12T09:11:07.798 INFO:tasks.workunit.client.0.smithi117.stdout:0/444: symlink d3/d59/d6a/d91/d94/d89/d97/l9f 0 2024-04-12T09:11:07.800 INFO:tasks.workunit.client.0.smithi117.stdout:7/264: dwrite d0/d2/f5 [0,4194304] 0 2024-04-12T09:11:07.806 INFO:tasks.workunit.client.0.smithi117.stdout:6/336: fsync d8/d3f/d51/f67 0 2024-04-12T09:11:07.806 INFO:tasks.workunit.client.0.smithi117.stdout:4/409: dread d0/d5/d3b/d38/d4f/f76 [0,4194304] 0 2024-04-12T09:11:07.807 INFO:tasks.workunit.client.0.smithi117.stdout:6/337: chown d8/d3a/d49 244 1 2024-04-12T09:11:07.812 INFO:tasks.workunit.client.0.smithi117.stdout:6/338: dread d8/d2a/f2f [0,4194304] 0 2024-04-12T09:11:07.817 INFO:tasks.workunit.client.0.smithi117.stdout:9/330: creat d1/d8/d12/f64 x:0 0 0 2024-04-12T09:11:07.819 INFO:tasks.workunit.client.0.smithi117.stdout:7/265: mkdir d0/d2/d45/d53 0 2024-04-12T09:11:07.821 INFO:tasks.workunit.client.0.smithi117.stdout:4/410: dread d0/d1/f48 [0,4194304] 0 2024-04-12T09:11:07.821 INFO:tasks.workunit.client.0.smithi117.stdout:3/616: rename de/d2c/d59/d19/d27/cdf to de/d2c/d59/d19/d4f/ce9 0 2024-04-12T09:11:07.823 INFO:tasks.workunit.client.0.smithi117.stdout:4/411: dread - d0/d5/f6a zero size 2024-04-12T09:11:07.824 INFO:tasks.workunit.client.0.smithi117.stdout:1/364: dread d1/d6/d3f/db/d1d/f52 [0,4194304] 0 2024-04-12T09:11:07.827 INFO:tasks.workunit.client.0.smithi117.stdout:3/617: creat de/d2c/d59/d30/fea x:0 0 0 2024-04-12T09:11:07.829 INFO:tasks.workunit.client.0.smithi117.stdout:0/445: truncate d3/f20 512180 0 2024-04-12T09:11:07.829 INFO:tasks.workunit.client.0.smithi117.stdout:7/266: dwrite d0/d2/d45/d17/f21 [0,4194304] 0 2024-04-12T09:11:07.831 INFO:tasks.workunit.client.0.smithi117.stdout:9/331: mknod d1/d8/c65 0 2024-04-12T09:11:07.831 INFO:tasks.workunit.client.0.smithi117.stdout:6/339: dread d8/d3a/d49/f4e [0,4194304] 0 2024-04-12T09:11:07.832 INFO:tasks.workunit.client.0.smithi117.stdout:4/412: mkdir d0/d5/d39/d88 0 2024-04-12T09:11:07.832 INFO:tasks.workunit.client.0.smithi117.stdout:0/446: truncate d3/d59/d6a/d91/f8d 484707 0 2024-04-12T09:11:07.833 INFO:tasks.workunit.client.0.smithi117.stdout:7/267: write d0/d2/d45/d17/d23/d50/f3d [734434,121513] 0 2024-04-12T09:11:07.834 INFO:tasks.workunit.client.0.smithi117.stdout:0/447: write d3/d59/d6a/d91/f86 [836885,60896] 0 2024-04-12T09:11:07.835 INFO:tasks.workunit.client.0.smithi117.stdout:0/448: read - d3/d47/f8a zero size 2024-04-12T09:11:07.843 INFO:tasks.workunit.client.0.smithi117.stdout:1/365: dread d1/d6/d3f/f61 [0,4194304] 0 2024-04-12T09:11:07.856 INFO:tasks.workunit.client.0.smithi117.stdout:9/332: dread d1/f15 [0,4194304] 0 2024-04-12T09:11:07.857 INFO:tasks.workunit.client.0.smithi117.stdout:9/333: truncate d1/d8/d12/f64 581088 0 2024-04-12T09:11:07.858 INFO:tasks.workunit.client.0.smithi117.stdout:7/268: creat d0/d2/d45/d15/f54 x:0 0 0 2024-04-12T09:11:07.859 INFO:tasks.workunit.client.0.smithi117.stdout:0/449: symlink d3/dc/la0 0 2024-04-12T09:11:07.859 INFO:tasks.workunit.client.0.smithi117.stdout:7/269: truncate d0/d2/d45/d17/f44 131205 0 2024-04-12T09:11:07.860 INFO:tasks.workunit.client.0.smithi117.stdout:7/270: readlink d0/d2/le 0 2024-04-12T09:11:07.862 INFO:tasks.workunit.client.0.smithi117.stdout:0/450: getdents d3/d22/d76/d83 0 2024-04-12T09:11:07.867 INFO:tasks.workunit.client.0.smithi117.stdout:1/366: rename d1/d6/d3f/c5f to d1/c6f 0 2024-04-12T09:11:07.868 INFO:tasks.workunit.client.0.smithi117.stdout:4/413: getdents d0/d5/d25 0 2024-04-12T09:11:07.870 INFO:tasks.workunit.client.0.smithi117.stdout:0/451: creat d3/d59/d6a/d91/d7a/fa1 x:0 0 0 2024-04-12T09:11:07.874 INFO:tasks.workunit.client.0.smithi117.stdout:9/334: rename d1/d24/c56 to d1/d8/df/d26/d41/c66 0 2024-04-12T09:11:07.875 INFO:tasks.workunit.client.0.smithi117.stdout:1/367: write d1/d6/d3f/db/f33 [95925,127187] 0 2024-04-12T09:11:07.877 INFO:tasks.workunit.client.0.smithi117.stdout:4/414: mknod d0/d5/d3b/d38/d4f/c89 0 2024-04-12T09:11:07.881 INFO:tasks.workunit.client.0.smithi117.stdout:6/340: dwrite f7 [0,4194304] 0 2024-04-12T09:11:07.883 INFO:tasks.workunit.client.0.smithi117.stdout:0/452: mkdir d3/da2 0 2024-04-12T09:11:07.884 INFO:tasks.workunit.client.0.smithi117.stdout:0/453: fdatasync d3/d22/d76/d85/f9b 0 2024-04-12T09:11:07.886 INFO:tasks.workunit.client.0.smithi117.stdout:7/271: rename d0/f30 to d0/d2/d1a/f55 0 2024-04-12T09:11:07.887 INFO:tasks.workunit.client.0.smithi117.stdout:9/335: mknod d1/d8/d5e/c67 0 2024-04-12T09:11:07.891 INFO:tasks.workunit.client.0.smithi117.stdout:0/454: truncate d3/d22/f2d 414092 0 2024-04-12T09:11:07.891 INFO:tasks.workunit.client.0.smithi117.stdout:0/455: stat d3/d30/f61 0 2024-04-12T09:11:07.895 INFO:tasks.workunit.client.0.smithi117.stdout:1/368: rename d1/d6/d3f/l6d to d1/d6/d3f/db/d16/l70 0 2024-04-12T09:11:07.896 INFO:tasks.workunit.client.0.smithi117.stdout:9/336: mkdir d1/d8/df/d68 0 2024-04-12T09:11:07.898 INFO:tasks.workunit.client.0.smithi117.stdout:9/337: read d1/d8/df/d3e/f2b [1578804,83407] 0 2024-04-12T09:11:07.900 INFO:tasks.workunit.client.0.smithi117.stdout:9/338: dread d1/d8/d12/f64 [0,4194304] 0 2024-04-12T09:11:07.904 INFO:tasks.workunit.client.0.smithi117.stdout:1/369: unlink d1/d6/d51/f56 0 2024-04-12T09:11:07.905 INFO:tasks.workunit.client.0.smithi117.stdout:6/341: creat d8/f70 x:0 0 0 2024-04-12T09:11:07.909 INFO:tasks.workunit.client.0.smithi117.stdout:4/415: link d0/d5/d25/d69/l7e d0/d5/l8a 0 2024-04-12T09:11:07.916 INFO:tasks.workunit.client.0.smithi117.stdout:0/456: creat d3/da2/fa3 x:0 0 0 2024-04-12T09:11:07.916 INFO:tasks.workunit.client.0.smithi117.stdout:9/339: truncate d1/d8/df/d1b/f1f 1751665 0 2024-04-12T09:11:07.922 INFO:tasks.workunit.client.0.smithi117.stdout:1/370: unlink d1/d64/d45/d4c/l5c 0 2024-04-12T09:11:07.922 INFO:tasks.workunit.client.0.smithi117.stdout:7/272: dwrite d0/d2/d1a/f24 [0,4194304] 0 2024-04-12T09:11:07.923 INFO:tasks.workunit.client.0.smithi117.stdout:6/342: write f2 [42021,6537] 0 2024-04-12T09:11:07.935 INFO:tasks.workunit.client.0.smithi117.stdout:0/457: rename d3/d30/f9d to d3/d22/d76/fa4 0 2024-04-12T09:11:07.962 INFO:tasks.workunit.client.0.smithi117.stdout:2/307: sync 2024-04-12T09:11:07.963 INFO:tasks.workunit.client.0.smithi117.stdout:8/331: sync 2024-04-12T09:11:07.974 INFO:tasks.workunit.client.0.smithi117.stdout:7/273: unlink d0/d2/f16 0 2024-04-12T09:11:07.979 INFO:tasks.workunit.client.0.smithi117.stdout:0/458: dwrite d3/d22/d76/d85/f9b [0,4194304] 0 2024-04-12T09:11:07.984 INFO:tasks.workunit.client.0.smithi117.stdout:8/332: dwrite db/d19/f5f [0,4194304] 0 2024-04-12T09:11:07.984 INFO:tasks.workunit.client.0.smithi117.stdout:4/416: getdents d0/d5/d39/d4e/d6b 0 2024-04-12T09:11:07.985 INFO:tasks.workunit.client.0.smithi117.stdout:7/274: dread d0/f2b [0,4194304] 0 2024-04-12T09:11:07.986 INFO:tasks.workunit.client.0.smithi117.stdout:8/333: dread - db/d13/d38/f48 zero size 2024-04-12T09:11:07.987 INFO:tasks.workunit.client.0.smithi117.stdout:2/308: creat d0/d4/d10/d27/f6b x:0 0 0 2024-04-12T09:11:07.988 INFO:tasks.workunit.client.0.smithi117.stdout:8/334: dread - db/d13/d38/f5c zero size 2024-04-12T09:11:07.989 INFO:tasks.workunit.client.0.smithi117.stdout:2/309: write d0/d4/d10/f63 [4446094,127598] 0 2024-04-12T09:11:07.992 INFO:tasks.workunit.client.0.smithi117.stdout:6/343: link d8/d9/d17/d33/c5f d8/d9/d17/d33/c71 0 2024-04-12T09:11:07.994 INFO:tasks.workunit.client.0.smithi117.stdout:6/344: read d8/d3a/d49/f4e [7098,117157] 0 2024-04-12T09:11:07.996 INFO:tasks.workunit.client.0.smithi117.stdout:9/340: dread d1/fc [0,4194304] 0 2024-04-12T09:11:07.997 INFO:tasks.workunit.client.0.smithi117.stdout:8/335: dwrite db/d19/d1a/f21 [0,4194304] 0 2024-04-12T09:11:07.998 INFO:tasks.workunit.client.0.smithi117.stdout:9/341: write d1/f61 [738305,43115] 0 2024-04-12T09:11:07.999 INFO:tasks.workunit.client.0.smithi117.stdout:0/459: mknod d3/d59/d6a/d91/d94/d5a/d62/ca5 0 2024-04-12T09:11:08.000 INFO:tasks.workunit.client.0.smithi117.stdout:0/460: truncate d3/d30/f38 332480 0 2024-04-12T09:11:08.000 INFO:tasks.workunit.client.0.smithi117.stdout:0/461: fsync d3/dc/f69 0 2024-04-12T09:11:08.001 INFO:tasks.workunit.client.0.smithi117.stdout:0/462: read - d3/f25 zero size 2024-04-12T09:11:08.005 INFO:tasks.workunit.client.0.smithi117.stdout:7/275: creat d0/d2/d1a/d49/f56 x:0 0 0 2024-04-12T09:11:08.014 INFO:tasks.workunit.client.0.smithi117.stdout:8/336: creat db/d4b/f72 x:0 0 0 2024-04-12T09:11:08.014 INFO:tasks.workunit.client.0.smithi117.stdout:8/337: chown db/d1b/d55/f68 0 1 2024-04-12T09:11:08.015 INFO:tasks.workunit.client.0.smithi117.stdout:4/417: creat d0/d1/d34/d7d/f8b x:0 0 0 2024-04-12T09:11:08.021 INFO:tasks.workunit.client.0.smithi117.stdout:7/276: dread d0/f47 [0,4194304] 0 2024-04-12T09:11:08.023 INFO:tasks.workunit.client.0.smithi117.stdout:4/418: dwrite d0/d1/d34/d7d/f8b [0,4194304] 0 2024-04-12T09:11:08.023 INFO:tasks.workunit.client.0.smithi117.stdout:7/277: chown d0/d2/d45/d17/d23/d50/f3b 11 1 2024-04-12T09:11:08.028 INFO:tasks.workunit.client.0.smithi117.stdout:6/345: link d8/d9/l53 d8/d3a/l72 0 2024-04-12T09:11:08.034 INFO:tasks.workunit.client.0.smithi117.stdout:6/346: dwrite d8/d9/fb [0,4194304] 0 2024-04-12T09:11:08.035 INFO:tasks.workunit.client.0.smithi117.stdout:7/278: mknod d0/d2/d45/d15/c57 0 2024-04-12T09:11:08.035 INFO:tasks.workunit.client.0.smithi117.stdout:6/347: stat d8/d3a/f3b 0 2024-04-12T09:11:08.036 INFO:tasks.workunit.client.0.smithi117.stdout:7/279: fdatasync d0/d2/fd 0 2024-04-12T09:11:08.041 INFO:tasks.workunit.client.0.smithi117.stdout:4/419: rename d0/c81 to d0/d5/d3b/d38/d4f/c8c 0 2024-04-12T09:11:08.042 INFO:tasks.workunit.client.0.smithi117.stdout:4/420: truncate d0/d5/d39/f77 19196 0 2024-04-12T09:11:08.047 INFO:tasks.workunit.client.0.smithi117.stdout:0/463: getdents d3/d22/d76 0 2024-04-12T09:11:08.051 INFO:tasks.workunit.client.0.smithi117.stdout:6/348: rename d8/d2a/l5d to d8/d3a/d49/l73 0 2024-04-12T09:11:08.053 INFO:tasks.workunit.client.0.smithi117.stdout:4/421: mkdir d0/d2c/d8d 0 2024-04-12T09:11:08.054 INFO:tasks.workunit.client.0.smithi117.stdout:4/422: write d0/d5/d3b/d38/d4f/f74 [109586,56356] 0 2024-04-12T09:11:08.055 INFO:tasks.workunit.client.0.smithi117.stdout:8/338: link db/d1b/l5a db/d13/d38/l73 0 2024-04-12T09:11:08.056 INFO:tasks.workunit.client.0.smithi117.stdout:8/339: read - db/d1b/d55/f68 zero size 2024-04-12T09:11:08.057 INFO:tasks.workunit.client.0.smithi117.stdout:8/340: chown db/d19/d1a/d3d/l37 82572528 1 2024-04-12T09:11:08.057 INFO:tasks.workunit.client.0.smithi117.stdout:7/280: mkdir d0/d2/d45/d53/d58 0 2024-04-12T09:11:08.061 INFO:tasks.workunit.client.0.smithi117.stdout:0/464: rename d3/dc/f51 to d3/d59/d6a/d91/d94/d89/d9a/fa6 0 2024-04-12T09:11:08.062 INFO:tasks.workunit.client.0.smithi117.stdout:4/423: dwrite d0/d2c/d3c/f87 [0,4194304] 0 2024-04-12T09:11:08.065 INFO:tasks.workunit.client.0.smithi117.stdout:8/341: creat db/d4b/f74 x:0 0 0 2024-04-12T09:11:08.066 INFO:tasks.workunit.client.0.smithi117.stdout:7/281: dwrite d0/d2/d45/d15/f54 [0,4194304] 0 2024-04-12T09:11:08.067 INFO:tasks.workunit.client.0.smithi117.stdout:8/342: write db/d13/f4d [1489724,65302] 0 2024-04-12T09:11:08.073 INFO:tasks.workunit.client.0.smithi117.stdout:6/349: symlink d8/d2a/d60/l74 0 2024-04-12T09:11:08.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:07 smithi203 ceph-mon[36428]: pgmap v14: 65 pgs: 65 active+clean; 824 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 8.8 MiB/s rd, 102 MiB/s wr, 364 op/s 2024-04-12T09:11:08.073 INFO:tasks.workunit.client.0.smithi117.stdout:6/350: read - d8/d9/d17/f68 zero size 2024-04-12T09:11:08.077 INFO:tasks.workunit.client.0.smithi117.stdout:6/351: dread d8/d3a/f3b [0,4194304] 0 2024-04-12T09:11:08.077 INFO:tasks.workunit.client.0.smithi117.stdout:0/465: mkdir d3/d59/d6a/d91/d94/d89/da7 0 2024-04-12T09:11:08.081 INFO:tasks.workunit.client.0.smithi117.stdout:4/424: read d0/d2c/d3c/f45 [235631,60094] 0 2024-04-12T09:11:08.085 INFO:tasks.workunit.client.0.smithi117.stdout:6/352: dwrite d8/d9/d39/f4f [0,4194304] 0 2024-04-12T09:11:08.085 INFO:tasks.workunit.client.0.smithi117.stdout:8/343: creat db/d19/f75 x:0 0 0 2024-04-12T09:11:08.086 INFO:tasks.workunit.client.0.smithi117.stdout:8/344: dread - db/d4b/f72 zero size 2024-04-12T09:11:08.088 INFO:tasks.workunit.client.0.smithi117.stdout:8/345: truncate db/d13/d38/d46/f67 183960 0 2024-04-12T09:11:08.089 INFO:tasks.workunit.client.0.smithi117.stdout:8/346: chown db/d19/f2b 1582 1 2024-04-12T09:11:08.093 INFO:tasks.workunit.client.0.smithi117.stdout:4/425: write d0/d2c/f31 [1128369,1373] 0 2024-04-12T09:11:08.095 INFO:tasks.workunit.client.0.smithi117.stdout:0/466: dwrite d3/d59/d6a/d91/d94/d5a/d62/d66/f7f [0,4194304] 0 2024-04-12T09:11:08.095 INFO:tasks.workunit.client.0.smithi117.stdout:8/347: fsync db/d1b/f11 0 2024-04-12T09:11:08.096 INFO:tasks.workunit.client.0.smithi117.stdout:0/467: chown d3/d22/d76/d85 4581967 1 2024-04-12T09:11:08.097 INFO:tasks.workunit.client.0.smithi117.stdout:8/348: dread - db/d19/f75 zero size 2024-04-12T09:11:08.100 INFO:tasks.workunit.client.0.smithi117.stdout:7/282: creat d0/d2/d45/f59 x:0 0 0 2024-04-12T09:11:08.100 INFO:tasks.workunit.client.0.smithi117.stdout:7/283: dread - d0/d2/d1a/d49/f4e zero size 2024-04-12T09:11:08.101 INFO:tasks.workunit.client.0.smithi117.stdout:7/284: write d0/d2/d45/f59 [598127,101935] 0 2024-04-12T09:11:08.106 INFO:tasks.workunit.client.0.smithi117.stdout:0/468: dread d3/f20 [0,4194304] 0 2024-04-12T09:11:08.107 INFO:tasks.workunit.client.0.smithi117.stdout:7/285: creat d0/d2/d45/f5a x:0 0 0 2024-04-12T09:11:08.110 INFO:tasks.workunit.client.0.smithi117.stdout:0/469: getdents d3/d47 0 2024-04-12T09:11:08.111 INFO:tasks.workunit.client.0.smithi117.stdout:7/286: mknod d0/d2/d45/d17/d23/d50/c5b 0 2024-04-12T09:11:08.113 INFO:tasks.workunit.client.0.smithi117.stdout:0/470: truncate d3/f14 809805 0 2024-04-12T09:11:08.115 INFO:tasks.workunit.client.0.smithi117.stdout:7/287: mkdir d0/d2/d45/d17/d23/d50/d5c 0 2024-04-12T09:11:08.120 INFO:tasks.workunit.client.0.smithi117.stdout:7/288: creat d0/f5d x:0 0 0 2024-04-12T09:11:08.126 INFO:tasks.workunit.client.0.smithi117.stdout:7/289: write d0/d2/d1a/d49/f56 [514168,93679] 0 2024-04-12T09:11:08.126 INFO:tasks.workunit.client.0.smithi117.stdout:0/471: rename d3/d59/d6a/d91/d94/d89 to d3/d22/d76/d83/da8 0 2024-04-12T09:11:08.126 INFO:tasks.workunit.client.0.smithi117.stdout:7/290: dread - d0/f5d zero size 2024-04-12T09:11:08.126 INFO:tasks.workunit.client.0.smithi117.stdout:0/472: write d3/d59/f6d [5214974,43784] 0 2024-04-12T09:11:08.126 INFO:tasks.workunit.client.0.smithi117.stdout:0/473: write d3/d22/d76/d85/f9b [2721894,37539] 0 2024-04-12T09:11:08.132 INFO:tasks.workunit.client.0.smithi117.stdout:0/474: rename d3/dc/f16 to d3/d59/d6a/d91/fa9 0 2024-04-12T09:11:08.133 INFO:tasks.workunit.client.0.smithi117.stdout:7/291: dwrite d0/da/f2d [0,4194304] 0 2024-04-12T09:11:08.136 INFO:tasks.workunit.client.0.smithi117.stdout:7/292: creat d0/d2/d1a/d49/f5e x:0 0 0 2024-04-12T09:11:08.137 INFO:tasks.workunit.client.0.smithi117.stdout:7/293: fdatasync d0/d2/d45/d15/f25 0 2024-04-12T09:11:08.138 INFO:tasks.workunit.client.0.smithi117.stdout:0/475: fsync d3/d22/f2d 0 2024-04-12T09:11:08.142 INFO:tasks.workunit.client.0.smithi117.stdout:4/426: write d0/d5/f6e [1294505,68714] 0 2024-04-12T09:11:08.143 INFO:tasks.workunit.client.0.smithi117.stdout:0/476: read - d3/d59/d6a/d91/f4a zero size 2024-04-12T09:11:08.144 INFO:tasks.workunit.client.0.smithi117.stdout:7/294: getdents d0/d2/d45/d53/d58 0 2024-04-12T09:11:08.145 INFO:tasks.workunit.client.0.smithi117.stdout:0/477: readlink d3/d59/d6a/d91/d7a/l43 0 2024-04-12T09:11:08.146 INFO:tasks.workunit.client.0.smithi117.stdout:4/427: dread d0/d5/d39/f36 [0,4194304] 0 2024-04-12T09:11:08.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:07 smithi117 ceph-mon[29277]: pgmap v14: 65 pgs: 65 active+clean; 824 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 8.8 MiB/s rd, 102 MiB/s wr, 364 op/s 2024-04-12T09:11:08.195 INFO:tasks.workunit.client.0.smithi117.stdout:5/379: sync 2024-04-12T09:11:08.195 INFO:tasks.workunit.client.0.smithi117.stdout:7/295: mkdir d0/d2/d1a/d5f 0 2024-04-12T09:11:08.197 INFO:tasks.workunit.client.0.smithi117.stdout:5/380: write d2/d3/dd/d39/f61 [53608,61747] 0 2024-04-12T09:11:08.200 INFO:tasks.workunit.client.0.smithi117.stdout:4/428: unlink d0/d5/d25/d69/l7e 0 2024-04-12T09:11:08.203 INFO:tasks.workunit.client.0.smithi117.stdout:5/381: creat d2/d3/d2e/d74/f7e x:0 0 0 2024-04-12T09:11:08.204 INFO:tasks.workunit.client.0.smithi117.stdout:4/429: creat d0/d5/d43/f8e x:0 0 0 2024-04-12T09:11:08.204 INFO:tasks.workunit.client.0.smithi117.stdout:7/296: dread d0/d2/d45/d17/f29 [0,4194304] 0 2024-04-12T09:11:08.205 INFO:tasks.workunit.client.0.smithi117.stdout:7/297: fdatasync d0/d2/d1a/d49/f56 0 2024-04-12T09:11:08.208 INFO:tasks.workunit.client.0.smithi117.stdout:4/430: mkdir d0/d5/d3b/d8f 0 2024-04-12T09:11:08.209 INFO:tasks.workunit.client.0.smithi117.stdout:4/431: dread d0/d5/f50 [0,4194304] 0 2024-04-12T09:11:08.211 INFO:tasks.workunit.client.0.smithi117.stdout:7/298: readlink d0/d2/d45/d17/l4b 0 2024-04-12T09:11:08.211 INFO:tasks.workunit.client.0.smithi117.stdout:4/432: write d0/d5/d3b/d38/d4f/f7a [962805,85211] 0 2024-04-12T09:11:08.215 INFO:tasks.workunit.client.0.smithi117.stdout:5/382: rename d2/f28 to d2/d3/de/d1e/f7f 0 2024-04-12T09:11:08.216 INFO:tasks.workunit.client.0.smithi117.stdout:4/433: chown d0/d72/c2d 55 1 2024-04-12T09:11:08.218 INFO:tasks.workunit.client.0.smithi117.stdout:7/299: rmdir d0/d2/d45/d17/d23 39 2024-04-12T09:11:08.218 INFO:tasks.workunit.client.0.smithi117.stdout:7/300: dread - d0/d2/d45/f5a zero size 2024-04-12T09:11:08.226 INFO:tasks.workunit.client.0.smithi117.stdout:5/383: fsync d2/d3/de/d1e/d46/f51 0 2024-04-12T09:11:08.227 INFO:tasks.workunit.client.0.smithi117.stdout:5/384: fsync d2/d3/de/d1e/d2c/f75 0 2024-04-12T09:11:08.228 INFO:tasks.workunit.client.0.smithi117.stdout:7/301: symlink d0/d2/d45/d17/d23/l60 0 2024-04-12T09:11:08.229 INFO:tasks.workunit.client.0.smithi117.stdout:7/302: chown d0/d2/le 3 1 2024-04-12T09:11:08.230 INFO:tasks.workunit.client.0.smithi117.stdout:5/385: symlink d2/d3/dd/d39/l80 0 2024-04-12T09:11:08.231 INFO:tasks.workunit.client.0.smithi117.stdout:5/386: stat d2/f5d 0 2024-04-12T09:11:08.232 INFO:tasks.workunit.client.0.smithi117.stdout:4/434: dread d0/d5/d39/f3e [0,4194304] 0 2024-04-12T09:11:08.234 INFO:tasks.workunit.client.0.smithi117.stdout:5/387: unlink d2/d3/f5f 0 2024-04-12T09:11:08.235 INFO:tasks.workunit.client.0.smithi117.stdout:5/388: write d2/d3/d2e/d4d/f6c [4824072,5049] 0 2024-04-12T09:11:08.242 INFO:tasks.workunit.client.0.smithi117.stdout:5/389: rmdir d2/d3/de/d1e 39 2024-04-12T09:11:08.243 INFO:tasks.workunit.client.0.smithi117.stdout:5/390: chown d2/c62 1 1 2024-04-12T09:11:08.243 INFO:tasks.workunit.client.0.smithi117.stdout:4/435: creat d0/d2c/d67/f90 x:0 0 0 2024-04-12T09:11:08.247 INFO:tasks.workunit.client.0.smithi117.stdout:4/436: creat d0/d72/f91 x:0 0 0 2024-04-12T09:11:08.250 INFO:tasks.workunit.client.0.smithi117.stdout:4/437: unlink d0/d5/d39/d4e/f6c 0 2024-04-12T09:11:08.253 INFO:tasks.workunit.client.0.smithi117.stdout:7/303: truncate d0/d2/d45/d17/f3a 1999056 0 2024-04-12T09:11:08.254 INFO:tasks.workunit.client.0.smithi117.stdout:4/438: dread d0/d5/f50 [0,4194304] 0 2024-04-12T09:11:08.259 INFO:tasks.workunit.client.0.smithi117.stdout:4/439: link d0/d5/d43/f8e d0/d5/f92 0 2024-04-12T09:11:08.262 INFO:tasks.workunit.client.0.smithi117.stdout:7/304: rename d0/f47 to d0/d2/d45/d17/f61 0 2024-04-12T09:11:08.264 INFO:tasks.workunit.client.0.smithi117.stdout:5/391: dwrite d2/d3/d2e/f30 [0,4194304] 0 2024-04-12T09:11:08.266 INFO:tasks.workunit.client.0.smithi117.stdout:7/305: creat d0/d2/d1a/d49/f62 x:0 0 0 2024-04-12T09:11:08.273 INFO:tasks.workunit.client.0.smithi117.stdout:7/306: symlink d0/d2/d1a/d4f/l63 0 2024-04-12T09:11:08.280 INFO:tasks.workunit.client.0.smithi117.stdout:5/392: write d2/f36 [3658064,121762] 0 2024-04-12T09:11:08.283 INFO:tasks.workunit.client.0.smithi117.stdout:7/307: write d0/d2/d45/d17/f31 [1335741,115247] 0 2024-04-12T09:11:08.283 INFO:tasks.workunit.client.0.smithi117.stdout:5/393: chown d2/d3/c31 33403 1 2024-04-12T09:11:08.284 INFO:tasks.workunit.client.0.smithi117.stdout:5/394: dread - d2/d3/dd/f6d zero size 2024-04-12T09:11:08.286 INFO:tasks.workunit.client.0.smithi117.stdout:5/395: dread - d2/d3/de/d1e/d2c/f75 zero size 2024-04-12T09:11:08.287 INFO:tasks.workunit.client.0.smithi117.stdout:5/396: truncate d2/d3/dd/d39/d7a/f6f 834056 0 2024-04-12T09:11:08.292 INFO:tasks.workunit.client.0.smithi117.stdout:5/397: link d2/d3/dd/d39/l80 d2/d3/de/d1e/l81 0 2024-04-12T09:11:08.294 INFO:tasks.workunit.client.0.smithi117.stdout:5/398: unlink d2/d3/de/d1e/d35/l25 0 2024-04-12T09:11:08.296 INFO:tasks.workunit.client.0.smithi117.stdout:5/399: write d2/d3/de/d1e/d46/f4f [315285,43974] 0 2024-04-12T09:11:08.297 INFO:tasks.workunit.client.0.smithi117.stdout:5/400: read - d2/d3/de/f47 zero size 2024-04-12T09:11:08.299 INFO:tasks.workunit.client.0.smithi117.stdout:5/401: truncate d2/d3/de/d1e/d66/f7d 878155 0 2024-04-12T09:11:08.303 INFO:tasks.workunit.client.0.smithi117.stdout:7/308: dread d0/da/f10 [0,4194304] 0 2024-04-12T09:11:08.315 INFO:tasks.workunit.client.0.smithi117.stdout:7/309: dwrite d0/da/f10 [4194304,4194304] 0 2024-04-12T09:11:08.319 INFO:tasks.workunit.client.0.smithi117.stdout:5/402: dread d2/f6 [0,4194304] 0 2024-04-12T09:11:08.321 INFO:tasks.workunit.client.0.smithi117.stdout:5/403: truncate d2/d3/dd/f4e 294179 0 2024-04-12T09:11:08.322 INFO:tasks.workunit.client.0.smithi117.stdout:7/310: write d0/d2/d45/d17/f3a [710393,112128] 0 2024-04-12T09:11:08.322 INFO:tasks.workunit.client.0.smithi117.stdout:7/311: fsync d0/f5d 0 2024-04-12T09:11:08.323 INFO:tasks.workunit.client.0.smithi117.stdout:5/404: mkdir d2/d3/dd/d39/d82 0 2024-04-12T09:11:08.329 INFO:tasks.workunit.client.0.smithi117.stdout:5/405: rename d2/d3/d2e to d2/d3/dd/d39/d83 0 2024-04-12T09:11:08.330 INFO:tasks.workunit.client.0.smithi117.stdout:7/312: dread d0/d2/d45/d17/d23/d50/f3d [0,4194304] 0 2024-04-12T09:11:08.330 INFO:tasks.workunit.client.0.smithi117.stdout:7/313: write d0/d2/d45/f5a [667296,32492] 0 2024-04-12T09:11:08.332 INFO:tasks.workunit.client.0.smithi117.stdout:5/406: rename d2/d3/de/d1e/d2c/f75 to d2/d3/dd/d39/d83/d4d/d52/f84 0 2024-04-12T09:11:08.334 INFO:tasks.workunit.client.0.smithi117.stdout:5/407: readlink d2/d3/dd/d39/d7a/l72 0 2024-04-12T09:11:08.336 INFO:tasks.workunit.client.0.smithi117.stdout:5/408: unlink d2/d3/de/f47 0 2024-04-12T09:11:08.336 INFO:tasks.workunit.client.0.smithi117.stdout:7/314: getdents d0/d2/d45/d15 0 2024-04-12T09:11:08.340 INFO:tasks.workunit.client.0.smithi117.stdout:5/409: dread d2/d3/dd/d39/d83/f68 [0,4194304] 0 2024-04-12T09:11:08.346 INFO:tasks.workunit.client.0.smithi117.stdout:5/410: dwrite d2/d3/dd/f6d [0,4194304] 0 2024-04-12T09:11:08.348 INFO:tasks.workunit.client.0.smithi117.stdout:7/315: dread d0/d2/d45/d17/f31 [0,4194304] 0 2024-04-12T09:11:08.352 INFO:tasks.workunit.client.0.smithi117.stdout:5/411: dread d2/d3/dd/d39/d83/d4d/f6c [0,4194304] 0 2024-04-12T09:11:08.353 INFO:tasks.workunit.client.0.smithi117.stdout:5/412: write d2/d3/de/d1e/d46/f51 [1893755,96842] 0 2024-04-12T09:11:08.357 INFO:tasks.workunit.client.0.smithi117.stdout:1/371: sync 2024-04-12T09:11:08.357 INFO:tasks.workunit.client.0.smithi117.stdout:3/618: sync 2024-04-12T09:11:08.360 INFO:tasks.workunit.client.0.smithi117.stdout:5/413: dwrite d2/d3/dd/d39/d83/d74/f7e [0,4194304] 0 2024-04-12T09:11:08.363 INFO:tasks.workunit.client.0.smithi117.stdout:3/619: write de/d2c/d59/d70/d3d/d63/f7e [455183,127244] 0 2024-04-12T09:11:08.372 INFO:tasks.workunit.client.0.smithi117.stdout:5/414: symlink d2/d3/de/d1e/d66/l85 0 2024-04-12T09:11:08.374 INFO:tasks.workunit.client.0.smithi117.stdout:1/372: dwrite d1/d6/d3f/db/d1d/d24/f44 [0,4194304] 0 2024-04-12T09:11:08.376 INFO:tasks.workunit.client.0.smithi117.stdout:5/415: write d2/d3/de/d1e/f44 [4805146,9795] 0 2024-04-12T09:11:08.376 INFO:tasks.workunit.client.0.smithi117.stdout:3/620: creat de/d2c/d59/d70/d3e/d5d/d80/d97/d9a/feb x:0 0 0 2024-04-12T09:11:08.381 INFO:tasks.workunit.client.0.smithi117.stdout:1/373: dwrite d1/d6/d3f/db/d1d/d24/f44 [4194304,4194304] 0 2024-04-12T09:11:08.383 INFO:tasks.workunit.client.0.smithi117.stdout:1/374: fdatasync d1/d64/d45/d4c/f59 0 2024-04-12T09:11:08.384 INFO:tasks.workunit.client.0.smithi117.stdout:5/416: dwrite d2/d3/dd/d39/d83/d4d/f5c [0,4194304] 0 2024-04-12T09:11:08.385 INFO:tasks.workunit.client.0.smithi117.stdout:5/417: write d2/f49 [708454,41941] 0 2024-04-12T09:11:08.489 INFO:tasks.workunit.client.0.smithi117.stdout:3/621: rename de/d2c/d59/d70/d3e/d84/fb6 to de/d2c/d59/d70/d40/fec 0 2024-04-12T09:11:08.490 INFO:tasks.workunit.client.0.smithi117.stdout:5/418: write d2/d3/de/d1e/d2c/f7b [872542,79445] 0 2024-04-12T09:11:08.492 INFO:tasks.workunit.client.0.smithi117.stdout:5/419: write d2/d3/dd/d39/f61 [1687943,87847] 0 2024-04-12T09:11:08.494 INFO:tasks.workunit.client.0.smithi117.stdout:1/375: mkdir d1/d6/d3f/db/d1d/d24/d71 0 2024-04-12T09:11:08.498 INFO:tasks.workunit.client.0.smithi117.stdout:5/420: readlink d2/d3/de/d1e/l81 0 2024-04-12T09:11:08.498 INFO:tasks.workunit.client.0.smithi117.stdout:1/376: dread d1/d64/d3e/f55 [0,4194304] 0 2024-04-12T09:11:08.500 INFO:tasks.workunit.client.0.smithi117.stdout:5/421: readlink d2/d3/dd/d39/d83/d4d/d6b/l77 0 2024-04-12T09:11:08.501 INFO:tasks.workunit.client.0.smithi117.stdout:1/377: mkdir d1/d6/d3f/d72 0 2024-04-12T09:11:08.503 INFO:tasks.workunit.client.0.smithi117.stdout:1/378: write d1/d6/d3f/f35 [2321959,85802] 0 2024-04-12T09:11:08.508 INFO:tasks.workunit.client.0.smithi117.stdout:1/379: link d1/d6/d3f/db/d1d/f5b d1/d6/d3f/db/f73 0 2024-04-12T09:11:08.511 INFO:tasks.workunit.client.0.smithi117.stdout:1/380: write d1/f10 [8471268,33850] 0 2024-04-12T09:11:08.513 INFO:tasks.workunit.client.0.smithi117.stdout:5/422: truncate d2/d3/dd/d39/d83/d74/f7e 2297956 0 2024-04-12T09:11:08.513 INFO:tasks.workunit.client.0.smithi117.stdout:3/622: dread de/d2c/d59/d70/d3e/f50 [0,4194304] 0 2024-04-12T09:11:08.514 INFO:tasks.workunit.client.0.smithi117.stdout:5/423: write d2/d3/dd/f6d [128717,96128] 0 2024-04-12T09:11:08.515 INFO:tasks.workunit.client.0.smithi117.stdout:1/381: mknod d1/d64/d45/c74 0 2024-04-12T09:11:08.518 INFO:tasks.workunit.client.0.smithi117.stdout:3/623: dread de/d2c/d59/d70/d3e/d3f/f43 [0,4194304] 0 2024-04-12T09:11:08.518 INFO:tasks.workunit.client.0.smithi117.stdout:5/424: creat d2/d3/dd/d39/f86 x:0 0 0 2024-04-12T09:11:08.522 INFO:tasks.workunit.client.0.smithi117.stdout:3/624: read de/d2c/d59/d70/d3e/d5d/db5/fd2 [893812,118399] 0 2024-04-12T09:11:08.522 INFO:tasks.workunit.client.0.smithi117.stdout:5/425: dread d2/f49 [0,4194304] 0 2024-04-12T09:11:08.530 INFO:tasks.workunit.client.0.smithi117.stdout:5/426: mknod d2/d3/c87 0 2024-04-12T09:11:08.533 INFO:tasks.workunit.client.0.smithi117.stdout:3/625: write de/d2c/d59/d70/d3d/f8c [822010,16412] 0 2024-04-12T09:11:08.535 INFO:tasks.workunit.client.0.smithi117.stdout:1/382: dwrite d1/d6/d3f/db/f73 [0,4194304] 0 2024-04-12T09:11:08.537 INFO:tasks.workunit.client.0.smithi117.stdout:1/383: write d1/d6/d51/f5a [198360,38463] 0 2024-04-12T09:11:08.538 INFO:tasks.workunit.client.0.smithi117.stdout:5/427: rename d2/d3/de/d1e/d2c/f7b to d2/d3/de/d1e/d46/f88 0 2024-04-12T09:11:08.544 INFO:tasks.workunit.client.0.smithi117.stdout:1/384: rename d1/d6/d3f/db/d16/l62 to d1/d6/d3f/db/d16/l75 0 2024-04-12T09:11:08.546 INFO:tasks.workunit.client.0.smithi117.stdout:5/428: stat d2/d3/de/d1e/f2d 0 2024-04-12T09:11:08.547 INFO:tasks.workunit.client.0.smithi117.stdout:5/429: chown d2/f34 70021 1 2024-04-12T09:11:08.550 INFO:tasks.workunit.client.0.smithi117.stdout:1/385: symlink d1/d6/d3f/db/d1d/d24/d71/l76 0 2024-04-12T09:11:08.552 INFO:tasks.workunit.client.0.smithi117.stdout:1/386: fsync d1/d6/d3f/db/d16/f19 0 2024-04-12T09:11:08.556 INFO:tasks.workunit.client.0.smithi117.stdout:3/626: dread de/d2c/d59/d70/d40/d79/f8a [0,4194304] 0 2024-04-12T09:11:08.556 INFO:tasks.workunit.client.0.smithi117.stdout:1/387: dread d1/d6/d3f/db/d1d/f5b [0,4194304] 0 2024-04-12T09:11:08.557 INFO:tasks.workunit.client.0.smithi117.stdout:5/430: getdents d2/d3/dd/d39 0 2024-04-12T09:11:08.558 INFO:tasks.workunit.client.0.smithi117.stdout:5/431: dread - d2/d3/de/d1e/d35/f63 zero size 2024-04-12T09:11:08.560 INFO:tasks.workunit.client.0.smithi117.stdout:3/627: mkdir de/d2c/d59/d90/ded 0 2024-04-12T09:11:08.562 INFO:tasks.workunit.client.0.smithi117.stdout:3/628: write de/d2c/d59/d70/d3e/d84/f9d [447432,88689] 0 2024-04-12T09:11:08.565 INFO:tasks.workunit.client.0.smithi117.stdout:1/388: creat d1/f77 x:0 0 0 2024-04-12T09:11:08.568 INFO:tasks.workunit.client.0.smithi117.stdout:3/629: creat de/d2c/d59/d70/d3e/d5d/d80/d82/fee x:0 0 0 2024-04-12T09:11:08.573 INFO:tasks.workunit.client.0.smithi117.stdout:1/389: rename d1/d64/d3e to d1/d6/d3f/db/d1d/d78 0 2024-04-12T09:11:08.574 INFO:tasks.workunit.client.0.smithi117.stdout:1/390: write d1/d64/d45/d4c/f59 [830909,59304] 0 2024-04-12T09:11:08.575 INFO:tasks.workunit.client.0.smithi117.stdout:3/630: mkdir de/def 0 2024-04-12T09:11:08.577 INFO:tasks.workunit.client.0.smithi117.stdout:1/391: unlink d1/f13 0 2024-04-12T09:11:08.577 INFO:tasks.workunit.client.0.smithi117.stdout:5/432: truncate d2/d3/de/d1e/f20 687113 0 2024-04-12T09:11:08.581 INFO:tasks.workunit.client.0.smithi117.stdout:5/433: creat d2/d3/dd/f89 x:0 0 0 2024-04-12T09:11:08.581 INFO:tasks.workunit.client.0.smithi117.stdout:1/392: symlink d1/d6/d3f/db/d16/l79 0 2024-04-12T09:11:08.582 INFO:tasks.workunit.client.0.smithi117.stdout:3/631: dwrite de/fd6 [0,4194304] 0 2024-04-12T09:11:08.587 INFO:tasks.workunit.client.0.smithi117.stdout:3/632: mknod de/d2c/d59/d4c/da0/cf0 0 2024-04-12T09:11:08.590 INFO:tasks.workunit.client.0.smithi117.stdout:1/393: dwrite d1/d6/d3f/db/d1d/d24/f4b [0,4194304] 0 2024-04-12T09:11:08.594 INFO:tasks.workunit.client.0.smithi117.stdout:3/633: fsync de/d2c/f99 0 2024-04-12T09:11:08.595 INFO:tasks.workunit.client.0.smithi117.stdout:1/394: mknod d1/d64/c7a 0 2024-04-12T09:11:08.597 INFO:tasks.workunit.client.0.smithi117.stdout:1/395: write d1/d6/d3f/db/d16/f2f [948040,55002] 0 2024-04-12T09:11:08.597 INFO:tasks.workunit.client.0.smithi117.stdout:5/434: link d2/d3/de/d1e/d35/c55 d2/d3/de/d1e/d2c/c8a 0 2024-04-12T09:11:08.598 INFO:tasks.workunit.client.0.smithi117.stdout:5/435: dread - d2/d3/dd/f3c zero size 2024-04-12T09:11:08.599 INFO:tasks.workunit.client.0.smithi117.stdout:1/396: write d1/d64/d45/d4c/f59 [1439823,7697] 0 2024-04-12T09:11:08.599 INFO:tasks.workunit.client.0.smithi117.stdout:3/634: rmdir de/d2c/d59/d70/d40/d49 39 2024-04-12T09:11:08.600 INFO:tasks.workunit.client.0.smithi117.stdout:1/397: fdatasync d1/d64/d45/d4c/d63/f69 0 2024-04-12T09:11:08.629 INFO:tasks.workunit.client.0.smithi117.stdout:9/342: sync 2024-04-12T09:11:08.629 INFO:tasks.workunit.client.0.smithi117.stdout:2/310: sync 2024-04-12T09:11:08.635 INFO:tasks.workunit.client.0.smithi117.stdout:3/635: mkdir de/d2c/d59/d70/d3e/d84/da1/df1 0 2024-04-12T09:11:08.638 INFO:tasks.workunit.client.0.smithi117.stdout:2/311: rename d0/d43/d4b/l4e to d0/d4/d10/d27/l6c 0 2024-04-12T09:11:08.641 INFO:tasks.workunit.client.0.smithi117.stdout:3/636: mkdir de/d2c/d59/d70/d3d/d63/df2 0 2024-04-12T09:11:08.647 INFO:tasks.workunit.client.0.smithi117.stdout:3/637: creat de/d2c/d59/d4c/d62/ff3 x:0 0 0 2024-04-12T09:11:08.649 INFO:tasks.workunit.client.0.smithi117.stdout:3/638: truncate de/d2c/d59/d4c/da0/daa/fbd 404799 0 2024-04-12T09:11:08.649 INFO:tasks.workunit.client.0.smithi117.stdout:3/639: fsync de/fd6 0 2024-04-12T09:11:08.652 INFO:tasks.workunit.client.0.smithi117.stdout:3/640: write de/f8e [4351276,4638] 0 2024-04-12T09:11:08.652 INFO:tasks.workunit.client.0.smithi117.stdout:3/641: dread - de/d2c/d59/d30/fea zero size 2024-04-12T09:11:08.667 INFO:tasks.workunit.client.0.smithi117.stdout:3/642: dread de/d2c/d59/d70/f85 [0,4194304] 0 2024-04-12T09:11:08.669 INFO:tasks.workunit.client.0.smithi117.stdout:8/349: sync 2024-04-12T09:11:08.669 INFO:tasks.workunit.client.0.smithi117.stdout:0/478: sync 2024-04-12T09:11:08.670 INFO:tasks.workunit.client.0.smithi117.stdout:6/353: sync 2024-04-12T09:11:08.670 INFO:tasks.workunit.client.0.smithi117.stdout:4/440: sync 2024-04-12T09:11:08.671 INFO:tasks.workunit.client.0.smithi117.stdout:3/643: creat de/d2c/d59/d70/d3e/d5d/d80/d97/d9a/ff4 x:0 0 0 2024-04-12T09:11:08.671 INFO:tasks.workunit.client.0.smithi117.stdout:8/350: dread - db/d1b/d55/f57 zero size 2024-04-12T09:11:08.672 INFO:tasks.workunit.client.0.smithi117.stdout:8/351: chown db/d13/d38/d46/c51 2499320 1 2024-04-12T09:11:08.673 INFO:tasks.workunit.client.0.smithi117.stdout:0/479: mknod d3/d30/caa 0 2024-04-12T09:11:08.675 INFO:tasks.workunit.client.0.smithi117.stdout:4/441: dread d0/d1/f48 [0,4194304] 0 2024-04-12T09:11:08.675 INFO:tasks.workunit.client.0.smithi117.stdout:6/354: symlink d8/d9/d39/d3c/l75 0 2024-04-12T09:11:08.677 INFO:tasks.workunit.client.0.smithi117.stdout:6/355: write d8/ff [98716,6807] 0 2024-04-12T09:11:08.681 INFO:tasks.workunit.client.0.smithi117.stdout:8/352: dread db/d19/f2b [0,4194304] 0 2024-04-12T09:11:08.681 INFO:tasks.workunit.client.0.smithi117.stdout:3/644: rename de/d2c/d59/d70/d3e/d5d/c6c to de/d2c/d59/d70/d3e/d5d/d89/dda/cf5 0 2024-04-12T09:11:08.682 INFO:tasks.workunit.client.0.smithi117.stdout:0/480: dwrite d3/d59/f6d [4194304,4194304] 0 2024-04-12T09:11:08.682 INFO:tasks.workunit.client.0.smithi117.stdout:8/353: fsync db/d13/d38/d46/f67 0 2024-04-12T09:11:08.683 INFO:tasks.workunit.client.0.smithi117.stdout:3/645: chown de/d2c/d59/d70/d3e/d84/de3 65202 1 2024-04-12T09:11:08.685 INFO:tasks.workunit.client.0.smithi117.stdout:8/354: truncate db/d1b/d62/f6f 362749 0 2024-04-12T09:11:08.688 INFO:tasks.workunit.client.0.smithi117.stdout:3/646: symlink de/d2c/d59/d70/d3e/d5d/d89/dda/lf6 0 2024-04-12T09:11:08.698 INFO:tasks.workunit.client.0.smithi117.stdout:4/442: creat d0/d2c/f93 x:0 0 0 2024-04-12T09:11:08.700 INFO:tasks.workunit.client.0.smithi117.stdout:3/647: getdents de/d2c/dc0/dcd/dd1 0 2024-04-12T09:11:08.704 INFO:tasks.workunit.client.0.smithi117.stdout:4/443: dwrite d0/d2c/f93 [0,4194304] 0 2024-04-12T09:11:08.713 INFO:tasks.workunit.client.0.smithi117.stdout:4/444: dwrite d0/d5/d39/f77 [0,4194304] 0 2024-04-12T09:11:08.718 INFO:tasks.workunit.client.0.smithi117.stdout:4/445: creat d0/d5/d3b/f94 x:0 0 0 2024-04-12T09:11:08.719 INFO:tasks.workunit.client.0.smithi117.stdout:2/312: truncate d0/d4/d10/f63 384900 0 2024-04-12T09:11:08.720 INFO:tasks.workunit.client.0.smithi117.stdout:2/313: write d0/f36 [1351100,127758] 0 2024-04-12T09:11:08.723 INFO:tasks.workunit.client.0.smithi117.stdout:4/446: rename d0/d5/d3b/f42 to d0/d5/d3b/d38/d4f/d79/f95 0 2024-04-12T09:11:08.726 INFO:tasks.workunit.client.0.smithi117.stdout:4/447: creat d0/d5/d25/d69/f96 x:0 0 0 2024-04-12T09:11:08.729 INFO:tasks.workunit.client.0.smithi117.stdout:9/343: symlink d1/d8/df/l69 0 2024-04-12T09:11:08.730 INFO:tasks.workunit.client.0.smithi117.stdout:3/648: dread de/d2c/d59/d70/d40/d49/f6e [0,4194304] 0 2024-04-12T09:11:08.731 INFO:tasks.workunit.client.0.smithi117.stdout:3/649: readlink de/d2c/l36 0 2024-04-12T09:11:08.732 INFO:tasks.workunit.client.0.smithi117.stdout:3/650: readlink de/d2c/d59/d70/d3d/d63/lc9 0 2024-04-12T09:11:08.734 INFO:tasks.workunit.client.0.smithi117.stdout:3/651: creat de/d2c/d59/d70/d40/d79/ff7 x:0 0 0 2024-04-12T09:11:08.738 INFO:tasks.workunit.client.0.smithi117.stdout:3/652: dwrite de/fd6 [4194304,4194304] 0 2024-04-12T09:11:08.742 INFO:tasks.workunit.client.0.smithi117.stdout:3/653: mkdir de/d2c/d59/d4c/da0/df8 0 2024-04-12T09:11:08.743 INFO:tasks.workunit.client.0.smithi117.stdout:3/654: read - de/d2c/d59/d4c/f57 zero size 2024-04-12T09:11:08.743 INFO:tasks.workunit.client.0.smithi117.stdout:4/448: rename d0/f14 to d0/d5/d3b/f97 0 2024-04-12T09:11:08.745 INFO:tasks.workunit.client.0.smithi117.stdout:3/655: write de/d2c/d59/d4c/da0/da8/dac/fbb [812103,29656] 0 2024-04-12T09:11:08.746 INFO:tasks.workunit.client.0.smithi117.stdout:5/436: symlink d2/d3/l8b 0 2024-04-12T09:11:08.746 INFO:tasks.workunit.client.0.smithi117.stdout:2/314: dread d0/d4/d10/d27/f39 [0,4194304] 0 2024-04-12T09:11:08.747 INFO:tasks.workunit.client.0.smithi117.stdout:4/449: fdatasync d0/d5/d39/f23 0 2024-04-12T09:11:08.751 INFO:tasks.workunit.client.0.smithi117.stdout:4/450: mknod d0/d72/c98 0 2024-04-12T09:11:08.757 INFO:tasks.workunit.client.0.smithi117.stdout:0/481: truncate d3/d59/d6a/d91/f86 881277 0 2024-04-12T09:11:08.759 INFO:tasks.workunit.client.0.smithi117.stdout:2/315: rename d0/d4/d10/f32 to d0/d43/f6d 0 2024-04-12T09:11:08.760 INFO:tasks.workunit.client.0.smithi117.stdout:2/316: dread - d0/d43/f56 zero size 2024-04-12T09:11:08.760 INFO:tasks.workunit.client.0.smithi117.stdout:0/482: rmdir d3/d59/d6a/d91 39 2024-04-12T09:11:08.761 INFO:tasks.workunit.client.0.smithi117.stdout:0/483: chown d3/d22/d76/d85 243 1 2024-04-12T09:11:08.762 INFO:tasks.workunit.client.0.smithi117.stdout:2/317: chown d0/d4/d10/d27/l33 2 1 2024-04-12T09:11:08.763 INFO:tasks.workunit.client.0.smithi117.stdout:2/318: fsync d0/d43/d30/d41/f5b 0 2024-04-12T09:11:08.764 INFO:tasks.workunit.client.0.smithi117.stdout:1/398: mkdir d1/d6/d3f/db/d1d/d7b 0 2024-04-12T09:11:08.766 INFO:tasks.workunit.client.0.smithi117.stdout:0/484: unlink d3/d59/d6a/d91/d7a/c63 0 2024-04-12T09:11:08.767 INFO:tasks.workunit.client.0.smithi117.stdout:2/319: rmdir d0/d43 39 2024-04-12T09:11:08.768 INFO:tasks.workunit.client.0.smithi117.stdout:1/399: mknod d1/d64/d45/d4c/c7c 0 2024-04-12T09:11:08.771 INFO:tasks.workunit.client.0.smithi117.stdout:1/400: creat d1/d64/d45/d4c/f7d x:0 0 0 2024-04-12T09:11:08.772 INFO:tasks.workunit.client.0.smithi117.stdout:0/485: dwrite d3/d47/f79 [0,4194304] 0 2024-04-12T09:11:08.773 INFO:tasks.workunit.client.0.smithi117.stdout:0/486: fsync d3/f4d 0 2024-04-12T09:11:08.779 INFO:tasks.workunit.client.0.smithi117.stdout:1/401: dread d1/d64/f43 [0,4194304] 0 2024-04-12T09:11:08.783 INFO:tasks.workunit.client.0.smithi117.stdout:0/487: dwrite d3/d59/d6a/d91/d94/d5a/d62/f70 [0,4194304] 0 2024-04-12T09:11:08.785 INFO:tasks.workunit.client.0.smithi117.stdout:4/451: fsync d0/d5/d25/d69/f96 0 2024-04-12T09:11:08.789 INFO:tasks.workunit.client.0.smithi117.stdout:1/402: rename d1/d6/d3f/db/d1d/d24/l6c to d1/d64/d45/d4c/l7e 0 2024-04-12T09:11:08.789 INFO:tasks.workunit.client.0.smithi117.stdout:1/403: stat d1/d64 0 2024-04-12T09:11:08.790 INFO:tasks.workunit.client.0.smithi117.stdout:0/488: mkdir d3/d22/d76/d85/dab 0 2024-04-12T09:11:08.791 INFO:tasks.workunit.client.0.smithi117.stdout:9/344: write d1/d24/f2a [672757,103775] 0 2024-04-12T09:11:08.797 INFO:tasks.workunit.client.0.smithi117.stdout:0/489: dwrite d3/dc/f1d [0,4194304] 0 2024-04-12T09:11:08.804 INFO:tasks.workunit.client.0.smithi117.stdout:4/452: creat d0/f99 x:0 0 0 2024-04-12T09:11:08.807 INFO:tasks.workunit.client.0.smithi117.stdout:0/490: symlink d3/d22/d76/d85/lac 0 2024-04-12T09:11:08.809 INFO:tasks.workunit.client.0.smithi117.stdout:3/656: dwrite de/d2c/d59/d19/d27/f38 [0,4194304] 0 2024-04-12T09:11:08.809 INFO:tasks.workunit.client.0.smithi117.stdout:0/491: dread - d3/d22/d76/f9c zero size 2024-04-12T09:11:08.816 INFO:tasks.workunit.client.0.smithi117.stdout:9/345: dread d1/d8/df/d26/f46 [0,4194304] 0 2024-04-12T09:11:08.817 INFO:tasks.workunit.client.0.smithi117.stdout:0/492: creat d3/d22/d76/d85/fad x:0 0 0 2024-04-12T09:11:08.819 INFO:tasks.workunit.client.0.smithi117.stdout:1/404: dread d1/d6/d3f/db/d1d/d24/f2e [0,4194304] 0 2024-04-12T09:11:08.819 INFO:tasks.workunit.client.0.smithi117.stdout:9/346: read d1/d8/d12/f37 [2149623,32249] 0 2024-04-12T09:11:08.820 INFO:tasks.workunit.client.0.smithi117.stdout:3/657: mkdir de/d2c/d59/d70/d3e/d84/df9 0 2024-04-12T09:11:08.822 INFO:tasks.workunit.client.0.smithi117.stdout:2/320: truncate d0/d43/d30/f5c 1598075 0 2024-04-12T09:11:08.825 INFO:tasks.workunit.client.0.smithi117.stdout:1/405: fsync d1/f40 0 2024-04-12T09:11:08.825 INFO:tasks.workunit.client.0.smithi117.stdout:9/347: creat d1/d24/f6a x:0 0 0 2024-04-12T09:11:08.826 INFO:tasks.workunit.client.0.smithi117.stdout:9/348: fdatasync d1/d8/df/d1b/f3f 0 2024-04-12T09:11:08.828 INFO:tasks.workunit.client.0.smithi117.stdout:9/349: dread d1/d8/f4e [0,4194304] 0 2024-04-12T09:11:08.836 INFO:tasks.workunit.client.0.smithi117.stdout:1/406: fsync d1/d64/d45/f50 0 2024-04-12T09:11:08.837 INFO:tasks.workunit.client.0.smithi117.stdout:1/407: fdatasync d1/d6/d3f/f20 0 2024-04-12T09:11:08.841 INFO:tasks.workunit.client.0.smithi117.stdout:7/316: sync 2024-04-12T09:11:08.842 INFO:tasks.workunit.client.0.smithi117.stdout:4/453: write d0/d1/f48 [3535732,20519] 0 2024-04-12T09:11:08.843 INFO:tasks.workunit.client.0.smithi117.stdout:1/408: dwrite d1/f40 [4194304,4194304] 0 2024-04-12T09:11:08.844 INFO:tasks.workunit.client.0.smithi117.stdout:1/409: rename d1/d64 to d1/d64/d45/d4c/d7f 22 2024-04-12T09:11:08.845 INFO:tasks.workunit.client.0.smithi117.stdout:9/350: dread d1/d8/d12/f64 [0,4194304] 0 2024-04-12T09:11:08.850 INFO:tasks.workunit.client.0.smithi117.stdout:4/454: symlink d0/d72/l9a 0 2024-04-12T09:11:08.850 INFO:tasks.workunit.client.0.smithi117.stdout:9/351: symlink d1/d8/df/d26/d41/l6b 0 2024-04-12T09:11:08.851 INFO:tasks.workunit.client.0.smithi117.stdout:9/352: readlink d1/d8/d12/l60 0 2024-04-12T09:11:08.853 INFO:tasks.workunit.client.0.smithi117.stdout:2/321: write d0/d43/f6d [3412882,86732] 0 2024-04-12T09:11:08.853 INFO:tasks.workunit.client.0.smithi117.stdout:9/353: write d1/d24/f2a [1152542,27168] 0 2024-04-12T09:11:08.895 INFO:tasks.workunit.client.0.smithi117.stdout:1/410: link d1/d6/d3f/db/f33 d1/d6/d3f/db/f80 0 2024-04-12T09:11:08.896 INFO:tasks.workunit.client.0.smithi117.stdout:0/493: truncate d3/dc/f34 1423922 0 2024-04-12T09:11:08.898 INFO:tasks.workunit.client.0.smithi117.stdout:3/658: dwrite de/d2c/d59/d70/d3e/d3f/f51 [0,4194304] 0 2024-04-12T09:11:08.898 INFO:tasks.workunit.client.0.smithi117.stdout:2/322: creat d0/d43/d30/f6e x:0 0 0 2024-04-12T09:11:08.899 INFO:tasks.workunit.client.0.smithi117.stdout:9/354: creat d1/d8/d52/f6c x:0 0 0 2024-04-12T09:11:08.900 INFO:tasks.workunit.client.0.smithi117.stdout:2/323: fsync d0/d4/d10/d27/f6b 0 2024-04-12T09:11:08.901 INFO:tasks.workunit.client.0.smithi117.stdout:0/494: write d3/d22/d76/f9c [894449,55773] 0 2024-04-12T09:11:08.903 INFO:tasks.workunit.client.0.smithi117.stdout:3/659: unlink de/d2c/d59/d4c/fd4 0 2024-04-12T09:11:08.907 INFO:tasks.workunit.client.0.smithi117.stdout:7/317: dwrite d0/d2/d45/d17/f61 [0,4194304] 0 2024-04-12T09:11:08.908 INFO:tasks.workunit.client.0.smithi117.stdout:7/318: readlink d0/d2/l11 0 2024-04-12T09:11:08.909 INFO:tasks.workunit.client.0.smithi117.stdout:2/324: rmdir d0/d43 39 2024-04-12T09:11:08.910 INFO:tasks.workunit.client.0.smithi117.stdout:0/495: read d3/d59/f5c [130833,6482] 0 2024-04-12T09:11:08.912 INFO:tasks.workunit.client.0.smithi117.stdout:1/411: link d1/d6/d3f/db/d1d/d24/f4b d1/d6/d51/f81 0 2024-04-12T09:11:08.913 INFO:tasks.workunit.client.0.smithi117.stdout:1/412: chown d1 42 1 2024-04-12T09:11:08.914 INFO:tasks.workunit.client.0.smithi117.stdout:1/413: dread - d1/d6/d3f/db/d16/f47 zero size 2024-04-12T09:11:08.919 INFO:tasks.workunit.client.0.smithi117.stdout:7/319: creat d0/d2/d45/d17/d23/d50/f64 x:0 0 0 2024-04-12T09:11:08.921 INFO:tasks.workunit.client.0.smithi117.stdout:2/325: creat d0/d43/d53/f6f x:0 0 0 2024-04-12T09:11:08.922 INFO:tasks.workunit.client.0.smithi117.stdout:2/326: read d0/d43/d30/f47 [451173,113840] 0 2024-04-12T09:11:08.929 INFO:tasks.workunit.client.0.smithi117.stdout:9/355: dwrite d1/d24/f57 [0,4194304] 0 2024-04-12T09:11:08.934 INFO:tasks.workunit.client.0.smithi117.stdout:3/660: rename de/d2c/d59/d70/d3d/d63/df2 to de/d2c/d59/d70/d3e/d84/dfa 0 2024-04-12T09:11:08.937 INFO:tasks.workunit.client.0.smithi117.stdout:3/661: chown de/d2c/d59/d70/f85 59726 1 2024-04-12T09:11:08.937 INFO:tasks.workunit.client.0.smithi117.stdout:9/356: dwrite d1/d24/f63 [0,4194304] 0 2024-04-12T09:11:08.945 INFO:tasks.workunit.client.0.smithi117.stdout:2/327: dread d0/df/f46 [0,4194304] 0 2024-04-12T09:11:08.953 INFO:tasks.workunit.client.0.smithi117.stdout:9/357: dwrite d1/d8/df/d39/d3b/f4a [0,4194304] 0 2024-04-12T09:11:08.954 INFO:tasks.workunit.client.0.smithi117.stdout:0/496: rename d3/f14 to d3/d22/fae 0 2024-04-12T09:11:08.960 INFO:tasks.workunit.client.0.smithi117.stdout:7/320: unlink d0/d13/c18 0 2024-04-12T09:11:08.961 INFO:tasks.workunit.client.0.smithi117.stdout:2/328: truncate d0/d4/d10/f19 8205235 0 2024-04-12T09:11:08.965 INFO:tasks.workunit.client.0.smithi117.stdout:1/414: link d1/d64/d45/d4c/c7c d1/d64/d45/c82 0 2024-04-12T09:11:08.965 INFO:tasks.workunit.client.0.smithi117.stdout:1/415: chown d1/d6/d3f/f20 252 1 2024-04-12T09:11:08.967 INFO:tasks.workunit.client.0.smithi117.stdout:7/321: mknod d0/d2/d45/d17/d23/d50/c65 0 2024-04-12T09:11:08.971 INFO:tasks.workunit.client.0.smithi117.stdout:3/662: rmdir de/d2c/d59/d4c/da0/df8 0 2024-04-12T09:11:08.972 INFO:tasks.workunit.client.0.smithi117.stdout:1/416: dread d1/d6/d51/f81 [0,4194304] 0 2024-04-12T09:11:08.976 INFO:tasks.workunit.client.0.smithi117.stdout:7/322: dwrite d0/d2/d45/d17/f44 [4194304,4194304] 0 2024-04-12T09:11:08.976 INFO:tasks.workunit.client.0.smithi117.stdout:3/663: chown de/d2c/d59/d70/d3e/d5d/d89/dda/cdd 929 1 2024-04-12T09:11:08.976 INFO:tasks.workunit.client.0.smithi117.stdout:7/323: readlink d0/da/l1f 0 2024-04-12T09:11:08.976 INFO:tasks.workunit.client.0.smithi117.stdout:0/497: dread d3/d30/f61 [0,4194304] 0 2024-04-12T09:11:08.983 INFO:tasks.workunit.client.0.smithi117.stdout:1/417: creat d1/d6/d51/f83 x:0 0 0 2024-04-12T09:11:08.991 INFO:tasks.workunit.client.0.smithi117.stdout:9/358: truncate d1/d24/f2e 1043387 0 2024-04-12T09:11:08.991 INFO:tasks.workunit.client.0.smithi117.stdout:9/359: readlink d1/d23/d27/l5f 0 2024-04-12T09:11:08.992 INFO:tasks.workunit.client.0.smithi117.stdout:9/360: chown d1/d8/d12/f20 476275 1 2024-04-12T09:11:08.992 INFO:tasks.workunit.client.0.smithi117.stdout:1/418: fdatasync d1/d6/d3f/db/d1d/d24/f2e 0 2024-04-12T09:11:08.998 INFO:tasks.workunit.client.0.smithi117.stdout:9/361: dwrite d1/d8/df/f13 [0,4194304] 0 2024-04-12T09:11:08.999 INFO:tasks.workunit.client.0.smithi117.stdout:3/664: dread de/d2c/d59/d19/f29 [0,4194304] 0 2024-04-12T09:11:09.006 INFO:tasks.workunit.client.0.smithi117.stdout:7/324: link d0/d2/d45/d17/d23/d50/f3b d0/d2/d45/d17/d23/d50/f66 0 2024-04-12T09:11:09.007 INFO:tasks.workunit.client.0.smithi117.stdout:7/325: stat d0/d2/d45/d17/d23/d50/c5b 0 2024-04-12T09:11:09.013 INFO:tasks.workunit.client.0.smithi117.stdout:7/326: dwrite d0/d2/f43 [0,4194304] 0 2024-04-12T09:11:09.014 INFO:tasks.workunit.client.0.smithi117.stdout:2/329: link d0/d4/d10/f19 d0/d4/d10/d27/f70 0 2024-04-12T09:11:09.015 INFO:tasks.workunit.client.0.smithi117.stdout:7/327: write d0/d2/d1a/d49/f5e [117964,39730] 0 2024-04-12T09:11:09.023 INFO:tasks.workunit.client.0.smithi117.stdout:2/330: dread d0/f36 [0,4194304] 0 2024-04-12T09:11:09.025 INFO:tasks.workunit.client.0.smithi117.stdout:0/498: dwrite d3/d59/d6a/d91/f45 [0,4194304] 0 2024-04-12T09:11:09.027 INFO:tasks.workunit.client.0.smithi117.stdout:7/328: mknod d0/d2/d1a/c67 0 2024-04-12T09:11:09.029 INFO:tasks.workunit.client.0.smithi117.stdout:3/665: getdents de/d2c/d59/d19 0 2024-04-12T09:11:09.031 INFO:tasks.workunit.client.0.smithi117.stdout:2/331: dwrite d0/d43/d30/f6e [0,4194304] 0 2024-04-12T09:11:09.032 INFO:tasks.workunit.client.0.smithi117.stdout:3/666: write de/d2c/d59/d70/d3d/d63/f7e [2169557,95512] 0 2024-04-12T09:11:09.033 INFO:tasks.workunit.client.0.smithi117.stdout:9/362: write d1/d24/f2e [326854,61679] 0 2024-04-12T09:11:09.036 INFO:tasks.workunit.client.0.smithi117.stdout:7/329: creat d0/d2/d12/f68 x:0 0 0 2024-04-12T09:11:09.040 INFO:tasks.workunit.client.0.smithi117.stdout:2/332: mknod d0/d4/c71 0 2024-04-12T09:11:09.041 INFO:tasks.workunit.client.0.smithi117.stdout:7/330: dwrite d0/d2/fd [0,4194304] 0 2024-04-12T09:11:09.043 INFO:tasks.workunit.client.0.smithi117.stdout:7/331: chown d0/d2/d45/d17/d23/d39/f48 366747 1 2024-04-12T09:11:09.050 INFO:tasks.workunit.client.0.smithi117.stdout:2/333: creat d0/d43/d30/d41/f72 x:0 0 0 2024-04-12T09:11:09.051 INFO:tasks.workunit.client.0.smithi117.stdout:7/332: rmdir d0/d2 39 2024-04-12T09:11:09.054 INFO:tasks.workunit.client.0.smithi117.stdout:9/363: link d1/f15 d1/d8/d5e/f6d 0 2024-04-12T09:11:09.055 INFO:tasks.workunit.client.0.smithi117.stdout:2/334: dwrite d0/df/f20 [0,4194304] 0 2024-04-12T09:11:09.059 INFO:tasks.workunit.client.0.smithi117.stdout:7/333: rename d0/d2/d45/d17/d23/d50 to d0/d2/d45/d17/d23/d50/d5c/d69 22 2024-04-12T09:11:09.062 INFO:tasks.workunit.client.0.smithi117.stdout:0/499: dread d3/dc/f7c [0,4194304] 0 2024-04-12T09:11:09.066 INFO:tasks.workunit.client.0.smithi117.stdout:3/667: getdents de/d2c/d59/d70/d3d 0 2024-04-12T09:11:09.068 INFO:tasks.workunit.client.0.smithi117.stdout:9/364: dwrite d1/f15 [4194304,4194304] 0 2024-04-12T09:11:09.132 INFO:tasks.workunit.client.0.smithi117.stdout:3/668: creat de/d2c/d59/d70/d3e/d5d/d80/ffb x:0 0 0 2024-04-12T09:11:09.142 INFO:tasks.workunit.client.0.smithi117.stdout:2/335: getdents d0 0 2024-04-12T09:11:09.143 INFO:tasks.workunit.client.0.smithi117.stdout:9/365: mkdir d1/d8/d5a/d6e 0 2024-04-12T09:11:09.145 INFO:tasks.workunit.client.0.smithi117.stdout:0/500: link d3/d59/d6a/d84/c9e d3/d22/d76/d83/da8/caf 0 2024-04-12T09:11:09.145 INFO:tasks.workunit.client.0.smithi117.stdout:9/366: read d1/d8/df/d1b/f3f [706073,4901] 0 2024-04-12T09:11:09.146 INFO:tasks.workunit.client.0.smithi117.stdout:7/334: truncate d0/d2/f43 2323162 0 2024-04-12T09:11:09.148 INFO:tasks.workunit.client.0.smithi117.stdout:3/669: dread de/f8e [0,4194304] 0 2024-04-12T09:11:09.149 INFO:tasks.workunit.client.0.smithi117.stdout:2/336: creat d0/f73 x:0 0 0 2024-04-12T09:11:09.152 INFO:tasks.workunit.client.0.smithi117.stdout:9/367: stat d1/d8/df/d26/d41/c66 0 2024-04-12T09:11:09.153 INFO:tasks.workunit.client.0.smithi117.stdout:7/335: mkdir d0/d2/d45/d15/d6a 0 2024-04-12T09:11:09.156 INFO:tasks.workunit.client.0.smithi117.stdout:9/368: creat d1/d8/df/d39/f6f x:0 0 0 2024-04-12T09:11:09.159 INFO:tasks.workunit.client.0.smithi117.stdout:7/336: dwrite d0/d2/fd [0,4194304] 0 2024-04-12T09:11:09.161 INFO:tasks.workunit.client.0.smithi117.stdout:9/369: mknod d1/d8/df/d39/d3b/c70 0 2024-04-12T09:11:09.162 INFO:tasks.workunit.client.0.smithi117.stdout:9/370: stat d1/d8/df/d3e/l31 0 2024-04-12T09:11:09.166 INFO:tasks.workunit.client.0.smithi117.stdout:0/501: getdents d3/d30 0 2024-04-12T09:11:09.168 INFO:tasks.workunit.client.0.smithi117.stdout:7/337: rename d0/d2/d45/d17/d23/l60 to d0/d2/d45/d15/l6b 0 2024-04-12T09:11:09.169 INFO:tasks.workunit.client.0.smithi117.stdout:7/338: read - d0/d2/d12/f68 zero size 2024-04-12T09:11:09.169 INFO:tasks.workunit.client.0.smithi117.stdout:7/339: stat d0/d2/d1a/f24 0 2024-04-12T09:11:09.173 INFO:tasks.workunit.client.0.smithi117.stdout:3/670: getdents de/d2c/d59/d70 0 2024-04-12T09:11:09.176 INFO:tasks.workunit.client.0.smithi117.stdout:3/671: fdatasync de/d2c/d59/d70/d3e/d5d/f46 0 2024-04-12T09:11:09.176 INFO:tasks.workunit.client.0.smithi117.stdout:7/340: dwrite d0/d2/d1a/f24 [0,4194304] 0 2024-04-12T09:11:09.181 INFO:tasks.workunit.client.0.smithi117.stdout:0/502: rename d3/c41 to d3/d22/d76/d85/dab/cb0 0 2024-04-12T09:11:09.186 INFO:tasks.workunit.client.0.smithi117.stdout:7/341: dwrite d0/d2/d45/d17/d23/d50/f64 [0,4194304] 0 2024-04-12T09:11:09.188 INFO:tasks.workunit.client.0.smithi117.stdout:7/342: truncate d0/d2/f5 5079799 0 2024-04-12T09:11:09.192 INFO:tasks.workunit.client.0.smithi117.stdout:9/371: dread d1/d8/df/d26/d41/f50 [0,4194304] 0 2024-04-12T09:11:09.195 INFO:tasks.workunit.client.0.smithi117.stdout:2/337: symlink d0/df/l74 0 2024-04-12T09:11:09.198 INFO:tasks.workunit.client.0.smithi117.stdout:7/343: mkdir d0/d2/d45/d17/d23/d39/d6c 0 2024-04-12T09:11:09.199 INFO:tasks.workunit.client.0.smithi117.stdout:9/372: dwrite d1/d8/df/d1b/f3f [4194304,4194304] 0 2024-04-12T09:11:09.200 INFO:tasks.workunit.client.0.smithi117.stdout:9/373: fdatasync d1/d23/f28 0 2024-04-12T09:11:09.200 INFO:tasks.workunit.client.0.smithi117.stdout:7/344: readlink d0/d2/d1a/d4f/l63 0 2024-04-12T09:11:09.201 INFO:tasks.workunit.client.0.smithi117.stdout:3/672: creat de/d2c/d59/ffc x:0 0 0 2024-04-12T09:11:09.209 INFO:tasks.workunit.client.0.smithi117.stdout:2/338: mknod d0/d43/d4b/c75 0 2024-04-12T09:11:09.211 INFO:tasks.workunit.client.0.smithi117.stdout:3/673: truncate f2 1172419 0 2024-04-12T09:11:09.212 INFO:tasks.workunit.client.0.smithi117.stdout:0/503: write d3/d22/f33 [41147,16194] 0 2024-04-12T09:11:09.214 INFO:tasks.workunit.client.0.smithi117.stdout:3/674: fdatasync de/d2c/d59/d70/d40/fec 0 2024-04-12T09:11:09.215 INFO:tasks.workunit.client.0.smithi117.stdout:0/504: rmdir d3/d30 39 2024-04-12T09:11:09.220 INFO:tasks.workunit.client.0.smithi117.stdout:3/675: dwrite de/d2c/d59/d70/d3e/d5d/d80/d82/fb0 [0,4194304] 0 2024-04-12T09:11:09.220 INFO:tasks.workunit.client.0.smithi117.stdout:0/505: chown d3/d30/f38 264 1 2024-04-12T09:11:09.225 INFO:tasks.workunit.client.0.smithi117.stdout:0/506: creat d3/d59/fb1 x:0 0 0 2024-04-12T09:11:09.226 INFO:tasks.workunit.client.0.smithi117.stdout:7/345: dread d0/da/f2d [0,4194304] 0 2024-04-12T09:11:09.228 INFO:tasks.workunit.client.0.smithi117.stdout:0/507: chown d3/d59/d6a/d91/d94/d5a/d62/d66/f7f 6945096 1 2024-04-12T09:11:09.228 INFO:tasks.workunit.client.0.smithi117.stdout:2/339: link d0/l1c d0/d43/d30/l76 0 2024-04-12T09:11:09.230 INFO:tasks.workunit.client.0.smithi117.stdout:3/676: link de/d2c/d59/d70/d40/d49/fbc de/d2c/d59/d70/d3d/d63/ffd 0 2024-04-12T09:11:09.232 INFO:tasks.workunit.client.0.smithi117.stdout:0/508: symlink d3/d59/d6a/d91/d7a/lb2 0 2024-04-12T09:11:09.234 INFO:tasks.workunit.client.0.smithi117.stdout:0/509: fsync d3/d47/f5e 0 2024-04-12T09:11:09.237 INFO:tasks.workunit.client.0.smithi117.stdout:9/374: dwrite d1/d23/d27/f4f [0,4194304] 0 2024-04-12T09:11:09.239 INFO:tasks.workunit.client.0.smithi117.stdout:7/346: dwrite d0/d2/d45/d17/f61 [8388608,4194304] 0 2024-04-12T09:11:09.240 INFO:tasks.workunit.client.0.smithi117.stdout:0/510: truncate d3/d47/f8a 537280 0 2024-04-12T09:11:09.242 INFO:tasks.workunit.client.0.smithi117.stdout:0/511: chown d3/d22/d76/d83/da8 3369 1 2024-04-12T09:11:09.243 INFO:tasks.workunit.client.0.smithi117.stdout:0/512: readlink d3/lf 0 2024-04-12T09:11:09.243 INFO:tasks.workunit.client.0.smithi117.stdout:7/347: read d0/d2/d45/f59 [39910,42719] 0 2024-04-12T09:11:09.246 INFO:tasks.workunit.client.0.smithi117.stdout:3/677: dwrite de/d2c/d59/d70/d40/d79/ff7 [0,4194304] 0 2024-04-12T09:11:09.251 INFO:tasks.workunit.client.0.smithi117.stdout:0/513: mkdir d3/d22/d76/db3 0 2024-04-12T09:11:09.252 INFO:tasks.workunit.client.0.smithi117.stdout:7/348: symlink d0/da/l6d 0 2024-04-12T09:11:09.255 INFO:tasks.workunit.client.0.smithi117.stdout:0/514: write d3/d22/d76/d83/da8/d9a/fa6 [4267055,93858] 0 2024-04-12T09:11:09.258 INFO:tasks.workunit.client.0.smithi117.stdout:3/678: unlink de/d2c/f45 0 2024-04-12T09:11:09.259 INFO:tasks.workunit.client.0.smithi117.stdout:2/340: dwrite d0/d4/d10/f19 [0,4194304] 0 2024-04-12T09:11:09.260 INFO:tasks.workunit.client.0.smithi117.stdout:2/341: read d0/df/f46 [149918,58534] 0 2024-04-12T09:11:09.261 INFO:tasks.workunit.client.0.smithi117.stdout:9/375: getdents d1/d24 0 2024-04-12T09:11:09.262 INFO:tasks.workunit.client.0.smithi117.stdout:9/376: chown d1/d8/df/d39/l43 153886 1 2024-04-12T09:11:09.263 INFO:tasks.workunit.client.0.smithi117.stdout:9/377: chown d1/f15 38208104 1 2024-04-12T09:11:09.264 INFO:tasks.workunit.client.0.smithi117.stdout:0/515: rmdir d3/d22/d76/d83/da8 39 2024-04-12T09:11:09.267 INFO:tasks.workunit.client.0.smithi117.stdout:2/342: creat d0/d43/d30/f77 x:0 0 0 2024-04-12T09:11:09.269 INFO:tasks.workunit.client.0.smithi117.stdout:9/378: write d1/d8/df/d26/d41/f50 [4399040,110488] 0 2024-04-12T09:11:09.270 INFO:tasks.workunit.client.0.smithi117.stdout:9/379: readlink d1/d8/df/l44 0 2024-04-12T09:11:09.271 INFO:tasks.workunit.client.0.smithi117.stdout:0/516: rmdir d3/d59/d6a/d91/d7a 39 2024-04-12T09:11:09.272 INFO:tasks.workunit.client.0.smithi117.stdout:0/517: write d3/dc/f8e [931103,62241] 0 2024-04-12T09:11:09.273 INFO:tasks.workunit.client.0.smithi117.stdout:0/518: write d3/d22/f33 [1943729,98514] 0 2024-04-12T09:11:09.274 INFO:tasks.workunit.client.0.smithi117.stdout:3/679: link de/d2c/d59/d70/d3e/d5d/d80/d97/fdb de/d2c/d59/d19/d27/ffe 0 2024-04-12T09:11:09.275 INFO:tasks.workunit.client.0.smithi117.stdout:3/680: write de/f47 [444016,102980] 0 2024-04-12T09:11:09.276 INFO:tasks.workunit.client.0.smithi117.stdout:2/343: symlink d0/l78 0 2024-04-12T09:11:09.280 INFO:tasks.workunit.client.0.smithi117.stdout:3/681: truncate de/d2c/d59/d4c/da0/daa/fbd 850163 0 2024-04-12T09:11:09.281 INFO:tasks.workunit.client.0.smithi117.stdout:0/519: dwrite d3/dc/f69 [0,4194304] 0 2024-04-12T09:11:09.290 INFO:tasks.workunit.client.0.smithi117.stdout:3/682: rmdir de/d2c 39 2024-04-12T09:11:09.300 INFO:tasks.workunit.client.0.smithi117.stdout:9/380: dread d1/d8/df/d39/d3b/f4c [4194304,4194304] 0 2024-04-12T09:11:09.300 INFO:tasks.workunit.client.0.smithi117.stdout:9/381: fsync d1/d8/d12/f59 0 2024-04-12T09:11:09.306 INFO:tasks.workunit.client.0.smithi117.stdout:0/520: symlink d3/d59/d6a/d91/d7a/lb4 0 2024-04-12T09:11:09.309 INFO:tasks.workunit.client.0.smithi117.stdout:2/344: creat d0/d43/d53/d61/d66/f79 x:0 0 0 2024-04-12T09:11:09.312 INFO:tasks.workunit.client.0.smithi117.stdout:0/521: creat d3/d59/d6a/d91/d94/d5a/d62/fb5 x:0 0 0 2024-04-12T09:11:09.313 INFO:tasks.workunit.client.0.smithi117.stdout:2/345: readlink d0/d43/d4b/l52 0 2024-04-12T09:11:09.314 INFO:tasks.workunit.client.0.smithi117.stdout:9/382: mkdir d1/d8/d5a/d6e/d71 0 2024-04-12T09:11:09.315 INFO:tasks.workunit.client.0.smithi117.stdout:3/683: creat de/d2c/d59/d70/d3e/d5d/d80/fff x:0 0 0 2024-04-12T09:11:09.321 INFO:tasks.workunit.client.0.smithi117.stdout:9/383: link d1/d8/df/d26/f46 d1/d8/d5a/d6e/d71/f72 0 2024-04-12T09:11:09.321 INFO:tasks.workunit.client.0.smithi117.stdout:9/384: chown d1/d8/df/d68 1 1 2024-04-12T09:11:09.322 INFO:tasks.workunit.client.0.smithi117.stdout:2/346: link d0/d43/d30/d41/f72 d0/df/f7a 0 2024-04-12T09:11:09.324 INFO:tasks.workunit.client.0.smithi117.stdout:0/522: link d3/d59/d6a/d91/d7a/c95 d3/d22/d76/db3/cb6 0 2024-04-12T09:11:09.326 INFO:tasks.workunit.client.0.smithi117.stdout:9/385: rename d1/d8/df/d39/l43 to d1/d8/df/d26/d41/l73 0 2024-04-12T09:11:09.328 INFO:tasks.workunit.client.0.smithi117.stdout:3/684: rmdir de/d2c/d59/d90/d9b 0 2024-04-12T09:11:09.329 INFO:tasks.workunit.client.0.smithi117.stdout:3/685: chown de/d2c/d59/d70/d3e/d5d/d80/fdc 8503698 1 2024-04-12T09:11:09.330 INFO:tasks.workunit.client.0.smithi117.stdout:0/523: creat d3/d22/d76/fb7 x:0 0 0 2024-04-12T09:11:09.331 INFO:tasks.workunit.client.0.smithi117.stdout:9/386: fdatasync d1/d8/df/d26/f46 0 2024-04-12T09:11:09.333 INFO:tasks.workunit.client.0.smithi117.stdout:3/686: dread de/d2c/d59/d4c/da0/da8/dac/fbb [0,4194304] 0 2024-04-12T09:11:09.334 INFO:tasks.workunit.client.0.smithi117.stdout:0/524: dread d3/dc/f8e [0,4194304] 0 2024-04-12T09:11:09.336 INFO:tasks.workunit.client.0.smithi117.stdout:9/387: rmdir d1/d23/d27 39 2024-04-12T09:11:09.339 INFO:tasks.workunit.client.0.smithi117.stdout:3/687: creat de/d2c/d59/d90/f100 x:0 0 0 2024-04-12T09:11:09.346 INFO:tasks.workunit.client.0.smithi117.stdout:9/388: symlink d1/d8/d5a/d6e/d71/l74 0 2024-04-12T09:11:09.349 INFO:tasks.workunit.client.0.smithi117.stdout:9/389: read d1/d8/d5e/f6d [6412448,84541] 0 2024-04-12T09:11:09.350 INFO:tasks.workunit.client.0.smithi117.stdout:9/390: rename d1/d8 to d1/d8/df/d39/d75 22 2024-04-12T09:11:09.353 INFO:tasks.workunit.client.0.smithi117.stdout:0/525: getdents d3/d59/d6a/d91/d94/d5a/d62 0 2024-04-12T09:11:09.355 INFO:tasks.workunit.client.0.smithi117.stdout:3/688: link de/d2c/l36 de/d2c/d59/d90/l101 0 2024-04-12T09:11:09.359 INFO:tasks.workunit.client.0.smithi117.stdout:9/391: dwrite d1/d8/d5a/d6e/d71/f72 [4194304,4194304] 0 2024-04-12T09:11:09.360 INFO:tasks.workunit.client.0.smithi117.stdout:9/392: chown d1/d24/f2a 30 1 2024-04-12T09:11:09.361 INFO:tasks.workunit.client.0.smithi117.stdout:3/689: mkdir de/d2c/d59/d70/d3e/d84/dfa/d102 0 2024-04-12T09:11:09.368 INFO:tasks.workunit.client.0.smithi117.stdout:3/690: mkdir de/d2c/d59/d70/d3e/d5d/d80/d97/d9a/d103 0 2024-04-12T09:11:09.368 INFO:tasks.workunit.client.0.smithi117.stdout:9/393: dwrite d1/d8/df/d39/d3b/f4a [0,4194304] 0 2024-04-12T09:11:09.370 INFO:tasks.workunit.client.0.smithi117.stdout:3/691: read - de/d2c/d59/d70/f61 zero size 2024-04-12T09:11:09.374 INFO:tasks.workunit.client.0.smithi117.stdout:0/526: getdents d3/d22/d76/d83/da8/d9a 0 2024-04-12T09:11:09.376 INFO:tasks.workunit.client.0.smithi117.stdout:9/394: write d1/d8/df/d3e/f2b [1109393,76804] 0 2024-04-12T09:11:09.378 INFO:tasks.workunit.client.0.smithi117.stdout:3/692: rename de/d2c/d59/d70/d3e/d5d/d89/l69 to de/d2c/d59/d4c/da0/da8/dac/l104 0 2024-04-12T09:11:09.383 INFO:tasks.workunit.client.0.smithi117.stdout:9/395: mknod d1/d8/d5a/c76 0 2024-04-12T09:11:09.388 INFO:tasks.workunit.client.0.smithi117.stdout:9/396: dread d1/d23/f28 [0,4194304] 0 2024-04-12T09:11:09.389 INFO:tasks.workunit.client.0.smithi117.stdout:3/693: link de/d2c/d59/c17 de/d2c/d59/d70/d3e/d3f/c105 0 2024-04-12T09:11:09.389 INFO:tasks.workunit.client.0.smithi117.stdout:9/397: chown d1/d24/f2a 10032741 1 2024-04-12T09:11:09.390 INFO:tasks.workunit.client.0.smithi117.stdout:0/527: link d3/d59/d6a/c99 d3/cb8 0 2024-04-12T09:11:09.391 INFO:tasks.workunit.client.0.smithi117.stdout:3/694: truncate de/d2c/d59/d30/fea 37070 0 2024-04-12T09:11:09.392 INFO:tasks.workunit.client.0.smithi117.stdout:9/398: truncate d1/d8/d12/f37 3431868 0 2024-04-12T09:11:09.394 INFO:tasks.workunit.client.0.smithi117.stdout:0/528: mknod d3/d59/d6a/d91/d94/d5a/d62/cb9 0 2024-04-12T09:11:09.396 INFO:tasks.workunit.client.0.smithi117.stdout:9/399: mknod d1/d8/df/c77 0 2024-04-12T09:11:09.396 INFO:tasks.workunit.client.0.smithi117.stdout:3/695: dread de/d2c/d59/d4c/da0/fb9 [0,4194304] 0 2024-04-12T09:11:09.398 INFO:tasks.workunit.client.0.smithi117.stdout:9/400: write d1/d4b/f55 [587036,27281] 0 2024-04-12T09:11:09.398 INFO:tasks.workunit.client.0.smithi117.stdout:0/529: chown d3/d59/d6a/d91/d7a/l58 15657090 1 2024-04-12T09:11:09.401 INFO:tasks.workunit.client.0.smithi117.stdout:3/696: rename de/d2c/d59/d70/d40/d79/de2 to de/d2c/d59/d70/d3d/d63/de1/d106 0 2024-04-12T09:11:09.402 INFO:tasks.workunit.client.0.smithi117.stdout:0/530: truncate d3/f6 37274 0 2024-04-12T09:11:09.407 INFO:tasks.workunit.client.0.smithi117.stdout:0/531: dwrite d3/dc/f2e [0,4194304] 0 2024-04-12T09:11:09.437 INFO:tasks.workunit.client.0.smithi117.stdout:0/532: dread d3/d59/d6a/d91/fa9 [0,4194304] 0 2024-04-12T09:11:09.438 INFO:tasks.workunit.client.0.smithi117.stdout:0/533: getdents d3/d47 0 2024-04-12T09:11:09.439 INFO:tasks.workunit.client.0.smithi117.stdout:0/534: truncate d3/d47/f79 4783913 0 2024-04-12T09:11:09.441 INFO:tasks.workunit.client.0.smithi117.stdout:0/535: truncate d3/dc/f34 2316146 0 2024-04-12T09:11:09.442 INFO:tasks.workunit.client.0.smithi117.stdout:0/536: mknod d3/d22/d76/d83/da8/d9a/cba 0 2024-04-12T09:11:09.443 INFO:tasks.workunit.client.0.smithi117.stdout:0/537: rmdir d3/d59/d6a/d91/d7a 39 2024-04-12T09:11:09.444 INFO:tasks.workunit.client.0.smithi117.stdout:0/538: stat d3/d22/d76/d83/da8 0 2024-04-12T09:11:09.446 INFO:tasks.workunit.client.0.smithi117.stdout:0/539: creat d3/d59/d6a/d91/d94/d5a/d62/d66/d73/fbb x:0 0 0 2024-04-12T09:11:09.447 INFO:tasks.workunit.client.0.smithi117.stdout:0/540: creat d3/d22/d76/d83/da8/fbc x:0 0 0 2024-04-12T09:11:09.448 INFO:tasks.workunit.client.0.smithi117.stdout:0/541: write d3/fe [2858639,42733] 0 2024-04-12T09:11:09.449 INFO:tasks.workunit.client.0.smithi117.stdout:0/542: rmdir d3/d59/d6a/d91 39 2024-04-12T09:11:09.451 INFO:tasks.workunit.client.0.smithi117.stdout:0/543: chown d3/d59/d6a/d84/c8f 33895 1 2024-04-12T09:11:09.453 INFO:tasks.workunit.client.0.smithi117.stdout:0/544: getdents d3/d22/d76/d83 0 2024-04-12T09:11:09.454 INFO:tasks.workunit.client.0.smithi117.stdout:0/545: symlink d3/d22/d76/lbd 0 2024-04-12T09:11:09.460 INFO:tasks.workunit.client.0.smithi117.stdout:8/355: sync 2024-04-12T09:11:09.460 INFO:tasks.workunit.client.0.smithi117.stdout:5/437: sync 2024-04-12T09:11:09.460 INFO:tasks.workunit.client.0.smithi117.stdout:6/356: sync 2024-04-12T09:11:09.462 INFO:tasks.workunit.client.0.smithi117.stdout:5/438: read - d2/d3/dd/d39/f86 zero size 2024-04-12T09:11:09.464 INFO:tasks.workunit.client.0.smithi117.stdout:6/357: truncate d8/d2a/f2f 1382133 0 2024-04-12T09:11:09.467 INFO:tasks.workunit.client.0.smithi117.stdout:8/356: dwrite db/d1b/d62/f6f [0,4194304] 0 2024-04-12T09:11:09.470 INFO:tasks.workunit.client.0.smithi117.stdout:6/358: dread d8/d9/f46 [0,4194304] 0 2024-04-12T09:11:09.471 INFO:tasks.workunit.client.0.smithi117.stdout:6/359: dread - d8/d9/d61/f65 zero size 2024-04-12T09:11:09.472 INFO:tasks.workunit.client.0.smithi117.stdout:5/439: unlink d2/d3/de/d1e/d46/f54 0 2024-04-12T09:11:09.473 INFO:tasks.workunit.client.0.smithi117.stdout:6/360: write d8/ff [1333309,120148] 0 2024-04-12T09:11:09.474 INFO:tasks.workunit.client.0.smithi117.stdout:5/440: write d2/d3/dd/f4b [2271624,15103] 0 2024-04-12T09:11:09.475 INFO:tasks.workunit.client.0.smithi117.stdout:5/441: chown d2/d3/dd/d39/d83 10025 1 2024-04-12T09:11:09.476 INFO:tasks.workunit.client.0.smithi117.stdout:5/442: chown d2/d3/dd/d39/d7a/l72 405389 1 2024-04-12T09:11:09.479 INFO:tasks.workunit.client.0.smithi117.stdout:8/357: link db/d19/d1a/d3d/d60/f6a db/d19/d1a/d3d/d33/f76 0 2024-04-12T09:11:09.481 INFO:tasks.workunit.client.0.smithi117.stdout:5/443: creat d2/d3/de/d1e/d2c/f8c x:0 0 0 2024-04-12T09:11:09.483 INFO:tasks.workunit.client.0.smithi117.stdout:6/361: rename d8/d2a/c43 to d8/d9/d39/d3c/c76 0 2024-04-12T09:11:09.485 INFO:tasks.workunit.client.0.smithi117.stdout:5/444: creat d2/d3/dd/d39/d83/d4d/f8d x:0 0 0 2024-04-12T09:11:09.489 INFO:tasks.workunit.client.0.smithi117.stdout:5/445: creat d2/d3/dd/d39/d83/d4d/d52/f8e x:0 0 0 2024-04-12T09:11:09.494 INFO:tasks.workunit.client.0.smithi117.stdout:6/362: getdents d8/d3f 0 2024-04-12T09:11:09.496 INFO:tasks.workunit.client.0.smithi117.stdout:6/363: read d8/f1e [254264,26835] 0 2024-04-12T09:11:09.496 INFO:tasks.workunit.client.0.smithi117.stdout:0/546: dread d3/d59/d6a/f6f [0,4194304] 0 2024-04-12T09:11:09.497 INFO:tasks.workunit.client.0.smithi117.stdout:0/547: fdatasync d3/d30/f3d 0 2024-04-12T09:11:09.498 INFO:tasks.workunit.client.0.smithi117.stdout:0/548: chown d3/d59/d6a/d84/c8f 1654 1 2024-04-12T09:11:09.508 INFO:tasks.workunit.client.0.smithi117.stdout:8/358: rename db/d19/d1a/d3d/d33 to db/d77 0 2024-04-12T09:11:09.511 INFO:tasks.workunit.client.0.smithi117.stdout:5/446: rename d2/d3/de/d1e/d46/f51 to d2/d3/dd/d39/d83/d74/f8f 0 2024-04-12T09:11:09.512 INFO:tasks.workunit.client.0.smithi117.stdout:5/447: fdatasync d2/d3/dd/d39/d7a/f71 0 2024-04-12T09:11:09.515 INFO:tasks.workunit.client.0.smithi117.stdout:5/448: creat d2/d3/dd/f90 x:0 0 0 2024-04-12T09:11:09.517 INFO:tasks.workunit.client.0.smithi117.stdout:5/449: dread d2/d3/dd/f4e [0,4194304] 0 2024-04-12T09:11:09.519 INFO:tasks.workunit.client.0.smithi117.stdout:6/364: write d8/f21 [935184,24868] 0 2024-04-12T09:11:09.524 INFO:tasks.workunit.client.0.smithi117.stdout:5/450: dwrite d2/d3/de/d1e/f67 [0,4194304] 0 2024-04-12T09:11:09.525 INFO:tasks.workunit.client.0.smithi117.stdout:5/451: chown d2/d3/dd/d39/d83/d74 489286715 1 2024-04-12T09:11:09.525 INFO:tasks.workunit.client.0.smithi117.stdout:6/365: rename d8/c6a to d8/d9/d17/d33/c77 0 2024-04-12T09:11:09.526 INFO:tasks.workunit.client.0.smithi117.stdout:5/452: readlink d2/d3/dd/d39/d7a/l72 0 2024-04-12T09:11:09.527 INFO:tasks.workunit.client.0.smithi117.stdout:0/549: truncate d3/fe 1082243 0 2024-04-12T09:11:09.528 INFO:tasks.workunit.client.0.smithi117.stdout:5/453: rmdir d2/d3/dd/d39 39 2024-04-12T09:11:09.529 INFO:tasks.workunit.client.0.smithi117.stdout:6/366: truncate d8/d3a/f3b 914952 0 2024-04-12T09:11:09.539 INFO:tasks.workunit.client.0.smithi117.stdout:8/359: rename db/d1b/l36 to db/d19/d1a/d3d/d60/d70/l78 0 2024-04-12T09:11:09.541 INFO:tasks.workunit.client.0.smithi117.stdout:5/454: dread d2/d3/de/d1e/f2d [0,4194304] 0 2024-04-12T09:11:09.542 INFO:tasks.workunit.client.0.smithi117.stdout:5/455: dread - d2/d3/de/f56 zero size 2024-04-12T09:11:09.543 INFO:tasks.workunit.client.0.smithi117.stdout:6/367: link d8/d9/d17/d2d/c37 d8/d2a/d60/c78 0 2024-04-12T09:11:09.544 INFO:tasks.workunit.client.0.smithi117.stdout:6/368: dread - d8/d9/d61/f65 zero size 2024-04-12T09:11:09.544 INFO:tasks.workunit.client.0.smithi117.stdout:8/360: fdatasync db/d19/d1a/d3d/d60/f6a 0 2024-04-12T09:11:09.546 INFO:tasks.workunit.client.0.smithi117.stdout:5/456: dread d2/d3/de/d1e/d46/f4f [0,4194304] 0 2024-04-12T09:11:09.550 INFO:tasks.workunit.client.0.smithi117.stdout:6/369: read d8/f1e [1726317,129884] 0 2024-04-12T09:11:09.554 INFO:tasks.workunit.client.0.smithi117.stdout:0/550: write d3/f25 [622221,129398] 0 2024-04-12T09:11:09.555 INFO:tasks.workunit.client.0.smithi117.stdout:5/457: stat d2/d3/dd/f1f 0 2024-04-12T09:11:09.556 INFO:tasks.workunit.client.0.smithi117.stdout:0/551: write d3/d22/d76/f9c [1400303,12575] 0 2024-04-12T09:11:09.559 INFO:tasks.workunit.client.0.smithi117.stdout:6/370: mkdir d8/d9/d39/d79 0 2024-04-12T09:11:09.559 INFO:tasks.workunit.client.0.smithi117.stdout:6/371: fsync d8/f64 0 2024-04-12T09:11:09.565 INFO:tasks.workunit.client.0.smithi117.stdout:6/372: dread d8/f21 [0,4194304] 0 2024-04-12T09:11:09.569 INFO:tasks.workunit.client.0.smithi117.stdout:8/361: creat db/d19/d1a/f79 x:0 0 0 2024-04-12T09:11:09.571 INFO:tasks.workunit.client.0.smithi117.stdout:5/458: dread d2/d3/dd/f4b [0,4194304] 0 2024-04-12T09:11:09.571 INFO:tasks.workunit.client.0.smithi117.stdout:6/373: dwrite f2 [0,4194304] 0 2024-04-12T09:11:09.576 INFO:tasks.workunit.client.0.smithi117.stdout:8/362: stat db/d19/d1a/d3d/f47 0 2024-04-12T09:11:09.579 INFO:tasks.workunit.client.0.smithi117.stdout:6/374: mknod d8/d9/d39/d3c/c7a 0 2024-04-12T09:11:09.580 INFO:tasks.workunit.client.0.smithi117.stdout:6/375: chown d8/d9/fb 35191428 1 2024-04-12T09:11:09.582 INFO:tasks.workunit.client.0.smithi117.stdout:0/552: rename d3/d59/d6a/d91/d94/d5a/d62/c7b to d3/cbe 0 2024-04-12T09:11:09.583 INFO:tasks.workunit.client.0.smithi117.stdout:5/459: creat d2/f91 x:0 0 0 2024-04-12T09:11:09.584 INFO:tasks.workunit.client.0.smithi117.stdout:5/460: truncate d2/d3/de/d1e/d46/f88 984635 0 2024-04-12T09:11:09.585 INFO:tasks.workunit.client.0.smithi117.stdout:0/553: creat d3/d22/d76/d85/fbf x:0 0 0 2024-04-12T09:11:09.589 INFO:tasks.workunit.client.0.smithi117.stdout:8/363: getdents db/d19/d1a/d3d/d60 0 2024-04-12T09:11:09.591 INFO:tasks.workunit.client.0.smithi117.stdout:8/364: write db/d19/f75 [274733,12100] 0 2024-04-12T09:11:09.591 INFO:tasks.workunit.client.0.smithi117.stdout:0/554: rename d3/dc/la0 to d3/d59/d6a/d91/d94/d5a/d62/lc0 0 2024-04-12T09:11:09.592 INFO:tasks.workunit.client.0.smithi117.stdout:6/376: dwrite d8/fc [0,4194304] 0 2024-04-12T09:11:09.596 INFO:tasks.workunit.client.0.smithi117.stdout:8/365: creat db/d13/d38/d46/f7a x:0 0 0 2024-04-12T09:11:09.597 INFO:tasks.workunit.client.0.smithi117.stdout:6/377: symlink d8/d3f/d51/l7b 0 2024-04-12T09:11:09.604 INFO:tasks.workunit.client.0.smithi117.stdout:8/366: dwrite db/d13/d38/f48 [0,4194304] 0 2024-04-12T09:11:09.605 INFO:tasks.workunit.client.0.smithi117.stdout:8/367: stat db/d13/d38/f58 0 2024-04-12T09:11:09.608 INFO:tasks.workunit.client.0.smithi117.stdout:8/368: rename db/d77/f35 to db/d13/f7b 0 2024-04-12T09:11:09.610 INFO:tasks.workunit.client.0.smithi117.stdout:4/455: sync 2024-04-12T09:11:09.614 INFO:tasks.workunit.client.0.smithi117.stdout:4/456: truncate d0/d2c/d3c/f45 236826 0 2024-04-12T09:11:09.615 INFO:tasks.workunit.client.0.smithi117.stdout:8/369: dwrite db/d4b/f72 [0,4194304] 0 2024-04-12T09:11:09.623 INFO:tasks.workunit.client.0.smithi117.stdout:0/555: getdents d3/dc 0 2024-04-12T09:11:09.624 INFO:tasks.workunit.client.0.smithi117.stdout:5/461: write d2/d3/dd/f17 [3648739,49843] 0 2024-04-12T09:11:09.629 INFO:tasks.workunit.client.0.smithi117.stdout:8/370: link db/d19/d1a/f26 db/d1b/d62/f7c 0 2024-04-12T09:11:09.630 INFO:tasks.workunit.client.0.smithi117.stdout:8/371: read db/d1b/f3c [201439,7119] 0 2024-04-12T09:11:09.631 INFO:tasks.workunit.client.0.smithi117.stdout:6/378: dread f7 [0,4194304] 0 2024-04-12T09:11:09.632 INFO:tasks.workunit.client.0.smithi117.stdout:8/372: fdatasync db/f2f 0 2024-04-12T09:11:09.632 INFO:tasks.workunit.client.0.smithi117.stdout:6/379: chown d8/d9/fb 79486253 1 2024-04-12T09:11:09.633 INFO:tasks.workunit.client.0.smithi117.stdout:4/457: read d0/d2c/d3c/f45 [148395,24307] 0 2024-04-12T09:11:09.634 INFO:tasks.workunit.client.0.smithi117.stdout:0/556: symlink d3/d59/d6a/d91/d94/d5a/d62/d66/lc1 0 2024-04-12T09:11:09.634 INFO:tasks.workunit.client.0.smithi117.stdout:4/458: read - d0/d5/f6a zero size 2024-04-12T09:11:09.635 INFO:tasks.workunit.client.0.smithi117.stdout:4/459: write d0/d5/f8 [890290,128028] 0 2024-04-12T09:11:09.639 INFO:tasks.workunit.client.0.smithi117.stdout:8/373: symlink db/d19/d1a/d3d/d60/d70/l7d 0 2024-04-12T09:11:09.640 INFO:tasks.workunit.client.0.smithi117.stdout:8/374: chown db/d77/c65 0 1 2024-04-12T09:11:09.642 INFO:tasks.workunit.client.0.smithi117.stdout:4/460: dwrite d0/d2c/f30 [4194304,4194304] 0 2024-04-12T09:11:09.642 INFO:tasks.workunit.client.0.smithi117.stdout:6/380: creat d8/d3a/f7c x:0 0 0 2024-04-12T09:11:09.645 INFO:tasks.workunit.client.0.smithi117.stdout:4/461: read d0/d5/d3b/d38/d4f/f74 [142150,106152] 0 2024-04-12T09:11:09.647 INFO:tasks.workunit.client.0.smithi117.stdout:0/557: mkdir d3/d59/d6a/d84/dc2 0 2024-04-12T09:11:09.649 INFO:tasks.workunit.client.0.smithi117.stdout:5/462: creat d2/f92 x:0 0 0 2024-04-12T09:11:09.649 INFO:tasks.workunit.client.0.smithi117.stdout:0/558: dread - d3/d22/d76/d83/da8/fbc zero size 2024-04-12T09:11:09.652 INFO:tasks.workunit.client.0.smithi117.stdout:6/381: dwrite d8/d3a/f4b [0,4194304] 0 2024-04-12T09:11:09.653 INFO:tasks.workunit.client.0.smithi117.stdout:5/463: write d2/d3/de/d1e/d2c/f8c [952219,106570] 0 2024-04-12T09:11:09.654 INFO:tasks.workunit.client.0.smithi117.stdout:6/382: chown d8/d9/d17/d33 679641 1 2024-04-12T09:11:09.657 INFO:tasks.workunit.client.0.smithi117.stdout:6/383: dread f7 [0,4194304] 0 2024-04-12T09:11:09.665 INFO:tasks.workunit.client.0.smithi117.stdout:6/384: readlink d8/d2a/l59 0 2024-04-12T09:11:09.667 INFO:tasks.workunit.client.0.smithi117.stdout:8/375: creat db/f7e x:0 0 0 2024-04-12T09:11:09.670 INFO:tasks.workunit.client.0.smithi117.stdout:5/464: rename d2/d3/dd/d39/d83/d4d/f5c to d2/d3/de/d1e/d35/f93 0 2024-04-12T09:11:09.678 INFO:tasks.workunit.client.0.smithi117.stdout:5/465: symlink d2/d3/dd/d39/d82/l94 0 2024-04-12T09:11:09.679 INFO:tasks.workunit.client.0.smithi117.stdout:0/559: truncate d3/dc/f44 2455165 0 2024-04-12T09:11:09.684 INFO:tasks.workunit.client.0.smithi117.stdout:4/462: dwrite d0/d5/f52 [0,4194304] 0 2024-04-12T09:11:09.688 INFO:tasks.workunit.client.0.smithi117.stdout:0/560: rmdir d3/d59/d6a/d91/d94/d5a/d62/d66/d73 39 2024-04-12T09:11:09.690 INFO:tasks.workunit.client.0.smithi117.stdout:6/385: dwrite d8/d9/fb [0,4194304] 0 2024-04-12T09:11:09.697 INFO:tasks.workunit.client.0.smithi117.stdout:6/386: rmdir d8/d3a 39 2024-04-12T09:11:09.698 INFO:tasks.workunit.client.0.smithi117.stdout:8/376: dwrite db/d13/f25 [0,4194304] 0 2024-04-12T09:11:09.698 INFO:tasks.workunit.client.0.smithi117.stdout:6/387: stat d8/d9/c25 0 2024-04-12T09:11:09.701 INFO:tasks.workunit.client.0.smithi117.stdout:5/466: dread d2/f36 [0,4194304] 0 2024-04-12T09:11:09.703 INFO:tasks.workunit.client.0.smithi117.stdout:8/377: read db/d13/d38/d46/f67 [59571,99007] 0 2024-04-12T09:11:09.703 INFO:tasks.workunit.client.0.smithi117.stdout:5/467: read - d2/d3/dd/d39/d83/d4d/d52/f84 zero size 2024-04-12T09:11:09.703 INFO:tasks.workunit.client.0.smithi117.stdout:4/463: mknod d0/d5/d39/d4e/d6b/d83/c9b 0 2024-04-12T09:11:09.704 INFO:tasks.workunit.client.0.smithi117.stdout:5/468: readlink d2/l59 0 2024-04-12T09:11:09.706 INFO:tasks.workunit.client.0.smithi117.stdout:5/469: fsync d2/d3/dd/f90 0 2024-04-12T09:11:09.707 INFO:tasks.workunit.client.0.smithi117.stdout:4/464: write d0/d5/d43/f75 [886203,106164] 0 2024-04-12T09:11:09.709 INFO:tasks.workunit.client.0.smithi117.stdout:8/378: fdatasync db/d19/d1a/d3d/f45 0 2024-04-12T09:11:09.710 INFO:tasks.workunit.client.0.smithi117.stdout:4/465: dread - d0/d5/d43/f8e zero size 2024-04-12T09:11:09.717 INFO:tasks.workunit.client.0.smithi117.stdout:0/561: dwrite d3/f6b [0,4194304] 0 2024-04-12T09:11:09.720 INFO:tasks.workunit.client.0.smithi117.stdout:6/388: write f3 [1834380,28388] 0 2024-04-12T09:11:09.722 INFO:tasks.workunit.client.0.smithi117.stdout:5/470: dwrite d2/f36 [0,4194304] 0 2024-04-12T09:11:09.729 INFO:tasks.workunit.client.0.smithi117.stdout:8/379: dwrite db/f53 [0,4194304] 0 2024-04-12T09:11:09.730 INFO:tasks.workunit.client.0.smithi117.stdout:6/389: mkdir d8/d2a/d60/d7d 0 2024-04-12T09:11:09.731 INFO:tasks.workunit.client.0.smithi117.stdout:8/380: truncate db/d19/f2b 2904136 0 2024-04-12T09:11:09.738 INFO:tasks.workunit.client.0.smithi117.stdout:0/562: creat d3/fc3 x:0 0 0 2024-04-12T09:11:09.738 INFO:tasks.workunit.client.0.smithi117.stdout:6/390: symlink d8/d9/l7e 0 2024-04-12T09:11:09.740 INFO:tasks.workunit.client.0.smithi117.stdout:6/391: write d8/d9/f29 [3998618,70756] 0 2024-04-12T09:11:09.740 INFO:tasks.workunit.client.0.smithi117.stdout:8/381: creat db/d19/d1a/d3d/f7f x:0 0 0 2024-04-12T09:11:09.742 INFO:tasks.workunit.client.0.smithi117.stdout:0/563: fdatasync d3/d59/d6a/d91/d7a/fa1 0 2024-04-12T09:11:09.744 INFO:tasks.workunit.client.0.smithi117.stdout:6/392: chown d8/d9/l4d 81 1 2024-04-12T09:11:09.744 INFO:tasks.workunit.client.0.smithi117.stdout:6/393: chown d8/d3f 3 1 2024-04-12T09:11:09.745 INFO:tasks.workunit.client.0.smithi117.stdout:8/382: creat db/d13/d38/d46/f80 x:0 0 0 2024-04-12T09:11:09.745 INFO:tasks.workunit.client.0.smithi117.stdout:6/394: write d8/d3f/d51/f67 [449758,76259] 0 2024-04-12T09:11:09.747 INFO:tasks.workunit.client.0.smithi117.stdout:0/564: creat d3/d22/d76/d85/dab/fc4 x:0 0 0 2024-04-12T09:11:09.749 INFO:tasks.workunit.client.0.smithi117.stdout:8/383: rename db/d13/f50 to db/d13/f81 0 2024-04-12T09:11:09.751 INFO:tasks.workunit.client.0.smithi117.stdout:6/395: readlink d8/d3a/d49/l73 0 2024-04-12T09:11:09.751 INFO:tasks.workunit.client.0.smithi117.stdout:4/466: truncate d0/d2c/f93 2509238 0 2024-04-12T09:11:09.754 INFO:tasks.workunit.client.0.smithi117.stdout:0/565: rename f0 to d3/d59/d6a/d91/d94/d5a/fc5 0 2024-04-12T09:11:09.755 INFO:tasks.workunit.client.0.smithi117.stdout:0/566: stat d3/d59/d6a/d91/d94/d5a/d62/f70 0 2024-04-12T09:11:09.756 INFO:tasks.workunit.client.0.smithi117.stdout:0/567: fsync d3/d22/d76/f9c 0 2024-04-12T09:11:09.757 INFO:tasks.workunit.client.0.smithi117.stdout:8/384: rmdir db/d1b/d62 39 2024-04-12T09:11:09.758 INFO:tasks.workunit.client.0.smithi117.stdout:0/568: write d3/d59/d6a/d91/f8d [31306,58260] 0 2024-04-12T09:11:09.759 INFO:tasks.workunit.client.0.smithi117.stdout:0/569: chown d3/dc/c1c 7475 1 2024-04-12T09:11:09.761 INFO:tasks.workunit.client.0.smithi117.stdout:5/471: write d2/d3/de/d1e/d46/f4f [577835,19405] 0 2024-04-12T09:11:09.766 INFO:tasks.workunit.client.0.smithi117.stdout:8/385: creat db/d13/d38/d46/f82 x:0 0 0 2024-04-12T09:11:09.771 INFO:tasks.workunit.client.0.smithi117.stdout:4/467: dread d0/d1/d34/f57 [0,4194304] 0 2024-04-12T09:11:09.774 INFO:tasks.workunit.client.0.smithi117.stdout:6/396: link d8/d2a/l5e d8/d3a/l7f 0 2024-04-12T09:11:09.776 INFO:tasks.workunit.client.0.smithi117.stdout:1/419: sync 2024-04-12T09:11:09.778 INFO:tasks.workunit.client.0.smithi117.stdout:4/468: dwrite d0/d2c/f7b [0,4194304] 0 2024-04-12T09:11:09.779 INFO:tasks.workunit.client.0.smithi117.stdout:5/472: truncate d2/d3/dd/d39/d83/d74/f7e 1453424 0 2024-04-12T09:11:09.782 INFO:tasks.workunit.client.0.smithi117.stdout:8/386: creat db/d1b/d62/f83 x:0 0 0 2024-04-12T09:11:09.784 INFO:tasks.workunit.client.0.smithi117.stdout:8/387: dread - db/d13/d38/f5c zero size 2024-04-12T09:11:09.784 INFO:tasks.workunit.client.0.smithi117.stdout:5/473: dread d2/d3/dd/f4b [0,4194304] 0 2024-04-12T09:11:09.785 INFO:tasks.workunit.client.0.smithi117.stdout:6/397: readlink d8/d9/d17/d2d/l54 0 2024-04-12T09:11:09.787 INFO:tasks.workunit.client.0.smithi117.stdout:8/388: readlink db/d19/d1a/d3d/l4c 0 2024-04-12T09:11:09.791 INFO:tasks.workunit.client.0.smithi117.stdout:5/474: dwrite d2/f36 [4194304,4194304] 0 2024-04-12T09:11:09.793 INFO:tasks.workunit.client.0.smithi117.stdout:1/420: dread d1/d6/d3f/db/d1d/f52 [0,4194304] 0 2024-04-12T09:11:09.793 INFO:tasks.workunit.client.0.smithi117.stdout:1/421: stat d1 0 2024-04-12T09:11:09.795 INFO:tasks.workunit.client.0.smithi117.stdout:8/389: mknod db/d19/d1a/d3d/c84 0 2024-04-12T09:11:09.802 INFO:tasks.workunit.client.0.smithi117.stdout:0/570: dwrite d3/f20 [0,4194304] 0 2024-04-12T09:11:09.807 INFO:tasks.workunit.client.0.smithi117.stdout:6/398: getdents d8/d9/d61 0 2024-04-12T09:11:09.808 INFO:tasks.workunit.client.0.smithi117.stdout:8/390: dwrite db/d13/f81 [0,4194304] 0 2024-04-12T09:11:09.817 INFO:tasks.workunit.client.0.smithi117.stdout:0/571: dread d3/d22/fae [0,4194304] 0 2024-04-12T09:11:09.819 INFO:tasks.workunit.client.0.smithi117.stdout:6/399: mknod d8/d3f/d51/c80 0 2024-04-12T09:11:09.822 INFO:tasks.workunit.client.0.smithi117.stdout:1/422: link d1/d6/d3f/ce d1/d64/c84 0 2024-04-12T09:11:09.826 INFO:tasks.workunit.client.0.smithi117.stdout:6/400: mknod d8/d2a/d60/c81 0 2024-04-12T09:11:09.827 INFO:tasks.workunit.client.0.smithi117.stdout:8/391: mknod db/d19/d1a/d3d/d60/d70/c85 0 2024-04-12T09:11:09.830 INFO:tasks.workunit.client.0.smithi117.stdout:5/475: dread d2/d3/de/d1e/d46/f48 [0,4194304] 0 2024-04-12T09:11:09.833 INFO:tasks.workunit.client.0.smithi117.stdout:6/401: unlink d8/d9/c10 0 2024-04-12T09:11:09.835 INFO:tasks.workunit.client.0.smithi117.stdout:1/423: symlink d1/d6/d3f/db/d1d/d24/l85 0 2024-04-12T09:11:09.835 INFO:tasks.workunit.client.0.smithi117.stdout:5/476: mknod d2/d3/dd/d39/d83/d4d/c95 0 2024-04-12T09:11:09.836 INFO:tasks.workunit.client.0.smithi117.stdout:0/572: getdents d3/da2 0 2024-04-12T09:11:09.838 INFO:tasks.workunit.client.0.smithi117.stdout:6/402: fsync d8/f21 0 2024-04-12T09:11:09.842 INFO:tasks.workunit.client.0.smithi117.stdout:1/424: dread d1/d6/d3f/db/d1d/d24/f2e [0,4194304] 0 2024-04-12T09:11:09.842 INFO:tasks.workunit.client.0.smithi117.stdout:0/573: unlink d3/d59/d6a/d91/d94/d5a/d62/l96 0 2024-04-12T09:11:09.847 INFO:tasks.workunit.client.0.smithi117.stdout:5/477: mkdir d2/d3/de/d1e/d46/d96 0 2024-04-12T09:11:09.847 INFO:tasks.workunit.client.0.smithi117.stdout:5/478: fsync d2/f92 0 2024-04-12T09:11:09.848 INFO:tasks.workunit.client.0.smithi117.stdout:0/574: creat d3/d22/d76/d83/da8/d9a/fc6 x:0 0 0 2024-04-12T09:11:09.851 INFO:tasks.workunit.client.0.smithi117.stdout:5/479: rmdir d2/d3/de/d1e/d66 39 2024-04-12T09:11:09.852 INFO:tasks.workunit.client.0.smithi117.stdout:5/480: fdatasync d2/d3/de/d1e/f67 0 2024-04-12T09:11:09.855 INFO:tasks.workunit.client.0.smithi117.stdout:0/575: mknod d3/d22/d76/d83/da8/da7/cc7 0 2024-04-12T09:11:09.856 INFO:tasks.workunit.client.0.smithi117.stdout:0/576: write d3/d59/d6a/d91/f8d [918059,96773] 0 2024-04-12T09:11:09.858 INFO:tasks.workunit.client.0.smithi117.stdout:5/481: write d2/d3/dd/d39/d83/d4d/d52/f84 [1018556,114956] 0 2024-04-12T09:11:09.859 INFO:tasks.workunit.client.0.smithi117.stdout:6/403: dread d8/d9/f40 [0,4194304] 0 2024-04-12T09:11:09.863 INFO:tasks.workunit.client.0.smithi117.stdout:0/577: dread d3/d22/d76/f9c [0,4194304] 0 2024-04-12T09:11:09.864 INFO:tasks.workunit.client.0.smithi117.stdout:5/482: creat d2/d3/dd/d39/d83/d4d/d6b/f97 x:0 0 0 2024-04-12T09:11:09.864 INFO:tasks.workunit.client.0.smithi117.stdout:0/578: chown d3/f81 391845621 1 2024-04-12T09:11:09.864 INFO:tasks.workunit.client.0.smithi117.stdout:5/483: readlink d2/d3/dd/d39/d83/l32 0 2024-04-12T09:11:09.865 INFO:tasks.workunit.client.0.smithi117.stdout:5/484: fdatasync d2/d3/dd/d39/d83/d4d/d6b/f97 0 2024-04-12T09:11:09.866 INFO:tasks.workunit.client.0.smithi117.stdout:0/579: dread d3/dc/f34 [0,4194304] 0 2024-04-12T09:11:09.868 INFO:tasks.workunit.client.0.smithi117.stdout:0/580: write d3/f4d [5128991,104822] 0 2024-04-12T09:11:09.911 INFO:tasks.workunit.client.0.smithi117.stdout:3/697: sync 2024-04-12T09:11:09.911 INFO:tasks.workunit.client.0.smithi117.stdout:2/347: sync 2024-04-12T09:11:09.911 INFO:tasks.workunit.client.0.smithi117.stdout:7/349: sync 2024-04-12T09:11:09.911 INFO:tasks.workunit.client.0.smithi117.stdout:9/401: sync 2024-04-12T09:11:09.912 INFO:tasks.workunit.client.0.smithi117.stdout:3/698: write de/d2c/d59/d4c/d62/ff3 [39494,55550] 0 2024-04-12T09:11:09.914 INFO:tasks.workunit.client.0.smithi117.stdout:3/699: read de/d2c/d59/f5b [1632962,122677] 0 2024-04-12T09:11:09.924 INFO:tasks.workunit.client.0.smithi117.stdout:2/348: dread d0/d43/d30/f6e [0,4194304] 0 2024-04-12T09:11:09.927 INFO:tasks.workunit.client.0.smithi117.stdout:2/349: dread d0/d43/d30/f6e [0,4194304] 0 2024-04-12T09:11:09.927 INFO:tasks.workunit.client.0.smithi117.stdout:2/350: dread - d0/f73 zero size 2024-04-12T09:11:09.960 INFO:tasks.workunit.client.0.smithi117.stdout:0/581: write d3/d59/f5c [759812,100657] 0 2024-04-12T09:11:09.963 INFO:tasks.workunit.client.0.smithi117.stdout:5/485: dwrite d2/f19 [0,4194304] 0 2024-04-12T09:11:09.966 INFO:tasks.workunit.client.0.smithi117.stdout:3/700: write de/d2c/d59/d70/d40/d49/f55 [3905268,17885] 0 2024-04-12T09:11:09.969 INFO:tasks.workunit.client.0.smithi117.stdout:6/404: getdents d8/d2a/d6e 0 2024-04-12T09:11:09.970 INFO:tasks.workunit.client.0.smithi117.stdout:2/351: chown d0/d4/d10/l5f 362069 1 2024-04-12T09:11:09.972 INFO:tasks.workunit.client.0.smithi117.stdout:9/402: creat d1/d23/d27/f78 x:0 0 0 2024-04-12T09:11:09.973 INFO:tasks.workunit.client.0.smithi117.stdout:9/403: chown d1/d8/df/d26/f46 921 1 2024-04-12T09:11:09.981 INFO:tasks.workunit.client.0.smithi117.stdout:7/350: creat d0/d2/d45/d17/f6e x:0 0 0 2024-04-12T09:11:09.981 INFO:tasks.workunit.client.0.smithi117.stdout:7/351: chown d0/d2/l11 1097378352 1 2024-04-12T09:11:09.982 INFO:tasks.workunit.client.0.smithi117.stdout:7/352: fdatasync d0/d2/d12/f68 0 2024-04-12T09:11:09.982 INFO:tasks.workunit.client.0.smithi117.stdout:9/404: rmdir d1/d8/df/d39 39 2024-04-12T09:11:09.984 INFO:tasks.workunit.client.0.smithi117.stdout:5/486: creat d2/d3/de/d1e/d79/f98 x:0 0 0 2024-04-12T09:11:09.985 INFO:tasks.workunit.client.0.smithi117.stdout:5/487: chown d2/d3/dd/f3c 14 1 2024-04-12T09:11:09.986 INFO:tasks.workunit.client.0.smithi117.stdout:3/701: creat de/d2c/d59/d70/d3e/d5d/d80/d97/d9a/d103/f107 x:0 0 0 2024-04-12T09:11:09.989 INFO:tasks.workunit.client.0.smithi117.stdout:0/582: dread d3/f23 [0,4194304] 0 2024-04-12T09:11:09.996 INFO:tasks.workunit.client.0.smithi117.stdout:0/583: fsync d3/d30/f31 0 2024-04-12T09:11:10.000 INFO:tasks.workunit.client.0.smithi117.stdout:2/352: dwrite d0/d4/fb [0,4194304] 0 2024-04-12T09:11:10.001 INFO:tasks.workunit.client.0.smithi117.stdout:5/488: dread d2/d3/dd/d39/f3e [0,4194304] 0 2024-04-12T09:11:10.003 INFO:tasks.workunit.client.0.smithi117.stdout:3/702: rmdir de 39 2024-04-12T09:11:10.007 INFO:tasks.workunit.client.0.smithi117.stdout:0/584: unlink d3/d59/d6a/d91/d94/d5a/d62/cb9 0 2024-04-12T09:11:10.009 INFO:tasks.workunit.client.0.smithi117.stdout:0/585: write d3/d22/d76/d83/da8/fbc [502489,65322] 0 2024-04-12T09:11:10.011 INFO:tasks.workunit.client.0.smithi117.stdout:6/405: rename d8/d2a/f2f to d8/d9/f82 0 2024-04-12T09:11:10.013 INFO:tasks.workunit.client.0.smithi117.stdout:2/353: creat d0/d43/d53/f7b x:0 0 0 2024-04-12T09:11:10.018 INFO:tasks.workunit.client.0.smithi117.stdout:7/353: getdents d0/d2/d1a/d49 0 2024-04-12T09:11:10.021 INFO:tasks.workunit.client.0.smithi117.stdout:0/586: mkdir d3/d30/dc8 0 2024-04-12T09:11:10.023 INFO:tasks.workunit.client.0.smithi117.stdout:3/703: dwrite de/d2c/d59/d70/d3e/d5d/d80/ffb [0,4194304] 0 2024-04-12T09:11:10.025 INFO:tasks.workunit.client.0.smithi117.stdout:3/704: write de/d2c/d59/d70/d3e/d3f/f51 [1279861,98451] 0 2024-04-12T09:11:10.025 INFO:tasks.workunit.client.0.smithi117.stdout:7/354: rmdir d0/d13 39 2024-04-12T09:11:10.029 INFO:tasks.workunit.client.0.smithi117.stdout:0/587: mkdir d3/d22/d76/d83/da8/d97/dc9 0 2024-04-12T09:11:10.034 INFO:tasks.workunit.client.0.smithi117.stdout:6/406: creat d8/d3a/d49/f83 x:0 0 0 2024-04-12T09:11:10.040 INFO:tasks.workunit.client.0.smithi117.stdout:7/355: write d0/d13/f40 [958919,37768] 0 2024-04-12T09:11:10.042 INFO:tasks.workunit.client.0.smithi117.stdout:7/356: write d0/d2/d45/d15/f54 [4229453,91232] 0 2024-04-12T09:11:10.042 INFO:tasks.workunit.client.0.smithi117.stdout:3/705: creat de/d2c/d59/d19/d27/f108 x:0 0 0 2024-04-12T09:11:10.042 INFO:tasks.workunit.client.0.smithi117.stdout:7/357: chown d0/d2/fd 275817113 1 2024-04-12T09:11:10.044 INFO:tasks.workunit.client.0.smithi117.stdout:2/354: link d0/d4/d10/c4a d0/d4/d10/d27/c7c 0 2024-04-12T09:11:10.046 INFO:tasks.workunit.client.0.smithi117.stdout:2/355: write d0/df/f46 [3277345,25934] 0 2024-04-12T09:11:10.048 INFO:tasks.workunit.client.0.smithi117.stdout:6/407: chown d8/d3a/f3b 12115 1 2024-04-12T09:11:10.049 INFO:tasks.workunit.client.0.smithi117.stdout:0/588: dread d3/d59/d6a/d91/d7a/f6c [0,4194304] 0 2024-04-12T09:11:10.049 INFO:tasks.workunit.client.0.smithi117.stdout:5/489: getdents d2/d3/de/d1e/d46 0 2024-04-12T09:11:10.051 INFO:tasks.workunit.client.0.smithi117.stdout:3/706: dwrite de/d2c/d59/d90/f98 [4194304,4194304] 0 2024-04-12T09:11:10.052 INFO:tasks.workunit.client.0.smithi117.stdout:3/707: dread - de/d2c/d59/d70/d40/d49/f95 zero size 2024-04-12T09:11:10.062 INFO:tasks.workunit.client.0.smithi117.stdout:2/356: creat d0/d43/d4b/f7d x:0 0 0 2024-04-12T09:11:10.064 INFO:tasks.workunit.client.0.smithi117.stdout:2/357: chown d0/df/l11 16 1 2024-04-12T09:11:10.065 INFO:tasks.workunit.client.0.smithi117.stdout:6/408: dread - d8/d9/f50 zero size 2024-04-12T09:11:10.071 INFO:tasks.workunit.client.0.smithi117.stdout:3/708: mkdir de/d2c/d59/d70/d3e/d5d/d89/d109 0 2024-04-12T09:11:10.072 INFO:tasks.workunit.client.0.smithi117.stdout:7/358: dread d0/d2/f43 [0,4194304] 0 2024-04-12T09:11:10.073 INFO:tasks.workunit.client.0.smithi117.stdout:7/359: dread - d0/d2/d45/d17/d23/d39/f48 zero size 2024-04-12T09:11:10.075 INFO:tasks.workunit.client.0.smithi117.stdout:2/358: fsync d0/d43/d30/d41/f72 0 2024-04-12T09:11:10.076 INFO:tasks.workunit.client.0.smithi117.stdout:2/359: dread - d0/d4/f4d zero size 2024-04-12T09:11:10.077 INFO:tasks.workunit.client.0.smithi117.stdout:2/360: write d0/d43/d53/d61/d66/f79 [287975,14911] 0 2024-04-12T09:11:10.078 INFO:tasks.workunit.client.0.smithi117.stdout:2/361: fsync d0/d43/d53/f6f 0 2024-04-12T09:11:10.078 INFO:tasks.workunit.client.0.smithi117.stdout:6/409: truncate d8/d9/d17/d33/f5b 976417 0 2024-04-12T09:11:10.080 INFO:tasks.workunit.client.0.smithi117.stdout:2/362: write d0/d4/f4d [67763,76870] 0 2024-04-12T09:11:10.081 INFO:tasks.workunit.client.0.smithi117.stdout:0/589: write d3/d22/fae [1241040,39765] 0 2024-04-12T09:11:10.082 INFO:tasks.workunit.client.0.smithi117.stdout:5/490: mkdir d2/d3/de/d1e/d99 0 2024-04-12T09:11:10.087 INFO:tasks.workunit.client.0.smithi117.stdout:0/590: dread d3/d59/d6a/d91/d7a/f6c [0,4194304] 0 2024-04-12T09:11:10.088 INFO:tasks.workunit.client.0.smithi117.stdout:3/709: creat de/d2c/d59/d70/d3d/f10a x:0 0 0 2024-04-12T09:11:10.090 INFO:tasks.workunit.client.0.smithi117.stdout:5/491: dwrite d2/d3/dd/d39/f61 [0,4194304] 0 2024-04-12T09:11:10.091 INFO:tasks.workunit.client.0.smithi117.stdout:5/492: chown d2/d3/de/d1e/d35 30 1 2024-04-12T09:11:10.091 INFO:tasks.workunit.client.0.smithi117.stdout:3/710: write de/d2c/d59/d4c/da0/fd0 [175066,13936] 0 2024-04-12T09:11:10.093 INFO:tasks.workunit.client.0.smithi117.stdout:3/711: dread - de/d2c/d59/d70/d40/d49/f95 zero size 2024-04-12T09:11:10.107 INFO:tasks.workunit.client.0.smithi117.stdout:2/363: link d0/d43/d30/d41/f5b d0/df/f7e 0 2024-04-12T09:11:10.111 INFO:tasks.workunit.client.0.smithi117.stdout:5/493: dwrite d2/d3/dd/d39/d83/f68 [0,4194304] 0 2024-04-12T09:11:10.114 INFO:tasks.workunit.client.0.smithi117.stdout:0/591: write d3/d59/d6a/d91/d7a/f4f [193047,55205] 0 2024-04-12T09:11:10.115 INFO:tasks.workunit.client.0.smithi117.stdout:5/494: write d2/f19 [2724509,44958] 0 2024-04-12T09:11:10.118 INFO:tasks.workunit.client.0.smithi117.stdout:6/410: dwrite d8/d9/f50 [0,4194304] 0 2024-04-12T09:11:10.123 INFO:tasks.workunit.client.0.smithi117.stdout:3/712: truncate de/d2c/d59/d30/f56 1664589 0 2024-04-12T09:11:10.132 INFO:tasks.workunit.client.0.smithi117.stdout:0/592: unlink d3/d59/l92 0 2024-04-12T09:11:10.135 INFO:tasks.workunit.client.0.smithi117.stdout:6/411: symlink d8/d9/d39/l84 0 2024-04-12T09:11:10.135 INFO:tasks.workunit.client.0.smithi117.stdout:6/412: chown d8/d9/d17/d33 2 1 2024-04-12T09:11:10.142 INFO:tasks.workunit.client.0.smithi117.stdout:6/413: dwrite d8/d3a/d49/f83 [0,4194304] 0 2024-04-12T09:11:10.144 INFO:tasks.workunit.client.0.smithi117.stdout:2/364: rename d0/l78 to d0/d43/l7f 0 2024-04-12T09:11:10.147 INFO:tasks.workunit.client.0.smithi117.stdout:3/713: dread de/d2c/d59/f5b [0,4194304] 0 2024-04-12T09:11:10.148 INFO:tasks.workunit.client.0.smithi117.stdout:3/714: fsync de/d2c/d59/d19/f52 0 2024-04-12T09:11:10.149 INFO:tasks.workunit.client.0.smithi117.stdout:5/495: write d2/d3/dd/f4e [886933,6118] 0 2024-04-12T09:11:10.150 INFO:tasks.workunit.client.0.smithi117.stdout:0/593: truncate d3/dc/f44 2516612 0 2024-04-12T09:11:10.153 INFO:tasks.workunit.client.0.smithi117.stdout:3/715: read - de/d2c/d59/d70/d3e/d5d/d80/fdc zero size 2024-04-12T09:11:10.154 INFO:tasks.workunit.client.0.smithi117.stdout:0/594: write d3/d30/f61 [1894116,68092] 0 2024-04-12T09:11:10.154 INFO:tasks.workunit.client.0.smithi117.stdout:5/496: fdatasync d2/d3/dd/d39/d83/d4d/d6b/f97 0 2024-04-12T09:11:10.155 INFO:tasks.workunit.client.0.smithi117.stdout:6/414: truncate d8/f1e 4782397 0 2024-04-12T09:11:10.157 INFO:tasks.workunit.client.0.smithi117.stdout:2/365: dwrite d0/d4/d10/d27/f70 [0,4194304] 0 2024-04-12T09:11:10.158 INFO:tasks.workunit.client.0.smithi117.stdout:0/595: readlink d3/d22/d76/d85/lac 0 2024-04-12T09:11:10.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:09 smithi117 ceph-mon[29277]: pgmap v15: 65 pgs: 65 active+clean; 824 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 8.6 MiB/s rd, 90 MiB/s wr, 260 op/s 2024-04-12T09:11:10.160 INFO:tasks.workunit.client.0.smithi117.stdout:6/415: truncate d8/d9/d39/f4f 4691596 0 2024-04-12T09:11:10.162 INFO:tasks.workunit.client.0.smithi117.stdout:3/716: creat de/d2c/d59/d4c/d62/f10b x:0 0 0 2024-04-12T09:11:10.163 INFO:tasks.workunit.client.0.smithi117.stdout:3/717: readlink de/l6f 0 2024-04-12T09:11:10.170 INFO:tasks.workunit.client.0.smithi117.stdout:3/718: dread - de/d2c/d59/d19/d27/f108 zero size 2024-04-12T09:11:10.170 INFO:tasks.workunit.client.0.smithi117.stdout:2/366: mknod d0/d4/d10/c80 0 2024-04-12T09:11:10.170 INFO:tasks.workunit.client.0.smithi117.stdout:5/497: dwrite d2/d3/dd/d39/d83/d4d/d52/f8e [0,4194304] 0 2024-04-12T09:11:10.171 INFO:tasks.workunit.client.0.smithi117.stdout:6/416: dwrite f2 [0,4194304] 0 2024-04-12T09:11:10.173 INFO:tasks.workunit.client.0.smithi117.stdout:5/498: fdatasync d2/d3/dd/f4e 0 2024-04-12T09:11:10.177 INFO:tasks.workunit.client.0.smithi117.stdout:5/499: write d2/d3/de/d1e/f67 [826717,5552] 0 2024-04-12T09:11:10.180 INFO:tasks.workunit.client.0.smithi117.stdout:3/719: dwrite de/d2c/d59/d19/d27/fb2 [0,4194304] 0 2024-04-12T09:11:10.186 INFO:tasks.workunit.client.0.smithi117.stdout:3/720: stat de/d2c/d59/d4c/d62/l6d 0 2024-04-12T09:11:10.186 INFO:tasks.workunit.client.0.smithi117.stdout:2/367: chown d0/d43/l7f 0 1 2024-04-12T09:11:10.186 INFO:tasks.workunit.client.0.smithi117.stdout:2/368: stat d0/d4/fb 0 2024-04-12T09:11:10.187 INFO:tasks.workunit.client.0.smithi117.stdout:5/500: read d2/f43 [2954169,25290] 0 2024-04-12T09:11:10.189 INFO:tasks.workunit.client.0.smithi117.stdout:6/417: chown d8/d3a/l7f 0 1 2024-04-12T09:11:10.195 INFO:tasks.workunit.client.0.smithi117.stdout:5/501: dwrite d2/d3/dd/d39/d7a/f6f [0,4194304] 0 2024-04-12T09:11:10.201 INFO:tasks.workunit.client.0.smithi117.stdout:0/596: dwrite d3/d59/d6a/d91/f86 [0,4194304] 0 2024-04-12T09:11:10.204 INFO:tasks.workunit.client.0.smithi117.stdout:2/369: rmdir d0/d43/d53 39 2024-04-12T09:11:10.218 INFO:tasks.workunit.client.0.smithi117.stdout:2/370: rmdir d0/d4 39 2024-04-12T09:11:10.219 INFO:tasks.workunit.client.0.smithi117.stdout:2/371: chown d0/d43/d30/c37 892 1 2024-04-12T09:11:10.220 INFO:tasks.workunit.client.0.smithi117.stdout:6/418: creat d8/d2a/d6e/f85 x:0 0 0 2024-04-12T09:11:10.221 INFO:tasks.workunit.client.0.smithi117.stdout:5/502: mknod d2/d3/de/d1e/c9a 0 2024-04-12T09:11:10.224 INFO:tasks.workunit.client.0.smithi117.stdout:8/392: sync 2024-04-12T09:11:10.224 INFO:tasks.workunit.client.0.smithi117.stdout:4/469: sync 2024-04-12T09:11:10.225 INFO:tasks.workunit.client.0.smithi117.stdout:2/372: dwrite d0/d43/d30/f62 [0,4194304] 0 2024-04-12T09:11:10.227 INFO:tasks.workunit.client.0.smithi117.stdout:4/470: chown d0/d5/d3b/d38/d4f/d79/f95 1 1 2024-04-12T09:11:10.228 INFO:tasks.workunit.client.0.smithi117.stdout:4/471: chown d0/d5/d3b/d38/d4f/f7a 2020591 1 2024-04-12T09:11:10.231 INFO:tasks.workunit.client.0.smithi117.stdout:6/419: rename d8/d9/f6b to d8/d2a/d6e/f86 0 2024-04-12T09:11:10.232 INFO:tasks.workunit.client.0.smithi117.stdout:4/472: dread d0/d1/d34/f57 [0,4194304] 0 2024-04-12T09:11:10.235 INFO:tasks.workunit.client.0.smithi117.stdout:3/721: link de/d2c/d59/d19/d27/cc3 de/d2c/d59/d4c/c10c 0 2024-04-12T09:11:10.236 INFO:tasks.workunit.client.0.smithi117.stdout:3/722: fsync de/d2c/d59/d70/d40/d49/f95 0 2024-04-12T09:11:10.237 INFO:tasks.workunit.client.0.smithi117.stdout:3/723: readlink de/d2c/d59/d19/d27/l74 0 2024-04-12T09:11:10.242 INFO:tasks.workunit.client.0.smithi117.stdout:6/420: stat d8/d9/d39/d3c/c76 0 2024-04-12T09:11:10.242 INFO:tasks.workunit.client.0.smithi117.stdout:0/597: dwrite d3/dc/f1d [0,4194304] 0 2024-04-12T09:11:10.244 INFO:tasks.workunit.client.0.smithi117.stdout:4/473: mkdir d0/d5/d3b/d38/d4f/d79/d9c 0 2024-04-12T09:11:10.246 INFO:tasks.workunit.client.0.smithi117.stdout:2/373: mkdir d0/d4/d81 0 2024-04-12T09:11:10.250 INFO:tasks.workunit.client.0.smithi117.stdout:3/724: creat de/d2c/d59/d19/f10d x:0 0 0 2024-04-12T09:11:10.254 INFO:tasks.workunit.client.0.smithi117.stdout:6/421: mknod d8/d9/d39/d3c/c87 0 2024-04-12T09:11:10.256 INFO:tasks.workunit.client.0.smithi117.stdout:0/598: symlink d3/d59/d6a/d84/lca 0 2024-04-12T09:11:10.259 INFO:tasks.workunit.client.0.smithi117.stdout:4/474: rename d0/d5/d39/l19 to d0/d2c/d8d/l9d 0 2024-04-12T09:11:10.261 INFO:tasks.workunit.client.0.smithi117.stdout:8/393: dwrite db/d19/d1a/d3d/d60/f6a [0,4194304] 0 2024-04-12T09:11:10.262 INFO:tasks.workunit.client.0.smithi117.stdout:3/725: write de/d2c/d59/d4c/da0/da8/dac/fbb [1318431,67844] 0 2024-04-12T09:11:10.264 INFO:tasks.workunit.client.0.smithi117.stdout:3/726: write de/d2c/d59/d70/d3e/d5d/d89/fce [837919,13627] 0 2024-04-12T09:11:10.267 INFO:tasks.workunit.client.0.smithi117.stdout:3/727: fdatasync de/d2c/f96 0 2024-04-12T09:11:10.268 INFO:tasks.workunit.client.0.smithi117.stdout:3/728: fdatasync de/d2c/d59/d70/d3e/d3f/f51 0 2024-04-12T09:11:10.270 INFO:tasks.workunit.client.0.smithi117.stdout:6/422: rename d8/d2a/d6e/f85 to d8/d3f/d51/f88 0 2024-04-12T09:11:10.272 INFO:tasks.workunit.client.0.smithi117.stdout:4/475: unlink d0/d5/c86 0 2024-04-12T09:11:10.273 INFO:tasks.workunit.client.0.smithi117.stdout:4/476: truncate d0/d5/d3b/f5c 545398 0 2024-04-12T09:11:10.274 INFO:tasks.workunit.client.0.smithi117.stdout:4/477: stat d0/d5/c9 0 2024-04-12T09:11:10.274 INFO:tasks.workunit.client.0.smithi117.stdout:4/478: dread - d0/d5/f92 zero size 2024-04-12T09:11:10.281 INFO:tasks.workunit.client.0.smithi117.stdout:3/729: creat de/d2c/d59/d70/d3e/d3f/dae/f10e x:0 0 0 2024-04-12T09:11:10.282 INFO:tasks.workunit.client.0.smithi117.stdout:0/599: rename d3/d59/d6a to d3/d59/d6a/dcb 22 2024-04-12T09:11:10.283 INFO:tasks.workunit.client.0.smithi117.stdout:0/600: stat d3/d59/d6a/d84/lca 0 2024-04-12T09:11:10.284 INFO:tasks.workunit.client.0.smithi117.stdout:6/423: unlink d8/d9/d39/d3c/c87 0 2024-04-12T09:11:10.286 INFO:tasks.workunit.client.0.smithi117.stdout:8/394: mkdir db/d13/d38/d86 0 2024-04-12T09:11:10.287 INFO:tasks.workunit.client.0.smithi117.stdout:4/479: creat d0/d1/f9e x:0 0 0 2024-04-12T09:11:10.293 INFO:tasks.workunit.client.0.smithi117.stdout:6/424: mkdir d8/d2a/d60/d89 0 2024-04-12T09:11:10.293 INFO:tasks.workunit.client.0.smithi117.stdout:8/395: fsync db/d1b/f5e 0 2024-04-12T09:11:10.293 INFO:tasks.workunit.client.0.smithi117.stdout:8/396: fsync db/f3e 0 2024-04-12T09:11:10.296 INFO:tasks.workunit.client.0.smithi117.stdout:6/425: dread d8/d9/fb [0,4194304] 0 2024-04-12T09:11:10.296 INFO:tasks.workunit.client.0.smithi117.stdout:4/480: mkdir d0/d5/d25/d9f 0 2024-04-12T09:11:10.296 INFO:tasks.workunit.client.0.smithi117.stdout:6/426: stat d8/d9/d39/f4f 0 2024-04-12T09:11:10.297 INFO:tasks.workunit.client.0.smithi117.stdout:4/481: write d0/d5/d3b/f94 [709820,86881] 0 2024-04-12T09:11:10.298 INFO:tasks.workunit.client.0.smithi117.stdout:4/482: chown d0/d5/d3b/d38/d4f/l6d 28344 1 2024-04-12T09:11:10.299 INFO:tasks.workunit.client.0.smithi117.stdout:4/483: chown d0/d5/c60 2981 1 2024-04-12T09:11:10.310 INFO:tasks.workunit.client.0.smithi117.stdout:4/484: mkdir d0/d5/d43/da0 0 2024-04-12T09:11:10.310 INFO:tasks.workunit.client.0.smithi117.stdout:3/730: write de/d2c/d59/f42 [535191,114129] 0 2024-04-12T09:11:10.312 INFO:tasks.workunit.client.0.smithi117.stdout:0/601: write d3/d59/d6a/d91/d7a/f42 [124303,71031] 0 2024-04-12T09:11:10.313 INFO:tasks.workunit.client.0.smithi117.stdout:0/602: read - d3/d22/d76/fb7 zero size 2024-04-12T09:11:10.314 INFO:tasks.workunit.client.0.smithi117.stdout:8/397: symlink db/d19/d1a/d3d/l87 0 2024-04-12T09:11:10.315 INFO:tasks.workunit.client.0.smithi117.stdout:3/731: dread de/d2c/d59/d70/d3e/f86 [0,4194304] 0 2024-04-12T09:11:10.316 INFO:tasks.workunit.client.0.smithi117.stdout:3/732: chown de/d2c 7076 1 2024-04-12T09:11:10.316 INFO:tasks.workunit.client.0.smithi117.stdout:8/398: write db/d1b/d62/f66 [18303,122216] 0 2024-04-12T09:11:10.318 INFO:tasks.workunit.client.0.smithi117.stdout:8/399: read db/d13/f54 [92210,71278] 0 2024-04-12T09:11:10.320 INFO:tasks.workunit.client.0.smithi117.stdout:8/400: write db/d1b/d55/f68 [120739,128151] 0 2024-04-12T09:11:10.323 INFO:tasks.workunit.client.0.smithi117.stdout:0/603: creat d3/d47/fcc x:0 0 0 2024-04-12T09:11:10.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:09 smithi203 ceph-mon[36428]: pgmap v15: 65 pgs: 65 active+clean; 824 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 8.6 MiB/s rd, 90 MiB/s wr, 260 op/s 2024-04-12T09:11:10.323 INFO:tasks.workunit.client.0.smithi117.stdout:0/604: fdatasync d3/d22/d76/d85/fbf 0 2024-04-12T09:11:10.329 INFO:tasks.workunit.client.0.smithi117.stdout:3/733: mkdir de/d2c/d59/d70/d3e/d5d/d80/d97/d10f 0 2024-04-12T09:11:10.336 INFO:tasks.workunit.client.0.smithi117.stdout:8/401: chown db/d19/d1a/d3d/l37 2436249 1 2024-04-12T09:11:10.337 INFO:tasks.workunit.client.0.smithi117.stdout:0/605: dread d3/dc/f3b [0,4194304] 0 2024-04-12T09:11:10.338 INFO:tasks.workunit.client.0.smithi117.stdout:0/606: dread - d3/d22/d76/d85/fbf zero size 2024-04-12T09:11:10.339 INFO:tasks.workunit.client.0.smithi117.stdout:6/427: getdents d8/d2a 0 2024-04-12T09:11:10.343 INFO:tasks.workunit.client.0.smithi117.stdout:8/402: dwrite db/d77/f76 [0,4194304] 0 2024-04-12T09:11:10.344 INFO:tasks.workunit.client.0.smithi117.stdout:4/485: write d0/d5/f50 [1232986,50167] 0 2024-04-12T09:11:10.345 INFO:tasks.workunit.client.0.smithi117.stdout:0/607: symlink d3/d22/d76/lcd 0 2024-04-12T09:11:10.347 INFO:tasks.workunit.client.0.smithi117.stdout:6/428: truncate d8/d9/d17/f23 1507840 0 2024-04-12T09:11:10.348 INFO:tasks.workunit.client.0.smithi117.stdout:3/734: dread de/d2c/d59/d70/d40/d79/f8a [0,4194304] 0 2024-04-12T09:11:10.348 INFO:tasks.workunit.client.0.smithi117.stdout:6/429: fdatasync d8/d9/d61/f65 0 2024-04-12T09:11:10.350 INFO:tasks.workunit.client.0.smithi117.stdout:8/403: creat db/d19/d1a/d3d/d60/f88 x:0 0 0 2024-04-12T09:11:10.350 INFO:tasks.workunit.client.0.smithi117.stdout:4/486: mknod d0/d2c/d3c/ca1 0 2024-04-12T09:11:10.353 INFO:tasks.workunit.client.0.smithi117.stdout:3/735: fsync de/d2c/d59/f5b 0 2024-04-12T09:11:10.354 INFO:tasks.workunit.client.0.smithi117.stdout:3/736: stat de/d2c/d59/d70/d3e/d3f/dae/fba 0 2024-04-12T09:11:10.355 INFO:tasks.workunit.client.0.smithi117.stdout:6/430: mkdir d8/d9/d39/d3c/d8a 0 2024-04-12T09:11:10.359 INFO:tasks.workunit.client.0.smithi117.stdout:6/431: chown d8/d2a/d60/c78 29860261 1 2024-04-12T09:11:10.360 INFO:tasks.workunit.client.0.smithi117.stdout:8/404: mknod db/d13/d38/c89 0 2024-04-12T09:11:10.364 INFO:tasks.workunit.client.0.smithi117.stdout:8/405: creat db/d19/f8a x:0 0 0 2024-04-12T09:11:10.365 INFO:tasks.workunit.client.0.smithi117.stdout:3/737: creat de/d2c/d59/d70/d3e/d5d/d80/d97/d10f/f110 x:0 0 0 2024-04-12T09:11:10.368 INFO:tasks.workunit.client.0.smithi117.stdout:3/738: truncate de/f15 3160952 0 2024-04-12T09:11:10.374 INFO:tasks.workunit.client.0.smithi117.stdout:4/487: write d0/d1/d34/f80 [237874,32315] 0 2024-04-12T09:11:10.378 INFO:tasks.workunit.client.0.smithi117.stdout:4/488: chown d0/d5/d39/f77 205734 1 2024-04-12T09:11:10.378 INFO:tasks.workunit.client.0.smithi117.stdout:0/608: dwrite d3/d59/d6a/d91/f4a [0,4194304] 0 2024-04-12T09:11:10.379 INFO:tasks.workunit.client.0.smithi117.stdout:3/739: getdents de/d2c/d59/d70/d3e/d5d 0 2024-04-12T09:11:10.379 INFO:tasks.workunit.client.0.smithi117.stdout:6/432: write d8/d3a/d49/f52 [590053,62737] 0 2024-04-12T09:11:10.382 INFO:tasks.workunit.client.0.smithi117.stdout:3/740: mkdir de/d2c/d59/d70/d3e/d5d/d111 0 2024-04-12T09:11:10.383 INFO:tasks.workunit.client.0.smithi117.stdout:8/406: write db/fc [2516330,122519] 0 2024-04-12T09:11:10.386 INFO:tasks.workunit.client.0.smithi117.stdout:0/609: creat d3/d22/d76/db3/fce x:0 0 0 2024-04-12T09:11:10.388 INFO:tasks.workunit.client.0.smithi117.stdout:4/489: dwrite d0/d2c/f4d [0,4194304] 0 2024-04-12T09:11:10.390 INFO:tasks.workunit.client.0.smithi117.stdout:4/490: write d0/d5/d3b/d38/d4f/f7a [870909,94297] 0 2024-04-12T09:11:10.392 INFO:tasks.workunit.client.0.smithi117.stdout:9/405: sync 2024-04-12T09:11:10.392 INFO:tasks.workunit.client.0.smithi117.stdout:1/425: sync 2024-04-12T09:11:10.394 INFO:tasks.workunit.client.0.smithi117.stdout:9/406: chown d1/d8/df/d26/d41/c66 17274111 1 2024-04-12T09:11:10.397 INFO:tasks.workunit.client.0.smithi117.stdout:3/741: mkdir de/d2c/d59/d70/d3e/d84/d112 0 2024-04-12T09:11:10.397 INFO:tasks.workunit.client.0.smithi117.stdout:9/407: read d1/d23/f28 [3322405,60039] 0 2024-04-12T09:11:10.398 INFO:tasks.workunit.client.0.smithi117.stdout:0/610: rename d3/dc/l1a to d3/d59/d6a/d84/lcf 0 2024-04-12T09:11:10.400 INFO:tasks.workunit.client.0.smithi117.stdout:8/407: creat db/d13/d38/d86/f8b x:0 0 0 2024-04-12T09:11:10.404 INFO:tasks.workunit.client.0.smithi117.stdout:4/491: dwrite d0/d5/f52 [4194304,4194304] 0 2024-04-12T09:11:10.405 INFO:tasks.workunit.client.0.smithi117.stdout:1/426: dwrite d1/d6/d3f/db/d16/f19 [4194304,4194304] 0 2024-04-12T09:11:10.407 INFO:tasks.workunit.client.0.smithi117.stdout:9/408: mkdir d1/d8/d5a/d79 0 2024-04-12T09:11:10.407 INFO:tasks.workunit.client.0.smithi117.stdout:8/408: readlink db/d1b/l16 0 2024-04-12T09:11:10.413 INFO:tasks.workunit.client.0.smithi117.stdout:0/611: rename d3/d59/d6a/d91 to d3/d59/d6a/d91/d94/d5a/d62/d66/dd0 22 2024-04-12T09:11:10.418 INFO:tasks.workunit.client.0.smithi117.stdout:4/492: dwrite d0/d72/f40 [4194304,4194304] 0 2024-04-12T09:11:10.419 INFO:tasks.workunit.client.0.smithi117.stdout:0/612: write d3/dc/f34 [2106025,17435] 0 2024-04-12T09:11:10.421 INFO:tasks.workunit.client.0.smithi117.stdout:1/427: dwrite d1/d6/d3f/f20 [0,4194304] 0 2024-04-12T09:11:10.423 INFO:tasks.workunit.client.0.smithi117.stdout:6/433: dwrite d8/f21 [0,4194304] 0 2024-04-12T09:11:10.428 INFO:tasks.workunit.client.0.smithi117.stdout:4/493: mkdir d0/d5/d39/da2 0 2024-04-12T09:11:10.430 INFO:tasks.workunit.client.0.smithi117.stdout:4/494: chown d0/d72 40793386 1 2024-04-12T09:11:10.430 INFO:tasks.workunit.client.0.smithi117.stdout:9/409: symlink d1/d8/df/d39/l7a 0 2024-04-12T09:11:10.436 INFO:tasks.workunit.client.0.smithi117.stdout:9/410: rename d1 to d1/d8/d5a/d6e/d71/d7b 22 2024-04-12T09:11:10.436 INFO:tasks.workunit.client.0.smithi117.stdout:1/428: dwrite d1/d64/d45/d4c/f68 [0,4194304] 0 2024-04-12T09:11:10.437 INFO:tasks.workunit.client.0.smithi117.stdout:6/434: dwrite d8/d3f/d51/f67 [0,4194304] 0 2024-04-12T09:11:10.439 INFO:tasks.workunit.client.0.smithi117.stdout:1/429: truncate d1/d6/d51/f83 39074 0 2024-04-12T09:11:10.444 INFO:tasks.workunit.client.0.smithi117.stdout:9/411: creat d1/d8/d5a/d6e/f7c x:0 0 0 2024-04-12T09:11:10.444 INFO:tasks.workunit.client.0.smithi117.stdout:9/412: readlink d1/d24/l47 0 2024-04-12T09:11:10.444 INFO:tasks.workunit.client.0.smithi117.stdout:9/413: stat d1/d8/d5a/d6e 0 2024-04-12T09:11:10.444 INFO:tasks.workunit.client.0.smithi117.stdout:6/435: symlink d8/d3f/l8b 0 2024-04-12T09:11:10.447 INFO:tasks.workunit.client.0.smithi117.stdout:9/414: chown d1/d8/df/d1b/c51 59547 1 2024-04-12T09:11:10.450 INFO:tasks.workunit.client.0.smithi117.stdout:1/430: unlink d1/d6/d3f/db/d16/c53 0 2024-04-12T09:11:10.450 INFO:tasks.workunit.client.0.smithi117.stdout:0/613: dread d3/d22/d76/d85/f9b [0,4194304] 0 2024-04-12T09:11:10.451 INFO:tasks.workunit.client.0.smithi117.stdout:1/431: chown d1/d6/d3f/db/d1d/d7b 0 1 2024-04-12T09:11:10.453 INFO:tasks.workunit.client.0.smithi117.stdout:6/436: mkdir d8/d2a/d60/d7d/d8c 0 2024-04-12T09:11:10.455 INFO:tasks.workunit.client.0.smithi117.stdout:0/614: symlink d3/d59/d6a/d84/ld1 0 2024-04-12T09:11:10.458 INFO:tasks.workunit.client.0.smithi117.stdout:3/742: truncate de/d2c/d59/d70/d40/d79/f8a 772452 0 2024-04-12T09:11:10.460 INFO:tasks.workunit.client.0.smithi117.stdout:6/437: creat d8/d9/d39/f8d x:0 0 0 2024-04-12T09:11:10.462 INFO:tasks.workunit.client.0.smithi117.stdout:0/615: rename d3/d59/d6a/d91/d7a to d3/d22/d76/d83/da8/d97/dc9/dd2 0 2024-04-12T09:11:10.466 INFO:tasks.workunit.client.0.smithi117.stdout:3/743: write de/d2c/d59/d19/fe6 [837206,46405] 0 2024-04-12T09:11:10.472 INFO:tasks.workunit.client.0.smithi117.stdout:0/616: creat d3/d59/d6a/d84/dc2/fd3 x:0 0 0 2024-04-12T09:11:10.472 INFO:tasks.workunit.client.0.smithi117.stdout:8/409: dwrite db/d13/f7b [0,4194304] 0 2024-04-12T09:11:10.474 INFO:tasks.workunit.client.0.smithi117.stdout:8/410: write db/d4b/f74 [679222,42038] 0 2024-04-12T09:11:10.474 INFO:tasks.workunit.client.0.smithi117.stdout:8/411: readlink db/d19/d1a/l2e 0 2024-04-12T09:11:10.475 INFO:tasks.workunit.client.0.smithi117.stdout:6/438: rename d8/f70 to d8/d9/d39/f8e 0 2024-04-12T09:11:10.478 INFO:tasks.workunit.client.0.smithi117.stdout:0/617: mkdir d3/d22/d76/d83/da8/dd4 0 2024-04-12T09:11:10.482 INFO:tasks.workunit.client.0.smithi117.stdout:8/412: creat db/d13/f8c x:0 0 0 2024-04-12T09:11:10.485 INFO:tasks.workunit.client.0.smithi117.stdout:9/415: dread d1/d8/d5a/d6e/d71/f72 [4194304,4194304] 0 2024-04-12T09:11:10.487 INFO:tasks.workunit.client.0.smithi117.stdout:1/432: write d1/d6/d3f/db/d1d/d78/f55 [1315055,123733] 0 2024-04-12T09:11:10.489 INFO:tasks.workunit.client.0.smithi117.stdout:8/413: fsync db/d19/d1a/d3d/f2a 0 2024-04-12T09:11:10.489 INFO:tasks.workunit.client.0.smithi117.stdout:0/618: dwrite d3/d59/d6a/d91/d94/d5a/d62/d66/f7f [0,4194304] 0 2024-04-12T09:11:10.491 INFO:tasks.workunit.client.0.smithi117.stdout:1/433: readlink d1/d6/d3f/db/d16/l79 0 2024-04-12T09:11:10.493 INFO:tasks.workunit.client.0.smithi117.stdout:6/439: dread f7 [0,4194304] 0 2024-04-12T09:11:10.494 INFO:tasks.workunit.client.0.smithi117.stdout:8/414: dread db/d19/f75 [0,4194304] 0 2024-04-12T09:11:10.497 INFO:tasks.workunit.client.0.smithi117.stdout:9/416: mkdir d1/d8/df/d7d 0 2024-04-12T09:11:10.498 INFO:tasks.workunit.client.0.smithi117.stdout:1/434: dwrite d1/f40 [0,4194304] 0 2024-04-12T09:11:10.503 INFO:tasks.workunit.client.0.smithi117.stdout:8/415: creat db/d19/f8d x:0 0 0 2024-04-12T09:11:10.505 INFO:tasks.workunit.client.0.smithi117.stdout:0/619: unlink d3/d22/d76/d83/da8/caf 0 2024-04-12T09:11:10.508 INFO:tasks.workunit.client.0.smithi117.stdout:9/417: rename d1/d23/d27 to d1/d8/df/d7d/d7e 0 2024-04-12T09:11:10.514 INFO:tasks.workunit.client.0.smithi117.stdout:0/620: mkdir d3/d22/dd5 0 2024-04-12T09:11:10.517 INFO:tasks.workunit.client.0.smithi117.stdout:8/416: symlink db/d19/d1a/l8e 0 2024-04-12T09:11:10.518 INFO:tasks.workunit.client.0.smithi117.stdout:9/418: symlink d1/d23/l7f 0 2024-04-12T09:11:10.522 INFO:tasks.workunit.client.0.smithi117.stdout:8/417: rename db/d19/d1a/l8e to db/d4b/l8f 0 2024-04-12T09:11:10.531 INFO:tasks.workunit.client.0.smithi117.stdout:8/418: dwrite db/d77/f76 [4194304,4194304] 0 2024-04-12T09:11:10.533 INFO:tasks.workunit.client.0.smithi117.stdout:8/419: fsync db/d1b/f15 0 2024-04-12T09:11:10.533 INFO:tasks.workunit.client.0.smithi117.stdout:6/440: dwrite d8/d3a/f3b [0,4194304] 0 2024-04-12T09:11:10.538 INFO:tasks.workunit.client.0.smithi117.stdout:1/435: truncate d1/d6/d3f/f20 2934687 0 2024-04-12T09:11:10.539 INFO:tasks.workunit.client.0.smithi117.stdout:8/420: creat db/d19/d1a/d3d/d60/d70/f90 x:0 0 0 2024-04-12T09:11:10.539 INFO:tasks.workunit.client.0.smithi117.stdout:9/419: dread d1/d8/df/d39/d3b/f4a [0,4194304] 0 2024-04-12T09:11:10.548 INFO:tasks.workunit.client.0.smithi117.stdout:6/441: symlink d8/d9/d39/d79/l8f 0 2024-04-12T09:11:10.549 INFO:tasks.workunit.client.0.smithi117.stdout:0/621: dwrite d3/d22/f2d [0,4194304] 0 2024-04-12T09:11:10.550 INFO:tasks.workunit.client.0.smithi117.stdout:6/442: truncate d8/d3a/f7c 766771 0 2024-04-12T09:11:10.562 INFO:tasks.workunit.client.0.smithi117.stdout:9/420: getdents d1/d8/df/d26 0 2024-04-12T09:11:10.562 INFO:tasks.workunit.client.0.smithi117.stdout:6/443: fdatasync d8/d9/f19 0 2024-04-12T09:11:10.564 INFO:tasks.workunit.client.0.smithi117.stdout:1/436: dread d1/d6/d51/f81 [0,4194304] 0 2024-04-12T09:11:10.566 INFO:tasks.workunit.client.0.smithi117.stdout:8/421: write db/d19/f52 [543534,74767] 0 2024-04-12T09:11:10.567 INFO:tasks.workunit.client.0.smithi117.stdout:9/421: creat d1/d8/df/d26/f80 x:0 0 0 2024-04-12T09:11:10.570 INFO:tasks.workunit.client.0.smithi117.stdout:6/444: mkdir d8/d9/d61/d90 0 2024-04-12T09:11:10.578 INFO:tasks.workunit.client.0.smithi117.stdout:8/422: rename db/d19/d1a/d3d/d60/f6a to db/d13/f91 0 2024-04-12T09:11:10.582 INFO:tasks.workunit.client.0.smithi117.stdout:6/445: mknod d8/d2a/d60/d7d/c91 0 2024-04-12T09:11:10.582 INFO:tasks.workunit.client.0.smithi117.stdout:0/622: getdents d3/d22/d76/d83/da8 0 2024-04-12T09:11:10.584 INFO:tasks.workunit.client.0.smithi117.stdout:9/422: dread d1/f15 [0,4194304] 0 2024-04-12T09:11:10.585 INFO:tasks.workunit.client.0.smithi117.stdout:9/423: readlink d1/d8/df/d3e/l31 0 2024-04-12T09:11:10.586 INFO:tasks.workunit.client.0.smithi117.stdout:8/423: rename db/d1b/c63 to db/d4b/c92 0 2024-04-12T09:11:10.588 INFO:tasks.workunit.client.0.smithi117.stdout:6/446: creat d8/d2a/f92 x:0 0 0 2024-04-12T09:11:10.588 INFO:tasks.workunit.client.0.smithi117.stdout:8/424: write db/d13/f81 [1287450,34551] 0 2024-04-12T09:11:10.591 INFO:tasks.workunit.client.0.smithi117.stdout:0/623: dwrite d3/d59/d6a/d91/f4a [0,4194304] 0 2024-04-12T09:11:10.591 INFO:tasks.workunit.client.0.smithi117.stdout:0/624: readlink l2 0 2024-04-12T09:11:10.592 INFO:tasks.workunit.client.0.smithi117.stdout:0/625: chown d3/d22/d76/d83/da8/d97/dc9 1177611 1 2024-04-12T09:11:10.595 INFO:tasks.workunit.client.0.smithi117.stdout:9/424: write d1/d8/d5a/d6e/d71/f72 [1144734,88812] 0 2024-04-12T09:11:10.599 INFO:tasks.workunit.client.0.smithi117.stdout:1/437: getdents d1/d6/d3f/db/d1d/d24/d71 0 2024-04-12T09:11:10.606 INFO:tasks.workunit.client.0.smithi117.stdout:1/438: dwrite d1/d64/d45/d4c/f59 [0,4194304] 0 2024-04-12T09:11:10.609 INFO:tasks.workunit.client.0.smithi117.stdout:1/439: creat d1/d6/d3f/db/d1d/d24/d54/f86 x:0 0 0 2024-04-12T09:11:10.612 INFO:tasks.workunit.client.0.smithi117.stdout:6/447: truncate d8/d9/f1f 2984256 0 2024-04-12T09:11:10.613 INFO:tasks.workunit.client.0.smithi117.stdout:6/448: dread - d8/d9/d39/f8d zero size 2024-04-12T09:11:10.614 INFO:tasks.workunit.client.0.smithi117.stdout:8/425: link db/d13/d38/l73 db/d1b/d55/l93 0 2024-04-12T09:11:10.615 INFO:tasks.workunit.client.0.smithi117.stdout:0/626: getdents d3/d59/d6a/d91 0 2024-04-12T09:11:10.617 INFO:tasks.workunit.client.0.smithi117.stdout:1/440: dread d1/d6/d3f/db/d16/f2f [0,4194304] 0 2024-04-12T09:11:10.617 INFO:tasks.workunit.client.0.smithi117.stdout:9/425: getdents d1/d8/df 0 2024-04-12T09:11:10.619 INFO:tasks.workunit.client.0.smithi117.stdout:8/426: creat db/d13/d38/d86/f94 x:0 0 0 2024-04-12T09:11:10.624 INFO:tasks.workunit.client.0.smithi117.stdout:0/627: symlink d3/d59/d6a/d91/d94/d5a/d62/d66/ld6 0 2024-04-12T09:11:10.625 INFO:tasks.workunit.client.0.smithi117.stdout:0/628: chown d3 3 1 2024-04-12T09:11:10.625 INFO:tasks.workunit.client.0.smithi117.stdout:1/441: symlink d1/d6/d3f/db/d1d/d7b/l87 0 2024-04-12T09:11:10.629 INFO:tasks.workunit.client.0.smithi117.stdout:8/427: truncate db/f3e 1503999 0 2024-04-12T09:11:10.630 INFO:tasks.workunit.client.0.smithi117.stdout:6/449: getdents d8/d9/d17 0 2024-04-12T09:11:10.633 INFO:tasks.workunit.client.0.smithi117.stdout:0/629: creat d3/d22/d76/d83/da8/d9a/fd7 x:0 0 0 2024-04-12T09:11:10.634 INFO:tasks.workunit.client.0.smithi117.stdout:1/442: symlink d1/d6/d3f/l88 0 2024-04-12T09:11:10.638 INFO:tasks.workunit.client.0.smithi117.stdout:0/630: dread d3/d30/f80 [0,4194304] 0 2024-04-12T09:11:10.639 INFO:tasks.workunit.client.0.smithi117.stdout:8/428: unlink db/d1b/d62/f83 0 2024-04-12T09:11:10.639 INFO:tasks.workunit.client.0.smithi117.stdout:9/426: dwrite d1/d8/d12/f64 [0,4194304] 0 2024-04-12T09:11:10.640 INFO:tasks.workunit.client.0.smithi117.stdout:9/427: chown d1/d8/df/d26 23 1 2024-04-12T09:11:10.648 INFO:tasks.workunit.client.0.smithi117.stdout:6/450: symlink d8/d9/l93 0 2024-04-12T09:11:10.651 INFO:tasks.workunit.client.0.smithi117.stdout:8/429: rename db/d19/d1a/d3d/d60/d70/l7d to db/d1b/d55/l95 0 2024-04-12T09:11:10.664 INFO:tasks.workunit.client.0.smithi117.stdout:8/430: truncate db/d19/d1a/d3d/f45 371504 0 2024-04-12T09:11:10.666 INFO:tasks.workunit.client.0.smithi117.stdout:8/431: fsync db/d77/f49 0 2024-04-12T09:11:10.726 INFO:tasks.workunit.client.0.smithi117.stdout:7/360: sync 2024-04-12T09:11:10.726 INFO:tasks.workunit.client.0.smithi117.stdout:5/503: sync 2024-04-12T09:11:10.744 INFO:tasks.workunit.client.0.smithi117.stdout:1/443: dwrite d1/d6/d3f/f20 [0,4194304] 0 2024-04-12T09:11:10.745 INFO:tasks.workunit.client.0.smithi117.stdout:7/361: creat d0/d2/f6f x:0 0 0 2024-04-12T09:11:10.747 INFO:tasks.workunit.client.0.smithi117.stdout:8/432: symlink db/d1b/d55/l96 0 2024-04-12T09:11:10.748 INFO:tasks.workunit.client.0.smithi117.stdout:1/444: mknod d1/d64/c89 0 2024-04-12T09:11:10.751 INFO:tasks.workunit.client.0.smithi117.stdout:9/428: dwrite d1/d8/d12/f37 [0,4194304] 0 2024-04-12T09:11:10.751 INFO:tasks.workunit.client.0.smithi117.stdout:8/433: creat db/d77/f97 x:0 0 0 2024-04-12T09:11:10.754 INFO:tasks.workunit.client.0.smithi117.stdout:1/445: mknod d1/d6/d3f/db/c8a 0 2024-04-12T09:11:10.756 INFO:tasks.workunit.client.0.smithi117.stdout:5/504: dwrite d2/d3/de/d1e/d35/f63 [0,4194304] 0 2024-04-12T09:11:10.758 INFO:tasks.workunit.client.0.smithi117.stdout:1/446: dread - d1/d64/d45/d4c/f7d zero size 2024-04-12T09:11:10.758 INFO:tasks.workunit.client.0.smithi117.stdout:5/505: stat d2/d3/c87 0 2024-04-12T09:11:10.763 INFO:tasks.workunit.client.0.smithi117.stdout:7/362: dwrite d0/d2/d45/d17/d23/d50/f64 [0,4194304] 0 2024-04-12T09:11:10.764 INFO:tasks.workunit.client.0.smithi117.stdout:1/447: read - d1/d64/d45/d4c/f7d zero size 2024-04-12T09:11:10.766 INFO:tasks.workunit.client.0.smithi117.stdout:7/363: readlink d0/d2/l11 0 2024-04-12T09:11:10.768 INFO:tasks.workunit.client.0.smithi117.stdout:9/429: rename d1/d8/df/d26/d41/l73 to d1/d8/df/l81 0 2024-04-12T09:11:10.768 INFO:tasks.workunit.client.0.smithi117.stdout:8/434: dwrite db/d19/d1a/d3d/d60/f88 [0,4194304] 0 2024-04-12T09:11:10.770 INFO:tasks.workunit.client.0.smithi117.stdout:7/364: write d0/d2/d45/d17/f3a [2914126,69105] 0 2024-04-12T09:11:10.775 INFO:tasks.workunit.client.0.smithi117.stdout:9/430: mknod d1/d8/d5a/c82 0 2024-04-12T09:11:10.776 INFO:tasks.workunit.client.0.smithi117.stdout:9/431: write d1/d24/f6a [912991,47664] 0 2024-04-12T09:11:10.778 INFO:tasks.workunit.client.0.smithi117.stdout:5/506: read d2/f3d [2697385,130960] 0 2024-04-12T09:11:10.781 INFO:tasks.workunit.client.0.smithi117.stdout:7/365: rename d0/da/c2e to d0/d2/d45/d17/d23/d50/c70 0 2024-04-12T09:11:10.786 INFO:tasks.workunit.client.0.smithi117.stdout:1/448: truncate d1/d6/f14 3720937 0 2024-04-12T09:11:10.787 INFO:tasks.workunit.client.0.smithi117.stdout:5/507: rename d2/d3/dd/d39/l78 to d2/d3/dd/d39/d82/l9b 0 2024-04-12T09:11:10.790 INFO:tasks.workunit.client.0.smithi117.stdout:7/366: mkdir d0/d2/d71 0 2024-04-12T09:11:10.791 INFO:tasks.workunit.client.0.smithi117.stdout:7/367: chown d0/d2/d45/d17/d23/d39/f48 4054569 1 2024-04-12T09:11:10.794 INFO:tasks.workunit.client.0.smithi117.stdout:9/432: symlink d1/d23/l83 0 2024-04-12T09:11:10.798 INFO:tasks.workunit.client.0.smithi117.stdout:1/449: dwrite d1/d64/f43 [0,4194304] 0 2024-04-12T09:11:10.804 INFO:tasks.workunit.client.0.smithi117.stdout:5/508: dread d2/d3/dd/f6d [0,4194304] 0 2024-04-12T09:11:10.804 INFO:tasks.workunit.client.0.smithi117.stdout:1/450: creat d1/d6/d3f/db/d16/f8b x:0 0 0 2024-04-12T09:11:10.807 INFO:tasks.workunit.client.0.smithi117.stdout:1/451: unlink d1/d64/d45/c74 0 2024-04-12T09:11:10.808 INFO:tasks.workunit.client.0.smithi117.stdout:5/509: write d2/d3/dd/d39/d83/d4d/f6c [5337676,113821] 0 2024-04-12T09:11:10.809 INFO:tasks.workunit.client.0.smithi117.stdout:5/510: dread - d2/d3/dd/f89 zero size 2024-04-12T09:11:10.816 INFO:tasks.workunit.client.0.smithi117.stdout:5/511: dwrite d2/d3/dd/f3c [0,4194304] 0 2024-04-12T09:11:10.819 INFO:tasks.workunit.client.0.smithi117.stdout:5/512: unlink d2/d3/de/d1e/d35/f3b 0 2024-04-12T09:11:10.825 INFO:tasks.workunit.client.0.smithi117.stdout:5/513: dwrite d2/d3/de/d1e/f44 [4194304,4194304] 0 2024-04-12T09:11:10.827 INFO:tasks.workunit.client.0.smithi117.stdout:2/374: sync 2024-04-12T09:11:10.832 INFO:tasks.workunit.client.0.smithi117.stdout:2/375: write d0/d43/d53/d61/d66/f79 [785214,95439] 0 2024-04-12T09:11:10.834 INFO:tasks.workunit.client.0.smithi117.stdout:2/376: write d0/d43/f56 [748657,90067] 0 2024-04-12T09:11:10.837 INFO:tasks.workunit.client.0.smithi117.stdout:5/514: mkdir d2/d3/de/d1e/d46/d96/d9c 0 2024-04-12T09:11:10.839 INFO:tasks.workunit.client.0.smithi117.stdout:8/435: dwrite db/d77/f49 [0,4194304] 0 2024-04-12T09:11:10.846 INFO:tasks.workunit.client.0.smithi117.stdout:8/436: dwrite db/d19/d1a/d3d/d60/f88 [0,4194304] 0 2024-04-12T09:11:10.852 INFO:tasks.workunit.client.0.smithi117.stdout:9/433: rename d1/d8/df/d1b/f1f to d1/d8/df/d26/d41/f84 0 2024-04-12T09:11:10.856 INFO:tasks.workunit.client.0.smithi117.stdout:5/515: symlink d2/d3/de/d1e/l9d 0 2024-04-12T09:11:10.856 INFO:tasks.workunit.client.0.smithi117.stdout:8/437: dwrite db/d19/d1a/d3d/f2a [0,4194304] 0 2024-04-12T09:11:10.857 INFO:tasks.workunit.client.0.smithi117.stdout:9/434: mknod d1/d8/d12/c85 0 2024-04-12T09:11:10.858 INFO:tasks.workunit.client.0.smithi117.stdout:7/368: truncate d0/da/f2d 829040 0 2024-04-12T09:11:10.862 INFO:tasks.workunit.client.0.smithi117.stdout:5/516: fdatasync d2/d3/de/d1e/d46/f48 0 2024-04-12T09:11:10.863 INFO:tasks.workunit.client.0.smithi117.stdout:8/438: mkdir db/d19/d1a/d3d/d60/d70/d98 0 2024-04-12T09:11:10.866 INFO:tasks.workunit.client.0.smithi117.stdout:9/435: mknod d1/d8/d52/c86 0 2024-04-12T09:11:10.872 INFO:tasks.workunit.client.0.smithi117.stdout:8/439: creat db/d13/d38/d86/f99 x:0 0 0 2024-04-12T09:11:10.872 INFO:tasks.workunit.client.0.smithi117.stdout:2/377: dread d0/d43/d30/f5c [0,4194304] 0 2024-04-12T09:11:10.873 INFO:tasks.workunit.client.0.smithi117.stdout:9/436: symlink d1/d4b/l87 0 2024-04-12T09:11:10.879 INFO:tasks.workunit.client.0.smithi117.stdout:8/440: mkdir db/d4b/d9a 0 2024-04-12T09:11:10.880 INFO:tasks.workunit.client.0.smithi117.stdout:9/437: dwrite d1/d8/df/d26/f3c [0,4194304] 0 2024-04-12T09:11:10.881 INFO:tasks.workunit.client.0.smithi117.stdout:9/438: write d1/d24/f2e [14612,124449] 0 2024-04-12T09:11:10.883 INFO:tasks.workunit.client.0.smithi117.stdout:9/439: fsync d1/d8/d12/f38 0 2024-04-12T09:11:10.883 INFO:tasks.workunit.client.0.smithi117.stdout:7/369: link d0/d2/d12/l2c d0/d2/d45/d53/d58/l72 0 2024-04-12T09:11:10.884 INFO:tasks.workunit.client.0.smithi117.stdout:1/452: write d1/d6/f14 [2854783,95230] 0 2024-04-12T09:11:10.886 INFO:tasks.workunit.client.0.smithi117.stdout:1/453: read d1/d3b/f4a [8176858,15372] 0 2024-04-12T09:11:10.887 INFO:tasks.workunit.client.0.smithi117.stdout:1/454: write d1/d6/d3f/f35 [481781,105956] 0 2024-04-12T09:11:10.890 INFO:tasks.workunit.client.0.smithi117.stdout:8/441: creat db/d19/d1a/d3d/d60/f9b x:0 0 0 2024-04-12T09:11:10.897 INFO:tasks.workunit.client.0.smithi117.stdout:8/442: dwrite db/d1b/f11 [0,4194304] 0 2024-04-12T09:11:10.897 INFO:tasks.workunit.client.0.smithi117.stdout:9/440: fsync d1/d8/df/d7d/d7e/f4f 0 2024-04-12T09:11:10.898 INFO:tasks.workunit.client.0.smithi117.stdout:8/443: write db/fc [1806625,113388] 0 2024-04-12T09:11:10.899 INFO:tasks.workunit.client.0.smithi117.stdout:7/370: fdatasync d0/d2/d45/f27 0 2024-04-12T09:11:10.905 INFO:tasks.workunit.client.0.smithi117.stdout:5/517: getdents d2/d3/dd/d39/d83 0 2024-04-12T09:11:10.910 INFO:tasks.workunit.client.0.smithi117.stdout:2/378: dread d0/df/f46 [0,4194304] 0 2024-04-12T09:11:10.915 INFO:tasks.workunit.client.0.smithi117.stdout:7/371: rmdir d0/d2/d45/d17/d23/d39 39 2024-04-12T09:11:10.917 INFO:tasks.workunit.client.0.smithi117.stdout:8/444: dwrite db/d77/f76 [0,4194304] 0 2024-04-12T09:11:10.921 INFO:tasks.workunit.client.0.smithi117.stdout:5/518: stat d2/d3/de/d1e/d66 0 2024-04-12T09:11:10.928 INFO:tasks.workunit.client.0.smithi117.stdout:2/379: creat d0/d43/d30/f82 x:0 0 0 2024-04-12T09:11:10.929 INFO:tasks.workunit.client.0.smithi117.stdout:8/445: dwrite db/d19/f52 [0,4194304] 0 2024-04-12T09:11:10.934 INFO:tasks.workunit.client.0.smithi117.stdout:8/446: dread db/d4b/f74 [0,4194304] 0 2024-04-12T09:11:10.936 INFO:tasks.workunit.client.0.smithi117.stdout:8/447: write db/d19/f52 [3143148,6480] 0 2024-04-12T09:11:10.937 INFO:tasks.workunit.client.0.smithi117.stdout:8/448: readlink db/d19/d1a/d3d/l87 0 2024-04-12T09:11:10.938 INFO:tasks.workunit.client.0.smithi117.stdout:8/449: chown db/d1b/d62/f6f 1767 1 2024-04-12T09:11:10.939 INFO:tasks.workunit.client.0.smithi117.stdout:8/450: write db/f30 [2816908,115673] 0 2024-04-12T09:11:10.945 INFO:tasks.workunit.client.0.smithi117.stdout:9/441: truncate d1/d8/df/d1b/f3f 385297 0 2024-04-12T09:11:10.950 INFO:tasks.workunit.client.0.smithi117.stdout:2/380: dread d0/df/f20 [0,4194304] 0 2024-04-12T09:11:10.952 INFO:tasks.workunit.client.0.smithi117.stdout:8/451: dread db/d19/f2b [0,4194304] 0 2024-04-12T09:11:10.953 INFO:tasks.workunit.client.0.smithi117.stdout:7/372: mknod d0/d2/d1a/d5f/c73 0 2024-04-12T09:11:10.953 INFO:tasks.workunit.client.0.smithi117.stdout:9/442: dwrite d1/d8/f10 [0,4194304] 0 2024-04-12T09:11:10.955 INFO:tasks.workunit.client.0.smithi117.stdout:5/519: dread - d2/d3/dd/d39/f86 zero size 2024-04-12T09:11:10.960 INFO:tasks.workunit.client.0.smithi117.stdout:7/373: rmdir d0/d2/d45/d53 39 2024-04-12T09:11:10.969 INFO:tasks.workunit.client.0.smithi117.stdout:7/374: dwrite d0/d2/d45/f5a [0,4194304] 0 2024-04-12T09:11:10.970 INFO:tasks.workunit.client.0.smithi117.stdout:9/443: dwrite d1/d8/df/d3e/f2b [0,4194304] 0 2024-04-12T09:11:10.974 INFO:tasks.workunit.client.0.smithi117.stdout:9/444: readlink d1/d8/df/l69 0 2024-04-12T09:11:10.982 INFO:tasks.workunit.client.0.smithi117.stdout:2/381: dread d0/df/f1d [0,4194304] 0 2024-04-12T09:11:10.986 INFO:tasks.workunit.client.0.smithi117.stdout:9/445: getdents d1/d8/df/d26/d41 0 2024-04-12T09:11:10.990 INFO:tasks.workunit.client.0.smithi117.stdout:5/520: dread d2/f6 [0,4194304] 0 2024-04-12T09:11:10.991 INFO:tasks.workunit.client.0.smithi117.stdout:9/446: unlink d1/d8/d12/f1e 0 2024-04-12T09:11:10.993 INFO:tasks.workunit.client.0.smithi117.stdout:5/521: mknod d2/d3/de/d1e/d79/c9e 0 2024-04-12T09:11:10.997 INFO:tasks.workunit.client.0.smithi117.stdout:5/522: symlink d2/d3/de/d1e/d35/l9f 0 2024-04-12T09:11:10.997 INFO:tasks.workunit.client.0.smithi117.stdout:8/452: truncate db/d4b/f72 3276577 0 2024-04-12T09:11:10.998 INFO:tasks.workunit.client.0.smithi117.stdout:8/453: dread - db/f7e zero size 2024-04-12T09:11:11.003 INFO:tasks.workunit.client.0.smithi117.stdout:5/523: stat d2/d3/de/d1e/d2c/c8a 0 2024-04-12T09:11:11.004 INFO:tasks.workunit.client.0.smithi117.stdout:7/375: dwrite d0/d2/d45/f27 [4194304,4194304] 0 2024-04-12T09:11:11.005 INFO:tasks.workunit.client.0.smithi117.stdout:2/382: write d0/d43/d30/f47 [1261468,71759] 0 2024-04-12T09:11:11.006 INFO:tasks.workunit.client.0.smithi117.stdout:8/454: dwrite db/d1b/f11 [0,4194304] 0 2024-04-12T09:11:11.007 INFO:tasks.workunit.client.0.smithi117.stdout:7/376: chown d0/d2/d12/f68 1596551783 1 2024-04-12T09:11:11.010 INFO:tasks.workunit.client.0.smithi117.stdout:9/447: getdents d1/d23 0 2024-04-12T09:11:11.012 INFO:tasks.workunit.client.0.smithi117.stdout:5/524: dread d2/d3/de/d1e/d35/f63 [0,4194304] 0 2024-04-12T09:11:11.013 INFO:tasks.workunit.client.0.smithi117.stdout:2/383: symlink d0/d4/d10/d27/l83 0 2024-04-12T09:11:11.014 INFO:tasks.workunit.client.0.smithi117.stdout:2/384: chown d0/d4/lc 564445523 1 2024-04-12T09:11:11.016 INFO:tasks.workunit.client.0.smithi117.stdout:2/385: chown d0/d43/c49 2592 1 2024-04-12T09:11:11.018 INFO:tasks.workunit.client.0.smithi117.stdout:2/386: stat d0/d43/d53/f6f 0 2024-04-12T09:11:11.018 INFO:tasks.workunit.client.0.smithi117.stdout:9/448: dwrite d1/d8/d12/f37 [4194304,4194304] 0 2024-04-12T09:11:11.018 INFO:tasks.workunit.client.0.smithi117.stdout:2/387: stat d0/f73 0 2024-04-12T09:11:11.028 INFO:tasks.workunit.client.0.smithi117.stdout:7/377: getdents d0/d2/d45/d15/d6a 0 2024-04-12T09:11:11.030 INFO:tasks.workunit.client.0.smithi117.stdout:5/525: dwrite d2/d3/dd/f17 [0,4194304] 0 2024-04-12T09:11:11.036 INFO:tasks.workunit.client.0.smithi117.stdout:8/455: write db/d13/d38/f4e [408506,72399] 0 2024-04-12T09:11:11.036 INFO:tasks.workunit.client.0.smithi117.stdout:9/449: mknod d1/d8/df/c88 0 2024-04-12T09:11:11.042 INFO:tasks.workunit.client.0.smithi117.stdout:7/378: mknod d0/d2/d45/c74 0 2024-04-12T09:11:11.045 INFO:tasks.workunit.client.0.smithi117.stdout:5/526: mknod d2/d3/de/ca0 0 2024-04-12T09:11:11.048 INFO:tasks.workunit.client.0.smithi117.stdout:3/744: sync 2024-04-12T09:11:11.048 INFO:tasks.workunit.client.0.smithi117.stdout:4/495: sync 2024-04-12T09:11:11.049 INFO:tasks.workunit.client.0.smithi117.stdout:3/745: chown de/d2c/d59/d70/d40/fec 25175 1 2024-04-12T09:11:11.051 INFO:tasks.workunit.client.0.smithi117.stdout:8/456: mkdir db/d19/d1a/d3d/d9c 0 2024-04-12T09:11:11.054 INFO:tasks.workunit.client.0.smithi117.stdout:7/379: readlink d0/d2/d45/d53/d58/l72 0 2024-04-12T09:11:11.057 INFO:tasks.workunit.client.0.smithi117.stdout:2/388: truncate d0/d4/fb 3983507 0 2024-04-12T09:11:11.058 INFO:tasks.workunit.client.0.smithi117.stdout:2/389: truncate d0/d43/d4b/f7d 379857 0 2024-04-12T09:11:11.059 INFO:tasks.workunit.client.0.smithi117.stdout:2/390: fdatasync d0/d43/d30/f58 0 2024-04-12T09:11:11.060 INFO:tasks.workunit.client.0.smithi117.stdout:3/746: unlink de/d2c/d59/f42 0 2024-04-12T09:11:11.061 INFO:tasks.workunit.client.0.smithi117.stdout:7/380: dread d0/d2/f43 [0,4194304] 0 2024-04-12T09:11:11.062 INFO:tasks.workunit.client.0.smithi117.stdout:8/457: dread db/d4b/f74 [0,4194304] 0 2024-04-12T09:11:11.063 INFO:tasks.workunit.client.0.smithi117.stdout:8/458: chown db/d19/d1a/f26 1372672 1 2024-04-12T09:11:11.063 INFO:tasks.workunit.client.0.smithi117.stdout:9/450: link d1/d24/f57 d1/d8/df/d26/d41/f89 0 2024-04-12T09:11:11.064 INFO:tasks.workunit.client.0.smithi117.stdout:9/451: chown d1/d8/d5a 0 1 2024-04-12T09:11:11.069 INFO:tasks.workunit.client.0.smithi117.stdout:4/496: fsync d0/d2c/f93 0 2024-04-12T09:11:11.070 INFO:tasks.workunit.client.0.smithi117.stdout:4/497: stat d0/d1/d34/c1e 0 2024-04-12T09:11:11.070 INFO:tasks.workunit.client.0.smithi117.stdout:4/498: chown d0/d5/d39/f77 224987377 1 2024-04-12T09:11:11.074 INFO:tasks.workunit.client.0.smithi117.stdout:2/391: rmdir d0/d43/d53/d61/d66 39 2024-04-12T09:11:11.076 INFO:tasks.workunit.client.0.smithi117.stdout:4/499: dwrite d0/d5/d3b/f5c [0,4194304] 0 2024-04-12T09:11:11.078 INFO:tasks.workunit.client.0.smithi117.stdout:3/747: mknod de/d2c/d59/d70/d3d/c113 0 2024-04-12T09:11:11.085 INFO:tasks.workunit.client.0.smithi117.stdout:8/459: mkdir db/d13/d38/d46/d9d 0 2024-04-12T09:11:11.087 INFO:tasks.workunit.client.0.smithi117.stdout:8/460: read db/f53 [1509554,42218] 0 2024-04-12T09:11:11.091 INFO:tasks.workunit.client.0.smithi117.stdout:5/527: truncate d2/f34 147306 0 2024-04-12T09:11:11.091 INFO:tasks.workunit.client.0.smithi117.stdout:5/528: chown d2/f36 1 1 2024-04-12T09:11:11.092 INFO:tasks.workunit.client.0.smithi117.stdout:5/529: fdatasync d2/d3/de/d1e/f76 0 2024-04-12T09:11:11.094 INFO:tasks.workunit.client.0.smithi117.stdout:5/530: write d2/d3/de/d1e/f44 [5496702,10340] 0 2024-04-12T09:11:11.100 INFO:tasks.workunit.client.0.smithi117.stdout:0/631: sync 2024-04-12T09:11:11.100 INFO:tasks.workunit.client.0.smithi117.stdout:0/632: stat d3/dc/c1c 0 2024-04-12T09:11:11.101 INFO:tasks.workunit.client.0.smithi117.stdout:8/461: dread db/d19/d1a/f26 [0,4194304] 0 2024-04-12T09:11:11.107 INFO:tasks.workunit.client.0.smithi117.stdout:5/531: readlink d2/d3/de/d1e/l2f 0 2024-04-12T09:11:11.108 INFO:tasks.workunit.client.0.smithi117.stdout:5/532: stat d2/f43 0 2024-04-12T09:11:11.111 INFO:tasks.workunit.client.0.smithi117.stdout:9/452: dwrite d1/d8/df/d26/d41/f84 [0,4194304] 0 2024-04-12T09:11:11.113 INFO:tasks.workunit.client.0.smithi117.stdout:9/453: readlink d1/d23/l7f 0 2024-04-12T09:11:11.117 INFO:tasks.workunit.client.0.smithi117.stdout:4/500: write d0/d5/d39/f23 [8785165,84583] 0 2024-04-12T09:11:11.117 INFO:tasks.workunit.client.0.smithi117.stdout:5/533: dwrite d2/d3/de/d1e/f76 [0,4194304] 0 2024-04-12T09:11:11.120 INFO:tasks.workunit.client.0.smithi117.stdout:5/534: write d2/d3/dd/d39/d83/d4d/d52/f8e [4317404,74249] 0 2024-04-12T09:11:11.128 INFO:tasks.workunit.client.0.smithi117.stdout:2/392: truncate d0/d43/d30/f62 3858176 0 2024-04-12T09:11:11.130 INFO:tasks.workunit.client.0.smithi117.stdout:2/393: write d0/d43/d4b/f7d [1005815,45895] 0 2024-04-12T09:11:11.131 INFO:tasks.workunit.client.0.smithi117.stdout:3/748: creat de/f114 x:0 0 0 2024-04-12T09:11:11.133 INFO:tasks.workunit.client.0.smithi117.stdout:9/454: mkdir d1/d8/df/d26/d8a 0 2024-04-12T09:11:11.134 INFO:tasks.workunit.client.0.smithi117.stdout:4/501: mknod d0/d1/d34/d7d/ca3 0 2024-04-12T09:11:11.135 INFO:tasks.workunit.client.0.smithi117.stdout:4/502: readlink d0/d5/d3b/l5f 0 2024-04-12T09:11:11.138 INFO:tasks.workunit.client.0.smithi117.stdout:0/633: rename d3/d22/d76/db3/cb6 to d3/d22/d76/d83/da8/cd8 0 2024-04-12T09:11:11.139 INFO:tasks.workunit.client.0.smithi117.stdout:0/634: dread - d3/d59/fb1 zero size 2024-04-12T09:11:11.140 INFO:tasks.workunit.client.0.smithi117.stdout:0/635: chown d3/d22/d76/d83/da8/d97 11 1 2024-04-12T09:11:11.140 INFO:tasks.workunit.client.0.smithi117.stdout:0/636: write d3/d22/f33 [97663,5882] 0 2024-04-12T09:11:11.141 INFO:tasks.workunit.client.0.smithi117.stdout:0/637: dread - d3/f81 zero size 2024-04-12T09:11:11.142 INFO:tasks.workunit.client.0.smithi117.stdout:0/638: fsync d3/d59/d6a/d91/d94/d5a/d62/f70 0 2024-04-12T09:11:11.144 INFO:tasks.workunit.client.0.smithi117.stdout:2/394: creat d0/d43/d53/f84 x:0 0 0 2024-04-12T09:11:11.147 INFO:tasks.workunit.client.0.smithi117.stdout:3/749: creat de/d2c/d59/d70/f115 x:0 0 0 2024-04-12T09:11:11.148 INFO:tasks.workunit.client.0.smithi117.stdout:0/639: dwrite d3/d22/f33 [0,4194304] 0 2024-04-12T09:11:11.148 INFO:tasks.workunit.client.0.smithi117.stdout:3/750: chown de/d2c/d59/f5b 0 1 2024-04-12T09:11:11.150 INFO:tasks.workunit.client.0.smithi117.stdout:9/455: creat d1/d24/f8b x:0 0 0 2024-04-12T09:11:11.151 INFO:tasks.workunit.client.0.smithi117.stdout:7/381: getdents d0/d20/d4a 0 2024-04-12T09:11:11.151 INFO:tasks.workunit.client.0.smithi117.stdout:9/456: readlink d1/d23/l83 0 2024-04-12T09:11:11.154 INFO:tasks.workunit.client.0.smithi117.stdout:4/503: write d0/d5/d39/d4e/d6b/d83/f85 [4767030,11110] 0 2024-04-12T09:11:11.157 INFO:tasks.workunit.client.0.smithi117.stdout:7/382: dwrite d0/d13/f40 [0,4194304] 0 2024-04-12T09:11:11.166 INFO:tasks.workunit.client.0.smithi117.stdout:2/395: creat d0/d43/d4b/f85 x:0 0 0 2024-04-12T09:11:11.169 INFO:tasks.workunit.client.0.smithi117.stdout:0/640: rename d3/dc/f7c to d3/d47/fd9 0 2024-04-12T09:11:11.170 INFO:tasks.workunit.client.0.smithi117.stdout:8/462: write db/f3e [2035318,25982] 0 2024-04-12T09:11:11.176 INFO:tasks.workunit.client.0.smithi117.stdout:8/463: dwrite fa [0,4194304] 0 2024-04-12T09:11:11.178 INFO:tasks.workunit.client.0.smithi117.stdout:4/504: truncate d0/d1/d34/f5b 2634732 0 2024-04-12T09:11:11.180 INFO:tasks.workunit.client.0.smithi117.stdout:7/383: symlink d0/da/l75 0 2024-04-12T09:11:11.181 INFO:tasks.workunit.client.0.smithi117.stdout:2/396: dread d0/d4/d10/d27/f39 [0,4194304] 0 2024-04-12T09:11:11.184 INFO:tasks.workunit.client.0.smithi117.stdout:9/457: creat d1/d8/df/d39/d3b/f8c x:0 0 0 2024-04-12T09:11:11.189 INFO:tasks.workunit.client.0.smithi117.stdout:4/505: mknod d0/d5/ca4 0 2024-04-12T09:11:11.193 INFO:tasks.workunit.client.0.smithi117.stdout:7/384: write d0/d2/d45/f59 [1241323,39235] 0 2024-04-12T09:11:11.194 INFO:tasks.workunit.client.0.smithi117.stdout:2/397: symlink d0/d43/d53/l86 0 2024-04-12T09:11:11.196 INFO:tasks.workunit.client.0.smithi117.stdout:4/506: dwrite d0/d5/d25/d69/f96 [0,4194304] 0 2024-04-12T09:11:11.197 INFO:tasks.workunit.client.0.smithi117.stdout:4/507: fdatasync d0/d1/f9e 0 2024-04-12T09:11:11.197 INFO:tasks.workunit.client.0.smithi117.stdout:9/458: write d1/d8/df/d3e/f1d [9004971,48124] 0 2024-04-12T09:11:11.198 INFO:tasks.workunit.client.0.smithi117.stdout:4/508: chown d0/d5/d43/f75 1947501939 1 2024-04-12T09:11:11.205 INFO:tasks.workunit.client.0.smithi117.stdout:4/509: dread d0/d72/f26 [0,4194304] 0 2024-04-12T09:11:11.208 INFO:tasks.workunit.client.0.smithi117.stdout:7/385: write d0/d2/d45/d17/d23/d39/f48 [802415,76024] 0 2024-04-12T09:11:11.210 INFO:tasks.workunit.client.0.smithi117.stdout:7/386: read d0/d2/f5 [2934511,114349] 0 2024-04-12T09:11:11.212 INFO:tasks.workunit.client.0.smithi117.stdout:0/641: write d3/d30/f31 [1399948,118119] 0 2024-04-12T09:11:11.215 INFO:tasks.workunit.client.0.smithi117.stdout:8/464: link db/c69 db/d13/c9e 0 2024-04-12T09:11:11.217 INFO:tasks.workunit.client.0.smithi117.stdout:4/510: mknod d0/d2c/d3c/ca5 0 2024-04-12T09:11:11.221 INFO:tasks.workunit.client.0.smithi117.stdout:8/465: dwrite db/d13/f7b [4194304,4194304] 0 2024-04-12T09:11:11.227 INFO:tasks.workunit.client.0.smithi117.stdout:0/642: write d3/d59/d6a/d91/d94/d5a/d62/d66/d73/fbb [24908,42868] 0 2024-04-12T09:11:11.227 INFO:tasks.workunit.client.0.smithi117.stdout:3/751: dwrite de/d2c/d59/d70/d3e/d5d/db5/fd2 [0,4194304] 0 2024-04-12T09:11:11.230 INFO:tasks.workunit.client.0.smithi117.stdout:2/398: chown d0/d43/d30/f62 378236 1 2024-04-12T09:11:11.238 INFO:tasks.workunit.client.0.smithi117.stdout:9/459: link d1/d4b/f55 d1/d8/df/d7d/f8d 0 2024-04-12T09:11:11.243 INFO:tasks.workunit.client.0.smithi117.stdout:3/752: mkdir de/d2c/d59/d70/d3e/d5d/d89/d68/d116 0 2024-04-12T09:11:11.245 INFO:tasks.workunit.client.0.smithi117.stdout:2/399: rmdir d0/d43/d53/d61 39 2024-04-12T09:11:11.246 INFO:tasks.workunit.client.0.smithi117.stdout:2/400: stat d0/df/f7a 0 2024-04-12T09:11:11.252 INFO:tasks.workunit.client.0.smithi117.stdout:9/460: symlink d1/d8/d5e/l8e 0 2024-04-12T09:11:11.256 INFO:tasks.workunit.client.0.smithi117.stdout:7/387: dwrite d0/f2b [0,4194304] 0 2024-04-12T09:11:11.264 INFO:tasks.workunit.client.0.smithi117.stdout:4/511: truncate d0/d5/d39/f3e 2330171 0 2024-04-12T09:11:11.265 INFO:tasks.workunit.client.0.smithi117.stdout:2/401: dwrite d0/df/f1d [4194304,4194304] 0 2024-04-12T09:11:11.266 INFO:tasks.workunit.client.0.smithi117.stdout:2/402: fdatasync d0/d4/f54 0 2024-04-12T09:11:11.270 INFO:tasks.workunit.client.0.smithi117.stdout:0/643: creat d3/d59/d6a/d91/d94/d5a/d62/d66/fda x:0 0 0 2024-04-12T09:11:11.271 INFO:tasks.workunit.client.0.smithi117.stdout:0/644: readlink d3/d59/d6a/l88 0 2024-04-12T09:11:11.272 INFO:tasks.workunit.client.0.smithi117.stdout:7/388: unlink d0/d2/d45/d17/f6e 0 2024-04-12T09:11:11.275 INFO:tasks.workunit.client.0.smithi117.stdout:8/466: getdents db/d19/d1a/d3d/d60/d70 0 2024-04-12T09:11:11.275 INFO:tasks.workunit.client.0.smithi117.stdout:8/467: chown db/d19/d1a/d3d/d60/d70 1030187636 1 2024-04-12T09:11:11.276 INFO:tasks.workunit.client.0.smithi117.stdout:4/512: mkdir d0/d2c/da6 0 2024-04-12T09:11:11.278 INFO:tasks.workunit.client.0.smithi117.stdout:3/753: creat de/d2c/d59/f117 x:0 0 0 2024-04-12T09:11:11.283 INFO:tasks.workunit.client.0.smithi117.stdout:3/754: dread de/d2c/d59/d70/d3e/d5d/db5/fd2 [0,4194304] 0 2024-04-12T09:11:11.286 INFO:tasks.workunit.client.0.smithi117.stdout:7/389: creat d0/d13/f76 x:0 0 0 2024-04-12T09:11:11.286 INFO:tasks.workunit.client.0.smithi117.stdout:3/755: truncate de/d2c/d59/d70/d3e/d3f/dae/fba 1469905 0 2024-04-12T09:11:11.287 INFO:tasks.workunit.client.0.smithi117.stdout:7/390: fdatasync d0/da/f10 0 2024-04-12T09:11:11.289 INFO:tasks.workunit.client.0.smithi117.stdout:4/513: dread d0/d5/d25/f53 [0,4194304] 0 2024-04-12T09:11:11.301 INFO:tasks.workunit.client.0.smithi117.stdout:3/756: creat de/d2c/dc0/dcd/dd1/f118 x:0 0 0 2024-04-12T09:11:11.307 INFO:tasks.workunit.client.0.smithi117.stdout:4/514: mkdir d0/d1/d34/d7d/da7 0 2024-04-12T09:11:11.309 INFO:tasks.workunit.client.0.smithi117.stdout:2/403: mknod d0/d43/d53/d61/c87 0 2024-04-12T09:11:11.310 INFO:tasks.workunit.client.0.smithi117.stdout:9/461: write d1/d8/df/d1b/f3f [328376,29099] 0 2024-04-12T09:11:11.314 INFO:tasks.workunit.client.0.smithi117.stdout:7/391: symlink d0/d2/d45/d17/d23/d50/d5c/l77 0 2024-04-12T09:11:11.314 INFO:tasks.workunit.client.0.smithi117.stdout:7/392: fdatasync d0/d2/d45/f5a 0 2024-04-12T09:11:11.317 INFO:tasks.workunit.client.0.smithi117.stdout:0/645: truncate d3/d22/fae 658722 0 2024-04-12T09:11:11.319 INFO:tasks.workunit.client.0.smithi117.stdout:2/404: creat d0/d43/d30/f88 x:0 0 0 2024-04-12T09:11:11.319 INFO:tasks.workunit.client.0.smithi117.stdout:2/405: chown d0/d4/c7 13 1 2024-04-12T09:11:11.321 INFO:tasks.workunit.client.0.smithi117.stdout:9/462: creat d1/d23/f8f x:0 0 0 2024-04-12T09:11:11.322 INFO:tasks.workunit.client.0.smithi117.stdout:9/463: readlink d1/d8/df/d7d/d7e/l2c 0 2024-04-12T09:11:11.323 INFO:tasks.workunit.client.0.smithi117.stdout:3/757: symlink de/d2c/d59/d70/d40/d49/l119 0 2024-04-12T09:11:11.326 INFO:tasks.workunit.client.0.smithi117.stdout:6/451: sync 2024-04-12T09:11:11.326 INFO:tasks.workunit.client.0.smithi117.stdout:1/455: sync 2024-04-12T09:11:11.329 INFO:tasks.workunit.client.0.smithi117.stdout:8/468: truncate db/d13/d38/f4e 367366 0 2024-04-12T09:11:11.332 INFO:tasks.workunit.client.0.smithi117.stdout:1/456: dwrite d1/d64/d45/f50 [4194304,4194304] 0 2024-04-12T09:11:11.333 INFO:tasks.workunit.client.0.smithi117.stdout:7/393: rename d0/d2/f5 to d0/d2/d45/d17/d23/d39/f78 0 2024-04-12T09:11:11.342 INFO:tasks.workunit.client.0.smithi117.stdout:8/469: dread db/f3e [0,4194304] 0 2024-04-12T09:11:11.351 INFO:tasks.workunit.client.0.smithi117.stdout:5/535: sync 2024-04-12T09:11:11.351 INFO:tasks.workunit.client.0.smithi117.stdout:7/394: creat d0/d2/d45/d17/d23/d50/d5c/f79 x:0 0 0 2024-04-12T09:11:11.352 INFO:tasks.workunit.client.0.smithi117.stdout:5/536: write d2/d3/dd/d39/f86 [608580,32604] 0 2024-04-12T09:11:11.356 INFO:tasks.workunit.client.0.smithi117.stdout:4/515: truncate d0/d5/d3b/f5c 2986443 0 2024-04-12T09:11:11.356 INFO:tasks.workunit.client.0.smithi117.stdout:0/646: truncate d3/d47/f5e 35106 0 2024-04-12T09:11:11.362 INFO:tasks.workunit.client.0.smithi117.stdout:9/464: mkdir d1/d8/d90 0 2024-04-12T09:11:11.363 INFO:tasks.workunit.client.0.smithi117.stdout:9/465: write d1/d8/d12/f37 [9033594,5609] 0 2024-04-12T09:11:11.365 INFO:tasks.workunit.client.0.smithi117.stdout:3/758: rename de/d2c/d59/f5b to de/d2c/d59/d70/d3d/d63/dc8/f11a 0 2024-04-12T09:11:11.367 INFO:tasks.workunit.client.0.smithi117.stdout:3/759: write de/d2c/d59/d70/d3e/d5d/d89/d68/f8f [1786692,35256] 0 2024-04-12T09:11:11.370 INFO:tasks.workunit.client.0.smithi117.stdout:0/647: dread d3/d22/d76/d83/da8/d97/dc9/dd2/f6c [0,4194304] 0 2024-04-12T09:11:11.373 INFO:tasks.workunit.client.0.smithi117.stdout:6/452: dwrite d8/d9/d17/d33/f5b [0,4194304] 0 2024-04-12T09:11:11.375 INFO:tasks.workunit.client.0.smithi117.stdout:1/457: link d1/d64/d45/d4c/f59 d1/d64/d45/d4c/d63/f8c 0 2024-04-12T09:11:11.375 INFO:tasks.workunit.client.0.smithi117.stdout:6/453: truncate d8/d2a/d6e/f86 1020276 0 2024-04-12T09:11:11.379 INFO:tasks.workunit.client.0.smithi117.stdout:7/395: rmdir d0/d2/d1a/d4f 39 2024-04-12T09:11:11.379 INFO:tasks.workunit.client.0.smithi117.stdout:0/648: dwrite d3/f20 [0,4194304] 0 2024-04-12T09:11:11.381 INFO:tasks.workunit.client.0.smithi117.stdout:0/649: truncate d3/f25 1719377 0 2024-04-12T09:11:11.386 INFO:tasks.workunit.client.0.smithi117.stdout:5/537: dread d2/d3/dd/f6d [0,4194304] 0 2024-04-12T09:11:11.391 INFO:tasks.workunit.client.0.smithi117.stdout:2/406: truncate d0/d43/d30/f47 81830 0 2024-04-12T09:11:11.398 INFO:tasks.workunit.client.0.smithi117.stdout:9/466: chown d1/d8/df/l48 948924395 1 2024-04-12T09:11:11.465 INFO:tasks.workunit.client.0.smithi117.stdout:8/470: link db/d13/d38/d86/f99 db/d13/f9f 0 2024-04-12T09:11:11.465 INFO:tasks.workunit.client.0.smithi117.stdout:3/760: dread - de/d2c/d59/d70/f61 zero size 2024-04-12T09:11:11.465 INFO:tasks.workunit.client.0.smithi117.stdout:6/454: mkdir d8/d2a/d94 0 2024-04-12T09:11:11.466 INFO:tasks.workunit.client.0.smithi117.stdout:5/538: dread d2/d3/de/d1e/f67 [0,4194304] 0 2024-04-12T09:11:11.466 INFO:tasks.workunit.client.0.smithi117.stdout:6/455: chown d8/d9/ld 214127 1 2024-04-12T09:11:11.466 INFO:tasks.workunit.client.0.smithi117.stdout:1/458: rmdir d1/d6/d3f/db/d1d/d24 39 2024-04-12T09:11:11.466 INFO:tasks.workunit.client.0.smithi117.stdout:4/516: dwrite d0/d1/f73 [0,4194304] 0 2024-04-12T09:11:11.466 INFO:tasks.workunit.client.0.smithi117.stdout:3/761: dread de/d2c/d59/d30/fb7 [0,4194304] 0 2024-04-12T09:11:11.466 INFO:tasks.workunit.client.0.smithi117.stdout:4/517: dwrite d0/d2c/f7b [0,4194304] 0 2024-04-12T09:11:11.466 INFO:tasks.workunit.client.0.smithi117.stdout:2/407: rmdir d0/d4/d10 39 2024-04-12T09:11:11.466 INFO:tasks.workunit.client.0.smithi117.stdout:8/471: mkdir db/d13/d38/d86/da0 0 2024-04-12T09:11:11.466 INFO:tasks.workunit.client.0.smithi117.stdout:8/472: chown db/d1b/l12 457581 1 2024-04-12T09:11:11.466 INFO:tasks.workunit.client.0.smithi117.stdout:8/473: readlink db/l3a 0 2024-04-12T09:11:11.466 INFO:tasks.workunit.client.0.smithi117.stdout:8/474: dread db/d1b/d55/f68 [0,4194304] 0 2024-04-12T09:11:11.466 INFO:tasks.workunit.client.0.smithi117.stdout:6/456: mknod d8/d3a/d49/c95 0 2024-04-12T09:11:11.466 INFO:tasks.workunit.client.0.smithi117.stdout:7/396: mkdir d0/d2/d45/d17/d7a 0 2024-04-12T09:11:11.467 INFO:tasks.workunit.client.0.smithi117.stdout:0/650: mknod d3/d30/dc8/cdb 0 2024-04-12T09:11:11.467 INFO:tasks.workunit.client.0.smithi117.stdout:3/762: mknod de/d2c/d59/d4c/da0/da8/c11b 0 2024-04-12T09:11:11.467 INFO:tasks.workunit.client.0.smithi117.stdout:9/467: mkdir d1/d8/d5a/d79/d91 0 2024-04-12T09:11:11.467 INFO:tasks.workunit.client.0.smithi117.stdout:8/475: truncate db/d13/d38/f58 3722497 0 2024-04-12T09:11:11.467 INFO:tasks.workunit.client.0.smithi117.stdout:1/459: write d1/d6/d3f/db/d1d/d78/f58 [589534,48724] 0 2024-04-12T09:11:11.467 INFO:tasks.workunit.client.0.smithi117.stdout:0/651: unlink d3/d59/d6a/d91/f4a 0 2024-04-12T09:11:11.467 INFO:tasks.workunit.client.0.smithi117.stdout:1/460: dread d1/d6/f14 [0,4194304] 0 2024-04-12T09:11:11.473 INFO:tasks.workunit.client.0.smithi117.stdout:5/539: dwrite d2/d3/de/d1e/f20 [0,4194304] 0 2024-04-12T09:11:11.475 INFO:tasks.workunit.client.0.smithi117.stdout:5/540: dread - d2/d3/dd/d39/d83/d4d/d52/f70 zero size 2024-04-12T09:11:11.475 INFO:tasks.workunit.client.0.smithi117.stdout:8/476: mknod db/d19/ca1 0 2024-04-12T09:11:11.476 INFO:tasks.workunit.client.0.smithi117.stdout:5/541: fdatasync d2/d3/dd/d39/f61 0 2024-04-12T09:11:11.476 INFO:tasks.workunit.client.0.smithi117.stdout:8/477: dread - db/d13/d38/d46/f7a zero size 2024-04-12T09:11:11.478 INFO:tasks.workunit.client.0.smithi117.stdout:4/518: truncate d0/d1/d34/d7d/f8b 3337851 0 2024-04-12T09:11:11.482 INFO:tasks.workunit.client.0.smithi117.stdout:4/519: dread d0/d1/d34/f80 [0,4194304] 0 2024-04-12T09:11:11.486 INFO:tasks.workunit.client.0.smithi117.stdout:1/461: mknod d1/d6/d3f/db/d1d/d7b/c8d 0 2024-04-12T09:11:11.486 INFO:tasks.workunit.client.0.smithi117.stdout:6/457: truncate d8/d3a/f4b 1725550 0 2024-04-12T09:11:11.488 INFO:tasks.workunit.client.0.smithi117.stdout:2/408: creat d0/d4/f89 x:0 0 0 2024-04-12T09:11:11.501 INFO:tasks.workunit.client.0.smithi117.stdout:1/462: creat d1/d64/d45/d4c/d63/f8e x:0 0 0 2024-04-12T09:11:11.502 INFO:tasks.workunit.client.0.smithi117.stdout:6/458: fdatasync d8/d9/d39/f8e 0 2024-04-12T09:11:11.502 INFO:tasks.workunit.client.0.smithi117.stdout:6/459: readlink d8/d3a/d49/l62 0 2024-04-12T09:11:11.503 INFO:tasks.workunit.client.0.smithi117.stdout:6/460: dread - d8/d9/d39/f8d zero size 2024-04-12T09:11:11.504 INFO:tasks.workunit.client.0.smithi117.stdout:5/542: mkdir d2/d3/dd/da1 0 2024-04-12T09:11:11.506 INFO:tasks.workunit.client.0.smithi117.stdout:7/397: getdents d0/d20 0 2024-04-12T09:11:11.554 INFO:tasks.workunit.client.0.smithi117.stdout:3/763: link de/d2c/d59/d19/d27/cad de/d2c/d59/d4c/d62/c11c 0 2024-04-12T09:11:11.555 INFO:tasks.workunit.client.0.smithi117.stdout:2/409: dwrite d0/d4/d10/f19 [4194304,4194304] 0 2024-04-12T09:11:11.557 INFO:tasks.workunit.client.0.smithi117.stdout:0/652: truncate d3/d59/d6a/f6f 1042308 0 2024-04-12T09:11:11.557 INFO:tasks.workunit.client.0.smithi117.stdout:1/463: write d1/d6/d3f/db/d1d/f5b [1647124,80175] 0 2024-04-12T09:11:11.560 INFO:tasks.workunit.client.0.smithi117.stdout:7/398: rmdir d0/d20 39 2024-04-12T09:11:11.561 INFO:tasks.workunit.client.0.smithi117.stdout:4/520: link d0/d1/c21 d0/d5/d3b/d38/d4f/d79/d9c/ca8 0 2024-04-12T09:11:11.561 INFO:tasks.workunit.client.0.smithi117.stdout:5/543: write d2/d3/de/f2a [3543059,61107] 0 2024-04-12T09:11:11.561 INFO:tasks.workunit.client.0.smithi117.stdout:3/764: rmdir de/d2c/d59/d4c/da0 39 2024-04-12T09:11:11.561 INFO:tasks.workunit.client.0.smithi117.stdout:2/410: truncate d0/df/f7a 1024556 0 2024-04-12T09:11:11.564 INFO:tasks.workunit.client.0.smithi117.stdout:3/765: dread - de/d2c/d59/d70/d3e/d3f/fd3 zero size 2024-04-12T09:11:11.574 INFO:tasks.workunit.client.0.smithi117.stdout:3/766: creat de/d2c/d59/d4c/d62/f11d x:0 0 0 2024-04-12T09:11:11.575 INFO:tasks.workunit.client.0.smithi117.stdout:2/411: mknod d0/c8a 0 2024-04-12T09:11:11.578 INFO:tasks.workunit.client.0.smithi117.stdout:4/521: creat d0/d5/d3b/d8f/fa9 x:0 0 0 2024-04-12T09:11:11.579 INFO:tasks.workunit.client.0.smithi117.stdout:4/522: stat d0/d5/d3b/f94 0 2024-04-12T09:11:11.579 INFO:tasks.workunit.client.0.smithi117.stdout:0/653: mknod d3/d59/d6a/d91/d94/d5a/cdc 0 2024-04-12T09:11:11.580 INFO:tasks.workunit.client.0.smithi117.stdout:4/523: write d0/d72/f40 [919502,39363] 0 2024-04-12T09:11:11.582 INFO:tasks.workunit.client.0.smithi117.stdout:1/464: rename d1/d64/d45/d4c/f59 to d1/d3b/f8f 0 2024-04-12T09:11:11.585 INFO:tasks.workunit.client.0.smithi117.stdout:4/524: dread d0/d5/d25/f53 [0,4194304] 0 2024-04-12T09:11:11.587 INFO:tasks.workunit.client.0.smithi117.stdout:6/461: truncate d8/fc 2572666 0 2024-04-12T09:11:11.591 INFO:tasks.workunit.client.0.smithi117.stdout:1/465: chown d1/d6/d3f/db/d1d/d24 1881 1 2024-04-12T09:11:11.592 INFO:tasks.workunit.client.0.smithi117.stdout:7/399: truncate d0/d13/f3e 953170 0 2024-04-12T09:11:11.592 INFO:tasks.workunit.client.0.smithi117.stdout:1/466: dread - d1/d6/d3f/db/d16/f8b zero size 2024-04-12T09:11:11.593 INFO:tasks.workunit.client.0.smithi117.stdout:3/767: mknod de/d2c/d59/d90/ded/c11e 0 2024-04-12T09:11:11.595 INFO:tasks.workunit.client.0.smithi117.stdout:4/525: symlink d0/d72/laa 0 2024-04-12T09:11:11.596 INFO:tasks.workunit.client.0.smithi117.stdout:4/526: write d0/d72/f40 [6534227,28000] 0 2024-04-12T09:11:11.602 INFO:tasks.workunit.client.0.smithi117.stdout:6/462: write d8/f1a [131787,69453] 0 2024-04-12T09:11:11.602 INFO:tasks.workunit.client.0.smithi117.stdout:6/463: chown d8/d3a/d49 11512 1 2024-04-12T09:11:11.604 INFO:tasks.workunit.client.0.smithi117.stdout:3/768: symlink de/d2c/d59/d70/d3d/d63/de1/l11f 0 2024-04-12T09:11:11.608 INFO:tasks.workunit.client.0.smithi117.stdout:0/654: dwrite d3/fe [0,4194304] 0 2024-04-12T09:11:11.612 INFO:tasks.workunit.client.0.smithi117.stdout:6/464: dread d8/d9/f40 [0,4194304] 0 2024-04-12T09:11:11.619 INFO:tasks.workunit.client.0.smithi117.stdout:2/412: dwrite d0/d4/fb [0,4194304] 0 2024-04-12T09:11:11.621 INFO:tasks.workunit.client.0.smithi117.stdout:6/465: creat d8/d3a/f96 x:0 0 0 2024-04-12T09:11:11.623 INFO:tasks.workunit.client.0.smithi117.stdout:3/769: creat de/d2c/d59/d70/d3e/d84/da1/df1/f120 x:0 0 0 2024-04-12T09:11:11.624 INFO:tasks.workunit.client.0.smithi117.stdout:7/400: write d0/d2/d1a/f55 [1125655,79457] 0 2024-04-12T09:11:11.626 INFO:tasks.workunit.client.0.smithi117.stdout:0/655: mkdir d3/ddd 0 2024-04-12T09:11:11.633 INFO:tasks.workunit.client.0.smithi117.stdout:2/413: mkdir d0/d4/d81/d8b 0 2024-04-12T09:11:11.635 INFO:tasks.workunit.client.0.smithi117.stdout:4/527: dwrite d0/d1/d34/d7d/f8b [0,4194304] 0 2024-04-12T09:11:11.637 INFO:tasks.workunit.client.0.smithi117.stdout:0/656: dwrite d3/d22/d76/d83/da8/d97/dc9/dd2/f4f [0,4194304] 0 2024-04-12T09:11:11.638 INFO:tasks.workunit.client.0.smithi117.stdout:3/770: rename de/d2c/c2d to de/d2c/d59/d70/d3d/d63/dc8/c121 0 2024-04-12T09:11:11.641 INFO:tasks.workunit.client.0.smithi117.stdout:7/401: creat d0/d2/d1a/d4f/f7b x:0 0 0 2024-04-12T09:11:11.645 INFO:tasks.workunit.client.0.smithi117.stdout:3/771: dread - de/d2c/d59/d4c/da0/da8/fb8 zero size 2024-04-12T09:11:11.646 INFO:tasks.workunit.client.0.smithi117.stdout:0/657: creat d3/d59/d6a/d91/d94/d5a/d62/d66/d73/fde x:0 0 0 2024-04-12T09:11:11.647 INFO:tasks.workunit.client.0.smithi117.stdout:2/414: dread d0/f3c [0,4194304] 0 2024-04-12T09:11:11.649 INFO:tasks.workunit.client.0.smithi117.stdout:7/402: mkdir d0/da/d7c 0 2024-04-12T09:11:11.651 INFO:tasks.workunit.client.0.smithi117.stdout:4/528: mkdir d0/d5/d3b/d38/d4f/d79/d9c/dab 0 2024-04-12T09:11:11.654 INFO:tasks.workunit.client.0.smithi117.stdout:0/658: mkdir d3/d22/d76/d83/ddf 0 2024-04-12T09:11:11.656 INFO:tasks.workunit.client.0.smithi117.stdout:6/466: dwrite d8/d9/f40 [0,4194304] 0 2024-04-12T09:11:11.659 INFO:tasks.workunit.client.0.smithi117.stdout:2/415: symlink d0/d43/l8c 0 2024-04-12T09:11:11.663 INFO:tasks.workunit.client.0.smithi117.stdout:6/467: mkdir d8/d3f/d51/d97 0 2024-04-12T09:11:11.663 INFO:tasks.workunit.client.0.smithi117.stdout:4/529: dwrite d0/d1/f9e [0,4194304] 0 2024-04-12T09:11:11.665 INFO:tasks.workunit.client.0.smithi117.stdout:3/772: getdents de/d2c/d59/d70/d3e/d5d/d89/dda 0 2024-04-12T09:11:11.667 INFO:tasks.workunit.client.0.smithi117.stdout:0/659: link d3/d30/f31 d3/d47/fe0 0 2024-04-12T09:11:11.668 INFO:tasks.workunit.client.0.smithi117.stdout:3/773: read - de/d2c/d59/d70/d3e/d3f/fd3 zero size 2024-04-12T09:11:11.671 INFO:tasks.workunit.client.0.smithi117.stdout:6/468: write f7 [1278625,51691] 0 2024-04-12T09:11:11.671 INFO:tasks.workunit.client.0.smithi117.stdout:2/416: dwrite d0/df/f1d [8388608,4194304] 0 2024-04-12T09:11:11.674 INFO:tasks.workunit.client.0.smithi117.stdout:0/660: creat d3/d59/d6a/d84/dc2/fe1 x:0 0 0 2024-04-12T09:11:11.674 INFO:tasks.workunit.client.0.smithi117.stdout:6/469: dread - d8/d2a/f92 zero size 2024-04-12T09:11:11.674 INFO:tasks.workunit.client.0.smithi117.stdout:2/417: readlink d0/d4/d10/d27/l83 0 2024-04-12T09:11:11.675 INFO:tasks.workunit.client.0.smithi117.stdout:3/774: dread - de/d2c/d59/d70/d3e/d5d/d80/d97/d10f/f110 zero size 2024-04-12T09:11:11.682 INFO:tasks.workunit.client.0.smithi117.stdout:3/775: creat de/d2c/d59/d30/f122 x:0 0 0 2024-04-12T09:11:11.684 INFO:tasks.workunit.client.0.smithi117.stdout:6/470: creat d8/d2a/d60/d7d/d8c/f98 x:0 0 0 2024-04-12T09:11:11.686 INFO:tasks.workunit.client.0.smithi117.stdout:2/418: dwrite d0/d43/d30/f88 [0,4194304] 0 2024-04-12T09:11:11.689 INFO:tasks.workunit.client.0.smithi117.stdout:0/661: dwrite d3/d59/d6a/d91/d94/d5a/d62/fb5 [0,4194304] 0 2024-04-12T09:11:11.691 INFO:tasks.workunit.client.0.smithi117.stdout:0/662: write d3/da2/fa3 [628745,43040] 0 2024-04-12T09:11:11.697 INFO:tasks.workunit.client.0.smithi117.stdout:0/663: stat d3/d47/l57 0 2024-04-12T09:11:11.697 INFO:tasks.workunit.client.0.smithi117.stdout:6/471: mkdir d8/d2a/d60/d89/d99 0 2024-04-12T09:11:11.701 INFO:tasks.workunit.client.0.smithi117.stdout:2/419: dwrite d0/d43/d30/f88 [0,4194304] 0 2024-04-12T09:11:11.703 INFO:tasks.workunit.client.0.smithi117.stdout:3/776: dwrite de/d2c/d59/d70/d3e/d5d/d89/fce [0,4194304] 0 2024-04-12T09:11:11.703 INFO:tasks.workunit.client.0.smithi117.stdout:7/403: dread d0/d2/d45/d17/f21 [0,4194304] 0 2024-04-12T09:11:11.704 INFO:tasks.workunit.client.0.smithi117.stdout:2/420: stat d0/d4/d10/d27/f70 0 2024-04-12T09:11:11.707 INFO:tasks.workunit.client.0.smithi117.stdout:4/530: truncate d0/d2c/f31 172959 0 2024-04-12T09:11:11.713 INFO:tasks.workunit.client.0.smithi117.stdout:7/404: mknod d0/d2/d45/d17/d23/d50/c7d 0 2024-04-12T09:11:11.715 INFO:tasks.workunit.client.0.smithi117.stdout:6/472: dwrite d8/d9/d61/f65 [0,4194304] 0 2024-04-12T09:11:11.723 INFO:tasks.workunit.client.0.smithi117.stdout:4/531: creat d0/d5/d25/fac x:0 0 0 2024-04-12T09:11:11.725 INFO:tasks.workunit.client.0.smithi117.stdout:6/473: dwrite d8/d3a/d49/f52 [0,4194304] 0 2024-04-12T09:11:11.727 INFO:tasks.workunit.client.0.smithi117.stdout:6/474: dread - d8/d2a/d60/d7d/d8c/f98 zero size 2024-04-12T09:11:11.728 INFO:tasks.workunit.client.0.smithi117.stdout:6/475: write d8/d3a/f7c [418034,60287] 0 2024-04-12T09:11:11.729 INFO:tasks.workunit.client.0.smithi117.stdout:2/421: mkdir d0/d43/d53/d61/d8d 0 2024-04-12T09:11:11.729 INFO:tasks.workunit.client.0.smithi117.stdout:6/476: fdatasync d8/d9/d39/f8d 0 2024-04-12T09:11:11.730 INFO:tasks.workunit.client.0.smithi117.stdout:2/422: chown d0/d43 427207645 1 2024-04-12T09:11:11.731 INFO:tasks.workunit.client.0.smithi117.stdout:2/423: chown d0/d4/d10/f19 6926680 1 2024-04-12T09:11:11.731 INFO:tasks.workunit.client.0.smithi117.stdout:7/405: mknod d0/d2/d1a/d4f/c7e 0 2024-04-12T09:11:11.763 INFO:tasks.workunit.client.0.smithi117.stdout:2/424: read - d0/d43/d4b/f85 zero size 2024-04-12T09:11:11.763 INFO:tasks.workunit.client.0.smithi117.stdout:7/406: chown d0/d2/l11 0 1 2024-04-12T09:11:11.763 INFO:tasks.workunit.client.0.smithi117.stdout:0/664: truncate d3/f25 1191335 0 2024-04-12T09:11:11.764 INFO:tasks.workunit.client.0.smithi117.stdout:4/532: creat d0/d5/d39/d4e/d6b/d83/fad x:0 0 0 2024-04-12T09:11:11.764 INFO:tasks.workunit.client.0.smithi117.stdout:6/477: rmdir d8/d2a/d60/d7d 39 2024-04-12T09:11:11.764 INFO:tasks.workunit.client.0.smithi117.stdout:0/665: readlink d3/d59/l7e 0 2024-04-12T09:11:11.766 INFO:tasks.workunit.client.0.smithi117.stdout:2/425: write d0/d4/d10/d27/f70 [7492563,16248] 0 2024-04-12T09:11:11.768 INFO:tasks.workunit.client.0.smithi117.stdout:6/478: mknod d8/d3a/d49/c9a 0 2024-04-12T09:11:11.770 INFO:tasks.workunit.client.0.smithi117.stdout:7/407: dread d0/d2/d45/d17/f29 [0,4194304] 0 2024-04-12T09:11:11.770 INFO:tasks.workunit.client.0.smithi117.stdout:6/479: chown d8/d9 20 1 2024-04-12T09:11:11.770 INFO:tasks.workunit.client.0.smithi117.stdout:0/666: dread d3/f6 [0,4194304] 0 2024-04-12T09:11:11.771 INFO:tasks.workunit.client.0.smithi117.stdout:4/533: symlink d0/d1/d34/d7d/da7/lae 0 2024-04-12T09:11:11.771 INFO:tasks.workunit.client.0.smithi117.stdout:3/777: dwrite de/d2c/d59/d70/d3e/f50 [0,4194304] 0 2024-04-12T09:11:11.774 INFO:tasks.workunit.client.0.smithi117.stdout:7/408: write d0/d2/d45/d15/f54 [3029278,24058] 0 2024-04-12T09:11:11.775 INFO:tasks.workunit.client.0.smithi117.stdout:7/409: read d0/d2/d45/d17/f29 [91167,57517] 0 2024-04-12T09:11:11.776 INFO:tasks.workunit.client.0.smithi117.stdout:6/480: dread d8/d9/f19 [0,4194304] 0 2024-04-12T09:11:11.778 INFO:tasks.workunit.client.0.smithi117.stdout:0/667: stat d3/dc/f44 0 2024-04-12T09:11:11.783 INFO:tasks.workunit.client.0.smithi117.stdout:4/534: dread d0/f5e [0,4194304] 0 2024-04-12T09:11:11.784 INFO:tasks.workunit.client.0.smithi117.stdout:3/778: mkdir de/d2c/d59/d70/d3e/d5d/d89/d123 0 2024-04-12T09:11:11.786 INFO:tasks.workunit.client.0.smithi117.stdout:0/668: dwrite d3/d22/d76/d85/fbf [0,4194304] 0 2024-04-12T09:11:11.786 INFO:tasks.workunit.client.0.smithi117.stdout:2/426: creat d0/d43/f8e x:0 0 0 2024-04-12T09:11:11.787 INFO:tasks.workunit.client.0.smithi117.stdout:3/779: truncate de/d2c/d59/d70/f115 74499 0 2024-04-12T09:11:11.794 INFO:tasks.workunit.client.0.smithi117.stdout:0/669: dwrite d3/fe [0,4194304] 0 2024-04-12T09:11:11.800 INFO:tasks.workunit.client.0.smithi117.stdout:4/535: mkdir d0/d1/d34/d7d/daf 0 2024-04-12T09:11:11.804 INFO:tasks.workunit.client.0.smithi117.stdout:0/670: dwrite d3/d47/fcc [0,4194304] 0 2024-04-12T09:11:11.804 INFO:tasks.workunit.client.0.smithi117.stdout:2/427: stat d0/d4/c14 0 2024-04-12T09:11:11.806 INFO:tasks.workunit.client.0.smithi117.stdout:2/428: truncate d0/d43/f8e 577435 0 2024-04-12T09:11:11.810 INFO:tasks.workunit.client.0.smithi117.stdout:6/481: mkdir d8/d2a/d60/d7d/d9b 0 2024-04-12T09:11:11.811 INFO:tasks.workunit.client.0.smithi117.stdout:6/482: fsync d8/d2a/f92 0 2024-04-12T09:11:11.816 INFO:tasks.workunit.client.0.smithi117.stdout:0/671: mkdir d3/d22/d76/de2 0 2024-04-12T09:11:11.817 INFO:tasks.workunit.client.0.smithi117.stdout:3/780: creat de/def/f124 x:0 0 0 2024-04-12T09:11:11.817 INFO:tasks.workunit.client.0.smithi117.stdout:6/483: dwrite d8/d9/f29 [0,4194304] 0 2024-04-12T09:11:11.817 INFO:tasks.workunit.client.0.smithi117.stdout:7/410: write d0/d2/d45/d17/d23/d50/f66 [1012217,98860] 0 2024-04-12T09:11:11.819 INFO:tasks.workunit.client.0.smithi117.stdout:2/429: mkdir d0/d4/d10/d2a/d8f 0 2024-04-12T09:11:11.820 INFO:tasks.workunit.client.0.smithi117.stdout:2/430: readlink d0/df/l2c 0 2024-04-12T09:11:11.821 INFO:tasks.workunit.client.0.smithi117.stdout:3/781: truncate de/d2c/d59/d70/d3d/f9f 982413 0 2024-04-12T09:11:11.821 INFO:tasks.workunit.client.0.smithi117.stdout:2/431: chown d0/d4/d81/d8b 298580 1 2024-04-12T09:11:11.823 INFO:tasks.workunit.client.0.smithi117.stdout:2/432: write d0/d4/f5d [79398,87271] 0 2024-04-12T09:11:11.831 INFO:tasks.workunit.client.0.smithi117.stdout:3/782: mkdir de/d2c/d59/d70/d3d/d63/de1/d125 0 2024-04-12T09:11:11.832 INFO:tasks.workunit.client.0.smithi117.stdout:2/433: fsync d0/d43/d30/d41/f5b 0 2024-04-12T09:11:11.833 INFO:tasks.workunit.client.0.smithi117.stdout:2/434: write d0/d4/d10/d27/f6b [459018,63999] 0 2024-04-12T09:11:11.833 INFO:tasks.workunit.client.0.smithi117.stdout:4/536: link d0/d2c/d3c/f45 d0/d5/d3b/d38/d4f/fb0 0 2024-04-12T09:11:11.839 INFO:tasks.workunit.client.0.smithi117.stdout:2/435: rmdir d0/d4/d10/d2a 39 2024-04-12T09:11:11.840 INFO:tasks.workunit.client.0.smithi117.stdout:4/537: mkdir d0/d5/d39/d4e/d6b/d83/db1 0 2024-04-12T09:11:11.842 INFO:tasks.workunit.client.0.smithi117.stdout:6/484: getdents d8/d9/d17/d33 0 2024-04-12T09:11:11.842 INFO:tasks.workunit.client.0.smithi117.stdout:6/485: chown d8/d9/d39/l84 5786 1 2024-04-12T09:11:11.843 INFO:tasks.workunit.client.0.smithi117.stdout:0/672: dread d3/f25 [0,4194304] 0 2024-04-12T09:11:11.843 INFO:tasks.workunit.client.0.smithi117.stdout:6/486: chown d8/d2a/f92 45948 1 2024-04-12T09:11:11.847 INFO:tasks.workunit.client.0.smithi117.stdout:7/411: truncate d0/d2/d45/d17/d23/d39/f48 212626 0 2024-04-12T09:11:11.848 INFO:tasks.workunit.client.0.smithi117.stdout:7/412: chown d0/d2/d45/d17/f44 7008 1 2024-04-12T09:11:11.848 INFO:tasks.workunit.client.0.smithi117.stdout:7/413: chown d0/d2/d45/d15/f54 0 1 2024-04-12T09:11:11.851 INFO:tasks.workunit.client.0.smithi117.stdout:6/487: unlink c4 0 2024-04-12T09:11:11.854 INFO:tasks.workunit.client.0.smithi117.stdout:3/783: dwrite de/d2c/d59/d70/d3e/d5d/db5/fd2 [4194304,4194304] 0 2024-04-12T09:11:11.854 INFO:tasks.workunit.client.0.smithi117.stdout:7/414: unlink d0/d2/d12/f68 0 2024-04-12T09:11:11.856 INFO:tasks.workunit.client.0.smithi117.stdout:7/415: write d0/d2/d45/d17/f3a [2540491,106378] 0 2024-04-12T09:11:11.857 INFO:tasks.workunit.client.0.smithi117.stdout:4/538: link d0/d1/d34/f28 d0/fb2 0 2024-04-12T09:11:11.859 INFO:tasks.workunit.client.0.smithi117.stdout:0/673: creat d3/fe3 x:0 0 0 2024-04-12T09:11:11.859 INFO:tasks.workunit.client.0.smithi117.stdout:0/674: readlink d3/l9 0 2024-04-12T09:11:11.863 INFO:tasks.workunit.client.0.smithi117.stdout:7/416: creat d0/d2/d1a/d5f/f7f x:0 0 0 2024-04-12T09:11:11.864 INFO:tasks.workunit.client.0.smithi117.stdout:6/488: getdents d8/d3f/d51/d97 0 2024-04-12T09:11:11.866 INFO:tasks.workunit.client.0.smithi117.stdout:6/489: chown d8/d2a/l6f 0 1 2024-04-12T09:11:11.866 INFO:tasks.workunit.client.0.smithi117.stdout:0/675: dwrite d3/d22/f33 [0,4194304] 0 2024-04-12T09:11:11.867 INFO:tasks.workunit.client.0.smithi117.stdout:3/784: fdatasync de/d2c/d59/d30/f56 0 2024-04-12T09:11:11.867 INFO:tasks.workunit.client.0.smithi117.stdout:7/417: read d0/d2/d1a/d49/f56 [574329,32249] 0 2024-04-12T09:11:11.868 INFO:tasks.workunit.client.0.smithi117.stdout:7/418: stat d0/d2/d1a/d49/f62 0 2024-04-12T09:11:11.869 INFO:tasks.workunit.client.0.smithi117.stdout:7/419: readlink d0/da/l1f 0 2024-04-12T09:11:11.870 INFO:tasks.workunit.client.0.smithi117.stdout:7/420: write d0/d2/d45/f5a [5187243,55127] 0 2024-04-12T09:11:11.872 INFO:tasks.workunit.client.0.smithi117.stdout:7/421: write d0/d2/d45/f42 [3524090,121587] 0 2024-04-12T09:11:11.877 INFO:tasks.workunit.client.0.smithi117.stdout:6/490: stat d8/d9/c35 0 2024-04-12T09:11:11.878 INFO:tasks.workunit.client.0.smithi117.stdout:6/491: chown d8/d2a/l59 5164 1 2024-04-12T09:11:11.882 INFO:tasks.workunit.client.0.smithi117.stdout:7/422: creat d0/d2/d45/d53/f80 x:0 0 0 2024-04-12T09:11:11.883 INFO:tasks.workunit.client.0.smithi117.stdout:6/492: mkdir d8/d2a/d60/d89/d9c 0 2024-04-12T09:11:11.889 INFO:tasks.workunit.client.0.smithi117.stdout:4/539: truncate d0/d5/d39/f77 858776 0 2024-04-12T09:11:11.893 INFO:tasks.workunit.client.0.smithi117.stdout:3/785: write de/d2c/d59/f7c [238787,112655] 0 2024-04-12T09:11:11.895 INFO:tasks.workunit.client.0.smithi117.stdout:6/493: getdents d8/d3f/d51 0 2024-04-12T09:11:11.895 INFO:tasks.workunit.client.0.smithi117.stdout:7/423: dread d0/d2/d45/d17/f61 [4194304,4194304] 0 2024-04-12T09:11:11.898 INFO:tasks.workunit.client.0.smithi117.stdout:0/676: truncate d3/f4d 3835376 0 2024-04-12T09:11:11.899 INFO:tasks.workunit.client.0.smithi117.stdout:6/494: symlink d8/d3f/d51/l9d 0 2024-04-12T09:11:11.902 INFO:tasks.workunit.client.0.smithi117.stdout:4/540: rename d0/d1/d34/d7d to d0/db3 0 2024-04-12T09:11:11.903 INFO:tasks.workunit.client.0.smithi117.stdout:7/424: dwrite d0/f5d [0,4194304] 0 2024-04-12T09:11:11.908 INFO:tasks.workunit.client.0.smithi117.stdout:6/495: write d8/d3f/d51/f88 [675319,112280] 0 2024-04-12T09:11:11.910 INFO:tasks.workunit.client.0.smithi117.stdout:6/496: write d8/d3a/d49/f83 [3003235,13183] 0 2024-04-12T09:11:11.911 INFO:tasks.workunit.client.0.smithi117.stdout:0/677: creat d3/d22/d76/d83/da8/d97/fe4 x:0 0 0 2024-04-12T09:11:11.912 INFO:tasks.workunit.client.0.smithi117.stdout:0/678: fsync d3/d22/d76/fb7 0 2024-04-12T09:11:11.913 INFO:tasks.workunit.client.0.smithi117.stdout:0/679: truncate d3/dc/f2e 5049342 0 2024-04-12T09:11:11.915 INFO:tasks.workunit.client.0.smithi117.stdout:4/541: creat d0/db3/fb4 x:0 0 0 2024-04-12T09:11:11.915 INFO:tasks.workunit.client.0.smithi117.stdout:0/680: read d3/d30/f38 [312939,88525] 0 2024-04-12T09:11:11.918 INFO:tasks.workunit.client.0.smithi117.stdout:3/786: truncate de/d2c/d59/d70/d3d/d63/ffd 2770820 0 2024-04-12T09:11:11.922 INFO:tasks.workunit.client.0.smithi117.stdout:0/681: chown d3/d59/d6a/c99 481214 1 2024-04-12T09:11:11.924 INFO:tasks.workunit.client.0.smithi117.stdout:0/682: readlink d3/d22/d76/d83/da8/d97/dc9/dd2/lb2 0 2024-04-12T09:11:11.924 INFO:tasks.workunit.client.0.smithi117.stdout:0/683: fsync d3/fe3 0 2024-04-12T09:11:11.925 INFO:tasks.workunit.client.0.smithi117.stdout:7/425: fsync d0/d2/d45/d17/d23/d39/f48 0 2024-04-12T09:11:11.932 INFO:tasks.workunit.client.0.smithi117.stdout:6/497: creat d8/d2a/d60/d89/d9c/f9e x:0 0 0 2024-04-12T09:11:11.945 INFO:tasks.workunit.client.0.smithi117.stdout:3/787: mknod de/d2c/d59/d70/d3e/d5d/d111/c126 0 2024-04-12T09:11:11.947 INFO:tasks.workunit.client.0.smithi117.stdout:6/498: write d8/d9/f82 [1969179,86389] 0 2024-04-12T09:11:11.951 INFO:tasks.workunit.client.0.smithi117.stdout:3/788: read de/d2c/d59/d19/f52 [3192508,9049] 0 2024-04-12T09:11:11.955 INFO:tasks.workunit.client.0.smithi117.stdout:3/789: mknod de/d2c/d59/d70/d3d/c127 0 2024-04-12T09:11:11.957 INFO:tasks.workunit.client.0.smithi117.stdout:6/499: getdents d8/d2a/d60/d89/d9c 0 2024-04-12T09:11:11.958 INFO:tasks.workunit.client.0.smithi117.stdout:3/790: fsync de/d2c/d59/d19/f7f 0 2024-04-12T09:11:11.961 INFO:tasks.workunit.client.0.smithi117.stdout:6/500: mkdir d8/d9/d39/d3c/d9f 0 2024-04-12T09:11:11.961 INFO:tasks.workunit.client.0.smithi117.stdout:6/501: fsync f2 0 2024-04-12T09:11:11.963 INFO:tasks.workunit.client.0.smithi117.stdout:3/791: creat de/d2c/d59/d70/d3e/d3f/f128 x:0 0 0 2024-04-12T09:11:11.966 INFO:tasks.workunit.client.0.smithi117.stdout:3/792: rmdir de/d2c/d59/d70/d3e/d5d/d80/d97/d10f 39 2024-04-12T09:11:11.967 INFO:tasks.workunit.client.0.smithi117.stdout:6/502: dwrite d8/d9/f40 [0,4194304] 0 2024-04-12T09:11:11.971 INFO:tasks.workunit.client.0.smithi117.stdout:3/793: mkdir de/d2c/d59/d4c/da0/daa/d129 0 2024-04-12T09:11:11.973 INFO:tasks.workunit.client.0.smithi117.stdout:3/794: mknod de/d2c/d59/d70/d3e/d5d/db5/c12a 0 2024-04-12T09:11:11.976 INFO:tasks.workunit.client.0.smithi117.stdout:7/426: write d0/da/f2d [771793,108708] 0 2024-04-12T09:11:11.976 INFO:tasks.workunit.client.0.smithi117.stdout:7/427: chown d0/d13 205959273 1 2024-04-12T09:11:11.980 INFO:tasks.workunit.client.0.smithi117.stdout:7/428: rename d0/d13/c3c to d0/d2/d45/d53/d58/c81 0 2024-04-12T09:11:11.985 INFO:tasks.workunit.client.0.smithi117.stdout:7/429: dwrite d0/f2b [0,4194304] 0 2024-04-12T09:11:11.989 INFO:tasks.workunit.client.0.smithi117.stdout:7/430: mknod d0/d2/d45/d17/d23/d39/d6c/c82 0 2024-04-12T09:11:11.992 INFO:tasks.workunit.client.0.smithi117.stdout:7/431: symlink d0/d2/d1a/d4f/l83 0 2024-04-12T09:11:11.995 INFO:tasks.workunit.client.0.smithi117.stdout:7/432: write d0/d2/d1a/d49/f5e [179912,58309] 0 2024-04-12T09:11:11.995 INFO:tasks.workunit.client.0.smithi117.stdout:7/433: stat d0/d2/d45/f42 0 2024-04-12T09:11:11.997 INFO:tasks.workunit.client.0.smithi117.stdout:7/434: symlink d0/d2/d12/l84 0 2024-04-12T09:11:11.998 INFO:tasks.workunit.client.0.smithi117.stdout:7/435: write d0/d13/f76 [912890,20027] 0 2024-04-12T09:11:12.001 INFO:tasks.workunit.client.0.smithi117.stdout:7/436: creat d0/d2/d45/d53/f85 x:0 0 0 2024-04-12T09:11:12.010 INFO:tasks.workunit.client.0.smithi117.stdout:7/437: getdents d0/d2/d45/d17 0 2024-04-12T09:11:12.015 INFO:tasks.workunit.client.0.smithi117.stdout:7/438: dwrite d0/d2/f6f [0,4194304] 0 2024-04-12T09:11:12.017 INFO:tasks.workunit.client.0.smithi117.stdout:7/439: chown d0/d2/d45/d17/d23/d50/d5c/l77 3448603 1 2024-04-12T09:11:12.018 INFO:tasks.workunit.client.0.smithi117.stdout:7/440: chown d0/d2/d45/d17/d23/d50/l34 33735 1 2024-04-12T09:11:12.019 INFO:tasks.workunit.client.0.smithi117.stdout:7/441: fsync d0/d13/f40 0 2024-04-12T09:11:12.042 INFO:tasks.workunit.client.0.smithi117.stdout:7/442: write d0/d13/f3e [416267,83232] 0 2024-04-12T09:11:12.050 INFO:tasks.workunit.client.0.smithi117.stdout:7/443: dread d0/d2/d45/d17/f31 [0,4194304] 0 2024-04-12T09:11:12.053 INFO:tasks.workunit.client.0.smithi117.stdout:7/444: mknod d0/da/d7c/c86 0 2024-04-12T09:11:12.056 INFO:tasks.workunit.client.0.smithi117.stdout:7/445: creat d0/d2/d45/d17/d23/d51/f87 x:0 0 0 2024-04-12T09:11:12.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:11 smithi117 ceph-mon[29277]: pgmap v16: 65 pgs: 65 active+clean; 913 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 13 MiB/s rd, 105 MiB/s wr, 288 op/s 2024-04-12T09:11:12.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:11 smithi203 ceph-mon[36428]: pgmap v16: 65 pgs: 65 active+clean; 913 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 13 MiB/s rd, 105 MiB/s wr, 288 op/s 2024-04-12T09:11:12.380 INFO:tasks.workunit.client.0.smithi117.stdout:9/468: sync 2024-04-12T09:11:12.383 INFO:tasks.workunit.client.0.smithi117.stdout:9/469: mkdir d1/d8/df/d3e/d92 0 2024-04-12T09:11:12.385 INFO:tasks.workunit.client.0.smithi117.stdout:9/470: mknod d1/d8/d52/c93 0 2024-04-12T09:11:12.385 INFO:tasks.workunit.client.0.smithi117.stdout:9/471: chown d1/d24 1024574 1 2024-04-12T09:11:12.390 INFO:tasks.workunit.client.0.smithi117.stdout:9/472: dwrite d1/d8/df/d26/f46 [0,4194304] 0 2024-04-12T09:11:12.394 INFO:tasks.workunit.client.0.smithi117.stdout:9/473: creat d1/d24/f94 x:0 0 0 2024-04-12T09:11:12.400 INFO:tasks.workunit.client.0.smithi117.stdout:9/474: dwrite d1/d8/df/d3e/f2b [0,4194304] 0 2024-04-12T09:11:12.410 INFO:tasks.workunit.client.0.smithi117.stdout:9/475: dread d1/d8/df/d1b/f3f [0,4194304] 0 2024-04-12T09:11:12.416 INFO:tasks.workunit.client.0.smithi117.stdout:9/476: dwrite d1/d8/df/d26/f3c [0,4194304] 0 2024-04-12T09:11:12.422 INFO:tasks.workunit.client.0.smithi117.stdout:9/477: dwrite d1/d8/df/d39/f6f [0,4194304] 0 2024-04-12T09:11:12.424 INFO:tasks.workunit.client.0.smithi117.stdout:9/478: mknod d1/d8/c95 0 2024-04-12T09:11:12.429 INFO:tasks.workunit.client.0.smithi117.stdout:8/478: sync 2024-04-12T09:11:12.431 INFO:tasks.workunit.client.0.smithi117.stdout:8/479: write db/d19/d1a/d3d/d60/d70/f90 [170778,75001] 0 2024-04-12T09:11:12.432 INFO:tasks.workunit.client.0.smithi117.stdout:9/479: dwrite d1/d8/df/d39/f6f [0,4194304] 0 2024-04-12T09:11:12.434 INFO:tasks.workunit.client.0.smithi117.stdout:9/480: read d1/d8/df/d39/d3b/f4c [154428,2265] 0 2024-04-12T09:11:12.438 INFO:tasks.workunit.client.0.smithi117.stdout:8/480: dwrite db/f2f [0,4194304] 0 2024-04-12T09:11:12.440 INFO:tasks.workunit.client.0.smithi117.stdout:9/481: rename d1/d24/f63 to d1/d8/d5a/d79/f96 0 2024-04-12T09:11:12.505 INFO:tasks.workunit.client.0.smithi117.stdout:8/481: fdatasync db/d13/d38/f4e 0 2024-04-12T09:11:12.506 INFO:tasks.workunit.client.0.smithi117.stdout:9/482: mkdir d1/d8/df/d39/d3b/d97 0 2024-04-12T09:11:12.509 INFO:tasks.workunit.client.0.smithi117.stdout:8/482: creat db/d77/fa2 x:0 0 0 2024-04-12T09:11:12.524 INFO:tasks.workunit.client.0.smithi117.stdout:9/483: dread d1/d8/d12/f64 [0,4194304] 0 2024-04-12T09:11:12.526 INFO:tasks.workunit.client.0.smithi117.stdout:9/484: creat d1/d8/df/d39/f98 x:0 0 0 2024-04-12T09:11:12.548 INFO:tasks.workunit.client.0.smithi117.stdout:1/467: sync 2024-04-12T09:11:12.549 INFO:tasks.workunit.client.0.smithi117.stdout:5/544: sync 2024-04-12T09:11:12.551 INFO:tasks.workunit.client.0.smithi117.stdout:1/468: write d1/d64/d45/f50 [5932256,15815] 0 2024-04-12T09:11:12.552 INFO:tasks.workunit.client.0.smithi117.stdout:9/485: mkdir d1/d8/d52/d99 0 2024-04-12T09:11:12.554 INFO:tasks.workunit.client.0.smithi117.stdout:5/545: rmdir d2/d3/de/d1e/d46 39 2024-04-12T09:11:12.556 INFO:tasks.workunit.client.0.smithi117.stdout:1/469: mkdir d1/d6/d3f/d90 0 2024-04-12T09:11:12.557 INFO:tasks.workunit.client.0.smithi117.stdout:1/470: write d1/d64/d45/d4c/d63/f69 [249846,114064] 0 2024-04-12T09:11:12.558 INFO:tasks.workunit.client.0.smithi117.stdout:9/486: creat d1/d8/df/d3e/f9a x:0 0 0 2024-04-12T09:11:12.559 INFO:tasks.workunit.client.0.smithi117.stdout:1/471: dread - d1/d6/d3f/db/d1d/d24/d54/f86 zero size 2024-04-12T09:11:12.561 INFO:tasks.workunit.client.0.smithi117.stdout:9/487: creat d1/d8/df/d3e/f9b x:0 0 0 2024-04-12T09:11:12.564 INFO:tasks.workunit.client.0.smithi117.stdout:5/546: dwrite d2/d3/dd/d39/d83/d74/f8f [0,4194304] 0 2024-04-12T09:11:12.567 INFO:tasks.workunit.client.0.smithi117.stdout:9/488: rmdir d1/d8/df/d7d/d7e 39 2024-04-12T09:11:12.569 INFO:tasks.workunit.client.0.smithi117.stdout:1/472: getdents d1/d6/d3f/db/d16 0 2024-04-12T09:11:12.571 INFO:tasks.workunit.client.0.smithi117.stdout:9/489: creat d1/d8/d5a/d6e/f9c x:0 0 0 2024-04-12T09:11:12.571 INFO:tasks.workunit.client.0.smithi117.stdout:8/483: write db/d4b/f74 [232777,29371] 0 2024-04-12T09:11:12.572 INFO:tasks.workunit.client.0.smithi117.stdout:9/490: write d1/d24/f94 [224119,20559] 0 2024-04-12T09:11:12.574 INFO:tasks.workunit.client.0.smithi117.stdout:9/491: stat d1/d8/df/d26/f80 0 2024-04-12T09:11:12.574 INFO:tasks.workunit.client.0.smithi117.stdout:8/484: truncate db/d13/d38/d46/f7a 532092 0 2024-04-12T09:11:12.576 INFO:tasks.workunit.client.0.smithi117.stdout:1/473: rename d1/d6/d3f/f35 to d1/d6/f91 0 2024-04-12T09:11:12.579 INFO:tasks.workunit.client.0.smithi117.stdout:5/547: symlink d2/d3/de/d1e/d46/d96/d9c/la2 0 2024-04-12T09:11:12.580 INFO:tasks.workunit.client.0.smithi117.stdout:1/474: dread d1/d6/d3f/db/f31 [0,4194304] 0 2024-04-12T09:11:12.581 INFO:tasks.workunit.client.0.smithi117.stdout:9/492: dread d1/f61 [0,4194304] 0 2024-04-12T09:11:12.582 INFO:tasks.workunit.client.0.smithi117.stdout:8/485: fsync db/d19/f2b 0 2024-04-12T09:11:12.585 INFO:tasks.workunit.client.0.smithi117.stdout:5/548: fsync d2/f49 0 2024-04-12T09:11:12.586 INFO:tasks.workunit.client.0.smithi117.stdout:5/549: fdatasync d2/d3/de/d1e/f20 0 2024-04-12T09:11:12.587 INFO:tasks.workunit.client.0.smithi117.stdout:1/475: fsync d1/d64/d45/d4c/d63/f8c 0 2024-04-12T09:11:12.588 INFO:tasks.workunit.client.0.smithi117.stdout:9/493: creat d1/d8/d52/f9d x:0 0 0 2024-04-12T09:11:12.595 INFO:tasks.workunit.client.0.smithi117.stdout:5/550: mknod d2/d3/de/d1e/d46/d96/ca3 0 2024-04-12T09:11:12.597 INFO:tasks.workunit.client.0.smithi117.stdout:8/486: symlink db/d13/d38/la3 0 2024-04-12T09:11:12.600 INFO:tasks.workunit.client.0.smithi117.stdout:9/494: dread d1/fc [0,4194304] 0 2024-04-12T09:11:12.601 INFO:tasks.workunit.client.0.smithi117.stdout:5/551: symlink d2/d3/dd/d39/d7a/la4 0 2024-04-12T09:11:12.605 INFO:tasks.workunit.client.0.smithi117.stdout:1/476: rename d1/d6/d3f/db/d1d/d78/l57 to d1/d6/d3f/db/d1d/l92 0 2024-04-12T09:11:12.606 INFO:tasks.workunit.client.0.smithi117.stdout:5/552: dwrite d2/d3/de/d1e/f44 [4194304,4194304] 0 2024-04-12T09:11:12.610 INFO:tasks.workunit.client.0.smithi117.stdout:8/487: mkdir db/d13/d38/d86/da0/da4 0 2024-04-12T09:11:12.613 INFO:tasks.workunit.client.0.smithi117.stdout:1/477: creat d1/d64/f93 x:0 0 0 2024-04-12T09:11:12.614 INFO:tasks.workunit.client.0.smithi117.stdout:5/553: chown d2/d3/dd/c65 3 1 2024-04-12T09:11:12.617 INFO:tasks.workunit.client.0.smithi117.stdout:8/488: rename db/d77/c39 to db/d19/d1a/d3d/d60/d70/d98/ca5 0 2024-04-12T09:11:12.618 INFO:tasks.workunit.client.0.smithi117.stdout:5/554: dread d2/d3/de/d1e/f44 [4194304,4194304] 0 2024-04-12T09:11:12.627 INFO:tasks.workunit.client.0.smithi117.stdout:1/478: dwrite d1/d6/d3f/db/d16/f2f [0,4194304] 0 2024-04-12T09:11:12.627 INFO:tasks.workunit.client.0.smithi117.stdout:5/555: dread d2/d3/dd/d39/d83/d4d/d52/f84 [0,4194304] 0 2024-04-12T09:11:12.630 INFO:tasks.workunit.client.0.smithi117.stdout:9/495: write d1/d4b/f55 [977745,29104] 0 2024-04-12T09:11:12.631 INFO:tasks.workunit.client.0.smithi117.stdout:1/479: mkdir d1/d64/d45/d4c/d94 0 2024-04-12T09:11:12.641 INFO:tasks.workunit.client.0.smithi117.stdout:5/556: dwrite d2/d3/de/d1e/d35/f63 [0,4194304] 0 2024-04-12T09:11:12.643 INFO:tasks.workunit.client.0.smithi117.stdout:5/557: fsync d2/f19 0 2024-04-12T09:11:12.644 INFO:tasks.workunit.client.0.smithi117.stdout:2/436: sync 2024-04-12T09:11:12.644 INFO:tasks.workunit.client.0.smithi117.stdout:0/684: sync 2024-04-12T09:11:12.644 INFO:tasks.workunit.client.0.smithi117.stdout:4/542: sync 2024-04-12T09:11:12.644 INFO:tasks.workunit.client.0.smithi117.stdout:9/496: dwrite d1/d8/df/d39/d3b/f4a [0,4194304] 0 2024-04-12T09:11:12.649 INFO:tasks.workunit.client.0.smithi117.stdout:8/489: dwrite db/d1b/fe [4194304,4194304] 0 2024-04-12T09:11:12.652 INFO:tasks.workunit.client.0.smithi117.stdout:4/543: mknod d0/d72/cb5 0 2024-04-12T09:11:12.655 INFO:tasks.workunit.client.0.smithi117.stdout:9/497: symlink d1/d24/l9e 0 2024-04-12T09:11:12.655 INFO:tasks.workunit.client.0.smithi117.stdout:5/558: mkdir d2/d3/dd/d39/d83/d4d/d6b/da5 0 2024-04-12T09:11:12.656 INFO:tasks.workunit.client.0.smithi117.stdout:5/559: readlink d2/l4a 0 2024-04-12T09:11:12.657 INFO:tasks.workunit.client.0.smithi117.stdout:9/498: write d1/d8/df/d26/f80 [866697,67152] 0 2024-04-12T09:11:12.661 INFO:tasks.workunit.client.0.smithi117.stdout:1/480: dread d1/d6/d3f/db/d1d/d24/f2e [0,4194304] 0 2024-04-12T09:11:12.662 INFO:tasks.workunit.client.0.smithi117.stdout:1/481: chown d1/d64/f43 21725343 1 2024-04-12T09:11:12.663 INFO:tasks.workunit.client.0.smithi117.stdout:4/544: rename d0/d2c/d56 to d0/d5/d3b/d38/d4f/db6 0 2024-04-12T09:11:12.664 INFO:tasks.workunit.client.0.smithi117.stdout:8/490: mkdir db/da6 0 2024-04-12T09:11:12.671 INFO:tasks.workunit.client.0.smithi117.stdout:5/560: symlink d2/d3/dd/d39/d83/d4d/d6b/da5/la6 0 2024-04-12T09:11:12.671 INFO:tasks.workunit.client.0.smithi117.stdout:8/491: dwrite db/d1b/f40 [0,4194304] 0 2024-04-12T09:11:12.672 INFO:tasks.workunit.client.0.smithi117.stdout:0/685: dread d3/d22/f2d [0,4194304] 0 2024-04-12T09:11:12.673 INFO:tasks.workunit.client.0.smithi117.stdout:1/482: creat d1/d64/d45/d4c/d94/f95 x:0 0 0 2024-04-12T09:11:12.674 INFO:tasks.workunit.client.0.smithi117.stdout:5/561: symlink d2/d3/de/d1e/d35/la7 0 2024-04-12T09:11:12.675 INFO:tasks.workunit.client.0.smithi117.stdout:8/492: mkdir db/d13/d38/d86/da7 0 2024-04-12T09:11:12.676 INFO:tasks.workunit.client.0.smithi117.stdout:8/493: stat db/f30 0 2024-04-12T09:11:12.678 INFO:tasks.workunit.client.0.smithi117.stdout:9/499: getdents d1/d8/df/d26/d41 0 2024-04-12T09:11:12.680 INFO:tasks.workunit.client.0.smithi117.stdout:2/437: truncate d0/d4/d10/d27/f6b 314801 0 2024-04-12T09:11:12.683 INFO:tasks.workunit.client.0.smithi117.stdout:0/686: rename d3/d22/d76/d83/da8/d97/dc9/dd2/f6c to d3/d22/d76/db3/fe5 0 2024-04-12T09:11:12.685 INFO:tasks.workunit.client.0.smithi117.stdout:6/503: sync 2024-04-12T09:11:12.685 INFO:tasks.workunit.client.0.smithi117.stdout:7/446: sync 2024-04-12T09:11:12.685 INFO:tasks.workunit.client.0.smithi117.stdout:3/795: sync 2024-04-12T09:11:12.686 INFO:tasks.workunit.client.0.smithi117.stdout:6/504: readlink d8/d2a/l34 0 2024-04-12T09:11:12.687 INFO:tasks.workunit.client.0.smithi117.stdout:7/447: stat d0/d2/d45/d17/d23/d50/c7d 0 2024-04-12T09:11:12.687 INFO:tasks.workunit.client.0.smithi117.stdout:1/483: mkdir d1/d96 0 2024-04-12T09:11:12.687 INFO:tasks.workunit.client.0.smithi117.stdout:4/545: write d0/d1/f1b [5105529,129435] 0 2024-04-12T09:11:12.689 INFO:tasks.workunit.client.0.smithi117.stdout:6/505: write d8/d9/f40 [4534648,116688] 0 2024-04-12T09:11:12.689 INFO:tasks.workunit.client.0.smithi117.stdout:9/500: write d1/d8/d12/f64 [3080316,55093] 0 2024-04-12T09:11:12.691 INFO:tasks.workunit.client.0.smithi117.stdout:1/484: fdatasync d1/d64/d45/d4c/f7d 0 2024-04-12T09:11:12.691 INFO:tasks.workunit.client.0.smithi117.stdout:5/562: mkdir d2/d3/de/da8 0 2024-04-12T09:11:12.693 INFO:tasks.workunit.client.0.smithi117.stdout:1/485: chown d1/d6/d3f/db/f33 1719454 1 2024-04-12T09:11:12.694 INFO:tasks.workunit.client.0.smithi117.stdout:3/796: readlink de/d2c/d59/d90/l101 0 2024-04-12T09:11:12.696 INFO:tasks.workunit.client.0.smithi117.stdout:1/486: fsync d1/d64/d45/d4c/d63/f69 0 2024-04-12T09:11:12.698 INFO:tasks.workunit.client.0.smithi117.stdout:2/438: symlink d0/l90 0 2024-04-12T09:11:12.700 INFO:tasks.workunit.client.0.smithi117.stdout:2/439: dread - d0/d43/d4b/f85 zero size 2024-04-12T09:11:12.700 INFO:tasks.workunit.client.0.smithi117.stdout:6/506: creat d8/d9/d61/fa0 x:0 0 0 2024-04-12T09:11:12.701 INFO:tasks.workunit.client.0.smithi117.stdout:7/448: dwrite d0/d2/d45/d17/d23/d50/f64 [0,4194304] 0 2024-04-12T09:11:12.703 INFO:tasks.workunit.client.0.smithi117.stdout:7/449: fsync d0/d2/d45/d17/f3a 0 2024-04-12T09:11:12.704 INFO:tasks.workunit.client.0.smithi117.stdout:4/546: mkdir d0/db3/da7/db7 0 2024-04-12T09:11:12.705 INFO:tasks.workunit.client.0.smithi117.stdout:4/547: chown d0/d5/lb 0 1 2024-04-12T09:11:12.713 INFO:tasks.workunit.client.0.smithi117.stdout:5/563: rename d2/c11 to d2/d3/de/d1e/d46/ca9 0 2024-04-12T09:11:12.724 INFO:tasks.workunit.client.0.smithi117.stdout:8/494: dwrite db/d4b/f72 [0,4194304] 0 2024-04-12T09:11:12.724 INFO:tasks.workunit.client.0.smithi117.stdout:5/564: dread d2/d3/de/d1e/d2c/f8c [0,4194304] 0 2024-04-12T09:11:12.725 INFO:tasks.workunit.client.0.smithi117.stdout:5/565: chown d2/d3/de/d1e/d79/c9e 7 1 2024-04-12T09:11:12.726 INFO:tasks.workunit.client.0.smithi117.stdout:3/797: mkdir de/d2c/d59/d70/d3e/d5d/d80/d97/d12b 0 2024-04-12T09:11:12.729 INFO:tasks.workunit.client.0.smithi117.stdout:1/487: link d1/f77 d1/d64/d45/d4c/d63/f97 0 2024-04-12T09:11:12.730 INFO:tasks.workunit.client.0.smithi117.stdout:0/687: truncate d3/d59/d6a/d91/d94/d5a/d62/fb5 3129615 0 2024-04-12T09:11:12.733 INFO:tasks.workunit.client.0.smithi117.stdout:2/440: dread d0/df/f20 [0,4194304] 0 2024-04-12T09:11:12.735 INFO:tasks.workunit.client.0.smithi117.stdout:2/441: stat d0/d4/c7 0 2024-04-12T09:11:12.738 INFO:tasks.workunit.client.0.smithi117.stdout:0/688: mkdir d3/da2/de6 0 2024-04-12T09:11:12.740 INFO:tasks.workunit.client.0.smithi117.stdout:5/566: dwrite d2/d3/dd/d39/f61 [4194304,4194304] 0 2024-04-12T09:11:12.740 INFO:tasks.workunit.client.0.smithi117.stdout:6/507: creat d8/d2a/d60/fa1 x:0 0 0 2024-04-12T09:11:12.741 INFO:tasks.workunit.client.0.smithi117.stdout:3/798: dwrite de/d2c/d59/f23 [4194304,4194304] 0 2024-04-12T09:11:12.743 INFO:tasks.workunit.client.0.smithi117.stdout:3/799: chown de/d2c/d59/d4c/d62 252989327 1 2024-04-12T09:11:12.746 INFO:tasks.workunit.client.0.smithi117.stdout:6/508: mkdir d8/d2a/d60/d89/da2 0 2024-04-12T09:11:12.749 INFO:tasks.workunit.client.0.smithi117.stdout:0/689: mknod d3/d22/d76/d83/da8/d97/dc9/ce7 0 2024-04-12T09:11:12.751 INFO:tasks.workunit.client.0.smithi117.stdout:2/442: dwrite d0/d43/d30/f6e [0,4194304] 0 2024-04-12T09:11:12.754 INFO:tasks.workunit.client.0.smithi117.stdout:0/690: write d3/d22/d76/d83/da8/d9a/fa6 [1047290,110017] 0 2024-04-12T09:11:12.758 INFO:tasks.workunit.client.0.smithi117.stdout:6/509: dwrite d8/d9/d39/f4f [4194304,4194304] 0 2024-04-12T09:11:12.758 INFO:tasks.workunit.client.0.smithi117.stdout:5/567: creat d2/d3/de/faa x:0 0 0 2024-04-12T09:11:12.759 INFO:tasks.workunit.client.0.smithi117.stdout:8/495: dread db/d19/d1a/d3d/f2a [0,4194304] 0 2024-04-12T09:11:12.766 INFO:tasks.workunit.client.0.smithi117.stdout:6/510: creat d8/d9/d61/fa3 x:0 0 0 2024-04-12T09:11:12.767 INFO:tasks.workunit.client.0.smithi117.stdout:5/568: readlink d2/d3/dd/d39/d82/l9b 0 2024-04-12T09:11:12.770 INFO:tasks.workunit.client.0.smithi117.stdout:6/511: read f2 [4194268,75749] 0 2024-04-12T09:11:12.771 INFO:tasks.workunit.client.0.smithi117.stdout:0/691: creat d3/d59/d6a/d91/d94/d5a/d62/d66/d73/fe8 x:0 0 0 2024-04-12T09:11:12.772 INFO:tasks.workunit.client.0.smithi117.stdout:8/496: symlink db/d77/la8 0 2024-04-12T09:11:12.775 INFO:tasks.workunit.client.0.smithi117.stdout:5/569: dwrite d2/d3/de/d1e/d79/f98 [0,4194304] 0 2024-04-12T09:11:12.776 INFO:tasks.workunit.client.0.smithi117.stdout:2/443: creat d0/d43/d53/d61/d8d/f91 x:0 0 0 2024-04-12T09:11:12.780 INFO:tasks.workunit.client.0.smithi117.stdout:6/512: rename d8/d9/d39/d3c to d8/d3a/d49/da4 0 2024-04-12T09:11:12.784 INFO:tasks.workunit.client.0.smithi117.stdout:2/444: dwrite d0/d4/d10/f19 [4194304,4194304] 0 2024-04-12T09:11:12.787 INFO:tasks.workunit.client.0.smithi117.stdout:3/800: getdents de/d2c/d59/d70/d3e/d5d/d80/d82 0 2024-04-12T09:11:12.788 INFO:tasks.workunit.client.0.smithi117.stdout:5/570: mknod d2/d3/dd/d39/d82/cab 0 2024-04-12T09:11:12.791 INFO:tasks.workunit.client.0.smithi117.stdout:6/513: write d8/ff [2213224,75045] 0 2024-04-12T09:11:12.794 INFO:tasks.workunit.client.0.smithi117.stdout:8/497: rename db/d19/f8a to db/d77/fa9 0 2024-04-12T09:11:12.796 INFO:tasks.workunit.client.0.smithi117.stdout:2/445: readlink d0/l16 0 2024-04-12T09:11:12.798 INFO:tasks.workunit.client.0.smithi117.stdout:3/801: creat de/d2c/d59/d70/d3e/d3f/dae/f12c x:0 0 0 2024-04-12T09:11:12.800 INFO:tasks.workunit.client.0.smithi117.stdout:5/571: creat d2/d3/dd/d39/d83/d74/fac x:0 0 0 2024-04-12T09:11:12.802 INFO:tasks.workunit.client.0.smithi117.stdout:5/572: dread - d2/f92 zero size 2024-04-12T09:11:12.804 INFO:tasks.workunit.client.0.smithi117.stdout:8/498: dwrite db/d19/d1a/d3d/f7f [0,4194304] 0 2024-04-12T09:11:12.806 INFO:tasks.workunit.client.0.smithi117.stdout:6/514: mknod d8/d2a/d60/d89/ca5 0 2024-04-12T09:11:12.806 INFO:tasks.workunit.client.0.smithi117.stdout:0/692: creat d3/d59/d6a/d91/d94/fe9 x:0 0 0 2024-04-12T09:11:12.807 INFO:tasks.workunit.client.0.smithi117.stdout:2/446: dwrite d0/d43/d30/f88 [0,4194304] 0 2024-04-12T09:11:12.809 INFO:tasks.workunit.client.0.smithi117.stdout:2/447: dread - d0/d43/d30/f77 zero size 2024-04-12T09:11:12.811 INFO:tasks.workunit.client.0.smithi117.stdout:2/448: dread d0/d43/f8e [0,4194304] 0 2024-04-12T09:11:12.813 INFO:tasks.workunit.client.0.smithi117.stdout:2/449: read d0/d4/f4d [68548,92570] 0 2024-04-12T09:11:12.814 INFO:tasks.workunit.client.0.smithi117.stdout:2/450: fsync d0/df/f1d 0 2024-04-12T09:11:12.814 INFO:tasks.workunit.client.0.smithi117.stdout:3/802: symlink de/d2c/d59/d70/d40/d79/l12d 0 2024-04-12T09:11:12.822 INFO:tasks.workunit.client.0.smithi117.stdout:3/803: dwrite de/d2c/d59/d70/d3e/d3f/f51 [0,4194304] 0 2024-04-12T09:11:12.831 INFO:tasks.workunit.client.0.smithi117.stdout:2/451: creat d0/d4/d81/f92 x:0 0 0 2024-04-12T09:11:12.837 INFO:tasks.workunit.client.0.smithi117.stdout:3/804: creat de/d2c/d59/d30/f12e x:0 0 0 2024-04-12T09:11:12.838 INFO:tasks.workunit.client.0.smithi117.stdout:3/805: dread - de/d2c/d59/d19/d27/f108 zero size 2024-04-12T09:11:12.838 INFO:tasks.workunit.client.0.smithi117.stdout:6/515: symlink d8/d3a/d49/da4/d8a/la6 0 2024-04-12T09:11:12.839 INFO:tasks.workunit.client.0.smithi117.stdout:3/806: stat de/d2c/d59/d70/d3e/d5d 0 2024-04-12T09:11:12.844 INFO:tasks.workunit.client.0.smithi117.stdout:5/573: mknod d2/d3/de/d1e/d46/d96/d9c/cad 0 2024-04-12T09:11:12.846 INFO:tasks.workunit.client.0.smithi117.stdout:8/499: dwrite db/d13/d38/f4e [0,4194304] 0 2024-04-12T09:11:12.849 INFO:tasks.workunit.client.0.smithi117.stdout:6/516: unlink d8/d3a/d49/f52 0 2024-04-12T09:11:12.852 INFO:tasks.workunit.client.0.smithi117.stdout:3/807: creat de/d2c/d59/d90/f12f x:0 0 0 2024-04-12T09:11:12.852 INFO:tasks.workunit.client.0.smithi117.stdout:0/693: write d3/d59/d6a/f6f [1818230,97427] 0 2024-04-12T09:11:12.854 INFO:tasks.workunit.client.0.smithi117.stdout:0/694: chown d3/d22/d76/d83/da8/d9a/cba 10136 1 2024-04-12T09:11:12.858 INFO:tasks.workunit.client.0.smithi117.stdout:6/517: symlink d8/d2a/la7 0 2024-04-12T09:11:12.858 INFO:tasks.workunit.client.0.smithi117.stdout:2/452: dread d0/d43/d30/d41/f21 [0,4194304] 0 2024-04-12T09:11:12.861 INFO:tasks.workunit.client.0.smithi117.stdout:0/695: creat d3/d59/d6a/d91/d94/d5a/d62/d66/d73/fea x:0 0 0 2024-04-12T09:11:12.862 INFO:tasks.workunit.client.0.smithi117.stdout:5/574: symlink d2/d3/de/d1e/d46/lae 0 2024-04-12T09:11:12.863 INFO:tasks.workunit.client.0.smithi117.stdout:0/696: write d3/dc/f2e [706820,30798] 0 2024-04-12T09:11:12.864 INFO:tasks.workunit.client.0.smithi117.stdout:8/500: creat db/d19/d1a/d3d/d9c/faa x:0 0 0 2024-04-12T09:11:12.866 INFO:tasks.workunit.client.0.smithi117.stdout:6/518: dwrite d8/d9/f82 [0,4194304] 0 2024-04-12T09:11:12.869 INFO:tasks.workunit.client.0.smithi117.stdout:8/501: read db/d13/f25 [1658167,24288] 0 2024-04-12T09:11:12.869 INFO:tasks.workunit.client.0.smithi117.stdout:5/575: write d2/d3/dd/d39/d83/d4d/d6b/f97 [609173,127981] 0 2024-04-12T09:11:12.871 INFO:tasks.workunit.client.0.smithi117.stdout:2/453: creat d0/df/f93 x:0 0 0 2024-04-12T09:11:12.873 INFO:tasks.workunit.client.0.smithi117.stdout:2/454: chown d0/d43/d30/d41/c25 1864600 1 2024-04-12T09:11:12.875 INFO:tasks.workunit.client.0.smithi117.stdout:2/455: readlink d0/d43/l8c 0 2024-04-12T09:11:12.876 INFO:tasks.workunit.client.0.smithi117.stdout:0/697: truncate d3/d59/d6a/d91/d94/d5a/f82 606182 0 2024-04-12T09:11:12.877 INFO:tasks.workunit.client.0.smithi117.stdout:8/502: creat db/d19/d1a/d3d/d60/d70/d98/fab x:0 0 0 2024-04-12T09:11:12.879 INFO:tasks.workunit.client.0.smithi117.stdout:6/519: dwrite d8/d9/d39/f8d [0,4194304] 0 2024-04-12T09:11:12.882 INFO:tasks.workunit.client.0.smithi117.stdout:3/808: getdents de/d2c/dc0 0 2024-04-12T09:11:12.886 INFO:tasks.workunit.client.0.smithi117.stdout:3/809: dread de/d2c/d59/d70/d3e/d84/f9d [0,4194304] 0 2024-04-12T09:11:12.887 INFO:tasks.workunit.client.0.smithi117.stdout:0/698: creat d3/d59/d6a/d84/dc2/feb x:0 0 0 2024-04-12T09:11:12.888 INFO:tasks.workunit.client.0.smithi117.stdout:8/503: unlink db/d19/d1a/c22 0 2024-04-12T09:11:12.894 INFO:tasks.workunit.client.0.smithi117.stdout:2/456: symlink d0/d43/d53/l94 0 2024-04-12T09:11:12.895 INFO:tasks.workunit.client.0.smithi117.stdout:2/457: rename d0 to d0/d4/d10/d27/d95 22 2024-04-12T09:11:12.896 INFO:tasks.workunit.client.0.smithi117.stdout:0/699: symlink d3/dc/lec 0 2024-04-12T09:11:12.904 INFO:tasks.workunit.client.0.smithi117.stdout:6/520: link d8/d3a/d49/f83 d8/d3a/fa8 0 2024-04-12T09:11:12.906 INFO:tasks.workunit.client.0.smithi117.stdout:8/504: dread db/d13/f91 [0,4194304] 0 2024-04-12T09:11:12.908 INFO:tasks.workunit.client.0.smithi117.stdout:3/810: dread de/d2c/d59/d19/d27/f38 [0,4194304] 0 2024-04-12T09:11:12.910 INFO:tasks.workunit.client.0.smithi117.stdout:3/811: chown de/d2c/d59/d70/d3e/f50 543657051 1 2024-04-12T09:11:12.911 INFO:tasks.workunit.client.0.smithi117.stdout:3/812: fsync de/d2c/d59/d4c/d62/f11d 0 2024-04-12T09:11:12.912 INFO:tasks.workunit.client.0.smithi117.stdout:5/576: truncate d2/d3/dd/f4b 175176 0 2024-04-12T09:11:12.915 INFO:tasks.workunit.client.0.smithi117.stdout:2/458: mkdir d0/d96 0 2024-04-12T09:11:12.915 INFO:tasks.workunit.client.0.smithi117.stdout:0/700: dread d3/d59/d6a/d91/f8d [0,4194304] 0 2024-04-12T09:11:12.916 INFO:tasks.workunit.client.0.smithi117.stdout:3/813: creat de/d2c/d59/d90/f130 x:0 0 0 2024-04-12T09:11:12.919 INFO:tasks.workunit.client.0.smithi117.stdout:5/577: symlink d2/d3/de/d1e/d2c/laf 0 2024-04-12T09:11:12.919 INFO:tasks.workunit.client.0.smithi117.stdout:8/505: mknod db/d13/d38/d46/d9d/cac 0 2024-04-12T09:11:12.923 INFO:tasks.workunit.client.0.smithi117.stdout:2/459: creat d0/df/f97 x:0 0 0 2024-04-12T09:11:12.924 INFO:tasks.workunit.client.0.smithi117.stdout:0/701: dread - d3/d59/d6a/d91/d94/d5a/d62/d66/f68 zero size 2024-04-12T09:11:12.926 INFO:tasks.workunit.client.0.smithi117.stdout:8/506: dwrite db/d13/d38/d46/f82 [0,4194304] 0 2024-04-12T09:11:12.929 INFO:tasks.workunit.client.0.smithi117.stdout:8/507: read db/f61 [1310501,101555] 0 2024-04-12T09:11:12.935 INFO:tasks.workunit.client.0.smithi117.stdout:3/814: creat de/d2c/d59/d70/d3e/d84/df9/f131 x:0 0 0 2024-04-12T09:11:12.936 INFO:tasks.workunit.client.0.smithi117.stdout:6/521: truncate d8/d9/f50 1750311 0 2024-04-12T09:11:12.938 INFO:tasks.workunit.client.0.smithi117.stdout:5/578: fdatasync d2/f34 0 2024-04-12T09:11:12.938 INFO:tasks.workunit.client.0.smithi117.stdout:6/522: chown d8/d9/d17/d33/l36 361383924 1 2024-04-12T09:11:12.966 INFO:tasks.workunit.client.0.smithi117.stdout:5/579: write d2/d3/dd/f4e [1699227,27975] 0 2024-04-12T09:11:12.968 INFO:tasks.workunit.client.0.smithi117.stdout:3/815: rename de/d2c/d59/d70/d3e/d5d/db5/c12a to de/d2c/d59/d4c/da0/daa/d129/c132 0 2024-04-12T09:11:12.969 INFO:tasks.workunit.client.0.smithi117.stdout:2/460: creat d0/f98 x:0 0 0 2024-04-12T09:11:12.970 INFO:tasks.workunit.client.0.smithi117.stdout:8/508: link db/d19/d1a/d3d/d60/f88 db/da6/fad 0 2024-04-12T09:11:12.971 INFO:tasks.workunit.client.0.smithi117.stdout:8/509: read - db/d19/d1a/d3d/d9c/faa zero size 2024-04-12T09:11:12.972 INFO:tasks.workunit.client.0.smithi117.stdout:0/702: link d3/d59/d6a/d91/d94/d5a/d62/d66/f68 d3/da2/fed 0 2024-04-12T09:11:12.974 INFO:tasks.workunit.client.0.smithi117.stdout:6/523: mknod d8/d9/ca9 0 2024-04-12T09:11:12.976 INFO:tasks.workunit.client.0.smithi117.stdout:5/580: rename d2/l59 to d2/d3/dd/d39/d83/d4d/d52/lb0 0 2024-04-12T09:11:12.979 INFO:tasks.workunit.client.0.smithi117.stdout:8/510: mkdir db/d1b/d62/dae 0 2024-04-12T09:11:12.980 INFO:tasks.workunit.client.0.smithi117.stdout:8/511: read db/d77/f76 [2111712,29871] 0 2024-04-12T09:11:12.983 INFO:tasks.workunit.client.0.smithi117.stdout:0/703: rename d3/d22 to d3/da2/dee 0 2024-04-12T09:11:12.986 INFO:tasks.workunit.client.0.smithi117.stdout:5/581: mknod d2/d3/de/d1e/d35/cb1 0 2024-04-12T09:11:12.987 INFO:tasks.workunit.client.0.smithi117.stdout:2/461: getdents d0/d4/d81/d8b 0 2024-04-12T09:11:12.991 INFO:tasks.workunit.client.0.smithi117.stdout:8/512: unlink db/d4b/f72 0 2024-04-12T09:11:12.993 INFO:tasks.workunit.client.0.smithi117.stdout:2/462: dwrite d0/df/f46 [0,4194304] 0 2024-04-12T09:11:12.994 INFO:tasks.workunit.client.0.smithi117.stdout:2/463: truncate d0/d43/d53/f84 580603 0 2024-04-12T09:11:13.001 INFO:tasks.workunit.client.0.smithi117.stdout:8/513: unlink db/d1b/l16 0 2024-04-12T09:11:13.001 INFO:tasks.workunit.client.0.smithi117.stdout:5/582: dread d2/d3/de/d1e/d46/f4f [0,4194304] 0 2024-04-12T09:11:13.002 INFO:tasks.workunit.client.0.smithi117.stdout:8/514: readlink db/d1b/d55/l6e 0 2024-04-12T09:11:13.003 INFO:tasks.workunit.client.0.smithi117.stdout:5/583: truncate d2/d3/dd/d39/f86 1423829 0 2024-04-12T09:11:13.003 INFO:tasks.workunit.client.0.smithi117.stdout:0/704: unlink d3/d59/d6a/d91/f86 0 2024-04-12T09:11:13.008 INFO:tasks.workunit.client.0.smithi117.stdout:8/515: dwrite db/d19/f5f [0,4194304] 0 2024-04-12T09:11:13.009 INFO:tasks.workunit.client.0.smithi117.stdout:8/516: readlink db/d13/l4a 0 2024-04-12T09:11:13.010 INFO:tasks.workunit.client.0.smithi117.stdout:8/517: chown db/d13/d38/d86/da0/da4 226879201 1 2024-04-12T09:11:13.012 INFO:tasks.workunit.client.0.smithi117.stdout:6/524: link d8/d9/f1f d8/d3f/faa 0 2024-04-12T09:11:13.013 INFO:tasks.workunit.client.0.smithi117.stdout:6/525: chown d8/d9/l93 8933 1 2024-04-12T09:11:13.014 INFO:tasks.workunit.client.0.smithi117.stdout:6/526: chown d8/d3a/d49/c9a 564 1 2024-04-12T09:11:13.022 INFO:tasks.workunit.client.0.smithi117.stdout:0/705: creat d3/d59/d6a/d84/fef x:0 0 0 2024-04-12T09:11:13.027 INFO:tasks.workunit.client.0.smithi117.stdout:3/816: write de/d2c/d59/d70/d40/d49/fbc [2969858,109292] 0 2024-04-12T09:11:13.028 INFO:tasks.workunit.client.0.smithi117.stdout:8/518: truncate db/d13/d38/f5c 445725 0 2024-04-12T09:11:13.028 INFO:tasks.workunit.client.0.smithi117.stdout:8/519: chown db/d1b/f40 2 1 2024-04-12T09:11:13.032 INFO:tasks.workunit.client.0.smithi117.stdout:5/584: mknod d2/d3/de/cb2 0 2024-04-12T09:11:13.032 INFO:tasks.workunit.client.0.smithi117.stdout:6/527: dread f7 [0,4194304] 0 2024-04-12T09:11:13.035 INFO:tasks.workunit.client.0.smithi117.stdout:5/585: read d2/d3/de/d1e/d66/f7d [325938,30738] 0 2024-04-12T09:11:13.037 INFO:tasks.workunit.client.0.smithi117.stdout:2/464: creat d0/f99 x:0 0 0 2024-04-12T09:11:13.040 INFO:tasks.workunit.client.0.smithi117.stdout:4/548: sync 2024-04-12T09:11:13.040 INFO:tasks.workunit.client.0.smithi117.stdout:7/450: sync 2024-04-12T09:11:13.040 INFO:tasks.workunit.client.0.smithi117.stdout:1/488: sync 2024-04-12T09:11:13.040 INFO:tasks.workunit.client.0.smithi117.stdout:9/501: sync 2024-04-12T09:11:13.041 INFO:tasks.workunit.client.0.smithi117.stdout:8/520: write db/f61 [1304899,23487] 0 2024-04-12T09:11:13.042 INFO:tasks.workunit.client.0.smithi117.stdout:9/502: chown d1/d8/d12/f38 251213537 1 2024-04-12T09:11:13.044 INFO:tasks.workunit.client.0.smithi117.stdout:6/528: creat d8/d2a/d6e/fab x:0 0 0 2024-04-12T09:11:13.045 INFO:tasks.workunit.client.0.smithi117.stdout:6/529: write d8/ff [293190,41034] 0 2024-04-12T09:11:13.046 INFO:tasks.workunit.client.0.smithi117.stdout:6/530: chown d8/d9/d61/f65 4345859 1 2024-04-12T09:11:13.047 INFO:tasks.workunit.client.0.smithi117.stdout:0/706: getdents d3/da2/dee/d76/d83/ddf 0 2024-04-12T09:11:13.050 INFO:tasks.workunit.client.0.smithi117.stdout:2/465: truncate d0/d43/d30/f5c 647043 0 2024-04-12T09:11:13.059 INFO:tasks.workunit.client.0.smithi117.stdout:7/451: unlink d0/d2/d45/d15/c57 0 2024-04-12T09:11:13.061 INFO:tasks.workunit.client.0.smithi117.stdout:9/503: mkdir d1/d8/d5e/d9f 0 2024-04-12T09:11:13.066 INFO:tasks.workunit.client.0.smithi117.stdout:3/817: dwrite de/d2c/d59/d4c/da0/da8/dac/fbf [0,4194304] 0 2024-04-12T09:11:13.074 INFO:tasks.workunit.client.0.smithi117.stdout:2/466: dread d0/d4/d10/d27/f70 [0,4194304] 0 2024-04-12T09:11:13.074 INFO:tasks.workunit.client.0.smithi117.stdout:6/531: creat d8/d2a/d60/d89/fac x:0 0 0 2024-04-12T09:11:13.075 INFO:tasks.workunit.client.0.smithi117.stdout:2/467: chown d0/d4/d10/d27/f70 10928 1 2024-04-12T09:11:13.078 INFO:tasks.workunit.client.0.smithi117.stdout:6/532: read d8/d3a/d49/f83 [2359378,69514] 0 2024-04-12T09:11:13.087 INFO:tasks.workunit.client.0.smithi117.stdout:1/489: dwrite d1/d64/d45/d4c/d63/f97 [0,4194304] 0 2024-04-12T09:11:13.088 INFO:tasks.workunit.client.0.smithi117.stdout:1/490: chown d1/d64/c4f 283772520 1 2024-04-12T09:11:13.089 INFO:tasks.workunit.client.0.smithi117.stdout:1/491: fsync d1/d6/d3f/db/d1d/d24/f44 0 2024-04-12T09:11:13.090 INFO:tasks.workunit.client.0.smithi117.stdout:9/504: rename d1/d8/f4e to d1/d8/df/d3e/d92/fa0 0 2024-04-12T09:11:13.091 INFO:tasks.workunit.client.0.smithi117.stdout:9/505: chown d1/d8/d12/l60 3 1 2024-04-12T09:11:13.093 INFO:tasks.workunit.client.0.smithi117.stdout:8/521: creat db/d1b/d62/dae/faf x:0 0 0 2024-04-12T09:11:13.102 INFO:tasks.workunit.client.0.smithi117.stdout:2/468: mkdir d0/d4/d10/d27/d9a 0 2024-04-12T09:11:13.102 INFO:tasks.workunit.client.0.smithi117.stdout:4/549: dwrite d0/d5/d3b/f5c [0,4194304] 0 2024-04-12T09:11:13.110 INFO:tasks.workunit.client.0.smithi117.stdout:5/586: creat d2/d3/dd/fb3 x:0 0 0 2024-04-12T09:11:13.111 INFO:tasks.workunit.client.0.smithi117.stdout:3/818: dread de/d2c/d59/f24 [0,4194304] 0 2024-04-12T09:11:13.120 INFO:tasks.workunit.client.0.smithi117.stdout:1/492: chown d1/c6f 1 1 2024-04-12T09:11:13.128 INFO:tasks.workunit.client.0.smithi117.stdout:6/533: symlink d8/d2a/d60/lad 0 2024-04-12T09:11:13.129 INFO:tasks.workunit.client.0.smithi117.stdout:5/587: write d2/f43 [113089,10629] 0 2024-04-12T09:11:13.138 INFO:tasks.workunit.client.0.smithi117.stdout:2/469: rmdir d0/d4/d10/d2a 39 2024-04-12T09:11:13.141 INFO:tasks.workunit.client.0.smithi117.stdout:5/588: dread d2/d3/dd/d39/d7a/f6f [0,4194304] 0 2024-04-12T09:11:13.142 INFO:tasks.workunit.client.0.smithi117.stdout:0/707: getdents d3/da2/dee/d76/d83/da8/d97 0 2024-04-12T09:11:13.144 INFO:tasks.workunit.client.0.smithi117.stdout:6/534: symlink d8/d2a/d60/d7d/lae 0 2024-04-12T09:11:13.145 INFO:tasks.workunit.client.0.smithi117.stdout:6/535: dread - d8/d2a/d60/d89/fac zero size 2024-04-12T09:11:13.146 INFO:tasks.workunit.client.0.smithi117.stdout:6/536: write d8/d3a/f7c [1781867,43443] 0 2024-04-12T09:11:13.148 INFO:tasks.workunit.client.0.smithi117.stdout:9/506: truncate d1/d8/d12/f37 4219081 0 2024-04-12T09:11:13.149 INFO:tasks.workunit.client.0.smithi117.stdout:7/452: getdents d0/da/d7c 0 2024-04-12T09:11:13.153 INFO:tasks.workunit.client.0.smithi117.stdout:8/522: link db/d13/f4d db/d1b/fb0 0 2024-04-12T09:11:13.155 INFO:tasks.workunit.client.0.smithi117.stdout:2/470: rename d0/d43/d4b/f85 to d0/d4/d10/d27/d9a/f9b 0 2024-04-12T09:11:13.155 INFO:tasks.workunit.client.0.smithi117.stdout:2/471: stat d0/d4/d10/d27/f39 0 2024-04-12T09:11:13.158 INFO:tasks.workunit.client.0.smithi117.stdout:5/589: creat d2/d3/de/d1e/d35/fb4 x:0 0 0 2024-04-12T09:11:13.160 INFO:tasks.workunit.client.0.smithi117.stdout:0/708: symlink d3/da2/dee/d76/d83/da8/d9a/lf0 0 2024-04-12T09:11:13.161 INFO:tasks.workunit.client.0.smithi117.stdout:3/819: creat de/f133 x:0 0 0 2024-04-12T09:11:13.164 INFO:tasks.workunit.client.0.smithi117.stdout:6/537: read d8/f1e [262987,16221] 0 2024-04-12T09:11:13.165 INFO:tasks.workunit.client.0.smithi117.stdout:1/493: dread d1/d3b/f8f [0,4194304] 0 2024-04-12T09:11:13.167 INFO:tasks.workunit.client.0.smithi117.stdout:7/453: symlink d0/d2/d45/d17/d23/d39/d6c/l88 0 2024-04-12T09:11:13.171 INFO:tasks.workunit.client.0.smithi117.stdout:8/523: creat db/d19/d1a/d3d/d60/d70/fb1 x:0 0 0 2024-04-12T09:11:13.176 INFO:tasks.workunit.client.0.smithi117.stdout:4/550: getdents d0/d5/d3b/d38/d4f/d79 0 2024-04-12T09:11:13.181 INFO:tasks.workunit.client.0.smithi117.stdout:3/820: truncate de/d2c/d59/d70/d3e/d84/fd8 481126 0 2024-04-12T09:11:13.188 INFO:tasks.workunit.client.0.smithi117.stdout:6/538: dread d8/d9/d17/f23 [0,4194304] 0 2024-04-12T09:11:13.190 INFO:tasks.workunit.client.0.smithi117.stdout:8/524: creat db/d13/d38/d86/fb2 x:0 0 0 2024-04-12T09:11:13.192 INFO:tasks.workunit.client.0.smithi117.stdout:2/472: link d0/f99 d0/d4/d10/d27/f9c 0 2024-04-12T09:11:13.193 INFO:tasks.workunit.client.0.smithi117.stdout:9/507: dwrite d1/d23/f28 [0,4194304] 0 2024-04-12T09:11:13.193 INFO:tasks.workunit.client.0.smithi117.stdout:2/473: chown d0/df/f93 95749637 1 2024-04-12T09:11:13.195 INFO:tasks.workunit.client.0.smithi117.stdout:5/590: mknod d2/d3/de/d1e/d99/cb5 0 2024-04-12T09:11:13.197 INFO:tasks.workunit.client.0.smithi117.stdout:3/821: rename de/d2c/d59/d70/d3e/d5d/d80/fdc to de/d2c/d59/d70/d3e/d5d/f134 0 2024-04-12T09:11:13.200 INFO:tasks.workunit.client.0.smithi117.stdout:1/494: unlink d1/d3b/f5d 0 2024-04-12T09:11:13.208 INFO:tasks.workunit.client.0.smithi117.stdout:4/551: creat d0/d5/d39/da2/fb8 x:0 0 0 2024-04-12T09:11:13.220 INFO:tasks.workunit.client.0.smithi117.stdout:8/525: truncate db/d19/d1a/d3d/f45 1051964 0 2024-04-12T09:11:13.221 INFO:tasks.workunit.client.0.smithi117.stdout:8/526: dread - db/d13/d38/d46/f80 zero size 2024-04-12T09:11:13.225 INFO:tasks.workunit.client.0.smithi117.stdout:5/591: dread d2/d3/de/d1e/d46/f48 [0,4194304] 0 2024-04-12T09:11:13.228 INFO:tasks.workunit.client.0.smithi117.stdout:0/709: getdents d3/d47 0 2024-04-12T09:11:13.229 INFO:tasks.workunit.client.0.smithi117.stdout:0/710: readlink d3/da2/dee/d76/d83/da8/d97/dc9/dd2/l43 0 2024-04-12T09:11:13.231 INFO:tasks.workunit.client.0.smithi117.stdout:0/711: write d3/da2/dee/d76/d83/da8/fbc [854482,85062] 0 2024-04-12T09:11:13.236 INFO:tasks.workunit.client.0.smithi117.stdout:6/539: link d8/f1a d8/d9/faf 0 2024-04-12T09:11:13.242 INFO:tasks.workunit.client.0.smithi117.stdout:8/527: rename db/f2f to db/d13/fb3 0 2024-04-12T09:11:13.245 INFO:tasks.workunit.client.0.smithi117.stdout:8/528: dread db/d13/fb3 [0,4194304] 0 2024-04-12T09:11:13.245 INFO:tasks.workunit.client.0.smithi117.stdout:2/474: creat d0/d4/f9d x:0 0 0 2024-04-12T09:11:13.247 INFO:tasks.workunit.client.0.smithi117.stdout:8/529: chown db/d19/d1a/d3d 2477 1 2024-04-12T09:11:13.247 INFO:tasks.workunit.client.0.smithi117.stdout:2/475: fsync d0/d43/d30/f77 0 2024-04-12T09:11:13.248 INFO:tasks.workunit.client.0.smithi117.stdout:7/454: truncate d0/d2/d45/d17/d23/d50/f64 492125 0 2024-04-12T09:11:13.249 INFO:tasks.workunit.client.0.smithi117.stdout:7/455: read d0/da/f2d [101053,24726] 0 2024-04-12T09:11:13.252 INFO:tasks.workunit.client.0.smithi117.stdout:6/540: creat d8/d2a/d60/d7d/d8c/fb0 x:0 0 0 2024-04-12T09:11:13.253 INFO:tasks.workunit.client.0.smithi117.stdout:6/541: read d8/f1a [44374,55883] 0 2024-04-12T09:11:13.255 INFO:tasks.workunit.client.0.smithi117.stdout:9/508: write d1/d24/f57 [93776,68351] 0 2024-04-12T09:11:13.258 INFO:tasks.workunit.client.0.smithi117.stdout:8/530: mkdir db/d1b/d62/dae/db4 0 2024-04-12T09:11:13.259 INFO:tasks.workunit.client.0.smithi117.stdout:2/476: symlink d0/d43/d4b/l9e 0 2024-04-12T09:11:13.267 INFO:tasks.workunit.client.0.smithi117.stdout:7/456: read d0/d2/d45/f28 [6546931,28110] 0 2024-04-12T09:11:13.273 INFO:tasks.workunit.client.0.smithi117.stdout:1/495: truncate d1/d6/d3f/db/f73 1574569 0 2024-04-12T09:11:13.273 INFO:tasks.workunit.client.0.smithi117.stdout:9/509: rmdir d1/d8/df/d3e/d92 39 2024-04-12T09:11:13.275 INFO:tasks.workunit.client.0.smithi117.stdout:2/477: fsync d0/d4/d10/d27/f70 0 2024-04-12T09:11:13.275 INFO:tasks.workunit.client.0.smithi117.stdout:9/510: write d1/d8/df/d39/d3b/f4a [707766,27123] 0 2024-04-12T09:11:13.283 INFO:tasks.workunit.client.0.smithi117.stdout:6/542: creat d8/d2a/d60/d89/d99/fb1 x:0 0 0 2024-04-12T09:11:13.289 INFO:tasks.workunit.client.0.smithi117.stdout:4/552: dwrite d0/d5/d39/f77 [0,4194304] 0 2024-04-12T09:11:13.291 INFO:tasks.workunit.client.0.smithi117.stdout:4/553: dread - d0/f99 zero size 2024-04-12T09:11:13.292 INFO:tasks.workunit.client.0.smithi117.stdout:2/478: truncate d0/d4/f4d 414819 0 2024-04-12T09:11:13.295 INFO:tasks.workunit.client.0.smithi117.stdout:5/592: dwrite d2/d3/dd/d39/f3e [0,4194304] 0 2024-04-12T09:11:13.297 INFO:tasks.workunit.client.0.smithi117.stdout:5/593: chown d2/d3/dd/d39/d83/d4d 84496763 1 2024-04-12T09:11:13.297 INFO:tasks.workunit.client.0.smithi117.stdout:7/457: symlink d0/d2/d45/d17/d7a/l89 0 2024-04-12T09:11:13.300 INFO:tasks.workunit.client.0.smithi117.stdout:5/594: chown d2/d3/dd/d39/d83/d74/f8f 15837 1 2024-04-12T09:11:13.302 INFO:tasks.workunit.client.0.smithi117.stdout:5/595: fdatasync d2/d3/dd/d39/d7a/f71 0 2024-04-12T09:11:13.303 INFO:tasks.workunit.client.0.smithi117.stdout:7/458: read d0/d2/d45/d17/d23/d50/f66 [1882305,79737] 0 2024-04-12T09:11:13.303 INFO:tasks.workunit.client.0.smithi117.stdout:9/511: unlink d1/d8/df/l69 0 2024-04-12T09:11:13.306 INFO:tasks.workunit.client.0.smithi117.stdout:0/712: write d3/d59/d6a/d91/d94/d5a/f5d [414798,73253] 0 2024-04-12T09:11:13.311 INFO:tasks.workunit.client.0.smithi117.stdout:6/543: truncate d8/d3a/f4b 1187748 0 2024-04-12T09:11:13.326 INFO:tasks.workunit.client.0.smithi117.stdout:2/479: link d0/d43/d30/d41/c25 d0/d4/d81/d8b/c9f 0 2024-04-12T09:11:13.327 INFO:tasks.workunit.client.0.smithi117.stdout:2/480: read - d0/f73 zero size 2024-04-12T09:11:13.329 INFO:tasks.workunit.client.0.smithi117.stdout:4/554: dread d0/d5/d3b/f97 [0,4194304] 0 2024-04-12T09:11:13.330 INFO:tasks.workunit.client.0.smithi117.stdout:5/596: dread d2/f3d [0,4194304] 0 2024-04-12T09:11:13.331 INFO:tasks.workunit.client.0.smithi117.stdout:0/713: rename d3/da2/fed to d3/da2/ff1 0 2024-04-12T09:11:13.331 INFO:tasks.workunit.client.0.smithi117.stdout:5/597: chown d2/d3/dd/d39/d83/d4d/d52 3086832 1 2024-04-12T09:11:13.332 INFO:tasks.workunit.client.0.smithi117.stdout:0/714: chown d3/da2/dee/d76/d83/da8/d97 16378 1 2024-04-12T09:11:13.334 INFO:tasks.workunit.client.0.smithi117.stdout:5/598: read d2/d3/dd/f17 [2977920,91698] 0 2024-04-12T09:11:13.334 INFO:tasks.workunit.client.0.smithi117.stdout:1/496: write d1/f49 [1303703,107603] 0 2024-04-12T09:11:13.334 INFO:tasks.workunit.client.0.smithi117.stdout:6/544: symlink d8/d2a/d60/d89/da2/lb2 0 2024-04-12T09:11:13.335 INFO:tasks.workunit.client.0.smithi117.stdout:6/545: readlink d8/d2a/d60/lad 0 2024-04-12T09:11:13.395 INFO:tasks.workunit.client.0.smithi117.stdout:0/715: dwrite d3/da2/dee/d76/d83/da8/d97/fe4 [0,4194304] 0 2024-04-12T09:11:13.395 INFO:tasks.workunit.client.0.smithi117.stdout:4/555: creat d0/d5/d3b/fb9 x:0 0 0 2024-04-12T09:11:13.397 INFO:tasks.workunit.client.0.smithi117.stdout:0/716: stat d3/d59/d6a/d91/d94/d5a/d62/d66/d73/fbb 0 2024-04-12T09:11:13.398 INFO:tasks.workunit.client.0.smithi117.stdout:7/459: getdents d0/da 0 2024-04-12T09:11:13.406 INFO:tasks.workunit.client.0.smithi117.stdout:5/599: dwrite d2/f6 [4194304,4194304] 0 2024-04-12T09:11:13.408 INFO:tasks.workunit.client.0.smithi117.stdout:5/600: truncate d2/d3/dd/d39/f86 1572857 0 2024-04-12T09:11:13.418 INFO:tasks.workunit.client.0.smithi117.stdout:6/546: symlink d8/d3f/d51/lb3 0 2024-04-12T09:11:13.419 INFO:tasks.workunit.client.0.smithi117.stdout:6/547: dread - d8/d9/d39/f8e zero size 2024-04-12T09:11:13.425 INFO:tasks.workunit.client.0.smithi117.stdout:9/512: dwrite d1/d8/df/d3e/f32 [0,4194304] 0 2024-04-12T09:11:13.432 INFO:tasks.workunit.client.0.smithi117.stdout:5/601: write d2/d3/de/d1e/f7f [8996941,64140] 0 2024-04-12T09:11:13.435 INFO:tasks.workunit.client.0.smithi117.stdout:5/602: readlink d2/d3/dd/d39/d83/d4d/d6b/da5/la6 0 2024-04-12T09:11:13.435 INFO:tasks.workunit.client.0.smithi117.stdout:5/603: chown d2/f34 216 1 2024-04-12T09:11:13.435 INFO:tasks.workunit.client.0.smithi117.stdout:2/481: getdents d0/d4/d10/d2a/d8f 0 2024-04-12T09:11:13.439 INFO:tasks.workunit.client.0.smithi117.stdout:4/556: unlink d0/d5/d3b/d38/d4f/c8c 0 2024-04-12T09:11:13.440 INFO:tasks.workunit.client.0.smithi117.stdout:0/717: dread d3/dc/f13 [0,4194304] 0 2024-04-12T09:11:13.441 INFO:tasks.workunit.client.0.smithi117.stdout:7/460: write d0/d2/d45/d17/f29 [742372,63568] 0 2024-04-12T09:11:13.446 INFO:tasks.workunit.client.0.smithi117.stdout:1/497: rename d1/f21 to d1/d3b/f98 0 2024-04-12T09:11:13.447 INFO:tasks.workunit.client.0.smithi117.stdout:2/482: dwrite d0/d4/f9d [0,4194304] 0 2024-04-12T09:11:13.448 INFO:tasks.workunit.client.0.smithi117.stdout:5/604: dwrite d2/d3/dd/d39/d83/d4d/f6c [0,4194304] 0 2024-04-12T09:11:13.450 INFO:tasks.workunit.client.0.smithi117.stdout:2/483: read - d0/d4/f54 zero size 2024-04-12T09:11:13.450 INFO:tasks.workunit.client.0.smithi117.stdout:4/557: symlink d0/d5/d39/da2/lba 0 2024-04-12T09:11:13.454 INFO:tasks.workunit.client.0.smithi117.stdout:1/498: dread d1/d64/d45/d4c/d63/f8c [0,4194304] 0 2024-04-12T09:11:13.455 INFO:tasks.workunit.client.0.smithi117.stdout:6/548: creat d8/d2a/d60/fb4 x:0 0 0 2024-04-12T09:11:13.456 INFO:tasks.workunit.client.0.smithi117.stdout:1/499: chown d1/d6/d3f/db/d1d/d24/f2e 47148 1 2024-04-12T09:11:13.460 INFO:tasks.workunit.client.0.smithi117.stdout:0/718: dread d3/d30/f61 [0,4194304] 0 2024-04-12T09:11:13.460 INFO:tasks.workunit.client.0.smithi117.stdout:4/558: chown d0/d1/d34/f5b 0 1 2024-04-12T09:11:13.463 INFO:tasks.workunit.client.0.smithi117.stdout:4/559: write d0/d5/d39/d4e/d6b/d83/f85 [3856669,23609] 0 2024-04-12T09:11:13.468 INFO:tasks.workunit.client.0.smithi117.stdout:1/500: rename d1/d6/d3f/db/f31 to d1/d64/f99 0 2024-04-12T09:11:13.468 INFO:tasks.workunit.client.0.smithi117.stdout:2/484: symlink d0/d4/d10/d2a/d8f/la0 0 2024-04-12T09:11:13.471 INFO:tasks.workunit.client.0.smithi117.stdout:0/719: dwrite d3/d59/d6a/d91/d94/d5a/d62/d66/d73/fe8 [0,4194304] 0 2024-04-12T09:11:13.476 INFO:tasks.workunit.client.0.smithi117.stdout:5/605: creat d2/fb6 x:0 0 0 2024-04-12T09:11:13.478 INFO:tasks.workunit.client.0.smithi117.stdout:7/461: getdents d0/d13 0 2024-04-12T09:11:13.479 INFO:tasks.workunit.client.0.smithi117.stdout:5/606: write d2/d3/de/f2a [1697696,97475] 0 2024-04-12T09:11:13.480 INFO:tasks.workunit.client.0.smithi117.stdout:9/513: dread d1/d8/d12/f37 [0,4194304] 0 2024-04-12T09:11:13.481 INFO:tasks.workunit.client.0.smithi117.stdout:9/514: chown d1 1739126 1 2024-04-12T09:11:13.481 INFO:tasks.workunit.client.0.smithi117.stdout:1/501: rename d1/d6/d3f/db/d1d/d24 to d1/d6/d3f/d90/d9a 0 2024-04-12T09:11:13.482 INFO:tasks.workunit.client.0.smithi117.stdout:7/462: write d0/d2/d45/d53/f80 [643220,120333] 0 2024-04-12T09:11:13.482 INFO:tasks.workunit.client.0.smithi117.stdout:2/485: dwrite d0/d4/f9d [0,4194304] 0 2024-04-12T09:11:13.484 INFO:tasks.workunit.client.0.smithi117.stdout:9/515: chown d1/d8/d5e/f6d 48686 1 2024-04-12T09:11:13.485 INFO:tasks.workunit.client.0.smithi117.stdout:4/560: creat d0/d5/d3b/d38/d4f/d79/d9c/dab/fbb x:0 0 0 2024-04-12T09:11:13.490 INFO:tasks.workunit.client.0.smithi117.stdout:1/502: chown d1/d3b/f4a 1407 1 2024-04-12T09:11:13.492 INFO:tasks.workunit.client.0.smithi117.stdout:2/486: symlink d0/d4/d10/d27/d9a/la1 0 2024-04-12T09:11:13.494 INFO:tasks.workunit.client.0.smithi117.stdout:5/607: truncate d2/d3/dd/f89 874052 0 2024-04-12T09:11:13.497 INFO:tasks.workunit.client.0.smithi117.stdout:9/516: chown d1/d8/df/f13 226272 1 2024-04-12T09:11:13.497 INFO:tasks.workunit.client.0.smithi117.stdout:6/549: dwrite d8/d3f/faa [0,4194304] 0 2024-04-12T09:11:13.498 INFO:tasks.workunit.client.0.smithi117.stdout:5/608: truncate d2/d3/de/d1e/f76 4716775 0 2024-04-12T09:11:13.499 INFO:tasks.workunit.client.0.smithi117.stdout:6/550: chown d8/d3f/d51/c80 1556 1 2024-04-12T09:11:13.500 INFO:tasks.workunit.client.0.smithi117.stdout:4/561: getdents d0/d5/d3b/d38/d4f/db6 0 2024-04-12T09:11:13.501 INFO:tasks.workunit.client.0.smithi117.stdout:0/720: link d3/dc/c93 d3/d59/d6a/d91/d94/d5a/d62/cf2 0 2024-04-12T09:11:13.501 INFO:tasks.workunit.client.0.smithi117.stdout:5/609: readlink d2/d3/dd/d39/d83/d4d/d6b/da5/la6 0 2024-04-12T09:11:13.505 INFO:tasks.workunit.client.0.smithi117.stdout:1/503: link d1/f40 d1/d6/d3f/f9b 0 2024-04-12T09:11:13.506 INFO:tasks.workunit.client.0.smithi117.stdout:2/487: creat d0/d43/d53/d61/d66/fa2 x:0 0 0 2024-04-12T09:11:13.506 INFO:tasks.workunit.client.0.smithi117.stdout:1/504: fdatasync d1/d6/d3f/db/d1d/d78/f55 0 2024-04-12T09:11:13.507 INFO:tasks.workunit.client.0.smithi117.stdout:2/488: fsync d0/d43/d30/f82 0 2024-04-12T09:11:13.508 INFO:tasks.workunit.client.0.smithi117.stdout:6/551: dread d8/d3f/d51/f88 [0,4194304] 0 2024-04-12T09:11:13.510 INFO:tasks.workunit.client.0.smithi117.stdout:6/552: stat d8/d9/d17/d33/c66 0 2024-04-12T09:11:13.511 INFO:tasks.workunit.client.0.smithi117.stdout:9/517: symlink d1/d8/d5a/d79/d91/la1 0 2024-04-12T09:11:13.512 INFO:tasks.workunit.client.0.smithi117.stdout:5/610: symlink d2/d3/dd/d39/d83/d74/lb7 0 2024-04-12T09:11:13.514 INFO:tasks.workunit.client.0.smithi117.stdout:9/518: write d1/d8/df/d26/d41/f89 [4936797,27784] 0 2024-04-12T09:11:13.516 INFO:tasks.workunit.client.0.smithi117.stdout:9/519: write d1/d8/d52/f6c [855829,80860] 0 2024-04-12T09:11:13.516 INFO:tasks.workunit.client.0.smithi117.stdout:0/721: mkdir d3/da2/de6/df3 0 2024-04-12T09:11:13.518 INFO:tasks.workunit.client.0.smithi117.stdout:2/489: symlink d0/d43/d4b/la3 0 2024-04-12T09:11:13.519 INFO:tasks.workunit.client.0.smithi117.stdout:4/562: dread d0/f37 [0,4194304] 0 2024-04-12T09:11:13.521 INFO:tasks.workunit.client.0.smithi117.stdout:5/611: creat d2/d3/dd/d39/d83/d74/fb8 x:0 0 0 2024-04-12T09:11:13.522 INFO:tasks.workunit.client.0.smithi117.stdout:5/612: truncate d2/fb6 173947 0 2024-04-12T09:11:13.524 INFO:tasks.workunit.client.0.smithi117.stdout:5/613: chown d2/d3/dd/d39/d83/d4d/d6b/f97 184614995 1 2024-04-12T09:11:13.525 INFO:tasks.workunit.client.0.smithi117.stdout:9/520: fsync d1/d8/df/d7d/d7e/f78 0 2024-04-12T09:11:13.526 INFO:tasks.workunit.client.0.smithi117.stdout:9/521: fsync d1/d8/d12/f64 0 2024-04-12T09:11:13.526 INFO:tasks.workunit.client.0.smithi117.stdout:9/522: fdatasync d1/d24/f2e 0 2024-04-12T09:11:13.528 INFO:tasks.workunit.client.0.smithi117.stdout:0/722: unlink d3/d59/d6a/d91/d94/d5a/d62/d66/lc1 0 2024-04-12T09:11:13.529 INFO:tasks.workunit.client.0.smithi117.stdout:4/563: rmdir d0/d2c/d8d 39 2024-04-12T09:11:13.532 INFO:tasks.workunit.client.0.smithi117.stdout:1/505: link d1/d6/d51/f67 d1/d6/d3f/d90/f9c 0 2024-04-12T09:11:13.532 INFO:tasks.workunit.client.0.smithi117.stdout:0/723: dread d3/da2/dee/d76/d83/da8/d9a/fa6 [0,4194304] 0 2024-04-12T09:11:13.537 INFO:tasks.workunit.client.0.smithi117.stdout:5/614: dread d2/d3/de/d1e/d46/f88 [0,4194304] 0 2024-04-12T09:11:13.539 INFO:tasks.workunit.client.0.smithi117.stdout:5/615: write d2/d3/dd/fb3 [699629,68168] 0 2024-04-12T09:11:13.541 INFO:tasks.workunit.client.0.smithi117.stdout:4/564: readlink d0/d5/d3b/la 0 2024-04-12T09:11:13.541 INFO:tasks.workunit.client.0.smithi117.stdout:0/724: dwrite d3/d59/d6a/d91/d94/d5a/d62/f70 [4194304,4194304] 0 2024-04-12T09:11:13.542 INFO:tasks.workunit.client.0.smithi117.stdout:1/506: fdatasync d1/d3b/f4a 0 2024-04-12T09:11:13.544 INFO:tasks.workunit.client.0.smithi117.stdout:5/616: write d2/d3/de/d1e/f76 [1838049,10763] 0 2024-04-12T09:11:13.553 INFO:tasks.workunit.client.0.smithi117.stdout:1/507: fsync d1/d6/d3f/db/f33 0 2024-04-12T09:11:13.553 INFO:tasks.workunit.client.0.smithi117.stdout:6/553: write d8/d3a/d49/f83 [628481,126956] 0 2024-04-12T09:11:13.555 INFO:tasks.workunit.client.0.smithi117.stdout:4/565: mknod d0/d5/d3b/d38/d4f/d79/d9c/cbc 0 2024-04-12T09:11:13.555 INFO:tasks.workunit.client.0.smithi117.stdout:6/554: write d8/d3a/fa8 [2400634,7551] 0 2024-04-12T09:11:13.557 INFO:tasks.workunit.client.0.smithi117.stdout:9/523: dread d1/d8/df/d39/d3b/f42 [0,4194304] 0 2024-04-12T09:11:13.558 INFO:tasks.workunit.client.0.smithi117.stdout:4/566: chown d0/d5/d3b/d38/d4f/d79/f95 612 1 2024-04-12T09:11:13.565 INFO:tasks.workunit.client.0.smithi117.stdout:0/725: dread d3/fe [0,4194304] 0 2024-04-12T09:11:13.570 INFO:tasks.workunit.client.0.smithi117.stdout:5/617: creat d2/d3/dd/fb9 x:0 0 0 2024-04-12T09:11:13.571 INFO:tasks.workunit.client.0.smithi117.stdout:0/726: creat d3/da2/dee/d76/d83/ff4 x:0 0 0 2024-04-12T09:11:13.571 INFO:tasks.workunit.client.0.smithi117.stdout:0/727: chown d3/c1f 1913512338 1 2024-04-12T09:11:13.572 INFO:tasks.workunit.client.0.smithi117.stdout:0/728: fdatasync d3/d59/f6d 0 2024-04-12T09:11:13.573 INFO:tasks.workunit.client.0.smithi117.stdout:0/729: chown d3/da2/dee/d76/fa4 127 1 2024-04-12T09:11:13.573 INFO:tasks.workunit.client.0.smithi117.stdout:9/524: mkdir d1/d8/df/da2 0 2024-04-12T09:11:13.575 INFO:tasks.workunit.client.0.smithi117.stdout:4/567: link d0/d5/d3b/d8f/fa9 d0/d1/fbd 0 2024-04-12T09:11:13.577 INFO:tasks.workunit.client.0.smithi117.stdout:1/508: creat d1/f9d x:0 0 0 2024-04-12T09:11:13.578 INFO:tasks.workunit.client.0.smithi117.stdout:1/509: read d1/d64/d45/d4c/d63/f97 [2970308,78619] 0 2024-04-12T09:11:13.581 INFO:tasks.workunit.client.0.smithi117.stdout:0/730: creat d3/d47/ff5 x:0 0 0 2024-04-12T09:11:13.585 INFO:tasks.workunit.client.0.smithi117.stdout:0/731: stat d3/da2/dee/d76/d83/da8/d97 0 2024-04-12T09:11:13.585 INFO:tasks.workunit.client.0.smithi117.stdout:1/510: dwrite d1/d6/d3f/db/d16/f19 [4194304,4194304] 0 2024-04-12T09:11:13.589 INFO:tasks.workunit.client.0.smithi117.stdout:6/555: dwrite d8/d9/d17/f23 [0,4194304] 0 2024-04-12T09:11:13.590 INFO:tasks.workunit.client.0.smithi117.stdout:5/618: mknod d2/d3/dd/cba 0 2024-04-12T09:11:13.592 INFO:tasks.workunit.client.0.smithi117.stdout:4/568: mkdir d0/d5/d25/d9f/dbe 0 2024-04-12T09:11:13.599 INFO:tasks.workunit.client.0.smithi117.stdout:6/556: dwrite d8/d9/d61/fa0 [0,4194304] 0 2024-04-12T09:11:13.602 INFO:tasks.workunit.client.0.smithi117.stdout:0/732: creat d3/d59/d6a/d91/d94/d5a/d62/ff6 x:0 0 0 2024-04-12T09:11:13.603 INFO:tasks.workunit.client.0.smithi117.stdout:5/619: creat d2/d3/de/d1e/d46/d96/fbb x:0 0 0 2024-04-12T09:11:13.610 INFO:tasks.workunit.client.0.smithi117.stdout:4/569: dread d0/d5/d39/f36 [0,4194304] 0 2024-04-12T09:11:13.663 INFO:tasks.workunit.client.0.smithi117.stdout:6/557: mknod d8/d3a/d49/da4/cb5 0 2024-04-12T09:11:13.768 INFO:tasks.workunit.client.0.smithi117.stdout:4/570: dread - d0/d5/d3b/f82 zero size 2024-04-12T09:11:13.769 INFO:tasks.workunit.client.0.smithi117.stdout:6/558: fsync d8/f1e 0 2024-04-12T09:11:13.774 INFO:tasks.workunit.client.0.smithi117.stdout:4/571: dwrite d0/d5/f6a [0,4194304] 0 2024-04-12T09:11:13.778 INFO:tasks.workunit.client.0.smithi117.stdout:6/559: dwrite d8/d2a/d60/d89/fac [0,4194304] 0 2024-04-12T09:11:13.786 INFO:tasks.workunit.client.0.smithi117.stdout:4/572: rename d0/d5/d3b/f1c to d0/d5/d3b/fbf 0 2024-04-12T09:11:13.786 INFO:tasks.workunit.client.0.smithi117.stdout:6/560: dwrite d8/d3a/fa8 [4194304,4194304] 0 2024-04-12T09:11:13.788 INFO:tasks.workunit.client.0.smithi117.stdout:4/573: write d0/db3/f8b [4409121,7293] 0 2024-04-12T09:11:13.796 INFO:tasks.workunit.client.0.smithi117.stdout:4/574: symlink d0/d2c/d3c/lc0 0 2024-04-12T09:11:13.800 INFO:tasks.workunit.client.0.smithi117.stdout:6/561: creat d8/d9/fb6 x:0 0 0 2024-04-12T09:11:13.807 INFO:tasks.workunit.client.0.smithi117.stdout:4/575: link d0/d5/d3b/d38/d4f/f74 d0/d1/d34/fc1 0 2024-04-12T09:11:13.808 INFO:tasks.workunit.client.0.smithi117.stdout:4/576: write d0/d1/f9e [2349850,83696] 0 2024-04-12T09:11:13.812 INFO:tasks.workunit.client.0.smithi117.stdout:4/577: unlink d0/d5/c9 0 2024-04-12T09:11:13.816 INFO:tasks.workunit.client.0.smithi117.stdout:9/525: link d1/d23/l7f d1/d8/la3 0 2024-04-12T09:11:13.817 INFO:tasks.workunit.client.0.smithi117.stdout:9/526: write d1/d8/df/d26/f3c [2565992,22847] 0 2024-04-12T09:11:13.822 INFO:tasks.workunit.client.0.smithi117.stdout:9/527: link d1/d8/df/d3e/f9b d1/d8/df/d3e/fa4 0 2024-04-12T09:11:13.827 INFO:tasks.workunit.client.0.smithi117.stdout:9/528: link d1/d8/d12/f20 d1/d24/fa5 0 2024-04-12T09:11:13.828 INFO:tasks.workunit.client.0.smithi117.stdout:9/529: truncate d1/d8/df/d39/f98 547443 0 2024-04-12T09:11:13.841 INFO:tasks.workunit.client.0.smithi117.stdout:4/578: creat d0/d5/d25/fc2 x:0 0 0 2024-04-12T09:11:13.844 INFO:tasks.workunit.client.0.smithi117.stdout:6/562: creat d8/d2a/fb7 x:0 0 0 2024-04-12T09:11:13.850 INFO:tasks.workunit.client.0.smithi117.stdout:6/563: fdatasync d8/d3a/f4b 0 2024-04-12T09:11:13.854 INFO:tasks.workunit.client.0.smithi117.stdout:6/564: fdatasync d8/d9/fb 0 2024-04-12T09:11:13.854 INFO:tasks.workunit.client.0.smithi117.stdout:1/511: dwrite d1/d6/d51/f67 [0,4194304] 0 2024-04-12T09:11:13.855 INFO:tasks.workunit.client.0.smithi117.stdout:6/565: chown d8/d9/d39/f8e 7 1 2024-04-12T09:11:13.855 INFO:tasks.workunit.client.0.smithi117.stdout:3/822: sync 2024-04-12T09:11:13.856 INFO:tasks.workunit.client.0.smithi117.stdout:6/566: truncate d8/d2a/d60/fa1 231947 0 2024-04-12T09:11:13.857 INFO:tasks.workunit.client.0.smithi117.stdout:6/567: stat d8/d3f/d51/c80 0 2024-04-12T09:11:13.860 INFO:tasks.workunit.client.0.smithi117.stdout:6/568: mkdir d8/d2a/d60/d7d/d8c/db8 0 2024-04-12T09:11:13.862 INFO:tasks.workunit.client.0.smithi117.stdout:1/512: truncate d1/d6/d3f/db/d1d/f5b 924021 0 2024-04-12T09:11:13.865 INFO:tasks.workunit.client.0.smithi117.stdout:3/823: rename de/d2c/d59/d70/d3e/d3f/f128 to de/d2c/dc0/dcd/dd1/f135 0 2024-04-12T09:11:13.866 INFO:tasks.workunit.client.0.smithi117.stdout:3/824: readlink de/d2c/d59/d70/d40/d49/l91 0 2024-04-12T09:11:13.868 INFO:tasks.workunit.client.0.smithi117.stdout:6/569: creat d8/d3f/d51/d97/fb9 x:0 0 0 2024-04-12T09:11:13.880 INFO:tasks.workunit.client.0.smithi117.stdout:6/570: link d8/d3a/l72 d8/d3f/lba 0 2024-04-12T09:11:13.882 INFO:tasks.workunit.client.0.smithi117.stdout:6/571: read d8/d3f/d51/f67 [3400869,20405] 0 2024-04-12T09:11:13.888 INFO:tasks.workunit.client.0.smithi117.stdout:6/572: dwrite d8/d3f/faa [0,4194304] 0 2024-04-12T09:11:13.889 INFO:tasks.workunit.client.0.smithi117.stdout:6/573: fdatasync d8/d9/d61/f65 0 2024-04-12T09:11:13.892 INFO:tasks.workunit.client.0.smithi117.stdout:6/574: creat d8/d2a/d60/d89/fbb x:0 0 0 2024-04-12T09:11:13.896 INFO:tasks.workunit.client.0.smithi117.stdout:6/575: dread d8/d9/d17/f23 [0,4194304] 0 2024-04-12T09:11:13.899 INFO:tasks.workunit.client.0.smithi117.stdout:6/576: readlink d8/d9/l53 0 2024-04-12T09:11:13.914 INFO:tasks.workunit.client.0.smithi117.stdout:9/530: rmdir d1/d23 39 2024-04-12T09:11:13.920 INFO:tasks.workunit.client.0.smithi117.stdout:0/733: rmdir d3/d59/d6a/d91/d94/d5a/d62/d66 39 2024-04-12T09:11:13.922 INFO:tasks.workunit.client.0.smithi117.stdout:4/579: dwrite d0/d5/d3b/d38/d4f/f74 [0,4194304] 0 2024-04-12T09:11:13.925 INFO:tasks.workunit.client.0.smithi117.stdout:0/734: symlink d3/d59/d6a/d91/lf7 0 2024-04-12T09:11:13.928 INFO:tasks.workunit.client.0.smithi117.stdout:4/580: mknod d0/d5/d39/d88/cc3 0 2024-04-12T09:11:13.931 INFO:tasks.workunit.client.0.smithi117.stdout:0/735: dwrite d3/da2/dee/f33 [0,4194304] 0 2024-04-12T09:11:13.932 INFO:tasks.workunit.client.0.smithi117.stdout:0/736: stat d3/dc/l2a 0 2024-04-12T09:11:13.944 INFO:tasks.workunit.client.0.smithi117.stdout:3/825: write de/d2c/d59/d70/d40/d79/f8a [672127,84094] 0 2024-04-12T09:11:13.953 INFO:tasks.workunit.client.0.smithi117.stdout:4/581: dread d0/d5/d39/f3e [0,4194304] 0 2024-04-12T09:11:13.964 INFO:tasks.workunit.client.0.smithi117.stdout:6/577: dwrite f3 [4194304,4194304] 0 2024-04-12T09:11:13.973 INFO:tasks.workunit.client.0.smithi117.stdout:3/826: mknod de/d2c/d59/d70/d3d/d63/de1/d106/c136 0 2024-04-12T09:11:13.981 INFO:tasks.workunit.client.0.smithi117.stdout:3/827: mknod de/d2c/d59/d90/c137 0 2024-04-12T09:11:13.981 INFO:tasks.workunit.client.0.smithi117.stdout:6/578: dwrite d8/d9/d17/d33/f5b [0,4194304] 0 2024-04-12T09:11:13.983 INFO:tasks.workunit.client.0.smithi117.stdout:6/579: stat d8/d9/l93 0 2024-04-12T09:11:13.984 INFO:tasks.workunit.client.0.smithi117.stdout:6/580: stat d8/d2a/d94 0 2024-04-12T09:11:13.988 INFO:tasks.workunit.client.0.smithi117.stdout:3/828: creat de/d2c/d59/d70/d3d/d63/de1/f138 x:0 0 0 2024-04-12T09:11:13.988 INFO:tasks.workunit.client.0.smithi117.stdout:0/737: dwrite d3/d30/f38 [0,4194304] 0 2024-04-12T09:11:13.994 INFO:tasks.workunit.client.0.smithi117.stdout:6/581: rename d8/d9/l93 to d8/d2a/d60/d7d/d9b/lbc 0 2024-04-12T09:11:13.996 INFO:tasks.workunit.client.0.smithi117.stdout:3/829: mknod de/d2c/d59/d19/d27/c139 0 2024-04-12T09:11:14.001 INFO:tasks.workunit.client.0.smithi117.stdout:6/582: rename d8/d9/d39/l84 to d8/d3a/d49/da4/d9f/lbd 0 2024-04-12T09:11:14.002 INFO:tasks.workunit.client.0.smithi117.stdout:0/738: mknod d3/da2/de6/df3/cf8 0 2024-04-12T09:11:14.003 INFO:tasks.workunit.client.0.smithi117.stdout:8/531: sync 2024-04-12T09:11:14.003 INFO:tasks.workunit.client.0.smithi117.stdout:7/463: sync 2024-04-12T09:11:14.003 INFO:tasks.workunit.client.0.smithi117.stdout:5/620: sync 2024-04-12T09:11:14.003 INFO:tasks.workunit.client.0.smithi117.stdout:2/490: sync 2024-04-12T09:11:14.004 INFO:tasks.workunit.client.0.smithi117.stdout:3/830: mknod de/d2c/d59/d70/d3e/d5d/d89/d68/c13a 0 2024-04-12T09:11:14.005 INFO:tasks.workunit.client.0.smithi117.stdout:5/621: dread - d2/d3/dd/d39/d83/d4d/f8d zero size 2024-04-12T09:11:14.008 INFO:tasks.workunit.client.0.smithi117.stdout:0/739: rmdir d3/d59/d6a/d84 39 2024-04-12T09:11:14.012 INFO:tasks.workunit.client.0.smithi117.stdout:5/622: dwrite d2/d3/dd/d39/f3e [0,4194304] 0 2024-04-12T09:11:14.014 INFO:tasks.workunit.client.0.smithi117.stdout:2/491: unlink d0/d4/lc 0 2024-04-12T09:11:14.015 INFO:tasks.workunit.client.0.smithi117.stdout:8/532: chown db/d19/d1a/d3d/c42 49 1 2024-04-12T09:11:14.017 INFO:tasks.workunit.client.0.smithi117.stdout:8/533: fdatasync db/d19/d1a/d3d/f7f 0 2024-04-12T09:11:14.019 INFO:tasks.workunit.client.0.smithi117.stdout:8/534: dread - db/d19/f8d zero size 2024-04-12T09:11:14.019 INFO:tasks.workunit.client.0.smithi117.stdout:3/831: creat de/d2c/d59/d70/d3e/d5d/d89/d68/f13b x:0 0 0 2024-04-12T09:11:14.020 INFO:tasks.workunit.client.0.smithi117.stdout:5/623: dwrite d2/d3/dd/d39/d83/f30 [0,4194304] 0 2024-04-12T09:11:14.029 INFO:tasks.workunit.client.0.smithi117.stdout:4/582: truncate d0/d5/f8 2550295 0 2024-04-12T09:11:14.029 INFO:tasks.workunit.client.0.smithi117.stdout:3/832: dwrite de/d2c/dc0/dcd/dd1/f118 [0,4194304] 0 2024-04-12T09:11:14.038 INFO:tasks.workunit.client.0.smithi117.stdout:5/624: creat d2/d3/de/d1e/d66/fbc x:0 0 0 2024-04-12T09:11:14.039 INFO:tasks.workunit.client.0.smithi117.stdout:5/625: chown d2/d3/dd/d39/d83/c7c 4131970 1 2024-04-12T09:11:14.040 INFO:tasks.workunit.client.0.smithi117.stdout:0/740: creat d3/d59/d6a/d84/ff9 x:0 0 0 2024-04-12T09:11:14.041 INFO:tasks.workunit.client.0.smithi117.stdout:7/464: getdents d0/d20/d4a 0 2024-04-12T09:11:14.042 INFO:tasks.workunit.client.0.smithi117.stdout:5/626: dread d2/f49 [0,4194304] 0 2024-04-12T09:11:14.065 INFO:tasks.workunit.client.0.smithi117.stdout:8/535: truncate db/d19/d1a/d3d/f28 4837463 0 2024-04-12T09:11:14.073 INFO:tasks.workunit.client.0.smithi117.stdout:2/492: rename d0/d4/d10/l15 to d0/d43/la4 0 2024-04-12T09:11:14.075 INFO:tasks.workunit.client.0.smithi117.stdout:8/536: dread - db/d1b/d55/f57 zero size 2024-04-12T09:11:14.076 INFO:tasks.workunit.client.0.smithi117.stdout:8/537: write db/d13/d38/d86/fb2 [899568,54602] 0 2024-04-12T09:11:14.077 INFO:tasks.workunit.client.0.smithi117.stdout:5/627: mknod d2/d3/de/d1e/cbd 0 2024-04-12T09:11:14.079 INFO:tasks.workunit.client.0.smithi117.stdout:4/583: link d0/d2c/f93 d0/d5/d3b/d38/d4f/fc4 0 2024-04-12T09:11:14.079 INFO:tasks.workunit.client.0.smithi117.stdout:3/833: write de/d2c/d59/d4c/f7b [371186,89052] 0 2024-04-12T09:11:14.080 INFO:tasks.workunit.client.0.smithi117.stdout:4/584: write d0/d5/f6a [2660028,128137] 0 2024-04-12T09:11:14.081 INFO:tasks.workunit.client.0.smithi117.stdout:4/585: chown d0/d5/d3b/d38/d4f/db6 887 1 2024-04-12T09:11:14.083 INFO:tasks.workunit.client.0.smithi117.stdout:7/465: rename d0/d2/d45/d53/f85 to d0/d13/f8a 0 2024-04-12T09:11:14.085 INFO:tasks.workunit.client.0.smithi117.stdout:8/538: symlink db/d1b/d62/dae/lb5 0 2024-04-12T09:11:14.086 INFO:tasks.workunit.client.0.smithi117.stdout:8/539: write db/f61 [2120879,106967] 0 2024-04-12T09:11:14.089 INFO:tasks.workunit.client.0.smithi117.stdout:5/628: mkdir d2/d3/de/d1e/d66/dbe 0 2024-04-12T09:11:14.094 INFO:tasks.workunit.client.0.smithi117.stdout:3/834: mknod de/d2c/d59/d4c/da0/da8/dac/c13c 0 2024-04-12T09:11:14.095 INFO:tasks.workunit.client.0.smithi117.stdout:0/741: dread d3/dc/f2c [0,4194304] 0 2024-04-12T09:11:14.104 INFO:tasks.workunit.client.0.smithi117.stdout:8/540: dwrite db/fc [0,4194304] 0 2024-04-12T09:11:14.110 INFO:tasks.workunit.client.0.smithi117.stdout:5/629: mknod d2/d3/de/d1e/d66/dbe/cbf 0 2024-04-12T09:11:14.111 INFO:tasks.workunit.client.0.smithi117.stdout:5/630: stat d2/d3/de/da8 0 2024-04-12T09:11:14.117 INFO:tasks.workunit.client.0.smithi117.stdout:2/493: rename d0/d4/d10/d2a to d0/d43/da5 0 2024-04-12T09:11:14.122 INFO:tasks.workunit.client.0.smithi117.stdout:8/541: mknod db/d1b/cb6 0 2024-04-12T09:11:14.126 INFO:tasks.workunit.client.0.smithi117.stdout:7/466: rename d0/d2/d45/d17/f61 to d0/d2/d45/d17/d23/d39/d6c/f8b 0 2024-04-12T09:11:14.126 INFO:tasks.workunit.client.0.smithi117.stdout:8/542: truncate db/d19/d1a/d3d/d60/d70/f90 609219 0 2024-04-12T09:11:14.127 INFO:tasks.workunit.client.0.smithi117.stdout:5/631: dread d2/f19 [0,4194304] 0 2024-04-12T09:11:14.128 INFO:tasks.workunit.client.0.smithi117.stdout:3/835: link de/d2c/d59/d70/d3d/d63/de1/l11f de/d2c/d59/d70/d3e/d5d/db5/l13d 0 2024-04-12T09:11:14.128 INFO:tasks.workunit.client.0.smithi117.stdout:0/742: dwrite d3/d47/f60 [0,4194304] 0 2024-04-12T09:11:14.128 INFO:tasks.workunit.client.0.smithi117.stdout:3/836: readlink l9 0 2024-04-12T09:11:14.129 INFO:tasks.workunit.client.0.smithi117.stdout:8/543: dread - db/d19/d1a/f79 zero size 2024-04-12T09:11:14.129 INFO:tasks.workunit.client.0.smithi117.stdout:5/632: dread - d2/d3/dd/d39/d7a/f71 zero size 2024-04-12T09:11:14.131 INFO:tasks.workunit.client.0.smithi117.stdout:3/837: write de/d2c/d59/d90/f130 [612939,108518] 0 2024-04-12T09:11:14.132 INFO:tasks.workunit.client.0.smithi117.stdout:8/544: truncate db/d1b/d62/f66 394668 0 2024-04-12T09:11:14.134 INFO:tasks.workunit.client.0.smithi117.stdout:2/494: creat d0/d43/d53/d61/fa6 x:0 0 0 2024-04-12T09:11:14.137 INFO:tasks.workunit.client.0.smithi117.stdout:0/743: unlink d3/da2/dee/d76/d83/da8/d9a/cba 0 2024-04-12T09:11:14.138 INFO:tasks.workunit.client.0.smithi117.stdout:5/633: unlink d2/d3/de/d1e/d35/cb1 0 2024-04-12T09:11:14.141 INFO:tasks.workunit.client.0.smithi117.stdout:8/545: readlink db/d19/d1a/d3d/l6b 0 2024-04-12T09:11:14.142 INFO:tasks.workunit.client.0.smithi117.stdout:8/546: stat db/d19/d1a/f79 0 2024-04-12T09:11:14.144 INFO:tasks.workunit.client.0.smithi117.stdout:7/467: rename d0/d2/d1a/d49/c33 to d0/d2/d1a/c8c 0 2024-04-12T09:11:14.149 INFO:tasks.workunit.client.0.smithi117.stdout:7/468: rmdir d0 39 2024-04-12T09:11:14.151 INFO:tasks.workunit.client.0.smithi117.stdout:5/634: dwrite d2/d3/dd/d39/d83/d4d/d52/f70 [0,4194304] 0 2024-04-12T09:11:14.154 INFO:tasks.workunit.client.0.smithi117.stdout:0/744: creat d3/d59/d6a/ffa x:0 0 0 2024-04-12T09:11:14.157 INFO:tasks.workunit.client.0.smithi117.stdout:7/469: write d0/d13/f40 [2717817,35541] 0 2024-04-12T09:11:14.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:13 smithi117 ceph-mon[29277]: pgmap v17: 65 pgs: 65 active+clean; 1.2 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 34 MiB/s rd, 148 MiB/s wr, 431 op/s 2024-04-12T09:11:14.161 INFO:tasks.workunit.client.0.smithi117.stdout:3/838: getdents de/d2c/d59/d70/d3e/d5d/d80/d97 0 2024-04-12T09:11:14.165 INFO:tasks.workunit.client.0.smithi117.stdout:0/745: creat d3/d59/d6a/d84/dc2/ffb x:0 0 0 2024-04-12T09:11:14.166 INFO:tasks.workunit.client.0.smithi117.stdout:0/746: stat d3/da2/dee/d76/lbd 0 2024-04-12T09:11:14.174 INFO:tasks.workunit.client.0.smithi117.stdout:0/747: rename d3/dc/c1c to d3/d59/d6a/d84/dc2/cfc 0 2024-04-12T09:11:14.175 INFO:tasks.workunit.client.0.smithi117.stdout:0/748: dread - d3/da2/dee/d76/d83/ff4 zero size 2024-04-12T09:11:14.179 INFO:tasks.workunit.client.0.smithi117.stdout:3/839: dread de/d2c/d59/d70/d3e/d3f/f51 [0,4194304] 0 2024-04-12T09:11:14.181 INFO:tasks.workunit.client.0.smithi117.stdout:5/635: creat d2/d3/de/fc0 x:0 0 0 2024-04-12T09:11:14.183 INFO:tasks.workunit.client.0.smithi117.stdout:0/749: chown d3/da2/dee/d76/d85/dab/cb0 10264 1 2024-04-12T09:11:14.184 INFO:tasks.workunit.client.0.smithi117.stdout:0/750: write d3/d47/f79 [2987986,65326] 0 2024-04-12T09:11:14.186 INFO:tasks.workunit.client.0.smithi117.stdout:7/470: rename d0/d2/d45/d17/d23/d50/l34 to d0/d2/d12/l8d 0 2024-04-12T09:11:14.187 INFO:tasks.workunit.client.0.smithi117.stdout:3/840: dwrite de/d2c/d59/d70/d40/fec [0,4194304] 0 2024-04-12T09:11:14.196 INFO:tasks.workunit.client.0.smithi117.stdout:5/636: rename d2/d3/de/d1e/d35/l9f to d2/d3/dd/d39/d83/d4d/lc1 0 2024-04-12T09:11:14.197 INFO:tasks.workunit.client.0.smithi117.stdout:8/547: write db/d13/d38/f5c [829874,15485] 0 2024-04-12T09:11:14.198 INFO:tasks.workunit.client.0.smithi117.stdout:7/471: symlink d0/da/l8e 0 2024-04-12T09:11:14.205 INFO:tasks.workunit.client.0.smithi117.stdout:8/548: fsync db/d1b/d55/f56 0 2024-04-12T09:11:14.211 INFO:tasks.workunit.client.0.smithi117.stdout:0/751: dread d3/d59/d6a/d91/f45 [0,4194304] 0 2024-04-12T09:11:14.212 INFO:tasks.workunit.client.0.smithi117.stdout:8/549: dwrite db/d13/d38/d86/f94 [0,4194304] 0 2024-04-12T09:11:14.213 INFO:tasks.workunit.client.0.smithi117.stdout:0/752: read d3/da2/dee/d76/f9c [1281218,890] 0 2024-04-12T09:11:14.216 INFO:tasks.workunit.client.0.smithi117.stdout:0/753: stat d3/da2/dee/d76/d85/fad 0 2024-04-12T09:11:14.224 INFO:tasks.workunit.client.0.smithi117.stdout:0/754: mknod d3/da2/dee/d76/d83/da8/d97/cfd 0 2024-04-12T09:11:14.228 INFO:tasks.workunit.client.0.smithi117.stdout:7/472: rename d0/da/l8e to d0/d2/d45/d17/l8f 0 2024-04-12T09:11:14.229 INFO:tasks.workunit.client.0.smithi117.stdout:3/841: link de/d2c/d59/l1d de/d2c/l13e 0 2024-04-12T09:11:14.230 INFO:tasks.workunit.client.0.smithi117.stdout:3/842: write de/d2c/d59/d19/d27/f108 [510409,92432] 0 2024-04-12T09:11:14.231 INFO:tasks.workunit.client.0.smithi117.stdout:8/550: mkdir db/d19/d1a/db7 0 2024-04-12T09:11:14.232 INFO:tasks.workunit.client.0.smithi117.stdout:8/551: read db/d13/d38/f5c [607916,49396] 0 2024-04-12T09:11:14.234 INFO:tasks.workunit.client.0.smithi117.stdout:7/473: chown d0/d2/d45/d17/d23/d51/f87 0 1 2024-04-12T09:11:14.235 INFO:tasks.workunit.client.0.smithi117.stdout:7/474: chown d0/d13/f8a 272800 1 2024-04-12T09:11:14.282 INFO:tasks.workunit.client.0.smithi117.stdout:1/513: sync 2024-04-12T09:11:14.282 INFO:tasks.workunit.client.0.smithi117.stdout:5/637: dwrite d2/d3/f15 [0,4194304] 0 2024-04-12T09:11:14.285 INFO:tasks.workunit.client.0.smithi117.stdout:3/843: creat de/def/f13f x:0 0 0 2024-04-12T09:11:14.288 INFO:tasks.workunit.client.0.smithi117.stdout:7/475: read d0/d2/d45/f42 [782214,77656] 0 2024-04-12T09:11:14.292 INFO:tasks.workunit.client.0.smithi117.stdout:8/552: mknod db/d13/d38/d46/cb8 0 2024-04-12T09:11:14.299 INFO:tasks.workunit.client.0.smithi117.stdout:5/638: mkdir d2/d3/de/d1e/d66/dc2 0 2024-04-12T09:11:14.307 INFO:tasks.workunit.client.0.smithi117.stdout:8/553: unlink db/d13/l4a 0 2024-04-12T09:11:14.307 INFO:tasks.workunit.client.0.smithi117.stdout:3/844: dread de/f15 [0,4194304] 0 2024-04-12T09:11:14.308 INFO:tasks.workunit.client.0.smithi117.stdout:1/514: dread d1/d6/d3f/db/f73 [0,4194304] 0 2024-04-12T09:11:14.312 INFO:tasks.workunit.client.0.smithi117.stdout:0/755: truncate d3/d59/d6a/d91/d94/d5a/f5d 114656 0 2024-04-12T09:11:14.314 INFO:tasks.workunit.client.0.smithi117.stdout:5/639: dread d2/d3/dd/d39/d7a/f6f [0,4194304] 0 2024-04-12T09:11:14.316 INFO:tasks.workunit.client.0.smithi117.stdout:8/554: chown db/d13/d38/f58 49526466 1 2024-04-12T09:11:14.319 INFO:tasks.workunit.client.0.smithi117.stdout:3/845: creat de/d2c/d59/d4c/da0/daa/f140 x:0 0 0 2024-04-12T09:11:14.320 INFO:tasks.workunit.client.0.smithi117.stdout:3/846: write de/d2c/d59/d70/d3e/d5d/f46 [1657913,11707] 0 2024-04-12T09:11:14.322 INFO:tasks.workunit.client.0.smithi117.stdout:0/756: chown d3/d59/d6a/d91/d94/d5a/d62/d66/d73/fe8 877520842 1 2024-04-12T09:11:14.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:13 smithi203 ceph-mon[36428]: pgmap v17: 65 pgs: 65 active+clean; 1.2 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 34 MiB/s rd, 148 MiB/s wr, 431 op/s 2024-04-12T09:11:14.324 INFO:tasks.workunit.client.0.smithi117.stdout:1/515: dread d1/f40 [4194304,4194304] 0 2024-04-12T09:11:14.325 INFO:tasks.workunit.client.0.smithi117.stdout:5/640: creat d2/d3/dd/d39/d83/d4d/d6b/fc3 x:0 0 0 2024-04-12T09:11:14.327 INFO:tasks.workunit.client.0.smithi117.stdout:8/555: creat db/d13/d38/d86/fb9 x:0 0 0 2024-04-12T09:11:14.329 INFO:tasks.workunit.client.0.smithi117.stdout:0/757: unlink d3/d47/fcc 0 2024-04-12T09:11:14.334 INFO:tasks.workunit.client.0.smithi117.stdout:7/476: rename d0/d2/d1a/c8c to d0/d2/d45/d17/d23/c90 0 2024-04-12T09:11:14.338 INFO:tasks.workunit.client.0.smithi117.stdout:1/516: creat d1/d6/d3f/db/f9e x:0 0 0 2024-04-12T09:11:14.338 INFO:tasks.workunit.client.0.smithi117.stdout:1/517: readlink d1/l6b 0 2024-04-12T09:11:14.340 INFO:tasks.workunit.client.0.smithi117.stdout:8/556: dread db/f30 [0,4194304] 0 2024-04-12T09:11:14.344 INFO:tasks.workunit.client.0.smithi117.stdout:5/641: dwrite d2/d3/dd/d39/d7a/f6f [0,4194304] 0 2024-04-12T09:11:14.346 INFO:tasks.workunit.client.0.smithi117.stdout:3/847: mknod de/d2c/d59/d70/d3e/d5d/d89/d123/c141 0 2024-04-12T09:11:14.352 INFO:tasks.workunit.client.0.smithi117.stdout:1/518: creat d1/d6/f9f x:0 0 0 2024-04-12T09:11:14.354 INFO:tasks.workunit.client.0.smithi117.stdout:8/557: fsync db/da6/fad 0 2024-04-12T09:11:14.355 INFO:tasks.workunit.client.0.smithi117.stdout:1/519: dread d1/d3b/f8f [0,4194304] 0 2024-04-12T09:11:14.359 INFO:tasks.workunit.client.0.smithi117.stdout:1/520: dwrite d1/d6/d3f/d90/d9a/f2e [0,4194304] 0 2024-04-12T09:11:14.360 INFO:tasks.workunit.client.0.smithi117.stdout:5/642: creat d2/d3/dd/d39/d83/fc4 x:0 0 0 2024-04-12T09:11:14.365 INFO:tasks.workunit.client.0.smithi117.stdout:3/848: fdatasync de/d2c/d59/d70/d3e/d84/f9d 0 2024-04-12T09:11:14.368 INFO:tasks.workunit.client.0.smithi117.stdout:0/758: rename d3/d59/d6a/d91/f8d to d3/d30/dc8/ffe 0 2024-04-12T09:11:14.375 INFO:tasks.workunit.client.0.smithi117.stdout:0/759: dwrite d3/d59/d6a/d84/fef [0,4194304] 0 2024-04-12T09:11:14.375 INFO:tasks.workunit.client.0.smithi117.stdout:8/558: fdatasync db/d19/d1a/f21 0 2024-04-12T09:11:14.377 INFO:tasks.workunit.client.0.smithi117.stdout:7/477: dwrite d0/d2/d45/f28 [0,4194304] 0 2024-04-12T09:11:14.377 INFO:tasks.workunit.client.0.smithi117.stdout:8/559: fdatasync db/d13/d38/d86/f8b 0 2024-04-12T09:11:14.379 INFO:tasks.workunit.client.0.smithi117.stdout:0/760: chown d3/d59/d6a/d91/d94/d5a/d62/ff6 1829780 1 2024-04-12T09:11:14.384 INFO:tasks.workunit.client.0.smithi117.stdout:5/643: mknod d2/d3/de/d1e/d66/dbe/cc5 0 2024-04-12T09:11:14.386 INFO:tasks.workunit.client.0.smithi117.stdout:8/560: dwrite db/d77/f97 [0,4194304] 0 2024-04-12T09:11:14.388 INFO:tasks.workunit.client.0.smithi117.stdout:8/561: chown db/d19/d1a/d3d/l37 746479 1 2024-04-12T09:11:14.388 INFO:tasks.workunit.client.0.smithi117.stdout:8/562: chown db/d13/d38/d46/f82 147040 1 2024-04-12T09:11:14.390 INFO:tasks.workunit.client.0.smithi117.stdout:3/849: unlink de/d2c/d59/d70/d3e/d84/f9d 0 2024-04-12T09:11:14.390 INFO:tasks.workunit.client.0.smithi117.stdout:8/563: write db/d19/d1a/f79 [453298,37719] 0 2024-04-12T09:11:14.394 INFO:tasks.workunit.client.0.smithi117.stdout:8/564: read db/d19/f52 [1503979,111284] 0 2024-04-12T09:11:14.399 INFO:tasks.workunit.client.0.smithi117.stdout:1/521: creat d1/d96/fa0 x:0 0 0 2024-04-12T09:11:14.401 INFO:tasks.workunit.client.0.smithi117.stdout:1/522: dread d1/d6/d3f/db/f73 [0,4194304] 0 2024-04-12T09:11:14.404 INFO:tasks.workunit.client.0.smithi117.stdout:3/850: read de/d2c/d59/d70/f85 [1671064,45616] 0 2024-04-12T09:11:14.406 INFO:tasks.workunit.client.0.smithi117.stdout:7/478: mkdir d0/d2/d45/d15/d6a/d91 0 2024-04-12T09:11:14.410 INFO:tasks.workunit.client.0.smithi117.stdout:1/523: symlink d1/d6/d3f/d90/d9a/d71/la1 0 2024-04-12T09:11:14.411 INFO:tasks.workunit.client.0.smithi117.stdout:1/524: write d1/d6/f9f [877431,65487] 0 2024-04-12T09:11:14.415 INFO:tasks.workunit.client.0.smithi117.stdout:8/565: unlink db/d19/f52 0 2024-04-12T09:11:14.418 INFO:tasks.workunit.client.0.smithi117.stdout:7/479: rename d0/d2/d45/f27 to d0/d2/d1a/d5f/f92 0 2024-04-12T09:11:14.420 INFO:tasks.workunit.client.0.smithi117.stdout:5/644: creat d2/fc6 x:0 0 0 2024-04-12T09:11:14.421 INFO:tasks.workunit.client.0.smithi117.stdout:8/566: dwrite db/fc [0,4194304] 0 2024-04-12T09:11:14.423 INFO:tasks.workunit.client.0.smithi117.stdout:5/645: read d2/d3/de/d1e/d35/f93 [1827692,31838] 0 2024-04-12T09:11:14.424 INFO:tasks.workunit.client.0.smithi117.stdout:5/646: chown d2/d3/dd/d39/l80 5627950 1 2024-04-12T09:11:14.425 INFO:tasks.workunit.client.0.smithi117.stdout:3/851: creat de/d2c/d59/d19/d4f/f142 x:0 0 0 2024-04-12T09:11:14.427 INFO:tasks.workunit.client.0.smithi117.stdout:9/531: sync 2024-04-12T09:11:14.427 INFO:tasks.workunit.client.0.smithi117.stdout:3/852: write de/d2c/d59/d70/d40/d79/ff7 [1193065,113980] 0 2024-04-12T09:11:14.430 INFO:tasks.workunit.client.0.smithi117.stdout:3/853: truncate de/d2c/d59/d4c/da0/fd0 574348 0 2024-04-12T09:11:14.431 INFO:tasks.workunit.client.0.smithi117.stdout:3/854: truncate de/f114 95719 0 2024-04-12T09:11:14.437 INFO:tasks.workunit.client.0.smithi117.stdout:9/532: mknod d1/d8/df/d7d/d7e/ca6 0 2024-04-12T09:11:14.438 INFO:tasks.workunit.client.0.smithi117.stdout:5/647: dwrite d2/d3/de/d1e/d35/f93 [0,4194304] 0 2024-04-12T09:11:14.439 INFO:tasks.workunit.client.0.smithi117.stdout:7/480: symlink d0/d2/d45/d15/d6a/d91/l93 0 2024-04-12T09:11:14.440 INFO:tasks.workunit.client.0.smithi117.stdout:5/648: chown d2/d3/de/d1e/d99/cb5 34141474 1 2024-04-12T09:11:14.445 INFO:tasks.workunit.client.0.smithi117.stdout:9/533: creat d1/d8/df/d26/d41/fa7 x:0 0 0 2024-04-12T09:11:14.448 INFO:tasks.workunit.client.0.smithi117.stdout:7/481: symlink d0/d20/d4a/l94 0 2024-04-12T09:11:14.451 INFO:tasks.workunit.client.0.smithi117.stdout:1/525: dwrite d1/f65 [0,4194304] 0 2024-04-12T09:11:14.457 INFO:tasks.workunit.client.0.smithi117.stdout:8/567: getdents db/d13/d38/d46 0 2024-04-12T09:11:14.458 INFO:tasks.workunit.client.0.smithi117.stdout:8/568: chown db/d19/d1a/f26 150 1 2024-04-12T09:11:14.463 INFO:tasks.workunit.client.0.smithi117.stdout:3/855: creat de/d2c/d59/f143 x:0 0 0 2024-04-12T09:11:14.464 INFO:tasks.workunit.client.0.smithi117.stdout:9/534: creat d1/d8/d52/d99/fa8 x:0 0 0 2024-04-12T09:11:14.465 INFO:tasks.workunit.client.0.smithi117.stdout:1/526: dread d1/d6/d3f/f61 [0,4194304] 0 2024-04-12T09:11:14.466 INFO:tasks.workunit.client.0.smithi117.stdout:5/649: unlink d2/d3/dd/d39/d83/f68 0 2024-04-12T09:11:14.467 INFO:tasks.workunit.client.0.smithi117.stdout:5/650: dread - d2/d3/de/d1e/d66/fbc zero size 2024-04-12T09:11:14.470 INFO:tasks.workunit.client.0.smithi117.stdout:8/569: rmdir db/d19 39 2024-04-12T09:11:14.474 INFO:tasks.workunit.client.0.smithi117.stdout:3/856: mknod de/d2c/d59/d70/d3e/d5d/d111/c144 0 2024-04-12T09:11:14.475 INFO:tasks.workunit.client.0.smithi117.stdout:1/527: symlink d1/d96/la2 0 2024-04-12T09:11:14.477 INFO:tasks.workunit.client.0.smithi117.stdout:7/482: dwrite d0/d2/d45/d17/d23/d39/f48 [0,4194304] 0 2024-04-12T09:11:14.479 INFO:tasks.workunit.client.0.smithi117.stdout:1/528: write d1/d6/d3f/db/f9e [968166,104214] 0 2024-04-12T09:11:14.479 INFO:tasks.workunit.client.0.smithi117.stdout:5/651: chown d2/d3/dd/f3c 39302179 1 2024-04-12T09:11:14.480 INFO:tasks.workunit.client.0.smithi117.stdout:1/529: stat d1/d6/d3f/db 0 2024-04-12T09:11:14.482 INFO:tasks.workunit.client.0.smithi117.stdout:3/857: creat de/d2c/d59/d70/d3e/d3f/f145 x:0 0 0 2024-04-12T09:11:14.482 INFO:tasks.workunit.client.0.smithi117.stdout:8/570: truncate db/d19/f8d 321925 0 2024-04-12T09:11:14.488 INFO:tasks.workunit.client.0.smithi117.stdout:9/535: dread d1/d8/df/d39/d3b/f4c [0,4194304] 0 2024-04-12T09:11:14.489 INFO:tasks.workunit.client.0.smithi117.stdout:5/652: dwrite d2/d3/dd/d39/f61 [4194304,4194304] 0 2024-04-12T09:11:14.492 INFO:tasks.workunit.client.0.smithi117.stdout:7/483: rename d0/d2/d45/d17/d7a/l89 to d0/d2/d1a/d4f/l95 0 2024-04-12T09:11:14.495 INFO:tasks.workunit.client.0.smithi117.stdout:5/653: mknod d2/d3/dd/d39/d82/cc7 0 2024-04-12T09:11:14.497 INFO:tasks.workunit.client.0.smithi117.stdout:9/536: creat d1/d8/d5a/d6e/d71/fa9 x:0 0 0 2024-04-12T09:11:14.498 INFO:tasks.workunit.client.0.smithi117.stdout:9/537: write d1/d24/f57 [3060202,91903] 0 2024-04-12T09:11:14.500 INFO:tasks.workunit.client.0.smithi117.stdout:3/858: rename de/d2c/d59/d19/d27/f108 to de/d2c/d59/d4c/da0/daa/f146 0 2024-04-12T09:11:14.503 INFO:tasks.workunit.client.0.smithi117.stdout:7/484: mkdir d0/d2/d96 0 2024-04-12T09:11:14.509 INFO:tasks.workunit.client.0.smithi117.stdout:1/530: dwrite d1/d6/d3f/db/d1d/f5b [0,4194304] 0 2024-04-12T09:11:14.509 INFO:tasks.workunit.client.0.smithi117.stdout:9/538: mknod d1/d4b/caa 0 2024-04-12T09:11:14.510 INFO:tasks.workunit.client.0.smithi117.stdout:8/571: dwrite db/f30 [0,4194304] 0 2024-04-12T09:11:14.511 INFO:tasks.workunit.client.0.smithi117.stdout:9/539: readlink d1/d8/d5a/d79/d91/la1 0 2024-04-12T09:11:14.511 INFO:tasks.workunit.client.0.smithi117.stdout:3/859: dread de/d2c/d59/f24 [0,4194304] 0 2024-04-12T09:11:14.512 INFO:tasks.workunit.client.0.smithi117.stdout:7/485: symlink d0/d2/d12/l97 0 2024-04-12T09:11:14.514 INFO:tasks.workunit.client.0.smithi117.stdout:5/654: rmdir d2/d3/dd/da1 0 2024-04-12T09:11:14.521 INFO:tasks.workunit.client.0.smithi117.stdout:9/540: unlink d1/d8/df/d3e/f9b 0 2024-04-12T09:11:14.521 INFO:tasks.workunit.client.0.smithi117.stdout:3/860: readlink de/d2c/d59/d19/l25 0 2024-04-12T09:11:14.529 INFO:tasks.workunit.client.0.smithi117.stdout:9/541: rename d1/d8/df/d3e/l31 to d1/d8/d5a/lab 0 2024-04-12T09:11:14.530 INFO:tasks.workunit.client.0.smithi117.stdout:3/861: creat de/d2c/d59/d70/d3e/d5d/db5/f147 x:0 0 0 2024-04-12T09:11:14.532 INFO:tasks.workunit.client.0.smithi117.stdout:7/486: mkdir d0/d2/d96/d98 0 2024-04-12T09:11:14.533 INFO:tasks.workunit.client.0.smithi117.stdout:1/531: creat d1/fa3 x:0 0 0 2024-04-12T09:11:14.533 INFO:tasks.workunit.client.0.smithi117.stdout:7/487: write d0/d2/f6f [1936371,20876] 0 2024-04-12T09:11:14.534 INFO:tasks.workunit.client.0.smithi117.stdout:5/655: mkdir d2/d3/dd/d39/d83/dc8 0 2024-04-12T09:11:14.534 INFO:tasks.workunit.client.0.smithi117.stdout:1/532: chown d1/d64/c46 270622326 1 2024-04-12T09:11:14.535 INFO:tasks.workunit.client.0.smithi117.stdout:8/572: rmdir db/d13/d38/d86/da7 0 2024-04-12T09:11:14.538 INFO:tasks.workunit.client.0.smithi117.stdout:3/862: creat de/d2c/d59/d70/d3e/d5d/d80/d82/f148 x:0 0 0 2024-04-12T09:11:14.539 INFO:tasks.workunit.client.0.smithi117.stdout:7/488: chown d0/d2/d45/d17/f31 22343810 1 2024-04-12T09:11:14.540 INFO:tasks.workunit.client.0.smithi117.stdout:3/863: write de/d2c/d59/d70/d3e/d5d/db5/fd2 [8265979,82276] 0 2024-04-12T09:11:14.544 INFO:tasks.workunit.client.0.smithi117.stdout:9/542: creat d1/d8/df/d3e/d92/fac x:0 0 0 2024-04-12T09:11:14.545 INFO:tasks.workunit.client.0.smithi117.stdout:9/543: chown d1/d8/d5a/c76 12108273 1 2024-04-12T09:11:14.546 INFO:tasks.workunit.client.0.smithi117.stdout:9/544: chown d1/d8/df/l48 122 1 2024-04-12T09:11:14.548 INFO:tasks.workunit.client.0.smithi117.stdout:7/489: dwrite d0/d2/d45/d17/d23/d50/d5c/f79 [0,4194304] 0 2024-04-12T09:11:14.550 INFO:tasks.workunit.client.0.smithi117.stdout:1/533: rename d1/d64/d45/d4c/d63/f97 to d1/d6/d3f/d72/fa4 0 2024-04-12T09:11:14.553 INFO:tasks.workunit.client.0.smithi117.stdout:5/656: mknod d2/d3/dd/d39/d83/d4d/cc9 0 2024-04-12T09:11:14.563 INFO:tasks.workunit.client.0.smithi117.stdout:7/490: chown d0/d2/d1a/d4f/l95 115251 1 2024-04-12T09:11:14.564 INFO:tasks.workunit.client.0.smithi117.stdout:1/534: creat d1/d6/d3f/fa5 x:0 0 0 2024-04-12T09:11:14.568 INFO:tasks.workunit.client.0.smithi117.stdout:3/864: mkdir de/d2c/d59/d70/d3d/d63/de1/d125/d149 0 2024-04-12T09:11:14.568 INFO:tasks.workunit.client.0.smithi117.stdout:3/865: read - de/d2c/f96 zero size 2024-04-12T09:11:14.569 INFO:tasks.workunit.client.0.smithi117.stdout:5/657: mknod d2/d3/dd/d39/d83/d4d/d6b/da5/cca 0 2024-04-12T09:11:14.573 INFO:tasks.workunit.client.0.smithi117.stdout:1/535: truncate d1/d6/d51/f5a 423645 0 2024-04-12T09:11:14.573 INFO:tasks.workunit.client.0.smithi117.stdout:6/583: sync 2024-04-12T09:11:14.574 INFO:tasks.workunit.client.0.smithi117.stdout:1/536: chown d1/d6/d3f/db/f39 2997695 1 2024-04-12T09:11:14.574 INFO:tasks.workunit.client.0.smithi117.stdout:6/584: write d8/d9/f1f [4324824,124357] 0 2024-04-12T09:11:14.580 INFO:tasks.workunit.client.0.smithi117.stdout:5/658: rmdir d2/d3/dd/d39/d83/d4d/d6b/da5 39 2024-04-12T09:11:14.580 INFO:tasks.workunit.client.0.smithi117.stdout:9/545: rmdir d1/d8/df 39 2024-04-12T09:11:14.582 INFO:tasks.workunit.client.0.smithi117.stdout:8/573: link db/d19/d1a/d3d/l37 db/lba 0 2024-04-12T09:11:14.583 INFO:tasks.workunit.client.0.smithi117.stdout:3/866: rmdir de/d2c/d59 39 2024-04-12T09:11:14.589 INFO:tasks.workunit.client.0.smithi117.stdout:1/537: rmdir d1 39 2024-04-12T09:11:14.590 INFO:tasks.workunit.client.0.smithi117.stdout:7/491: truncate d0/d2/d45/d17/f31 1649670 0 2024-04-12T09:11:14.592 INFO:tasks.workunit.client.0.smithi117.stdout:6/585: rename d8/d3a/d49/da4/cb5 to d8/d9/d17/d2d/cbe 0 2024-04-12T09:11:14.600 INFO:tasks.workunit.client.0.smithi117.stdout:6/586: fsync d8/d3a/d49/f4e 0 2024-04-12T09:11:14.602 INFO:tasks.workunit.client.0.smithi117.stdout:6/587: read d8/f1e [2469818,39656] 0 2024-04-12T09:11:14.603 INFO:tasks.workunit.client.0.smithi117.stdout:5/659: symlink d2/d3/dd/d39/d83/lcb 0 2024-04-12T09:11:14.604 INFO:tasks.workunit.client.0.smithi117.stdout:9/546: rmdir d1/d8/df/d7d 39 2024-04-12T09:11:14.605 INFO:tasks.workunit.client.0.smithi117.stdout:9/547: readlink d1/d8/df/d26/d41/l58 0 2024-04-12T09:11:14.606 INFO:tasks.workunit.client.0.smithi117.stdout:8/574: dwrite db/da6/fad [0,4194304] 0 2024-04-12T09:11:14.608 INFO:tasks.workunit.client.0.smithi117.stdout:3/867: mknod de/d2c/d59/d70/d40/d49/c14a 0 2024-04-12T09:11:14.611 INFO:tasks.workunit.client.0.smithi117.stdout:6/588: readlink d8/l27 0 2024-04-12T09:11:14.611 INFO:tasks.workunit.client.0.smithi117.stdout:3/868: truncate de/d2c/d59/d70/d3e/d3f/fd3 727271 0 2024-04-12T09:11:14.621 INFO:tasks.workunit.client.0.smithi117.stdout:5/660: dread d2/f6 [0,4194304] 0 2024-04-12T09:11:14.622 INFO:tasks.workunit.client.0.smithi117.stdout:9/548: truncate d1/d8/df/d26/f3c 3030167 0 2024-04-12T09:11:14.627 INFO:tasks.workunit.client.0.smithi117.stdout:6/589: fsync d8/fc 0 2024-04-12T09:11:14.627 INFO:tasks.workunit.client.0.smithi117.stdout:1/538: write d1/f77 [833640,64197] 0 2024-04-12T09:11:14.631 INFO:tasks.workunit.client.0.smithi117.stdout:3/869: write de/d2c/d59/d70/d3e/f86 [1171516,32115] 0 2024-04-12T09:11:14.631 INFO:tasks.workunit.client.0.smithi117.stdout:4/586: sync 2024-04-12T09:11:14.632 INFO:tasks.workunit.client.0.smithi117.stdout:0/761: sync 2024-04-12T09:11:14.632 INFO:tasks.workunit.client.0.smithi117.stdout:2/495: sync 2024-04-12T09:11:14.633 INFO:tasks.workunit.client.0.smithi117.stdout:9/549: dwrite d1/d8/df/d26/f46 [4194304,4194304] 0 2024-04-12T09:11:14.636 INFO:tasks.workunit.client.0.smithi117.stdout:8/575: creat db/d4b/d9a/fbb x:0 0 0 2024-04-12T09:11:14.638 INFO:tasks.workunit.client.0.smithi117.stdout:9/550: dread - d1/d24/f8b zero size 2024-04-12T09:11:14.638 INFO:tasks.workunit.client.0.smithi117.stdout:3/870: fsync de/def/f124 0 2024-04-12T09:11:14.639 INFO:tasks.workunit.client.0.smithi117.stdout:5/661: mkdir d2/d3/dd/d39/d83/d4d/d6b/dcc 0 2024-04-12T09:11:14.640 INFO:tasks.workunit.client.0.smithi117.stdout:7/492: dwrite d0/d2/d45/d17/f31 [0,4194304] 0 2024-04-12T09:11:14.641 INFO:tasks.workunit.client.0.smithi117.stdout:1/539: symlink d1/d64/d45/d4c/la6 0 2024-04-12T09:11:14.645 INFO:tasks.workunit.client.0.smithi117.stdout:9/551: write d1/d8/d52/f9d [955898,6003] 0 2024-04-12T09:11:14.646 INFO:tasks.workunit.client.0.smithi117.stdout:6/590: rename d8/d2a/d60/d89/d9c to d8/d2a/d60/d7d/dbf 0 2024-04-12T09:11:14.652 INFO:tasks.workunit.client.0.smithi117.stdout:0/762: dwrite d3/d59/d6a/d84/dc2/ffb [0,4194304] 0 2024-04-12T09:11:14.653 INFO:tasks.workunit.client.0.smithi117.stdout:4/587: dwrite d0/d2c/f30 [4194304,4194304] 0 2024-04-12T09:11:14.654 INFO:tasks.workunit.client.0.smithi117.stdout:0/763: fdatasync d3/d47/f79 0 2024-04-12T09:11:14.656 INFO:tasks.workunit.client.0.smithi117.stdout:1/540: mkdir d1/d6/d3f/db/d1d/d78/da7 0 2024-04-12T09:11:14.657 INFO:tasks.workunit.client.0.smithi117.stdout:7/493: mknod d0/d2/d45/d17/d23/d39/d6c/c99 0 2024-04-12T09:11:14.661 INFO:tasks.workunit.client.0.smithi117.stdout:0/764: write d3/d59/d6a/d91/f45 [1820278,23141] 0 2024-04-12T09:11:14.662 INFO:tasks.workunit.client.0.smithi117.stdout:0/765: chown d3/d59/f6d 4126787 1 2024-04-12T09:11:14.662 INFO:tasks.workunit.client.0.smithi117.stdout:4/588: creat d0/d2c/d67/fc5 x:0 0 0 2024-04-12T09:11:14.664 INFO:tasks.workunit.client.0.smithi117.stdout:8/576: creat db/d4b/fbc x:0 0 0 2024-04-12T09:11:14.666 INFO:tasks.workunit.client.0.smithi117.stdout:3/871: truncate de/d2c/d59/d70/d3e/d5d/d80/d97/d9a/ff4 138704 0 2024-04-12T09:11:14.670 INFO:tasks.workunit.client.0.smithi117.stdout:3/872: fdatasync de/d2c/d59/d70/f115 0 2024-04-12T09:11:14.671 INFO:tasks.workunit.client.0.smithi117.stdout:5/662: creat d2/d3/de/d1e/d46/fcd x:0 0 0 2024-04-12T09:11:14.671 INFO:tasks.workunit.client.0.smithi117.stdout:5/663: dread - d2/d3/de/fc0 zero size 2024-04-12T09:11:14.671 INFO:tasks.workunit.client.0.smithi117.stdout:7/494: mkdir d0/d2/d1a/d4f/d9a 0 2024-04-12T09:11:14.671 INFO:tasks.workunit.client.0.smithi117.stdout:1/541: chown d1/d6/d3f/db/d1d/l92 20 1 2024-04-12T09:11:14.672 INFO:tasks.workunit.client.0.smithi117.stdout:1/542: read - d1/d6/d3f/db/d16/f8b zero size 2024-04-12T09:11:14.673 INFO:tasks.workunit.client.0.smithi117.stdout:1/543: stat d1/d6/d3f/db/d16/c42 0 2024-04-12T09:11:14.675 INFO:tasks.workunit.client.0.smithi117.stdout:4/589: creat d0/d5/d25/fc6 x:0 0 0 2024-04-12T09:11:14.676 INFO:tasks.workunit.client.0.smithi117.stdout:2/496: getdents d0/d43/d53/d61/d66 0 2024-04-12T09:11:14.677 INFO:tasks.workunit.client.0.smithi117.stdout:2/497: chown d0/d4/f54 7384919 1 2024-04-12T09:11:14.680 INFO:tasks.workunit.client.0.smithi117.stdout:3/873: rmdir de/d2c/d59/d70/d3e/d5d/d80/d97/d9a 39 2024-04-12T09:11:14.682 INFO:tasks.workunit.client.0.smithi117.stdout:5/664: chown d2/d3/dd/f90 169 1 2024-04-12T09:11:14.682 INFO:tasks.workunit.client.0.smithi117.stdout:5/665: chown d2/f19 104768895 1 2024-04-12T09:11:14.684 INFO:tasks.workunit.client.0.smithi117.stdout:6/591: link d8/d3a/d49/l73 d8/d9/d17/d2d/lc0 0 2024-04-12T09:11:14.685 INFO:tasks.workunit.client.0.smithi117.stdout:0/766: dread d3/d59/d6a/d91/d94/d5a/fc5 [0,4194304] 0 2024-04-12T09:11:14.687 INFO:tasks.workunit.client.0.smithi117.stdout:3/874: dread de/d2c/d59/d70/d40/d79/f8a [0,4194304] 0 2024-04-12T09:11:14.687 INFO:tasks.workunit.client.0.smithi117.stdout:2/498: creat d0/d4/d10/d27/fa7 x:0 0 0 2024-04-12T09:11:14.692 INFO:tasks.workunit.client.0.smithi117.stdout:5/666: creat d2/d3/dd/d39/d7a/fce x:0 0 0 2024-04-12T09:11:14.693 INFO:tasks.workunit.client.0.smithi117.stdout:9/552: dread d1/d24/fa5 [0,4194304] 0 2024-04-12T09:11:14.695 INFO:tasks.workunit.client.0.smithi117.stdout:6/592: mkdir d8/d9/d17/d2d/dc1 0 2024-04-12T09:11:14.697 INFO:tasks.workunit.client.0.smithi117.stdout:6/593: chown d8/d2a/d60/d89/fbb 3580203 1 2024-04-12T09:11:14.701 INFO:tasks.workunit.client.0.smithi117.stdout:8/577: dwrite db/d13/f9f [0,4194304] 0 2024-04-12T09:11:14.703 INFO:tasks.workunit.client.0.smithi117.stdout:0/767: rename d3/d59/d6a to d3/da2/dee/dd5/dff 0 2024-04-12T09:11:14.704 INFO:tasks.workunit.client.0.smithi117.stdout:1/544: write d1/d64/d45/d4c/d63/f8c [2954812,122937] 0 2024-04-12T09:11:14.707 INFO:tasks.workunit.client.0.smithi117.stdout:7/495: dwrite d0/da/f2d [0,4194304] 0 2024-04-12T09:11:14.709 INFO:tasks.workunit.client.0.smithi117.stdout:6/594: dread d8/d9/f19 [0,4194304] 0 2024-04-12T09:11:14.709 INFO:tasks.workunit.client.0.smithi117.stdout:8/578: write db/d19/d1a/d3d/d60/f88 [366649,116949] 0 2024-04-12T09:11:14.712 INFO:tasks.workunit.client.0.smithi117.stdout:8/579: write db/da6/fad [250052,40756] 0 2024-04-12T09:11:14.712 INFO:tasks.workunit.client.0.smithi117.stdout:0/768: write d3/da2/dee/d76/f9c [1215208,9569] 0 2024-04-12T09:11:14.712 INFO:tasks.workunit.client.0.smithi117.stdout:2/499: chown d0/d43/d30/f5c 3413893 1 2024-04-12T09:11:14.714 INFO:tasks.workunit.client.0.smithi117.stdout:0/769: dread - d3/da2/dee/dd5/dff/d91/d94/d5a/d62/d66/fda zero size 2024-04-12T09:11:14.719 INFO:tasks.workunit.client.0.smithi117.stdout:3/875: write de/d2c/d59/d70/d3e/f5a [309664,1867] 0 2024-04-12T09:11:14.719 INFO:tasks.workunit.client.0.smithi117.stdout:4/590: link d0/d1/fbd d0/d5/d43/da0/fc7 0 2024-04-12T09:11:14.728 INFO:tasks.workunit.client.0.smithi117.stdout:0/770: mknod d3/da2/dee/dd5/dff/d84/dc2/c100 0 2024-04-12T09:11:14.729 INFO:tasks.workunit.client.0.smithi117.stdout:9/553: rename d1/d8/df/d26/d41/l58 to d1/d8/df/d7d/d7e/lad 0 2024-04-12T09:11:14.731 INFO:tasks.workunit.client.0.smithi117.stdout:4/591: chown d0/d2c/f93 1396479 1 2024-04-12T09:11:14.732 INFO:tasks.workunit.client.0.smithi117.stdout:0/771: truncate d3/da2/dee/dd5/dff/d91/d94/d5a/d62/d66/d73/fbb 265973 0 2024-04-12T09:11:14.733 INFO:tasks.workunit.client.0.smithi117.stdout:7/496: write d0/d2/d45/d17/f44 [1305540,46346] 0 2024-04-12T09:11:14.735 INFO:tasks.workunit.client.0.smithi117.stdout:7/497: stat d0/d2/f6f 0 2024-04-12T09:11:14.740 INFO:tasks.workunit.client.0.smithi117.stdout:1/545: rename d1/d6/d3f/db/d1d/l92 to d1/d6/d3f/db/d1d/la8 0 2024-04-12T09:11:14.741 INFO:tasks.workunit.client.0.smithi117.stdout:1/546: fdatasync d1/d64/d45/f50 0 2024-04-12T09:11:14.744 INFO:tasks.workunit.client.0.smithi117.stdout:8/580: creat db/d19/d1a/d3d/fbd x:0 0 0 2024-04-12T09:11:14.746 INFO:tasks.workunit.client.0.smithi117.stdout:2/500: creat d0/d4/d10/fa8 x:0 0 0 2024-04-12T09:11:14.747 INFO:tasks.workunit.client.0.smithi117.stdout:5/667: dread d2/d3/dd/f17 [0,4194304] 0 2024-04-12T09:11:14.749 INFO:tasks.workunit.client.0.smithi117.stdout:7/498: mkdir d0/da/d9b 0 2024-04-12T09:11:14.750 INFO:tasks.workunit.client.0.smithi117.stdout:1/547: dwrite d1/d96/fa0 [0,4194304] 0 2024-04-12T09:11:14.750 INFO:tasks.workunit.client.0.smithi117.stdout:5/668: write d2/f91 [290384,13021] 0 2024-04-12T09:11:14.752 INFO:tasks.workunit.client.0.smithi117.stdout:9/554: dread d1/d8/df/d7d/d7e/f4f [0,4194304] 0 2024-04-12T09:11:14.754 INFO:tasks.workunit.client.0.smithi117.stdout:1/548: write d1/d6/d3f/db/d1d/d78/f58 [1112427,82133] 0 2024-04-12T09:11:14.756 INFO:tasks.workunit.client.0.smithi117.stdout:1/549: chown d1/d6/d3f/db/d1d/d78 0 1 2024-04-12T09:11:14.757 INFO:tasks.workunit.client.0.smithi117.stdout:0/772: fsync d3/da2/dee/dd5/dff/d91/fa9 0 2024-04-12T09:11:14.760 INFO:tasks.workunit.client.0.smithi117.stdout:1/550: readlink d1/d6/d3f/d90/d9a/d71/la1 0 2024-04-12T09:11:14.760 INFO:tasks.workunit.client.0.smithi117.stdout:2/501: symlink d0/d4/d81/la9 0 2024-04-12T09:11:14.762 INFO:tasks.workunit.client.0.smithi117.stdout:3/876: getdents de/d2c/d59/d70/d3d 0 2024-04-12T09:11:14.763 INFO:tasks.workunit.client.0.smithi117.stdout:4/592: dwrite d0/fb2 [4194304,4194304] 0 2024-04-12T09:11:14.765 INFO:tasks.workunit.client.0.smithi117.stdout:1/551: truncate d1/d6/d3f/db/f73 4837369 0 2024-04-12T09:11:14.767 INFO:tasks.workunit.client.0.smithi117.stdout:7/499: rename d0 to d0/d2/d45/d17/d23/d9c 22 2024-04-12T09:11:14.769 INFO:tasks.workunit.client.0.smithi117.stdout:9/555: fdatasync d1/f4 0 2024-04-12T09:11:14.772 INFO:tasks.workunit.client.0.smithi117.stdout:9/556: fdatasync d1/d8/df/d26/d41/fa7 0 2024-04-12T09:11:14.772 INFO:tasks.workunit.client.0.smithi117.stdout:2/502: dwrite d0/df/f93 [0,4194304] 0 2024-04-12T09:11:14.778 INFO:tasks.workunit.client.0.smithi117.stdout:5/669: dread d2/d3/de/d1e/f76 [0,4194304] 0 2024-04-12T09:11:14.780 INFO:tasks.workunit.client.0.smithi117.stdout:4/593: rename d0/d5/d43 to d0/d5/d25/dc8 0 2024-04-12T09:11:14.786 INFO:tasks.workunit.client.0.smithi117.stdout:2/503: rmdir d0/df 39 2024-04-12T09:11:14.791 INFO:tasks.workunit.client.0.smithi117.stdout:5/670: dwrite d2/d3/dd/d39/f3e [0,4194304] 0 2024-04-12T09:11:14.793 INFO:tasks.workunit.client.0.smithi117.stdout:9/557: creat d1/d8/d5a/d79/fae x:0 0 0 2024-04-12T09:11:14.795 INFO:tasks.workunit.client.0.smithi117.stdout:4/594: dwrite d0/d5/d39/da2/fb8 [0,4194304] 0 2024-04-12T09:11:14.797 INFO:tasks.workunit.client.0.smithi117.stdout:4/595: chown d0/d5/d39/d4e/c54 90121692 1 2024-04-12T09:11:14.800 INFO:tasks.workunit.client.0.smithi117.stdout:0/773: dwrite d3/da2/dee/dd5/dff/f75 [0,4194304] 0 2024-04-12T09:11:14.800 INFO:tasks.workunit.client.0.smithi117.stdout:3/877: rename de/d2c/d59/d70/d3d/f8c to de/def/f14b 0 2024-04-12T09:11:14.807 INFO:tasks.workunit.client.0.smithi117.stdout:0/774: fdatasync d3/da2/dee/dd5/dff/d84/dc2/fe1 0 2024-04-12T09:11:14.812 INFO:tasks.workunit.client.0.smithi117.stdout:8/581: link db/d19/d1a/d3d/f45 db/d19/d1a/d3d/d60/fbe 0 2024-04-12T09:11:14.812 INFO:tasks.workunit.client.0.smithi117.stdout:3/878: dwrite de/d2c/d59/f143 [0,4194304] 0 2024-04-12T09:11:14.814 INFO:tasks.workunit.client.0.smithi117.stdout:2/504: creat d0/d4/d10/d27/d9a/faa x:0 0 0 2024-04-12T09:11:14.816 INFO:tasks.workunit.client.0.smithi117.stdout:3/879: dread - de/d2c/d59/d30/f12e zero size 2024-04-12T09:11:14.817 INFO:tasks.workunit.client.0.smithi117.stdout:1/552: rename d1/d6/d3f/d90 to d1/d64/d45/d4c/d63/da9 0 2024-04-12T09:11:14.817 INFO:tasks.workunit.client.0.smithi117.stdout:3/880: readlink de/d2c/d59/d70/d3d/d63/lc9 0 2024-04-12T09:11:14.819 INFO:tasks.workunit.client.0.smithi117.stdout:1/553: chown d1/d6/d3f/d72/fa4 19 1 2024-04-12T09:11:14.820 INFO:tasks.workunit.client.0.smithi117.stdout:0/775: chown d3/cbe 16737 1 2024-04-12T09:11:14.821 INFO:tasks.workunit.client.0.smithi117.stdout:0/776: read d3/da2/dee/dd5/dff/d84/fef [2222208,44753] 0 2024-04-12T09:11:14.822 INFO:tasks.workunit.client.0.smithi117.stdout:0/777: fdatasync d3/f81 0 2024-04-12T09:11:14.829 INFO:tasks.workunit.client.0.smithi117.stdout:1/554: write d1/d6/f91 [8929101,96676] 0 2024-04-12T09:11:14.829 INFO:tasks.workunit.client.0.smithi117.stdout:0/778: read d3/da2/dee/f2d [1009560,55322] 0 2024-04-12T09:11:14.831 INFO:tasks.workunit.client.0.smithi117.stdout:0/779: write d3/d59/f6d [7456196,57151] 0 2024-04-12T09:11:14.833 INFO:tasks.workunit.client.0.smithi117.stdout:5/671: rename d2/f19 to d2/fcf 0 2024-04-12T09:11:14.838 INFO:tasks.workunit.client.0.smithi117.stdout:2/505: creat d0/df/fab x:0 0 0 2024-04-12T09:11:14.838 INFO:tasks.workunit.client.0.smithi117.stdout:2/506: chown d0/d43/d53/d61 6 1 2024-04-12T09:11:14.838 INFO:tasks.workunit.client.0.smithi117.stdout:4/596: rmdir d0/d5/d25/d9f/dbe 0 2024-04-12T09:11:14.841 INFO:tasks.workunit.client.0.smithi117.stdout:9/558: dread d1/d8/df/d39/d3b/f4a [0,4194304] 0 2024-04-12T09:11:14.843 INFO:tasks.workunit.client.0.smithi117.stdout:9/559: chown d1/d24/f2a 750 1 2024-04-12T09:11:14.844 INFO:tasks.workunit.client.0.smithi117.stdout:8/582: creat db/d13/d38/fbf x:0 0 0 2024-04-12T09:11:14.848 INFO:tasks.workunit.client.0.smithi117.stdout:9/560: dread d1/d8/df/d39/f98 [0,4194304] 0 2024-04-12T09:11:14.848 INFO:tasks.workunit.client.0.smithi117.stdout:1/555: mknod d1/d6/d3f/db/d16/caa 0 2024-04-12T09:11:14.850 INFO:tasks.workunit.client.0.smithi117.stdout:3/881: dwrite de/d2c/d59/d70/d3e/d5d/d80/d97/d10f/f110 [0,4194304] 0 2024-04-12T09:11:14.851 INFO:tasks.workunit.client.0.smithi117.stdout:9/561: dread - d1/d8/d5a/d6e/f7c zero size 2024-04-12T09:11:14.853 INFO:tasks.workunit.client.0.smithi117.stdout:7/500: rename d0/f5d to d0/d2/d1a/f9d 0 2024-04-12T09:11:14.856 INFO:tasks.workunit.client.0.smithi117.stdout:0/780: dread d3/dc/f69 [0,4194304] 0 2024-04-12T09:11:14.860 INFO:tasks.workunit.client.0.smithi117.stdout:4/597: dread d0/d2c/f31 [0,4194304] 0 2024-04-12T09:11:14.862 INFO:tasks.workunit.client.0.smithi117.stdout:8/583: creat db/d19/d1a/d3d/d60/d70/d98/fc0 x:0 0 0 2024-04-12T09:11:14.864 INFO:tasks.workunit.client.0.smithi117.stdout:2/507: mknod d0/d96/cac 0 2024-04-12T09:11:14.867 INFO:tasks.workunit.client.0.smithi117.stdout:4/598: dwrite d0/d5/d25/dc8/f75 [0,4194304] 0 2024-04-12T09:11:14.873 INFO:tasks.workunit.client.0.smithi117.stdout:5/672: rename d2/d3/dd/cba to d2/d3/de/d1e/d79/cd0 0 2024-04-12T09:11:14.874 INFO:tasks.workunit.client.0.smithi117.stdout:0/781: unlink d3/da2/dee/d76/fa4 0 2024-04-12T09:11:14.877 INFO:tasks.workunit.client.0.smithi117.stdout:4/599: symlink d0/d5/d25/dc8/lc9 0 2024-04-12T09:11:14.878 INFO:tasks.workunit.client.0.smithi117.stdout:3/882: creat de/d2c/d59/d70/d3e/d84/dfa/d102/f14c x:0 0 0 2024-04-12T09:11:14.880 INFO:tasks.workunit.client.0.smithi117.stdout:1/556: rename d1/d6/d3f/db/d16/c42 to d1/d64/d45/d4c/d63/da9/d9a/d54/cab 0 2024-04-12T09:11:14.882 INFO:tasks.workunit.client.0.smithi117.stdout:5/673: dread d2/f34 [0,4194304] 0 2024-04-12T09:11:14.883 INFO:tasks.workunit.client.0.smithi117.stdout:0/782: creat d3/d30/f101 x:0 0 0 2024-04-12T09:11:14.884 INFO:tasks.workunit.client.0.smithi117.stdout:8/584: symlink db/da6/lc1 0 2024-04-12T09:11:14.885 INFO:tasks.workunit.client.0.smithi117.stdout:4/600: symlink d0/d5/d3b/d38/d4f/db6/lca 0 2024-04-12T09:11:14.886 INFO:tasks.workunit.client.0.smithi117.stdout:4/601: stat d0/d5/d25/dc8/f8e 0 2024-04-12T09:11:14.886 INFO:tasks.workunit.client.0.smithi117.stdout:8/585: truncate db/d19/d1a/d3d/d9c/faa 120454 0 2024-04-12T09:11:14.887 INFO:tasks.workunit.client.0.smithi117.stdout:4/602: chown d0/f27 4 1 2024-04-12T09:11:14.887 INFO:tasks.workunit.client.0.smithi117.stdout:8/586: dread - db/f7e zero size 2024-04-12T09:11:14.888 INFO:tasks.workunit.client.0.smithi117.stdout:7/501: dread d0/d2/d1a/f9d [0,4194304] 0 2024-04-12T09:11:14.888 INFO:tasks.workunit.client.0.smithi117.stdout:9/562: rename d1/d8/df/d39 to d1/d8/df/d26/d41/daf 0 2024-04-12T09:11:14.888 INFO:tasks.workunit.client.0.smithi117.stdout:2/508: rename d0/d4 to d0/d4/d81/dad 22 2024-04-12T09:11:14.890 INFO:tasks.workunit.client.0.smithi117.stdout:8/587: write db/d1b/d62/dae/faf [103357,127158] 0 2024-04-12T09:11:14.894 INFO:tasks.workunit.client.0.smithi117.stdout:5/674: write d2/d3/dd/d39/d83/d4d/d52/f84 [109109,2323] 0 2024-04-12T09:11:14.895 INFO:tasks.workunit.client.0.smithi117.stdout:3/883: mkdir de/d2c/d59/d19/d14d 0 2024-04-12T09:11:14.898 INFO:tasks.workunit.client.0.smithi117.stdout:4/603: creat d0/d5/d3b/d38/d4f/d79/d9c/dab/fcb x:0 0 0 2024-04-12T09:11:14.898 INFO:tasks.workunit.client.0.smithi117.stdout:4/604: readlink d0/d5/d3b/l64 0 2024-04-12T09:11:14.899 INFO:tasks.workunit.client.0.smithi117.stdout:2/509: mkdir d0/d43/d4b/dae 0 2024-04-12T09:11:14.906 INFO:tasks.workunit.client.0.smithi117.stdout:3/884: mkdir de/d2c/d59/d70/d3e/d5d/d89/d123/d14e 0 2024-04-12T09:11:14.910 INFO:tasks.workunit.client.0.smithi117.stdout:9/563: rename d1/d8/df/d26 to d1/d8/d5a/d79/d91/db0 0 2024-04-12T09:11:14.911 INFO:tasks.workunit.client.0.smithi117.stdout:1/557: write d1/d6/d51/f81 [3831816,127872] 0 2024-04-12T09:11:14.914 INFO:tasks.workunit.client.0.smithi117.stdout:0/783: write d3/f21 [4245054,56062] 0 2024-04-12T09:11:14.917 INFO:tasks.workunit.client.0.smithi117.stdout:5/675: mkdir d2/d3/dd/d39/d83/dc8/dd1 0 2024-04-12T09:11:14.925 INFO:tasks.workunit.client.0.smithi117.stdout:1/558: unlink d1/f65 0 2024-04-12T09:11:14.925 INFO:tasks.workunit.client.0.smithi117.stdout:3/885: dread de/d2c/d59/f1b [0,4194304] 0 2024-04-12T09:11:14.926 INFO:tasks.workunit.client.0.smithi117.stdout:7/502: write d0/d2/d45/d17/d23/d39/f78 [1089576,52720] 0 2024-04-12T09:11:14.928 INFO:tasks.workunit.client.0.smithi117.stdout:3/886: truncate de/d2c/d59/d70/d3e/d5d/d89/d68/f8f 4836554 0 2024-04-12T09:11:14.929 INFO:tasks.workunit.client.0.smithi117.stdout:3/887: readlink de/d2c/d59/d70/d40/d49/l91 0 2024-04-12T09:11:14.936 INFO:tasks.workunit.client.0.smithi117.stdout:2/510: creat d0/d43/faf x:0 0 0 2024-04-12T09:11:14.938 INFO:tasks.workunit.client.0.smithi117.stdout:1/559: symlink d1/d6/d3f/db/d16/lac 0 2024-04-12T09:11:14.946 INFO:tasks.workunit.client.0.smithi117.stdout:7/503: mknod d0/d2/d96/c9e 0 2024-04-12T09:11:14.948 INFO:tasks.workunit.client.0.smithi117.stdout:5/676: mkdir d2/d3/dd/d39/d83/dc8/dd1/dd2 0 2024-04-12T09:11:14.949 INFO:tasks.workunit.client.0.smithi117.stdout:4/605: getdents d0/d1/d34 0 2024-04-12T09:11:14.949 INFO:tasks.workunit.client.0.smithi117.stdout:9/564: link d1/d8/d5a/c82 d1/d8/d5a/d79/d91/db0/d41/daf/cb1 0 2024-04-12T09:11:14.952 INFO:tasks.workunit.client.0.smithi117.stdout:4/606: chown d0/d5/d3b/f94 22 1 2024-04-12T09:11:14.954 INFO:tasks.workunit.client.0.smithi117.stdout:1/560: dwrite d1/d64/d45/d4c/d63/f8c [0,4194304] 0 2024-04-12T09:11:14.955 INFO:tasks.workunit.client.0.smithi117.stdout:9/565: truncate d1/d8/d5a/d6e/f9c 930586 0 2024-04-12T09:11:14.956 INFO:tasks.workunit.client.0.smithi117.stdout:3/888: dwrite de/d2c/d59/d19/d27/f3c [0,4194304] 0 2024-04-12T09:11:14.958 INFO:tasks.workunit.client.0.smithi117.stdout:3/889: chown de/d2c/d59/d90/f100 1132359884 1 2024-04-12T09:11:14.975 INFO:tasks.workunit.client.0.smithi117.stdout:0/784: rename d3/d30/f3d to d3/da2/dee/dd5/dff/d91/f102 0 2024-04-12T09:11:14.975 INFO:tasks.workunit.client.0.smithi117.stdout:7/504: creat d0/da/d7c/f9f x:0 0 0 2024-04-12T09:11:14.978 INFO:tasks.workunit.client.0.smithi117.stdout:4/607: fdatasync d0/d2c/d3c/f87 0 2024-04-12T09:11:14.979 INFO:tasks.workunit.client.0.smithi117.stdout:9/566: creat d1/d8/d5a/d79/d91/fb2 x:0 0 0 2024-04-12T09:11:14.980 INFO:tasks.workunit.client.0.smithi117.stdout:9/567: truncate d1/d4b/f55 1252056 0 2024-04-12T09:11:14.981 INFO:tasks.workunit.client.0.smithi117.stdout:1/561: mknod d1/d64/d45/d4c/d63/da9/d9a/d54/cad 0 2024-04-12T09:11:14.982 INFO:tasks.workunit.client.0.smithi117.stdout:4/608: dread d0/d5/d39/d4e/d6b/d83/f85 [4194304,4194304] 0 2024-04-12T09:11:14.982 INFO:tasks.workunit.client.0.smithi117.stdout:3/890: readlink de/d2c/l9c 0 2024-04-12T09:11:14.983 INFO:tasks.workunit.client.0.smithi117.stdout:4/609: fsync d0/fb2 0 2024-04-12T09:11:14.987 INFO:tasks.workunit.client.0.smithi117.stdout:7/505: unlink d0/d2/d45/d17/f44 0 2024-04-12T09:11:14.987 INFO:tasks.workunit.client.0.smithi117.stdout:0/785: dread d3/da2/dee/dd5/dff/d91/d94/d5a/f82 [0,4194304] 0 2024-04-12T09:11:14.987 INFO:tasks.workunit.client.0.smithi117.stdout:7/506: chown d0/d2/d1a/f55 160080 1 2024-04-12T09:11:14.988 INFO:tasks.workunit.client.0.smithi117.stdout:0/786: write d3/d59/f5c [1521753,29383] 0 2024-04-12T09:11:14.988 INFO:tasks.workunit.client.0.smithi117.stdout:5/677: mknod d2/d3/dd/d39/d83/d4d/d6b/da5/cd3 0 2024-04-12T09:11:14.992 INFO:tasks.workunit.client.0.smithi117.stdout:9/568: write d1/d8/d12/f59 [1240177,1686] 0 2024-04-12T09:11:14.993 INFO:tasks.workunit.client.0.smithi117.stdout:1/562: creat d1/d6/fae x:0 0 0 2024-04-12T09:11:15.000 INFO:tasks.workunit.client.0.smithi117.stdout:5/678: creat d2/d3/de/d1e/d35/fd4 x:0 0 0 2024-04-12T09:11:15.006 INFO:tasks.workunit.client.0.smithi117.stdout:3/891: write de/d2c/d59/d19/f29 [703708,112856] 0 2024-04-12T09:11:15.007 INFO:tasks.workunit.client.0.smithi117.stdout:4/610: symlink d0/d5/d39/d4e/d6b/d83/db1/lcc 0 2024-04-12T09:11:15.009 INFO:tasks.workunit.client.0.smithi117.stdout:7/507: mknod d0/ca0 0 2024-04-12T09:11:15.009 INFO:tasks.workunit.client.0.smithi117.stdout:9/569: dwrite d1/d8/d5a/d79/d91/db0/d41/daf/d3b/f4c [8388608,4194304] 0 2024-04-12T09:11:15.012 INFO:tasks.workunit.client.0.smithi117.stdout:5/679: mknod d2/d3/de/d1e/d79/cd5 0 2024-04-12T09:11:15.013 INFO:tasks.workunit.client.0.smithi117.stdout:0/787: truncate d3/da2/dee/dd5/dff/d91/d94/d5a/d62/d66/f68 37154 0 2024-04-12T09:11:15.017 INFO:tasks.workunit.client.0.smithi117.stdout:4/611: mkdir d0/db3/da7/dcd 0 2024-04-12T09:11:15.018 INFO:tasks.workunit.client.0.smithi117.stdout:3/892: fdatasync de/d2c/d59/d70/d3e/d5d/d80/d82/fee 0 2024-04-12T09:11:15.022 INFO:tasks.workunit.client.0.smithi117.stdout:5/680: mkdir d2/d3/dd/d39/d82/dd6 0 2024-04-12T09:11:15.025 INFO:tasks.workunit.client.0.smithi117.stdout:3/893: dwrite de/d2c/d59/d70/d3d/f10a [0,4194304] 0 2024-04-12T09:11:15.026 INFO:tasks.workunit.client.0.smithi117.stdout:0/788: creat d3/da2/dee/d76/d83/da8/f103 x:0 0 0 2024-04-12T09:11:15.035 INFO:tasks.workunit.client.0.smithi117.stdout:1/563: getdents d1/d64/d45 0 2024-04-12T09:11:15.036 INFO:tasks.workunit.client.0.smithi117.stdout:1/564: chown d1/d6/d3f/l23 26057 1 2024-04-12T09:11:15.042 INFO:tasks.workunit.client.0.smithi117.stdout:0/789: mkdir d3/da2/dee/d76/d83/da8/d97/d104 0 2024-04-12T09:11:15.043 INFO:tasks.workunit.client.0.smithi117.stdout:0/790: read d3/da2/dee/dd5/dff/d91/d94/d5a/fc5 [374786,2956] 0 2024-04-12T09:11:15.044 INFO:tasks.workunit.client.0.smithi117.stdout:0/791: truncate d3/dc/f2e 5423892 0 2024-04-12T09:11:15.045 INFO:tasks.workunit.client.0.smithi117.stdout:0/792: readlink d3/da2/dee/d76/d85/lac 0 2024-04-12T09:11:15.046 INFO:tasks.workunit.client.0.smithi117.stdout:1/565: symlink d1/d6/laf 0 2024-04-12T09:11:15.047 INFO:tasks.workunit.client.0.smithi117.stdout:0/793: truncate d3/da2/dee/d76/d83/da8/fbc 1365886 0 2024-04-12T09:11:15.047 INFO:tasks.workunit.client.0.smithi117.stdout:1/566: fsync d1/d6/d3f/f20 0 2024-04-12T09:11:15.050 INFO:tasks.workunit.client.0.smithi117.stdout:1/567: dread d1/d3b/f8f [0,4194304] 0 2024-04-12T09:11:15.056 INFO:tasks.workunit.client.0.smithi117.stdout:3/894: creat de/d2c/d59/d70/d3e/d5d/d80/d97/d9a/d103/f14f x:0 0 0 2024-04-12T09:11:15.057 INFO:tasks.workunit.client.0.smithi117.stdout:6/595: sync 2024-04-12T09:11:15.057 INFO:tasks.workunit.client.0.smithi117.stdout:3/895: fdatasync de/d2c/d59/d4c/da0/da8/dac/fbb 0 2024-04-12T09:11:15.058 INFO:tasks.workunit.client.0.smithi117.stdout:3/896: chown de/d2c/d59/d70/d3e/d5d/f64 0 1 2024-04-12T09:11:15.062 INFO:tasks.workunit.client.0.smithi117.stdout:3/897: readlink de/d2c/d59/d70/d3e/d5d/d89/dda/lf6 0 2024-04-12T09:11:15.065 INFO:tasks.workunit.client.0.smithi117.stdout:7/508: write d0/f1b [2689165,82793] 0 2024-04-12T09:11:15.067 INFO:tasks.workunit.client.0.smithi117.stdout:1/568: creat d1/d64/d45/d4c/d63/da9/d9a/d54/fb0 x:0 0 0 2024-04-12T09:11:15.069 INFO:tasks.workunit.client.0.smithi117.stdout:6/596: fdatasync d8/f1a 0 2024-04-12T09:11:15.070 INFO:tasks.workunit.client.0.smithi117.stdout:6/597: chown d8/d9/d17/d2d/c37 726293 1 2024-04-12T09:11:15.071 INFO:tasks.workunit.client.0.smithi117.stdout:6/598: dread - d8/d2a/d60/d7d/dbf/f9e zero size 2024-04-12T09:11:15.073 INFO:tasks.workunit.client.0.smithi117.stdout:4/612: getdents d0/d5/d3b/d38/d4f/d79/d9c 0 2024-04-12T09:11:15.073 INFO:tasks.workunit.client.0.smithi117.stdout:4/613: write d0/d2c/f2f [1750616,9768] 0 2024-04-12T09:11:15.078 INFO:tasks.workunit.client.0.smithi117.stdout:4/614: chown d0/db3/da7/lae 19797482 1 2024-04-12T09:11:15.080 INFO:tasks.workunit.client.0.smithi117.stdout:5/681: link d2/d3/dd/d39/d7a/la4 d2/d3/dd/d39/d83/d74/ld7 0 2024-04-12T09:11:15.093 INFO:tasks.workunit.client.0.smithi117.stdout:6/599: dread d8/d9/f19 [0,4194304] 0 2024-04-12T09:11:15.096 INFO:tasks.workunit.client.0.smithi117.stdout:4/615: write d0/d5/d3b/f97 [4819826,79872] 0 2024-04-12T09:11:15.097 INFO:tasks.workunit.client.0.smithi117.stdout:4/616: readlink d0/d5/d25/dc8/lc9 0 2024-04-12T09:11:15.099 INFO:tasks.workunit.client.0.smithi117.stdout:5/682: creat d2/d3/dd/d39/d83/d4d/fd8 x:0 0 0 2024-04-12T09:11:15.099 INFO:tasks.workunit.client.0.smithi117.stdout:5/683: stat d2/d3/de/d1e/f2d 0 2024-04-12T09:11:15.102 INFO:tasks.workunit.client.0.smithi117.stdout:7/509: mkdir d0/d2/d45/da1 0 2024-04-12T09:11:15.110 INFO:tasks.workunit.client.0.smithi117.stdout:0/794: rename d3/da2/dee/d76/d83/ff4 to d3/da2/dee/d76/db3/f105 0 2024-04-12T09:11:15.110 INFO:tasks.workunit.client.0.smithi117.stdout:6/600: dread f2 [0,4194304] 0 2024-04-12T09:11:15.112 INFO:tasks.workunit.client.0.smithi117.stdout:1/569: dwrite d1/d64/f99 [0,4194304] 0 2024-04-12T09:11:15.112 INFO:tasks.workunit.client.0.smithi117.stdout:3/898: write de/d2c/d59/d70/d3e/d5d/d80/d97/d9a/ff4 [999956,122438] 0 2024-04-12T09:11:15.112 INFO:tasks.workunit.client.0.smithi117.stdout:0/795: readlink d3/d47/l49 0 2024-04-12T09:11:15.113 INFO:tasks.workunit.client.0.smithi117.stdout:7/510: dwrite d0/d2/d45/d15/f54 [4194304,4194304] 0 2024-04-12T09:11:15.113 INFO:tasks.workunit.client.0.smithi117.stdout:6/601: dread - d8/d2a/fb7 zero size 2024-04-12T09:11:15.116 INFO:tasks.workunit.client.0.smithi117.stdout:1/570: write d1/f49 [4186577,50195] 0 2024-04-12T09:11:15.120 INFO:tasks.workunit.client.0.smithi117.stdout:5/684: mknod d2/d3/de/d1e/d66/dc2/cd9 0 2024-04-12T09:11:15.123 INFO:tasks.workunit.client.0.smithi117.stdout:0/796: fsync d3/d30/f31 0 2024-04-12T09:11:15.128 INFO:tasks.workunit.client.0.smithi117.stdout:6/602: symlink d8/d2a/d60/d7d/d9b/lc2 0 2024-04-12T09:11:15.130 INFO:tasks.workunit.client.0.smithi117.stdout:3/899: creat de/d2c/d59/d70/d3e/d5d/d89/d123/f150 x:0 0 0 2024-04-12T09:11:15.133 INFO:tasks.workunit.client.0.smithi117.stdout:7/511: creat d0/d2/d1a/d4f/fa2 x:0 0 0 2024-04-12T09:11:15.134 INFO:tasks.workunit.client.0.smithi117.stdout:1/571: symlink d1/d64/d45/d4c/d63/da9/d9a/d71/lb1 0 2024-04-12T09:11:15.135 INFO:tasks.workunit.client.0.smithi117.stdout:1/572: dread - d1/d64/d45/d4c/f7d zero size 2024-04-12T09:11:15.136 INFO:tasks.workunit.client.0.smithi117.stdout:5/685: rmdir d2/d3/de/d1e/d66/dbe 39 2024-04-12T09:11:15.139 INFO:tasks.workunit.client.0.smithi117.stdout:0/797: unlink d3/da2/dee/d76/c90 0 2024-04-12T09:11:15.141 INFO:tasks.workunit.client.0.smithi117.stdout:4/617: getdents d0/d5/d39/d4e/d6b/d83/db1 0 2024-04-12T09:11:15.142 INFO:tasks.workunit.client.0.smithi117.stdout:4/618: write d0/d5/d39/da2/fb8 [2243255,65478] 0 2024-04-12T09:11:15.143 INFO:tasks.workunit.client.0.smithi117.stdout:4/619: readlink d0/d5/d3b/d38/d4f/l6d 0 2024-04-12T09:11:15.144 INFO:tasks.workunit.client.0.smithi117.stdout:6/603: unlink d8/d3a/f4b 0 2024-04-12T09:11:15.144 INFO:tasks.workunit.client.0.smithi117.stdout:4/620: chown d0/d1/d34/f57 56684 1 2024-04-12T09:11:15.145 INFO:tasks.workunit.client.0.smithi117.stdout:3/900: fsync de/d2c/d59/d70/d3e/f8b 0 2024-04-12T09:11:15.146 INFO:tasks.workunit.client.0.smithi117.stdout:6/604: truncate d8/d3f/d51/d97/fb9 951509 0 2024-04-12T09:11:15.148 INFO:tasks.workunit.client.0.smithi117.stdout:6/605: dread d8/d9/f46 [0,4194304] 0 2024-04-12T09:11:15.149 INFO:tasks.workunit.client.0.smithi117.stdout:1/573: creat d1/d6/d51/fb2 x:0 0 0 2024-04-12T09:11:15.151 INFO:tasks.workunit.client.0.smithi117.stdout:1/574: read - d1/d64/d45/d4c/d63/da9/d9a/d54/f86 zero size 2024-04-12T09:11:15.152 INFO:tasks.workunit.client.0.smithi117.stdout:5/686: mknod d2/d3/de/d1e/d79/cda 0 2024-04-12T09:11:15.153 INFO:tasks.workunit.client.0.smithi117.stdout:4/621: dread d0/d5/d3b/f97 [0,4194304] 0 2024-04-12T09:11:15.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:14 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:11:15.160 INFO:tasks.workunit.client.0.smithi117.stdout:3/901: creat de/d2c/d59/d70/d3e/d5d/d89/dda/f151 x:0 0 0 2024-04-12T09:11:15.162 INFO:tasks.workunit.client.0.smithi117.stdout:6/606: symlink d8/d3a/lc3 0 2024-04-12T09:11:15.163 INFO:tasks.workunit.client.0.smithi117.stdout:6/607: stat d8/d2a/d60/d7d/d9b 0 2024-04-12T09:11:15.163 INFO:tasks.workunit.client.0.smithi117.stdout:6/608: chown d8/d9/f19 4709 1 2024-04-12T09:11:15.165 INFO:tasks.workunit.client.0.smithi117.stdout:0/798: mknod d3/da2/dee/d76/d83/da8/dd4/c106 0 2024-04-12T09:11:15.165 INFO:tasks.workunit.client.0.smithi117.stdout:0/799: fdatasync d3/d47/ff5 0 2024-04-12T09:11:15.167 INFO:tasks.workunit.client.0.smithi117.stdout:4/622: mkdir d0/d5/d3b/d38/d4f/dce 0 2024-04-12T09:11:15.169 INFO:tasks.workunit.client.0.smithi117.stdout:5/687: truncate d2/d3/de/d1e/d46/f48 4376208 0 2024-04-12T09:11:15.174 INFO:tasks.workunit.client.0.smithi117.stdout:7/512: dwrite d0/d2/d1a/f24 [0,4194304] 0 2024-04-12T09:11:15.175 INFO:tasks.workunit.client.0.smithi117.stdout:6/609: creat d8/d9/d17/d33/fc4 x:0 0 0 2024-04-12T09:11:15.182 INFO:tasks.workunit.client.0.smithi117.stdout:3/902: mkdir de/d2c/d59/d70/d3e/d152 0 2024-04-12T09:11:15.184 INFO:tasks.workunit.client.0.smithi117.stdout:3/903: stat de/d2c/d59/d70/d3e/d5d/d80/d97/d9a/ff4 0 2024-04-12T09:11:15.184 INFO:tasks.workunit.client.0.smithi117.stdout:7/513: symlink d0/d2/d45/d53/la3 0 2024-04-12T09:11:15.187 INFO:tasks.workunit.client.0.smithi117.stdout:0/800: creat d3/da2/dee/d76/de2/f107 x:0 0 0 2024-04-12T09:11:15.188 INFO:tasks.workunit.client.0.smithi117.stdout:4/623: mkdir d0/db3/da7/dcd/dcf 0 2024-04-12T09:11:15.188 INFO:tasks.workunit.client.0.smithi117.stdout:4/624: readlink d0/d2c/l59 0 2024-04-12T09:11:15.190 INFO:tasks.workunit.client.0.smithi117.stdout:4/625: read d0/d1/f1b [197323,75248] 0 2024-04-12T09:11:15.190 INFO:tasks.workunit.client.0.smithi117.stdout:4/626: dread - d0/d5/d25/fc2 zero size 2024-04-12T09:11:15.194 INFO:tasks.workunit.client.0.smithi117.stdout:3/904: fdatasync de/d2c/d59/d4c/d62/fcc 0 2024-04-12T09:11:15.199 INFO:tasks.workunit.client.0.smithi117.stdout:0/801: dread d3/dc/f8e [0,4194304] 0 2024-04-12T09:11:15.200 INFO:tasks.workunit.client.0.smithi117.stdout:5/688: rename d2/d3/de/d1e/f2d to d2/d3/dd/d39/d83/fdb 0 2024-04-12T09:11:15.203 INFO:tasks.workunit.client.0.smithi117.stdout:7/514: unlink d0/d2/d45/d17/l8f 0 2024-04-12T09:11:15.209 INFO:tasks.workunit.client.0.smithi117.stdout:3/905: symlink de/d2c/dc0/l153 0 2024-04-12T09:11:15.214 INFO:tasks.workunit.client.0.smithi117.stdout:0/802: mkdir d3/d30/dc8/d108 0 2024-04-12T09:11:15.214 INFO:tasks.workunit.client.0.smithi117.stdout:3/906: dwrite de/d2c/d59/d4c/d62/f11d [0,4194304] 0 2024-04-12T09:11:15.216 INFO:tasks.workunit.client.0.smithi117.stdout:5/689: mknod d2/d3/dd/d39/d83/d4d/cdc 0 2024-04-12T09:11:15.223 INFO:tasks.workunit.client.0.smithi117.stdout:6/610: getdents d8/d2a 0 2024-04-12T09:11:15.224 INFO:tasks.workunit.client.0.smithi117.stdout:6/611: dread - d8/d2a/f92 zero size 2024-04-12T09:11:15.236 INFO:tasks.workunit.client.0.smithi117.stdout:6/612: creat d8/d2a/d6e/fc5 x:0 0 0 2024-04-12T09:11:15.238 INFO:tasks.workunit.client.0.smithi117.stdout:0/803: mkdir d3/da2/dee/dd5/dff/d91/d109 0 2024-04-12T09:11:15.242 INFO:tasks.workunit.client.0.smithi117.stdout:4/627: getdents d0/db3/da7 0 2024-04-12T09:11:15.244 INFO:tasks.workunit.client.0.smithi117.stdout:6/613: rmdir d8/d3f/d51/d97 39 2024-04-12T09:11:15.245 INFO:tasks.workunit.client.0.smithi117.stdout:6/614: fdatasync d8/d9/f82 0 2024-04-12T09:11:15.246 INFO:tasks.workunit.client.0.smithi117.stdout:6/615: write d8/d2a/d60/d7d/d8c/f98 [686296,128421] 0 2024-04-12T09:11:15.246 INFO:tasks.workunit.client.0.smithi117.stdout:6/616: chown d8/d2a/d60/d7d/dbf 352 1 2024-04-12T09:11:15.253 INFO:tasks.workunit.client.0.smithi117.stdout:4/628: unlink d0/d5/d3b/le 0 2024-04-12T09:11:15.257 INFO:tasks.workunit.client.0.smithi117.stdout:0/804: dread d3/f4d [0,4194304] 0 2024-04-12T09:11:15.257 INFO:tasks.workunit.client.0.smithi117.stdout:7/515: truncate d0/d2/d45/d17/d23/d39/f78 2104181 0 2024-04-12T09:11:15.258 INFO:tasks.workunit.client.0.smithi117.stdout:3/907: getdents de/d2c/d59/d70/d3e/d5d/d80/d82 0 2024-04-12T09:11:15.261 INFO:tasks.workunit.client.0.smithi117.stdout:5/690: write d2/d3/de/d1e/d46/f48 [3150039,110003] 0 2024-04-12T09:11:15.261 INFO:tasks.workunit.client.0.smithi117.stdout:7/516: write d0/d2/d45/d17/d23/d51/f87 [624091,82344] 0 2024-04-12T09:11:15.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:14 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:11:15.363 INFO:tasks.workunit.client.0.smithi117.stdout:6/617: truncate d8/d9/d61/f65 3297976 0 2024-04-12T09:11:15.364 INFO:tasks.workunit.client.0.smithi117.stdout:0/805: chown d3/da2/dee/d76/d83/da8/d97/dc9/dd2/lb2 2026 1 2024-04-12T09:11:15.366 INFO:tasks.workunit.client.0.smithi117.stdout:4/629: dwrite d0/d5/d25/fac [0,4194304] 0 2024-04-12T09:11:15.367 INFO:tasks.workunit.client.0.smithi117.stdout:0/806: write d3/d30/f101 [980700,108868] 0 2024-04-12T09:11:15.369 INFO:tasks.workunit.client.0.smithi117.stdout:4/630: readlink d0/d5/d3b/l5f 0 2024-04-12T09:11:15.369 INFO:tasks.workunit.client.0.smithi117.stdout:5/691: creat d2/d3/de/d1e/d79/fdd x:0 0 0 2024-04-12T09:11:15.372 INFO:tasks.workunit.client.0.smithi117.stdout:7/517: write d0/d2/d45/d17/f21 [3360560,91388] 0 2024-04-12T09:11:15.373 INFO:tasks.workunit.client.0.smithi117.stdout:4/631: symlink d0/d2c/d67/ld0 0 2024-04-12T09:11:15.375 INFO:tasks.workunit.client.0.smithi117.stdout:7/518: truncate d0/d2/d45/d15/f54 8579994 0 2024-04-12T09:11:15.376 INFO:tasks.workunit.client.0.smithi117.stdout:4/632: read d0/d5/d3b/f94 [363748,41020] 0 2024-04-12T09:11:15.378 INFO:tasks.workunit.client.0.smithi117.stdout:7/519: read d0/d2/f6f [3803039,26588] 0 2024-04-12T09:11:15.380 INFO:tasks.workunit.client.0.smithi117.stdout:5/692: mkdir d2/d3/dd/d39/d83/dc8/dd1/dd2/dde 0 2024-04-12T09:11:15.385 INFO:tasks.workunit.client.0.smithi117.stdout:4/633: dread d0/d5/d3b/d38/d4f/fb0 [0,4194304] 0 2024-04-12T09:11:15.385 INFO:tasks.workunit.client.0.smithi117.stdout:0/807: dread d3/da2/dee/dd5/dff/d91/fa9 [0,4194304] 0 2024-04-12T09:11:15.386 INFO:tasks.workunit.client.0.smithi117.stdout:5/693: creat d2/d3/de/d1e/d35/fdf x:0 0 0 2024-04-12T09:11:15.387 INFO:tasks.workunit.client.0.smithi117.stdout:7/520: stat d0/d2/d45/d17/d23/d39/d6c/c99 0 2024-04-12T09:11:15.389 INFO:tasks.workunit.client.0.smithi117.stdout:5/694: write d2/d3/de/d1e/d46/fcd [970112,53047] 0 2024-04-12T09:11:15.389 INFO:tasks.workunit.client.0.smithi117.stdout:0/808: fsync d3/da2/dee/dd5/dff/d91/d94/d5a/d62/ff6 0 2024-04-12T09:11:15.390 INFO:tasks.workunit.client.0.smithi117.stdout:4/634: creat d0/d5/d25/dc8/da0/fd1 x:0 0 0 2024-04-12T09:11:15.392 INFO:tasks.workunit.client.0.smithi117.stdout:6/618: dread d8/d9/d61/f65 [0,4194304] 0 2024-04-12T09:11:15.393 INFO:tasks.workunit.client.0.smithi117.stdout:6/619: fsync d8/d9/fb6 0 2024-04-12T09:11:15.394 INFO:tasks.workunit.client.0.smithi117.stdout:4/635: unlink d0/d72/f26 0 2024-04-12T09:11:15.394 INFO:tasks.workunit.client.0.smithi117.stdout:6/620: stat d8/d2a/d60/fa1 0 2024-04-12T09:11:15.398 INFO:tasks.workunit.client.0.smithi117.stdout:6/621: dread d8/d3f/d51/d97/fb9 [0,4194304] 0 2024-04-12T09:11:15.399 INFO:tasks.workunit.client.0.smithi117.stdout:4/636: mknod d0/d5/d3b/d38/d4f/d79/cd2 0 2024-04-12T09:11:15.401 INFO:tasks.workunit.client.0.smithi117.stdout:6/622: dread d8/d2a/d60/fa1 [0,4194304] 0 2024-04-12T09:11:15.401 INFO:tasks.workunit.client.0.smithi117.stdout:7/521: link d0/da/f2d d0/d2/d45/d17/d23/d39/d6c/fa4 0 2024-04-12T09:11:15.402 INFO:tasks.workunit.client.0.smithi117.stdout:6/623: read d8/d3a/f3b [730015,24849] 0 2024-04-12T09:11:15.404 INFO:tasks.workunit.client.0.smithi117.stdout:6/624: write d8/d3a/f7c [1843771,111225] 0 2024-04-12T09:11:15.405 INFO:tasks.workunit.client.0.smithi117.stdout:4/637: creat d0/d72/fd3 x:0 0 0 2024-04-12T09:11:15.405 INFO:tasks.workunit.client.0.smithi117.stdout:6/625: fdatasync d8/d2a/d60/d89/fac 0 2024-04-12T09:11:15.406 INFO:tasks.workunit.client.0.smithi117.stdout:6/626: dread - d8/d2a/d60/d7d/dbf/f9e zero size 2024-04-12T09:11:15.409 INFO:tasks.workunit.client.0.smithi117.stdout:7/522: readlink d0/l41 0 2024-04-12T09:11:15.410 INFO:tasks.workunit.client.0.smithi117.stdout:7/523: write d0/d2/d45/f5a [3269431,72822] 0 2024-04-12T09:11:15.416 INFO:tasks.workunit.client.0.smithi117.stdout:6/627: symlink d8/d2a/d60/d89/lc6 0 2024-04-12T09:11:15.422 INFO:tasks.workunit.client.0.smithi117.stdout:4/638: rename d0/f4 to d0/db3/da7/fd4 0 2024-04-12T09:11:15.424 INFO:tasks.workunit.client.0.smithi117.stdout:6/628: write f7 [5162623,33346] 0 2024-04-12T09:11:15.425 INFO:tasks.workunit.client.0.smithi117.stdout:7/524: dwrite d0/d2/d1a/f9d [0,4194304] 0 2024-04-12T09:11:15.427 INFO:tasks.workunit.client.0.smithi117.stdout:4/639: chown d0/d72/c5a 2 1 2024-04-12T09:11:15.428 INFO:tasks.workunit.client.0.smithi117.stdout:6/629: creat d8/d3a/fc7 x:0 0 0 2024-04-12T09:11:15.429 INFO:tasks.workunit.client.0.smithi117.stdout:7/525: creat d0/d20/fa5 x:0 0 0 2024-04-12T09:11:15.430 INFO:tasks.workunit.client.0.smithi117.stdout:4/640: fsync d0/d1/f1b 0 2024-04-12T09:11:15.433 INFO:tasks.workunit.client.0.smithi117.stdout:6/630: unlink d8/d9/d17/f23 0 2024-04-12T09:11:15.434 INFO:tasks.workunit.client.0.smithi117.stdout:6/631: write d8/d2a/d60/d7d/d8c/fb0 [461271,130323] 0 2024-04-12T09:11:15.436 INFO:tasks.workunit.client.0.smithi117.stdout:4/641: creat d0/db3/da7/dcd/fd5 x:0 0 0 2024-04-12T09:11:15.440 INFO:tasks.workunit.client.0.smithi117.stdout:6/632: read d8/f21 [2670324,101648] 0 2024-04-12T09:11:15.443 INFO:tasks.workunit.client.0.smithi117.stdout:6/633: mkdir d8/d3a/dc8 0 2024-04-12T09:11:15.446 INFO:tasks.workunit.client.0.smithi117.stdout:6/634: creat d8/fc9 x:0 0 0 2024-04-12T09:11:15.447 INFO:tasks.workunit.client.0.smithi117.stdout:6/635: dread - d8/d9/d39/f8e zero size 2024-04-12T09:11:15.449 INFO:tasks.workunit.client.0.smithi117.stdout:6/636: fsync d8/d3a/d49/f4e 0 2024-04-12T09:11:15.455 INFO:tasks.workunit.client.0.smithi117.stdout:6/637: dwrite d8/d9/f29 [0,4194304] 0 2024-04-12T09:11:15.461 INFO:tasks.workunit.client.0.smithi117.stdout:6/638: getdents d8/d9/d39 0 2024-04-12T09:11:15.463 INFO:tasks.workunit.client.0.smithi117.stdout:6/639: chown d8/l30 33870121 1 2024-04-12T09:11:15.466 INFO:tasks.workunit.client.0.smithi117.stdout:6/640: unlink d8/d3f/d51/l9d 0 2024-04-12T09:11:15.467 INFO:tasks.workunit.client.0.smithi117.stdout:5/695: write d2/d3/dd/d39/d83/d74/f7e [2063021,46034] 0 2024-04-12T09:11:15.469 INFO:tasks.workunit.client.0.smithi117.stdout:6/641: creat d8/d2a/fca x:0 0 0 2024-04-12T09:11:15.470 INFO:tasks.workunit.client.0.smithi117.stdout:5/696: mknod d2/d3/de/d1e/d79/ce0 0 2024-04-12T09:11:15.487 INFO:tasks.workunit.client.0.smithi117.stdout:5/697: dread d2/d3/de/f2a [0,4194304] 0 2024-04-12T09:11:15.491 INFO:tasks.workunit.client.0.smithi117.stdout:4/642: truncate d0/d1/f65 2347020 0 2024-04-12T09:11:15.498 INFO:tasks.workunit.client.0.smithi117.stdout:5/698: rmdir d2/d3/de/d1e/d79 39 2024-04-12T09:11:15.502 INFO:tasks.workunit.client.0.smithi117.stdout:5/699: creat d2/d3/de/d1e/d66/dc2/fe1 x:0 0 0 2024-04-12T09:11:15.503 INFO:tasks.workunit.client.0.smithi117.stdout:4/643: dread d0/d5/d39/f6f [0,4194304] 0 2024-04-12T09:11:15.505 INFO:tasks.workunit.client.0.smithi117.stdout:5/700: creat d2/d3/de/d1e/d35/fe2 x:0 0 0 2024-04-12T09:11:15.507 INFO:tasks.workunit.client.0.smithi117.stdout:4/644: dread d0/fb2 [4194304,4194304] 0 2024-04-12T09:11:15.507 INFO:tasks.workunit.client.0.smithi117.stdout:4/645: readlink d0/db3/da7/lae 0 2024-04-12T09:11:15.508 INFO:tasks.workunit.client.0.smithi117.stdout:4/646: mkdir d0/d5/d3b/dd6 0 2024-04-12T09:11:15.510 INFO:tasks.workunit.client.0.smithi117.stdout:4/647: creat d0/d5/d25/fd7 x:0 0 0 2024-04-12T09:11:15.511 INFO:tasks.workunit.client.0.smithi117.stdout:4/648: unlink d0/d5/c33 0 2024-04-12T09:11:15.515 INFO:tasks.workunit.client.0.smithi117.stdout:4/649: link d0/d1/d34/f5b d0/d2c/d67/fd8 0 2024-04-12T09:11:15.516 INFO:tasks.workunit.client.0.smithi117.stdout:5/701: dwrite d2/f36 [0,4194304] 0 2024-04-12T09:11:15.517 INFO:tasks.workunit.client.0.smithi117.stdout:4/650: fdatasync d0/d2c/f31 0 2024-04-12T09:11:15.519 INFO:tasks.workunit.client.0.smithi117.stdout:4/651: mknod d0/db3/da7/dcd/cd9 0 2024-04-12T09:11:15.522 INFO:tasks.workunit.client.0.smithi117.stdout:4/652: creat d0/d2c/d67/fda x:0 0 0 2024-04-12T09:11:15.524 INFO:tasks.workunit.client.0.smithi117.stdout:5/702: getdents d2/d3/de/d1e/d46 0 2024-04-12T09:11:15.525 INFO:tasks.workunit.client.0.smithi117.stdout:4/653: symlink d0/d5/d25/d69/ldb 0 2024-04-12T09:11:15.526 INFO:tasks.workunit.client.0.smithi117.stdout:5/703: creat d2/d3/dd/d39/d83/dc8/fe3 x:0 0 0 2024-04-12T09:11:15.527 INFO:tasks.workunit.client.0.smithi117.stdout:4/654: write d0/d5/d3b/d38/d4f/f76 [230919,95116] 0 2024-04-12T09:11:15.529 INFO:tasks.workunit.client.0.smithi117.stdout:5/704: mkdir d2/d3/de/d1e/d46/de4 0 2024-04-12T09:11:15.530 INFO:tasks.workunit.client.0.smithi117.stdout:4/655: creat d0/d5/d3b/fdc x:0 0 0 2024-04-12T09:11:15.533 INFO:tasks.workunit.client.0.smithi117.stdout:4/656: creat d0/d5/d39/d88/fdd x:0 0 0 2024-04-12T09:11:15.534 INFO:tasks.workunit.client.0.smithi117.stdout:5/705: mknod d2/d3/de/d1e/d66/dbe/ce5 0 2024-04-12T09:11:15.539 INFO:tasks.workunit.client.0.smithi117.stdout:5/706: creat d2/d3/de/d1e/d79/fe6 x:0 0 0 2024-04-12T09:11:15.541 INFO:tasks.workunit.client.0.smithi117.stdout:5/707: symlink d2/d3/dd/d39/d83/dc8/le7 0 2024-04-12T09:11:15.547 INFO:tasks.workunit.client.0.smithi117.stdout:5/708: dwrite d2/d3/de/d1e/d79/f98 [0,4194304] 0 2024-04-12T09:11:15.555 INFO:tasks.workunit.client.0.smithi117.stdout:5/709: unlink d2/d3/de/d1e/d46/d96/d9c/cad 0 2024-04-12T09:11:15.555 INFO:tasks.workunit.client.0.smithi117.stdout:6/642: dread d8/d3f/d51/f88 [0,4194304] 0 2024-04-12T09:11:15.562 INFO:tasks.workunit.client.0.smithi117.stdout:5/710: link d2/f43 d2/d3/de/d1e/d66/dbe/fe8 0 2024-04-12T09:11:15.572 INFO:tasks.workunit.client.0.smithi117.stdout:6/643: dwrite d8/d3a/f3b [0,4194304] 0 2024-04-12T09:11:15.572 INFO:tasks.workunit.client.0.smithi117.stdout:4/657: dread d0/d5/d25/d69/f96 [0,4194304] 0 2024-04-12T09:11:15.574 INFO:tasks.workunit.client.0.smithi117.stdout:8/588: sync 2024-04-12T09:11:15.574 INFO:tasks.workunit.client.0.smithi117.stdout:8/589: dread - db/d13/f8c zero size 2024-04-12T09:11:15.575 INFO:tasks.workunit.client.0.smithi117.stdout:6/644: creat d8/d9/d39/fcb x:0 0 0 2024-04-12T09:11:15.576 INFO:tasks.workunit.client.0.smithi117.stdout:4/658: fdatasync d0/d5/d3b/f97 0 2024-04-12T09:11:15.582 INFO:tasks.workunit.client.0.smithi117.stdout:8/590: dwrite db/d1b/d62/f66 [0,4194304] 0 2024-04-12T09:11:15.591 INFO:tasks.workunit.client.0.smithi117.stdout:4/659: rmdir d0 39 2024-04-12T09:11:15.601 INFO:tasks.workunit.client.0.smithi117.stdout:6/645: write d8/f64 [4909,53808] 0 2024-04-12T09:11:15.605 INFO:tasks.workunit.client.0.smithi117.stdout:6/646: unlink d8/d2a/d60/d7d/d8c/fb0 0 2024-04-12T09:11:15.607 INFO:tasks.workunit.client.0.smithi117.stdout:8/591: dread db/d13/f7b [0,4194304] 0 2024-04-12T09:11:15.608 INFO:tasks.workunit.client.0.smithi117.stdout:6/647: symlink d8/d3a/d49/da4/d9f/lcc 0 2024-04-12T09:11:15.609 INFO:tasks.workunit.client.0.smithi117.stdout:8/592: chown db/d13/d38/l73 37647 1 2024-04-12T09:11:15.614 INFO:tasks.workunit.client.0.smithi117.stdout:8/593: symlink db/d19/d1a/db7/lc2 0 2024-04-12T09:11:15.617 INFO:tasks.workunit.client.0.smithi117.stdout:4/660: dread d0/d1/f73 [0,4194304] 0 2024-04-12T09:11:15.618 INFO:tasks.workunit.client.0.smithi117.stdout:4/661: read - d0/d2c/d67/fda zero size 2024-04-12T09:11:15.619 INFO:tasks.workunit.client.0.smithi117.stdout:4/662: write d0/d5/d39/d4e/d6b/d83/fad [255027,405] 0 2024-04-12T09:11:15.622 INFO:tasks.workunit.client.0.smithi117.stdout:8/594: rename db/d13/d38/d46 to db/d13/d38/dc3 0 2024-04-12T09:11:15.622 INFO:tasks.workunit.client.0.smithi117.stdout:4/663: fsync d0/f37 0 2024-04-12T09:11:15.627 INFO:tasks.workunit.client.0.smithi117.stdout:8/595: unlink db/d13/d38/d86/f99 0 2024-04-12T09:11:15.628 INFO:tasks.workunit.client.0.smithi117.stdout:6/648: dread d8/d3a/d49/f83 [0,4194304] 0 2024-04-12T09:11:15.629 INFO:tasks.workunit.client.0.smithi117.stdout:4/664: dwrite d0/d5/d39/f77 [0,4194304] 0 2024-04-12T09:11:15.629 INFO:tasks.workunit.client.0.smithi117.stdout:8/596: write db/d77/fa9 [601291,96874] 0 2024-04-12T09:11:15.631 INFO:tasks.workunit.client.0.smithi117.stdout:8/597: write db/d13/d38/d86/f94 [5223545,1655] 0 2024-04-12T09:11:15.687 INFO:tasks.workunit.client.0.smithi117.stdout:4/665: write d0/d5/d3b/d38/d4f/d79/f95 [1528228,69008] 0 2024-04-12T09:11:15.691 INFO:tasks.workunit.client.0.smithi117.stdout:4/666: dread d0/d5/d39/d4e/d6b/d83/f85 [0,4194304] 0 2024-04-12T09:11:15.691 INFO:tasks.workunit.client.0.smithi117.stdout:8/598: symlink db/d13/d38/d86/da0/da4/lc4 0 2024-04-12T09:11:15.692 INFO:tasks.workunit.client.0.smithi117.stdout:6/649: write d8/d2a/d60/fa1 [426121,85664] 0 2024-04-12T09:11:15.693 INFO:tasks.workunit.client.0.smithi117.stdout:4/667: write d0/f37 [3352742,29575] 0 2024-04-12T09:11:15.699 INFO:tasks.workunit.client.0.smithi117.stdout:6/650: symlink d8/d2a/d60/d89/d99/lcd 0 2024-04-12T09:11:15.707 INFO:tasks.workunit.client.0.smithi117.stdout:4/668: rmdir d0/db3/da7/db7 0 2024-04-12T09:11:15.708 INFO:tasks.workunit.client.0.smithi117.stdout:6/651: write d8/fc [3457247,65454] 0 2024-04-12T09:11:15.711 INFO:tasks.workunit.client.0.smithi117.stdout:6/652: truncate d8/d9/f19 2453882 0 2024-04-12T09:11:15.713 INFO:tasks.workunit.client.0.smithi117.stdout:6/653: dread d8/d3f/d51/f88 [0,4194304] 0 2024-04-12T09:11:15.713 INFO:tasks.workunit.client.0.smithi117.stdout:8/599: mkdir db/d13/d38/dc5 0 2024-04-12T09:11:15.714 INFO:tasks.workunit.client.0.smithi117.stdout:6/654: dread - d8/d2a/f92 zero size 2024-04-12T09:11:15.716 INFO:tasks.workunit.client.0.smithi117.stdout:8/600: fdatasync db/d19/d1a/f21 0 2024-04-12T09:11:15.721 INFO:tasks.workunit.client.0.smithi117.stdout:4/669: dwrite d0/d5/d39/f36 [0,4194304] 0 2024-04-12T09:11:15.726 INFO:tasks.workunit.client.0.smithi117.stdout:4/670: dread d0/d1/d34/f28 [4194304,4194304] 0 2024-04-12T09:11:15.726 INFO:tasks.workunit.client.0.smithi117.stdout:6/655: getdents d8/d2a/d60/d7d/d9b 0 2024-04-12T09:11:15.727 INFO:tasks.workunit.client.0.smithi117.stdout:4/671: dread - d0/d5/d3b/fdc zero size 2024-04-12T09:11:15.728 INFO:tasks.workunit.client.0.smithi117.stdout:4/672: readlink d0/d5/l8a 0 2024-04-12T09:11:15.729 INFO:tasks.workunit.client.0.smithi117.stdout:6/656: read d8/d3a/d49/f4e [430464,107858] 0 2024-04-12T09:11:15.729 INFO:tasks.workunit.client.0.smithi117.stdout:4/673: read d0/d1/f73 [3746194,38446] 0 2024-04-12T09:11:15.730 INFO:tasks.workunit.client.0.smithi117.stdout:6/657: chown d8/d9/fb6 3683 1 2024-04-12T09:11:15.730 INFO:tasks.workunit.client.0.smithi117.stdout:8/601: getdents db/d4b 0 2024-04-12T09:11:15.736 INFO:tasks.workunit.client.0.smithi117.stdout:8/602: rename db/f3e to db/d13/d38/dc3/d9d/fc6 0 2024-04-12T09:11:15.738 INFO:tasks.workunit.client.0.smithi117.stdout:8/603: creat db/d13/d38/d86/da0/fc7 x:0 0 0 2024-04-12T09:11:15.739 INFO:tasks.workunit.client.0.smithi117.stdout:8/604: chown db/d13/d38/d86/da0/da4 198465 1 2024-04-12T09:11:15.744 INFO:tasks.workunit.client.0.smithi117.stdout:4/674: dwrite d0/d5/d3b/f97 [4194304,4194304] 0 2024-04-12T09:11:15.745 INFO:tasks.workunit.client.0.smithi117.stdout:4/675: dread - d0/d5/d3b/f82 zero size 2024-04-12T09:11:15.746 INFO:tasks.workunit.client.0.smithi117.stdout:8/605: dread db/d19/d1a/d3d/f45 [0,4194304] 0 2024-04-12T09:11:15.749 INFO:tasks.workunit.client.0.smithi117.stdout:8/606: creat db/d1b/d62/fc8 x:0 0 0 2024-04-12T09:11:15.756 INFO:tasks.workunit.client.0.smithi117.stdout:8/607: dwrite db/d1b/f3c [4194304,4194304] 0 2024-04-12T09:11:15.757 INFO:tasks.workunit.client.0.smithi117.stdout:8/608: fdatasync db/d13/d38/d86/f94 0 2024-04-12T09:11:15.760 INFO:tasks.workunit.client.0.smithi117.stdout:8/609: mkdir db/d13/d38/dc3/d9d/dc9 0 2024-04-12T09:11:15.772 INFO:tasks.workunit.client.0.smithi117.stdout:8/610: write db/d13/f9f [4113196,23282] 0 2024-04-12T09:11:15.773 INFO:tasks.workunit.client.0.smithi117.stdout:8/611: fsync db/d13/f8c 0 2024-04-12T09:11:15.777 INFO:tasks.workunit.client.0.smithi117.stdout:8/612: creat db/d13/d38/d86/da0/fca x:0 0 0 2024-04-12T09:11:15.778 INFO:tasks.workunit.client.0.smithi117.stdout:8/613: chown db/d13/d38/f4e 40 1 2024-04-12T09:11:15.780 INFO:tasks.workunit.client.0.smithi117.stdout:8/614: getdents db/d4b 0 2024-04-12T09:11:15.785 INFO:tasks.workunit.client.0.smithi117.stdout:8/615: dread db/d1b/f5e [0,4194304] 0 2024-04-12T09:11:15.801 INFO:tasks.workunit.client.0.smithi117.stdout:8/616: dread db/d13/d38/dc3/f82 [0,4194304] 0 2024-04-12T09:11:15.802 INFO:tasks.workunit.client.0.smithi117.stdout:8/617: write db/d4b/d9a/fbb [931191,74025] 0 2024-04-12T09:11:15.804 INFO:tasks.workunit.client.0.smithi117.stdout:8/618: mknod db/d13/d38/d86/ccb 0 2024-04-12T09:11:15.804 INFO:tasks.workunit.client.0.smithi117.stdout:8/619: readlink db/d19/d1a/d3d/l6b 0 2024-04-12T09:11:15.807 INFO:tasks.workunit.client.0.smithi117.stdout:8/620: mkdir db/d19/d1a/d3d/d9c/dcc 0 2024-04-12T09:11:15.810 INFO:tasks.workunit.client.0.smithi117.stdout:8/621: truncate db/d13/f25 195740 0 2024-04-12T09:11:15.826 INFO:tasks.workunit.client.0.smithi117.stdout:8/622: dwrite db/d13/f4d [0,4194304] 0 2024-04-12T09:11:15.827 INFO:tasks.workunit.client.1.smithi203.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-12T09:11:15.831 INFO:tasks.workunit.client.0.smithi117.stdout:8/623: link db/d19/c23 db/d1b/ccd 0 2024-04-12T09:11:15.831 INFO:tasks.workunit.client.1.smithi203.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-12T09:11:15.831 INFO:tasks.workunit.client.1.smithi203.stderr:+ make 2024-04-12T09:11:15.834 INFO:tasks.workunit.client.0.smithi117.stdout:8/624: dread db/d13/f7b [4194304,4194304] 0 2024-04-12T09:11:15.835 INFO:tasks.workunit.client.0.smithi117.stdout:8/625: chown db/d19/d1a/d3d/f7f 234 1 2024-04-12T09:11:15.837 INFO:tasks.workunit.client.0.smithi117.stdout:8/626: creat db/d13/d38/d86/da0/da4/fce x:0 0 0 2024-04-12T09:11:15.845 INFO:tasks.workunit.client.0.smithi117.stdout:2/511: sync 2024-04-12T09:11:15.845 INFO:tasks.workunit.client.0.smithi117.stdout:2/512: chown d0/d4/f5d 946745 1 2024-04-12T09:11:15.848 INFO:tasks.workunit.client.0.smithi117.stdout:2/513: getdents d0/d43/da5/d8f 0 2024-04-12T09:11:15.849 INFO:tasks.workunit.client.0.smithi117.stdout:2/514: write d0/d43/d53/d61/d66/fa2 [528908,123192] 0 2024-04-12T09:11:15.851 INFO:tasks.workunit.client.0.smithi117.stdout:2/515: readlink d0/l1c 0 2024-04-12T09:11:15.854 INFO:tasks.workunit.client.0.smithi117.stdout:2/516: rename d0/d43/d30/l76 to d0/d43/da5/d8f/lb0 0 2024-04-12T09:11:15.857 INFO:tasks.workunit.client.0.smithi117.stdout:2/517: rename d0/d4/c2 to d0/df/cb1 0 2024-04-12T09:11:15.861 INFO:tasks.workunit.client.0.smithi117.stdout:2/518: creat d0/d43/d53/d61/fb2 x:0 0 0 2024-04-12T09:11:15.862 INFO:tasks.workunit.client.0.smithi117.stdout:2/519: mknod d0/d43/d53/d61/d8d/cb3 0 2024-04-12T09:11:15.864 INFO:tasks.workunit.client.0.smithi117.stdout:2/520: creat d0/d43/d4b/dae/fb4 x:0 0 0 2024-04-12T09:11:15.864 INFO:tasks.workunit.client.0.smithi117.stdout:2/521: chown d0/d4/d81/la9 184019585 1 2024-04-12T09:11:15.866 INFO:tasks.workunit.client.1.smithi203.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-12T09:11:15.866 INFO:tasks.workunit.client.0.smithi117.stdout:2/522: creat d0/d4/d81/d8b/fb5 x:0 0 0 2024-04-12T09:11:15.867 INFO:tasks.workunit.client.0.smithi117.stdout:2/523: write d0/df/f97 [282068,46170] 0 2024-04-12T09:11:15.868 INFO:tasks.workunit.client.0.smithi117.stdout:2/524: chown d0/d43/l7f 21 1 2024-04-12T09:11:15.868 INFO:tasks.workunit.client.0.smithi117.stdout:2/525: stat d0/d43/f8e 0 2024-04-12T09:11:15.870 INFO:tasks.workunit.client.0.smithi117.stdout:2/526: unlink d0/d43/d53/f84 0 2024-04-12T09:11:15.872 INFO:tasks.workunit.client.0.smithi117.stdout:2/527: creat d0/d43/da5/d8f/fb6 x:0 0 0 2024-04-12T09:11:15.873 INFO:tasks.workunit.client.0.smithi117.stdout:2/528: chown d0/d43/d4b 470481 1 2024-04-12T09:11:15.873 INFO:tasks.workunit.client.0.smithi117.stdout:2/529: stat d0/d4/c14 0 2024-04-12T09:11:15.877 INFO:tasks.workunit.client.0.smithi117.stdout:2/530: link d0/d43/d30/d41/f72 d0/d96/fb7 0 2024-04-12T09:11:15.879 INFO:tasks.workunit.client.0.smithi117.stdout:2/531: truncate d0/d43/d53/d61/fa6 826407 0 2024-04-12T09:11:15.882 INFO:tasks.workunit.client.0.smithi117.stdout:2/532: rename d0/d43/d4b/l9e to d0/d4/lb8 0 2024-04-12T09:11:15.884 INFO:tasks.workunit.client.0.smithi117.stdout:2/533: rename d0/d4/d10/d27/l59 to d0/d4/d81/lb9 0 2024-04-12T09:11:15.885 INFO:tasks.workunit.client.0.smithi117.stdout:2/534: dread - d0/d43/da5/d8f/fb6 zero size 2024-04-12T09:11:15.886 INFO:tasks.workunit.client.0.smithi117.stdout:2/535: stat d0/d4/d10/d27/d9a/la1 0 2024-04-12T09:11:15.886 INFO:tasks.workunit.client.0.smithi117.stdout:2/536: write d0/d4/d10/f63 [3630140,19811] 0 2024-04-12T09:11:15.887 INFO:tasks.workunit.client.0.smithi117.stdout:2/537: fsync d0/df/f1d 0 2024-04-12T09:11:15.887 INFO:tasks.workunit.client.0.smithi117.stdout:2/538: readlink d0/d43/d30/l55 0 2024-04-12T09:11:15.889 INFO:tasks.workunit.client.0.smithi117.stdout:2/539: read d0/d4/f5d [718804,36688] 0 2024-04-12T09:11:15.895 INFO:tasks.workunit.client.0.smithi117.stdout:2/540: dwrite d0/d43/d4b/dae/fb4 [0,4194304] 0 2024-04-12T09:11:15.992 INFO:tasks.workunit.client.0.smithi117.stdout:9/570: sync 2024-04-12T09:11:15.994 INFO:tasks.workunit.client.0.smithi117.stdout:9/571: symlink d1/d8/d5a/d79/d91/lb3 0 2024-04-12T09:11:15.996 INFO:tasks.workunit.client.0.smithi117.stdout:9/572: creat d1/d8/d5a/d79/d91/fb4 x:0 0 0 2024-04-12T09:11:15.997 INFO:tasks.workunit.client.0.smithi117.stdout:9/573: creat d1/d8/d5a/d6e/d71/fb5 x:0 0 0 2024-04-12T09:11:15.999 INFO:tasks.workunit.client.0.smithi117.stdout:9/574: getdents d1/d8/d5e 0 2024-04-12T09:11:16.015 INFO:tasks.workunit.client.0.smithi117.stdout:9/575: dread d1/d8/d12/f38 [4194304,4194304] 0 2024-04-12T09:11:16.021 INFO:tasks.workunit.client.0.smithi117.stdout:9/576: dwrite d1/d8/d5a/d6e/d71/fa9 [0,4194304] 0 2024-04-12T09:11:16.022 INFO:tasks.workunit.client.0.smithi117.stdout:9/577: write d1/d8/d12/f59 [1563613,123288] 0 2024-04-12T09:11:16.034 INFO:tasks.workunit.client.0.smithi117.stdout:9/578: dwrite d1/d8/d12/f38 [8388608,4194304] 0 2024-04-12T09:11:16.039 INFO:tasks.workunit.client.0.smithi117.stdout:9/579: truncate d1/d8/d12/f37 4557237 0 2024-04-12T09:11:16.046 INFO:tasks.workunit.client.0.smithi117.stdout:9/580: dwrite d1/d8/d5a/d79/d91/db0/d41/fa7 [0,4194304] 0 2024-04-12T09:11:16.053 INFO:tasks.workunit.client.0.smithi117.stdout:9/581: dwrite d1/d8/df/d7d/f8d [0,4194304] 0 2024-04-12T09:11:16.061 INFO:tasks.workunit.client.0.smithi117.stdout:9/582: rmdir d1/d8/d5a/d79/d91 39 2024-04-12T09:11:16.071 INFO:tasks.workunit.client.0.smithi117.stdout:9/583: creat d1/d8/fb6 x:0 0 0 2024-04-12T09:11:16.075 INFO:tasks.workunit.client.0.smithi117.stdout:9/584: mkdir d1/db7 0 2024-04-12T09:11:16.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:15 smithi117 ceph-mon[29277]: pgmap v18: 65 pgs: 65 active+clean; 1.2 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 33 MiB/s rd, 126 MiB/s wr, 327 op/s 2024-04-12T09:11:16.194 INFO:tasks.workunit.client.0.smithi117.stdout:9/585: rename d1/db7 to d1/d8/d5a/d79/db8 0 2024-04-12T09:11:16.195 INFO:tasks.workunit.client.0.smithi117.stdout:9/586: fdatasync d1/d8/d12/f38 0 2024-04-12T09:11:16.201 INFO:tasks.workunit.client.0.smithi117.stdout:9/587: write d1/d8/d5a/d79/d91/db0/d41/daf/d3b/f4a [3710593,22032] 0 2024-04-12T09:11:16.205 INFO:tasks.workunit.client.0.smithi117.stdout:9/588: mknod d1/d8/d5a/d79/d91/db0/cb9 0 2024-04-12T09:11:16.210 INFO:tasks.workunit.client.0.smithi117.stdout:9/589: symlink d1/d8/d90/lba 0 2024-04-12T09:11:16.213 INFO:tasks.workunit.client.0.smithi117.stdout:9/590: creat d1/d8/d52/d99/fbb x:0 0 0 2024-04-12T09:11:16.214 INFO:tasks.workunit.client.0.smithi117.stdout:9/591: readlink d1/d4b/l87 0 2024-04-12T09:11:16.216 INFO:tasks.workunit.client.0.smithi117.stdout:9/592: fdatasync d1/f15 0 2024-04-12T09:11:16.222 INFO:tasks.workunit.client.0.smithi117.stdout:9/593: dwrite d1/d8/d5a/d79/d91/db0/f46 [0,4194304] 0 2024-04-12T09:11:16.225 INFO:tasks.workunit.client.0.smithi117.stdout:1/575: sync 2024-04-12T09:11:16.225 INFO:tasks.workunit.client.0.smithi117.stdout:3/908: sync 2024-04-12T09:11:16.227 INFO:tasks.workunit.client.0.smithi117.stdout:3/909: fsync de/d2c/d59/d4c/d62/f11d 0 2024-04-12T09:11:16.227 INFO:tasks.workunit.client.0.smithi117.stdout:1/576: dread - d1/d64/d45/d4c/d63/da9/d9a/d54/fb0 zero size 2024-04-12T09:11:16.228 INFO:tasks.workunit.client.0.smithi117.stdout:9/594: rmdir d1/d4b 39 2024-04-12T09:11:16.234 INFO:tasks.workunit.client.0.smithi117.stdout:3/910: dwrite de/d2c/d59/d70/d3e/d84/da1/df1/f120 [0,4194304] 0 2024-04-12T09:11:16.238 INFO:tasks.workunit.client.0.smithi117.stdout:1/577: mkdir d1/db3 0 2024-04-12T09:11:16.242 INFO:tasks.workunit.client.0.smithi117.stdout:3/911: dread - de/d2c/d59/d70/d3e/d84/f88 zero size 2024-04-12T09:11:16.245 INFO:tasks.workunit.client.0.smithi117.stdout:1/578: rename d1/d64/d45/d4c/d63/da9/d9a/d54/c5e to d1/d64/d45/d4c/cb4 0 2024-04-12T09:11:16.246 INFO:tasks.workunit.client.0.smithi117.stdout:9/595: link d1/d8/df/d1b/l40 d1/d8/d12/lbc 0 2024-04-12T09:11:16.248 INFO:tasks.workunit.client.0.smithi117.stdout:3/912: write de/d2c/d59/d19/d27/f38 [3306603,34452] 0 2024-04-12T09:11:16.249 INFO:tasks.workunit.client.0.smithi117.stdout:9/596: truncate d1/d8/d5a/d79/d91/db0/d41/daf/d3b/f4c 13370000 0 2024-04-12T09:11:16.250 INFO:tasks.workunit.client.0.smithi117.stdout:1/579: rmdir d1/d6/d51 39 2024-04-12T09:11:16.253 INFO:tasks.workunit.client.0.smithi117.stdout:3/913: creat de/d2c/d59/d70/d3e/d5d/d89/f154 x:0 0 0 2024-04-12T09:11:16.254 INFO:tasks.workunit.client.0.smithi117.stdout:3/914: chown de/d2c/d59/d70/d3d/d63/de1/d106 985199642 1 2024-04-12T09:11:16.260 INFO:tasks.workunit.client.0.smithi117.stdout:9/597: link d1/d8/d5a/d6e/f7c d1/d8/d5e/d9f/fbd 0 2024-04-12T09:11:16.261 INFO:tasks.workunit.client.0.smithi117.stdout:3/915: dwrite de/d2c/d59/d70/d3e/d3f/f145 [0,4194304] 0 2024-04-12T09:11:16.262 INFO:tasks.workunit.client.0.smithi117.stdout:3/916: dread - de/d2c/f96 zero size 2024-04-12T09:11:16.265 INFO:tasks.workunit.client.0.smithi117.stdout:1/580: dread d1/d6/d3f/db/d16/f19 [4194304,4194304] 0 2024-04-12T09:11:16.266 INFO:tasks.workunit.client.0.smithi117.stdout:9/598: fsync d1/d8/d12/f20 0 2024-04-12T09:11:16.267 INFO:tasks.workunit.client.0.smithi117.stdout:1/581: chown d1/d64/d45/d4c/d63/da9/d9a/d54/fb0 719 1 2024-04-12T09:11:16.274 INFO:tasks.workunit.client.0.smithi117.stdout:9/599: mknod d1/d8/d5a/d79/d91/db0/d41/daf/cbe 0 2024-04-12T09:11:16.278 INFO:tasks.workunit.client.0.smithi117.stdout:1/582: symlink d1/d6/d3f/db/d1d/lb5 0 2024-04-12T09:11:16.286 INFO:tasks.workunit.client.0.smithi117.stdout:9/600: mkdir d1/d8/df/da2/dbf 0 2024-04-12T09:11:16.288 INFO:tasks.workunit.client.0.smithi117.stdout:3/917: link de/d2c/d59/c7a de/d2c/d59/d70/d3e/d5d/d80/d97/c155 0 2024-04-12T09:11:16.289 INFO:tasks.workunit.client.0.smithi117.stdout:1/583: dwrite d1/d6/d3f/db/d16/f19 [4194304,4194304] 0 2024-04-12T09:11:16.290 INFO:tasks.workunit.client.0.smithi117.stdout:9/601: creat d1/d8/d90/fc0 x:0 0 0 2024-04-12T09:11:16.295 INFO:tasks.workunit.client.0.smithi117.stdout:1/584: rename d1/d64/d45/d4c/d63 to d1/d6/d3f/db/d16/db6 0 2024-04-12T09:11:16.296 INFO:tasks.workunit.client.0.smithi117.stdout:3/918: truncate f2 274190 0 2024-04-12T09:11:16.298 INFO:tasks.workunit.client.0.smithi117.stdout:3/919: truncate de/d2c/d59/f117 640647 0 2024-04-12T09:11:16.301 INFO:tasks.workunit.client.0.smithi117.stdout:9/602: creat d1/d8/df/d68/fc1 x:0 0 0 2024-04-12T09:11:16.303 INFO:tasks.workunit.client.0.smithi117.stdout:3/920: mkdir de/d2c/d59/d70/d3e/d5d/d89/d123/d156 0 2024-04-12T09:11:16.303 INFO:tasks.workunit.client.0.smithi117.stdout:7/526: sync 2024-04-12T09:11:16.304 INFO:tasks.workunit.client.0.smithi117.stdout:5/711: sync 2024-04-12T09:11:16.304 INFO:tasks.workunit.client.0.smithi117.stdout:0/809: sync 2024-04-12T09:11:16.305 INFO:tasks.workunit.client.0.smithi117.stdout:7/527: chown d0/d2/d45/d53 27 1 2024-04-12T09:11:16.307 INFO:tasks.workunit.client.0.smithi117.stdout:9/603: dwrite d1/d8/d5a/d79/d91/db0/d41/daf/d3b/f4c [0,4194304] 0 2024-04-12T09:11:16.319 INFO:tasks.workunit.client.0.smithi117.stdout:7/528: mknod d0/d2/d45/d17/d23/d39/ca6 0 2024-04-12T09:11:16.319 INFO:tasks.workunit.client.0.smithi117.stdout:7/529: readlink d0/d2/d12/l97 0 2024-04-12T09:11:16.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:15 smithi203 ceph-mon[36428]: pgmap v18: 65 pgs: 65 active+clean; 1.2 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 33 MiB/s rd, 126 MiB/s wr, 327 op/s 2024-04-12T09:11:16.326 INFO:tasks.workunit.client.0.smithi117.stdout:1/585: getdents d1/d6/d3f/db/d16/db6 0 2024-04-12T09:11:16.328 INFO:tasks.workunit.client.0.smithi117.stdout:1/586: read d1/d6/d3f/db/f9e [906473,81030] 0 2024-04-12T09:11:16.328 INFO:tasks.workunit.client.0.smithi117.stdout:1/587: stat d1/d6/d3f/f9b 0 2024-04-12T09:11:16.329 INFO:tasks.workunit.client.0.smithi117.stdout:3/921: mkdir de/d2c/d59/d70/d3e/d5d/d89/d68/d116/d157 0 2024-04-12T09:11:16.330 INFO:tasks.workunit.client.0.smithi117.stdout:7/530: rmdir d0/d2/d45/d17/d23/d39 39 2024-04-12T09:11:16.334 INFO:tasks.workunit.client.0.smithi117.stdout:9/604: rename d1/d4b to d1/d8/d5a/dc2 0 2024-04-12T09:11:16.336 INFO:tasks.workunit.client.0.smithi117.stdout:5/712: creat d2/d3/de/fe9 x:0 0 0 2024-04-12T09:11:16.338 INFO:tasks.workunit.client.0.smithi117.stdout:0/810: dwrite d3/d47/fe0 [0,4194304] 0 2024-04-12T09:11:16.341 INFO:tasks.workunit.client.0.smithi117.stdout:3/922: chown de/d2c/d59/d19/d4f 713 1 2024-04-12T09:11:16.344 INFO:tasks.workunit.client.0.smithi117.stdout:1/588: dread d1/d6/d3f/db/f80 [0,4194304] 0 2024-04-12T09:11:16.345 INFO:tasks.workunit.client.0.smithi117.stdout:7/531: dread d0/d2/d45/f5a [0,4194304] 0 2024-04-12T09:11:16.353 INFO:tasks.workunit.client.0.smithi117.stdout:7/532: dwrite d0/d2/d1a/f24 [4194304,4194304] 0 2024-04-12T09:11:16.358 INFO:tasks.workunit.client.0.smithi117.stdout:1/589: chown d1/f4d 10 1 2024-04-12T09:11:16.359 INFO:tasks.workunit.client.0.smithi117.stdout:1/590: dread - d1/d6/fae zero size 2024-04-12T09:11:16.360 INFO:tasks.workunit.client.0.smithi117.stdout:9/605: fdatasync d1/d8/df/d3e/f9a 0 2024-04-12T09:11:16.367 INFO:tasks.workunit.client.0.smithi117.stdout:3/923: rename de/d2c/d59/d19/d4f/ce9 to de/d2c/d59/d70/d3e/d84/da1/df1/c158 0 2024-04-12T09:11:16.369 INFO:tasks.workunit.client.0.smithi117.stdout:3/924: write de/d2c/d59/d70/d3d/d63/de1/f138 [685624,100535] 0 2024-04-12T09:11:16.370 INFO:tasks.workunit.client.0.smithi117.stdout:5/713: write d2/f5d [403785,115075] 0 2024-04-12T09:11:16.372 INFO:tasks.workunit.client.0.smithi117.stdout:5/714: write d2/d3/dd/d39/d7a/fce [378421,114613] 0 2024-04-12T09:11:16.374 INFO:tasks.workunit.client.0.smithi117.stdout:7/533: mkdir d0/d2/d1a/da7 0 2024-04-12T09:11:16.374 INFO:tasks.workunit.client.0.smithi117.stdout:5/715: write d2/d3/dd/d39/d83/d4d/d52/f8e [3253384,13684] 0 2024-04-12T09:11:16.375 INFO:tasks.workunit.client.0.smithi117.stdout:7/534: chown d0/d2/d1a/d49 11 1 2024-04-12T09:11:16.375 INFO:tasks.workunit.client.0.smithi117.stdout:7/535: chown d0 1040841 1 2024-04-12T09:11:16.382 INFO:tasks.workunit.client.0.smithi117.stdout:3/925: getdents de/d2c/d59/d19/d14d 0 2024-04-12T09:11:16.383 INFO:tasks.workunit.client.0.smithi117.stdout:3/926: stat de/d2c/d59/d70/d3e/d5d/d89/dda/cf5 0 2024-04-12T09:11:16.385 INFO:tasks.workunit.client.0.smithi117.stdout:5/716: mkdir d2/d3/de/d1e/d46/de4/dea 0 2024-04-12T09:11:16.385 INFO:tasks.workunit.client.0.smithi117.stdout:1/591: write d1/f10 [323170,129368] 0 2024-04-12T09:11:16.386 INFO:tasks.workunit.client.0.smithi117.stdout:9/606: link d1/d8/df/d3e/fa4 d1/d8/d5a/d79/d91/fc3 0 2024-04-12T09:11:16.388 INFO:tasks.workunit.client.0.smithi117.stdout:5/717: truncate d2/d3/de/d1e/d35/fd4 928797 0 2024-04-12T09:11:16.389 INFO:tasks.workunit.client.0.smithi117.stdout:3/927: rename de/d2c/d59/d30 to de/d2c/d59/d70/d3d/d63/de1/d125/d159 0 2024-04-12T09:11:16.392 INFO:tasks.workunit.client.0.smithi117.stdout:1/592: dwrite d1/d6/d3f/fa5 [0,4194304] 0 2024-04-12T09:11:16.393 INFO:tasks.workunit.client.0.smithi117.stdout:5/718: symlink d2/d3/de/d1e/d2c/leb 0 2024-04-12T09:11:16.394 INFO:tasks.workunit.client.0.smithi117.stdout:5/719: write d2/f49 [1320662,77530] 0 2024-04-12T09:11:16.395 INFO:tasks.workunit.client.0.smithi117.stdout:9/607: link d1/d8/d5a/d6e/f9c d1/d8/d5a/d79/d91/fc4 0 2024-04-12T09:11:16.397 INFO:tasks.workunit.client.0.smithi117.stdout:3/928: mkdir de/d2c/d59/d70/d3e/d5d/d111/d15a 0 2024-04-12T09:11:16.400 INFO:tasks.workunit.client.0.smithi117.stdout:5/720: mkdir d2/d3/de/d1e/d79/dec 0 2024-04-12T09:11:16.400 INFO:tasks.workunit.client.0.smithi117.stdout:1/593: dwrite d1/d6/d3f/db/d16/f2f [0,4194304] 0 2024-04-12T09:11:16.402 INFO:tasks.workunit.client.0.smithi117.stdout:9/608: rename d1/d8/df/l48 to d1/d8/d5a/d79/d91/lc5 0 2024-04-12T09:11:16.406 INFO:tasks.workunit.client.0.smithi117.stdout:5/721: write d2/d3/de/f2a [798340,88128] 0 2024-04-12T09:11:16.407 INFO:tasks.workunit.client.0.smithi117.stdout:1/594: creat d1/d64/d45/d4c/d94/fb7 x:0 0 0 2024-04-12T09:11:16.409 INFO:tasks.workunit.client.0.smithi117.stdout:5/722: read - d2/d3/de/d1e/d46/d96/fbb zero size 2024-04-12T09:11:16.411 INFO:tasks.workunit.client.0.smithi117.stdout:1/595: write d1/d6/d51/f81 [3178108,16809] 0 2024-04-12T09:11:16.413 INFO:tasks.workunit.client.0.smithi117.stdout:1/596: dread - d1/d6/d3f/db/d16/db6/da9/d9a/d54/f86 zero size 2024-04-12T09:11:16.413 INFO:tasks.workunit.client.1.smithi203.stderr:++ readlink -f fsstress 2024-04-12T09:11:16.414 INFO:tasks.workunit.client.1.smithi203.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-12T09:11:16.415 INFO:tasks.workunit.client.1.smithi203.stderr:+ popd 2024-04-12T09:11:16.415 INFO:tasks.workunit.client.0.smithi117.stdout:5/723: unlink d2/d3/f15 0 2024-04-12T09:11:16.415 INFO:tasks.workunit.client.1.smithi203.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-12T09:11:16.416 INFO:tasks.workunit.client.1.smithi203.stderr:+ popd 2024-04-12T09:11:16.416 INFO:tasks.workunit.client.1.smithi203.stdout:~/cephtest/mnt.1/client.1/tmp 2024-04-12T09:11:16.416 INFO:tasks.workunit.client.1.smithi203.stderr:++ mktemp -d -p . 2024-04-12T09:11:16.421 INFO:tasks.workunit.client.0.smithi117.stdout:7/536: dwrite d0/d2/d45/d17/d23/d39/f78 [0,4194304] 0 2024-04-12T09:11:16.423 INFO:tasks.workunit.client.1.smithi203.stderr:+ T=./tmp.p7ILWHDxgp 2024-04-12T09:11:16.423 INFO:tasks.workunit.client.1.smithi203.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.p7ILWHDxgp -l 1 -n 1000 -p 10 -v 2024-04-12T09:11:16.424 INFO:tasks.workunit.client.0.smithi117.stdout:9/609: getdents d1/d8/d52/d99 0 2024-04-12T09:11:16.424 INFO:tasks.workunit.client.0.smithi117.stdout:5/724: dwrite d2/d3/dd/d39/d83/fc4 [0,4194304] 0 2024-04-12T09:11:16.426 INFO:tasks.workunit.client.0.smithi117.stdout:9/610: fsync d1/d8/d5a/d6e/d71/f72 0 2024-04-12T09:11:16.428 INFO:tasks.workunit.client.0.smithi117.stdout:1/597: fsync d1/d3b/f98 0 2024-04-12T09:11:16.432 INFO:tasks.workunit.client.0.smithi117.stdout:3/929: dread de/d2c/d59/d70/d3e/d5d/f64 [0,4194304] 0 2024-04-12T09:11:16.435 INFO:tasks.workunit.client.1.smithi203.stdout:seed = 1713265765 2024-04-12T09:11:16.439 INFO:tasks.workunit.client.0.smithi117.stdout:1/598: symlink d1/d6/d3f/db/d16/db6/da9/d9a/d54/lb8 0 2024-04-12T09:11:16.441 INFO:tasks.workunit.client.0.smithi117.stdout:3/930: mkdir de/d2c/d59/d70/d3e/d5d/d80/d15b 0 2024-04-12T09:11:16.442 INFO:tasks.workunit.client.0.smithi117.stdout:5/725: creat d2/d3/dd/d39/d82/dd6/fed x:0 0 0 2024-04-12T09:11:16.443 INFO:tasks.workunit.client.1.smithi203.stdout:1/0: truncate - no filename 2024-04-12T09:11:16.443 INFO:tasks.workunit.client.1.smithi203.stdout:1/1: unlink - no file 2024-04-12T09:11:16.443 INFO:tasks.workunit.client.1.smithi203.stdout:1/2: rmdir - no directory 2024-04-12T09:11:16.443 INFO:tasks.workunit.client.1.smithi203.stdout:1/3: dwrite - no filename 2024-04-12T09:11:16.443 INFO:tasks.workunit.client.1.smithi203.stdout:1/4: write - no filename 2024-04-12T09:11:16.443 INFO:tasks.workunit.client.1.smithi203.stdout:1/5: rename - no filename 2024-04-12T09:11:16.444 INFO:tasks.workunit.client.1.smithi203.stdout:1/6: fdatasync - no filename 2024-04-12T09:11:16.444 INFO:tasks.workunit.client.0.smithi117.stdout:5/726: read - d2/d3/dd/d39/d83/d4d/fd8 zero size 2024-04-12T09:11:16.445 INFO:tasks.workunit.client.0.smithi117.stdout:5/727: chown d2/d3/dd/d39/d83/d4d/d6b/da5/la6 1 1 2024-04-12T09:11:16.445 INFO:tasks.workunit.client.1.smithi203.stdout:0/0: mkdir d0 0 2024-04-12T09:11:16.445 INFO:tasks.workunit.client.1.smithi203.stdout:0/1: unlink - no file 2024-04-12T09:11:16.445 INFO:tasks.workunit.client.1.smithi203.stdout:0/2: fsync - no filename 2024-04-12T09:11:16.445 INFO:tasks.workunit.client.1.smithi203.stdout:0/3: truncate - no filename 2024-04-12T09:11:16.446 INFO:tasks.workunit.client.0.smithi117.stdout:5/728: write d2/d3/de/fc0 [744012,87503] 0 2024-04-12T09:11:16.446 INFO:tasks.workunit.client.0.smithi117.stdout:1/599: chown d1/d6/d3f/db/d16/db6/da9/d9a/c3c 0 1 2024-04-12T09:11:16.447 INFO:tasks.workunit.client.1.smithi203.stdout:2/0: fsync - no filename 2024-04-12T09:11:16.449 INFO:tasks.workunit.client.0.smithi117.stdout:7/537: getdents d0/d2/d1a/d4f 0 2024-04-12T09:11:16.451 INFO:tasks.workunit.client.0.smithi117.stdout:5/729: dread d2/d3/dd/d39/d83/fc4 [0,4194304] 0 2024-04-12T09:11:16.452 INFO:tasks.workunit.client.1.smithi203.stdout:3/0: dread - no filename 2024-04-12T09:11:16.452 INFO:tasks.workunit.client.1.smithi203.stdout:3/1: dread - no filename 2024-04-12T09:11:16.452 INFO:tasks.workunit.client.1.smithi203.stdout:3/2: unlink - no file 2024-04-12T09:11:16.453 INFO:tasks.workunit.client.1.smithi203.stdout:3/3: fdatasync - no filename 2024-04-12T09:11:16.453 INFO:tasks.workunit.client.1.smithi203.stdout:3/4: dread - no filename 2024-04-12T09:11:16.453 INFO:tasks.workunit.client.1.smithi203.stdout:3/5: dread - no filename 2024-04-12T09:11:16.453 INFO:tasks.workunit.client.1.smithi203.stdout:3/6: chown . 25 1 2024-04-12T09:11:16.453 INFO:tasks.workunit.client.1.smithi203.stdout:3/7: readlink - no filename 2024-04-12T09:11:16.453 INFO:tasks.workunit.client.1.smithi203.stdout:3/8: unlink - no file 2024-04-12T09:11:16.453 INFO:tasks.workunit.client.1.smithi203.stdout:3/9: fdatasync - no filename 2024-04-12T09:11:16.456 INFO:tasks.workunit.client.0.smithi117.stdout:7/538: unlink d0/da/d7c/c86 0 2024-04-12T09:11:16.456 INFO:tasks.workunit.client.0.smithi117.stdout:9/611: dread d1/d8/d5a/d79/d91/db0/d41/daf/f6f [0,4194304] 0 2024-04-12T09:11:16.457 INFO:tasks.workunit.client.1.smithi203.stdout:1/7: mknod c0 0 2024-04-12T09:11:16.457 INFO:tasks.workunit.client.1.smithi203.stdout:1/8: dread - no filename 2024-04-12T09:11:16.457 INFO:tasks.workunit.client.1.smithi203.stdout:1/9: write - no filename 2024-04-12T09:11:16.457 INFO:tasks.workunit.client.1.smithi203.stdout:1/10: rmdir - no directory 2024-04-12T09:11:16.457 INFO:tasks.workunit.client.1.smithi203.stdout:1/11: dread - no filename 2024-04-12T09:11:16.458 INFO:tasks.workunit.client.1.smithi203.stdout:0/4: symlink d0/l1 0 2024-04-12T09:11:16.459 INFO:tasks.workunit.client.0.smithi117.stdout:2/541: sync 2024-04-12T09:11:16.459 INFO:tasks.workunit.client.0.smithi117.stdout:6/658: sync 2024-04-12T09:11:16.460 INFO:tasks.workunit.client.0.smithi117.stdout:4/676: sync 2024-04-12T09:11:16.460 INFO:tasks.workunit.client.0.smithi117.stdout:8/627: sync 2024-04-12T09:11:16.462 INFO:tasks.workunit.client.0.smithi117.stdout:6/659: fsync d8/d3f/faa 0 2024-04-12T09:11:16.462 INFO:tasks.workunit.client.0.smithi117.stdout:2/542: fsync d0/d4/f54 0 2024-04-12T09:11:16.462 INFO:tasks.workunit.client.0.smithi117.stdout:8/628: chown db/d1b/f3c 24 1 2024-04-12T09:11:16.462 INFO:tasks.workunit.client.0.smithi117.stdout:3/931: dread de/d2c/d59/d70/d3e/d5d/d80/ffb [0,4194304] 0 2024-04-12T09:11:16.463 INFO:tasks.workunit.client.1.smithi203.stdout:2/1: mkdir d0 0 2024-04-12T09:11:16.465 INFO:tasks.workunit.client.1.smithi203.stdout:2/2: dread - no filename 2024-04-12T09:11:16.465 INFO:tasks.workunit.client.1.smithi203.stdout:2/3: read - no filename 2024-04-12T09:11:16.465 INFO:tasks.workunit.client.1.smithi203.stdout:2/4: stat d0 0 2024-04-12T09:11:16.466 INFO:tasks.workunit.client.0.smithi117.stdout:8/629: write db/f61 [624391,49493] 0 2024-04-12T09:11:16.466 INFO:tasks.workunit.client.0.smithi117.stdout:7/539: rmdir d0/d2/d1a/d5f 39 2024-04-12T09:11:16.466 INFO:tasks.workunit.client.0.smithi117.stdout:9/612: dwrite d1/d8/d5a/d79/d91/db0/d41/fa7 [0,4194304] 0 2024-04-12T09:11:16.467 INFO:tasks.workunit.client.0.smithi117.stdout:8/630: fdatasync db/d1b/fb0 0 2024-04-12T09:11:16.469 INFO:tasks.workunit.client.1.smithi203.stdout:1/12: mknod c1 0 2024-04-12T09:11:16.469 INFO:tasks.workunit.client.1.smithi203.stdout:1/13: truncate - no filename 2024-04-12T09:11:16.469 INFO:tasks.workunit.client.1.smithi203.stdout:1/14: truncate - no filename 2024-04-12T09:11:16.469 INFO:tasks.workunit.client.0.smithi117.stdout:3/932: dread de/d2c/d59/d4c/da0/fb9 [0,4194304] 0 2024-04-12T09:11:16.471 INFO:tasks.workunit.client.0.smithi117.stdout:1/600: rename d1/d6/d3f/fa5 to d1/d6/d3f/db/d16/db6/da9/d9a/fb9 0 2024-04-12T09:11:16.472 INFO:tasks.workunit.client.1.smithi203.stdout:0/5: symlink d0/l2 0 2024-04-12T09:11:16.472 INFO:tasks.workunit.client.1.smithi203.stdout:0/6: write - no filename 2024-04-12T09:11:16.472 INFO:tasks.workunit.client.1.smithi203.stdout:0/7: truncate - no filename 2024-04-12T09:11:16.475 INFO:tasks.workunit.client.1.smithi203.stdout:5/0: rename - no filename 2024-04-12T09:11:16.475 INFO:tasks.workunit.client.1.smithi203.stdout:5/1: rmdir - no directory 2024-04-12T09:11:16.475 INFO:tasks.workunit.client.0.smithi117.stdout:5/730: mknod d2/d3/de/d1e/d79/dec/cee 0 2024-04-12T09:11:16.478 INFO:tasks.workunit.client.1.smithi203.stdout:3/10: getdents . 0 2024-04-12T09:11:16.478 INFO:tasks.workunit.client.1.smithi203.stdout:3/11: truncate - no filename 2024-04-12T09:11:16.479 INFO:tasks.workunit.client.1.smithi203.stdout:1/15: symlink l2 0 2024-04-12T09:11:16.479 INFO:tasks.workunit.client.1.smithi203.stdout:1/16: dwrite - no filename 2024-04-12T09:11:16.479 INFO:tasks.workunit.client.1.smithi203.stdout:1/17: write - no filename 2024-04-12T09:11:16.480 INFO:tasks.workunit.client.1.smithi203.stdout:1/18: rmdir - no directory 2024-04-12T09:11:16.481 INFO:tasks.workunit.client.1.smithi203.stdout:0/8: creat d0/f3 x:0 0 0 2024-04-12T09:11:16.481 INFO:tasks.workunit.client.1.smithi203.stdout:0/9: chown d0 7122413 1 2024-04-12T09:11:16.484 INFO:tasks.workunit.client.1.smithi203.stdout:4/0: symlink l0 0 2024-04-12T09:11:16.484 INFO:tasks.workunit.client.0.smithi117.stdout:6/660: dwrite d8/d3a/d49/f83 [0,4194304] 0 2024-04-12T09:11:16.489 INFO:tasks.workunit.client.0.smithi117.stdout:1/601: rename d1/d6/d3f/db/d16/db6/da9/d9a/d71/lb1 to d1/db3/lba 0 2024-04-12T09:11:16.490 INFO:tasks.workunit.client.0.smithi117.stdout:4/677: symlink d0/d5/d3b/d38/d4f/dce/lde 0 2024-04-12T09:11:16.493 INFO:tasks.workunit.client.0.smithi117.stdout:9/613: unlink d1/d8/df/d3e/f36 0 2024-04-12T09:11:16.498 INFO:tasks.workunit.client.0.smithi117.stdout:4/678: symlink d0/db3/da7/ldf 0 2024-04-12T09:11:16.500 INFO:tasks.workunit.client.0.smithi117.stdout:6/661: mkdir d8/d9/dce 0 2024-04-12T09:11:16.502 INFO:tasks.workunit.client.0.smithi117.stdout:5/731: creat d2/d3/dd/d39/d83/d4d/d6b/fef x:0 0 0 2024-04-12T09:11:16.506 INFO:tasks.workunit.client.0.smithi117.stdout:8/631: dwrite db/d13/f91 [4194304,4194304] 0 2024-04-12T09:11:16.506 INFO:tasks.workunit.client.0.smithi117.stdout:3/933: getdents de/d2c/d59/d70/d3e/d5d/d80/d97/d9a 0 2024-04-12T09:11:16.506 INFO:tasks.workunit.client.0.smithi117.stdout:6/662: chown d8/d2a/d60/d7d/c91 3306987 1 2024-04-12T09:11:16.506 INFO:tasks.workunit.client.0.smithi117.stdout:1/602: dwrite d1/d6/f1a [4194304,4194304] 0 2024-04-12T09:11:16.508 INFO:tasks.workunit.client.0.smithi117.stdout:8/632: write db/d19/f5f [4284392,97816] 0 2024-04-12T09:11:16.509 INFO:tasks.workunit.client.0.smithi117.stdout:9/614: rename d1/d8/d5a/d79/d91/lb3 to d1/d8/df/lc6 0 2024-04-12T09:11:16.511 INFO:tasks.workunit.client.0.smithi117.stdout:1/603: rmdir d1/d64 39 2024-04-12T09:11:16.511 INFO:tasks.workunit.client.0.smithi117.stdout:4/679: dread d0/d5/f3f [0,4194304] 0 2024-04-12T09:11:16.511 INFO:tasks.workunit.client.0.smithi117.stdout:6/663: read d8/d9/f1f [500124,122466] 0 2024-04-12T09:11:16.512 INFO:tasks.workunit.client.0.smithi117.stdout:3/934: read - de/d2c/d59/d19/f7f zero size 2024-04-12T09:11:16.513 INFO:tasks.workunit.client.0.smithi117.stdout:5/732: mkdir d2/d3/dd/d39/d83/dc8/dd1/dd2/df0 0 2024-04-12T09:11:16.515 INFO:tasks.workunit.client.0.smithi117.stdout:9/615: creat d1/d8/df/d68/fc7 x:0 0 0 2024-04-12T09:11:16.516 INFO:tasks.workunit.client.1.smithi203.stdout:5/2: mkdir d0 0 2024-04-12T09:11:16.516 INFO:tasks.workunit.client.1.smithi203.stdout:5/3: write - no filename 2024-04-12T09:11:16.516 INFO:tasks.workunit.client.0.smithi117.stdout:5/733: write d2/d3/dd/d39/d83/d4d/d52/f8e [132786,24176] 0 2024-04-12T09:11:16.517 INFO:tasks.workunit.client.1.smithi203.stdout:3/12: mknod c0 0 2024-04-12T09:11:16.517 INFO:tasks.workunit.client.0.smithi117.stdout:1/604: creat d1/d6/d3f/d72/fbb x:0 0 0 2024-04-12T09:11:16.519 INFO:tasks.workunit.client.0.smithi117.stdout:6/664: rename f2 to d8/d2a/fcf 0 2024-04-12T09:11:16.519 INFO:tasks.workunit.client.0.smithi117.stdout:5/734: truncate d2/d3/dd/d39/d83/d74/fb8 379005 0 2024-04-12T09:11:16.520 INFO:tasks.workunit.client.0.smithi117.stdout:5/735: chown d2/fb6 1106426440 1 2024-04-12T09:11:16.521 INFO:tasks.workunit.client.0.smithi117.stdout:3/935: write de/f8e [1509674,79760] 0 2024-04-12T09:11:16.522 INFO:tasks.workunit.client.1.smithi203.stdout:0/10: dwrite d0/f3 [0,4194304] 0 2024-04-12T09:11:16.522 INFO:tasks.workunit.client.1.smithi203.stdout:6/0: creat f0 x:0 0 0 2024-04-12T09:11:16.523 INFO:tasks.workunit.client.1.smithi203.stdout:8/0: dread - no filename 2024-04-12T09:11:16.523 INFO:tasks.workunit.client.1.smithi203.stdout:8/1: rmdir - no directory 2024-04-12T09:11:16.524 INFO:tasks.workunit.client.1.smithi203.stdout:8/2: dread - no filename 2024-04-12T09:11:16.524 INFO:tasks.workunit.client.1.smithi203.stdout:8/3: chown . 19886 1 2024-04-12T09:11:16.524 INFO:tasks.workunit.client.1.smithi203.stdout:8/4: dwrite - no filename 2024-04-12T09:11:16.528 INFO:tasks.workunit.client.1.smithi203.stdout:3/13: creat f1 x:0 0 0 2024-04-12T09:11:16.529 INFO:tasks.workunit.client.0.smithi117.stdout:6/665: dwrite d8/d3a/fc7 [0,4194304] 0 2024-04-12T09:11:16.529 INFO:tasks.workunit.client.1.smithi203.stdout:0/11: dread d0/f3 [0,4194304] 0 2024-04-12T09:11:16.530 INFO:tasks.workunit.client.1.smithi203.stdout:0/12: write d0/f3 [4134010,18228] 0 2024-04-12T09:11:16.532 INFO:tasks.workunit.client.0.smithi117.stdout:1/605: stat d1/d64/d45/d4c/d94 0 2024-04-12T09:11:16.534 INFO:tasks.workunit.client.1.smithi203.stdout:9/0: stat - no entries 2024-04-12T09:11:16.534 INFO:tasks.workunit.client.1.smithi203.stdout:9/1: chown . 29220 1 2024-04-12T09:11:16.535 INFO:tasks.workunit.client.0.smithi117.stdout:8/633: creat db/d19/d1a/d3d/fcf x:0 0 0 2024-04-12T09:11:16.535 INFO:tasks.workunit.client.0.smithi117.stdout:1/606: chown d1/d6/d3f/db/d1d/d7b 45 1 2024-04-12T09:11:16.535 INFO:tasks.workunit.client.0.smithi117.stdout:8/634: readlink db/da6/lc1 0 2024-04-12T09:11:16.536 INFO:tasks.workunit.client.0.smithi117.stdout:8/635: stat db/d19/d1a/d3d/d60/f9b 0 2024-04-12T09:11:16.538 INFO:tasks.workunit.client.1.smithi203.stdout:5/4: mknod d0/c1 0 2024-04-12T09:11:16.539 INFO:tasks.workunit.client.1.smithi203.stdout:7/0: mkdir d0 0 2024-04-12T09:11:16.540 INFO:tasks.workunit.client.1.smithi203.stdout:7/1: chown d0 2863682 1 2024-04-12T09:11:16.540 INFO:tasks.workunit.client.1.smithi203.stdout:7/2: write - no filename 2024-04-12T09:11:16.541 INFO:tasks.workunit.client.1.smithi203.stdout:0/13: unlink d0/l2 0 2024-04-12T09:11:16.542 INFO:tasks.workunit.client.0.smithi117.stdout:5/736: mkdir d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1 0 2024-04-12T09:11:16.543 INFO:tasks.workunit.client.0.smithi117.stdout:1/607: dwrite d1/d6/d51/f81 [0,4194304] 0 2024-04-12T09:11:16.544 INFO:tasks.workunit.client.0.smithi117.stdout:4/680: rename d0/d5/f8 to d0/d2c/d8d/fe0 0 2024-04-12T09:11:16.546 INFO:tasks.workunit.client.0.smithi117.stdout:6/666: rmdir d8/d3a/d49/da4 39 2024-04-12T09:11:16.547 INFO:tasks.workunit.client.0.smithi117.stdout:6/667: write d8/d3a/fa8 [7622384,55530] 0 2024-04-12T09:11:16.548 INFO:tasks.workunit.client.0.smithi117.stdout:6/668: dread - d8/d9/d17/d33/fc4 zero size 2024-04-12T09:11:16.550 INFO:tasks.workunit.client.1.smithi203.stdout:8/5: symlink l0 0 2024-04-12T09:11:16.550 INFO:tasks.workunit.client.1.smithi203.stdout:8/6: dwrite - no filename 2024-04-12T09:11:16.551 INFO:tasks.workunit.client.0.smithi117.stdout:8/636: readlink db/d19/d1a/d3d/l37 0 2024-04-12T09:11:16.552 INFO:tasks.workunit.client.1.smithi203.stdout:5/5: mkdir d0/d2 0 2024-04-12T09:11:16.553 INFO:tasks.workunit.client.1.smithi203.stdout:1/19: getdents . 0 2024-04-12T09:11:16.553 INFO:tasks.workunit.client.1.smithi203.stdout:1/20: stat c1 0 2024-04-12T09:11:16.553 INFO:tasks.workunit.client.1.smithi203.stdout:1/21: fdatasync - no filename 2024-04-12T09:11:16.556 INFO:tasks.workunit.client.1.smithi203.stdout:0/14: write d0/f3 [3501677,126220] 0 2024-04-12T09:11:16.556 INFO:tasks.workunit.client.1.smithi203.stdout:9/2: symlink l0 0 2024-04-12T09:11:16.556 INFO:tasks.workunit.client.1.smithi203.stdout:9/3: dread - no filename 2024-04-12T09:11:16.556 INFO:tasks.workunit.client.1.smithi203.stdout:9/4: fsync - no filename 2024-04-12T09:11:16.557 INFO:tasks.workunit.client.1.smithi203.stdout:0/15: chown d0 0 1 2024-04-12T09:11:16.558 INFO:tasks.workunit.client.1.smithi203.stdout:8/7: symlink l1 0 2024-04-12T09:11:16.561 INFO:tasks.workunit.client.0.smithi117.stdout:1/608: mkdir d1/d6/d3f/db/d1d/d78/dbc 0 2024-04-12T09:11:16.562 INFO:tasks.workunit.client.1.smithi203.stdout:7/3: mknod d0/c1 0 2024-04-12T09:11:16.562 INFO:tasks.workunit.client.1.smithi203.stdout:7/4: fsync - no filename 2024-04-12T09:11:16.564 INFO:tasks.workunit.client.1.smithi203.stdout:0/16: fsync d0/f3 0 2024-04-12T09:11:16.564 INFO:tasks.workunit.client.1.smithi203.stdout:1/22: creat f3 x:0 0 0 2024-04-12T09:11:16.565 INFO:tasks.workunit.client.1.smithi203.stdout:1/23: chown f3 1474 1 2024-04-12T09:11:16.565 INFO:tasks.workunit.client.1.smithi203.stdout:1/24: readlink l2 0 2024-04-12T09:11:16.567 INFO:tasks.workunit.client.1.smithi203.stdout:9/5: rename l0 to l1 0 2024-04-12T09:11:16.567 INFO:tasks.workunit.client.1.smithi203.stdout:9/6: dwrite - no filename 2024-04-12T09:11:16.568 INFO:tasks.workunit.client.0.smithi117.stdout:2/543: dwrite d0/d43/d30/f47 [0,4194304] 0 2024-04-12T09:11:16.569 INFO:tasks.workunit.client.0.smithi117.stdout:8/637: mknod db/d4b/cd0 0 2024-04-12T09:11:16.573 INFO:tasks.workunit.client.1.smithi203.stdout:8/8: symlink l2 0 2024-04-12T09:11:16.576 INFO:tasks.workunit.client.1.smithi203.stdout:5/6: mknod d0/d2/c3 0 2024-04-12T09:11:16.578 INFO:tasks.workunit.client.1.smithi203.stdout:7/5: creat d0/f2 x:0 0 0 2024-04-12T09:11:16.579 INFO:tasks.workunit.client.1.smithi203.stdout:0/17: creat d0/f4 x:0 0 0 2024-04-12T09:11:16.586 INFO:tasks.workunit.client.1.smithi203.stdout:8/9: creat f3 x:0 0 0 2024-04-12T09:11:16.589 INFO:tasks.workunit.client.0.smithi117.stdout:3/936: dwrite de/d2c/d59/d70/d3e/d84/f88 [0,4194304] 0 2024-04-12T09:11:16.589 INFO:tasks.workunit.client.1.smithi203.stdout:5/7: creat d0/f4 x:0 0 0 2024-04-12T09:11:16.589 INFO:tasks.workunit.client.1.smithi203.stdout:5/8: read - d0/f4 zero size 2024-04-12T09:11:16.590 INFO:tasks.workunit.client.1.smithi203.stdout:5/9: write d0/f4 [284128,90201] 0 2024-04-12T09:11:16.591 INFO:tasks.workunit.client.0.smithi117.stdout:5/737: creat d2/d3/dd/d39/d83/ff2 x:0 0 0 2024-04-12T09:11:16.593 INFO:tasks.workunit.client.0.smithi117.stdout:5/738: stat d2/d3/de/d1e/d46 0 2024-04-12T09:11:16.593 INFO:tasks.workunit.client.1.smithi203.stdout:7/6: mknod d0/c3 0 2024-04-12T09:11:16.593 INFO:tasks.workunit.client.1.smithi203.stdout:7/7: chown d0 3 1 2024-04-12T09:11:16.594 INFO:tasks.workunit.client.0.smithi117.stdout:8/638: dread db/da6/fad [0,4194304] 0 2024-04-12T09:11:16.596 INFO:tasks.workunit.client.0.smithi117.stdout:8/639: dread - db/d19/d1a/d3d/d60/d70/d98/fab zero size 2024-04-12T09:11:16.596 INFO:tasks.workunit.client.1.smithi203.stdout:0/18: mkdir d0/d5 0 2024-04-12T09:11:16.599 INFO:tasks.workunit.client.1.smithi203.stdout:1/25: link f3 f4 0 2024-04-12T09:11:16.601 INFO:tasks.workunit.client.0.smithi117.stdout:9/616: truncate d1/d8/df/d3e/d92/fa0 123450 0 2024-04-12T09:11:16.602 INFO:tasks.workunit.client.0.smithi117.stdout:8/640: dwrite db/d19/d1a/d3d/f7f [0,4194304] 0 2024-04-12T09:11:16.602 INFO:tasks.workunit.client.1.smithi203.stdout:8/10: mkdir d4 0 2024-04-12T09:11:16.602 INFO:tasks.workunit.client.1.smithi203.stdout:8/11: truncate f3 149943 0 2024-04-12T09:11:16.603 INFO:tasks.workunit.client.1.smithi203.stdout:8/12: dread f3 [0,4194304] 0 2024-04-12T09:11:16.605 INFO:tasks.workunit.client.1.smithi203.stdout:5/10: rename d0/c1 to d0/d2/c5 0 2024-04-12T09:11:16.607 INFO:tasks.workunit.client.1.smithi203.stdout:7/8: mkdir d0/d4 0 2024-04-12T09:11:16.608 INFO:tasks.workunit.client.0.smithi117.stdout:7/540: sync 2024-04-12T09:11:16.608 INFO:tasks.workunit.client.0.smithi117.stdout:0/811: sync 2024-04-12T09:11:16.609 INFO:tasks.workunit.client.0.smithi117.stdout:7/541: fdatasync d0/d2/d45/d17/f21 0 2024-04-12T09:11:16.612 INFO:tasks.workunit.client.1.smithi203.stdout:1/26: mknod c5 0 2024-04-12T09:11:16.617 INFO:tasks.workunit.client.0.smithi117.stdout:1/609: rename d1/d6 to d1/dbd 0 2024-04-12T09:11:16.619 INFO:tasks.workunit.client.0.smithi117.stdout:4/681: dwrite d0/db3/da7/fd4 [0,4194304] 0 2024-04-12T09:11:16.621 INFO:tasks.workunit.client.0.smithi117.stdout:9/617: creat d1/d8/df/d3e/d92/fc8 x:0 0 0 2024-04-12T09:11:16.626 INFO:tasks.workunit.client.0.smithi117.stdout:1/610: dwrite d1/fa3 [0,4194304] 0 2024-04-12T09:11:16.626 INFO:tasks.workunit.client.1.smithi203.stdout:0/19: getdents d0/d5 0 2024-04-12T09:11:16.628 INFO:tasks.workunit.client.0.smithi117.stdout:7/542: dread d0/f1b [0,4194304] 0 2024-04-12T09:11:16.630 INFO:tasks.workunit.client.1.smithi203.stdout:9/7: rename l1 to l2 0 2024-04-12T09:11:16.633 INFO:tasks.workunit.client.1.smithi203.stdout:1/27: mknod c6 0 2024-04-12T09:11:16.636 INFO:tasks.workunit.client.0.smithi117.stdout:2/544: write d0/d96/fb7 [809160,22632] 0 2024-04-12T09:11:16.637 INFO:tasks.workunit.client.0.smithi117.stdout:0/812: symlink d3/da2/dee/dd5/dff/d91/d94/d5a/d62/d66/d73/l10a 0 2024-04-12T09:11:16.637 INFO:tasks.workunit.client.1.smithi203.stdout:5/11: rmdir d0 39 2024-04-12T09:11:16.638 INFO:tasks.workunit.client.0.smithi117.stdout:0/813: fdatasync d3/da2/dee/dd5/dff/d91/f45 0 2024-04-12T09:11:16.638 INFO:tasks.workunit.client.1.smithi203.stdout:8/13: mknod d4/c5 0 2024-04-12T09:11:16.639 INFO:tasks.workunit.client.1.smithi203.stdout:8/14: stat l1 0 2024-04-12T09:11:16.640 INFO:tasks.workunit.client.0.smithi117.stdout:3/937: write de/d2c/d59/d4c/da0/fb9 [1472532,55653] 0 2024-04-12T09:11:16.641 INFO:tasks.workunit.client.0.smithi117.stdout:5/739: symlink d2/d3/dd/d39/d83/d4d/d6b/lf3 0 2024-04-12T09:11:16.643 INFO:tasks.workunit.client.0.smithi117.stdout:6/669: getdents d8/d3a/d49/da4/d8a 0 2024-04-12T09:11:16.645 INFO:tasks.workunit.client.1.smithi203.stdout:9/8: creat f3 x:0 0 0 2024-04-12T09:11:16.647 INFO:tasks.workunit.client.1.smithi203.stdout:1/28: creat f7 x:0 0 0 2024-04-12T09:11:16.648 INFO:tasks.workunit.client.0.smithi117.stdout:3/938: dwrite de/d2c/d59/d70/d3e/d5d/d80/d97/d9a/d103/f14f [0,4194304] 0 2024-04-12T09:11:16.652 INFO:tasks.workunit.client.1.smithi203.stdout:8/15: creat d4/f6 x:0 0 0 2024-04-12T09:11:16.653 INFO:tasks.workunit.client.1.smithi203.stdout:7/9: link d0/c1 d0/c5 0 2024-04-12T09:11:16.654 INFO:tasks.workunit.client.1.smithi203.stdout:7/10: chown d0/f2 3434 1 2024-04-12T09:11:16.654 INFO:tasks.workunit.client.0.smithi117.stdout:9/618: truncate d1/d8/d12/f20 1736819 0 2024-04-12T09:11:16.655 INFO:tasks.workunit.client.1.smithi203.stdout:7/11: write d0/f2 [108,122464] 0 2024-04-12T09:11:16.656 INFO:tasks.workunit.client.1.smithi203.stdout:7/12: write d0/f2 [561881,40300] 0 2024-04-12T09:11:16.656 INFO:tasks.workunit.client.1.smithi203.stdout:0/20: link d0/f4 d0/d5/f6 0 2024-04-12T09:11:16.658 INFO:tasks.workunit.client.0.smithi117.stdout:7/543: mkdir d0/da/da8 0 2024-04-12T09:11:16.659 INFO:tasks.workunit.client.0.smithi117.stdout:9/619: dread d1/d8/d5a/dc2/f55 [0,4194304] 0 2024-04-12T09:11:16.661 INFO:tasks.workunit.client.1.smithi203.stdout:1/29: symlink l8 0 2024-04-12T09:11:16.662 INFO:tasks.workunit.client.0.smithi117.stdout:8/641: write db/d19/d1a/d3d/f47 [1446995,101871] 0 2024-04-12T09:11:16.662 INFO:tasks.workunit.client.1.smithi203.stdout:1/30: dread - f3 zero size 2024-04-12T09:11:16.662 INFO:tasks.workunit.client.1.smithi203.stdout:1/31: read - f3 zero size 2024-04-12T09:11:16.663 INFO:tasks.workunit.client.1.smithi203.stdout:7/13: fdatasync d0/f2 0 2024-04-12T09:11:16.663 INFO:tasks.workunit.client.1.smithi203.stdout:7/14: readlink - no filename 2024-04-12T09:11:16.664 INFO:tasks.workunit.client.1.smithi203.stdout:8/16: creat d4/f7 x:0 0 0 2024-04-12T09:11:16.665 INFO:tasks.workunit.client.0.smithi117.stdout:0/814: unlink d3/da2/dee/d76/fb7 0 2024-04-12T09:11:16.666 INFO:tasks.workunit.client.0.smithi117.stdout:5/740: rmdir d2/d3/dd/d39 39 2024-04-12T09:11:16.669 INFO:tasks.workunit.client.0.smithi117.stdout:4/682: symlink d0/db3/daf/le1 0 2024-04-12T09:11:16.671 INFO:tasks.workunit.client.1.smithi203.stdout:1/32: creat f9 x:0 0 0 2024-04-12T09:11:16.673 INFO:tasks.workunit.client.1.smithi203.stdout:7/15: unlink d0/c3 0 2024-04-12T09:11:16.675 INFO:tasks.workunit.client.0.smithi117.stdout:1/611: mkdir d1/dbe 0 2024-04-12T09:11:16.676 INFO:tasks.workunit.client.1.smithi203.stdout:7/16: write d0/f2 [241753,40571] 0 2024-04-12T09:11:16.678 INFO:tasks.workunit.client.0.smithi117.stdout:1/612: dread d1/fa3 [0,4194304] 0 2024-04-12T09:11:16.679 INFO:tasks.workunit.client.1.smithi203.stdout:1/33: unlink c0 0 2024-04-12T09:11:16.681 INFO:tasks.workunit.client.0.smithi117.stdout:7/544: rmdir d0/d2 39 2024-04-12T09:11:16.683 INFO:tasks.workunit.client.1.smithi203.stdout:7/17: dwrite d0/f2 [0,4194304] 0 2024-04-12T09:11:16.685 INFO:tasks.workunit.client.0.smithi117.stdout:2/545: unlink d0/d43/d30/c44 0 2024-04-12T09:11:16.687 INFO:tasks.workunit.client.1.smithi203.stdout:7/18: dread d0/f2 [0,4194304] 0 2024-04-12T09:11:16.687 INFO:tasks.workunit.client.1.smithi203.stdout:5/12: getdents d0 0 2024-04-12T09:11:16.689 INFO:tasks.workunit.client.1.smithi203.stdout:0/21: dwrite d0/f4 [0,4194304] 0 2024-04-12T09:11:16.690 INFO:tasks.workunit.client.1.smithi203.stdout:1/34: mknod ca 0 2024-04-12T09:11:16.690 INFO:tasks.workunit.client.0.smithi117.stdout:6/670: getdents d8/d9/d61/d90 0 2024-04-12T09:11:16.691 INFO:tasks.workunit.client.0.smithi117.stdout:6/671: chown d8/d9/c35 19437 1 2024-04-12T09:11:16.691 INFO:tasks.workunit.client.1.smithi203.stdout:1/35: read - f9 zero size 2024-04-12T09:11:16.694 INFO:tasks.workunit.client.0.smithi117.stdout:5/741: mknod d2/d3/de/d1e/d66/dc2/cf4 0 2024-04-12T09:11:16.696 INFO:tasks.workunit.client.1.smithi203.stdout:5/13: dwrite d0/f4 [0,4194304] 0 2024-04-12T09:11:16.697 INFO:tasks.workunit.client.0.smithi117.stdout:0/815: truncate d3/da2/dee/dd5/dff/d91/d94/d5a/f82 987252 0 2024-04-12T09:11:16.698 INFO:tasks.workunit.client.0.smithi117.stdout:8/642: dread db/d19/d1a/f21 [0,4194304] 0 2024-04-12T09:11:16.700 INFO:tasks.workunit.client.0.smithi117.stdout:4/683: creat d0/d5/d3b/d38/d4f/d79/d9c/fe2 x:0 0 0 2024-04-12T09:11:16.702 INFO:tasks.workunit.client.1.smithi203.stdout:0/22: creat d0/f7 x:0 0 0 2024-04-12T09:11:16.702 INFO:tasks.workunit.client.0.smithi117.stdout:3/939: getdents de/d2c/d59/d70/d3e/d5d/d111/d15a 0 2024-04-12T09:11:16.703 INFO:tasks.workunit.client.1.smithi203.stdout:0/23: dread - d0/f7 zero size 2024-04-12T09:11:16.709 INFO:tasks.workunit.client.1.smithi203.stdout:7/19: rename d0/c5 to d0/d4/c6 0 2024-04-12T09:11:16.710 INFO:tasks.workunit.client.1.smithi203.stdout:7/20: truncate d0/f2 4906845 0 2024-04-12T09:11:16.710 INFO:tasks.workunit.client.1.smithi203.stdout:5/14: mkdir d0/d6 0 2024-04-12T09:11:16.710 INFO:tasks.workunit.client.0.smithi117.stdout:3/940: dwrite de/d2c/d59/d4c/da0/daa/f140 [0,4194304] 0 2024-04-12T09:11:16.710 INFO:tasks.workunit.client.1.smithi203.stdout:5/15: read d0/f4 [3276307,111678] 0 2024-04-12T09:11:16.713 INFO:tasks.workunit.client.0.smithi117.stdout:1/613: rmdir d1/db3 39 2024-04-12T09:11:16.713 INFO:tasks.workunit.client.1.smithi203.stdout:0/24: unlink d0/f7 0 2024-04-12T09:11:16.713 INFO:tasks.workunit.client.1.smithi203.stdout:0/25: chown d0/d5 128 1 2024-04-12T09:11:16.714 INFO:tasks.workunit.client.0.smithi117.stdout:0/816: dread d3/da2/dee/dd5/dff/d91/fa9 [0,4194304] 0 2024-04-12T09:11:16.716 INFO:tasks.workunit.client.0.smithi117.stdout:0/817: chown d3/da2/dee/dd5/dff/d91/d94/d5a/d62/d66/d73/fea 13774056 1 2024-04-12T09:11:16.717 INFO:tasks.workunit.client.0.smithi117.stdout:6/672: rename d8/d3a/f7c to d8/d2a/fd0 0 2024-04-12T09:11:16.722 INFO:tasks.workunit.client.0.smithi117.stdout:8/643: symlink db/d13/d38/dc3/ld1 0 2024-04-12T09:11:16.727 INFO:tasks.workunit.client.1.smithi203.stdout:7/21: link d0/f2 d0/f7 0 2024-04-12T09:11:16.733 INFO:tasks.workunit.client.1.smithi203.stdout:0/26: mknod d0/d5/c8 0 2024-04-12T09:11:16.735 INFO:tasks.workunit.client.0.smithi117.stdout:3/941: stat de/d2c/d59/d4c/da0/da8/dac/l104 0 2024-04-12T09:11:16.736 INFO:tasks.workunit.client.1.smithi203.stdout:7/22: mknod d0/d4/c8 0 2024-04-12T09:11:16.738 INFO:tasks.workunit.client.0.smithi117.stdout:6/673: dread d8/f1e [0,4194304] 0 2024-04-12T09:11:16.739 INFO:tasks.workunit.client.1.smithi203.stdout:0/27: dwrite d0/f4 [0,4194304] 0 2024-04-12T09:11:16.742 INFO:tasks.workunit.client.0.smithi117.stdout:8/644: dread fa [0,4194304] 0 2024-04-12T09:11:16.742 INFO:tasks.workunit.client.0.smithi117.stdout:9/620: creat d1/d8/d5a/d79/fc9 x:0 0 0 2024-04-12T09:11:16.742 INFO:tasks.workunit.client.0.smithi117.stdout:8/645: readlink db/d1b/d55/l93 0 2024-04-12T09:11:16.742 INFO:tasks.workunit.client.1.smithi203.stdout:7/23: creat d0/f9 x:0 0 0 2024-04-12T09:11:16.744 INFO:tasks.workunit.client.0.smithi117.stdout:7/545: write d0/d2/d1a/d5f/f7f [418919,115930] 0 2024-04-12T09:11:16.748 INFO:tasks.workunit.client.1.smithi203.stdout:0/28: mkdir d0/d9 0 2024-04-12T09:11:16.749 INFO:tasks.workunit.client.1.smithi203.stdout:7/24: rmdir d0/d4 39 2024-04-12T09:11:16.749 INFO:tasks.workunit.client.0.smithi117.stdout:5/742: dwrite d2/d3/de/d1e/d2c/f8c [0,4194304] 0 2024-04-12T09:11:16.754 INFO:tasks.workunit.client.0.smithi117.stdout:0/818: creat d3/da2/dee/dd5/dff/d91/d94/d5a/d62/d66/d73/f10b x:0 0 0 2024-04-12T09:11:16.754 INFO:tasks.workunit.client.0.smithi117.stdout:4/684: dwrite d0/f5e [0,4194304] 0 2024-04-12T09:11:16.755 INFO:tasks.workunit.client.1.smithi203.stdout:5/16: truncate d0/f4 847202 0 2024-04-12T09:11:16.756 INFO:tasks.workunit.client.0.smithi117.stdout:4/685: fdatasync d0/d72/fd3 0 2024-04-12T09:11:16.758 INFO:tasks.workunit.client.1.smithi203.stdout:0/29: creat d0/d5/fa x:0 0 0 2024-04-12T09:11:16.762 INFO:tasks.workunit.client.1.smithi203.stdout:5/17: mkdir d0/d2/d7 0 2024-04-12T09:11:16.763 INFO:tasks.workunit.client.1.smithi203.stdout:0/30: creat d0/fb x:0 0 0 2024-04-12T09:11:16.764 INFO:tasks.workunit.client.0.smithi117.stdout:3/942: chown de/d2c/d59/d70/d3e/d5d/d80/d82/cb4 0 1 2024-04-12T09:11:16.764 INFO:tasks.workunit.client.1.smithi203.stdout:0/31: truncate d0/d5/fa 268784 0 2024-04-12T09:11:16.765 INFO:tasks.workunit.client.1.smithi203.stdout:7/25: unlink d0/d4/c6 0 2024-04-12T09:11:16.765 INFO:tasks.workunit.client.1.smithi203.stdout:0/32: stat d0 0 2024-04-12T09:11:16.765 INFO:tasks.workunit.client.0.smithi117.stdout:1/614: mkdir d1/dbd/dbf 0 2024-04-12T09:11:16.766 INFO:tasks.workunit.client.1.smithi203.stdout:7/26: dread - d0/f9 zero size 2024-04-12T09:11:16.766 INFO:tasks.workunit.client.0.smithi117.stdout:1/615: fdatasync d1/dbd/d3f/db/d16/db6/da9/d9a/f2e 0 2024-04-12T09:11:16.767 INFO:tasks.workunit.client.0.smithi117.stdout:1/616: stat d1/dbd/d3f/db/d16/db6/da9 0 2024-04-12T09:11:16.768 INFO:tasks.workunit.client.0.smithi117.stdout:6/674: rename d8/d2a/d60/d89/fac to d8/d2a/d60/d7d/d8c/db8/fd1 0 2024-04-12T09:11:16.768 INFO:tasks.workunit.client.0.smithi117.stdout:6/675: fdatasync d8/d2a/f92 0 2024-04-12T09:11:16.769 INFO:tasks.workunit.client.0.smithi117.stdout:6/676: truncate d8/d2a/f92 782198 0 2024-04-12T09:11:16.770 INFO:tasks.workunit.client.0.smithi117.stdout:8/646: mkdir db/d19/dd2 0 2024-04-12T09:11:16.770 INFO:tasks.workunit.client.0.smithi117.stdout:6/677: stat d8/d2a/d60/lad 0 2024-04-12T09:11:16.771 INFO:tasks.workunit.client.1.smithi203.stdout:0/33: creat d0/d5/fc x:0 0 0 2024-04-12T09:11:16.773 INFO:tasks.workunit.client.0.smithi117.stdout:2/546: creat d0/d43/d53/fba x:0 0 0 2024-04-12T09:11:16.776 INFO:tasks.workunit.client.1.smithi203.stdout:0/34: mkdir d0/dd 0 2024-04-12T09:11:16.776 INFO:tasks.workunit.client.0.smithi117.stdout:7/546: chown d0/d2/d45/d15/l6b 7000931 1 2024-04-12T09:11:16.778 INFO:tasks.workunit.client.0.smithi117.stdout:5/743: write d2/d3/dd/d39/f61 [4162438,45232] 0 2024-04-12T09:11:16.779 INFO:tasks.workunit.client.1.smithi203.stdout:7/27: dwrite d0/f2 [0,4194304] 0 2024-04-12T09:11:16.783 INFO:tasks.workunit.client.0.smithi117.stdout:0/819: symlink d3/da2/dee/d76/d83/da8/d9a/l10c 0 2024-04-12T09:11:16.785 INFO:tasks.workunit.client.0.smithi117.stdout:7/547: dwrite d0/d2/d1a/d49/f56 [0,4194304] 0 2024-04-12T09:11:16.785 INFO:tasks.workunit.client.1.smithi203.stdout:0/35: dwrite d0/d5/fa [0,4194304] 0 2024-04-12T09:11:16.787 INFO:tasks.workunit.client.0.smithi117.stdout:4/686: fsync d0/d5/f52 0 2024-04-12T09:11:16.790 INFO:tasks.workunit.client.1.smithi203.stdout:7/28: dwrite d0/f9 [0,4194304] 0 2024-04-12T09:11:16.794 INFO:tasks.workunit.client.1.smithi203.stdout:5/18: truncate d0/f4 916943 0 2024-04-12T09:11:16.796 INFO:tasks.workunit.client.1.smithi203.stdout:7/29: dread d0/f7 [0,4194304] 0 2024-04-12T09:11:16.802 INFO:tasks.workunit.client.1.smithi203.stdout:5/19: mkdir d0/d2/d8 0 2024-04-12T09:11:16.802 INFO:tasks.workunit.client.1.smithi203.stdout:7/30: dread d0/f7 [0,4194304] 0 2024-04-12T09:11:16.805 INFO:tasks.workunit.client.1.smithi203.stdout:0/36: creat d0/dd/fe x:0 0 0 2024-04-12T09:11:16.805 INFO:tasks.workunit.client.1.smithi203.stdout:0/37: write d0/fb [1029160,25926] 0 2024-04-12T09:11:16.806 INFO:tasks.workunit.client.0.smithi117.stdout:1/617: dread - d1/dbd/d3f/db/d16/f47 zero size 2024-04-12T09:11:16.806 INFO:tasks.workunit.client.1.smithi203.stdout:0/38: stat d0/d9 0 2024-04-12T09:11:16.806 INFO:tasks.workunit.client.1.smithi203.stdout:0/39: readlink d0/l1 0 2024-04-12T09:11:16.809 INFO:tasks.workunit.client.0.smithi117.stdout:8/647: mknod db/d1b/d55/cd3 0 2024-04-12T09:11:16.811 INFO:tasks.workunit.client.0.smithi117.stdout:9/621: mknod d1/d8/d5a/d79/d91/db0/d41/daf/d3b/d97/cca 0 2024-04-12T09:11:16.812 INFO:tasks.workunit.client.0.smithi117.stdout:2/547: symlink d0/d43/d4b/dae/lbb 0 2024-04-12T09:11:16.813 INFO:tasks.workunit.client.0.smithi117.stdout:2/548: chown d0/d43/d30/f88 86227870 1 2024-04-12T09:11:16.814 INFO:tasks.workunit.client.0.smithi117.stdout:2/549: stat d0/d43/d30/c3f 0 2024-04-12T09:11:16.817 INFO:tasks.workunit.client.0.smithi117.stdout:7/548: mknod d0/d2/d1a/d49/ca9 0 2024-04-12T09:11:16.818 INFO:tasks.workunit.client.0.smithi117.stdout:0/820: write d3/da2/dee/dd5/dff/d91/d94/d5a/fc5 [568562,14094] 0 2024-04-12T09:11:16.823 INFO:tasks.workunit.client.1.smithi203.stdout:0/40: fdatasync d0/fb 0 2024-04-12T09:11:16.826 INFO:tasks.workunit.client.1.smithi203.stdout:0/41: mknod d0/cf 0 2024-04-12T09:11:16.829 INFO:tasks.workunit.client.0.smithi117.stdout:0/821: rename d3/da2/dee/d76/d85 to d3/d30/dc8/d10d 0 2024-04-12T09:11:16.830 INFO:tasks.workunit.client.1.smithi203.stdout:0/42: dread d0/f4 [0,4194304] 0 2024-04-12T09:11:16.830 INFO:tasks.workunit.client.1.smithi203.stdout:5/20: write d0/f4 [1003031,86572] 0 2024-04-12T09:11:16.830 INFO:tasks.workunit.client.1.smithi203.stdout:0/43: fsync d0/d5/f6 0 2024-04-12T09:11:16.830 INFO:tasks.workunit.client.0.smithi117.stdout:7/549: dwrite d0/d13/f8a [0,4194304] 0 2024-04-12T09:11:16.831 INFO:tasks.workunit.client.1.smithi203.stdout:0/44: fsync d0/d5/fa 0 2024-04-12T09:11:16.833 INFO:tasks.workunit.client.1.smithi203.stdout:5/21: dread d0/f4 [0,4194304] 0 2024-04-12T09:11:16.833 INFO:tasks.workunit.client.1.smithi203.stdout:7/31: truncate d0/f2 746726 0 2024-04-12T09:11:16.835 INFO:tasks.workunit.client.0.smithi117.stdout:9/622: write d1/d24/f2e [1290617,27938] 0 2024-04-12T09:11:16.836 INFO:tasks.workunit.client.0.smithi117.stdout:9/623: write d1/d8/d52/f9d [1136424,101158] 0 2024-04-12T09:11:16.840 INFO:tasks.workunit.client.0.smithi117.stdout:5/744: dread d2/d3/de/d1e/d46/f48 [0,4194304] 0 2024-04-12T09:11:16.840 INFO:tasks.workunit.client.0.smithi117.stdout:6/678: write d8/d9/f46 [1103772,61182] 0 2024-04-12T09:11:16.843 INFO:tasks.workunit.client.1.smithi203.stdout:0/45: symlink d0/dd/l10 0 2024-04-12T09:11:16.844 INFO:tasks.workunit.client.0.smithi117.stdout:3/943: getdents de/d2c/d59/d70/d3e/d84/da1/df1 0 2024-04-12T09:11:16.845 INFO:tasks.workunit.client.0.smithi117.stdout:3/944: chown de/d2c/d59/d70/d3e/d84/da1 0 1 2024-04-12T09:11:16.847 INFO:tasks.workunit.client.1.smithi203.stdout:7/32: unlink d0/f9 0 2024-04-12T09:11:16.848 INFO:tasks.workunit.client.0.smithi117.stdout:1/618: creat d1/dbd/fc0 x:0 0 0 2024-04-12T09:11:16.850 INFO:tasks.workunit.client.1.smithi203.stdout:5/22: mkdir d0/d2/d9 0 2024-04-12T09:11:16.854 INFO:tasks.workunit.client.1.smithi203.stdout:0/46: creat d0/d5/f11 x:0 0 0 2024-04-12T09:11:16.856 INFO:tasks.workunit.client.0.smithi117.stdout:7/550: mkdir d0/d2/d45/d15/d6a/daa 0 2024-04-12T09:11:16.857 INFO:tasks.workunit.client.0.smithi117.stdout:8/648: truncate db/d13/f7b 1421776 0 2024-04-12T09:11:16.860 INFO:tasks.workunit.client.1.smithi203.stdout:7/33: dread d0/f2 [0,4194304] 0 2024-04-12T09:11:16.861 INFO:tasks.workunit.client.0.smithi117.stdout:2/550: truncate d0/df/f93 1789368 0 2024-04-12T09:11:16.862 INFO:tasks.workunit.client.0.smithi117.stdout:2/551: write d0/d43/d30/d41/f72 [1695632,114603] 0 2024-04-12T09:11:16.862 INFO:tasks.workunit.client.1.smithi203.stdout:5/23: write d0/f4 [561256,27830] 0 2024-04-12T09:11:16.863 INFO:tasks.workunit.client.1.smithi203.stdout:5/24: chown d0/d6 141877833 1 2024-04-12T09:11:16.863 INFO:tasks.workunit.client.1.smithi203.stdout:5/25: write d0/f4 [618900,23240] 0 2024-04-12T09:11:16.864 INFO:tasks.workunit.client.1.smithi203.stdout:5/26: chown d0/d2 3428 1 2024-04-12T09:11:16.864 INFO:tasks.workunit.client.0.smithi117.stdout:5/745: creat d2/d3/de/d1e/d46/de4/ff5 x:0 0 0 2024-04-12T09:11:16.869 INFO:tasks.workunit.client.0.smithi117.stdout:3/945: creat de/d2c/d59/d70/d3d/d63/de1/d125/f15c x:0 0 0 2024-04-12T09:11:16.872 INFO:tasks.workunit.client.1.smithi203.stdout:0/47: symlink d0/d9/l12 0 2024-04-12T09:11:16.872 INFO:tasks.workunit.client.1.smithi203.stdout:7/34: dwrite d0/f7 [0,4194304] 0 2024-04-12T09:11:16.873 INFO:tasks.workunit.client.0.smithi117.stdout:7/551: symlink d0/d2/d45/d17/d23/d50/d5c/lab 0 2024-04-12T09:11:16.873 INFO:tasks.workunit.client.0.smithi117.stdout:0/822: write d3/d47/f5e [1034423,99403] 0 2024-04-12T09:11:16.876 INFO:tasks.workunit.client.0.smithi117.stdout:8/649: mkdir db/d19/d1a/d3d/d9c/dd4 0 2024-04-12T09:11:16.876 INFO:tasks.workunit.client.0.smithi117.stdout:2/552: dread d0/d43/d30/d41/f21 [0,4194304] 0 2024-04-12T09:11:16.877 INFO:tasks.workunit.client.0.smithi117.stdout:8/650: dread - db/d13/d38/fbf zero size 2024-04-12T09:11:16.878 INFO:tasks.workunit.client.1.smithi203.stdout:0/48: creat d0/f13 x:0 0 0 2024-04-12T09:11:16.879 INFO:tasks.workunit.client.0.smithi117.stdout:8/651: write db/d13/d38/d86/da0/da4/fce [375391,12004] 0 2024-04-12T09:11:16.883 INFO:tasks.workunit.client.1.smithi203.stdout:7/35: mknod d0/d4/ca 0 2024-04-12T09:11:16.886 INFO:tasks.workunit.client.1.smithi203.stdout:5/27: mkdir d0/d2/d9/da 0 2024-04-12T09:11:16.888 INFO:tasks.workunit.client.0.smithi117.stdout:5/746: symlink d2/d3/dd/d39/d83/d4d/d52/lf6 0 2024-04-12T09:11:16.889 INFO:tasks.workunit.client.0.smithi117.stdout:5/747: readlink d2/d3/dd/d39/d83/d4d/d6b/lf3 0 2024-04-12T09:11:16.890 INFO:tasks.workunit.client.1.smithi203.stdout:7/36: fsync d0/f2 0 2024-04-12T09:11:16.890 INFO:tasks.workunit.client.1.smithi203.stdout:7/37: fsync d0/f2 0 2024-04-12T09:11:16.891 INFO:tasks.workunit.client.0.smithi117.stdout:6/679: rename d8/d3a/d49/da4/d9f/lbd to d8/d2a/d60/d89/ld2 0 2024-04-12T09:11:16.894 INFO:tasks.workunit.client.0.smithi117.stdout:7/552: fdatasync d0/d2/d45/f5a 0 2024-04-12T09:11:16.895 INFO:tasks.workunit.client.0.smithi117.stdout:5/748: dwrite d2/d3/dd/d39/d83/d74/f8f [0,4194304] 0 2024-04-12T09:11:16.900 INFO:tasks.workunit.client.0.smithi117.stdout:5/749: dread d2/d3/de/d1e/d46/f48 [0,4194304] 0 2024-04-12T09:11:16.901 INFO:tasks.workunit.client.1.smithi203.stdout:5/28: symlink d0/d2/d8/lb 0 2024-04-12T09:11:16.902 INFO:tasks.workunit.client.0.smithi117.stdout:9/624: creat d1/d8/fcb x:0 0 0 2024-04-12T09:11:16.902 INFO:tasks.workunit.client.1.smithi203.stdout:0/49: link d0/l1 d0/l14 0 2024-04-12T09:11:16.903 INFO:tasks.workunit.client.0.smithi117.stdout:8/652: fdatasync db/d19/d1a/d3d/d60/f88 0 2024-04-12T09:11:16.904 INFO:tasks.workunit.client.1.smithi203.stdout:0/50: dread - d0/d5/fc zero size 2024-04-12T09:11:16.905 INFO:tasks.workunit.client.1.smithi203.stdout:0/51: read - d0/dd/fe zero size 2024-04-12T09:11:16.907 INFO:tasks.workunit.client.1.smithi203.stdout:0/52: read d0/f3 [181490,102177] 0 2024-04-12T09:11:16.908 INFO:tasks.workunit.client.0.smithi117.stdout:1/619: rename d1/dbd/d3f/db/f80 to d1/dbd/d3f/db/d1d/d78/fc1 0 2024-04-12T09:11:16.908 INFO:tasks.workunit.client.1.smithi203.stdout:0/53: dread - d0/d5/fc zero size 2024-04-12T09:11:16.908 INFO:tasks.workunit.client.1.smithi203.stdout:5/29: dwrite d0/f4 [0,4194304] 0 2024-04-12T09:11:16.910 INFO:tasks.workunit.client.1.smithi203.stdout:7/38: truncate d0/f7 1409040 0 2024-04-12T09:11:16.911 INFO:tasks.workunit.client.0.smithi117.stdout:6/680: fdatasync d8/d3f/d51/f67 0 2024-04-12T09:11:16.913 INFO:tasks.workunit.client.0.smithi117.stdout:6/681: stat d8/d9/d17/d33/l36 0 2024-04-12T09:11:16.914 INFO:tasks.workunit.client.0.smithi117.stdout:2/553: write d0/d43/d53/d61/d66/f79 [469275,108233] 0 2024-04-12T09:11:16.915 INFO:tasks.workunit.client.0.smithi117.stdout:0/823: symlink d3/d30/dc8/d108/l10e 0 2024-04-12T09:11:16.916 INFO:tasks.workunit.client.1.smithi203.stdout:5/30: dread d0/f4 [0,4194304] 0 2024-04-12T09:11:16.917 INFO:tasks.workunit.client.1.smithi203.stdout:0/54: dwrite d0/d5/f11 [0,4194304] 0 2024-04-12T09:11:16.918 INFO:tasks.workunit.client.1.smithi203.stdout:0/55: chown d0/cf 474062 1 2024-04-12T09:11:16.921 INFO:tasks.workunit.client.0.smithi117.stdout:0/824: dwrite d3/d30/dc8/d10d/fbf [0,4194304] 0 2024-04-12T09:11:16.921 INFO:tasks.workunit.client.0.smithi117.stdout:5/750: mknod d2/d3/dd/d39/d83/d4d/d52/cf7 0 2024-04-12T09:11:16.924 INFO:tasks.workunit.client.1.smithi203.stdout:5/31: symlink d0/d2/lc 0 2024-04-12T09:11:16.925 INFO:tasks.workunit.client.1.smithi203.stdout:0/56: dwrite d0/d5/fa [0,4194304] 0 2024-04-12T09:11:16.926 INFO:tasks.workunit.client.1.smithi203.stdout:0/57: read d0/d5/fa [3714821,62] 0 2024-04-12T09:11:16.927 INFO:tasks.workunit.client.1.smithi203.stdout:0/58: fdatasync d0/f3 0 2024-04-12T09:11:16.931 INFO:tasks.workunit.client.0.smithi117.stdout:5/751: dwrite d2/d3/de/d1e/d46/d96/fbb [0,4194304] 0 2024-04-12T09:11:16.933 INFO:tasks.workunit.client.0.smithi117.stdout:1/620: mkdir d1/dbd/d3f/db/dc2 0 2024-04-12T09:11:16.934 INFO:tasks.workunit.client.1.smithi203.stdout:5/32: symlink d0/d2/d9/ld 0 2024-04-12T09:11:16.935 INFO:tasks.workunit.client.0.smithi117.stdout:1/621: fdatasync d1/dbd/d3f/db/d1d/f5b 0 2024-04-12T09:11:16.935 INFO:tasks.workunit.client.1.smithi203.stdout:7/39: getdents d0/d4 0 2024-04-12T09:11:16.939 INFO:tasks.workunit.client.1.smithi203.stdout:0/59: unlink d0/dd/fe 0 2024-04-12T09:11:16.942 INFO:tasks.workunit.client.0.smithi117.stdout:2/554: creat d0/d43/d4b/dae/fbc x:0 0 0 2024-04-12T09:11:16.942 INFO:tasks.workunit.client.0.smithi117.stdout:2/555: dread - d0/d4/f54 zero size 2024-04-12T09:11:16.945 INFO:tasks.workunit.client.0.smithi117.stdout:0/825: dread - d3/da2/dee/d76/d83/da8/d97/dc9/dd2/fa1 zero size 2024-04-12T09:11:16.946 INFO:tasks.workunit.client.1.smithi203.stdout:0/60: mknod d0/d9/c15 0 2024-04-12T09:11:16.947 INFO:tasks.workunit.client.1.smithi203.stdout:5/33: creat d0/d6/fe x:0 0 0 2024-04-12T09:11:16.948 INFO:tasks.workunit.client.0.smithi117.stdout:8/653: symlink db/d19/d1a/d3d/d9c/dcc/ld5 0 2024-04-12T09:11:16.949 INFO:tasks.workunit.client.1.smithi203.stdout:0/61: creat d0/dd/f16 x:0 0 0 2024-04-12T09:11:16.949 INFO:tasks.workunit.client.0.smithi117.stdout:8/654: write db/d19/d1a/d3d/f47 [646758,116684] 0 2024-04-12T09:11:16.949 INFO:tasks.workunit.client.0.smithi117.stdout:5/752: mknod d2/d3/de/d1e/d99/cf8 0 2024-04-12T09:11:16.950 INFO:tasks.workunit.client.1.smithi203.stdout:5/34: dread d0/f4 [0,4194304] 0 2024-04-12T09:11:16.954 INFO:tasks.workunit.client.1.smithi203.stdout:0/62: rename d0/d5 to d0/d9/d17 0 2024-04-12T09:11:16.956 INFO:tasks.workunit.client.0.smithi117.stdout:3/946: link de/d2c/d59/d19/l25 de/d2c/d59/d70/d3e/d5d/d89/d109/l15d 0 2024-04-12T09:11:16.957 INFO:tasks.workunit.client.0.smithi117.stdout:5/753: dread d2/f5d [0,4194304] 0 2024-04-12T09:11:16.957 INFO:tasks.workunit.client.0.smithi117.stdout:3/947: readlink de/d2c/d59/d70/d3d/le7 0 2024-04-12T09:11:16.957 INFO:tasks.workunit.client.1.smithi203.stdout:5/35: dwrite d0/d6/fe [0,4194304] 0 2024-04-12T09:11:16.963 INFO:tasks.workunit.client.0.smithi117.stdout:2/556: chown d0/d4/ca 43473 1 2024-04-12T09:11:16.964 INFO:tasks.workunit.client.0.smithi117.stdout:3/948: dwrite de/d2c/d59/d4c/da0/daa/f140 [0,4194304] 0 2024-04-12T09:11:16.967 INFO:tasks.workunit.client.0.smithi117.stdout:9/625: creat d1/d24/fcc x:0 0 0 2024-04-12T09:11:16.970 INFO:tasks.workunit.client.0.smithi117.stdout:6/682: dwrite d8/d3a/d49/f4e [0,4194304] 0 2024-04-12T09:11:16.973 INFO:tasks.workunit.client.0.smithi117.stdout:1/622: mkdir d1/dc3 0 2024-04-12T09:11:16.976 INFO:tasks.workunit.client.0.smithi117.stdout:1/623: chown d1/dbd/d3f/db/d16/l25 65253045 1 2024-04-12T09:11:16.976 INFO:tasks.workunit.client.0.smithi117.stdout:3/949: dwrite de/d2c/d59/d70/d3e/d5d/d80/d97/d9a/d103/f14f [4194304,4194304] 0 2024-04-12T09:11:16.976 INFO:tasks.workunit.client.1.smithi203.stdout:5/36: getdents d0/d2 0 2024-04-12T09:11:16.977 INFO:tasks.workunit.client.0.smithi117.stdout:1/624: chown d1/dbd/d3f/db/d1d/d78/da7 0 1 2024-04-12T09:11:16.985 INFO:tasks.workunit.client.1.smithi203.stdout:0/63: write d0/f4 [3710961,67648] 0 2024-04-12T09:11:16.987 INFO:tasks.workunit.client.1.smithi203.stdout:5/37: dwrite d0/f4 [0,4194304] 0 2024-04-12T09:11:16.991 INFO:tasks.workunit.client.1.smithi203.stdout:5/38: creat d0/d2/d7/ff x:0 0 0 2024-04-12T09:11:16.992 INFO:tasks.workunit.client.1.smithi203.stdout:5/39: readlink d0/d2/d9/ld 0 2024-04-12T09:11:16.993 INFO:tasks.workunit.client.1.smithi203.stdout:0/64: dwrite d0/d9/d17/f11 [0,4194304] 0 2024-04-12T09:11:16.993 INFO:tasks.workunit.client.1.smithi203.stdout:0/65: chown d0/d9/d17 935109612 1 2024-04-12T09:11:16.995 INFO:tasks.workunit.client.1.smithi203.stdout:0/66: write d0/d9/d17/fc [241412,1395] 0 2024-04-12T09:11:16.997 INFO:tasks.workunit.client.1.smithi203.stdout:5/40: creat d0/d2/d9/f10 x:0 0 0 2024-04-12T09:11:16.999 INFO:tasks.workunit.client.1.smithi203.stdout:5/41: write d0/d2/d7/ff [739087,87462] 0 2024-04-12T09:11:17.000 INFO:tasks.workunit.client.1.smithi203.stdout:0/67: dread d0/fb [0,4194304] 0 2024-04-12T09:11:17.003 INFO:tasks.workunit.client.1.smithi203.stdout:5/42: rename d0/d2/d9/da to d0/d6/d11 0 2024-04-12T09:11:17.004 INFO:tasks.workunit.client.1.smithi203.stdout:0/68: mknod d0/dd/c18 0 2024-04-12T09:11:17.004 INFO:tasks.workunit.client.1.smithi203.stdout:0/69: chown d0/dd/f16 387306 1 2024-04-12T09:11:17.005 INFO:tasks.workunit.client.0.smithi117.stdout:5/754: rmdir d2/d3/dd/d39/d82/dd6 39 2024-04-12T09:11:17.007 INFO:tasks.workunit.client.1.smithi203.stdout:5/43: rename d0/d2/d8/lb to d0/d6/d11/l12 0 2024-04-12T09:11:17.008 INFO:tasks.workunit.client.0.smithi117.stdout:7/553: getdents d0/d2/d45/d17/d23/d39/d6c 0 2024-04-12T09:11:17.008 INFO:tasks.workunit.client.1.smithi203.stdout:0/70: dread d0/d9/d17/f11 [0,4194304] 0 2024-04-12T09:11:17.009 INFO:tasks.workunit.client.1.smithi203.stdout:0/71: chown d0/d9/l12 58 1 2024-04-12T09:11:17.010 INFO:tasks.workunit.client.0.smithi117.stdout:2/557: readlink d0/d43/la4 0 2024-04-12T09:11:17.011 INFO:tasks.workunit.client.1.smithi203.stdout:5/44: rename d0/d2/lc to d0/d2/d9/l13 0 2024-04-12T09:11:17.013 INFO:tasks.workunit.client.1.smithi203.stdout:0/72: mkdir d0/d9/d17/d19 0 2024-04-12T09:11:17.014 INFO:tasks.workunit.client.0.smithi117.stdout:6/683: mknod d8/d3a/d49/da4/d8a/cd3 0 2024-04-12T09:11:17.015 INFO:tasks.workunit.client.1.smithi203.stdout:5/45: mkdir d0/d2/d9/d14 0 2024-04-12T09:11:17.018 INFO:tasks.workunit.client.0.smithi117.stdout:1/625: mknod d1/dbd/d3f/db/d16/cc4 0 2024-04-12T09:11:17.019 INFO:tasks.workunit.client.0.smithi117.stdout:1/626: fdatasync d1/dbd/d3f/db/d16/db6/da9/d9a/f4b 0 2024-04-12T09:11:17.021 INFO:tasks.workunit.client.1.smithi203.stdout:5/46: dwrite d0/d2/d7/ff [0,4194304] 0 2024-04-12T09:11:17.022 INFO:tasks.workunit.client.1.smithi203.stdout:5/47: truncate d0/d2/d9/f10 194970 0 2024-04-12T09:11:17.023 INFO:tasks.workunit.client.0.smithi117.stdout:2/558: unlink d0/d4/d10/d27/f2e 0 2024-04-12T09:11:17.025 INFO:tasks.workunit.client.1.smithi203.stdout:0/73: getdents d0/d9 0 2024-04-12T09:11:17.027 INFO:tasks.workunit.client.1.smithi203.stdout:0/74: read d0/d9/d17/fc [107590,72032] 0 2024-04-12T09:11:17.028 INFO:tasks.workunit.client.1.smithi203.stdout:0/75: truncate d0/fb 1289637 0 2024-04-12T09:11:17.031 INFO:tasks.workunit.client.0.smithi117.stdout:6/684: fsync d8/d9/fb 0 2024-04-12T09:11:17.032 INFO:tasks.workunit.client.0.smithi117.stdout:5/755: getdents d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1 0 2024-04-12T09:11:17.032 INFO:tasks.workunit.client.0.smithi117.stdout:1/627: mkdir d1/dbd/d3f/db/d16/db6/dc5 0 2024-04-12T09:11:17.033 INFO:tasks.workunit.client.0.smithi117.stdout:7/554: mkdir d0/d2/d45/d17/d23/dac 0 2024-04-12T09:11:17.034 INFO:tasks.workunit.client.0.smithi117.stdout:1/628: fsync d1/f77 0 2024-04-12T09:11:17.034 INFO:tasks.workunit.client.0.smithi117.stdout:6/685: fsync d8/d3a/fa8 0 2024-04-12T09:11:17.034 INFO:tasks.workunit.client.0.smithi117.stdout:8/655: getdents db/d1b/d62/dae 0 2024-04-12T09:11:17.037 INFO:tasks.workunit.client.1.smithi203.stdout:0/76: fsync d0/d9/d17/f11 0 2024-04-12T09:11:17.039 INFO:tasks.workunit.client.0.smithi117.stdout:1/629: write d1/dbd/d3f/db/d1d/d78/f55 [2140127,30659] 0 2024-04-12T09:11:17.042 INFO:tasks.workunit.client.0.smithi117.stdout:2/559: dwrite d0/d4/fb [0,4194304] 0 2024-04-12T09:11:17.042 INFO:tasks.workunit.client.0.smithi117.stdout:5/756: mknod d2/d3/de/d1e/d79/dec/cf9 0 2024-04-12T09:11:17.043 INFO:tasks.workunit.client.1.smithi203.stdout:0/77: dwrite d0/dd/f16 [0,4194304] 0 2024-04-12T09:11:17.043 INFO:tasks.workunit.client.1.smithi203.stdout:0/78: readlink d0/dd/l10 0 2024-04-12T09:11:17.044 INFO:tasks.workunit.client.1.smithi203.stdout:0/79: chown d0/dd/l10 3551419 1 2024-04-12T09:11:17.045 INFO:tasks.workunit.client.0.smithi117.stdout:6/686: dwrite d8/d2a/d6e/fc5 [0,4194304] 0 2024-04-12T09:11:17.047 INFO:tasks.workunit.client.0.smithi117.stdout:8/656: mknod db/d19/d1a/d3d/d60/d70/d98/cd6 0 2024-04-12T09:11:17.055 INFO:tasks.workunit.client.0.smithi117.stdout:8/657: dwrite db/d1b/d62/f66 [0,4194304] 0 2024-04-12T09:11:17.056 INFO:tasks.workunit.client.0.smithi117.stdout:5/757: chown d2/d3/dd/c26 276622 1 2024-04-12T09:11:17.060 INFO:tasks.workunit.client.0.smithi117.stdout:2/560: mknod d0/d43/d30/cbd 0 2024-04-12T09:11:17.061 INFO:tasks.workunit.client.0.smithi117.stdout:2/561: chown d0/d4/f9d 1165 1 2024-04-12T09:11:17.064 INFO:tasks.workunit.client.0.smithi117.stdout:6/687: mknod d8/d9/d39/d79/cd4 0 2024-04-12T09:11:17.067 INFO:tasks.workunit.client.0.smithi117.stdout:3/950: write de/d2c/d59/f1b [918623,117754] 0 2024-04-12T09:11:17.070 INFO:tasks.workunit.client.0.smithi117.stdout:8/658: mknod db/d13/d38/d86/da0/cd7 0 2024-04-12T09:11:17.071 INFO:tasks.workunit.client.0.smithi117.stdout:8/659: write db/f53 [6940538,85508] 0 2024-04-12T09:11:17.075 INFO:tasks.workunit.client.0.smithi117.stdout:6/688: rmdir d8/d9/d39/d79 39 2024-04-12T09:11:17.079 INFO:tasks.workunit.client.0.smithi117.stdout:8/660: creat db/d4b/d9a/fd8 x:0 0 0 2024-04-12T09:11:17.081 INFO:tasks.workunit.client.0.smithi117.stdout:7/555: getdents d0/d2/d45/d53/d58 0 2024-04-12T09:11:17.087 INFO:tasks.workunit.client.0.smithi117.stdout:2/562: creat d0/d43/fbe x:0 0 0 2024-04-12T09:11:17.090 INFO:tasks.workunit.client.0.smithi117.stdout:7/556: rename d0/d2/d45/d15/d6a to d0/d2/d45/d17/d23/dac/dad 0 2024-04-12T09:11:17.094 INFO:tasks.workunit.client.0.smithi117.stdout:1/630: dwrite d1/dbd/d51/f83 [0,4194304] 0 2024-04-12T09:11:17.094 INFO:tasks.workunit.client.0.smithi117.stdout:8/661: creat db/d1b/d62/dae/db4/fd9 x:0 0 0 2024-04-12T09:11:17.095 INFO:tasks.workunit.client.0.smithi117.stdout:8/662: chown db/d1b/fb0 211767984 1 2024-04-12T09:11:17.096 INFO:tasks.workunit.client.0.smithi117.stdout:2/563: fsync d0/d43/d30/f5c 0 2024-04-12T09:11:17.101 INFO:tasks.workunit.client.0.smithi117.stdout:1/631: write d1/dbd/d3f/db/d16/db6/da9/d9a/fb9 [3139982,113982] 0 2024-04-12T09:11:17.102 INFO:tasks.workunit.client.0.smithi117.stdout:1/632: chown d1/dbd/f91 2 1 2024-04-12T09:11:17.104 INFO:tasks.workunit.client.0.smithi117.stdout:8/663: rename db/d19/d1a/d3d/c84 to db/d1b/d62/dae/db4/cda 0 2024-04-12T09:11:17.111 INFO:tasks.workunit.client.0.smithi117.stdout:1/633: mkdir d1/dbd/d3f/db/d16/db6/dc6 0 2024-04-12T09:11:17.117 INFO:tasks.workunit.client.0.smithi117.stdout:8/664: getdents db/d19/dd2 0 2024-04-12T09:11:17.118 INFO:tasks.workunit.client.0.smithi117.stdout:3/951: dwrite de/def/f14b [0,4194304] 0 2024-04-12T09:11:17.119 INFO:tasks.workunit.client.0.smithi117.stdout:8/665: chown db/d77/fa9 1811045 1 2024-04-12T09:11:17.120 INFO:tasks.workunit.client.0.smithi117.stdout:1/634: mknod d1/dbd/d3f/db/d16/db6/dc5/cc7 0 2024-04-12T09:11:17.133 INFO:tasks.workunit.client.0.smithi117.stdout:2/564: write d0/d43/d4b/f7d [694018,36827] 0 2024-04-12T09:11:17.138 INFO:tasks.workunit.client.0.smithi117.stdout:3/952: getdents de/d2c/d59/d70/d3d/d63 0 2024-04-12T09:11:17.139 INFO:tasks.workunit.client.0.smithi117.stdout:2/565: dwrite d0/d43/d30/f77 [0,4194304] 0 2024-04-12T09:11:17.140 INFO:tasks.workunit.client.0.smithi117.stdout:3/953: chown de/d2c/d59/d70/d3e/d84/df9/f131 14 1 2024-04-12T09:11:17.145 INFO:tasks.workunit.client.0.smithi117.stdout:3/954: creat de/d2c/d59/d70/d3e/d5d/d89/d68/d116/f15e x:0 0 0 2024-04-12T09:11:17.147 INFO:tasks.workunit.client.0.smithi117.stdout:8/666: write db/d13/d38/dc3/d9d/fc6 [294320,70492] 0 2024-04-12T09:11:17.147 INFO:tasks.workunit.client.0.smithi117.stdout:3/955: chown de/d2c/d59/d70/d3e/d5d/d89/d123/d14e 330225 1 2024-04-12T09:11:17.149 INFO:tasks.workunit.client.0.smithi117.stdout:8/667: write db/d77/f76 [5495115,104135] 0 2024-04-12T09:11:17.149 INFO:tasks.workunit.client.0.smithi117.stdout:1/635: write d1/dbd/d3f/db/d1d/f52 [5131252,62026] 0 2024-04-12T09:11:17.150 INFO:tasks.workunit.client.0.smithi117.stdout:8/668: chown db/d4b/d9a/fd8 84770369 1 2024-04-12T09:11:17.156 INFO:tasks.workunit.client.0.smithi117.stdout:1/636: mknod d1/dbd/d3f/db/d16/db6/da9/d9a/d71/cc8 0 2024-04-12T09:11:17.158 INFO:tasks.workunit.client.0.smithi117.stdout:2/566: write d0/df/f20 [2131235,90799] 0 2024-04-12T09:11:17.159 INFO:tasks.workunit.client.0.smithi117.stdout:2/567: dread - d0/d43/fbe zero size 2024-04-12T09:11:17.161 INFO:tasks.workunit.client.0.smithi117.stdout:2/568: truncate d0/d43/d53/d61/d8d/f91 111271 0 2024-04-12T09:11:17.164 INFO:tasks.workunit.client.0.smithi117.stdout:1/637: unlink d1/d64/d45/d4c/f7d 0 2024-04-12T09:11:17.164 INFO:tasks.workunit.client.0.smithi117.stdout:1/638: fsync d1/dbd/f1a 0 2024-04-12T09:11:17.167 INFO:tasks.workunit.client.0.smithi117.stdout:3/956: write fa [5683711,63050] 0 2024-04-12T09:11:17.170 INFO:tasks.workunit.client.0.smithi117.stdout:1/639: dwrite d1/dbd/d3f/d72/fbb [0,4194304] 0 2024-04-12T09:11:17.177 INFO:tasks.workunit.client.0.smithi117.stdout:2/569: link d0/d4/d10/f63 d0/d43/d30/d41/fbf 0 2024-04-12T09:11:17.180 INFO:tasks.workunit.client.0.smithi117.stdout:3/957: mknod de/d2c/d59/d70/d3e/d5d/d89/d68/c15f 0 2024-04-12T09:11:17.181 INFO:tasks.workunit.client.0.smithi117.stdout:8/669: dwrite db/d13/f54 [0,4194304] 0 2024-04-12T09:11:17.183 INFO:tasks.workunit.client.0.smithi117.stdout:1/640: rename d1/dbd/d3f/db/d16/l79 to d1/dbd/d3f/db/d16/db6/da9/lc9 0 2024-04-12T09:11:17.191 INFO:tasks.workunit.client.0.smithi117.stdout:8/670: mknod db/d19/d1a/d3d/d60/d70/cdb 0 2024-04-12T09:11:17.194 INFO:tasks.workunit.client.0.smithi117.stdout:1/641: symlink d1/dbd/d3f/db/d16/db6/da9/d9a/d54/lca 0 2024-04-12T09:11:17.195 INFO:tasks.workunit.client.0.smithi117.stdout:8/671: dread db/d1b/d62/f66 [0,4194304] 0 2024-04-12T09:11:17.195 INFO:tasks.workunit.client.0.smithi117.stdout:1/642: chown d1/dbd/f9f 1323 1 2024-04-12T09:11:17.196 INFO:tasks.workunit.client.0.smithi117.stdout:1/643: write d1/d3b/f4a [1192398,27429] 0 2024-04-12T09:11:17.199 INFO:tasks.workunit.client.0.smithi117.stdout:3/958: mknod de/d2c/d59/d70/d3e/d5d/d80/d97/c160 0 2024-04-12T09:11:17.200 INFO:tasks.workunit.client.0.smithi117.stdout:3/959: chown de/d2c/d59/d19 455230 1 2024-04-12T09:11:17.228 INFO:tasks.workunit.client.1.smithi203.stdout:5/48: getdents d0/d2/d9 0 2024-04-12T09:11:17.229 INFO:tasks.workunit.client.1.smithi203.stdout:0/80: write d0/d9/d17/fa [4147829,75528] 0 2024-04-12T09:11:17.230 INFO:tasks.workunit.client.1.smithi203.stdout:5/49: symlink d0/l15 0 2024-04-12T09:11:17.231 INFO:tasks.workunit.client.1.smithi203.stdout:0/81: creat d0/f1a x:0 0 0 2024-04-12T09:11:17.232 INFO:tasks.workunit.client.1.smithi203.stdout:0/82: read d0/fb [493036,66987] 0 2024-04-12T09:11:17.234 INFO:tasks.workunit.client.1.smithi203.stdout:5/50: rename d0/d2 to d0/d6/d16 0 2024-04-12T09:11:17.236 INFO:tasks.workunit.client.1.smithi203.stdout:5/51: mknod d0/d6/d11/c17 0 2024-04-12T09:11:17.238 INFO:tasks.workunit.client.1.smithi203.stdout:0/83: getdents d0/d9/d17/d19 0 2024-04-12T09:11:17.239 INFO:tasks.workunit.client.1.smithi203.stdout:5/52: mkdir d0/d6/d11/d18 0 2024-04-12T09:11:17.239 INFO:tasks.workunit.client.1.smithi203.stdout:5/53: readlink d0/l15 0 2024-04-12T09:11:17.240 INFO:tasks.workunit.client.1.smithi203.stdout:5/54: read d0/f4 [3034322,72181] 0 2024-04-12T09:11:17.243 INFO:tasks.workunit.client.1.smithi203.stdout:5/55: write d0/f4 [2798845,55867] 0 2024-04-12T09:11:17.244 INFO:tasks.workunit.client.1.smithi203.stdout:0/84: dwrite d0/d9/d17/fa [0,4194304] 0 2024-04-12T09:11:17.246 INFO:tasks.workunit.client.1.smithi203.stdout:5/56: creat d0/d6/d11/f19 x:0 0 0 2024-04-12T09:11:17.248 INFO:tasks.workunit.client.1.smithi203.stdout:0/85: truncate d0/d9/d17/fc 729833 0 2024-04-12T09:11:17.249 INFO:tasks.workunit.client.0.smithi117.stdout:8/672: symlink db/d19/ldc 0 2024-04-12T09:11:17.249 INFO:tasks.workunit.client.0.smithi117.stdout:3/960: write de/d2c/d59/d70/d3e/f86 [810973,40786] 0 2024-04-12T09:11:17.250 INFO:tasks.workunit.client.0.smithi117.stdout:1/644: rmdir d1/dbd/d3f/db/d16/db6/da9/d9a 39 2024-04-12T09:11:17.251 INFO:tasks.workunit.client.0.smithi117.stdout:2/570: truncate d0/d43/d30/d41/fbf 3809471 0 2024-04-12T09:11:17.252 INFO:tasks.workunit.client.1.smithi203.stdout:0/86: creat d0/dd/f1b x:0 0 0 2024-04-12T09:11:17.254 INFO:tasks.workunit.client.1.smithi203.stdout:5/57: mkdir d0/d6/d11/d18/d1a 0 2024-04-12T09:11:17.258 INFO:tasks.workunit.client.1.smithi203.stdout:0/87: fdatasync d0/d9/d17/fa 0 2024-04-12T09:11:17.259 INFO:tasks.workunit.client.1.smithi203.stdout:5/58: unlink d0/l15 0 2024-04-12T09:11:17.261 INFO:tasks.workunit.client.1.smithi203.stdout:0/88: dread d0/f4 [0,4194304] 0 2024-04-12T09:11:17.263 INFO:tasks.workunit.client.0.smithi117.stdout:2/571: mknod d0/d4/d81/d8b/cc0 0 2024-04-12T09:11:17.264 INFO:tasks.workunit.client.0.smithi117.stdout:2/572: stat d0/d43/d53/fba 0 2024-04-12T09:11:17.264 INFO:tasks.workunit.client.1.smithi203.stdout:5/59: creat d0/d6/d16/f1b x:0 0 0 2024-04-12T09:11:17.265 INFO:tasks.workunit.client.0.smithi117.stdout:8/673: symlink db/d19/d1a/ldd 0 2024-04-12T09:11:17.267 INFO:tasks.workunit.client.1.smithi203.stdout:5/60: dread d0/f4 [0,4194304] 0 2024-04-12T09:11:17.268 INFO:tasks.workunit.client.0.smithi117.stdout:1/645: mkdir d1/dcb 0 2024-04-12T09:11:17.268 INFO:tasks.workunit.client.1.smithi203.stdout:5/61: chown d0/d6/d16/d7 697534 1 2024-04-12T09:11:17.271 INFO:tasks.workunit.client.0.smithi117.stdout:1/646: dread d1/dbd/f1a [4194304,4194304] 0 2024-04-12T09:11:17.272 INFO:tasks.workunit.client.1.smithi203.stdout:5/62: dwrite d0/f4 [0,4194304] 0 2024-04-12T09:11:17.276 INFO:tasks.workunit.client.1.smithi203.stdout:5/63: rmdir d0/d6/d16/d7 39 2024-04-12T09:11:17.281 INFO:tasks.workunit.client.1.smithi203.stdout:5/64: creat d0/d6/d11/d18/f1c x:0 0 0 2024-04-12T09:11:17.282 INFO:tasks.workunit.client.1.smithi203.stdout:5/65: truncate d0/d6/d16/f1b 291760 0 2024-04-12T09:11:17.282 INFO:tasks.workunit.client.0.smithi117.stdout:2/573: link d0/d4/d81/la9 d0/d43/d4b/dae/lc1 0 2024-04-12T09:11:17.282 INFO:tasks.workunit.client.1.smithi203.stdout:5/66: rename d0/d6/d11 to d0/d6/d11/d18/d1a/d1d 22 2024-04-12T09:11:17.288 INFO:tasks.workunit.client.1.smithi203.stdout:5/67: dread d0/d6/d16/d7/ff [0,4194304] 0 2024-04-12T09:11:17.288 INFO:tasks.workunit.client.1.smithi203.stdout:5/68: stat d0/d6/d11/d18 0 2024-04-12T09:11:17.302 INFO:tasks.workunit.client.0.smithi117.stdout:2/574: getdents d0/d4/d81/d8b 0 2024-04-12T09:11:17.304 INFO:tasks.workunit.client.0.smithi117.stdout:3/961: dwrite de/d2c/d59/d4c/da0/daa/fbd [0,4194304] 0 2024-04-12T09:11:17.309 INFO:tasks.workunit.client.0.smithi117.stdout:3/962: rename de/d2c/d59/d70/d3e/d5d/d111/d15a to de/d2c/d59/d70/d3d/d63/de1/d125/d161 0 2024-04-12T09:11:17.311 INFO:tasks.workunit.client.1.smithi203.stdout:0/89: truncate d0/d9/d17/f6 595846 0 2024-04-12T09:11:17.313 INFO:tasks.workunit.client.0.smithi117.stdout:8/674: truncate db/d19/d1a/d3d/f47 2596965 0 2024-04-12T09:11:17.315 INFO:tasks.workunit.client.1.smithi203.stdout:5/69: rmdir d0 39 2024-04-12T09:11:17.316 INFO:tasks.workunit.client.0.smithi117.stdout:1/647: write d1/dbd/d3f/db/f33 [4136372,94573] 0 2024-04-12T09:11:17.316 INFO:tasks.workunit.client.1.smithi203.stdout:0/90: link d0/dd/l10 d0/d9/l1c 0 2024-04-12T09:11:17.322 INFO:tasks.workunit.client.0.smithi117.stdout:8/675: rename db/d19/d1a/d3d/d60/fbe to db/d19/fde 0 2024-04-12T09:11:17.322 INFO:tasks.workunit.client.0.smithi117.stdout:3/963: dread de/d2c/d59/d4c/da0/da8/dac/fbb [0,4194304] 0 2024-04-12T09:11:17.322 INFO:tasks.workunit.client.0.smithi117.stdout:1/648: symlink d1/d64/lcc 0 2024-04-12T09:11:17.323 INFO:tasks.workunit.client.0.smithi117.stdout:2/575: write d0/df/f46 [1720671,83713] 0 2024-04-12T09:11:17.323 INFO:tasks.workunit.client.0.smithi117.stdout:3/964: read de/d2c/d59/d70/d3d/d63/ffd [898506,62416] 0 2024-04-12T09:11:17.324 INFO:tasks.workunit.client.1.smithi203.stdout:0/91: mkdir d0/d1d 0 2024-04-12T09:11:17.325 INFO:tasks.workunit.client.1.smithi203.stdout:0/92: write d0/dd/f16 [1530341,33034] 0 2024-04-12T09:11:17.325 INFO:tasks.workunit.client.0.smithi117.stdout:1/649: write d1/dbd/d3f/db/f73 [5370642,93743] 0 2024-04-12T09:11:17.325 INFO:tasks.workunit.client.0.smithi117.stdout:8/676: creat db/d1b/d62/fdf x:0 0 0 2024-04-12T09:11:17.326 INFO:tasks.workunit.client.0.smithi117.stdout:8/677: stat db/d1b/d55/l96 0 2024-04-12T09:11:17.328 INFO:tasks.workunit.client.0.smithi117.stdout:2/576: mkdir d0/d43/da5/d8f/dc2 0 2024-04-12T09:11:17.332 INFO:tasks.workunit.client.0.smithi117.stdout:1/650: dread d1/dbd/d3f/db/d16/f2f [0,4194304] 0 2024-04-12T09:11:17.333 INFO:tasks.workunit.client.1.smithi203.stdout:0/93: rmdir d0/d9/d17 39 2024-04-12T09:11:17.333 INFO:tasks.workunit.client.0.smithi117.stdout:1/651: read d1/dbd/d3f/f61 [4058484,98361] 0 2024-04-12T09:11:17.336 INFO:tasks.workunit.client.0.smithi117.stdout:3/965: creat de/d2c/d59/d70/d3e/d84/dfa/d102/f162 x:0 0 0 2024-04-12T09:11:17.341 INFO:tasks.workunit.client.0.smithi117.stdout:2/577: symlink d0/d43/d30/lc3 0 2024-04-12T09:11:17.345 INFO:tasks.workunit.client.0.smithi117.stdout:1/652: mknod d1/dbd/d3f/db/d1d/d78/ccd 0 2024-04-12T09:11:17.347 INFO:tasks.workunit.client.1.smithi203.stdout:0/94: creat d0/d9/f1e x:0 0 0 2024-04-12T09:11:17.349 INFO:tasks.workunit.client.1.smithi203.stdout:5/70: truncate d0/d6/fe 1759152 0 2024-04-12T09:11:17.350 INFO:tasks.workunit.client.1.smithi203.stdout:5/71: dread d0/d6/d16/f1b [0,4194304] 0 2024-04-12T09:11:17.351 INFO:tasks.workunit.client.1.smithi203.stdout:5/72: chown d0/d6/d11/c17 612 1 2024-04-12T09:11:17.356 INFO:tasks.workunit.client.1.smithi203.stdout:5/73: mkdir d0/d6/d11/d1e 0 2024-04-12T09:11:17.357 INFO:tasks.workunit.client.0.smithi117.stdout:1/653: mkdir d1/dbd/d51/dce 0 2024-04-12T09:11:17.361 INFO:tasks.workunit.client.0.smithi117.stdout:8/678: truncate db/f61 2729987 0 2024-04-12T09:11:17.361 INFO:tasks.workunit.client.0.smithi117.stdout:8/679: chown db/d19/d1a/f79 19573688 1 2024-04-12T09:11:17.363 INFO:tasks.workunit.client.1.smithi203.stdout:0/95: truncate d0/d9/d17/fc 1195157 0 2024-04-12T09:11:17.366 INFO:tasks.workunit.client.1.smithi203.stdout:0/96: dread d0/d9/d17/f11 [0,4194304] 0 2024-04-12T09:11:17.366 INFO:tasks.workunit.client.0.smithi117.stdout:1/654: truncate d1/dbd/d3f/db/d16/f47 76847 0 2024-04-12T09:11:17.367 INFO:tasks.workunit.client.1.smithi203.stdout:5/74: symlink d0/d6/d11/d18/d1a/l1f 0 2024-04-12T09:11:17.368 INFO:tasks.workunit.client.0.smithi117.stdout:8/680: creat db/d13/d38/d86/fe0 x:0 0 0 2024-04-12T09:11:17.370 INFO:tasks.workunit.client.0.smithi117.stdout:3/966: truncate de/d2c/d59/d70/d3e/f5a 60362 0 2024-04-12T09:11:17.371 INFO:tasks.workunit.client.0.smithi117.stdout:3/967: readlink de/d2c/d59/d19/d27/l74 0 2024-04-12T09:11:17.375 INFO:tasks.workunit.client.0.smithi117.stdout:8/681: mknod db/d19/d1a/db7/ce1 0 2024-04-12T09:11:17.377 INFO:tasks.workunit.client.1.smithi203.stdout:0/97: truncate d0/d9/d17/f11 1432917 0 2024-04-12T09:11:17.377 INFO:tasks.workunit.client.0.smithi117.stdout:2/578: write d0/f36 [1232167,93016] 0 2024-04-12T09:11:17.378 INFO:tasks.workunit.client.1.smithi203.stdout:0/98: chown d0/dd/f16 456681 1 2024-04-12T09:11:17.378 INFO:tasks.workunit.client.0.smithi117.stdout:1/655: rename d1/dbd/d3f/db/d16/db6 to d1/dbd/d3f/db/d16/db6/da9/d9a/dcf 22 2024-04-12T09:11:17.378 INFO:tasks.workunit.client.1.smithi203.stdout:0/99: write d0/f3 [4086326,94600] 0 2024-04-12T09:11:17.380 INFO:tasks.workunit.client.0.smithi117.stdout:2/579: chown d0/d4/d10/d27/l33 171227628 1 2024-04-12T09:11:17.384 INFO:tasks.workunit.client.0.smithi117.stdout:3/968: rename de/d2c/d59/d19/d27/c53 to de/d2c/d59/d4c/da0/daa/c163 0 2024-04-12T09:11:17.385 INFO:tasks.workunit.client.1.smithi203.stdout:0/100: fdatasync d0/fb 0 2024-04-12T09:11:17.393 INFO:tasks.workunit.client.0.smithi117.stdout:2/580: truncate d0/f3c 1132215 0 2024-04-12T09:11:17.395 INFO:tasks.workunit.client.0.smithi117.stdout:3/969: stat de/d2c/d59/d70/d3e/d5d/db5/l13d 0 2024-04-12T09:11:17.395 INFO:tasks.workunit.client.0.smithi117.stdout:3/970: readlink de/d2c/l36 0 2024-04-12T09:11:17.399 INFO:tasks.workunit.client.0.smithi117.stdout:1/656: dread d1/dbd/d3f/db/d16/db6/da9/f9c [0,4194304] 0 2024-04-12T09:11:17.400 INFO:tasks.workunit.client.0.smithi117.stdout:8/682: dread db/d1b/fe [4194304,4194304] 0 2024-04-12T09:11:17.402 INFO:tasks.workunit.client.0.smithi117.stdout:2/581: dread d0/df/f7a [0,4194304] 0 2024-04-12T09:11:17.405 INFO:tasks.workunit.client.0.smithi117.stdout:3/971: readlink de/d2c/d59/d70/lcb 0 2024-04-12T09:11:17.408 INFO:tasks.workunit.client.0.smithi117.stdout:2/582: dread d0/f36 [0,4194304] 0 2024-04-12T09:11:17.409 INFO:tasks.workunit.client.0.smithi117.stdout:1/657: unlink d1/dbd/f14 0 2024-04-12T09:11:17.409 INFO:tasks.workunit.client.0.smithi117.stdout:2/583: chown d0/d43/d30/f47 0 1 2024-04-12T09:11:17.410 INFO:tasks.workunit.client.1.smithi203.stdout:0/101: getdents d0/d9 0 2024-04-12T09:11:17.412 INFO:tasks.workunit.client.1.smithi203.stdout:0/102: creat d0/f1f x:0 0 0 2024-04-12T09:11:17.413 INFO:tasks.workunit.client.1.smithi203.stdout:0/103: readlink d0/d9/l12 0 2024-04-12T09:11:17.414 INFO:tasks.workunit.client.1.smithi203.stdout:5/75: dwrite d0/d6/fe [0,4194304] 0 2024-04-12T09:11:17.414 INFO:tasks.workunit.client.0.smithi117.stdout:1/658: mkdir d1/d64/d45/d4c/d94/dd0 0 2024-04-12T09:11:17.416 INFO:tasks.workunit.client.0.smithi117.stdout:2/584: dread d0/d43/f8e [0,4194304] 0 2024-04-12T09:11:17.417 INFO:tasks.workunit.client.0.smithi117.stdout:8/683: link db/d77/fa9 db/d77/fe2 0 2024-04-12T09:11:17.419 INFO:tasks.workunit.client.1.smithi203.stdout:0/104: mknod d0/d9/d17/c20 0 2024-04-12T09:11:17.421 INFO:tasks.workunit.client.1.smithi203.stdout:5/76: symlink d0/d6/d11/l20 0 2024-04-12T09:11:17.422 INFO:tasks.workunit.client.1.smithi203.stdout:5/77: read d0/d6/d16/d7/ff [1686210,63961] 0 2024-04-12T09:11:17.423 INFO:tasks.workunit.client.1.smithi203.stdout:0/105: chown d0/d9/d17/f11 15828 1 2024-04-12T09:11:17.423 INFO:tasks.workunit.client.1.smithi203.stdout:0/106: dread - d0/dd/f1b zero size 2024-04-12T09:11:17.424 INFO:tasks.workunit.client.0.smithi117.stdout:1/659: mknod d1/dbd/d3f/db/d1d/d7b/cd1 0 2024-04-12T09:11:17.425 INFO:tasks.workunit.client.1.smithi203.stdout:5/78: creat d0/f21 x:0 0 0 2024-04-12T09:11:17.426 INFO:tasks.workunit.client.1.smithi203.stdout:5/79: chown d0/d6/d16/d7 253569 1 2024-04-12T09:11:17.426 INFO:tasks.workunit.client.0.smithi117.stdout:8/684: chown db/d19/d1a/d3d/l3f 3135528 1 2024-04-12T09:11:17.430 INFO:tasks.workunit.client.1.smithi203.stdout:5/80: creat d0/d6/f22 x:0 0 0 2024-04-12T09:11:17.433 INFO:tasks.workunit.client.1.smithi203.stdout:5/81: mkdir d0/d6/d11/d18/d1a/d23 0 2024-04-12T09:11:17.434 INFO:tasks.workunit.client.0.smithi117.stdout:3/972: link de/d2c/d59/d4c/da0/daa/c163 de/d2c/d59/d70/d3e/d5d/d89/d68/c164 0 2024-04-12T09:11:17.436 INFO:tasks.workunit.client.0.smithi117.stdout:8/685: creat db/d19/dd2/fe3 x:0 0 0 2024-04-12T09:11:17.436 INFO:tasks.workunit.client.0.smithi117.stdout:3/973: truncate de/d2c/d59/d70/d3e/d5d/d89/f154 28907 0 2024-04-12T09:11:17.437 INFO:tasks.workunit.client.0.smithi117.stdout:8/686: dread - db/d1b/d55/f57 zero size 2024-04-12T09:11:17.438 INFO:tasks.workunit.client.1.smithi203.stdout:5/82: rename d0/d6/d11/f19 to d0/d6/d16/d9/f24 0 2024-04-12T09:11:17.439 INFO:tasks.workunit.client.1.smithi203.stdout:5/83: write d0/d6/d11/d18/f1c [28817,103589] 0 2024-04-12T09:11:17.439 INFO:tasks.workunit.client.0.smithi117.stdout:1/660: write d1/d64/f99 [1554124,118870] 0 2024-04-12T09:11:17.443 INFO:tasks.workunit.client.0.smithi117.stdout:2/585: truncate d0/d43/d30/f88 737109 0 2024-04-12T09:11:17.445 INFO:tasks.workunit.client.1.smithi203.stdout:5/84: creat d0/d6/d16/d9/d14/f25 x:0 0 0 2024-04-12T09:11:17.447 INFO:tasks.workunit.client.0.smithi117.stdout:1/661: truncate d1/f4d 1406698 0 2024-04-12T09:11:17.447 INFO:tasks.workunit.client.0.smithi117.stdout:8/687: write db/d77/fe2 [647368,51961] 0 2024-04-12T09:11:17.449 INFO:tasks.workunit.client.0.smithi117.stdout:3/974: creat de/d2c/d59/d70/d3e/d84/d112/f165 x:0 0 0 2024-04-12T09:11:17.449 INFO:tasks.workunit.client.0.smithi117.stdout:3/975: chown de/d2c/d59/d90 15608754 1 2024-04-12T09:11:17.451 INFO:tasks.workunit.client.0.smithi117.stdout:2/586: mkdir d0/d43/dc4 0 2024-04-12T09:11:17.452 INFO:tasks.workunit.client.1.smithi203.stdout:5/85: getdents d0/d6/d11 0 2024-04-12T09:11:17.452 INFO:tasks.workunit.client.0.smithi117.stdout:3/976: fsync de/d2c/d59/d90/f130 0 2024-04-12T09:11:17.452 INFO:tasks.workunit.client.0.smithi117.stdout:4/687: sync 2024-04-12T09:11:17.455 INFO:tasks.workunit.client.0.smithi117.stdout:2/587: write d0/d4/d10/fa8 [3182,26156] 0 2024-04-12T09:11:17.455 INFO:tasks.workunit.client.1.smithi203.stdout:5/86: mknod d0/d6/d11/d18/d1a/d23/c26 0 2024-04-12T09:11:17.456 INFO:tasks.workunit.client.0.smithi117.stdout:3/977: chown de/d2c/d59/d70/d3e/d5d/d80/d82/fee 216385 1 2024-04-12T09:11:17.458 INFO:tasks.workunit.client.0.smithi117.stdout:1/662: dwrite d1/dbd/d3f/db/f33 [0,4194304] 0 2024-04-12T09:11:17.459 INFO:tasks.workunit.client.0.smithi117.stdout:8/688: getdents db/d19/d1a/d3d 0 2024-04-12T09:11:17.460 INFO:tasks.workunit.client.1.smithi203.stdout:5/87: symlink d0/l27 0 2024-04-12T09:11:17.460 INFO:tasks.workunit.client.1.smithi203.stdout:5/88: write d0/f4 [1382029,48707] 0 2024-04-12T09:11:17.461 INFO:tasks.workunit.client.1.smithi203.stdout:5/89: stat d0/d6/d11/d18/d1a 0 2024-04-12T09:11:17.461 INFO:tasks.workunit.client.0.smithi117.stdout:4/688: read d0/d5/f50 [781133,32421] 0 2024-04-12T09:11:17.462 INFO:tasks.workunit.client.1.smithi203.stdout:5/90: write d0/f21 [527951,82975] 0 2024-04-12T09:11:17.463 INFO:tasks.workunit.client.0.smithi117.stdout:4/689: write d0/db3/f8b [3989413,65707] 0 2024-04-12T09:11:17.465 INFO:tasks.workunit.client.0.smithi117.stdout:2/588: symlink d0/df/lc5 0 2024-04-12T09:11:17.471 INFO:tasks.workunit.client.0.smithi117.stdout:1/663: dread d1/dbd/d3f/f9b [4194304,4194304] 0 2024-04-12T09:11:17.473 INFO:tasks.workunit.client.0.smithi117.stdout:2/589: fdatasync d0/d4/f5d 0 2024-04-12T09:11:17.474 INFO:tasks.workunit.client.0.smithi117.stdout:4/690: truncate d0/d5/f63 2335112 0 2024-04-12T09:11:17.475 INFO:tasks.workunit.client.0.smithi117.stdout:8/689: write db/d13/fb3 [2997342,32116] 0 2024-04-12T09:11:17.476 INFO:tasks.workunit.client.0.smithi117.stdout:3/978: write de/d2c/dc0/dcd/dd1/f135 [497965,97753] 0 2024-04-12T09:11:17.478 INFO:tasks.workunit.client.0.smithi117.stdout:1/664: creat d1/dbd/d3f/db/d16/db6/da9/d9a/d71/fd2 x:0 0 0 2024-04-12T09:11:17.479 INFO:tasks.workunit.client.0.smithi117.stdout:2/590: mkdir d0/d43/d30/dc6 0 2024-04-12T09:11:17.480 INFO:tasks.workunit.client.0.smithi117.stdout:1/665: write d1/dbd/d3f/db/d16/f19 [9143534,113204] 0 2024-04-12T09:11:17.481 INFO:tasks.workunit.client.0.smithi117.stdout:8/690: rename db/d1b/d55/f56 to db/d1b/d62/dae/db4/fe4 0 2024-04-12T09:11:17.483 INFO:tasks.workunit.client.0.smithi117.stdout:3/979: symlink de/d2c/d59/d70/d3e/d5d/d89/d123/l166 0 2024-04-12T09:11:17.484 INFO:tasks.workunit.client.0.smithi117.stdout:3/980: fdatasync de/d2c/d59/d70/d3e/d5d/d80/d82/f148 0 2024-04-12T09:11:17.487 INFO:tasks.workunit.client.0.smithi117.stdout:1/666: mknod d1/d64/cd3 0 2024-04-12T09:11:17.487 INFO:tasks.workunit.client.1.smithi203.stdout:5/91: truncate d0/d6/fe 3057339 0 2024-04-12T09:11:17.491 INFO:tasks.workunit.client.1.smithi203.stdout:5/92: rmdir d0/d6/d11/d18 39 2024-04-12T09:11:17.493 INFO:tasks.workunit.client.0.smithi117.stdout:1/667: creat d1/d96/fd4 x:0 0 0 2024-04-12T09:11:17.497 INFO:tasks.workunit.client.0.smithi117.stdout:8/691: truncate db/d19/d1a/d3d/d60/f88 3496338 0 2024-04-12T09:11:17.499 INFO:tasks.workunit.client.0.smithi117.stdout:3/981: creat de/d2c/d59/d70/d3e/d5d/d80/d15b/f167 x:0 0 0 2024-04-12T09:11:17.504 INFO:tasks.workunit.client.0.smithi117.stdout:3/982: rmdir de/d2c/d59/d70/d3d/d63/de1/d106 39 2024-04-12T09:11:17.506 INFO:tasks.workunit.client.0.smithi117.stdout:2/591: dwrite d0/f36 [0,4194304] 0 2024-04-12T09:11:17.510 INFO:tasks.workunit.client.1.smithi203.stdout:5/93: getdents d0/d6/d11/d18/d1a 0 2024-04-12T09:11:17.510 INFO:tasks.workunit.client.1.smithi203.stdout:5/94: dread - d0/d6/d16/d9/d14/f25 zero size 2024-04-12T09:11:17.511 INFO:tasks.workunit.client.1.smithi203.stdout:5/95: chown d0/d6/d11/d18/d1a/d23 6033974 1 2024-04-12T09:11:17.512 INFO:tasks.workunit.client.1.smithi203.stdout:5/96: fdatasync d0/d6/d16/d9/f10 0 2024-04-12T09:11:17.513 INFO:tasks.workunit.client.0.smithi117.stdout:1/668: dread d1/dbd/f91 [0,4194304] 0 2024-04-12T09:11:17.516 INFO:tasks.workunit.client.0.smithi117.stdout:2/592: symlink d0/d4/d10/d27/d9a/lc7 0 2024-04-12T09:11:17.516 INFO:tasks.workunit.client.0.smithi117.stdout:3/983: mkdir de/d2c/d59/d168 0 2024-04-12T09:11:17.516 INFO:tasks.workunit.client.0.smithi117.stdout:1/669: chown d1/dbd/d3f/db/d16/db6/f8c 3 1 2024-04-12T09:11:17.517 INFO:tasks.workunit.client.0.smithi117.stdout:8/692: dwrite db/d1b/d62/f66 [0,4194304] 0 2024-04-12T09:11:17.517 INFO:tasks.workunit.client.1.smithi203.stdout:5/97: symlink d0/d6/d16/d7/l28 0 2024-04-12T09:11:17.518 INFO:tasks.workunit.client.1.smithi203.stdout:5/98: stat d0/d6/d16/d9/f24 0 2024-04-12T09:11:17.519 INFO:tasks.workunit.client.0.smithi117.stdout:8/693: chown db/d4b/l8f 105408889 1 2024-04-12T09:11:17.519 INFO:tasks.workunit.client.1.smithi203.stdout:5/99: truncate d0/d6/d16/d9/d14/f25 414964 0 2024-04-12T09:11:17.519 INFO:tasks.workunit.client.0.smithi117.stdout:3/984: fsync de/d2c/d59/d70/f61 0 2024-04-12T09:11:17.520 INFO:tasks.workunit.client.1.smithi203.stdout:5/100: read d0/d6/d16/d9/d14/f25 [275488,104373] 0 2024-04-12T09:11:17.520 INFO:tasks.workunit.client.0.smithi117.stdout:2/593: rmdir d0/d43/d53/d61/d66 39 2024-04-12T09:11:17.521 INFO:tasks.workunit.client.1.smithi203.stdout:5/101: chown d0/d6/d16/c5 1093 1 2024-04-12T09:11:17.524 INFO:tasks.workunit.client.0.smithi117.stdout:8/694: mknod db/d13/d38/d86/ce5 0 2024-04-12T09:11:17.526 INFO:tasks.workunit.client.0.smithi117.stdout:8/695: chown db/d19/d1a/db7/lc2 1319440 1 2024-04-12T09:11:17.526 INFO:tasks.workunit.client.1.smithi203.stdout:5/102: rmdir d0/d6/d11/d18 39 2024-04-12T09:11:17.527 INFO:tasks.workunit.client.0.smithi117.stdout:2/594: mknod d0/d4/d10/d27/d9a/cc8 0 2024-04-12T09:11:17.534 INFO:tasks.workunit.client.0.smithi117.stdout:2/595: creat d0/d43/d30/d41/fc9 x:0 0 0 2024-04-12T09:11:17.535 INFO:tasks.workunit.client.0.smithi117.stdout:1/670: creat d1/dbd/d3f/db/d1d/fd5 x:0 0 0 2024-04-12T09:11:17.536 INFO:tasks.workunit.client.0.smithi117.stdout:1/671: stat d1/dbd/d3f/db/d1d/d7b/l87 0 2024-04-12T09:11:17.537 INFO:tasks.workunit.client.0.smithi117.stdout:8/696: link db/d13/f54 db/d19/d1a/d3d/d60/d70/d98/fe6 0 2024-04-12T09:11:17.538 INFO:tasks.workunit.client.0.smithi117.stdout:8/697: write db/d13/d38/d86/f8b [977586,107757] 0 2024-04-12T09:11:17.539 INFO:tasks.workunit.client.0.smithi117.stdout:3/985: getdents de/d2c/d59/d4c 0 2024-04-12T09:11:17.540 INFO:tasks.workunit.client.0.smithi117.stdout:2/596: symlink d0/lca 0 2024-04-12T09:11:17.542 INFO:tasks.workunit.client.0.smithi117.stdout:1/672: link d1/dbd/d3f/db/d1d/f5b d1/dbd/dbf/fd6 0 2024-04-12T09:11:17.544 INFO:tasks.workunit.client.1.smithi203.stdout:5/103: dwrite d0/d6/fe [0,4194304] 0 2024-04-12T09:11:17.545 INFO:tasks.workunit.client.0.smithi117.stdout:1/673: stat d1/dbd/d3f/db/d1d/d7b/l87 0 2024-04-12T09:11:17.545 INFO:tasks.workunit.client.0.smithi117.stdout:8/698: unlink db/d4b/fbc 0 2024-04-12T09:11:17.545 INFO:tasks.workunit.client.0.smithi117.stdout:1/674: read d1/dbd/d3f/d72/fa4 [2060622,129802] 0 2024-04-12T09:11:17.545 INFO:tasks.workunit.client.0.smithi117.stdout:8/699: truncate db/d13/d38/d86/f8b 1919899 0 2024-04-12T09:11:17.546 INFO:tasks.workunit.client.0.smithi117.stdout:3/986: getdents de/d2c/d59/d70/d3e/d5d/d89/d123/d14e 0 2024-04-12T09:11:17.548 INFO:tasks.workunit.client.1.smithi203.stdout:5/104: write d0/d6/d16/d7/ff [3853930,62] 0 2024-04-12T09:11:17.549 INFO:tasks.workunit.client.0.smithi117.stdout:8/700: symlink db/d19/le7 0 2024-04-12T09:11:17.553 INFO:tasks.workunit.client.0.smithi117.stdout:3/987: rmdir de/d2c/d59/d4c/d62 39 2024-04-12T09:11:17.554 INFO:tasks.workunit.client.1.smithi203.stdout:5/105: dread d0/d6/d11/d18/f1c [0,4194304] 0 2024-04-12T09:11:17.555 INFO:tasks.workunit.client.0.smithi117.stdout:8/701: creat db/d13/d38/d86/fe8 x:0 0 0 2024-04-12T09:11:17.556 INFO:tasks.workunit.client.0.smithi117.stdout:8/702: stat db/d13/d38/d86/da0/da4 0 2024-04-12T09:11:17.557 INFO:tasks.workunit.client.0.smithi117.stdout:8/703: chown db/d1b/d55 1 1 2024-04-12T09:11:17.558 INFO:tasks.workunit.client.0.smithi117.stdout:8/704: truncate db/d77/fa2 827343 0 2024-04-12T09:11:17.558 INFO:tasks.workunit.client.0.smithi117.stdout:1/675: symlink d1/dbd/d3f/db/d16/db6/da9/ld7 0 2024-04-12T09:11:17.560 INFO:tasks.workunit.client.1.smithi203.stdout:5/106: mkdir d0/d6/d16/d9/d29 0 2024-04-12T09:11:17.564 INFO:tasks.workunit.client.0.smithi117.stdout:2/597: dwrite d0/d4/d10/d27/f39 [0,4194304] 0 2024-04-12T09:11:17.568 INFO:tasks.workunit.client.0.smithi117.stdout:3/988: dread de/d2c/d59/d4c/da0/da8/dac/fbb [0,4194304] 0 2024-04-12T09:11:17.573 INFO:tasks.workunit.client.0.smithi117.stdout:8/705: truncate db/d19/d1a/d3d/f2a 1208838 0 2024-04-12T09:11:17.575 INFO:tasks.workunit.client.0.smithi117.stdout:2/598: dread d0/d96/fb7 [0,4194304] 0 2024-04-12T09:11:17.577 INFO:tasks.workunit.client.1.smithi203.stdout:5/107: dwrite d0/d6/d16/d9/d14/f25 [0,4194304] 0 2024-04-12T09:11:17.577 INFO:tasks.workunit.client.0.smithi117.stdout:1/676: link d1/d64/d45/f50 d1/dbd/d3f/db/d16/db6/da9/fd8 0 2024-04-12T09:11:17.578 INFO:tasks.workunit.client.0.smithi117.stdout:8/706: dread db/d19/d1a/d3d/d9c/faa [0,4194304] 0 2024-04-12T09:11:17.580 INFO:tasks.workunit.client.0.smithi117.stdout:3/989: dwrite fa [4194304,4194304] 0 2024-04-12T09:11:17.580 INFO:tasks.workunit.client.1.smithi203.stdout:5/108: rename d0/d6/d16/d7 to d0/d6/d11/d18/d2a 0 2024-04-12T09:11:17.583 INFO:tasks.workunit.client.1.smithi203.stdout:5/109: fdatasync d0/d6/d16/d9/f24 0 2024-04-12T09:11:17.584 INFO:tasks.workunit.client.1.smithi203.stdout:5/110: chown d0/d6/d11/c17 28 1 2024-04-12T09:11:17.587 INFO:tasks.workunit.client.0.smithi117.stdout:3/990: chown de/d2c/d59/d70/d3e/d5d/d111/c144 13642 1 2024-04-12T09:11:17.588 INFO:tasks.workunit.client.0.smithi117.stdout:8/707: rename db/d19/d1a/db7 to db/d13/d38/dc3/de9 0 2024-04-12T09:11:17.589 INFO:tasks.workunit.client.1.smithi203.stdout:5/111: creat d0/d6/d11/d18/d2a/f2b x:0 0 0 2024-04-12T09:11:17.589 INFO:tasks.workunit.client.0.smithi117.stdout:1/677: dwrite d1/dbd/d51/f83 [0,4194304] 0 2024-04-12T09:11:17.593 INFO:tasks.workunit.client.0.smithi117.stdout:1/678: chown d1/d64/d45/d4c/d94/fb7 17559 1 2024-04-12T09:11:17.594 INFO:tasks.workunit.client.0.smithi117.stdout:1/679: chown d1/d3b 89543 1 2024-04-12T09:11:17.595 INFO:tasks.workunit.client.0.smithi117.stdout:2/599: dwrite d0/d4/d10/d27/d9a/f9b [0,4194304] 0 2024-04-12T09:11:17.597 INFO:tasks.workunit.client.0.smithi117.stdout:8/708: link db/d13/d38/dc3/d9d/fc6 db/d4b/fea 0 2024-04-12T09:11:17.601 INFO:tasks.workunit.client.0.smithi117.stdout:8/709: dread - db/d19/d1a/d3d/d60/d70/d98/fab zero size 2024-04-12T09:11:17.605 INFO:tasks.workunit.client.0.smithi117.stdout:2/600: dwrite d0/d43/d30/d41/fc9 [0,4194304] 0 2024-04-12T09:11:17.608 INFO:tasks.workunit.client.0.smithi117.stdout:8/710: unlink db/d1b/ccd 0 2024-04-12T09:11:17.609 INFO:tasks.workunit.client.0.smithi117.stdout:2/601: truncate d0/d43/da5/d8f/fb6 5817 0 2024-04-12T09:11:17.610 INFO:tasks.workunit.client.0.smithi117.stdout:8/711: dread - db/d13/d38/d86/fe0 zero size 2024-04-12T09:11:17.612 INFO:tasks.workunit.client.0.smithi117.stdout:8/712: symlink db/d77/leb 0 2024-04-12T09:11:17.615 INFO:tasks.workunit.client.0.smithi117.stdout:8/713: creat db/d19/dd2/fec x:0 0 0 2024-04-12T09:11:17.616 INFO:tasks.workunit.client.0.smithi117.stdout:2/602: dwrite d0/d43/d4b/f7d [0,4194304] 0 2024-04-12T09:11:17.617 INFO:tasks.workunit.client.0.smithi117.stdout:8/714: creat db/d19/dd2/fed x:0 0 0 2024-04-12T09:11:17.618 INFO:tasks.workunit.client.0.smithi117.stdout:2/603: stat d0/d43/d30/d41/c25 0 2024-04-12T09:11:17.620 INFO:tasks.workunit.client.0.smithi117.stdout:8/715: write db/d19/d1a/d3d/d60/d70/f90 [1225280,103705] 0 2024-04-12T09:11:17.622 INFO:tasks.workunit.client.0.smithi117.stdout:2/604: truncate d0/d43/f56 614963 0 2024-04-12T09:11:17.623 INFO:tasks.workunit.client.0.smithi117.stdout:2/605: chown d0/d4/f89 10122 1 2024-04-12T09:11:17.627 INFO:tasks.workunit.client.0.smithi117.stdout:1/680: write d1/dbd/d3f/db/f73 [441875,125407] 0 2024-04-12T09:11:17.628 INFO:tasks.workunit.client.0.smithi117.stdout:8/716: dwrite db/f7e [0,4194304] 0 2024-04-12T09:11:17.631 INFO:tasks.workunit.client.0.smithi117.stdout:8/717: mknod db/da6/cee 0 2024-04-12T09:11:17.636 INFO:tasks.workunit.client.0.smithi117.stdout:2/606: dwrite d0/d4/d81/d8b/fb5 [0,4194304] 0 2024-04-12T09:11:17.640 INFO:tasks.workunit.client.0.smithi117.stdout:1/681: dwrite d1/dbd/d51/f67 [4194304,4194304] 0 2024-04-12T09:11:17.641 INFO:tasks.workunit.client.0.smithi117.stdout:2/607: creat d0/d4/d10/d27/d9a/fcb x:0 0 0 2024-04-12T09:11:17.648 INFO:tasks.workunit.client.0.smithi117.stdout:1/682: unlink d1/dbd/d3f/db/f33 0 2024-04-12T09:11:17.650 INFO:tasks.workunit.client.0.smithi117.stdout:2/608: rename d0/d43/d4b/dae/fbc to d0/d43/da5/d8f/fcc 0 2024-04-12T09:11:17.654 INFO:tasks.workunit.client.0.smithi117.stdout:2/609: chown d0/l1c 7144497 1 2024-04-12T09:11:17.656 INFO:tasks.workunit.client.0.smithi117.stdout:2/610: truncate d0/df/f97 726084 0 2024-04-12T09:11:17.657 INFO:tasks.workunit.client.0.smithi117.stdout:2/611: fsync d0/d4/f9d 0 2024-04-12T09:11:17.658 INFO:tasks.workunit.client.0.smithi117.stdout:8/718: dwrite db/d13/f54 [0,4194304] 0 2024-04-12T09:11:17.661 INFO:tasks.workunit.client.0.smithi117.stdout:8/719: mkdir db/d13/d38/def 0 2024-04-12T09:11:17.662 INFO:tasks.workunit.client.0.smithi117.stdout:8/720: fdatasync db/d1b/f3c 0 2024-04-12T09:11:17.663 INFO:tasks.workunit.client.0.smithi117.stdout:0/826: sync 2024-04-12T09:11:17.664 INFO:tasks.workunit.client.0.smithi117.stdout:8/721: mkdir db/d1b/d62/df0 0 2024-04-12T09:11:17.664 INFO:tasks.workunit.client.0.smithi117.stdout:0/827: write d3/f81 [1008392,59315] 0 2024-04-12T09:11:17.670 INFO:tasks.workunit.client.0.smithi117.stdout:1/683: dread d1/f77 [0,4194304] 0 2024-04-12T09:11:17.672 INFO:tasks.workunit.client.0.smithi117.stdout:0/828: link d3/da2/dee/dd5/dff/d84/dc2/cfc d3/c10f 0 2024-04-12T09:11:17.717 INFO:tasks.workunit.client.0.smithi117.stdout:1/684: fdatasync d1/f40 0 2024-04-12T09:11:17.721 INFO:tasks.workunit.client.0.smithi117.stdout:1/685: dread d1/dbd/d3f/d72/fa4 [0,4194304] 0 2024-04-12T09:11:17.726 INFO:tasks.workunit.client.0.smithi117.stdout:0/829: rmdir d3/da2/dee/d76/d83/ddf 0 2024-04-12T09:11:17.731 INFO:tasks.workunit.client.0.smithi117.stdout:8/722: dwrite db/d13/d38/dc3/d9d/fc6 [0,4194304] 0 2024-04-12T09:11:17.732 INFO:tasks.workunit.client.0.smithi117.stdout:0/830: creat d3/da2/dee/d76/d83/da8/d97/d104/f110 x:0 0 0 2024-04-12T09:11:17.736 INFO:tasks.workunit.client.0.smithi117.stdout:8/723: truncate db/d4b/d9a/fd8 243804 0 2024-04-12T09:11:17.736 INFO:tasks.workunit.client.0.smithi117.stdout:1/686: dread d1/dbd/d3f/db/f73 [0,4194304] 0 2024-04-12T09:11:17.737 INFO:tasks.workunit.client.0.smithi117.stdout:0/831: dread - d3/d30/dc8/d10d/fad zero size 2024-04-12T09:11:17.738 INFO:tasks.workunit.client.0.smithi117.stdout:8/724: mknod db/da6/cf1 0 2024-04-12T09:11:17.739 INFO:tasks.workunit.client.0.smithi117.stdout:0/832: write d3/dc/f2e [4647579,58510] 0 2024-04-12T09:11:17.739 INFO:tasks.workunit.client.0.smithi117.stdout:8/725: chown db/d13/d38/d86/ce5 1 1 2024-04-12T09:11:17.741 INFO:tasks.workunit.client.0.smithi117.stdout:8/726: chown db/d4b/fea 33917 1 2024-04-12T09:11:17.743 INFO:tasks.workunit.client.0.smithi117.stdout:8/727: read - db/d19/d1a/d3d/d60/f9b zero size 2024-04-12T09:11:17.745 INFO:tasks.workunit.client.0.smithi117.stdout:0/833: link d3/da2/dee/d76/d83/da8/d9a/fa6 d3/da2/dee/d76/d83/f111 0 2024-04-12T09:11:17.746 INFO:tasks.workunit.client.0.smithi117.stdout:1/687: rmdir d1/dbd/d3f/db/d1d/d78/da7 0 2024-04-12T09:11:17.746 INFO:tasks.workunit.client.0.smithi117.stdout:1/688: chown d1/d64/d45/d4c/la6 76 1 2024-04-12T09:11:17.747 INFO:tasks.workunit.client.0.smithi117.stdout:8/728: creat db/d19/d1a/d3d/d60/ff2 x:0 0 0 2024-04-12T09:11:17.748 INFO:tasks.workunit.client.0.smithi117.stdout:0/834: symlink d3/dc/l112 0 2024-04-12T09:11:17.749 INFO:tasks.workunit.client.0.smithi117.stdout:0/835: stat d3/da2/dee/dd5/dff/d84/dc2/c100 0 2024-04-12T09:11:17.751 INFO:tasks.workunit.client.0.smithi117.stdout:8/729: creat db/d13/d38/ff3 x:0 0 0 2024-04-12T09:11:17.751 INFO:tasks.workunit.client.0.smithi117.stdout:0/836: creat d3/da2/dee/dd5/dff/d91/d94/d5a/d62/d66/d73/f113 x:0 0 0 2024-04-12T09:11:17.752 INFO:tasks.workunit.client.0.smithi117.stdout:8/730: truncate db/d77/f49 2996621 0 2024-04-12T09:11:17.754 INFO:tasks.workunit.client.0.smithi117.stdout:8/731: creat db/d19/d1a/d3d/d60/d70/d98/ff4 x:0 0 0 2024-04-12T09:11:17.755 INFO:tasks.workunit.client.0.smithi117.stdout:8/732: chown db/d1b/d62/f66 21 1 2024-04-12T09:11:17.755 INFO:tasks.workunit.client.0.smithi117.stdout:8/733: dread - db/d19/d1a/d3d/fbd zero size 2024-04-12T09:11:17.757 INFO:tasks.workunit.client.0.smithi117.stdout:8/734: creat db/d19/d1a/d3d/ff5 x:0 0 0 2024-04-12T09:11:17.759 INFO:tasks.workunit.client.0.smithi117.stdout:8/735: fsync db/d13/f81 0 2024-04-12T09:11:17.761 INFO:tasks.workunit.client.0.smithi117.stdout:8/736: write db/d13/f54 [226394,123018] 0 2024-04-12T09:11:17.762 INFO:tasks.workunit.client.0.smithi117.stdout:1/689: dread d1/dbd/d3f/db/d16/db6/da9/d9a/fb9 [0,4194304] 0 2024-04-12T09:11:17.766 INFO:tasks.workunit.client.0.smithi117.stdout:1/690: symlink d1/dbd/d3f/db/ld9 0 2024-04-12T09:11:17.768 INFO:tasks.workunit.client.0.smithi117.stdout:1/691: write d1/dbd/d3f/db/d16/f2f [2981645,24433] 0 2024-04-12T09:11:17.770 INFO:tasks.workunit.client.0.smithi117.stdout:1/692: symlink d1/dbd/d51/lda 0 2024-04-12T09:11:17.772 INFO:tasks.workunit.client.0.smithi117.stdout:1/693: read - d1/dbd/d3f/db/d16/f8b zero size 2024-04-12T09:11:17.773 INFO:tasks.workunit.client.0.smithi117.stdout:1/694: write d1/dbd/d3f/f9b [2378176,50708] 0 2024-04-12T09:11:17.777 INFO:tasks.workunit.client.0.smithi117.stdout:1/695: truncate d1/f4d 1873718 0 2024-04-12T09:11:17.781 INFO:tasks.workunit.client.0.smithi117.stdout:8/737: rename db/d13/c64 to db/d19/d1a/d3d/cf6 0 2024-04-12T09:11:17.787 INFO:tasks.workunit.client.0.smithi117.stdout:8/738: write db/d19/d1a/d3d/fcf [909520,37500] 0 2024-04-12T09:11:17.798 INFO:tasks.workunit.client.0.smithi117.stdout:1/696: dread d1/dbd/d3f/db/d16/db6/da9/fd8 [4194304,4194304] 0 2024-04-12T09:11:17.798 INFO:tasks.workunit.client.0.smithi117.stdout:1/697: truncate d1/f9d 331579 0 2024-04-12T09:11:17.813 INFO:tasks.workunit.client.0.smithi117.stdout:1/698: dread d1/dbd/d3f/db/d16/db6/f8c [0,4194304] 0 2024-04-12T09:11:17.815 INFO:tasks.workunit.client.0.smithi117.stdout:1/699: mknod d1/dbd/d3f/db/d16/db6/da9/d9a/d54/cdb 0 2024-04-12T09:11:17.815 INFO:tasks.workunit.client.0.smithi117.stdout:1/700: chown d1/dbd/f1a 25 1 2024-04-12T09:11:17.821 INFO:tasks.workunit.client.0.smithi117.stdout:1/701: dwrite d1/dbd/f1a [4194304,4194304] 0 2024-04-12T09:11:17.824 INFO:tasks.workunit.client.0.smithi117.stdout:1/702: readlink d1/dbd/d3f/db/d1d/la8 0 2024-04-12T09:11:17.824 INFO:tasks.workunit.client.0.smithi117.stdout:1/703: readlink d1/l6b 0 2024-04-12T09:11:17.830 INFO:tasks.workunit.client.0.smithi117.stdout:1/704: dwrite d1/dbd/d51/f81 [0,4194304] 0 2024-04-12T09:11:17.837 INFO:tasks.workunit.client.0.smithi117.stdout:1/705: truncate d1/d64/d45/f50 1831824 0 2024-04-12T09:11:17.840 INFO:tasks.workunit.client.0.smithi117.stdout:1/706: mknod d1/dbd/d3f/db/d1d/cdc 0 2024-04-12T09:11:17.850 INFO:tasks.workunit.client.0.smithi117.stdout:5/758: sync 2024-04-12T09:11:17.850 INFO:tasks.workunit.client.0.smithi117.stdout:6/689: sync 2024-04-12T09:11:17.851 INFO:tasks.workunit.client.0.smithi117.stdout:7/557: sync 2024-04-12T09:11:17.851 INFO:tasks.workunit.client.0.smithi117.stdout:9/626: sync 2024-04-12T09:11:17.853 INFO:tasks.workunit.client.0.smithi117.stdout:5/759: fsync d2/fcf 0 2024-04-12T09:11:17.855 INFO:tasks.workunit.client.0.smithi117.stdout:6/690: mknod d8/d2a/d94/cd5 0 2024-04-12T09:11:17.856 INFO:tasks.workunit.client.0.smithi117.stdout:7/558: fdatasync d0/d2/d45/d17/d23/d50/f3d 0 2024-04-12T09:11:17.856 INFO:tasks.workunit.client.0.smithi117.stdout:1/707: dwrite d1/d64/f43 [0,4194304] 0 2024-04-12T09:11:17.864 INFO:tasks.workunit.client.0.smithi117.stdout:5/760: unlink d2/d3/de/d1e/f76 0 2024-04-12T09:11:17.865 INFO:tasks.workunit.client.0.smithi117.stdout:6/691: unlink d8/d2a/d6e/fc5 0 2024-04-12T09:11:17.866 INFO:tasks.workunit.client.0.smithi117.stdout:7/559: write d0/d2/d45/d15/f54 [5953318,211] 0 2024-04-12T09:11:17.867 INFO:tasks.workunit.client.0.smithi117.stdout:1/708: readlink d1/dbd/d3f/db/d16/db6/da9/d9a/d71/la1 0 2024-04-12T09:11:17.868 INFO:tasks.workunit.client.0.smithi117.stdout:1/709: fsync d1/d64/f93 0 2024-04-12T09:11:17.868 INFO:tasks.workunit.client.0.smithi117.stdout:7/560: chown d0/d2/d12/l97 115425 1 2024-04-12T09:11:17.871 INFO:tasks.workunit.client.0.smithi117.stdout:6/692: chown d8/d9/l53 13 1 2024-04-12T09:11:17.872 INFO:tasks.workunit.client.0.smithi117.stdout:1/710: creat d1/d64/d45/fdd x:0 0 0 2024-04-12T09:11:17.875 INFO:tasks.workunit.client.0.smithi117.stdout:6/693: creat d8/d3f/fd6 x:0 0 0 2024-04-12T09:11:17.876 INFO:tasks.workunit.client.0.smithi117.stdout:5/761: creat d2/d3/dd/ffa x:0 0 0 2024-04-12T09:11:17.877 INFO:tasks.workunit.client.0.smithi117.stdout:5/762: chown d2/d3/dd/d39/d83/d4d/d6b/f97 0 1 2024-04-12T09:11:17.881 INFO:tasks.workunit.client.0.smithi117.stdout:5/763: creat d2/d3/de/d1e/d99/ffb x:0 0 0 2024-04-12T09:11:17.882 INFO:tasks.workunit.client.0.smithi117.stdout:9/627: write d1/d8/d5a/d79/d91/db0/d41/f89 [1090453,22271] 0 2024-04-12T09:11:17.882 INFO:tasks.workunit.client.0.smithi117.stdout:5/764: fdatasync d2/f91 0 2024-04-12T09:11:17.886 INFO:tasks.workunit.client.0.smithi117.stdout:5/765: creat d2/d3/dd/d39/d83/d4d/ffc x:0 0 0 2024-04-12T09:11:17.889 INFO:tasks.workunit.client.0.smithi117.stdout:7/561: truncate d0/f2b 3912819 0 2024-04-12T09:11:17.889 INFO:tasks.workunit.client.0.smithi117.stdout:5/766: truncate d2/d3/dd/d39/d83/d4d/d6b/fef 661130 0 2024-04-12T09:11:17.891 INFO:tasks.workunit.client.0.smithi117.stdout:1/711: rmdir d1/d64/d45 39 2024-04-12T09:11:17.891 INFO:tasks.workunit.client.0.smithi117.stdout:5/767: write d2/d3/de/fc0 [258958,10198] 0 2024-04-12T09:11:17.892 INFO:tasks.workunit.client.0.smithi117.stdout:7/562: mkdir d0/da/d7c/dae 0 2024-04-12T09:11:17.893 INFO:tasks.workunit.client.0.smithi117.stdout:5/768: write d2/d3/de/d1e/d79/f98 [5157540,78428] 0 2024-04-12T09:11:17.893 INFO:tasks.workunit.client.0.smithi117.stdout:6/694: write d8/d9/f19 [1404115,105373] 0 2024-04-12T09:11:17.896 INFO:tasks.workunit.client.0.smithi117.stdout:9/628: write d1/d8/d5a/d79/d91/db0/d41/daf/d3b/f8c [65043,126207] 0 2024-04-12T09:11:17.899 INFO:tasks.workunit.client.0.smithi117.stdout:6/695: creat d8/d2a/d60/d7d/d8c/db8/fd7 x:0 0 0 2024-04-12T09:11:17.900 INFO:tasks.workunit.client.0.smithi117.stdout:7/563: unlink d0/d2/d45/d17/d23/d50/c70 0 2024-04-12T09:11:17.901 INFO:tasks.workunit.client.0.smithi117.stdout:5/769: mknod d2/d3/de/d1e/cfd 0 2024-04-12T09:11:17.906 INFO:tasks.workunit.client.0.smithi117.stdout:7/564: creat d0/da/d7c/dae/faf x:0 0 0 2024-04-12T09:11:17.906 INFO:tasks.workunit.client.0.smithi117.stdout:6/696: dwrite d8/d9/d61/fa0 [0,4194304] 0 2024-04-12T09:11:17.907 INFO:tasks.workunit.client.0.smithi117.stdout:6/697: chown d8/d3f/d51/d97 337 1 2024-04-12T09:11:17.910 INFO:tasks.workunit.client.0.smithi117.stdout:5/770: creat d2/d3/dd/d39/d82/dd6/ffe x:0 0 0 2024-04-12T09:11:17.911 INFO:tasks.workunit.client.0.smithi117.stdout:7/565: rmdir d0/d2/d45/d17/d23 39 2024-04-12T09:11:17.912 INFO:tasks.workunit.client.0.smithi117.stdout:6/698: mknod d8/d3a/d49/da4/d8a/cd8 0 2024-04-12T09:11:17.917 INFO:tasks.workunit.client.0.smithi117.stdout:9/629: truncate d1/d8/df/d1b/f3f 269139 0 2024-04-12T09:11:17.923 INFO:tasks.workunit.client.0.smithi117.stdout:5/771: creat d2/d3/dd/d39/d82/fff x:0 0 0 2024-04-12T09:11:17.927 INFO:tasks.workunit.client.0.smithi117.stdout:7/566: creat d0/d2/d45/d17/d23/fb0 x:0 0 0 2024-04-12T09:11:17.929 INFO:tasks.workunit.client.0.smithi117.stdout:5/772: read d2/d3/de/d1e/d35/f93 [3460446,60781] 0 2024-04-12T09:11:17.934 INFO:tasks.workunit.client.0.smithi117.stdout:9/630: link d1/d8/c33 d1/d8/df/ccd 0 2024-04-12T09:11:17.934 INFO:tasks.workunit.client.0.smithi117.stdout:5/773: dread d2/f49 [0,4194304] 0 2024-04-12T09:11:17.936 INFO:tasks.workunit.client.0.smithi117.stdout:5/774: read - d2/d3/de/d1e/d79/fe6 zero size 2024-04-12T09:11:17.936 INFO:tasks.workunit.client.0.smithi117.stdout:7/567: truncate d0/d2/d45/d17/f3a 2745057 0 2024-04-12T09:11:17.938 INFO:tasks.workunit.client.0.smithi117.stdout:5/775: chown d2/d3/de/d1e/d99 120803 1 2024-04-12T09:11:17.938 INFO:tasks.workunit.client.0.smithi117.stdout:9/631: mkdir d1/d8/df/d3e/d92/dce 0 2024-04-12T09:11:17.942 INFO:tasks.workunit.client.0.smithi117.stdout:5/776: mknod d2/d3/dd/d39/d7a/c100 0 2024-04-12T09:11:17.944 INFO:tasks.workunit.client.0.smithi117.stdout:9/632: creat d1/d8/df/fcf x:0 0 0 2024-04-12T09:11:17.945 INFO:tasks.workunit.client.0.smithi117.stdout:5/777: symlink d2/d3/de/d1e/d46/d96/d9c/l101 0 2024-04-12T09:11:17.961 INFO:tasks.workunit.client.0.smithi117.stdout:7/568: dread d0/d2/d45/d17/d23/d39/d6c/fa4 [0,4194304] 0 2024-04-12T09:11:17.961 INFO:tasks.workunit.client.0.smithi117.stdout:9/633: dread d1/d8/d12/f38 [8388608,4194304] 0 2024-04-12T09:11:17.962 INFO:tasks.workunit.client.0.smithi117.stdout:7/569: dread - d0/da/d7c/dae/faf zero size 2024-04-12T09:11:17.963 INFO:tasks.workunit.client.0.smithi117.stdout:9/634: write d1/d8/d5a/d79/d91/db0/d41/daf/d3b/f4c [249120,38539] 0 2024-04-12T09:11:17.975 INFO:tasks.workunit.client.0.smithi117.stdout:9/635: rmdir d1/d8/d5a/d79/d91 39 2024-04-12T09:11:17.977 INFO:tasks.workunit.client.0.smithi117.stdout:9/636: readlink d1/d24/l47 0 2024-04-12T09:11:17.979 INFO:tasks.workunit.client.0.smithi117.stdout:9/637: fdatasync d1/d8/df/d7d/d7e/f78 0 2024-04-12T09:11:17.985 INFO:tasks.workunit.client.0.smithi117.stdout:9/638: getdents d1/d23 0 2024-04-12T09:11:17.986 INFO:tasks.workunit.client.0.smithi117.stdout:9/639: fdatasync d1/d8/d5a/d6e/f9c 0 2024-04-12T09:11:17.989 INFO:tasks.workunit.client.0.smithi117.stdout:9/640: symlink d1/d8/d5a/d6e/d71/ld0 0 2024-04-12T09:11:17.991 INFO:tasks.workunit.client.0.smithi117.stdout:9/641: mknod d1/d8/df/cd1 0 2024-04-12T09:11:17.992 INFO:tasks.workunit.client.0.smithi117.stdout:9/642: readlink d1/d24/l9e 0 2024-04-12T09:11:17.994 INFO:tasks.workunit.client.0.smithi117.stdout:9/643: symlink d1/d8/df/d3e/d92/dce/ld2 0 2024-04-12T09:11:17.995 INFO:tasks.workunit.client.0.smithi117.stdout:7/570: dwrite d0/d13/f76 [0,4194304] 0 2024-04-12T09:11:17.995 INFO:tasks.workunit.client.0.smithi117.stdout:9/644: readlink d1/d8/df/d7d/d7e/l5f 0 2024-04-12T09:11:17.999 INFO:tasks.workunit.client.0.smithi117.stdout:7/571: rmdir d0/d2/d45/d17/d23 39 2024-04-12T09:11:18.000 INFO:tasks.workunit.client.0.smithi117.stdout:9/645: creat d1/d8/d5e/fd3 x:0 0 0 2024-04-12T09:11:18.003 INFO:tasks.workunit.client.0.smithi117.stdout:9/646: chown d1/d8/c33 1117 1 2024-04-12T09:11:18.006 INFO:tasks.workunit.client.0.smithi117.stdout:7/572: dwrite d0/d2/d45/f5a [4194304,4194304] 0 2024-04-12T09:11:18.007 INFO:tasks.workunit.client.0.smithi117.stdout:9/647: write d1/d8/d5a/d79/d91/db0/f46 [6673500,86494] 0 2024-04-12T09:11:18.008 INFO:tasks.workunit.client.0.smithi117.stdout:9/648: chown d1/c53 381771 1 2024-04-12T09:11:18.012 INFO:tasks.workunit.client.0.smithi117.stdout:9/649: mknod d1/d8/d5a/d6e/d71/cd4 0 2024-04-12T09:11:18.013 INFO:tasks.workunit.client.0.smithi117.stdout:9/650: write d1/d8/df/d68/fc1 [253437,73630] 0 2024-04-12T09:11:18.016 INFO:tasks.workunit.client.0.smithi117.stdout:9/651: chown d1/d8/df/d1b/l40 1 1 2024-04-12T09:11:18.019 INFO:tasks.workunit.client.0.smithi117.stdout:7/573: dwrite d0/d2/d1a/d49/f5e [0,4194304] 0 2024-04-12T09:11:18.021 INFO:tasks.workunit.client.0.smithi117.stdout:7/574: write d0/d13/f76 [4704376,120774] 0 2024-04-12T09:11:18.028 INFO:tasks.workunit.client.0.smithi117.stdout:7/575: symlink d0/d2/d71/lb1 0 2024-04-12T09:11:18.029 INFO:tasks.workunit.client.0.smithi117.stdout:9/652: truncate d1/d8/d5a/d79/d91/db0/d41/daf/f6f 344592 0 2024-04-12T09:11:18.030 INFO:tasks.workunit.client.0.smithi117.stdout:4/691: sync 2024-04-12T09:11:18.032 INFO:tasks.workunit.client.0.smithi117.stdout:7/576: creat d0/d2/d45/d17/d23/d51/fb2 x:0 0 0 2024-04-12T09:11:18.032 INFO:tasks.workunit.client.0.smithi117.stdout:9/653: dread d1/d8/d5a/d79/d91/db0/d41/daf/d3b/f8c [0,4194304] 0 2024-04-12T09:11:18.039 INFO:tasks.workunit.client.0.smithi117.stdout:9/654: getdents d1/d8/d5a/d79/d91/db0/d41/daf 0 2024-04-12T09:11:18.040 INFO:tasks.workunit.client.0.smithi117.stdout:7/577: dwrite d0/d20/fa5 [0,4194304] 0 2024-04-12T09:11:18.044 INFO:tasks.workunit.client.0.smithi117.stdout:7/578: write d0/d2/d45/d17/d23/d51/fb2 [97929,24697] 0 2024-04-12T09:11:18.047 INFO:tasks.workunit.client.0.smithi117.stdout:4/692: truncate d0/d2c/d8d/fe0 1233980 0 2024-04-12T09:11:18.056 INFO:tasks.workunit.client.0.smithi117.stdout:7/579: creat d0/d2/d45/da1/fb3 x:0 0 0 2024-04-12T09:11:18.060 INFO:tasks.workunit.client.0.smithi117.stdout:9/655: getdents d1/d8/df 0 2024-04-12T09:11:18.067 INFO:tasks.workunit.client.0.smithi117.stdout:7/580: creat d0/d2/d45/d17/d23/dac/dad/daa/fb4 x:0 0 0 2024-04-12T09:11:18.068 INFO:tasks.workunit.client.0.smithi117.stdout:4/693: dread d0/d5/f6e [0,4194304] 0 2024-04-12T09:11:18.074 INFO:tasks.workunit.client.0.smithi117.stdout:9/656: dread d1/d8/d5a/d79/d91/db0/d41/daf/f6f [0,4194304] 0 2024-04-12T09:11:18.079 INFO:tasks.workunit.client.0.smithi117.stdout:4/694: dread d0/d2c/f93 [0,4194304] 0 2024-04-12T09:11:18.082 INFO:tasks.workunit.client.0.smithi117.stdout:9/657: mkdir d1/d8/dd5 0 2024-04-12T09:11:18.082 INFO:tasks.workunit.client.0.smithi117.stdout:9/658: readlink d1/d24/l47 0 2024-04-12T09:11:18.085 INFO:tasks.workunit.client.0.smithi117.stdout:7/581: write d0/d2/d45/d17/d23/d50/f3b [2193,55747] 0 2024-04-12T09:11:18.087 INFO:tasks.workunit.client.0.smithi117.stdout:7/582: write d0/da/d7c/dae/faf [45112,66630] 0 2024-04-12T09:11:18.093 INFO:tasks.workunit.client.0.smithi117.stdout:9/659: getdents d1/d8/d5a/d79/d91/db0/d41 0 2024-04-12T09:11:18.094 INFO:tasks.workunit.client.0.smithi117.stdout:4/695: dread d0/d5/d3b/d38/d4f/f76 [0,4194304] 0 2024-04-12T09:11:18.095 INFO:tasks.workunit.client.0.smithi117.stdout:9/660: read d1/d8/d5e/f6d [6491597,49177] 0 2024-04-12T09:11:18.097 INFO:tasks.workunit.client.0.smithi117.stdout:9/661: chown d1/d8/d5a/d79/d91/db0 0 1 2024-04-12T09:11:18.100 INFO:tasks.workunit.client.0.smithi117.stdout:4/696: dwrite d0/fb2 [4194304,4194304] 0 2024-04-12T09:11:18.100 INFO:tasks.workunit.client.0.smithi117.stdout:4/697: chown d0/d5 13 1 2024-04-12T09:11:18.106 INFO:tasks.workunit.client.0.smithi117.stdout:9/662: creat d1/d24/fd6 x:0 0 0 2024-04-12T09:11:18.109 INFO:tasks.workunit.client.0.smithi117.stdout:9/663: mknod d1/d8/d12/cd7 0 2024-04-12T09:11:18.110 INFO:tasks.workunit.client.0.smithi117.stdout:9/664: stat d1/d8/d5a/d79/d91/db0/d41/daf 0 2024-04-12T09:11:18.113 INFO:tasks.workunit.client.0.smithi117.stdout:4/698: getdents d0/d5/d25/dc8 0 2024-04-12T09:11:18.117 INFO:tasks.workunit.client.0.smithi117.stdout:7/583: truncate d0/d2/d45/d17/f31 3467121 0 2024-04-12T09:11:18.119 INFO:tasks.workunit.client.0.smithi117.stdout:9/665: fsync d1/d8/d12/f20 0 2024-04-12T09:11:18.121 INFO:tasks.workunit.client.0.smithi117.stdout:4/699: unlink d0/d1/d34/f5b 0 2024-04-12T09:11:18.127 INFO:tasks.workunit.client.0.smithi117.stdout:4/700: unlink d0/d5/d25/fc6 0 2024-04-12T09:11:18.132 INFO:tasks.workunit.client.0.smithi117.stdout:4/701: mknod d0/d5/d25/d69/ce3 0 2024-04-12T09:11:18.135 INFO:tasks.workunit.client.0.smithi117.stdout:7/584: rename d0/d2/d12/l2c to d0/lb5 0 2024-04-12T09:11:18.138 INFO:tasks.workunit.client.0.smithi117.stdout:9/666: creat d1/d24/fd8 x:0 0 0 2024-04-12T09:11:18.138 INFO:tasks.workunit.client.0.smithi117.stdout:9/667: stat d1/c53 0 2024-04-12T09:11:18.138 INFO:tasks.workunit.client.0.smithi117.stdout:9/668: chown d1/d8/df/ccd 1 1 2024-04-12T09:11:18.140 INFO:tasks.workunit.client.0.smithi117.stdout:4/702: symlink d0/d5/d3b/d38/d4f/d79/d9c/dab/le4 0 2024-04-12T09:11:18.141 INFO:tasks.workunit.client.0.smithi117.stdout:4/703: read - d0/d5/d3b/d38/d4f/d79/d9c/dab/fcb zero size 2024-04-12T09:11:18.142 INFO:tasks.workunit.client.0.smithi117.stdout:7/585: symlink d0/d2/d45/da1/lb6 0 2024-04-12T09:11:18.149 INFO:tasks.workunit.client.0.smithi117.stdout:4/704: creat d0/db3/fe5 x:0 0 0 2024-04-12T09:11:18.150 INFO:tasks.workunit.client.0.smithi117.stdout:4/705: chown d0/d5/d39/d4e/d6b/d83/f85 1 1 2024-04-12T09:11:18.151 INFO:tasks.workunit.client.0.smithi117.stdout:4/706: chown d0/d5/d25/dc8/da0/fc7 4240551 1 2024-04-12T09:11:18.153 INFO:tasks.workunit.client.0.smithi117.stdout:7/586: unlink d0/d2/d1a/d49/f56 0 2024-04-12T09:11:18.159 INFO:tasks.workunit.client.0.smithi117.stdout:9/669: fdatasync d1/d8/df/d3e/f2b 0 2024-04-12T09:11:18.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:17 smithi117 ceph-mon[29277]: pgmap v19: 65 pgs: 65 active+clean; 1.6 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 61 MiB/s rd, 187 MiB/s wr, 515 op/s 2024-04-12T09:11:18.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:17 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:18.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:17 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:18.165 INFO:tasks.workunit.client.0.smithi117.stdout:4/707: mkdir d0/db3/da7/dcd/de6 0 2024-04-12T09:11:18.167 INFO:tasks.workunit.client.0.smithi117.stdout:7/587: creat d0/d2/d45/d15/fb7 x:0 0 0 2024-04-12T09:11:18.181 INFO:tasks.workunit.client.0.smithi117.stdout:7/588: creat d0/d2/d45/d17/d23/d39/fb8 x:0 0 0 2024-04-12T09:11:18.186 INFO:tasks.workunit.client.0.smithi117.stdout:7/589: rename d0/d2/d45/d17/d23/c4d to d0/d2/d45/d53/d58/cb9 0 2024-04-12T09:11:18.189 INFO:tasks.workunit.client.0.smithi117.stdout:9/670: write d1/fc [4695417,74366] 0 2024-04-12T09:11:18.191 INFO:tasks.workunit.client.0.smithi117.stdout:7/590: symlink d0/d2/d45/lba 0 2024-04-12T09:11:18.192 INFO:tasks.workunit.client.0.smithi117.stdout:7/591: chown d0/d2/d45/d17/d23/d51/fb2 182792987 1 2024-04-12T09:11:18.193 INFO:tasks.workunit.client.0.smithi117.stdout:4/708: write d0/d2c/f4d [1339206,40752] 0 2024-04-12T09:11:18.195 INFO:tasks.workunit.client.0.smithi117.stdout:9/671: symlink d1/ld9 0 2024-04-12T09:11:18.196 INFO:tasks.workunit.client.0.smithi117.stdout:4/709: rmdir d0/d5 39 2024-04-12T09:11:18.199 INFO:tasks.workunit.client.0.smithi117.stdout:7/592: rename d0/d2/d45/d17/d23/d39/d6c/c99 to d0/d2/d12/cbb 0 2024-04-12T09:11:18.201 INFO:tasks.workunit.client.0.smithi117.stdout:3/991: sync 2024-04-12T09:11:18.204 INFO:tasks.workunit.client.0.smithi117.stdout:9/672: dwrite d1/d8/d5a/d79/d91/db0/d41/daf/d3b/f4c [8388608,4194304] 0 2024-04-12T09:11:18.216 INFO:tasks.workunit.client.0.smithi117.stdout:9/673: creat d1/d8/dd5/fda x:0 0 0 2024-04-12T09:11:18.217 INFO:tasks.workunit.client.0.smithi117.stdout:4/710: getdents d0/d5/d25/dc8 0 2024-04-12T09:11:18.218 INFO:tasks.workunit.client.0.smithi117.stdout:7/593: getdents d0/da/d7c/dae 0 2024-04-12T09:11:18.220 INFO:tasks.workunit.client.0.smithi117.stdout:4/711: creat d0/d1/fe7 x:0 0 0 2024-04-12T09:11:18.224 INFO:tasks.workunit.client.0.smithi117.stdout:4/712: mknod d0/db3/ce8 0 2024-04-12T09:11:18.247 INFO:tasks.workunit.client.0.smithi117.stdout:3/992: write de/d2c/d59/d70/d3e/d5d/d80/d97/fdb [3060206,25674] 0 2024-04-12T09:11:18.252 INFO:tasks.workunit.client.0.smithi117.stdout:3/993: mkdir de/d2c/d59/d70/d3e/d84/da1/d169 0 2024-04-12T09:11:18.254 INFO:tasks.workunit.client.0.smithi117.stdout:3/994: creat de/def/f16a x:0 0 0 2024-04-12T09:11:18.259 INFO:tasks.workunit.client.0.smithi117.stdout:3/995: creat de/d2c/d59/d70/d3e/d3f/dae/f16b x:0 0 0 2024-04-12T09:11:18.262 INFO:tasks.workunit.client.0.smithi117.stdout:4/713: write d0/d5/f50 [1104700,13504] 0 2024-04-12T09:11:18.264 INFO:tasks.workunit.client.0.smithi117.stdout:3/996: symlink de/d2c/d59/d70/d3e/d5d/d89/d8d/l16c 0 2024-04-12T09:11:18.266 INFO:tasks.workunit.client.0.smithi117.stdout:3/997: write de/d2c/d59/d4c/da0/daa/fbd [1526637,68126] 0 2024-04-12T09:11:18.273 INFO:tasks.workunit.client.0.smithi117.stdout:4/714: dread d0/d2c/d8d/fe0 [0,4194304] 0 2024-04-12T09:11:18.275 INFO:tasks.workunit.client.0.smithi117.stdout:3/998: fdatasync de/d2c/d59/d70/d3d/d63/de1/d106/fe5 0 2024-04-12T09:11:18.282 INFO:tasks.workunit.client.0.smithi117.stdout:7/594: dwrite d0/d2/d45/d17/d23/d39/d6c/f8b [4194304,4194304] 0 2024-04-12T09:11:18.284 INFO:tasks.workunit.client.0.smithi117.stdout:3/999: mkdir de/d2c/d59/d90/ded/d16d 0 2024-04-12T09:11:18.287 INFO:tasks.workunit.client.0.smithi117.stdout:7/595: rmdir d0/d2/d45/d17 39 2024-04-12T09:11:18.293 INFO:tasks.workunit.client.0.smithi117.stdout:7/596: rmdir d0/d2/d45/d17/d23/dac 39 2024-04-12T09:11:18.296 INFO:tasks.workunit.client.0.smithi117.stdout:7/597: truncate d0/d2/f43 1015768 0 2024-04-12T09:11:18.301 INFO:tasks.workunit.client.0.smithi117.stdout:7/598: dwrite d0/d13/f40 [0,4194304] 0 2024-04-12T09:11:18.303 INFO:tasks.workunit.client.0.smithi117.stdout:7/599: truncate d0/da/d7c/dae/faf 139159 0 2024-04-12T09:11:18.308 INFO:tasks.workunit.client.0.smithi117.stdout:7/600: dread d0/d13/f76 [0,4194304] 0 2024-04-12T09:11:18.311 INFO:tasks.workunit.client.0.smithi117.stdout:7/601: truncate d0/d2/d45/d17/d23/d51/fb2 777467 0 2024-04-12T09:11:18.311 INFO:tasks.workunit.client.0.smithi117.stdout:7/602: read - d0/d2/d1a/d4f/fa2 zero size 2024-04-12T09:11:18.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:17 smithi203 ceph-mon[36428]: pgmap v19: 65 pgs: 65 active+clean; 1.6 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 61 MiB/s rd, 187 MiB/s wr, 515 op/s 2024-04-12T09:11:18.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:17 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:18.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:17 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:18.325 INFO:tasks.workunit.client.0.smithi117.stdout:4/715: write d0/d1/fbd [477211,101119] 0 2024-04-12T09:11:18.328 INFO:tasks.workunit.client.0.smithi117.stdout:4/716: mkdir d0/d1/de9 0 2024-04-12T09:11:18.330 INFO:tasks.workunit.client.0.smithi117.stdout:4/717: symlink d0/db3/da7/dcd/dcf/lea 0 2024-04-12T09:11:18.335 INFO:tasks.workunit.client.0.smithi117.stdout:7/603: dread d0/d2/d45/f5a [0,4194304] 0 2024-04-12T09:11:18.337 INFO:tasks.workunit.client.0.smithi117.stdout:7/604: truncate d0/d2/d45/d15/f25 6607492 0 2024-04-12T09:11:18.337 INFO:tasks.workunit.client.0.smithi117.stdout:7/605: chown d0/d2/d45/f42 244943 1 2024-04-12T09:11:18.354 INFO:tasks.workunit.client.0.smithi117.stdout:4/718: dwrite d0/d5/d3b/f94 [0,4194304] 0 2024-04-12T09:11:18.357 INFO:tasks.workunit.client.0.smithi117.stdout:4/719: rmdir d0/db3/da7/dcd/dcf 39 2024-04-12T09:11:18.359 INFO:tasks.workunit.client.0.smithi117.stdout:4/720: rmdir d0/d2c/d3c 39 2024-04-12T09:11:18.360 INFO:tasks.workunit.client.0.smithi117.stdout:4/721: readlink d0/d5/d39/d4e/d6b/d83/db1/lcc 0 2024-04-12T09:11:18.364 INFO:tasks.workunit.client.1.smithi203.stdout:4/1: sync 2024-04-12T09:11:18.364 INFO:tasks.workunit.client.1.smithi203.stdout:2/5: sync 2024-04-12T09:11:18.365 INFO:tasks.workunit.client.1.smithi203.stdout:2/6: chown d0 1 1 2024-04-12T09:11:18.365 INFO:tasks.workunit.client.1.smithi203.stdout:2/7: link - no file 2024-04-12T09:11:18.366 INFO:tasks.workunit.client.1.smithi203.stdout:4/2: symlink l1 0 2024-04-12T09:11:18.366 INFO:tasks.workunit.client.1.smithi203.stdout:4/3: truncate - no filename 2024-04-12T09:11:18.366 INFO:tasks.workunit.client.1.smithi203.stdout:4/4: stat l1 0 2024-04-12T09:11:18.366 INFO:tasks.workunit.client.1.smithi203.stdout:4/5: fsync - no filename 2024-04-12T09:11:18.367 INFO:tasks.workunit.client.1.smithi203.stdout:4/6: dwrite - no filename 2024-04-12T09:11:18.367 INFO:tasks.workunit.client.1.smithi203.stdout:4/7: dwrite - no filename 2024-04-12T09:11:18.367 INFO:tasks.workunit.client.1.smithi203.stdout:4/8: write - no filename 2024-04-12T09:11:18.367 INFO:tasks.workunit.client.1.smithi203.stdout:4/9: dread - no filename 2024-04-12T09:11:18.367 INFO:tasks.workunit.client.1.smithi203.stdout:2/8: mkdir d0/d1 0 2024-04-12T09:11:18.367 INFO:tasks.workunit.client.1.smithi203.stdout:2/9: truncate - no filename 2024-04-12T09:11:18.368 INFO:tasks.workunit.client.0.smithi117.stdout:4/722: dwrite d0/d5/d25/dc8/da0/fc7 [0,4194304] 0 2024-04-12T09:11:18.368 INFO:tasks.workunit.client.1.smithi203.stdout:4/10: rename l0 to l2 0 2024-04-12T09:11:18.368 INFO:tasks.workunit.client.1.smithi203.stdout:4/11: dread - no filename 2024-04-12T09:11:18.369 INFO:tasks.workunit.client.1.smithi203.stdout:4/12: truncate - no filename 2024-04-12T09:11:18.415 INFO:tasks.workunit.client.0.smithi117.stdout:2/612: sync 2024-04-12T09:11:18.415 INFO:tasks.workunit.client.0.smithi117.stdout:4/723: unlink d0/d72/c98 0 2024-04-12T09:11:18.416 INFO:tasks.workunit.client.1.smithi203.stdout:2/10: creat d0/d1/f2 x:0 0 0 2024-04-12T09:11:18.417 INFO:tasks.workunit.client.1.smithi203.stdout:2/11: chown d0/d1/f2 217745151 1 2024-04-12T09:11:18.417 INFO:tasks.workunit.client.1.smithi203.stdout:2/12: chown d0 38434353 1 2024-04-12T09:11:18.417 INFO:tasks.workunit.client.0.smithi117.stdout:4/724: rmdir d0/db3/daf 39 2024-04-12T09:11:18.418 INFO:tasks.workunit.client.1.smithi203.stdout:2/13: fdatasync d0/d1/f2 0 2024-04-12T09:11:18.418 INFO:tasks.workunit.client.1.smithi203.stdout:2/14: chown d0/d1/f2 21504 1 2024-04-12T09:11:18.418 INFO:tasks.workunit.client.1.smithi203.stdout:2/15: write d0/d1/f2 [659053,56030] 0 2024-04-12T09:11:18.418 INFO:tasks.workunit.client.0.smithi117.stdout:2/613: creat d0/fcd x:0 0 0 2024-04-12T09:11:18.422 INFO:tasks.workunit.client.0.smithi117.stdout:2/614: fsync d0/d43/d30/d41/f21 0 2024-04-12T09:11:18.422 INFO:tasks.workunit.client.1.smithi203.stdout:2/16: dread d0/d1/f2 [0,4194304] 0 2024-04-12T09:11:18.423 INFO:tasks.workunit.client.0.smithi117.stdout:2/615: readlink d0/d43/d53/l6a 0 2024-04-12T09:11:18.423 INFO:tasks.workunit.client.0.smithi117.stdout:2/616: readlink d0/l16 0 2024-04-12T09:11:18.427 INFO:tasks.workunit.client.0.smithi117.stdout:2/617: dread d0/d4/d81/d8b/fb5 [0,4194304] 0 2024-04-12T09:11:18.431 INFO:tasks.workunit.client.1.smithi203.stdout:2/17: rename d0/d1 to d0/d3 0 2024-04-12T09:11:18.432 INFO:tasks.workunit.client.1.smithi203.stdout:4/13: stat l2 0 2024-04-12T09:11:18.432 INFO:tasks.workunit.client.1.smithi203.stdout:4/14: write - no filename 2024-04-12T09:11:18.432 INFO:tasks.workunit.client.1.smithi203.stdout:4/15: dread - no filename 2024-04-12T09:11:18.432 INFO:tasks.workunit.client.1.smithi203.stdout:2/18: dread d0/d3/f2 [0,4194304] 0 2024-04-12T09:11:18.432 INFO:tasks.workunit.client.0.smithi117.stdout:4/725: write d0/db3/da7/fd4 [95718,71732] 0 2024-04-12T09:11:18.433 INFO:tasks.workunit.client.1.smithi203.stdout:2/19: read d0/d3/f2 [604822,58917] 0 2024-04-12T09:11:18.433 INFO:tasks.workunit.client.0.smithi117.stdout:4/726: stat d0/d1/d34/f80 0 2024-04-12T09:11:18.434 INFO:tasks.workunit.client.1.smithi203.stdout:2/20: dread d0/d3/f2 [0,4194304] 0 2024-04-12T09:11:18.434 INFO:tasks.workunit.client.0.smithi117.stdout:2/618: dwrite d0/f36 [4194304,4194304] 0 2024-04-12T09:11:18.436 INFO:tasks.workunit.client.1.smithi203.stdout:4/16: rename l2 to l3 0 2024-04-12T09:11:18.436 INFO:tasks.workunit.client.1.smithi203.stdout:4/17: read - no filename 2024-04-12T09:11:18.437 INFO:tasks.workunit.client.0.smithi117.stdout:2/619: write d0/d43/d30/f77 [5017816,12549] 0 2024-04-12T09:11:18.438 INFO:tasks.workunit.client.1.smithi203.stdout:2/21: write d0/d3/f2 [1430848,21006] 0 2024-04-12T09:11:18.442 INFO:tasks.workunit.client.1.smithi203.stdout:4/18: creat f4 x:0 0 0 2024-04-12T09:11:18.442 INFO:tasks.workunit.client.1.smithi203.stdout:4/19: rmdir - no directory 2024-04-12T09:11:18.443 INFO:tasks.workunit.client.1.smithi203.stdout:4/20: fdatasync f4 0 2024-04-12T09:11:18.443 INFO:tasks.workunit.client.1.smithi203.stdout:2/22: symlink d0/d3/l4 0 2024-04-12T09:11:18.444 INFO:tasks.workunit.client.0.smithi117.stdout:2/620: symlink d0/d43/lce 0 2024-04-12T09:11:18.444 INFO:tasks.workunit.client.1.smithi203.stdout:2/23: rename d0/d3 to d0/d3/d5 22 2024-04-12T09:11:18.447 INFO:tasks.workunit.client.0.smithi117.stdout:2/621: rename d0/df/cb1 to d0/df/ccf 0 2024-04-12T09:11:18.447 INFO:tasks.workunit.client.1.smithi203.stdout:9/9: sync 2024-04-12T09:11:18.447 INFO:tasks.workunit.client.1.smithi203.stdout:6/1: sync 2024-04-12T09:11:18.448 INFO:tasks.workunit.client.1.smithi203.stdout:3/14: sync 2024-04-12T09:11:18.448 INFO:tasks.workunit.client.0.smithi117.stdout:4/727: write d0/d5/d3b/d38/d4f/fb0 [553691,125290] 0 2024-04-12T09:11:18.448 INFO:tasks.workunit.client.1.smithi203.stdout:3/15: write f1 [981697,4208] 0 2024-04-12T09:11:18.450 INFO:tasks.workunit.client.1.smithi203.stdout:4/21: dwrite f4 [0,4194304] 0 2024-04-12T09:11:18.450 INFO:tasks.workunit.client.1.smithi203.stdout:3/16: write f1 [449826,113475] 0 2024-04-12T09:11:18.450 INFO:tasks.workunit.client.1.smithi203.stdout:9/10: creat f4 x:0 0 0 2024-04-12T09:11:18.453 INFO:tasks.workunit.client.1.smithi203.stdout:6/2: unlink f0 0 2024-04-12T09:11:18.453 INFO:tasks.workunit.client.1.smithi203.stdout:6/3: readlink - no filename 2024-04-12T09:11:18.453 INFO:tasks.workunit.client.1.smithi203.stdout:6/4: read - no filename 2024-04-12T09:11:18.453 INFO:tasks.workunit.client.1.smithi203.stdout:6/5: dwrite - no filename 2024-04-12T09:11:18.453 INFO:tasks.workunit.client.1.smithi203.stdout:6/6: dwrite - no filename 2024-04-12T09:11:18.457 INFO:tasks.workunit.client.1.smithi203.stdout:9/11: dwrite f4 [0,4194304] 0 2024-04-12T09:11:18.458 INFO:tasks.workunit.client.0.smithi117.stdout:2/622: link d0/d43/d53/d61/fa6 d0/d43/d4b/dae/fd0 0 2024-04-12T09:11:18.458 INFO:tasks.workunit.client.1.smithi203.stdout:9/12: write f4 [363101,7761] 0 2024-04-12T09:11:18.459 INFO:tasks.workunit.client.1.smithi203.stdout:3/17: mkdir d2 0 2024-04-12T09:11:18.460 INFO:tasks.workunit.client.0.smithi117.stdout:2/623: truncate d0/d4/d10/d27/d9a/faa 682647 0 2024-04-12T09:11:18.466 INFO:tasks.workunit.client.1.smithi203.stdout:6/7: mkdir d1 0 2024-04-12T09:11:18.468 INFO:tasks.workunit.client.0.smithi117.stdout:2/624: mknod d0/d4/cd1 0 2024-04-12T09:11:18.469 INFO:tasks.workunit.client.0.smithi117.stdout:2/625: read d0/d43/f8e [574619,77543] 0 2024-04-12T09:11:18.469 INFO:tasks.workunit.client.1.smithi203.stdout:2/24: link d0/d3/l4 d0/l6 0 2024-04-12T09:11:18.471 INFO:tasks.workunit.client.1.smithi203.stdout:9/13: creat f5 x:0 0 0 2024-04-12T09:11:18.473 INFO:tasks.workunit.client.1.smithi203.stdout:3/18: rename c0 to d2/c3 0 2024-04-12T09:11:18.473 INFO:tasks.workunit.client.1.smithi203.stdout:6/8: rename d1 to d1/d2 22 2024-04-12T09:11:18.474 INFO:tasks.workunit.client.1.smithi203.stdout:6/9: dwrite - no filename 2024-04-12T09:11:18.474 INFO:tasks.workunit.client.1.smithi203.stdout:6/10: fsync - no filename 2024-04-12T09:11:18.475 INFO:tasks.workunit.client.1.smithi203.stdout:4/22: rename f4 to f5 0 2024-04-12T09:11:18.475 INFO:tasks.workunit.client.0.smithi117.stdout:4/728: dread d0/d5/f63 [0,4194304] 0 2024-04-12T09:11:18.477 INFO:tasks.workunit.client.0.smithi117.stdout:4/729: rmdir d0/d5/d3b/d38 39 2024-04-12T09:11:18.481 INFO:tasks.workunit.client.1.smithi203.stdout:4/23: symlink l6 0 2024-04-12T09:11:18.482 INFO:tasks.workunit.client.1.smithi203.stdout:9/14: dwrite f4 [0,4194304] 0 2024-04-12T09:11:18.482 INFO:tasks.workunit.client.1.smithi203.stdout:6/11: mkdir d1/d3 0 2024-04-12T09:11:18.482 INFO:tasks.workunit.client.1.smithi203.stdout:6/12: dwrite - no filename 2024-04-12T09:11:18.482 INFO:tasks.workunit.client.1.smithi203.stdout:6/13: chown d1 2 1 2024-04-12T09:11:18.482 INFO:tasks.workunit.client.1.smithi203.stdout:6/14: dread - no filename 2024-04-12T09:11:18.483 INFO:tasks.workunit.client.1.smithi203.stdout:6/15: chown d1 986 1 2024-04-12T09:11:18.483 INFO:tasks.workunit.client.1.smithi203.stdout:6/16: fdatasync - no filename 2024-04-12T09:11:18.483 INFO:tasks.workunit.client.1.smithi203.stdout:6/17: truncate - no filename 2024-04-12T09:11:18.483 INFO:tasks.workunit.client.1.smithi203.stdout:6/18: dread - no filename 2024-04-12T09:11:18.483 INFO:tasks.workunit.client.1.smithi203.stdout:6/19: readlink - no filename 2024-04-12T09:11:18.483 INFO:tasks.workunit.client.1.smithi203.stdout:6/20: dread - no filename 2024-04-12T09:11:18.484 INFO:tasks.workunit.client.1.smithi203.stdout:4/24: creat f7 x:0 0 0 2024-04-12T09:11:18.486 INFO:tasks.workunit.client.1.smithi203.stdout:3/19: dwrite f1 [0,4194304] 0 2024-04-12T09:11:18.486 INFO:tasks.workunit.client.1.smithi203.stdout:2/25: getdents d0/d3 0 2024-04-12T09:11:18.487 INFO:tasks.workunit.client.1.smithi203.stdout:4/25: write f7 [148005,70849] 0 2024-04-12T09:11:18.487 INFO:tasks.workunit.client.1.smithi203.stdout:2/26: chown d0/d3 11291099 1 2024-04-12T09:11:18.487 INFO:tasks.workunit.client.1.smithi203.stdout:9/15: symlink l6 0 2024-04-12T09:11:18.491 INFO:tasks.workunit.client.1.smithi203.stdout:3/20: dread f1 [0,4194304] 0 2024-04-12T09:11:18.491 INFO:tasks.workunit.client.1.smithi203.stdout:2/27: rmdir d0/d3 39 2024-04-12T09:11:18.493 INFO:tasks.workunit.client.0.smithi117.stdout:2/626: write d0/df/f7a [2149943,62170] 0 2024-04-12T09:11:18.493 INFO:tasks.workunit.client.1.smithi203.stdout:6/21: mkdir d1/d3/d4 0 2024-04-12T09:11:18.496 INFO:tasks.workunit.client.1.smithi203.stdout:6/22: mknod d1/d3/c5 0 2024-04-12T09:11:18.496 INFO:tasks.workunit.client.1.smithi203.stdout:6/23: read - no filename 2024-04-12T09:11:18.497 INFO:tasks.workunit.client.0.smithi117.stdout:2/627: symlink d0/d43/d4b/ld2 0 2024-04-12T09:11:18.499 INFO:tasks.workunit.client.1.smithi203.stdout:5/112: sync 2024-04-12T09:11:18.499 INFO:tasks.workunit.client.1.smithi203.stdout:8/17: sync 2024-04-12T09:11:18.499 INFO:tasks.workunit.client.1.smithi203.stdout:0/107: sync 2024-04-12T09:11:18.499 INFO:tasks.workunit.client.1.smithi203.stdout:1/36: sync 2024-04-12T09:11:18.499 INFO:tasks.workunit.client.1.smithi203.stdout:7/40: sync 2024-04-12T09:11:18.499 INFO:tasks.workunit.client.1.smithi203.stdout:7/41: readlink - no filename 2024-04-12T09:11:18.500 INFO:tasks.workunit.client.1.smithi203.stdout:2/28: unlink d0/d3/f2 0 2024-04-12T09:11:18.500 INFO:tasks.workunit.client.1.smithi203.stdout:2/29: write - no filename 2024-04-12T09:11:18.500 INFO:tasks.workunit.client.1.smithi203.stdout:2/30: fsync - no filename 2024-04-12T09:11:18.501 INFO:tasks.workunit.client.1.smithi203.stdout:1/37: write f7 [910988,124594] 0 2024-04-12T09:11:18.501 INFO:tasks.workunit.client.1.smithi203.stdout:4/26: fsync f5 0 2024-04-12T09:11:18.502 INFO:tasks.workunit.client.1.smithi203.stdout:1/38: chown c6 23087 1 2024-04-12T09:11:18.502 INFO:tasks.workunit.client.1.smithi203.stdout:6/24: mknod d1/d3/c6 0 2024-04-12T09:11:18.502 INFO:tasks.workunit.client.1.smithi203.stdout:6/25: truncate - no filename 2024-04-12T09:11:18.502 INFO:tasks.workunit.client.1.smithi203.stdout:4/27: write f7 [1149397,65534] 0 2024-04-12T09:11:18.503 INFO:tasks.workunit.client.1.smithi203.stdout:6/26: chown d1/d3 65 1 2024-04-12T09:11:18.503 INFO:tasks.workunit.client.1.smithi203.stdout:1/39: write f9 [192155,1980] 0 2024-04-12T09:11:18.503 INFO:tasks.workunit.client.1.smithi203.stdout:4/28: chown f5 15 1 2024-04-12T09:11:18.506 INFO:tasks.workunit.client.1.smithi203.stdout:8/18: rmdir d4 39 2024-04-12T09:11:18.507 INFO:tasks.workunit.client.1.smithi203.stdout:5/113: symlink d0/d6/l2c 0 2024-04-12T09:11:18.509 INFO:tasks.workunit.client.0.smithi117.stdout:2/628: rename d0/d43/d4b/la3 to d0/d43/d53/d61/ld3 0 2024-04-12T09:11:18.511 INFO:tasks.workunit.client.1.smithi203.stdout:7/42: symlink d0/d4/lb 0 2024-04-12T09:11:18.512 INFO:tasks.workunit.client.1.smithi203.stdout:1/40: dread f9 [0,4194304] 0 2024-04-12T09:11:18.512 INFO:tasks.workunit.client.1.smithi203.stdout:7/43: readlink d0/d4/lb 0 2024-04-12T09:11:18.512 INFO:tasks.workunit.client.1.smithi203.stdout:2/31: symlink d0/d3/l7 0 2024-04-12T09:11:18.512 INFO:tasks.workunit.client.1.smithi203.stdout:2/32: fsync - no filename 2024-04-12T09:11:18.513 INFO:tasks.workunit.client.0.smithi117.stdout:2/629: creat d0/d4/d10/d27/fd4 x:0 0 0 2024-04-12T09:11:18.514 INFO:tasks.workunit.client.1.smithi203.stdout:9/16: truncate f4 1406731 0 2024-04-12T09:11:18.516 INFO:tasks.workunit.client.0.smithi117.stdout:2/630: mkdir d0/d43/d4b/dae/dd5 0 2024-04-12T09:11:18.518 INFO:tasks.workunit.client.0.smithi117.stdout:2/631: dread - d0/d4/d81/f92 zero size 2024-04-12T09:11:18.519 INFO:tasks.workunit.client.1.smithi203.stdout:5/114: mkdir d0/d6/d16/d9/d14/d2d 0 2024-04-12T09:11:18.519 INFO:tasks.workunit.client.0.smithi117.stdout:2/632: chown d0/d43/d4b/dae 2413 1 2024-04-12T09:11:18.520 INFO:tasks.workunit.client.0.smithi117.stdout:2/633: chown d0/d43/d30/d41/fc9 4 1 2024-04-12T09:11:18.521 INFO:tasks.workunit.client.1.smithi203.stdout:1/41: rename c1 to cb 0 2024-04-12T09:11:18.521 INFO:tasks.workunit.client.0.smithi117.stdout:2/634: dread - d0/d4/d10/d27/d9a/fcb zero size 2024-04-12T09:11:18.522 INFO:tasks.workunit.client.1.smithi203.stdout:2/33: creat d0/d3/f8 x:0 0 0 2024-04-12T09:11:18.522 INFO:tasks.workunit.client.1.smithi203.stdout:5/115: dread d0/d6/fe [0,4194304] 0 2024-04-12T09:11:18.525 INFO:tasks.workunit.client.1.smithi203.stdout:8/19: mkdir d4/d8 0 2024-04-12T09:11:18.525 INFO:tasks.workunit.client.1.smithi203.stdout:8/20: chown l2 57765 1 2024-04-12T09:11:18.527 INFO:tasks.workunit.client.1.smithi203.stdout:1/42: fdatasync f9 0 2024-04-12T09:11:18.529 INFO:tasks.workunit.client.1.smithi203.stdout:5/116: dwrite d0/d6/d16/d9/f24 [0,4194304] 0 2024-04-12T09:11:18.531 INFO:tasks.workunit.client.1.smithi203.stdout:2/34: creat d0/d3/f9 x:0 0 0 2024-04-12T09:11:18.532 INFO:tasks.workunit.client.1.smithi203.stdout:0/108: link d0/d9/l1c d0/d9/d17/l21 0 2024-04-12T09:11:18.536 INFO:tasks.workunit.client.1.smithi203.stdout:8/21: creat d4/f9 x:0 0 0 2024-04-12T09:11:18.538 INFO:tasks.workunit.client.1.smithi203.stdout:1/43: symlink lc 0 2024-04-12T09:11:18.538 INFO:tasks.workunit.client.1.smithi203.stdout:9/17: link l6 l7 0 2024-04-12T09:11:18.540 INFO:tasks.workunit.client.1.smithi203.stdout:4/29: getdents . 0 2024-04-12T09:11:18.540 INFO:tasks.workunit.client.1.smithi203.stdout:4/30: fsync f5 0 2024-04-12T09:11:18.541 INFO:tasks.workunit.client.1.smithi203.stdout:5/117: fdatasync d0/d6/fe 0 2024-04-12T09:11:18.543 INFO:tasks.workunit.client.1.smithi203.stdout:2/35: mknod d0/d3/ca 0 2024-04-12T09:11:18.544 INFO:tasks.workunit.client.1.smithi203.stdout:2/36: chown d0/d3/f9 18 1 2024-04-12T09:11:18.545 INFO:tasks.workunit.client.1.smithi203.stdout:8/22: mknod d4/ca 0 2024-04-12T09:11:18.550 INFO:tasks.workunit.client.1.smithi203.stdout:9/18: write f4 [1965988,115022] 0 2024-04-12T09:11:18.551 INFO:tasks.workunit.client.1.smithi203.stdout:4/31: rename l6 to l8 0 2024-04-12T09:11:18.551 INFO:tasks.workunit.client.1.smithi203.stdout:7/44: write d0/f2 [1790910,21382] 0 2024-04-12T09:11:18.551 INFO:tasks.workunit.client.1.smithi203.stdout:5/118: rmdir d0/d6/d11/d18/d1a 39 2024-04-12T09:11:18.551 INFO:tasks.workunit.client.1.smithi203.stdout:7/45: write d0/f2 [2372047,41419] 0 2024-04-12T09:11:18.555 INFO:tasks.workunit.client.1.smithi203.stdout:8/23: fsync d4/f9 0 2024-04-12T09:11:18.556 INFO:tasks.workunit.client.1.smithi203.stdout:9/19: chown l6 3403894 1 2024-04-12T09:11:18.557 INFO:tasks.workunit.client.1.smithi203.stdout:9/20: chown f4 2312 1 2024-04-12T09:11:18.558 INFO:tasks.workunit.client.1.smithi203.stdout:2/37: rename d0/d3/l4 to d0/d3/lb 0 2024-04-12T09:11:18.559 INFO:tasks.workunit.client.1.smithi203.stdout:7/46: symlink d0/d4/lc 0 2024-04-12T09:11:18.560 INFO:tasks.workunit.client.1.smithi203.stdout:4/32: dwrite f7 [0,4194304] 0 2024-04-12T09:11:18.560 INFO:tasks.workunit.client.1.smithi203.stdout:5/119: dwrite d0/f4 [0,4194304] 0 2024-04-12T09:11:18.561 INFO:tasks.workunit.client.1.smithi203.stdout:8/24: rename d4/f7 to d4/fb 0 2024-04-12T09:11:18.562 INFO:tasks.workunit.client.1.smithi203.stdout:9/21: mkdir d8 0 2024-04-12T09:11:18.567 INFO:tasks.workunit.client.1.smithi203.stdout:5/120: unlink d0/l27 0 2024-04-12T09:11:18.567 INFO:tasks.workunit.client.1.smithi203.stdout:9/22: chown d8 472927 1 2024-04-12T09:11:18.578 INFO:tasks.workunit.client.0.smithi117.stdout:0/837: sync 2024-04-12T09:11:18.580 INFO:tasks.workunit.client.0.smithi117.stdout:0/838: creat d3/d47/f114 x:0 0 0 2024-04-12T09:11:18.584 INFO:tasks.workunit.client.1.smithi203.stdout:9/23: write f4 [851801,59262] 0 2024-04-12T09:11:18.585 INFO:tasks.workunit.client.1.smithi203.stdout:1/44: dwrite f3 [0,4194304] 0 2024-04-12T09:11:18.590 INFO:tasks.workunit.client.1.smithi203.stdout:4/33: dread f5 [0,4194304] 0 2024-04-12T09:11:18.590 INFO:tasks.workunit.client.1.smithi203.stdout:0/109: dwrite d0/d9/d17/f6 [0,4194304] 0 2024-04-12T09:11:18.593 INFO:tasks.workunit.client.1.smithi203.stdout:4/34: write f5 [4990171,63610] 0 2024-04-12T09:11:18.594 INFO:tasks.workunit.client.1.smithi203.stdout:8/25: dwrite d4/f9 [0,4194304] 0 2024-04-12T09:11:18.597 INFO:tasks.workunit.client.1.smithi203.stdout:4/35: write f5 [3082363,60085] 0 2024-04-12T09:11:18.599 INFO:tasks.workunit.client.1.smithi203.stdout:5/121: dwrite d0/d6/d11/d18/d2a/f2b [0,4194304] 0 2024-04-12T09:11:18.611 INFO:tasks.workunit.client.1.smithi203.stdout:1/45: fsync f3 0 2024-04-12T09:11:18.629 INFO:tasks.workunit.client.1.smithi203.stdout:1/46: dread f7 [0,4194304] 0 2024-04-12T09:11:18.630 INFO:tasks.workunit.client.1.smithi203.stdout:1/47: write f9 [136956,52571] 0 2024-04-12T09:11:18.637 INFO:tasks.workunit.client.1.smithi203.stdout:1/48: dwrite f9 [0,4194304] 0 2024-04-12T09:11:18.637 INFO:tasks.workunit.client.1.smithi203.stdout:1/49: readlink l8 0 2024-04-12T09:11:18.641 INFO:tasks.workunit.client.1.smithi203.stdout:6/27: sync 2024-04-12T09:11:18.641 INFO:tasks.workunit.client.1.smithi203.stdout:7/47: sync 2024-04-12T09:11:18.641 INFO:tasks.workunit.client.1.smithi203.stdout:6/28: write - no filename 2024-04-12T09:11:18.641 INFO:tasks.workunit.client.1.smithi203.stdout:3/21: sync 2024-04-12T09:11:18.642 INFO:tasks.workunit.client.1.smithi203.stdout:6/29: truncate - no filename 2024-04-12T09:11:18.642 INFO:tasks.workunit.client.0.smithi117.stdout:0/839: dread d3/da2/dee/d76/db3/fe5 [0,4194304] 0 2024-04-12T09:11:18.642 INFO:tasks.workunit.client.1.smithi203.stdout:6/30: chown d1/d3 52767 1 2024-04-12T09:11:18.643 INFO:tasks.workunit.client.1.smithi203.stdout:7/48: write d0/f2 [3226507,12945] 0 2024-04-12T09:11:18.643 INFO:tasks.workunit.client.1.smithi203.stdout:7/49: readlink d0/d4/lb 0 2024-04-12T09:11:18.664 INFO:tasks.workunit.client.0.smithi117.stdout:0/840: dread d3/da2/dee/f2d [0,4194304] 0 2024-04-12T09:11:18.699 INFO:tasks.workunit.client.1.smithi203.stdout:2/38: creat d0/fc x:0 0 0 2024-04-12T09:11:18.702 INFO:tasks.workunit.client.0.smithi117.stdout:0/841: rename d3/d59/f5c to d3/da2/dee/d76/d83/da8/d97/dc9/dd2/f115 0 2024-04-12T09:11:18.711 INFO:tasks.workunit.client.0.smithi117.stdout:0/842: truncate d3/dc/f34 684983 0 2024-04-12T09:11:18.716 INFO:tasks.workunit.client.1.smithi203.stdout:0/110: symlink d0/dd/l22 0 2024-04-12T09:11:18.717 INFO:tasks.workunit.client.1.smithi203.stdout:0/111: dread - d0/f1f zero size 2024-04-12T09:11:18.725 INFO:tasks.workunit.client.1.smithi203.stdout:8/26: truncate f3 277850 0 2024-04-12T09:11:18.729 INFO:tasks.workunit.client.1.smithi203.stdout:5/122: creat d0/d6/d16/d9/f2e x:0 0 0 2024-04-12T09:11:18.732 INFO:tasks.workunit.client.1.smithi203.stdout:5/123: dread d0/d6/d16/d9/f24 [0,4194304] 0 2024-04-12T09:11:18.734 INFO:tasks.workunit.client.1.smithi203.stdout:1/50: symlink ld 0 2024-04-12T09:11:18.736 INFO:tasks.workunit.client.1.smithi203.stdout:3/22: write f1 [2359718,53011] 0 2024-04-12T09:11:18.740 INFO:tasks.workunit.client.1.smithi203.stdout:6/31: mkdir d1/d7 0 2024-04-12T09:11:18.743 INFO:tasks.workunit.client.1.smithi203.stdout:2/39: creat d0/d3/fd x:0 0 0 2024-04-12T09:11:18.744 INFO:tasks.workunit.client.1.smithi203.stdout:9/24: link f5 d8/f9 0 2024-04-12T09:11:18.754 INFO:tasks.workunit.client.1.smithi203.stdout:9/25: dwrite f3 [0,4194304] 0 2024-04-12T09:11:18.755 INFO:tasks.workunit.client.1.smithi203.stdout:1/51: creat fe x:0 0 0 2024-04-12T09:11:18.755 INFO:tasks.workunit.client.1.smithi203.stdout:3/23: creat d2/f4 x:0 0 0 2024-04-12T09:11:18.757 INFO:tasks.workunit.client.1.smithi203.stdout:6/32: mknod d1/c8 0 2024-04-12T09:11:18.757 INFO:tasks.workunit.client.1.smithi203.stdout:6/33: stat d1/d3/c5 0 2024-04-12T09:11:18.757 INFO:tasks.workunit.client.1.smithi203.stdout:1/52: dread f4 [0,4194304] 0 2024-04-12T09:11:18.759 INFO:tasks.workunit.client.1.smithi203.stdout:7/50: rename d0/c1 to d0/d4/cd 0 2024-04-12T09:11:18.760 INFO:tasks.workunit.client.1.smithi203.stdout:2/40: mknod d0/d3/ce 0 2024-04-12T09:11:18.761 INFO:tasks.workunit.client.1.smithi203.stdout:0/112: creat d0/d9/d17/d19/f23 x:0 0 0 2024-04-12T09:11:18.764 INFO:tasks.workunit.client.1.smithi203.stdout:8/27: link d4/f9 d4/d8/fc 0 2024-04-12T09:11:18.765 INFO:tasks.workunit.client.1.smithi203.stdout:4/36: link l1 l9 0 2024-04-12T09:11:18.765 INFO:tasks.workunit.client.0.smithi117.stdout:8/739: sync 2024-04-12T09:11:18.768 INFO:tasks.workunit.client.1.smithi203.stdout:9/26: rename d8/f9 to d8/fa 0 2024-04-12T09:11:18.771 INFO:tasks.workunit.client.1.smithi203.stdout:5/124: truncate d0/d6/fe 4044707 0 2024-04-12T09:11:18.771 INFO:tasks.workunit.client.1.smithi203.stdout:5/125: stat d0/d6/f22 0 2024-04-12T09:11:18.772 INFO:tasks.workunit.client.1.smithi203.stdout:3/24: mknod d2/c5 0 2024-04-12T09:11:18.775 INFO:tasks.workunit.client.1.smithi203.stdout:6/34: creat d1/f9 x:0 0 0 2024-04-12T09:11:18.777 INFO:tasks.workunit.client.1.smithi203.stdout:1/53: mkdir df 0 2024-04-12T09:11:18.778 INFO:tasks.workunit.client.1.smithi203.stdout:3/25: dwrite d2/f4 [0,4194304] 0 2024-04-12T09:11:18.779 INFO:tasks.workunit.client.1.smithi203.stdout:3/26: chown d2/f4 44 1 2024-04-12T09:11:18.780 INFO:tasks.workunit.client.1.smithi203.stdout:3/27: chown d2/c5 28643624 1 2024-04-12T09:11:18.785 INFO:tasks.workunit.client.1.smithi203.stdout:0/113: creat d0/dd/f24 x:0 0 0 2024-04-12T09:11:18.786 INFO:tasks.workunit.client.0.smithi117.stdout:6/699: sync 2024-04-12T09:11:18.787 INFO:tasks.workunit.client.0.smithi117.stdout:5/778: sync 2024-04-12T09:11:18.787 INFO:tasks.workunit.client.0.smithi117.stdout:9/674: sync 2024-04-12T09:11:18.787 INFO:tasks.workunit.client.0.smithi117.stdout:1/712: sync 2024-04-12T09:11:18.787 INFO:tasks.workunit.client.0.smithi117.stdout:4/730: sync 2024-04-12T09:11:18.787 INFO:tasks.workunit.client.0.smithi117.stdout:7/606: sync 2024-04-12T09:11:18.787 INFO:tasks.workunit.client.0.smithi117.stdout:2/635: sync 2024-04-12T09:11:18.789 INFO:tasks.workunit.client.0.smithi117.stdout:4/731: readlink d0/d72/l9a 0 2024-04-12T09:11:18.790 INFO:tasks.workunit.client.0.smithi117.stdout:4/732: write d0/d2c/f4d [956197,110739] 0 2024-04-12T09:11:18.791 INFO:tasks.workunit.client.0.smithi117.stdout:9/675: chown d1/d8/d5a/d79/d91/db0/d41/daf/d3b/f4c 13402388 1 2024-04-12T09:11:18.792 INFO:tasks.workunit.client.1.smithi203.stdout:4/37: mknod ca 0 2024-04-12T09:11:18.792 INFO:tasks.workunit.client.1.smithi203.stdout:4/38: truncate f7 4886354 0 2024-04-12T09:11:18.792 INFO:tasks.workunit.client.0.smithi117.stdout:5/779: dread d2/f91 [0,4194304] 0 2024-04-12T09:11:18.794 INFO:tasks.workunit.client.0.smithi117.stdout:9/676: write d1/d8/df/f13 [838008,106923] 0 2024-04-12T09:11:18.796 INFO:tasks.workunit.client.0.smithi117.stdout:5/780: dread d2/d3/dd/d39/d83/d4d/d6b/fef [0,4194304] 0 2024-04-12T09:11:18.800 INFO:tasks.workunit.client.1.smithi203.stdout:9/27: creat d8/fb x:0 0 0 2024-04-12T09:11:18.801 INFO:tasks.workunit.client.0.smithi117.stdout:5/781: chown d2/d3/dd/d39/d83/ff2 1408297793 1 2024-04-12T09:11:18.811 INFO:tasks.workunit.client.1.smithi203.stdout:1/54: rename c5 to df/c10 0 2024-04-12T09:11:18.818 INFO:tasks.workunit.client.0.smithi117.stdout:1/713: creat d1/dcb/fde x:0 0 0 2024-04-12T09:11:18.818 INFO:tasks.workunit.client.0.smithi117.stdout:9/677: dread d1/d8/df/f3a [0,4194304] 0 2024-04-12T09:11:18.821 INFO:tasks.workunit.client.1.smithi203.stdout:4/39: creat fb x:0 0 0 2024-04-12T09:11:18.822 INFO:tasks.workunit.client.1.smithi203.stdout:4/40: read f7 [1634860,59482] 0 2024-04-12T09:11:18.823 INFO:tasks.workunit.client.1.smithi203.stdout:9/28: creat d8/fc x:0 0 0 2024-04-12T09:11:18.824 INFO:tasks.workunit.client.1.smithi203.stdout:9/29: truncate d8/fc 961919 0 2024-04-12T09:11:18.824 INFO:tasks.workunit.client.0.smithi117.stdout:6/700: mknod d8/d9/d61/d90/cd9 0 2024-04-12T09:11:18.826 INFO:tasks.workunit.client.0.smithi117.stdout:6/701: truncate d8/d9/d39/f8e 145927 0 2024-04-12T09:11:18.826 INFO:tasks.workunit.client.1.smithi203.stdout:5/126: mknod d0/d6/d11/d1e/c2f 0 2024-04-12T09:11:18.828 INFO:tasks.workunit.client.0.smithi117.stdout:4/733: mknod d0/d2c/da6/ceb 0 2024-04-12T09:11:18.831 INFO:tasks.workunit.client.0.smithi117.stdout:5/782: dread d2/d3/dd/f6d [0,4194304] 0 2024-04-12T09:11:18.832 INFO:tasks.workunit.client.0.smithi117.stdout:1/714: creat d1/dbd/d51/fdf x:0 0 0 2024-04-12T09:11:18.833 INFO:tasks.workunit.client.0.smithi117.stdout:1/715: dread - d1/dbd/d51/fdf zero size 2024-04-12T09:11:18.834 INFO:tasks.workunit.client.1.smithi203.stdout:1/55: symlink df/l11 0 2024-04-12T09:11:18.834 INFO:tasks.workunit.client.1.smithi203.stdout:1/56: readlink l8 0 2024-04-12T09:11:18.834 INFO:tasks.workunit.client.0.smithi117.stdout:5/783: truncate d2/d3/dd/ffa 476542 0 2024-04-12T09:11:18.837 INFO:tasks.workunit.client.0.smithi117.stdout:6/702: creat d8/d2a/d60/d89/fda x:0 0 0 2024-04-12T09:11:18.839 INFO:tasks.workunit.client.1.smithi203.stdout:1/57: dwrite f9 [0,4194304] 0 2024-04-12T09:11:18.840 INFO:tasks.workunit.client.1.smithi203.stdout:1/58: dread - fe zero size 2024-04-12T09:11:18.840 INFO:tasks.workunit.client.0.smithi117.stdout:5/784: unlink d2/d3/dd/d39/d83/d74/fb8 0 2024-04-12T09:11:18.841 INFO:tasks.workunit.client.0.smithi117.stdout:1/716: dwrite d1/dbd/d3f/db/d16/db6/da9/d9a/f2e [0,4194304] 0 2024-04-12T09:11:18.842 INFO:tasks.workunit.client.0.smithi117.stdout:1/717: stat d1/dbd/d3f/db/d1d/d7b 0 2024-04-12T09:11:18.843 INFO:tasks.workunit.client.0.smithi117.stdout:1/718: dread - d1/d64/f93 zero size 2024-04-12T09:11:18.843 INFO:tasks.workunit.client.1.smithi203.stdout:0/114: link d0/f1a d0/d9/d17/d19/f25 0 2024-04-12T09:11:18.843 INFO:tasks.workunit.client.1.smithi203.stdout:0/115: fdatasync d0/f13 0 2024-04-12T09:11:18.844 INFO:tasks.workunit.client.1.smithi203.stdout:1/59: dread f4 [0,4194304] 0 2024-04-12T09:11:18.845 INFO:tasks.workunit.client.0.smithi117.stdout:1/719: chown d1/d3b/f98 140403 1 2024-04-12T09:11:18.851 INFO:tasks.workunit.client.1.smithi203.stdout:4/41: creat fc x:0 0 0 2024-04-12T09:11:18.853 INFO:tasks.workunit.client.0.smithi117.stdout:4/734: creat d0/d5/d3b/d38/d4f/d79/d9c/fec x:0 0 0 2024-04-12T09:11:18.855 INFO:tasks.workunit.client.0.smithi117.stdout:5/785: unlink d2/d3/dd/f90 0 2024-04-12T09:11:18.857 INFO:tasks.workunit.client.1.smithi203.stdout:5/127: mkdir d0/d6/d16/d9/d30 0 2024-04-12T09:11:18.859 INFO:tasks.workunit.client.1.smithi203.stdout:6/35: link d1/d3/c5 d1/d3/d4/ca 0 2024-04-12T09:11:18.862 INFO:tasks.workunit.client.1.smithi203.stdout:2/41: fsync d0/fc 0 2024-04-12T09:11:18.862 INFO:tasks.workunit.client.0.smithi117.stdout:5/786: dwrite d2/d3/de/d1e/d46/d96/fbb [0,4194304] 0 2024-04-12T09:11:18.862 INFO:tasks.workunit.client.1.smithi203.stdout:2/42: write d0/d3/fd [306609,91272] 0 2024-04-12T09:11:18.869 INFO:tasks.workunit.client.0.smithi117.stdout:6/703: creat d8/d9/d39/fdb x:0 0 0 2024-04-12T09:11:18.869 INFO:tasks.workunit.client.1.smithi203.stdout:1/60: symlink df/l12 0 2024-04-12T09:11:18.870 INFO:tasks.workunit.client.0.smithi117.stdout:4/735: mknod d0/d2c/d3c/ced 0 2024-04-12T09:11:18.871 INFO:tasks.workunit.client.1.smithi203.stdout:0/116: dwrite d0/d9/d17/d19/f25 [0,4194304] 0 2024-04-12T09:11:18.882 INFO:tasks.workunit.client.1.smithi203.stdout:5/128: symlink d0/d6/d16/d9/d14/l31 0 2024-04-12T09:11:18.883 INFO:tasks.workunit.client.1.smithi203.stdout:5/129: chown d0/d6/d16/d9/f2e 19 1 2024-04-12T09:11:18.890 INFO:tasks.workunit.client.0.smithi117.stdout:0/843: write d3/da2/ff1 [560245,39813] 0 2024-04-12T09:11:18.891 INFO:tasks.workunit.client.1.smithi203.stdout:6/36: symlink d1/d3/d4/lb 0 2024-04-12T09:11:18.894 INFO:tasks.workunit.client.1.smithi203.stdout:2/43: symlink d0/lf 0 2024-04-12T09:11:18.898 INFO:tasks.workunit.client.0.smithi117.stdout:0/844: dwrite d3/da2/dee/dd5/dff/d91/d94/d5a/d62/d66/d73/fe8 [0,4194304] 0 2024-04-12T09:11:18.904 INFO:tasks.workunit.client.0.smithi117.stdout:0/845: fsync d3/da2/dee/d76/d83/f111 0 2024-04-12T09:11:18.905 INFO:tasks.workunit.client.0.smithi117.stdout:0/846: dread - d3/da2/dee/dd5/dff/d84/dc2/fe1 zero size 2024-04-12T09:11:18.907 INFO:tasks.workunit.client.0.smithi117.stdout:0/847: truncate d3/da2/dee/d76/de2/f107 143476 0 2024-04-12T09:11:18.907 INFO:tasks.workunit.client.1.smithi203.stdout:2/44: creat d0/d3/f10 x:0 0 0 2024-04-12T09:11:18.909 INFO:tasks.workunit.client.0.smithi117.stdout:0/848: write d3/da2/dee/dd5/dff/d91/d94/d5a/d62/d66/d73/fe8 [2564208,2875] 0 2024-04-12T09:11:18.910 INFO:tasks.workunit.client.1.smithi203.stdout:6/37: unlink d1/d3/c5 0 2024-04-12T09:11:18.915 INFO:tasks.workunit.client.1.smithi203.stdout:2/45: dwrite d0/d3/f10 [0,4194304] 0 2024-04-12T09:11:18.916 INFO:tasks.workunit.client.1.smithi203.stdout:2/46: dread - d0/d3/f8 zero size 2024-04-12T09:11:18.917 INFO:tasks.workunit.client.1.smithi203.stdout:6/38: rmdir d1/d7 0 2024-04-12T09:11:18.918 INFO:tasks.workunit.client.1.smithi203.stdout:2/47: creat d0/d3/f11 x:0 0 0 2024-04-12T09:11:18.919 INFO:tasks.workunit.client.1.smithi203.stdout:2/48: chown d0/d3/f9 135 1 2024-04-12T09:11:18.920 INFO:tasks.workunit.client.1.smithi203.stdout:6/39: mkdir d1/d3/d4/dc 0 2024-04-12T09:11:18.925 INFO:tasks.workunit.client.1.smithi203.stdout:7/51: stat d0/d4/cd 0 2024-04-12T09:11:18.926 INFO:tasks.workunit.client.0.smithi117.stdout:0/849: dread d3/f23 [0,4194304] 0 2024-04-12T09:11:18.926 INFO:tasks.workunit.client.0.smithi117.stdout:0/850: chown d3/da2/dee/dd5 5622218 1 2024-04-12T09:11:18.930 INFO:tasks.workunit.client.1.smithi203.stdout:7/52: creat d0/d4/fe x:0 0 0 2024-04-12T09:11:18.931 INFO:tasks.workunit.client.1.smithi203.stdout:2/49: dwrite d0/d3/f11 [0,4194304] 0 2024-04-12T09:11:18.931 INFO:tasks.workunit.client.1.smithi203.stdout:6/40: dwrite d1/f9 [0,4194304] 0 2024-04-12T09:11:18.931 INFO:tasks.workunit.client.0.smithi117.stdout:0/851: creat d3/da2/dee/dd5/dff/d91/d94/d5a/d62/d66/d73/f116 x:0 0 0 2024-04-12T09:11:18.932 INFO:tasks.workunit.client.1.smithi203.stdout:7/53: dread - d0/d4/fe zero size 2024-04-12T09:11:18.932 INFO:tasks.workunit.client.1.smithi203.stdout:2/50: dread - d0/d3/f9 zero size 2024-04-12T09:11:18.932 INFO:tasks.workunit.client.1.smithi203.stdout:9/30: fsync d8/fa 0 2024-04-12T09:11:18.933 INFO:tasks.workunit.client.0.smithi117.stdout:0/852: write d3/d47/f60 [2013255,72600] 0 2024-04-12T09:11:18.937 INFO:tasks.workunit.client.0.smithi117.stdout:0/853: mknod d3/da2/dee/dd5/dff/d84/c117 0 2024-04-12T09:11:18.944 INFO:tasks.workunit.client.1.smithi203.stdout:9/31: rename l7 to d8/ld 0 2024-04-12T09:11:18.944 INFO:tasks.workunit.client.1.smithi203.stdout:9/32: fdatasync f3 0 2024-04-12T09:11:18.945 INFO:tasks.workunit.client.1.smithi203.stdout:9/33: chown f3 0 1 2024-04-12T09:11:18.949 INFO:tasks.workunit.client.1.smithi203.stdout:9/34: creat d8/fe x:0 0 0 2024-04-12T09:11:18.949 INFO:tasks.workunit.client.1.smithi203.stdout:9/35: chown d8 108287036 1 2024-04-12T09:11:18.951 INFO:tasks.workunit.client.1.smithi203.stdout:7/54: getdents d0 0 2024-04-12T09:11:18.951 INFO:tasks.workunit.client.1.smithi203.stdout:7/55: chown d0 885650055 1 2024-04-12T09:11:18.952 INFO:tasks.workunit.client.1.smithi203.stdout:7/56: stat d0/d4 0 2024-04-12T09:11:18.954 INFO:tasks.workunit.client.0.smithi117.stdout:6/704: link d8/d2a/d60/d7d/d8c/db8/fd1 d8/d9/fdc 0 2024-04-12T09:11:18.960 INFO:tasks.workunit.client.0.smithi117.stdout:6/705: symlink d8/d2a/d60/d7d/dbf/ldd 0 2024-04-12T09:11:18.960 INFO:tasks.workunit.client.0.smithi117.stdout:6/706: write d8/d2a/d60/d89/fbb [1046717,42114] 0 2024-04-12T09:11:18.961 INFO:tasks.workunit.client.1.smithi203.stdout:9/36: creat d8/ff x:0 0 0 2024-04-12T09:11:18.961 INFO:tasks.workunit.client.1.smithi203.stdout:7/57: dwrite d0/f2 [0,4194304] 0 2024-04-12T09:11:18.961 INFO:tasks.workunit.client.1.smithi203.stdout:2/51: link d0/d3/lb d0/l12 0 2024-04-12T09:11:18.964 INFO:tasks.workunit.client.1.smithi203.stdout:7/58: dwrite d0/f7 [0,4194304] 0 2024-04-12T09:11:18.966 INFO:tasks.workunit.client.1.smithi203.stdout:2/52: symlink d0/d3/l13 0 2024-04-12T09:11:18.969 INFO:tasks.workunit.client.1.smithi203.stdout:9/37: link f5 d8/f10 0 2024-04-12T09:11:18.969 INFO:tasks.workunit.client.1.smithi203.stdout:2/53: dread d0/d3/f11 [0,4194304] 0 2024-04-12T09:11:18.973 INFO:tasks.workunit.client.0.smithi117.stdout:2/636: write d0/d43/d30/f6e [2816376,96767] 0 2024-04-12T09:11:18.974 INFO:tasks.workunit.client.0.smithi117.stdout:2/637: chown d0/d4/d10/fa8 13491261 1 2024-04-12T09:11:18.975 INFO:tasks.workunit.client.0.smithi117.stdout:2/638: chown d0/d43/lce 238548035 1 2024-04-12T09:11:18.977 INFO:tasks.workunit.client.1.smithi203.stdout:2/54: dwrite d0/d3/fd [0,4194304] 0 2024-04-12T09:11:18.977 INFO:tasks.workunit.client.1.smithi203.stdout:9/38: mkdir d8/d11 0 2024-04-12T09:11:18.978 INFO:tasks.workunit.client.1.smithi203.stdout:2/55: chown d0/lf 1 1 2024-04-12T09:11:18.985 INFO:tasks.workunit.client.1.smithi203.stdout:9/39: rename d8/d11 to d8/d12 0 2024-04-12T09:11:18.986 INFO:tasks.workunit.client.1.smithi203.stdout:9/40: dread - d8/ff zero size 2024-04-12T09:11:18.988 INFO:tasks.workunit.client.1.smithi203.stdout:2/56: mkdir d0/d14 0 2024-04-12T09:11:18.989 INFO:tasks.workunit.client.1.smithi203.stdout:9/41: dread f4 [0,4194304] 0 2024-04-12T09:11:18.989 INFO:tasks.workunit.client.1.smithi203.stdout:7/59: fsync d0/f2 0 2024-04-12T09:11:18.991 INFO:tasks.workunit.client.0.smithi117.stdout:6/707: dread d8/d9/f19 [0,4194304] 0 2024-04-12T09:11:18.994 INFO:tasks.workunit.client.1.smithi203.stdout:2/57: unlink d0/d3/l7 0 2024-04-12T09:11:18.996 INFO:tasks.workunit.client.1.smithi203.stdout:7/60: creat d0/ff x:0 0 0 2024-04-12T09:11:19.001 INFO:tasks.workunit.client.1.smithi203.stdout:3/28: truncate d2/f4 1336704 0 2024-04-12T09:11:19.004 INFO:tasks.workunit.client.1.smithi203.stdout:2/58: symlink d0/l15 0 2024-04-12T09:11:19.005 INFO:tasks.workunit.client.1.smithi203.stdout:2/59: read d0/d3/fd [134757,65305] 0 2024-04-12T09:11:19.005 INFO:tasks.workunit.client.1.smithi203.stdout:2/60: truncate d0/d3/f9 16653 0 2024-04-12T09:11:19.019 INFO:tasks.workunit.client.1.smithi203.stdout:4/42: truncate f7 106971 0 2024-04-12T09:11:19.020 INFO:tasks.workunit.client.1.smithi203.stdout:4/43: read - fc zero size 2024-04-12T09:11:19.020 INFO:tasks.workunit.client.0.smithi117.stdout:5/787: write d2/f43 [817201,124250] 0 2024-04-12T09:11:19.023 INFO:tasks.workunit.client.1.smithi203.stdout:5/130: rmdir d0/d6/d16/d9/d14 39 2024-04-12T09:11:19.024 INFO:tasks.workunit.client.1.smithi203.stdout:4/44: dwrite fb [0,4194304] 0 2024-04-12T09:11:19.025 INFO:tasks.workunit.client.0.smithi117.stdout:4/736: write d0/d5/d3b/fbf [167918,35354] 0 2024-04-12T09:11:19.025 INFO:tasks.workunit.client.1.smithi203.stdout:4/45: write fc [649288,99927] 0 2024-04-12T09:11:19.028 INFO:tasks.workunit.client.1.smithi203.stdout:5/131: fsync d0/d6/d16/d9/d14/f25 0 2024-04-12T09:11:19.035 INFO:tasks.workunit.client.1.smithi203.stdout:1/61: truncate f9 1517697 0 2024-04-12T09:11:19.036 INFO:tasks.workunit.client.1.smithi203.stdout:0/117: truncate d0/f1a 658073 0 2024-04-12T09:11:19.038 INFO:tasks.workunit.client.1.smithi203.stdout:8/28: dwrite f3 [0,4194304] 0 2024-04-12T09:11:19.039 INFO:tasks.workunit.client.1.smithi203.stdout:8/29: truncate d4/f6 397822 0 2024-04-12T09:11:19.039 INFO:tasks.workunit.client.1.smithi203.stdout:8/30: readlink l2 0 2024-04-12T09:11:19.044 INFO:tasks.workunit.client.0.smithi117.stdout:5/788: write d2/fb6 [718947,9153] 0 2024-04-12T09:11:19.046 INFO:tasks.workunit.client.0.smithi117.stdout:6/708: dwrite d8/d2a/d60/d89/d99/fb1 [0,4194304] 0 2024-04-12T09:11:19.047 INFO:tasks.workunit.client.0.smithi117.stdout:5/789: chown d2/d3/dd/d39/d83/d4d/d6b/f97 0 1 2024-04-12T09:11:19.049 INFO:tasks.workunit.client.1.smithi203.stdout:2/61: fsync d0/d3/f11 0 2024-04-12T09:11:19.053 INFO:tasks.workunit.client.0.smithi117.stdout:8/740: rename db/d19/f5f to db/d19/d1a/d3d/ff7 0 2024-04-12T09:11:19.058 INFO:tasks.workunit.client.1.smithi203.stdout:6/41: write d1/f9 [4627065,22932] 0 2024-04-12T09:11:19.059 INFO:tasks.workunit.client.0.smithi117.stdout:5/790: dwrite d2/d3/de/d1e/d2c/f8c [4194304,4194304] 0 2024-04-12T09:11:19.062 INFO:tasks.workunit.client.0.smithi117.stdout:8/741: dwrite db/d13/f54 [0,4194304] 0 2024-04-12T09:11:19.070 INFO:tasks.workunit.client.0.smithi117.stdout:6/709: dwrite d8/d2a/fcf [0,4194304] 0 2024-04-12T09:11:19.070 INFO:tasks.workunit.client.0.smithi117.stdout:6/710: chown d8/d9/f29 8940 1 2024-04-12T09:11:19.071 INFO:tasks.workunit.client.1.smithi203.stdout:6/42: dread d1/f9 [0,4194304] 0 2024-04-12T09:11:19.072 INFO:tasks.workunit.client.1.smithi203.stdout:6/43: write d1/f9 [5039867,39097] 0 2024-04-12T09:11:19.078 INFO:tasks.workunit.client.0.smithi117.stdout:1/720: rename d1/dbd/d3f/db/d1d/f52 to d1/dbd/d3f/db/fe0 0 2024-04-12T09:11:19.078 INFO:tasks.workunit.client.1.smithi203.stdout:2/62: read d0/d3/fd [2914297,74914] 0 2024-04-12T09:11:19.080 INFO:tasks.workunit.client.0.smithi117.stdout:7/607: sync 2024-04-12T09:11:19.081 INFO:tasks.workunit.client.1.smithi203.stdout:0/118: unlink d0/l1 0 2024-04-12T09:11:19.083 INFO:tasks.workunit.client.0.smithi117.stdout:5/791: creat d2/d3/dd/d39/d83/d4d/d6b/da5/f102 x:0 0 0 2024-04-12T09:11:19.085 INFO:tasks.workunit.client.0.smithi117.stdout:5/792: write d2/d3/dd/d39/d83/dc8/fe3 [976083,111970] 0 2024-04-12T09:11:19.086 INFO:tasks.workunit.client.0.smithi117.stdout:5/793: stat d2/d3/de/d1e/cbd 0 2024-04-12T09:11:19.088 INFO:tasks.workunit.client.1.smithi203.stdout:5/132: link d0/d6/d16/d9/f24 d0/d6/d11/d18/f32 0 2024-04-12T09:11:19.093 INFO:tasks.workunit.client.0.smithi117.stdout:4/737: rename d0/d5/d3b/f94 to d0/d2c/da6/fee 0 2024-04-12T09:11:19.093 INFO:tasks.workunit.client.0.smithi117.stdout:4/738: dread - d0/d5/d3b/f82 zero size 2024-04-12T09:11:19.094 INFO:tasks.workunit.client.1.smithi203.stdout:5/133: dwrite d0/f21 [0,4194304] 0 2024-04-12T09:11:19.094 INFO:tasks.workunit.client.0.smithi117.stdout:4/739: write d0/d5/d3b/fdc [1002518,55886] 0 2024-04-12T09:11:19.095 INFO:tasks.workunit.client.1.smithi203.stdout:5/134: write d0/d6/d16/d9/f2e [5467,74805] 0 2024-04-12T09:11:19.095 INFO:tasks.workunit.client.0.smithi117.stdout:7/608: mkdir d0/d2/d1a/d4f/dbc 0 2024-04-12T09:11:19.096 INFO:tasks.workunit.client.0.smithi117.stdout:4/740: chown d0/d5/d25/d69/f96 217161 1 2024-04-12T09:11:19.099 INFO:tasks.workunit.client.0.smithi117.stdout:8/742: mkdir db/d19/d1a/df8 0 2024-04-12T09:11:19.100 INFO:tasks.workunit.client.1.smithi203.stdout:9/42: sync 2024-04-12T09:11:19.103 INFO:tasks.workunit.client.0.smithi117.stdout:7/609: dwrite d0/d2/d1a/f9d [0,4194304] 0 2024-04-12T09:11:19.108 INFO:tasks.workunit.client.0.smithi117.stdout:5/794: chown d2/d3/de/d1e/c53 30 1 2024-04-12T09:11:19.110 INFO:tasks.workunit.client.0.smithi117.stdout:5/795: read d2/d3/dd/d39/d83/d4d/d52/f70 [1571117,113340] 0 2024-04-12T09:11:19.116 INFO:tasks.workunit.client.0.smithi117.stdout:4/741: dread d0/d2c/f30 [0,4194304] 0 2024-04-12T09:11:19.117 INFO:tasks.workunit.client.0.smithi117.stdout:4/742: fsync d0/d1/d34/f28 0 2024-04-12T09:11:19.120 INFO:tasks.workunit.client.0.smithi117.stdout:8/743: rename db/d19/d1a/df8 to db/d1b/d62/dae/df9 0 2024-04-12T09:11:19.128 INFO:tasks.workunit.client.0.smithi117.stdout:7/610: dwrite d0/da/f2d [0,4194304] 0 2024-04-12T09:11:19.128 INFO:tasks.workunit.client.0.smithi117.stdout:7/611: stat d0/d2/le 0 2024-04-12T09:11:19.137 INFO:tasks.workunit.client.0.smithi117.stdout:5/796: rename d2/d3/dd/d39/d83/ff2 to d2/d3/dd/d39/d83/d4d/d52/f103 0 2024-04-12T09:11:19.138 INFO:tasks.workunit.client.0.smithi117.stdout:5/797: dread d2/f49 [0,4194304] 0 2024-04-12T09:11:19.139 INFO:tasks.workunit.client.0.smithi117.stdout:8/744: creat db/d13/d38/d86/da0/da4/ffa x:0 0 0 2024-04-12T09:11:19.140 INFO:tasks.workunit.client.0.smithi117.stdout:5/798: dread d2/f49 [0,4194304] 0 2024-04-12T09:11:19.141 INFO:tasks.workunit.client.0.smithi117.stdout:8/745: stat db/d13/d38/d86/da0/da4/lc4 0 2024-04-12T09:11:19.148 INFO:tasks.workunit.client.0.smithi117.stdout:5/799: dwrite d2/d3/de/d1e/d2c/f8c [0,4194304] 0 2024-04-12T09:11:19.163 INFO:tasks.workunit.client.0.smithi117.stdout:4/743: getdents d0 0 2024-04-12T09:11:19.164 INFO:tasks.workunit.client.0.smithi117.stdout:5/800: rename d2/d3/c31 to d2/d3/dd/d39/d83/dc8/c104 0 2024-04-12T09:11:19.167 INFO:tasks.workunit.client.0.smithi117.stdout:4/744: fsync d0/d5/d25/d69/f96 0 2024-04-12T09:11:19.171 INFO:tasks.workunit.client.0.smithi117.stdout:2/639: write d0/d4/f4d [262144,100484] 0 2024-04-12T09:11:19.172 INFO:tasks.workunit.client.0.smithi117.stdout:2/640: fdatasync d0/d4/d10/d27/fd4 0 2024-04-12T09:11:19.175 INFO:tasks.workunit.client.0.smithi117.stdout:4/745: chown d0/d2c/d67/fda 64 1 2024-04-12T09:11:19.182 INFO:tasks.workunit.client.0.smithi117.stdout:2/641: fdatasync d0/d43/d53/d61/d66/f79 0 2024-04-12T09:11:19.184 INFO:tasks.workunit.client.0.smithi117.stdout:5/801: dread d2/f3d [0,4194304] 0 2024-04-12T09:11:19.185 INFO:tasks.workunit.client.0.smithi117.stdout:5/802: chown d2/d3/de/d1e/d46/d96/d9c 2208749 1 2024-04-12T09:11:19.199 INFO:tasks.workunit.client.0.smithi117.stdout:6/711: truncate d8/d2a/d60/d89/d99/fb1 1222787 0 2024-04-12T09:11:19.207 INFO:tasks.workunit.client.0.smithi117.stdout:6/712: rename d8/d3a/d49/c95 to d8/cde 0 2024-04-12T09:11:19.208 INFO:tasks.workunit.client.0.smithi117.stdout:0/854: sync 2024-04-12T09:11:19.208 INFO:tasks.workunit.client.0.smithi117.stdout:9/678: sync 2024-04-12T09:11:19.212 INFO:tasks.workunit.client.0.smithi117.stdout:6/713: read d8/d9/d39/f4f [2245260,21792] 0 2024-04-12T09:11:19.213 INFO:tasks.workunit.client.1.smithi203.stdout:3/29: write d2/f4 [1255174,39210] 0 2024-04-12T09:11:19.213 INFO:tasks.workunit.client.0.smithi117.stdout:6/714: chown d8/d3a/f3b 53408 1 2024-04-12T09:11:19.214 INFO:tasks.workunit.client.0.smithi117.stdout:6/715: write d8/d3a/fc7 [2127356,100781] 0 2024-04-12T09:11:19.214 INFO:tasks.workunit.client.0.smithi117.stdout:6/716: chown d8/d9/dce 226499 1 2024-04-12T09:11:19.226 INFO:tasks.workunit.client.0.smithi117.stdout:0/855: creat d3/f118 x:0 0 0 2024-04-12T09:11:19.226 INFO:tasks.workunit.client.0.smithi117.stdout:6/717: dread d8/d9/d61/f65 [0,4194304] 0 2024-04-12T09:11:19.230 INFO:tasks.workunit.client.0.smithi117.stdout:7/612: dwrite d0/d2/d45/f42 [4194304,4194304] 0 2024-04-12T09:11:19.232 INFO:tasks.workunit.client.0.smithi117.stdout:6/718: fsync d8/d2a/d60/d7d/d8c/db8/fd1 0 2024-04-12T09:11:19.235 INFO:tasks.workunit.client.0.smithi117.stdout:8/746: write db/d1b/d55/f57 [789942,32592] 0 2024-04-12T09:11:19.235 INFO:tasks.workunit.client.0.smithi117.stdout:1/721: sync 2024-04-12T09:11:19.244 INFO:tasks.workunit.client.0.smithi117.stdout:0/856: symlink d3/da2/dee/dd5/dff/d91/d94/d5a/d62/l119 0 2024-04-12T09:11:19.252 INFO:tasks.workunit.client.0.smithi117.stdout:0/857: symlink d3/da2/dee/d76/d83/da8/d97/dc9/dd2/l11a 0 2024-04-12T09:11:19.254 INFO:tasks.workunit.client.0.smithi117.stdout:8/747: rename db/d77/fa9 to db/d19/d1a/d3d/d60/d70/ffb 0 2024-04-12T09:11:19.256 INFO:tasks.workunit.client.0.smithi117.stdout:4/746: dwrite d0/d5/d3b/f82 [0,4194304] 0 2024-04-12T09:11:19.263 INFO:tasks.workunit.client.0.smithi117.stdout:2/642: dwrite d0/d4/d81/f92 [0,4194304] 0 2024-04-12T09:11:19.265 INFO:tasks.workunit.client.0.smithi117.stdout:5/803: dwrite d2/d3/de/d1e/d35/f63 [0,4194304] 0 2024-04-12T09:11:19.271 INFO:tasks.workunit.client.0.smithi117.stdout:0/858: truncate d3/d47/fd9 3268 0 2024-04-12T09:11:19.273 INFO:tasks.workunit.client.0.smithi117.stdout:8/748: creat db/d19/ffc x:0 0 0 2024-04-12T09:11:19.275 INFO:tasks.workunit.client.0.smithi117.stdout:4/747: truncate d0/d1/f1b 155299 0 2024-04-12T09:11:19.283 INFO:tasks.workunit.client.0.smithi117.stdout:5/804: mkdir d2/d3/de/d1e/d66/dbe/d105 0 2024-04-12T09:11:19.285 INFO:tasks.workunit.client.0.smithi117.stdout:0/859: dread d3/d47/f79 [0,4194304] 0 2024-04-12T09:11:19.290 INFO:tasks.workunit.client.0.smithi117.stdout:9/679: dwrite d1/d8/df/d1b/f3f [0,4194304] 0 2024-04-12T09:11:19.292 INFO:tasks.workunit.client.0.smithi117.stdout:0/860: fsync d3/da2/dee/f33 0 2024-04-12T09:11:19.295 INFO:tasks.workunit.client.0.smithi117.stdout:2/643: fdatasync d0/d4/d81/f92 0 2024-04-12T09:11:19.296 INFO:tasks.workunit.client.0.smithi117.stdout:2/644: write d0/df/f97 [227944,11297] 0 2024-04-12T09:11:19.297 INFO:tasks.workunit.client.0.smithi117.stdout:4/748: symlink d0/db3/da7/dcd/de6/lef 0 2024-04-12T09:11:19.301 INFO:tasks.workunit.client.0.smithi117.stdout:5/805: rename d2/d3/dd/d39/d82/dd6/ffe to d2/d3/dd/d39/d83/dc8/dd1/dd2/dde/f106 0 2024-04-12T09:11:19.305 INFO:tasks.workunit.client.0.smithi117.stdout:8/749: creat db/d19/d1a/d3d/ffd x:0 0 0 2024-04-12T09:11:19.306 INFO:tasks.workunit.client.0.smithi117.stdout:8/750: readlink db/d1b/l12 0 2024-04-12T09:11:19.308 INFO:tasks.workunit.client.0.smithi117.stdout:9/680: rmdir d1/d8/df/d3e/d92 39 2024-04-12T09:11:19.311 INFO:tasks.workunit.client.0.smithi117.stdout:6/719: dwrite d8/f1e [0,4194304] 0 2024-04-12T09:11:19.318 INFO:tasks.workunit.client.0.smithi117.stdout:2/645: chown d0/d43/d53/d61/ld3 1 1 2024-04-12T09:11:19.319 INFO:tasks.workunit.client.0.smithi117.stdout:7/613: dwrite d0/d2/d45/d15/f25 [0,4194304] 0 2024-04-12T09:11:19.321 INFO:tasks.workunit.client.0.smithi117.stdout:7/614: write d0/d2/d45/d17/d23/d39/fb8 [328409,79967] 0 2024-04-12T09:11:19.322 INFO:tasks.workunit.client.0.smithi117.stdout:4/749: symlink d0/d5/d3b/d38/d4f/d79/lf0 0 2024-04-12T09:11:19.323 INFO:tasks.workunit.client.0.smithi117.stdout:7/615: truncate d0/d2/d1a/f9d 4325308 0 2024-04-12T09:11:19.326 INFO:tasks.workunit.client.0.smithi117.stdout:1/722: truncate d1/dbd/d51/f67 69262 0 2024-04-12T09:11:19.330 INFO:tasks.workunit.client.0.smithi117.stdout:7/616: dwrite d0/d2/d45/d17/f21 [0,4194304] 0 2024-04-12T09:11:19.333 INFO:tasks.workunit.client.0.smithi117.stdout:8/751: rename db/d4b/c92 to db/d19/dd2/cfe 0 2024-04-12T09:11:19.334 INFO:tasks.workunit.client.0.smithi117.stdout:7/617: truncate d0/d2/d45/d17/d23/d50/d5c/f79 4941633 0 2024-04-12T09:11:19.334 INFO:tasks.workunit.client.0.smithi117.stdout:8/752: write db/d13/f8c [498264,54611] 0 2024-04-12T09:11:19.335 INFO:tasks.workunit.client.0.smithi117.stdout:9/681: creat d1/d8/d52/fdb x:0 0 0 2024-04-12T09:11:19.336 INFO:tasks.workunit.client.0.smithi117.stdout:7/618: write d0/d2/d1a/f24 [3022198,111348] 0 2024-04-12T09:11:19.338 INFO:tasks.workunit.client.0.smithi117.stdout:6/720: dread f3 [0,4194304] 0 2024-04-12T09:11:19.340 INFO:tasks.workunit.client.0.smithi117.stdout:8/753: truncate db/d13/d38/ff3 664686 0 2024-04-12T09:11:19.342 INFO:tasks.workunit.client.0.smithi117.stdout:8/754: chown db/d19/d1a/c2c 9806963 1 2024-04-12T09:11:19.345 INFO:tasks.workunit.client.0.smithi117.stdout:7/619: truncate d0/d2/d45/d15/fb7 102591 0 2024-04-12T09:11:19.345 INFO:tasks.workunit.client.0.smithi117.stdout:8/755: write db/d19/d1a/d3d/d60/d70/d98/fab [175301,122711] 0 2024-04-12T09:11:19.348 INFO:tasks.workunit.client.0.smithi117.stdout:7/620: write d0/d2/d1a/d49/f5e [802590,78250] 0 2024-04-12T09:11:19.349 INFO:tasks.workunit.client.0.smithi117.stdout:4/750: creat d0/d5/d3b/d38/ff1 x:0 0 0 2024-04-12T09:11:19.354 INFO:tasks.workunit.client.0.smithi117.stdout:5/806: mknod d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1/c107 0 2024-04-12T09:11:19.360 INFO:tasks.workunit.client.0.smithi117.stdout:0/861: creat d3/da2/dee/dd5/dff/f11b x:0 0 0 2024-04-12T09:11:19.364 INFO:tasks.workunit.client.0.smithi117.stdout:9/682: dread d1/d8/d5a/d6e/d71/fa9 [0,4194304] 0 2024-04-12T09:11:19.377 INFO:tasks.workunit.client.0.smithi117.stdout:5/807: symlink d2/d3/dd/d39/d7a/l108 0 2024-04-12T09:11:19.377 INFO:tasks.workunit.client.0.smithi117.stdout:5/808: read d2/f34 [46742,24404] 0 2024-04-12T09:11:19.378 INFO:tasks.workunit.client.0.smithi117.stdout:0/862: mkdir d3/da2/d11c 0 2024-04-12T09:11:19.379 INFO:tasks.workunit.client.0.smithi117.stdout:5/809: dread - d2/d3/dd/d39/d83/dc8/dd1/dd2/dde/f106 zero size 2024-04-12T09:11:19.379 INFO:tasks.workunit.client.0.smithi117.stdout:0/863: chown d3/da2/dee/f33 355504 1 2024-04-12T09:11:19.384 INFO:tasks.workunit.client.0.smithi117.stdout:0/864: write d3/da2/dee/dd5/dff/f75 [4351861,83635] 0 2024-04-12T09:11:19.384 INFO:tasks.workunit.client.0.smithi117.stdout:6/721: creat d8/d9/d17/d2d/dc1/fdf x:0 0 0 2024-04-12T09:11:19.388 INFO:tasks.workunit.client.0.smithi117.stdout:5/810: dwrite d2/d3/dd/ffa [0,4194304] 0 2024-04-12T09:11:19.389 INFO:tasks.workunit.client.0.smithi117.stdout:5/811: dread - d2/d3/dd/d39/d83/d4d/ffc zero size 2024-04-12T09:11:19.392 INFO:tasks.workunit.client.0.smithi117.stdout:4/751: mkdir d0/db3/da7/dcd/dcf/df2 0 2024-04-12T09:11:19.395 INFO:tasks.workunit.client.0.smithi117.stdout:2/646: write d0/d43/d53/f6f [543771,125411] 0 2024-04-12T09:11:19.397 INFO:tasks.workunit.client.0.smithi117.stdout:2/647: chown d0/d43/c3b 3 1 2024-04-12T09:11:19.400 INFO:tasks.workunit.client.0.smithi117.stdout:5/812: dwrite d2/d3/dd/d39/d83/d4d/d52/f84 [0,4194304] 0 2024-04-12T09:11:19.402 INFO:tasks.workunit.client.0.smithi117.stdout:1/723: write d1/fa3 [3909721,40323] 0 2024-04-12T09:11:19.407 INFO:tasks.workunit.client.0.smithi117.stdout:9/683: symlink d1/d8/d5e/d9f/ldc 0 2024-04-12T09:11:19.409 INFO:tasks.workunit.client.1.smithi203.stdout:2/63: creat d0/d3/f16 x:0 0 0 2024-04-12T09:11:19.410 INFO:tasks.workunit.client.0.smithi117.stdout:6/722: creat d8/d3a/d49/da4/d9f/fe0 x:0 0 0 2024-04-12T09:11:19.410 INFO:tasks.workunit.client.0.smithi117.stdout:6/723: chown d8/l27 824676 1 2024-04-12T09:11:19.416 INFO:tasks.workunit.client.0.smithi117.stdout:8/756: link db/d19/dd2/fe3 db/d13/d38/fff 0 2024-04-12T09:11:19.420 INFO:tasks.workunit.client.1.smithi203.stdout:7/61: write d0/d4/fe [584599,52458] 0 2024-04-12T09:11:19.422 INFO:tasks.workunit.client.1.smithi203.stdout:4/46: truncate f7 46081 0 2024-04-12T09:11:19.426 INFO:tasks.workunit.client.1.smithi203.stdout:0/119: rename d0/f1f to d0/d9/d17/d19/f26 0 2024-04-12T09:11:19.428 INFO:tasks.workunit.client.1.smithi203.stdout:3/30: mknod d2/c6 0 2024-04-12T09:11:19.431 INFO:tasks.workunit.client.0.smithi117.stdout:5/813: unlink d2/d3/dd/d39/d83/d4d/fd8 0 2024-04-12T09:11:19.436 INFO:tasks.workunit.client.1.smithi203.stdout:1/62: getdents df 0 2024-04-12T09:11:19.438 INFO:tasks.workunit.client.0.smithi117.stdout:6/724: mknod d8/d2a/d60/d89/ce1 0 2024-04-12T09:11:19.442 INFO:tasks.workunit.client.0.smithi117.stdout:8/757: mknod db/d1b/d55/c100 0 2024-04-12T09:11:19.442 INFO:tasks.workunit.client.1.smithi203.stdout:8/31: truncate f3 2562960 0 2024-04-12T09:11:19.443 INFO:tasks.workunit.client.0.smithi117.stdout:4/752: getdents d0/d1/de9 0 2024-04-12T09:11:19.444 INFO:tasks.workunit.client.1.smithi203.stdout:5/135: mknod d0/d6/d16/d9/d30/c33 0 2024-04-12T09:11:19.445 INFO:tasks.workunit.client.0.smithi117.stdout:2/648: symlink d0/d43/d30/dc6/ld6 0 2024-04-12T09:11:19.446 INFO:tasks.workunit.client.1.smithi203.stdout:7/62: write d0/f2 [4713608,88129] 0 2024-04-12T09:11:19.448 INFO:tasks.workunit.client.0.smithi117.stdout:7/621: dwrite d0/d2/d45/d17/f29 [0,4194304] 0 2024-04-12T09:11:19.448 INFO:tasks.workunit.client.1.smithi203.stdout:4/47: creat fd x:0 0 0 2024-04-12T09:11:19.449 INFO:tasks.workunit.client.0.smithi117.stdout:2/649: dread d0/d43/f8e [0,4194304] 0 2024-04-12T09:11:19.449 INFO:tasks.workunit.client.1.smithi203.stdout:4/48: fsync f5 0 2024-04-12T09:11:19.449 INFO:tasks.workunit.client.0.smithi117.stdout:5/814: truncate d2/d3/dd/d39/f86 1303050 0 2024-04-12T09:11:19.456 INFO:tasks.workunit.client.1.smithi203.stdout:9/43: rename d8/fc to d8/d12/f13 0 2024-04-12T09:11:19.456 INFO:tasks.workunit.client.1.smithi203.stdout:3/31: rename d2 to d2/d7 22 2024-04-12T09:11:19.457 INFO:tasks.workunit.client.1.smithi203.stdout:1/63: symlink df/l13 0 2024-04-12T09:11:19.458 INFO:tasks.workunit.client.0.smithi117.stdout:9/684: truncate d1/d24/f2a 575112 0 2024-04-12T09:11:19.459 INFO:tasks.workunit.client.0.smithi117.stdout:9/685: chown d1/d23/c3d 175989 1 2024-04-12T09:11:19.460 INFO:tasks.workunit.client.1.smithi203.stdout:2/64: getdents d0/d14 0 2024-04-12T09:11:19.460 INFO:tasks.workunit.client.0.smithi117.stdout:0/865: dwrite d3/da2/dee/d76/db3/fe5 [4194304,4194304] 0 2024-04-12T09:11:19.460 INFO:tasks.workunit.client.0.smithi117.stdout:6/725: truncate d8/d2a/d60/d7d/d8c/db8/fd1 4498603 0 2024-04-12T09:11:19.462 INFO:tasks.workunit.client.1.smithi203.stdout:8/32: fsync d4/d8/fc 0 2024-04-12T09:11:19.463 INFO:tasks.workunit.client.1.smithi203.stdout:8/33: read - d4/fb zero size 2024-04-12T09:11:19.463 INFO:tasks.workunit.client.1.smithi203.stdout:1/64: dwrite f4 [4194304,4194304] 0 2024-04-12T09:11:19.464 INFO:tasks.workunit.client.1.smithi203.stdout:1/65: read f4 [4407179,4903] 0 2024-04-12T09:11:19.468 INFO:tasks.workunit.client.1.smithi203.stdout:4/49: symlink le 0 2024-04-12T09:11:19.469 INFO:tasks.workunit.client.1.smithi203.stdout:4/50: truncate fc 815022 0 2024-04-12T09:11:19.470 INFO:tasks.workunit.client.1.smithi203.stdout:4/51: truncate fd 656977 0 2024-04-12T09:11:19.471 INFO:tasks.workunit.client.0.smithi117.stdout:5/815: rmdir d2/d3/dd/d39/d83/dc8 39 2024-04-12T09:11:19.476 INFO:tasks.workunit.client.0.smithi117.stdout:0/866: dread d3/da2/dee/dd5/dff/d91/fa9 [0,4194304] 0 2024-04-12T09:11:19.478 INFO:tasks.workunit.client.1.smithi203.stdout:9/44: mkdir d8/d12/d14 0 2024-04-12T09:11:19.479 INFO:tasks.workunit.client.1.smithi203.stdout:9/45: write f3 [5106440,6531] 0 2024-04-12T09:11:19.481 INFO:tasks.workunit.client.1.smithi203.stdout:5/136: rename d0/d6/d16/d9/l13 to d0/d6/d16/d9/d30/l34 0 2024-04-12T09:11:19.483 INFO:tasks.workunit.client.1.smithi203.stdout:6/44: truncate d1/f9 1500250 0 2024-04-12T09:11:19.484 INFO:tasks.workunit.client.0.smithi117.stdout:1/724: dwrite d1/d3b/f98 [0,4194304] 0 2024-04-12T09:11:19.484 INFO:tasks.workunit.client.1.smithi203.stdout:2/65: creat d0/d3/f17 x:0 0 0 2024-04-12T09:11:19.486 INFO:tasks.workunit.client.0.smithi117.stdout:6/726: mkdir d8/d3a/d49/da4/d8a/de2 0 2024-04-12T09:11:19.488 INFO:tasks.workunit.client.0.smithi117.stdout:9/686: dread d1/f61 [0,4194304] 0 2024-04-12T09:11:19.488 INFO:tasks.workunit.client.0.smithi117.stdout:6/727: dread - d8/d9/d39/fcb zero size 2024-04-12T09:11:19.490 INFO:tasks.workunit.client.0.smithi117.stdout:8/758: getdents db/d13/d38/dc5 0 2024-04-12T09:11:19.491 INFO:tasks.workunit.client.0.smithi117.stdout:8/759: readlink db/d77/la8 0 2024-04-12T09:11:19.491 INFO:tasks.workunit.client.1.smithi203.stdout:2/66: dwrite d0/d3/f9 [0,4194304] 0 2024-04-12T09:11:19.493 INFO:tasks.workunit.client.0.smithi117.stdout:5/816: rmdir d2/d3/dd/d39/d83/d74 39 2024-04-12T09:11:19.495 INFO:tasks.workunit.client.0.smithi117.stdout:9/687: dwrite d1/d24/f2e [0,4194304] 0 2024-04-12T09:11:19.496 INFO:tasks.workunit.client.0.smithi117.stdout:0/867: mkdir d3/da2/dee/dd5/dff/d91/d94/d5a/d11d 0 2024-04-12T09:11:19.497 INFO:tasks.workunit.client.0.smithi117.stdout:0/868: chown d3/d30/dc8/d10d/lac 6659 1 2024-04-12T09:11:19.500 INFO:tasks.workunit.client.0.smithi117.stdout:0/869: truncate d3/da2/ff1 1232980 0 2024-04-12T09:11:19.504 INFO:tasks.workunit.client.1.smithi203.stdout:1/66: creat df/f14 x:0 0 0 2024-04-12T09:11:19.508 INFO:tasks.workunit.client.0.smithi117.stdout:1/725: unlink d1/dbd/d3f/db/d16/db6/da9/d9a/l85 0 2024-04-12T09:11:19.509 INFO:tasks.workunit.client.0.smithi117.stdout:1/726: chown d1/dbd/d3f/d72/fa4 80926 1 2024-04-12T09:11:19.511 INFO:tasks.workunit.client.1.smithi203.stdout:0/120: dread d0/d9/d17/f11 [0,4194304] 0 2024-04-12T09:11:19.517 INFO:tasks.workunit.client.1.smithi203.stdout:5/137: unlink d0/d6/d16/d9/ld 0 2024-04-12T09:11:19.517 INFO:tasks.workunit.client.1.smithi203.stdout:9/46: rmdir d8 39 2024-04-12T09:11:19.518 INFO:tasks.workunit.client.0.smithi117.stdout:5/817: mknod d2/d3/de/d1e/d99/c109 0 2024-04-12T09:11:19.521 INFO:tasks.workunit.client.0.smithi117.stdout:9/688: fsync d1/d8/d12/f64 0 2024-04-12T09:11:19.530 INFO:tasks.workunit.client.0.smithi117.stdout:8/760: dread db/d19/d1a/d3d/f47 [0,4194304] 0 2024-04-12T09:11:19.530 INFO:tasks.workunit.client.0.smithi117.stdout:9/689: dwrite d1/d8/df/d7d/d7e/f78 [0,4194304] 0 2024-04-12T09:11:19.533 INFO:tasks.workunit.client.1.smithi203.stdout:8/34: fdatasync f3 0 2024-04-12T09:11:19.533 INFO:tasks.workunit.client.0.smithi117.stdout:6/728: getdents d8/d3a/dc8 0 2024-04-12T09:11:19.535 INFO:tasks.workunit.client.0.smithi117.stdout:5/818: mkdir d2/d3/dd/d39/d83/d4d/d6b/da5/d10a 0 2024-04-12T09:11:19.536 INFO:tasks.workunit.client.0.smithi117.stdout:5/819: readlink d2/d3/de/d1e/l81 0 2024-04-12T09:11:19.538 INFO:tasks.workunit.client.1.smithi203.stdout:1/67: creat df/f15 x:0 0 0 2024-04-12T09:11:19.542 INFO:tasks.workunit.client.1.smithi203.stdout:4/52: rename fd to ff 0 2024-04-12T09:11:19.544 INFO:tasks.workunit.client.0.smithi117.stdout:2/650: link d0/d43/d53/d61/d8d/cb3 d0/d43/d53/cd7 0 2024-04-12T09:11:19.548 INFO:tasks.workunit.client.0.smithi117.stdout:2/651: read d0/d43/d30/f5c [481223,73333] 0 2024-04-12T09:11:19.556 INFO:tasks.workunit.client.0.smithi117.stdout:6/729: mknod d8/d3f/ce3 0 2024-04-12T09:11:19.557 INFO:tasks.workunit.client.0.smithi117.stdout:1/727: dwrite d1/dbd/d3f/db/d16/db6/f8e [0,4194304] 0 2024-04-12T09:11:19.557 INFO:tasks.workunit.client.0.smithi117.stdout:0/870: write d3/dc/f34 [57980,93977] 0 2024-04-12T09:11:19.561 INFO:tasks.workunit.client.1.smithi203.stdout:1/68: creat df/f16 x:0 0 0 2024-04-12T09:11:19.562 INFO:tasks.workunit.client.1.smithi203.stdout:4/53: symlink l10 0 2024-04-12T09:11:19.563 INFO:tasks.workunit.client.0.smithi117.stdout:8/761: write db/d1b/f11 [489582,71718] 0 2024-04-12T09:11:19.563 INFO:tasks.workunit.client.1.smithi203.stdout:1/69: truncate fe 446033 0 2024-04-12T09:11:19.566 INFO:tasks.workunit.client.1.smithi203.stdout:1/70: write fe [809758,39176] 0 2024-04-12T09:11:19.567 INFO:tasks.workunit.client.0.smithi117.stdout:9/690: dread d1/d8/df/d3e/d92/fa0 [0,4194304] 0 2024-04-12T09:11:19.567 INFO:tasks.workunit.client.1.smithi203.stdout:0/121: symlink d0/d9/d17/l27 0 2024-04-12T09:11:19.568 INFO:tasks.workunit.client.1.smithi203.stdout:3/32: sync 2024-04-12T09:11:19.569 INFO:tasks.workunit.client.1.smithi203.stdout:5/138: write d0/d6/d16/f1b [873305,90892] 0 2024-04-12T09:11:19.570 INFO:tasks.workunit.client.1.smithi203.stdout:7/63: rename d0/d4/ca to d0/c10 0 2024-04-12T09:11:19.574 INFO:tasks.workunit.client.1.smithi203.stdout:0/122: read - d0/d9/d17/d19/f23 zero size 2024-04-12T09:11:19.574 INFO:tasks.workunit.client.1.smithi203.stdout:3/33: truncate f1 5138362 0 2024-04-12T09:11:19.574 INFO:tasks.workunit.client.1.smithi203.stdout:9/47: dwrite f5 [0,4194304] 0 2024-04-12T09:11:19.575 INFO:tasks.workunit.client.0.smithi117.stdout:8/762: readlink db/d19/d1a/d3d/d9c/dcc/ld5 0 2024-04-12T09:11:19.575 INFO:tasks.workunit.client.1.smithi203.stdout:2/67: creat d0/f18 x:0 0 0 2024-04-12T09:11:19.575 INFO:tasks.workunit.client.1.smithi203.stdout:5/139: readlink d0/d6/d16/d9/d14/l31 0 2024-04-12T09:11:19.576 INFO:tasks.workunit.client.0.smithi117.stdout:2/652: link d0/fcd d0/d43/da5/d8f/dc2/fd8 0 2024-04-12T09:11:19.577 INFO:tasks.workunit.client.0.smithi117.stdout:2/653: chown d0/df/l74 6 1 2024-04-12T09:11:19.578 INFO:tasks.workunit.client.0.smithi117.stdout:9/691: mknod d1/d8/d52/cdd 0 2024-04-12T09:11:19.578 INFO:tasks.workunit.client.1.smithi203.stdout:2/68: fdatasync d0/fc 0 2024-04-12T09:11:19.578 INFO:tasks.workunit.client.1.smithi203.stdout:6/45: dread d1/f9 [0,4194304] 0 2024-04-12T09:11:19.578 INFO:tasks.workunit.client.1.smithi203.stdout:8/35: dwrite f3 [0,4194304] 0 2024-04-12T09:11:19.581 INFO:tasks.workunit.client.0.smithi117.stdout:6/730: dread d8/d3a/fa8 [0,4194304] 0 2024-04-12T09:11:19.582 INFO:tasks.workunit.client.0.smithi117.stdout:5/820: creat d2/d3/dd/f10b x:0 0 0 2024-04-12T09:11:19.587 INFO:tasks.workunit.client.0.smithi117.stdout:2/654: mkdir d0/d43/d53/d61/d66/dd9 0 2024-04-12T09:11:19.588 INFO:tasks.workunit.client.1.smithi203.stdout:8/36: dread d4/f9 [0,4194304] 0 2024-04-12T09:11:19.589 INFO:tasks.workunit.client.1.smithi203.stdout:3/34: mkdir d2/d8 0 2024-04-12T09:11:19.590 INFO:tasks.workunit.client.1.smithi203.stdout:3/35: fdatasync f1 0 2024-04-12T09:11:19.591 INFO:tasks.workunit.client.0.smithi117.stdout:1/728: creat d1/d64/d45/d4c/fe1 x:0 0 0 2024-04-12T09:11:19.592 INFO:tasks.workunit.client.0.smithi117.stdout:1/729: write d1/dbd/d3f/f20 [1613124,89073] 0 2024-04-12T09:11:19.593 INFO:tasks.workunit.client.1.smithi203.stdout:0/123: symlink d0/d9/d17/l28 0 2024-04-12T09:11:19.594 INFO:tasks.workunit.client.0.smithi117.stdout:6/731: mknod d8/d2a/d94/ce4 0 2024-04-12T09:11:19.596 INFO:tasks.workunit.client.1.smithi203.stdout:3/36: dwrite f1 [0,4194304] 0 2024-04-12T09:11:19.598 INFO:tasks.workunit.client.1.smithi203.stdout:5/140: rename d0/d6/d16/f1b to d0/f35 0 2024-04-12T09:11:19.599 INFO:tasks.workunit.client.0.smithi117.stdout:0/871: dwrite d3/d30/f80 [0,4194304] 0 2024-04-12T09:11:19.599 INFO:tasks.workunit.client.1.smithi203.stdout:4/54: unlink f7 0 2024-04-12T09:11:19.600 INFO:tasks.workunit.client.1.smithi203.stdout:4/55: read f5 [4717097,79860] 0 2024-04-12T09:11:19.601 INFO:tasks.workunit.client.0.smithi117.stdout:2/655: truncate d0/f98 954117 0 2024-04-12T09:11:19.606 INFO:tasks.workunit.client.0.smithi117.stdout:2/656: write d0/d4/d10/d27/d9a/f9b [4103430,16410] 0 2024-04-12T09:11:19.607 INFO:tasks.workunit.client.0.smithi117.stdout:6/732: creat d8/d3a/d49/da4/d9f/fe5 x:0 0 0 2024-04-12T09:11:19.612 INFO:tasks.workunit.client.1.smithi203.stdout:1/71: fdatasync f9 0 2024-04-12T09:11:19.612 INFO:tasks.workunit.client.1.smithi203.stdout:1/72: read - df/f16 zero size 2024-04-12T09:11:19.613 INFO:tasks.workunit.client.0.smithi117.stdout:0/872: symlink d3/da2/dee/dd5/dff/d91/d94/d5a/l11e 0 2024-04-12T09:11:19.613 INFO:tasks.workunit.client.0.smithi117.stdout:9/692: dread d1/f15 [0,4194304] 0 2024-04-12T09:11:19.615 INFO:tasks.workunit.client.0.smithi117.stdout:6/733: dwrite d8/d3f/faa [4194304,4194304] 0 2024-04-12T09:11:19.617 INFO:tasks.workunit.client.0.smithi117.stdout:6/734: fsync d8/d9/fb 0 2024-04-12T09:11:19.619 INFO:tasks.workunit.client.0.smithi117.stdout:0/873: read d3/da2/dee/dd5/dff/d91/d94/d5a/d62/d66/d73/fbb [143207,29254] 0 2024-04-12T09:11:19.620 INFO:tasks.workunit.client.1.smithi203.stdout:9/48: creat d8/f15 x:0 0 0 2024-04-12T09:11:19.621 INFO:tasks.workunit.client.0.smithi117.stdout:0/874: chown d3/da2/dee/dd5/dff/d84/lca 93 1 2024-04-12T09:11:19.621 INFO:tasks.workunit.client.0.smithi117.stdout:8/763: dwrite db/d19/f2b [0,4194304] 0 2024-04-12T09:11:19.622 INFO:tasks.workunit.client.0.smithi117.stdout:1/730: creat d1/dbd/d3f/db/d1d/d78/fe2 x:0 0 0 2024-04-12T09:11:19.624 INFO:tasks.workunit.client.1.smithi203.stdout:3/37: mknod d2/c9 0 2024-04-12T09:11:19.626 INFO:tasks.workunit.client.1.smithi203.stdout:3/38: write d2/f4 [1042238,17121] 0 2024-04-12T09:11:19.629 INFO:tasks.workunit.client.1.smithi203.stdout:4/56: symlink l11 0 2024-04-12T09:11:19.630 INFO:tasks.workunit.client.0.smithi117.stdout:2/657: mknod d0/d43/da5/d8f/dc2/cda 0 2024-04-12T09:11:19.631 INFO:tasks.workunit.client.1.smithi203.stdout:6/46: readlink d1/d3/d4/lb 0 2024-04-12T09:11:19.631 INFO:tasks.workunit.client.0.smithi117.stdout:8/764: dread db/d13/d38/d86/fb2 [0,4194304] 0 2024-04-12T09:11:19.632 INFO:tasks.workunit.client.0.smithi117.stdout:2/658: write d0/d43/d30/d41/f72 [2885891,89140] 0 2024-04-12T09:11:19.632 INFO:tasks.workunit.client.0.smithi117.stdout:6/735: symlink d8/d3a/d49/da4/d8a/le6 0 2024-04-12T09:11:19.634 INFO:tasks.workunit.client.1.smithi203.stdout:2/69: mkdir d0/d19 0 2024-04-12T09:11:19.637 INFO:tasks.workunit.client.1.smithi203.stdout:1/73: rename f9 to df/f17 0 2024-04-12T09:11:19.637 INFO:tasks.workunit.client.0.smithi117.stdout:8/765: dwrite db/d13/f8c [0,4194304] 0 2024-04-12T09:11:19.637 INFO:tasks.workunit.client.0.smithi117.stdout:1/731: rmdir d1/dbd/d3f/db/d16/db6/dc5 39 2024-04-12T09:11:19.640 INFO:tasks.workunit.client.1.smithi203.stdout:7/64: link d0/d4/fe d0/d4/f11 0 2024-04-12T09:11:19.640 INFO:tasks.workunit.client.1.smithi203.stdout:7/65: dread - d0/ff zero size 2024-04-12T09:11:19.643 INFO:tasks.workunit.client.1.smithi203.stdout:9/49: creat d8/d12/f16 x:0 0 0 2024-04-12T09:11:19.643 INFO:tasks.workunit.client.1.smithi203.stdout:9/50: dread - d8/f15 zero size 2024-04-12T09:11:19.645 INFO:tasks.workunit.client.1.smithi203.stdout:5/141: symlink d0/d6/d11/l36 0 2024-04-12T09:11:19.647 INFO:tasks.workunit.client.1.smithi203.stdout:5/142: fdatasync d0/d6/d16/d9/d14/f25 0 2024-04-12T09:11:19.648 INFO:tasks.workunit.client.0.smithi117.stdout:2/659: dread - d0/f73 zero size 2024-04-12T09:11:19.649 INFO:tasks.workunit.client.0.smithi117.stdout:2/660: stat d0/d43/d4b/c57 0 2024-04-12T09:11:19.649 INFO:tasks.workunit.client.1.smithi203.stdout:3/39: unlink f1 0 2024-04-12T09:11:19.650 INFO:tasks.workunit.client.1.smithi203.stdout:3/40: write d2/f4 [1530282,93379] 0 2024-04-12T09:11:19.650 INFO:tasks.workunit.client.1.smithi203.stdout:4/57: mknod c12 0 2024-04-12T09:11:19.650 INFO:tasks.workunit.client.1.smithi203.stdout:4/58: rmdir - no directory 2024-04-12T09:11:19.652 INFO:tasks.workunit.client.0.smithi117.stdout:9/693: creat d1/d8/df/d3e/fde x:0 0 0 2024-04-12T09:11:19.654 INFO:tasks.workunit.client.1.smithi203.stdout:6/47: mknod d1/d3/cd 0 2024-04-12T09:11:19.655 INFO:tasks.workunit.client.1.smithi203.stdout:6/48: dread d1/f9 [0,4194304] 0 2024-04-12T09:11:19.657 INFO:tasks.workunit.client.0.smithi117.stdout:5/821: dwrite d2/d3/de/d1e/f67 [0,4194304] 0 2024-04-12T09:11:19.661 INFO:tasks.workunit.client.0.smithi117.stdout:8/766: creat db/d13/d38/dc3/f101 x:0 0 0 2024-04-12T09:11:19.662 INFO:tasks.workunit.client.0.smithi117.stdout:6/736: dwrite d8/d2a/fd0 [0,4194304] 0 2024-04-12T09:11:19.663 INFO:tasks.workunit.client.0.smithi117.stdout:8/767: write db/d19/d1a/d3d/d60/d70/f90 [1417045,19049] 0 2024-04-12T09:11:19.664 INFO:tasks.workunit.client.0.smithi117.stdout:6/737: fsync d8/d2a/d60/d7d/d8c/db8/fd7 0 2024-04-12T09:11:19.666 INFO:tasks.workunit.client.0.smithi117.stdout:8/768: fdatasync db/d13/d38/d86/da0/fc7 0 2024-04-12T09:11:19.668 INFO:tasks.workunit.client.0.smithi117.stdout:8/769: chown db/d19/ldc 239893 1 2024-04-12T09:11:19.668 INFO:tasks.workunit.client.0.smithi117.stdout:0/875: link d3/da2/dee/dd5/dff/d91/d94/d5a/d62/d66/d73/fbb d3/da2/dee/dd5/dff/d91/d109/f11f 0 2024-04-12T09:11:19.675 INFO:tasks.workunit.client.0.smithi117.stdout:5/822: mkdir d2/d3/dd/d39/d83/d4d/d10c 0 2024-04-12T09:11:19.678 INFO:tasks.workunit.client.0.smithi117.stdout:1/732: mkdir d1/d64/d45/d4c/d94/dd0/de3 0 2024-04-12T09:11:19.681 INFO:tasks.workunit.client.1.smithi203.stdout:9/51: rmdir d8/d12 39 2024-04-12T09:11:19.682 INFO:tasks.workunit.client.0.smithi117.stdout:6/738: creat d8/d3a/d49/da4/d8a/fe7 x:0 0 0 2024-04-12T09:11:19.682 INFO:tasks.workunit.client.1.smithi203.stdout:9/52: write d8/f15 [120748,87843] 0 2024-04-12T09:11:19.683 INFO:tasks.workunit.client.1.smithi203.stdout:7/66: mknod d0/c12 0 2024-04-12T09:11:19.686 INFO:tasks.workunit.client.0.smithi117.stdout:0/876: rename d3/f118 to d3/da2/de6/df3/f120 0 2024-04-12T09:11:19.688 INFO:tasks.workunit.client.1.smithi203.stdout:5/143: symlink d0/d6/d16/d9/d29/l37 0 2024-04-12T09:11:19.689 INFO:tasks.workunit.client.0.smithi117.stdout:2/661: mkdir d0/d4/ddb 0 2024-04-12T09:11:19.691 INFO:tasks.workunit.client.1.smithi203.stdout:3/41: unlink d2/c3 0 2024-04-12T09:11:19.697 INFO:tasks.workunit.client.1.smithi203.stdout:5/144: dwrite d0/d6/d16/d9/d14/f25 [4194304,4194304] 0 2024-04-12T09:11:19.698 INFO:tasks.workunit.client.1.smithi203.stdout:2/70: rename d0/d3/f11 to d0/f1a 0 2024-04-12T09:11:19.698 INFO:tasks.workunit.client.0.smithi117.stdout:5/823: symlink d2/d3/de/d1e/d66/dc2/l10d 0 2024-04-12T09:11:19.702 INFO:tasks.workunit.client.0.smithi117.stdout:1/733: unlink d1/dbd/d3f/db/d16/db6/da9/d9a/fb9 0 2024-04-12T09:11:19.703 INFO:tasks.workunit.client.0.smithi117.stdout:1/734: dread - d1/dbd/d3f/db/d1d/fd5 zero size 2024-04-12T09:11:19.704 INFO:tasks.workunit.client.1.smithi203.stdout:1/74: dwrite f7 [0,4194304] 0 2024-04-12T09:11:19.704 INFO:tasks.workunit.client.1.smithi203.stdout:3/42: dwrite d2/f4 [0,4194304] 0 2024-04-12T09:11:19.704 INFO:tasks.workunit.client.1.smithi203.stdout:1/75: chown l2 923395082 1 2024-04-12T09:11:19.705 INFO:tasks.workunit.client.1.smithi203.stdout:3/43: truncate d2/f4 4769650 0 2024-04-12T09:11:19.706 INFO:tasks.workunit.client.0.smithi117.stdout:8/770: unlink db/d19/d1a/d3d/c42 0 2024-04-12T09:11:19.706 INFO:tasks.workunit.client.0.smithi117.stdout:8/771: stat db/d1b/d55/cd3 0 2024-04-12T09:11:19.708 INFO:tasks.workunit.client.1.smithi203.stdout:4/59: link c12 c13 0 2024-04-12T09:11:19.709 INFO:tasks.workunit.client.1.smithi203.stdout:4/60: chown fc 17303 1 2024-04-12T09:11:19.710 INFO:tasks.workunit.client.0.smithi117.stdout:6/739: rename d8/d2a/fca to d8/d3a/d49/da4/d9f/fe8 0 2024-04-12T09:11:19.716 INFO:tasks.workunit.client.0.smithi117.stdout:0/877: creat d3/da2/dee/d76/d83/da8/d9a/f121 x:0 0 0 2024-04-12T09:11:19.718 INFO:tasks.workunit.client.0.smithi117.stdout:2/662: mknod d0/d96/cdc 0 2024-04-12T09:11:19.719 INFO:tasks.workunit.client.0.smithi117.stdout:2/663: fdatasync d0/d43/faf 0 2024-04-12T09:11:19.720 INFO:tasks.workunit.client.0.smithi117.stdout:2/664: write d0/d43/da5/d8f/fb6 [108158,47242] 0 2024-04-12T09:11:19.721 INFO:tasks.workunit.client.0.smithi117.stdout:9/694: truncate d1/d8/d5a/d6e/d71/f72 6272542 0 2024-04-12T09:11:19.722 INFO:tasks.workunit.client.0.smithi117.stdout:5/824: symlink d2/d3/dd/d39/d83/d4d/d52/l10e 0 2024-04-12T09:11:19.723 INFO:tasks.workunit.client.0.smithi117.stdout:2/665: readlink d0/d4/d10/l4f 0 2024-04-12T09:11:19.724 INFO:tasks.workunit.client.0.smithi117.stdout:2/666: chown d0/df/f7a 366 1 2024-04-12T09:11:19.725 INFO:tasks.workunit.client.0.smithi117.stdout:1/735: symlink d1/dbd/d3f/le4 0 2024-04-12T09:11:19.725 INFO:tasks.workunit.client.0.smithi117.stdout:2/667: dread - d0/df/fab zero size 2024-04-12T09:11:19.727 INFO:tasks.workunit.client.0.smithi117.stdout:8/772: rmdir db/d13/d38/d86/da0/da4 39 2024-04-12T09:11:19.728 INFO:tasks.workunit.client.1.smithi203.stdout:5/145: rmdir d0/d6/d11/d18 39 2024-04-12T09:11:19.730 INFO:tasks.workunit.client.0.smithi117.stdout:9/695: dwrite d1/d8/d5a/d79/d91/fb2 [0,4194304] 0 2024-04-12T09:11:19.730 INFO:tasks.workunit.client.1.smithi203.stdout:7/67: mknod d0/c13 0 2024-04-12T09:11:19.731 INFO:tasks.workunit.client.1.smithi203.stdout:7/68: stat d0/d4/f11 0 2024-04-12T09:11:19.732 INFO:tasks.workunit.client.0.smithi117.stdout:6/740: write d8/d3f/d51/f88 [871331,15402] 0 2024-04-12T09:11:19.732 INFO:tasks.workunit.client.0.smithi117.stdout:8/773: chown db/d19/d1a/d3d/d60/d70/d98/ff4 0 1 2024-04-12T09:11:19.733 INFO:tasks.workunit.client.0.smithi117.stdout:0/878: creat d3/da2/dee/dd5/f122 x:0 0 0 2024-04-12T09:11:19.733 INFO:tasks.workunit.client.1.smithi203.stdout:1/76: mknod df/c18 0 2024-04-12T09:11:19.736 INFO:tasks.workunit.client.1.smithi203.stdout:3/44: creat d2/fa x:0 0 0 2024-04-12T09:11:19.736 INFO:tasks.workunit.client.1.smithi203.stdout:8/37: sync 2024-04-12T09:11:19.738 INFO:tasks.workunit.client.0.smithi117.stdout:5/825: readlink d2/d3/dd/d39/d83/dc8/le7 0 2024-04-12T09:11:19.741 INFO:tasks.workunit.client.0.smithi117.stdout:1/736: dwrite d1/dbd/d51/fb2 [0,4194304] 0 2024-04-12T09:11:19.742 INFO:tasks.workunit.client.0.smithi117.stdout:9/696: dwrite d1/d24/f2e [0,4194304] 0 2024-04-12T09:11:19.745 INFO:tasks.workunit.client.1.smithi203.stdout:6/49: getdents d1 0 2024-04-12T09:11:19.746 INFO:tasks.workunit.client.0.smithi117.stdout:1/737: dread - d1/dbd/d3f/db/d16/db6/da9/d9a/d54/fb0 zero size 2024-04-12T09:11:19.748 INFO:tasks.workunit.client.0.smithi117.stdout:2/668: rename d0/d43/f6d to d0/d43/d53/d61/d8d/fdd 0 2024-04-12T09:11:19.752 INFO:tasks.workunit.client.1.smithi203.stdout:2/71: mkdir d0/d1b 0 2024-04-12T09:11:19.754 INFO:tasks.workunit.client.1.smithi203.stdout:5/146: write d0/d6/d11/d18/d2a/ff [2001388,50685] 0 2024-04-12T09:11:19.756 INFO:tasks.workunit.client.1.smithi203.stdout:9/53: creat d8/d12/d14/f17 x:0 0 0 2024-04-12T09:11:19.756 INFO:tasks.workunit.client.0.smithi117.stdout:0/879: unlink d3/f6 0 2024-04-12T09:11:19.760 INFO:tasks.workunit.client.1.smithi203.stdout:1/77: creat df/f19 x:0 0 0 2024-04-12T09:11:19.760 INFO:tasks.workunit.client.1.smithi203.stdout:1/78: write fe [409855,28] 0 2024-04-12T09:11:19.761 INFO:tasks.workunit.client.1.smithi203.stdout:3/45: mknod d2/cb 0 2024-04-12T09:11:19.763 INFO:tasks.workunit.client.1.smithi203.stdout:8/38: fsync d4/f9 0 2024-04-12T09:11:19.764 INFO:tasks.workunit.client.1.smithi203.stdout:8/39: chown f3 0 1 2024-04-12T09:11:19.765 INFO:tasks.workunit.client.0.smithi117.stdout:1/738: symlink d1/d64/d45/d4c/d94/dd0/le5 0 2024-04-12T09:11:19.766 INFO:tasks.workunit.client.0.smithi117.stdout:1/739: truncate d1/d64/f93 81455 0 2024-04-12T09:11:19.767 INFO:tasks.workunit.client.1.smithi203.stdout:8/40: dread d4/d8/fc [0,4194304] 0 2024-04-12T09:11:19.767 INFO:tasks.workunit.client.0.smithi117.stdout:9/697: rename d1/d8/d5a/d79/d91/db0/d41 to d1/d8/df/d68/ddf 0 2024-04-12T09:11:19.767 INFO:tasks.workunit.client.1.smithi203.stdout:6/50: rename d1/d3/d4 to d1/d3/d4/de 22 2024-04-12T09:11:19.768 INFO:tasks.workunit.client.1.smithi203.stdout:9/54: rename d8 to d8/d12/d14/d18 22 2024-04-12T09:11:19.768 INFO:tasks.workunit.client.1.smithi203.stdout:2/72: fdatasync d0/d3/fd 0 2024-04-12T09:11:19.769 INFO:tasks.workunit.client.0.smithi117.stdout:0/880: stat d3/da2/dee/dd5/dff/d84/c9e 0 2024-04-12T09:11:19.769 INFO:tasks.workunit.client.1.smithi203.stdout:2/73: read d0/d3/fd [3945093,95136] 0 2024-04-12T09:11:19.771 INFO:tasks.workunit.client.0.smithi117.stdout:4/753: sync 2024-04-12T09:11:19.771 INFO:tasks.workunit.client.0.smithi117.stdout:7/622: sync 2024-04-12T09:11:19.774 INFO:tasks.workunit.client.1.smithi203.stdout:7/69: symlink d0/l14 0 2024-04-12T09:11:19.774 INFO:tasks.workunit.client.0.smithi117.stdout:5/826: symlink d2/d3/dd/d39/d83/d4d/d6b/dcc/l10f 0 2024-04-12T09:11:19.775 INFO:tasks.workunit.client.1.smithi203.stdout:7/70: dread - d0/ff zero size 2024-04-12T09:11:19.776 INFO:tasks.workunit.client.0.smithi117.stdout:0/881: dwrite d3/fe [0,4194304] 0 2024-04-12T09:11:19.777 INFO:tasks.workunit.client.1.smithi203.stdout:2/74: dwrite d0/f18 [0,4194304] 0 2024-04-12T09:11:19.777 INFO:tasks.workunit.client.1.smithi203.stdout:1/79: creat df/f1a x:0 0 0 2024-04-12T09:11:19.780 INFO:tasks.workunit.client.0.smithi117.stdout:9/698: mknod d1/d8/d90/ce0 0 2024-04-12T09:11:19.780 INFO:tasks.workunit.client.0.smithi117.stdout:0/882: write d3/da2/dee/dd5/dff/d91/d94/d5a/d62/ff6 [205930,75959] 0 2024-04-12T09:11:19.782 INFO:tasks.workunit.client.1.smithi203.stdout:2/75: dread d0/d3/f10 [0,4194304] 0 2024-04-12T09:11:19.791 INFO:tasks.workunit.client.1.smithi203.stdout:8/41: rename d4/fb to d4/d8/fd 0 2024-04-12T09:11:19.792 INFO:tasks.workunit.client.1.smithi203.stdout:8/42: stat l0 0 2024-04-12T09:11:19.792 INFO:tasks.workunit.client.0.smithi117.stdout:8/774: dwrite db/d1b/d55/f68 [0,4194304] 0 2024-04-12T09:11:19.793 INFO:tasks.workunit.client.1.smithi203.stdout:8/43: dread d4/f6 [0,4194304] 0 2024-04-12T09:11:19.793 INFO:tasks.workunit.client.1.smithi203.stdout:4/61: truncate fb 1091311 0 2024-04-12T09:11:19.794 INFO:tasks.workunit.client.0.smithi117.stdout:7/623: mkdir d0/d2/d45/d17/d23/d39/dbd 0 2024-04-12T09:11:19.800 INFO:tasks.workunit.client.1.smithi203.stdout:8/44: dread d4/d8/fc [0,4194304] 0 2024-04-12T09:11:19.801 INFO:tasks.workunit.client.0.smithi117.stdout:1/740: mknod d1/d3b/ce6 0 2024-04-12T09:11:19.802 INFO:tasks.workunit.client.1.smithi203.stdout:5/147: mkdir d0/d6/d11/d38 0 2024-04-12T09:11:19.805 INFO:tasks.workunit.client.0.smithi117.stdout:4/754: dread d0/d2c/da6/fee [0,4194304] 0 2024-04-12T09:11:19.805 INFO:tasks.workunit.client.0.smithi117.stdout:2/669: dwrite d0/d4/d10/d27/f70 [0,4194304] 0 2024-04-12T09:11:19.805 INFO:tasks.workunit.client.1.smithi203.stdout:4/62: dread fc [0,4194304] 0 2024-04-12T09:11:19.806 INFO:tasks.workunit.client.0.smithi117.stdout:6/741: getdents d8/d2a/d60/d7d 0 2024-04-12T09:11:19.807 INFO:tasks.workunit.client.0.smithi117.stdout:6/742: chown d8/d2a/d60/d7d/lae 4712 1 2024-04-12T09:11:19.807 INFO:tasks.workunit.client.1.smithi203.stdout:1/80: mknod df/c1b 0 2024-04-12T09:11:19.812 INFO:tasks.workunit.client.1.smithi203.stdout:7/71: dwrite d0/f7 [0,4194304] 0 2024-04-12T09:11:19.815 INFO:tasks.workunit.client.1.smithi203.stdout:4/63: dread f5 [0,4194304] 0 2024-04-12T09:11:19.816 INFO:tasks.workunit.client.1.smithi203.stdout:7/72: write d0/f7 [2421545,88002] 0 2024-04-12T09:11:19.818 INFO:tasks.workunit.client.1.smithi203.stdout:1/81: dwrite df/f14 [0,4194304] 0 2024-04-12T09:11:19.818 INFO:tasks.workunit.client.0.smithi117.stdout:0/883: link d3/da2/dee/d76/de2/f107 d3/da2/dee/dd5/dff/d91/d94/d5a/d62/d66/d73/f123 0 2024-04-12T09:11:19.820 INFO:tasks.workunit.client.0.smithi117.stdout:0/884: dread - d3/da2/dee/d76/d83/da8/d9a/f121 zero size 2024-04-12T09:11:19.821 INFO:tasks.workunit.client.0.smithi117.stdout:2/670: symlink d0/d43/d4b/lde 0 2024-04-12T09:11:19.821 INFO:tasks.workunit.client.1.smithi203.stdout:8/45: symlink d4/le 0 2024-04-12T09:11:19.822 INFO:tasks.workunit.client.0.smithi117.stdout:0/885: fsync d3/da2/dee/dd5/dff/d91/fa9 0 2024-04-12T09:11:19.822 INFO:tasks.workunit.client.0.smithi117.stdout:6/743: dread - d8/d9/d17/f68 zero size 2024-04-12T09:11:19.824 INFO:tasks.workunit.client.1.smithi203.stdout:5/148: symlink d0/d6/d16/d9/d14/l39 0 2024-04-12T09:11:19.825 INFO:tasks.workunit.client.0.smithi117.stdout:2/671: truncate d0/d4/d10/d27/d9a/f9b 4768765 0 2024-04-12T09:11:19.826 INFO:tasks.workunit.client.0.smithi117.stdout:2/672: dread - d0/d43/da5/d8f/dc2/fd8 zero size 2024-04-12T09:11:19.828 INFO:tasks.workunit.client.0.smithi117.stdout:5/827: creat d2/d3/de/f110 x:0 0 0 2024-04-12T09:11:19.828 INFO:tasks.workunit.client.1.smithi203.stdout:8/46: dread d4/f9 [0,4194304] 0 2024-04-12T09:11:19.831 INFO:tasks.workunit.client.1.smithi203.stdout:6/51: rename d1/d3/d4/dc to d1/df 0 2024-04-12T09:11:19.832 INFO:tasks.workunit.client.0.smithi117.stdout:1/741: symlink d1/d64/d45/le7 0 2024-04-12T09:11:19.832 INFO:tasks.workunit.client.1.smithi203.stdout:6/52: readlink d1/d3/d4/lb 0 2024-04-12T09:11:19.835 INFO:tasks.workunit.client.0.smithi117.stdout:0/886: creat d3/d59/f124 x:0 0 0 2024-04-12T09:11:19.837 INFO:tasks.workunit.client.0.smithi117.stdout:0/887: write d3/d30/f31 [3530235,69623] 0 2024-04-12T09:11:19.840 INFO:tasks.workunit.client.0.smithi117.stdout:8/775: rename db/d1b/d62/f6f to db/d19/d1a/f102 0 2024-04-12T09:11:19.847 INFO:tasks.workunit.client.1.smithi203.stdout:1/82: mknod df/c1c 0 2024-04-12T09:11:19.851 INFO:tasks.workunit.client.1.smithi203.stdout:5/149: symlink d0/d6/d16/d9/d14/l3a 0 2024-04-12T09:11:19.854 INFO:tasks.workunit.client.0.smithi117.stdout:6/744: mknod d8/d9/d39/d79/ce9 0 2024-04-12T09:11:19.858 INFO:tasks.workunit.client.1.smithi203.stdout:2/76: rename d0/l15 to d0/d3/l1c 0 2024-04-12T09:11:19.860 INFO:tasks.workunit.client.0.smithi117.stdout:7/624: dwrite d0/d2/d45/f59 [0,4194304] 0 2024-04-12T09:11:19.862 INFO:tasks.workunit.client.1.smithi203.stdout:9/55: getdents d8/d12/d14 0 2024-04-12T09:11:19.864 INFO:tasks.workunit.client.0.smithi117.stdout:5/828: creat d2/d3/de/d1e/d46/de4/dea/f111 x:0 0 0 2024-04-12T09:11:19.865 INFO:tasks.workunit.client.0.smithi117.stdout:5/829: chown d2/d3/de/d1e/d66/f7d 0 1 2024-04-12T09:11:19.866 INFO:tasks.workunit.client.0.smithi117.stdout:1/742: creat d1/dbd/d3f/db/dc2/fe8 x:0 0 0 2024-04-12T09:11:19.868 INFO:tasks.workunit.client.0.smithi117.stdout:4/755: getdents d0/d5 0 2024-04-12T09:11:19.870 INFO:tasks.workunit.client.0.smithi117.stdout:6/745: mkdir d8/d2a/d60/d89/dea 0 2024-04-12T09:11:19.872 INFO:tasks.workunit.client.0.smithi117.stdout:6/746: chown d8/d2a/d60/d7d/d8c/f98 5 1 2024-04-12T09:11:19.874 INFO:tasks.workunit.client.1.smithi203.stdout:1/83: rename fe to df/f1d 0 2024-04-12T09:11:19.874 INFO:tasks.workunit.client.1.smithi203.stdout:1/84: stat df/l13 0 2024-04-12T09:11:19.877 INFO:tasks.workunit.client.1.smithi203.stdout:4/64: write ff [367825,125013] 0 2024-04-12T09:11:19.878 INFO:tasks.workunit.client.1.smithi203.stdout:9/56: creat d8/d12/f19 x:0 0 0 2024-04-12T09:11:19.883 INFO:tasks.workunit.client.0.smithi117.stdout:5/830: fsync d2/d3/de/d1e/d35/f93 0 2024-04-12T09:11:19.884 INFO:tasks.workunit.client.1.smithi203.stdout:0/124: sync 2024-04-12T09:11:19.885 INFO:tasks.workunit.client.1.smithi203.stdout:7/73: dwrite d0/d4/f11 [0,4194304] 0 2024-04-12T09:11:19.886 INFO:tasks.workunit.client.0.smithi117.stdout:0/888: write d3/da2/dee/dd5/dff/d84/dc2/feb [596359,119376] 0 2024-04-12T09:11:19.886 INFO:tasks.workunit.client.0.smithi117.stdout:1/743: write d1/dbd/d3f/db/d1d/f5b [2709784,118320] 0 2024-04-12T09:11:19.888 INFO:tasks.workunit.client.0.smithi117.stdout:1/744: chown d1/dbd/d51/fb2 20312531 1 2024-04-12T09:11:19.888 INFO:tasks.workunit.client.1.smithi203.stdout:9/57: dwrite d8/fa [0,4194304] 0 2024-04-12T09:11:19.889 INFO:tasks.workunit.client.0.smithi117.stdout:4/756: chown d0/d2c/d67/ld0 6461518 1 2024-04-12T09:11:19.891 INFO:tasks.workunit.client.1.smithi203.stdout:2/77: symlink d0/d14/l1d 0 2024-04-12T09:11:19.891 INFO:tasks.workunit.client.0.smithi117.stdout:6/747: mkdir d8/d2a/d60/d7d/d8c/deb 0 2024-04-12T09:11:19.892 INFO:tasks.workunit.client.0.smithi117.stdout:6/748: write d8/d9/f82 [6529986,80007] 0 2024-04-12T09:11:19.893 INFO:tasks.workunit.client.1.smithi203.stdout:9/58: dread d8/f10 [0,4194304] 0 2024-04-12T09:11:19.897 INFO:tasks.workunit.client.1.smithi203.stdout:4/65: creat f14 x:0 0 0 2024-04-12T09:11:19.898 INFO:tasks.workunit.client.0.smithi117.stdout:6/749: read f7 [2072610,82911] 0 2024-04-12T09:11:19.900 INFO:tasks.workunit.client.0.smithi117.stdout:2/673: link d0/d43/d30/f62 d0/d4/d10/fdf 0 2024-04-12T09:11:19.901 INFO:tasks.workunit.client.1.smithi203.stdout:5/150: creat d0/d6/d11/d18/f3b x:0 0 0 2024-04-12T09:11:19.903 INFO:tasks.workunit.client.0.smithi117.stdout:5/831: truncate d2/f34 1146481 0 2024-04-12T09:11:19.903 INFO:tasks.workunit.client.0.smithi117.stdout:2/674: dread d0/d43/d53/f6f [0,4194304] 0 2024-04-12T09:11:19.904 INFO:tasks.workunit.client.1.smithi203.stdout:8/47: getdents d4 0 2024-04-12T09:11:19.905 INFO:tasks.workunit.client.0.smithi117.stdout:0/889: mkdir d3/d47/d125 0 2024-04-12T09:11:19.905 INFO:tasks.workunit.client.0.smithi117.stdout:2/675: write d0/d4/fb [3822694,44941] 0 2024-04-12T09:11:19.909 INFO:tasks.workunit.client.0.smithi117.stdout:4/757: creat d0/d5/d25/d69/ff3 x:0 0 0 2024-04-12T09:11:19.912 INFO:tasks.workunit.client.1.smithi203.stdout:3/46: sync 2024-04-12T09:11:19.913 INFO:tasks.workunit.client.0.smithi117.stdout:8/776: link db/d19/fde db/d1b/d62/df0/f103 0 2024-04-12T09:11:19.914 INFO:tasks.workunit.client.0.smithi117.stdout:0/890: dwrite d3/da2/dee/dd5/dff/d91/d94/d5a/d62/d66/d73/f10b [0,4194304] 0 2024-04-12T09:11:19.915 INFO:tasks.workunit.client.0.smithi117.stdout:8/777: chown db/d13/f81 1540393 1 2024-04-12T09:11:19.917 INFO:tasks.workunit.client.1.smithi203.stdout:1/85: unlink df/f14 0 2024-04-12T09:11:19.920 INFO:tasks.workunit.client.0.smithi117.stdout:7/625: creat d0/d2/d45/fbe x:0 0 0 2024-04-12T09:11:19.926 INFO:tasks.workunit.client.1.smithi203.stdout:6/53: link d1/d3/d4/ca d1/d3/c10 0 2024-04-12T09:11:19.926 INFO:tasks.workunit.client.1.smithi203.stdout:2/78: dread d0/d3/f10 [0,4194304] 0 2024-04-12T09:11:19.927 INFO:tasks.workunit.client.0.smithi117.stdout:7/626: dwrite d0/d13/f40 [0,4194304] 0 2024-04-12T09:11:19.927 INFO:tasks.workunit.client.0.smithi117.stdout:2/676: dread d0/d43/d30/f6e [0,4194304] 0 2024-04-12T09:11:19.928 INFO:tasks.workunit.client.1.smithi203.stdout:9/59: mknod d8/d12/c1a 0 2024-04-12T09:11:19.930 INFO:tasks.workunit.client.0.smithi117.stdout:5/832: symlink d2/d3/de/d1e/d66/dbe/l112 0 2024-04-12T09:11:19.931 INFO:tasks.workunit.client.1.smithi203.stdout:4/66: symlink l15 0 2024-04-12T09:11:19.934 INFO:tasks.workunit.client.0.smithi117.stdout:1/745: mknod d1/db3/ce9 0 2024-04-12T09:11:19.936 INFO:tasks.workunit.client.1.smithi203.stdout:8/48: symlink d4/lf 0 2024-04-12T09:11:19.937 INFO:tasks.workunit.client.1.smithi203.stdout:7/74: mkdir d0/d15 0 2024-04-12T09:11:19.938 INFO:tasks.workunit.client.1.smithi203.stdout:7/75: readlink d0/l14 0 2024-04-12T09:11:19.938 INFO:tasks.workunit.client.1.smithi203.stdout:3/47: creat d2/fc x:0 0 0 2024-04-12T09:11:19.940 INFO:tasks.workunit.client.1.smithi203.stdout:1/86: creat df/f1e x:0 0 0 2024-04-12T09:11:19.940 INFO:tasks.workunit.client.0.smithi117.stdout:0/891: symlink d3/da2/de6/df3/l126 0 2024-04-12T09:11:19.941 INFO:tasks.workunit.client.0.smithi117.stdout:0/892: chown d3/da2/dee/d76/d83/da8/f103 9 1 2024-04-12T09:11:19.944 INFO:tasks.workunit.client.1.smithi203.stdout:2/79: mkdir d0/d14/d1e 0 2024-04-12T09:11:19.946 INFO:tasks.workunit.client.1.smithi203.stdout:9/60: mknod d8/d12/d14/c1b 0 2024-04-12T09:11:19.949 INFO:tasks.workunit.client.1.smithi203.stdout:2/80: read d0/d3/f10 [621811,23380] 0 2024-04-12T09:11:19.949 INFO:tasks.workunit.client.0.smithi117.stdout:2/677: symlink d0/d4/d10/d27/le0 0 2024-04-12T09:11:19.951 INFO:tasks.workunit.client.1.smithi203.stdout:3/48: dwrite d2/fa [0,4194304] 0 2024-04-12T09:11:19.952 INFO:tasks.workunit.client.1.smithi203.stdout:4/67: dread fc [0,4194304] 0 2024-04-12T09:11:19.953 INFO:tasks.workunit.client.0.smithi117.stdout:5/833: mknod d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/c113 0 2024-04-12T09:11:19.953 INFO:tasks.workunit.client.1.smithi203.stdout:0/125: symlink d0/d1d/l29 0 2024-04-12T09:11:19.954 INFO:tasks.workunit.client.1.smithi203.stdout:9/61: write d8/d12/f16 [1016569,18685] 0 2024-04-12T09:11:19.954 INFO:tasks.workunit.client.1.smithi203.stdout:2/81: read - d0/d3/f16 zero size 2024-04-12T09:11:19.955 INFO:tasks.workunit.client.0.smithi117.stdout:5/834: write d2/d3/de/fe9 [996194,9495] 0 2024-04-12T09:11:19.956 INFO:tasks.workunit.client.1.smithi203.stdout:7/76: creat d0/d4/f16 x:0 0 0 2024-04-12T09:11:19.957 INFO:tasks.workunit.client.0.smithi117.stdout:5/835: fsync d2/d3/de/d1e/d99/ffb 0 2024-04-12T09:11:19.957 INFO:tasks.workunit.client.0.smithi117.stdout:1/746: readlink d1/db3/lba 0 2024-04-12T09:11:19.957 INFO:tasks.workunit.client.1.smithi203.stdout:1/87: dwrite df/f1a [0,4194304] 0 2024-04-12T09:11:19.957 INFO:tasks.workunit.client.1.smithi203.stdout:6/54: dwrite d1/f9 [0,4194304] 0 2024-04-12T09:11:19.961 INFO:tasks.workunit.client.1.smithi203.stdout:0/126: dread d0/d9/d17/f11 [0,4194304] 0 2024-04-12T09:11:19.971 INFO:tasks.workunit.client.1.smithi203.stdout:5/151: truncate d0/d6/d11/d18/d2a/f2b 4170361 0 2024-04-12T09:11:19.971 INFO:tasks.workunit.client.1.smithi203.stdout:4/68: fdatasync fc 0 2024-04-12T09:11:19.972 INFO:tasks.workunit.client.1.smithi203.stdout:5/152: chown d0/d6/d11/l12 21751597 1 2024-04-12T09:11:19.976 INFO:tasks.workunit.client.1.smithi203.stdout:3/49: write d2/fa [4659254,15843] 0 2024-04-12T09:11:19.976 INFO:tasks.workunit.client.0.smithi117.stdout:7/627: creat d0/d2/d45/d17/d23/d39/dbd/fbf x:0 0 0 2024-04-12T09:11:19.977 INFO:tasks.workunit.client.1.smithi203.stdout:3/50: write d2/fc [38257,17707] 0 2024-04-12T09:11:19.977 INFO:tasks.workunit.client.0.smithi117.stdout:1/747: symlink d1/dbd/d3f/lea 0 2024-04-12T09:11:19.982 INFO:tasks.workunit.client.0.smithi117.stdout:1/748: write d1/dbd/d3f/f20 [3292504,117624] 0 2024-04-12T09:11:19.982 INFO:tasks.workunit.client.0.smithi117.stdout:1/749: write d1/dcb/fde [91242,39143] 0 2024-04-12T09:11:19.982 INFO:tasks.workunit.client.0.smithi117.stdout:4/758: link d0/d1/d34/l78 d0/d5/d39/d4e/lf4 0 2024-04-12T09:11:19.982 INFO:tasks.workunit.client.0.smithi117.stdout:1/750: dread - d1/dbd/d3f/db/d16/f8b zero size 2024-04-12T09:11:19.983 INFO:tasks.workunit.client.1.smithi203.stdout:7/77: creat d0/d4/f17 x:0 0 0 2024-04-12T09:11:19.983 INFO:tasks.workunit.client.1.smithi203.stdout:6/55: creat d1/df/f11 x:0 0 0 2024-04-12T09:11:19.983 INFO:tasks.workunit.client.1.smithi203.stdout:9/62: creat d8/d12/d14/f1c x:0 0 0 2024-04-12T09:11:19.984 INFO:tasks.workunit.client.0.smithi117.stdout:4/759: read d0/d1/d34/f80 [3810085,120107] 0 2024-04-12T09:11:19.985 INFO:tasks.workunit.client.1.smithi203.stdout:0/127: mknod d0/d1d/c2a 0 2024-04-12T09:11:19.993 INFO:tasks.workunit.client.0.smithi117.stdout:1/751: dwrite d1/dbd/d3f/db/d1d/d78/fe2 [0,4194304] 0 2024-04-12T09:11:19.993 INFO:tasks.workunit.client.0.smithi117.stdout:8/778: dwrite db/d19/d1a/d3d/f45 [0,4194304] 0 2024-04-12T09:11:19.994 INFO:tasks.workunit.client.0.smithi117.stdout:1/752: readlink d1/dbd/d3f/db/l26 0 2024-04-12T09:11:19.994 INFO:tasks.workunit.client.0.smithi117.stdout:8/779: chown db/da6/lc1 1060 1 2024-04-12T09:11:19.996 INFO:tasks.workunit.client.1.smithi203.stdout:5/153: unlink d0/d6/d16/c5 0 2024-04-12T09:11:19.996 INFO:tasks.workunit.client.0.smithi117.stdout:1/753: write d1/dbd/d3f/db/d16/db6/da9/d9a/d54/f86 [840217,124523] 0 2024-04-12T09:11:19.998 INFO:tasks.workunit.client.0.smithi117.stdout:1/754: write d1/dbd/d3f/db/d1d/f5b [5580451,70077] 0 2024-04-12T09:11:20.002 INFO:tasks.workunit.client.0.smithi117.stdout:1/755: dread d1/dbd/d51/fb2 [0,4194304] 0 2024-04-12T09:11:20.003 INFO:tasks.workunit.client.0.smithi117.stdout:1/756: fsync d1/dbd/d3f/db/d16/f19 0 2024-04-12T09:11:20.005 INFO:tasks.workunit.client.1.smithi203.stdout:3/51: creat d2/fd x:0 0 0 2024-04-12T09:11:20.006 INFO:tasks.workunit.client.1.smithi203.stdout:6/56: mkdir d1/d3/d12 0 2024-04-12T09:11:20.007 INFO:tasks.workunit.client.1.smithi203.stdout:1/88: truncate df/f17 177280 0 2024-04-12T09:11:20.007 INFO:tasks.workunit.client.1.smithi203.stdout:9/63: creat d8/d12/d14/f1d x:0 0 0 2024-04-12T09:11:20.008 INFO:tasks.workunit.client.1.smithi203.stdout:0/128: symlink d0/d9/l2b 0 2024-04-12T09:11:20.008 INFO:tasks.workunit.client.1.smithi203.stdout:3/52: dread - d2/fd zero size 2024-04-12T09:11:20.009 INFO:tasks.workunit.client.1.smithi203.stdout:6/57: readlink d1/d3/d4/lb 0 2024-04-12T09:11:20.010 INFO:tasks.workunit.client.1.smithi203.stdout:4/69: fsync fb 0 2024-04-12T09:11:20.030 INFO:tasks.workunit.client.0.smithi117.stdout:9/699: sync 2024-04-12T09:11:20.047 INFO:tasks.workunit.client.0.smithi117.stdout:6/750: getdents d8/d2a/d60 0 2024-04-12T09:11:20.050 INFO:tasks.workunit.client.0.smithi117.stdout:2/678: unlink d0/d4/d10/c4a 0 2024-04-12T09:11:20.055 INFO:tasks.workunit.client.0.smithi117.stdout:4/760: rename d0/d5/d3b/d38/d4f/c89 to d0/d5/d25/dc8/cf5 0 2024-04-12T09:11:20.062 INFO:tasks.workunit.client.0.smithi117.stdout:9/700: symlink d1/d8/d5a/d79/d91/le1 0 2024-04-12T09:11:20.064 INFO:tasks.workunit.client.0.smithi117.stdout:6/751: dread d8/d3f/d51/d97/fb9 [0,4194304] 0 2024-04-12T09:11:20.064 INFO:tasks.workunit.client.0.smithi117.stdout:2/679: mkdir d0/df/de1 0 2024-04-12T09:11:20.065 INFO:tasks.workunit.client.0.smithi117.stdout:7/628: symlink d0/d2/d45/lc0 0 2024-04-12T09:11:20.066 INFO:tasks.workunit.client.0.smithi117.stdout:7/629: fdatasync d0/d2/d1a/f9d 0 2024-04-12T09:11:20.067 INFO:tasks.workunit.client.0.smithi117.stdout:7/630: fsync d0/d2/d45/d17/d23/d39/f78 0 2024-04-12T09:11:20.071 INFO:tasks.workunit.client.0.smithi117.stdout:9/701: stat d1/d8/d12/f37 0 2024-04-12T09:11:20.072 INFO:tasks.workunit.client.0.smithi117.stdout:6/752: symlink d8/d3a/d49/da4/d8a/lec 0 2024-04-12T09:11:20.072 INFO:tasks.workunit.client.0.smithi117.stdout:9/702: write d1/d8/d5a/d79/d91/fb2 [4672403,51685] 0 2024-04-12T09:11:20.073 INFO:tasks.workunit.client.0.smithi117.stdout:2/680: symlink d0/d43/d53/d61/d66/le2 0 2024-04-12T09:11:20.078 INFO:tasks.workunit.client.0.smithi117.stdout:1/757: creat d1/dbd/feb x:0 0 0 2024-04-12T09:11:20.079 INFO:tasks.workunit.client.0.smithi117.stdout:1/758: write d1/d64/d45/d4c/d94/fb7 [571939,111242] 0 2024-04-12T09:11:20.079 INFO:tasks.workunit.client.1.smithi203.stdout:6/58: write d1/df/f11 [805984,123995] 0 2024-04-12T09:11:20.084 INFO:tasks.workunit.client.0.smithi117.stdout:2/681: write d0/d43/d53/d61/d8d/fdd [12475477,88295] 0 2024-04-12T09:11:20.086 INFO:tasks.workunit.client.1.smithi203.stdout:7/78: mknod d0/d15/c18 0 2024-04-12T09:11:20.087 INFO:tasks.workunit.client.1.smithi203.stdout:4/70: write ff [803255,120350] 0 2024-04-12T09:11:20.087 INFO:tasks.workunit.client.0.smithi117.stdout:1/759: creat d1/d96/fec x:0 0 0 2024-04-12T09:11:20.087 INFO:tasks.workunit.client.0.smithi117.stdout:6/753: dwrite d8/f21 [4194304,4194304] 0 2024-04-12T09:11:20.089 INFO:tasks.workunit.client.1.smithi203.stdout:5/154: dread d0/d6/d16/d9/d14/f25 [4194304,4194304] 0 2024-04-12T09:11:20.089 INFO:tasks.workunit.client.1.smithi203.stdout:9/64: dread d8/d12/f16 [0,4194304] 0 2024-04-12T09:11:20.089 INFO:tasks.workunit.client.0.smithi117.stdout:9/703: truncate d1/d24/f94 102452 0 2024-04-12T09:11:20.090 INFO:tasks.workunit.client.1.smithi203.stdout:5/155: readlink d0/d6/d16/d9/d14/l31 0 2024-04-12T09:11:20.090 INFO:tasks.workunit.client.1.smithi203.stdout:9/65: chown d8/d12/d14/c1b 67 1 2024-04-12T09:11:20.093 INFO:tasks.workunit.client.1.smithi203.stdout:7/79: dread d0/d4/fe [0,4194304] 0 2024-04-12T09:11:20.097 INFO:tasks.workunit.client.0.smithi117.stdout:2/682: rmdir d0/d4/d10 39 2024-04-12T09:11:20.099 INFO:tasks.workunit.client.1.smithi203.stdout:7/80: dwrite d0/d4/f16 [0,4194304] 0 2024-04-12T09:11:20.100 INFO:tasks.workunit.client.0.smithi117.stdout:0/893: dwrite d3/da2/dee/d76/db3/fce [0,4194304] 0 2024-04-12T09:11:20.100 INFO:tasks.workunit.client.0.smithi117.stdout:5/836: truncate d2/d3/dd/d39/d83/d4d/d52/f84 3012743 0 2024-04-12T09:11:20.101 INFO:tasks.workunit.client.0.smithi117.stdout:5/837: readlink d2/d3/de/d1e/d66/l85 0 2024-04-12T09:11:20.113 INFO:tasks.workunit.client.0.smithi117.stdout:4/761: truncate d0/d1/d34/f80 97381 0 2024-04-12T09:11:20.114 INFO:tasks.workunit.client.0.smithi117.stdout:8/780: write db/d13/f7b [1695819,53266] 0 2024-04-12T09:11:20.115 INFO:tasks.workunit.client.0.smithi117.stdout:0/894: dread - d3/da2/dee/d76/db3/f105 zero size 2024-04-12T09:11:20.121 INFO:tasks.workunit.client.0.smithi117.stdout:7/631: write d0/d2/fd [4615214,55938] 0 2024-04-12T09:11:20.121 INFO:tasks.workunit.client.0.smithi117.stdout:6/754: creat d8/d2a/d60/d7d/d8c/deb/fed x:0 0 0 2024-04-12T09:11:20.122 INFO:tasks.workunit.client.0.smithi117.stdout:7/632: write d0/d2/d45/da1/fb3 [933921,123485] 0 2024-04-12T09:11:20.128 INFO:tasks.workunit.client.0.smithi117.stdout:4/762: creat d0/d72/ff6 x:0 0 0 2024-04-12T09:11:20.131 INFO:tasks.workunit.client.0.smithi117.stdout:0/895: fsync d3/d30/dc8/d10d/dab/fc4 0 2024-04-12T09:11:20.139 INFO:tasks.workunit.client.0.smithi117.stdout:6/755: creat d8/d9/d17/d2d/dc1/fee x:0 0 0 2024-04-12T09:11:20.141 INFO:tasks.workunit.client.0.smithi117.stdout:6/756: write d8/d3f/faa [353995,12017] 0 2024-04-12T09:11:20.150 INFO:tasks.workunit.client.0.smithi117.stdout:8/781: rename db/d19/d1a/d3d/d60/d70/d98/ca5 to db/d13/d38/dc3/de9/c104 0 2024-04-12T09:11:20.151 INFO:tasks.workunit.client.0.smithi117.stdout:1/760: dwrite d1/dbd/d3f/db/d16/db6/da9/f9c [0,4194304] 0 2024-04-12T09:11:20.151 INFO:tasks.workunit.client.0.smithi117.stdout:2/683: truncate d0/f36 6090831 0 2024-04-12T09:11:20.152 INFO:tasks.workunit.client.0.smithi117.stdout:8/782: chown db/d1b/d62/dae/db4 619520 1 2024-04-12T09:11:20.156 INFO:tasks.workunit.client.0.smithi117.stdout:6/757: truncate d8/d9/d61/fa3 82733 0 2024-04-12T09:11:20.163 INFO:tasks.workunit.client.0.smithi117.stdout:4/763: rename d0/d2c/f30 to d0/d5/d3b/d8f/ff7 0 2024-04-12T09:11:20.165 INFO:tasks.workunit.client.0.smithi117.stdout:1/761: creat d1/dbd/d3f/db/dc2/fed x:0 0 0 2024-04-12T09:11:20.172 INFO:tasks.workunit.client.0.smithi117.stdout:1/762: truncate d1/dbd/d3f/db/d16/db6/da9/d9a/d54/f86 1707446 0 2024-04-12T09:11:20.172 INFO:tasks.workunit.client.0.smithi117.stdout:5/838: dwrite d2/d3/dd/f4b [0,4194304] 0 2024-04-12T09:11:20.176 INFO:tasks.workunit.client.0.smithi117.stdout:7/633: creat d0/d2/d45/d17/d23/d39/d6c/fc1 x:0 0 0 2024-04-12T09:11:20.179 INFO:tasks.workunit.client.0.smithi117.stdout:0/896: creat d3/da2/dee/dd5/dff/d91/f127 x:0 0 0 2024-04-12T09:11:20.180 INFO:tasks.workunit.client.0.smithi117.stdout:0/897: stat d3/d47/ff5 0 2024-04-12T09:11:20.185 INFO:tasks.workunit.client.0.smithi117.stdout:6/758: rename d8/d9/f29 to d8/d2a/d60/fef 0 2024-04-12T09:11:20.187 INFO:tasks.workunit.client.0.smithi117.stdout:4/764: symlink d0/d5/lf8 0 2024-04-12T09:11:20.192 INFO:tasks.workunit.client.0.smithi117.stdout:2/684: mknod d0/d43/d53/d61/d66/dd9/ce3 0 2024-04-12T09:11:20.197 INFO:tasks.workunit.client.0.smithi117.stdout:8/783: write db/d13/d38/dc3/f7a [118264,129806] 0 2024-04-12T09:11:20.203 INFO:tasks.workunit.client.1.smithi203.stdout:8/49: sync 2024-04-12T09:11:20.209 INFO:tasks.workunit.client.0.smithi117.stdout:2/685: creat d0/d4/d81/fe4 x:0 0 0 2024-04-12T09:11:20.217 INFO:tasks.workunit.client.0.smithi117.stdout:7/634: mknod d0/d2/d45/d17/cc2 0 2024-04-12T09:11:20.224 INFO:tasks.workunit.client.0.smithi117.stdout:4/765: write d0/d2c/f7b [1383744,127891] 0 2024-04-12T09:11:20.225 INFO:tasks.workunit.client.0.smithi117.stdout:0/898: dwrite d3/da2/dee/dd5/dff/d91/d94/d5a/d62/d66/d73/f123 [0,4194304] 0 2024-04-12T09:11:20.230 INFO:tasks.workunit.client.0.smithi117.stdout:7/635: truncate d0/d2/d45/d17/d23/d39/f48 2803869 0 2024-04-12T09:11:20.231 INFO:tasks.workunit.client.0.smithi117.stdout:5/839: truncate d2/d3/de/fe9 66931 0 2024-04-12T09:11:20.236 INFO:tasks.workunit.client.0.smithi117.stdout:1/763: getdents d1/dbd/d3f/d72 0 2024-04-12T09:11:20.238 INFO:tasks.workunit.client.0.smithi117.stdout:8/784: dwrite db/f30 [0,4194304] 0 2024-04-12T09:11:20.239 INFO:tasks.workunit.client.0.smithi117.stdout:4/766: unlink d0/d2c/da6/fee 0 2024-04-12T09:11:20.244 INFO:tasks.workunit.client.0.smithi117.stdout:2/686: write d0/d43/da5/d8f/dc2/fd8 [854657,107403] 0 2024-04-12T09:11:20.244 INFO:tasks.workunit.client.0.smithi117.stdout:7/636: dread - d0/d2/d1a/d4f/f7b zero size 2024-04-12T09:11:20.249 INFO:tasks.workunit.client.0.smithi117.stdout:1/764: rename d1/dbd/d3f/db/d16/f8b to d1/dbd/d3f/db/d16/fee 0 2024-04-12T09:11:20.250 INFO:tasks.workunit.client.0.smithi117.stdout:1/765: fdatasync d1/dbd/d3f/db/d1d/f5b 0 2024-04-12T09:11:20.258 INFO:tasks.workunit.client.0.smithi117.stdout:0/899: dread d3/da2/dee/dd5/dff/d91/d94/d5a/d62/f70 [0,4194304] 0 2024-04-12T09:11:20.262 INFO:tasks.workunit.client.1.smithi203.stdout:3/53: sync 2024-04-12T09:11:20.263 INFO:tasks.workunit.client.1.smithi203.stdout:3/54: write d2/f4 [1867883,103070] 0 2024-04-12T09:11:20.270 INFO:tasks.workunit.client.0.smithi117.stdout:2/687: write d0/df/f67 [675105,67975] 0 2024-04-12T09:11:20.274 INFO:tasks.workunit.client.0.smithi117.stdout:0/900: mkdir d3/da2/dee/dd5/d128 0 2024-04-12T09:11:20.276 INFO:tasks.workunit.client.0.smithi117.stdout:5/840: creat d2/d3/de/d1e/d66/f114 x:0 0 0 2024-04-12T09:11:20.279 INFO:tasks.workunit.client.0.smithi117.stdout:8/785: truncate db/d4b/fea 2466874 0 2024-04-12T09:11:20.281 INFO:tasks.workunit.client.0.smithi117.stdout:4/767: dwrite d0/d2c/d67/f90 [0,4194304] 0 2024-04-12T09:11:20.282 INFO:tasks.workunit.client.0.smithi117.stdout:2/688: creat d0/d43/da5/d8f/dc2/fe5 x:0 0 0 2024-04-12T09:11:20.284 INFO:tasks.workunit.client.0.smithi117.stdout:7/637: creat d0/fc3 x:0 0 0 2024-04-12T09:11:20.285 INFO:tasks.workunit.client.0.smithi117.stdout:7/638: dread - d0/d2/d45/d17/d23/d39/dbd/fbf zero size 2024-04-12T09:11:20.286 INFO:tasks.workunit.client.0.smithi117.stdout:0/901: fsync d3/f4d 0 2024-04-12T09:11:20.361 INFO:tasks.workunit.client.0.smithi117.stdout:0/902: creat d3/da2/dee/d76/d83/da8/f129 x:0 0 0 2024-04-12T09:11:20.365 INFO:tasks.workunit.client.0.smithi117.stdout:2/689: mkdir d0/de6 0 2024-04-12T09:11:20.367 INFO:tasks.workunit.client.0.smithi117.stdout:7/639: symlink d0/d2/d45/d17/d23/d39/d6c/lc4 0 2024-04-12T09:11:20.368 INFO:tasks.workunit.client.0.smithi117.stdout:7/640: dread - d0/d2/d1a/d4f/fa2 zero size 2024-04-12T09:11:20.368 INFO:tasks.workunit.client.0.smithi117.stdout:7/641: chown d0 6422 1 2024-04-12T09:11:20.368 INFO:tasks.workunit.client.0.smithi117.stdout:7/642: chown d0/d13 426388 1 2024-04-12T09:11:20.373 INFO:tasks.workunit.client.0.smithi117.stdout:8/786: rename db/d19/d1a/d3d/ffd to db/d13/f105 0 2024-04-12T09:11:20.375 INFO:tasks.workunit.client.0.smithi117.stdout:2/690: creat d0/d43/d53/d61/d66/fe7 x:0 0 0 2024-04-12T09:11:20.376 INFO:tasks.workunit.client.0.smithi117.stdout:5/841: write d2/d3/de/d1e/d35/fb4 [1018251,46910] 0 2024-04-12T09:11:20.378 INFO:tasks.workunit.client.0.smithi117.stdout:7/643: mknod d0/d2/d1a/d49/cc5 0 2024-04-12T09:11:20.386 INFO:tasks.workunit.client.0.smithi117.stdout:8/787: mknod db/d13/d38/dc3/d9d/dc9/c106 0 2024-04-12T09:11:20.390 INFO:tasks.workunit.client.0.smithi117.stdout:2/691: mknod d0/ce8 0 2024-04-12T09:11:20.390 INFO:tasks.workunit.client.0.smithi117.stdout:0/903: write d3/d30/dc8/d10d/dab/fc4 [19597,16937] 0 2024-04-12T09:11:20.398 INFO:tasks.workunit.client.0.smithi117.stdout:2/692: symlink d0/d43/le9 0 2024-04-12T09:11:20.400 INFO:tasks.workunit.client.1.smithi203.stdout:4/71: mknod c16 0 2024-04-12T09:11:20.400 INFO:tasks.workunit.client.1.smithi203.stdout:4/72: chown fb 1723 1 2024-04-12T09:11:20.401 INFO:tasks.workunit.client.0.smithi117.stdout:0/904: creat d3/ddd/f12a x:0 0 0 2024-04-12T09:11:20.404 INFO:tasks.workunit.client.1.smithi203.stdout:6/59: rename d1/f9 to d1/d3/f13 0 2024-04-12T09:11:20.406 INFO:tasks.workunit.client.1.smithi203.stdout:9/66: readlink l2 0 2024-04-12T09:11:20.407 INFO:tasks.workunit.client.1.smithi203.stdout:9/67: write d8/ff [765339,73764] 0 2024-04-12T09:11:20.407 INFO:tasks.workunit.client.1.smithi203.stdout:5/156: mknod d0/d6/d16/d8/c3c 0 2024-04-12T09:11:20.409 INFO:tasks.workunit.client.1.smithi203.stdout:5/157: write d0/d6/d11/d18/f3b [79857,71491] 0 2024-04-12T09:11:20.410 INFO:tasks.workunit.client.1.smithi203.stdout:7/81: rmdir d0/d4 39 2024-04-12T09:11:20.414 INFO:tasks.workunit.client.1.smithi203.stdout:3/55: symlink d2/le 0 2024-04-12T09:11:20.414 INFO:tasks.workunit.client.1.smithi203.stdout:2/82: link d0/l12 d0/l1f 0 2024-04-12T09:11:20.416 INFO:tasks.workunit.client.1.smithi203.stdout:3/56: truncate d2/fc 335960 0 2024-04-12T09:11:20.416 INFO:tasks.workunit.client.1.smithi203.stdout:0/129: creat d0/f2c x:0 0 0 2024-04-12T09:11:20.416 INFO:tasks.workunit.client.1.smithi203.stdout:2/83: read - d0/d3/f16 zero size 2024-04-12T09:11:20.416 INFO:tasks.workunit.client.1.smithi203.stdout:1/89: link l8 df/l1f 0 2024-04-12T09:11:20.418 INFO:tasks.workunit.client.1.smithi203.stdout:4/73: chown c13 447 1 2024-04-12T09:11:20.418 INFO:tasks.workunit.client.1.smithi203.stdout:8/50: dwrite d4/d8/fd [0,4194304] 0 2024-04-12T09:11:20.420 INFO:tasks.workunit.client.1.smithi203.stdout:8/51: readlink d4/lf 0 2024-04-12T09:11:20.425 INFO:tasks.workunit.client.1.smithi203.stdout:5/158: mknod d0/d6/d16/d9/d29/c3d 0 2024-04-12T09:11:20.425 INFO:tasks.workunit.client.1.smithi203.stdout:0/130: write d0/d9/d17/f6 [3805926,109758] 0 2024-04-12T09:11:20.426 INFO:tasks.workunit.client.1.smithi203.stdout:1/90: rmdir df 39 2024-04-12T09:11:20.428 INFO:tasks.workunit.client.1.smithi203.stdout:7/82: fdatasync d0/d4/f17 0 2024-04-12T09:11:20.436 INFO:tasks.workunit.client.1.smithi203.stdout:3/57: dwrite d2/f4 [0,4194304] 0 2024-04-12T09:11:20.438 INFO:tasks.workunit.client.1.smithi203.stdout:2/84: dwrite d0/d3/fd [0,4194304] 0 2024-04-12T09:11:20.439 INFO:tasks.workunit.client.1.smithi203.stdout:5/159: stat d0/d6/d11/d18/d1a/d23/c26 0 2024-04-12T09:11:20.441 INFO:tasks.workunit.client.1.smithi203.stdout:1/91: mkdir df/d20 0 2024-04-12T09:11:20.443 INFO:tasks.workunit.client.1.smithi203.stdout:7/83: chown d0/c10 3442542 1 2024-04-12T09:11:20.443 INFO:tasks.workunit.client.1.smithi203.stdout:8/52: getdents d4 0 2024-04-12T09:11:20.444 INFO:tasks.workunit.client.1.smithi203.stdout:6/60: dwrite d1/d3/f13 [0,4194304] 0 2024-04-12T09:11:20.445 INFO:tasks.workunit.client.1.smithi203.stdout:1/92: stat df/f15 0 2024-04-12T09:11:20.448 INFO:tasks.workunit.client.1.smithi203.stdout:0/131: rename d0/d9/d17/f6 to d0/dd/f2d 0 2024-04-12T09:11:20.449 INFO:tasks.workunit.client.1.smithi203.stdout:3/58: symlink d2/d8/lf 0 2024-04-12T09:11:20.449 INFO:tasks.workunit.client.1.smithi203.stdout:9/68: dwrite d8/fa [0,4194304] 0 2024-04-12T09:11:20.449 INFO:tasks.workunit.client.1.smithi203.stdout:7/84: chown d0/f7 181 1 2024-04-12T09:11:20.450 INFO:tasks.workunit.client.1.smithi203.stdout:5/160: creat d0/d6/d16/d9/d30/f3e x:0 0 0 2024-04-12T09:11:20.451 INFO:tasks.workunit.client.1.smithi203.stdout:6/61: readlink d1/d3/d4/lb 0 2024-04-12T09:11:20.451 INFO:tasks.workunit.client.1.smithi203.stdout:2/85: symlink d0/d14/l20 0 2024-04-12T09:11:20.458 INFO:tasks.workunit.client.1.smithi203.stdout:7/85: creat d0/d15/f19 x:0 0 0 2024-04-12T09:11:20.459 INFO:tasks.workunit.client.1.smithi203.stdout:2/86: chown d0/d3/ce 3080 1 2024-04-12T09:11:20.459 INFO:tasks.workunit.client.1.smithi203.stdout:3/59: rename d2/c9 to d2/c10 0 2024-04-12T09:11:20.459 INFO:tasks.workunit.client.1.smithi203.stdout:9/69: symlink d8/l1e 0 2024-04-12T09:11:20.465 INFO:tasks.workunit.client.1.smithi203.stdout:2/87: dread - d0/d3/f8 zero size 2024-04-12T09:11:20.467 INFO:tasks.workunit.client.1.smithi203.stdout:1/93: dread df/f1d [0,4194304] 0 2024-04-12T09:11:20.469 INFO:tasks.workunit.client.1.smithi203.stdout:8/53: dread d4/d8/fd [0,4194304] 0 2024-04-12T09:11:20.472 INFO:tasks.workunit.client.1.smithi203.stdout:7/86: dread d0/f2 [4194304,4194304] 0 2024-04-12T09:11:20.472 INFO:tasks.workunit.client.1.smithi203.stdout:1/94: unlink df/f15 0 2024-04-12T09:11:20.473 INFO:tasks.workunit.client.1.smithi203.stdout:0/132: dwrite d0/f13 [0,4194304] 0 2024-04-12T09:11:20.473 INFO:tasks.workunit.client.1.smithi203.stdout:2/88: mknod d0/c21 0 2024-04-12T09:11:20.476 INFO:tasks.workunit.client.1.smithi203.stdout:8/54: mknod d4/d8/c10 0 2024-04-12T09:11:20.480 INFO:tasks.workunit.client.1.smithi203.stdout:2/89: creat d0/d14/f22 x:0 0 0 2024-04-12T09:11:20.481 INFO:tasks.workunit.client.1.smithi203.stdout:1/95: creat df/d20/f21 x:0 0 0 2024-04-12T09:11:20.481 INFO:tasks.workunit.client.1.smithi203.stdout:3/60: dwrite d2/fc [0,4194304] 0 2024-04-12T09:11:20.481 INFO:tasks.workunit.client.1.smithi203.stdout:7/87: creat d0/f1a x:0 0 0 2024-04-12T09:11:20.482 INFO:tasks.workunit.client.1.smithi203.stdout:9/70: dwrite f3 [0,4194304] 0 2024-04-12T09:11:20.484 INFO:tasks.workunit.client.1.smithi203.stdout:7/88: read d0/f2 [533192,115515] 0 2024-04-12T09:11:20.485 INFO:tasks.workunit.client.1.smithi203.stdout:2/90: fdatasync d0/f18 0 2024-04-12T09:11:20.489 INFO:tasks.workunit.client.1.smithi203.stdout:7/89: mknod d0/d4/c1b 0 2024-04-12T09:11:20.491 INFO:tasks.workunit.client.1.smithi203.stdout:1/96: write df/f1d [1225005,49411] 0 2024-04-12T09:11:20.494 INFO:tasks.workunit.client.1.smithi203.stdout:9/71: creat d8/d12/d14/f1f x:0 0 0 2024-04-12T09:11:20.495 INFO:tasks.workunit.client.1.smithi203.stdout:7/90: mkdir d0/d4/d1c 0 2024-04-12T09:11:20.496 INFO:tasks.workunit.client.1.smithi203.stdout:3/61: link d2/c6 d2/c11 0 2024-04-12T09:11:20.496 INFO:tasks.workunit.client.1.smithi203.stdout:0/133: dread d0/dd/f2d [0,4194304] 0 2024-04-12T09:11:20.496 INFO:tasks.workunit.client.1.smithi203.stdout:1/97: truncate df/f1e 910205 0 2024-04-12T09:11:20.498 INFO:tasks.workunit.client.1.smithi203.stdout:2/91: rename d0/d1b to d0/d14/d23 0 2024-04-12T09:11:20.498 INFO:tasks.workunit.client.1.smithi203.stdout:9/72: dread - d8/d12/d14/f1c zero size 2024-04-12T09:11:20.499 INFO:tasks.workunit.client.1.smithi203.stdout:1/98: fsync df/f16 0 2024-04-12T09:11:20.499 INFO:tasks.workunit.client.1.smithi203.stdout:8/55: dwrite d4/d8/fd [4194304,4194304] 0 2024-04-12T09:11:20.500 INFO:tasks.workunit.client.1.smithi203.stdout:7/91: truncate d0/d4/fe 4483670 0 2024-04-12T09:11:20.501 INFO:tasks.workunit.client.1.smithi203.stdout:2/92: write d0/d14/f22 [855646,116262] 0 2024-04-12T09:11:20.503 INFO:tasks.workunit.client.1.smithi203.stdout:0/134: write d0/d9/d17/d19/f26 [250792,73308] 0 2024-04-12T09:11:20.503 INFO:tasks.workunit.client.1.smithi203.stdout:1/99: mknod df/d20/c22 0 2024-04-12T09:11:20.504 INFO:tasks.workunit.client.1.smithi203.stdout:8/56: mknod d4/c11 0 2024-04-12T09:11:20.506 INFO:tasks.workunit.client.1.smithi203.stdout:8/57: chown d4/c11 3638 1 2024-04-12T09:11:20.508 INFO:tasks.workunit.client.1.smithi203.stdout:2/93: symlink d0/d14/l24 0 2024-04-12T09:11:20.509 INFO:tasks.workunit.client.1.smithi203.stdout:7/92: mknod d0/c1d 0 2024-04-12T09:11:20.515 INFO:tasks.workunit.client.1.smithi203.stdout:5/161: dwrite d0/d6/d16/d9/f24 [0,4194304] 0 2024-04-12T09:11:20.516 INFO:tasks.workunit.client.1.smithi203.stdout:6/62: truncate d1/df/f11 449970 0 2024-04-12T09:11:20.518 INFO:tasks.workunit.client.1.smithi203.stdout:2/94: truncate d0/d3/f16 943959 0 2024-04-12T09:11:20.519 INFO:tasks.workunit.client.1.smithi203.stdout:9/73: link l2 d8/d12/l20 0 2024-04-12T09:11:20.519 INFO:tasks.workunit.client.1.smithi203.stdout:3/62: getdents d2/d8 0 2024-04-12T09:11:20.521 INFO:tasks.workunit.client.1.smithi203.stdout:6/63: symlink d1/d3/l14 0 2024-04-12T09:11:20.523 INFO:tasks.workunit.client.1.smithi203.stdout:7/93: rename d0/c1d to d0/d4/d1c/c1e 0 2024-04-12T09:11:20.523 INFO:tasks.workunit.client.1.smithi203.stdout:0/135: dwrite d0/d9/d17/d19/f26 [0,4194304] 0 2024-04-12T09:11:20.524 INFO:tasks.workunit.client.1.smithi203.stdout:5/162: dread d0/d6/d16/d9/f2e [0,4194304] 0 2024-04-12T09:11:20.524 INFO:tasks.workunit.client.0.smithi117.stdout:8/788: dread db/d1b/f34 [4194304,4194304] 0 2024-04-12T09:11:20.527 INFO:tasks.workunit.client.0.smithi117.stdout:5/842: dwrite d2/d3/dd/d39/d83/d4d/d52/f70 [0,4194304] 0 2024-04-12T09:11:20.529 INFO:tasks.workunit.client.1.smithi203.stdout:3/63: mknod d2/c12 0 2024-04-12T09:11:20.531 INFO:tasks.workunit.client.0.smithi117.stdout:8/789: dread db/d19/f8d [0,4194304] 0 2024-04-12T09:11:20.531 INFO:tasks.workunit.client.0.smithi117.stdout:2/693: link d0/d43/d30/d41/f5b d0/d43/d30/dc6/fea 0 2024-04-12T09:11:20.532 INFO:tasks.workunit.client.1.smithi203.stdout:6/64: dread d1/d3/f13 [0,4194304] 0 2024-04-12T09:11:20.535 INFO:tasks.workunit.client.0.smithi117.stdout:8/790: dread db/d13/d38/ff3 [0,4194304] 0 2024-04-12T09:11:20.537 INFO:tasks.workunit.client.1.smithi203.stdout:5/163: dwrite d0/d6/d16/d9/d30/f3e [0,4194304] 0 2024-04-12T09:11:20.538 INFO:tasks.workunit.client.1.smithi203.stdout:2/95: rename d0/d3/lb to d0/d19/l25 0 2024-04-12T09:11:20.540 INFO:tasks.workunit.client.1.smithi203.stdout:1/100: truncate f3 7685257 0 2024-04-12T09:11:20.541 INFO:tasks.workunit.client.1.smithi203.stdout:5/164: write d0/d6/d16/d9/d30/f3e [248415,73986] 0 2024-04-12T09:11:20.541 INFO:tasks.workunit.client.1.smithi203.stdout:9/74: mkdir d8/d21 0 2024-04-12T09:11:20.541 INFO:tasks.workunit.client.1.smithi203.stdout:8/58: truncate f3 2853084 0 2024-04-12T09:11:20.542 INFO:tasks.workunit.client.1.smithi203.stdout:9/75: dread - d8/d12/d14/f1f zero size 2024-04-12T09:11:20.543 INFO:tasks.workunit.client.1.smithi203.stdout:7/94: rmdir d0/d4 39 2024-04-12T09:11:20.545 INFO:tasks.workunit.client.0.smithi117.stdout:8/791: rename db/d1b/d62/dae/faf to db/d1b/d62/dae/f107 0 2024-04-12T09:11:20.546 INFO:tasks.workunit.client.0.smithi117.stdout:5/843: creat d2/d3/de/da8/f115 x:0 0 0 2024-04-12T09:11:20.547 INFO:tasks.workunit.client.0.smithi117.stdout:8/792: truncate db/d1b/d62/f66 4270469 0 2024-04-12T09:11:20.548 INFO:tasks.workunit.client.1.smithi203.stdout:3/64: chown d2/c6 1646 1 2024-04-12T09:11:20.549 INFO:tasks.workunit.client.0.smithi117.stdout:2/694: symlink d0/d43/d4b/dae/dd5/leb 0 2024-04-12T09:11:20.551 INFO:tasks.workunit.client.1.smithi203.stdout:3/65: read d2/fa [4284869,89884] 0 2024-04-12T09:11:20.552 INFO:tasks.workunit.client.1.smithi203.stdout:6/65: creat d1/d3/f15 x:0 0 0 2024-04-12T09:11:20.553 INFO:tasks.workunit.client.1.smithi203.stdout:3/66: write d2/fc [2627637,49413] 0 2024-04-12T09:11:20.555 INFO:tasks.workunit.client.1.smithi203.stdout:1/101: rmdir df 39 2024-04-12T09:11:20.557 INFO:tasks.workunit.client.0.smithi117.stdout:5/844: creat d2/d3/de/d1e/d66/dbe/d105/f116 x:0 0 0 2024-04-12T09:11:20.557 INFO:tasks.workunit.client.1.smithi203.stdout:3/67: dread d2/fa [0,4194304] 0 2024-04-12T09:11:20.560 INFO:tasks.workunit.client.0.smithi117.stdout:0/905: write d3/da2/dee/dd5/dff/d84/dc2/ffb [3937373,43573] 0 2024-04-12T09:11:20.567 INFO:tasks.workunit.client.1.smithi203.stdout:3/68: dwrite d2/fa [0,4194304] 0 2024-04-12T09:11:20.572 INFO:tasks.workunit.client.1.smithi203.stdout:7/95: dwrite d0/d4/f16 [0,4194304] 0 2024-04-12T09:11:20.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:20 smithi203 ceph-mon[36428]: pgmap v20: 65 pgs: 65 active+clean; 1.6 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 53 MiB/s rd, 127 MiB/s wr, 376 op/s 2024-04-12T09:11:20.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:20 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:20.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:20 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:20.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:20 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:11:20.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:20 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:11:20.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:20 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:11:20.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:20 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:11:20.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:20 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:11:20.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:20 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:11:20.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:20 smithi203 ceph-mon[36428]: Adjusting osd_memory_target on smithi117 to 1557M 2024-04-12T09:11:20.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:20 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:20.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:20 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:11:20.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:20 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:11:20.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:20 smithi203 ceph-mon[36428]: Updating smithi117:/etc/ceph/ceph.conf 2024-04-12T09:11:20.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:20 smithi203 ceph-mon[36428]: Updating smithi203:/etc/ceph/ceph.conf 2024-04-12T09:11:20.577 INFO:tasks.workunit.client.1.smithi203.stdout:3/69: dwrite d2/f4 [4194304,4194304] 0 2024-04-12T09:11:20.584 INFO:tasks.workunit.client.1.smithi203.stdout:6/66: creat d1/f16 x:0 0 0 2024-04-12T09:11:20.585 INFO:tasks.workunit.client.0.smithi117.stdout:5/845: getdents d2/d3/de/d1e/d46/d96 0 2024-04-12T09:11:20.586 INFO:tasks.workunit.client.1.smithi203.stdout:3/70: dwrite d2/f4 [0,4194304] 0 2024-04-12T09:11:20.588 INFO:tasks.workunit.client.1.smithi203.stdout:2/96: getdents d0/d14/d23 0 2024-04-12T09:11:20.588 INFO:tasks.workunit.client.1.smithi203.stdout:2/97: readlink d0/d14/l1d 0 2024-04-12T09:11:20.591 INFO:tasks.workunit.client.1.smithi203.stdout:2/98: dread d0/d3/f16 [0,4194304] 0 2024-04-12T09:11:20.592 INFO:tasks.workunit.client.1.smithi203.stdout:2/99: chown d0/d3/f10 619 1 2024-04-12T09:11:20.594 INFO:tasks.workunit.client.1.smithi203.stdout:5/165: fsync d0/d6/d11/d18/d2a/f2b 0 2024-04-12T09:11:20.596 INFO:tasks.workunit.client.1.smithi203.stdout:2/100: dread d0/d3/f10 [0,4194304] 0 2024-04-12T09:11:20.600 INFO:tasks.workunit.client.0.smithi117.stdout:8/793: dwrite db/d13/d38/f48 [0,4194304] 0 2024-04-12T09:11:20.603 INFO:tasks.workunit.client.0.smithi117.stdout:8/794: chown db/d19/ldc 12 1 2024-04-12T09:11:20.603 INFO:tasks.workunit.client.1.smithi203.stdout:7/96: creat d0/d4/d1c/f1f x:0 0 0 2024-04-12T09:11:20.605 INFO:tasks.workunit.client.1.smithi203.stdout:6/67: rename d1/d3/d4 to d1/d3/d4/d17 22 2024-04-12T09:11:20.606 INFO:tasks.workunit.client.0.smithi117.stdout:2/695: dwrite d0/f73 [0,4194304] 0 2024-04-12T09:11:20.610 INFO:tasks.workunit.client.1.smithi203.stdout:3/71: rename d2/f4 to d2/f13 0 2024-04-12T09:11:20.611 INFO:tasks.workunit.client.1.smithi203.stdout:8/59: dwrite d4/d8/fc [0,4194304] 0 2024-04-12T09:11:20.611 INFO:tasks.workunit.client.0.smithi117.stdout:8/795: mkdir db/d19/d1a/d3d/d9c/d108 0 2024-04-12T09:11:20.618 INFO:tasks.workunit.client.0.smithi117.stdout:0/906: dwrite d3/d47/fd9 [0,4194304] 0 2024-04-12T09:11:20.619 INFO:tasks.workunit.client.1.smithi203.stdout:1/102: dread df/f17 [0,4194304] 0 2024-04-12T09:11:20.620 INFO:tasks.workunit.client.0.smithi117.stdout:5/846: dread d2/f36 [0,4194304] 0 2024-04-12T09:11:20.620 INFO:tasks.workunit.client.0.smithi117.stdout:8/796: read db/d13/f4d [2084622,108587] 0 2024-04-12T09:11:20.621 INFO:tasks.workunit.client.1.smithi203.stdout:5/166: unlink d0/d6/d11/d18/f1c 0 2024-04-12T09:11:20.622 INFO:tasks.workunit.client.1.smithi203.stdout:3/72: dwrite d2/fd [0,4194304] 0 2024-04-12T09:11:20.622 INFO:tasks.workunit.client.0.smithi117.stdout:5/847: chown d2/d3/de/fc0 1524939978 1 2024-04-12T09:11:20.623 INFO:tasks.workunit.client.1.smithi203.stdout:5/167: chown d0/d6/d11/d18/f32 234796 1 2024-04-12T09:11:20.624 INFO:tasks.workunit.client.1.smithi203.stdout:0/136: getdents d0/d9/d17 0 2024-04-12T09:11:20.625 INFO:tasks.workunit.client.0.smithi117.stdout:5/848: fdatasync d2/d3/de/d1e/d66/f114 0 2024-04-12T09:11:20.625 INFO:tasks.workunit.client.0.smithi117.stdout:8/797: truncate db/d13/d38/fbf 499767 0 2024-04-12T09:11:20.626 INFO:tasks.workunit.client.0.smithi117.stdout:8/798: stat db/d77/f76 0 2024-04-12T09:11:20.631 INFO:tasks.workunit.client.1.smithi203.stdout:5/168: dwrite d0/d6/d16/d9/f24 [0,4194304] 0 2024-04-12T09:11:20.633 INFO:tasks.workunit.client.0.smithi117.stdout:5/849: rmdir d2/d3/de/d1e/d35 39 2024-04-12T09:11:20.633 INFO:tasks.workunit.client.1.smithi203.stdout:5/169: dread d0/f35 [0,4194304] 0 2024-04-12T09:11:20.634 INFO:tasks.workunit.client.0.smithi117.stdout:9/704: sync 2024-04-12T09:11:20.634 INFO:tasks.workunit.client.0.smithi117.stdout:1/766: sync 2024-04-12T09:11:20.634 INFO:tasks.workunit.client.0.smithi117.stdout:4/768: sync 2024-04-12T09:11:20.634 INFO:tasks.workunit.client.0.smithi117.stdout:6/759: sync 2024-04-12T09:11:20.635 INFO:tasks.workunit.client.1.smithi203.stdout:5/170: chown d0/d6/d11/c17 82746 1 2024-04-12T09:11:20.635 INFO:tasks.workunit.client.1.smithi203.stdout:7/97: creat d0/d15/f20 x:0 0 0 2024-04-12T09:11:20.644 INFO:tasks.workunit.client.1.smithi203.stdout:8/60: creat d4/d8/f12 x:0 0 0 2024-04-12T09:11:20.648 INFO:tasks.workunit.client.0.smithi117.stdout:2/696: dwrite d0/d43/d53/f6f [0,4194304] 0 2024-04-12T09:11:20.648 INFO:tasks.workunit.client.0.smithi117.stdout:4/769: creat d0/d5/d39/d4e/d51/ff9 x:0 0 0 2024-04-12T09:11:20.649 INFO:tasks.workunit.client.0.smithi117.stdout:6/760: dwrite d8/d9/fb [0,4194304] 0 2024-04-12T09:11:20.649 INFO:tasks.workunit.client.0.smithi117.stdout:9/705: mkdir d1/d8/de2 0 2024-04-12T09:11:20.650 INFO:tasks.workunit.client.1.smithi203.stdout:8/61: dwrite d4/d8/f12 [0,4194304] 0 2024-04-12T09:11:20.651 INFO:tasks.workunit.client.1.smithi203.stdout:8/62: chown d4/c11 6279413 1 2024-04-12T09:11:20.652 INFO:tasks.workunit.client.1.smithi203.stdout:8/63: read d4/f9 [2282022,36664] 0 2024-04-12T09:11:20.653 INFO:tasks.workunit.client.1.smithi203.stdout:8/64: fsync d4/f9 0 2024-04-12T09:11:20.653 INFO:tasks.workunit.client.0.smithi117.stdout:1/767: mknod d1/dc3/cef 0 2024-04-12T09:11:20.656 INFO:tasks.workunit.client.1.smithi203.stdout:4/74: sync 2024-04-12T09:11:20.656 INFO:tasks.workunit.client.1.smithi203.stdout:3/73: mkdir d2/d8/d14 0 2024-04-12T09:11:20.657 INFO:tasks.workunit.client.1.smithi203.stdout:2/101: symlink d0/l26 0 2024-04-12T09:11:20.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:20 smithi117 ceph-mon[29277]: pgmap v20: 65 pgs: 65 active+clean; 1.6 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 53 MiB/s rd, 127 MiB/s wr, 376 op/s 2024-04-12T09:11:20.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:20 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:20.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:20 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:20.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:20 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:11:20.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:20 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:11:20.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:20 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:11:20.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:20 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:11:20.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:20 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:11:20.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:20 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-12T09:11:20.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:20 smithi117 ceph-mon[29277]: Adjusting osd_memory_target on smithi117 to 1557M 2024-04-12T09:11:20.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:20 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:20.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:20 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:11:20.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:20 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:11:20.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:20 smithi117 ceph-mon[29277]: Updating smithi117:/etc/ceph/ceph.conf 2024-04-12T09:11:20.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:20 smithi117 ceph-mon[29277]: Updating smithi203:/etc/ceph/ceph.conf 2024-04-12T09:11:20.662 INFO:tasks.workunit.client.1.smithi203.stdout:8/65: dwrite d4/f9 [0,4194304] 0 2024-04-12T09:11:20.664 INFO:tasks.workunit.client.1.smithi203.stdout:7/98: fsync d0/d15/f20 0 2024-04-12T09:11:20.665 INFO:tasks.workunit.client.1.smithi203.stdout:5/171: creat d0/d6/d11/d18/d1a/f3f x:0 0 0 2024-04-12T09:11:20.669 INFO:tasks.workunit.client.0.smithi117.stdout:9/706: unlink d1/d23/l54 0 2024-04-12T09:11:20.672 INFO:tasks.workunit.client.0.smithi117.stdout:0/907: dwrite d3/da2/dee/dd5/dff/d91/d94/d5a/f82 [0,4194304] 0 2024-04-12T09:11:20.673 INFO:tasks.workunit.client.1.smithi203.stdout:6/68: truncate d1/df/f11 43939 0 2024-04-12T09:11:20.674 INFO:tasks.workunit.client.0.smithi117.stdout:0/908: chown d3/da2/dee/d76/lbd 68736 1 2024-04-12T09:11:20.674 INFO:tasks.workunit.client.1.smithi203.stdout:6/69: chown d1/d3/c6 44 1 2024-04-12T09:11:20.678 INFO:tasks.workunit.client.0.smithi117.stdout:8/799: getdents db 0 2024-04-12T09:11:20.682 INFO:tasks.workunit.client.1.smithi203.stdout:4/75: symlink l17 0 2024-04-12T09:11:20.682 INFO:tasks.workunit.client.0.smithi117.stdout:4/770: getdents d0/d5/d3b/dd6 0 2024-04-12T09:11:20.683 INFO:tasks.workunit.client.1.smithi203.stdout:4/76: chown c13 942 1 2024-04-12T09:11:20.684 INFO:tasks.workunit.client.1.smithi203.stdout:3/74: mknod d2/d8/c15 0 2024-04-12T09:11:20.686 INFO:tasks.workunit.client.1.smithi203.stdout:2/102: mknod d0/d14/c27 0 2024-04-12T09:11:20.689 INFO:tasks.workunit.client.0.smithi117.stdout:0/909: mknod d3/da2/dee/c12b 0 2024-04-12T09:11:20.691 INFO:tasks.workunit.client.1.smithi203.stdout:1/103: fdatasync f3 0 2024-04-12T09:11:20.694 INFO:tasks.workunit.client.1.smithi203.stdout:7/99: symlink d0/d15/l21 0 2024-04-12T09:11:20.694 INFO:tasks.workunit.client.0.smithi117.stdout:0/910: dread d3/dc/f1d [0,4194304] 0 2024-04-12T09:11:20.694 INFO:tasks.workunit.client.0.smithi117.stdout:5/850: link d2/d3/dd/d39/d83/d4d/cc9 d2/d3/de/c117 0 2024-04-12T09:11:20.699 INFO:tasks.workunit.client.0.smithi117.stdout:6/761: unlink d8/d2a/d60/fef 0 2024-04-12T09:11:20.700 INFO:tasks.workunit.client.0.smithi117.stdout:1/768: dwrite d1/dbd/d3f/db/f39 [0,4194304] 0 2024-04-12T09:11:20.700 INFO:tasks.workunit.client.1.smithi203.stdout:9/76: sync 2024-04-12T09:11:20.704 INFO:tasks.workunit.client.0.smithi117.stdout:4/771: creat d0/d1/d34/ffa x:0 0 0 2024-04-12T09:11:20.705 INFO:tasks.workunit.client.0.smithi117.stdout:0/911: dread d3/da2/dee/d76/d83/da8/d97/dc9/dd2/f42 [0,4194304] 0 2024-04-12T09:11:20.706 INFO:tasks.workunit.client.0.smithi117.stdout:0/912: fdatasync d3/da2/dee/d76/db3/fce 0 2024-04-12T09:11:20.711 INFO:tasks.workunit.client.0.smithi117.stdout:8/800: mknod db/d1b/d62/df0/c109 0 2024-04-12T09:11:20.712 INFO:tasks.workunit.client.1.smithi203.stdout:9/77: dwrite d8/d12/f19 [0,4194304] 0 2024-04-12T09:11:20.712 INFO:tasks.workunit.client.0.smithi117.stdout:5/851: fdatasync d2/d3/dd/fb9 0 2024-04-12T09:11:20.714 INFO:tasks.workunit.client.1.smithi203.stdout:0/137: link d0/dd/l22 d0/d9/d17/d19/l2e 0 2024-04-12T09:11:20.717 INFO:tasks.workunit.client.1.smithi203.stdout:0/138: dread - d0/f2c zero size 2024-04-12T09:11:20.719 INFO:tasks.workunit.client.1.smithi203.stdout:4/77: write fc [567851,51367] 0 2024-04-12T09:11:20.720 INFO:tasks.workunit.client.1.smithi203.stdout:4/78: stat c16 0 2024-04-12T09:11:20.720 INFO:tasks.workunit.client.1.smithi203.stdout:4/79: rmdir - no directory 2024-04-12T09:11:20.720 INFO:tasks.workunit.client.1.smithi203.stdout:1/104: write f4 [268056,126543] 0 2024-04-12T09:11:20.722 INFO:tasks.workunit.client.0.smithi117.stdout:4/772: rmdir d0/d5/d39/d4e 39 2024-04-12T09:11:20.722 INFO:tasks.workunit.client.1.smithi203.stdout:9/78: dwrite d8/f10 [0,4194304] 0 2024-04-12T09:11:20.722 INFO:tasks.workunit.client.1.smithi203.stdout:4/80: truncate fc 860938 0 2024-04-12T09:11:20.724 INFO:tasks.workunit.client.0.smithi117.stdout:2/697: getdents d0/d43/da5/d8f 0 2024-04-12T09:11:20.724 INFO:tasks.workunit.client.1.smithi203.stdout:6/70: dwrite d1/d3/f13 [0,4194304] 0 2024-04-12T09:11:20.728 INFO:tasks.workunit.client.0.smithi117.stdout:8/801: symlink db/d13/d38/dc3/l10a 0 2024-04-12T09:11:20.729 INFO:tasks.workunit.client.1.smithi203.stdout:2/103: symlink d0/l28 0 2024-04-12T09:11:20.730 INFO:tasks.workunit.client.1.smithi203.stdout:9/79: dread d8/fa [0,4194304] 0 2024-04-12T09:11:20.733 INFO:tasks.workunit.client.0.smithi117.stdout:4/773: rmdir d0/db3/da7/dcd 39 2024-04-12T09:11:20.737 INFO:tasks.workunit.client.1.smithi203.stdout:1/105: symlink df/l23 0 2024-04-12T09:11:20.738 INFO:tasks.workunit.client.0.smithi117.stdout:1/769: dread d1/d96/fa0 [0,4194304] 0 2024-04-12T09:11:20.739 INFO:tasks.workunit.client.0.smithi117.stdout:2/698: mkdir d0/d43/d30/dec 0 2024-04-12T09:11:20.740 INFO:tasks.workunit.client.0.smithi117.stdout:2/699: chown d0/d43/l8c 46 1 2024-04-12T09:11:20.741 INFO:tasks.workunit.client.0.smithi117.stdout:2/700: chown d0/l1c 41026 1 2024-04-12T09:11:20.741 INFO:tasks.workunit.client.1.smithi203.stdout:5/172: rename d0/d6/d16/d9/d30/f3e to d0/d6/d11/d18/f40 0 2024-04-12T09:11:20.742 INFO:tasks.workunit.client.1.smithi203.stdout:5/173: read d0/f35 [129227,55825] 0 2024-04-12T09:11:20.743 INFO:tasks.workunit.client.1.smithi203.stdout:3/75: truncate d2/fd 539767 0 2024-04-12T09:11:20.744 INFO:tasks.workunit.client.0.smithi117.stdout:8/802: mknod db/d19/c10b 0 2024-04-12T09:11:20.748 INFO:tasks.workunit.client.1.smithi203.stdout:6/71: creat d1/df/f18 x:0 0 0 2024-04-12T09:11:20.748 INFO:tasks.workunit.client.1.smithi203.stdout:6/72: dread - d1/f16 zero size 2024-04-12T09:11:20.749 INFO:tasks.workunit.client.0.smithi117.stdout:4/774: symlink d0/d1/lfb 0 2024-04-12T09:11:20.749 INFO:tasks.workunit.client.1.smithi203.stdout:6/73: dread - d1/f16 zero size 2024-04-12T09:11:20.750 INFO:tasks.workunit.client.1.smithi203.stdout:2/104: creat d0/d3/f29 x:0 0 0 2024-04-12T09:11:20.750 INFO:tasks.workunit.client.1.smithi203.stdout:6/74: truncate d1/df/f18 325931 0 2024-04-12T09:11:20.750 INFO:tasks.workunit.client.0.smithi117.stdout:6/762: truncate f3 6036918 0 2024-04-12T09:11:20.750 INFO:tasks.workunit.client.1.smithi203.stdout:6/75: chown d1/d3/cd 28 1 2024-04-12T09:11:20.751 INFO:tasks.workunit.client.0.smithi117.stdout:0/913: link d3/dc/f8e d3/d30/f12c 0 2024-04-12T09:11:20.752 INFO:tasks.workunit.client.1.smithi203.stdout:9/80: rmdir d8/d12/d14 39 2024-04-12T09:11:20.754 INFO:tasks.workunit.client.1.smithi203.stdout:8/66: getdents d4/d8 0 2024-04-12T09:11:20.756 INFO:tasks.workunit.client.0.smithi117.stdout:2/701: rmdir d0/d43/d4b/dae 39 2024-04-12T09:11:20.757 INFO:tasks.workunit.client.1.smithi203.stdout:7/100: link d0/d4/c1b d0/d4/d1c/c22 0 2024-04-12T09:11:20.758 INFO:tasks.workunit.client.1.smithi203.stdout:8/67: dread d4/d8/f12 [0,4194304] 0 2024-04-12T09:11:20.758 INFO:tasks.workunit.client.1.smithi203.stdout:7/101: write d0/d15/f19 [462192,30068] 0 2024-04-12T09:11:20.758 INFO:tasks.workunit.client.1.smithi203.stdout:8/68: chown d4/c5 32625 1 2024-04-12T09:11:20.759 INFO:tasks.workunit.client.0.smithi117.stdout:8/803: creat db/d13/d38/dc3/f10c x:0 0 0 2024-04-12T09:11:20.759 INFO:tasks.workunit.client.0.smithi117.stdout:1/770: dread d1/fa3 [0,4194304] 0 2024-04-12T09:11:20.760 INFO:tasks.workunit.client.1.smithi203.stdout:1/106: symlink df/d20/l24 0 2024-04-12T09:11:20.762 INFO:tasks.workunit.client.1.smithi203.stdout:4/81: write fb [331405,28727] 0 2024-04-12T09:11:20.763 INFO:tasks.workunit.client.1.smithi203.stdout:4/82: chown fc 1466870 1 2024-04-12T09:11:20.766 INFO:tasks.workunit.client.1.smithi203.stdout:0/139: rename d0/d9 to d0/d1d/d2f 0 2024-04-12T09:11:20.767 INFO:tasks.workunit.client.1.smithi203.stdout:1/107: dwrite f4 [0,4194304] 0 2024-04-12T09:11:20.768 INFO:tasks.workunit.client.1.smithi203.stdout:1/108: chown lc 173843 1 2024-04-12T09:11:20.769 INFO:tasks.workunit.client.1.smithi203.stdout:5/174: mknod d0/d6/d11/d1e/c41 0 2024-04-12T09:11:20.769 INFO:tasks.workunit.client.1.smithi203.stdout:1/109: chown df/l11 1 1 2024-04-12T09:11:20.771 INFO:tasks.workunit.client.1.smithi203.stdout:1/110: fsync df/f19 0 2024-04-12T09:11:20.772 INFO:tasks.workunit.client.1.smithi203.stdout:4/83: dwrite fc [0,4194304] 0 2024-04-12T09:11:20.772 INFO:tasks.workunit.client.0.smithi117.stdout:5/852: dwrite d2/d3/de/fe9 [0,4194304] 0 2024-04-12T09:11:20.775 INFO:tasks.workunit.client.0.smithi117.stdout:2/702: dread - d0/d43/d53/f7b zero size 2024-04-12T09:11:20.777 INFO:tasks.workunit.client.0.smithi117.stdout:8/804: rename db/d1b/l12 to db/d13/d38/dc3/l10d 0 2024-04-12T09:11:20.777 INFO:tasks.workunit.client.1.smithi203.stdout:0/140: dread d0/f13 [0,4194304] 0 2024-04-12T09:11:20.778 INFO:tasks.workunit.client.1.smithi203.stdout:4/84: dread ff [0,4194304] 0 2024-04-12T09:11:20.781 INFO:tasks.workunit.client.1.smithi203.stdout:6/76: unlink d1/d3/f15 0 2024-04-12T09:11:20.781 INFO:tasks.workunit.client.1.smithi203.stdout:0/141: truncate d0/dd/f24 1019078 0 2024-04-12T09:11:20.783 INFO:tasks.workunit.client.1.smithi203.stdout:1/111: dwrite f3 [4194304,4194304] 0 2024-04-12T09:11:20.783 INFO:tasks.workunit.client.0.smithi117.stdout:6/763: symlink d8/d2a/d60/d7d/lf0 0 2024-04-12T09:11:20.785 INFO:tasks.workunit.client.0.smithi117.stdout:8/805: dwrite db/d19/fde [0,4194304] 0 2024-04-12T09:11:20.789 INFO:tasks.workunit.client.1.smithi203.stdout:8/69: creat d4/f13 x:0 0 0 2024-04-12T09:11:20.791 INFO:tasks.workunit.client.1.smithi203.stdout:7/102: write d0/d4/f11 [655615,8849] 0 2024-04-12T09:11:20.793 INFO:tasks.workunit.client.0.smithi117.stdout:5/853: fsync d2/f49 0 2024-04-12T09:11:20.795 INFO:tasks.workunit.client.0.smithi117.stdout:2/703: truncate d0/d43/d53/f7b 950274 0 2024-04-12T09:11:20.798 INFO:tasks.workunit.client.1.smithi203.stdout:3/76: mkdir d2/d8/d14/d16 0 2024-04-12T09:11:20.800 INFO:tasks.workunit.client.1.smithi203.stdout:5/175: creat d0/d6/d16/d9/d29/f42 x:0 0 0 2024-04-12T09:11:20.801 INFO:tasks.workunit.client.0.smithi117.stdout:4/775: creat d0/d5/d39/ffc x:0 0 0 2024-04-12T09:11:20.803 INFO:tasks.workunit.client.1.smithi203.stdout:2/105: mkdir d0/d14/d1e/d2a 0 2024-04-12T09:11:20.804 INFO:tasks.workunit.client.1.smithi203.stdout:3/77: dread d2/fc [0,4194304] 0 2024-04-12T09:11:20.805 INFO:tasks.workunit.client.0.smithi117.stdout:5/854: fdatasync d2/f36 0 2024-04-12T09:11:20.807 INFO:tasks.workunit.client.1.smithi203.stdout:5/176: dwrite d0/d6/d11/d18/f32 [0,4194304] 0 2024-04-12T09:11:20.808 INFO:tasks.workunit.client.0.smithi117.stdout:2/704: unlink d0/d43/d30/d41/l1f 0 2024-04-12T09:11:20.810 INFO:tasks.workunit.client.1.smithi203.stdout:9/81: symlink d8/l22 0 2024-04-12T09:11:20.813 INFO:tasks.workunit.client.1.smithi203.stdout:6/77: creat d1/df/f19 x:0 0 0 2024-04-12T09:11:20.814 INFO:tasks.workunit.client.1.smithi203.stdout:6/78: truncate d1/f16 80831 0 2024-04-12T09:11:20.814 INFO:tasks.workunit.client.1.smithi203.stdout:6/79: read d1/d3/f13 [2875660,70665] 0 2024-04-12T09:11:20.815 INFO:tasks.workunit.client.1.smithi203.stdout:0/142: mknod d0/d1d/d2f/d17/d19/c30 0 2024-04-12T09:11:20.816 INFO:tasks.workunit.client.1.smithi203.stdout:6/80: truncate d1/d3/f13 4654774 0 2024-04-12T09:11:20.816 INFO:tasks.workunit.client.1.smithi203.stdout:0/143: stat d0/d1d/d2f/d17/c8 0 2024-04-12T09:11:20.817 INFO:tasks.workunit.client.1.smithi203.stdout:6/81: fdatasync d1/d3/f13 0 2024-04-12T09:11:20.817 INFO:tasks.workunit.client.0.smithi117.stdout:0/914: truncate d3/da2/dee/dd5/dff/d91/d94/d5a/d62/d66/d73/f10b 1537941 0 2024-04-12T09:11:20.817 INFO:tasks.workunit.client.1.smithi203.stdout:6/82: fdatasync d1/f16 0 2024-04-12T09:11:20.818 INFO:tasks.workunit.client.1.smithi203.stdout:1/112: rename df/d20/l24 to df/d20/l25 0 2024-04-12T09:11:20.818 INFO:tasks.workunit.client.1.smithi203.stdout:6/83: write d1/d3/f13 [1824610,58327] 0 2024-04-12T09:11:20.819 INFO:tasks.workunit.client.1.smithi203.stdout:6/84: write d1/df/f19 [23186,58053] 0 2024-04-12T09:11:20.821 INFO:tasks.workunit.client.0.smithi117.stdout:5/855: write d2/d3/de/d1e/d35/fd4 [1600644,52451] 0 2024-04-12T09:11:20.821 INFO:tasks.workunit.client.0.smithi117.stdout:2/705: mknod d0/d43/da5/d8f/ced 0 2024-04-12T09:11:20.822 INFO:tasks.workunit.client.0.smithi117.stdout:6/764: link d8/d9/l7e d8/d3a/d49/da4/d9f/lf1 0 2024-04-12T09:11:20.823 INFO:tasks.workunit.client.1.smithi203.stdout:8/70: symlink d4/d8/l14 0 2024-04-12T09:11:20.824 INFO:tasks.workunit.client.1.smithi203.stdout:8/71: chown d4/le 3307 1 2024-04-12T09:11:20.824 INFO:tasks.workunit.client.1.smithi203.stdout:7/103: creat d0/d15/f23 x:0 0 0 2024-04-12T09:11:20.824 INFO:tasks.workunit.client.1.smithi203.stdout:8/72: dread - d4/f13 zero size 2024-04-12T09:11:20.825 INFO:tasks.workunit.client.1.smithi203.stdout:7/104: stat d0/d15/l21 0 2024-04-12T09:11:20.825 INFO:tasks.workunit.client.0.smithi117.stdout:0/915: mknod d3/da2/dee/d76/d83/da8/d97/dc9/c12d 0 2024-04-12T09:11:20.828 INFO:tasks.workunit.client.0.smithi117.stdout:5/856: read - d2/f92 zero size 2024-04-12T09:11:20.831 INFO:tasks.workunit.client.0.smithi117.stdout:6/765: fdatasync d8/d2a/d60/d89/fbb 0 2024-04-12T09:11:20.832 INFO:tasks.workunit.client.1.smithi203.stdout:2/106: stat d0/d3/l1c 0 2024-04-12T09:11:20.832 INFO:tasks.workunit.client.1.smithi203.stdout:2/107: stat d0 0 2024-04-12T09:11:20.833 INFO:tasks.workunit.client.0.smithi117.stdout:0/916: mknod d3/da2/dee/d76/d83/da8/d97/d104/c12e 0 2024-04-12T09:11:20.834 INFO:tasks.workunit.client.0.smithi117.stdout:2/706: mknod d0/df/de1/cee 0 2024-04-12T09:11:20.835 INFO:tasks.workunit.client.0.smithi117.stdout:2/707: write d0/d4/f54 [412345,128877] 0 2024-04-12T09:11:20.836 INFO:tasks.workunit.client.1.smithi203.stdout:3/78: creat d2/f17 x:0 0 0 2024-04-12T09:11:20.837 INFO:tasks.workunit.client.0.smithi117.stdout:1/771: truncate d1/d64/f43 3038614 0 2024-04-12T09:11:20.837 INFO:tasks.workunit.client.0.smithi117.stdout:1/772: chown d1/dbd/d51/lda 2396 1 2024-04-12T09:11:20.838 INFO:tasks.workunit.client.0.smithi117.stdout:5/857: mknod d2/d3/de/d1e/d79/c118 0 2024-04-12T09:11:20.842 INFO:tasks.workunit.client.0.smithi117.stdout:6/766: symlink d8/d2a/d60/d89/lf2 0 2024-04-12T09:11:20.848 INFO:tasks.workunit.client.0.smithi117.stdout:7/644: sync 2024-04-12T09:11:20.849 INFO:tasks.workunit.client.0.smithi117.stdout:7/645: fsync d0/d2/d1a/d49/f5e 0 2024-04-12T09:11:20.850 INFO:tasks.workunit.client.0.smithi117.stdout:6/767: dwrite d8/d2a/d60/d7d/d8c/f98 [0,4194304] 0 2024-04-12T09:11:20.850 INFO:tasks.workunit.client.0.smithi117.stdout:0/917: dread d3/d30/dc8/ffe [0,4194304] 0 2024-04-12T09:11:20.853 INFO:tasks.workunit.client.1.smithi203.stdout:0/144: rename d0/d1d/d2f/d17/c8 to d0/d1d/d2f/d17/d19/c31 0 2024-04-12T09:11:20.863 INFO:tasks.workunit.client.1.smithi203.stdout:7/105: symlink d0/d4/l24 0 2024-04-12T09:11:20.864 INFO:tasks.workunit.client.1.smithi203.stdout:8/73: dread f3 [0,4194304] 0 2024-04-12T09:11:20.864 INFO:tasks.workunit.client.1.smithi203.stdout:8/74: chown d4/lf 139493 1 2024-04-12T09:11:20.865 INFO:tasks.workunit.client.0.smithi117.stdout:5/858: symlink d2/d3/de/d1e/d46/de4/dea/l119 0 2024-04-12T09:11:20.865 INFO:tasks.workunit.client.0.smithi117.stdout:7/646: read d0/d2/d45/d17/d23/d50/f66 [3957740,80198] 0 2024-04-12T09:11:20.866 INFO:tasks.workunit.client.1.smithi203.stdout:2/108: creat d0/d14/d1e/f2b x:0 0 0 2024-04-12T09:11:20.866 INFO:tasks.workunit.client.1.smithi203.stdout:2/109: readlink d0/d14/l1d 0 2024-04-12T09:11:20.867 INFO:tasks.workunit.client.0.smithi117.stdout:8/806: dwrite db/d19/d1a/d3d/f2a [0,4194304] 0 2024-04-12T09:11:20.870 INFO:tasks.workunit.client.0.smithi117.stdout:0/918: symlink d3/da2/dee/d76/d83/l12f 0 2024-04-12T09:11:20.871 INFO:tasks.workunit.client.1.smithi203.stdout:3/79: creat d2/f18 x:0 0 0 2024-04-12T09:11:20.871 INFO:tasks.workunit.client.0.smithi117.stdout:6/768: fdatasync d8/d3a/d49/da4/d9f/fe8 0 2024-04-12T09:11:20.872 INFO:tasks.workunit.client.0.smithi117.stdout:6/769: readlink d8/d3a/d49/da4/l47 0 2024-04-12T09:11:20.872 INFO:tasks.workunit.client.1.smithi203.stdout:5/177: symlink d0/d6/d16/d9/l43 0 2024-04-12T09:11:20.877 INFO:tasks.workunit.client.1.smithi203.stdout:9/82: write f4 [2844563,79020] 0 2024-04-12T09:11:20.880 INFO:tasks.workunit.client.0.smithi117.stdout:5/859: fsync d2/f3d 0 2024-04-12T09:11:20.885 INFO:tasks.workunit.client.0.smithi117.stdout:7/647: mknod d0/d2/d45/d15/cc6 0 2024-04-12T09:11:20.888 INFO:tasks.workunit.client.1.smithi203.stdout:8/75: creat d4/f15 x:0 0 0 2024-04-12T09:11:20.891 INFO:tasks.workunit.client.1.smithi203.stdout:2/110: symlink d0/d3/l2c 0 2024-04-12T09:11:20.891 INFO:tasks.workunit.client.1.smithi203.stdout:2/111: chown d0/l28 27 1 2024-04-12T09:11:20.892 INFO:tasks.workunit.client.0.smithi117.stdout:6/770: truncate d8/d9/f40 4536565 0 2024-04-12T09:11:20.894 INFO:tasks.workunit.client.1.smithi203.stdout:4/85: getdents . 0 2024-04-12T09:11:20.894 INFO:tasks.workunit.client.1.smithi203.stdout:4/86: fdatasync fb 0 2024-04-12T09:11:20.895 INFO:tasks.workunit.client.1.smithi203.stdout:4/87: write f14 [195975,22066] 0 2024-04-12T09:11:20.896 INFO:tasks.workunit.client.1.smithi203.stdout:3/80: symlink d2/l19 0 2024-04-12T09:11:20.898 INFO:tasks.workunit.client.0.smithi117.stdout:1/773: link d1/d3b/f4a d1/dbd/d3f/db/d16/db6/ff0 0 2024-04-12T09:11:20.898 INFO:tasks.workunit.client.0.smithi117.stdout:8/807: dread db/d13/d38/f4e [0,4194304] 0 2024-04-12T09:11:20.899 INFO:tasks.workunit.client.1.smithi203.stdout:5/178: write d0/f35 [1664598,58962] 0 2024-04-12T09:11:20.900 INFO:tasks.workunit.client.1.smithi203.stdout:4/88: dwrite f5 [4194304,4194304] 0 2024-04-12T09:11:20.901 INFO:tasks.workunit.client.1.smithi203.stdout:4/89: chown le 459917 1 2024-04-12T09:11:20.903 INFO:tasks.workunit.client.0.smithi117.stdout:5/860: mkdir d2/d3/de/d1e/d46/de4/dea/d11a 0 2024-04-12T09:11:20.905 INFO:tasks.workunit.client.1.smithi203.stdout:0/145: rename d0/fb to d0/d1d/f32 0 2024-04-12T09:11:20.910 INFO:tasks.workunit.client.1.smithi203.stdout:7/106: link d0/d15/f19 d0/d4/f25 0 2024-04-12T09:11:20.911 INFO:tasks.workunit.client.0.smithi117.stdout:0/919: write d3/f21 [5727745,81094] 0 2024-04-12T09:11:20.911 INFO:tasks.workunit.client.1.smithi203.stdout:6/85: dwrite d1/df/f11 [0,4194304] 0 2024-04-12T09:11:20.912 INFO:tasks.workunit.client.1.smithi203.stdout:7/107: chown d0/d4/f11 355437931 1 2024-04-12T09:11:20.912 INFO:tasks.workunit.client.1.smithi203.stdout:8/76: rename d4/c5 to d4/c16 0 2024-04-12T09:11:20.912 INFO:tasks.workunit.client.1.smithi203.stdout:7/108: fsync d0/f1a 0 2024-04-12T09:11:20.913 INFO:tasks.workunit.client.1.smithi203.stdout:2/112: chown d0/l1f 96314263 1 2024-04-12T09:11:20.916 INFO:tasks.workunit.client.0.smithi117.stdout:8/808: mkdir db/d1b/d55/d10e 0 2024-04-12T09:11:20.917 INFO:tasks.workunit.client.0.smithi117.stdout:8/809: dread - db/d13/d38/d86/fe0 zero size 2024-04-12T09:11:20.918 INFO:tasks.workunit.client.0.smithi117.stdout:5/861: truncate d2/f92 840590 0 2024-04-12T09:11:20.920 INFO:tasks.workunit.client.1.smithi203.stdout:4/90: symlink l18 0 2024-04-12T09:11:20.920 INFO:tasks.workunit.client.1.smithi203.stdout:8/77: dwrite d4/f13 [0,4194304] 0 2024-04-12T09:11:20.922 INFO:tasks.workunit.client.1.smithi203.stdout:9/83: mkdir d8/d12/d23 0 2024-04-12T09:11:20.924 INFO:tasks.workunit.client.1.smithi203.stdout:9/84: write d8/f15 [611172,24855] 0 2024-04-12T09:11:20.924 INFO:tasks.workunit.client.0.smithi117.stdout:7/648: rename d0/lb5 to d0/d2/d45/d15/lc7 0 2024-04-12T09:11:20.925 INFO:tasks.workunit.client.1.smithi203.stdout:9/85: write f4 [3213351,54084] 0 2024-04-12T09:11:20.928 INFO:tasks.workunit.client.0.smithi117.stdout:6/771: mkdir d8/d3a/d49/da4/d8a/de2/df3 0 2024-04-12T09:11:20.929 INFO:tasks.workunit.client.1.smithi203.stdout:1/113: getdents df/d20 0 2024-04-12T09:11:20.931 INFO:tasks.workunit.client.0.smithi117.stdout:0/920: fsync d3/da2/dee/dd5/dff/d91/d94/d5a/d62/f70 0 2024-04-12T09:11:20.935 INFO:tasks.workunit.client.0.smithi117.stdout:8/810: fdatasync db/d19/f75 0 2024-04-12T09:11:20.937 INFO:tasks.workunit.client.1.smithi203.stdout:1/114: dwrite df/f1e [0,4194304] 0 2024-04-12T09:11:20.938 INFO:tasks.workunit.client.1.smithi203.stdout:2/113: creat d0/d14/d23/f2d x:0 0 0 2024-04-12T09:11:20.939 INFO:tasks.workunit.client.1.smithi203.stdout:1/115: truncate df/d20/f21 12607 0 2024-04-12T09:11:20.941 INFO:tasks.workunit.client.0.smithi117.stdout:2/708: link d0/d4/d10/d27/f70 d0/d43/d4b/dae/dd5/fef 0 2024-04-12T09:11:20.943 INFO:tasks.workunit.client.1.smithi203.stdout:5/179: mkdir d0/d6/d16/d44 0 2024-04-12T09:11:20.944 INFO:tasks.workunit.client.0.smithi117.stdout:5/862: dwrite d2/d3/dd/d39/d83/d4d/d52/f103 [0,4194304] 0 2024-04-12T09:11:20.946 INFO:tasks.workunit.client.0.smithi117.stdout:1/774: dwrite d1/dbd/d3f/db/d16/db6/da9/d9a/f44 [0,4194304] 0 2024-04-12T09:11:20.947 INFO:tasks.workunit.client.0.smithi117.stdout:1/775: chown d1/dbd 6471297 1 2024-04-12T09:11:20.948 INFO:tasks.workunit.client.1.smithi203.stdout:3/81: truncate d2/fd 1507401 0 2024-04-12T09:11:20.950 INFO:tasks.workunit.client.0.smithi117.stdout:6/772: symlink d8/d9/d61/lf4 0 2024-04-12T09:11:20.957 INFO:tasks.workunit.client.1.smithi203.stdout:4/91: creat f19 x:0 0 0 2024-04-12T09:11:20.959 INFO:tasks.workunit.client.1.smithi203.stdout:3/82: dwrite d2/f18 [0,4194304] 0 2024-04-12T09:11:20.964 INFO:tasks.workunit.client.0.smithi117.stdout:7/649: write d0/d2/d45/d17/d23/d50/f3d [22760,52120] 0 2024-04-12T09:11:20.966 INFO:tasks.workunit.client.1.smithi203.stdout:6/86: dwrite d1/d3/f13 [0,4194304] 0 2024-04-12T09:11:20.969 INFO:tasks.workunit.client.1.smithi203.stdout:1/116: rename f3 to df/d20/f26 0 2024-04-12T09:11:20.970 INFO:tasks.workunit.client.1.smithi203.stdout:1/117: readlink l8 0 2024-04-12T09:11:20.970 INFO:tasks.workunit.client.1.smithi203.stdout:1/118: chown df 169 1 2024-04-12T09:11:20.970 INFO:tasks.workunit.client.0.smithi117.stdout:6/773: readlink d8/d9/d17/d2d/lc0 0 2024-04-12T09:11:20.971 INFO:tasks.workunit.client.1.smithi203.stdout:5/180: fsync d0/d6/d11/d18/f40 0 2024-04-12T09:11:20.975 INFO:tasks.workunit.client.1.smithi203.stdout:4/92: mkdir d1a 0 2024-04-12T09:11:20.975 INFO:tasks.workunit.client.1.smithi203.stdout:1/119: dread df/f1e [0,4194304] 0 2024-04-12T09:11:20.975 INFO:tasks.workunit.client.1.smithi203.stdout:4/93: write fc [2231689,69906] 0 2024-04-12T09:11:20.976 INFO:tasks.workunit.client.1.smithi203.stdout:1/120: chown ca 116576452 1 2024-04-12T09:11:20.977 INFO:tasks.workunit.client.1.smithi203.stdout:5/181: dread d0/d6/d11/d18/f32 [0,4194304] 0 2024-04-12T09:11:20.978 INFO:tasks.workunit.client.0.smithi117.stdout:1/776: dwrite d1/dbd/d3f/db/fe0 [0,4194304] 0 2024-04-12T09:11:20.978 INFO:tasks.workunit.client.0.smithi117.stdout:8/811: symlink db/d1b/l10f 0 2024-04-12T09:11:20.979 INFO:tasks.workunit.client.1.smithi203.stdout:5/182: truncate d0/d6/f22 210894 0 2024-04-12T09:11:20.981 INFO:tasks.workunit.client.1.smithi203.stdout:7/109: link d0/ff d0/f26 0 2024-04-12T09:11:20.981 INFO:tasks.workunit.client.1.smithi203.stdout:4/94: dread fc [0,4194304] 0 2024-04-12T09:11:20.987 INFO:tasks.workunit.client.1.smithi203.stdout:8/78: link d4/le d4/d8/l17 0 2024-04-12T09:11:20.991 INFO:tasks.workunit.client.1.smithi203.stdout:1/121: rmdir df 39 2024-04-12T09:11:20.991 INFO:tasks.workunit.client.1.smithi203.stdout:8/79: write d4/d8/fd [2275359,111163] 0 2024-04-12T09:11:20.993 INFO:tasks.workunit.client.1.smithi203.stdout:0/146: getdents d0/d1d/d2f/d17/d19 0 2024-04-12T09:11:21.000 INFO:tasks.workunit.client.1.smithi203.stdout:7/110: unlink d0/d4/c1b 0 2024-04-12T09:11:21.000 INFO:tasks.workunit.client.1.smithi203.stdout:7/111: read - d0/d15/f23 zero size 2024-04-12T09:11:21.001 INFO:tasks.workunit.client.1.smithi203.stdout:7/112: dread - d0/d4/d1c/f1f zero size 2024-04-12T09:11:21.002 INFO:tasks.workunit.client.1.smithi203.stdout:7/113: chown d0/d4 1871184 1 2024-04-12T09:11:21.002 INFO:tasks.workunit.client.0.smithi117.stdout:9/707: sync 2024-04-12T09:11:21.006 INFO:tasks.workunit.client.1.smithi203.stdout:7/114: write d0/d4/fe [4553775,28340] 0 2024-04-12T09:11:21.006 INFO:tasks.workunit.client.0.smithi117.stdout:0/921: dwrite d3/da2/dee/dd5/dff/d91/d94/d5a/d62/d66/fda [0,4194304] 0 2024-04-12T09:11:21.010 INFO:tasks.workunit.client.1.smithi203.stdout:7/115: dwrite d0/f1a [0,4194304] 0 2024-04-12T09:11:21.013 INFO:tasks.workunit.client.1.smithi203.stdout:8/80: symlink d4/d8/l18 0 2024-04-12T09:11:21.016 INFO:tasks.workunit.client.1.smithi203.stdout:0/147: creat d0/d1d/d2f/f33 x:0 0 0 2024-04-12T09:11:21.017 INFO:tasks.workunit.client.1.smithi203.stdout:0/148: write d0/d1d/d2f/f33 [226756,113549] 0 2024-04-12T09:11:21.018 INFO:tasks.workunit.client.1.smithi203.stdout:0/149: chown d0/d1d/d2f/d17/fc 394402 1 2024-04-12T09:11:21.021 INFO:tasks.workunit.client.1.smithi203.stdout:4/95: creat d1a/f1b x:0 0 0 2024-04-12T09:11:21.026 INFO:tasks.workunit.client.1.smithi203.stdout:7/116: symlink d0/d4/l27 0 2024-04-12T09:11:21.029 INFO:tasks.workunit.client.1.smithi203.stdout:8/81: mkdir d4/d8/d19 0 2024-04-12T09:11:21.029 INFO:tasks.workunit.client.1.smithi203.stdout:3/83: write d2/fd [663943,53403] 0 2024-04-12T09:11:21.032 INFO:tasks.workunit.client.1.smithi203.stdout:0/150: truncate d0/f13 1266829 0 2024-04-12T09:11:21.032 INFO:tasks.workunit.client.1.smithi203.stdout:5/183: write d0/d6/d11/d18/d2a/f2b [1577423,71326] 0 2024-04-12T09:11:21.035 INFO:tasks.workunit.client.1.smithi203.stdout:5/184: dread d0/d6/d11/d18/d2a/ff [0,4194304] 0 2024-04-12T09:11:21.036 INFO:tasks.workunit.client.1.smithi203.stdout:5/185: fsync d0/d6/d11/d18/f40 0 2024-04-12T09:11:21.038 INFO:tasks.workunit.client.1.smithi203.stdout:8/82: rename d4/d8/c10 to d4/c1a 0 2024-04-12T09:11:21.040 INFO:tasks.workunit.client.1.smithi203.stdout:3/84: symlink d2/d8/d14/l1a 0 2024-04-12T09:11:21.040 INFO:tasks.workunit.client.1.smithi203.stdout:3/85: chown d2/fc 50 1 2024-04-12T09:11:21.041 INFO:tasks.workunit.client.1.smithi203.stdout:3/86: chown d2/le 66334543 1 2024-04-12T09:11:21.042 INFO:tasks.workunit.client.1.smithi203.stdout:3/87: chown d2/fd 38777202 1 2024-04-12T09:11:21.042 INFO:tasks.workunit.client.1.smithi203.stdout:8/83: dread d4/d8/fc [0,4194304] 0 2024-04-12T09:11:21.042 INFO:tasks.workunit.client.1.smithi203.stdout:0/151: mkdir d0/d1d/d2f/d34 0 2024-04-12T09:11:21.047 INFO:tasks.workunit.client.1.smithi203.stdout:3/88: dwrite d2/fa [0,4194304] 0 2024-04-12T09:11:21.049 INFO:tasks.workunit.client.1.smithi203.stdout:5/186: creat d0/d6/d11/d1e/f45 x:0 0 0 2024-04-12T09:11:21.049 INFO:tasks.workunit.client.1.smithi203.stdout:4/96: rmdir d1a 39 2024-04-12T09:11:21.054 INFO:tasks.workunit.client.1.smithi203.stdout:8/84: fdatasync d4/f9 0 2024-04-12T09:11:21.055 INFO:tasks.workunit.client.1.smithi203.stdout:4/97: dwrite f14 [0,4194304] 0 2024-04-12T09:11:21.056 INFO:tasks.workunit.client.1.smithi203.stdout:8/85: write d4/f15 [14273,53054] 0 2024-04-12T09:11:21.057 INFO:tasks.workunit.client.0.smithi117.stdout:4/776: sync 2024-04-12T09:11:21.057 INFO:tasks.workunit.client.1.smithi203.stdout:0/152: mknod d0/d1d/c35 0 2024-04-12T09:11:21.067 INFO:tasks.workunit.client.1.smithi203.stdout:3/89: dread d2/fc [0,4194304] 0 2024-04-12T09:11:21.070 INFO:tasks.workunit.client.1.smithi203.stdout:4/98: write fc [2095982,94673] 0 2024-04-12T09:11:21.074 INFO:tasks.workunit.client.1.smithi203.stdout:3/90: dwrite d2/f17 [0,4194304] 0 2024-04-12T09:11:21.076 INFO:tasks.workunit.client.1.smithi203.stdout:7/117: getdents d0 0 2024-04-12T09:11:21.081 INFO:tasks.workunit.client.1.smithi203.stdout:8/86: unlink d4/c16 0 2024-04-12T09:11:21.082 INFO:tasks.workunit.client.0.smithi117.stdout:2/709: rmdir d0/d43/dc4 0 2024-04-12T09:11:21.083 INFO:tasks.workunit.client.1.smithi203.stdout:3/91: dwrite d2/fd [0,4194304] 0 2024-04-12T09:11:21.085 INFO:tasks.workunit.client.0.smithi117.stdout:6/774: rename d8/d2a/d60/d7d/dbf to d8/d2a/d60/d89/d99/df5 0 2024-04-12T09:11:21.087 INFO:tasks.workunit.client.0.smithi117.stdout:6/775: truncate d8/d3a/d49/da4/d8a/fe7 202375 0 2024-04-12T09:11:21.088 INFO:tasks.workunit.client.0.smithi117.stdout:7/650: mknod d0/d2/d1a/da7/cc8 0 2024-04-12T09:11:21.092 INFO:tasks.workunit.client.0.smithi117.stdout:8/812: chown db/d4b/l59 6 1 2024-04-12T09:11:21.095 INFO:tasks.workunit.client.1.smithi203.stdout:7/118: mknod d0/d4/c28 0 2024-04-12T09:11:21.096 INFO:tasks.workunit.client.0.smithi117.stdout:5/863: creat d2/d3/de/f11b x:0 0 0 2024-04-12T09:11:21.100 INFO:tasks.workunit.client.0.smithi117.stdout:0/922: chown d3/da2/dee/dd5/dff/d91/d94/d5a/d62/cf2 3586201 1 2024-04-12T09:11:21.102 INFO:tasks.workunit.client.1.smithi203.stdout:0/153: truncate d0/dd/f2d 4017576 0 2024-04-12T09:11:21.103 INFO:tasks.workunit.client.0.smithi117.stdout:4/777: mkdir d0/d5/d25/dfd 0 2024-04-12T09:11:21.104 INFO:tasks.workunit.client.0.smithi117.stdout:2/710: truncate d0/d43/d30/f62 1129951 0 2024-04-12T09:11:21.106 INFO:tasks.workunit.client.0.smithi117.stdout:6/776: mkdir d8/d2a/df6 0 2024-04-12T09:11:21.107 INFO:tasks.workunit.client.0.smithi117.stdout:6/777: readlink d8/d3f/lba 0 2024-04-12T09:11:21.108 INFO:tasks.workunit.client.0.smithi117.stdout:7/651: truncate d0/d2/d1a/f55 2106470 0 2024-04-12T09:11:21.110 INFO:tasks.workunit.client.0.smithi117.stdout:1/777: symlink d1/dbd/d3f/db/d1d/d78/lf1 0 2024-04-12T09:11:21.112 INFO:tasks.workunit.client.0.smithi117.stdout:1/778: write d1/dbd/d3f/db/d16/db6/da9/d9a/f4b [2250791,40336] 0 2024-04-12T09:11:21.112 INFO:tasks.workunit.client.0.smithi117.stdout:5/864: truncate d2/d3/dd/f6d 4110637 0 2024-04-12T09:11:21.113 INFO:tasks.workunit.client.0.smithi117.stdout:9/708: mkdir d1/d8/df/d3e/de3 0 2024-04-12T09:11:21.115 INFO:tasks.workunit.client.0.smithi117.stdout:0/923: creat d3/d30/dc8/d108/f130 x:0 0 0 2024-04-12T09:11:21.120 INFO:tasks.workunit.client.0.smithi117.stdout:7/652: dread - d0/d2/d1a/d49/f62 zero size 2024-04-12T09:11:21.122 INFO:tasks.workunit.client.0.smithi117.stdout:7/653: read d0/d2/d45/d17/d23/d39/fb8 [179899,12099] 0 2024-04-12T09:11:21.123 INFO:tasks.workunit.client.0.smithi117.stdout:8/813: creat db/d13/d38/d86/da0/da4/f110 x:0 0 0 2024-04-12T09:11:21.127 INFO:tasks.workunit.client.0.smithi117.stdout:1/779: chown d1/d64/c84 10074 1 2024-04-12T09:11:21.130 INFO:tasks.workunit.client.0.smithi117.stdout:5/865: rmdir d2/d3/dd/d39/d83 39 2024-04-12T09:11:21.133 INFO:tasks.workunit.client.0.smithi117.stdout:1/780: dwrite d1/dbd/d3f/db/d16/db6/da9/f9c [0,4194304] 0 2024-04-12T09:11:21.135 INFO:tasks.workunit.client.0.smithi117.stdout:9/709: symlink d1/d8/df/d7d/d7e/le4 0 2024-04-12T09:11:21.139 INFO:tasks.workunit.client.0.smithi117.stdout:4/778: write d0/d5/d25/fd7 [60586,89385] 0 2024-04-12T09:11:21.140 INFO:tasks.workunit.client.0.smithi117.stdout:2/711: symlink d0/lf0 0 2024-04-12T09:11:21.140 INFO:tasks.workunit.client.0.smithi117.stdout:4/779: chown d0/d5/d3b/d38/d4f/db6 0 1 2024-04-12T09:11:21.147 INFO:tasks.workunit.client.0.smithi117.stdout:7/654: creat d0/da/fc9 x:0 0 0 2024-04-12T09:11:21.151 INFO:tasks.workunit.client.0.smithi117.stdout:8/814: creat db/d13/d38/dc3/d9d/dc9/f111 x:0 0 0 2024-04-12T09:11:21.157 INFO:tasks.workunit.client.0.smithi117.stdout:8/815: dwrite db/d13/d38/d86/da0/da4/fce [0,4194304] 0 2024-04-12T09:11:21.159 INFO:tasks.workunit.client.0.smithi117.stdout:1/781: rmdir d1/dbd/d3f/d72 39 2024-04-12T09:11:21.165 INFO:tasks.workunit.client.0.smithi117.stdout:2/712: creat d0/df/ff1 x:0 0 0 2024-04-12T09:11:21.166 INFO:tasks.workunit.client.1.smithi203.stdout:9/86: sync 2024-04-12T09:11:21.167 INFO:tasks.workunit.client.0.smithi117.stdout:0/924: dwrite d3/da2/dee/d76/d83/da8/d9a/fc6 [0,4194304] 0 2024-04-12T09:11:21.168 INFO:tasks.workunit.client.0.smithi117.stdout:4/780: chown d0/d5/d39/d4e/d51/l55 7 1 2024-04-12T09:11:21.170 INFO:tasks.workunit.client.0.smithi117.stdout:4/781: dread - d0/d72/fd3 zero size 2024-04-12T09:11:21.170 INFO:tasks.workunit.client.0.smithi117.stdout:9/710: dwrite d1/d24/f57 [0,4194304] 0 2024-04-12T09:11:21.174 INFO:tasks.workunit.client.0.smithi117.stdout:9/711: chown d1/d8/df/d7d/f8d 407545 1 2024-04-12T09:11:21.181 INFO:tasks.workunit.client.0.smithi117.stdout:0/925: dwrite d3/da2/dee/dd5/dff/d91/d94/d5a/d62/d66/d73/f113 [0,4194304] 0 2024-04-12T09:11:21.182 INFO:tasks.workunit.client.0.smithi117.stdout:0/926: chown l2 891 1 2024-04-12T09:11:21.185 INFO:tasks.workunit.client.0.smithi117.stdout:5/866: mkdir d2/d3/dd/d39/d82/d11c 0 2024-04-12T09:11:21.186 INFO:tasks.workunit.client.0.smithi117.stdout:8/816: read - db/d1b/d62/dae/db4/fe4 zero size 2024-04-12T09:11:21.195 INFO:tasks.workunit.client.0.smithi117.stdout:6/778: link d8/d9/l53 d8/d9/lf7 0 2024-04-12T09:11:21.196 INFO:tasks.workunit.client.0.smithi117.stdout:6/779: read d8/d9/d61/f65 [553642,108064] 0 2024-04-12T09:11:21.197 INFO:tasks.workunit.client.0.smithi117.stdout:9/712: rmdir d1/d8/df/da2 39 2024-04-12T09:11:21.200 INFO:tasks.workunit.client.0.smithi117.stdout:7/655: mkdir d0/d2/d45/d17/d23/dac/dad/d91/dca 0 2024-04-12T09:11:21.205 INFO:tasks.workunit.client.0.smithi117.stdout:0/927: creat d3/da2/dee/dd5/dff/d91/d94/d5a/f131 x:0 0 0 2024-04-12T09:11:21.212 INFO:tasks.workunit.client.0.smithi117.stdout:8/817: dread db/d19/d1a/f26 [0,4194304] 0 2024-04-12T09:11:21.212 INFO:tasks.workunit.client.0.smithi117.stdout:2/713: dread d0/d4/d10/d27/f39 [0,4194304] 0 2024-04-12T09:11:21.212 INFO:tasks.workunit.client.0.smithi117.stdout:1/782: mkdir d1/dbd/d3f/df2 0 2024-04-12T09:11:21.220 INFO:tasks.workunit.client.0.smithi117.stdout:7/656: creat d0/d2/d71/fcb x:0 0 0 2024-04-12T09:11:21.222 INFO:tasks.workunit.client.0.smithi117.stdout:0/928: mknod d3/da2/dee/c132 0 2024-04-12T09:11:21.232 INFO:tasks.workunit.client.1.smithi203.stdout:6/87: sync 2024-04-12T09:11:21.232 INFO:tasks.workunit.client.1.smithi203.stdout:0/154: sync 2024-04-12T09:11:21.232 INFO:tasks.workunit.client.1.smithi203.stdout:2/114: sync 2024-04-12T09:11:21.232 INFO:tasks.workunit.client.1.smithi203.stdout:1/122: sync 2024-04-12T09:11:21.232 INFO:tasks.workunit.client.1.smithi203.stdout:2/115: stat d0/d14/d1e 0 2024-04-12T09:11:21.237 INFO:tasks.workunit.client.1.smithi203.stdout:6/88: dwrite d1/df/f18 [0,4194304] 0 2024-04-12T09:11:21.238 INFO:tasks.workunit.client.1.smithi203.stdout:6/89: fsync d1/df/f19 0 2024-04-12T09:11:21.292 INFO:tasks.workunit.client.1.smithi203.stdout:5/187: getdents d0/d6/d16/d9/d14 0 2024-04-12T09:11:21.292 INFO:tasks.workunit.client.1.smithi203.stdout:7/119: unlink d0/c13 0 2024-04-12T09:11:21.293 INFO:tasks.workunit.client.1.smithi203.stdout:5/188: dread - d0/d6/d11/d1e/f45 zero size 2024-04-12T09:11:21.301 INFO:tasks.workunit.client.1.smithi203.stdout:6/90: creat d1/d3/f1a x:0 0 0 2024-04-12T09:11:21.303 INFO:tasks.workunit.client.1.smithi203.stdout:5/189: creat d0/d6/f46 x:0 0 0 2024-04-12T09:11:21.304 INFO:tasks.workunit.client.1.smithi203.stdout:4/99: link l3 d1a/l1c 0 2024-04-12T09:11:21.306 INFO:tasks.workunit.client.1.smithi203.stdout:9/87: creat d8/d12/d14/f24 x:0 0 0 2024-04-12T09:11:21.307 INFO:tasks.workunit.client.1.smithi203.stdout:9/88: chown d8/fe 1974239 1 2024-04-12T09:11:21.307 INFO:tasks.workunit.client.1.smithi203.stdout:1/123: symlink df/l27 0 2024-04-12T09:11:21.311 INFO:tasks.workunit.client.1.smithi203.stdout:2/116: mkdir d0/d2e 0 2024-04-12T09:11:21.312 INFO:tasks.workunit.client.1.smithi203.stdout:6/91: mkdir d1/df/d1b 0 2024-04-12T09:11:21.314 INFO:tasks.workunit.client.1.smithi203.stdout:5/190: creat d0/d6/d11/d18/d1a/f47 x:0 0 0 2024-04-12T09:11:21.314 INFO:tasks.workunit.client.1.smithi203.stdout:5/191: chown d0/d6/d11/l36 15913 1 2024-04-12T09:11:21.316 INFO:tasks.workunit.client.1.smithi203.stdout:3/92: getdents d2/d8 0 2024-04-12T09:11:21.319 INFO:tasks.workunit.client.1.smithi203.stdout:1/124: unlink df/f1a 0 2024-04-12T09:11:21.322 INFO:tasks.workunit.client.1.smithi203.stdout:2/117: rename d0/d3/l13 to d0/d14/l2f 0 2024-04-12T09:11:21.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.321+0000 7fb5f20b7700 1 -- 172.21.15.117:0/986321866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5ec0ffff0 msgr2=0x7fb5ec1023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:21.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.321+0000 7fb5f20b7700 1 --2- 172.21.15.117:0/986321866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5ec0ffff0 0x7fb5ec1023d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0004940 tx=0x7fb5e0009e30 comp rx=0 tx=0).stop 2024-04-12T09:11:21.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.321+0000 7fb5f20b7700 1 -- 172.21.15.117:0/986321866 shutdown_connections 2024-04-12T09:11:21.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.321+0000 7fb5f20b7700 1 --2- 172.21.15.117:0/986321866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5ec0ffff0 0x7fb5ec1023d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:21.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.321+0000 7fb5f20b7700 1 --2- 172.21.15.117:0/986321866 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5ec066b10 0x7fb5ec0ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:21.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.321+0000 7fb5f20b7700 1 -- 172.21.15.117:0/986321866 >> 172.21.15.117:0/986321866 conn(0x7fb5ec0f74e0 msgr2=0x7fb5ec0f98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:11:21.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.321+0000 7fb5f20b7700 1 -- 172.21.15.117:0/986321866 shutdown_connections 2024-04-12T09:11:21.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.321+0000 7fb5f20b7700 1 -- 172.21.15.117:0/986321866 wait complete. 2024-04-12T09:11:21.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.322+0000 7fb5f20b7700 1 Processor -- start 2024-04-12T09:11:21.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.323+0000 7fb5f20b7700 1 -- start start 2024-04-12T09:11:21.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.323+0000 7fb5f20b7700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5ec066b10 0x7fb5ec10da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:21.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.323+0000 7fb5f20b7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5ec0ffff0 0x7fb5ec10df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:21.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.323+0000 7fb5f20b7700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec10e570 con 0x7fb5ec0ffff0 2024-04-12T09:11:21.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.323+0000 7fb5f20b7700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec10ed70 con 0x7fb5ec066b10 2024-04-12T09:11:21.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.323+0000 7fb5eaffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5ec0ffff0 0x7fb5ec10df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:21.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.323+0000 7fb5eaffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5ec0ffff0 0x7fb5ec10df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47832/0 (socket says 172.21.15.117:47832) 2024-04-12T09:11:21.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.323+0000 7fb5eaffd700 1 -- 172.21.15.117:0/1746558021 learned_addr learned my addr 172.21.15.117:0/1746558021 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:11:21.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.323+0000 7fb5eb7fe700 1 --2- 172.21.15.117:0/1746558021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5ec066b10 0x7fb5ec10da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:21.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.323+0000 7fb5eaffd700 1 -- 172.21.15.117:0/1746558021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5ec066b10 msgr2=0x7fb5ec10da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:21.325 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.323+0000 7fb5eaffd700 1 --2- 172.21.15.117:0/1746558021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5ec066b10 0x7fb5ec10da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:21.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.323+0000 7fb5eaffd700 1 -- 172.21.15.117:0/1746558021 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e0005040 con 0x7fb5ec0ffff0 2024-04-12T09:11:21.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.323+0000 7fb5eb7fe700 1 --2- 172.21.15.117:0/1746558021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5ec066b10 0x7fb5ec10da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T09:11:21.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.323+0000 7fb5eaffd700 1 --2- 172.21.15.117:0/1746558021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5ec0ffff0 0x7fb5ec10df70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0013870 tx=0x7fb5e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:11:21.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.324+0000 7fb5d3fff700 1 -- 172.21.15.117:0/1746558021 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5e0021070 con 0x7fb5ec0ffff0 2024-04-12T09:11:21.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.324+0000 7fb5d3fff700 1 -- 172.21.15.117:0/1746558021 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb5e001c400 con 0x7fb5ec0ffff0 2024-04-12T09:11:21.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.324+0000 7fb5d3fff700 1 -- 172.21.15.117:0/1746558021 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5e000e070 con 0x7fb5ec0ffff0 2024-04-12T09:11:21.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.324+0000 7fb5f20b7700 1 -- 172.21.15.117:0/1746558021 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ec10eff0 con 0x7fb5ec0ffff0 2024-04-12T09:11:21.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.324+0000 7fb5f20b7700 1 -- 172.21.15.117:0/1746558021 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ec10f530 con 0x7fb5ec0ffff0 2024-04-12T09:11:21.327 INFO:tasks.workunit.client.1.smithi203.stdout:5/192: mkdir d0/d6/d16/d9/d29/d48 0 2024-04-12T09:11:21.327 INFO:tasks.workunit.client.1.smithi203.stdout:5/193: write d0/d6/d11/d18/d1a/f47 [1027559,92313] 0 2024-04-12T09:11:21.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.325+0000 7fb5f20b7700 1 -- 172.21.15.117:0/1746558021 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ec05f5f0 con 0x7fb5ec0ffff0 2024-04-12T09:11:21.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.326+0000 7fb5d3fff700 1 -- 172.21.15.117:0/1746558021 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 25) v1 ==== 89201+0+0 (secure 0 0 0) 0x7fb5e001ca20 con 0x7fb5ec0ffff0 2024-04-12T09:11:21.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.326+0000 7fb5d3fff700 1 --2- 172.21.15.117:0/1746558021 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fb5d406b540 0x7fb5d406d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:21.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.326+0000 7fb5d3fff700 1 -- 172.21.15.117:0/1746558021 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb5e008b290 con 0x7fb5ec0ffff0 2024-04-12T09:11:21.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.327+0000 7fb5eb7fe700 1 --2- 172.21.15.117:0/1746558021 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fb5d406b540 0x7fb5d406d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:21.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.328+0000 7fb5eb7fe700 1 --2- 172.21.15.117:0/1746558021 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fb5d406b540 0x7fb5d406d9f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc007fd0 tx=0x7fb5dc00b040 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:11:21.329 INFO:tasks.workunit.client.1.smithi203.stdout:9/89: mknod d8/d12/d23/c25 0 2024-04-12T09:11:21.332 INFO:tasks.workunit.client.1.smithi203.stdout:1/125: mknod df/c28 0 2024-04-12T09:11:21.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.332+0000 7fb5d3fff700 1 -- 172.21.15.117:0/1746558021 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7fb5e0058d40 con 0x7fb5ec0ffff0 2024-04-12T09:11:21.333 INFO:tasks.workunit.client.1.smithi203.stdout:1/126: truncate df/f19 838648 0 2024-04-12T09:11:21.333 INFO:tasks.workunit.client.1.smithi203.stdout:2/118: mknod d0/d14/d23/c30 0 2024-04-12T09:11:21.334 INFO:tasks.workunit.client.1.smithi203.stdout:6/92: getdents d1/d3/d12 0 2024-04-12T09:11:21.334 INFO:tasks.workunit.client.1.smithi203.stdout:2/119: chown d0/d3/fd 865687309 1 2024-04-12T09:11:21.335 INFO:tasks.workunit.client.1.smithi203.stdout:9/90: dwrite d8/d12/d14/f17 [0,4194304] 0 2024-04-12T09:11:21.335 INFO:tasks.workunit.client.1.smithi203.stdout:6/93: rename d1 to d1/d3/d1c 22 2024-04-12T09:11:21.335 INFO:tasks.workunit.client.1.smithi203.stdout:5/194: mknod d0/d6/d11/d1e/c49 0 2024-04-12T09:11:21.336 INFO:tasks.workunit.client.1.smithi203.stdout:2/120: write d0/f18 [1165560,942] 0 2024-04-12T09:11:21.336 INFO:tasks.workunit.client.1.smithi203.stdout:9/91: fdatasync d8/ff 0 2024-04-12T09:11:21.339 INFO:tasks.workunit.client.1.smithi203.stdout:2/121: fsync d0/f18 0 2024-04-12T09:11:21.340 INFO:tasks.workunit.client.1.smithi203.stdout:5/195: read d0/d6/d16/d9/f2e [44457,20255] 0 2024-04-12T09:11:21.341 INFO:tasks.workunit.client.1.smithi203.stdout:2/122: truncate d0/d14/d1e/f2b 93970 0 2024-04-12T09:11:21.343 INFO:tasks.workunit.client.1.smithi203.stdout:9/92: unlink d8/f10 0 2024-04-12T09:11:21.343 INFO:tasks.workunit.client.1.smithi203.stdout:5/196: dread d0/d6/d11/d18/f3b [0,4194304] 0 2024-04-12T09:11:21.345 INFO:tasks.workunit.client.1.smithi203.stdout:6/94: creat d1/d3/d4/f1d x:0 0 0 2024-04-12T09:11:21.347 INFO:tasks.workunit.client.1.smithi203.stdout:6/95: stat d1/d3/d4 0 2024-04-12T09:11:21.351 INFO:tasks.workunit.client.0.smithi117.stdout:2/714: rmdir d0/d43/da5/d8f/dc2 39 2024-04-12T09:11:21.352 INFO:tasks.workunit.client.1.smithi203.stdout:2/123: dwrite d0/d3/f29 [0,4194304] 0 2024-04-12T09:11:21.352 INFO:tasks.workunit.client.0.smithi117.stdout:8/818: dread - db/d19/d1a/d3d/d60/d70/fb1 zero size 2024-04-12T09:11:21.353 INFO:tasks.workunit.client.0.smithi117.stdout:1/783: truncate d1/d3b/f8f 3871541 0 2024-04-12T09:11:21.353 INFO:tasks.workunit.client.0.smithi117.stdout:7/657: dwrite d0/d2/d45/d17/f21 [4194304,4194304] 0 2024-04-12T09:11:21.354 INFO:tasks.workunit.client.1.smithi203.stdout:9/93: dwrite f4 [0,4194304] 0 2024-04-12T09:11:21.354 INFO:tasks.workunit.client.0.smithi117.stdout:0/929: creat d3/d59/f133 x:0 0 0 2024-04-12T09:11:21.355 INFO:tasks.workunit.client.1.smithi203.stdout:6/96: rename d1/d3/f13 to d1/d3/d12/f1e 0 2024-04-12T09:11:21.355 INFO:tasks.workunit.client.0.smithi117.stdout:5/867: rename d2/d3/de/d1e/d46/f4f to d2/d3/dd/d39/d83/dc8/dd1/dd2/f11d 0 2024-04-12T09:11:21.355 INFO:tasks.workunit.client.0.smithi117.stdout:9/713: stat d1/d8/df/fcf 0 2024-04-12T09:11:21.355 INFO:tasks.workunit.client.1.smithi203.stdout:6/97: truncate d1/f16 537071 0 2024-04-12T09:11:21.356 INFO:tasks.workunit.client.0.smithi117.stdout:4/782: getdents d0/d5/d3b/d38/d4f/d79 0 2024-04-12T09:11:21.357 INFO:tasks.workunit.client.1.smithi203.stdout:2/124: dread d0/d3/f29 [0,4194304] 0 2024-04-12T09:11:21.358 INFO:tasks.workunit.client.1.smithi203.stdout:6/98: dread d1/df/f19 [0,4194304] 0 2024-04-12T09:11:21.358 INFO:tasks.workunit.client.1.smithi203.stdout:2/125: chown d0/d3/f9 4 1 2024-04-12T09:11:21.359 INFO:tasks.workunit.client.0.smithi117.stdout:0/930: chown d3/d30/dc8/d10d/dab/fc4 4642031 1 2024-04-12T09:11:21.359 INFO:tasks.workunit.client.1.smithi203.stdout:6/99: chown d1/d3/d4/ca 5 1 2024-04-12T09:11:21.363 INFO:tasks.workunit.client.0.smithi117.stdout:7/658: truncate d0/d2/d45/d17/d23/dac/dad/daa/fb4 12686 0 2024-04-12T09:11:21.364 INFO:tasks.workunit.client.0.smithi117.stdout:2/715: creat d0/d43/d4b/dae/ff2 x:0 0 0 2024-04-12T09:11:21.366 INFO:tasks.workunit.client.0.smithi117.stdout:8/819: unlink db/d13/d38/dc3/d9d/cac 0 2024-04-12T09:11:21.368 INFO:tasks.workunit.client.0.smithi117.stdout:8/820: write db/fc [1242805,126570] 0 2024-04-12T09:11:21.373 INFO:tasks.workunit.client.1.smithi203.stdout:9/94: rename d8/d12/f13 to d8/d12/d23/f26 0 2024-04-12T09:11:21.375 INFO:tasks.workunit.client.0.smithi117.stdout:2/716: dwrite d0/d43/d53/d61/d8d/f91 [0,4194304] 0 2024-04-12T09:11:21.377 INFO:tasks.workunit.client.0.smithi117.stdout:4/783: rename d0/d5/d25/d69 to d0/d1/de9/dfe 0 2024-04-12T09:11:21.380 INFO:tasks.workunit.client.1.smithi203.stdout:2/126: mknod d0/d3/c31 0 2024-04-12T09:11:21.384 INFO:tasks.workunit.client.1.smithi203.stdout:6/100: creat d1/d3/d12/f1f x:0 0 0 2024-04-12T09:11:21.385 INFO:tasks.workunit.client.1.smithi203.stdout:6/101: write d1/d3/f1a [996667,69343] 0 2024-04-12T09:11:21.386 INFO:tasks.workunit.client.0.smithi117.stdout:7/659: symlink d0/d13/lcc 0 2024-04-12T09:11:21.388 INFO:tasks.workunit.client.1.smithi203.stdout:9/95: mkdir d8/d12/d23/d27 0 2024-04-12T09:11:21.391 INFO:tasks.workunit.client.1.smithi203.stdout:9/96: dread d8/d12/d14/f17 [0,4194304] 0 2024-04-12T09:11:21.393 INFO:tasks.workunit.client.0.smithi117.stdout:7/660: dwrite d0/d2/d45/d15/f54 [0,4194304] 0 2024-04-12T09:11:21.395 INFO:tasks.workunit.client.0.smithi117.stdout:7/661: fdatasync d0/d2/d45/d17/d23/d39/d6c/fc1 0 2024-04-12T09:11:21.396 INFO:tasks.workunit.client.0.smithi117.stdout:8/821: unlink db/d13/d38/dc3/l10a 0 2024-04-12T09:11:21.397 INFO:tasks.workunit.client.0.smithi117.stdout:8/822: chown db/d13/d38/dc5 2 1 2024-04-12T09:11:21.409 INFO:tasks.workunit.client.0.smithi117.stdout:9/714: rename d1/d8/d12/f20 to d1/d8/d5a/d6e/d71/fe5 0 2024-04-12T09:11:21.415 INFO:tasks.workunit.client.0.smithi117.stdout:7/662: symlink d0/da/lcd 0 2024-04-12T09:11:21.417 INFO:tasks.workunit.client.1.smithi203.stdout:9/97: rmdir d8/d21 0 2024-04-12T09:11:21.420 INFO:tasks.workunit.client.1.smithi203.stdout:9/98: dread f3 [0,4194304] 0 2024-04-12T09:11:21.421 INFO:tasks.workunit.client.0.smithi117.stdout:9/715: chown d1/d8/d5a/c82 430852090 1 2024-04-12T09:11:21.422 INFO:tasks.workunit.client.0.smithi117.stdout:1/784: getdents d1/d64/d45/d4c/d94/dd0 0 2024-04-12T09:11:21.426 INFO:tasks.workunit.client.0.smithi117.stdout:7/663: mkdir d0/d20/d4a/dce 0 2024-04-12T09:11:21.427 INFO:tasks.workunit.client.1.smithi203.stdout:8/87: truncate d4/d8/f12 2220933 0 2024-04-12T09:11:21.430 INFO:tasks.workunit.client.1.smithi203.stdout:7/120: dread - d0/d4/f17 zero size 2024-04-12T09:11:21.436 INFO:tasks.workunit.client.0.smithi117.stdout:1/785: mknod d1/dbd/d3f/db/d16/cf3 0 2024-04-12T09:11:21.440 INFO:tasks.workunit.client.0.smithi117.stdout:2/717: link d0/d43/l7f d0/d4/d10/d27/lf3 0 2024-04-12T09:11:21.442 INFO:tasks.workunit.client.0.smithi117.stdout:2/718: write d0/d43/d30/f77 [1625391,16644] 0 2024-04-12T09:11:21.442 INFO:tasks.workunit.client.0.smithi117.stdout:2/719: readlink d0/df/l74 0 2024-04-12T09:11:21.443 INFO:tasks.workunit.client.1.smithi203.stdout:9/99: rename d8/fe to d8/f28 0 2024-04-12T09:11:21.444 INFO:tasks.workunit.client.1.smithi203.stdout:0/155: dwrite d0/d1d/d2f/d17/d19/f25 [0,4194304] 0 2024-04-12T09:11:21.446 INFO:tasks.workunit.client.1.smithi203.stdout:0/156: write d0/d1d/d2f/d17/fa [3061992,81391] 0 2024-04-12T09:11:21.446 INFO:tasks.workunit.client.0.smithi117.stdout:9/716: mknod d1/d8/df/d3e/d92/ce6 0 2024-04-12T09:11:21.450 INFO:tasks.workunit.client.1.smithi203.stdout:4/100: dwrite ff [0,4194304] 0 2024-04-12T09:11:21.453 INFO:tasks.workunit.client.1.smithi203.stdout:3/93: write d2/fd [4415618,28195] 0 2024-04-12T09:11:21.454 INFO:tasks.workunit.client.1.smithi203.stdout:3/94: chown d2/f13 13901716 1 2024-04-12T09:11:21.455 INFO:tasks.workunit.client.1.smithi203.stdout:3/95: write d2/f18 [1997277,115314] 0 2024-04-12T09:11:21.455 INFO:tasks.workunit.client.1.smithi203.stdout:9/100: mkdir d8/d12/d23/d29 0 2024-04-12T09:11:21.458 INFO:tasks.workunit.client.0.smithi117.stdout:2/720: symlink d0/d4/d81/lf4 0 2024-04-12T09:11:21.463 INFO:tasks.workunit.client.1.smithi203.stdout:1/127: truncate df/f19 446084 0 2024-04-12T09:11:21.465 INFO:tasks.workunit.client.1.smithi203.stdout:4/101: mkdir d1a/d1d 0 2024-04-12T09:11:21.470 INFO:tasks.workunit.client.0.smithi117.stdout:9/717: mkdir d1/d8/d5a/d79/d91/db0/d8a/de7 0 2024-04-12T09:11:21.472 INFO:tasks.workunit.client.0.smithi117.stdout:1/786: creat d1/d64/ff4 x:0 0 0 2024-04-12T09:11:21.474 INFO:tasks.workunit.client.1.smithi203.stdout:5/197: truncate d0/d6/d16/d9/d14/f25 6474865 0 2024-04-12T09:11:21.478 INFO:tasks.workunit.client.1.smithi203.stdout:1/128: unlink f7 0 2024-04-12T09:11:21.479 INFO:tasks.workunit.client.0.smithi117.stdout:5/868: write d2/d3/de/d1e/f20 [2563089,70556] 0 2024-04-12T09:11:21.484 INFO:tasks.workunit.client.1.smithi203.stdout:1/129: dwrite df/f1d [0,4194304] 0 2024-04-12T09:11:21.485 INFO:tasks.workunit.client.1.smithi203.stdout:2/127: getdents d0/d3 0 2024-04-12T09:11:21.485 INFO:tasks.workunit.client.0.smithi117.stdout:0/931: write d3/f4d [2596948,108876] 0 2024-04-12T09:11:21.488 INFO:tasks.workunit.client.1.smithi203.stdout:7/121: rename d0/d15/l21 to d0/d4/d1c/l29 0 2024-04-12T09:11:21.490 INFO:tasks.workunit.client.0.smithi117.stdout:5/869: creat d2/d3/dd/d39/d83/d4d/d6b/dcc/f11e x:0 0 0 2024-04-12T09:11:21.492 INFO:tasks.workunit.client.1.smithi203.stdout:0/157: creat d0/f36 x:0 0 0 2024-04-12T09:11:21.494 INFO:tasks.workunit.client.0.smithi117.stdout:0/932: mkdir d3/da2/dee/d76/d83/da8/d9a/d134 0 2024-04-12T09:11:21.499 INFO:tasks.workunit.client.1.smithi203.stdout:6/102: truncate d1/df/f11 3490928 0 2024-04-12T09:11:21.499 INFO:tasks.workunit.client.1.smithi203.stdout:6/103: stat d1/d3/f1a 0 2024-04-12T09:11:21.499 INFO:tasks.workunit.client.1.smithi203.stdout:4/102: creat d1a/d1d/f1e x:0 0 0 2024-04-12T09:11:21.500 INFO:tasks.workunit.client.1.smithi203.stdout:4/103: chown f19 343 1 2024-04-12T09:11:21.500 INFO:tasks.workunit.client.1.smithi203.stdout:6/104: write d1/d3/f1a [1968242,71678] 0 2024-04-12T09:11:21.501 INFO:tasks.workunit.client.0.smithi117.stdout:0/933: creat d3/da2/dee/dd5/dff/d91/d109/f135 x:0 0 0 2024-04-12T09:11:21.503 INFO:tasks.workunit.client.1.smithi203.stdout:3/96: rmdir d2/d8/d14/d16 0 2024-04-12T09:11:21.513 INFO:tasks.workunit.client.0.smithi117.stdout:4/784: dwrite d0/d5/d25/f53 [0,4194304] 0 2024-04-12T09:11:21.513 INFO:tasks.workunit.client.1.smithi203.stdout:5/198: mkdir d0/d6/d11/d4a 0 2024-04-12T09:11:21.517 INFO:tasks.workunit.client.1.smithi203.stdout:4/104: symlink d1a/d1d/l1f 0 2024-04-12T09:11:21.520 INFO:tasks.workunit.client.1.smithi203.stdout:3/97: mkdir d2/d8/d14/d1b 0 2024-04-12T09:11:21.521 INFO:tasks.workunit.client.0.smithi117.stdout:7/664: write d0/da/f10 [6244239,3756] 0 2024-04-12T09:11:21.522 INFO:tasks.workunit.client.0.smithi117.stdout:4/785: mknod d0/d1/de9/dfe/cff 0 2024-04-12T09:11:21.523 INFO:tasks.workunit.client.0.smithi117.stdout:0/934: dread d3/f20 [0,4194304] 0 2024-04-12T09:11:21.525 INFO:tasks.workunit.client.0.smithi117.stdout:0/935: readlink d3/da2/dee/d76/d83/da8/d97/l9f 0 2024-04-12T09:11:21.530 INFO:tasks.workunit.client.1.smithi203.stdout:0/158: link d0/dd/f16 d0/d1d/d2f/d17/d19/f37 0 2024-04-12T09:11:21.532 INFO:tasks.workunit.client.0.smithi117.stdout:7/665: dread d0/d2/d45/f5a [0,4194304] 0 2024-04-12T09:11:21.533 INFO:tasks.workunit.client.0.smithi117.stdout:0/936: creat d3/da2/dee/d76/d83/da8/d97/dc9/f136 x:0 0 0 2024-04-12T09:11:21.534 INFO:tasks.workunit.client.1.smithi203.stdout:5/199: mkdir d0/d6/d16/d9/d14/d4b 0 2024-04-12T09:11:21.536 INFO:tasks.workunit.client.1.smithi203.stdout:4/105: mkdir d1a/d20 0 2024-04-12T09:11:21.537 INFO:tasks.workunit.client.1.smithi203.stdout:4/106: truncate fb 1863025 0 2024-04-12T09:11:21.541 INFO:tasks.workunit.client.1.smithi203.stdout:2/128: creat d0/f32 x:0 0 0 2024-04-12T09:11:21.543 INFO:tasks.workunit.client.0.smithi117.stdout:7/666: mkdir d0/d20/d4a/dce/dcf 0 2024-04-12T09:11:21.544 INFO:tasks.workunit.client.1.smithi203.stdout:1/130: link lc df/l29 0 2024-04-12T09:11:21.547 INFO:tasks.workunit.client.1.smithi203.stdout:9/101: rename d8/d12/d14/f1c to d8/f2a 0 2024-04-12T09:11:21.550 INFO:tasks.workunit.client.0.smithi117.stdout:2/721: dwrite d0/d4/d10/d27/f70 [0,4194304] 0 2024-04-12T09:11:21.551 INFO:tasks.workunit.client.0.smithi117.stdout:0/937: dread d3/da2/dee/d76/d83/f111 [0,4194304] 0 2024-04-12T09:11:21.552 INFO:tasks.workunit.client.1.smithi203.stdout:0/159: unlink d0/dd/c18 0 2024-04-12T09:11:21.554 INFO:tasks.workunit.client.0.smithi117.stdout:7/667: mknod d0/d2/d45/d17/d23/d39/dbd/cd0 0 2024-04-12T09:11:21.555 INFO:tasks.workunit.client.1.smithi203.stdout:0/160: dread d0/d1d/d2f/d17/d19/f25 [0,4194304] 0 2024-04-12T09:11:21.559 INFO:tasks.workunit.client.1.smithi203.stdout:4/107: mkdir d1a/d21 0 2024-04-12T09:11:21.559 INFO:tasks.workunit.client.1.smithi203.stdout:4/108: stat fb 0 2024-04-12T09:11:21.559 INFO:tasks.workunit.client.1.smithi203.stdout:4/109: dread - d1a/d1d/f1e zero size 2024-04-12T09:11:21.560 INFO:tasks.workunit.client.0.smithi117.stdout:1/787: truncate d1/dbd/d3f/db/d16/db6/da9/d9a/d54/f86 224566 0 2024-04-12T09:11:21.560 INFO:tasks.workunit.client.0.smithi117.stdout:9/718: dwrite d1/d8/d5e/d9f/fbd [0,4194304] 0 2024-04-12T09:11:21.563 INFO:tasks.workunit.client.0.smithi117.stdout:2/722: unlink d0/df/l74 0 2024-04-12T09:11:21.563 INFO:tasks.workunit.client.0.smithi117.stdout:2/723: chown d0/de6 3272 1 2024-04-12T09:11:21.565 INFO:tasks.workunit.client.1.smithi203.stdout:2/129: mkdir d0/d14/d23/d33 0 2024-04-12T09:11:21.572 INFO:tasks.workunit.client.0.smithi117.stdout:2/724: dwrite d0/df/f46 [0,4194304] 0 2024-04-12T09:11:21.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:21 smithi203 ceph-mon[36428]: Updating smithi203:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T09:11:21.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:21 smithi203 ceph-mon[36428]: Updating smithi117:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T09:11:21.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:21 smithi203 ceph-mon[36428]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-04-12T09:11:21.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:21 smithi203 ceph-mon[36428]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2024-04-12T09:11:21.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:21 smithi203 ceph-mon[36428]: Updating smithi203:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T09:11:21.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:21 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:21.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:21 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:21.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:21 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:21.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:21 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:21.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:21 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:21.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:21 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:21.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:21 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:21.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:21 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:21.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:21 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:21.575 INFO:tasks.workunit.client.0.smithi117.stdout:7/668: symlink d0/d2/d45/d17/d23/dac/dad/ld1 0 2024-04-12T09:11:21.575 INFO:tasks.workunit.client.1.smithi203.stdout:1/131: dwrite f4 [4194304,4194304] 0 2024-04-12T09:11:21.578 INFO:tasks.workunit.client.1.smithi203.stdout:6/105: rename d1/d3/d4/lb to d1/d3/l20 0 2024-04-12T09:11:21.585 INFO:tasks.workunit.client.0.smithi117.stdout:9/719: creat d1/d8/df/d3e/d92/dce/fe8 x:0 0 0 2024-04-12T09:11:21.589 INFO:tasks.workunit.client.1.smithi203.stdout:8/88: write d4/d8/f12 [780883,76936] 0 2024-04-12T09:11:21.590 INFO:tasks.workunit.client.1.smithi203.stdout:7/122: truncate d0/d4/d1c/f1f 936161 0 2024-04-12T09:11:21.592 INFO:tasks.workunit.client.0.smithi117.stdout:2/725: unlink d0/d43/d30/f58 0 2024-04-12T09:11:21.594 INFO:tasks.workunit.client.1.smithi203.stdout:1/132: creat df/f2a x:0 0 0 2024-04-12T09:11:21.595 INFO:tasks.workunit.client.0.smithi117.stdout:7/669: rmdir d0/d2/d1a 39 2024-04-12T09:11:21.596 INFO:tasks.workunit.client.0.smithi117.stdout:7/670: stat d0/d2/d45/d17/d23/d39/dbd/fbf 0 2024-04-12T09:11:21.597 INFO:tasks.workunit.client.1.smithi203.stdout:6/106: mknod d1/c21 0 2024-04-12T09:11:21.601 INFO:tasks.workunit.client.0.smithi117.stdout:1/788: rename d1/dbd/d3f/db/d16/f2f to d1/dbd/d3f/d72/ff5 0 2024-04-12T09:11:21.603 INFO:tasks.workunit.client.1.smithi203.stdout:6/107: dwrite d1/df/f19 [0,4194304] 0 2024-04-12T09:11:21.604 INFO:tasks.workunit.client.1.smithi203.stdout:3/98: rename d2/c5 to d2/d8/d14/c1c 0 2024-04-12T09:11:21.610 INFO:tasks.workunit.client.1.smithi203.stdout:0/161: mknod d0/c38 0 2024-04-12T09:11:21.612 INFO:tasks.workunit.client.0.smithi117.stdout:6/780: sync 2024-04-12T09:11:21.618 INFO:tasks.workunit.client.0.smithi117.stdout:7/671: rmdir d0/da 39 2024-04-12T09:11:21.620 INFO:tasks.workunit.client.1.smithi203.stdout:0/162: dwrite d0/d1d/d2f/f33 [0,4194304] 0 2024-04-12T09:11:21.620 INFO:tasks.workunit.client.1.smithi203.stdout:1/133: mkdir df/d20/d2b 0 2024-04-12T09:11:21.620 INFO:tasks.workunit.client.1.smithi203.stdout:1/134: chown df/d20/f26 877120769 1 2024-04-12T09:11:21.627 INFO:tasks.workunit.client.0.smithi117.stdout:2/726: truncate d0/d43/d30/f62 845213 0 2024-04-12T09:11:21.629 INFO:tasks.workunit.client.1.smithi203.stdout:6/108: unlink d1/d3/c6 0 2024-04-12T09:11:21.632 INFO:tasks.workunit.client.0.smithi117.stdout:6/781: rename d8/d9/d61/d90 to d8/d3a/d49/da4/df8 0 2024-04-12T09:11:21.635 INFO:tasks.workunit.client.1.smithi203.stdout:5/200: rename d0/d6/d16/d9/d29 to d0/d6/d11/d1e/d4c 0 2024-04-12T09:11:21.637 INFO:tasks.workunit.client.0.smithi117.stdout:7/672: chown d0/da/f10 53980432 1 2024-04-12T09:11:21.638 INFO:tasks.workunit.client.1.smithi203.stdout:3/99: creat d2/d8/f1d x:0 0 0 2024-04-12T09:11:21.639 INFO:tasks.workunit.client.0.smithi117.stdout:1/789: mknod d1/dbd/d3f/db/d16/db6/cf6 0 2024-04-12T09:11:21.639 INFO:tasks.workunit.client.1.smithi203.stdout:3/100: write d2/d8/f1d [510338,117406] 0 2024-04-12T09:11:21.642 INFO:tasks.workunit.client.1.smithi203.stdout:3/101: dread d2/fd [0,4194304] 0 2024-04-12T09:11:21.644 INFO:tasks.workunit.client.0.smithi117.stdout:0/938: dwrite d3/da2/dee/d76/d83/da8/d9a/fa6 [0,4194304] 0 2024-04-12T09:11:21.644 INFO:tasks.workunit.client.0.smithi117.stdout:0/939: dread - d3/ddd/f12a zero size 2024-04-12T09:11:21.645 INFO:tasks.workunit.client.0.smithi117.stdout:6/782: unlink d8/d3a/d49/da4/df8/cd9 0 2024-04-12T09:11:21.646 INFO:tasks.workunit.client.0.smithi117.stdout:6/783: write d8/d3f/fd6 [353350,71262] 0 2024-04-12T09:11:21.650 INFO:tasks.workunit.client.0.smithi117.stdout:7/673: symlink d0/d2/d45/d17/d23/d51/ld2 0 2024-04-12T09:11:21.652 INFO:tasks.workunit.client.0.smithi117.stdout:6/784: read d8/d3f/fd6 [214696,55224] 0 2024-04-12T09:11:21.652 INFO:tasks.workunit.client.1.smithi203.stdout:8/89: creat d4/d8/d19/f1b x:0 0 0 2024-04-12T09:11:21.658 INFO:tasks.workunit.client.1.smithi203.stdout:8/90: dwrite d4/f9 [0,4194304] 0 2024-04-12T09:11:21.659 INFO:tasks.workunit.client.0.smithi117.stdout:0/940: rename d3/d30/dc8/d10d to d3/da2/dee/dd5/d137 0 2024-04-12T09:11:21.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:21 smithi117 ceph-mon[29277]: Updating smithi203:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T09:11:21.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:21 smithi117 ceph-mon[29277]: Updating smithi117:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T09:11:21.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:21 smithi117 ceph-mon[29277]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-04-12T09:11:21.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:21 smithi117 ceph-mon[29277]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2024-04-12T09:11:21.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:21 smithi117 ceph-mon[29277]: Updating smithi203:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T09:11:21.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:21 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:21.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:21 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:21.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:21 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:21.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:21 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:21.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:21 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:21.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:21 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:21.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:21 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:21.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:21 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:21.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:21 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:21.661 INFO:tasks.workunit.client.1.smithi203.stdout:0/163: dread d0/d1d/f32 [0,4194304] 0 2024-04-12T09:11:21.664 INFO:tasks.workunit.client.1.smithi203.stdout:0/164: dread d0/d1d/d2f/f33 [0,4194304] 0 2024-04-12T09:11:21.668 INFO:tasks.workunit.client.0.smithi117.stdout:1/790: symlink d1/dbd/d3f/db/d16/db6/da9/d9a/lf7 0 2024-04-12T09:11:21.672 INFO:tasks.workunit.client.1.smithi203.stdout:3/102: symlink d2/d8/l1e 0 2024-04-12T09:11:21.673 INFO:tasks.workunit.client.0.smithi117.stdout:0/941: rmdir d3/da2/de6 39 2024-04-12T09:11:21.676 INFO:tasks.workunit.client.0.smithi117.stdout:9/720: dwrite d1/d8/d5a/d6e/d71/fe5 [0,4194304] 0 2024-04-12T09:11:21.676 INFO:tasks.workunit.client.1.smithi203.stdout:4/110: getdents d1a/d1d 0 2024-04-12T09:11:21.677 INFO:tasks.workunit.client.1.smithi203.stdout:4/111: readlink l17 0 2024-04-12T09:11:21.677 INFO:tasks.workunit.client.0.smithi117.stdout:9/721: readlink d1/d8/d5e/d9f/ldc 0 2024-04-12T09:11:21.679 INFO:tasks.workunit.client.0.smithi117.stdout:7/674: creat d0/d2/d96/d98/fd3 x:0 0 0 2024-04-12T09:11:21.685 INFO:tasks.workunit.client.1.smithi203.stdout:8/91: mkdir d4/d8/d1c 0 2024-04-12T09:11:21.686 INFO:tasks.workunit.client.1.smithi203.stdout:8/92: dread d4/f15 [0,4194304] 0 2024-04-12T09:11:21.687 INFO:tasks.workunit.client.1.smithi203.stdout:1/135: getdents df/d20/d2b 0 2024-04-12T09:11:21.687 INFO:tasks.workunit.client.1.smithi203.stdout:8/93: chown l1 128128459 1 2024-04-12T09:11:21.687 INFO:tasks.workunit.client.1.smithi203.stdout:1/136: write df/f16 [612385,78250] 0 2024-04-12T09:11:21.688 INFO:tasks.workunit.client.1.smithi203.stdout:1/137: fdatasync df/d20/f26 0 2024-04-12T09:11:21.693 INFO:tasks.workunit.client.0.smithi117.stdout:7/675: mknod d0/d2/d45/d17/d23/d50/cd4 0 2024-04-12T09:11:21.695 INFO:tasks.workunit.client.0.smithi117.stdout:6/785: creat d8/ff9 x:0 0 0 2024-04-12T09:11:21.697 INFO:tasks.workunit.client.1.smithi203.stdout:0/165: symlink d0/d1d/d2f/d17/d19/l39 0 2024-04-12T09:11:21.698 INFO:tasks.workunit.client.1.smithi203.stdout:0/166: write d0/dd/f24 [1317228,82835] 0 2024-04-12T09:11:21.698 INFO:tasks.workunit.client.0.smithi117.stdout:0/942: creat d3/da2/dee/dd5/dff/d91/d94/d5a/d11d/f138 x:0 0 0 2024-04-12T09:11:21.698 INFO:tasks.workunit.client.0.smithi117.stdout:0/943: chown d3/cb8 0 1 2024-04-12T09:11:21.699 INFO:tasks.workunit.client.1.smithi203.stdout:5/201: symlink d0/d6/d16/d44/l4d 0 2024-04-12T09:11:21.700 INFO:tasks.workunit.client.1.smithi203.stdout:0/167: dread d0/d1d/d2f/d17/f11 [0,4194304] 0 2024-04-12T09:11:21.700 INFO:tasks.workunit.client.0.smithi117.stdout:9/722: rmdir d1/d8/df/d7d/d7e 39 2024-04-12T09:11:21.702 INFO:tasks.workunit.client.0.smithi117.stdout:7/676: rmdir d0/da/d7c/dae 39 2024-04-12T09:11:21.704 INFO:tasks.workunit.client.1.smithi203.stdout:3/103: mkdir d2/d1f 0 2024-04-12T09:11:21.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.703+0000 7fb5f20b7700 1 -- 172.21.15.117:0/1746558021 --> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5ec10f860 con 0x7fb5d406b540 2024-04-12T09:11:21.704 INFO:tasks.workunit.client.0.smithi117.stdout:6/786: creat d8/d3a/d49/da4/ffa x:0 0 0 2024-04-12T09:11:21.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.705+0000 7fb5d3fff700 1 -- 172.21.15.117:0/1746558021 <== mgr.24371 v2:172.21.15.203:6828/2773660052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fb5ec10f860 con 0x7fb5d406b540 2024-04-12T09:11:21.706 INFO:tasks.workunit.client.0.smithi117.stdout:0/944: mknod d3/da2/dee/d76/d83/da8/d9a/c139 0 2024-04-12T09:11:21.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.708+0000 7fb5f20b7700 1 -- 172.21.15.117:0/1746558021 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fb5d406b540 msgr2=0x7fb5d406d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:21.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.708+0000 7fb5f20b7700 1 --2- 172.21.15.117:0/1746558021 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fb5d406b540 0x7fb5d406d9f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc007fd0 tx=0x7fb5dc00b040 comp rx=0 tx=0).stop 2024-04-12T09:11:21.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.708+0000 7fb5f20b7700 1 -- 172.21.15.117:0/1746558021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5ec0ffff0 msgr2=0x7fb5ec10df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:21.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.708+0000 7fb5f20b7700 1 --2- 172.21.15.117:0/1746558021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5ec0ffff0 0x7fb5ec10df70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0013870 tx=0x7fb5e0009e30 comp rx=0 tx=0).stop 2024-04-12T09:11:21.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.708+0000 7fb5f20b7700 1 -- 172.21.15.117:0/1746558021 shutdown_connections 2024-04-12T09:11:21.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.708+0000 7fb5f20b7700 1 --2- 172.21.15.117:0/1746558021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5ec066b10 0x7fb5ec10da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:21.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.708+0000 7fb5f20b7700 1 --2- 172.21.15.117:0/1746558021 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fb5d406b540 0x7fb5d406d9f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:21.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.708+0000 7fb5f20b7700 1 --2- 172.21.15.117:0/1746558021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5ec0ffff0 0x7fb5ec10df70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:21.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.708+0000 7fb5f20b7700 1 -- 172.21.15.117:0/1746558021 >> 172.21.15.117:0/1746558021 conn(0x7fb5ec0f74e0 msgr2=0x7fb5ec0f78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:11:21.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.708+0000 7fb5f20b7700 1 -- 172.21.15.117:0/1746558021 shutdown_connections 2024-04-12T09:11:21.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.708+0000 7fb5f20b7700 1 -- 172.21.15.117:0/1746558021 wait complete. 2024-04-12T09:11:21.710 INFO:tasks.workunit.client.1.smithi203.stdout:8/94: creat d4/d8/f1d x:0 0 0 2024-04-12T09:11:21.711 INFO:tasks.workunit.client.0.smithi117.stdout:7/677: dread - d0/da/d7c/f9f zero size 2024-04-12T09:11:21.713 INFO:tasks.workunit.client.0.smithi117.stdout:0/945: fdatasync d3/da2/dee/d76/d83/da8/fbc 0 2024-04-12T09:11:21.715 INFO:tasks.workunit.client.1.smithi203.stdout:7/123: rename d0/d4/c8 to d0/d4/d1c/c2a 0 2024-04-12T09:11:21.715 INFO:tasks.workunit.client.0.smithi117.stdout:0/946: read d3/da2/dee/dd5/dff/d91/d94/d5a/d62/d66/d73/f113 [2651765,50527] 0 2024-04-12T09:11:21.716 INFO:tasks.workunit.client.1.smithi203.stdout:7/124: read - d0/ff zero size 2024-04-12T09:11:21.718 INFO:tasks.workunit.client.0.smithi117.stdout:6/787: creat d8/d2a/d60/d89/dea/ffb x:0 0 0 2024-04-12T09:11:21.720 INFO:tasks.workunit.client.0.smithi117.stdout:7/678: mknod d0/d2/d45/d15/cd5 0 2024-04-12T09:11:21.722 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:11:21.724 INFO:tasks.workunit.client.1.smithi203.stdout:4/112: mkdir d1a/d21/d22 0 2024-04-12T09:11:21.729 INFO:tasks.workunit.client.1.smithi203.stdout:8/95: creat d4/d8/d19/f1e x:0 0 0 2024-04-12T09:11:21.730 INFO:tasks.workunit.client.1.smithi203.stdout:8/96: chown d4/d8/l18 623 1 2024-04-12T09:11:21.730 INFO:tasks.workunit.client.0.smithi117.stdout:9/723: creat d1/d8/df/d3e/fe9 x:0 0 0 2024-04-12T09:11:21.731 INFO:tasks.workunit.client.1.smithi203.stdout:8/97: read - d4/d8/d19/f1b zero size 2024-04-12T09:11:21.731 INFO:tasks.workunit.client.1.smithi203.stdout:1/138: getdents df/d20/d2b 0 2024-04-12T09:11:21.731 INFO:tasks.workunit.client.1.smithi203.stdout:8/98: dread - d4/d8/d19/f1e zero size 2024-04-12T09:11:21.732 INFO:tasks.workunit.client.1.smithi203.stdout:8/99: read d4/d8/fc [2018480,127518] 0 2024-04-12T09:11:21.733 INFO:tasks.workunit.client.1.smithi203.stdout:8/100: write d4/d8/fd [3774013,31501] 0 2024-04-12T09:11:21.734 INFO:tasks.workunit.client.1.smithi203.stdout:8/101: fsync d4/f13 0 2024-04-12T09:11:21.737 INFO:tasks.workunit.client.1.smithi203.stdout:0/168: dread d0/f3 [0,4194304] 0 2024-04-12T09:11:21.740 INFO:tasks.workunit.client.1.smithi203.stdout:5/202: symlink d0/d6/d16/l4e 0 2024-04-12T09:11:21.743 INFO:tasks.workunit.client.0.smithi117.stdout:7/679: symlink d0/ld6 0 2024-04-12T09:11:21.744 INFO:tasks.workunit.client.1.smithi203.stdout:4/113: stat l9 0 2024-04-12T09:11:21.745 INFO:tasks.workunit.client.0.smithi117.stdout:7/680: chown d0/ca0 34325 1 2024-04-12T09:11:21.745 INFO:tasks.workunit.client.0.smithi117.stdout:0/947: dwrite d3/fc3 [0,4194304] 0 2024-04-12T09:11:21.746 INFO:tasks.workunit.client.1.smithi203.stdout:1/139: symlink df/l2c 0 2024-04-12T09:11:21.746 INFO:tasks.workunit.client.1.smithi203.stdout:1/140: stat df/f1d 0 2024-04-12T09:11:21.747 INFO:tasks.workunit.client.0.smithi117.stdout:0/948: dread - d3/da2/dee/dd5/dff/d91/d94/d5a/d11d/f138 zero size 2024-04-12T09:11:21.749 INFO:tasks.workunit.client.0.smithi117.stdout:6/788: getdents d8/d2a 0 2024-04-12T09:11:21.749 INFO:tasks.workunit.client.0.smithi117.stdout:0/949: read - d3/d59/f133 zero size 2024-04-12T09:11:21.750 INFO:tasks.workunit.client.1.smithi203.stdout:2/130: sync 2024-04-12T09:11:21.750 INFO:tasks.workunit.client.1.smithi203.stdout:9/102: sync 2024-04-12T09:11:21.751 INFO:tasks.workunit.client.1.smithi203.stdout:9/103: fdatasync d8/d12/f19 0 2024-04-12T09:11:21.752 INFO:tasks.workunit.client.1.smithi203.stdout:2/131: truncate d0/d3/f17 350177 0 2024-04-12T09:11:21.752 INFO:tasks.workunit.client.1.smithi203.stdout:0/169: symlink d0/d1d/l3a 0 2024-04-12T09:11:21.755 INFO:tasks.workunit.client.0.smithi117.stdout:6/789: read d8/d9/d61/f65 [407602,129770] 0 2024-04-12T09:11:21.758 INFO:tasks.workunit.client.0.smithi117.stdout:0/950: chown d3/da2/dee/dd5/dff/d91/d94/d5a/d62/fb5 64020 1 2024-04-12T09:11:21.762 INFO:tasks.workunit.client.1.smithi203.stdout:4/114: rmdir d1a 39 2024-04-12T09:11:21.763 INFO:tasks.workunit.client.0.smithi117.stdout:6/790: symlink d8/d2a/d60/d89/dea/lfc 0 2024-04-12T09:11:21.763 INFO:tasks.workunit.client.1.smithi203.stdout:1/141: mkdir df/d2d 0 2024-04-12T09:11:21.764 INFO:tasks.workunit.client.0.smithi117.stdout:0/951: rmdir d3/da2/dee/d76/de2 39 2024-04-12T09:11:21.768 INFO:tasks.workunit.client.0.smithi117.stdout:0/952: rmdir d3/da2/dee/dd5/dff/d84/dc2 39 2024-04-12T09:11:21.768 INFO:tasks.workunit.client.1.smithi203.stdout:1/142: dwrite df/f1d [0,4194304] 0 2024-04-12T09:11:21.771 INFO:tasks.workunit.client.1.smithi203.stdout:8/102: dwrite d4/f15 [0,4194304] 0 2024-04-12T09:11:21.773 INFO:tasks.workunit.client.1.smithi203.stdout:2/132: write d0/d3/f29 [4201422,104566] 0 2024-04-12T09:11:21.773 INFO:tasks.workunit.client.0.smithi117.stdout:6/791: creat d8/d3f/d51/ffd x:0 0 0 2024-04-12T09:11:21.782 INFO:tasks.workunit.client.0.smithi117.stdout:0/953: creat d3/f13a x:0 0 0 2024-04-12T09:11:21.784 INFO:tasks.workunit.client.0.smithi117.stdout:0/954: fdatasync d3/da2/dee/dd5/dff/d91/f127 0 2024-04-12T09:11:21.785 INFO:tasks.workunit.client.0.smithi117.stdout:0/955: readlink d3/da2/dee/d76/d83/da8/d97/l9f 0 2024-04-12T09:11:21.786 INFO:tasks.workunit.client.1.smithi203.stdout:9/104: rename l2 to d8/d12/d23/d29/l2b 0 2024-04-12T09:11:21.787 INFO:tasks.workunit.client.1.smithi203.stdout:8/103: creat d4/f1f x:0 0 0 2024-04-12T09:11:21.788 INFO:tasks.workunit.client.1.smithi203.stdout:5/203: dwrite d0/d6/fe [0,4194304] 0 2024-04-12T09:11:21.788 INFO:tasks.workunit.client.1.smithi203.stdout:9/105: dread - d8/d12/d14/f1f zero size 2024-04-12T09:11:21.789 INFO:tasks.workunit.client.1.smithi203.stdout:1/143: dread df/f1e [0,4194304] 0 2024-04-12T09:11:21.790 INFO:tasks.workunit.client.1.smithi203.stdout:1/144: stat df/c10 0 2024-04-12T09:11:21.790 INFO:tasks.workunit.client.1.smithi203.stdout:5/204: write d0/d6/d11/d18/d1a/f3f [508822,85882] 0 2024-04-12T09:11:21.792 INFO:tasks.workunit.client.1.smithi203.stdout:5/205: readlink d0/d6/d11/d18/d2a/l28 0 2024-04-12T09:11:21.795 INFO:tasks.workunit.client.0.smithi117.stdout:8/823: sync 2024-04-12T09:11:21.799 INFO:tasks.workunit.client.0.smithi117.stdout:0/956: symlink d3/ddd/l13b 0 2024-04-12T09:11:21.799 INFO:tasks.workunit.client.0.smithi117.stdout:0/957: chown d3/da2/dee/f33 2046539376 1 2024-04-12T09:11:21.800 INFO:tasks.workunit.client.0.smithi117.stdout:6/792: write d8/d9/fb6 [992934,45955] 0 2024-04-12T09:11:21.800 INFO:tasks.workunit.client.1.smithi203.stdout:7/125: getdents d0/d4/d1c 0 2024-04-12T09:11:21.802 INFO:tasks.workunit.client.1.smithi203.stdout:4/115: mkdir d1a/d1d/d23 0 2024-04-12T09:11:21.804 INFO:tasks.workunit.client.0.smithi117.stdout:8/824: symlink db/d13/d38/dc3/de9/l112 0 2024-04-12T09:11:21.805 INFO:tasks.workunit.client.0.smithi117.stdout:6/793: fdatasync d8/fc9 0 2024-04-12T09:11:21.807 INFO:tasks.workunit.client.0.smithi117.stdout:8/825: mkdir db/d77/d113 0 2024-04-12T09:11:21.809 INFO:tasks.workunit.client.1.smithi203.stdout:2/133: creat d0/d2e/f34 x:0 0 0 2024-04-12T09:11:21.813 INFO:tasks.workunit.client.1.smithi203.stdout:0/170: rename d0/dd/f24 to d0/d1d/d2f/d17/d19/f3b 0 2024-04-12T09:11:21.814 INFO:tasks.workunit.client.0.smithi117.stdout:6/794: mkdir d8/d2a/d60/d89/dfe 0 2024-04-12T09:11:21.817 INFO:tasks.workunit.client.0.smithi117.stdout:8/826: mkdir db/d1b/d62/df0/d114 0 2024-04-12T09:11:21.818 INFO:tasks.workunit.client.1.smithi203.stdout:0/171: dwrite d0/dd/f1b [0,4194304] 0 2024-04-12T09:11:21.821 INFO:tasks.workunit.client.0.smithi117.stdout:6/795: symlink d8/d2a/d60/d7d/d9b/lff 0 2024-04-12T09:11:21.822 INFO:tasks.workunit.client.1.smithi203.stdout:1/145: rename df/d20/l25 to df/d20/l2e 0 2024-04-12T09:11:21.823 INFO:tasks.workunit.client.0.smithi117.stdout:8/827: chown db/d1b/d62/dae/db4 22951 1 2024-04-12T09:11:21.826 INFO:tasks.workunit.client.1.smithi203.stdout:7/126: symlink d0/d15/l2b 0 2024-04-12T09:11:21.826 INFO:tasks.workunit.client.1.smithi203.stdout:7/127: stat d0/d15/f20 0 2024-04-12T09:11:21.827 INFO:tasks.workunit.client.1.smithi203.stdout:7/128: write d0/d4/f17 [291025,5736] 0 2024-04-12T09:11:21.829 INFO:tasks.workunit.client.1.smithi203.stdout:4/116: unlink c12 0 2024-04-12T09:11:21.830 INFO:tasks.workunit.client.0.smithi117.stdout:8/828: fdatasync db/d19/d1a/d3d/d60/d70/ffb 0 2024-04-12T09:11:21.830 INFO:tasks.workunit.client.1.smithi203.stdout:4/117: write fc [244218,113777] 0 2024-04-12T09:11:21.831 INFO:tasks.workunit.client.0.smithi117.stdout:6/796: dwrite d8/d3f/d51/f88 [0,4194304] 0 2024-04-12T09:11:21.833 INFO:tasks.workunit.client.1.smithi203.stdout:2/134: unlink d0/d3/f29 0 2024-04-12T09:11:21.834 INFO:tasks.workunit.client.1.smithi203.stdout:2/135: fdatasync d0/f32 0 2024-04-12T09:11:21.834 INFO:tasks.workunit.client.1.smithi203.stdout:2/136: chown d0 2643622 1 2024-04-12T09:11:21.834 INFO:tasks.workunit.client.1.smithi203.stdout:2/137: chown d0/d19 0 1 2024-04-12T09:11:21.836 INFO:tasks.workunit.client.0.smithi117.stdout:6/797: read d8/d2a/f92 [630576,84177] 0 2024-04-12T09:11:21.845 INFO:tasks.workunit.client.1.smithi203.stdout:0/172: write d0/d1d/d2f/f33 [1976143,10771] 0 2024-04-12T09:11:21.852 INFO:tasks.workunit.client.1.smithi203.stdout:2/138: mknod d0/d3/c35 0 2024-04-12T09:11:21.852 INFO:tasks.workunit.client.1.smithi203.stdout:5/206: dwrite d0/d6/d16/d9/f2e [0,4194304] 0 2024-04-12T09:11:21.853 INFO:tasks.workunit.client.1.smithi203.stdout:5/207: fdatasync d0/d6/d11/d1e/f45 0 2024-04-12T09:11:21.853 INFO:tasks.workunit.client.1.smithi203.stdout:1/146: mknod df/d2d/c2f 0 2024-04-12T09:11:21.855 INFO:tasks.workunit.client.1.smithi203.stdout:0/173: symlink d0/d1d/d2f/d17/l3c 0 2024-04-12T09:11:21.855 INFO:tasks.workunit.client.1.smithi203.stdout:6/109: sync 2024-04-12T09:11:21.855 INFO:tasks.workunit.client.1.smithi203.stdout:0/174: stat d0/dd/f16 0 2024-04-12T09:11:21.856 INFO:tasks.workunit.client.1.smithi203.stdout:6/110: chown d1/df 660217 1 2024-04-12T09:11:21.857 INFO:tasks.workunit.client.1.smithi203.stdout:0/175: fsync d0/d1d/d2f/d17/d19/f26 0 2024-04-12T09:11:21.857 INFO:tasks.workunit.client.1.smithi203.stdout:6/111: fsync d1/d3/d12/f1f 0 2024-04-12T09:11:21.859 INFO:tasks.workunit.client.1.smithi203.stdout:8/104: truncate d4/f15 2108998 0 2024-04-12T09:11:21.860 INFO:tasks.workunit.client.1.smithi203.stdout:0/176: dread d0/d1d/d2f/d17/d19/f26 [0,4194304] 0 2024-04-12T09:11:21.863 INFO:tasks.workunit.client.1.smithi203.stdout:2/139: creat d0/d3/f36 x:0 0 0 2024-04-12T09:11:21.865 INFO:tasks.workunit.client.1.smithi203.stdout:5/208: rmdir d0/d6/d11/d1e 39 2024-04-12T09:11:21.866 INFO:tasks.workunit.client.1.smithi203.stdout:5/209: truncate d0/f35 2717503 0 2024-04-12T09:11:21.866 INFO:tasks.workunit.client.0.smithi117.stdout:6/798: dread d8/d3a/d49/f4e [0,4194304] 0 2024-04-12T09:11:21.866 INFO:tasks.workunit.client.0.smithi117.stdout:8/829: dwrite db/d19/d1a/d3d/f47 [0,4194304] 0 2024-04-12T09:11:21.868 INFO:tasks.workunit.client.0.smithi117.stdout:8/830: read - db/d19/dd2/fe3 zero size 2024-04-12T09:11:21.871 INFO:tasks.workunit.client.1.smithi203.stdout:7/129: rename d0/d4/c28 to d0/c2c 0 2024-04-12T09:11:21.877 INFO:tasks.workunit.client.1.smithi203.stdout:0/177: dread d0/dd/f16 [0,4194304] 0 2024-04-12T09:11:21.877 INFO:tasks.workunit.client.1.smithi203.stdout:6/112: symlink d1/l22 0 2024-04-12T09:11:21.878 INFO:tasks.workunit.client.1.smithi203.stdout:6/113: chown d1/d3/d12/f1f 87 1 2024-04-12T09:11:21.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.878+0000 7fd07a6de700 1 -- 172.21.15.117:0/999090917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0740fdff0 msgr2=0x7fd0740fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:21.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.878+0000 7fd07a6de700 1 --2- 172.21.15.117:0/999090917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0740fdff0 0x7fd0740fe460 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd068004940 tx=0x7fd068009e30 comp rx=0 tx=0).stop 2024-04-12T09:11:21.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.878+0000 7fd07a6de700 1 -- 172.21.15.117:0/999090917 shutdown_connections 2024-04-12T09:11:21.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.878+0000 7fd07a6de700 1 --2- 172.21.15.117:0/999090917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0740fdff0 0x7fd0740fe460 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:21.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.878+0000 7fd07a6de700 1 --2- 172.21.15.117:0/999090917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0740fce80 0x7fd0740fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:21.880 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.878+0000 7fd07a6de700 1 -- 172.21.15.117:0/999090917 >> 172.21.15.117:0/999090917 conn(0x7fd0740f8540 msgr2=0x7fd0740fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:11:21.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.879+0000 7fd07a6de700 1 -- 172.21.15.117:0/999090917 shutdown_connections 2024-04-12T09:11:21.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.879+0000 7fd07a6de700 1 -- 172.21.15.117:0/999090917 wait complete. 2024-04-12T09:11:21.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.879+0000 7fd07a6de700 1 Processor -- start 2024-04-12T09:11:21.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.880+0000 7fd07a6de700 1 -- start start 2024-04-12T09:11:21.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.880+0000 7fd07a6de700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0740fce80 0x7fd07410b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:21.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.880+0000 7fd07a6de700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0740fdff0 0x7fd07410bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:21.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.880+0000 7fd07a6de700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07410c290 con 0x7fd0740fce80 2024-04-12T09:11:21.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.880+0000 7fd07a6de700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07410cb80 con 0x7fd0740fdff0 2024-04-12T09:11:21.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.880+0000 7fd0737fe700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0740fdff0 0x7fd07410bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:21.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.880+0000 7fd0737fe700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0740fdff0 0x7fd07410bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.117:58226/0 (socket says 172.21.15.117:58226) 2024-04-12T09:11:21.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.880+0000 7fd0737fe700 1 -- 172.21.15.117:0/235889630 learned_addr learned my addr 172.21.15.117:0/235889630 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:11:21.883 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.881+0000 7fd0737fe700 1 -- 172.21.15.117:0/235889630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0740fce80 msgr2=0x7fd07410b7a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T09:11:21.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.881+0000 7fd0737fe700 1 --2- 172.21.15.117:0/235889630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0740fce80 0x7fd07410b7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:21.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.881+0000 7fd0737fe700 1 -- 172.21.15.117:0/235889630 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd068005040 con 0x7fd0740fdff0 2024-04-12T09:11:21.884 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.881+0000 7fd0737fe700 1 --2- 172.21.15.117:0/235889630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0740fdff0 0x7fd07410bce0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd06800b970 tx=0x7fd068009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:11:21.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.881+0000 7fd070ff9700 1 -- 172.21.15.117:0/235889630 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd06800e070 con 0x7fd0740fdff0 2024-04-12T09:11:21.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.881+0000 7fd070ff9700 1 -- 172.21.15.117:0/235889630 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd06800bbf0 con 0x7fd0740fdff0 2024-04-12T09:11:21.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.881+0000 7fd07a6de700 1 -- 172.21.15.117:0/235889630 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd07410cd20 con 0x7fd0740fdff0 2024-04-12T09:11:21.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.881+0000 7fd07a6de700 1 -- 172.21.15.117:0/235889630 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd07410d2e0 con 0x7fd0740fdff0 2024-04-12T09:11:21.885 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.882+0000 7fd070ff9700 1 -- 172.21.15.117:0/235889630 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd06801c400 con 0x7fd0740fdff0 2024-04-12T09:11:21.886 INFO:tasks.workunit.client.0.smithi117.stdout:8/831: stat db/d19/d1a/d3d/d60/f88 0 2024-04-12T09:11:21.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.883+0000 7fd07a6de700 1 -- 172.21.15.117:0/235889630 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd07405f5f0 con 0x7fd0740fdff0 2024-04-12T09:11:21.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.883+0000 7fd070ff9700 1 -- 172.21.15.117:0/235889630 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) v1 ==== 89201+0+0 (secure 0 0 0) 0x7fd06800bd60 con 0x7fd0740fdff0 2024-04-12T09:11:21.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.884+0000 7fd070ff9700 1 --2- 172.21.15.117:0/235889630 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fd05c06b660 0x7fd05c06db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:21.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.884+0000 7fd070ff9700 1 -- 172.21.15.117:0/235889630 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fd06808bbe0 con 0x7fd0740fdff0 2024-04-12T09:11:21.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.884+0000 7fd073fff700 1 --2- 172.21.15.117:0/235889630 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fd05c06b660 0x7fd05c06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:21.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.885+0000 7fd073fff700 1 --2- 172.21.15.117:0/235889630 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fd05c06b660 0x7fd05c06db10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd07410b530 tx=0x7fd06c009b50 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:11:21.889 INFO:tasks.workunit.client.1.smithi203.stdout:4/118: link l18 d1a/d21/l24 0 2024-04-12T09:11:21.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:21.889+0000 7fd070ff9700 1 -- 172.21.15.117:0/235889630 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7fd068055980 con 0x7fd0740fdff0 2024-04-12T09:11:21.892 INFO:tasks.workunit.client.0.smithi117.stdout:6/799: dwrite d8/f1a [0,4194304] 0 2024-04-12T09:11:21.896 INFO:tasks.workunit.client.1.smithi203.stdout:5/210: truncate d0/d6/d16/d9/f24 4936336 0 2024-04-12T09:11:21.897 INFO:tasks.workunit.client.1.smithi203.stdout:5/211: write d0/f4 [3550513,25139] 0 2024-04-12T09:11:21.898 INFO:tasks.workunit.client.0.smithi117.stdout:8/832: mknod db/d13/d38/dc5/c115 0 2024-04-12T09:11:21.901 INFO:tasks.workunit.client.0.smithi117.stdout:6/800: rename d8/d9/d17/d2d/dc1/fdf to d8/d2a/d60/d89/da2/f100 0 2024-04-12T09:11:21.902 INFO:tasks.workunit.client.0.smithi117.stdout:8/833: creat db/d13/d38/dc3/de9/f116 x:0 0 0 2024-04-12T09:11:21.903 INFO:tasks.workunit.client.1.smithi203.stdout:0/178: creat d0/d1d/f3d x:0 0 0 2024-04-12T09:11:21.905 INFO:tasks.workunit.client.1.smithi203.stdout:8/105: mknod d4/d8/d1c/c20 0 2024-04-12T09:11:21.907 INFO:tasks.workunit.client.0.smithi117.stdout:6/801: rename d8/d3f/d51 to d8/d9/d17/d33/d101 0 2024-04-12T09:11:21.913 INFO:tasks.workunit.client.0.smithi117.stdout:8/834: dread db/d19/d1a/f79 [0,4194304] 0 2024-04-12T09:11:21.914 INFO:tasks.workunit.client.1.smithi203.stdout:2/140: truncate d0/f18 3101840 0 2024-04-12T09:11:21.915 INFO:tasks.workunit.client.1.smithi203.stdout:2/141: readlink d0/d3/l2c 0 2024-04-12T09:11:21.921 INFO:tasks.workunit.client.0.smithi117.stdout:8/835: symlink db/d1b/d62/dae/db4/l117 0 2024-04-12T09:11:21.922 INFO:tasks.workunit.client.1.smithi203.stdout:7/130: mkdir d0/d15/d2d 0 2024-04-12T09:11:21.923 INFO:tasks.workunit.client.1.smithi203.stdout:3/104: sync 2024-04-12T09:11:21.923 INFO:tasks.workunit.client.0.smithi117.stdout:6/802: creat d8/d9/d39/f102 x:0 0 0 2024-04-12T09:11:21.923 INFO:tasks.workunit.client.1.smithi203.stdout:8/106: mknod d4/d8/d1c/c21 0 2024-04-12T09:11:21.924 INFO:tasks.workunit.client.1.smithi203.stdout:8/107: write d4/d8/f1d [1026272,9909] 0 2024-04-12T09:11:21.925 INFO:tasks.workunit.client.1.smithi203.stdout:0/179: truncate d0/d1d/d2f/d17/fc 1166856 0 2024-04-12T09:11:21.928 INFO:tasks.workunit.client.0.smithi117.stdout:8/836: dwrite db/d13/f4d [0,4194304] 0 2024-04-12T09:11:21.928 INFO:tasks.workunit.client.1.smithi203.stdout:7/131: symlink d0/d15/l2e 0 2024-04-12T09:11:21.930 INFO:tasks.workunit.client.1.smithi203.stdout:3/105: rename d2/d8/d14/l1a to d2/d8/d14/l20 0 2024-04-12T09:11:21.933 INFO:tasks.workunit.client.1.smithi203.stdout:4/119: creat d1a/d21/d22/f25 x:0 0 0 2024-04-12T09:11:21.935 INFO:tasks.workunit.client.1.smithi203.stdout:0/180: fdatasync d0/dd/f16 0 2024-04-12T09:11:21.936 INFO:tasks.workunit.client.0.smithi117.stdout:8/837: symlink db/d1b/d55/l118 0 2024-04-12T09:11:21.938 INFO:tasks.workunit.client.1.smithi203.stdout:8/108: mknod d4/d8/d19/c22 0 2024-04-12T09:11:21.940 INFO:tasks.workunit.client.1.smithi203.stdout:8/109: write d4/d8/d19/f1e [56906,102230] 0 2024-04-12T09:11:21.941 INFO:tasks.workunit.client.0.smithi117.stdout:6/803: rename d8/d3a/d49/da4/c76 to d8/d3a/d49/c103 0 2024-04-12T09:11:21.946 INFO:tasks.workunit.client.0.smithi117.stdout:6/804: symlink d8/d2a/d60/d7d/d9b/l104 0 2024-04-12T09:11:21.947 INFO:tasks.workunit.client.1.smithi203.stdout:2/142: write d0/f18 [2284654,66012] 0 2024-04-12T09:11:21.949 INFO:tasks.workunit.client.1.smithi203.stdout:3/106: rmdir d2/d8 39 2024-04-12T09:11:21.949 INFO:tasks.workunit.client.1.smithi203.stdout:2/143: dread - d0/f32 zero size 2024-04-12T09:11:21.950 INFO:tasks.workunit.client.1.smithi203.stdout:5/212: dwrite d0/d6/d11/d18/f32 [4194304,4194304] 0 2024-04-12T09:11:21.950 INFO:tasks.workunit.client.0.smithi117.stdout:8/838: creat db/d13/d38/def/f119 x:0 0 0 2024-04-12T09:11:21.950 INFO:tasks.workunit.client.1.smithi203.stdout:7/132: dwrite d0/d4/f16 [0,4194304] 0 2024-04-12T09:11:21.951 INFO:tasks.workunit.client.1.smithi203.stdout:2/144: chown d0/c21 86 1 2024-04-12T09:11:21.951 INFO:tasks.workunit.client.0.smithi117.stdout:8/839: chown db/d13/d38/dc3/f7a 117 1 2024-04-12T09:11:21.951 INFO:tasks.workunit.client.1.smithi203.stdout:2/145: fsync d0/d3/f36 0 2024-04-12T09:11:21.955 INFO:tasks.workunit.client.1.smithi203.stdout:2/146: dread d0/d14/d1e/f2b [0,4194304] 0 2024-04-12T09:11:21.956 INFO:tasks.workunit.client.1.smithi203.stdout:2/147: readlink d0/l28 0 2024-04-12T09:11:21.957 INFO:tasks.workunit.client.0.smithi117.stdout:8/840: symlink db/d13/d38/d86/l11a 0 2024-04-12T09:11:21.957 INFO:tasks.workunit.client.1.smithi203.stdout:2/148: stat d0/d3/f9 0 2024-04-12T09:11:21.959 INFO:tasks.workunit.client.1.smithi203.stdout:1/147: sync 2024-04-12T09:11:21.959 INFO:tasks.workunit.client.1.smithi203.stdout:9/106: sync 2024-04-12T09:11:21.959 INFO:tasks.workunit.client.1.smithi203.stdout:6/114: sync 2024-04-12T09:11:21.959 INFO:tasks.workunit.client.1.smithi203.stdout:8/110: creat d4/d8/d19/f23 x:0 0 0 2024-04-12T09:11:21.960 INFO:tasks.workunit.client.1.smithi203.stdout:5/213: dwrite d0/f21 [0,4194304] 0 2024-04-12T09:11:21.961 INFO:tasks.workunit.client.0.smithi117.stdout:6/805: write d8/d2a/fb7 [513308,56190] 0 2024-04-12T09:11:21.962 INFO:tasks.workunit.client.0.smithi117.stdout:6/806: readlink d8/d9/d17/d2d/l4c 0 2024-04-12T09:11:21.962 INFO:tasks.workunit.client.1.smithi203.stdout:1/148: truncate df/f1d 4238911 0 2024-04-12T09:11:21.963 INFO:tasks.workunit.client.0.smithi117.stdout:6/807: readlink d8/d2a/d60/d89/d99/df5/ldd 0 2024-04-12T09:11:21.963 INFO:tasks.workunit.client.1.smithi203.stdout:8/111: write d4/d8/fd [9373457,75793] 0 2024-04-12T09:11:21.965 INFO:tasks.workunit.client.1.smithi203.stdout:4/120: dread f5 [4194304,4194304] 0 2024-04-12T09:11:21.965 INFO:tasks.workunit.client.0.smithi117.stdout:8/841: mkdir db/d4b/d11b 0 2024-04-12T09:11:21.966 INFO:tasks.workunit.client.0.smithi117.stdout:8/842: stat db/d13 0 2024-04-12T09:11:21.969 INFO:tasks.workunit.client.1.smithi203.stdout:2/149: dwrite d0/d3/f36 [0,4194304] 0 2024-04-12T09:11:21.971 INFO:tasks.workunit.client.1.smithi203.stdout:0/181: unlink d0/dd/l10 0 2024-04-12T09:11:21.971 INFO:tasks.workunit.client.0.smithi117.stdout:8/843: creat db/d4b/d9a/f11c x:0 0 0 2024-04-12T09:11:21.972 INFO:tasks.workunit.client.1.smithi203.stdout:0/182: write d0/d1d/d2f/f33 [3191675,77670] 0 2024-04-12T09:11:21.973 INFO:tasks.workunit.client.0.smithi117.stdout:8/844: chown db/d13/d38/d86/fe8 4480 1 2024-04-12T09:11:21.993 INFO:tasks.workunit.client.0.smithi117.stdout:5/870: sync 2024-04-12T09:11:21.994 INFO:tasks.workunit.client.0.smithi117.stdout:5/871: chown d2/d3/dd/d39/d83/d4d/d10c 947050 1 2024-04-12T09:11:21.997 INFO:tasks.workunit.client.0.smithi117.stdout:6/808: creat d8/d9/f105 x:0 0 0 2024-04-12T09:11:21.998 INFO:tasks.workunit.client.0.smithi117.stdout:5/872: truncate d2/d3/de/d1e/d46/de4/dea/f111 590182 0 2024-04-12T09:11:21.999 INFO:tasks.workunit.client.1.smithi203.stdout:9/107: mkdir d8/d12/d23/d29/d2c 0 2024-04-12T09:11:22.000 INFO:tasks.workunit.client.0.smithi117.stdout:6/809: write d8/d2a/d60/d89/fda [442802,120308] 0 2024-04-12T09:11:22.001 INFO:tasks.workunit.client.0.smithi117.stdout:6/810: chown d8/d9/d17 0 1 2024-04-12T09:11:22.001 INFO:tasks.workunit.client.0.smithi117.stdout:8/845: symlink db/d1b/d62/dae/df9/l11d 0 2024-04-12T09:11:22.005 INFO:tasks.workunit.client.1.smithi203.stdout:3/107: write d2/fc [3526537,126972] 0 2024-04-12T09:11:22.006 INFO:tasks.workunit.client.1.smithi203.stdout:6/115: rename d1/f16 to d1/df/d1b/f23 0 2024-04-12T09:11:22.010 INFO:tasks.workunit.client.1.smithi203.stdout:8/112: creat d4/d8/f24 x:0 0 0 2024-04-12T09:11:22.012 INFO:tasks.workunit.client.1.smithi203.stdout:5/214: creat d0/d6/d11/d18/d1a/d23/f4f x:0 0 0 2024-04-12T09:11:22.014 INFO:tasks.workunit.client.0.smithi117.stdout:5/873: dread d2/d3/de/d1e/d35/f63 [0,4194304] 0 2024-04-12T09:11:22.016 INFO:tasks.workunit.client.1.smithi203.stdout:7/133: symlink d0/d15/d2d/l2f 0 2024-04-12T09:11:22.019 INFO:tasks.workunit.client.1.smithi203.stdout:7/134: dread d0/d4/f17 [0,4194304] 0 2024-04-12T09:11:22.023 INFO:tasks.workunit.client.1.smithi203.stdout:1/149: dwrite df/f17 [0,4194304] 0 2024-04-12T09:11:22.023 INFO:tasks.workunit.client.1.smithi203.stdout:1/150: fsync df/f16 0 2024-04-12T09:11:22.027 INFO:tasks.workunit.client.1.smithi203.stdout:2/150: mknod d0/d3/c37 0 2024-04-12T09:11:22.043 INFO:tasks.workunit.client.1.smithi203.stdout:6/116: mknod d1/df/c24 0 2024-04-12T09:11:22.045 INFO:tasks.workunit.client.1.smithi203.stdout:6/117: dread d1/df/d1b/f23 [0,4194304] 0 2024-04-12T09:11:22.050 INFO:tasks.workunit.client.1.smithi203.stdout:5/215: mknod d0/d6/d16/d8/c50 0 2024-04-12T09:11:22.058 INFO:tasks.workunit.client.1.smithi203.stdout:0/183: rename d0/dd/l22 to d0/d1d/d2f/l3e 0 2024-04-12T09:11:22.061 INFO:tasks.workunit.client.1.smithi203.stdout:7/135: rmdir d0/d4 39 2024-04-12T09:11:22.067 INFO:tasks.workunit.client.1.smithi203.stdout:1/151: creat df/d2d/f30 x:0 0 0 2024-04-12T09:11:22.074 INFO:tasks.workunit.client.1.smithi203.stdout:9/108: mkdir d8/d12/d23/d27/d2d 0 2024-04-12T09:11:22.080 INFO:tasks.workunit.client.1.smithi203.stdout:6/118: creat d1/d3/f25 x:0 0 0 2024-04-12T09:11:22.081 INFO:tasks.workunit.client.1.smithi203.stdout:2/151: write d0/d3/f16 [1296041,110671] 0 2024-04-12T09:11:22.085 INFO:tasks.workunit.client.1.smithi203.stdout:5/216: creat d0/d6/d16/d9/d14/f51 x:0 0 0 2024-04-12T09:11:22.098 INFO:tasks.workunit.client.1.smithi203.stdout:3/108: unlink d2/d8/d14/l20 0 2024-04-12T09:11:22.099 INFO:tasks.workunit.client.1.smithi203.stdout:3/109: fsync d2/fa 0 2024-04-12T09:11:22.100 INFO:tasks.workunit.client.1.smithi203.stdout:6/119: mkdir d1/d3/d26 0 2024-04-12T09:11:22.100 INFO:tasks.workunit.client.1.smithi203.stdout:6/120: fdatasync d1/d3/f25 0 2024-04-12T09:11:22.101 INFO:tasks.workunit.client.1.smithi203.stdout:6/121: stat d1/d3/d4/f1d 0 2024-04-12T09:11:22.108 INFO:tasks.workunit.client.1.smithi203.stdout:4/121: link l8 d1a/d21/d22/l26 0 2024-04-12T09:11:22.110 INFO:tasks.workunit.client.1.smithi203.stdout:0/184: symlink d0/l3f 0 2024-04-12T09:11:22.115 INFO:tasks.workunit.client.1.smithi203.stdout:1/152: symlink df/d20/d2b/l31 0 2024-04-12T09:11:22.118 INFO:tasks.workunit.client.1.smithi203.stdout:9/109: write f5 [1764964,4771] 0 2024-04-12T09:11:22.119 INFO:tasks.workunit.client.1.smithi203.stdout:1/153: dwrite f4 [4194304,4194304] 0 2024-04-12T09:11:22.123 INFO:tasks.workunit.client.1.smithi203.stdout:9/110: dread f4 [0,4194304] 0 2024-04-12T09:11:22.124 INFO:tasks.workunit.client.1.smithi203.stdout:3/110: truncate d2/fd 5212814 0 2024-04-12T09:11:22.125 INFO:tasks.workunit.client.1.smithi203.stdout:9/111: dread - d8/fb zero size 2024-04-12T09:11:22.126 INFO:tasks.workunit.client.1.smithi203.stdout:1/154: dwrite f4 [0,4194304] 0 2024-04-12T09:11:22.126 INFO:tasks.workunit.client.1.smithi203.stdout:8/113: getdents d4/d8/d19 0 2024-04-12T09:11:22.127 INFO:tasks.workunit.client.1.smithi203.stdout:8/114: dread - d4/f1f zero size 2024-04-12T09:11:22.128 INFO:tasks.workunit.client.1.smithi203.stdout:8/115: dread - d4/f1f zero size 2024-04-12T09:11:22.131 INFO:tasks.workunit.client.0.smithi117.stdout:5/874: unlink d2/d3/de/d1e/d79/c9e 0 2024-04-12T09:11:22.132 INFO:tasks.workunit.client.1.smithi203.stdout:2/152: getdents d0/d14/d1e/d2a 0 2024-04-12T09:11:22.133 INFO:tasks.workunit.client.0.smithi117.stdout:5/875: write d2/d3/dd/d39/d83/d4d/d6b/da5/f102 [138752,21869] 0 2024-04-12T09:11:22.135 INFO:tasks.workunit.client.1.smithi203.stdout:5/217: rename d0/d6/d11/c17 to d0/d6/d11/d1e/c52 0 2024-04-12T09:11:22.135 INFO:tasks.workunit.client.1.smithi203.stdout:8/116: dwrite d4/f13 [4194304,4194304] 0 2024-04-12T09:11:22.139 INFO:tasks.workunit.client.1.smithi203.stdout:7/136: getdents d0/d4/d1c 0 2024-04-12T09:11:22.142 INFO:tasks.workunit.client.1.smithi203.stdout:8/117: dread d4/d8/f1d [0,4194304] 0 2024-04-12T09:11:22.142 INFO:tasks.workunit.client.0.smithi117.stdout:6/811: rename d8/d9/d61 to d8/d2a/d60/d106 0 2024-04-12T09:11:22.143 INFO:tasks.workunit.client.1.smithi203.stdout:8/118: write d4/d8/f12 [512755,24610] 0 2024-04-12T09:11:22.145 INFO:tasks.workunit.client.1.smithi203.stdout:3/111: chown d2/d8/d14/c1c 8625332 1 2024-04-12T09:11:22.146 INFO:tasks.workunit.client.1.smithi203.stdout:9/112: fsync d8/d12/d23/f26 0 2024-04-12T09:11:22.153 INFO:tasks.workunit.client.1.smithi203.stdout:4/122: dread fb [0,4194304] 0 2024-04-12T09:11:22.153 INFO:tasks.workunit.client.1.smithi203.stdout:0/185: stat d0/d1d/d2f/d17/c20 0 2024-04-12T09:11:22.154 INFO:tasks.workunit.client.1.smithi203.stdout:7/137: dread d0/d4/f17 [0,4194304] 0 2024-04-12T09:11:22.157 INFO:tasks.workunit.client.1.smithi203.stdout:8/119: creat d4/d8/d19/f25 x:0 0 0 2024-04-12T09:11:22.158 INFO:tasks.workunit.client.1.smithi203.stdout:4/123: dwrite d1a/d21/d22/f25 [0,4194304] 0 2024-04-12T09:11:22.160 INFO:tasks.workunit.client.1.smithi203.stdout:1/155: rmdir df 39 2024-04-12T09:11:22.162 INFO:tasks.workunit.client.1.smithi203.stdout:2/153: mkdir d0/d38 0 2024-04-12T09:11:22.163 INFO:tasks.workunit.client.1.smithi203.stdout:2/154: write d0/d14/d23/f2d [308782,111177] 0 2024-04-12T09:11:22.165 INFO:tasks.workunit.client.1.smithi203.stdout:2/155: truncate d0/d3/fd 4457671 0 2024-04-12T09:11:22.165 INFO:tasks.workunit.client.1.smithi203.stdout:5/218: symlink d0/d6/d11/l53 0 2024-04-12T09:11:22.166 INFO:tasks.workunit.client.1.smithi203.stdout:0/186: readlink d0/d1d/d2f/d17/l21 0 2024-04-12T09:11:22.169 INFO:tasks.workunit.client.1.smithi203.stdout:3/112: symlink d2/d8/d14/d1b/l21 0 2024-04-12T09:11:22.171 INFO:tasks.workunit.client.1.smithi203.stdout:3/113: write d2/f18 [3568497,54459] 0 2024-04-12T09:11:22.171 INFO:tasks.workunit.client.1.smithi203.stdout:4/124: mkdir d1a/d21/d27 0 2024-04-12T09:11:22.172 INFO:tasks.workunit.client.0.smithi117.stdout:5/876: write d2/d3/de/f2a [3365088,105360] 0 2024-04-12T09:11:22.172 INFO:tasks.workunit.client.0.smithi117.stdout:8/846: dwrite db/d19/d1a/f79 [0,4194304] 0 2024-04-12T09:11:22.173 INFO:tasks.workunit.client.1.smithi203.stdout:5/219: dwrite d0/d6/d11/d1e/f45 [0,4194304] 0 2024-04-12T09:11:22.174 INFO:tasks.workunit.client.1.smithi203.stdout:4/125: truncate d1a/f1b 302542 0 2024-04-12T09:11:22.174 INFO:tasks.workunit.client.1.smithi203.stdout:5/220: chown d0/d6/d11/d1e/d4c 399 1 2024-04-12T09:11:22.178 INFO:tasks.workunit.client.1.smithi203.stdout:9/113: link d8/f15 d8/d12/d23/d27/f2e 0 2024-04-12T09:11:22.180 INFO:tasks.workunit.client.1.smithi203.stdout:6/122: getdents d1/d3/d4 0 2024-04-12T09:11:22.180 INFO:tasks.workunit.client.1.smithi203.stdout:6/123: chown d1/df/d1b 1 1 2024-04-12T09:11:22.181 INFO:tasks.workunit.client.0.smithi117.stdout:5/877: dread d2/d3/de/fc0 [0,4194304] 0 2024-04-12T09:11:22.183 INFO:tasks.workunit.client.0.smithi117.stdout:8/847: rename db/d19/d1a/d3d/d60/ff2 to db/da6/f11e 0 2024-04-12T09:11:22.184 INFO:tasks.workunit.client.0.smithi117.stdout:5/878: write d2/d3/de/d1e/d79/f98 [3505651,50835] 0 2024-04-12T09:11:22.186 INFO:tasks.workunit.client.0.smithi117.stdout:4/786: sync 2024-04-12T09:11:22.189 INFO:tasks.workunit.client.1.smithi203.stdout:0/187: rmdir d0 39 2024-04-12T09:11:22.192 INFO:tasks.workunit.client.0.smithi117.stdout:8/848: dwrite db/d13/d38/d86/da0/da4/fce [0,4194304] 0 2024-04-12T09:11:22.192 INFO:tasks.workunit.client.0.smithi117.stdout:5/879: dread d2/d3/de/d1e/d35/fd4 [0,4194304] 0 2024-04-12T09:11:22.194 INFO:tasks.workunit.client.0.smithi117.stdout:8/849: write db/d1b/d62/fdf [811020,123812] 0 2024-04-12T09:11:22.196 INFO:tasks.workunit.client.1.smithi203.stdout:7/138: mknod d0/c30 0 2024-04-12T09:11:22.197 INFO:tasks.workunit.client.1.smithi203.stdout:7/139: chown d0/d4/f25 276357513 1 2024-04-12T09:11:22.198 INFO:tasks.workunit.client.0.smithi117.stdout:4/787: mknod d0/d5/d3b/d38/d4f/d79/d9c/c100 0 2024-04-12T09:11:22.208 INFO:tasks.workunit.client.1.smithi203.stdout:4/126: chown ca 51777 1 2024-04-12T09:11:22.211 INFO:tasks.workunit.client.1.smithi203.stdout:6/124: creat d1/d3/f27 x:0 0 0 2024-04-12T09:11:22.214 INFO:tasks.workunit.client.1.smithi203.stdout:8/120: truncate d4/d8/f12 691852 0 2024-04-12T09:11:22.215 INFO:tasks.workunit.client.0.smithi117.stdout:8/850: write db/d19/d1a/d3d/d60/d70/d98/fc0 [82534,106900] 0 2024-04-12T09:11:22.216 INFO:tasks.workunit.client.1.smithi203.stdout:7/140: mknod d0/d4/c31 0 2024-04-12T09:11:22.216 INFO:tasks.workunit.client.1.smithi203.stdout:0/188: stat d0/d1d/d2f/d17/d19/c30 0 2024-04-12T09:11:22.216 INFO:tasks.workunit.client.1.smithi203.stdout:3/114: truncate d2/fd 1112825 0 2024-04-12T09:11:22.217 INFO:tasks.workunit.client.1.smithi203.stdout:7/141: fsync d0/d15/f23 0 2024-04-12T09:11:22.218 INFO:tasks.workunit.client.1.smithi203.stdout:6/125: dwrite d1/df/f18 [0,4194304] 0 2024-04-12T09:11:22.219 INFO:tasks.workunit.client.0.smithi117.stdout:8/851: fsync db/d13/d38/d86/f94 0 2024-04-12T09:11:22.220 INFO:tasks.workunit.client.1.smithi203.stdout:9/114: creat d8/d12/d23/d29/d2c/f2f x:0 0 0 2024-04-12T09:11:22.220 INFO:tasks.workunit.client.1.smithi203.stdout:0/189: dread d0/d1d/d2f/d17/f11 [0,4194304] 0 2024-04-12T09:11:22.221 INFO:tasks.workunit.client.1.smithi203.stdout:2/156: link d0/l6 d0/d19/l39 0 2024-04-12T09:11:22.222 INFO:tasks.workunit.client.1.smithi203.stdout:2/157: fsync d0/d3/f36 0 2024-04-12T09:11:22.223 INFO:tasks.workunit.client.0.smithi117.stdout:4/788: dwrite d0/d5/d3b/f97 [4194304,4194304] 0 2024-04-12T09:11:22.223 INFO:tasks.workunit.client.0.smithi117.stdout:5/880: dwrite d2/d3/dd/d39/d83/d4d/d52/f84 [0,4194304] 0 2024-04-12T09:11:22.225 INFO:tasks.workunit.client.0.smithi117.stdout:4/789: chown d0/d5/d3b/d38/l41 86241433 1 2024-04-12T09:11:22.230 INFO:tasks.workunit.client.0.smithi117.stdout:8/852: rmdir db/d1b/d55 39 2024-04-12T09:11:22.230 INFO:tasks.workunit.client.1.smithi203.stdout:9/115: dwrite d8/d12/f19 [0,4194304] 0 2024-04-12T09:11:22.230 INFO:tasks.workunit.client.1.smithi203.stdout:2/158: dwrite d0/d2e/f34 [0,4194304] 0 2024-04-12T09:11:22.238 INFO:tasks.workunit.client.1.smithi203.stdout:3/115: creat d2/d8/d14/f22 x:0 0 0 2024-04-12T09:11:22.238 INFO:tasks.workunit.client.1.smithi203.stdout:3/116: chown d2 3582423 1 2024-04-12T09:11:22.238 INFO:tasks.workunit.client.0.smithi117.stdout:8/853: dwrite db/d19/d1a/d3d/ff5 [0,4194304] 0 2024-04-12T09:11:22.241 INFO:tasks.workunit.client.1.smithi203.stdout:6/126: rmdir d1 39 2024-04-12T09:11:22.242 INFO:tasks.workunit.client.1.smithi203.stdout:7/142: creat d0/d15/d2d/f32 x:0 0 0 2024-04-12T09:11:22.243 INFO:tasks.workunit.client.1.smithi203.stdout:7/143: chown d0/c30 126 1 2024-04-12T09:11:22.243 INFO:tasks.workunit.client.1.smithi203.stdout:7/144: dread - d0/d15/f20 zero size 2024-04-12T09:11:22.248 INFO:tasks.workunit.client.0.smithi117.stdout:5/881: rename d2/d3/dd/d39/d83/d4d to d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1/d11f 0 2024-04-12T09:11:22.251 INFO:tasks.workunit.client.0.smithi117.stdout:4/790: mkdir d0/d5/d3b/d38/d4f/d79/d9c/dab/d101 0 2024-04-12T09:11:22.253 INFO:tasks.workunit.client.1.smithi203.stdout:0/190: mkdir d0/dd/d40 0 2024-04-12T09:11:22.255 INFO:tasks.workunit.client.1.smithi203.stdout:0/191: write d0/d1d/d2f/d17/d19/f37 [38388,88968] 0 2024-04-12T09:11:22.257 INFO:tasks.workunit.client.1.smithi203.stdout:8/121: rename d4/c1a to d4/d8/c26 0 2024-04-12T09:11:22.259 INFO:tasks.workunit.client.0.smithi117.stdout:4/791: write d0/f37 [1490180,83374] 0 2024-04-12T09:11:22.261 INFO:tasks.workunit.client.0.smithi117.stdout:8/854: rename db/d1b/d55/f68 to db/d19/d1a/d3d/d9c/dd4/f11f 0 2024-04-12T09:11:22.264 INFO:tasks.workunit.client.1.smithi203.stdout:3/117: mkdir d2/d8/d14/d23 0 2024-04-12T09:11:22.265 INFO:tasks.workunit.client.1.smithi203.stdout:3/118: read d2/d8/f1d [356925,24403] 0 2024-04-12T09:11:22.265 INFO:tasks.workunit.client.1.smithi203.stdout:6/127: stat d1/d3/c10 0 2024-04-12T09:11:22.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.265+0000 7fd07a6de700 1 -- 172.21.15.117:0/235889630 --> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd07410d630 con 0x7fd05c06b660 2024-04-12T09:11:22.267 INFO:tasks.workunit.client.1.smithi203.stdout:6/128: write d1/df/f19 [3226949,100395] 0 2024-04-12T09:11:22.267 INFO:tasks.workunit.client.1.smithi203.stdout:7/145: unlink d0/d4/f16 0 2024-04-12T09:11:22.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.267+0000 7fd070ff9700 1 -- 172.21.15.117:0/235889630 <== mgr.24371 v2:172.21.15.203:6828/2773660052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fd07410d630 con 0x7fd05c06b660 2024-04-12T09:11:22.268 INFO:tasks.workunit.client.0.smithi117.stdout:4/792: mknod d0/d2c/d8d/c102 0 2024-04-12T09:11:22.268 INFO:tasks.workunit.client.1.smithi203.stdout:5/221: sync 2024-04-12T09:11:22.269 INFO:tasks.workunit.client.0.smithi117.stdout:4/793: fsync d0/db3/f8b 0 2024-04-12T09:11:22.270 INFO:tasks.workunit.client.1.smithi203.stdout:1/156: getdents df 0 2024-04-12T09:11:22.270 INFO:tasks.workunit.client.0.smithi117.stdout:8/855: mknod db/d13/d38/dc3/d9d/dc9/c120 0 2024-04-12T09:11:22.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.269+0000 7fd07a6de700 1 -- 172.21.15.117:0/235889630 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fd05c06b660 msgr2=0x7fd05c06db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:22.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.269+0000 7fd07a6de700 1 --2- 172.21.15.117:0/235889630 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fd05c06b660 0x7fd05c06db10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd07410b530 tx=0x7fd06c009b50 comp rx=0 tx=0).stop 2024-04-12T09:11:22.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.269+0000 7fd07a6de700 1 -- 172.21.15.117:0/235889630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0740fdff0 msgr2=0x7fd07410bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:22.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.269+0000 7fd07a6de700 1 --2- 172.21.15.117:0/235889630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0740fdff0 0x7fd07410bce0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd06800b970 tx=0x7fd068009e30 comp rx=0 tx=0).stop 2024-04-12T09:11:22.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.270+0000 7fd07a6de700 1 -- 172.21.15.117:0/235889630 shutdown_connections 2024-04-12T09:11:22.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.270+0000 7fd07a6de700 1 --2- 172.21.15.117:0/235889630 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fd05c06b660 0x7fd05c06db10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:22.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.270+0000 7fd07a6de700 1 --2- 172.21.15.117:0/235889630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0740fce80 0x7fd07410b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:22.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.270+0000 7fd07a6de700 1 --2- 172.21.15.117:0/235889630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0740fdff0 0x7fd07410bce0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:22.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.270+0000 7fd07a6de700 1 -- 172.21.15.117:0/235889630 >> 172.21.15.117:0/235889630 conn(0x7fd0740f8540 msgr2=0x7fd0740f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:11:22.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.270+0000 7fd07a6de700 1 -- 172.21.15.117:0/235889630 shutdown_connections 2024-04-12T09:11:22.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.270+0000 7fd07a6de700 1 -- 172.21.15.117:0/235889630 wait complete. 2024-04-12T09:11:22.272 INFO:tasks.workunit.client.0.smithi117.stdout:8/856: truncate db/d1b/fb0 5225009 0 2024-04-12T09:11:22.272 INFO:tasks.workunit.client.0.smithi117.stdout:5/882: link d2/d3/de/d1e/d66/dbe/cc5 d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1/d11f/d6b/da5/d10a/c120 0 2024-04-12T09:11:22.274 INFO:tasks.workunit.client.1.smithi203.stdout:7/146: dwrite d0/d15/d2d/f32 [0,4194304] 0 2024-04-12T09:11:22.276 INFO:tasks.workunit.client.0.smithi117.stdout:8/857: dread db/d19/d1a/d3d/f47 [0,4194304] 0 2024-04-12T09:11:22.277 INFO:tasks.workunit.client.1.smithi203.stdout:9/116: unlink d8/d12/d23/d29/l2b 0 2024-04-12T09:11:22.279 INFO:tasks.workunit.client.1.smithi203.stdout:4/127: getdents d1a/d1d 0 2024-04-12T09:11:22.281 INFO:tasks.workunit.client.0.smithi117.stdout:5/883: creat d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1/d11f/d6b/dcc/f121 x:0 0 0 2024-04-12T09:11:22.283 INFO:tasks.workunit.client.0.smithi117.stdout:5/884: write d2/d3/de/d1e/d79/fe6 [49404,103036] 0 2024-04-12T09:11:22.286 INFO:tasks.workunit.client.0.smithi117.stdout:5/885: truncate d2/d3/dd/d39/d83/dc8/dd1/dd2/dde/f106 523324 0 2024-04-12T09:11:22.287 INFO:tasks.workunit.client.1.smithi203.stdout:3/119: write d2/f13 [8488165,102128] 0 2024-04-12T09:11:22.288 INFO:tasks.workunit.client.0.smithi117.stdout:8/858: mknod db/d1b/d55/c121 0 2024-04-12T09:11:22.288 INFO:tasks.workunit.client.0.smithi117.stdout:8/859: rename db/d77 to db/d77/d113/d122 22 2024-04-12T09:11:22.293 INFO:tasks.workunit.client.0.smithi117.stdout:4/794: creat d0/db3/da7/dcd/dcf/df2/f103 x:0 0 0 2024-04-12T09:11:22.294 INFO:tasks.workunit.client.1.smithi203.stdout:6/129: write d1/df/d1b/f23 [1206834,85821] 0 2024-04-12T09:11:22.298 INFO:tasks.workunit.client.1.smithi203.stdout:5/222: stat d0/d6/d16/d9/d14/f25 0 2024-04-12T09:11:22.299 INFO:tasks.workunit.client.1.smithi203.stdout:5/223: write d0/d6/d16/d9/f24 [2988140,89560] 0 2024-04-12T09:11:22.301 INFO:tasks.workunit.client.1.smithi203.stdout:1/157: unlink df/l13 0 2024-04-12T09:11:22.302 INFO:tasks.workunit.client.1.smithi203.stdout:1/158: fsync df/f2a 0 2024-04-12T09:11:22.302 INFO:tasks.workunit.client.1.smithi203.stdout:1/159: write df/f16 [1714040,85350] 0 2024-04-12T09:11:22.302 INFO:tasks.workunit.client.0.smithi117.stdout:4/795: read - d0/d2c/d67/fda zero size 2024-04-12T09:11:22.305 INFO:tasks.workunit.client.0.smithi117.stdout:5/886: creat d2/d3/de/d1e/d46/de4/dea/d11a/f122 x:0 0 0 2024-04-12T09:11:22.308 INFO:tasks.workunit.client.1.smithi203.stdout:1/160: dwrite f4 [4194304,4194304] 0 2024-04-12T09:11:22.308 INFO:tasks.workunit.client.1.smithi203.stdout:1/161: read df/f1e [1512232,24002] 0 2024-04-12T09:11:22.310 INFO:tasks.workunit.client.1.smithi203.stdout:2/159: rename d0/l12 to d0/d14/d1e/l3a 0 2024-04-12T09:11:22.312 INFO:tasks.workunit.client.1.smithi203.stdout:7/147: mknod d0/d15/c33 0 2024-04-12T09:11:22.313 INFO:tasks.workunit.client.1.smithi203.stdout:2/160: read d0/d3/f9 [1268925,122201] 0 2024-04-12T09:11:22.314 INFO:tasks.workunit.client.1.smithi203.stdout:2/161: stat d0/l26 0 2024-04-12T09:11:22.315 INFO:tasks.workunit.client.0.smithi117.stdout:5/887: rmdir d2/d3/dd/d39/d83 39 2024-04-12T09:11:22.316 INFO:tasks.workunit.client.1.smithi203.stdout:1/162: dwrite df/f17 [0,4194304] 0 2024-04-12T09:11:22.318 INFO:tasks.workunit.client.1.smithi203.stdout:9/117: truncate f4 2848309 0 2024-04-12T09:11:22.320 INFO:tasks.workunit.client.0.smithi117.stdout:1/791: sync 2024-04-12T09:11:22.320 INFO:tasks.workunit.client.0.smithi117.stdout:0/958: sync 2024-04-12T09:11:22.320 INFO:tasks.workunit.client.0.smithi117.stdout:7/681: sync 2024-04-12T09:11:22.320 INFO:tasks.workunit.client.0.smithi117.stdout:9/724: sync 2024-04-12T09:11:22.320 INFO:tasks.workunit.client.0.smithi117.stdout:2/727: sync 2024-04-12T09:11:22.322 INFO:tasks.workunit.client.1.smithi203.stdout:4/128: write f5 [8111141,61142] 0 2024-04-12T09:11:22.323 INFO:tasks.workunit.client.1.smithi203.stdout:4/129: write f5 [9111131,8697] 0 2024-04-12T09:11:22.324 INFO:tasks.workunit.client.1.smithi203.stdout:1/163: dwrite f4 [0,4194304] 0 2024-04-12T09:11:22.325 INFO:tasks.workunit.client.0.smithi117.stdout:5/888: creat d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/f123 x:0 0 0 2024-04-12T09:11:22.325 INFO:tasks.workunit.client.1.smithi203.stdout:1/164: readlink df/l23 0 2024-04-12T09:11:22.327 INFO:tasks.workunit.client.0.smithi117.stdout:8/860: dwrite db/d13/d38/d86/fb2 [0,4194304] 0 2024-04-12T09:11:22.332 INFO:tasks.workunit.client.1.smithi203.stdout:8/122: chown d4/d8/c26 165427 1 2024-04-12T09:11:22.334 INFO:tasks.workunit.client.0.smithi117.stdout:1/792: mkdir d1/dbd/d3f/d72/df8 0 2024-04-12T09:11:22.334 INFO:tasks.workunit.client.1.smithi203.stdout:4/130: dwrite d1a/d1d/f1e [0,4194304] 0 2024-04-12T09:11:22.337 INFO:tasks.workunit.client.1.smithi203.stdout:0/192: dwrite d0/d1d/d2f/d17/fc [0,4194304] 0 2024-04-12T09:11:22.337 INFO:tasks.workunit.client.0.smithi117.stdout:0/959: mkdir d3/da2/dee/dd5/dff/d91/d94/d5a/d11d/d13c 0 2024-04-12T09:11:22.340 INFO:tasks.workunit.client.0.smithi117.stdout:5/889: rmdir d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1/d11f/d6b/da5/d10a 39 2024-04-12T09:11:22.340 INFO:tasks.workunit.client.0.smithi117.stdout:8/861: dread db/d13/d38/dc3/f7a [0,4194304] 0 2024-04-12T09:11:22.340 INFO:tasks.workunit.client.0.smithi117.stdout:1/793: write d1/dbd/d3f/db/d16/db6/da9/d9a/f44 [2087131,56100] 0 2024-04-12T09:11:22.341 INFO:tasks.workunit.client.1.smithi203.stdout:4/131: write d1a/f1b [1107468,29603] 0 2024-04-12T09:11:22.341 INFO:tasks.workunit.client.1.smithi203.stdout:4/132: stat d1a/d21 0 2024-04-12T09:11:22.343 INFO:tasks.workunit.client.0.smithi117.stdout:4/796: dwrite d0/d5/d3b/fb9 [0,4194304] 0 2024-04-12T09:11:22.344 INFO:tasks.workunit.client.0.smithi117.stdout:9/725: dread d1/d24/f2a [0,4194304] 0 2024-04-12T09:11:22.346 INFO:tasks.workunit.client.0.smithi117.stdout:7/682: fsync d0/d2/d1a/d49/f62 0 2024-04-12T09:11:22.347 INFO:tasks.workunit.client.1.smithi203.stdout:5/224: rename d0/d6/d16/d44/l4d to d0/d6/d11/d4a/l54 0 2024-04-12T09:11:22.351 INFO:tasks.workunit.client.1.smithi203.stdout:7/148: readlink d0/l14 0 2024-04-12T09:11:22.353 INFO:tasks.workunit.client.1.smithi203.stdout:5/225: dread d0/d6/d11/d18/d1a/f47 [0,4194304] 0 2024-04-12T09:11:22.356 INFO:tasks.workunit.client.1.smithi203.stdout:2/162: rmdir d0/d3 39 2024-04-12T09:11:22.362 INFO:tasks.workunit.client.0.smithi117.stdout:0/960: symlink d3/da2/dee/d76/d83/da8/d97/dc9/l13d 0 2024-04-12T09:11:22.368 INFO:tasks.workunit.client.0.smithi117.stdout:8/862: truncate db/d13/f9f 348694 0 2024-04-12T09:11:22.371 INFO:tasks.workunit.client.1.smithi203.stdout:8/123: rename d4/d8/d19/f1e to d4/d8/d19/f27 0 2024-04-12T09:11:22.372 INFO:tasks.workunit.client.0.smithi117.stdout:9/726: truncate d1/f4 319717 0 2024-04-12T09:11:22.374 INFO:tasks.workunit.client.1.smithi203.stdout:0/193: chown d0/d1d/d2f/l12 188881 1 2024-04-12T09:11:22.374 INFO:tasks.workunit.client.0.smithi117.stdout:8/863: dwrite db/d13/fb3 [0,4194304] 0 2024-04-12T09:11:22.375 INFO:tasks.workunit.client.1.smithi203.stdout:0/194: chown d0/d1d/d2f/d17/d19/f26 54 1 2024-04-12T09:11:22.377 INFO:tasks.workunit.client.0.smithi117.stdout:2/728: truncate d0/d96/fb7 916009 0 2024-04-12T09:11:22.384 INFO:tasks.workunit.client.0.smithi117.stdout:5/890: write d2/d3/de/d1e/d66/dc2/fe1 [727106,79310] 0 2024-04-12T09:11:22.387 INFO:tasks.workunit.client.0.smithi117.stdout:8/864: creat db/d19/d1a/d3d/d9c/f123 x:0 0 0 2024-04-12T09:11:22.389 INFO:tasks.workunit.client.0.smithi117.stdout:5/891: truncate d2/d3/dd/d39/d83/dc8/fe3 1691992 0 2024-04-12T09:11:22.392 INFO:tasks.workunit.client.0.smithi117.stdout:1/794: dwrite d1/dbd/fae [0,4194304] 0 2024-04-12T09:11:22.392 INFO:tasks.workunit.client.0.smithi117.stdout:0/961: mkdir d3/da2/d13e 0 2024-04-12T09:11:22.393 INFO:tasks.workunit.client.0.smithi117.stdout:7/683: write d0/f1b [4085934,35945] 0 2024-04-12T09:11:22.393 INFO:tasks.workunit.client.1.smithi203.stdout:6/130: sync 2024-04-12T09:11:22.394 INFO:tasks.workunit.client.0.smithi117.stdout:0/962: chown d3/dc/f2e 1968 1 2024-04-12T09:11:22.398 INFO:tasks.workunit.client.0.smithi117.stdout:4/797: write d0/d5/d39/da2/fb8 [1993130,46876] 0 2024-04-12T09:11:22.404 INFO:tasks.workunit.client.1.smithi203.stdout:0/195: fdatasync d0/d1d/d2f/f33 0 2024-04-12T09:11:22.404 INFO:tasks.workunit.client.1.smithi203.stdout:0/196: readlink d0/d1d/d2f/d17/l28 0 2024-04-12T09:11:22.406 INFO:tasks.workunit.client.0.smithi117.stdout:4/798: dwrite d0/d5/d25/dc8/da0/fc7 [0,4194304] 0 2024-04-12T09:11:22.407 INFO:tasks.workunit.client.1.smithi203.stdout:4/133: rename f19 to d1a/d1d/d23/f28 0 2024-04-12T09:11:22.408 INFO:tasks.workunit.client.0.smithi117.stdout:0/963: mkdir d3/d30/d13f 0 2024-04-12T09:11:22.410 INFO:tasks.workunit.client.0.smithi117.stdout:0/964: stat d3/da2/dee/c132 0 2024-04-12T09:11:22.410 INFO:tasks.workunit.client.1.smithi203.stdout:9/118: chown d8/d12/d23/c25 119 1 2024-04-12T09:11:22.412 INFO:tasks.workunit.client.0.smithi117.stdout:0/965: chown d3/da2/dee/dd5/dff/d91/fa9 0 1 2024-04-12T09:11:22.413 INFO:tasks.workunit.client.1.smithi203.stdout:3/120: write d2/fd [1310417,129142] 0 2024-04-12T09:11:22.413 INFO:tasks.workunit.client.1.smithi203.stdout:7/149: dwrite d0/d4/f17 [0,4194304] 0 2024-04-12T09:11:22.414 INFO:tasks.workunit.client.0.smithi117.stdout:4/799: dwrite d0/d5/d39/ffc [0,4194304] 0 2024-04-12T09:11:22.419 INFO:tasks.workunit.client.1.smithi203.stdout:1/165: truncate df/f16 336033 0 2024-04-12T09:11:22.424 INFO:tasks.workunit.client.0.smithi117.stdout:4/800: dread d0/d2c/d3c/f45 [0,4194304] 0 2024-04-12T09:11:22.428 INFO:tasks.workunit.client.0.smithi117.stdout:0/966: dwrite d3/da2/dee/dd5/dff/d91/f127 [0,4194304] 0 2024-04-12T09:11:22.434 INFO:tasks.workunit.client.0.smithi117.stdout:8/865: creat db/d1b/d62/df0/d114/f124 x:0 0 0 2024-04-12T09:11:22.434 INFO:tasks.workunit.client.0.smithi117.stdout:5/892: mkdir d2/d3/d124 0 2024-04-12T09:11:22.436 INFO:tasks.workunit.client.0.smithi117.stdout:5/893: stat d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1/d11f/c95 0 2024-04-12T09:11:22.437 INFO:tasks.workunit.client.1.smithi203.stdout:2/163: link d0/f32 d0/d38/f3b 0 2024-04-12T09:11:22.438 INFO:tasks.workunit.client.0.smithi117.stdout:5/894: readlink d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1/d11f/d52/lf6 0 2024-04-12T09:11:22.439 INFO:tasks.workunit.client.1.smithi203.stdout:6/131: mkdir d1/df/d28 0 2024-04-12T09:11:22.441 INFO:tasks.workunit.client.1.smithi203.stdout:0/197: mknod d0/d1d/c41 0 2024-04-12T09:11:22.442 INFO:tasks.workunit.client.1.smithi203.stdout:2/164: dwrite d0/fc [0,4194304] 0 2024-04-12T09:11:22.444 INFO:tasks.workunit.client.0.smithi117.stdout:4/801: truncate d0/d5/f3f 1024588 0 2024-04-12T09:11:22.444 INFO:tasks.workunit.client.0.smithi117.stdout:4/802: chown d0/d1/fe7 4448 1 2024-04-12T09:11:22.445 INFO:tasks.workunit.client.0.smithi117.stdout:0/967: dread - d3/da2/dee/d76/d83/da8/f103 zero size 2024-04-12T09:11:22.449 INFO:tasks.workunit.client.0.smithi117.stdout:8/866: mknod db/d4b/c125 0 2024-04-12T09:11:22.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.449+0000 7f83c9e45700 1 -- 172.21.15.117:0/2233208061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83c40fc130 msgr2=0x7f83c40fc540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:22.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.449+0000 7f83c9e45700 1 --2- 172.21.15.117:0/2233208061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83c40fc130 0x7f83c40fc540 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f83b4004940 tx=0x7f83b4009e30 comp rx=0 tx=0).stop 2024-04-12T09:11:22.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.449+0000 7f83c9e45700 1 -- 172.21.15.117:0/2233208061 shutdown_connections 2024-04-12T09:11:22.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.449+0000 7f83c9e45700 1 --2- 172.21.15.117:0/2233208061 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83c40fca80 0x7f83c40fae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:22.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.449+0000 7f83c9e45700 1 --2- 172.21.15.117:0/2233208061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83c40fc130 0x7f83c40fc540 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:22.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.449+0000 7f83c9e45700 1 -- 172.21.15.117:0/2233208061 >> 172.21.15.117:0/2233208061 conn(0x7f83c40f6ba0 msgr2=0x7f83c40f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:11:22.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.449+0000 7f83c9e45700 1 -- 172.21.15.117:0/2233208061 shutdown_connections 2024-04-12T09:11:22.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.450+0000 7f83c9e45700 1 -- 172.21.15.117:0/2233208061 wait complete. 2024-04-12T09:11:22.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.450+0000 7f83c9e45700 1 Processor -- start 2024-04-12T09:11:22.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.450+0000 7f83c9e45700 1 -- start start 2024-04-12T09:11:22.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.451+0000 7f83c9e45700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83c40fc130 0x7f83c411ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:22.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.451+0000 7f83c9e45700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83c40fca80 0x7f83c411cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:22.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.451+0000 7f83c9e45700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c411d640 con 0x7f83c40fc130 2024-04-12T09:11:22.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.451+0000 7f83c9e45700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c411daf0 con 0x7f83c40fca80 2024-04-12T09:11:22.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.451+0000 7f83c37fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83c40fc130 0x7f83c411ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:22.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.451+0000 7f83c37fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83c40fc130 0x7f83c411ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47860/0 (socket says 172.21.15.117:47860) 2024-04-12T09:11:22.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.451+0000 7f83c37fe700 1 -- 172.21.15.117:0/1928192736 learned_addr learned my addr 172.21.15.117:0/1928192736 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:11:22.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.451+0000 7f83c37fe700 1 -- 172.21.15.117:0/1928192736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83c40fca80 msgr2=0x7f83c411cff0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-12T09:11:22.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.451+0000 7f83c37fe700 1 --2- 172.21.15.117:0/1928192736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83c40fca80 0x7f83c411cff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:22.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.451+0000 7f83c37fe700 1 -- 172.21.15.117:0/1928192736 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b4005040 con 0x7f83c40fc130 2024-04-12T09:11:22.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.452+0000 7f83c37fe700 1 --2- 172.21.15.117:0/1928192736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83c40fc130 0x7f83c411ca90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f83b4013870 tx=0x7f83b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:11:22.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.452+0000 7f83abfff700 1 -- 172.21.15.117:0/1928192736 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83b4021070 con 0x7f83c40fc130 2024-04-12T09:11:22.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.452+0000 7f83c9e45700 1 -- 172.21.15.117:0/1928192736 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c411dd70 con 0x7f83c40fc130 2024-04-12T09:11:22.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.452+0000 7f83c9e45700 1 -- 172.21.15.117:0/1928192736 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c411e2b0 con 0x7f83c40fc130 2024-04-12T09:11:22.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.452+0000 7f83abfff700 1 -- 172.21.15.117:0/1928192736 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f83b401c400 con 0x7f83c40fc130 2024-04-12T09:11:22.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.452+0000 7f83abfff700 1 -- 172.21.15.117:0/1928192736 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83b400e070 con 0x7f83c40fc130 2024-04-12T09:11:22.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.454+0000 7f83c9e45700 1 -- 172.21.15.117:0/1928192736 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b00052e0 con 0x7f83c40fc130 2024-04-12T09:11:22.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.454+0000 7f83abfff700 1 -- 172.21.15.117:0/1928192736 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 25) v1 ==== 89201+0+0 (secure 0 0 0) 0x7f83b400b670 con 0x7f83c40fc130 2024-04-12T09:11:22.455 INFO:tasks.workunit.client.0.smithi117.stdout:2/729: getdents d0/d4/d10/d27 0 2024-04-12T09:11:22.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.455+0000 7f83abfff700 1 --2- 172.21.15.117:0/1928192736 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f83ac06b610 0x7f83ac06dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:22.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.455+0000 7f83abfff700 1 -- 172.21.15.117:0/1928192736 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f83b408b230 con 0x7f83c40fc130 2024-04-12T09:11:22.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.455+0000 7f83c2ffd700 1 --2- 172.21.15.117:0/1928192736 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f83ac06b610 0x7f83ac06dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:22.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.456+0000 7f83c2ffd700 1 --2- 172.21.15.117:0/1928192736 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f83ac06b610 0x7f83ac06dac0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f83c40f8d60 tx=0x7f83b800b040 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:11:22.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.460+0000 7f83abfff700 1 -- 172.21.15.117:0/1928192736 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f83b4058c20 con 0x7f83c40fc130 2024-04-12T09:11:22.462 INFO:tasks.workunit.client.1.smithi203.stdout:6/132: creat d1/d3/f29 x:0 0 0 2024-04-12T09:11:22.464 INFO:tasks.workunit.client.1.smithi203.stdout:5/226: truncate d0/d6/d11/d1e/f45 1275071 0 2024-04-12T09:11:22.465 INFO:tasks.workunit.client.0.smithi117.stdout:1/795: creat d1/dbd/d3f/db/d16/db6/da9/d9a/ff9 x:0 0 0 2024-04-12T09:11:22.466 INFO:tasks.workunit.client.0.smithi117.stdout:1/796: write d1/dbd/d3f/db/d16/db6/f8e [3871431,91327] 0 2024-04-12T09:11:22.467 INFO:tasks.workunit.client.0.smithi117.stdout:4/803: creat d0/db3/da7/dcd/de6/f104 x:0 0 0 2024-04-12T09:11:22.467 INFO:tasks.workunit.client.0.smithi117.stdout:1/797: stat d1/dbd/d3f/f9b 0 2024-04-12T09:11:22.468 INFO:tasks.workunit.client.0.smithi117.stdout:4/804: chown d0/d72/c5a 12697 1 2024-04-12T09:11:22.469 INFO:tasks.workunit.client.0.smithi117.stdout:0/968: symlink d3/da2/dee/dd5/dff/d91/d94/d5a/l140 0 2024-04-12T09:11:22.472 INFO:tasks.workunit.client.1.smithi203.stdout:8/124: rename d4/f15 to d4/d8/d19/f28 0 2024-04-12T09:11:22.476 INFO:tasks.workunit.client.1.smithi203.stdout:8/125: dread d4/d8/fd [8388608,4194304] 0 2024-04-12T09:11:22.476 INFO:tasks.workunit.client.0.smithi117.stdout:5/895: mknod d2/d3/de/d1e/c125 0 2024-04-12T09:11:22.477 INFO:tasks.workunit.client.1.smithi203.stdout:7/150: mkdir d0/d34 0 2024-04-12T09:11:22.477 INFO:tasks.workunit.client.0.smithi117.stdout:5/896: read - d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1/d11f/ffc zero size 2024-04-12T09:11:22.478 INFO:tasks.workunit.client.0.smithi117.stdout:7/684: link d0/d2/d45/d17/d23/d50/cd4 d0/da/d7c/dae/cd7 0 2024-04-12T09:11:22.484 INFO:tasks.workunit.client.1.smithi203.stdout:6/133: creat d1/d3/f2a x:0 0 0 2024-04-12T09:11:22.485 INFO:tasks.workunit.client.0.smithi117.stdout:0/969: mknod d3/da2/dee/d76/d83/da8/c141 0 2024-04-12T09:11:22.486 INFO:tasks.workunit.client.1.smithi203.stdout:3/121: dwrite d2/d8/f1d [0,4194304] 0 2024-04-12T09:11:22.488 INFO:tasks.workunit.client.1.smithi203.stdout:5/227: fdatasync d0/d6/d11/d18/d1a/f47 0 2024-04-12T09:11:22.488 INFO:tasks.workunit.client.0.smithi117.stdout:4/805: truncate d0/d5/d3b/d38/d4f/d79/d9c/dab/fbb 637589 0 2024-04-12T09:11:22.490 INFO:tasks.workunit.client.0.smithi117.stdout:4/806: dread - d0/db3/da7/dcd/dcf/df2/f103 zero size 2024-04-12T09:11:22.490 INFO:tasks.workunit.client.1.smithi203.stdout:1/166: dwrite df/f1e [0,4194304] 0 2024-04-12T09:11:22.492 INFO:tasks.workunit.client.1.smithi203.stdout:2/165: mknod d0/c3c 0 2024-04-12T09:11:22.494 INFO:tasks.workunit.client.1.smithi203.stdout:3/122: dwrite d2/fc [0,4194304] 0 2024-04-12T09:11:22.497 INFO:tasks.workunit.client.1.smithi203.stdout:4/134: getdents d1a/d20 0 2024-04-12T09:11:22.498 INFO:tasks.workunit.client.1.smithi203.stdout:4/135: dread - d1a/d1d/d23/f28 zero size 2024-04-12T09:11:22.501 INFO:tasks.workunit.client.1.smithi203.stdout:9/119: unlink d8/d12/d14/f24 0 2024-04-12T09:11:22.502 INFO:tasks.workunit.client.1.smithi203.stdout:9/120: write f5 [1634355,118481] 0 2024-04-12T09:11:22.503 INFO:tasks.workunit.client.1.smithi203.stdout:8/126: creat d4/f29 x:0 0 0 2024-04-12T09:11:22.504 INFO:tasks.workunit.client.1.smithi203.stdout:8/127: write d4/d8/f24 [695458,63615] 0 2024-04-12T09:11:22.505 INFO:tasks.workunit.client.1.smithi203.stdout:7/151: creat d0/d4/d1c/f35 x:0 0 0 2024-04-12T09:11:22.510 INFO:tasks.workunit.client.1.smithi203.stdout:6/134: symlink d1/l2b 0 2024-04-12T09:11:22.512 INFO:tasks.workunit.client.0.smithi117.stdout:8/867: creat db/d13/f126 x:0 0 0 2024-04-12T09:11:22.513 INFO:tasks.workunit.client.0.smithi117.stdout:4/807: creat d0/d5/d3b/d38/d4f/f105 x:0 0 0 2024-04-12T09:11:22.515 INFO:tasks.workunit.client.0.smithi117.stdout:2/730: rmdir d0/d43/d30/dec 0 2024-04-12T09:11:22.517 INFO:tasks.workunit.client.1.smithi203.stdout:0/198: creat d0/d1d/d2f/f42 x:0 0 0 2024-04-12T09:11:22.518 INFO:tasks.workunit.client.0.smithi117.stdout:5/897: symlink d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1/d11f/d10c/l126 0 2024-04-12T09:11:22.518 INFO:tasks.workunit.client.1.smithi203.stdout:1/167: readlink df/d20/l2e 0 2024-04-12T09:11:22.520 INFO:tasks.workunit.client.0.smithi117.stdout:1/798: link d1/f10 d1/d64/d45/d4c/ffa 0 2024-04-12T09:11:22.521 INFO:tasks.workunit.client.1.smithi203.stdout:5/228: truncate d0/d6/d16/d9/d14/f25 2468253 0 2024-04-12T09:11:22.522 INFO:tasks.workunit.client.0.smithi117.stdout:2/731: dwrite d0/d4/d10/fa8 [0,4194304] 0 2024-04-12T09:11:22.524 INFO:tasks.workunit.client.1.smithi203.stdout:2/166: mkdir d0/d14/d23/d3d 0 2024-04-12T09:11:22.527 INFO:tasks.workunit.client.1.smithi203.stdout:3/123: rename d2/l19 to d2/d1f/l24 0 2024-04-12T09:11:22.528 INFO:tasks.workunit.client.1.smithi203.stdout:3/124: fsync d2/f13 0 2024-04-12T09:11:22.531 INFO:tasks.workunit.client.0.smithi117.stdout:6/812: sync 2024-04-12T09:11:22.534 INFO:tasks.workunit.client.1.smithi203.stdout:3/125: dwrite d2/fa [0,4194304] 0 2024-04-12T09:11:22.535 INFO:tasks.workunit.client.0.smithi117.stdout:7/685: creat d0/d2/d45/d17/d23/fd8 x:0 0 0 2024-04-12T09:11:22.535 INFO:tasks.workunit.client.1.smithi203.stdout:3/126: write d2/f17 [3506576,84618] 0 2024-04-12T09:11:22.536 INFO:tasks.workunit.client.0.smithi117.stdout:4/808: dread d0/d2c/f4d [0,4194304] 0 2024-04-12T09:11:22.536 INFO:tasks.workunit.client.1.smithi203.stdout:3/127: truncate d2/f18 5093638 0 2024-04-12T09:11:22.537 INFO:tasks.workunit.client.0.smithi117.stdout:4/809: chown d0/db3 431967 1 2024-04-12T09:11:22.537 INFO:tasks.workunit.client.1.smithi203.stdout:3/128: dread - d2/d8/d14/f22 zero size 2024-04-12T09:11:22.537 INFO:tasks.workunit.client.1.smithi203.stdout:3/129: stat d2/c11 0 2024-04-12T09:11:22.539 INFO:tasks.workunit.client.0.smithi117.stdout:6/813: dwrite d8/f1a [0,4194304] 0 2024-04-12T09:11:22.541 INFO:tasks.workunit.client.1.smithi203.stdout:9/121: write d8/f2a [391890,126069] 0 2024-04-12T09:11:22.542 INFO:tasks.workunit.client.0.smithi117.stdout:0/970: truncate d3/da2/dee/d76/db3/fe5 3307769 0 2024-04-12T09:11:22.543 INFO:tasks.workunit.client.1.smithi203.stdout:8/128: creat d4/f2a x:0 0 0 2024-04-12T09:11:22.543 INFO:tasks.workunit.client.0.smithi117.stdout:6/814: readlink d8/d9/ld 0 2024-04-12T09:11:22.544 INFO:tasks.workunit.client.1.smithi203.stdout:8/129: chown d4/d8/d19/f1b 5521 1 2024-04-12T09:11:22.544 INFO:tasks.workunit.client.0.smithi117.stdout:1/799: chown d1/f10 2261324 1 2024-04-12T09:11:22.545 INFO:tasks.workunit.client.0.smithi117.stdout:2/732: fdatasync d0/d43/da5/d8f/fcc 0 2024-04-12T09:11:22.546 INFO:tasks.workunit.client.0.smithi117.stdout:6/815: write d8/d9/d17/d33/d101/f88 [762256,6211] 0 2024-04-12T09:11:22.547 INFO:tasks.workunit.client.0.smithi117.stdout:8/868: fdatasync db/d13/f25 0 2024-04-12T09:11:22.548 INFO:tasks.workunit.client.0.smithi117.stdout:8/869: chown db/d1b/cb6 13237045 1 2024-04-12T09:11:22.550 INFO:tasks.workunit.client.0.smithi117.stdout:6/816: truncate d8/d9/d39/f8e 500347 0 2024-04-12T09:11:22.558 INFO:tasks.workunit.client.1.smithi203.stdout:5/229: rmdir d0/d6/d11/d1e/d4c 39 2024-04-12T09:11:22.558 INFO:tasks.workunit.client.0.smithi117.stdout:0/971: chown d3/da2/dee/c78 22156 1 2024-04-12T09:11:22.560 INFO:tasks.workunit.client.0.smithi117.stdout:5/898: mkdir d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1/d11f/d6b/da5/d127 0 2024-04-12T09:11:22.560 INFO:tasks.workunit.client.0.smithi117.stdout:7/686: dread d0/d2/d45/d17/d23/d39/fb8 [0,4194304] 0 2024-04-12T09:11:22.565 INFO:tasks.workunit.client.0.smithi117.stdout:2/733: fdatasync d0/d4/d10/d27/f9c 0 2024-04-12T09:11:22.569 INFO:tasks.workunit.client.1.smithi203.stdout:3/130: creat d2/d8/d14/d1b/f25 x:0 0 0 2024-04-12T09:11:22.569 INFO:tasks.workunit.client.0.smithi117.stdout:9/727: sync 2024-04-12T09:11:22.572 INFO:tasks.workunit.client.0.smithi117.stdout:6/817: truncate d8/d9/d17/f68 647664 0 2024-04-12T09:11:22.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:22 smithi203 ceph-mon[36428]: Updating smithi117:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T09:11:22.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:22 smithi203 ceph-mon[36428]: pgmap v21: 65 pgs: 65 active+clean; 1.6 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 56 MiB/s rd, 142 MiB/s wr, 432 op/s 2024-04-12T09:11:22.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:22 smithi203 ceph-mon[36428]: Reconfiguring node-exporter.smithi117 (dependencies changed)... 2024-04-12T09:11:22.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:22 smithi203 ceph-mon[36428]: Reconfiguring daemon node-exporter.smithi117 on smithi117 2024-04-12T09:11:22.574 INFO:tasks.workunit.client.1.smithi203.stdout:9/122: dread d8/d12/f16 [0,4194304] 0 2024-04-12T09:11:22.575 INFO:tasks.workunit.client.1.smithi203.stdout:7/152: mknod d0/d34/c36 0 2024-04-12T09:11:22.575 INFO:tasks.workunit.client.1.smithi203.stdout:9/123: read d8/d12/f16 [124167,62734] 0 2024-04-12T09:11:22.576 INFO:tasks.workunit.client.1.smithi203.stdout:8/130: dread d4/d8/fc [0,4194304] 0 2024-04-12T09:11:22.577 INFO:tasks.workunit.client.1.smithi203.stdout:2/167: dread d0/d3/f10 [0,4194304] 0 2024-04-12T09:11:22.577 INFO:tasks.workunit.client.0.smithi117.stdout:4/810: dwrite d0/d5/f6a [4194304,4194304] 0 2024-04-12T09:11:22.577 INFO:tasks.workunit.client.1.smithi203.stdout:6/135: fsync d1/df/f11 0 2024-04-12T09:11:22.578 INFO:tasks.workunit.client.1.smithi203.stdout:8/131: rename d4/d8/d19 to d4/d8/d19/d2b 22 2024-04-12T09:11:22.579 INFO:tasks.workunit.client.1.smithi203.stdout:0/199: symlink d0/dd/d40/l43 0 2024-04-12T09:11:22.579 INFO:tasks.workunit.client.0.smithi117.stdout:6/818: dwrite d8/d3a/f3b [4194304,4194304] 0 2024-04-12T09:11:22.583 INFO:tasks.workunit.client.1.smithi203.stdout:9/124: dwrite d8/fb [0,4194304] 0 2024-04-12T09:11:22.583 INFO:tasks.workunit.client.0.smithi117.stdout:6/819: truncate d8/d9/fb6 1671173 0 2024-04-12T09:11:22.583 INFO:tasks.workunit.client.0.smithi117.stdout:5/899: fdatasync d2/f5d 0 2024-04-12T09:11:22.583 INFO:tasks.workunit.client.0.smithi117.stdout:8/870: write db/d13/d38/d86/fb9 [912665,10248] 0 2024-04-12T09:11:22.586 INFO:tasks.workunit.client.1.smithi203.stdout:1/168: link df/d20/f21 df/d2d/f32 0 2024-04-12T09:11:22.588 INFO:tasks.workunit.client.1.smithi203.stdout:1/169: chown df/l12 1590 1 2024-04-12T09:11:22.588 INFO:tasks.workunit.client.1.smithi203.stdout:5/230: truncate d0/d6/d11/d18/f3b 1065640 0 2024-04-12T09:11:22.589 INFO:tasks.workunit.client.1.smithi203.stdout:1/170: dread df/d20/f21 [0,4194304] 0 2024-04-12T09:11:22.590 INFO:tasks.workunit.client.1.smithi203.stdout:1/171: fsync df/f17 0 2024-04-12T09:11:22.590 INFO:tasks.workunit.client.0.smithi117.stdout:2/734: rename d0/d4/d10/d27/d9a/fcb to d0/d43/d53/d61/d8d/ff5 0 2024-04-12T09:11:22.592 INFO:tasks.workunit.client.1.smithi203.stdout:7/153: chown d0/d4/d1c/c22 13838383 1 2024-04-12T09:11:22.596 INFO:tasks.workunit.client.0.smithi117.stdout:0/972: creat d3/da2/dee/dd5/dff/d91/d94/d5a/d11d/d13c/f142 x:0 0 0 2024-04-12T09:11:22.598 INFO:tasks.workunit.client.1.smithi203.stdout:2/168: dwrite d0/d3/f9 [0,4194304] 0 2024-04-12T09:11:22.600 INFO:tasks.workunit.client.1.smithi203.stdout:8/132: unlink d4/d8/d19/f23 0 2024-04-12T09:11:22.603 INFO:tasks.workunit.client.0.smithi117.stdout:0/973: dwrite d3/dc/f2e [0,4194304] 0 2024-04-12T09:11:22.604 INFO:tasks.workunit.client.0.smithi117.stdout:0/974: dread - d3/d59/f133 zero size 2024-04-12T09:11:22.604 INFO:tasks.workunit.client.0.smithi117.stdout:4/811: mknod d0/d5/d39/d4e/d6b/d83/c106 0 2024-04-12T09:11:22.606 INFO:tasks.workunit.client.1.smithi203.stdout:9/125: creat d8/d12/d23/d29/d2c/f30 x:0 0 0 2024-04-12T09:11:22.607 INFO:tasks.workunit.client.1.smithi203.stdout:9/126: stat d8/fa 0 2024-04-12T09:11:22.607 INFO:tasks.workunit.client.0.smithi117.stdout:0/975: write d3/da2/dee/dd5/dff/f11b [204708,123152] 0 2024-04-12T09:11:22.607 INFO:tasks.workunit.client.0.smithi117.stdout:4/812: read d0/d5/f50 [172135,11480] 0 2024-04-12T09:11:22.609 INFO:tasks.workunit.client.1.smithi203.stdout:4/136: link l18 d1a/l29 0 2024-04-12T09:11:22.610 INFO:tasks.workunit.client.0.smithi117.stdout:6/820: mkdir d8/d2a/d60/d7d/d8c/d107 0 2024-04-12T09:11:22.612 INFO:tasks.workunit.client.0.smithi117.stdout:4/813: chown d0/d2c/d8d/fe0 3849 1 2024-04-12T09:11:22.617 INFO:tasks.workunit.client.1.smithi203.stdout:1/172: creat df/f33 x:0 0 0 2024-04-12T09:11:22.618 INFO:tasks.workunit.client.0.smithi117.stdout:5/900: rename d2/d3/de/d1e/d79/fe6 to d2/d3/dd/d39/d83/dc8/f128 0 2024-04-12T09:11:22.620 INFO:tasks.workunit.client.1.smithi203.stdout:6/136: creat d1/df/d28/f2c x:0 0 0 2024-04-12T09:11:22.622 INFO:tasks.workunit.client.0.smithi117.stdout:9/728: mkdir d1/d8/df/d3e/dea 0 2024-04-12T09:11:22.625 INFO:tasks.workunit.client.0.smithi117.stdout:2/735: dread d0/d43/d53/d61/d66/fa2 [0,4194304] 0 2024-04-12T09:11:22.628 INFO:tasks.workunit.client.0.smithi117.stdout:5/901: dwrite d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1/d11f/d52/f70 [0,4194304] 0 2024-04-12T09:11:22.630 INFO:tasks.workunit.client.0.smithi117.stdout:5/902: chown d2/d3/de/d1e/d2c/leb 6 1 2024-04-12T09:11:22.631 INFO:tasks.workunit.client.1.smithi203.stdout:3/131: link d2/d8/c15 d2/d1f/c26 0 2024-04-12T09:11:22.632 INFO:tasks.workunit.client.0.smithi117.stdout:0/976: creat d3/da2/dee/d76/d83/da8/d9a/f143 x:0 0 0 2024-04-12T09:11:22.633 INFO:tasks.workunit.client.0.smithi117.stdout:2/736: dwrite d0/df/fab [0,4194304] 0 2024-04-12T09:11:22.634 INFO:tasks.workunit.client.0.smithi117.stdout:2/737: stat d0/d4/f9d 0 2024-04-12T09:11:22.637 INFO:tasks.workunit.client.0.smithi117.stdout:2/738: write d0/d4/f5d [3272801,124271] 0 2024-04-12T09:11:22.641 INFO:tasks.workunit.client.1.smithi203.stdout:6/137: readlink d1/d3/l20 0 2024-04-12T09:11:22.641 INFO:tasks.workunit.client.1.smithi203.stdout:0/200: write d0/d1d/d2f/d17/d19/f25 [5213166,50566] 0 2024-04-12T09:11:22.642 INFO:tasks.workunit.client.0.smithi117.stdout:1/800: link d1/dbd/d3f/db/d16/db6/da9/d9a/d54/f86 d1/dc3/ffb 0 2024-04-12T09:11:22.644 INFO:tasks.workunit.client.1.smithi203.stdout:2/169: creat d0/d38/f3e x:0 0 0 2024-04-12T09:11:22.646 INFO:tasks.workunit.client.1.smithi203.stdout:8/133: unlink d4/d8/f12 0 2024-04-12T09:11:22.647 INFO:tasks.workunit.client.0.smithi117.stdout:7/687: write d0/d2/d45/d17/d23/d39/f48 [2151921,29617] 0 2024-04-12T09:11:22.648 INFO:tasks.workunit.client.1.smithi203.stdout:2/170: dread d0/d3/f9 [0,4194304] 0 2024-04-12T09:11:22.649 INFO:tasks.workunit.client.1.smithi203.stdout:9/127: link d8/d12/d14/f1f d8/d12/d23/d29/f31 0 2024-04-12T09:11:22.649 INFO:tasks.workunit.client.1.smithi203.stdout:6/138: dread d1/d3/f1a [0,4194304] 0 2024-04-12T09:11:22.650 INFO:tasks.workunit.client.0.smithi117.stdout:8/871: write db/d13/d38/dc3/f80 [503206,8056] 0 2024-04-12T09:11:22.650 INFO:tasks.workunit.client.1.smithi203.stdout:9/128: truncate d8/f2a 554950 0 2024-04-12T09:11:22.650 INFO:tasks.workunit.client.1.smithi203.stdout:6/139: chown d1/d3/d12/f1e 35838 1 2024-04-12T09:11:22.652 INFO:tasks.workunit.client.1.smithi203.stdout:3/132: creat d2/d8/d14/f27 x:0 0 0 2024-04-12T09:11:22.652 INFO:tasks.workunit.client.1.smithi203.stdout:3/133: chown d2/c12 231 1 2024-04-12T09:11:22.653 INFO:tasks.workunit.client.1.smithi203.stdout:3/134: write d2/d8/f1d [4192824,26228] 0 2024-04-12T09:11:22.655 INFO:tasks.workunit.client.1.smithi203.stdout:5/231: creat d0/d6/d11/d1e/d4c/d48/f55 x:0 0 0 2024-04-12T09:11:22.656 INFO:tasks.workunit.client.1.smithi203.stdout:5/232: truncate d0/d6/d16/d9/d14/f51 804892 0 2024-04-12T09:11:22.659 INFO:tasks.workunit.client.1.smithi203.stdout:1/173: truncate df/f17 871341 0 2024-04-12T09:11:22.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:22 smithi117 ceph-mon[29277]: Updating smithi117:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T09:11:22.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:22 smithi117 ceph-mon[29277]: pgmap v21: 65 pgs: 65 active+clean; 1.6 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 56 MiB/s rd, 142 MiB/s wr, 432 op/s 2024-04-12T09:11:22.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:22 smithi117 ceph-mon[29277]: Reconfiguring node-exporter.smithi117 (dependencies changed)... 2024-04-12T09:11:22.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:22 smithi117 ceph-mon[29277]: Reconfiguring daemon node-exporter.smithi117 on smithi117 2024-04-12T09:11:22.660 INFO:tasks.workunit.client.0.smithi117.stdout:0/977: fdatasync d3/dc/f52 0 2024-04-12T09:11:22.663 INFO:tasks.workunit.client.0.smithi117.stdout:5/903: mknod d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1/d11f/c129 0 2024-04-12T09:11:22.663 INFO:tasks.workunit.client.1.smithi203.stdout:7/154: dwrite d0/d15/f19 [0,4194304] 0 2024-04-12T09:11:22.664 INFO:tasks.workunit.client.1.smithi203.stdout:5/233: dwrite d0/d6/d16/d9/f2e [0,4194304] 0 2024-04-12T09:11:22.664 INFO:tasks.workunit.client.1.smithi203.stdout:7/155: truncate d0/d4/f25 4409607 0 2024-04-12T09:11:22.672 INFO:tasks.workunit.client.0.smithi117.stdout:1/801: rmdir d1/d3b 39 2024-04-12T09:11:22.674 INFO:tasks.workunit.client.1.smithi203.stdout:2/171: rename d0/d3/c35 to d0/d14/d23/d3d/c3f 0 2024-04-12T09:11:22.680 INFO:tasks.workunit.client.1.smithi203.stdout:6/140: creat d1/d3/f2d x:0 0 0 2024-04-12T09:11:22.680 INFO:tasks.workunit.client.1.smithi203.stdout:6/141: chown d1/l22 0 1 2024-04-12T09:11:22.681 INFO:tasks.workunit.client.1.smithi203.stdout:6/142: stat d1/d3/c10 0 2024-04-12T09:11:22.681 INFO:tasks.workunit.client.0.smithi117.stdout:9/729: symlink d1/d8/df/d3e/dea/leb 0 2024-04-12T09:11:22.682 INFO:tasks.workunit.client.1.smithi203.stdout:6/143: write d1/df/f18 [5218563,98414] 0 2024-04-12T09:11:22.684 INFO:tasks.workunit.client.1.smithi203.stdout:9/129: unlink d8/d12/d23/d29/d2c/f2f 0 2024-04-12T09:11:22.685 INFO:tasks.workunit.client.0.smithi117.stdout:8/872: chown db/d1b/d62/dae/f107 519499953 1 2024-04-12T09:11:22.687 INFO:tasks.workunit.client.1.smithi203.stdout:6/144: dwrite d1/d3/d12/f1f [0,4194304] 0 2024-04-12T09:11:22.693 INFO:tasks.workunit.client.0.smithi117.stdout:5/904: read - d2/d3/de/d1e/d35/fdf zero size 2024-04-12T09:11:22.693 INFO:tasks.workunit.client.1.smithi203.stdout:6/145: fsync d1/df/f18 0 2024-04-12T09:11:22.693 INFO:tasks.workunit.client.1.smithi203.stdout:8/134: write d4/d8/f1d [730575,34001] 0 2024-04-12T09:11:22.697 INFO:tasks.workunit.client.0.smithi117.stdout:7/688: write d0/d2/d45/d17/d23/d50/f66 [2079301,110074] 0 2024-04-12T09:11:22.698 INFO:tasks.workunit.client.0.smithi117.stdout:7/689: read - d0/d2/d45/d17/d23/d39/dbd/fbf zero size 2024-04-12T09:11:22.698 INFO:tasks.workunit.client.1.smithi203.stdout:6/146: dread d1/df/f19 [0,4194304] 0 2024-04-12T09:11:22.700 INFO:tasks.workunit.client.1.smithi203.stdout:8/135: dwrite d4/f2a [0,4194304] 0 2024-04-12T09:11:22.704 INFO:tasks.workunit.client.0.smithi117.stdout:9/730: unlink d1/d8/df/d3e/fde 0 2024-04-12T09:11:22.707 INFO:tasks.workunit.client.0.smithi117.stdout:8/873: dread db/d19/d1a/d3d/d9c/faa [0,4194304] 0 2024-04-12T09:11:22.707 INFO:tasks.workunit.client.1.smithi203.stdout:3/135: rename d2/d8/d14/d1b/l21 to d2/d8/d14/l28 0 2024-04-12T09:11:22.708 INFO:tasks.workunit.client.1.smithi203.stdout:3/136: chown d2 742 1 2024-04-12T09:11:22.708 INFO:tasks.workunit.client.0.smithi117.stdout:6/821: link d8/d2a/d60/l74 d8/d9/d17/d33/l108 0 2024-04-12T09:11:22.708 INFO:tasks.workunit.client.1.smithi203.stdout:3/137: fsync d2/d8/d14/f27 0 2024-04-12T09:11:22.709 INFO:tasks.workunit.client.1.smithi203.stdout:3/138: chown d2/c12 12 1 2024-04-12T09:11:22.709 INFO:tasks.workunit.client.0.smithi117.stdout:1/802: write d1/f49 [1792269,75786] 0 2024-04-12T09:11:22.710 INFO:tasks.workunit.client.1.smithi203.stdout:3/139: write d2/f13 [8844266,91331] 0 2024-04-12T09:11:22.712 INFO:tasks.workunit.client.1.smithi203.stdout:3/140: truncate d2/d8/d14/f27 577142 0 2024-04-12T09:11:22.713 INFO:tasks.workunit.client.1.smithi203.stdout:3/141: chown d2/d8/f1d 124588125 1 2024-04-12T09:11:22.713 INFO:tasks.workunit.client.0.smithi117.stdout:5/905: read d2/d3/dd/f89 [695014,110314] 0 2024-04-12T09:11:22.715 INFO:tasks.workunit.client.0.smithi117.stdout:4/814: getdents d0/d1/de9 0 2024-04-12T09:11:22.716 INFO:tasks.workunit.client.0.smithi117.stdout:4/815: dread - d0/d2c/d67/fda zero size 2024-04-12T09:11:22.717 INFO:tasks.workunit.client.0.smithi117.stdout:4/816: write d0/d5/d3b/fdc [1070688,16316] 0 2024-04-12T09:11:22.722 INFO:tasks.workunit.client.1.smithi203.stdout:1/174: write df/f17 [636710,108807] 0 2024-04-12T09:11:22.725 INFO:tasks.workunit.client.1.smithi203.stdout:2/172: dwrite d0/d3/f10 [4194304,4194304] 0 2024-04-12T09:11:22.725 INFO:tasks.workunit.client.1.smithi203.stdout:6/147: dread d1/d3/d12/f1e [0,4194304] 0 2024-04-12T09:11:22.726 INFO:tasks.workunit.client.0.smithi117.stdout:6/822: dread d8/d2a/d60/d106/fa3 [0,4194304] 0 2024-04-12T09:11:22.728 INFO:tasks.workunit.client.0.smithi117.stdout:0/978: creat d3/da2/dee/dd5/dff/d91/d94/d5a/d62/f144 x:0 0 0 2024-04-12T09:11:22.730 INFO:tasks.workunit.client.0.smithi117.stdout:0/979: chown d3/da2/dee/dd5/dff/d91/d94/d5a/d11d/d13c/f142 0 1 2024-04-12T09:11:22.730 INFO:tasks.workunit.client.0.smithi117.stdout:0/980: readlink d3/l9 0 2024-04-12T09:11:22.731 INFO:tasks.workunit.client.1.smithi203.stdout:8/136: creat d4/d8/d1c/f2c x:0 0 0 2024-04-12T09:11:22.731 INFO:tasks.workunit.client.1.smithi203.stdout:8/137: write d4/d8/f24 [1741037,129336] 0 2024-04-12T09:11:22.732 INFO:tasks.workunit.client.1.smithi203.stdout:8/138: stat d4/f9 0 2024-04-12T09:11:22.732 INFO:tasks.workunit.client.1.smithi203.stdout:5/234: write d0/d6/d11/d1e/f45 [68748,33530] 0 2024-04-12T09:11:22.734 INFO:tasks.workunit.client.1.smithi203.stdout:7/156: rename d0/d4/l27 to d0/d15/l37 0 2024-04-12T09:11:22.734 INFO:tasks.workunit.client.1.smithi203.stdout:5/235: rename d0 to d0/d6/d16/d44/d56 22 2024-04-12T09:11:22.735 INFO:tasks.workunit.client.1.smithi203.stdout:4/137: sync 2024-04-12T09:11:22.735 INFO:tasks.workunit.client.0.smithi117.stdout:1/803: write d1/dbd/d51/fb2 [187880,103741] 0 2024-04-12T09:11:22.735 INFO:tasks.workunit.client.0.smithi117.stdout:2/739: getdents d0/d43/d53/d61/d8d 0 2024-04-12T09:11:22.736 INFO:tasks.workunit.client.1.smithi203.stdout:7/157: write d0/d4/f11 [2736084,44557] 0 2024-04-12T09:11:22.739 INFO:tasks.workunit.client.0.smithi117.stdout:7/690: unlink d0/d2/d45/d53/d58/l72 0 2024-04-12T09:11:22.741 INFO:tasks.workunit.client.0.smithi117.stdout:5/906: write d2/d3/dd/f3c [4097039,109776] 0 2024-04-12T09:11:22.743 INFO:tasks.workunit.client.1.smithi203.stdout:3/142: mknod d2/d8/c29 0 2024-04-12T09:11:22.744 INFO:tasks.workunit.client.0.smithi117.stdout:5/907: write d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1/d11f/d52/f103 [2437194,82294] 0 2024-04-12T09:11:22.744 INFO:tasks.workunit.client.1.smithi203.stdout:3/143: dread - d2/d8/d14/f22 zero size 2024-04-12T09:11:22.745 INFO:tasks.workunit.client.1.smithi203.stdout:9/130: truncate d8/f2a 135428 0 2024-04-12T09:11:22.747 INFO:tasks.workunit.client.0.smithi117.stdout:0/981: mknod d3/da2/dee/c145 0 2024-04-12T09:11:22.751 INFO:tasks.workunit.client.1.smithi203.stdout:2/173: symlink d0/d19/l40 0 2024-04-12T09:11:22.752 INFO:tasks.workunit.client.0.smithi117.stdout:7/691: creat d0/da/fd9 x:0 0 0 2024-04-12T09:11:22.755 INFO:tasks.workunit.client.0.smithi117.stdout:8/874: creat db/d1b/f127 x:0 0 0 2024-04-12T09:11:22.756 INFO:tasks.workunit.client.1.smithi203.stdout:0/201: getdents d0/d1d/d2f 0 2024-04-12T09:11:22.760 INFO:tasks.workunit.client.1.smithi203.stdout:8/139: rmdir d4/d8/d19 39 2024-04-12T09:11:22.762 INFO:tasks.workunit.client.1.smithi203.stdout:6/148: write d1/df/f11 [2741989,79483] 0 2024-04-12T09:11:22.764 INFO:tasks.workunit.client.0.smithi117.stdout:0/982: fsync d3/da2/dee/d76/d83/da8/d97/dc9/dd2/f42 0 2024-04-12T09:11:22.765 INFO:tasks.workunit.client.1.smithi203.stdout:4/138: stat ca 0 2024-04-12T09:11:22.768 INFO:tasks.workunit.client.1.smithi203.stdout:6/149: dwrite d1/d3/d12/f1f [0,4194304] 0 2024-04-12T09:11:22.768 INFO:tasks.workunit.client.1.smithi203.stdout:5/236: symlink d0/d6/d16/d44/l57 0 2024-04-12T09:11:22.770 INFO:tasks.workunit.client.0.smithi117.stdout:1/804: creat d1/dbd/dbf/ffc x:0 0 0 2024-04-12T09:11:22.775 INFO:tasks.workunit.client.1.smithi203.stdout:9/131: rename d8/d12/d14/f17 to d8/d12/d23/d27/f32 0 2024-04-12T09:11:22.776 INFO:tasks.workunit.client.1.smithi203.stdout:1/175: fsync df/f16 0 2024-04-12T09:11:22.776 INFO:tasks.workunit.client.0.smithi117.stdout:2/740: dwrite d0/f98 [0,4194304] 0 2024-04-12T09:11:22.777 INFO:tasks.workunit.client.1.smithi203.stdout:2/174: mkdir d0/d2e/d41 0 2024-04-12T09:11:22.783 INFO:tasks.workunit.client.0.smithi117.stdout:2/741: dwrite d0/df/fab [0,4194304] 0 2024-04-12T09:11:22.785 INFO:tasks.workunit.client.1.smithi203.stdout:4/139: readlink l3 0 2024-04-12T09:11:22.788 INFO:tasks.workunit.client.0.smithi117.stdout:6/823: link d8/d9/d17/d2d/cbe d8/d2a/d60/d89/dfe/c109 0 2024-04-12T09:11:22.789 INFO:tasks.workunit.client.1.smithi203.stdout:7/158: mkdir d0/d38 0 2024-04-12T09:11:22.791 INFO:tasks.workunit.client.1.smithi203.stdout:3/144: creat d2/d8/d14/d23/f2a x:0 0 0 2024-04-12T09:11:22.792 INFO:tasks.workunit.client.1.smithi203.stdout:3/145: chown d2/d8/d14 946116546 1 2024-04-12T09:11:22.795 INFO:tasks.workunit.client.1.smithi203.stdout:6/150: rename d1/d3/c10 to d1/df/d28/c2e 0 2024-04-12T09:11:22.795 INFO:tasks.workunit.client.1.smithi203.stdout:6/151: readlink d1/d3/l14 0 2024-04-12T09:11:22.796 INFO:tasks.workunit.client.0.smithi117.stdout:0/983: mkdir d3/da2/dee/dd5/d128/d146 0 2024-04-12T09:11:22.797 INFO:tasks.workunit.client.1.smithi203.stdout:9/132: mknod d8/d12/d23/d29/c33 0 2024-04-12T09:11:22.799 INFO:tasks.workunit.client.0.smithi117.stdout:8/875: dread db/d19/d1a/d3d/f2a [0,4194304] 0 2024-04-12T09:11:22.800 INFO:tasks.workunit.client.0.smithi117.stdout:2/742: rename d0/d43/d30/d41/c28 to d0/d43/d30/cf6 0 2024-04-12T09:11:22.801 INFO:tasks.workunit.client.1.smithi203.stdout:1/176: truncate df/f19 804655 0 2024-04-12T09:11:22.803 INFO:tasks.workunit.client.0.smithi117.stdout:0/984: mknod d3/d59/c147 0 2024-04-12T09:11:22.805 INFO:tasks.workunit.client.0.smithi117.stdout:1/805: creat d1/dbd/d3f/db/d1d/d78/ffd x:0 0 0 2024-04-12T09:11:22.806 INFO:tasks.workunit.client.0.smithi117.stdout:1/806: readlink d1/dbd/d3f/db/d1d/la8 0 2024-04-12T09:11:22.813 INFO:tasks.workunit.client.0.smithi117.stdout:5/908: dwrite d2/d3/dd/f6d [0,4194304] 0 2024-04-12T09:11:22.816 INFO:tasks.workunit.client.1.smithi203.stdout:7/159: mkdir d0/d34/d39 0 2024-04-12T09:11:22.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.815+0000 7f83c9e45700 1 -- 172.21.15.117:0/1928192736 --> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f83b0000bf0 con 0x7f83ac06b610 2024-04-12T09:11:22.819 INFO:tasks.workunit.client.0.smithi117.stdout:8/876: unlink db/d13/d38/dc3/d9d/fc6 0 2024-04-12T09:11:22.820 INFO:tasks.workunit.client.0.smithi117.stdout:8/877: dread - db/d13/d38/dc3/f101 zero size 2024-04-12T09:11:22.823 INFO:tasks.workunit.client.1.smithi203.stdout:6/152: mknod d1/df/d28/c2f 0 2024-04-12T09:11:22.826 INFO:tasks.workunit.client.0.smithi117.stdout:5/909: mkdir d2/d3/de/d1e/d2c/d12a 0 2024-04-12T09:11:22.826 INFO:tasks.workunit.client.0.smithi117.stdout:5/910: chown d2/d3/dd/c26 7418162 1 2024-04-12T09:11:22.827 INFO:tasks.workunit.client.1.smithi203.stdout:1/177: mkdir df/d34 0 2024-04-12T09:11:22.828 INFO:tasks.workunit.client.1.smithi203.stdout:1/178: fsync df/f1e 0 2024-04-12T09:11:22.828 INFO:tasks.workunit.client.1.smithi203.stdout:2/175: mknod d0/d2e/d41/c42 0 2024-04-12T09:11:22.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.828+0000 7f83abfff700 1 -- 172.21.15.117:0/1928192736 <== mgr.24371 v2:172.21.15.203:6828/2773660052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f83b0000bf0 con 0x7f83ac06b610 2024-04-12T09:11:22.829 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:11:22.829 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 running (7m) 5s ago 8m 24.7M - 0.25.0 c8568f914cd2 8fdf255143c1 2024-04-12T09:11:22.829 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (8m) 5s ago 8m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad 1e9f2c6a4491 2024-04-12T09:11:22.830 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (7m) 28s ago 7m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad e42da3f6e517 2024-04-12T09:11:22.830 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 running (6m) 5s ago 8m 82.2M - 9.4.7 954c08fa6188 80596fd1f615 2024-04-12T09:11:22.830 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (3m) 5s ago 2m 157M - 17.2.7-827-gd3b5060a 21de9b7369ad de062e2c10e7 2024-04-12T09:11:22.830 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 running (3m) 5s ago 3m 11.8M - 17.2.7-827-gd3b5060a 21de9b7369ad 1e82c6241a18 2024-04-12T09:11:22.830 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (2m) 28s ago 2m 14.6M - 17.2.7-827-gd3b5060a 21de9b7369ad b05228e997f7 2024-04-12T09:11:22.830 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (3m) 28s ago 3m 15.0M - 17.2.7-827-gd3b5060a 21de9b7369ad 6d7f82c072c7 2024-04-12T09:11:22.830 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:9283 running (9m) 5s ago 9m 335M - 17.2.7-827-gd3b5060a 21de9b7369ad cd0beaa7ece1 2024-04-12T09:11:22.830 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283 running (53s) 28s ago 7m 489M - 19.0.0-2053-gb277feb2 668895944f0e bce98e99ffe8 2024-04-12T09:11:22.830 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (9m) 5s ago 9m 47.5M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad f9d5f7ac5270 2024-04-12T09:11:22.830 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (7m) 28s ago 7m 38.6M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad 17c0db49bb16 2024-04-12T09:11:22.830 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 running (8m) 5s ago 8m 15.9M - 1.5.0 0da6a335fe13 9fb7eb0eaa72 2024-04-12T09:11:22.830 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (7m) 28s ago 7m 16.2M - 1.5.0 0da6a335fe13 be0daeda3393 2024-04-12T09:11:22.830 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (6m) 5s ago 6m 110M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 77040a2498f3 2024-04-12T09:11:22.831 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (6m) 5s ago 6m 119M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 8f9dbf0274ed 2024-04-12T09:11:22.831 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (5m) 5s ago 5m 102M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 339c5a80d1dd 2024-04-12T09:11:22.831 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (5m) 28s ago 5m 120M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad fb87d616bae3 2024-04-12T09:11:22.831 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (5m) 28s ago 5m 116M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad c873826a2dea 2024-04-12T09:11:22.831 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (4m) 28s ago 4m 108M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad 69cb7c22f002 2024-04-12T09:11:22.831 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 running (6m) 5s ago 7m 55.2M - 2.43.0 a07b618ecd1d 2799a65eed76 2024-04-12T09:11:22.831 INFO:tasks.workunit.client.1.smithi203.stdout:1/179: dread f4 [4194304,4194304] 0 2024-04-12T09:11:22.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.831+0000 7f83c9e45700 1 -- 172.21.15.117:0/1928192736 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f83ac06b610 msgr2=0x7f83ac06dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:22.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.831+0000 7f83c9e45700 1 --2- 172.21.15.117:0/1928192736 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f83ac06b610 0x7f83ac06dac0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f83c40f8d60 tx=0x7f83b800b040 comp rx=0 tx=0).stop 2024-04-12T09:11:22.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.831+0000 7f83c9e45700 1 -- 172.21.15.117:0/1928192736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83c40fc130 msgr2=0x7f83c411ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:22.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.831+0000 7f83c9e45700 1 --2- 172.21.15.117:0/1928192736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83c40fc130 0x7f83c411ca90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f83b4013870 tx=0x7f83b4009e30 comp rx=0 tx=0).stop 2024-04-12T09:11:22.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.832+0000 7f83c9e45700 1 -- 172.21.15.117:0/1928192736 shutdown_connections 2024-04-12T09:11:22.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.832+0000 7f83c9e45700 1 --2- 172.21.15.117:0/1928192736 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f83ac06b610 0x7f83ac06dac0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:22.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.832+0000 7f83c9e45700 1 --2- 172.21.15.117:0/1928192736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83c40fc130 0x7f83c411ca90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:22.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.832+0000 7f83c9e45700 1 --2- 172.21.15.117:0/1928192736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83c40fca80 0x7f83c411cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:22.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.832+0000 7f83c9e45700 1 -- 172.21.15.117:0/1928192736 >> 172.21.15.117:0/1928192736 conn(0x7f83c40f6ba0 msgr2=0x7f83c40f82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:11:22.833 INFO:tasks.workunit.client.0.smithi117.stdout:1/807: dread d1/dbd/d3f/db/f73 [0,4194304] 0 2024-04-12T09:11:22.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.832+0000 7f83c9e45700 1 -- 172.21.15.117:0/1928192736 shutdown_connections 2024-04-12T09:11:22.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.832+0000 7f83c9e45700 1 -- 172.21.15.117:0/1928192736 wait complete. 2024-04-12T09:11:22.834 INFO:tasks.workunit.client.1.smithi203.stdout:4/140: creat d1a/d20/f2a x:0 0 0 2024-04-12T09:11:22.836 INFO:tasks.workunit.client.0.smithi117.stdout:0/985: rename d3/da2/dee/dd5/dff/f6f to d3/da2/dee/dd5/dff/d91/d94/f148 0 2024-04-12T09:11:22.838 INFO:tasks.workunit.client.0.smithi117.stdout:0/986: write d3/da2/dee/d76/d83/da8/d9a/f121 [92597,90825] 0 2024-04-12T09:11:22.838 INFO:tasks.workunit.client.0.smithi117.stdout:8/878: getdents db/d77/d113 0 2024-04-12T09:11:22.840 INFO:tasks.workunit.client.0.smithi117.stdout:0/987: dread - d3/da2/dee/dd5/dff/d91/d94/d5a/d62/f144 zero size 2024-04-12T09:11:22.840 INFO:tasks.workunit.client.0.smithi117.stdout:8/879: read db/d13/f8c [2697300,40852] 0 2024-04-12T09:11:22.841 INFO:tasks.workunit.client.1.smithi203.stdout:4/141: dwrite d1a/d21/d22/f25 [4194304,4194304] 0 2024-04-12T09:11:22.841 INFO:tasks.workunit.client.1.smithi203.stdout:7/160: unlink d0/d15/l2b 0 2024-04-12T09:11:22.841 INFO:tasks.workunit.client.0.smithi117.stdout:0/988: readlink d3/da2/dee/d76/d83/da8/d9a/l10c 0 2024-04-12T09:11:22.841 INFO:tasks.workunit.client.0.smithi117.stdout:8/880: fsync db/d13/d38/dc3/f80 0 2024-04-12T09:11:22.842 INFO:tasks.workunit.client.0.smithi117.stdout:0/989: chown d3/da2/d11c 4023142 1 2024-04-12T09:11:22.843 INFO:tasks.workunit.client.0.smithi117.stdout:0/990: fdatasync d3/da2/dee/dd5/dff/f75 0 2024-04-12T09:11:22.851 INFO:tasks.workunit.client.0.smithi117.stdout:0/991: dwrite d3/f13a [0,4194304] 0 2024-04-12T09:11:22.852 INFO:tasks.workunit.client.0.smithi117.stdout:1/808: dwrite d1/d3b/f98 [0,4194304] 0 2024-04-12T09:11:22.853 INFO:tasks.workunit.client.1.smithi203.stdout:2/176: mkdir d0/d38/d43 0 2024-04-12T09:11:22.856 INFO:tasks.workunit.client.0.smithi117.stdout:2/743: truncate d0/df/f1d 1965691 0 2024-04-12T09:11:22.859 INFO:tasks.workunit.client.1.smithi203.stdout:8/140: sync 2024-04-12T09:11:22.860 INFO:tasks.workunit.client.1.smithi203.stdout:0/202: link d0/d1d/d2f/d17/d19/c31 d0/c44 0 2024-04-12T09:11:22.862 INFO:tasks.workunit.client.1.smithi203.stdout:1/180: creat df/f35 x:0 0 0 2024-04-12T09:11:22.864 INFO:tasks.workunit.client.1.smithi203.stdout:8/141: dread d4/f2a [0,4194304] 0 2024-04-12T09:11:22.866 INFO:tasks.workunit.client.1.smithi203.stdout:5/237: getdents d0/d6 0 2024-04-12T09:11:22.867 INFO:tasks.workunit.client.1.smithi203.stdout:0/203: dwrite d0/d1d/d2f/d17/d19/f23 [0,4194304] 0 2024-04-12T09:11:22.869 INFO:tasks.workunit.client.0.smithi117.stdout:1/809: rmdir d1/d64 39 2024-04-12T09:11:22.869 INFO:tasks.workunit.client.0.smithi117.stdout:5/911: dwrite d2/d3/dd/d39/d83/fc4 [0,4194304] 0 2024-04-12T09:11:22.873 INFO:tasks.workunit.client.1.smithi203.stdout:7/161: creat d0/d4/d1c/f3a x:0 0 0 2024-04-12T09:11:22.874 INFO:tasks.workunit.client.1.smithi203.stdout:7/162: chown d0/d4/d1c/c2a 66847366 1 2024-04-12T09:11:22.876 INFO:tasks.workunit.client.0.smithi117.stdout:8/881: creat db/d13/f128 x:0 0 0 2024-04-12T09:11:22.879 INFO:tasks.workunit.client.0.smithi117.stdout:1/810: dwrite d1/dbd/d51/f83 [4194304,4194304] 0 2024-04-12T09:11:22.880 INFO:tasks.workunit.client.1.smithi203.stdout:3/146: rename d2/f13 to d2/f2b 0 2024-04-12T09:11:22.881 INFO:tasks.workunit.client.0.smithi117.stdout:5/912: write d2/d3/dd/d39/d83/dc8/f128 [930879,8610] 0 2024-04-12T09:11:22.881 INFO:tasks.workunit.client.1.smithi203.stdout:6/153: getdents d1/d3/d4 0 2024-04-12T09:11:22.881 INFO:tasks.workunit.client.1.smithi203.stdout:3/147: truncate d2/d8/d14/d1b/f25 42550 0 2024-04-12T09:11:22.881 INFO:tasks.workunit.client.1.smithi203.stdout:6/154: chown d1/d3 400 1 2024-04-12T09:11:22.882 INFO:tasks.workunit.client.1.smithi203.stdout:6/155: fsync d1/d3/f25 0 2024-04-12T09:11:22.882 INFO:tasks.workunit.client.1.smithi203.stdout:9/133: creat d8/f34 x:0 0 0 2024-04-12T09:11:22.888 INFO:tasks.workunit.client.0.smithi117.stdout:1/811: dread d1/dbd/d3f/db/d16/f47 [0,4194304] 0 2024-04-12T09:11:22.892 INFO:tasks.workunit.client.1.smithi203.stdout:8/142: creat d4/f2d x:0 0 0 2024-04-12T09:11:22.892 INFO:tasks.workunit.client.1.smithi203.stdout:6/156: dwrite d1/df/d28/f2c [0,4194304] 0 2024-04-12T09:11:22.892 INFO:tasks.workunit.client.0.smithi117.stdout:8/882: creat db/d19/d1a/d3d/f129 x:0 0 0 2024-04-12T09:11:22.893 INFO:tasks.workunit.client.1.smithi203.stdout:5/238: mkdir d0/d6/d16/d9/d30/d58 0 2024-04-12T09:11:22.894 INFO:tasks.workunit.client.0.smithi117.stdout:5/913: creat d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1/d11f/d6b/da5/f12b x:0 0 0 2024-04-12T09:11:22.895 INFO:tasks.workunit.client.1.smithi203.stdout:4/142: truncate fb 2651056 0 2024-04-12T09:11:22.897 INFO:tasks.workunit.client.1.smithi203.stdout:4/143: write d1a/d21/d22/f25 [7581801,119997] 0 2024-04-12T09:11:22.898 INFO:tasks.workunit.client.0.smithi117.stdout:2/744: write d0/d43/d30/f82 [931739,89912] 0 2024-04-12T09:11:22.902 INFO:tasks.workunit.client.0.smithi117.stdout:2/745: dread d0/d4/d10/d27/f39 [0,4194304] 0 2024-04-12T09:11:22.902 INFO:tasks.workunit.client.0.smithi117.stdout:2/746: chown d0/fcd 634 1 2024-04-12T09:11:22.932 INFO:tasks.workunit.client.0.smithi117.stdout:8/883: mknod db/d13/d38/d86/da0/c12a 0 2024-04-12T09:11:22.933 INFO:tasks.workunit.client.1.smithi203.stdout:2/177: creat d0/d38/d43/f44 x:0 0 0 2024-04-12T09:11:22.938 INFO:tasks.workunit.client.0.smithi117.stdout:1/812: link d1/dbd/d3f/ce d1/d3b/cfe 0 2024-04-12T09:11:22.939 INFO:tasks.workunit.client.1.smithi203.stdout:1/181: creat df/d34/f36 x:0 0 0 2024-04-12T09:11:22.948 INFO:tasks.workunit.client.1.smithi203.stdout:5/239: rmdir d0 39 2024-04-12T09:11:22.951 INFO:tasks.workunit.client.1.smithi203.stdout:3/148: sync 2024-04-12T09:11:22.952 INFO:tasks.workunit.client.0.smithi117.stdout:8/884: rename db/d13/d38 to db/d1b/d62/dae/df9/d12b 0 2024-04-12T09:11:22.953 INFO:tasks.workunit.client.0.smithi117.stdout:5/914: truncate d2/f6 3160199 0 2024-04-12T09:11:22.955 INFO:tasks.workunit.client.0.smithi117.stdout:2/747: write d0/d43/d30/f5c [752036,111139] 0 2024-04-12T09:11:22.956 INFO:tasks.workunit.client.0.smithi117.stdout:1/813: mknod d1/d64/d45/cff 0 2024-04-12T09:11:22.958 INFO:tasks.workunit.client.1.smithi203.stdout:4/144: rename d1a/d21/d27 to d1a/d2b 0 2024-04-12T09:11:22.959 INFO:tasks.workunit.client.0.smithi117.stdout:8/885: creat db/d1b/d62/dae/df9/d12b/d86/da0/da4/f12c x:0 0 0 2024-04-12T09:11:22.960 INFO:tasks.workunit.client.1.smithi203.stdout:9/134: truncate d8/d12/d23/d27/f32 4339059 0 2024-04-12T09:11:22.962 INFO:tasks.workunit.client.1.smithi203.stdout:1/182: chown df/f19 7 1 2024-04-12T09:11:22.962 INFO:tasks.workunit.client.1.smithi203.stdout:1/183: chown ca 702026260 1 2024-04-12T09:11:22.965 INFO:tasks.workunit.client.1.smithi203.stdout:0/204: dwrite d0/f13 [0,4194304] 0 2024-04-12T09:11:22.966 INFO:tasks.workunit.client.1.smithi203.stdout:8/143: creat d4/d8/d19/f2e x:0 0 0 2024-04-12T09:11:22.967 INFO:tasks.workunit.client.0.smithi117.stdout:1/814: creat d1/dbd/d3f/db/d16/db6/da9/d9a/d71/f100 x:0 0 0 2024-04-12T09:11:22.969 INFO:tasks.workunit.client.1.smithi203.stdout:6/157: mkdir d1/d3/d26/d30 0 2024-04-12T09:11:22.969 INFO:tasks.workunit.client.1.smithi203.stdout:6/158: dread - d1/d3/f2a zero size 2024-04-12T09:11:22.973 INFO:tasks.workunit.client.0.smithi117.stdout:8/886: dread db/d19/f2b [0,4194304] 0 2024-04-12T09:11:22.977 INFO:tasks.workunit.client.1.smithi203.stdout:7/163: rmdir d0/d34/d39 0 2024-04-12T09:11:22.977 INFO:tasks.workunit.client.0.smithi117.stdout:8/887: dread db/d19/f2b [0,4194304] 0 2024-04-12T09:11:22.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.978+0000 7ff755750700 1 -- 172.21.15.117:0/3439478511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500fbcd0 msgr2=0x7ff7500fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:22.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.978+0000 7ff755750700 1 --2- 172.21.15.117:0/3439478511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500fbcd0 0x7ff7500fc0e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff740004940 tx=0x7ff740009e30 comp rx=0 tx=0).stop 2024-04-12T09:11:22.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.978+0000 7ff755750700 1 -- 172.21.15.117:0/3439478511 shutdown_connections 2024-04-12T09:11:22.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.978+0000 7ff755750700 1 --2- 172.21.15.117:0/3439478511 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7500fcf80 0x7ff7500fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:22.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.978+0000 7ff755750700 1 --2- 172.21.15.117:0/3439478511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500fbcd0 0x7ff7500fc0e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:22.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.978+0000 7ff755750700 1 -- 172.21.15.117:0/3439478511 >> 172.21.15.117:0/3439478511 conn(0x7ff7500f7430 msgr2=0x7ff7500f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:11:22.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.979+0000 7ff755750700 1 -- 172.21.15.117:0/3439478511 shutdown_connections 2024-04-12T09:11:22.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.979+0000 7ff755750700 1 -- 172.21.15.117:0/3439478511 wait complete. 2024-04-12T09:11:22.980 INFO:tasks.workunit.client.0.smithi117.stdout:5/915: rename d2/d3/de/d1e/d79/c118 to d2/d3/de/d1e/d46/c12c 0 2024-04-12T09:11:22.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.979+0000 7ff755750700 1 Processor -- start 2024-04-12T09:11:22.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.979+0000 7ff755750700 1 -- start start 2024-04-12T09:11:22.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.980+0000 7ff755750700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7500fbcd0 0x7ff75010fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:22.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.980+0000 7ff755750700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500fcf80 0x7ff7501100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:22.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.980+0000 7ff755750700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7501106b0 con 0x7ff7500fcf80 2024-04-12T09:11:22.981 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.980+0000 7ff755750700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff750110f00 con 0x7ff7500fbcd0 2024-04-12T09:11:22.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.980+0000 7ff74e7fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500fcf80 0x7ff7501100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:22.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.980+0000 7ff74e7fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500fcf80 0x7ff7501100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47880/0 (socket says 172.21.15.117:47880) 2024-04-12T09:11:22.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.980+0000 7ff74e7fc700 1 -- 172.21.15.117:0/3097112858 learned_addr learned my addr 172.21.15.117:0/3097112858 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:11:22.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.980+0000 7ff74effd700 1 --2- 172.21.15.117:0/3097112858 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7500fbcd0 0x7ff75010fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:22.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.980+0000 7ff74effd700 1 -- 172.21.15.117:0/3097112858 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500fcf80 msgr2=0x7ff7501100b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:22.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.980+0000 7ff74effd700 1 --2- 172.21.15.117:0/3097112858 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500fcf80 0x7ff7501100b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:22.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.980+0000 7ff74effd700 1 -- 172.21.15.117:0/3097112858 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff740005040 con 0x7ff7500fbcd0 2024-04-12T09:11:22.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.981+0000 7ff74effd700 1 --2- 172.21.15.117:0/3097112858 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7500fbcd0 0x7ff75010fb70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff74000b970 tx=0x7ff740009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:11:22.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.981+0000 7ff7377fe700 1 -- 172.21.15.117:0/3097112858 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff74000e040 con 0x7ff7500fbcd0 2024-04-12T09:11:22.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.981+0000 7ff755750700 1 -- 172.21.15.117:0/3097112858 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff750111180 con 0x7ff7500fbcd0 2024-04-12T09:11:22.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.981+0000 7ff7377fe700 1 -- 172.21.15.117:0/3097112858 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff740004290 con 0x7ff7500fbcd0 2024-04-12T09:11:22.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.981+0000 7ff755750700 1 -- 172.21.15.117:0/3097112858 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7501116c0 con 0x7ff7500fbcd0 2024-04-12T09:11:22.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.981+0000 7ff7377fe700 1 -- 172.21.15.117:0/3097112858 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff74001c3f0 con 0x7ff7500fbcd0 2024-04-12T09:11:22.983 INFO:tasks.workunit.client.1.smithi203.stdout:4/145: rmdir d1a/d1d 39 2024-04-12T09:11:22.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.982+0000 7ff755750700 1 -- 172.21.15.117:0/3097112858 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff750102980 con 0x7ff7500fbcd0 2024-04-12T09:11:22.984 INFO:tasks.workunit.client.0.smithi117.stdout:2/748: creat d0/d43/da5/d8f/ff7 x:0 0 0 2024-04-12T09:11:22.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.983+0000 7ff7377fe700 1 -- 172.21.15.117:0/3097112858 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) v1 ==== 89201+0+0 (secure 0 0 0) 0x7ff740013420 con 0x7ff7500fbcd0 2024-04-12T09:11:22.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.984+0000 7ff7377fe700 1 --2- 172.21.15.117:0/3097112858 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7ff73806b540 0x7ff73806d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:22.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.984+0000 7ff7377fe700 1 -- 172.21.15.117:0/3097112858 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7ff74008b270 con 0x7ff7500fbcd0 2024-04-12T09:11:22.985 INFO:tasks.workunit.client.1.smithi203.stdout:0/205: rmdir d0/dd/d40 39 2024-04-12T09:11:22.986 INFO:tasks.workunit.client.1.smithi203.stdout:0/206: chown d0/c38 52 1 2024-04-12T09:11:22.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.984+0000 7ff74e7fc700 1 --2- 172.21.15.117:0/3097112858 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7ff73806b540 0x7ff73806d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:22.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.985+0000 7ff74e7fc700 1 --2- 172.21.15.117:0/3097112858 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7ff73806b540 0x7ff73806d9f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff7440102e0 tx=0x7ff74400b040 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:11:22.988 INFO:tasks.workunit.client.1.smithi203.stdout:8/144: unlink d4/f9 0 2024-04-12T09:11:22.988 INFO:tasks.workunit.client.1.smithi203.stdout:6/159: dread d1/df/f11 [0,4194304] 0 2024-04-12T09:11:22.989 INFO:tasks.workunit.client.1.smithi203.stdout:6/160: fdatasync d1/df/d28/f2c 0 2024-04-12T09:11:22.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:22.989+0000 7ff7377fe700 1 -- 172.21.15.117:0/3097112858 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7ff740058c00 con 0x7ff7500fbcd0 2024-04-12T09:11:22.992 INFO:tasks.workunit.client.1.smithi203.stdout:5/240: symlink d0/d6/d16/d8/l59 0 2024-04-12T09:11:22.994 INFO:tasks.workunit.client.1.smithi203.stdout:5/241: read d0/d6/f22 [126163,67176] 0 2024-04-12T09:11:22.994 INFO:tasks.workunit.client.1.smithi203.stdout:7/164: mkdir d0/d4/d1c/d3b 0 2024-04-12T09:11:22.996 INFO:tasks.workunit.client.1.smithi203.stdout:2/178: rename d0/d19/l39 to d0/d2e/l45 0 2024-04-12T09:11:22.998 INFO:tasks.workunit.client.0.smithi117.stdout:8/888: dread db/d1b/d62/dae/df9/d12b/f48 [0,4194304] 0 2024-04-12T09:11:22.999 INFO:tasks.workunit.client.1.smithi203.stdout:2/179: dread d0/fc [0,4194304] 0 2024-04-12T09:11:23.000 INFO:tasks.workunit.client.1.smithi203.stdout:4/146: dread f5 [4194304,4194304] 0 2024-04-12T09:11:23.000 INFO:tasks.workunit.client.1.smithi203.stdout:8/145: mknod d4/d8/d19/c2f 0 2024-04-12T09:11:23.006 INFO:tasks.workunit.client.1.smithi203.stdout:7/165: rmdir d0/d15/d2d 39 2024-04-12T09:11:23.008 INFO:tasks.workunit.client.1.smithi203.stdout:5/242: creat d0/d6/d11/d4a/f5a x:0 0 0 2024-04-12T09:11:23.009 INFO:tasks.workunit.client.1.smithi203.stdout:8/146: dread f3 [0,4194304] 0 2024-04-12T09:11:23.010 INFO:tasks.workunit.client.1.smithi203.stdout:8/147: chown d4/f2a 52656808 1 2024-04-12T09:11:23.010 INFO:tasks.workunit.client.1.smithi203.stdout:3/149: rename d2/d8/f1d to d2/d8/d14/f2c 0 2024-04-12T09:11:23.012 INFO:tasks.workunit.client.1.smithi203.stdout:3/150: read d2/f18 [1248430,96538] 0 2024-04-12T09:11:23.013 INFO:tasks.workunit.client.1.smithi203.stdout:3/151: write d2/fa [5671776,106720] 0 2024-04-12T09:11:23.015 INFO:tasks.workunit.client.1.smithi203.stdout:3/152: write d2/d8/d14/d1b/f25 [1059197,30746] 0 2024-04-12T09:11:23.015 INFO:tasks.workunit.client.1.smithi203.stdout:1/184: link df/l2c df/d2d/l37 0 2024-04-12T09:11:23.016 INFO:tasks.workunit.client.1.smithi203.stdout:1/185: stat df/l2c 0 2024-04-12T09:11:23.031 INFO:tasks.workunit.client.1.smithi203.stdout:5/243: rename d0/d6/d16/c3 to d0/d6/d11/d38/c5b 0 2024-04-12T09:11:23.034 INFO:tasks.workunit.client.1.smithi203.stdout:5/244: dread d0/d6/fe [0,4194304] 0 2024-04-12T09:11:23.034 INFO:tasks.workunit.client.1.smithi203.stdout:5/245: dread - d0/d6/d11/d18/d1a/d23/f4f zero size 2024-04-12T09:11:23.040 INFO:tasks.workunit.client.1.smithi203.stdout:3/153: mkdir d2/d8/d14/d2d 0 2024-04-12T09:11:23.041 INFO:tasks.workunit.client.1.smithi203.stdout:3/154: fdatasync d2/d8/d14/f27 0 2024-04-12T09:11:23.041 INFO:tasks.workunit.client.1.smithi203.stdout:3/155: stat d2/fc 0 2024-04-12T09:11:23.046 INFO:tasks.workunit.client.1.smithi203.stdout:7/166: symlink d0/l3c 0 2024-04-12T09:11:23.047 INFO:tasks.workunit.client.1.smithi203.stdout:1/186: write df/d20/f26 [1563080,2410] 0 2024-04-12T09:11:23.048 INFO:tasks.workunit.client.1.smithi203.stdout:1/187: readlink df/l11 0 2024-04-12T09:11:23.048 INFO:tasks.workunit.client.1.smithi203.stdout:1/188: dread - df/d34/f36 zero size 2024-04-12T09:11:23.052 INFO:tasks.workunit.client.1.smithi203.stdout:5/246: creat d0/d6/d16/d44/f5c x:0 0 0 2024-04-12T09:11:23.052 INFO:tasks.workunit.client.1.smithi203.stdout:5/247: chown d0/d6/d16/d9/d14/l39 4661950 1 2024-04-12T09:11:23.057 INFO:tasks.workunit.client.1.smithi203.stdout:3/156: mkdir d2/d1f/d2e 0 2024-04-12T09:11:23.058 INFO:tasks.workunit.client.1.smithi203.stdout:0/207: getdents d0/dd 0 2024-04-12T09:11:23.060 INFO:tasks.workunit.client.0.smithi117.stdout:2/749: creat d0/d4/d10/d27/d9a/ff8 x:0 0 0 2024-04-12T09:11:23.060 INFO:tasks.workunit.client.1.smithi203.stdout:6/161: getdents d1/d3 0 2024-04-12T09:11:23.061 INFO:tasks.workunit.client.0.smithi117.stdout:5/916: link d2/d3/dd/d39/f61 d2/d3/de/d1e/d66/dbe/f12d 0 2024-04-12T09:11:23.062 INFO:tasks.workunit.client.0.smithi117.stdout:2/750: stat d0/df/f1d 0 2024-04-12T09:11:23.062 INFO:tasks.workunit.client.1.smithi203.stdout:1/189: symlink df/d20/d2b/l38 0 2024-04-12T09:11:23.063 INFO:tasks.workunit.client.1.smithi203.stdout:5/248: chown d0/d6/d16/d9/d14/f25 2 1 2024-04-12T09:11:23.066 INFO:tasks.workunit.client.1.smithi203.stdout:6/162: dwrite d1/d3/d12/f1f [4194304,4194304] 0 2024-04-12T09:11:23.066 INFO:tasks.workunit.client.1.smithi203.stdout:6/163: read - d1/d3/f27 zero size 2024-04-12T09:11:23.067 INFO:tasks.workunit.client.1.smithi203.stdout:6/164: fdatasync d1/d3/f27 0 2024-04-12T09:11:23.067 INFO:tasks.workunit.client.1.smithi203.stdout:6/165: stat d1/d3/d12/f1f 0 2024-04-12T09:11:23.083 INFO:tasks.workunit.client.1.smithi203.stdout:9/135: sync 2024-04-12T09:11:23.084 INFO:tasks.workunit.client.1.smithi203.stdout:9/136: stat d8/d12/d23/d27/d2d 0 2024-04-12T09:11:23.104 INFO:tasks.workunit.client.1.smithi203.stdout:4/147: sync 2024-04-12T09:11:23.119 INFO:tasks.workunit.client.1.smithi203.stdout:8/148: creat d4/d8/d1c/f30 x:0 0 0 2024-04-12T09:11:23.120 INFO:tasks.workunit.client.0.smithi117.stdout:2/751: rmdir d0/d43/da5 39 2024-04-12T09:11:23.122 INFO:tasks.workunit.client.1.smithi203.stdout:3/157: unlink d2/fc 0 2024-04-12T09:11:23.122 INFO:tasks.workunit.client.1.smithi203.stdout:3/158: dread - d2/d8/d14/d23/f2a zero size 2024-04-12T09:11:23.123 INFO:tasks.workunit.client.1.smithi203.stdout:3/159: fsync d2/d8/d14/f27 0 2024-04-12T09:11:23.124 INFO:tasks.workunit.client.1.smithi203.stdout:2/180: getdents d0/d3 0 2024-04-12T09:11:23.125 INFO:tasks.workunit.client.0.smithi117.stdout:2/752: dwrite d0/d4/d10/d27/f70 [0,4194304] 0 2024-04-12T09:11:23.135 INFO:tasks.workunit.client.1.smithi203.stdout:7/167: symlink d0/d4/d1c/d3b/l3d 0 2024-04-12T09:11:23.136 INFO:tasks.workunit.client.0.smithi117.stdout:8/889: getdents db/d1b/d62/dae/df9/d12b/d86 0 2024-04-12T09:11:23.137 INFO:tasks.workunit.client.1.smithi203.stdout:1/190: mknod df/d20/d2b/c39 0 2024-04-12T09:11:23.138 INFO:tasks.workunit.client.0.smithi117.stdout:2/753: symlink d0/d43/d30/dc6/lf9 0 2024-04-12T09:11:23.138 INFO:tasks.workunit.client.1.smithi203.stdout:1/191: dread df/d20/f21 [0,4194304] 0 2024-04-12T09:11:23.139 INFO:tasks.workunit.client.1.smithi203.stdout:1/192: read - df/f33 zero size 2024-04-12T09:11:23.139 INFO:tasks.workunit.client.1.smithi203.stdout:5/249: mkdir d0/d5d 0 2024-04-12T09:11:23.140 INFO:tasks.workunit.client.0.smithi117.stdout:5/917: rename d2/f6 to d2/d3/f12e 0 2024-04-12T09:11:23.141 INFO:tasks.workunit.client.0.smithi117.stdout:8/890: symlink db/d1b/d62/dae/df9/d12b/dc5/l12d 0 2024-04-12T09:11:23.143 INFO:tasks.workunit.client.0.smithi117.stdout:2/754: mkdir d0/d43/d30/d41/dfa 0 2024-04-12T09:11:23.143 INFO:tasks.workunit.client.0.smithi117.stdout:8/891: readlink db/d19/d1a/d3d/l41 0 2024-04-12T09:11:23.144 INFO:tasks.workunit.client.0.smithi117.stdout:5/918: truncate d2/d3/de/d1e/d35/fe2 229781 0 2024-04-12T09:11:23.146 INFO:tasks.workunit.client.0.smithi117.stdout:2/755: write d0/d43/da5/d8f/ff7 [167449,51608] 0 2024-04-12T09:11:23.147 INFO:tasks.workunit.client.0.smithi117.stdout:8/892: mknod db/da6/c12e 0 2024-04-12T09:11:23.148 INFO:tasks.workunit.client.0.smithi117.stdout:2/756: write d0/d43/d53/f6f [2181551,36553] 0 2024-04-12T09:11:23.149 INFO:tasks.workunit.client.1.smithi203.stdout:4/148: dread d1a/d1d/f1e [0,4194304] 0 2024-04-12T09:11:23.151 INFO:tasks.workunit.client.1.smithi203.stdout:0/208: symlink d0/l45 0 2024-04-12T09:11:23.152 INFO:tasks.workunit.client.0.smithi117.stdout:8/893: truncate db/d13/f8c 26587 0 2024-04-12T09:11:23.155 INFO:tasks.workunit.client.1.smithi203.stdout:4/149: dwrite d1a/f1b [0,4194304] 0 2024-04-12T09:11:23.155 INFO:tasks.workunit.client.0.smithi117.stdout:2/757: read d0/d43/d30/f62 [641895,29290] 0 2024-04-12T09:11:23.156 INFO:tasks.workunit.client.1.smithi203.stdout:7/168: rename d0/l3c to d0/d4/d1c/d3b/l3e 0 2024-04-12T09:11:23.157 INFO:tasks.workunit.client.1.smithi203.stdout:7/169: readlink d0/d4/d1c/l29 0 2024-04-12T09:11:23.159 INFO:tasks.workunit.client.1.smithi203.stdout:1/193: symlink df/l3a 0 2024-04-12T09:11:23.159 INFO:tasks.workunit.client.0.smithi117.stdout:5/919: link d2/d3/de/d1e/d79/dec/cf9 d2/d3/dd/d39/d83/dc8/dd1/c12f 0 2024-04-12T09:11:23.160 INFO:tasks.workunit.client.0.smithi117.stdout:5/920: read d2/d3/dd/d39/d83/fc4 [525179,117436] 0 2024-04-12T09:11:23.161 INFO:tasks.workunit.client.1.smithi203.stdout:2/181: dwrite d0/fc [0,4194304] 0 2024-04-12T09:11:23.163 INFO:tasks.workunit.client.1.smithi203.stdout:6/166: creat d1/d3/d26/d30/f31 x:0 0 0 2024-04-12T09:11:23.166 INFO:tasks.workunit.client.1.smithi203.stdout:5/250: dwrite d0/d6/d16/d9/f10 [0,4194304] 0 2024-04-12T09:11:23.176 INFO:tasks.workunit.client.1.smithi203.stdout:0/209: rmdir d0/d1d 39 2024-04-12T09:11:23.177 INFO:tasks.workunit.client.0.smithi117.stdout:5/921: truncate d2/d3/dd/d39/d83/f30 5144951 0 2024-04-12T09:11:23.183 INFO:tasks.workunit.client.1.smithi203.stdout:4/150: mkdir d1a/d1d/d23/d2c 0 2024-04-12T09:11:23.185 INFO:tasks.workunit.client.1.smithi203.stdout:1/194: creat df/d34/f3b x:0 0 0 2024-04-12T09:11:23.185 INFO:tasks.workunit.client.0.smithi117.stdout:2/758: link d0/d43/le9 d0/d43/d53/d61/d66/dd9/lfb 0 2024-04-12T09:11:23.187 INFO:tasks.workunit.client.0.smithi117.stdout:5/922: symlink d2/d3/de/d1e/d66/l130 0 2024-04-12T09:11:23.188 INFO:tasks.workunit.client.1.smithi203.stdout:6/167: read d1/df/f11 [1906415,124669] 0 2024-04-12T09:11:23.189 INFO:tasks.workunit.client.1.smithi203.stdout:6/168: stat d1/d3/f27 0 2024-04-12T09:11:23.192 INFO:tasks.workunit.client.1.smithi203.stdout:9/137: link d8/f15 d8/d12/d23/d29/f35 0 2024-04-12T09:11:23.195 INFO:tasks.workunit.client.1.smithi203.stdout:5/251: mknod d0/d6/d16/d9/d30/c5e 0 2024-04-12T09:11:23.196 INFO:tasks.workunit.client.1.smithi203.stdout:5/252: chown d0/d6/d11/d18/d1a/d23/f4f 2839244 1 2024-04-12T09:11:23.197 INFO:tasks.workunit.client.1.smithi203.stdout:5/253: chown d0/d6/d11/d4a/f5a 55932820 1 2024-04-12T09:11:23.199 INFO:tasks.workunit.client.0.smithi117.stdout:8/894: dwrite db/f53 [4194304,4194304] 0 2024-04-12T09:11:23.200 INFO:tasks.workunit.client.1.smithi203.stdout:0/210: fsync d0/f3 0 2024-04-12T09:11:23.202 INFO:tasks.workunit.client.1.smithi203.stdout:4/151: mkdir d1a/d20/d2d 0 2024-04-12T09:11:23.203 INFO:tasks.workunit.client.1.smithi203.stdout:1/195: mknod df/d2d/c3c 0 2024-04-12T09:11:23.203 INFO:tasks.workunit.client.1.smithi203.stdout:1/196: chown df/d20 165748 1 2024-04-12T09:11:23.205 INFO:tasks.workunit.client.0.smithi117.stdout:8/895: symlink db/d1b/d62/dae/df9/d12b/def/l12f 0 2024-04-12T09:11:23.207 INFO:tasks.workunit.client.1.smithi203.stdout:3/160: truncate d2/f2b 4001986 0 2024-04-12T09:11:23.210 INFO:tasks.workunit.client.1.smithi203.stdout:3/161: dread - d2/d8/d14/d23/f2a zero size 2024-04-12T09:11:23.213 INFO:tasks.workunit.client.1.smithi203.stdout:1/197: dwrite df/f1d [0,4194304] 0 2024-04-12T09:11:23.213 INFO:tasks.workunit.client.1.smithi203.stdout:5/254: mknod d0/d6/d11/d4a/c5f 0 2024-04-12T09:11:23.213 INFO:tasks.workunit.client.1.smithi203.stdout:3/162: dread - d2/d8/d14/f22 zero size 2024-04-12T09:11:23.214 INFO:tasks.workunit.client.1.smithi203.stdout:5/255: write d0/d6/d11/d18/d1a/f3f [1042254,23166] 0 2024-04-12T09:11:23.215 INFO:tasks.workunit.client.0.smithi117.stdout:2/759: write d0/d43/d30/f6e [4083120,110731] 0 2024-04-12T09:11:23.216 INFO:tasks.workunit.client.1.smithi203.stdout:0/211: rmdir d0 39 2024-04-12T09:11:23.216 INFO:tasks.workunit.client.1.smithi203.stdout:5/256: chown d0/d6/d11/d18/d1a/d23 117 1 2024-04-12T09:11:23.218 INFO:tasks.workunit.client.1.smithi203.stdout:4/152: chown ff 242 1 2024-04-12T09:11:23.218 INFO:tasks.workunit.client.1.smithi203.stdout:5/257: fdatasync d0/d6/d16/d44/f5c 0 2024-04-12T09:11:23.220 INFO:tasks.workunit.client.1.smithi203.stdout:1/198: dwrite df/d34/f3b [0,4194304] 0 2024-04-12T09:11:23.224 INFO:tasks.workunit.client.0.smithi117.stdout:2/760: symlink d0/d4/lfc 0 2024-04-12T09:11:23.226 INFO:tasks.workunit.client.0.smithi117.stdout:5/923: dread d2/d3/dd/d39/d83/d74/f8f [0,4194304] 0 2024-04-12T09:11:23.228 INFO:tasks.workunit.client.1.smithi203.stdout:7/170: sync 2024-04-12T09:11:23.229 INFO:tasks.workunit.client.1.smithi203.stdout:1/199: dwrite df/f33 [0,4194304] 0 2024-04-12T09:11:23.231 INFO:tasks.workunit.client.0.smithi117.stdout:8/896: write db/d1b/d62/dae/df9/d12b/d86/f94 [3992026,64816] 0 2024-04-12T09:11:23.235 INFO:tasks.workunit.client.1.smithi203.stdout:6/169: dwrite d1/df/f19 [0,4194304] 0 2024-04-12T09:11:23.235 INFO:tasks.workunit.client.0.smithi117.stdout:2/761: mkdir d0/de6/dfd 0 2024-04-12T09:11:23.238 INFO:tasks.workunit.client.0.smithi117.stdout:8/897: fsync db/d1b/d62/dae/f107 0 2024-04-12T09:11:23.242 INFO:tasks.workunit.client.1.smithi203.stdout:8/149: dwrite d4/d8/d19/f28 [0,4194304] 0 2024-04-12T09:11:23.243 INFO:tasks.workunit.client.1.smithi203.stdout:4/153: mkdir d1a/d21/d22/d2e 0 2024-04-12T09:11:23.245 INFO:tasks.workunit.client.0.smithi117.stdout:8/898: mkdir db/d1b/d62/dae/db4/d130 0 2024-04-12T09:11:23.245 INFO:tasks.workunit.client.1.smithi203.stdout:2/182: getdents d0 0 2024-04-12T09:11:23.247 INFO:tasks.workunit.client.1.smithi203.stdout:2/183: stat d0/d14/d1e/d2a 0 2024-04-12T09:11:23.251 INFO:tasks.workunit.client.1.smithi203.stdout:7/171: unlink d0/d15/f23 0 2024-04-12T09:11:23.251 INFO:tasks.workunit.client.1.smithi203.stdout:9/138: write d8/d12/d23/d27/f32 [4242804,109556] 0 2024-04-12T09:11:23.251 INFO:tasks.workunit.client.1.smithi203.stdout:1/200: unlink df/l2c 0 2024-04-12T09:11:23.253 INFO:tasks.workunit.client.0.smithi117.stdout:5/924: write d2/d3/de/d1e/d35/fdf [523659,59853] 0 2024-04-12T09:11:23.254 INFO:tasks.workunit.client.1.smithi203.stdout:6/170: symlink d1/d3/d26/l32 0 2024-04-12T09:11:23.255 INFO:tasks.workunit.client.1.smithi203.stdout:5/258: dread d0/d6/d11/d18/f40 [0,4194304] 0 2024-04-12T09:11:23.256 INFO:tasks.workunit.client.0.smithi117.stdout:2/762: rename d0/d43/d30/cbd to d0/d4/d10/cfe 0 2024-04-12T09:11:23.258 INFO:tasks.workunit.client.1.smithi203.stdout:0/212: creat d0/dd/f46 x:0 0 0 2024-04-12T09:11:23.259 INFO:tasks.workunit.client.1.smithi203.stdout:8/150: creat d4/d8/d1c/f31 x:0 0 0 2024-04-12T09:11:23.259 INFO:tasks.workunit.client.1.smithi203.stdout:8/151: dread - d4/f1f zero size 2024-04-12T09:11:23.260 INFO:tasks.workunit.client.1.smithi203.stdout:8/152: write d4/f29 [1014670,125582] 0 2024-04-12T09:11:23.261 INFO:tasks.workunit.client.0.smithi117.stdout:5/925: mknod d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1/d11f/c131 0 2024-04-12T09:11:23.262 INFO:tasks.workunit.client.0.smithi117.stdout:2/763: dwrite d0/df/f97 [0,4194304] 0 2024-04-12T09:11:23.263 INFO:tasks.workunit.client.1.smithi203.stdout:2/184: readlink d0/d19/l25 0 2024-04-12T09:11:23.267 INFO:tasks.workunit.client.1.smithi203.stdout:8/153: dwrite d4/d8/d1c/f2c [0,4194304] 0 2024-04-12T09:11:23.268 INFO:tasks.workunit.client.1.smithi203.stdout:7/172: creat d0/d4/d1c/d3b/f3f x:0 0 0 2024-04-12T09:11:23.270 INFO:tasks.workunit.client.0.smithi117.stdout:5/926: dread d2/d3/de/d1e/d35/fb4 [0,4194304] 0 2024-04-12T09:11:23.272 INFO:tasks.workunit.client.0.smithi117.stdout:5/927: stat d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1/d11f/d6b/fc3 0 2024-04-12T09:11:23.273 INFO:tasks.workunit.client.1.smithi203.stdout:1/201: symlink df/d20/d2b/l3d 0 2024-04-12T09:11:23.275 INFO:tasks.workunit.client.1.smithi203.stdout:6/171: mknod d1/c33 0 2024-04-12T09:11:23.275 INFO:tasks.workunit.client.1.smithi203.stdout:1/202: dread df/d20/f21 [0,4194304] 0 2024-04-12T09:11:23.276 INFO:tasks.workunit.client.1.smithi203.stdout:7/173: dwrite d0/d4/d1c/f35 [0,4194304] 0 2024-04-12T09:11:23.277 INFO:tasks.workunit.client.1.smithi203.stdout:1/203: write df/f35 [374941,118605] 0 2024-04-12T09:11:23.277 INFO:tasks.workunit.client.0.smithi117.stdout:8/899: write db/d1b/d62/dae/df9/d12b/d86/f8b [1783685,52512] 0 2024-04-12T09:11:23.279 INFO:tasks.workunit.client.0.smithi117.stdout:5/928: mknod d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/c132 0 2024-04-12T09:11:23.279 INFO:tasks.workunit.client.0.smithi117.stdout:8/900: readlink db/d1b/d62/dae/df9/d12b/dc3/de9/l112 0 2024-04-12T09:11:23.281 INFO:tasks.workunit.client.1.smithi203.stdout:0/213: chown d0/d1d/d2f/l12 6088 1 2024-04-12T09:11:23.282 INFO:tasks.workunit.client.1.smithi203.stdout:0/214: write d0/d1d/d2f/f33 [447728,43537] 0 2024-04-12T09:11:23.283 INFO:tasks.workunit.client.1.smithi203.stdout:0/215: read - d0/d1d/d2f/f42 zero size 2024-04-12T09:11:23.284 INFO:tasks.workunit.client.0.smithi117.stdout:8/901: mknod db/d1b/d62/df0/d114/c131 0 2024-04-12T09:11:23.285 INFO:tasks.workunit.client.0.smithi117.stdout:5/929: creat d2/d3/dd/d39/d83/dc8/dd1/f133 x:0 0 0 2024-04-12T09:11:23.289 INFO:tasks.workunit.client.1.smithi203.stdout:0/216: dwrite d0/f2c [0,4194304] 0 2024-04-12T09:11:23.289 INFO:tasks.workunit.client.0.smithi117.stdout:8/902: dwrite db/d19/d1a/d3d/d60/d70/d98/fe6 [0,4194304] 0 2024-04-12T09:11:23.291 INFO:tasks.workunit.client.1.smithi203.stdout:6/172: rename d1/d3/d26/d30/f31 to d1/d3/f34 0 2024-04-12T09:11:23.292 INFO:tasks.workunit.client.1.smithi203.stdout:4/154: link d1a/l1c d1a/d21/l2f 0 2024-04-12T09:11:23.293 INFO:tasks.workunit.client.0.smithi117.stdout:8/903: mknod db/d19/d1a/d3d/d9c/dd4/c132 0 2024-04-12T09:11:23.295 INFO:tasks.workunit.client.1.smithi203.stdout:2/185: symlink d0/d14/d1e/d2a/l46 0 2024-04-12T09:11:23.304 INFO:tasks.workunit.client.1.smithi203.stdout:9/139: getdents d8/d12/d23/d29/d2c 0 2024-04-12T09:11:23.306 INFO:tasks.workunit.client.1.smithi203.stdout:2/186: mkdir d0/d3/d47 0 2024-04-12T09:11:23.306 INFO:tasks.workunit.client.1.smithi203.stdout:5/259: link d0/d6/d16/d9/d14/l31 d0/d6/d11/l60 0 2024-04-12T09:11:23.306 INFO:tasks.workunit.client.1.smithi203.stdout:5/260: stat d0/d6/f22 0 2024-04-12T09:11:23.309 INFO:tasks.workunit.client.1.smithi203.stdout:6/173: truncate d1/df/f18 2276937 0 2024-04-12T09:11:23.309 INFO:tasks.workunit.client.1.smithi203.stdout:6/174: chown d1/d3/cd 103670 1 2024-04-12T09:11:23.311 INFO:tasks.workunit.client.1.smithi203.stdout:4/155: getdents d1a/d1d/d23/d2c 0 2024-04-12T09:11:23.313 INFO:tasks.workunit.client.1.smithi203.stdout:8/154: getdents d4/d8/d1c 0 2024-04-12T09:11:23.314 INFO:tasks.workunit.client.1.smithi203.stdout:9/140: mknod d8/d12/d23/d27/c36 0 2024-04-12T09:11:23.315 INFO:tasks.workunit.client.1.smithi203.stdout:2/187: creat d0/d14/d1e/f48 x:0 0 0 2024-04-12T09:11:23.316 INFO:tasks.workunit.client.1.smithi203.stdout:6/175: dwrite d1/df/d28/f2c [0,4194304] 0 2024-04-12T09:11:23.317 INFO:tasks.workunit.client.1.smithi203.stdout:5/261: read d0/d6/d11/d18/d1a/f47 [1040337,63420] 0 2024-04-12T09:11:23.317 INFO:tasks.workunit.client.1.smithi203.stdout:2/188: chown d0/d3/c31 94099565 1 2024-04-12T09:11:23.319 INFO:tasks.workunit.client.1.smithi203.stdout:4/156: chown l8 499868566 1 2024-04-12T09:11:23.321 INFO:tasks.workunit.client.1.smithi203.stdout:8/155: write d4/d8/d19/f27 [412267,117521] 0 2024-04-12T09:11:23.322 INFO:tasks.workunit.client.1.smithi203.stdout:8/156: dread - d4/d8/d19/f25 zero size 2024-04-12T09:11:23.324 INFO:tasks.workunit.client.1.smithi203.stdout:8/157: stat d4/d8/d1c/c21 0 2024-04-12T09:11:23.324 INFO:tasks.workunit.client.1.smithi203.stdout:6/176: symlink d1/d3/d26/l35 0 2024-04-12T09:11:23.325 INFO:tasks.workunit.client.1.smithi203.stdout:2/189: dwrite d0/d3/f17 [0,4194304] 0 2024-04-12T09:11:23.326 INFO:tasks.workunit.client.0.smithi117.stdout:2/764: dwrite d0/f36 [0,4194304] 0 2024-04-12T09:11:23.331 INFO:tasks.workunit.client.1.smithi203.stdout:9/141: symlink d8/l37 0 2024-04-12T09:11:23.335 INFO:tasks.workunit.client.0.smithi117.stdout:2/765: mkdir d0/d43/d4b/dff 0 2024-04-12T09:11:23.336 INFO:tasks.workunit.client.0.smithi117.stdout:5/930: write d2/fc6 [1003747,80480] 0 2024-04-12T09:11:23.337 INFO:tasks.workunit.client.1.smithi203.stdout:6/177: mkdir d1/d3/d26/d36 0 2024-04-12T09:11:23.338 INFO:tasks.workunit.client.0.smithi117.stdout:5/931: dread - d2/d3/de/d1e/d66/f114 zero size 2024-04-12T09:11:23.341 INFO:tasks.workunit.client.1.smithi203.stdout:8/158: dwrite d4/d8/f1d [0,4194304] 0 2024-04-12T09:11:23.342 INFO:tasks.workunit.client.1.smithi203.stdout:1/204: rename df/c18 to df/d2d/c3e 0 2024-04-12T09:11:23.342 INFO:tasks.workunit.client.1.smithi203.stdout:5/262: rename d0/d6/d16/d9/d14 to d0/d6/d16/d9/d14/d2d/d61 22 2024-04-12T09:11:23.343 INFO:tasks.workunit.client.1.smithi203.stdout:8/159: chown d4/d8/d1c/f2c 1991 1 2024-04-12T09:11:23.343 INFO:tasks.workunit.client.1.smithi203.stdout:8/160: read f3 [1617768,117112] 0 2024-04-12T09:11:23.344 INFO:tasks.workunit.client.0.smithi117.stdout:2/766: symlink d0/df/de1/l100 0 2024-04-12T09:11:23.344 INFO:tasks.workunit.client.1.smithi203.stdout:5/263: write d0/d6/d11/d1e/f45 [1695623,49305] 0 2024-04-12T09:11:23.345 INFO:tasks.workunit.client.1.smithi203.stdout:9/142: mkdir d8/d12/d23/d38 0 2024-04-12T09:11:23.348 INFO:tasks.workunit.client.0.smithi117.stdout:8/904: truncate db/d19/d1a/d3d/d60/d70/f90 1205460 0 2024-04-12T09:11:23.349 INFO:tasks.workunit.client.1.smithi203.stdout:8/161: dread d4/d8/d19/f27 [0,4194304] 0 2024-04-12T09:11:23.349 INFO:tasks.workunit.client.1.smithi203.stdout:8/162: write d4/f2d [811976,43435] 0 2024-04-12T09:11:23.350 INFO:tasks.workunit.client.1.smithi203.stdout:0/217: write d0/d1d/d2f/d17/f11 [856050,7777] 0 2024-04-12T09:11:23.353 INFO:tasks.workunit.client.1.smithi203.stdout:6/178: rmdir d1/d3/d4 39 2024-04-12T09:11:23.355 INFO:tasks.workunit.client.0.smithi117.stdout:5/932: mkdir d2/d3/de/d134 0 2024-04-12T09:11:23.357 INFO:tasks.workunit.client.0.smithi117.stdout:2/767: dread d0/d43/d30/f88 [0,4194304] 0 2024-04-12T09:11:23.357 INFO:tasks.workunit.client.0.smithi117.stdout:8/905: rmdir db/d1b/d62/dae/df9/d12b/d86/da0/da4 39 2024-04-12T09:11:23.359 INFO:tasks.workunit.client.1.smithi203.stdout:0/218: dwrite d0/d1d/d2f/d17/d19/f25 [4194304,4194304] 0 2024-04-12T09:11:23.362 INFO:tasks.workunit.client.1.smithi203.stdout:1/205: creat df/f3f x:0 0 0 2024-04-12T09:11:23.363 INFO:tasks.workunit.client.1.smithi203.stdout:1/206: chown df/d34/f36 109 1 2024-04-12T09:11:23.364 INFO:tasks.workunit.client.0.smithi117.stdout:8/906: dwrite db/f30 [0,4194304] 0 2024-04-12T09:11:23.365 INFO:tasks.workunit.client.1.smithi203.stdout:1/207: stat f4 0 2024-04-12T09:11:23.365 INFO:tasks.workunit.client.1.smithi203.stdout:3/163: dread d2/f2b [0,4194304] 0 2024-04-12T09:11:23.365 INFO:tasks.workunit.client.1.smithi203.stdout:1/208: chown df/l23 2401154 1 2024-04-12T09:11:23.366 INFO:tasks.workunit.client.0.smithi117.stdout:5/933: symlink d2/d3/d124/l135 0 2024-04-12T09:11:23.369 INFO:tasks.workunit.client.1.smithi203.stdout:4/157: dwrite d1a/d1d/f1e [0,4194304] 0 2024-04-12T09:11:23.370 INFO:tasks.workunit.client.1.smithi203.stdout:5/264: rmdir d0/d6/d11/d4a 39 2024-04-12T09:11:23.372 INFO:tasks.workunit.client.0.smithi117.stdout:5/934: symlink d2/d3/de/d1e/d2c/l136 0 2024-04-12T09:11:23.374 INFO:tasks.workunit.client.1.smithi203.stdout:7/174: sync 2024-04-12T09:11:23.374 INFO:tasks.workunit.client.0.smithi117.stdout:8/907: creat db/d4b/d11b/f133 x:0 0 0 2024-04-12T09:11:23.376 INFO:tasks.workunit.client.1.smithi203.stdout:3/164: dwrite d2/fd [0,4194304] 0 2024-04-12T09:11:23.377 INFO:tasks.workunit.client.1.smithi203.stdout:8/163: rename d4/d8/d19/f28 to d4/d8/d19/f32 0 2024-04-12T09:11:23.378 INFO:tasks.workunit.client.0.smithi117.stdout:8/908: symlink db/d1b/d62/dae/df9/l134 0 2024-04-12T09:11:23.383 INFO:tasks.workunit.client.1.smithi203.stdout:0/219: creat d0/d1d/d2f/d17/f47 x:0 0 0 2024-04-12T09:11:23.384 INFO:tasks.workunit.client.1.smithi203.stdout:5/265: dread d0/d6/d11/d18/d1a/f47 [0,4194304] 0 2024-04-12T09:11:23.385 INFO:tasks.workunit.client.1.smithi203.stdout:1/209: rename df/d34/f36 to df/d34/f40 0 2024-04-12T09:11:23.386 INFO:tasks.workunit.client.1.smithi203.stdout:2/190: dwrite d0/d3/f9 [0,4194304] 0 2024-04-12T09:11:23.386 INFO:tasks.workunit.client.1.smithi203.stdout:6/179: write d1/d3/d4/f1d [942772,26480] 0 2024-04-12T09:11:23.387 INFO:tasks.workunit.client.1.smithi203.stdout:4/158: dwrite d1a/d21/d22/f25 [0,4194304] 0 2024-04-12T09:11:23.388 INFO:tasks.workunit.client.1.smithi203.stdout:0/220: write d0/d1d/d2f/d17/f11 [678458,119176] 0 2024-04-12T09:11:23.391 INFO:tasks.workunit.client.1.smithi203.stdout:0/221: chown d0/d1d/d2f/l12 1634982701 1 2024-04-12T09:11:23.391 INFO:tasks.workunit.client.1.smithi203.stdout:9/143: mknod d8/c39 0 2024-04-12T09:11:23.393 INFO:tasks.workunit.client.1.smithi203.stdout:0/222: stat d0/d1d/c2a 0 2024-04-12T09:11:23.393 INFO:tasks.workunit.client.1.smithi203.stdout:8/164: readlink d4/d8/l18 0 2024-04-12T09:11:23.394 INFO:tasks.workunit.client.1.smithi203.stdout:7/175: truncate d0/d15/d2d/f32 4810793 0 2024-04-12T09:11:23.396 INFO:tasks.workunit.client.1.smithi203.stdout:1/210: creat df/d20/f41 x:0 0 0 2024-04-12T09:11:23.396 INFO:tasks.workunit.client.1.smithi203.stdout:2/191: mknod d0/d38/c49 0 2024-04-12T09:11:23.398 INFO:tasks.workunit.client.1.smithi203.stdout:6/180: creat d1/f37 x:0 0 0 2024-04-12T09:11:23.398 INFO:tasks.workunit.client.1.smithi203.stdout:4/159: mknod d1a/d21/d22/c30 0 2024-04-12T09:11:23.399 INFO:tasks.workunit.client.1.smithi203.stdout:9/144: readlink d8/d12/l20 0 2024-04-12T09:11:23.401 INFO:tasks.workunit.client.1.smithi203.stdout:8/165: mknod d4/d8/d19/c33 0 2024-04-12T09:11:23.401 INFO:tasks.workunit.client.1.smithi203.stdout:2/192: truncate d0/f32 814073 0 2024-04-12T09:11:23.402 INFO:tasks.workunit.client.1.smithi203.stdout:6/181: readlink d1/d3/d26/l32 0 2024-04-12T09:11:23.403 INFO:tasks.workunit.client.1.smithi203.stdout:4/160: chown d1a/d1d/l1f 6 1 2024-04-12T09:11:23.403 INFO:tasks.workunit.client.1.smithi203.stdout:9/145: stat d8/d12/d14/f1f 0 2024-04-12T09:11:23.404 INFO:tasks.workunit.client.1.smithi203.stdout:1/211: creat df/d20/d2b/f42 x:0 0 0 2024-04-12T09:11:23.408 INFO:tasks.workunit.client.1.smithi203.stdout:6/182: write d1/df/d1b/f23 [2247578,102705] 0 2024-04-12T09:11:23.408 INFO:tasks.workunit.client.1.smithi203.stdout:1/212: creat df/f43 x:0 0 0 2024-04-12T09:11:23.409 INFO:tasks.workunit.client.1.smithi203.stdout:7/176: dread d0/d4/d1c/f35 [0,4194304] 0 2024-04-12T09:11:23.410 INFO:tasks.workunit.client.1.smithi203.stdout:9/146: creat d8/d12/d23/f3a x:0 0 0 2024-04-12T09:11:23.411 INFO:tasks.workunit.client.1.smithi203.stdout:5/266: dwrite d0/d6/fe [4194304,4194304] 0 2024-04-12T09:11:23.412 INFO:tasks.workunit.client.0.smithi117.stdout:8/909: dread db/d77/f76 [0,4194304] 0 2024-04-12T09:11:23.413 INFO:tasks.workunit.client.0.smithi117.stdout:8/910: readlink db/d1b/d62/dae/df9/d12b/d86/l11a 0 2024-04-12T09:11:23.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.414+0000 7ff755750700 1 -- 172.21.15.117:0/3097112858 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff7501119f0 con 0x7ff7500fbcd0 2024-04-12T09:11:23.415 INFO:tasks.workunit.client.1.smithi203.stdout:1/213: creat df/d20/d2b/f44 x:0 0 0 2024-04-12T09:11:23.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.415+0000 7ff7377fe700 1 -- 172.21.15.117:0/3097112858 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7ff740058790 con 0x7ff7500fbcd0 2024-04-12T09:11:23.416 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:11:23.416 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": { 2024-04-12T09:11:23.416 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 2 2024-04-12T09:11:23.416 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:11:23.416 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": { 2024-04-12T09:11:23.416 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 1, 2024-04-12T09:11:23.416 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 1 2024-04-12T09:11:23.416 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:11:23.416 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": { 2024-04-12T09:11:23.416 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 6 2024-04-12T09:11:23.416 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:11:23.417 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-04-12T09:11:23.417 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 4 2024-04-12T09:11:23.417 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:11:23.417 INFO:teuthology.orchestra.run.smithi117.stdout: "overall": { 2024-04-12T09:11:23.417 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 13, 2024-04-12T09:11:23.417 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 1 2024-04-12T09:11:23.417 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:11:23.417 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:11:23.417 INFO:tasks.workunit.client.1.smithi203.stdout:4/161: rmdir d1a/d20/d2d 0 2024-04-12T09:11:23.418 INFO:tasks.workunit.client.1.smithi203.stdout:5/267: chown d0/d6/d16/d9 289 1 2024-04-12T09:11:23.418 INFO:tasks.workunit.client.1.smithi203.stdout:6/183: creat d1/df/f38 x:0 0 0 2024-04-12T09:11:23.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.419+0000 7ff755750700 1 -- 172.21.15.117:0/3097112858 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7ff73806b540 msgr2=0x7ff73806d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:23.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.419+0000 7ff755750700 1 --2- 172.21.15.117:0/3097112858 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7ff73806b540 0x7ff73806d9f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff7440102e0 tx=0x7ff74400b040 comp rx=0 tx=0).stop 2024-04-12T09:11:23.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.419+0000 7ff755750700 1 -- 172.21.15.117:0/3097112858 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7500fbcd0 msgr2=0x7ff75010fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:23.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.419+0000 7ff755750700 1 --2- 172.21.15.117:0/3097112858 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7500fbcd0 0x7ff75010fb70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff74000b970 tx=0x7ff740009e30 comp rx=0 tx=0).stop 2024-04-12T09:11:23.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.419+0000 7ff755750700 1 -- 172.21.15.117:0/3097112858 shutdown_connections 2024-04-12T09:11:23.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.419+0000 7ff755750700 1 --2- 172.21.15.117:0/3097112858 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7500fbcd0 0x7ff75010fb70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:23.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.419+0000 7ff755750700 1 --2- 172.21.15.117:0/3097112858 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7ff73806b540 0x7ff73806d9f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:23.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.419+0000 7ff755750700 1 --2- 172.21.15.117:0/3097112858 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7500fcf80 0x7ff7501100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:23.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.419+0000 7ff755750700 1 -- 172.21.15.117:0/3097112858 >> 172.21.15.117:0/3097112858 conn(0x7ff7500f7430 msgr2=0x7ff7500f8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:11:23.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.419+0000 7ff755750700 1 -- 172.21.15.117:0/3097112858 shutdown_connections 2024-04-12T09:11:23.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.419+0000 7ff755750700 1 -- 172.21.15.117:0/3097112858 wait complete. 2024-04-12T09:11:23.422 INFO:tasks.workunit.client.1.smithi203.stdout:0/223: dwrite d0/f1a [8388608,4194304] 0 2024-04-12T09:11:23.424 INFO:tasks.workunit.client.1.smithi203.stdout:7/177: dread d0/d15/d2d/f32 [4194304,4194304] 0 2024-04-12T09:11:23.425 INFO:tasks.workunit.client.1.smithi203.stdout:2/193: dwrite d0/d2e/f34 [0,4194304] 0 2024-04-12T09:11:23.427 INFO:tasks.workunit.client.1.smithi203.stdout:8/166: dwrite d4/d8/f24 [0,4194304] 0 2024-04-12T09:11:23.428 INFO:tasks.workunit.client.0.smithi117.stdout:5/935: dwrite d2/d3/de/d1e/d35/f93 [4194304,4194304] 0 2024-04-12T09:11:23.428 INFO:tasks.workunit.client.1.smithi203.stdout:5/268: write d0/d6/d11/d1e/d4c/f42 [1042892,93099] 0 2024-04-12T09:11:23.430 INFO:tasks.workunit.client.1.smithi203.stdout:8/167: chown d4/f13 0 1 2024-04-12T09:11:23.430 INFO:tasks.workunit.client.1.smithi203.stdout:4/162: creat d1a/d21/f31 x:0 0 0 2024-04-12T09:11:23.431 INFO:tasks.workunit.client.1.smithi203.stdout:2/194: fsync d0/d14/f22 0 2024-04-12T09:11:23.433 INFO:tasks.workunit.client.1.smithi203.stdout:1/214: dread df/d2d/f32 [0,4194304] 0 2024-04-12T09:11:23.435 INFO:tasks.workunit.client.1.smithi203.stdout:9/147: rename d8/d12/d23/d27/d2d to d8/d3b 0 2024-04-12T09:11:23.437 INFO:tasks.workunit.client.1.smithi203.stdout:5/269: write d0/d6/d16/d44/f5c [161210,77247] 0 2024-04-12T09:11:23.438 INFO:tasks.workunit.client.1.smithi203.stdout:7/178: dread d0/d15/d2d/f32 [0,4194304] 0 2024-04-12T09:11:23.438 INFO:tasks.workunit.client.0.smithi117.stdout:5/936: readlink d2/d3/dd/d39/d83/l5b 0 2024-04-12T09:11:23.440 INFO:tasks.workunit.client.0.smithi117.stdout:5/937: chown d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1 9 1 2024-04-12T09:11:23.442 INFO:tasks.workunit.client.1.smithi203.stdout:0/224: mkdir d0/d48 0 2024-04-12T09:11:23.443 INFO:tasks.workunit.client.1.smithi203.stdout:0/225: write d0/d1d/d2f/f42 [905702,93717] 0 2024-04-12T09:11:23.444 INFO:tasks.workunit.client.1.smithi203.stdout:8/168: truncate d4/f6 752031 0 2024-04-12T09:11:23.445 INFO:tasks.workunit.client.0.smithi117.stdout:5/938: mknod d2/d3/de/d1e/d46/d96/c137 0 2024-04-12T09:11:23.445 INFO:tasks.workunit.client.1.smithi203.stdout:8/169: read - d4/d8/d19/f1b zero size 2024-04-12T09:11:23.445 INFO:tasks.workunit.client.1.smithi203.stdout:8/170: chown d4/ca 0 1 2024-04-12T09:11:23.448 INFO:tasks.workunit.client.1.smithi203.stdout:9/148: mknod d8/d12/d23/d27/c3c 0 2024-04-12T09:11:23.448 INFO:tasks.workunit.client.1.smithi203.stdout:5/270: creat d0/d6/d16/d8/f62 x:0 0 0 2024-04-12T09:11:23.450 INFO:tasks.workunit.client.1.smithi203.stdout:4/163: symlink d1a/l32 0 2024-04-12T09:11:23.453 INFO:tasks.workunit.client.1.smithi203.stdout:8/171: mkdir d4/d34 0 2024-04-12T09:11:23.454 INFO:tasks.workunit.client.0.smithi117.stdout:8/911: write db/d1b/d62/dae/df9/d12b/d86/da0/fca [817192,61515] 0 2024-04-12T09:11:23.455 INFO:tasks.workunit.client.1.smithi203.stdout:8/172: write d4/f1f [734282,79105] 0 2024-04-12T09:11:23.457 INFO:tasks.workunit.client.1.smithi203.stdout:2/195: link d0/d3/c31 d0/d3/d47/c4a 0 2024-04-12T09:11:23.461 INFO:tasks.workunit.client.0.smithi117.stdout:8/912: dwrite db/d77/fe2 [0,4194304] 0 2024-04-12T09:11:23.462 INFO:tasks.workunit.client.1.smithi203.stdout:4/164: dwrite f14 [0,4194304] 0 2024-04-12T09:11:23.463 INFO:tasks.workunit.client.1.smithi203.stdout:7/179: creat d0/f40 x:0 0 0 2024-04-12T09:11:23.464 INFO:tasks.workunit.client.1.smithi203.stdout:8/173: creat d4/f35 x:0 0 0 2024-04-12T09:11:23.465 INFO:tasks.workunit.client.1.smithi203.stdout:6/184: getdents d1/df/d1b 0 2024-04-12T09:11:23.466 INFO:tasks.workunit.client.0.smithi117.stdout:8/913: write db/d1b/d62/dae/df9/d12b/d86/da0/da4/fce [4354891,7377] 0 2024-04-12T09:11:23.466 INFO:tasks.workunit.client.1.smithi203.stdout:7/180: truncate d0/d4/d1c/f1f 1089928 0 2024-04-12T09:11:23.469 INFO:tasks.workunit.client.1.smithi203.stdout:0/226: dread d0/d1d/d2f/d17/f11 [0,4194304] 0 2024-04-12T09:11:23.470 INFO:tasks.workunit.client.1.smithi203.stdout:1/215: getdents df/d20/d2b 0 2024-04-12T09:11:23.473 INFO:tasks.workunit.client.0.smithi117.stdout:8/914: symlink db/d1b/d55/d10e/l135 0 2024-04-12T09:11:23.478 INFO:tasks.workunit.client.0.smithi117.stdout:8/915: rmdir db/d19/dd2 39 2024-04-12T09:11:23.479 INFO:tasks.workunit.client.0.smithi117.stdout:8/916: fsync db/d1b/d62/dae/df9/d12b/fbf 0 2024-04-12T09:11:23.481 INFO:tasks.workunit.client.1.smithi203.stdout:4/165: dwrite d1a/d1d/d23/f28 [0,4194304] 0 2024-04-12T09:11:23.483 INFO:tasks.workunit.client.1.smithi203.stdout:8/174: rename l1 to d4/d8/d19/l36 0 2024-04-12T09:11:23.484 INFO:tasks.workunit.client.1.smithi203.stdout:8/175: chown d4/f2d 2262 1 2024-04-12T09:11:23.486 INFO:tasks.workunit.client.1.smithi203.stdout:5/271: creat d0/d6/d16/d9/f63 x:0 0 0 2024-04-12T09:11:23.486 INFO:tasks.workunit.client.0.smithi117.stdout:8/917: mknod db/d1b/d55/c136 0 2024-04-12T09:11:23.488 INFO:tasks.workunit.client.1.smithi203.stdout:7/181: mknod d0/d34/c41 0 2024-04-12T09:11:23.490 INFO:tasks.workunit.client.1.smithi203.stdout:9/149: dwrite d8/f2a [0,4194304] 0 2024-04-12T09:11:23.491 INFO:tasks.workunit.client.1.smithi203.stdout:1/216: truncate df/f19 1294860 0 2024-04-12T09:11:23.493 INFO:tasks.workunit.client.0.smithi117.stdout:8/918: dwrite db/d1b/d62/df0/d114/f124 [0,4194304] 0 2024-04-12T09:11:23.495 INFO:tasks.workunit.client.1.smithi203.stdout:4/166: creat d1a/d21/f33 x:0 0 0 2024-04-12T09:11:23.495 INFO:tasks.workunit.client.1.smithi203.stdout:8/176: dwrite d4/d8/d19/f2e [0,4194304] 0 2024-04-12T09:11:23.498 INFO:tasks.workunit.client.1.smithi203.stdout:5/272: creat d0/d6/d11/d1e/d4c/f64 x:0 0 0 2024-04-12T09:11:23.499 INFO:tasks.workunit.client.1.smithi203.stdout:0/227: mknod d0/c49 0 2024-04-12T09:11:23.500 INFO:tasks.workunit.client.1.smithi203.stdout:1/217: dread df/f1e [0,4194304] 0 2024-04-12T09:11:23.500 INFO:tasks.workunit.client.0.smithi117.stdout:8/919: creat db/d19/d1a/d3d/d9c/dd4/f137 x:0 0 0 2024-04-12T09:11:23.502 INFO:tasks.workunit.client.1.smithi203.stdout:2/196: link d0/l26 d0/d19/l4b 0 2024-04-12T09:11:23.502 INFO:tasks.workunit.client.0.smithi117.stdout:8/920: write db/d1b/d62/dae/df9/d12b/dc3/d9d/dc9/f111 [918319,33664] 0 2024-04-12T09:11:23.505 INFO:tasks.workunit.client.1.smithi203.stdout:6/185: creat d1/d3/f39 x:0 0 0 2024-04-12T09:11:23.506 INFO:tasks.workunit.client.1.smithi203.stdout:9/150: write d8/d12/f16 [844387,30689] 0 2024-04-12T09:11:23.507 INFO:tasks.workunit.client.0.smithi117.stdout:8/921: mkdir db/d1b/d62/dae/df9/d12b/dc3/d138 0 2024-04-12T09:11:23.507 INFO:tasks.workunit.client.1.smithi203.stdout:4/167: chown c16 77952246 1 2024-04-12T09:11:23.507 INFO:tasks.workunit.client.1.smithi203.stdout:0/228: dwrite d0/f1a [4194304,4194304] 0 2024-04-12T09:11:23.510 INFO:tasks.workunit.client.1.smithi203.stdout:9/151: truncate d8/d12/d23/f26 1211079 0 2024-04-12T09:11:23.512 INFO:tasks.workunit.client.1.smithi203.stdout:3/165: sync 2024-04-12T09:11:23.513 INFO:tasks.workunit.client.1.smithi203.stdout:5/273: mkdir d0/d6/d11/d1e/d65 0 2024-04-12T09:11:23.517 INFO:tasks.workunit.client.1.smithi203.stdout:6/186: mkdir d1/df/d28/d3a 0 2024-04-12T09:11:23.519 INFO:tasks.workunit.client.1.smithi203.stdout:0/229: rmdir d0/d1d 39 2024-04-12T09:11:23.519 INFO:tasks.workunit.client.1.smithi203.stdout:0/230: chown d0/l45 0 1 2024-04-12T09:11:23.522 INFO:tasks.workunit.client.1.smithi203.stdout:1/218: mkdir df/d2d/d45 0 2024-04-12T09:11:23.523 INFO:tasks.workunit.client.1.smithi203.stdout:1/219: write df/f17 [451993,120902] 0 2024-04-12T09:11:23.526 INFO:tasks.workunit.client.1.smithi203.stdout:5/274: creat d0/f66 x:0 0 0 2024-04-12T09:11:23.527 INFO:tasks.workunit.client.1.smithi203.stdout:3/166: rename d2/d8/d14/d2d to d2/d8/d14/d1b/d2f 0 2024-04-12T09:11:23.528 INFO:tasks.workunit.client.1.smithi203.stdout:6/187: mkdir d1/df/d1b/d3b 0 2024-04-12T09:11:23.529 INFO:tasks.workunit.client.1.smithi203.stdout:4/168: mkdir d1a/d34 0 2024-04-12T09:11:23.530 INFO:tasks.workunit.client.1.smithi203.stdout:1/220: dwrite df/d20/d2b/f44 [0,4194304] 0 2024-04-12T09:11:23.533 INFO:tasks.workunit.client.1.smithi203.stdout:7/182: dread d0/d4/f11 [0,4194304] 0 2024-04-12T09:11:23.534 INFO:tasks.workunit.client.1.smithi203.stdout:7/183: write d0/d15/f20 [185107,64697] 0 2024-04-12T09:11:23.535 INFO:tasks.workunit.client.1.smithi203.stdout:8/177: truncate d4/f1f 622214 0 2024-04-12T09:11:23.536 INFO:tasks.workunit.client.0.smithi117.stdout:9/731: sync 2024-04-12T09:11:23.538 INFO:tasks.workunit.client.1.smithi203.stdout:7/184: dread d0/d4/f11 [0,4194304] 0 2024-04-12T09:11:23.538 INFO:tasks.workunit.client.0.smithi117.stdout:8/922: truncate db/d19/d1a/d3d/f45 3118162 0 2024-04-12T09:11:23.539 INFO:tasks.workunit.client.1.smithi203.stdout:7/185: stat d0/d4/d1c 0 2024-04-12T09:11:23.539 INFO:tasks.workunit.client.1.smithi203.stdout:7/186: chown d0/d15/d2d/f32 30360 1 2024-04-12T09:11:23.540 INFO:tasks.workunit.client.1.smithi203.stdout:5/275: rename d0/d6/d11/l12 to d0/l67 0 2024-04-12T09:11:23.543 INFO:tasks.workunit.client.0.smithi117.stdout:9/732: readlink d1/d8/df/d1b/l40 0 2024-04-12T09:11:23.543 INFO:tasks.workunit.client.1.smithi203.stdout:2/197: truncate d0/d2e/f34 3894034 0 2024-04-12T09:11:23.544 INFO:tasks.workunit.client.0.smithi117.stdout:8/923: fdatasync db/da6/f11e 0 2024-04-12T09:11:23.547 INFO:tasks.workunit.client.1.smithi203.stdout:5/276: dwrite d0/f66 [0,4194304] 0 2024-04-12T09:11:23.547 INFO:tasks.workunit.client.0.smithi117.stdout:9/733: creat d1/d8/d90/fec x:0 0 0 2024-04-12T09:11:23.549 INFO:tasks.workunit.client.0.smithi117.stdout:8/924: rmdir db/d1b/d62/dae/df9/d12b/d86 39 2024-04-12T09:11:23.549 INFO:tasks.workunit.client.1.smithi203.stdout:1/221: creat df/d34/f46 x:0 0 0 2024-04-12T09:11:23.550 INFO:tasks.workunit.client.0.smithi117.stdout:8/925: chown db/d1b/l10f 35 1 2024-04-12T09:11:23.552 INFO:tasks.workunit.client.0.smithi117.stdout:9/734: creat d1/d8/d12/fed x:0 0 0 2024-04-12T09:11:23.553 INFO:tasks.workunit.client.1.smithi203.stdout:2/198: dread d0/d14/f22 [0,4194304] 0 2024-04-12T09:11:23.553 INFO:tasks.workunit.client.0.smithi117.stdout:9/735: stat d1/d8/df/fcf 0 2024-04-12T09:11:23.554 INFO:tasks.workunit.client.1.smithi203.stdout:2/199: fsync d0/d14/d1e/f48 0 2024-04-12T09:11:23.555 INFO:tasks.workunit.client.1.smithi203.stdout:9/152: dwrite d8/f15 [0,4194304] 0 2024-04-12T09:11:23.559 INFO:tasks.workunit.client.0.smithi117.stdout:8/926: dwrite db/d19/d1a/d3d/d60/d70/d98/fe6 [0,4194304] 0 2024-04-12T09:11:23.560 INFO:tasks.workunit.client.1.smithi203.stdout:0/231: truncate d0/f13 2567885 0 2024-04-12T09:11:23.562 INFO:tasks.workunit.client.0.smithi117.stdout:9/736: creat d1/d8/d12/fee x:0 0 0 2024-04-12T09:11:23.565 INFO:tasks.workunit.client.1.smithi203.stdout:4/169: creat d1a/d34/f35 x:0 0 0 2024-04-12T09:11:23.570 INFO:tasks.workunit.client.1.smithi203.stdout:1/222: dread df/f19 [0,4194304] 0 2024-04-12T09:11:23.571 INFO:tasks.workunit.client.1.smithi203.stdout:1/223: chown df/l12 1790 1 2024-04-12T09:11:23.572 INFO:tasks.workunit.client.0.smithi117.stdout:9/737: write d1/d8/df/d68/ddf/daf/d3b/f4c [1641409,1755] 0 2024-04-12T09:11:23.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:23 smithi203 ceph-mon[36428]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:11:23.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:23 smithi203 ceph-mon[36428]: from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:11:23.575 INFO:tasks.workunit.client.1.smithi203.stdout:8/178: mkdir d4/d8/d37 0 2024-04-12T09:11:23.580 INFO:tasks.workunit.client.1.smithi203.stdout:3/167: creat d2/f30 x:0 0 0 2024-04-12T09:11:23.581 INFO:tasks.workunit.client.1.smithi203.stdout:3/168: write d2/d8/d14/f27 [336383,64664] 0 2024-04-12T09:11:23.584 INFO:tasks.workunit.client.1.smithi203.stdout:0/232: truncate d0/d1d/d2f/d17/f47 707468 0 2024-04-12T09:11:23.584 INFO:tasks.workunit.client.0.smithi117.stdout:9/738: link d1/d8/d5a/d6e/d71/ld0 d1/d8/d5e/d9f/lef 0 2024-04-12T09:11:23.586 INFO:tasks.workunit.client.0.smithi117.stdout:8/927: dwrite db/d13/f91 [0,4194304] 0 2024-04-12T09:11:23.589 INFO:tasks.workunit.client.0.smithi117.stdout:9/739: dread - d1/d24/fcc zero size 2024-04-12T09:11:23.594 INFO:tasks.workunit.client.1.smithi203.stdout:9/153: link d8/f2a d8/d12/d23/d38/f3d 0 2024-04-12T09:11:23.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.593+0000 7fc5277de700 1 -- 172.21.15.117:0/3924107687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc520066b70 msgr2=0x7fc5200ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:23.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.593+0000 7fc5277de700 1 --2- 172.21.15.117:0/3924107687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc520066b70 0x7fc5200ff9e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc51c004940 tx=0x7fc51c009e30 comp rx=0 tx=0).stop 2024-04-12T09:11:23.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.593+0000 7fc5277de700 1 -- 172.21.15.117:0/3924107687 shutdown_connections 2024-04-12T09:11:23.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.593+0000 7fc5277de700 1 --2- 172.21.15.117:0/3924107687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc5200fff20 0x7fc520102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:23.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.593+0000 7fc5277de700 1 --2- 172.21.15.117:0/3924107687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc520066b70 0x7fc5200ff9e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:23.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.593+0000 7fc5277de700 1 -- 172.21.15.117:0/3924107687 >> 172.21.15.117:0/3924107687 conn(0x7fc5200f7450 msgr2=0x7fc5200f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:11:23.595 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:23 smithi117 ceph-mon[29277]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:11:23.595 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:23 smithi117 ceph-mon[29277]: from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:11:23.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.594+0000 7fc5277de700 1 -- 172.21.15.117:0/3924107687 shutdown_connections 2024-04-12T09:11:23.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.594+0000 7fc5277de700 1 -- 172.21.15.117:0/3924107687 wait complete. 2024-04-12T09:11:23.596 INFO:tasks.workunit.client.0.smithi117.stdout:9/740: creat d1/d8/d5e/d9f/ff0 x:0 0 0 2024-04-12T09:11:23.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.594+0000 7fc5277de700 1 Processor -- start 2024-04-12T09:11:23.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.594+0000 7fc5277de700 1 -- start start 2024-04-12T09:11:23.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.595+0000 7fc5277de700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc520066b70 0x7fc52010fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:23.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.595+0000 7fc5277de700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5200fff20 0x7fc520110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:23.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.595+0000 7fc5277de700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc520110820 con 0x7fc5200fff20 2024-04-12T09:11:23.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.595+0000 7fc5277de700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc520111010 con 0x7fc520066b70 2024-04-12T09:11:23.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.595+0000 7fc524d79700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5200fff20 0x7fc520110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:23.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.595+0000 7fc524d79700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5200fff20 0x7fc520110190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:47900/0 (socket says 172.21.15.117:47900) 2024-04-12T09:11:23.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.595+0000 7fc524d79700 1 -- 172.21.15.117:0/888114636 learned_addr learned my addr 172.21.15.117:0/888114636 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:11:23.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.595+0000 7fc52557a700 1 --2- 172.21.15.117:0/888114636 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc520066b70 0x7fc52010fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:23.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.596+0000 7fc524d79700 1 -- 172.21.15.117:0/888114636 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc520066b70 msgr2=0x7fc52010fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:23.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.596+0000 7fc524d79700 1 --2- 172.21.15.117:0/888114636 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc520066b70 0x7fc52010fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:23.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.596+0000 7fc524d79700 1 -- 172.21.15.117:0/888114636 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51c005040 con 0x7fc5200fff20 2024-04-12T09:11:23.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.596+0000 7fc524d79700 1 --2- 172.21.15.117:0/888114636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5200fff20 0x7fc520110190 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc51000b790 tx=0x7fc510009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:11:23.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.596+0000 7fc515ffb700 1 -- 172.21.15.117:0/888114636 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc51000f6f0 con 0x7fc5200fff20 2024-04-12T09:11:23.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.596+0000 7fc515ffb700 1 -- 172.21.15.117:0/888114636 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc51000fd20 con 0x7fc5200fff20 2024-04-12T09:11:23.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.596+0000 7fc515ffb700 1 -- 172.21.15.117:0/888114636 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc510011e90 con 0x7fc5200fff20 2024-04-12T09:11:23.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.596+0000 7fc5277de700 1 -- 172.21.15.117:0/888114636 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5201112f0 con 0x7fc5200fff20 2024-04-12T09:11:23.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.597+0000 7fc5277de700 1 -- 172.21.15.117:0/888114636 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc520111850 con 0x7fc5200fff20 2024-04-12T09:11:23.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.598+0000 7fc5277de700 1 -- 172.21.15.117:0/888114636 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc52005f5f0 con 0x7fc5200fff20 2024-04-12T09:11:23.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.599+0000 7fc515ffb700 1 -- 172.21.15.117:0/888114636 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 25) v1 ==== 89201+0+0 (secure 0 0 0) 0x7fc51000f850 con 0x7fc5200fff20 2024-04-12T09:11:23.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.599+0000 7fc515ffb700 1 --2- 172.21.15.117:0/888114636 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fc50c06b650 0x7fc50c06db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:23.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.599+0000 7fc515ffb700 1 -- 172.21.15.117:0/888114636 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc510089d50 con 0x7fc5200fff20 2024-04-12T09:11:23.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.600+0000 7fc52557a700 1 --2- 172.21.15.117:0/888114636 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fc50c06b650 0x7fc50c06db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:23.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.600+0000 7fc52557a700 1 --2- 172.21.15.117:0/888114636 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fc50c06b650 0x7fc50c06db00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc51c00b3b0 tx=0x7fc51c009e30 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:11:23.601 INFO:tasks.workunit.client.1.smithi203.stdout:3/169: creat d2/d1f/f31 x:0 0 0 2024-04-12T09:11:23.602 INFO:tasks.workunit.client.1.smithi203.stdout:3/170: chown d2/d8/l1e 0 1 2024-04-12T09:11:23.602 INFO:tasks.workunit.client.1.smithi203.stdout:3/171: chown d2 3912 1 2024-04-12T09:11:23.602 INFO:tasks.workunit.client.1.smithi203.stdout:7/187: rename d0/l14 to d0/d15/l42 0 2024-04-12T09:11:23.602 INFO:tasks.workunit.client.1.smithi203.stdout:7/188: read - d0/d4/d1c/d3b/f3f zero size 2024-04-12T09:11:23.602 INFO:tasks.workunit.client.1.smithi203.stdout:7/189: write d0/d4/f17 [3964517,879] 0 2024-04-12T09:11:23.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.605+0000 7fc515ffb700 1 -- 172.21.15.117:0/888114636 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7fc510057730 con 0x7fc5200fff20 2024-04-12T09:11:23.606 INFO:tasks.workunit.client.0.smithi117.stdout:9/741: creat d1/d8/df/ff1 x:0 0 0 2024-04-12T09:11:23.607 INFO:tasks.workunit.client.0.smithi117.stdout:8/928: dwrite db/d19/d1a/d3d/f47 [0,4194304] 0 2024-04-12T09:11:23.609 INFO:tasks.workunit.client.1.smithi203.stdout:0/233: creat d0/d1d/d2f/d34/f4a x:0 0 0 2024-04-12T09:11:23.610 INFO:tasks.workunit.client.1.smithi203.stdout:1/224: link df/l27 df/d34/l47 0 2024-04-12T09:11:23.613 INFO:tasks.workunit.client.1.smithi203.stdout:9/154: dread d8/d12/d23/d27/f32 [0,4194304] 0 2024-04-12T09:11:23.613 INFO:tasks.workunit.client.0.smithi117.stdout:9/742: creat d1/ff2 x:0 0 0 2024-04-12T09:11:23.613 INFO:tasks.workunit.client.0.smithi117.stdout:9/743: readlink d1/d8/df/d1b/l2d 0 2024-04-12T09:11:23.621 INFO:tasks.workunit.client.1.smithi203.stdout:9/155: dwrite d8/ff [0,4194304] 0 2024-04-12T09:11:23.647 INFO:tasks.workunit.client.1.smithi203.stdout:8/179: creat d4/d8/f38 x:0 0 0 2024-04-12T09:11:23.655 INFO:tasks.workunit.client.1.smithi203.stdout:6/188: sync 2024-04-12T09:11:23.667 INFO:tasks.workunit.client.0.smithi117.stdout:6/824: sync 2024-04-12T09:11:23.667 INFO:tasks.workunit.client.0.smithi117.stdout:7/692: sync 2024-04-12T09:11:23.667 INFO:tasks.workunit.client.0.smithi117.stdout:4/817: sync 2024-04-12T09:11:23.681 INFO:tasks.workunit.client.0.smithi117.stdout:8/929: creat db/d1b/d62/dae/df9/d12b/dc3/d138/f139 x:0 0 0 2024-04-12T09:11:23.682 INFO:tasks.workunit.client.1.smithi203.stdout:2/200: getdents d0/d14/d23/d3d 0 2024-04-12T09:11:23.689 INFO:tasks.workunit.client.0.smithi117.stdout:6/825: rename d8/d9/d39/f102 to d8/d3a/dc8/f10a 0 2024-04-12T09:11:23.695 INFO:tasks.workunit.client.0.smithi117.stdout:9/744: mknod d1/d24/cf3 0 2024-04-12T09:11:23.697 INFO:tasks.workunit.client.1.smithi203.stdout:1/225: fsync df/d20/f21 0 2024-04-12T09:11:23.697 INFO:tasks.workunit.client.1.smithi203.stdout:1/226: chown df/d20/f21 3338 1 2024-04-12T09:11:23.698 INFO:tasks.workunit.client.0.smithi117.stdout:7/693: creat d0/d2/d1a/d4f/dbc/fda x:0 0 0 2024-04-12T09:11:23.699 INFO:tasks.workunit.client.1.smithi203.stdout:1/227: dread df/f19 [0,4194304] 0 2024-04-12T09:11:23.706 INFO:tasks.workunit.client.0.smithi117.stdout:0/992: sync 2024-04-12T09:11:23.706 INFO:tasks.workunit.client.0.smithi117.stdout:5/939: sync 2024-04-12T09:11:23.706 INFO:tasks.workunit.client.0.smithi117.stdout:2/768: sync 2024-04-12T09:11:23.706 INFO:tasks.workunit.client.0.smithi117.stdout:1/815: sync 2024-04-12T09:11:23.706 INFO:tasks.workunit.client.0.smithi117.stdout:4/818: rename d0/db3 to d0/d5/d25/dfd/d107 0 2024-04-12T09:11:23.708 INFO:tasks.workunit.client.1.smithi203.stdout:8/180: unlink d4/d8/d1c/c20 0 2024-04-12T09:11:23.710 INFO:tasks.workunit.client.0.smithi117.stdout:6/826: mkdir d8/d3a/d49/da4/df8/d10b 0 2024-04-12T09:11:23.712 INFO:tasks.workunit.client.1.smithi203.stdout:2/201: creat d0/d14/d1e/d2a/f4c x:0 0 0 2024-04-12T09:11:23.719 INFO:tasks.workunit.client.1.smithi203.stdout:0/234: read d0/dd/f2d [1057111,52778] 0 2024-04-12T09:11:23.723 INFO:tasks.workunit.client.0.smithi117.stdout:7/694: dwrite d0/d2/d1a/d5f/f92 [4194304,4194304] 0 2024-04-12T09:11:23.723 INFO:tasks.workunit.client.0.smithi117.stdout:2/769: readlink d0/d4/d81/la9 0 2024-04-12T09:11:23.728 INFO:tasks.workunit.client.1.smithi203.stdout:9/156: mkdir d8/d12/d3e 0 2024-04-12T09:11:23.730 INFO:tasks.workunit.client.0.smithi117.stdout:4/819: unlink d0/d5/d3b/fb9 0 2024-04-12T09:11:23.733 INFO:tasks.workunit.client.1.smithi203.stdout:8/181: dread d4/f6 [0,4194304] 0 2024-04-12T09:11:23.733 INFO:tasks.workunit.client.1.smithi203.stdout:8/182: chown d4 12394 1 2024-04-12T09:11:23.734 INFO:tasks.workunit.client.1.smithi203.stdout:2/202: mknod d0/d2e/c4d 0 2024-04-12T09:11:23.735 INFO:tasks.workunit.client.1.smithi203.stdout:2/203: write d0/d3/f9 [4320890,5556] 0 2024-04-12T09:11:23.736 INFO:tasks.workunit.client.1.smithi203.stdout:2/204: read - d0/d14/d1e/d2a/f4c zero size 2024-04-12T09:11:23.737 INFO:tasks.workunit.client.0.smithi117.stdout:5/940: mkdir d2/d3/de/d1e/d46/de4/d138 0 2024-04-12T09:11:23.738 INFO:tasks.workunit.client.1.smithi203.stdout:3/172: getdents d2/d8/d14 0 2024-04-12T09:11:23.745 INFO:tasks.workunit.client.1.smithi203.stdout:7/190: getdents d0/d15 0 2024-04-12T09:11:23.748 INFO:tasks.workunit.client.1.smithi203.stdout:0/235: dwrite d0/d1d/d2f/d17/f11 [0,4194304] 0 2024-04-12T09:11:23.757 INFO:tasks.workunit.client.0.smithi117.stdout:4/820: fdatasync d0/d5/d25/dfd/d107/da7/dcd/fd5 0 2024-04-12T09:11:23.760 INFO:tasks.workunit.client.0.smithi117.stdout:1/816: mknod d1/dbd/d3f/d72/df8/c101 0 2024-04-12T09:11:23.765 INFO:tasks.workunit.client.1.smithi203.stdout:7/191: rename d0/d4/f25 to d0/d4/f43 0 2024-04-12T09:11:23.766 INFO:tasks.workunit.client.1.smithi203.stdout:7/192: read d0/d4/d1c/f35 [366052,61272] 0 2024-04-12T09:11:23.767 INFO:tasks.workunit.client.1.smithi203.stdout:9/157: dread f4 [0,4194304] 0 2024-04-12T09:11:23.769 INFO:tasks.workunit.client.0.smithi117.stdout:7/695: symlink d0/d2/d45/ldb 0 2024-04-12T09:11:23.769 INFO:tasks.workunit.client.1.smithi203.stdout:8/183: getdents d4/d8/d37 0 2024-04-12T09:11:23.770 INFO:tasks.workunit.client.1.smithi203.stdout:0/236: dread d0/d1d/d2f/f33 [0,4194304] 0 2024-04-12T09:11:23.772 INFO:tasks.workunit.client.1.smithi203.stdout:3/173: link d2/d8/d14/d23/f2a d2/d8/d14/d1b/d2f/f32 0 2024-04-12T09:11:23.774 INFO:tasks.workunit.client.1.smithi203.stdout:9/158: dwrite d8/f34 [0,4194304] 0 2024-04-12T09:11:23.778 INFO:tasks.workunit.client.0.smithi117.stdout:7/696: creat d0/d2/d45/d17/d23/dac/dad/d91/fdc x:0 0 0 2024-04-12T09:11:23.779 INFO:tasks.workunit.client.1.smithi203.stdout:1/228: rename df/d2d/f30 to df/d2d/f48 0 2024-04-12T09:11:23.779 INFO:tasks.workunit.client.1.smithi203.stdout:9/159: write d8/d12/d23/d27/f2e [1114279,126239] 0 2024-04-12T09:11:23.779 INFO:tasks.workunit.client.1.smithi203.stdout:8/184: dwrite d4/f13 [8388608,4194304] 0 2024-04-12T09:11:23.787 INFO:tasks.workunit.client.0.smithi117.stdout:1/817: creat d1/dbd/d3f/db/d1d/d78/dbc/f102 x:0 0 0 2024-04-12T09:11:23.795 INFO:tasks.workunit.client.1.smithi203.stdout:3/174: truncate d2/f2b 2293356 0 2024-04-12T09:11:23.796 INFO:tasks.workunit.client.0.smithi117.stdout:7/697: dread d0/d13/f40 [0,4194304] 0 2024-04-12T09:11:23.801 INFO:tasks.workunit.client.1.smithi203.stdout:3/175: dwrite d2/fa [4194304,4194304] 0 2024-04-12T09:11:23.810 INFO:tasks.workunit.client.0.smithi117.stdout:8/930: symlink db/d13/l13a 0 2024-04-12T09:11:23.811 INFO:tasks.workunit.client.1.smithi203.stdout:9/160: symlink d8/l3f 0 2024-04-12T09:11:23.816 INFO:tasks.workunit.client.1.smithi203.stdout:9/161: dread d8/d12/f16 [0,4194304] 0 2024-04-12T09:11:23.816 INFO:tasks.workunit.client.0.smithi117.stdout:8/931: unlink db/d77/f76 0 2024-04-12T09:11:23.817 INFO:tasks.workunit.client.1.smithi203.stdout:1/229: mkdir df/d2d/d49 0 2024-04-12T09:11:23.818 INFO:tasks.workunit.client.1.smithi203.stdout:1/230: write df/f2a [181886,22843] 0 2024-04-12T09:11:23.818 INFO:tasks.workunit.client.1.smithi203.stdout:1/231: chown df/d34/f46 496 1 2024-04-12T09:11:23.823 INFO:tasks.workunit.client.1.smithi203.stdout:3/176: dread d2/f17 [0,4194304] 0 2024-04-12T09:11:23.824 INFO:tasks.workunit.client.1.smithi203.stdout:3/177: write d2/f30 [587850,116162] 0 2024-04-12T09:11:23.830 INFO:tasks.workunit.client.1.smithi203.stdout:9/162: mkdir d8/d12/d23/d29/d2c/d40 0 2024-04-12T09:11:23.833 INFO:tasks.workunit.client.1.smithi203.stdout:1/232: rmdir df/d20 39 2024-04-12T09:11:23.833 INFO:tasks.workunit.client.1.smithi203.stdout:1/233: stat df/d34 0 2024-04-12T09:11:23.833 INFO:tasks.workunit.client.1.smithi203.stdout:9/163: dread d8/d12/d23/d27/f2e [0,4194304] 0 2024-04-12T09:11:23.834 INFO:tasks.workunit.client.1.smithi203.stdout:9/164: stat d8/fb 0 2024-04-12T09:11:23.834 INFO:tasks.workunit.client.1.smithi203.stdout:3/178: creat d2/d8/f33 x:0 0 0 2024-04-12T09:11:23.835 INFO:tasks.workunit.client.1.smithi203.stdout:3/179: chown d2/d8/f33 923 1 2024-04-12T09:11:23.838 INFO:tasks.workunit.client.1.smithi203.stdout:1/234: dwrite df/f2a [0,4194304] 0 2024-04-12T09:11:23.839 INFO:tasks.workunit.client.1.smithi203.stdout:1/235: fsync df/d34/f3b 0 2024-04-12T09:11:23.845 INFO:tasks.workunit.client.1.smithi203.stdout:9/165: dwrite f3 [0,4194304] 0 2024-04-12T09:11:23.846 INFO:tasks.workunit.client.1.smithi203.stdout:9/166: stat d8/c39 0 2024-04-12T09:11:23.846 INFO:tasks.workunit.client.1.smithi203.stdout:3/180: unlink d2/d1f/l24 0 2024-04-12T09:11:23.847 INFO:tasks.workunit.client.0.smithi117.stdout:8/932: dread db/d1b/f34 [0,4194304] 0 2024-04-12T09:11:23.850 INFO:tasks.workunit.client.1.smithi203.stdout:9/167: mkdir d8/d12/d23/d41 0 2024-04-12T09:11:23.851 INFO:tasks.workunit.client.1.smithi203.stdout:3/181: fdatasync d2/d8/d14/d23/f2a 0 2024-04-12T09:11:23.854 INFO:tasks.workunit.client.1.smithi203.stdout:3/182: dread d2/f30 [0,4194304] 0 2024-04-12T09:11:23.855 INFO:tasks.workunit.client.1.smithi203.stdout:1/236: mkdir df/d2d/d45/d4a 0 2024-04-12T09:11:23.856 INFO:tasks.workunit.client.1.smithi203.stdout:3/183: read d2/d8/d14/d1b/f25 [958544,37489] 0 2024-04-12T09:11:23.856 INFO:tasks.workunit.client.1.smithi203.stdout:1/237: write f4 [6536274,15119] 0 2024-04-12T09:11:23.857 INFO:tasks.workunit.client.1.smithi203.stdout:3/184: write d2/d8/d14/f22 [880458,56728] 0 2024-04-12T09:11:23.857 INFO:tasks.workunit.client.1.smithi203.stdout:9/168: rmdir d8/d12 39 2024-04-12T09:11:23.859 INFO:tasks.workunit.client.1.smithi203.stdout:9/169: read d8/f34 [3626875,92206] 0 2024-04-12T09:11:23.862 INFO:tasks.workunit.client.1.smithi203.stdout:1/238: dwrite df/f1d [0,4194304] 0 2024-04-12T09:11:23.863 INFO:tasks.workunit.client.1.smithi203.stdout:1/239: chown df/f2a 840879793 1 2024-04-12T09:11:23.867 INFO:tasks.workunit.client.1.smithi203.stdout:3/185: unlink d2/cb 0 2024-04-12T09:11:23.868 INFO:tasks.workunit.client.1.smithi203.stdout:3/186: fdatasync d2/d1f/f31 0 2024-04-12T09:11:23.869 INFO:tasks.workunit.client.1.smithi203.stdout:1/240: dwrite df/d34/f3b [0,4194304] 0 2024-04-12T09:11:23.905 INFO:tasks.workunit.client.0.smithi117.stdout:6/827: dwrite d8/d2a/d6e/fab [0,4194304] 0 2024-04-12T09:11:23.908 INFO:tasks.workunit.client.0.smithi117.stdout:9/745: dwrite d1/d24/f8b [0,4194304] 0 2024-04-12T09:11:23.910 INFO:tasks.workunit.client.0.smithi117.stdout:6/828: dread - d8/d9/d17/d2d/dc1/fee zero size 2024-04-12T09:11:23.912 INFO:tasks.workunit.client.0.smithi117.stdout:9/746: chown d1/d8/df/d68/ddf/daf/d3b/f8c 3 1 2024-04-12T09:11:23.916 INFO:tasks.workunit.client.1.smithi203.stdout:7/193: write d0/d15/d2d/f32 [1265388,8296] 0 2024-04-12T09:11:23.917 INFO:tasks.workunit.client.0.smithi117.stdout:2/770: dwrite d0/df/f97 [4194304,4194304] 0 2024-04-12T09:11:23.920 INFO:tasks.workunit.client.0.smithi117.stdout:9/747: dread d1/d8/d5a/d79/d91/fc4 [0,4194304] 0 2024-04-12T09:11:23.921 INFO:tasks.workunit.client.0.smithi117.stdout:0/993: rename d3/d59 to d3/ddd/d149 0 2024-04-12T09:11:23.922 INFO:tasks.workunit.client.0.smithi117.stdout:5/941: dwrite d2/d3/dd/fb3 [0,4194304] 0 2024-04-12T09:11:23.924 INFO:tasks.workunit.client.1.smithi203.stdout:7/194: write d0/d4/f43 [3765915,55273] 0 2024-04-12T09:11:23.930 INFO:tasks.workunit.client.1.smithi203.stdout:7/195: write d0/f1a [3187503,44353] 0 2024-04-12T09:11:23.930 INFO:tasks.workunit.client.1.smithi203.stdout:7/196: fdatasync d0/d15/d2d/f32 0 2024-04-12T09:11:23.935 INFO:tasks.workunit.client.0.smithi117.stdout:4/821: rename d0/d1/c21 to d0/d1/d34/c108 0 2024-04-12T09:11:23.937 INFO:tasks.workunit.client.0.smithi117.stdout:1/818: dwrite d1/dbd/d51/f5a [0,4194304] 0 2024-04-12T09:11:23.941 INFO:tasks.workunit.client.1.smithi203.stdout:7/197: fsync d0/d4/d1c/f35 0 2024-04-12T09:11:23.941 INFO:tasks.workunit.client.1.smithi203.stdout:7/198: readlink d0/d15/l42 0 2024-04-12T09:11:23.943 INFO:tasks.workunit.client.0.smithi117.stdout:0/994: write d3/da2/dee/dd5/dff/d91/d94/d5a/d62/d66/d73/fbb [544989,58611] 0 2024-04-12T09:11:23.946 INFO:tasks.workunit.client.0.smithi117.stdout:7/698: dwrite d0/d13/f8a [0,4194304] 0 2024-04-12T09:11:23.947 INFO:tasks.workunit.client.0.smithi117.stdout:2/771: mknod d0/d43/d53/c101 0 2024-04-12T09:11:23.956 INFO:tasks.workunit.client.0.smithi117.stdout:4/822: unlink d0/d5/d39/d4e/d6b/d83/c106 0 2024-04-12T09:11:23.958 INFO:tasks.workunit.client.1.smithi203.stdout:7/199: link d0/d15/l37 d0/d15/d2d/l44 0 2024-04-12T09:11:23.958 INFO:tasks.workunit.client.1.smithi203.stdout:7/200: write d0/d15/f19 [1298433,47971] 0 2024-04-12T09:11:23.959 INFO:tasks.workunit.client.0.smithi117.stdout:0/995: creat d3/d47/f14a x:0 0 0 2024-04-12T09:11:23.960 INFO:tasks.workunit.client.0.smithi117.stdout:6/829: link d8/d2a/d60/d7d/d9b/lff d8/d2a/d60/d7d/d8c/deb/l10c 0 2024-04-12T09:11:23.961 INFO:tasks.workunit.client.0.smithi117.stdout:0/996: chown d3/dc/f69 3608949 1 2024-04-12T09:11:23.961 INFO:tasks.workunit.client.0.smithi117.stdout:6/830: write d8/d9/f105 [747537,112175] 0 2024-04-12T09:11:23.962 INFO:tasks.workunit.client.0.smithi117.stdout:7/699: rmdir d0/d2/d12 39 2024-04-12T09:11:23.963 INFO:tasks.workunit.client.1.smithi203.stdout:7/201: read d0/f1a [1144779,64897] 0 2024-04-12T09:11:23.964 INFO:tasks.workunit.client.0.smithi117.stdout:2/772: symlink d0/d43/d4b/dae/dd5/l102 0 2024-04-12T09:11:23.966 INFO:tasks.workunit.client.0.smithi117.stdout:1/819: mknod d1/d64/d45/d4c/d94/dd0/de3/c103 0 2024-04-12T09:11:23.967 INFO:tasks.workunit.client.0.smithi117.stdout:4/823: mkdir d0/d5/d25/d9f/d109 0 2024-04-12T09:11:23.974 INFO:tasks.workunit.client.1.smithi203.stdout:8/185: truncate d4/d8/f1d 2991921 0 2024-04-12T09:11:23.974 INFO:tasks.workunit.client.0.smithi117.stdout:2/773: rmdir d0/d43/d53/d61 39 2024-04-12T09:11:23.974 INFO:tasks.workunit.client.1.smithi203.stdout:8/186: write d4/d8/d1c/f2c [3575846,125045] 0 2024-04-12T09:11:23.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.976+0000 7fc5277de700 1 -- 172.21.15.117:0/888114636 --> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc520111bf0 con 0x7fc50c06b650 2024-04-12T09:11:23.978 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.977+0000 7fc515ffb700 1 -- 172.21.15.117:0/888114636 <== mgr.24371 v2:172.21.15.203:6828/2773660052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fc520111bf0 con 0x7fc50c06b650 2024-04-12T09:11:23.978 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:11:23.978 INFO:teuthology.orchestra.run.smithi117.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec", 2024-04-12T09:11:23.978 INFO:teuthology.orchestra.run.smithi117.stdout: "in_progress": true, 2024-04-12T09:11:23.979 INFO:teuthology.orchestra.run.smithi117.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-12T09:11:23.979 INFO:teuthology.orchestra.run.smithi117.stdout: "services_complete": [], 2024-04-12T09:11:23.979 INFO:teuthology.orchestra.run.smithi117.stdout: "progress": "1/2 daemons upgraded", 2024-04-12T09:11:23.979 INFO:teuthology.orchestra.run.smithi117.stdout: "message": "", 2024-04-12T09:11:23.979 INFO:teuthology.orchestra.run.smithi117.stdout: "is_paused": false 2024-04-12T09:11:23.979 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:11:23.980 INFO:tasks.workunit.client.0.smithi117.stdout:4/824: mkdir d0/d2c/d3c/d10a 0 2024-04-12T09:11:23.981 INFO:tasks.workunit.client.1.smithi203.stdout:8/187: stat d4/d8/fc 0 2024-04-12T09:11:23.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.980+0000 7fc5277de700 1 -- 172.21.15.117:0/888114636 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fc50c06b650 msgr2=0x7fc50c06db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:23.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.980+0000 7fc5277de700 1 --2- 172.21.15.117:0/888114636 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fc50c06b650 0x7fc50c06db00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc51c00b3b0 tx=0x7fc51c009e30 comp rx=0 tx=0).stop 2024-04-12T09:11:23.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.980+0000 7fc5277de700 1 -- 172.21.15.117:0/888114636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5200fff20 msgr2=0x7fc520110190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:23.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.980+0000 7fc5277de700 1 --2- 172.21.15.117:0/888114636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5200fff20 0x7fc520110190 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc51000b790 tx=0x7fc510009250 comp rx=0 tx=0).stop 2024-04-12T09:11:23.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.980+0000 7fc5277de700 1 -- 172.21.15.117:0/888114636 shutdown_connections 2024-04-12T09:11:23.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.980+0000 7fc5277de700 1 --2- 172.21.15.117:0/888114636 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc520066b70 0x7fc52010fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:23.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.980+0000 7fc5277de700 1 --2- 172.21.15.117:0/888114636 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fc50c06b650 0x7fc50c06db00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:23.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.980+0000 7fc5277de700 1 --2- 172.21.15.117:0/888114636 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5200fff20 0x7fc520110190 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:23.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.980+0000 7fc5277de700 1 -- 172.21.15.117:0/888114636 >> 172.21.15.117:0/888114636 conn(0x7fc5200f7450 msgr2=0x7fc5200f7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:11:23.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.980+0000 7fc5277de700 1 -- 172.21.15.117:0/888114636 shutdown_connections 2024-04-12T09:11:23.982 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:23.980+0000 7fc5277de700 1 -- 172.21.15.117:0/888114636 wait complete. 2024-04-12T09:11:23.983 INFO:tasks.workunit.client.0.smithi117.stdout:6/831: mknod d8/d2a/d60/c10d 0 2024-04-12T09:11:23.983 INFO:tasks.workunit.client.0.smithi117.stdout:7/700: fdatasync d0/d2/d1a/f55 0 2024-04-12T09:11:23.984 INFO:tasks.workunit.client.1.smithi203.stdout:8/188: dread d4/f1f [0,4194304] 0 2024-04-12T09:11:23.984 INFO:tasks.workunit.client.0.smithi117.stdout:2/774: creat d0/d4/d81/f103 x:0 0 0 2024-04-12T09:11:23.985 INFO:tasks.workunit.client.0.smithi117.stdout:2/775: fsync d0/f36 0 2024-04-12T09:11:23.987 INFO:tasks.workunit.client.0.smithi117.stdout:6/832: mkdir d8/d9/d17/d2d/d10e 0 2024-04-12T09:11:23.989 INFO:tasks.workunit.client.1.smithi203.stdout:5/277: rename d0/l67 to d0/d6/d11/d18/d1a/l68 0 2024-04-12T09:11:23.994 INFO:tasks.workunit.client.0.smithi117.stdout:6/833: dread d8/f1a [0,4194304] 0 2024-04-12T09:11:23.995 INFO:tasks.workunit.client.0.smithi117.stdout:7/701: dread d0/d2/d45/d53/f80 [0,4194304] 0 2024-04-12T09:11:24.000 INFO:tasks.workunit.client.0.smithi117.stdout:8/933: dwrite db/d19/d1a/d3d/d9c/faa [0,4194304] 0 2024-04-12T09:11:24.001 INFO:tasks.workunit.client.1.smithi203.stdout:4/170: rename l11 to d1a/l36 0 2024-04-12T09:11:24.001 INFO:tasks.workunit.client.0.smithi117.stdout:8/934: fsync db/d19/d1a/d3d/d60/d70/d98/fe6 0 2024-04-12T09:11:24.003 INFO:tasks.workunit.client.0.smithi117.stdout:8/935: chown db/d19/d1a/d3d/d60/d70/d98/fe6 3031203 1 2024-04-12T09:11:24.004 INFO:tasks.workunit.client.0.smithi117.stdout:8/936: readlink db/d1b/d55/l93 0 2024-04-12T09:11:24.005 INFO:tasks.workunit.client.1.smithi203.stdout:4/171: chown l17 14 1 2024-04-12T09:11:24.008 INFO:tasks.workunit.client.1.smithi203.stdout:6/189: rename d1/c8 to d1/d3/d26/d36/c3c 0 2024-04-12T09:11:24.010 INFO:tasks.workunit.client.1.smithi203.stdout:4/172: chown d1a/d21/l24 98 1 2024-04-12T09:11:24.013 INFO:tasks.workunit.client.1.smithi203.stdout:2/205: rename d0/d14/d1e/d2a/l46 to d0/d38/l4e 0 2024-04-12T09:11:24.013 INFO:tasks.workunit.client.1.smithi203.stdout:2/206: stat d0/d2e/c4d 0 2024-04-12T09:11:24.013 INFO:tasks.workunit.client.1.smithi203.stdout:2/207: fsync d0/d3/f16 0 2024-04-12T09:11:24.014 INFO:tasks.workunit.client.1.smithi203.stdout:3/187: write d2/f18 [4345368,20260] 0 2024-04-12T09:11:24.015 INFO:tasks.workunit.client.1.smithi203.stdout:6/190: creat d1/d3/d26/d30/f3d x:0 0 0 2024-04-12T09:11:24.015 INFO:tasks.workunit.client.1.smithi203.stdout:3/188: chown d2/fd 8872494 1 2024-04-12T09:11:24.015 INFO:tasks.workunit.client.1.smithi203.stdout:0/237: creat d0/d1d/d2f/f4b x:0 0 0 2024-04-12T09:11:24.021 INFO:tasks.workunit.client.1.smithi203.stdout:6/191: mkdir d1/df/d1b/d3e 0 2024-04-12T09:11:24.023 INFO:tasks.workunit.client.1.smithi203.stdout:4/173: symlink d1a/l37 0 2024-04-12T09:11:24.025 INFO:tasks.workunit.client.1.smithi203.stdout:4/174: read d1a/d21/d22/f25 [7927550,82047] 0 2024-04-12T09:11:24.026 INFO:tasks.workunit.client.1.smithi203.stdout:4/175: readlink d1a/l37 0 2024-04-12T09:11:24.026 INFO:tasks.workunit.client.1.smithi203.stdout:1/241: rename df/d34/l47 to df/d2d/d45/d4a/l4b 0 2024-04-12T09:11:24.027 INFO:tasks.workunit.client.1.smithi203.stdout:9/170: rename d8/d12 to d8/d12/d23/d29/d42 22 2024-04-12T09:11:24.027 INFO:tasks.workunit.client.1.smithi203.stdout:4/176: write d1a/d21/f33 [349505,53139] 0 2024-04-12T09:11:24.028 INFO:tasks.workunit.client.1.smithi203.stdout:1/242: write df/f17 [1312396,96982] 0 2024-04-12T09:11:24.031 INFO:tasks.workunit.client.0.smithi117.stdout:5/942: write d2/d3/dd/f4e [1296532,23061] 0 2024-04-12T09:11:24.032 INFO:tasks.workunit.client.1.smithi203.stdout:6/192: chown d1/d3/d4/ca 556 1 2024-04-12T09:11:24.035 INFO:tasks.workunit.client.1.smithi203.stdout:0/238: dread d0/dd/f1b [0,4194304] 0 2024-04-12T09:11:24.036 INFO:tasks.workunit.client.0.smithi117.stdout:9/748: dwrite d1/d8/f10 [8388608,4194304] 0 2024-04-12T09:11:24.048 INFO:tasks.workunit.client.0.smithi117.stdout:0/997: write d3/dc/f2c [3071322,36960] 0 2024-04-12T09:11:24.049 INFO:tasks.workunit.client.1.smithi203.stdout:9/171: write d8/d12/f19 [427586,29053] 0 2024-04-12T09:11:24.050 INFO:tasks.workunit.client.1.smithi203.stdout:7/202: truncate d0/d4/f43 3929673 0 2024-04-12T09:11:24.054 INFO:tasks.workunit.client.1.smithi203.stdout:4/177: mknod d1a/d21/d22/c38 0 2024-04-12T09:11:24.054 INFO:tasks.workunit.client.1.smithi203.stdout:9/172: dread f3 [0,4194304] 0 2024-04-12T09:11:24.054 INFO:tasks.workunit.client.0.smithi117.stdout:1/820: write d1/f40 [61460,23532] 0 2024-04-12T09:11:24.054 INFO:tasks.workunit.client.1.smithi203.stdout:9/173: dread - d8/d12/d23/f3a zero size 2024-04-12T09:11:24.055 INFO:tasks.workunit.client.1.smithi203.stdout:9/174: fdatasync d8/d12/d23/f26 0 2024-04-12T09:11:24.057 INFO:tasks.workunit.client.1.smithi203.stdout:6/193: creat d1/d3/d26/d30/f3f x:0 0 0 2024-04-12T09:11:24.063 INFO:tasks.workunit.client.1.smithi203.stdout:6/194: dwrite d1/d3/f39 [0,4194304] 0 2024-04-12T09:11:24.064 INFO:tasks.workunit.client.1.smithi203.stdout:6/195: truncate d1/df/d1b/f23 3085890 0 2024-04-12T09:11:24.068 INFO:tasks.workunit.client.0.smithi117.stdout:2/776: symlink d0/d43/d53/d61/d66/l104 0 2024-04-12T09:11:24.070 INFO:tasks.workunit.client.1.smithi203.stdout:4/178: creat d1a/d21/d22/f39 x:0 0 0 2024-04-12T09:11:24.072 INFO:tasks.workunit.client.0.smithi117.stdout:7/702: mknod d0/d2/d96/cdd 0 2024-04-12T09:11:24.074 INFO:tasks.workunit.client.1.smithi203.stdout:9/175: fdatasync d8/d12/f16 0 2024-04-12T09:11:24.075 INFO:tasks.workunit.client.0.smithi117.stdout:4/825: link d0/d5/d25/dfd/d107/fb4 d0/d5/d3b/d38/d4f/f10b 0 2024-04-12T09:11:24.075 INFO:tasks.workunit.client.1.smithi203.stdout:9/176: truncate d8/d12/d23/d38/f3d 4494333 0 2024-04-12T09:11:24.076 INFO:tasks.workunit.client.0.smithi117.stdout:7/703: dread d0/d13/f8a [0,4194304] 0 2024-04-12T09:11:24.077 INFO:tasks.workunit.client.0.smithi117.stdout:7/704: write d0/d2/d45/d17/f29 [1776392,74591] 0 2024-04-12T09:11:24.081 INFO:tasks.workunit.client.1.smithi203.stdout:5/278: rename d0/d6/d16/d9/d14/f51 to d0/d6/d11/f69 0 2024-04-12T09:11:24.089 INFO:tasks.workunit.client.1.smithi203.stdout:7/203: truncate d0/d15/d2d/f32 3338530 0 2024-04-12T09:11:24.089 INFO:tasks.workunit.client.1.smithi203.stdout:7/204: dread - d0/ff zero size 2024-04-12T09:11:24.091 INFO:tasks.workunit.client.1.smithi203.stdout:2/208: truncate d0/d3/f9 435088 0 2024-04-12T09:11:24.093 INFO:tasks.workunit.client.0.smithi117.stdout:2/777: dread - d0/d43/fbe zero size 2024-04-12T09:11:24.094 INFO:tasks.workunit.client.1.smithi203.stdout:9/177: creat d8/d12/d23/d29/f43 x:0 0 0 2024-04-12T09:11:24.102 INFO:tasks.workunit.client.1.smithi203.stdout:3/189: rename d2/d8/d14/f22 to d2/d1f/d2e/f34 0 2024-04-12T09:11:24.102 INFO:tasks.workunit.client.1.smithi203.stdout:5/279: mkdir d0/d6/d11/d1e/d4c/d6a 0 2024-04-12T09:11:24.102 INFO:tasks.workunit.client.0.smithi117.stdout:7/705: truncate d0/d2/f6f 4886078 0 2024-04-12T09:11:24.102 INFO:tasks.workunit.client.1.smithi203.stdout:3/190: write d2/d8/f33 [181768,24601] 0 2024-04-12T09:11:24.106 INFO:tasks.workunit.client.1.smithi203.stdout:4/179: unlink l9 0 2024-04-12T09:11:24.108 INFO:tasks.workunit.client.0.smithi117.stdout:0/998: mknod d3/da2/d13e/c14b 0 2024-04-12T09:11:24.108 INFO:tasks.workunit.client.1.smithi203.stdout:2/209: read d0/d14/d1e/f2b [32151,82399] 0 2024-04-12T09:11:24.111 INFO:tasks.workunit.client.1.smithi203.stdout:1/243: dwrite df/f16 [0,4194304] 0 2024-04-12T09:11:24.113 INFO:tasks.workunit.client.0.smithi117.stdout:0/999: dwrite d3/f13a [0,4194304] 0 2024-04-12T09:11:24.120 INFO:tasks.workunit.client.0.smithi117.stdout:7/706: read d0/f2b [2913673,105821] 0 2024-04-12T09:11:24.124 INFO:tasks.workunit.client.1.smithi203.stdout:3/191: unlink d2/d8/d14/d1b/f25 0 2024-04-12T09:11:24.127 INFO:tasks.workunit.client.0.smithi117.stdout:4/826: link d0/d2c/f31 d0/d5/d3b/d38/d4f/f10c 0 2024-04-12T09:11:24.128 INFO:tasks.workunit.client.0.smithi117.stdout:6/834: dwrite d8/d9/d17/d33/fc4 [0,4194304] 0 2024-04-12T09:11:24.130 INFO:tasks.workunit.client.0.smithi117.stdout:7/707: symlink d0/d2/d45/d17/d23/d39/dbd/lde 0 2024-04-12T09:11:24.130 INFO:tasks.workunit.client.1.smithi203.stdout:4/180: creat d1a/d2b/f3a x:0 0 0 2024-04-12T09:11:24.133 INFO:tasks.workunit.client.1.smithi203.stdout:9/178: mknod d8/c44 0 2024-04-12T09:11:24.136 INFO:tasks.workunit.client.1.smithi203.stdout:2/210: mkdir d0/d2e/d4f 0 2024-04-12T09:11:24.137 INFO:tasks.workunit.client.0.smithi117.stdout:4/827: rmdir d0/d5/d3b/d38/d4f/db6 39 2024-04-12T09:11:24.138 INFO:tasks.workunit.client.0.smithi117.stdout:5/943: write d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1/d11f/d6b/fc3 [629965,69827] 0 2024-04-12T09:11:24.139 INFO:tasks.workunit.client.0.smithi117.stdout:8/937: dwrite db/d1b/f34 [4194304,4194304] 0 2024-04-12T09:11:24.142 INFO:tasks.workunit.client.0.smithi117.stdout:9/749: write d1/d8/dd5/fda [856682,75911] 0 2024-04-12T09:11:24.143 INFO:tasks.workunit.client.0.smithi117.stdout:7/708: unlink d0/ca0 0 2024-04-12T09:11:24.144 INFO:tasks.workunit.client.0.smithi117.stdout:6/835: read d8/d9/fdc [2235678,42968] 0 2024-04-12T09:11:24.145 INFO:tasks.workunit.client.0.smithi117.stdout:7/709: chown d0/d2/d45/d17/d23/d51 89 1 2024-04-12T09:11:24.145 INFO:tasks.workunit.client.0.smithi117.stdout:6/836: readlink d8/d2a/l2c 0 2024-04-12T09:11:24.147 INFO:tasks.workunit.client.1.smithi203.stdout:1/244: chown df/d20/d2b/f44 9 1 2024-04-12T09:11:24.152 INFO:tasks.workunit.client.1.smithi203.stdout:6/196: getdents d1/d3/d12 0 2024-04-12T09:11:24.152 INFO:tasks.workunit.client.1.smithi203.stdout:3/192: mkdir d2/d8/d14/d23/d35 0 2024-04-12T09:11:24.153 INFO:tasks.workunit.client.0.smithi117.stdout:8/938: write db/d1b/d62/dae/df9/d12b/f48 [1225486,46945] 0 2024-04-12T09:11:24.154 INFO:tasks.workunit.client.1.smithi203.stdout:7/205: link d0/d4/cd d0/d15/d2d/c45 0 2024-04-12T09:11:24.154 INFO:tasks.workunit.client.0.smithi117.stdout:1/821: dwrite d1/dbd/f9f [0,4194304] 0 2024-04-12T09:11:24.155 INFO:tasks.workunit.client.1.smithi203.stdout:4/181: dread ff [0,4194304] 0 2024-04-12T09:11:24.161 INFO:tasks.workunit.client.1.smithi203.stdout:9/179: mknod d8/d12/d23/d29/d2c/c45 0 2024-04-12T09:11:24.163 INFO:tasks.workunit.client.0.smithi117.stdout:5/944: mknod d2/c139 0 2024-04-12T09:11:24.165 INFO:tasks.workunit.client.1.smithi203.stdout:2/211: creat d0/d14/d23/f50 x:0 0 0 2024-04-12T09:11:24.165 INFO:tasks.workunit.client.0.smithi117.stdout:5/945: truncate d2/d3/de/f2a 4601807 0 2024-04-12T09:11:24.166 INFO:tasks.workunit.client.1.smithi203.stdout:2/212: stat d0/d14/d23/d3d 0 2024-04-12T09:11:24.166 INFO:tasks.workunit.client.0.smithi117.stdout:4/828: creat d0/d2c/d3c/d10a/f10d x:0 0 0 2024-04-12T09:11:24.171 INFO:tasks.workunit.client.0.smithi117.stdout:1/822: unlink d1/dbd/d3f/db/d16/db6/ff0 0 2024-04-12T09:11:24.172 INFO:tasks.workunit.client.0.smithi117.stdout:2/778: write d0/d96/fb7 [1856048,89153] 0 2024-04-12T09:11:24.175 INFO:tasks.workunit.client.0.smithi117.stdout:8/939: truncate db/d1b/d62/dae/df9/d12b/dc3/f82 1122907 0 2024-04-12T09:11:24.177 INFO:tasks.workunit.client.1.smithi203.stdout:4/182: symlink d1a/d20/l3b 0 2024-04-12T09:11:24.177 INFO:tasks.workunit.client.1.smithi203.stdout:4/183: dread - d1a/d21/f31 zero size 2024-04-12T09:11:24.178 INFO:tasks.workunit.client.1.smithi203.stdout:3/193: dwrite d2/d1f/d2e/f34 [0,4194304] 0 2024-04-12T09:11:24.182 INFO:tasks.workunit.client.1.smithi203.stdout:9/180: creat d8/d12/d14/f46 x:0 0 0 2024-04-12T09:11:24.185 INFO:tasks.workunit.client.0.smithi117.stdout:4/829: dread d0/d1/de9/dfe/f96 [0,4194304] 0 2024-04-12T09:11:24.185 INFO:tasks.workunit.client.1.smithi203.stdout:2/213: symlink d0/d2e/d41/l51 0 2024-04-12T09:11:24.188 INFO:tasks.workunit.client.1.smithi203.stdout:0/239: getdents d0/d1d/d2f/d17 0 2024-04-12T09:11:24.191 INFO:tasks.workunit.client.0.smithi117.stdout:9/750: dwrite d1/d8/d5e/f6d [4194304,4194304] 0 2024-04-12T09:11:24.195 INFO:tasks.workunit.client.0.smithi117.stdout:6/837: dwrite d8/ff [0,4194304] 0 2024-04-12T09:11:24.231 INFO:tasks.workunit.client.1.smithi203.stdout:8/189: sync 2024-04-12T09:11:24.242 INFO:tasks.workunit.client.0.smithi117.stdout:6/838: truncate d8/fc 299580 0 2024-04-12T09:11:24.246 INFO:tasks.workunit.client.1.smithi203.stdout:3/194: write d2/d1f/d2e/f34 [4990569,68225] 0 2024-04-12T09:11:24.247 INFO:tasks.workunit.client.1.smithi203.stdout:3/195: read d2/f18 [3997024,8431] 0 2024-04-12T09:11:24.248 INFO:tasks.workunit.client.1.smithi203.stdout:2/214: creat d0/d14/d1e/d2a/f52 x:0 0 0 2024-04-12T09:11:24.249 INFO:tasks.workunit.client.0.smithi117.stdout:8/940: write db/d19/d1a/d3d/f45 [1157353,40692] 0 2024-04-12T09:11:24.250 INFO:tasks.workunit.client.0.smithi117.stdout:1/823: dwrite d1/dbd/d3f/db/d16/f47 [0,4194304] 0 2024-04-12T09:11:24.250 INFO:tasks.workunit.client.1.smithi203.stdout:7/206: truncate d0/d4/f43 675839 0 2024-04-12T09:11:24.250 INFO:tasks.workunit.client.0.smithi117.stdout:6/839: creat d8/d2a/d60/d89/f10f x:0 0 0 2024-04-12T09:11:24.252 INFO:tasks.workunit.client.0.smithi117.stdout:2/779: dwrite d0/d43/fbe [0,4194304] 0 2024-04-12T09:11:24.252 INFO:tasks.workunit.client.0.smithi117.stdout:4/830: getdents d0/d2c/d67 0 2024-04-12T09:11:24.253 INFO:tasks.workunit.client.1.smithi203.stdout:3/196: dwrite d2/d1f/f31 [0,4194304] 0 2024-04-12T09:11:24.258 INFO:tasks.workunit.client.0.smithi117.stdout:9/751: write d1/f4 [386685,28623] 0 2024-04-12T09:11:24.260 INFO:tasks.workunit.client.1.smithi203.stdout:4/184: creat d1a/d21/d22/d2e/f3c x:0 0 0 2024-04-12T09:11:24.270 INFO:tasks.workunit.client.1.smithi203.stdout:0/240: mkdir d0/d1d/d2f/d4c 0 2024-04-12T09:11:24.270 INFO:tasks.workunit.client.1.smithi203.stdout:4/185: dwrite d1a/f1b [0,4194304] 0 2024-04-12T09:11:24.271 INFO:tasks.workunit.client.1.smithi203.stdout:7/207: rename d0/d4/d1c/f1f to d0/d4/d1c/d3b/f46 0 2024-04-12T09:11:24.271 INFO:tasks.workunit.client.0.smithi117.stdout:2/780: chown d0/df/f7e 32202 1 2024-04-12T09:11:24.271 INFO:tasks.workunit.client.0.smithi117.stdout:4/831: symlink d0/d1/de9/l10e 0 2024-04-12T09:11:24.271 INFO:tasks.workunit.client.0.smithi117.stdout:2/781: dread d0/d43/d30/d41/f5b [0,4194304] 0 2024-04-12T09:11:24.271 INFO:tasks.workunit.client.1.smithi203.stdout:1/245: getdents df/d2d 0 2024-04-12T09:11:24.272 INFO:tasks.workunit.client.1.smithi203.stdout:1/246: write f4 [5138762,45509] 0 2024-04-12T09:11:24.275 INFO:tasks.workunit.client.0.smithi117.stdout:2/782: dread d0/df/fab [0,4194304] 0 2024-04-12T09:11:24.278 INFO:tasks.workunit.client.1.smithi203.stdout:3/197: fdatasync d2/d1f/f31 0 2024-04-12T09:11:24.280 INFO:tasks.workunit.client.1.smithi203.stdout:2/215: symlink d0/d14/d23/d33/l53 0 2024-04-12T09:11:24.283 INFO:tasks.workunit.client.0.smithi117.stdout:9/752: rename d1/d8/df/d1b/c51 to d1/d8/df/d3e/cf4 0 2024-04-12T09:11:24.285 INFO:tasks.workunit.client.0.smithi117.stdout:2/783: mknod d0/df/c105 0 2024-04-12T09:11:24.286 INFO:tasks.workunit.client.1.smithi203.stdout:4/186: chown l3 31300 1 2024-04-12T09:11:24.288 INFO:tasks.workunit.client.0.smithi117.stdout:8/941: write db/d19/f8d [552185,91393] 0 2024-04-12T09:11:24.291 INFO:tasks.workunit.client.0.smithi117.stdout:4/832: truncate d0/d5/d25/dfd/d107/f8b 985608 0 2024-04-12T09:11:24.292 INFO:tasks.workunit.client.0.smithi117.stdout:6/840: dread d8/d2a/d60/d106/fa0 [0,4194304] 0 2024-04-12T09:11:24.293 INFO:tasks.workunit.client.0.smithi117.stdout:6/841: write d8/d2a/d6e/fab [1264516,60294] 0 2024-04-12T09:11:24.296 INFO:tasks.workunit.client.1.smithi203.stdout:9/181: getdents d8/d12/d23 0 2024-04-12T09:11:24.297 INFO:tasks.workunit.client.1.smithi203.stdout:8/190: truncate d4/f29 662452 0 2024-04-12T09:11:24.298 INFO:tasks.workunit.client.0.smithi117.stdout:1/824: write d1/d64/d45/f50 [2036719,72034] 0 2024-04-12T09:11:24.299 INFO:tasks.workunit.client.0.smithi117.stdout:8/942: mknod db/d1b/d62/dae/c13b 0 2024-04-12T09:11:24.299 INFO:tasks.workunit.client.1.smithi203.stdout:3/198: dread d2/f2b [0,4194304] 0 2024-04-12T09:11:24.300 INFO:tasks.workunit.client.0.smithi117.stdout:4/833: mkdir d0/d5/d3b/d38/d10f 0 2024-04-12T09:11:24.302 INFO:tasks.workunit.client.0.smithi117.stdout:4/834: truncate d0/d2c/d3c/d10a/f10d 865937 0 2024-04-12T09:11:24.304 INFO:tasks.workunit.client.1.smithi203.stdout:4/187: creat d1a/d20/f3d x:0 0 0 2024-04-12T09:11:24.305 INFO:tasks.workunit.client.0.smithi117.stdout:6/842: rename d8/d2a/d60/d89/d99/df5/f9e to d8/d2a/d60/d89/dea/f110 0 2024-04-12T09:11:24.306 INFO:tasks.workunit.client.1.smithi203.stdout:0/241: dwrite d0/d1d/d2f/d17/d19/f3b [0,4194304] 0 2024-04-12T09:11:24.309 INFO:tasks.workunit.client.0.smithi117.stdout:8/943: write db/d1b/d62/dae/df9/d12b/d86/fb2 [2775250,67226] 0 2024-04-12T09:11:24.311 INFO:tasks.workunit.client.0.smithi117.stdout:4/835: fdatasync d0/d2c/d67/fc5 0 2024-04-12T09:11:24.312 INFO:tasks.workunit.client.1.smithi203.stdout:8/191: rmdir d4/d8/d1c 39 2024-04-12T09:11:24.317 INFO:tasks.workunit.client.0.smithi117.stdout:2/784: creat d0/d4/f106 x:0 0 0 2024-04-12T09:11:24.318 INFO:tasks.workunit.client.1.smithi203.stdout:5/280: sync 2024-04-12T09:11:24.319 INFO:tasks.workunit.client.1.smithi203.stdout:3/199: mkdir d2/d8/d14/d23/d36 0 2024-04-12T09:11:24.319 INFO:tasks.workunit.client.0.smithi117.stdout:2/785: truncate d0/d4/d81/fe4 701608 0 2024-04-12T09:11:24.320 INFO:tasks.workunit.client.1.smithi203.stdout:5/281: write d0/d6/d11/d18/f32 [7918918,57060] 0 2024-04-12T09:11:24.320 INFO:tasks.workunit.client.0.smithi117.stdout:2/786: readlink d0/d43/d4b/l52 0 2024-04-12T09:11:24.320 INFO:tasks.workunit.client.1.smithi203.stdout:5/282: chown d0/d6/d11/d18 125156158 1 2024-04-12T09:11:24.322 INFO:tasks.workunit.client.1.smithi203.stdout:5/283: dread d0/d6/d11/d18/d1a/f47 [0,4194304] 0 2024-04-12T09:11:24.323 INFO:tasks.workunit.client.1.smithi203.stdout:1/247: truncate df/f33 683416 0 2024-04-12T09:11:24.326 INFO:tasks.workunit.client.0.smithi117.stdout:8/944: creat db/d1b/d62/f13c x:0 0 0 2024-04-12T09:11:24.328 INFO:tasks.workunit.client.1.smithi203.stdout:2/216: truncate d0/d38/f3b 1551 0 2024-04-12T09:11:24.328 INFO:tasks.workunit.client.1.smithi203.stdout:2/217: stat d0/d19/l40 0 2024-04-12T09:11:24.329 INFO:tasks.workunit.client.1.smithi203.stdout:5/284: dwrite d0/d6/d11/d18/d2a/f2b [0,4194304] 0 2024-04-12T09:11:24.329 INFO:tasks.workunit.client.1.smithi203.stdout:9/182: creat d8/d12/d3e/f47 x:0 0 0 2024-04-12T09:11:24.330 INFO:tasks.workunit.client.1.smithi203.stdout:9/183: stat d8/d12/d23/c25 0 2024-04-12T09:11:24.331 INFO:tasks.workunit.client.0.smithi117.stdout:4/836: mkdir d0/d5/d25/d110 0 2024-04-12T09:11:24.331 INFO:tasks.workunit.client.1.smithi203.stdout:2/218: truncate d0/d38/d43/f44 565168 0 2024-04-12T09:11:24.331 INFO:tasks.workunit.client.1.smithi203.stdout:5/285: chown d0/d6/d16/d9/f10 121142 1 2024-04-12T09:11:24.332 INFO:tasks.workunit.client.0.smithi117.stdout:4/837: fsync d0/d5/d39/d4e/d51/ff9 0 2024-04-12T09:11:24.333 INFO:tasks.workunit.client.1.smithi203.stdout:5/286: truncate d0/d6/d11/d18/d1a/f3f 1185018 0 2024-04-12T09:11:24.339 INFO:tasks.workunit.client.1.smithi203.stdout:5/287: dread d0/d6/d11/d1e/d4c/f42 [0,4194304] 0 2024-04-12T09:11:24.339 INFO:tasks.workunit.client.0.smithi117.stdout:2/787: dread d0/d43/d53/f7b [0,4194304] 0 2024-04-12T09:11:24.340 INFO:tasks.workunit.client.1.smithi203.stdout:5/288: stat d0/d6/d11/d1e/c49 0 2024-04-12T09:11:24.340 INFO:tasks.workunit.client.1.smithi203.stdout:5/289: fsync d0/d6/d11/d18/f32 0 2024-04-12T09:11:24.341 INFO:tasks.workunit.client.0.smithi117.stdout:8/945: creat db/d1b/d62/f13d x:0 0 0 2024-04-12T09:11:24.342 INFO:tasks.workunit.client.1.smithi203.stdout:7/208: link d0/d4/cd d0/d4/d1c/d3b/c47 0 2024-04-12T09:11:24.343 INFO:tasks.workunit.client.1.smithi203.stdout:1/248: dread f4 [4194304,4194304] 0 2024-04-12T09:11:24.346 INFO:tasks.workunit.client.0.smithi117.stdout:4/838: unlink d0/d5/lc 0 2024-04-12T09:11:24.347 INFO:tasks.workunit.client.1.smithi203.stdout:0/242: mkdir d0/dd/d4d 0 2024-04-12T09:11:24.348 INFO:tasks.workunit.client.0.smithi117.stdout:6/843: write d8/d2a/d60/fa1 [911820,74406] 0 2024-04-12T09:11:24.349 INFO:tasks.workunit.client.1.smithi203.stdout:2/219: rmdir d0/d38 39 2024-04-12T09:11:24.351 INFO:tasks.workunit.client.0.smithi117.stdout:1/825: getdents d1/d64/d45/d4c 0 2024-04-12T09:11:24.352 INFO:tasks.workunit.client.1.smithi203.stdout:9/184: mknod d8/d3b/c48 0 2024-04-12T09:11:24.352 INFO:tasks.workunit.client.1.smithi203.stdout:9/185: fdatasync d8/ff 0 2024-04-12T09:11:24.353 INFO:tasks.workunit.client.1.smithi203.stdout:9/186: chown d8/d12/d3e/f47 1215672188 1 2024-04-12T09:11:24.354 INFO:tasks.workunit.client.1.smithi203.stdout:8/192: symlink d4/d8/d1c/l39 0 2024-04-12T09:11:24.354 INFO:tasks.workunit.client.1.smithi203.stdout:9/187: write d8/d12/d23/f3a [345886,114521] 0 2024-04-12T09:11:24.355 INFO:tasks.workunit.client.1.smithi203.stdout:9/188: chown d8/d12/l20 0 1 2024-04-12T09:11:24.357 INFO:tasks.workunit.client.0.smithi117.stdout:4/839: read d0/d2c/d3c/f45 [279447,1353] 0 2024-04-12T09:11:24.361 INFO:tasks.workunit.client.0.smithi117.stdout:2/788: write d0/d43/d30/d41/f21 [915170,28615] 0 2024-04-12T09:11:24.365 INFO:tasks.workunit.client.1.smithi203.stdout:7/209: read - d0/f26 zero size 2024-04-12T09:11:24.365 INFO:tasks.workunit.client.1.smithi203.stdout:3/200: truncate d2/f17 1006310 0 2024-04-12T09:11:24.366 INFO:tasks.workunit.client.1.smithi203.stdout:3/201: write d2/d8/f33 [53729,68880] 0 2024-04-12T09:11:24.366 INFO:tasks.workunit.client.0.smithi117.stdout:6/844: mkdir d8/d9/d17/d2d/d10e/d111 0 2024-04-12T09:11:24.367 INFO:tasks.workunit.client.0.smithi117.stdout:1/826: dread d1/dbd/d3f/db/d16/db6/da9/f9c [0,4194304] 0 2024-04-12T09:11:24.368 INFO:tasks.workunit.client.0.smithi117.stdout:4/840: truncate d0/d5/d39/f77 4478058 0 2024-04-12T09:11:24.370 INFO:tasks.workunit.client.0.smithi117.stdout:8/946: link db/d1b/d62/df0/d114/c131 db/d1b/d62/dae/df9/d12b/dc3/d9d/c13e 0 2024-04-12T09:11:24.371 INFO:tasks.workunit.client.0.smithi117.stdout:1/827: dread d1/f49 [4194304,4194304] 0 2024-04-12T09:11:24.372 INFO:tasks.workunit.client.0.smithi117.stdout:8/947: read db/d1b/d62/dae/df9/d12b/dc3/f80 [389438,115094] 0 2024-04-12T09:11:24.373 INFO:tasks.workunit.client.1.smithi203.stdout:8/193: rename d4/d8/d19/f1b to d4/d8/d19/f3a 0 2024-04-12T09:11:24.380 INFO:tasks.workunit.client.0.smithi117.stdout:6/845: unlink d8/d9/f82 0 2024-04-12T09:11:24.382 INFO:tasks.workunit.client.1.smithi203.stdout:5/290: creat d0/d6/d16/d9/d14/d4b/f6b x:0 0 0 2024-04-12T09:11:24.382 INFO:tasks.workunit.client.1.smithi203.stdout:5/291: fsync d0/d6/f46 0 2024-04-12T09:11:24.385 INFO:tasks.workunit.client.0.smithi117.stdout:8/948: symlink db/d19/d1a/d3d/d60/d70/l13f 0 2024-04-12T09:11:24.390 INFO:tasks.workunit.client.1.smithi203.stdout:9/189: dwrite d8/d12/d14/f1f [0,4194304] 0 2024-04-12T09:11:24.392 INFO:tasks.workunit.client.0.smithi117.stdout:4/841: dwrite d0/d5/d3b/d38/d4f/f74 [0,4194304] 0 2024-04-12T09:11:24.393 INFO:tasks.workunit.client.1.smithi203.stdout:8/194: mknod d4/d8/d1c/c3b 0 2024-04-12T09:11:24.394 INFO:tasks.workunit.client.0.smithi117.stdout:6/846: dread d8/f21 [4194304,4194304] 0 2024-04-12T09:11:24.398 INFO:tasks.workunit.client.1.smithi203.stdout:7/210: fsync d0/d15/d2d/f32 0 2024-04-12T09:11:24.402 INFO:tasks.workunit.client.0.smithi117.stdout:8/949: creat db/d19/d1a/f140 x:0 0 0 2024-04-12T09:11:24.403 INFO:tasks.workunit.client.1.smithi203.stdout:1/249: rmdir df/d2d/d49 0 2024-04-12T09:11:24.404 INFO:tasks.workunit.client.1.smithi203.stdout:1/250: chown df/f43 54335674 1 2024-04-12T09:11:24.404 INFO:tasks.workunit.client.1.smithi203.stdout:1/251: stat c6 0 2024-04-12T09:11:24.404 INFO:tasks.workunit.client.0.smithi117.stdout:1/828: truncate d1/f40 6504307 0 2024-04-12T09:11:24.404 INFO:tasks.workunit.client.1.smithi203.stdout:1/252: chown df/f3f 53750 1 2024-04-12T09:11:24.407 INFO:tasks.workunit.client.0.smithi117.stdout:8/950: creat db/da6/f141 x:0 0 0 2024-04-12T09:11:24.408 INFO:tasks.workunit.client.1.smithi203.stdout:2/220: mkdir d0/d54 0 2024-04-12T09:11:24.408 INFO:tasks.workunit.client.1.smithi203.stdout:9/190: fsync d8/d12/d23/d27/f32 0 2024-04-12T09:11:24.409 INFO:tasks.workunit.client.1.smithi203.stdout:9/191: stat d8/d12/d14 0 2024-04-12T09:11:24.410 INFO:tasks.workunit.client.1.smithi203.stdout:8/195: rename d4/d8/d1c/l39 to d4/d8/d19/l3c 0 2024-04-12T09:11:24.411 INFO:tasks.workunit.client.1.smithi203.stdout:8/196: read - d4/d8/d19/f3a zero size 2024-04-12T09:11:24.412 INFO:tasks.workunit.client.0.smithi117.stdout:1/829: dwrite d1/dbd/d3f/db/d16/db6/da9/d9a/ff9 [0,4194304] 0 2024-04-12T09:11:24.414 INFO:tasks.workunit.client.1.smithi203.stdout:7/211: creat d0/d4/d1c/f48 x:0 0 0 2024-04-12T09:11:24.415 INFO:tasks.workunit.client.1.smithi203.stdout:7/212: chown d0/d15 0 1 2024-04-12T09:11:24.418 INFO:tasks.workunit.client.0.smithi117.stdout:1/830: dwrite d1/dbd/d51/f5a [0,4194304] 0 2024-04-12T09:11:24.422 INFO:tasks.workunit.client.0.smithi117.stdout:4/842: write d0/d2c/d67/fd8 [2170594,91319] 0 2024-04-12T09:11:24.423 INFO:tasks.workunit.client.1.smithi203.stdout:3/202: creat d2/f37 x:0 0 0 2024-04-12T09:11:24.423 INFO:tasks.workunit.client.1.smithi203.stdout:3/203: read d2/fa [5121813,123290] 0 2024-04-12T09:11:24.425 INFO:tasks.workunit.client.0.smithi117.stdout:1/831: rename d1/d96/fec to d1/dbd/d3f/db/dc2/f104 0 2024-04-12T09:11:24.429 INFO:tasks.workunit.client.0.smithi117.stdout:8/951: creat db/d1b/d62/dae/df9/d12b/d86/da0/f142 x:0 0 0 2024-04-12T09:11:24.430 INFO:tasks.workunit.client.1.smithi203.stdout:5/292: creat d0/d6/d11/f6c x:0 0 0 2024-04-12T09:11:24.434 INFO:tasks.workunit.client.1.smithi203.stdout:7/213: mknod d0/d4/d1c/c49 0 2024-04-12T09:11:24.435 INFO:tasks.workunit.client.1.smithi203.stdout:7/214: stat d0/d15/d2d/f32 0 2024-04-12T09:11:24.436 INFO:tasks.workunit.client.0.smithi117.stdout:8/952: dwrite db/d1b/d62/dae/df9/d12b/d86/fb2 [0,4194304] 0 2024-04-12T09:11:24.437 INFO:tasks.workunit.client.1.smithi203.stdout:6/197: sync 2024-04-12T09:11:24.440 INFO:tasks.workunit.client.0.smithi117.stdout:8/953: rmdir db/d1b/d62/df0 39 2024-04-12T09:11:24.441 INFO:tasks.workunit.client.1.smithi203.stdout:2/221: stat d0/d14/d23/d3d 0 2024-04-12T09:11:24.442 INFO:tasks.workunit.client.1.smithi203.stdout:9/192: symlink d8/d12/l49 0 2024-04-12T09:11:24.442 INFO:tasks.workunit.client.1.smithi203.stdout:8/197: getdents d4/d34 0 2024-04-12T09:11:24.443 INFO:tasks.workunit.client.1.smithi203.stdout:7/215: creat d0/d15/f4a x:0 0 0 2024-04-12T09:11:24.444 INFO:tasks.workunit.client.0.smithi117.stdout:8/954: read db/d19/d1a/d3d/ff7 [1970521,107071] 0 2024-04-12T09:11:24.444 INFO:tasks.workunit.client.1.smithi203.stdout:1/253: truncate df/d2d/f32 741660 0 2024-04-12T09:11:24.445 INFO:tasks.workunit.client.0.smithi117.stdout:8/955: readlink db/d1b/l5a 0 2024-04-12T09:11:24.445 INFO:tasks.workunit.client.1.smithi203.stdout:7/216: write d0/d4/d1c/d3b/f3f [673292,84053] 0 2024-04-12T09:11:24.447 INFO:tasks.workunit.client.1.smithi203.stdout:9/193: dread d8/d12/d23/d38/f3d [0,4194304] 0 2024-04-12T09:11:24.449 INFO:tasks.workunit.client.1.smithi203.stdout:2/222: stat d0/d3/f16 0 2024-04-12T09:11:24.450 INFO:tasks.workunit.client.1.smithi203.stdout:5/293: symlink d0/d6/d11/d1e/d4c/d6a/l6d 0 2024-04-12T09:11:24.450 INFO:tasks.workunit.client.1.smithi203.stdout:5/294: chown d0/d6/d16/d9/d14/d4b 7 1 2024-04-12T09:11:24.452 INFO:tasks.workunit.client.0.smithi117.stdout:1/832: dread d1/d64/f99 [0,4194304] 0 2024-04-12T09:11:24.453 INFO:tasks.workunit.client.1.smithi203.stdout:8/198: fsync f3 0 2024-04-12T09:11:24.454 INFO:tasks.workunit.client.1.smithi203.stdout:6/198: creat d1/df/d1b/d3b/f40 x:0 0 0 2024-04-12T09:11:24.455 INFO:tasks.workunit.client.1.smithi203.stdout:1/254: mknod df/d34/c4c 0 2024-04-12T09:11:24.455 INFO:tasks.workunit.client.0.smithi117.stdout:8/956: getdents db/d19/d1a/d3d/d60 0 2024-04-12T09:11:24.456 INFO:tasks.workunit.client.1.smithi203.stdout:4/188: sync 2024-04-12T09:11:24.456 INFO:tasks.workunit.client.1.smithi203.stdout:0/243: sync 2024-04-12T09:11:24.457 INFO:tasks.workunit.client.0.smithi117.stdout:1/833: symlink d1/dbd/d3f/l105 0 2024-04-12T09:11:24.458 INFO:tasks.workunit.client.1.smithi203.stdout:5/295: dwrite d0/d6/f46 [0,4194304] 0 2024-04-12T09:11:24.458 INFO:tasks.workunit.client.0.smithi117.stdout:8/957: read db/d1b/d62/dae/f107 [56689,124322] 0 2024-04-12T09:11:24.458 INFO:tasks.workunit.client.0.smithi117.stdout:8/958: fsync db/d1b/d62/f13c 0 2024-04-12T09:11:24.459 INFO:tasks.workunit.client.1.smithi203.stdout:4/189: write d1a/d1d/f1e [4789956,39076] 0 2024-04-12T09:11:24.460 INFO:tasks.workunit.client.1.smithi203.stdout:9/194: rmdir d8/d12/d23/d27 39 2024-04-12T09:11:24.464 INFO:tasks.workunit.client.1.smithi203.stdout:4/190: dread d1a/d21/f33 [0,4194304] 0 2024-04-12T09:11:24.464 INFO:tasks.workunit.client.1.smithi203.stdout:2/223: rmdir d0/d14/d23/d3d 39 2024-04-12T09:11:24.466 INFO:tasks.workunit.client.0.smithi117.stdout:1/834: rename d1/dbd/d3f/db/d1d/d78/ccd to d1/dbd/dbf/c106 0 2024-04-12T09:11:24.467 INFO:tasks.workunit.client.1.smithi203.stdout:2/224: fsync d0/d14/d1e/d2a/f52 0 2024-04-12T09:11:24.470 INFO:tasks.workunit.client.1.smithi203.stdout:5/296: dwrite d0/d6/fe [0,4194304] 0 2024-04-12T09:11:24.474 INFO:tasks.workunit.client.1.smithi203.stdout:3/204: getdents d2/d1f 0 2024-04-12T09:11:24.476 INFO:tasks.workunit.client.1.smithi203.stdout:6/199: dread d1/d3/d12/f1f [0,4194304] 0 2024-04-12T09:11:24.477 INFO:tasks.workunit.client.0.smithi117.stdout:8/959: dwrite db/f7e [0,4194304] 0 2024-04-12T09:11:24.480 INFO:tasks.workunit.client.0.smithi117.stdout:8/960: write db/d1b/d62/dae/df9/d12b/dc3/f80 [1422895,87764] 0 2024-04-12T09:11:24.481 INFO:tasks.workunit.client.0.smithi117.stdout:8/961: chown db/d1b/d55 1 1 2024-04-12T09:11:24.483 INFO:tasks.workunit.client.1.smithi203.stdout:6/200: chown d1/df/d28 13 1 2024-04-12T09:11:24.483 INFO:tasks.workunit.client.1.smithi203.stdout:4/191: dwrite d1a/d20/f3d [0,4194304] 0 2024-04-12T09:11:24.485 INFO:tasks.workunit.client.1.smithi203.stdout:5/297: mknod d0/d6/d16/d9/d14/d4b/c6e 0 2024-04-12T09:11:24.485 INFO:tasks.workunit.client.0.smithi117.stdout:8/962: mkdir db/d1b/d62/dae/df9/d12b/dc3/de9/d143 0 2024-04-12T09:11:24.487 INFO:tasks.workunit.client.1.smithi203.stdout:3/205: creat d2/d1f/d2e/f38 x:0 0 0 2024-04-12T09:11:24.488 INFO:tasks.workunit.client.1.smithi203.stdout:0/244: creat d0/f4e x:0 0 0 2024-04-12T09:11:24.489 INFO:tasks.workunit.client.1.smithi203.stdout:7/217: dread d0/d4/f17 [0,4194304] 0 2024-04-12T09:11:24.490 INFO:tasks.workunit.client.1.smithi203.stdout:6/201: creat d1/df/f41 x:0 0 0 2024-04-12T09:11:24.490 INFO:tasks.workunit.client.1.smithi203.stdout:5/298: chown d0/d6/d11/d1e/c2f 104543481 1 2024-04-12T09:11:24.490 INFO:tasks.workunit.client.0.smithi117.stdout:8/963: symlink db/d4b/l144 0 2024-04-12T09:11:24.491 INFO:tasks.workunit.client.1.smithi203.stdout:1/255: dread df/d20/f26 [0,4194304] 0 2024-04-12T09:11:24.491 INFO:tasks.workunit.client.1.smithi203.stdout:9/195: creat d8/f4a x:0 0 0 2024-04-12T09:11:24.494 INFO:tasks.workunit.client.1.smithi203.stdout:0/245: readlink d0/l14 0 2024-04-12T09:11:24.495 INFO:tasks.workunit.client.1.smithi203.stdout:8/199: dwrite d4/d8/d19/f27 [0,4194304] 0 2024-04-12T09:11:24.495 INFO:tasks.workunit.client.0.smithi117.stdout:8/964: symlink db/d1b/d62/dae/df9/d12b/dc5/l145 0 2024-04-12T09:11:24.495 INFO:tasks.workunit.client.1.smithi203.stdout:8/200: readlink l0 0 2024-04-12T09:11:24.497 INFO:tasks.workunit.client.0.smithi117.stdout:1/835: dread d1/dbd/d3f/db/d16/f19 [0,4194304] 0 2024-04-12T09:11:24.499 INFO:tasks.workunit.client.0.smithi117.stdout:1/836: stat d1/dbd/d3f/db/dc2/fed 0 2024-04-12T09:11:24.500 INFO:tasks.workunit.client.1.smithi203.stdout:4/192: mknod d1a/d1d/d23/d2c/c3e 0 2024-04-12T09:11:24.500 INFO:tasks.workunit.client.1.smithi203.stdout:1/256: fdatasync f4 0 2024-04-12T09:11:24.501 INFO:tasks.workunit.client.1.smithi203.stdout:1/257: chown ld 7192 1 2024-04-12T09:11:24.502 INFO:tasks.workunit.client.0.smithi117.stdout:1/837: fdatasync d1/d96/fd4 0 2024-04-12T09:11:24.503 INFO:tasks.workunit.client.1.smithi203.stdout:9/196: creat d8/d3b/f4b x:0 0 0 2024-04-12T09:11:24.503 INFO:tasks.workunit.client.1.smithi203.stdout:9/197: chown d8/f34 566 1 2024-04-12T09:11:24.507 INFO:tasks.workunit.client.1.smithi203.stdout:8/201: unlink d4/d8/d19/c2f 0 2024-04-12T09:11:24.509 INFO:tasks.workunit.client.1.smithi203.stdout:4/193: mknod d1a/d1d/d23/c3f 0 2024-04-12T09:11:24.509 INFO:tasks.workunit.client.1.smithi203.stdout:5/299: rmdir d0/d6/d16/d9/d14/d4b 39 2024-04-12T09:11:24.511 INFO:tasks.workunit.client.1.smithi203.stdout:9/198: creat d8/d12/d23/d29/d2c/f4c x:0 0 0 2024-04-12T09:11:24.512 INFO:tasks.workunit.client.1.smithi203.stdout:0/246: creat d0/d1d/d2f/d4c/f4f x:0 0 0 2024-04-12T09:11:24.514 INFO:tasks.workunit.client.1.smithi203.stdout:0/247: chown d0/d1d/l29 94002 1 2024-04-12T09:11:24.515 INFO:tasks.workunit.client.1.smithi203.stdout:7/218: creat d0/d15/d2d/f4b x:0 0 0 2024-04-12T09:11:24.516 INFO:tasks.workunit.client.1.smithi203.stdout:4/194: truncate ff 1921674 0 2024-04-12T09:11:24.517 INFO:tasks.workunit.client.1.smithi203.stdout:5/300: dwrite d0/d6/d11/d18/d1a/f3f [0,4194304] 0 2024-04-12T09:11:24.517 INFO:tasks.workunit.client.1.smithi203.stdout:1/258: unlink df/d2d/c3c 0 2024-04-12T09:11:24.519 INFO:tasks.workunit.client.1.smithi203.stdout:1/259: dread - df/d34/f40 zero size 2024-04-12T09:11:24.520 INFO:tasks.workunit.client.1.smithi203.stdout:3/206: write d2/f18 [1774713,93685] 0 2024-04-12T09:11:24.520 INFO:tasks.workunit.client.1.smithi203.stdout:8/202: symlink d4/d34/l3d 0 2024-04-12T09:11:24.521 INFO:tasks.workunit.client.1.smithi203.stdout:3/207: readlink d2/d8/l1e 0 2024-04-12T09:11:24.522 INFO:tasks.workunit.client.0.smithi117.stdout:8/965: write db/d19/d1a/d3d/f28 [5728252,83786] 0 2024-04-12T09:11:24.523 INFO:tasks.workunit.client.1.smithi203.stdout:7/219: fsync d0/f26 0 2024-04-12T09:11:24.524 INFO:tasks.workunit.client.1.smithi203.stdout:4/195: rename d1a/l37 to d1a/d2b/l40 0 2024-04-12T09:11:24.525 INFO:tasks.workunit.client.1.smithi203.stdout:5/301: rmdir d0/d6/d11/d18/d1a/d23 39 2024-04-12T09:11:24.525 INFO:tasks.workunit.client.1.smithi203.stdout:6/202: dread d1/df/f11 [0,4194304] 0 2024-04-12T09:11:24.525 INFO:tasks.workunit.client.1.smithi203.stdout:3/208: chown d2/d8/d14/d23 38 1 2024-04-12T09:11:24.526 INFO:tasks.workunit.client.1.smithi203.stdout:3/209: stat d2/d1f 0 2024-04-12T09:11:24.527 INFO:tasks.workunit.client.0.smithi117.stdout:1/838: write d1/d64/d45/fdd [589217,25809] 0 2024-04-12T09:11:24.527 INFO:tasks.workunit.client.1.smithi203.stdout:6/203: write d1/df/f19 [3564942,46661] 0 2024-04-12T09:11:24.528 INFO:tasks.workunit.client.1.smithi203.stdout:6/204: chown d1/df/c24 0 1 2024-04-12T09:11:24.529 INFO:tasks.workunit.client.0.smithi117.stdout:8/966: mknod db/d19/dd2/c146 0 2024-04-12T09:11:24.529 INFO:tasks.workunit.client.1.smithi203.stdout:6/205: write d1/d3/f2d [129380,126050] 0 2024-04-12T09:11:24.529 INFO:tasks.workunit.client.0.smithi117.stdout:8/967: fsync db/d13/f128 0 2024-04-12T09:11:24.531 INFO:tasks.workunit.client.1.smithi203.stdout:0/248: mknod d0/dd/d40/c50 0 2024-04-12T09:11:24.531 INFO:tasks.workunit.client.1.smithi203.stdout:6/206: chown d1/df/d28/c2e 719444 1 2024-04-12T09:11:24.533 INFO:tasks.workunit.client.0.smithi117.stdout:1/839: rename d1/d96/fd4 to d1/dbd/d3f/db/d1d/d78/dbc/f107 0 2024-04-12T09:11:24.540 INFO:tasks.workunit.client.1.smithi203.stdout:7/220: mkdir d0/d4/d1c/d3b/d4c 0 2024-04-12T09:11:24.541 INFO:tasks.workunit.client.1.smithi203.stdout:7/221: stat d0/d15/d2d/c45 0 2024-04-12T09:11:24.542 INFO:tasks.workunit.client.1.smithi203.stdout:5/302: creat d0/d6/d16/d9/d30/f6f x:0 0 0 2024-04-12T09:11:24.543 INFO:tasks.workunit.client.1.smithi203.stdout:9/199: dwrite f3 [4194304,4194304] 0 2024-04-12T09:11:24.544 INFO:tasks.workunit.client.1.smithi203.stdout:1/260: creat df/d2d/d45/f4d x:0 0 0 2024-04-12T09:11:24.545 INFO:tasks.workunit.client.0.smithi117.stdout:8/968: rename db/d19/d1a/d3d/cf6 to db/d1b/d62/df0/c147 0 2024-04-12T09:11:24.545 INFO:tasks.workunit.client.1.smithi203.stdout:1/261: write df/d20/d2b/f44 [2132288,101949] 0 2024-04-12T09:11:24.547 INFO:tasks.workunit.client.1.smithi203.stdout:5/303: dread d0/d6/f46 [0,4194304] 0 2024-04-12T09:11:24.547 INFO:tasks.workunit.client.1.smithi203.stdout:5/304: chown d0/d6/d16/d9/d14/f25 7433012 1 2024-04-12T09:11:24.548 INFO:tasks.workunit.client.1.smithi203.stdout:3/210: creat d2/d8/f39 x:0 0 0 2024-04-12T09:11:24.548 INFO:tasks.workunit.client.1.smithi203.stdout:5/305: chown d0/d6/d11/d38 859 1 2024-04-12T09:11:24.549 INFO:tasks.workunit.client.1.smithi203.stdout:8/203: creat d4/d8/d37/f3e x:0 0 0 2024-04-12T09:11:24.549 INFO:tasks.workunit.client.1.smithi203.stdout:8/204: dread - d4/d8/f38 zero size 2024-04-12T09:11:24.551 INFO:tasks.workunit.client.0.smithi117.stdout:8/969: creat db/d4b/d11b/f148 x:0 0 0 2024-04-12T09:11:24.552 INFO:tasks.workunit.client.1.smithi203.stdout:4/196: write f5 [2058699,46044] 0 2024-04-12T09:11:24.553 INFO:tasks.workunit.client.0.smithi117.stdout:8/970: write db/d1b/d62/dae/df9/d12b/dc3/f10c [155886,76167] 0 2024-04-12T09:11:24.554 INFO:tasks.workunit.client.1.smithi203.stdout:6/207: creat d1/d3/d4/f42 x:0 0 0 2024-04-12T09:11:24.554 INFO:tasks.workunit.client.1.smithi203.stdout:6/208: dread - d1/d3/f34 zero size 2024-04-12T09:11:24.555 INFO:tasks.workunit.client.0.smithi117.stdout:8/971: chown db/d1b/d62/dae/df9/d12b/f4e 26946328 1 2024-04-12T09:11:24.556 INFO:tasks.workunit.client.1.smithi203.stdout:7/222: rename d0/d4/f17 to d0/d15/d2d/f4d 0 2024-04-12T09:11:24.558 INFO:tasks.workunit.client.0.smithi117.stdout:1/840: dwrite d1/d64/d45/d4c/f68 [0,4194304] 0 2024-04-12T09:11:24.559 INFO:tasks.workunit.client.0.smithi117.stdout:8/972: creat db/d1b/d62/dae/df9/d12b/dc5/f149 x:0 0 0 2024-04-12T09:11:24.560 INFO:tasks.workunit.client.0.smithi117.stdout:8/973: chown db/d1b/d62/dae/df9/d12b/dc5 2081906396 1 2024-04-12T09:11:24.560 INFO:tasks.workunit.client.0.smithi117.stdout:8/974: stat db/d1b/d62/df0/c109 0 2024-04-12T09:11:24.562 INFO:tasks.workunit.client.1.smithi203.stdout:8/205: unlink d4/d8/d19/c33 0 2024-04-12T09:11:24.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:24 smithi203 ceph-mon[36428]: pgmap v22: 65 pgs: 65 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 71 MiB/s rd, 189 MiB/s wr, 501 op/s 2024-04-12T09:11:24.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:24 smithi203 ceph-mon[36428]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:11:24.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:24 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/3097112858' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:11:24.574 INFO:tasks.workunit.client.1.smithi203.stdout:4/197: unlink d1a/d1d/d23/f28 0 2024-04-12T09:11:24.575 INFO:tasks.workunit.client.0.smithi117.stdout:8/975: rename db/d1b/d62/dae/df9/d12b/d86/da0/f142 to db/d1b/d62/dae/df9/d12b/dc3/f14a 0 2024-04-12T09:11:24.578 INFO:tasks.workunit.client.1.smithi203.stdout:4/198: dwrite f5 [8388608,4194304] 0 2024-04-12T09:11:24.579 INFO:tasks.workunit.client.1.smithi203.stdout:4/199: write d1a/d21/d22/d2e/f3c [617378,27475] 0 2024-04-12T09:11:24.608 INFO:tasks.workunit.client.1.smithi203.stdout:6/209: mkdir d1/df/d28/d43 0 2024-04-12T09:11:24.609 INFO:tasks.workunit.client.1.smithi203.stdout:6/210: stat d1/d3/d26/d36 0 2024-04-12T09:11:24.609 INFO:tasks.workunit.client.1.smithi203.stdout:6/211: stat d1/d3/d12/f1f 0 2024-04-12T09:11:24.610 INFO:tasks.workunit.client.0.smithi117.stdout:8/976: creat db/da6/f14b x:0 0 0 2024-04-12T09:11:24.610 INFO:tasks.workunit.client.1.smithi203.stdout:6/212: truncate d1/d3/d4/f42 281734 0 2024-04-12T09:11:24.610 INFO:tasks.workunit.client.1.smithi203.stdout:6/213: readlink d1/d3/l20 0 2024-04-12T09:11:24.611 INFO:tasks.workunit.client.1.smithi203.stdout:7/223: rename d0/f1a to d0/d4/d1c/d3b/f4e 0 2024-04-12T09:11:24.612 INFO:tasks.workunit.client.1.smithi203.stdout:7/224: dread - d0/f40 zero size 2024-04-12T09:11:24.612 INFO:tasks.workunit.client.0.smithi117.stdout:1/841: link d1/d64/d45/d4c/la6 d1/d64/l108 0 2024-04-12T09:11:24.613 INFO:tasks.workunit.client.1.smithi203.stdout:9/200: symlink d8/d12/d23/d41/l4d 0 2024-04-12T09:11:24.614 INFO:tasks.workunit.client.0.smithi117.stdout:1/842: write d1/dbd/d3f/db/d16/f47 [4701679,55135] 0 2024-04-12T09:11:24.615 INFO:tasks.workunit.client.1.smithi203.stdout:1/262: symlink df/l4e 0 2024-04-12T09:11:24.615 INFO:tasks.workunit.client.1.smithi203.stdout:3/211: mknod d2/c3a 0 2024-04-12T09:11:24.623 INFO:tasks.workunit.client.1.smithi203.stdout:0/249: creat d0/d1d/d2f/f51 x:0 0 0 2024-04-12T09:11:24.624 INFO:tasks.workunit.client.0.smithi117.stdout:8/977: getdents db/d1b/d62/df0/d114 0 2024-04-12T09:11:24.624 INFO:tasks.workunit.client.1.smithi203.stdout:0/250: fsync d0/d1d/d2f/d17/d19/f3b 0 2024-04-12T09:11:24.625 INFO:tasks.workunit.client.1.smithi203.stdout:4/200: creat d1a/d21/d22/d2e/f41 x:0 0 0 2024-04-12T09:11:24.628 INFO:tasks.workunit.client.1.smithi203.stdout:6/214: rename d1/df/f11 to d1/df/d1b/d3b/f44 0 2024-04-12T09:11:24.629 INFO:tasks.workunit.client.1.smithi203.stdout:6/215: fsync d1/df/d1b/d3b/f40 0 2024-04-12T09:11:24.629 INFO:tasks.workunit.client.1.smithi203.stdout:6/216: chown d1/df/d28/d43 209 1 2024-04-12T09:11:24.632 INFO:tasks.workunit.client.1.smithi203.stdout:9/201: rmdir d8/d12 39 2024-04-12T09:11:24.632 INFO:tasks.workunit.client.1.smithi203.stdout:9/202: chown d8/d3b 2 1 2024-04-12T09:11:24.633 INFO:tasks.workunit.client.1.smithi203.stdout:1/263: mknod df/d20/c4f 0 2024-04-12T09:11:24.636 INFO:tasks.workunit.client.1.smithi203.stdout:3/212: rmdir d2/d8 39 2024-04-12T09:11:24.637 INFO:tasks.workunit.client.1.smithi203.stdout:6/217: dwrite d1/d3/d4/f42 [0,4194304] 0 2024-04-12T09:11:24.637 INFO:tasks.workunit.client.1.smithi203.stdout:7/225: dread d0/d15/f19 [0,4194304] 0 2024-04-12T09:11:24.638 INFO:tasks.workunit.client.1.smithi203.stdout:1/264: truncate df/d20/f41 89472 0 2024-04-12T09:11:24.638 INFO:tasks.workunit.client.1.smithi203.stdout:4/201: symlink d1a/d21/d22/d2e/l42 0 2024-04-12T09:11:24.640 INFO:tasks.workunit.client.1.smithi203.stdout:4/202: chown d1a/d21/d22/d2e/l42 121759820 1 2024-04-12T09:11:24.641 INFO:tasks.workunit.client.1.smithi203.stdout:5/306: dwrite d0/d6/d11/d18/f3b [0,4194304] 0 2024-04-12T09:11:24.643 INFO:tasks.workunit.client.1.smithi203.stdout:0/251: creat d0/d1d/d2f/d34/f52 x:0 0 0 2024-04-12T09:11:24.648 INFO:tasks.workunit.client.1.smithi203.stdout:2/225: sync 2024-04-12T09:11:24.651 INFO:tasks.workunit.client.1.smithi203.stdout:0/252: write d0/f2c [4026682,90574] 0 2024-04-12T09:11:24.652 INFO:tasks.workunit.client.1.smithi203.stdout:5/307: mknod d0/c70 0 2024-04-12T09:11:24.653 INFO:tasks.workunit.client.1.smithi203.stdout:1/265: symlink df/d2d/l50 0 2024-04-12T09:11:24.654 INFO:tasks.workunit.client.1.smithi203.stdout:4/203: creat d1a/d21/d22/d2e/f43 x:0 0 0 2024-04-12T09:11:24.654 INFO:tasks.workunit.client.1.smithi203.stdout:2/226: rename d0 to d0/d55 22 2024-04-12T09:11:24.656 INFO:tasks.workunit.client.1.smithi203.stdout:5/308: symlink d0/d6/l71 0 2024-04-12T09:11:24.657 INFO:tasks.workunit.client.1.smithi203.stdout:3/213: link d2/d8/l1e d2/d8/l3b 0 2024-04-12T09:11:24.658 INFO:tasks.workunit.client.1.smithi203.stdout:9/203: dwrite d8/d12/f19 [4194304,4194304] 0 2024-04-12T09:11:24.658 INFO:tasks.workunit.client.1.smithi203.stdout:7/226: dwrite d0/d4/d1c/f35 [0,4194304] 0 2024-04-12T09:11:24.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:24 smithi117 ceph-mon[29277]: pgmap v22: 65 pgs: 65 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 71 MiB/s rd, 189 MiB/s wr, 501 op/s 2024-04-12T09:11:24.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:24 smithi117 ceph-mon[29277]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:11:24.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:24 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/3097112858' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:11:24.660 INFO:tasks.workunit.client.1.smithi203.stdout:0/253: rename d0/l14 to d0/dd/d40/l53 0 2024-04-12T09:11:24.662 INFO:tasks.workunit.client.1.smithi203.stdout:3/214: symlink d2/d8/d14/d23/l3c 0 2024-04-12T09:11:24.664 INFO:tasks.workunit.client.1.smithi203.stdout:9/204: fdatasync d8/d12/f16 0 2024-04-12T09:11:24.665 INFO:tasks.workunit.client.1.smithi203.stdout:2/227: mkdir d0/d54/d56 0 2024-04-12T09:11:24.665 INFO:tasks.workunit.client.1.smithi203.stdout:1/266: getdents df/d20/d2b 0 2024-04-12T09:11:24.665 INFO:tasks.workunit.client.1.smithi203.stdout:0/254: rmdir d0/dd/d40 39 2024-04-12T09:11:24.667 INFO:tasks.workunit.client.1.smithi203.stdout:7/227: mknod d0/d38/c4f 0 2024-04-12T09:11:24.672 INFO:tasks.workunit.client.1.smithi203.stdout:1/267: rename df/f1d to df/d20/d2b/f51 0 2024-04-12T09:11:24.673 INFO:tasks.workunit.client.1.smithi203.stdout:9/205: mknod d8/d12/d23/c4e 0 2024-04-12T09:11:24.678 INFO:tasks.workunit.client.1.smithi203.stdout:2/228: dwrite d0/d14/f22 [0,4194304] 0 2024-04-12T09:11:24.678 INFO:tasks.workunit.client.1.smithi203.stdout:1/268: chown df/d20/d2b/l38 0 1 2024-04-12T09:11:24.678 INFO:tasks.workunit.client.1.smithi203.stdout:0/255: dwrite d0/f4e [0,4194304] 0 2024-04-12T09:11:24.680 INFO:tasks.workunit.client.1.smithi203.stdout:7/228: rename d0/d34/c41 to d0/d4/d1c/d3b/c50 0 2024-04-12T09:11:24.683 INFO:tasks.workunit.client.1.smithi203.stdout:3/215: getdents d2 0 2024-04-12T09:11:24.685 INFO:tasks.workunit.client.1.smithi203.stdout:7/229: mkdir d0/d38/d51 0 2024-04-12T09:11:24.686 INFO:tasks.workunit.client.1.smithi203.stdout:9/206: mkdir d8/d12/d23/d27/d4f 0 2024-04-12T09:11:24.688 INFO:tasks.workunit.client.1.smithi203.stdout:1/269: dread df/d2d/f32 [0,4194304] 0 2024-04-12T09:11:24.690 INFO:tasks.workunit.client.1.smithi203.stdout:3/216: rmdir d2/d8/d14/d1b/d2f 39 2024-04-12T09:11:24.690 INFO:tasks.workunit.client.1.smithi203.stdout:5/309: dwrite d0/d6/d11/d18/d2a/ff [0,4194304] 0 2024-04-12T09:11:24.691 INFO:tasks.workunit.client.1.smithi203.stdout:4/204: dwrite ff [0,4194304] 0 2024-04-12T09:11:24.691 INFO:tasks.workunit.client.0.smithi117.stdout:8/978: mknod db/d1b/d62/dae/df9/d12b/dc3/d9d/c14c 0 2024-04-12T09:11:24.692 INFO:tasks.workunit.client.0.smithi117.stdout:1/843: getdents d1/dc3 0 2024-04-12T09:11:24.694 INFO:tasks.workunit.client.0.smithi117.stdout:8/979: symlink db/d19/d1a/d3d/d60/d70/d98/l14d 0 2024-04-12T09:11:24.696 INFO:tasks.workunit.client.0.smithi117.stdout:8/980: readlink db/d1b/d62/dae/df9/d12b/d86/l11a 0 2024-04-12T09:11:24.698 INFO:tasks.workunit.client.1.smithi203.stdout:2/229: rmdir d0/d2e/d4f 0 2024-04-12T09:11:24.700 INFO:tasks.workunit.client.0.smithi117.stdout:1/844: dwrite d1/dbd/d3f/db/d16/db6/da9/fd8 [0,4194304] 0 2024-04-12T09:11:24.700 INFO:tasks.workunit.client.1.smithi203.stdout:7/230: symlink d0/l52 0 2024-04-12T09:11:24.701 INFO:tasks.workunit.client.1.smithi203.stdout:4/205: symlink d1a/d21/l44 0 2024-04-12T09:11:24.701 INFO:tasks.workunit.client.1.smithi203.stdout:0/256: dwrite d0/d1d/d2f/d17/d19/f26 [0,4194304] 0 2024-04-12T09:11:24.704 INFO:tasks.workunit.client.1.smithi203.stdout:4/206: fdatasync d1a/f1b 0 2024-04-12T09:11:24.704 INFO:tasks.workunit.client.0.smithi117.stdout:8/981: rename db/d1b/d55/l95 to db/d19/d1a/d3d/d9c/d108/l14e 0 2024-04-12T09:11:24.710 INFO:tasks.workunit.client.1.smithi203.stdout:8/206: sync 2024-04-12T09:11:24.710 INFO:tasks.workunit.client.1.smithi203.stdout:3/217: rename d2/d8/c15 to d2/d1f/c3d 0 2024-04-12T09:11:24.711 INFO:tasks.workunit.client.0.smithi117.stdout:8/982: dwrite db/d1b/fb0 [0,4194304] 0 2024-04-12T09:11:24.712 INFO:tasks.workunit.client.1.smithi203.stdout:1/270: dwrite df/d34/f46 [0,4194304] 0 2024-04-12T09:11:24.712 INFO:tasks.workunit.client.1.smithi203.stdout:9/207: dread d8/f34 [0,4194304] 0 2024-04-12T09:11:24.713 INFO:tasks.workunit.client.1.smithi203.stdout:4/207: write d1a/d21/f31 [696944,9830] 0 2024-04-12T09:11:24.713 INFO:tasks.workunit.client.1.smithi203.stdout:2/230: dread d0/d14/d23/f2d [0,4194304] 0 2024-04-12T09:11:24.715 INFO:tasks.workunit.client.1.smithi203.stdout:8/207: dread - d4/d8/d37/f3e zero size 2024-04-12T09:11:24.717 INFO:tasks.workunit.client.1.smithi203.stdout:7/231: mkdir d0/d4/d53 0 2024-04-12T09:11:24.717 INFO:tasks.workunit.client.0.smithi117.stdout:1/845: rmdir d1/dbd/d51/dce 0 2024-04-12T09:11:24.718 INFO:tasks.workunit.client.1.smithi203.stdout:0/257: truncate d0/f3 3593538 0 2024-04-12T09:11:24.722 INFO:tasks.workunit.client.0.smithi117.stdout:8/983: dwrite db/d1b/d62/dae/df9/d12b/dc3/f101 [0,4194304] 0 2024-04-12T09:11:24.723 INFO:tasks.workunit.client.0.smithi117.stdout:8/984: write db/d1b/f127 [42808,64978] 0 2024-04-12T09:11:24.725 INFO:tasks.workunit.client.1.smithi203.stdout:5/310: dwrite d0/d6/d11/d18/d1a/d23/f4f [0,4194304] 0 2024-04-12T09:11:24.725 INFO:tasks.workunit.client.1.smithi203.stdout:7/232: dread - d0/d15/f4a zero size 2024-04-12T09:11:24.728 INFO:tasks.workunit.client.1.smithi203.stdout:1/271: creat df/d20/d2b/f52 x:0 0 0 2024-04-12T09:11:24.730 INFO:tasks.workunit.client.0.smithi117.stdout:1/846: dread d1/f4d [0,4194304] 0 2024-04-12T09:11:24.731 INFO:tasks.workunit.client.1.smithi203.stdout:1/272: dread df/d2d/f32 [0,4194304] 0 2024-04-12T09:11:24.733 INFO:tasks.workunit.client.1.smithi203.stdout:1/273: write df/d20/d2b/f44 [3480799,92956] 0 2024-04-12T09:11:24.733 INFO:tasks.workunit.client.1.smithi203.stdout:5/311: symlink d0/d6/d11/d18/d2a/l72 0 2024-04-12T09:11:24.734 INFO:tasks.workunit.client.1.smithi203.stdout:8/208: fdatasync d4/d8/fd 0 2024-04-12T09:11:24.734 INFO:tasks.workunit.client.0.smithi117.stdout:8/985: getdents db/d1b/d62/dae/df9/d12b/def 0 2024-04-12T09:11:24.735 INFO:tasks.workunit.client.1.smithi203.stdout:4/208: dread d1a/d21/d22/d2e/f3c [0,4194304] 0 2024-04-12T09:11:24.737 INFO:tasks.workunit.client.1.smithi203.stdout:4/209: dread - d1a/d20/f2a zero size 2024-04-12T09:11:24.737 INFO:tasks.workunit.client.0.smithi117.stdout:1/847: dread - d1/dbd/d3f/db/d16/db6/da9/d9a/d71/fd2 zero size 2024-04-12T09:11:24.739 INFO:tasks.workunit.client.1.smithi203.stdout:7/233: fdatasync d0/f2 0 2024-04-12T09:11:24.741 INFO:tasks.workunit.client.1.smithi203.stdout:5/312: symlink d0/d6/d16/d44/l73 0 2024-04-12T09:11:24.742 INFO:tasks.workunit.client.1.smithi203.stdout:8/209: dwrite d4/d8/d37/f3e [0,4194304] 0 2024-04-12T09:11:24.742 INFO:tasks.workunit.client.1.smithi203.stdout:1/274: rename f4 to df/d2d/d45/d4a/f53 0 2024-04-12T09:11:24.743 INFO:tasks.workunit.client.0.smithi117.stdout:8/986: dwrite db/d19/d1a/d3d/d9c/f123 [0,4194304] 0 2024-04-12T09:11:24.743 INFO:tasks.workunit.client.1.smithi203.stdout:1/275: chown df/d34 351091 1 2024-04-12T09:11:24.744 INFO:tasks.workunit.client.1.smithi203.stdout:1/276: chown df/c28 300688 1 2024-04-12T09:11:24.745 INFO:tasks.workunit.client.1.smithi203.stdout:1/277: stat df/f2a 0 2024-04-12T09:11:24.745 INFO:tasks.workunit.client.1.smithi203.stdout:9/208: link d8/d12/d23/c4e d8/d12/d23/d29/d2c/d40/c50 0 2024-04-12T09:11:24.746 INFO:tasks.workunit.client.1.smithi203.stdout:4/210: unlink d1a/d21/d22/d2e/f41 0 2024-04-12T09:11:24.753 INFO:tasks.workunit.client.0.smithi117.stdout:8/987: creat db/d1b/d62/dae/df9/d12b/d86/f14f x:0 0 0 2024-04-12T09:11:24.754 INFO:tasks.workunit.client.1.smithi203.stdout:7/234: mkdir d0/d4/d54 0 2024-04-12T09:11:24.755 INFO:tasks.workunit.client.1.smithi203.stdout:6/218: sync 2024-04-12T09:11:24.758 INFO:tasks.workunit.client.0.smithi117.stdout:8/988: creat db/d77/d113/f150 x:0 0 0 2024-04-12T09:11:24.759 INFO:tasks.workunit.client.1.smithi203.stdout:8/210: mknod d4/c3f 0 2024-04-12T09:11:24.762 INFO:tasks.workunit.client.1.smithi203.stdout:1/278: fdatasync df/d34/f40 0 2024-04-12T09:11:24.763 INFO:tasks.workunit.client.0.smithi117.stdout:8/989: mkdir db/d1b/d62/dae/df9/d12b/dc3/d138/d151 0 2024-04-12T09:11:24.763 INFO:tasks.workunit.client.1.smithi203.stdout:1/279: write df/f17 [468980,49585] 0 2024-04-12T09:11:24.764 INFO:tasks.workunit.client.1.smithi203.stdout:1/280: dread - df/d2d/d45/f4d zero size 2024-04-12T09:11:24.765 INFO:tasks.workunit.client.1.smithi203.stdout:9/209: fsync d8/d12/d23/d27/f2e 0 2024-04-12T09:11:24.766 INFO:tasks.workunit.client.1.smithi203.stdout:4/211: write d1a/d21/d22/d2e/f3c [370310,61789] 0 2024-04-12T09:11:24.767 INFO:tasks.workunit.client.0.smithi117.stdout:8/990: mknod db/d1b/d62/df0/c152 0 2024-04-12T09:11:24.769 INFO:tasks.workunit.client.1.smithi203.stdout:6/219: mkdir d1/df/d1b/d3b/d45 0 2024-04-12T09:11:24.769 INFO:tasks.workunit.client.1.smithi203.stdout:5/313: mkdir d0/d6/d16/d9/d30/d58/d74 0 2024-04-12T09:11:24.771 INFO:tasks.workunit.client.1.smithi203.stdout:8/211: rename d4/d8/d19/f32 to d4/d8/d1c/f40 0 2024-04-12T09:11:24.772 INFO:tasks.workunit.client.1.smithi203.stdout:8/212: fsync d4/f2d 0 2024-04-12T09:11:24.773 INFO:tasks.workunit.client.1.smithi203.stdout:3/218: truncate d2/f18 974074 0 2024-04-12T09:11:24.773 INFO:tasks.workunit.client.1.smithi203.stdout:2/231: dwrite d0/d14/d1e/f2b [0,4194304] 0 2024-04-12T09:11:24.774 INFO:tasks.workunit.client.0.smithi117.stdout:1/848: dread d1/dbd/d3f/db/d16/db6/da9/d9a/f4b [0,4194304] 0 2024-04-12T09:11:24.774 INFO:tasks.workunit.client.1.smithi203.stdout:0/258: dread d0/f4 [0,4194304] 0 2024-04-12T09:11:24.774 INFO:tasks.workunit.client.0.smithi117.stdout:1/849: readlink d1/dbd/d3f/db/ld9 0 2024-04-12T09:11:24.778 INFO:tasks.workunit.client.1.smithi203.stdout:9/210: mknod d8/d3b/c51 0 2024-04-12T09:11:24.779 INFO:tasks.workunit.client.0.smithi117.stdout:1/850: symlink d1/dbd/d3f/db/d16/l109 0 2024-04-12T09:11:24.781 INFO:tasks.workunit.client.1.smithi203.stdout:3/219: dwrite d2/d8/d14/d23/f2a [0,4194304] 0 2024-04-12T09:11:24.782 INFO:tasks.workunit.client.1.smithi203.stdout:4/212: unlink d1a/f1b 0 2024-04-12T09:11:24.788 INFO:tasks.workunit.client.1.smithi203.stdout:9/211: dwrite d8/d12/d23/d29/d2c/f30 [0,4194304] 0 2024-04-12T09:11:24.788 INFO:tasks.workunit.client.1.smithi203.stdout:9/212: stat d8/f2a 0 2024-04-12T09:11:24.789 INFO:tasks.workunit.client.0.smithi117.stdout:8/991: dread db/d1b/d62/df0/f103 [0,4194304] 0 2024-04-12T09:11:24.789 INFO:tasks.workunit.client.1.smithi203.stdout:6/220: dread d1/d3/f1a [0,4194304] 0 2024-04-12T09:11:24.790 INFO:tasks.workunit.client.1.smithi203.stdout:9/213: write d8/f4a [154286,103293] 0 2024-04-12T09:11:24.791 INFO:tasks.workunit.client.0.smithi117.stdout:8/992: write db/d1b/d62/dae/df9/d12b/d86/fb9 [281360,80567] 0 2024-04-12T09:11:24.791 INFO:tasks.workunit.client.1.smithi203.stdout:6/221: stat d1/df/c24 0 2024-04-12T09:11:24.795 INFO:tasks.workunit.client.1.smithi203.stdout:5/314: rename d0/d6/d16/d9/d30/c5e to d0/d5d/c75 0 2024-04-12T09:11:24.797 INFO:tasks.workunit.client.1.smithi203.stdout:5/315: write d0/d6/d11/d1e/d4c/d48/f55 [828784,81137] 0 2024-04-12T09:11:24.798 INFO:tasks.workunit.client.1.smithi203.stdout:2/232: mkdir d0/d14/d1e/d57 0 2024-04-12T09:11:24.803 INFO:tasks.workunit.client.0.smithi117.stdout:1/851: getdents d1 0 2024-04-12T09:11:24.805 INFO:tasks.workunit.client.1.smithi203.stdout:3/220: mknod d2/d8/d14/c3e 0 2024-04-12T09:11:24.806 INFO:tasks.workunit.client.1.smithi203.stdout:3/221: dread - d2/d1f/d2e/f38 zero size 2024-04-12T09:11:24.807 INFO:tasks.workunit.client.1.smithi203.stdout:3/222: write d2/f37 [732080,24808] 0 2024-04-12T09:11:24.808 INFO:tasks.workunit.client.1.smithi203.stdout:9/214: mknod d8/d12/d14/c52 0 2024-04-12T09:11:24.811 INFO:tasks.workunit.client.0.smithi117.stdout:1/852: getdents d1/dbd/d51 0 2024-04-12T09:11:24.811 INFO:tasks.workunit.client.1.smithi203.stdout:6/222: symlink d1/d3/d26/d30/l46 0 2024-04-12T09:11:24.813 INFO:tasks.workunit.client.1.smithi203.stdout:0/259: rename d0/d1d/d2f/d17/d19/l39 to d0/d48/l54 0 2024-04-12T09:11:24.814 INFO:tasks.workunit.client.1.smithi203.stdout:5/316: mkdir d0/d6/d16/d9/d30/d58/d76 0 2024-04-12T09:11:24.815 INFO:tasks.workunit.client.1.smithi203.stdout:5/317: readlink d0/d6/d16/d9/d14/l3a 0 2024-04-12T09:11:24.820 INFO:tasks.workunit.client.1.smithi203.stdout:3/223: mknod d2/c3f 0 2024-04-12T09:11:24.821 INFO:tasks.workunit.client.1.smithi203.stdout:9/215: symlink d8/d12/d23/d29/l53 0 2024-04-12T09:11:24.821 INFO:tasks.workunit.client.1.smithi203.stdout:9/216: chown d8/d12/l20 13198132 1 2024-04-12T09:11:24.822 INFO:tasks.workunit.client.1.smithi203.stdout:9/217: write d8/f4a [715842,22293] 0 2024-04-12T09:11:24.827 INFO:tasks.workunit.client.1.smithi203.stdout:4/213: rename d1a/d21/d22/c38 to d1a/d21/c45 0 2024-04-12T09:11:24.828 INFO:tasks.workunit.client.0.smithi117.stdout:1/853: dread d1/dbd/d3f/db/d16/db6/f8c [0,4194304] 0 2024-04-12T09:11:24.830 INFO:tasks.workunit.client.0.smithi117.stdout:1/854: dread - d1/dbd/d3f/db/d1d/d78/dbc/f107 zero size 2024-04-12T09:11:24.831 INFO:tasks.workunit.client.1.smithi203.stdout:8/213: link d4/d8/c26 d4/d8/d1c/c41 0 2024-04-12T09:11:24.831 INFO:tasks.workunit.client.0.smithi117.stdout:1/855: write d1/dbd/d3f/db/fe0 [1150237,27921] 0 2024-04-12T09:11:24.833 INFO:tasks.workunit.client.1.smithi203.stdout:4/214: dwrite d1a/d20/f2a [0,4194304] 0 2024-04-12T09:11:24.833 INFO:tasks.workunit.client.1.smithi203.stdout:5/318: mknod d0/d6/d16/d9/d14/d2d/c77 0 2024-04-12T09:11:24.835 INFO:tasks.workunit.client.1.smithi203.stdout:0/260: rename d0/d1d/d2f/f4b to d0/dd/d4d/f55 0 2024-04-12T09:11:24.837 INFO:tasks.workunit.client.1.smithi203.stdout:4/215: creat d1a/d34/f46 x:0 0 0 2024-04-12T09:11:24.838 INFO:tasks.workunit.client.1.smithi203.stdout:4/216: stat d1a/l32 0 2024-04-12T09:11:24.839 INFO:tasks.workunit.client.1.smithi203.stdout:1/281: truncate df/d2d/d45/d4a/f53 3069171 0 2024-04-12T09:11:24.840 INFO:tasks.workunit.client.1.smithi203.stdout:2/233: getdents d0/d14/d1e 0 2024-04-12T09:11:24.842 INFO:tasks.workunit.client.1.smithi203.stdout:2/234: fdatasync d0/fc 0 2024-04-12T09:11:24.843 INFO:tasks.workunit.client.1.smithi203.stdout:8/214: rename d4/f13 to d4/d8/f42 0 2024-04-12T09:11:24.843 INFO:tasks.workunit.client.1.smithi203.stdout:5/319: dwrite d0/d6/d11/d1e/d4c/f64 [0,4194304] 0 2024-04-12T09:11:24.843 INFO:tasks.workunit.client.1.smithi203.stdout:4/217: symlink d1a/d1d/d23/l47 0 2024-04-12T09:11:24.844 INFO:tasks.workunit.client.1.smithi203.stdout:8/215: fsync d4/f35 0 2024-04-12T09:11:24.848 INFO:tasks.workunit.client.1.smithi203.stdout:1/282: rename df/d34 to df/d20/d54 0 2024-04-12T09:11:24.849 INFO:tasks.workunit.client.1.smithi203.stdout:7/235: sync 2024-04-12T09:11:24.849 INFO:tasks.workunit.client.1.smithi203.stdout:1/283: fsync df/d20/d54/f46 0 2024-04-12T09:11:24.850 INFO:tasks.workunit.client.1.smithi203.stdout:8/216: fsync d4/d8/f1d 0 2024-04-12T09:11:24.852 INFO:tasks.workunit.client.1.smithi203.stdout:1/284: dread - df/f43 zero size 2024-04-12T09:11:24.852 INFO:tasks.workunit.client.1.smithi203.stdout:5/320: rename d0/f35 to d0/d6/d11/d1e/f78 0 2024-04-12T09:11:24.853 INFO:tasks.workunit.client.1.smithi203.stdout:2/235: dwrite d0/d14/f22 [4194304,4194304] 0 2024-04-12T09:11:24.853 INFO:tasks.workunit.client.1.smithi203.stdout:7/236: chown d0/d15/c33 20003038 1 2024-04-12T09:11:24.856 INFO:tasks.workunit.client.1.smithi203.stdout:2/236: write d0/d3/fd [1469501,108319] 0 2024-04-12T09:11:24.857 INFO:tasks.workunit.client.1.smithi203.stdout:1/285: rename df/l23 to df/d20/d2b/l55 0 2024-04-12T09:11:24.858 INFO:tasks.workunit.client.1.smithi203.stdout:1/286: chown df/c10 279 1 2024-04-12T09:11:24.858 INFO:tasks.workunit.client.1.smithi203.stdout:5/321: symlink d0/d6/d16/l79 0 2024-04-12T09:11:24.859 INFO:tasks.workunit.client.1.smithi203.stdout:8/217: dwrite d4/d8/f24 [0,4194304] 0 2024-04-12T09:11:24.860 INFO:tasks.workunit.client.1.smithi203.stdout:2/237: chown d0/f32 15 1 2024-04-12T09:11:24.860 INFO:tasks.workunit.client.1.smithi203.stdout:5/322: dread - d0/d6/d16/d8/f62 zero size 2024-04-12T09:11:24.861 INFO:tasks.workunit.client.1.smithi203.stdout:8/218: dread - d4/d8/d19/f3a zero size 2024-04-12T09:11:24.861 INFO:tasks.workunit.client.1.smithi203.stdout:1/287: write df/f2a [934459,97251] 0 2024-04-12T09:11:24.863 INFO:tasks.workunit.client.1.smithi203.stdout:2/238: chown d0/d14/l2f 0 1 2024-04-12T09:11:24.865 INFO:tasks.workunit.client.1.smithi203.stdout:8/219: truncate d4/d8/d19/f3a 543225 0 2024-04-12T09:11:24.865 INFO:tasks.workunit.client.1.smithi203.stdout:2/239: dread - d0/d14/d1e/d2a/f4c zero size 2024-04-12T09:11:24.867 INFO:tasks.workunit.client.1.smithi203.stdout:2/240: rmdir d0/d2e/d41 39 2024-04-12T09:11:24.868 INFO:tasks.workunit.client.1.smithi203.stdout:8/220: creat d4/d8/d19/f43 x:0 0 0 2024-04-12T09:11:24.869 INFO:tasks.workunit.client.1.smithi203.stdout:1/288: dwrite df/f16 [0,4194304] 0 2024-04-12T09:11:24.871 INFO:tasks.workunit.client.1.smithi203.stdout:8/221: mknod d4/c44 0 2024-04-12T09:11:24.872 INFO:tasks.workunit.client.1.smithi203.stdout:2/241: unlink d0/d38/l4e 0 2024-04-12T09:11:24.876 INFO:tasks.workunit.client.1.smithi203.stdout:2/242: getdents d0/d54 0 2024-04-12T09:11:24.877 INFO:tasks.workunit.client.1.smithi203.stdout:8/222: dwrite d4/d8/d19/f27 [0,4194304] 0 2024-04-12T09:11:24.878 INFO:tasks.workunit.client.1.smithi203.stdout:2/243: mknod d0/d38/d43/c58 0 2024-04-12T09:11:24.882 INFO:tasks.workunit.client.1.smithi203.stdout:8/223: fdatasync d4/d8/d1c/f40 0 2024-04-12T09:11:24.882 INFO:tasks.workunit.client.1.smithi203.stdout:2/244: dread d0/d38/d43/f44 [0,4194304] 0 2024-04-12T09:11:24.882 INFO:tasks.workunit.client.1.smithi203.stdout:8/224: creat d4/f45 x:0 0 0 2024-04-12T09:11:24.883 INFO:tasks.workunit.client.1.smithi203.stdout:2/245: fdatasync d0/f18 0 2024-04-12T09:11:24.884 INFO:tasks.workunit.client.1.smithi203.stdout:2/246: stat d0/d14/l2f 0 2024-04-12T09:11:24.886 INFO:tasks.workunit.client.1.smithi203.stdout:6/223: dread d1/d3/f2d [0,4194304] 0 2024-04-12T09:11:24.887 INFO:tasks.workunit.client.1.smithi203.stdout:6/224: write d1/d3/f25 [184342,44379] 0 2024-04-12T09:11:24.888 INFO:tasks.workunit.client.1.smithi203.stdout:9/218: read d8/d12/d23/f26 [1039332,87966] 0 2024-04-12T09:11:24.890 INFO:tasks.workunit.client.0.smithi117.stdout:8/993: dwrite db/da6/fad [0,4194304] 0 2024-04-12T09:11:24.893 INFO:tasks.workunit.client.1.smithi203.stdout:5/323: dread d0/d6/d16/d9/f24 [4194304,4194304] 0 2024-04-12T09:11:24.895 INFO:tasks.workunit.client.1.smithi203.stdout:6/225: dwrite d1/d3/d4/f1d [0,4194304] 0 2024-04-12T09:11:24.897 INFO:tasks.workunit.client.1.smithi203.stdout:6/226: write d1/f37 [1016323,97747] 0 2024-04-12T09:11:24.897 INFO:tasks.workunit.client.0.smithi117.stdout:1/856: mkdir d1/dbe/d10a 0 2024-04-12T09:11:24.897 INFO:tasks.workunit.client.0.smithi117.stdout:8/994: symlink db/d19/d1a/d3d/d9c/l153 0 2024-04-12T09:11:24.902 INFO:tasks.workunit.client.1.smithi203.stdout:9/219: symlink d8/d12/d23/d27/l54 0 2024-04-12T09:11:24.907 INFO:tasks.workunit.client.1.smithi203.stdout:6/227: symlink d1/df/l47 0 2024-04-12T09:11:24.907 INFO:tasks.workunit.client.1.smithi203.stdout:2/247: fsync d0/d2e/f34 0 2024-04-12T09:11:24.907 INFO:tasks.workunit.client.0.smithi117.stdout:8/995: symlink db/d13/l154 0 2024-04-12T09:11:24.908 INFO:tasks.workunit.client.1.smithi203.stdout:2/248: chown d0/d3/l2c 38500132 1 2024-04-12T09:11:24.910 INFO:tasks.workunit.client.1.smithi203.stdout:6/228: symlink d1/d3/d4/l48 0 2024-04-12T09:11:24.914 INFO:tasks.workunit.client.1.smithi203.stdout:6/229: dread d1/d3/f39 [0,4194304] 0 2024-04-12T09:11:24.918 INFO:tasks.workunit.client.1.smithi203.stdout:2/249: mknod d0/d14/d23/d3d/c59 0 2024-04-12T09:11:24.923 INFO:tasks.workunit.client.1.smithi203.stdout:6/230: rename d1/d3/f2a to d1/df/d1b/d3b/d45/f49 0 2024-04-12T09:11:24.925 INFO:tasks.workunit.client.1.smithi203.stdout:4/218: rmdir d1a/d21/d22 39 2024-04-12T09:11:24.926 INFO:tasks.workunit.client.1.smithi203.stdout:2/250: creat d0/d38/d43/f5a x:0 0 0 2024-04-12T09:11:24.927 INFO:tasks.workunit.client.1.smithi203.stdout:2/251: stat d0/d14/d23/d3d/c3f 0 2024-04-12T09:11:24.928 INFO:tasks.workunit.client.1.smithi203.stdout:2/252: dread - d0/d14/d1e/f48 zero size 2024-04-12T09:11:24.931 INFO:tasks.workunit.client.1.smithi203.stdout:3/224: creat d2/d8/d14/f40 x:0 0 0 2024-04-12T09:11:24.932 INFO:tasks.workunit.client.1.smithi203.stdout:4/219: mknod d1a/d20/c48 0 2024-04-12T09:11:24.934 INFO:tasks.workunit.client.1.smithi203.stdout:9/220: dread d8/ff [0,4194304] 0 2024-04-12T09:11:24.935 INFO:tasks.workunit.client.1.smithi203.stdout:6/231: dread d1/df/d1b/f23 [0,4194304] 0 2024-04-12T09:11:24.935 INFO:tasks.workunit.client.1.smithi203.stdout:9/221: chown d8/d12/d3e/f47 108971936 1 2024-04-12T09:11:24.936 INFO:tasks.workunit.client.1.smithi203.stdout:6/232: truncate d1/d3/d26/d30/f3f 769408 0 2024-04-12T09:11:24.938 INFO:tasks.workunit.client.1.smithi203.stdout:6/233: write d1/d3/d26/d30/f3d [879585,102663] 0 2024-04-12T09:11:24.940 INFO:tasks.workunit.client.1.smithi203.stdout:2/253: link d0/d3/f36 d0/d38/d43/f5b 0 2024-04-12T09:11:24.940 INFO:tasks.workunit.client.1.smithi203.stdout:2/254: dread - d0/d3/f8 zero size 2024-04-12T09:11:24.940 INFO:tasks.workunit.client.1.smithi203.stdout:3/225: creat d2/d8/d14/d23/d36/f41 x:0 0 0 2024-04-12T09:11:24.941 INFO:tasks.workunit.client.1.smithi203.stdout:1/289: rmdir df/d20/d54 39 2024-04-12T09:11:24.942 INFO:tasks.workunit.client.1.smithi203.stdout:2/255: truncate d0/d14/d1e/d2a/f4c 272183 0 2024-04-12T09:11:24.942 INFO:tasks.workunit.client.1.smithi203.stdout:2/256: fsync d0/d3/f17 0 2024-04-12T09:11:24.943 INFO:tasks.workunit.client.1.smithi203.stdout:4/220: creat d1a/d21/d22/d2e/f49 x:0 0 0 2024-04-12T09:11:24.943 INFO:tasks.workunit.client.1.smithi203.stdout:4/221: chown d1a/d1d/d23 608 1 2024-04-12T09:11:24.946 INFO:tasks.workunit.client.0.smithi117.stdout:8/996: dread db/d19/d1a/d3d/ff7 [0,4194304] 0 2024-04-12T09:11:24.947 INFO:tasks.workunit.client.1.smithi203.stdout:1/290: chown df/d20/d54 15 1 2024-04-12T09:11:24.949 INFO:tasks.workunit.client.1.smithi203.stdout:2/257: fdatasync d0/d38/d43/f5b 0 2024-04-12T09:11:24.951 INFO:tasks.workunit.client.0.smithi117.stdout:8/997: creat db/d1b/d62/dae/df9/d12b/def/f155 x:0 0 0 2024-04-12T09:11:24.952 INFO:tasks.workunit.client.1.smithi203.stdout:6/234: dread d1/df/f18 [0,4194304] 0 2024-04-12T09:11:24.952 INFO:tasks.workunit.client.1.smithi203.stdout:6/235: chown d1/d3/f2d 4 1 2024-04-12T09:11:24.952 INFO:tasks.workunit.client.1.smithi203.stdout:6/236: fdatasync d1/df/f19 0 2024-04-12T09:11:24.953 INFO:tasks.workunit.client.1.smithi203.stdout:4/222: rmdir d1a/d34 39 2024-04-12T09:11:24.953 INFO:tasks.workunit.client.1.smithi203.stdout:6/237: fdatasync d1/f37 0 2024-04-12T09:11:24.955 INFO:tasks.workunit.client.1.smithi203.stdout:9/222: creat d8/d12/d23/f55 x:0 0 0 2024-04-12T09:11:24.956 INFO:tasks.workunit.client.1.smithi203.stdout:7/237: truncate d0/d15/d2d/f4d 1141232 0 2024-04-12T09:11:24.957 INFO:tasks.workunit.client.0.smithi117.stdout:8/998: mkdir db/d1b/d62/dae/df9/d12b/dc3/d138/d156 0 2024-04-12T09:11:24.958 INFO:tasks.workunit.client.1.smithi203.stdout:3/226: link d2/d8/d14/f2c d2/d8/d14/d23/f42 0 2024-04-12T09:11:24.959 INFO:tasks.workunit.client.1.smithi203.stdout:8/225: fsync d4/d8/d19/f43 0 2024-04-12T09:11:24.959 INFO:tasks.workunit.client.0.smithi117.stdout:8/999: mknod db/c157 0 2024-04-12T09:11:24.963 INFO:tasks.workunit.client.1.smithi203.stdout:4/223: dread - d1a/d34/f46 zero size 2024-04-12T09:11:24.963 INFO:tasks.workunit.client.1.smithi203.stdout:6/238: mkdir d1/d3/d26/d30/d4a 0 2024-04-12T09:11:24.965 INFO:tasks.workunit.client.1.smithi203.stdout:1/291: mknod df/d20/c56 0 2024-04-12T09:11:24.967 INFO:tasks.workunit.client.1.smithi203.stdout:8/226: symlink d4/l46 0 2024-04-12T09:11:24.970 INFO:tasks.workunit.client.1.smithi203.stdout:9/223: mknod d8/c56 0 2024-04-12T09:11:24.971 INFO:tasks.workunit.client.1.smithi203.stdout:7/238: creat d0/d4/d1c/d3b/d4c/f55 x:0 0 0 2024-04-12T09:11:24.971 INFO:tasks.workunit.client.1.smithi203.stdout:1/292: dread df/f17 [0,4194304] 0 2024-04-12T09:11:24.974 INFO:tasks.workunit.client.1.smithi203.stdout:5/324: dwrite d0/d6/f46 [0,4194304] 0 2024-04-12T09:11:24.979 INFO:tasks.workunit.client.1.smithi203.stdout:0/261: dwrite d0/f3 [0,4194304] 0 2024-04-12T09:11:24.980 INFO:tasks.workunit.client.1.smithi203.stdout:7/239: unlink d0/d4/d1c/f48 0 2024-04-12T09:11:24.981 INFO:tasks.workunit.client.1.smithi203.stdout:7/240: chown d0/d15/f4a 82 1 2024-04-12T09:11:24.983 INFO:tasks.workunit.client.1.smithi203.stdout:8/227: unlink d4/f29 0 2024-04-12T09:11:24.984 INFO:tasks.workunit.client.1.smithi203.stdout:4/224: getdents d1a/d1d 0 2024-04-12T09:11:24.984 INFO:tasks.workunit.client.1.smithi203.stdout:8/228: fdatasync d4/d8/d1c/f40 0 2024-04-12T09:11:24.985 INFO:tasks.workunit.client.1.smithi203.stdout:4/225: fsync d1a/d20/f3d 0 2024-04-12T09:11:24.986 INFO:tasks.workunit.client.1.smithi203.stdout:6/239: link d1/d3/d26/l35 d1/df/l4b 0 2024-04-12T09:11:24.986 INFO:tasks.workunit.client.1.smithi203.stdout:5/325: write d0/d6/d11/d1e/f78 [2024515,12799] 0 2024-04-12T09:11:24.987 INFO:tasks.workunit.client.1.smithi203.stdout:4/226: write f5 [969346,111682] 0 2024-04-12T09:11:24.987 INFO:tasks.workunit.client.1.smithi203.stdout:8/229: write d4/f2d [609747,34488] 0 2024-04-12T09:11:24.991 INFO:tasks.workunit.client.1.smithi203.stdout:0/262: dwrite d0/d1d/d2f/d17/d19/f3b [4194304,4194304] 0 2024-04-12T09:11:24.991 INFO:tasks.workunit.client.1.smithi203.stdout:4/227: write d1a/d21/d22/d2e/f3c [1379367,91551] 0 2024-04-12T09:11:24.996 INFO:tasks.workunit.client.1.smithi203.stdout:1/293: dread df/f33 [0,4194304] 0 2024-04-12T09:11:24.999 INFO:tasks.workunit.client.1.smithi203.stdout:0/263: dwrite d0/d1d/d2f/d17/d19/f26 [0,4194304] 0 2024-04-12T09:11:25.003 INFO:tasks.workunit.client.1.smithi203.stdout:5/326: creat d0/d6/d11/d38/f7a x:0 0 0 2024-04-12T09:11:25.006 INFO:tasks.workunit.client.1.smithi203.stdout:8/230: unlink d4/lf 0 2024-04-12T09:11:25.009 INFO:tasks.workunit.client.1.smithi203.stdout:2/258: write d0/d3/f9 [841784,128472] 0 2024-04-12T09:11:25.011 INFO:tasks.workunit.client.1.smithi203.stdout:9/224: link d8/d12/d23/c25 d8/d12/d23/d29/d2c/c57 0 2024-04-12T09:11:25.013 INFO:tasks.workunit.client.1.smithi203.stdout:7/241: symlink d0/d4/d54/l56 0 2024-04-12T09:11:25.013 INFO:tasks.workunit.client.1.smithi203.stdout:3/227: write d2/f17 [910615,1565] 0 2024-04-12T09:11:25.024 INFO:tasks.workunit.client.1.smithi203.stdout:6/240: mknod d1/d3/d26/d30/d4a/c4c 0 2024-04-12T09:11:25.026 INFO:tasks.workunit.client.1.smithi203.stdout:2/259: dread d0/f18 [0,4194304] 0 2024-04-12T09:11:25.027 INFO:tasks.workunit.client.1.smithi203.stdout:8/231: chown d4/d8/c26 636 1 2024-04-12T09:11:25.030 INFO:tasks.workunit.client.1.smithi203.stdout:7/242: creat d0/d4/f57 x:0 0 0 2024-04-12T09:11:25.032 INFO:tasks.workunit.client.1.smithi203.stdout:3/228: mknod d2/d8/d14/c43 0 2024-04-12T09:11:25.039 INFO:tasks.workunit.client.1.smithi203.stdout:6/241: symlink d1/d3/d26/l4d 0 2024-04-12T09:11:25.048 INFO:tasks.workunit.client.1.smithi203.stdout:0/264: truncate d0/f3 1564464 0 2024-04-12T09:11:25.050 INFO:tasks.workunit.client.1.smithi203.stdout:1/294: write df/d2d/d45/d4a/f53 [1460797,20223] 0 2024-04-12T09:11:25.052 INFO:tasks.workunit.client.1.smithi203.stdout:7/243: dwrite d0/d4/f11 [0,4194304] 0 2024-04-12T09:11:25.053 INFO:tasks.workunit.client.1.smithi203.stdout:5/327: truncate d0/d6/d16/d9/f2e 2091901 0 2024-04-12T09:11:25.054 INFO:tasks.workunit.client.1.smithi203.stdout:2/260: symlink d0/d3/d47/l5c 0 2024-04-12T09:11:25.060 INFO:tasks.workunit.client.1.smithi203.stdout:0/265: symlink d0/dd/d4d/l56 0 2024-04-12T09:11:25.061 INFO:tasks.workunit.client.1.smithi203.stdout:5/328: dwrite d0/d6/f46 [0,4194304] 0 2024-04-12T09:11:25.062 INFO:tasks.workunit.client.1.smithi203.stdout:3/229: mknod d2/d1f/d2e/c44 0 2024-04-12T09:11:25.063 INFO:tasks.workunit.client.1.smithi203.stdout:4/228: getdents d1a/d1d/d23 0 2024-04-12T09:11:25.066 INFO:tasks.workunit.client.1.smithi203.stdout:4/229: fdatasync d1a/d21/d22/d2e/f43 0 2024-04-12T09:11:25.068 INFO:tasks.workunit.client.1.smithi203.stdout:0/266: dwrite d0/d1d/d2f/d4c/f4f [0,4194304] 0 2024-04-12T09:11:25.074 INFO:tasks.workunit.client.1.smithi203.stdout:6/242: mknod d1/df/d28/d43/c4e 0 2024-04-12T09:11:25.075 INFO:tasks.workunit.client.1.smithi203.stdout:9/225: getdents d8/d3b 0 2024-04-12T09:11:25.077 INFO:tasks.workunit.client.1.smithi203.stdout:5/329: chown d0/d6/d16/d9/d14/d4b/c6e 57 1 2024-04-12T09:11:25.078 INFO:tasks.workunit.client.1.smithi203.stdout:3/230: mkdir d2/d8/d14/d45 0 2024-04-12T09:11:25.080 INFO:tasks.workunit.client.1.smithi203.stdout:6/243: dwrite d1/df/d1b/d3b/f40 [0,4194304] 0 2024-04-12T09:11:25.081 INFO:tasks.workunit.client.1.smithi203.stdout:6/244: fdatasync d1/d3/d4/f42 0 2024-04-12T09:11:25.082 INFO:tasks.workunit.client.1.smithi203.stdout:4/230: creat d1a/d21/d22/f4a x:0 0 0 2024-04-12T09:11:25.085 INFO:tasks.workunit.client.1.smithi203.stdout:0/267: readlink d0/dd/d40/l43 0 2024-04-12T09:11:25.086 INFO:tasks.workunit.client.1.smithi203.stdout:0/268: fdatasync d0/f1a 0 2024-04-12T09:11:25.087 INFO:tasks.workunit.client.1.smithi203.stdout:4/231: chown d1a/d21/d22/l26 14706552 1 2024-04-12T09:11:25.087 INFO:tasks.workunit.client.1.smithi203.stdout:8/232: getdents d4/d8 0 2024-04-12T09:11:25.087 INFO:tasks.workunit.client.1.smithi203.stdout:4/232: write f5 [6784681,57566] 0 2024-04-12T09:11:25.087 INFO:tasks.workunit.client.1.smithi203.stdout:0/269: fdatasync d0/d1d/d2f/d17/f11 0 2024-04-12T09:11:25.087 INFO:tasks.workunit.client.1.smithi203.stdout:9/226: unlink d8/d12/d23/d29/f35 0 2024-04-12T09:11:25.089 INFO:tasks.workunit.client.1.smithi203.stdout:4/233: read d1a/d21/d22/d2e/f3c [1336266,7823] 0 2024-04-12T09:11:25.106 INFO:tasks.workunit.client.1.smithi203.stdout:8/233: creat d4/d34/f47 x:0 0 0 2024-04-12T09:11:25.106 INFO:tasks.workunit.client.1.smithi203.stdout:7/244: write d0/d15/d2d/f32 [2709378,109661] 0 2024-04-12T09:11:25.106 INFO:tasks.workunit.client.1.smithi203.stdout:8/234: fdatasync d4/d8/d1c/f2c 0 2024-04-12T09:11:25.107 INFO:tasks.workunit.client.1.smithi203.stdout:0/270: symlink d0/dd/d4d/l57 0 2024-04-12T09:11:25.109 INFO:tasks.workunit.client.1.smithi203.stdout:9/227: unlink d8/d12/d23/d27/l54 0 2024-04-12T09:11:25.111 INFO:tasks.workunit.client.1.smithi203.stdout:4/234: creat d1a/d21/d22/d2e/f4b x:0 0 0 2024-04-12T09:11:25.111 INFO:tasks.workunit.client.1.smithi203.stdout:4/235: stat d1a/d21/l2f 0 2024-04-12T09:11:25.113 INFO:tasks.workunit.client.1.smithi203.stdout:1/295: rename cb to df/c57 0 2024-04-12T09:11:25.113 INFO:tasks.workunit.client.1.smithi203.stdout:3/231: rename d2/d8/d14/d23/d36 to d2/d8/d14/d23/d36/d46 22 2024-04-12T09:11:25.114 INFO:tasks.workunit.client.1.smithi203.stdout:1/296: write df/d2d/d45/f4d [31180,89394] 0 2024-04-12T09:11:25.114 INFO:tasks.workunit.client.1.smithi203.stdout:1/297: chown ld 4 1 2024-04-12T09:11:25.118 INFO:tasks.workunit.client.1.smithi203.stdout:7/245: mkdir d0/d4/d1c/d3b/d58 0 2024-04-12T09:11:25.119 INFO:tasks.workunit.client.1.smithi203.stdout:8/235: mkdir d4/d8/d1c/d48 0 2024-04-12T09:11:25.120 INFO:tasks.workunit.client.1.smithi203.stdout:0/271: symlink d0/d1d/d2f/d17/d19/l58 0 2024-04-12T09:11:25.120 INFO:tasks.workunit.client.1.smithi203.stdout:4/236: symlink d1a/d20/l4c 0 2024-04-12T09:11:25.121 INFO:tasks.workunit.client.1.smithi203.stdout:4/237: fdatasync f5 0 2024-04-12T09:11:25.121 INFO:tasks.workunit.client.1.smithi203.stdout:4/238: write d1a/d2b/f3a [905269,36471] 0 2024-04-12T09:11:25.122 INFO:tasks.workunit.client.1.smithi203.stdout:3/232: creat d2/d8/d14/d23/f47 x:0 0 0 2024-04-12T09:11:25.124 INFO:tasks.workunit.client.1.smithi203.stdout:1/298: chown df/l29 2111815 1 2024-04-12T09:11:25.124 INFO:tasks.workunit.client.1.smithi203.stdout:7/246: creat d0/d4/d1c/d3b/d4c/f59 x:0 0 0 2024-04-12T09:11:25.124 INFO:tasks.workunit.client.1.smithi203.stdout:1/299: readlink df/l11 0 2024-04-12T09:11:25.140 INFO:tasks.workunit.client.1.smithi203.stdout:7/247: chown d0/d38/d51 1631 1 2024-04-12T09:11:25.142 INFO:tasks.workunit.client.1.smithi203.stdout:6/245: getdents d1/d3/d26 0 2024-04-12T09:11:25.142 INFO:tasks.workunit.client.1.smithi203.stdout:7/248: stat d0/d15/c33 0 2024-04-12T09:11:25.145 INFO:tasks.workunit.client.1.smithi203.stdout:0/272: mkdir d0/d59 0 2024-04-12T09:11:25.146 INFO:tasks.workunit.client.1.smithi203.stdout:4/239: dwrite d1a/d21/d22/d2e/f4b [0,4194304] 0 2024-04-12T09:11:25.146 INFO:tasks.workunit.client.1.smithi203.stdout:9/228: rename d8/d12/d23/f55 to d8/f58 0 2024-04-12T09:11:25.146 INFO:tasks.workunit.client.1.smithi203.stdout:8/236: link d4/d8/d1c/c3b d4/c49 0 2024-04-12T09:11:25.149 INFO:tasks.workunit.client.1.smithi203.stdout:7/249: creat d0/d38/f5a x:0 0 0 2024-04-12T09:11:25.152 INFO:tasks.workunit.client.1.smithi203.stdout:9/229: chown d8/d12/l20 13938904 1 2024-04-12T09:11:25.154 INFO:tasks.workunit.client.1.smithi203.stdout:5/330: dwrite d0/d6/d11/d1e/d4c/f42 [0,4194304] 0 2024-04-12T09:11:25.155 INFO:tasks.workunit.client.1.smithi203.stdout:4/240: readlink d1a/l36 0 2024-04-12T09:11:25.157 INFO:tasks.workunit.client.1.smithi203.stdout:1/300: dwrite df/d2d/d45/f4d [0,4194304] 0 2024-04-12T09:11:25.159 INFO:tasks.workunit.client.1.smithi203.stdout:8/237: unlink d4/d8/d1c/f40 0 2024-04-12T09:11:25.159 INFO:tasks.workunit.client.1.smithi203.stdout:4/241: stat d1a/d21/d22/d2e/f43 0 2024-04-12T09:11:25.220 INFO:tasks.workunit.client.1.smithi203.stdout:7/250: dread d0/d4/d1c/d3b/f3f [0,4194304] 0 2024-04-12T09:11:25.221 INFO:tasks.workunit.client.1.smithi203.stdout:4/242: chown d1a/d1d/d23/d2c 425933 1 2024-04-12T09:11:25.221 INFO:tasks.workunit.client.1.smithi203.stdout:1/301: mkdir df/d2d/d45/d58 0 2024-04-12T09:11:25.221 INFO:tasks.workunit.client.1.smithi203.stdout:6/246: dwrite d1/d3/f2d [0,4194304] 0 2024-04-12T09:11:25.223 INFO:tasks.workunit.client.1.smithi203.stdout:3/233: link d2/fa d2/d8/d14/d1b/f48 0 2024-04-12T09:11:25.223 INFO:tasks.workunit.client.1.smithi203.stdout:4/243: write d1a/d34/f46 [896182,55051] 0 2024-04-12T09:11:25.223 INFO:tasks.workunit.client.1.smithi203.stdout:1/302: write df/f3f [277776,8916] 0 2024-04-12T09:11:25.225 INFO:tasks.workunit.client.1.smithi203.stdout:3/234: dread - d2/d8/f39 zero size 2024-04-12T09:11:25.225 INFO:tasks.workunit.client.1.smithi203.stdout:4/244: chown l8 11870587 1 2024-04-12T09:11:25.226 INFO:tasks.workunit.client.1.smithi203.stdout:0/273: getdents d0/d48 0 2024-04-12T09:11:25.226 INFO:tasks.workunit.client.1.smithi203.stdout:6/247: write d1/d3/d26/d30/f3d [39397,98822] 0 2024-04-12T09:11:25.226 INFO:tasks.workunit.client.1.smithi203.stdout:7/251: chown d0/d4/d1c/d3b/c50 101073435 1 2024-04-12T09:11:25.227 INFO:tasks.workunit.client.1.smithi203.stdout:4/245: chown d1a/l36 0 1 2024-04-12T09:11:25.229 INFO:tasks.workunit.client.1.smithi203.stdout:1/303: unlink df/d20/d54/c4c 0 2024-04-12T09:11:25.229 INFO:tasks.workunit.client.1.smithi203.stdout:3/235: write d2/d8/d14/f27 [670224,14126] 0 2024-04-12T09:11:25.229 INFO:tasks.workunit.client.1.smithi203.stdout:8/238: dread d4/d8/d19/f27 [0,4194304] 0 2024-04-12T09:11:25.229 INFO:tasks.workunit.client.1.smithi203.stdout:9/230: getdents d8/d12/d23/d41 0 2024-04-12T09:11:25.230 INFO:tasks.workunit.client.1.smithi203.stdout:1/304: chown df/l3a 11216060 1 2024-04-12T09:11:25.230 INFO:tasks.workunit.client.1.smithi203.stdout:8/239: chown d4/d8/d19/f27 34349225 1 2024-04-12T09:11:25.232 INFO:tasks.workunit.client.1.smithi203.stdout:7/252: mkdir d0/d4/d1c/d5b 0 2024-04-12T09:11:25.233 INFO:tasks.workunit.client.1.smithi203.stdout:8/240: mkdir d4/d4a 0 2024-04-12T09:11:25.234 INFO:tasks.workunit.client.1.smithi203.stdout:4/246: dread d1a/d2b/f3a [0,4194304] 0 2024-04-12T09:11:25.234 INFO:tasks.workunit.client.1.smithi203.stdout:6/248: getdents d1/d3/d12 0 2024-04-12T09:11:25.235 INFO:tasks.workunit.client.1.smithi203.stdout:0/274: write d0/d1d/d2f/f33 [459922,93565] 0 2024-04-12T09:11:25.235 INFO:tasks.workunit.client.1.smithi203.stdout:8/241: fsync d4/d8/d1c/f30 0 2024-04-12T09:11:25.236 INFO:tasks.workunit.client.1.smithi203.stdout:7/253: fdatasync d0/f7 0 2024-04-12T09:11:25.236 INFO:tasks.workunit.client.1.smithi203.stdout:3/236: creat d2/d8/d14/d23/f49 x:0 0 0 2024-04-12T09:11:25.238 INFO:tasks.workunit.client.1.smithi203.stdout:9/231: link d8/f4a d8/d12/d23/d29/f59 0 2024-04-12T09:11:25.239 INFO:tasks.workunit.client.1.smithi203.stdout:8/242: write d4/d8/d19/f25 [273600,101730] 0 2024-04-12T09:11:25.239 INFO:tasks.workunit.client.1.smithi203.stdout:3/237: chown d2/d8/lf 1848 1 2024-04-12T09:11:25.239 INFO:tasks.workunit.client.1.smithi203.stdout:4/247: rename d1a/d1d/l1f to d1a/d2b/l4d 0 2024-04-12T09:11:25.240 INFO:tasks.workunit.client.1.smithi203.stdout:9/232: dread - d8/f28 zero size 2024-04-12T09:11:25.240 INFO:tasks.workunit.client.1.smithi203.stdout:7/254: truncate d0/d38/f5a 537030 0 2024-04-12T09:11:25.242 INFO:tasks.workunit.client.1.smithi203.stdout:6/249: truncate d1/d3/f1a 677935 0 2024-04-12T09:11:25.242 INFO:tasks.workunit.client.1.smithi203.stdout:1/305: dread df/d2d/d45/f4d [0,4194304] 0 2024-04-12T09:11:25.244 INFO:tasks.workunit.client.1.smithi203.stdout:4/248: mkdir d1a/d21/d22/d4e 0 2024-04-12T09:11:25.244 INFO:tasks.workunit.client.1.smithi203.stdout:6/250: chown d1/df/d1b/d3b/d45 1 1 2024-04-12T09:11:25.245 INFO:tasks.workunit.client.1.smithi203.stdout:8/243: rename d4/f45 to d4/f4b 0 2024-04-12T09:11:25.246 INFO:tasks.workunit.client.1.smithi203.stdout:9/233: creat d8/d12/d23/d29/d2c/f5a x:0 0 0 2024-04-12T09:11:25.247 INFO:tasks.workunit.client.1.smithi203.stdout:4/249: symlink d1a/d20/l4f 0 2024-04-12T09:11:25.248 INFO:tasks.workunit.client.1.smithi203.stdout:6/251: mknod d1/d3/d4/c4f 0 2024-04-12T09:11:25.250 INFO:tasks.workunit.client.1.smithi203.stdout:7/255: link d0/d4/d1c/d3b/f4e d0/d4/d1c/d3b/d58/f5c 0 2024-04-12T09:11:25.250 INFO:tasks.workunit.client.1.smithi203.stdout:1/306: truncate df/d20/d54/f46 835254 0 2024-04-12T09:11:25.252 INFO:tasks.workunit.client.1.smithi203.stdout:3/238: dwrite d2/f37 [0,4194304] 0 2024-04-12T09:11:25.254 INFO:tasks.workunit.client.1.smithi203.stdout:2/261: sync 2024-04-12T09:11:25.255 INFO:tasks.workunit.client.1.smithi203.stdout:9/234: rename d8/d12/d23/d29/d2c/f30 to d8/d12/d23/d27/d4f/f5b 0 2024-04-12T09:11:25.257 INFO:tasks.workunit.client.1.smithi203.stdout:1/307: mkdir df/d59 0 2024-04-12T09:11:25.262 INFO:tasks.workunit.client.1.smithi203.stdout:0/275: dread d0/d1d/d2f/d17/fa [0,4194304] 0 2024-04-12T09:11:25.262 INFO:tasks.workunit.client.1.smithi203.stdout:2/262: dread d0/d38/f3b [0,4194304] 0 2024-04-12T09:11:25.263 INFO:tasks.workunit.client.1.smithi203.stdout:6/252: rmdir d1/d3 39 2024-04-12T09:11:25.263 INFO:tasks.workunit.client.1.smithi203.stdout:1/308: mknod df/d20/d2b/c5a 0 2024-04-12T09:11:25.264 INFO:tasks.workunit.client.1.smithi203.stdout:7/256: dwrite d0/d15/d2d/f4b [0,4194304] 0 2024-04-12T09:11:25.264 INFO:tasks.workunit.client.1.smithi203.stdout:9/235: creat d8/d12/d23/d29/d2c/f5c x:0 0 0 2024-04-12T09:11:25.266 INFO:tasks.workunit.client.1.smithi203.stdout:3/239: truncate d2/f18 42864 0 2024-04-12T09:11:25.266 INFO:tasks.workunit.client.1.smithi203.stdout:1/309: read df/f33 [345533,22976] 0 2024-04-12T09:11:25.267 INFO:tasks.workunit.client.1.smithi203.stdout:0/276: write d0/d1d/d2f/d17/d19/f37 [3484123,94169] 0 2024-04-12T09:11:25.269 INFO:tasks.workunit.client.1.smithi203.stdout:9/236: write f5 [3081562,76119] 0 2024-04-12T09:11:25.270 INFO:tasks.workunit.client.1.smithi203.stdout:6/253: mknod d1/c50 0 2024-04-12T09:11:25.270 INFO:tasks.workunit.client.1.smithi203.stdout:1/310: write df/f16 [2470673,70805] 0 2024-04-12T09:11:25.273 INFO:tasks.workunit.client.1.smithi203.stdout:9/237: chown d8/d12/d14/f1d 979653849 1 2024-04-12T09:11:25.274 INFO:tasks.workunit.client.1.smithi203.stdout:7/257: rename d0/d4/d1c/d3b/d58 to d0/d4/d5d 0 2024-04-12T09:11:25.275 INFO:tasks.workunit.client.1.smithi203.stdout:0/277: mknod d0/d1d/d2f/c5a 0 2024-04-12T09:11:25.279 INFO:tasks.workunit.client.1.smithi203.stdout:3/240: rename d2/d1f/d2e/c44 to d2/d8/d14/d23/c4a 0 2024-04-12T09:11:25.280 INFO:tasks.workunit.client.1.smithi203.stdout:9/238: mkdir d8/d12/d23/d29/d2c/d5d 0 2024-04-12T09:11:25.280 INFO:tasks.workunit.client.1.smithi203.stdout:2/263: dwrite d0/d14/d23/f2d [0,4194304] 0 2024-04-12T09:11:25.281 INFO:tasks.workunit.client.1.smithi203.stdout:7/258: unlink d0/d4/d1c/l29 0 2024-04-12T09:11:25.284 INFO:tasks.workunit.client.1.smithi203.stdout:0/278: dread - d0/d1d/d2f/f1e zero size 2024-04-12T09:11:25.284 INFO:tasks.workunit.client.1.smithi203.stdout:3/241: stat d2/c10 0 2024-04-12T09:11:25.286 INFO:tasks.workunit.client.1.smithi203.stdout:9/239: creat d8/d12/d23/d41/f5e x:0 0 0 2024-04-12T09:11:25.287 INFO:tasks.workunit.client.1.smithi203.stdout:2/264: creat d0/d14/d1e/d2a/f5d x:0 0 0 2024-04-12T09:11:25.289 INFO:tasks.workunit.client.1.smithi203.stdout:6/254: dread d1/d3/f39 [0,4194304] 0 2024-04-12T09:11:25.290 INFO:tasks.workunit.client.1.smithi203.stdout:2/265: write d0/d14/d23/f2d [2530933,120458] 0 2024-04-12T09:11:25.291 INFO:tasks.workunit.client.1.smithi203.stdout:9/240: write d8/f58 [666085,62186] 0 2024-04-12T09:11:25.296 INFO:tasks.workunit.client.1.smithi203.stdout:0/279: getdents d0/d1d/d2f/d4c 0 2024-04-12T09:11:25.296 INFO:tasks.workunit.client.1.smithi203.stdout:3/242: dwrite d2/f37 [0,4194304] 0 2024-04-12T09:11:25.296 INFO:tasks.workunit.client.1.smithi203.stdout:9/241: rmdir d8/d12/d23/d27 39 2024-04-12T09:11:25.298 INFO:tasks.workunit.client.1.smithi203.stdout:6/255: truncate d1/df/f19 2720534 0 2024-04-12T09:11:25.299 INFO:tasks.workunit.client.1.smithi203.stdout:2/266: dread d0/d14/d1e/f2b [0,4194304] 0 2024-04-12T09:11:25.301 INFO:tasks.workunit.client.0.smithi117.stdout:7/710: sync 2024-04-12T09:11:25.303 INFO:tasks.workunit.client.1.smithi203.stdout:0/280: mkdir d0/dd/d5b 0 2024-04-12T09:11:25.304 INFO:tasks.workunit.client.0.smithi117.stdout:7/711: read d0/d2/d45/d17/d23/d50/f3d [841849,79789] 0 2024-04-12T09:11:25.305 INFO:tasks.workunit.client.1.smithi203.stdout:6/256: rmdir d1/df/d1b/d3b/d45 39 2024-04-12T09:11:25.309 INFO:tasks.workunit.client.0.smithi117.stdout:7/712: symlink d0/d2/d45/d17/d23/dac/dad/d91/ldf 0 2024-04-12T09:11:25.310 INFO:tasks.workunit.client.0.smithi117.stdout:7/713: fdatasync d0/d2/d45/d17/d23/dac/dad/d91/fdc 0 2024-04-12T09:11:25.310 INFO:tasks.workunit.client.1.smithi203.stdout:9/242: mknod d8/d12/d23/d38/c5f 0 2024-04-12T09:11:25.310 INFO:tasks.workunit.client.1.smithi203.stdout:1/311: dwrite df/f17 [0,4194304] 0 2024-04-12T09:11:25.311 INFO:tasks.workunit.client.1.smithi203.stdout:0/281: fsync d0/dd/d4d/f55 0 2024-04-12T09:11:25.313 INFO:tasks.workunit.client.1.smithi203.stdout:9/243: truncate d8/d12/d23/d29/d2c/f5c 865604 0 2024-04-12T09:11:25.313 INFO:tasks.workunit.client.0.smithi117.stdout:7/714: creat d0/d2/d45/d17/d7a/fe0 x:0 0 0 2024-04-12T09:11:25.317 INFO:tasks.workunit.client.1.smithi203.stdout:6/257: link d1/d3/f25 d1/df/f51 0 2024-04-12T09:11:25.317 INFO:tasks.workunit.client.1.smithi203.stdout:0/282: creat d0/d1d/d2f/d17/d19/f5c x:0 0 0 2024-04-12T09:11:25.319 INFO:tasks.workunit.client.1.smithi203.stdout:2/267: rmdir d0/d54/d56 0 2024-04-12T09:11:25.321 INFO:tasks.workunit.client.1.smithi203.stdout:9/244: mkdir d8/d12/d23/d27/d4f/d60 0 2024-04-12T09:11:25.322 INFO:tasks.workunit.client.1.smithi203.stdout:6/258: truncate d1/f37 680682 0 2024-04-12T09:11:25.322 INFO:tasks.workunit.client.1.smithi203.stdout:0/283: mkdir d0/d59/d5d 0 2024-04-12T09:11:25.323 INFO:tasks.workunit.client.1.smithi203.stdout:6/259: chown d1/d3/f34 3902477 1 2024-04-12T09:11:25.323 INFO:tasks.workunit.client.1.smithi203.stdout:2/268: creat d0/d14/d23/d33/f5e x:0 0 0 2024-04-12T09:11:25.325 INFO:tasks.workunit.client.1.smithi203.stdout:2/269: write d0/d38/d43/f5a [1023092,110150] 0 2024-04-12T09:11:25.325 INFO:tasks.workunit.client.1.smithi203.stdout:0/284: write d0/dd/f16 [3974684,31957] 0 2024-04-12T09:11:25.325 INFO:tasks.workunit.client.1.smithi203.stdout:0/285: chown d0/dd 564037 1 2024-04-12T09:11:25.326 INFO:tasks.workunit.client.1.smithi203.stdout:9/245: rename d8/d12/d23/d27/f2e to d8/d12/d23/d29/d2c/d5d/f61 0 2024-04-12T09:11:25.327 INFO:tasks.workunit.client.1.smithi203.stdout:9/246: readlink d8/d12/l20 0 2024-04-12T09:11:25.327 INFO:tasks.workunit.client.1.smithi203.stdout:0/286: write d0/dd/f16 [2459436,68843] 0 2024-04-12T09:11:25.328 INFO:tasks.workunit.client.1.smithi203.stdout:2/270: unlink d0/d3/l1c 0 2024-04-12T09:11:25.330 INFO:tasks.workunit.client.1.smithi203.stdout:0/287: fsync d0/d1d/d2f/d17/fa 0 2024-04-12T09:11:25.330 INFO:tasks.workunit.client.1.smithi203.stdout:9/247: write d8/f28 [366682,89113] 0 2024-04-12T09:11:25.330 INFO:tasks.workunit.client.1.smithi203.stdout:6/260: getdents d1/d3/d4 0 2024-04-12T09:11:25.332 INFO:tasks.workunit.client.1.smithi203.stdout:2/271: rename d0/d14/d23/d33/f5e to d0/d3/f5f 0 2024-04-12T09:11:25.333 INFO:tasks.workunit.client.1.smithi203.stdout:0/288: mkdir d0/d48/d5e 0 2024-04-12T09:11:25.335 INFO:tasks.workunit.client.1.smithi203.stdout:2/272: rename d0/d3/f9 to d0/d14/d1e/d2a/f60 0 2024-04-12T09:11:25.338 INFO:tasks.workunit.client.1.smithi203.stdout:6/261: creat d1/df/d1b/d3b/d45/f52 x:0 0 0 2024-04-12T09:11:25.338 INFO:tasks.workunit.client.1.smithi203.stdout:2/273: mkdir d0/d54/d61 0 2024-04-12T09:11:25.339 INFO:tasks.workunit.client.1.smithi203.stdout:0/289: write d0/dd/f1b [4271044,22017] 0 2024-04-12T09:11:25.343 INFO:tasks.workunit.client.1.smithi203.stdout:9/248: dread d8/f4a [0,4194304] 0 2024-04-12T09:11:25.343 INFO:tasks.workunit.client.1.smithi203.stdout:3/243: write d2/d8/d14/f2c [2776678,45109] 0 2024-04-12T09:11:25.346 INFO:tasks.workunit.client.1.smithi203.stdout:3/244: stat d2/d8/d14/d1b 0 2024-04-12T09:11:25.346 INFO:tasks.workunit.client.1.smithi203.stdout:2/274: dread d0/d14/d1e/f2b [0,4194304] 0 2024-04-12T09:11:25.346 INFO:tasks.workunit.client.1.smithi203.stdout:0/290: dread d0/f3 [0,4194304] 0 2024-04-12T09:11:25.346 INFO:tasks.workunit.client.1.smithi203.stdout:9/249: write d8/d12/d3e/f47 [391115,34110] 0 2024-04-12T09:11:25.346 INFO:tasks.workunit.client.1.smithi203.stdout:2/275: stat d0/d14/l24 0 2024-04-12T09:11:25.347 INFO:tasks.workunit.client.1.smithi203.stdout:6/262: creat d1/df/d1b/d3e/f53 x:0 0 0 2024-04-12T09:11:25.349 INFO:tasks.workunit.client.1.smithi203.stdout:0/291: rmdir d0/d1d/d2f/d4c 39 2024-04-12T09:11:25.351 INFO:tasks.workunit.client.1.smithi203.stdout:2/276: rename d0/d14/l1d to d0/d14/l62 0 2024-04-12T09:11:25.351 INFO:tasks.workunit.client.1.smithi203.stdout:1/312: write df/f33 [617040,119071] 0 2024-04-12T09:11:25.352 INFO:tasks.workunit.client.1.smithi203.stdout:0/292: truncate d0/f3 1973443 0 2024-04-12T09:11:25.353 INFO:tasks.workunit.client.1.smithi203.stdout:3/245: dwrite d2/f37 [0,4194304] 0 2024-04-12T09:11:25.354 INFO:tasks.workunit.client.1.smithi203.stdout:1/313: read df/d2d/d45/f4d [1217950,64300] 0 2024-04-12T09:11:25.358 INFO:tasks.workunit.client.0.smithi117.stdout:7/715: dwrite d0/d2/d45/d17/d23/d50/f64 [0,4194304] 0 2024-04-12T09:11:25.358 INFO:tasks.workunit.client.1.smithi203.stdout:0/293: dread d0/f4 [0,4194304] 0 2024-04-12T09:11:25.359 INFO:tasks.workunit.client.0.smithi117.stdout:7/716: dread - d0/d2/d45/d17/d7a/fe0 zero size 2024-04-12T09:11:25.366 INFO:tasks.workunit.client.0.smithi117.stdout:7/717: dwrite d0/d2/d45/d17/d7a/fe0 [0,4194304] 0 2024-04-12T09:11:25.367 INFO:tasks.workunit.client.1.smithi203.stdout:1/314: unlink df/d2d/f48 0 2024-04-12T09:11:25.368 INFO:tasks.workunit.client.1.smithi203.stdout:5/331: sync 2024-04-12T09:11:25.368 INFO:tasks.workunit.client.0.smithi117.stdout:7/718: write d0/d2/d45/d17/d23/dac/dad/daa/fb4 [12848,121605] 0 2024-04-12T09:11:25.369 INFO:tasks.workunit.client.1.smithi203.stdout:5/332: write d0/d6/f46 [2330806,47755] 0 2024-04-12T09:11:25.370 INFO:tasks.workunit.client.1.smithi203.stdout:1/315: dread df/d20/f26 [0,4194304] 0 2024-04-12T09:11:25.375 INFO:tasks.workunit.client.0.smithi117.stdout:7/719: dwrite d0/d2/d45/d17/f29 [0,4194304] 0 2024-04-12T09:11:25.376 INFO:tasks.workunit.client.0.smithi117.stdout:7/720: chown d0/d2/d1a/d4f/dbc 1026932 1 2024-04-12T09:11:25.380 INFO:tasks.workunit.client.1.smithi203.stdout:6/263: getdents d1/df/d1b/d3b/d45 0 2024-04-12T09:11:25.387 INFO:tasks.workunit.client.1.smithi203.stdout:6/264: mknod d1/df/d28/d3a/c54 0 2024-04-12T09:11:25.395 INFO:tasks.workunit.client.1.smithi203.stdout:2/277: dwrite d0/d38/f3b [0,4194304] 0 2024-04-12T09:11:25.395 INFO:tasks.workunit.client.1.smithi203.stdout:5/333: truncate d0/d6/d11/d1e/d4c/f42 1876623 0 2024-04-12T09:11:25.395 INFO:tasks.workunit.client.1.smithi203.stdout:3/246: dwrite d2/f30 [0,4194304] 0 2024-04-12T09:11:25.400 INFO:tasks.workunit.client.1.smithi203.stdout:0/294: write d0/f3 [220898,30624] 0 2024-04-12T09:11:25.406 INFO:tasks.workunit.client.1.smithi203.stdout:0/295: creat d0/d1d/f5f x:0 0 0 2024-04-12T09:11:25.409 INFO:tasks.workunit.client.1.smithi203.stdout:5/334: dread d0/d6/d11/d18/d1a/f3f [0,4194304] 0 2024-04-12T09:11:25.410 INFO:tasks.workunit.client.1.smithi203.stdout:6/265: dwrite d1/df/f19 [0,4194304] 0 2024-04-12T09:11:25.410 INFO:tasks.workunit.client.1.smithi203.stdout:3/247: dwrite d2/f37 [0,4194304] 0 2024-04-12T09:11:25.412 INFO:tasks.workunit.client.0.smithi117.stdout:7/721: dread d0/d2/d45/d15/f25 [0,4194304] 0 2024-04-12T09:11:25.419 INFO:tasks.workunit.client.1.smithi203.stdout:0/296: dwrite d0/d1d/d2f/d17/f11 [0,4194304] 0 2024-04-12T09:11:25.422 INFO:tasks.workunit.client.1.smithi203.stdout:3/248: write d2/d8/d14/d1b/d2f/f32 [1770934,89631] 0 2024-04-12T09:11:25.422 INFO:tasks.workunit.client.1.smithi203.stdout:6/266: write d1/d3/d12/f1f [3039396,75337] 0 2024-04-12T09:11:25.427 INFO:tasks.workunit.client.1.smithi203.stdout:3/249: dread - d2/d1f/d2e/f38 zero size 2024-04-12T09:11:25.427 INFO:tasks.workunit.client.1.smithi203.stdout:6/267: mkdir d1/df/d1b/d3b/d45/d55 0 2024-04-12T09:11:25.427 INFO:tasks.workunit.client.0.smithi117.stdout:9/753: sync 2024-04-12T09:11:25.427 INFO:tasks.workunit.client.0.smithi117.stdout:5/946: sync 2024-04-12T09:11:25.428 INFO:tasks.workunit.client.1.smithi203.stdout:2/278: fsync d0/d38/f3b 0 2024-04-12T09:11:25.428 INFO:tasks.workunit.client.0.smithi117.stdout:9/754: fdatasync d1/d8/f10 0 2024-04-12T09:11:25.432 INFO:tasks.workunit.client.0.smithi117.stdout:5/947: symlink d2/d3/dd/d39/d83/l13a 0 2024-04-12T09:11:25.433 INFO:tasks.workunit.client.1.smithi203.stdout:2/279: symlink d0/d2e/l63 0 2024-04-12T09:11:25.434 INFO:tasks.workunit.client.0.smithi117.stdout:5/948: dread - d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1/d11f/ffc zero size 2024-04-12T09:11:25.434 INFO:tasks.workunit.client.0.smithi117.stdout:5/949: chown d2/d3/de/d1e/d79/dec 52798514 1 2024-04-12T09:11:25.435 INFO:tasks.workunit.client.1.smithi203.stdout:2/280: write d0/d38/f3b [1138788,50823] 0 2024-04-12T09:11:25.436 INFO:tasks.workunit.client.1.smithi203.stdout:3/250: dwrite d2/d8/d14/d23/f49 [0,4194304] 0 2024-04-12T09:11:25.437 INFO:tasks.workunit.client.1.smithi203.stdout:2/281: chown d0/d3/f10 178254 1 2024-04-12T09:11:25.440 INFO:tasks.workunit.client.1.smithi203.stdout:2/282: creat d0/d14/d23/d3d/f64 x:0 0 0 2024-04-12T09:11:25.443 INFO:tasks.workunit.client.1.smithi203.stdout:2/283: chown d0/d14/d23/d3d/f64 211474674 1 2024-04-12T09:11:25.445 INFO:tasks.workunit.client.1.smithi203.stdout:0/297: write d0/f4 [2010672,76620] 0 2024-04-12T09:11:25.447 INFO:tasks.workunit.client.1.smithi203.stdout:3/251: dwrite d2/d1f/d2e/f34 [4194304,4194304] 0 2024-04-12T09:11:25.447 INFO:tasks.workunit.client.0.smithi117.stdout:9/755: write d1/d8/d52/fdb [570876,17745] 0 2024-04-12T09:11:25.447 INFO:tasks.workunit.client.0.smithi117.stdout:7/722: dwrite d0/d2/d45/f42 [0,4194304] 0 2024-04-12T09:11:25.450 INFO:tasks.workunit.client.0.smithi117.stdout:7/723: dread - d0/d2/d45/fbe zero size 2024-04-12T09:11:25.453 INFO:tasks.workunit.client.0.smithi117.stdout:7/724: mkdir d0/d2/d45/d17/d23/dac/de1 0 2024-04-12T09:11:25.454 INFO:tasks.workunit.client.0.smithi117.stdout:5/950: dwrite d2/f92 [0,4194304] 0 2024-04-12T09:11:25.457 INFO:tasks.workunit.client.0.smithi117.stdout:7/725: symlink d0/d2/d45/d17/d23/dac/dad/d91/le2 0 2024-04-12T09:11:25.458 INFO:tasks.workunit.client.1.smithi203.stdout:5/335: dread d0/d6/d11/d18/f40 [0,4194304] 0 2024-04-12T09:11:25.458 INFO:tasks.workunit.client.1.smithi203.stdout:2/284: dwrite d0/f32 [4194304,4194304] 0 2024-04-12T09:11:25.459 INFO:tasks.workunit.client.0.smithi117.stdout:5/951: mkdir d2/d3/de/d1e/d66/dbe/d105/d13b 0 2024-04-12T09:11:25.460 INFO:tasks.workunit.client.1.smithi203.stdout:6/268: dwrite d1/df/f18 [0,4194304] 0 2024-04-12T09:11:25.461 INFO:tasks.workunit.client.0.smithi117.stdout:2/789: sync 2024-04-12T09:11:25.461 INFO:tasks.workunit.client.0.smithi117.stdout:6/847: sync 2024-04-12T09:11:25.461 INFO:tasks.workunit.client.0.smithi117.stdout:1/857: sync 2024-04-12T09:11:25.461 INFO:tasks.workunit.client.0.smithi117.stdout:4/843: sync 2024-04-12T09:11:25.461 INFO:tasks.workunit.client.1.smithi203.stdout:0/298: creat d0/d1d/d2f/d17/f60 x:0 0 0 2024-04-12T09:11:25.463 INFO:tasks.workunit.client.0.smithi117.stdout:7/726: rename d0/d2/d45/f59 to d0/d2/d1a/d4f/d9a/fe3 0 2024-04-12T09:11:25.464 INFO:tasks.workunit.client.0.smithi117.stdout:4/844: write d0/d72/fd3 [346988,9945] 0 2024-04-12T09:11:25.464 INFO:tasks.workunit.client.0.smithi117.stdout:1/858: write d1/d64/d45/fdd [154025,88128] 0 2024-04-12T09:11:25.465 INFO:tasks.workunit.client.1.smithi203.stdout:0/299: truncate d0/f3 2959820 0 2024-04-12T09:11:25.466 INFO:tasks.workunit.client.0.smithi117.stdout:7/727: dread - d0/d2/d1a/d4f/dbc/fda zero size 2024-04-12T09:11:25.466 INFO:tasks.workunit.client.0.smithi117.stdout:7/728: dread - d0/da/fd9 zero size 2024-04-12T09:11:25.467 INFO:tasks.workunit.client.1.smithi203.stdout:2/285: dread d0/d14/f22 [4194304,4194304] 0 2024-04-12T09:11:25.468 INFO:tasks.workunit.client.0.smithi117.stdout:7/729: stat d0/da/d7c/dae 0 2024-04-12T09:11:25.468 INFO:tasks.workunit.client.1.smithi203.stdout:4/250: sync 2024-04-12T09:11:25.468 INFO:tasks.workunit.client.1.smithi203.stdout:8/244: sync 2024-04-12T09:11:25.469 INFO:tasks.workunit.client.0.smithi117.stdout:5/952: creat d2/d3/dd/d39/d83/dc8/dd1/f13c x:0 0 0 2024-04-12T09:11:25.469 INFO:tasks.workunit.client.0.smithi117.stdout:9/756: truncate d1/d8/d5a/dc2/f55 3177495 0 2024-04-12T09:11:25.470 INFO:tasks.workunit.client.0.smithi117.stdout:1/859: chown d1/dbd/d3f/db/d16/db6/da9/d9a/d71/fd2 3582 1 2024-04-12T09:11:25.473 INFO:tasks.workunit.client.0.smithi117.stdout:1/860: readlink d1/dbd/d3f/db/d16/l75 0 2024-04-12T09:11:25.474 INFO:tasks.workunit.client.1.smithi203.stdout:6/269: mknod d1/d3/d26/c56 0 2024-04-12T09:11:25.474 INFO:tasks.workunit.client.0.smithi117.stdout:4/845: dwrite d0/f37 [0,4194304] 0 2024-04-12T09:11:25.474 INFO:tasks.workunit.client.0.smithi117.stdout:6/848: creat d8/d2a/d60/d7d/f112 x:0 0 0 2024-04-12T09:11:25.480 INFO:tasks.workunit.client.1.smithi203.stdout:0/300: creat d0/dd/d40/f61 x:0 0 0 2024-04-12T09:11:25.480 INFO:tasks.workunit.client.0.smithi117.stdout:2/790: creat d0/d43/d30/f107 x:0 0 0 2024-04-12T09:11:25.480 INFO:tasks.workunit.client.0.smithi117.stdout:6/849: chown d8/d3a/d49/da4/d9f/fe0 107590507 1 2024-04-12T09:11:25.481 INFO:tasks.workunit.client.0.smithi117.stdout:2/791: chown d0/d4/f106 95 1 2024-04-12T09:11:25.481 INFO:tasks.workunit.client.1.smithi203.stdout:2/286: fdatasync d0/d14/d1e/f2b 0 2024-04-12T09:11:25.483 INFO:tasks.workunit.client.0.smithi117.stdout:7/730: rename d0/da/da8 to d0/d2/d45/d17/d23/dac/de4 0 2024-04-12T09:11:25.485 INFO:tasks.workunit.client.0.smithi117.stdout:9/757: rmdir d1/d8/df/d3e/d92/dce 39 2024-04-12T09:11:25.486 INFO:tasks.workunit.client.0.smithi117.stdout:9/758: chown d1/d8/d5e/fd3 7 1 2024-04-12T09:11:25.486 INFO:tasks.workunit.client.0.smithi117.stdout:9/759: chown d1/d8/d5a/d79/d91 221790 1 2024-04-12T09:11:25.487 INFO:tasks.workunit.client.1.smithi203.stdout:5/336: symlink d0/d6/d16/l7b 0 2024-04-12T09:11:25.488 INFO:tasks.workunit.client.1.smithi203.stdout:5/337: read - d0/d6/d16/d8/f62 zero size 2024-04-12T09:11:25.489 INFO:tasks.workunit.client.1.smithi203.stdout:3/252: link d2/f2b d2/d8/d14/d23/d36/f4b 0 2024-04-12T09:11:25.493 INFO:tasks.workunit.client.0.smithi117.stdout:2/792: mkdir d0/d43/d53/d61/d66/dd9/d108 0 2024-04-12T09:11:25.494 INFO:tasks.workunit.client.1.smithi203.stdout:8/245: symlink d4/d4a/l4c 0 2024-04-12T09:11:25.495 INFO:tasks.workunit.client.1.smithi203.stdout:8/246: write d4/d8/d37/f3e [5236854,14453] 0 2024-04-12T09:11:25.495 INFO:tasks.workunit.client.0.smithi117.stdout:7/731: creat d0/d2/d45/d17/d23/d50/d5c/fe5 x:0 0 0 2024-04-12T09:11:25.496 INFO:tasks.workunit.client.1.smithi203.stdout:6/270: mknod d1/df/d1b/d3b/d45/d55/c57 0 2024-04-12T09:11:25.497 INFO:tasks.workunit.client.1.smithi203.stdout:5/338: symlink d0/d6/l7c 0 2024-04-12T09:11:25.497 INFO:tasks.workunit.client.1.smithi203.stdout:6/271: dread - d1/df/d1b/d3e/f53 zero size 2024-04-12T09:11:25.499 INFO:tasks.workunit.client.1.smithi203.stdout:3/253: rename d2/d1f to d2/d8/d14/d23/d35/d4c 0 2024-04-12T09:11:25.500 INFO:tasks.workunit.client.0.smithi117.stdout:9/760: fsync d1/d8/d5a/d79/f96 0 2024-04-12T09:11:25.500 INFO:tasks.workunit.client.1.smithi203.stdout:0/301: truncate d0/f13 304490 0 2024-04-12T09:11:25.501 INFO:tasks.workunit.client.0.smithi117.stdout:4/846: truncate d0/d5/d39/f77 3849963 0 2024-04-12T09:11:25.502 INFO:tasks.workunit.client.0.smithi117.stdout:2/793: truncate d0/d4/d10/d27/f6b 520054 0 2024-04-12T09:11:25.504 INFO:tasks.workunit.client.0.smithi117.stdout:7/732: mknod d0/da/d7c/dae/ce6 0 2024-04-12T09:11:25.504 INFO:tasks.workunit.client.0.smithi117.stdout:1/861: rmdir d1/dbd/d3f/db/d16/db6/dc6 0 2024-04-12T09:11:25.505 INFO:tasks.workunit.client.1.smithi203.stdout:5/339: dwrite d0/d6/d11/d18/f3b [4194304,4194304] 0 2024-04-12T09:11:25.507 INFO:tasks.workunit.client.0.smithi117.stdout:9/761: dread - d1/d8/d5a/d79/d91/fc3 zero size 2024-04-12T09:11:25.508 INFO:tasks.workunit.client.0.smithi117.stdout:5/953: dread d2/f43 [0,4194304] 0 2024-04-12T09:11:25.508 INFO:tasks.workunit.client.1.smithi203.stdout:6/272: creat d1/d3/d4/f58 x:0 0 0 2024-04-12T09:11:25.512 INFO:tasks.workunit.client.0.smithi117.stdout:7/733: rmdir d0/d2/d45/d17/d23/dac/dad 39 2024-04-12T09:11:25.512 INFO:tasks.workunit.client.1.smithi203.stdout:8/247: dwrite d4/d8/d19/f3a [0,4194304] 0 2024-04-12T09:11:25.513 INFO:tasks.workunit.client.1.smithi203.stdout:0/302: dwrite d0/d1d/d2f/d17/f47 [0,4194304] 0 2024-04-12T09:11:25.516 INFO:tasks.workunit.client.1.smithi203.stdout:5/340: readlink d0/d6/d11/l60 0 2024-04-12T09:11:25.518 INFO:tasks.workunit.client.0.smithi117.stdout:1/862: mkdir d1/dbd/d3f/db/d16/db6/da9/d9a/d71/d10b 0 2024-04-12T09:11:25.519 INFO:tasks.workunit.client.1.smithi203.stdout:5/341: truncate d0/d6/d11/d18/f40 4999036 0 2024-04-12T09:11:25.519 INFO:tasks.workunit.client.0.smithi117.stdout:5/954: dwrite d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1/d11f/d6b/dcc/f121 [0,4194304] 0 2024-04-12T09:11:25.520 INFO:tasks.workunit.client.1.smithi203.stdout:4/251: dread d1a/d21/d22/f25 [0,4194304] 0 2024-04-12T09:11:25.526 INFO:tasks.workunit.client.1.smithi203.stdout:4/252: dread ff [0,4194304] 0 2024-04-12T09:11:25.531 INFO:tasks.workunit.client.1.smithi203.stdout:6/273: symlink d1/d3/d26/d36/l59 0 2024-04-12T09:11:25.531 INFO:tasks.workunit.client.1.smithi203.stdout:8/248: mknod d4/d8/c4d 0 2024-04-12T09:11:25.534 INFO:tasks.workunit.client.0.smithi117.stdout:1/863: creat d1/dc3/f10c x:0 0 0 2024-04-12T09:11:25.538 INFO:tasks.workunit.client.1.smithi203.stdout:4/253: mknod d1a/d34/c50 0 2024-04-12T09:11:25.539 INFO:tasks.workunit.client.0.smithi117.stdout:6/850: write d8/d2a/d60/d106/fa0 [4387138,44608] 0 2024-04-12T09:11:25.540 INFO:tasks.workunit.client.1.smithi203.stdout:6/274: dread d1/d3/d4/f1d [0,4194304] 0 2024-04-12T09:11:25.540 INFO:tasks.workunit.client.1.smithi203.stdout:6/275: readlink d1/d3/l14 0 2024-04-12T09:11:25.541 INFO:tasks.workunit.client.1.smithi203.stdout:2/287: write d0/d2e/f34 [1899587,38637] 0 2024-04-12T09:11:25.542 INFO:tasks.workunit.client.0.smithi117.stdout:4/847: link d0/d5/d25/l3a d0/d5/d25/dfd/d107/da7/dcd/dcf/l111 0 2024-04-12T09:11:25.543 INFO:tasks.workunit.client.1.smithi203.stdout:4/254: dread d1a/d21/d22/f25 [0,4194304] 0 2024-04-12T09:11:25.544 INFO:tasks.workunit.client.0.smithi117.stdout:4/848: chown d0/d5/d3b/d38/d4f/d79/d9c/c100 2 1 2024-04-12T09:11:25.544 INFO:tasks.workunit.client.0.smithi117.stdout:7/734: mknod d0/d2/d45/d17/ce7 0 2024-04-12T09:11:25.552 INFO:tasks.workunit.client.0.smithi117.stdout:2/794: dread d0/d43/d4b/dae/fb4 [0,4194304] 0 2024-04-12T09:11:25.557 INFO:tasks.workunit.client.1.smithi203.stdout:2/288: dwrite d0/d14/f22 [0,4194304] 0 2024-04-12T09:11:25.560 INFO:tasks.workunit.client.1.smithi203.stdout:5/342: rename d0/d6/d16/d9/d14/l3a to d0/d6/d11/d18/d1a/l7d 0 2024-04-12T09:11:25.561 INFO:tasks.workunit.client.0.smithi117.stdout:1/864: mknod d1/dbd/d3f/c10d 0 2024-04-12T09:11:25.562 INFO:tasks.workunit.client.1.smithi203.stdout:5/343: read d0/d6/fe [7030193,7982] 0 2024-04-12T09:11:25.565 INFO:tasks.workunit.client.0.smithi117.stdout:7/735: truncate d0/d2/d45/d17/d23/fb0 585724 0 2024-04-12T09:11:25.568 INFO:tasks.workunit.client.1.smithi203.stdout:4/255: link d1a/d21/d22/f39 d1a/d1d/d23/d2c/f51 0 2024-04-12T09:11:25.570 INFO:tasks.workunit.client.0.smithi117.stdout:2/795: mkdir d0/d43/d53/d61/d8d/d109 0 2024-04-12T09:11:25.570 INFO:tasks.workunit.client.0.smithi117.stdout:2/796: chown d0/f98 304497 1 2024-04-12T09:11:25.572 INFO:tasks.workunit.client.0.smithi117.stdout:9/762: link d1/d8/df/d7d/d7e/ca6 d1/d8/df/d3e/de3/cf5 0 2024-04-12T09:11:25.575 INFO:tasks.workunit.client.1.smithi203.stdout:5/344: symlink d0/d6/d11/d18/d2a/l7e 0 2024-04-12T09:11:25.576 INFO:tasks.workunit.client.0.smithi117.stdout:6/851: truncate d8/fc 635462 0 2024-04-12T09:11:25.576 INFO:tasks.workunit.client.0.smithi117.stdout:6/852: readlink d8/d3a/d49/da4/d9f/lcc 0 2024-04-12T09:11:25.578 INFO:tasks.workunit.client.1.smithi203.stdout:3/254: creat d2/d8/d14/d23/d35/d4c/d2e/f4d x:0 0 0 2024-04-12T09:11:25.578 INFO:tasks.workunit.client.0.smithi117.stdout:4/849: getdents d0/d5/d39/d4e/d6b/d83/db1 0 2024-04-12T09:11:25.581 INFO:tasks.workunit.client.0.smithi117.stdout:1/865: truncate d1/d64/f93 63751 0 2024-04-12T09:11:25.583 INFO:tasks.workunit.client.1.smithi203.stdout:2/289: rename d0/c3c to d0/d38/d43/c65 0 2024-04-12T09:11:25.585 INFO:tasks.workunit.client.0.smithi117.stdout:5/955: rename d2/d3/de/d1e/d46/f88 to d2/f13d 0 2024-04-12T09:11:25.585 INFO:tasks.workunit.client.1.smithi203.stdout:8/249: chown d4/d8/l18 30610 1 2024-04-12T09:11:25.587 INFO:tasks.workunit.client.1.smithi203.stdout:5/345: mknod d0/d6/d16/d8/c7f 0 2024-04-12T09:11:25.587 INFO:tasks.workunit.client.1.smithi203.stdout:5/346: chown d0/d6/d11 3 1 2024-04-12T09:11:25.588 INFO:tasks.workunit.client.0.smithi117.stdout:6/853: creat d8/d2a/d60/d7d/d8c/f113 x:0 0 0 2024-04-12T09:11:25.589 INFO:tasks.workunit.client.1.smithi203.stdout:6/276: link d1/d3/f39 d1/df/d1b/d3b/f5a 0 2024-04-12T09:11:25.590 INFO:tasks.workunit.client.1.smithi203.stdout:4/256: creat d1a/d21/d22/d4e/f52 x:0 0 0 2024-04-12T09:11:25.590 INFO:tasks.workunit.client.0.smithi117.stdout:4/850: read d0/d1/d34/f57 [3014879,86845] 0 2024-04-12T09:11:25.592 INFO:tasks.workunit.client.0.smithi117.stdout:7/736: mkdir d0/d2/d45/d17/d23/dac/dad/de8 0 2024-04-12T09:11:25.593 INFO:tasks.workunit.client.0.smithi117.stdout:7/737: dread - d0/d2/d1a/d49/f62 zero size 2024-04-12T09:11:25.595 INFO:tasks.workunit.client.1.smithi203.stdout:3/255: symlink d2/d8/d14/d45/l4e 0 2024-04-12T09:11:25.596 INFO:tasks.workunit.client.1.smithi203.stdout:4/257: dwrite d1a/d20/f2a [0,4194304] 0 2024-04-12T09:11:25.596 INFO:tasks.workunit.client.0.smithi117.stdout:2/797: mkdir d0/d43/d30/d41/dfa/d10a 0 2024-04-12T09:11:25.597 INFO:tasks.workunit.client.0.smithi117.stdout:9/763: mknod d1/d8/df/d3e/cf6 0 2024-04-12T09:11:25.598 INFO:tasks.workunit.client.1.smithi203.stdout:7/259: sync 2024-04-12T09:11:25.600 INFO:tasks.workunit.client.0.smithi117.stdout:6/854: read d8/d2a/f92 [363339,16634] 0 2024-04-12T09:11:25.601 INFO:tasks.workunit.client.0.smithi117.stdout:4/851: dread - d0/d5/d25/fc2 zero size 2024-04-12T09:11:25.601 INFO:tasks.workunit.client.0.smithi117.stdout:6/855: stat d8/d2a/d60/d7d/d8c/d107 0 2024-04-12T09:11:25.602 INFO:tasks.workunit.client.0.smithi117.stdout:4/852: write d0/d2c/f7b [4119736,31427] 0 2024-04-12T09:11:25.603 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:25 smithi117 ceph-mon[29277]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:11:25.606 INFO:tasks.workunit.client.1.smithi203.stdout:7/260: dwrite d0/d15/d2d/f4b [0,4194304] 0 2024-04-12T09:11:25.609 INFO:tasks.workunit.client.1.smithi203.stdout:4/258: symlink d1a/d2b/l53 0 2024-04-12T09:11:25.609 INFO:tasks.workunit.client.1.smithi203.stdout:4/259: readlink l8 0 2024-04-12T09:11:25.610 INFO:tasks.workunit.client.0.smithi117.stdout:5/956: getdents d2/d3/dd/d39/d82/d11c 0 2024-04-12T09:11:25.610 INFO:tasks.workunit.client.0.smithi117.stdout:4/853: dwrite d0/d5/d25/dfd/d107/da7/dcd/de6/f104 [0,4194304] 0 2024-04-12T09:11:25.612 INFO:tasks.workunit.client.1.smithi203.stdout:5/347: mkdir d0/d6/d16/d9/d80 0 2024-04-12T09:11:25.613 INFO:tasks.workunit.client.0.smithi117.stdout:5/957: truncate d2/d3/dd/d39/d83/dc8/f128 1632011 0 2024-04-12T09:11:25.615 INFO:tasks.workunit.client.0.smithi117.stdout:2/798: unlink d0/d43/d4b/ld2 0 2024-04-12T09:11:25.616 INFO:tasks.workunit.client.0.smithi117.stdout:4/854: dread d0/f37 [0,4194304] 0 2024-04-12T09:11:25.616 INFO:tasks.workunit.client.0.smithi117.stdout:2/799: stat d0/d43/d30/f47 0 2024-04-12T09:11:25.619 INFO:tasks.workunit.client.1.smithi203.stdout:6/277: mkdir d1/d3/d5b 0 2024-04-12T09:11:25.620 INFO:tasks.workunit.client.0.smithi117.stdout:9/764: stat d1/d8/df/c77 0 2024-04-12T09:11:25.625 INFO:tasks.workunit.client.1.smithi203.stdout:8/250: rename d4/le to d4/d8/d1c/l4e 0 2024-04-12T09:11:25.627 INFO:tasks.workunit.client.1.smithi203.stdout:9/250: sync 2024-04-12T09:11:25.627 INFO:tasks.workunit.client.1.smithi203.stdout:1/316: sync 2024-04-12T09:11:25.627 INFO:tasks.workunit.client.1.smithi203.stdout:7/261: mkdir d0/d15/d2d/d5e 0 2024-04-12T09:11:25.628 INFO:tasks.workunit.client.1.smithi203.stdout:1/317: read - df/d20/d2b/f42 zero size 2024-04-12T09:11:25.629 INFO:tasks.workunit.client.0.smithi117.stdout:6/856: chown d8/d3a/l44 3 1 2024-04-12T09:11:25.629 INFO:tasks.workunit.client.1.smithi203.stdout:7/262: read d0/f7 [2809609,32571] 0 2024-04-12T09:11:25.630 INFO:tasks.workunit.client.1.smithi203.stdout:5/348: creat d0/d6/d16/d9/d14/d2d/f81 x:0 0 0 2024-04-12T09:11:25.633 INFO:tasks.workunit.client.0.smithi117.stdout:7/738: creat d0/d2/d45/d17/d23/dac/dad/d91/dca/fe9 x:0 0 0 2024-04-12T09:11:25.634 INFO:tasks.workunit.client.0.smithi117.stdout:1/866: dwrite d1/dbd/d3f/f61 [4194304,4194304] 0 2024-04-12T09:11:25.636 INFO:tasks.workunit.client.1.smithi203.stdout:3/256: rmdir d2/d8/d14 39 2024-04-12T09:11:25.636 INFO:tasks.workunit.client.1.smithi203.stdout:6/278: write d1/d3/f34 [370917,7961] 0 2024-04-12T09:11:25.639 INFO:tasks.workunit.client.1.smithi203.stdout:9/251: symlink d8/d12/d23/d41/l62 0 2024-04-12T09:11:25.640 INFO:tasks.workunit.client.0.smithi117.stdout:5/958: chown d2/d3/dd/d39/d83/c7c 8273425 1 2024-04-12T09:11:25.641 INFO:tasks.workunit.client.0.smithi117.stdout:5/959: readlink d2/d3/de/d1e/d66/l85 0 2024-04-12T09:11:25.643 INFO:tasks.workunit.client.0.smithi117.stdout:4/855: symlink d0/d1/d34/l112 0 2024-04-12T09:11:25.644 INFO:tasks.workunit.client.0.smithi117.stdout:2/800: dread d0/d43/d30/f88 [0,4194304] 0 2024-04-12T09:11:25.647 INFO:tasks.workunit.client.0.smithi117.stdout:9/765: unlink d1/d8/df/d68/ddf/daf/d3b/d97/cca 0 2024-04-12T09:11:25.658 INFO:tasks.workunit.client.0.smithi117.stdout:5/960: read d2/d3/f12e [2983405,121921] 0 2024-04-12T09:11:25.661 INFO:tasks.workunit.client.0.smithi117.stdout:9/766: rmdir d1/d8/d5a/d79/d91/db0/d8a 39 2024-04-12T09:11:25.663 INFO:tasks.workunit.client.0.smithi117.stdout:6/857: dwrite d8/f1a [0,4194304] 0 2024-04-12T09:11:25.665 INFO:tasks.workunit.client.0.smithi117.stdout:4/856: mkdir d0/d5/d3b/d38/d10f/d113 0 2024-04-12T09:11:25.668 INFO:tasks.workunit.client.0.smithi117.stdout:2/801: symlink d0/d43/d4b/l10b 0 2024-04-12T09:11:25.669 INFO:tasks.workunit.client.0.smithi117.stdout:7/739: truncate d0/d2/d45/d17/f29 76591 0 2024-04-12T09:11:25.672 INFO:tasks.workunit.client.0.smithi117.stdout:1/867: rename d1/dbd/d3f/d72/df8 to d1/dbd/d3f/db/d1d/d10e 0 2024-04-12T09:11:25.674 INFO:tasks.workunit.client.0.smithi117.stdout:5/961: symlink d2/d3/de/l13e 0 2024-04-12T09:11:25.677 INFO:tasks.workunit.client.0.smithi117.stdout:2/802: dwrite d0/d43/d30/d41/f72 [0,4194304] 0 2024-04-12T09:11:25.681 INFO:tasks.workunit.client.1.smithi203.stdout:2/290: truncate d0/d38/d43/f44 514009 0 2024-04-12T09:11:25.682 INFO:tasks.workunit.client.1.smithi203.stdout:6/279: symlink d1/d3/d12/l5c 0 2024-04-12T09:11:25.683 INFO:tasks.workunit.client.1.smithi203.stdout:6/280: chown d1/df/f18 1566 1 2024-04-12T09:11:25.684 INFO:tasks.workunit.client.1.smithi203.stdout:3/257: dread d2/f18 [0,4194304] 0 2024-04-12T09:11:25.684 INFO:tasks.workunit.client.1.smithi203.stdout:7/263: symlink d0/d38/d51/l5f 0 2024-04-12T09:11:25.687 INFO:tasks.workunit.client.0.smithi117.stdout:9/767: rmdir d1/d8/d5a/d79/db8 0 2024-04-12T09:11:25.688 INFO:tasks.workunit.client.0.smithi117.stdout:1/868: dwrite d1/dbd/d3f/d72/ff5 [0,4194304] 0 2024-04-12T09:11:25.690 INFO:tasks.workunit.client.0.smithi117.stdout:4/857: dwrite d0/d5/d39/f23 [8388608,4194304] 0 2024-04-12T09:11:25.691 INFO:tasks.workunit.client.0.smithi117.stdout:9/768: chown d1/d8/d5a/d79/d91/fb4 31453 1 2024-04-12T09:11:25.693 INFO:tasks.workunit.client.1.smithi203.stdout:5/349: creat d0/d6/d11/d4a/f82 x:0 0 0 2024-04-12T09:11:25.694 INFO:tasks.workunit.client.1.smithi203.stdout:5/350: chown d0/d6/d11/d1e/d4c/l37 3894210 1 2024-04-12T09:11:25.695 INFO:tasks.workunit.client.0.smithi117.stdout:5/962: read d2/d3/dd/d39/d83/fc4 [2249288,6940] 0 2024-04-12T09:11:25.697 INFO:tasks.workunit.client.0.smithi117.stdout:7/740: symlink d0/d2/d45/d17/d23/d39/d6c/lea 0 2024-04-12T09:11:25.698 INFO:tasks.workunit.client.1.smithi203.stdout:2/291: write d0/f32 [1055058,60074] 0 2024-04-12T09:11:25.702 INFO:tasks.workunit.client.1.smithi203.stdout:4/260: rename d1a/d21/d22/d2e/l42 to d1a/l54 0 2024-04-12T09:11:25.702 INFO:tasks.workunit.client.1.smithi203.stdout:4/261: readlink d1a/d20/l4c 0 2024-04-12T09:11:25.703 INFO:tasks.workunit.client.0.smithi117.stdout:1/869: dwrite d1/dbd/d3f/db/d1d/d78/dbc/f102 [0,4194304] 0 2024-04-12T09:11:25.703 INFO:tasks.workunit.client.1.smithi203.stdout:6/281: write d1/df/d1b/d3b/d45/f49 [156989,97802] 0 2024-04-12T09:11:25.704 INFO:tasks.workunit.client.1.smithi203.stdout:6/282: fdatasync d1/df/d1b/d3e/f53 0 2024-04-12T09:11:25.705 INFO:tasks.workunit.client.1.smithi203.stdout:7/264: creat d0/d4/f60 x:0 0 0 2024-04-12T09:11:25.706 INFO:tasks.workunit.client.1.smithi203.stdout:1/318: creat df/f5b x:0 0 0 2024-04-12T09:11:25.707 INFO:tasks.workunit.client.0.smithi117.stdout:6/858: getdents d8/d9/d17/d2d 0 2024-04-12T09:11:25.708 INFO:tasks.workunit.client.1.smithi203.stdout:5/351: mkdir d0/d6/d16/d9/d30/d83 0 2024-04-12T09:11:25.708 INFO:tasks.workunit.client.0.smithi117.stdout:7/741: fsync d0/da/d7c/dae/faf 0 2024-04-12T09:11:25.710 INFO:tasks.workunit.client.0.smithi117.stdout:1/870: creat d1/dbd/d3f/db/f10f x:0 0 0 2024-04-12T09:11:25.712 INFO:tasks.workunit.client.0.smithi117.stdout:9/769: creat d1/d8/d5a/d79/d91/db0/d8a/ff7 x:0 0 0 2024-04-12T09:11:25.712 INFO:tasks.workunit.client.1.smithi203.stdout:2/292: write d0/d14/d23/f50 [925493,112187] 0 2024-04-12T09:11:25.714 INFO:tasks.workunit.client.1.smithi203.stdout:9/252: rename d8/ff to d8/d12/d3e/f63 0 2024-04-12T09:11:25.717 INFO:tasks.workunit.client.1.smithi203.stdout:3/258: creat d2/d8/d14/f4f x:0 0 0 2024-04-12T09:11:25.718 INFO:tasks.workunit.client.1.smithi203.stdout:6/283: unlink d1/df/l47 0 2024-04-12T09:11:25.720 INFO:tasks.workunit.client.1.smithi203.stdout:7/265: mkdir d0/d4/d1c/d61 0 2024-04-12T09:11:25.724 INFO:tasks.workunit.client.0.smithi117.stdout:9/770: rename d1/d8/df/d68/ddf/daf/l45 to d1/d8/df/d68/ddf/daf/lf8 0 2024-04-12T09:11:25.725 INFO:tasks.workunit.client.1.smithi203.stdout:2/293: symlink d0/d14/d23/d3d/l66 0 2024-04-12T09:11:25.725 INFO:tasks.workunit.client.1.smithi203.stdout:0/303: sync 2024-04-12T09:11:25.726 INFO:tasks.workunit.client.1.smithi203.stdout:0/304: chown d0/dd/d40 95259048 1 2024-04-12T09:11:25.726 INFO:tasks.workunit.client.0.smithi117.stdout:5/963: dread d2/f3d [0,4194304] 0 2024-04-12T09:11:25.728 INFO:tasks.workunit.client.1.smithi203.stdout:5/352: rename d0/d6/d16/d9/d14/d2d/f81 to d0/d6/d11/d38/f84 0 2024-04-12T09:11:25.729 INFO:tasks.workunit.client.1.smithi203.stdout:0/305: read d0/f2c [456722,84326] 0 2024-04-12T09:11:25.730 INFO:tasks.workunit.client.1.smithi203.stdout:5/353: truncate d0/d6/d11/f69 1359425 0 2024-04-12T09:11:25.732 INFO:tasks.workunit.client.0.smithi117.stdout:9/771: mkdir d1/d8/df/d68/df9 0 2024-04-12T09:11:25.734 INFO:tasks.workunit.client.1.smithi203.stdout:9/253: dwrite d8/d12/d3e/f63 [4194304,4194304] 0 2024-04-12T09:11:25.735 INFO:tasks.workunit.client.1.smithi203.stdout:6/284: mkdir d1/d3/d26/d5d 0 2024-04-12T09:11:25.735 INFO:tasks.workunit.client.0.smithi117.stdout:4/858: write d0/d5/d3b/d38/ff1 [852497,99066] 0 2024-04-12T09:11:25.735 INFO:tasks.workunit.client.1.smithi203.stdout:4/262: dread fc [0,4194304] 0 2024-04-12T09:11:25.738 INFO:tasks.workunit.client.1.smithi203.stdout:6/285: truncate d1/d3/d26/d30/f3d 1359236 0 2024-04-12T09:11:25.739 INFO:tasks.workunit.client.0.smithi117.stdout:2/803: dwrite d0/d43/d53/d61/d66/fa2 [0,4194304] 0 2024-04-12T09:11:25.739 INFO:tasks.workunit.client.1.smithi203.stdout:1/319: dread df/f2a [0,4194304] 0 2024-04-12T09:11:25.739 INFO:tasks.workunit.client.1.smithi203.stdout:1/320: readlink lc 0 2024-04-12T09:11:25.740 INFO:tasks.workunit.client.0.smithi117.stdout:6/859: getdents d8/d9/d17/d2d/d10e 0 2024-04-12T09:11:25.750 INFO:tasks.workunit.client.0.smithi117.stdout:4/859: creat d0/d5/d39/d4e/d51/f114 x:0 0 0 2024-04-12T09:11:25.750 INFO:tasks.workunit.client.1.smithi203.stdout:8/251: sync 2024-04-12T09:11:25.751 INFO:tasks.workunit.client.1.smithi203.stdout:0/306: creat d0/dd/d40/f62 x:0 0 0 2024-04-12T09:11:25.751 INFO:tasks.workunit.client.1.smithi203.stdout:0/307: chown d0/d1d/d2f/d34 2412259 1 2024-04-12T09:11:25.753 INFO:tasks.workunit.client.0.smithi117.stdout:7/742: write d0/d2/d45/d17/d23/d51/fb2 [20347,126030] 0 2024-04-12T09:11:25.754 INFO:tasks.workunit.client.0.smithi117.stdout:7/743: stat d0/da/lcd 0 2024-04-12T09:11:25.755 INFO:tasks.workunit.client.0.smithi117.stdout:7/744: fdatasync d0/d2/d45/d17/d23/d39/f48 0 2024-04-12T09:11:25.755 INFO:tasks.workunit.client.1.smithi203.stdout:3/259: mknod d2/d8/d14/d1b/c50 0 2024-04-12T09:11:25.756 INFO:tasks.workunit.client.1.smithi203.stdout:3/260: dread - d2/d8/d14/f4f zero size 2024-04-12T09:11:25.758 INFO:tasks.workunit.client.0.smithi117.stdout:5/964: creat d2/d3/de/d1e/f13f x:0 0 0 2024-04-12T09:11:25.760 INFO:tasks.workunit.client.0.smithi117.stdout:1/871: dwrite d1/d64/d45/d4c/fe1 [0,4194304] 0 2024-04-12T09:11:25.761 INFO:tasks.workunit.client.1.smithi203.stdout:7/266: mknod d0/d4/d53/c62 0 2024-04-12T09:11:25.763 INFO:tasks.workunit.client.1.smithi203.stdout:4/263: creat d1a/d1d/f55 x:0 0 0 2024-04-12T09:11:25.764 INFO:tasks.workunit.client.0.smithi117.stdout:9/772: write d1/d8/d12/f59 [763127,66357] 0 2024-04-12T09:11:25.765 INFO:tasks.workunit.client.0.smithi117.stdout:6/860: creat d8/d3a/d49/da4/d8a/de2/df3/f114 x:0 0 0 2024-04-12T09:11:25.767 INFO:tasks.workunit.client.1.smithi203.stdout:9/254: rename d8/d12/d23/d41/l62 to d8/d12/d23/d41/l64 0 2024-04-12T09:11:25.771 INFO:tasks.workunit.client.1.smithi203.stdout:9/255: dread d8/f28 [0,4194304] 0 2024-04-12T09:11:25.771 INFO:tasks.workunit.client.0.smithi117.stdout:9/773: dwrite d1/d8/d5a/d79/d91/db0/f3c [0,4194304] 0 2024-04-12T09:11:25.772 INFO:tasks.workunit.client.0.smithi117.stdout:6/861: dread d8/d2a/d60/d89/fda [0,4194304] 0 2024-04-12T09:11:25.774 INFO:tasks.workunit.client.1.smithi203.stdout:2/294: mkdir d0/d67 0 2024-04-12T09:11:25.776 INFO:tasks.workunit.client.0.smithi117.stdout:4/860: mkdir d0/d5/d39/d115 0 2024-04-12T09:11:25.778 INFO:tasks.workunit.client.1.smithi203.stdout:8/252: creat d4/d4a/f4f x:0 0 0 2024-04-12T09:11:25.778 INFO:tasks.workunit.client.0.smithi117.stdout:1/872: creat d1/dc3/f110 x:0 0 0 2024-04-12T09:11:25.778 INFO:tasks.workunit.client.1.smithi203.stdout:8/253: readlink d4/l46 0 2024-04-12T09:11:25.779 INFO:tasks.workunit.client.1.smithi203.stdout:0/308: symlink d0/dd/d40/l63 0 2024-04-12T09:11:25.779 INFO:tasks.workunit.client.1.smithi203.stdout:8/254: read d4/f6 [390029,80409] 0 2024-04-12T09:11:25.780 INFO:tasks.workunit.client.1.smithi203.stdout:0/309: read d0/f3 [229950,48481] 0 2024-04-12T09:11:25.781 INFO:tasks.workunit.client.1.smithi203.stdout:8/255: write d4/d4a/f4f [385170,112206] 0 2024-04-12T09:11:25.783 INFO:tasks.workunit.client.1.smithi203.stdout:7/267: fsync d0/f26 0 2024-04-12T09:11:25.785 INFO:tasks.workunit.client.0.smithi117.stdout:7/745: rename d0/d2/d12/l84 to d0/d20/d4a/dce/dcf/leb 0 2024-04-12T09:11:25.785 INFO:tasks.workunit.client.0.smithi117.stdout:1/873: dwrite d1/d64/d45/f50 [0,4194304] 0 2024-04-12T09:11:25.786 INFO:tasks.workunit.client.0.smithi117.stdout:1/874: readlink d1/dbd/d3f/db/l26 0 2024-04-12T09:11:25.787 INFO:tasks.workunit.client.1.smithi203.stdout:0/310: dwrite d0/d1d/d2f/d17/f47 [0,4194304] 0 2024-04-12T09:11:25.788 INFO:tasks.workunit.client.0.smithi117.stdout:1/875: readlink d1/dbd/d3f/db/d16/db6/da9/d9a/lf7 0 2024-04-12T09:11:25.789 INFO:tasks.workunit.client.1.smithi203.stdout:0/311: chown d0/d1d/d2f/d34/f52 266809345 1 2024-04-12T09:11:25.789 INFO:tasks.workunit.client.0.smithi117.stdout:6/862: fdatasync d8/d2a/d60/d7d/d8c/db8/fd1 0 2024-04-12T09:11:25.791 INFO:tasks.workunit.client.1.smithi203.stdout:0/312: truncate d0/dd/f16 4717651 0 2024-04-12T09:11:25.793 INFO:tasks.workunit.client.1.smithi203.stdout:0/313: write d0/d1d/d2f/d17/fa [1226688,76897] 0 2024-04-12T09:11:25.798 INFO:tasks.workunit.client.1.smithi203.stdout:0/314: stat d0/f36 0 2024-04-12T09:11:25.798 INFO:tasks.workunit.client.1.smithi203.stdout:0/315: dread - d0/d1d/d2f/d34/f52 zero size 2024-04-12T09:11:25.800 INFO:tasks.workunit.client.0.smithi117.stdout:2/804: link d0/d4/d10/d27/c3e d0/d43/d30/dc6/c10c 0 2024-04-12T09:11:25.805 INFO:tasks.workunit.client.0.smithi117.stdout:9/774: dread d1/d24/f8b [0,4194304] 0 2024-04-12T09:11:25.805 INFO:tasks.workunit.client.1.smithi203.stdout:5/354: creat d0/d6/d16/d9/d14/f85 x:0 0 0 2024-04-12T09:11:25.806 INFO:tasks.workunit.client.1.smithi203.stdout:5/355: write d0/f4 [503923,95531] 0 2024-04-12T09:11:25.812 INFO:tasks.workunit.client.1.smithi203.stdout:3/261: mkdir d2/d51 0 2024-04-12T09:11:25.812 INFO:tasks.workunit.client.0.smithi117.stdout:9/775: dwrite d1/d8/d12/f59 [0,4194304] 0 2024-04-12T09:11:25.812 INFO:tasks.workunit.client.0.smithi117.stdout:4/861: dread d0/d5/d3b/d38/d4f/f76 [0,4194304] 0 2024-04-12T09:11:25.813 INFO:tasks.workunit.client.0.smithi117.stdout:9/776: stat d1/d8/d5a/c82 0 2024-04-12T09:11:25.819 INFO:tasks.workunit.client.0.smithi117.stdout:6/863: dread - d8/d2a/d60/fb4 zero size 2024-04-12T09:11:25.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:25 smithi203 ceph-mon[36428]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:11:25.824 INFO:tasks.workunit.client.1.smithi203.stdout:4/264: unlink l15 0 2024-04-12T09:11:25.827 INFO:tasks.workunit.client.0.smithi117.stdout:2/805: mkdir d0/d4/d81/d10d 0 2024-04-12T09:11:25.834 INFO:tasks.workunit.client.0.smithi117.stdout:9/777: creat d1/d8/d5a/d79/d91/ffa x:0 0 0 2024-04-12T09:11:25.834 INFO:tasks.workunit.client.0.smithi117.stdout:9/778: fdatasync d1/d8/df/ff1 0 2024-04-12T09:11:25.835 INFO:tasks.workunit.client.1.smithi203.stdout:9/256: chown d8/d12/d23/d41/l64 24202 1 2024-04-12T09:11:25.835 INFO:tasks.workunit.client.1.smithi203.stdout:9/257: dread - d8/d12/d23/d29/f43 zero size 2024-04-12T09:11:25.837 INFO:tasks.workunit.client.1.smithi203.stdout:9/258: truncate d8/fa 4550149 0 2024-04-12T09:11:25.839 INFO:tasks.workunit.client.0.smithi117.stdout:5/965: getdents d2/d3/de/d1e/d66 0 2024-04-12T09:11:25.840 INFO:tasks.workunit.client.0.smithi117.stdout:7/746: dread d0/da/f2d [0,4194304] 0 2024-04-12T09:11:25.841 INFO:tasks.workunit.client.1.smithi203.stdout:7/268: dwrite d0/d4/d5d/f5c [4194304,4194304] 0 2024-04-12T09:11:25.843 INFO:tasks.workunit.client.1.smithi203.stdout:7/269: write d0/d4/f60 [335659,75855] 0 2024-04-12T09:11:25.848 INFO:tasks.workunit.client.0.smithi117.stdout:1/876: dwrite d1/dbd/d3f/db/d1d/d78/dbc/f107 [0,4194304] 0 2024-04-12T09:11:25.849 INFO:tasks.workunit.client.1.smithi203.stdout:4/265: symlink d1a/d21/d22/d2e/l56 0 2024-04-12T09:11:25.854 INFO:tasks.workunit.client.0.smithi117.stdout:5/966: dwrite d2/d3/de/da8/f115 [0,4194304] 0 2024-04-12T09:11:25.856 INFO:tasks.workunit.client.1.smithi203.stdout:6/286: link d1/d3/f39 d1/d3/d12/f5e 0 2024-04-12T09:11:25.858 INFO:tasks.workunit.client.1.smithi203.stdout:5/356: dread d0/d6/d16/d9/f2e [0,4194304] 0 2024-04-12T09:11:25.859 INFO:tasks.workunit.client.0.smithi117.stdout:6/864: creat d8/d2a/d60/f115 x:0 0 0 2024-04-12T09:11:25.859 INFO:tasks.workunit.client.0.smithi117.stdout:4/862: write d0/d5/d3b/d38/d4f/f10c [147257,2816] 0 2024-04-12T09:11:25.859 INFO:tasks.workunit.client.1.smithi203.stdout:5/357: fsync d0/d6/d16/d9/d14/f85 0 2024-04-12T09:11:25.861 INFO:tasks.workunit.client.0.smithi117.stdout:1/877: dwrite d1/dbd/d3f/db/f73 [0,4194304] 0 2024-04-12T09:11:25.861 INFO:tasks.workunit.client.0.smithi117.stdout:9/779: symlink d1/d8/df/d3e/d92/lfb 0 2024-04-12T09:11:25.862 INFO:tasks.workunit.client.0.smithi117.stdout:6/865: chown d8/d2a/d60/d89/d99/df5 5053635 1 2024-04-12T09:11:25.866 INFO:tasks.workunit.client.0.smithi117.stdout:2/806: dwrite d0/d4/f9d [0,4194304] 0 2024-04-12T09:11:25.867 INFO:tasks.workunit.client.0.smithi117.stdout:6/866: fdatasync d8/d3a/d49/da4/d8a/de2/df3/f114 0 2024-04-12T09:11:25.872 INFO:tasks.workunit.client.1.smithi203.stdout:8/256: link d4/d4a/f4f d4/d8/f50 0 2024-04-12T09:11:25.873 INFO:tasks.workunit.client.1.smithi203.stdout:4/266: creat d1a/d21/d22/f57 x:0 0 0 2024-04-12T09:11:25.876 INFO:tasks.workunit.client.0.smithi117.stdout:4/863: unlink d0/d5/d3b/d38/d4f/d79/d9c/cbc 0 2024-04-12T09:11:25.878 INFO:tasks.workunit.client.0.smithi117.stdout:6/867: symlink d8/d3f/l116 0 2024-04-12T09:11:25.879 INFO:tasks.workunit.client.1.smithi203.stdout:1/321: link df/d2d/c2f df/d2d/c5c 0 2024-04-12T09:11:25.881 INFO:tasks.workunit.client.0.smithi117.stdout:6/868: truncate d8/d2a/d60/d7d/d8c/deb/fed 765757 0 2024-04-12T09:11:25.882 INFO:tasks.workunit.client.1.smithi203.stdout:4/267: dwrite d1a/d21/d22/f4a [0,4194304] 0 2024-04-12T09:11:25.885 INFO:tasks.workunit.client.1.smithi203.stdout:0/316: truncate d0/d1d/d2f/d17/f47 1743658 0 2024-04-12T09:11:25.886 INFO:tasks.workunit.client.0.smithi117.stdout:1/878: mkdir d1/d64/d111 0 2024-04-12T09:11:25.887 INFO:tasks.workunit.client.0.smithi117.stdout:1/879: chown d1/dbd/d3f/l105 16523480 1 2024-04-12T09:11:25.889 INFO:tasks.workunit.client.1.smithi203.stdout:8/257: chown d4/d8/l17 1161458 1 2024-04-12T09:11:25.891 INFO:tasks.workunit.client.1.smithi203.stdout:8/258: dread - d4/d34/f47 zero size 2024-04-12T09:11:25.892 INFO:tasks.workunit.client.1.smithi203.stdout:0/317: dwrite d0/d1d/d2f/d17/d19/f5c [0,4194304] 0 2024-04-12T09:11:25.892 INFO:tasks.workunit.client.1.smithi203.stdout:5/358: mkdir d0/d6/d16/d9/d86 0 2024-04-12T09:11:25.892 INFO:tasks.workunit.client.0.smithi117.stdout:7/747: truncate d0/d2/d45/d17/d23/dac/dad/daa/fb4 40937 0 2024-04-12T09:11:25.893 INFO:tasks.workunit.client.0.smithi117.stdout:6/869: rmdir d8/d2a/d60/d106 39 2024-04-12T09:11:25.895 INFO:tasks.workunit.client.1.smithi203.stdout:5/359: truncate d0/d6/d16/d9/d14/d4b/f6b 774694 0 2024-04-12T09:11:25.897 INFO:tasks.workunit.client.0.smithi117.stdout:5/967: getdents d2/d3/dd/d39/d83/dc8/dd1 0 2024-04-12T09:11:25.900 INFO:tasks.workunit.client.1.smithi203.stdout:2/295: rename d0/d14/l62 to d0/l68 0 2024-04-12T09:11:25.906 INFO:tasks.workunit.client.0.smithi117.stdout:1/880: write d1/dbd/d3f/db/d16/db6/da9/f9c [1716865,15258] 0 2024-04-12T09:11:25.907 INFO:tasks.workunit.client.0.smithi117.stdout:2/807: write d0/df/f20 [2429978,522] 0 2024-04-12T09:11:25.907 INFO:tasks.workunit.client.0.smithi117.stdout:6/870: dwrite d8/d3a/d49/da4/d8a/fe7 [0,4194304] 0 2024-04-12T09:11:25.908 INFO:tasks.workunit.client.1.smithi203.stdout:3/262: sync 2024-04-12T09:11:25.908 INFO:tasks.workunit.client.0.smithi117.stdout:4/864: getdents d0/d5/d3b/dd6 0 2024-04-12T09:11:25.908 INFO:tasks.workunit.client.0.smithi117.stdout:1/881: read d1/dbd/d51/f81 [2250707,123839] 0 2024-04-12T09:11:25.909 INFO:tasks.workunit.client.0.smithi117.stdout:9/780: dread d1/d8/d5e/f6d [4194304,4194304] 0 2024-04-12T09:11:25.911 INFO:tasks.workunit.client.0.smithi117.stdout:9/781: chown d1/d8/df/d7d/d7e 205595 1 2024-04-12T09:11:25.912 INFO:tasks.workunit.client.1.smithi203.stdout:7/270: creat d0/d15/f63 x:0 0 0 2024-04-12T09:11:25.919 INFO:tasks.workunit.client.1.smithi203.stdout:4/268: write d1a/d1d/d23/d2c/f51 [273895,123054] 0 2024-04-12T09:11:25.919 INFO:tasks.workunit.client.1.smithi203.stdout:8/259: mknod d4/d4a/c51 0 2024-04-12T09:11:25.919 INFO:tasks.workunit.client.1.smithi203.stdout:4/269: write d1a/d20/f2a [5223326,10163] 0 2024-04-12T09:11:25.920 INFO:tasks.workunit.client.0.smithi117.stdout:6/871: creat d8/d3a/d49/da4/df8/f117 x:0 0 0 2024-04-12T09:11:25.923 INFO:tasks.workunit.client.1.smithi203.stdout:1/322: rename df/d2d/d45 to df/d20/d54/d5d 0 2024-04-12T09:11:25.925 INFO:tasks.workunit.client.0.smithi117.stdout:2/808: dread d0/df/f1d [0,4194304] 0 2024-04-12T09:11:25.926 INFO:tasks.workunit.client.1.smithi203.stdout:2/296: creat d0/d54/f69 x:0 0 0 2024-04-12T09:11:25.926 INFO:tasks.workunit.client.1.smithi203.stdout:4/270: dwrite d1a/d21/d22/f4a [0,4194304] 0 2024-04-12T09:11:25.926 INFO:tasks.workunit.client.1.smithi203.stdout:1/323: dread df/d20/f21 [0,4194304] 0 2024-04-12T09:11:25.927 INFO:tasks.workunit.client.0.smithi117.stdout:2/809: stat d0/d43/d53/f7b 0 2024-04-12T09:11:25.927 INFO:tasks.workunit.client.0.smithi117.stdout:6/872: dwrite d8/d9/d17/d33/d101/f88 [4194304,4194304] 0 2024-04-12T09:11:25.928 INFO:tasks.workunit.client.1.smithi203.stdout:4/271: chown d1a/d34/c50 1975511 1 2024-04-12T09:11:25.928 INFO:tasks.workunit.client.1.smithi203.stdout:1/324: write df/f33 [312851,7504] 0 2024-04-12T09:11:25.929 INFO:tasks.workunit.client.0.smithi117.stdout:6/873: chown d8/d3a/d49/da4/d8a/cd3 2691157 1 2024-04-12T09:11:25.930 INFO:tasks.workunit.client.1.smithi203.stdout:9/259: link d8/d12/d14/c1b d8/d12/d23/c65 0 2024-04-12T09:11:25.930 INFO:tasks.workunit.client.1.smithi203.stdout:3/263: write d2/d8/d14/d23/f2a [3328013,13698] 0 2024-04-12T09:11:25.933 INFO:tasks.workunit.client.0.smithi117.stdout:1/882: mknod d1/dbd/d3f/db/d1d/c112 0 2024-04-12T09:11:25.936 INFO:tasks.workunit.client.1.smithi203.stdout:6/287: link d1/d3/d4/l48 d1/df/d1b/d3b/l5f 0 2024-04-12T09:11:25.938 INFO:tasks.workunit.client.0.smithi117.stdout:7/748: unlink d0/d2/d45/d17/d23/dac/dad/daa/fb4 0 2024-04-12T09:11:25.941 INFO:tasks.workunit.client.0.smithi117.stdout:4/865: link d0/d5/d39/d4e/d51/ff9 d0/d2c/da6/f116 0 2024-04-12T09:11:25.943 INFO:tasks.workunit.client.0.smithi117.stdout:2/810: creat d0/d4/d81/f10e x:0 0 0 2024-04-12T09:11:25.944 INFO:tasks.workunit.client.1.smithi203.stdout:0/318: symlink d0/d1d/d2f/l64 0 2024-04-12T09:11:25.950 INFO:tasks.workunit.client.0.smithi117.stdout:5/968: dwrite d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1/d11f/d6b/fef [0,4194304] 0 2024-04-12T09:11:25.953 INFO:tasks.workunit.client.0.smithi117.stdout:5/969: read - d2/d3/de/d1e/d66/f114 zero size 2024-04-12T09:11:25.955 INFO:tasks.workunit.client.1.smithi203.stdout:1/325: symlink df/d20/d54/l5e 0 2024-04-12T09:11:25.956 INFO:tasks.workunit.client.0.smithi117.stdout:9/782: dwrite d1/d8/d5a/d79/d91/db0/f80 [0,4194304] 0 2024-04-12T09:11:25.956 INFO:tasks.workunit.client.1.smithi203.stdout:1/326: write df/f5b [676636,122024] 0 2024-04-12T09:11:25.957 INFO:tasks.workunit.client.0.smithi117.stdout:4/866: mknod d0/d5/d25/dfd/c117 0 2024-04-12T09:11:25.961 INFO:tasks.workunit.client.1.smithi203.stdout:7/271: creat d0/d4/d1c/d5b/f64 x:0 0 0 2024-04-12T09:11:25.962 INFO:tasks.workunit.client.0.smithi117.stdout:6/874: symlink d8/d9/d17/d33/d101/l118 0 2024-04-12T09:11:25.964 INFO:tasks.workunit.client.0.smithi117.stdout:1/883: write d1/f9d [1067344,72403] 0 2024-04-12T09:11:25.966 INFO:tasks.workunit.client.1.smithi203.stdout:9/260: mknod d8/d12/d23/d29/d2c/c66 0 2024-04-12T09:11:25.969 INFO:tasks.workunit.client.1.smithi203.stdout:8/260: rmdir d4/d8/d1c 39 2024-04-12T09:11:25.972 INFO:tasks.workunit.client.1.smithi203.stdout:0/319: mkdir d0/d1d/d65 0 2024-04-12T09:11:25.972 INFO:tasks.workunit.client.0.smithi117.stdout:9/783: creat d1/d8/d5a/d79/d91/db0/d8a/ffc x:0 0 0 2024-04-12T09:11:25.973 INFO:tasks.workunit.client.1.smithi203.stdout:2/297: mknod d0/d67/c6a 0 2024-04-12T09:11:25.974 INFO:tasks.workunit.client.1.smithi203.stdout:0/320: truncate d0/d1d/d2f/d17/d19/f23 4623971 0 2024-04-12T09:11:25.974 INFO:tasks.workunit.client.0.smithi117.stdout:4/867: rmdir d0/d5/d25/dfd 39 2024-04-12T09:11:25.974 INFO:tasks.workunit.client.1.smithi203.stdout:0/321: read d0/d1d/d2f/d17/fa [1940079,111224] 0 2024-04-12T09:11:25.977 INFO:tasks.workunit.client.1.smithi203.stdout:5/360: sync 2024-04-12T09:11:25.978 INFO:tasks.workunit.client.0.smithi117.stdout:1/884: creat d1/dbd/d3f/db/dc2/f113 x:0 0 0 2024-04-12T09:11:25.980 INFO:tasks.workunit.client.1.smithi203.stdout:4/272: link d1a/d34/f35 d1a/d21/d22/d2e/f58 0 2024-04-12T09:11:25.985 INFO:tasks.workunit.client.0.smithi117.stdout:9/784: dread - d1/d8/d5e/fd3 zero size 2024-04-12T09:11:25.986 INFO:tasks.workunit.client.1.smithi203.stdout:8/261: mknod d4/c52 0 2024-04-12T09:11:25.986 INFO:tasks.workunit.client.1.smithi203.stdout:8/262: stat l0 0 2024-04-12T09:11:25.987 INFO:tasks.workunit.client.0.smithi117.stdout:2/811: creat d0/f10f x:0 0 0 2024-04-12T09:11:25.993 INFO:tasks.workunit.client.0.smithi117.stdout:5/970: write d2/d3/dd/d39/f86 [2057416,28877] 0 2024-04-12T09:11:25.995 INFO:tasks.workunit.client.0.smithi117.stdout:7/749: getdents d0/d20/d4a/dce/dcf 0 2024-04-12T09:11:25.995 INFO:tasks.workunit.client.0.smithi117.stdout:6/875: dwrite d8/d9/f19 [0,4194304] 0 2024-04-12T09:11:25.998 INFO:tasks.workunit.client.1.smithi203.stdout:3/264: creat d2/d8/f52 x:0 0 0 2024-04-12T09:11:26.002 INFO:tasks.workunit.client.0.smithi117.stdout:7/750: dread - d0/d2/d1a/d4f/f7b zero size 2024-04-12T09:11:26.003 INFO:tasks.workunit.client.0.smithi117.stdout:4/868: symlink d0/d5/d3b/d38/d4f/d79/d9c/dab/d101/l118 0 2024-04-12T09:11:26.005 INFO:tasks.workunit.client.0.smithi117.stdout:5/971: unlink d2/d3/dd/d39/d7a/c100 0 2024-04-12T09:11:26.009 INFO:tasks.workunit.client.1.smithi203.stdout:8/263: write d4/d8/f24 [1206355,13162] 0 2024-04-12T09:11:26.010 INFO:tasks.workunit.client.1.smithi203.stdout:2/298: mknod d0/d19/c6b 0 2024-04-12T09:11:26.011 INFO:tasks.workunit.client.0.smithi117.stdout:1/885: dread d1/f40 [4194304,4194304] 0 2024-04-12T09:11:26.015 INFO:tasks.workunit.client.0.smithi117.stdout:2/812: dwrite d0/d4/d10/d27/f9c [0,4194304] 0 2024-04-12T09:11:26.016 INFO:tasks.workunit.client.1.smithi203.stdout:1/327: creat df/d2d/f5f x:0 0 0 2024-04-12T09:11:26.016 INFO:tasks.workunit.client.0.smithi117.stdout:5/972: dwrite d2/d3/de/d1e/d66/f114 [0,4194304] 0 2024-04-12T09:11:26.017 INFO:tasks.workunit.client.0.smithi117.stdout:5/973: chown d2/d3/dd/d39/d83 6 1 2024-04-12T09:11:26.021 INFO:tasks.workunit.client.1.smithi203.stdout:5/361: symlink d0/d6/d16/d9/d14/l87 0 2024-04-12T09:11:26.022 INFO:tasks.workunit.client.1.smithi203.stdout:4/273: symlink d1a/l59 0 2024-04-12T09:11:26.023 INFO:tasks.workunit.client.1.smithi203.stdout:5/362: write d0/d6/d11/d18/d2a/ff [3454697,95094] 0 2024-04-12T09:11:26.025 INFO:tasks.workunit.client.1.smithi203.stdout:6/288: getdents d1/df/d1b/d3e 0 2024-04-12T09:11:26.027 INFO:tasks.workunit.client.1.smithi203.stdout:5/363: write d0/f21 [928796,58423] 0 2024-04-12T09:11:26.031 INFO:tasks.workunit.client.1.smithi203.stdout:0/322: creat d0/d1d/d2f/f66 x:0 0 0 2024-04-12T09:11:26.032 INFO:tasks.workunit.client.1.smithi203.stdout:7/272: getdents d0/d4/d5d 0 2024-04-12T09:11:26.034 INFO:tasks.workunit.client.1.smithi203.stdout:3/265: symlink d2/l53 0 2024-04-12T09:11:26.035 INFO:tasks.workunit.client.1.smithi203.stdout:6/289: dwrite d1/df/d1b/d3b/f40 [4194304,4194304] 0 2024-04-12T09:11:26.036 INFO:tasks.workunit.client.1.smithi203.stdout:6/290: write d1/df/d1b/d3b/d45/f52 [148540,8767] 0 2024-04-12T09:11:26.038 INFO:tasks.workunit.client.1.smithi203.stdout:9/261: getdents d8/d12/d23/d29 0 2024-04-12T09:11:26.042 INFO:tasks.workunit.client.1.smithi203.stdout:4/274: fsync d1a/d21/d22/f25 0 2024-04-12T09:11:26.046 INFO:tasks.workunit.client.1.smithi203.stdout:8/264: mkdir d4/d8/d19/d53 0 2024-04-12T09:11:26.047 INFO:tasks.workunit.client.1.smithi203.stdout:8/265: readlink l2 0 2024-04-12T09:11:26.052 INFO:tasks.workunit.client.1.smithi203.stdout:1/328: mknod df/d2d/c60 0 2024-04-12T09:11:26.053 INFO:tasks.workunit.client.1.smithi203.stdout:1/329: write df/f17 [870315,128355] 0 2024-04-12T09:11:26.056 INFO:tasks.workunit.client.1.smithi203.stdout:0/323: chown d0/dd/f2d 30854 1 2024-04-12T09:11:26.057 INFO:tasks.workunit.client.1.smithi203.stdout:0/324: fdatasync d0/d1d/d2f/d17/d19/f23 0 2024-04-12T09:11:26.057 INFO:tasks.workunit.client.1.smithi203.stdout:9/262: dread d8/d12/d14/f1f [0,4194304] 0 2024-04-12T09:11:26.058 INFO:tasks.workunit.client.1.smithi203.stdout:7/273: creat d0/d4/d1c/d5b/f65 x:0 0 0 2024-04-12T09:11:26.058 INFO:tasks.workunit.client.1.smithi203.stdout:7/274: fdatasync d0/f2 0 2024-04-12T09:11:26.067 INFO:tasks.workunit.client.1.smithi203.stdout:3/266: dwrite d2/f17 [0,4194304] 0 2024-04-12T09:11:26.068 INFO:tasks.workunit.client.1.smithi203.stdout:4/275: mknod d1a/d1d/d23/c5a 0 2024-04-12T09:11:26.068 INFO:tasks.workunit.client.1.smithi203.stdout:9/263: dread d8/d12/d23/d27/f32 [0,4194304] 0 2024-04-12T09:11:26.071 INFO:tasks.workunit.client.1.smithi203.stdout:9/264: chown d8/d12/d23/d41/l64 217 1 2024-04-12T09:11:26.071 INFO:tasks.workunit.client.1.smithi203.stdout:4/276: write d1a/d1d/d23/d2c/f51 [717741,44668] 0 2024-04-12T09:11:26.071 INFO:tasks.workunit.client.1.smithi203.stdout:8/266: creat d4/d8/d19/f54 x:0 0 0 2024-04-12T09:11:26.071 INFO:tasks.workunit.client.1.smithi203.stdout:3/267: truncate d2/d8/d14/d23/d35/d4c/d2e/f38 332522 0 2024-04-12T09:11:26.072 INFO:tasks.workunit.client.1.smithi203.stdout:9/265: write d8/fb [4380175,127599] 0 2024-04-12T09:11:26.073 INFO:tasks.workunit.client.1.smithi203.stdout:8/267: dread - d4/d8/d19/f43 zero size 2024-04-12T09:11:26.077 INFO:tasks.workunit.client.1.smithi203.stdout:5/364: mkdir d0/d6/d16/d9/d30/d58/d74/d88 0 2024-04-12T09:11:26.077 INFO:tasks.workunit.client.1.smithi203.stdout:9/266: dread d8/d12/d3e/f47 [0,4194304] 0 2024-04-12T09:11:26.078 INFO:tasks.workunit.client.1.smithi203.stdout:1/330: rmdir df/d2d 39 2024-04-12T09:11:26.081 INFO:tasks.workunit.client.1.smithi203.stdout:3/268: dwrite d2/d8/d14/d23/f47 [0,4194304] 0 2024-04-12T09:11:26.082 INFO:tasks.workunit.client.1.smithi203.stdout:1/331: dread - df/d20/d2b/f52 zero size 2024-04-12T09:11:26.083 INFO:tasks.workunit.client.1.smithi203.stdout:1/332: dread - df/d20/d2b/f42 zero size 2024-04-12T09:11:26.083 INFO:tasks.workunit.client.1.smithi203.stdout:3/269: write d2/d8/d14/d23/f42 [2722791,7127] 0 2024-04-12T09:11:26.084 INFO:tasks.workunit.client.1.smithi203.stdout:6/291: link d1/df/d28/f2c d1/df/d28/d3a/f60 0 2024-04-12T09:11:26.084 INFO:tasks.workunit.client.1.smithi203.stdout:3/270: readlink d2/l53 0 2024-04-12T09:11:26.085 INFO:tasks.workunit.client.1.smithi203.stdout:3/271: readlink d2/d8/lf 0 2024-04-12T09:11:26.093 INFO:tasks.workunit.client.1.smithi203.stdout:2/299: dwrite d0/d38/d43/f44 [0,4194304] 0 2024-04-12T09:11:26.095 INFO:tasks.workunit.client.0.smithi117.stdout:4/869: creat d0/d5/d39/d4e/d6b/d83/f119 x:0 0 0 2024-04-12T09:11:26.101 INFO:tasks.workunit.client.0.smithi117.stdout:1/886: mknod d1/dbd/d3f/db/d1d/d10e/c114 0 2024-04-12T09:11:26.102 INFO:tasks.workunit.client.0.smithi117.stdout:1/887: chown d1/d64/d45/d4c/d94/dd0 68947057 1 2024-04-12T09:11:26.111 INFO:tasks.workunit.client.0.smithi117.stdout:6/876: rename d8/d9/lf7 to d8/d9/d17/d33/l119 0 2024-04-12T09:11:26.111 INFO:tasks.workunit.client.0.smithi117.stdout:1/888: dwrite d1/dbd/d3f/db/d1d/f5b [4194304,4194304] 0 2024-04-12T09:11:26.111 INFO:tasks.workunit.client.1.smithi203.stdout:5/365: mkdir d0/d6/d16/d9/d30/d89 0 2024-04-12T09:11:26.111 INFO:tasks.workunit.client.1.smithi203.stdout:9/267: symlink d8/d12/d23/d29/d2c/l67 0 2024-04-12T09:11:26.112 INFO:tasks.workunit.client.0.smithi117.stdout:4/870: fdatasync d0/d1/f73 0 2024-04-12T09:11:26.113 INFO:tasks.workunit.client.0.smithi117.stdout:4/871: write d0/d72/fd3 [374665,88580] 0 2024-04-12T09:11:26.113 INFO:tasks.workunit.client.1.smithi203.stdout:7/275: creat d0/d15/d2d/f66 x:0 0 0 2024-04-12T09:11:26.114 INFO:tasks.workunit.client.0.smithi117.stdout:2/813: mknod d0/d4/d81/d10d/c110 0 2024-04-12T09:11:26.114 INFO:tasks.workunit.client.1.smithi203.stdout:4/277: write d1a/d21/d22/d2e/f58 [178166,3483] 0 2024-04-12T09:11:26.115 INFO:tasks.workunit.client.0.smithi117.stdout:2/814: write d0/df/f20 [891061,61120] 0 2024-04-12T09:11:26.116 INFO:tasks.workunit.client.1.smithi203.stdout:7/276: write d0/d15/d2d/f4b [533165,89493] 0 2024-04-12T09:11:26.119 INFO:tasks.workunit.client.1.smithi203.stdout:1/333: creat df/d20/d54/f61 x:0 0 0 2024-04-12T09:11:26.119 INFO:tasks.workunit.client.1.smithi203.stdout:6/292: truncate d1/df/d1b/f23 3636786 0 2024-04-12T09:11:26.120 INFO:tasks.workunit.client.1.smithi203.stdout:7/277: read - d0/d4/d1c/d5b/f65 zero size 2024-04-12T09:11:26.121 INFO:tasks.workunit.client.1.smithi203.stdout:9/268: dwrite f5 [4194304,4194304] 0 2024-04-12T09:11:26.122 INFO:tasks.workunit.client.1.smithi203.stdout:3/272: rename d2/d8/d14/d23/d36/f41 to d2/d8/d14/d23/d35/d4c/f54 0 2024-04-12T09:11:26.123 INFO:tasks.workunit.client.0.smithi117.stdout:1/889: truncate d1/dbd/d3f/db/d16/db6/f69 1017608 0 2024-04-12T09:11:26.125 INFO:tasks.workunit.client.0.smithi117.stdout:5/974: dwrite d2/d3/dd/d39/d7a/f6f [0,4194304] 0 2024-04-12T09:11:26.130 INFO:tasks.workunit.client.0.smithi117.stdout:4/872: creat d0/d5/d3b/d38/d10f/f11a x:0 0 0 2024-04-12T09:11:26.133 INFO:tasks.workunit.client.1.smithi203.stdout:8/268: dread d4/d8/d37/f3e [0,4194304] 0 2024-04-12T09:11:26.136 INFO:tasks.workunit.client.0.smithi117.stdout:6/877: creat d8/d2a/df6/f11a x:0 0 0 2024-04-12T09:11:26.139 INFO:tasks.workunit.client.0.smithi117.stdout:1/890: mknod d1/dbe/c115 0 2024-04-12T09:11:26.140 INFO:tasks.workunit.client.0.smithi117.stdout:1/891: chown d1/dbd/d3f/f20 408405 1 2024-04-12T09:11:26.142 INFO:tasks.workunit.client.0.smithi117.stdout:2/815: read d0/df/f93 [1141383,3765] 0 2024-04-12T09:11:26.144 INFO:tasks.workunit.client.0.smithi117.stdout:6/878: dwrite d8/d2a/d60/d89/dea/ffb [0,4194304] 0 2024-04-12T09:11:26.145 INFO:tasks.workunit.client.1.smithi203.stdout:0/325: sync 2024-04-12T09:11:26.147 INFO:tasks.workunit.client.1.smithi203.stdout:6/293: creat d1/d3/d26/f61 x:0 0 0 2024-04-12T09:11:26.148 INFO:tasks.workunit.client.0.smithi117.stdout:1/892: dread d1/d64/f93 [0,4194304] 0 2024-04-12T09:11:26.150 INFO:tasks.workunit.client.1.smithi203.stdout:9/269: truncate d8/f34 3169588 0 2024-04-12T09:11:26.151 INFO:tasks.workunit.client.1.smithi203.stdout:5/366: rename d0/d6/d16/d8/l59 to d0/d6/d11/d38/l8a 0 2024-04-12T09:11:26.152 INFO:tasks.workunit.client.1.smithi203.stdout:3/273: mkdir d2/d8/d14/d23/d35/d4c/d2e/d55 0 2024-04-12T09:11:26.154 INFO:tasks.workunit.client.1.smithi203.stdout:1/334: dread df/f16 [0,4194304] 0 2024-04-12T09:11:26.155 INFO:tasks.workunit.client.0.smithi117.stdout:6/879: symlink d8/d2a/d60/d89/dea/l11b 0 2024-04-12T09:11:26.159 INFO:tasks.workunit.client.0.smithi117.stdout:2/816: mkdir d0/d4/ddb/d111 0 2024-04-12T09:11:26.160 INFO:tasks.workunit.client.1.smithi203.stdout:3/274: dread d2/d8/d14/d23/f47 [0,4194304] 0 2024-04-12T09:11:26.161 INFO:tasks.workunit.client.0.smithi117.stdout:6/880: read - d8/d3a/d49/da4/d9f/fe8 zero size 2024-04-12T09:11:26.161 INFO:tasks.workunit.client.1.smithi203.stdout:5/367: dwrite d0/d6/d16/d44/f5c [0,4194304] 0 2024-04-12T09:11:26.162 INFO:tasks.workunit.client.1.smithi203.stdout:2/300: dread d0/d2e/f34 [0,4194304] 0 2024-04-12T09:11:26.163 INFO:tasks.workunit.client.0.smithi117.stdout:2/817: mkdir d0/d4/ddb/d112 0 2024-04-12T09:11:26.165 INFO:tasks.workunit.client.1.smithi203.stdout:0/326: write d0/d1d/d2f/d4c/f4f [4848229,130075] 0 2024-04-12T09:11:26.166 INFO:tasks.workunit.client.0.smithi117.stdout:2/818: read - d0/d43/d30/f107 zero size 2024-04-12T09:11:26.169 INFO:tasks.workunit.client.1.smithi203.stdout:9/270: symlink d8/d12/d23/d29/d2c/l68 0 2024-04-12T09:11:26.170 INFO:tasks.workunit.client.0.smithi117.stdout:5/975: dwrite d2/d3/de/d1e/d66/dbe/d105/f116 [0,4194304] 0 2024-04-12T09:11:26.172 INFO:tasks.workunit.client.0.smithi117.stdout:4/873: dwrite d0/d1/d34/ffa [0,4194304] 0 2024-04-12T09:11:26.172 INFO:tasks.workunit.client.0.smithi117.stdout:1/893: getdents d1/dbd/d3f/db/d1d/d10e 0 2024-04-12T09:11:26.178 INFO:tasks.workunit.client.0.smithi117.stdout:6/881: dwrite d8/d2a/d60/d7d/f112 [0,4194304] 0 2024-04-12T09:11:26.179 INFO:tasks.workunit.client.0.smithi117.stdout:2/819: dread d0/d43/d53/d61/d66/fa2 [0,4194304] 0 2024-04-12T09:11:26.182 INFO:tasks.workunit.client.1.smithi203.stdout:8/269: dwrite d4/f6 [0,4194304] 0 2024-04-12T09:11:26.184 INFO:tasks.workunit.client.1.smithi203.stdout:8/270: chown d4/ca 27 1 2024-04-12T09:11:26.185 INFO:tasks.workunit.client.1.smithi203.stdout:1/335: stat df/d2d/l50 0 2024-04-12T09:11:26.186 INFO:tasks.workunit.client.0.smithi117.stdout:1/894: rmdir d1/dbd/d3f/db/dc2 39 2024-04-12T09:11:26.190 INFO:tasks.workunit.client.0.smithi117.stdout:4/874: symlink d0/d2c/d3c/d10a/l11b 0 2024-04-12T09:11:26.190 INFO:tasks.workunit.client.0.smithi117.stdout:4/875: dread - d0/d2c/d67/fda zero size 2024-04-12T09:11:26.191 INFO:tasks.workunit.client.1.smithi203.stdout:3/275: dread d2/f18 [0,4194304] 0 2024-04-12T09:11:26.191 INFO:tasks.workunit.client.0.smithi117.stdout:5/976: mknod d2/c140 0 2024-04-12T09:11:26.192 INFO:tasks.workunit.client.0.smithi117.stdout:6/882: truncate d8/fc9 304130 0 2024-04-12T09:11:26.193 INFO:tasks.workunit.client.1.smithi203.stdout:5/368: creat d0/d6/d11/d4a/f8b x:0 0 0 2024-04-12T09:11:26.195 INFO:tasks.workunit.client.0.smithi117.stdout:2/820: rename d0/d43/d53/fba to d0/d4/d10/d27/d9a/f113 0 2024-04-12T09:11:26.196 INFO:tasks.workunit.client.1.smithi203.stdout:2/301: creat d0/d67/f6c x:0 0 0 2024-04-12T09:11:26.197 INFO:tasks.workunit.client.0.smithi117.stdout:2/821: write d0/d4/fb [4781025,94456] 0 2024-04-12T09:11:26.197 INFO:tasks.workunit.client.1.smithi203.stdout:2/302: readlink d0/d14/d23/d33/l53 0 2024-04-12T09:11:26.197 INFO:tasks.workunit.client.1.smithi203.stdout:2/303: dread - d0/d14/d23/d3d/f64 zero size 2024-04-12T09:11:26.202 INFO:tasks.workunit.client.1.smithi203.stdout:2/304: read d0/d38/d43/f5b [1299979,115150] 0 2024-04-12T09:11:26.203 INFO:tasks.workunit.client.0.smithi117.stdout:2/822: creat d0/d43/d53/d61/d66/f114 x:0 0 0 2024-04-12T09:11:26.205 INFO:tasks.workunit.client.0.smithi117.stdout:2/823: write d0/d4/d10/f63 [1552974,82637] 0 2024-04-12T09:11:26.210 INFO:tasks.workunit.client.1.smithi203.stdout:1/336: creat df/d20/d54/d5d/d4a/f62 x:0 0 0 2024-04-12T09:11:26.211 INFO:tasks.workunit.client.1.smithi203.stdout:1/337: stat df/d20/f26 0 2024-04-12T09:11:26.213 INFO:tasks.workunit.client.1.smithi203.stdout:4/278: link d1a/d21/c45 d1a/d20/c5b 0 2024-04-12T09:11:26.214 INFO:tasks.workunit.client.1.smithi203.stdout:5/369: write d0/d6/d11/d38/f84 [137900,19448] 0 2024-04-12T09:11:26.215 INFO:tasks.workunit.client.1.smithi203.stdout:5/370: chown d0/d6/d11/d1e/d4c/d48 418328 1 2024-04-12T09:11:26.216 INFO:tasks.workunit.client.0.smithi117.stdout:2/824: creat d0/d43/d53/d61/d8d/f115 x:0 0 0 2024-04-12T09:11:26.217 INFO:tasks.workunit.client.1.smithi203.stdout:6/294: link d1/df/f38 d1/d3/f62 0 2024-04-12T09:11:26.219 INFO:tasks.workunit.client.0.smithi117.stdout:6/883: dread d8/d9/f1f [0,4194304] 0 2024-04-12T09:11:26.220 INFO:tasks.workunit.client.0.smithi117.stdout:4/876: dwrite d0/d5/d39/d4e/d51/ff9 [0,4194304] 0 2024-04-12T09:11:26.220 INFO:tasks.workunit.client.1.smithi203.stdout:5/371: dwrite d0/d6/d11/d18/f32 [0,4194304] 0 2024-04-12T09:11:26.220 INFO:tasks.workunit.client.1.smithi203.stdout:9/271: symlink d8/l69 0 2024-04-12T09:11:26.221 INFO:tasks.workunit.client.0.smithi117.stdout:1/895: write d1/dbd/d3f/db/dc2/fed [909261,103104] 0 2024-04-12T09:11:26.225 INFO:tasks.workunit.client.1.smithi203.stdout:7/278: rename d0/d4/lc to d0/d15/l67 0 2024-04-12T09:11:26.227 INFO:tasks.workunit.client.0.smithi117.stdout:2/825: mkdir d0/d4/ddb/d116 0 2024-04-12T09:11:26.230 INFO:tasks.workunit.client.1.smithi203.stdout:2/305: dread d0/d3/fd [4194304,4194304] 0 2024-04-12T09:11:26.230 INFO:tasks.workunit.client.0.smithi117.stdout:5/977: dwrite d2/d3/dd/d39/f61 [4194304,4194304] 0 2024-04-12T09:11:26.231 INFO:tasks.workunit.client.1.smithi203.stdout:2/306: write d0/d3/f17 [4113479,106168] 0 2024-04-12T09:11:26.231 INFO:tasks.workunit.client.1.smithi203.stdout:8/271: fdatasync d4/d8/f1d 0 2024-04-12T09:11:26.233 INFO:tasks.workunit.client.0.smithi117.stdout:4/877: chown d0/d5/d25/dfd/d107/da7/dcd/de6/f104 0 1 2024-04-12T09:11:26.237 INFO:tasks.workunit.client.1.smithi203.stdout:4/279: unlink d1a/d21/d22/d2e/f58 0 2024-04-12T09:11:26.237 INFO:tasks.workunit.client.1.smithi203.stdout:2/307: dread d0/d14/d23/f50 [0,4194304] 0 2024-04-12T09:11:26.239 INFO:tasks.workunit.client.1.smithi203.stdout:4/280: write d1a/d21/d22/f4a [2171725,117859] 0 2024-04-12T09:11:26.240 INFO:tasks.workunit.client.0.smithi117.stdout:5/978: rmdir d2/d3/dd/d39/d7a 39 2024-04-12T09:11:26.243 INFO:tasks.workunit.client.1.smithi203.stdout:1/338: rename df/l29 to df/d20/d2b/l63 0 2024-04-12T09:11:26.244 INFO:tasks.workunit.client.0.smithi117.stdout:4/878: fdatasync d0/fb2 0 2024-04-12T09:11:26.245 INFO:tasks.workunit.client.1.smithi203.stdout:2/308: dwrite d0/d38/d43/f5b [0,4194304] 0 2024-04-12T09:11:26.252 INFO:tasks.workunit.client.1.smithi203.stdout:3/276: write d2/f2b [313039,120520] 0 2024-04-12T09:11:26.256 INFO:tasks.workunit.client.0.smithi117.stdout:1/896: creat d1/d3b/f116 x:0 0 0 2024-04-12T09:11:26.257 INFO:tasks.workunit.client.0.smithi117.stdout:1/897: readlink d1/dbd/d3f/db/d16/l25 0 2024-04-12T09:11:26.258 INFO:tasks.workunit.client.0.smithi117.stdout:4/879: symlink d0/d5/d25/dfd/d107/da7/dcd/dcf/l11c 0 2024-04-12T09:11:26.258 INFO:tasks.workunit.client.1.smithi203.stdout:3/277: dwrite d2/d8/d14/f27 [0,4194304] 0 2024-04-12T09:11:26.259 INFO:tasks.workunit.client.0.smithi117.stdout:2/826: creat d0/f117 x:0 0 0 2024-04-12T09:11:26.260 INFO:tasks.workunit.client.1.smithi203.stdout:3/278: fdatasync d2/d8/d14/d23/d35/d4c/d2e/f4d 0 2024-04-12T09:11:26.261 INFO:tasks.workunit.client.0.smithi117.stdout:6/884: getdents d8/d2a/d60/d7d 0 2024-04-12T09:11:26.261 INFO:tasks.workunit.client.1.smithi203.stdout:0/327: getdents d0/d59 0 2024-04-12T09:11:26.261 INFO:tasks.workunit.client.1.smithi203.stdout:6/295: symlink d1/d3/d5b/l63 0 2024-04-12T09:11:26.262 INFO:tasks.workunit.client.1.smithi203.stdout:0/328: readlink d0/dd/d40/l43 0 2024-04-12T09:11:26.263 INFO:tasks.workunit.client.1.smithi203.stdout:4/281: write d1a/d2b/f3a [1138946,6600] 0 2024-04-12T09:11:26.264 INFO:tasks.workunit.client.1.smithi203.stdout:4/282: chown l3 56 1 2024-04-12T09:11:26.264 INFO:tasks.workunit.client.1.smithi203.stdout:9/272: rename d8/d12/f19 to d8/d12/d23/d29/f6a 0 2024-04-12T09:11:26.267 INFO:tasks.workunit.client.0.smithi117.stdout:5/979: rename d2/d3/dd/f6d to d2/f141 0 2024-04-12T09:11:26.268 INFO:tasks.workunit.client.0.smithi117.stdout:5/980: chown d2/d3/dd/f4e 217431734 1 2024-04-12T09:11:26.273 INFO:tasks.workunit.client.0.smithi117.stdout:4/880: rename d0/d2c/d3c/lc0 to d0/d5/d25/dc8/da0/l11d 0 2024-04-12T09:11:26.274 INFO:tasks.workunit.client.0.smithi117.stdout:6/885: creat d8/d3a/d49/da4/df8/d10b/f11c x:0 0 0 2024-04-12T09:11:26.277 INFO:tasks.workunit.client.0.smithi117.stdout:5/981: unlink d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1/d11f/d6b/fc3 0 2024-04-12T09:11:26.277 INFO:tasks.workunit.client.0.smithi117.stdout:4/881: dread d0/d5/d3b/d38/d4f/fb0 [0,4194304] 0 2024-04-12T09:11:26.278 INFO:tasks.workunit.client.0.smithi117.stdout:4/882: stat d0/d1/d34/ffa 0 2024-04-12T09:11:26.279 INFO:tasks.workunit.client.1.smithi203.stdout:8/272: dwrite d4/d8/f42 [4194304,4194304] 0 2024-04-12T09:11:26.281 INFO:tasks.workunit.client.0.smithi117.stdout:6/886: creat d8/d2a/d60/d89/f11d x:0 0 0 2024-04-12T09:11:26.281 INFO:tasks.workunit.client.0.smithi117.stdout:6/887: chown d8/d2a/la7 113714 1 2024-04-12T09:11:26.283 INFO:tasks.workunit.client.1.smithi203.stdout:8/273: write d4/d34/f47 [483883,41876] 0 2024-04-12T09:11:26.283 INFO:tasks.workunit.client.1.smithi203.stdout:5/372: rename d0/d6/d11/d18/d1a/f47 to d0/d6/d11/d1e/d4c/f8c 0 2024-04-12T09:11:26.283 INFO:tasks.workunit.client.0.smithi117.stdout:6/888: write d8/d2a/df6/f11a [294624,78470] 0 2024-04-12T09:11:26.284 INFO:tasks.workunit.client.0.smithi117.stdout:6/889: chown d8/d3a/d49/da4/l3d 686678530 1 2024-04-12T09:11:26.284 INFO:tasks.workunit.client.1.smithi203.stdout:9/273: readlink d8/ld 0 2024-04-12T09:11:26.285 INFO:tasks.workunit.client.1.smithi203.stdout:5/373: dread - d0/d6/d11/d4a/f82 zero size 2024-04-12T09:11:26.286 INFO:tasks.workunit.client.1.smithi203.stdout:9/274: chown d8/d12/d23/d41 18894574 1 2024-04-12T09:11:26.287 INFO:tasks.workunit.client.0.smithi117.stdout:4/883: dread d0/d1/d34/f80 [0,4194304] 0 2024-04-12T09:11:26.287 INFO:tasks.workunit.client.1.smithi203.stdout:6/296: dwrite d1/d3/d12/f1e [0,4194304] 0 2024-04-12T09:11:26.287 INFO:tasks.workunit.client.1.smithi203.stdout:5/374: readlink d0/d6/l7c 0 2024-04-12T09:11:26.290 INFO:tasks.workunit.client.1.smithi203.stdout:7/279: link d0/d4/d1c/d3b/c50 d0/d38/c68 0 2024-04-12T09:11:26.292 INFO:tasks.workunit.client.0.smithi117.stdout:1/898: dread d1/d64/d45/d4c/f68 [0,4194304] 0 2024-04-12T09:11:26.293 INFO:tasks.workunit.client.0.smithi117.stdout:4/884: creat d0/d5/d25/dfd/f11e x:0 0 0 2024-04-12T09:11:26.294 INFO:tasks.workunit.client.1.smithi203.stdout:5/375: dwrite d0/d6/d16/d9/d30/f6f [0,4194304] 0 2024-04-12T09:11:26.295 INFO:tasks.workunit.client.0.smithi117.stdout:2/827: dread d0/d4/d81/d8b/fb5 [0,4194304] 0 2024-04-12T09:11:26.299 INFO:tasks.workunit.client.0.smithi117.stdout:1/899: creat d1/d96/f117 x:0 0 0 2024-04-12T09:11:26.301 INFO:tasks.workunit.client.1.smithi203.stdout:8/274: readlink d4/d8/l18 0 2024-04-12T09:11:26.301 INFO:tasks.workunit.client.0.smithi117.stdout:4/885: rmdir d0/d5/d25/dfd/d107 39 2024-04-12T09:11:26.303 INFO:tasks.workunit.client.0.smithi117.stdout:4/886: readlink d0/d72/l44 0 2024-04-12T09:11:26.303 INFO:tasks.workunit.client.1.smithi203.stdout:8/275: truncate d4/d4a/f4f 1342817 0 2024-04-12T09:11:26.303 INFO:tasks.workunit.client.1.smithi203.stdout:8/276: chown d4/d8/f42 42559 1 2024-04-12T09:11:26.308 INFO:tasks.workunit.client.0.smithi117.stdout:1/900: write d1/d64/d45/d4c/f68 [1924956,115955] 0 2024-04-12T09:11:26.309 INFO:tasks.workunit.client.1.smithi203.stdout:2/309: link d0/d2e/c4d d0/d38/c6d 0 2024-04-12T09:11:26.309 INFO:tasks.workunit.client.1.smithi203.stdout:2/310: fdatasync d0/d3/f10 0 2024-04-12T09:11:26.314 INFO:tasks.workunit.client.1.smithi203.stdout:0/329: dread d0/d1d/d2f/d17/d19/f23 [0,4194304] 0 2024-04-12T09:11:26.314 INFO:tasks.workunit.client.1.smithi203.stdout:7/280: creat d0/d4/f69 x:0 0 0 2024-04-12T09:11:26.315 INFO:tasks.workunit.client.1.smithi203.stdout:7/281: chown d0/d4/d1c/c49 996460 1 2024-04-12T09:11:26.315 INFO:tasks.workunit.client.0.smithi117.stdout:2/828: creat d0/d43/d4b/dff/f118 x:0 0 0 2024-04-12T09:11:26.316 INFO:tasks.workunit.client.1.smithi203.stdout:4/283: creat d1a/d21/f5c x:0 0 0 2024-04-12T09:11:26.317 INFO:tasks.workunit.client.0.smithi117.stdout:5/982: dwrite d2/d3/dd/d39/d83/fdb [0,4194304] 0 2024-04-12T09:11:26.318 INFO:tasks.workunit.client.1.smithi203.stdout:5/376: dread d0/d6/d11/d1e/d4c/f8c [0,4194304] 0 2024-04-12T09:11:26.319 INFO:tasks.workunit.client.1.smithi203.stdout:5/377: chown d0/d6/d16/d9/d14/l31 401006391 1 2024-04-12T09:11:26.321 INFO:tasks.workunit.client.1.smithi203.stdout:4/284: dwrite d1a/d21/d22/f39 [0,4194304] 0 2024-04-12T09:11:26.395 INFO:tasks.workunit.client.0.smithi117.stdout:2/829: unlink d0/d43/d53/d61/fb2 0 2024-04-12T09:11:26.396 INFO:tasks.workunit.client.0.smithi117.stdout:1/901: creat d1/dbe/d10a/f118 x:0 0 0 2024-04-12T09:11:26.397 INFO:tasks.workunit.client.0.smithi117.stdout:1/902: chown d1/d64/d111 15040 1 2024-04-12T09:11:26.398 INFO:tasks.workunit.client.1.smithi203.stdout:8/277: mknod d4/d8/d19/c55 0 2024-04-12T09:11:26.398 INFO:tasks.workunit.client.0.smithi117.stdout:4/887: link d0/d2c/d3c/ced d0/d2c/d67/c11f 0 2024-04-12T09:11:26.399 INFO:tasks.workunit.client.1.smithi203.stdout:3/279: dwrite d2/fd [4194304,4194304] 0 2024-04-12T09:11:26.400 INFO:tasks.workunit.client.0.smithi117.stdout:6/890: dwrite d8/d2a/d60/d89/dea/f110 [0,4194304] 0 2024-04-12T09:11:26.401 INFO:tasks.workunit.client.1.smithi203.stdout:6/297: symlink d1/d3/l64 0 2024-04-12T09:11:26.403 INFO:tasks.workunit.client.1.smithi203.stdout:1/339: getdents df/d20/d54/d5d/d4a 0 2024-04-12T09:11:26.404 INFO:tasks.workunit.client.0.smithi117.stdout:2/830: dread - d0/d4/d10/d27/d9a/f113 zero size 2024-04-12T09:11:26.405 INFO:tasks.workunit.client.0.smithi117.stdout:2/831: chown d0/d4/cd1 551308 1 2024-04-12T09:11:26.407 INFO:tasks.workunit.client.1.smithi203.stdout:3/280: dwrite d2/d8/f33 [0,4194304] 0 2024-04-12T09:11:26.409 INFO:tasks.workunit.client.0.smithi117.stdout:4/888: rename d0/d1/fe7 to d0/d5/f120 0 2024-04-12T09:11:26.415 INFO:tasks.workunit.client.1.smithi203.stdout:4/285: rename d1a/d1d/d23 to d1a/d20/d5d 0 2024-04-12T09:11:26.416 INFO:tasks.workunit.client.1.smithi203.stdout:4/286: read - d1a/d21/d22/d2e/f43 zero size 2024-04-12T09:11:26.418 INFO:tasks.workunit.client.0.smithi117.stdout:2/832: readlink d0/df/l3d 0 2024-04-12T09:11:26.419 INFO:tasks.workunit.client.1.smithi203.stdout:9/275: creat d8/f6b x:0 0 0 2024-04-12T09:11:26.425 INFO:tasks.workunit.client.0.smithi117.stdout:5/983: rmdir d2/d3/de/d1e/d46/de4/d138 0 2024-04-12T09:11:26.425 INFO:tasks.workunit.client.1.smithi203.stdout:6/298: rmdir d1/df/d1b/d3b 39 2024-04-12T09:11:26.426 INFO:tasks.workunit.client.1.smithi203.stdout:6/299: stat d1/df/d28/d43/c4e 0 2024-04-12T09:11:26.427 INFO:tasks.workunit.client.1.smithi203.stdout:1/340: mknod df/d20/d54/c64 0 2024-04-12T09:11:26.429 INFO:tasks.workunit.client.1.smithi203.stdout:2/311: symlink d0/l6e 0 2024-04-12T09:11:26.433 INFO:tasks.workunit.client.0.smithi117.stdout:5/984: read d2/d3/dd/d39/d7a/f6f [2323031,125866] 0 2024-04-12T09:11:26.433 INFO:tasks.workunit.client.1.smithi203.stdout:1/341: dwrite df/d20/f41 [0,4194304] 0 2024-04-12T09:11:26.434 INFO:tasks.workunit.client.1.smithi203.stdout:3/281: creat d2/d8/d14/d23/d35/d4c/d2e/f56 x:0 0 0 2024-04-12T09:11:26.434 INFO:tasks.workunit.client.0.smithi117.stdout:6/891: truncate d8/d3a/d49/f4e 103700 0 2024-04-12T09:11:26.435 INFO:tasks.workunit.client.0.smithi117.stdout:2/833: dread d0/f3c [0,4194304] 0 2024-04-12T09:11:26.436 INFO:tasks.workunit.client.0.smithi117.stdout:6/892: dread - d8/d2a/d60/f115 zero size 2024-04-12T09:11:26.436 INFO:tasks.workunit.client.1.smithi203.stdout:7/282: symlink d0/d15/d2d/d5e/l6a 0 2024-04-12T09:11:26.437 INFO:tasks.workunit.client.1.smithi203.stdout:1/342: dread df/f16 [0,4194304] 0 2024-04-12T09:11:26.437 INFO:tasks.workunit.client.0.smithi117.stdout:6/893: write d8/d9/d17/d2d/dc1/fee [37964,84796] 0 2024-04-12T09:11:26.438 INFO:tasks.workunit.client.0.smithi117.stdout:1/903: getdents d1/dcb 0 2024-04-12T09:11:26.442 INFO:tasks.workunit.client.1.smithi203.stdout:5/378: symlink d0/d6/d16/d9/d80/l8d 0 2024-04-12T09:11:26.444 INFO:tasks.workunit.client.1.smithi203.stdout:0/330: write d0/f13 [1025910,74288] 0 2024-04-12T09:11:26.445 INFO:tasks.workunit.client.1.smithi203.stdout:4/287: creat d1a/d20/f5e x:0 0 0 2024-04-12T09:11:26.446 INFO:tasks.workunit.client.1.smithi203.stdout:8/278: symlink d4/d8/d1c/l56 0 2024-04-12T09:11:26.447 INFO:tasks.workunit.client.1.smithi203.stdout:0/331: write d0/d1d/f3d [13915,109068] 0 2024-04-12T09:11:26.447 INFO:tasks.workunit.client.0.smithi117.stdout:5/985: unlink d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1/d11f/d52/l10e 0 2024-04-12T09:11:26.448 INFO:tasks.workunit.client.1.smithi203.stdout:6/300: mkdir d1/df/d65 0 2024-04-12T09:11:26.448 INFO:tasks.workunit.client.0.smithi117.stdout:2/834: fsync d0/d4/d10/d27/f39 0 2024-04-12T09:11:26.449 INFO:tasks.workunit.client.1.smithi203.stdout:4/288: write d1a/d20/f5e [405102,90113] 0 2024-04-12T09:11:26.449 INFO:tasks.workunit.client.0.smithi117.stdout:6/894: mkdir d8/d9/d17/d2d/d11e 0 2024-04-12T09:11:26.450 INFO:tasks.workunit.client.1.smithi203.stdout:2/312: mknod d0/d19/c6f 0 2024-04-12T09:11:26.451 INFO:tasks.workunit.client.0.smithi117.stdout:6/895: write d8/d2a/d60/d7d/d8c/deb/fed [1315754,37415] 0 2024-04-12T09:11:26.452 INFO:tasks.workunit.client.1.smithi203.stdout:0/332: chown d0/d1d/d2f/d17/d19/c30 32410 1 2024-04-12T09:11:26.452 INFO:tasks.workunit.client.1.smithi203.stdout:4/289: write f14 [1269655,7555] 0 2024-04-12T09:11:26.452 INFO:tasks.workunit.client.1.smithi203.stdout:6/301: truncate d1/df/f51 812195 0 2024-04-12T09:11:26.453 INFO:tasks.workunit.client.0.smithi117.stdout:4/889: link d0/d5/l13 d0/d5/d3b/d38/d10f/l121 0 2024-04-12T09:11:26.453 INFO:tasks.workunit.client.0.smithi117.stdout:6/896: read d8/d2a/d60/d89/dea/ffb [419738,48961] 0 2024-04-12T09:11:26.453 INFO:tasks.workunit.client.1.smithi203.stdout:5/379: dwrite d0/d6/d16/d9/d30/f6f [0,4194304] 0 2024-04-12T09:11:26.453 INFO:tasks.workunit.client.1.smithi203.stdout:6/302: chown d1/d3 4375 1 2024-04-12T09:11:26.454 INFO:tasks.workunit.client.0.smithi117.stdout:5/986: dread - d2/d3/dd/d39/d82/fff zero size 2024-04-12T09:11:26.455 INFO:tasks.workunit.client.1.smithi203.stdout:3/282: creat d2/d8/d14/d23/f57 x:0 0 0 2024-04-12T09:11:26.456 INFO:tasks.workunit.client.0.smithi117.stdout:5/987: write d2/d3/dd/d39/d83/dc8/f128 [1849926,16477] 0 2024-04-12T09:11:26.456 INFO:tasks.workunit.client.1.smithi203.stdout:7/283: creat d0/d4/d1c/f6b x:0 0 0 2024-04-12T09:11:26.457 INFO:tasks.workunit.client.0.smithi117.stdout:2/835: write d0/d43/d53/d61/d8d/ff5 [367382,23274] 0 2024-04-12T09:11:26.458 INFO:tasks.workunit.client.0.smithi117.stdout:1/904: creat d1/dbd/d3f/db/d16/db6/da9/d9a/d71/d10b/f119 x:0 0 0 2024-04-12T09:11:26.459 INFO:tasks.workunit.client.0.smithi117.stdout:5/988: stat d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1/d11f/d6b/l77 0 2024-04-12T09:11:26.461 INFO:tasks.workunit.client.1.smithi203.stdout:8/279: mkdir d4/d8/d37/d57 0 2024-04-12T09:11:26.463 INFO:tasks.workunit.client.1.smithi203.stdout:2/313: dread d0/d38/d43/f44 [0,4194304] 0 2024-04-12T09:11:26.463 INFO:tasks.workunit.client.1.smithi203.stdout:8/280: stat d4/d4a 0 2024-04-12T09:11:26.464 INFO:tasks.workunit.client.1.smithi203.stdout:0/333: dwrite d0/d1d/d2f/d17/d19/f26 [0,4194304] 0 2024-04-12T09:11:26.464 INFO:tasks.workunit.client.0.smithi117.stdout:4/890: dread - d0/d5/d25/dfd/d107/fb4 zero size 2024-04-12T09:11:26.465 INFO:tasks.workunit.client.1.smithi203.stdout:5/380: creat d0/f8e x:0 0 0 2024-04-12T09:11:26.466 INFO:tasks.workunit.client.1.smithi203.stdout:0/334: stat d0/d48/l54 0 2024-04-12T09:11:26.474 INFO:tasks.workunit.client.1.smithi203.stdout:1/343: mknod df/d20/c65 0 2024-04-12T09:11:26.478 INFO:tasks.workunit.client.0.smithi117.stdout:4/891: dread - d0/d5/d25/dfd/d107/fe5 zero size 2024-04-12T09:11:26.479 INFO:tasks.workunit.client.1.smithi203.stdout:6/303: dread d1/df/d28/d3a/f60 [0,4194304] 0 2024-04-12T09:11:26.480 INFO:tasks.workunit.client.1.smithi203.stdout:7/284: creat d0/d4/d1c/d5b/f6c x:0 0 0 2024-04-12T09:11:26.482 INFO:tasks.workunit.client.1.smithi203.stdout:8/281: fdatasync d4/f2a 0 2024-04-12T09:11:26.484 INFO:tasks.workunit.client.1.smithi203.stdout:2/314: mknod d0/d14/d23/d3d/c70 0 2024-04-12T09:11:26.484 INFO:tasks.workunit.client.1.smithi203.stdout:8/282: dread - d4/d8/d19/f54 zero size 2024-04-12T09:11:26.487 INFO:tasks.workunit.client.0.smithi117.stdout:5/989: rename d2/d3/de/d1e/c53 to d2/d3/de/d1e/c142 0 2024-04-12T09:11:26.489 INFO:tasks.workunit.client.1.smithi203.stdout:3/283: symlink d2/d51/l58 0 2024-04-12T09:11:26.490 INFO:tasks.workunit.client.1.smithi203.stdout:4/290: write d1a/d21/d22/d2e/f3c [2370854,92112] 0 2024-04-12T09:11:26.491 INFO:tasks.workunit.client.1.smithi203.stdout:9/276: getdents d8/d12/d14 0 2024-04-12T09:11:26.491 INFO:tasks.workunit.client.1.smithi203.stdout:9/277: stat d8/l22 0 2024-04-12T09:11:26.493 INFO:tasks.workunit.client.1.smithi203.stdout:3/284: dread d2/d8/d14/f27 [0,4194304] 0 2024-04-12T09:11:26.495 INFO:tasks.workunit.client.1.smithi203.stdout:6/304: fdatasync d1/d3/f25 0 2024-04-12T09:11:26.495 INFO:tasks.workunit.client.0.smithi117.stdout:1/905: dwrite d1/dbd/d3f/db/d16/f19 [0,4194304] 0 2024-04-12T09:11:26.496 INFO:tasks.workunit.client.0.smithi117.stdout:1/906: chown d1/d3b/f8f 709 1 2024-04-12T09:11:26.497 INFO:tasks.workunit.client.1.smithi203.stdout:6/305: read d1/d3/d12/f1f [6334347,81138] 0 2024-04-12T09:11:26.497 INFO:tasks.workunit.client.0.smithi117.stdout:6/897: write d8/fc [242046,18252] 0 2024-04-12T09:11:26.499 INFO:tasks.workunit.client.0.smithi117.stdout:6/898: write d8/d2a/d60/d89/f11d [33440,62086] 0 2024-04-12T09:11:26.503 INFO:tasks.workunit.client.0.smithi117.stdout:2/836: truncate d0/d43/d30/d41/f72 3806238 0 2024-04-12T09:11:26.503 INFO:tasks.workunit.client.0.smithi117.stdout:5/990: dread d2/d3/de/f2a [0,4194304] 0 2024-04-12T09:11:26.504 INFO:tasks.workunit.client.1.smithi203.stdout:0/335: symlink d0/dd/l67 0 2024-04-12T09:11:26.504 INFO:tasks.workunit.client.0.smithi117.stdout:2/837: write d0/d43/d53/d61/d8d/f115 [208507,127922] 0 2024-04-12T09:11:26.505 INFO:tasks.workunit.client.1.smithi203.stdout:5/381: creat d0/d6/d16/d9/d86/f8f x:0 0 0 2024-04-12T09:11:26.507 INFO:tasks.workunit.client.0.smithi117.stdout:1/907: truncate d1/dc3/ffb 891573 0 2024-04-12T09:11:26.509 INFO:tasks.workunit.client.0.smithi117.stdout:5/991: rename d2/d3/l29 to d2/d3/de/d1e/d35/l143 0 2024-04-12T09:11:26.510 INFO:tasks.workunit.client.0.smithi117.stdout:5/992: chown d2/d3/de/d1e 236 1 2024-04-12T09:11:26.510 INFO:tasks.workunit.client.1.smithi203.stdout:0/336: dwrite d0/dd/f46 [0,4194304] 0 2024-04-12T09:11:26.513 INFO:tasks.workunit.client.1.smithi203.stdout:4/291: mkdir d1a/d20/d5f 0 2024-04-12T09:11:26.514 INFO:tasks.workunit.client.0.smithi117.stdout:2/838: rename d0/d4/cd1 to d0/d96/c119 0 2024-04-12T09:11:26.514 INFO:tasks.workunit.client.1.smithi203.stdout:4/292: chown d1a/d20/c5b 3 1 2024-04-12T09:11:26.518 INFO:tasks.workunit.client.1.smithi203.stdout:9/278: fdatasync d8/d12/d14/f1d 0 2024-04-12T09:11:26.518 INFO:tasks.workunit.client.1.smithi203.stdout:4/293: readlink d1a/d21/d22/d2e/l56 0 2024-04-12T09:11:26.519 INFO:tasks.workunit.client.0.smithi117.stdout:5/993: creat d2/d3/dd/d39/d83/dc8/dd1/dd2/df0/df1/d11f/d10c/f144 x:0 0 0 2024-04-12T09:11:26.521 INFO:tasks.workunit.client.1.smithi203.stdout:9/279: dwrite d8/d12/d23/d29/d2c/f5c [0,4194304] 0 2024-04-12T09:11:26.523 INFO:tasks.workunit.client.1.smithi203.stdout:1/344: truncate df/d20/d2b/f44 1540418 0 2024-04-12T09:11:26.523 INFO:tasks.workunit.client.1.smithi203.stdout:7/285: mknod d0/d4/d1c/d61/c6d 0 2024-04-12T09:11:26.524 INFO:tasks.workunit.client.1.smithi203.stdout:7/286: dread - d0/d4/d1c/d3b/d4c/f59 zero size 2024-04-12T09:11:26.525 INFO:tasks.workunit.client.0.smithi117.stdout:1/908: creat d1/dbd/f11a x:0 0 0 2024-04-12T09:11:26.531 INFO:tasks.workunit.client.1.smithi203.stdout:8/283: mknod d4/d8/d1c/d48/c58 0 2024-04-12T09:11:26.535 INFO:tasks.workunit.client.1.smithi203.stdout:0/337: creat d0/d1d/f68 x:0 0 0 2024-04-12T09:11:26.536 INFO:tasks.workunit.client.0.smithi117.stdout:1/909: symlink d1/dbd/d3f/db/d1d/l11b 0 2024-04-12T09:11:26.537 INFO:tasks.workunit.client.0.smithi117.stdout:5/994: creat d2/d3/de/d1e/d46/f145 x:0 0 0 2024-04-12T09:11:26.538 INFO:tasks.workunit.client.0.smithi117.stdout:5/995: chown d2/d3/de/d1e/d46/d96/d9c 717799 1 2024-04-12T09:11:26.542 INFO:tasks.workunit.client.1.smithi203.stdout:3/285: mkdir d2/d8/d59 0 2024-04-12T09:11:26.544 INFO:tasks.workunit.client.0.smithi117.stdout:5/996: unlink d2/f3d 0 2024-04-12T09:11:26.547 INFO:tasks.workunit.client.1.smithi203.stdout:9/280: unlink f3 0 2024-04-12T09:11:26.548 INFO:tasks.workunit.client.0.smithi117.stdout:5/997: dread d2/d3/de/d1e/d35/fb4 [0,4194304] 0 2024-04-12T09:11:26.549 INFO:tasks.workunit.client.1.smithi203.stdout:7/287: rmdir d0/d34 39 2024-04-12T09:11:26.550 INFO:tasks.workunit.client.0.smithi117.stdout:2/839: dread d0/df/f7a [0,4194304] 0 2024-04-12T09:11:26.551 INFO:tasks.workunit.client.1.smithi203.stdout:2/315: creat d0/d2e/f71 x:0 0 0 2024-04-12T09:11:26.552 INFO:tasks.workunit.client.0.smithi117.stdout:5/998: mkdir d2/d3/de/d1e/d66/dbe/d105/d146 0 2024-04-12T09:11:26.553 INFO:tasks.workunit.client.0.smithi117.stdout:1/910: write d1/dbd/d3f/f9b [4763217,20296] 0 2024-04-12T09:11:26.554 INFO:tasks.workunit.client.0.smithi117.stdout:1/911: stat d1/dbd/d3f/db/d16/db6/da9/d9a/d71/la1 0 2024-04-12T09:11:26.555 INFO:tasks.workunit.client.1.smithi203.stdout:7/288: dwrite d0/f40 [0,4194304] 0 2024-04-12T09:11:26.555 INFO:tasks.workunit.client.0.smithi117.stdout:2/840: creat d0/d43/d30/d41/f11a x:0 0 0 2024-04-12T09:11:26.555 INFO:tasks.workunit.client.1.smithi203.stdout:8/284: write d4/d8/f38 [344365,130386] 0 2024-04-12T09:11:26.557 INFO:tasks.workunit.client.1.smithi203.stdout:5/382: unlink d0/d6/d11/d4a/l54 0 2024-04-12T09:11:26.558 INFO:tasks.workunit.client.0.smithi117.stdout:5/999: fsync d2/d3/de/d1e/f44 0 2024-04-12T09:11:26.561 INFO:tasks.workunit.client.0.smithi117.stdout:1/912: dwrite d1/dc3/f10c [0,4194304] 0 2024-04-12T09:11:26.562 INFO:tasks.workunit.client.1.smithi203.stdout:8/285: dread d4/d8/d19/f3a [0,4194304] 0 2024-04-12T09:11:26.563 INFO:tasks.workunit.client.1.smithi203.stdout:4/294: mkdir d1a/d21/d60 0 2024-04-12T09:11:26.564 INFO:tasks.workunit.client.1.smithi203.stdout:5/383: dwrite d0/d6/d11/d18/d1a/d23/f4f [0,4194304] 0 2024-04-12T09:11:26.570 INFO:tasks.workunit.client.0.smithi117.stdout:1/913: mkdir d1/dbd/d3f/d72/d11c 0 2024-04-12T09:11:26.571 INFO:tasks.workunit.client.1.smithi203.stdout:4/295: dwrite d1a/d21/d22/d2e/f43 [0,4194304] 0 2024-04-12T09:11:26.573 INFO:tasks.workunit.client.1.smithi203.stdout:9/281: rmdir d8/d12/d23 39 2024-04-12T09:11:26.574 INFO:tasks.workunit.client.1.smithi203.stdout:9/282: chown d8/d12/d14/f46 482 1 2024-04-12T09:11:26.574 INFO:tasks.workunit.client.1.smithi203.stdout:1/345: creat df/d20/d54/d5d/d58/f66 x:0 0 0 2024-04-12T09:11:26.580 INFO:tasks.workunit.client.0.smithi117.stdout:1/914: symlink d1/dbd/d3f/db/d16/db6/da9/d9a/l11d 0 2024-04-12T09:11:26.582 INFO:tasks.workunit.client.1.smithi203.stdout:6/306: rename d1/d3/d4/f58 to d1/df/d1b/f66 0 2024-04-12T09:11:26.582 INFO:tasks.workunit.client.0.smithi117.stdout:2/841: dwrite d0/f73 [0,4194304] 0 2024-04-12T09:11:26.583 INFO:tasks.workunit.client.1.smithi203.stdout:6/307: dread - d1/d3/f29 zero size 2024-04-12T09:11:26.583 INFO:tasks.workunit.client.1.smithi203.stdout:7/289: symlink d0/d4/d1c/d61/l6e 0 2024-04-12T09:11:26.590 INFO:tasks.workunit.client.1.smithi203.stdout:3/286: link d2/d8/d14/d23/d35/d4c/f54 d2/d8/d14/d23/d35/f5a 0 2024-04-12T09:11:26.591 INFO:tasks.workunit.client.0.smithi117.stdout:2/842: creat d0/d43/d53/d61/f11b x:0 0 0 2024-04-12T09:11:26.591 INFO:tasks.workunit.client.1.smithi203.stdout:3/287: chown d2/d8/d14/d23 15 1 2024-04-12T09:11:26.592 INFO:tasks.workunit.client.1.smithi203.stdout:5/384: symlink d0/d6/d16/d9/d14/d2d/l90 0 2024-04-12T09:11:26.592 INFO:tasks.workunit.client.0.smithi117.stdout:1/915: getdents d1/d96 0 2024-04-12T09:11:26.592 INFO:tasks.workunit.client.0.smithi117.stdout:1/916: chown d1 235682879 1 2024-04-12T09:11:26.642 INFO:tasks.workunit.client.0.smithi117.stdout:2/843: creat d0/de6/f11c x:0 0 0 2024-04-12T09:11:26.643 INFO:tasks.workunit.client.0.smithi117.stdout:2/844: write d0/f10f [621509,30009] 0 2024-04-12T09:11:26.643 INFO:tasks.workunit.client.1.smithi203.stdout:4/296: mknod d1a/d20/d5d/d2c/c61 0 2024-04-12T09:11:26.644 INFO:tasks.workunit.client.0.smithi117.stdout:2/845: fsync d0/d43/d53/d61/d8d/f115 0 2024-04-12T09:11:26.644 INFO:tasks.workunit.client.0.smithi117.stdout:2/846: chown d0/d4/ddb/d111 426201289 1 2024-04-12T09:11:26.646 INFO:tasks.workunit.client.1.smithi203.stdout:1/346: mkdir df/d20/d54/d5d/d67 0 2024-04-12T09:11:26.649 INFO:tasks.workunit.client.1.smithi203.stdout:2/316: rename d0/d2e/l63 to d0/d19/l72 0 2024-04-12T09:11:26.649 INFO:tasks.workunit.client.1.smithi203.stdout:8/286: write d4/d8/f50 [1974608,68459] 0 2024-04-12T09:11:26.650 INFO:tasks.workunit.client.0.smithi117.stdout:2/847: mknod d0/d43/d53/d61/d66/c11d 0 2024-04-12T09:11:26.653 INFO:tasks.workunit.client.0.smithi117.stdout:1/917: creat d1/dbd/d3f/db/d16/db6/f11e x:0 0 0 2024-04-12T09:11:26.656 INFO:tasks.workunit.client.0.smithi117.stdout:2/848: unlink d0/d43/d30/c37 0 2024-04-12T09:11:26.659 INFO:tasks.workunit.client.1.smithi203.stdout:0/338: link d0/d1d/d2f/f42 d0/d48/f69 0 2024-04-12T09:11:26.659 INFO:tasks.workunit.client.0.smithi117.stdout:1/918: dread d1/d64/d45/d4c/d94/fb7 [0,4194304] 0 2024-04-12T09:11:26.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:26 smithi117 ceph-mon[29277]: pgmap v23: 65 pgs: 65 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 50 MiB/s rd, 138 MiB/s wr, 340 op/s 2024-04-12T09:11:26.660 INFO:tasks.workunit.client.1.smithi203.stdout:0/339: write d0/d1d/f5f [640184,130658] 0 2024-04-12T09:11:26.662 INFO:tasks.workunit.client.1.smithi203.stdout:3/288: unlink d2/d8/d14/d23/f2a 0 2024-04-12T09:11:26.665 INFO:tasks.workunit.client.0.smithi117.stdout:2/849: symlink d0/d43/d4b/l11e 0 2024-04-12T09:11:26.666 INFO:tasks.workunit.client.1.smithi203.stdout:9/283: creat d8/d12/d23/d38/f6c x:0 0 0 2024-04-12T09:11:26.669 INFO:tasks.workunit.client.0.smithi117.stdout:2/850: truncate d0/d4/d10/d27/d9a/f113 960873 0 2024-04-12T09:11:26.670 INFO:tasks.workunit.client.0.smithi117.stdout:1/919: creat d1/d64/d111/f11f x:0 0 0 2024-04-12T09:11:26.672 INFO:tasks.workunit.client.1.smithi203.stdout:2/317: creat d0/d3/d47/f73 x:0 0 0 2024-04-12T09:11:26.673 INFO:tasks.workunit.client.0.smithi117.stdout:2/851: creat d0/d43/d30/d41/dfa/f11f x:0 0 0 2024-04-12T09:11:26.674 INFO:tasks.workunit.client.0.smithi117.stdout:2/852: read d0/f73 [213469,77690] 0 2024-04-12T09:11:26.674 INFO:tasks.workunit.client.0.smithi117.stdout:2/853: chown d0/d43/d53/d61/d8d 5 1 2024-04-12T09:11:26.675 INFO:tasks.workunit.client.1.smithi203.stdout:8/287: creat d4/d8/d1c/d48/f59 x:0 0 0 2024-04-12T09:11:26.679 INFO:tasks.workunit.client.1.smithi203.stdout:4/297: write d1a/d21/f33 [458179,73009] 0 2024-04-12T09:11:26.680 INFO:tasks.workunit.client.0.smithi117.stdout:1/920: dread d1/d64/f99 [0,4194304] 0 2024-04-12T09:11:26.680 INFO:tasks.workunit.client.1.smithi203.stdout:8/288: dwrite d4/d8/d19/f25 [0,4194304] 0 2024-04-12T09:11:26.681 INFO:tasks.workunit.client.1.smithi203.stdout:8/289: chown d4/d8/d19/f25 3831 1 2024-04-12T09:11:26.682 INFO:tasks.workunit.client.0.smithi117.stdout:2/854: rename d0/d43/c38 to d0/df/de1/c120 0 2024-04-12T09:11:26.683 INFO:tasks.workunit.client.1.smithi203.stdout:0/340: fdatasync d0/d1d/d2f/f42 0 2024-04-12T09:11:26.685 INFO:tasks.workunit.client.1.smithi203.stdout:3/289: read d2/fa [7930970,54881] 0 2024-04-12T09:11:26.685 INFO:tasks.workunit.client.1.smithi203.stdout:2/318: truncate d0/d3/fd 1229366 0 2024-04-12T09:11:26.686 INFO:tasks.workunit.client.1.smithi203.stdout:6/308: fdatasync d1/df/d1b/d3b/f44 0 2024-04-12T09:11:26.692 INFO:tasks.workunit.client.1.smithi203.stdout:8/290: creat d4/f5a x:0 0 0 2024-04-12T09:11:26.695 INFO:tasks.workunit.client.1.smithi203.stdout:1/347: creat df/d2d/f68 x:0 0 0 2024-04-12T09:11:26.697 INFO:tasks.workunit.client.1.smithi203.stdout:5/385: rename d0/d6/d11/d4a/f8b to d0/d6/d11/d18/d1a/f91 0 2024-04-12T09:11:26.697 INFO:tasks.workunit.client.1.smithi203.stdout:0/341: dread d0/d1d/d2f/d17/fa [0,4194304] 0 2024-04-12T09:11:26.698 INFO:tasks.workunit.client.1.smithi203.stdout:2/319: mkdir d0/d14/d74 0 2024-04-12T09:11:26.698 INFO:tasks.workunit.client.1.smithi203.stdout:5/386: write d0/d6/d16/d9/f10 [370987,17418] 0 2024-04-12T09:11:26.699 INFO:tasks.workunit.client.1.smithi203.stdout:5/387: chown d0/d6/d11/d1e/d65 8332 1 2024-04-12T09:11:26.700 INFO:tasks.workunit.client.1.smithi203.stdout:7/290: getdents d0 0 2024-04-12T09:11:26.700 INFO:tasks.workunit.client.0.smithi117.stdout:1/921: write d1/d64/f93 [418704,99772] 0 2024-04-12T09:11:26.702 INFO:tasks.workunit.client.1.smithi203.stdout:7/291: write d0/d4/d1c/d3b/d4c/f55 [269504,4088] 0 2024-04-12T09:11:26.703 INFO:tasks.workunit.client.1.smithi203.stdout:7/292: write d0/f40 [3885400,29932] 0 2024-04-12T09:11:26.703 INFO:tasks.workunit.client.1.smithi203.stdout:5/388: dread d0/d6/d11/d38/f84 [0,4194304] 0 2024-04-12T09:11:26.704 INFO:tasks.workunit.client.0.smithi117.stdout:1/922: creat d1/dcb/f120 x:0 0 0 2024-04-12T09:11:26.704 INFO:tasks.workunit.client.1.smithi203.stdout:4/298: write d1a/d21/d22/f25 [3612769,61624] 0 2024-04-12T09:11:26.706 INFO:tasks.workunit.client.1.smithi203.stdout:7/293: chown d0/d4/cd 1955764798 1 2024-04-12T09:11:26.706 INFO:tasks.workunit.client.1.smithi203.stdout:4/299: write d1a/d21/f33 [153560,13615] 0 2024-04-12T09:11:26.708 INFO:tasks.workunit.client.1.smithi203.stdout:4/300: chown d1a/d21/d22/f25 27 1 2024-04-12T09:11:26.710 INFO:tasks.workunit.client.0.smithi117.stdout:1/923: truncate d1/d3b/f4a 6096854 0 2024-04-12T09:11:26.711 INFO:tasks.workunit.client.1.smithi203.stdout:0/342: rmdir d0/dd 39 2024-04-12T09:11:26.712 INFO:tasks.workunit.client.1.smithi203.stdout:1/348: dwrite df/f16 [0,4194304] 0 2024-04-12T09:11:26.712 INFO:tasks.workunit.client.0.smithi117.stdout:1/924: symlink d1/dbd/d3f/db/d1d/d10e/l121 0 2024-04-12T09:11:26.713 INFO:tasks.workunit.client.1.smithi203.stdout:1/349: chown df/d20/f41 22883737 1 2024-04-12T09:11:26.714 INFO:tasks.workunit.client.1.smithi203.stdout:3/290: creat d2/d8/d59/f5b x:0 0 0 2024-04-12T09:11:26.716 INFO:tasks.workunit.client.1.smithi203.stdout:6/309: creat d1/d3/d26/d5d/f67 x:0 0 0 2024-04-12T09:11:26.718 INFO:tasks.workunit.client.1.smithi203.stdout:8/291: creat d4/d8/d19/d53/f5b x:0 0 0 2024-04-12T09:11:26.718 INFO:tasks.workunit.client.1.smithi203.stdout:5/389: dread d0/d6/f46 [0,4194304] 0 2024-04-12T09:11:26.719 INFO:tasks.workunit.client.1.smithi203.stdout:8/292: fdatasync d4/d8/d1c/f30 0 2024-04-12T09:11:26.721 INFO:tasks.workunit.client.1.smithi203.stdout:7/294: mknod d0/d4/d5d/c6f 0 2024-04-12T09:11:26.726 INFO:tasks.workunit.client.1.smithi203.stdout:8/293: dread d4/f1f [0,4194304] 0 2024-04-12T09:11:26.737 INFO:tasks.workunit.client.0.smithi117.stdout:1/925: dread d1/f77 [0,4194304] 0 2024-04-12T09:11:26.739 INFO:tasks.workunit.client.1.smithi203.stdout:9/284: rename d8/f15 to d8/d12/d23/d29/d2c/d40/f6d 0 2024-04-12T09:11:26.743 INFO:tasks.workunit.client.1.smithi203.stdout:0/343: write d0/dd/f16 [5253837,104808] 0 2024-04-12T09:11:26.744 INFO:tasks.workunit.client.0.smithi117.stdout:1/926: symlink d1/dbd/d3f/d72/d11c/l122 0 2024-04-12T09:11:26.746 INFO:tasks.workunit.client.1.smithi203.stdout:2/320: link d0/d38/d43/f5b d0/d67/f75 0 2024-04-12T09:11:26.747 INFO:tasks.workunit.client.0.smithi117.stdout:1/927: mkdir d1/dbd/d3f/db/d1d/d78/dbc/d123 0 2024-04-12T09:11:26.748 INFO:tasks.workunit.client.1.smithi203.stdout:3/291: write d2/f30 [1373787,32928] 0 2024-04-12T09:11:26.750 INFO:tasks.workunit.client.1.smithi203.stdout:6/310: unlink d1/d3/f34 0 2024-04-12T09:11:26.757 INFO:tasks.workunit.client.1.smithi203.stdout:7/295: symlink d0/d4/d1c/d3b/l70 0 2024-04-12T09:11:26.758 INFO:tasks.workunit.client.1.smithi203.stdout:9/285: rmdir d8/d12/d23/d27 39 2024-04-12T09:11:26.759 INFO:tasks.workunit.client.1.smithi203.stdout:4/301: link d1a/d34/f46 d1a/d21/d22/f62 0 2024-04-12T09:11:26.760 INFO:tasks.workunit.client.0.smithi117.stdout:1/928: dread d1/dbd/f9f [0,4194304] 0 2024-04-12T09:11:26.760 INFO:tasks.workunit.client.1.smithi203.stdout:4/302: stat d1a/d20/f3d 0 2024-04-12T09:11:26.764 INFO:tasks.workunit.client.1.smithi203.stdout:3/292: write d2/f37 [82302,97319] 0 2024-04-12T09:11:26.765 INFO:tasks.workunit.client.1.smithi203.stdout:7/296: creat d0/d4/d1c/d5b/f71 x:0 0 0 2024-04-12T09:11:26.766 INFO:tasks.workunit.client.1.smithi203.stdout:9/286: mknod d8/d12/d23/d29/d2c/c6e 0 2024-04-12T09:11:26.766 INFO:tasks.workunit.client.1.smithi203.stdout:3/293: fsync d2/d8/d14/d23/f42 0 2024-04-12T09:11:26.770 INFO:tasks.workunit.client.1.smithi203.stdout:0/344: link d0/d1d/d2f/f42 d0/d1d/d2f/d4c/f6a 0 2024-04-12T09:11:26.771 INFO:tasks.workunit.client.1.smithi203.stdout:7/297: creat d0/d15/d2d/d5e/f72 x:0 0 0 2024-04-12T09:11:26.771 INFO:tasks.workunit.client.0.smithi117.stdout:1/929: write d1/dbd/f1a [4056813,15296] 0 2024-04-12T09:11:26.772 INFO:tasks.workunit.client.1.smithi203.stdout:9/287: mkdir d8/d3b/d6f 0 2024-04-12T09:11:26.772 INFO:tasks.workunit.client.1.smithi203.stdout:1/350: getdents df/d20/d54/d5d/d58 0 2024-04-12T09:11:26.773 INFO:tasks.workunit.client.1.smithi203.stdout:9/288: chown d8/d3b/c51 2027 1 2024-04-12T09:11:26.774 INFO:tasks.workunit.client.1.smithi203.stdout:2/321: rename d0/l6 to d0/d2e/d41/l76 0 2024-04-12T09:11:26.774 INFO:tasks.workunit.client.1.smithi203.stdout:9/289: read d8/d12/d23/f3a [21190,52934] 0 2024-04-12T09:11:26.774 INFO:tasks.workunit.client.1.smithi203.stdout:6/311: write d1/df/d1b/d3b/f5a [2325973,42491] 0 2024-04-12T09:11:26.775 INFO:tasks.workunit.client.1.smithi203.stdout:5/390: getdents d0/d6/d16/d9 0 2024-04-12T09:11:26.777 INFO:tasks.workunit.client.1.smithi203.stdout:3/294: rename d2/d8/d14/d23/d35/d4c/d2e to d2/d8/d14/d23/d35/d4c/d5c 0 2024-04-12T09:11:26.779 INFO:tasks.workunit.client.1.smithi203.stdout:7/298: mknod d0/d4/c73 0 2024-04-12T09:11:26.779 INFO:tasks.workunit.client.1.smithi203.stdout:5/391: write d0/d6/d11/d18/d1a/d23/f4f [498179,91955] 0 2024-04-12T09:11:26.779 INFO:tasks.workunit.client.1.smithi203.stdout:1/351: chown df/d2d/l37 7444 1 2024-04-12T09:11:26.780 INFO:tasks.workunit.client.1.smithi203.stdout:1/352: readlink df/l11 0 2024-04-12T09:11:26.780 INFO:tasks.workunit.client.1.smithi203.stdout:7/299: write d0/d4/d5d/f5c [6331265,33571] 0 2024-04-12T09:11:26.781 INFO:tasks.workunit.client.1.smithi203.stdout:3/295: truncate d2/d8/d14/d23/d35/d4c/d5c/f38 806018 0 2024-04-12T09:11:26.782 INFO:tasks.workunit.client.1.smithi203.stdout:2/322: creat d0/d38/f77 x:0 0 0 2024-04-12T09:11:26.783 INFO:tasks.workunit.client.1.smithi203.stdout:0/345: mkdir d0/dd/d5b/d6b 0 2024-04-12T09:11:26.784 INFO:tasks.workunit.client.1.smithi203.stdout:3/296: write d2/d8/f52 [763295,47880] 0 2024-04-12T09:11:26.784 INFO:tasks.workunit.client.1.smithi203.stdout:9/290: mkdir d8/d12/d23/d29/d2c/d70 0 2024-04-12T09:11:26.786 INFO:tasks.workunit.client.1.smithi203.stdout:6/312: mknod d1/df/d1b/d3b/d45/d55/c68 0 2024-04-12T09:11:26.787 INFO:tasks.workunit.client.1.smithi203.stdout:3/297: write d2/d8/f52 [1114989,104962] 0 2024-04-12T09:11:26.788 INFO:tasks.workunit.client.1.smithi203.stdout:1/353: dwrite df/f33 [0,4194304] 0 2024-04-12T09:11:26.788 INFO:tasks.workunit.client.1.smithi203.stdout:9/291: truncate d8/d12/d23/f26 1519255 0 2024-04-12T09:11:26.789 INFO:tasks.workunit.client.1.smithi203.stdout:6/313: write d1/d3/d4/f42 [4083631,57683] 0 2024-04-12T09:11:26.791 INFO:tasks.workunit.client.1.smithi203.stdout:7/300: creat d0/d4/d1c/d61/f74 x:0 0 0 2024-04-12T09:11:26.791 INFO:tasks.workunit.client.1.smithi203.stdout:6/314: readlink d1/d3/d26/d36/l59 0 2024-04-12T09:11:26.792 INFO:tasks.workunit.client.1.smithi203.stdout:7/301: chown d0/d38/f5a 1983 1 2024-04-12T09:11:26.792 INFO:tasks.workunit.client.1.smithi203.stdout:3/298: truncate d2/d8/d14/d23/d35/f5a 573006 0 2024-04-12T09:11:26.792 INFO:tasks.workunit.client.1.smithi203.stdout:2/323: rename d0/d2e/d41 to d0/d54/d61/d78 0 2024-04-12T09:11:26.793 INFO:tasks.workunit.client.1.smithi203.stdout:6/315: write d1/df/d1b/d3b/f5a [3041030,51464] 0 2024-04-12T09:11:26.794 INFO:tasks.workunit.client.1.smithi203.stdout:2/324: truncate d0/d3/f5f 501166 0 2024-04-12T09:11:26.794 INFO:tasks.workunit.client.1.smithi203.stdout:6/316: dread - d1/df/f38 zero size 2024-04-12T09:11:26.796 INFO:tasks.workunit.client.1.smithi203.stdout:0/346: creat d0/dd/d4d/f6c x:0 0 0 2024-04-12T09:11:26.800 INFO:tasks.workunit.client.1.smithi203.stdout:7/302: write d0/d4/d1c/d3b/f46 [943871,34264] 0 2024-04-12T09:11:26.801 INFO:tasks.workunit.client.1.smithi203.stdout:3/299: symlink d2/d51/l5d 0 2024-04-12T09:11:26.803 INFO:tasks.workunit.client.1.smithi203.stdout:2/325: creat d0/d54/d61/f79 x:0 0 0 2024-04-12T09:11:26.804 INFO:tasks.workunit.client.1.smithi203.stdout:1/354: mknod df/d2d/c69 0 2024-04-12T09:11:26.805 INFO:tasks.workunit.client.1.smithi203.stdout:5/392: link d0/d6/d16/d9/d14/f85 d0/d6/d11/d18/f92 0 2024-04-12T09:11:26.807 INFO:tasks.workunit.client.1.smithi203.stdout:3/300: stat d2/le 0 2024-04-12T09:11:26.809 INFO:tasks.workunit.client.1.smithi203.stdout:9/292: link d8/f58 d8/d12/d23/f71 0 2024-04-12T09:11:26.813 INFO:tasks.workunit.client.1.smithi203.stdout:9/293: read d8/d12/d23/f26 [860384,24044] 0 2024-04-12T09:11:26.815 INFO:tasks.workunit.client.1.smithi203.stdout:1/355: rename df/d20/c56 to df/c6a 0 2024-04-12T09:11:26.815 INFO:tasks.workunit.client.1.smithi203.stdout:2/326: dwrite d0/d3/f17 [4194304,4194304] 0 2024-04-12T09:11:26.815 INFO:tasks.workunit.client.1.smithi203.stdout:5/393: write d0/d6/d11/d18/f92 [369695,65831] 0 2024-04-12T09:11:26.816 INFO:tasks.workunit.client.1.smithi203.stdout:9/294: chown d8/d12/d23/d29/f31 124497 1 2024-04-12T09:11:26.817 INFO:tasks.workunit.client.1.smithi203.stdout:5/394: write d0/f21 [3792780,84150] 0 2024-04-12T09:11:26.823 INFO:tasks.workunit.client.1.smithi203.stdout:9/295: symlink d8/d12/d23/d38/l72 0 2024-04-12T09:11:26.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:26 smithi203 ceph-mon[36428]: pgmap v23: 65 pgs: 65 active+clean; 2.0 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 50 MiB/s rd, 138 MiB/s wr, 340 op/s 2024-04-12T09:11:26.826 INFO:tasks.workunit.client.1.smithi203.stdout:5/395: dread d0/d6/d16/d9/d14/d4b/f6b [0,4194304] 0 2024-04-12T09:11:26.826 INFO:tasks.workunit.client.1.smithi203.stdout:1/356: creat df/d20/d54/d5d/d67/f6b x:0 0 0 2024-04-12T09:11:26.829 INFO:tasks.workunit.client.1.smithi203.stdout:9/296: creat d8/d12/d3e/f73 x:0 0 0 2024-04-12T09:11:26.830 INFO:tasks.workunit.client.1.smithi203.stdout:5/396: unlink d0/d6/d11/d18/f92 0 2024-04-12T09:11:26.831 INFO:tasks.workunit.client.1.smithi203.stdout:3/301: dread d2/d8/d14/d23/f49 [0,4194304] 0 2024-04-12T09:11:26.831 INFO:tasks.workunit.client.1.smithi203.stdout:1/357: mkdir df/d20/d54/d5d/d6c 0 2024-04-12T09:11:26.832 INFO:tasks.workunit.client.1.smithi203.stdout:1/358: fdatasync df/d20/d54/f61 0 2024-04-12T09:11:26.833 INFO:tasks.workunit.client.1.smithi203.stdout:2/327: getdents d0/d3 0 2024-04-12T09:11:26.833 INFO:tasks.workunit.client.1.smithi203.stdout:1/359: fdatasync df/f16 0 2024-04-12T09:11:26.836 INFO:tasks.workunit.client.1.smithi203.stdout:5/397: creat d0/d6/f93 x:0 0 0 2024-04-12T09:11:26.837 INFO:tasks.workunit.client.1.smithi203.stdout:9/297: mkdir d8/d3b/d6f/d74 0 2024-04-12T09:11:26.840 INFO:tasks.workunit.client.1.smithi203.stdout:3/302: dwrite d2/d8/d14/d23/d35/d4c/d5c/f4d [0,4194304] 0 2024-04-12T09:11:26.841 INFO:tasks.workunit.client.1.smithi203.stdout:1/360: dread df/d20/f41 [0,4194304] 0 2024-04-12T09:11:26.842 INFO:tasks.workunit.client.1.smithi203.stdout:2/328: symlink d0/d2e/l7a 0 2024-04-12T09:11:26.843 INFO:tasks.workunit.client.1.smithi203.stdout:2/329: fsync d0/d38/f3b 0 2024-04-12T09:11:26.845 INFO:tasks.workunit.client.1.smithi203.stdout:5/398: truncate d0/d6/d11/d38/f84 13725 0 2024-04-12T09:11:26.845 INFO:tasks.workunit.client.1.smithi203.stdout:0/347: write d0/d1d/d2f/f1e [19653,123116] 0 2024-04-12T09:11:26.848 INFO:tasks.workunit.client.1.smithi203.stdout:7/303: write d0/f26 [127533,114546] 0 2024-04-12T09:11:26.849 INFO:tasks.workunit.client.1.smithi203.stdout:1/361: write df/d20/d54/d5d/d4a/f62 [108165,74577] 0 2024-04-12T09:11:26.851 INFO:tasks.workunit.client.1.smithi203.stdout:9/298: dwrite d8/f6b [0,4194304] 0 2024-04-12T09:11:26.851 INFO:tasks.workunit.client.1.smithi203.stdout:3/303: rename d2/d8/d14/d23/f47 to d2/d8/d59/f5e 0 2024-04-12T09:11:26.853 INFO:tasks.workunit.client.1.smithi203.stdout:5/399: symlink d0/d6/d11/d18/d2a/l94 0 2024-04-12T09:11:26.856 INFO:tasks.workunit.client.1.smithi203.stdout:9/299: write d8/fb [4238961,110700] 0 2024-04-12T09:11:26.856 INFO:tasks.workunit.client.1.smithi203.stdout:7/304: mkdir d0/d4/d54/d75 0 2024-04-12T09:11:26.857 INFO:tasks.workunit.client.1.smithi203.stdout:1/362: fsync df/d20/d2b/f51 0 2024-04-12T09:11:26.859 INFO:tasks.workunit.client.1.smithi203.stdout:7/305: symlink d0/d4/d1c/l76 0 2024-04-12T09:11:26.861 INFO:tasks.workunit.client.1.smithi203.stdout:1/363: chown df/d20/d2b/l55 5 1 2024-04-12T09:11:26.862 INFO:tasks.workunit.client.1.smithi203.stdout:7/306: write d0/f26 [1095095,44598] 0 2024-04-12T09:11:26.863 INFO:tasks.workunit.client.1.smithi203.stdout:3/304: symlink d2/d8/d14/d1b/d2f/l5f 0 2024-04-12T09:11:26.864 INFO:tasks.workunit.client.1.smithi203.stdout:5/400: dwrite d0/d6/d11/d1e/f78 [0,4194304] 0 2024-04-12T09:11:26.866 INFO:tasks.workunit.client.1.smithi203.stdout:7/307: chown d0/d4/d1c/d3b/f3f 381717 1 2024-04-12T09:11:26.866 INFO:tasks.workunit.client.1.smithi203.stdout:3/305: chown d2/le 30511 1 2024-04-12T09:11:26.866 INFO:tasks.workunit.client.1.smithi203.stdout:1/364: mkdir df/d2d/d6d 0 2024-04-12T09:11:26.868 INFO:tasks.workunit.client.1.smithi203.stdout:1/365: readlink df/d20/d2b/l38 0 2024-04-12T09:11:26.869 INFO:tasks.workunit.client.1.smithi203.stdout:3/306: chown d2/d8/d14/d23/d35/d4c/d5c/d55 9 1 2024-04-12T09:11:26.870 INFO:tasks.workunit.client.1.smithi203.stdout:1/366: dread - df/d20/d54/d5d/d67/f6b zero size 2024-04-12T09:11:26.872 INFO:tasks.workunit.client.1.smithi203.stdout:7/308: rename d0/d15/d2d/d5e/f72 to d0/d4/d54/f77 0 2024-04-12T09:11:26.874 INFO:tasks.workunit.client.1.smithi203.stdout:1/367: readlink df/d2d/l50 0 2024-04-12T09:11:26.879 INFO:tasks.workunit.client.1.smithi203.stdout:3/307: rmdir d2/d8 39 2024-04-12T09:11:26.879 INFO:tasks.workunit.client.1.smithi203.stdout:2/330: dread d0/f32 [4194304,4194304] 0 2024-04-12T09:11:26.880 INFO:tasks.workunit.client.1.smithi203.stdout:5/401: dwrite d0/d6/d11/d18/d1a/f3f [4194304,4194304] 0 2024-04-12T09:11:26.880 INFO:tasks.workunit.client.1.smithi203.stdout:0/348: dread d0/f4e [0,4194304] 0 2024-04-12T09:11:26.882 INFO:tasks.workunit.client.1.smithi203.stdout:7/309: getdents d0/d38/d51 0 2024-04-12T09:11:26.883 INFO:tasks.workunit.client.1.smithi203.stdout:5/402: fdatasync d0/d6/d11/d4a/f82 0 2024-04-12T09:11:26.883 INFO:tasks.workunit.client.1.smithi203.stdout:1/368: creat df/f6e x:0 0 0 2024-04-12T09:11:26.884 INFO:tasks.workunit.client.1.smithi203.stdout:7/310: write d0/d15/f4a [126719,95329] 0 2024-04-12T09:11:26.884 INFO:tasks.workunit.client.1.smithi203.stdout:1/369: dread - df/d20/d2b/f42 zero size 2024-04-12T09:11:26.885 INFO:tasks.workunit.client.1.smithi203.stdout:1/370: write df/f5b [391580,25665] 0 2024-04-12T09:11:26.888 INFO:tasks.workunit.client.1.smithi203.stdout:7/311: truncate d0/d4/f60 1425391 0 2024-04-12T09:11:26.893 INFO:tasks.workunit.client.1.smithi203.stdout:0/349: dwrite d0/f1a [12582912,4194304] 0 2024-04-12T09:11:26.909 INFO:tasks.workunit.client.0.smithi117.stdout:9/785: sync 2024-04-12T09:11:26.910 INFO:tasks.workunit.client.0.smithi117.stdout:7/751: sync 2024-04-12T09:11:26.910 INFO:tasks.workunit.client.0.smithi117.stdout:7/752: chown d0/d20/d4a/dce/dcf 2745540 1 2024-04-12T09:11:26.912 INFO:tasks.workunit.client.1.smithi203.stdout:5/403: mknod d0/d6/d16/d44/c95 0 2024-04-12T09:11:26.916 INFO:tasks.workunit.client.0.smithi117.stdout:7/753: mknod d0/d2/d45/d17/d23/dac/dad/d91/cec 0 2024-04-12T09:11:26.917 INFO:tasks.workunit.client.1.smithi203.stdout:7/312: creat d0/d4/d1c/d3b/f78 x:0 0 0 2024-04-12T09:11:26.917 INFO:tasks.workunit.client.1.smithi203.stdout:7/313: chown d0/d38/d51 262 1 2024-04-12T09:11:26.918 INFO:tasks.workunit.client.1.smithi203.stdout:0/350: symlink d0/d1d/d2f/d17/d19/l6d 0 2024-04-12T09:11:26.919 INFO:tasks.workunit.client.0.smithi117.stdout:7/754: symlink d0/d2/d1a/d4f/d9a/led 0 2024-04-12T09:11:26.922 INFO:tasks.workunit.client.1.smithi203.stdout:5/404: mknod d0/d6/d16/d9/d80/c96 0 2024-04-12T09:11:26.923 INFO:tasks.workunit.client.1.smithi203.stdout:1/371: mkdir df/d2d/d6f 0 2024-04-12T09:11:26.923 INFO:tasks.workunit.client.0.smithi117.stdout:7/755: truncate d0/d2/d1a/d49/f4e 995481 0 2024-04-12T09:11:26.924 INFO:tasks.workunit.client.1.smithi203.stdout:1/372: truncate df/d2d/f68 1011705 0 2024-04-12T09:11:26.924 INFO:tasks.workunit.client.1.smithi203.stdout:7/314: readlink d0/d15/l67 0 2024-04-12T09:11:26.925 INFO:tasks.workunit.client.0.smithi117.stdout:7/756: write d0/f1b [87768,119983] 0 2024-04-12T09:11:26.925 INFO:tasks.workunit.client.0.smithi117.stdout:9/786: dwrite d1/d8/df/d68/ddf/daf/f6f [0,4194304] 0 2024-04-12T09:11:26.926 INFO:tasks.workunit.client.1.smithi203.stdout:0/351: unlink d0/dd/l67 0 2024-04-12T09:11:26.929 INFO:tasks.workunit.client.1.smithi203.stdout:2/331: link d0/d38/c49 d0/d14/d23/d3d/c7b 0 2024-04-12T09:11:26.930 INFO:tasks.workunit.client.1.smithi203.stdout:7/315: dwrite d0/d15/f4a [0,4194304] 0 2024-04-12T09:11:26.930 INFO:tasks.workunit.client.1.smithi203.stdout:5/405: fdatasync d0/d6/d16/d9/d14/f25 0 2024-04-12T09:11:26.935 INFO:tasks.workunit.client.1.smithi203.stdout:5/406: readlink d0/d6/d11/l36 0 2024-04-12T09:11:26.936 INFO:tasks.workunit.client.0.smithi117.stdout:7/757: unlink d0/d2/d71/fcb 0 2024-04-12T09:11:26.939 INFO:tasks.workunit.client.1.smithi203.stdout:2/332: dwrite d0/d14/d1e/d2a/f52 [0,4194304] 0 2024-04-12T09:11:26.940 INFO:tasks.workunit.client.0.smithi117.stdout:9/787: symlink d1/d8/d5a/d6e/d71/lfd 0 2024-04-12T09:11:26.940 INFO:tasks.workunit.client.1.smithi203.stdout:2/333: chown d0/d3 48913 1 2024-04-12T09:11:26.942 INFO:tasks.workunit.client.1.smithi203.stdout:7/316: mkdir d0/d38/d79 0 2024-04-12T09:11:26.944 INFO:tasks.workunit.client.0.smithi117.stdout:7/758: chown d0/d2/f6f 25425 1 2024-04-12T09:11:26.945 INFO:tasks.workunit.client.0.smithi117.stdout:7/759: stat d0/d2/d45/d17/d23/d51/f87 0 2024-04-12T09:11:26.945 INFO:tasks.workunit.client.0.smithi117.stdout:9/788: mkdir d1/d8/d5a/d79/d91/db0/d8a/dfe 0 2024-04-12T09:11:26.948 INFO:tasks.workunit.client.1.smithi203.stdout:5/407: creat d0/d6/d16/d9/d30/d58/d74/d88/f97 x:0 0 0 2024-04-12T09:11:26.949 INFO:tasks.workunit.client.1.smithi203.stdout:5/408: readlink d0/d6/l7c 0 2024-04-12T09:11:26.950 INFO:tasks.workunit.client.1.smithi203.stdout:7/317: dwrite d0/d4/fe [0,4194304] 0 2024-04-12T09:11:26.951 INFO:tasks.workunit.client.1.smithi203.stdout:5/409: fsync d0/f21 0 2024-04-12T09:11:26.952 INFO:tasks.workunit.client.0.smithi117.stdout:9/789: link d1/d8/df/d68/ddf/daf/c62 d1/d8/d5a/dc2/cff 0 2024-04-12T09:11:26.955 INFO:tasks.workunit.client.1.smithi203.stdout:7/318: unlink d0/ff 0 2024-04-12T09:11:26.957 INFO:tasks.workunit.client.1.smithi203.stdout:2/334: dwrite d0/f1a [4194304,4194304] 0 2024-04-12T09:11:26.959 INFO:tasks.workunit.client.0.smithi117.stdout:9/790: dread d1/d8/d52/f6c [0,4194304] 0 2024-04-12T09:11:26.962 INFO:tasks.workunit.client.0.smithi117.stdout:9/791: getdents d1/d8/df/d3e 0 2024-04-12T09:11:26.964 INFO:tasks.workunit.client.1.smithi203.stdout:5/410: rmdir d0/d6/d11/d1e/d65 0 2024-04-12T09:11:26.964 INFO:tasks.workunit.client.0.smithi117.stdout:9/792: creat d1/d8/d52/f100 x:0 0 0 2024-04-12T09:11:26.965 INFO:tasks.workunit.client.1.smithi203.stdout:2/335: dwrite d0/d14/d1e/f2b [0,4194304] 0 2024-04-12T09:11:26.966 INFO:tasks.workunit.client.0.smithi117.stdout:9/793: mkdir d1/d8/df/d1b/d101 0 2024-04-12T09:11:26.968 INFO:tasks.workunit.client.1.smithi203.stdout:2/336: mknod d0/d54/d61/c7c 0 2024-04-12T09:11:26.969 INFO:tasks.workunit.client.1.smithi203.stdout:2/337: fsync d0/d14/d1e/d2a/f5d 0 2024-04-12T09:11:26.972 INFO:tasks.workunit.client.1.smithi203.stdout:2/338: creat d0/d14/d74/f7d x:0 0 0 2024-04-12T09:11:26.975 INFO:tasks.workunit.client.1.smithi203.stdout:2/339: symlink d0/d14/d74/l7e 0 2024-04-12T09:11:26.978 INFO:tasks.workunit.client.1.smithi203.stdout:2/340: write d0/d14/f22 [653266,26715] 0 2024-04-12T09:11:26.980 INFO:tasks.workunit.client.1.smithi203.stdout:1/373: dwrite df/f19 [0,4194304] 0 2024-04-12T09:11:26.983 INFO:tasks.workunit.client.0.smithi117.stdout:7/760: dwrite d0/d2/d45/d17/f31 [0,4194304] 0 2024-04-12T09:11:26.988 INFO:tasks.workunit.client.1.smithi203.stdout:7/319: chown d0/d15/d2d 311952288 1 2024-04-12T09:11:26.990 INFO:tasks.workunit.client.1.smithi203.stdout:0/352: dwrite d0/d1d/d2f/d4c/f6a [0,4194304] 0 2024-04-12T09:11:26.990 INFO:tasks.workunit.client.1.smithi203.stdout:2/341: mkdir d0/d54/d61/d78/d7f 0 2024-04-12T09:11:26.991 INFO:tasks.workunit.client.0.smithi117.stdout:9/794: write d1/d8/df/d3e/f32 [926597,58361] 0 2024-04-12T09:11:26.992 INFO:tasks.workunit.client.0.smithi117.stdout:7/761: link d0/d2/d1a/d4f/dbc/fda d0/d2/d45/d17/d23/d50/d5c/fee 0 2024-04-12T09:11:26.994 INFO:tasks.workunit.client.1.smithi203.stdout:2/342: write d0/d38/f3e [224918,70565] 0 2024-04-12T09:11:26.996 INFO:tasks.workunit.client.1.smithi203.stdout:2/343: dread - d0/d14/d1e/d2a/f5d zero size 2024-04-12T09:11:26.997 INFO:tasks.workunit.client.0.smithi117.stdout:9/795: link d1/d8/d5a/d79/d91/la1 d1/d8/df/d68/ddf/l102 0 2024-04-12T09:11:26.998 INFO:tasks.workunit.client.1.smithi203.stdout:0/353: dread d0/d1d/d2f/d4c/f6a [0,4194304] 0 2024-04-12T09:11:26.998 INFO:tasks.workunit.client.1.smithi203.stdout:0/354: dread - d0/dd/d4d/f6c zero size 2024-04-12T09:11:27.000 INFO:tasks.workunit.client.0.smithi117.stdout:9/796: symlink d1/d8/dd5/l103 0 2024-04-12T09:11:27.002 INFO:tasks.workunit.client.1.smithi203.stdout:5/411: dread d0/d6/fe [0,4194304] 0 2024-04-12T09:11:27.003 INFO:tasks.workunit.client.1.smithi203.stdout:2/344: symlink d0/d14/d23/l80 0 2024-04-12T09:11:27.004 INFO:tasks.workunit.client.1.smithi203.stdout:5/412: read d0/d6/d16/d44/f5c [2257089,40979] 0 2024-04-12T09:11:27.007 INFO:tasks.workunit.client.1.smithi203.stdout:0/355: dwrite d0/d1d/f68 [0,4194304] 0 2024-04-12T09:11:27.008 INFO:tasks.workunit.client.1.smithi203.stdout:5/413: read d0/d6/d11/d18/f3b [7576906,5299] 0 2024-04-12T09:11:27.009 INFO:tasks.workunit.client.1.smithi203.stdout:2/345: creat d0/d54/d61/d78/f81 x:0 0 0 2024-04-12T09:11:27.010 INFO:tasks.workunit.client.1.smithi203.stdout:2/346: fdatasync d0/d54/f69 0 2024-04-12T09:11:27.013 INFO:tasks.workunit.client.1.smithi203.stdout:0/356: mknod d0/d1d/d2f/d4c/c6e 0 2024-04-12T09:11:27.015 INFO:tasks.workunit.client.1.smithi203.stdout:2/347: mkdir d0/d54/d61/d82 0 2024-04-12T09:11:27.016 INFO:tasks.workunit.client.1.smithi203.stdout:5/414: getdents d0/d6/d16/d9/d30/d89 0 2024-04-12T09:11:27.018 INFO:tasks.workunit.client.1.smithi203.stdout:0/357: mkdir d0/d1d/d2f/d17/d19/d6f 0 2024-04-12T09:11:27.019 INFO:tasks.workunit.client.1.smithi203.stdout:2/348: creat d0/d14/d23/d33/f83 x:0 0 0 2024-04-12T09:11:27.026 INFO:tasks.workunit.client.1.smithi203.stdout:5/415: dwrite d0/d6/d16/d44/f5c [0,4194304] 0 2024-04-12T09:11:27.026 INFO:tasks.workunit.client.1.smithi203.stdout:0/358: rename d0/d1d/d2f/d17/d19/f5c to d0/dd/f70 0 2024-04-12T09:11:27.028 INFO:tasks.workunit.client.1.smithi203.stdout:1/374: dread df/f2a [0,4194304] 0 2024-04-12T09:11:27.029 INFO:tasks.workunit.client.1.smithi203.stdout:0/359: chown d0/d1d/d2f/f51 236666 1 2024-04-12T09:11:27.030 INFO:tasks.workunit.client.1.smithi203.stdout:4/303: sync 2024-04-12T09:11:27.030 INFO:tasks.workunit.client.1.smithi203.stdout:8/294: sync 2024-04-12T09:11:27.030 INFO:tasks.workunit.client.1.smithi203.stdout:3/308: sync 2024-04-12T09:11:27.030 INFO:tasks.workunit.client.1.smithi203.stdout:9/300: sync 2024-04-12T09:11:27.030 INFO:tasks.workunit.client.1.smithi203.stdout:6/317: sync 2024-04-12T09:11:27.035 INFO:tasks.workunit.client.0.smithi117.stdout:9/797: write d1/d8/fb6 [681407,51054] 0 2024-04-12T09:11:27.037 INFO:tasks.workunit.client.1.smithi203.stdout:1/375: symlink df/d20/d54/d5d/d4a/l70 0 2024-04-12T09:11:27.037 INFO:tasks.workunit.client.0.smithi117.stdout:7/762: dwrite d0/f2b [4194304,4194304] 0 2024-04-12T09:11:27.037 INFO:tasks.workunit.client.0.smithi117.stdout:9/798: chown d1/d8/df/d7d/d7e/f4f 149741618 1 2024-04-12T09:11:27.038 INFO:tasks.workunit.client.0.smithi117.stdout:7/763: chown d0/da/d7c/dae 38588915 1 2024-04-12T09:11:27.046 INFO:tasks.workunit.client.1.smithi203.stdout:8/295: mknod d4/d8/d37/c5c 0 2024-04-12T09:11:27.047 INFO:tasks.workunit.client.1.smithi203.stdout:8/296: write d4/d8/d1c/f2c [1327413,115038] 0 2024-04-12T09:11:27.048 INFO:tasks.workunit.client.1.smithi203.stdout:8/297: write d4/d8/d19/f2e [4329702,78206] 0 2024-04-12T09:11:27.052 INFO:tasks.workunit.client.1.smithi203.stdout:9/301: rmdir d8/d12/d23/d29/d2c/d5d 39 2024-04-12T09:11:27.053 INFO:tasks.workunit.client.1.smithi203.stdout:3/309: truncate d2/f18 451524 0 2024-04-12T09:11:27.055 INFO:tasks.workunit.client.1.smithi203.stdout:1/376: mknod df/d20/d2b/c71 0 2024-04-12T09:11:27.056 INFO:tasks.workunit.client.1.smithi203.stdout:4/304: symlink d1a/d21/l63 0 2024-04-12T09:11:27.061 INFO:tasks.workunit.client.1.smithi203.stdout:4/305: dwrite d1a/d2b/f3a [0,4194304] 0 2024-04-12T09:11:27.062 INFO:tasks.workunit.client.1.smithi203.stdout:4/306: chown d1a/d20/f2a 51 1 2024-04-12T09:11:27.063 INFO:tasks.workunit.client.1.smithi203.stdout:2/349: truncate d0/d14/f22 6232217 0 2024-04-12T09:11:27.064 INFO:tasks.workunit.client.0.smithi117.stdout:4/892: sync 2024-04-12T09:11:27.067 INFO:tasks.workunit.client.1.smithi203.stdout:8/298: rename d4/d4a to d4/d8/d1c/d5d 0 2024-04-12T09:11:27.067 INFO:tasks.workunit.client.1.smithi203.stdout:2/350: read d0/f1a [1963055,34638] 0 2024-04-12T09:11:27.070 INFO:tasks.workunit.client.1.smithi203.stdout:9/302: mknod d8/d3b/d6f/c75 0 2024-04-12T09:11:27.072 INFO:tasks.workunit.client.1.smithi203.stdout:2/351: dread d0/d14/d1e/d2a/f52 [0,4194304] 0 2024-04-12T09:11:27.074 INFO:tasks.workunit.client.1.smithi203.stdout:7/320: write d0/d15/f19 [56355,10078] 0 2024-04-12T09:11:27.075 INFO:tasks.workunit.client.0.smithi117.stdout:7/764: truncate d0/d2/d96/d98/fd3 572449 0 2024-04-12T09:11:27.075 INFO:tasks.workunit.client.0.smithi117.stdout:7/765: chown d0/da/l1f 3972002 1 2024-04-12T09:11:27.076 INFO:tasks.workunit.client.0.smithi117.stdout:4/893: getdents d0/d5/d3b 0 2024-04-12T09:11:27.078 INFO:tasks.workunit.client.1.smithi203.stdout:2/352: dwrite d0/d3/f17 [0,4194304] 0 2024-04-12T09:11:27.079 INFO:tasks.workunit.client.1.smithi203.stdout:2/353: truncate d0/d38/d43/f5b 5099179 0 2024-04-12T09:11:27.079 INFO:tasks.workunit.client.1.smithi203.stdout:8/299: mkdir d4/d8/d1c/d48/d5e 0 2024-04-12T09:11:27.080 INFO:tasks.workunit.client.1.smithi203.stdout:6/318: write d1/d3/d4/f1d [4964467,124273] 0 2024-04-12T09:11:27.082 INFO:tasks.workunit.client.0.smithi117.stdout:4/894: creat d0/d5/d25/dfd/d107/da7/dcd/dcf/f122 x:0 0 0 2024-04-12T09:11:27.083 INFO:tasks.workunit.client.1.smithi203.stdout:9/303: creat d8/d12/d3e/f76 x:0 0 0 2024-04-12T09:11:27.084 INFO:tasks.workunit.client.1.smithi203.stdout:3/310: creat d2/d8/d59/f60 x:0 0 0 2024-04-12T09:11:27.085 INFO:tasks.workunit.client.1.smithi203.stdout:3/311: chown d2 1194 1 2024-04-12T09:11:27.086 INFO:tasks.workunit.client.0.smithi117.stdout:4/895: rmdir d0/d72 39 2024-04-12T09:11:27.088 INFO:tasks.workunit.client.1.smithi203.stdout:1/377: mknod df/d2d/d6f/c72 0 2024-04-12T09:11:27.088 INFO:tasks.workunit.client.1.smithi203.stdout:1/378: readlink l8 0 2024-04-12T09:11:27.090 INFO:tasks.workunit.client.1.smithi203.stdout:5/416: link d0/d6/d11/d18/d2a/l7e d0/d6/d11/d18/l98 0 2024-04-12T09:11:27.092 INFO:tasks.workunit.client.0.smithi117.stdout:4/896: fdatasync d0/d5/f3f 0 2024-04-12T09:11:27.095 INFO:tasks.workunit.client.1.smithi203.stdout:0/360: truncate d0/d1d/d2f/f33 2477619 0 2024-04-12T09:11:27.096 INFO:tasks.workunit.client.1.smithi203.stdout:0/361: chown d0/f2c 119 1 2024-04-12T09:11:27.098 INFO:tasks.workunit.client.0.smithi117.stdout:9/799: write d1/f61 [804079,105672] 0 2024-04-12T09:11:27.099 INFO:tasks.workunit.client.1.smithi203.stdout:2/354: creat d0/d14/d74/f84 x:0 0 0 2024-04-12T09:11:27.099 INFO:tasks.workunit.client.1.smithi203.stdout:2/355: chown d0/d67/f6c 2584077 1 2024-04-12T09:11:27.101 INFO:tasks.workunit.client.1.smithi203.stdout:6/319: fdatasync d1/df/f51 0 2024-04-12T09:11:27.102 INFO:tasks.workunit.client.0.smithi117.stdout:4/897: dread d0/d5/d39/f3e [0,4194304] 0 2024-04-12T09:11:27.102 INFO:tasks.workunit.client.0.smithi117.stdout:9/800: truncate d1/d8/d52/f6c 415418 0 2024-04-12T09:11:27.105 INFO:tasks.workunit.client.1.smithi203.stdout:2/356: dread d0/d38/d43/f5a [0,4194304] 0 2024-04-12T09:11:27.106 INFO:tasks.workunit.client.1.smithi203.stdout:1/379: mknod df/d20/d54/d5d/d67/c73 0 2024-04-12T09:11:27.110 INFO:tasks.workunit.client.0.smithi117.stdout:4/898: mkdir d0/d5/d25/d123 0 2024-04-12T09:11:27.111 INFO:tasks.workunit.client.0.smithi117.stdout:7/766: dwrite d0/d13/f3e [0,4194304] 0 2024-04-12T09:11:27.119 INFO:tasks.workunit.client.1.smithi203.stdout:7/321: dwrite d0/d4/f69 [0,4194304] 0 2024-04-12T09:11:27.121 INFO:tasks.workunit.client.1.smithi203.stdout:8/300: write d4/d8/d37/f3e [4751369,79294] 0 2024-04-12T09:11:27.121 INFO:tasks.workunit.client.1.smithi203.stdout:7/322: write d0/d4/f43 [813933,82997] 0 2024-04-12T09:11:27.122 INFO:tasks.workunit.client.1.smithi203.stdout:8/301: dread - d4/f4b zero size 2024-04-12T09:11:27.123 INFO:tasks.workunit.client.0.smithi117.stdout:1/930: sync 2024-04-12T09:11:27.123 INFO:tasks.workunit.client.0.smithi117.stdout:2/855: sync 2024-04-12T09:11:27.123 INFO:tasks.workunit.client.0.smithi117.stdout:6/899: sync 2024-04-12T09:11:27.125 INFO:tasks.workunit.client.0.smithi117.stdout:9/801: getdents d1/d8/d5a 0 2024-04-12T09:11:27.126 INFO:tasks.workunit.client.1.smithi203.stdout:4/307: getdents d1a/d21/d22/d4e 0 2024-04-12T09:11:27.126 INFO:tasks.workunit.client.0.smithi117.stdout:4/899: dread d0/d5/d3b/d38/ff1 [0,4194304] 0 2024-04-12T09:11:27.128 INFO:tasks.workunit.client.0.smithi117.stdout:1/931: mknod d1/dbd/d3f/db/dc2/c124 0 2024-04-12T09:11:27.132 INFO:tasks.workunit.client.1.smithi203.stdout:0/362: mkdir d0/dd/d71 0 2024-04-12T09:11:27.139 INFO:tasks.workunit.client.1.smithi203.stdout:9/304: creat d8/d12/d23/f77 x:0 0 0 2024-04-12T09:11:27.140 INFO:tasks.workunit.client.1.smithi203.stdout:9/305: write d8/d12/d3e/f63 [7790830,76153] 0 2024-04-12T09:11:27.140 INFO:tasks.workunit.client.0.smithi117.stdout:1/932: mkdir d1/dbd/d3f/db/d1d/d78/d125 0 2024-04-12T09:11:27.141 INFO:tasks.workunit.client.0.smithi117.stdout:7/767: write d0/d2/d1a/d4f/fa2 [616074,118134] 0 2024-04-12T09:11:27.144 INFO:tasks.workunit.client.0.smithi117.stdout:6/900: link d8/d3a/d49/da4/l41 d8/d9/d17/d2d/d11e/l11f 0 2024-04-12T09:11:27.145 INFO:tasks.workunit.client.1.smithi203.stdout:7/323: mknod d0/d4/d1c/c7a 0 2024-04-12T09:11:27.146 INFO:tasks.workunit.client.0.smithi117.stdout:1/933: rename d1/c6f to d1/dbe/c126 0 2024-04-12T09:11:27.147 INFO:tasks.workunit.client.1.smithi203.stdout:2/357: truncate d0/f32 7727477 0 2024-04-12T09:11:27.148 INFO:tasks.workunit.client.0.smithi117.stdout:9/802: dread d1/d8/d5a/d6e/f7c [0,4194304] 0 2024-04-12T09:11:27.149 INFO:tasks.workunit.client.1.smithi203.stdout:2/358: truncate d0/d54/d61/f79 560026 0 2024-04-12T09:11:27.150 INFO:tasks.workunit.client.1.smithi203.stdout:8/302: creat d4/d8/d37/f5f x:0 0 0 2024-04-12T09:11:27.151 INFO:tasks.workunit.client.0.smithi117.stdout:7/768: creat d0/d2/d45/d17/d23/dac/dad/daa/fef x:0 0 0 2024-04-12T09:11:27.152 INFO:tasks.workunit.client.1.smithi203.stdout:4/308: rmdir d1a/d1d 39 2024-04-12T09:11:27.154 INFO:tasks.workunit.client.0.smithi117.stdout:6/901: mknod d8/d3a/dc8/c120 0 2024-04-12T09:11:27.155 INFO:tasks.workunit.client.1.smithi203.stdout:6/320: write d1/f37 [863433,83845] 0 2024-04-12T09:11:27.155 INFO:tasks.workunit.client.0.smithi117.stdout:1/934: dwrite d1/dbd/f11a [0,4194304] 0 2024-04-12T09:11:27.155 INFO:tasks.workunit.client.0.smithi117.stdout:4/900: dwrite d0/d2c/d3c/f87 [0,4194304] 0 2024-04-12T09:11:27.157 INFO:tasks.workunit.client.0.smithi117.stdout:6/902: chown d8/f64 5187864 1 2024-04-12T09:11:27.159 INFO:tasks.workunit.client.1.smithi203.stdout:1/380: truncate df/d20/d2b/f51 2534576 0 2024-04-12T09:11:27.160 INFO:tasks.workunit.client.0.smithi117.stdout:1/935: write d1/dbd/d3f/db/d1d/f5b [1575671,113540] 0 2024-04-12T09:11:27.160 INFO:tasks.workunit.client.1.smithi203.stdout:1/381: chown df/d20/d2b/l3d 3495 1 2024-04-12T09:11:27.161 INFO:tasks.workunit.client.0.smithi117.stdout:2/856: dwrite d0/d43/da5/d8f/dc2/fd8 [0,4194304] 0 2024-04-12T09:11:27.162 INFO:tasks.workunit.client.1.smithi203.stdout:1/382: truncate df/d20/d54/d5d/d58/f66 196300 0 2024-04-12T09:11:27.163 INFO:tasks.workunit.client.1.smithi203.stdout:1/383: chown df/d2d/d6f/c72 98544041 1 2024-04-12T09:11:27.164 INFO:tasks.workunit.client.1.smithi203.stdout:1/384: readlink df/d20/d2b/l55 0 2024-04-12T09:11:27.166 INFO:tasks.workunit.client.0.smithi117.stdout:9/803: unlink d1/d8/df/d68/ddf/l102 0 2024-04-12T09:11:27.171 INFO:tasks.workunit.client.1.smithi203.stdout:3/312: getdents d2/d8/d14/d23 0 2024-04-12T09:11:27.173 INFO:tasks.workunit.client.1.smithi203.stdout:9/306: write d8/d12/d23/d29/f6a [1562299,90362] 0 2024-04-12T09:11:27.175 INFO:tasks.workunit.client.1.smithi203.stdout:7/324: mknod d0/d4/d5d/c7b 0 2024-04-12T09:11:27.177 INFO:tasks.workunit.client.0.smithi117.stdout:1/936: creat d1/d64/d45/d4c/f127 x:0 0 0 2024-04-12T09:11:27.180 INFO:tasks.workunit.client.1.smithi203.stdout:8/303: creat d4/d8/d1c/d5d/f60 x:0 0 0 2024-04-12T09:11:27.180 INFO:tasks.workunit.client.0.smithi117.stdout:9/804: rmdir d1/d8/df/d3e/d92 39 2024-04-12T09:11:27.181 INFO:tasks.workunit.client.0.smithi117.stdout:4/901: creat d0/d5/d25/d110/f124 x:0 0 0 2024-04-12T09:11:27.182 INFO:tasks.workunit.client.1.smithi203.stdout:6/321: fdatasync d1/df/d1b/f66 0 2024-04-12T09:11:27.183 INFO:tasks.workunit.client.0.smithi117.stdout:1/937: creat d1/dc3/f128 x:0 0 0 2024-04-12T09:11:27.184 INFO:tasks.workunit.client.0.smithi117.stdout:7/769: link d0/d2/d45/lba d0/d2/d45/d17/d23/d39/dbd/lf0 0 2024-04-12T09:11:27.185 INFO:tasks.workunit.client.1.smithi203.stdout:1/385: stat df/d20/d54/f46 0 2024-04-12T09:11:27.186 INFO:tasks.workunit.client.1.smithi203.stdout:7/325: dwrite d0/d4/f57 [0,4194304] 0 2024-04-12T09:11:27.187 INFO:tasks.workunit.client.1.smithi203.stdout:2/359: dwrite d0/d3/f5f [0,4194304] 0 2024-04-12T09:11:27.187 INFO:tasks.workunit.client.0.smithi117.stdout:4/902: mknod d0/d5/d3b/d38/d4f/d79/d9c/dab/d101/c125 0 2024-04-12T09:11:27.188 INFO:tasks.workunit.client.1.smithi203.stdout:7/326: fsync d0/d4/d1c/d5b/f65 0 2024-04-12T09:11:27.188 INFO:tasks.workunit.client.0.smithi117.stdout:1/938: dwrite d1/d3b/f98 [0,4194304] 0 2024-04-12T09:11:27.190 INFO:tasks.workunit.client.1.smithi203.stdout:3/313: rename d2/fd to d2/d8/d59/f61 0 2024-04-12T09:11:27.190 INFO:tasks.workunit.client.0.smithi117.stdout:4/903: write d0/d5/d3b/d38/d4f/f74 [4520574,99218] 0 2024-04-12T09:11:27.191 INFO:tasks.workunit.client.1.smithi203.stdout:3/314: readlink d2/d51/l58 0 2024-04-12T09:11:27.192 INFO:tasks.workunit.client.0.smithi117.stdout:4/904: readlink d0/d5/d25/l61 0 2024-04-12T09:11:27.192 INFO:tasks.workunit.client.1.smithi203.stdout:9/307: fsync d8/f4a 0 2024-04-12T09:11:27.193 INFO:tasks.workunit.client.1.smithi203.stdout:5/417: sync 2024-04-12T09:11:27.194 INFO:tasks.workunit.client.1.smithi203.stdout:5/418: readlink d0/d6/l2c 0 2024-04-12T09:11:27.194 INFO:tasks.workunit.client.1.smithi203.stdout:4/309: creat d1a/d20/d5f/f64 x:0 0 0 2024-04-12T09:11:27.196 INFO:tasks.workunit.client.1.smithi203.stdout:4/310: write d1a/d2b/f3a [2027510,83722] 0 2024-04-12T09:11:27.197 INFO:tasks.workunit.client.1.smithi203.stdout:8/304: creat d4/d8/d37/f61 x:0 0 0 2024-04-12T09:11:27.198 INFO:tasks.workunit.client.1.smithi203.stdout:8/305: write d4/f35 [923533,25351] 0 2024-04-12T09:11:27.199 INFO:tasks.workunit.client.1.smithi203.stdout:8/306: chown d4/f4b 1320035 1 2024-04-12T09:11:27.199 INFO:tasks.workunit.client.1.smithi203.stdout:8/307: dread - d4/f5a zero size 2024-04-12T09:11:27.201 INFO:tasks.workunit.client.0.smithi117.stdout:7/770: mkdir d0/d2/d45/d17/d23/df1 0 2024-04-12T09:11:27.203 INFO:tasks.workunit.client.0.smithi117.stdout:9/805: mknod d1/d8/df/da2/dbf/c104 0 2024-04-12T09:11:27.210 INFO:tasks.workunit.client.0.smithi117.stdout:9/806: dwrite d1/d8/d5a/d79/d91/db0/f3c [0,4194304] 0 2024-04-12T09:11:27.210 INFO:tasks.workunit.client.0.smithi117.stdout:7/771: unlink d0/da/c4c 0 2024-04-12T09:11:27.212 INFO:tasks.workunit.client.0.smithi117.stdout:9/807: stat d1/d8/d52/cdd 0 2024-04-12T09:11:27.214 INFO:tasks.workunit.client.0.smithi117.stdout:6/903: dwrite d8/d2a/d60/d7d/d8c/db8/fd1 [0,4194304] 0 2024-04-12T09:11:27.216 INFO:tasks.workunit.client.0.smithi117.stdout:7/772: dread - d0/d2/d45/d17/d23/dac/dad/d91/fdc zero size 2024-04-12T09:11:27.218 INFO:tasks.workunit.client.1.smithi203.stdout:0/363: truncate d0/d1d/d2f/d17/fc 3968051 0 2024-04-12T09:11:27.219 INFO:tasks.workunit.client.0.smithi117.stdout:2/857: dwrite d0/d4/d10/fdf [0,4194304] 0 2024-04-12T09:11:27.220 INFO:tasks.workunit.client.1.smithi203.stdout:0/364: write d0/d1d/d2f/d17/f60 [769840,40887] 0 2024-04-12T09:11:27.221 INFO:tasks.workunit.client.1.smithi203.stdout:0/365: fdatasync d0/dd/f46 0 2024-04-12T09:11:27.226 INFO:tasks.workunit.client.0.smithi117.stdout:2/858: write d0/d43/d4b/dae/dd5/fef [3416696,22890] 0 2024-04-12T09:11:27.228 INFO:tasks.workunit.client.0.smithi117.stdout:4/905: link d0/d5/d25/dfd/d107/da7/fd4 d0/d5/d39/d115/f126 0 2024-04-12T09:11:27.229 INFO:tasks.workunit.client.0.smithi117.stdout:2/859: readlink d0/df/de1/l100 0 2024-04-12T09:11:27.229 INFO:tasks.workunit.client.0.smithi117.stdout:6/904: dwrite d8/d9/d17/d33/fc4 [4194304,4194304] 0 2024-04-12T09:11:27.229 INFO:tasks.workunit.client.1.smithi203.stdout:3/315: dread d2/f2b [0,4194304] 0 2024-04-12T09:11:27.229 INFO:tasks.workunit.client.0.smithi117.stdout:4/906: fsync d0/d5/d3b/d38/d4f/f10c 0 2024-04-12T09:11:27.230 INFO:tasks.workunit.client.0.smithi117.stdout:9/808: fsync d1/d8/d5a/d6e/d71/fa9 0 2024-04-12T09:11:27.230 INFO:tasks.workunit.client.0.smithi117.stdout:4/907: stat d0/d5/d25/dfd/d107/ca3 0 2024-04-12T09:11:27.232 INFO:tasks.workunit.client.1.smithi203.stdout:5/419: creat d0/d6/d16/d9/d30/d58/f99 x:0 0 0 2024-04-12T09:11:27.235 INFO:tasks.workunit.client.0.smithi117.stdout:1/939: getdents d1/db3 0 2024-04-12T09:11:27.244 INFO:tasks.workunit.client.0.smithi117.stdout:2/860: dread d0/d43/f56 [0,4194304] 0 2024-04-12T09:11:27.244 INFO:tasks.workunit.client.1.smithi203.stdout:4/311: dwrite d1a/d1d/f1e [4194304,4194304] 0 2024-04-12T09:11:27.244 INFO:tasks.workunit.client.0.smithi117.stdout:2/861: chown d0/d43/d53/d61/d66/le2 0 1 2024-04-12T09:11:27.245 INFO:tasks.workunit.client.0.smithi117.stdout:6/905: symlink d8/d2a/d60/d7d/d9b/l121 0 2024-04-12T09:11:27.246 INFO:tasks.workunit.client.1.smithi203.stdout:7/327: dread d0/f2 [0,4194304] 0 2024-04-12T09:11:27.246 INFO:tasks.workunit.client.1.smithi203.stdout:7/328: stat d0 0 2024-04-12T09:11:27.248 INFO:tasks.workunit.client.1.smithi203.stdout:0/366: rename d0/dd/d5b/d6b to d0/d59/d5d/d72 0 2024-04-12T09:11:27.250 INFO:tasks.workunit.client.1.smithi203.stdout:0/367: chown d0/f3 996 1 2024-04-12T09:11:27.252 INFO:tasks.workunit.client.1.smithi203.stdout:0/368: fdatasync d0/d1d/f5f 0 2024-04-12T09:11:27.252 INFO:tasks.workunit.client.1.smithi203.stdout:5/420: mkdir d0/d9a 0 2024-04-12T09:11:27.255 INFO:tasks.workunit.client.1.smithi203.stdout:2/360: link d0/d14/d1e/d2a/f60 d0/d14/d23/f85 0 2024-04-12T09:11:27.257 INFO:tasks.workunit.client.0.smithi117.stdout:2/862: rename d0/d4/ddb to d0/d4/d10/d27/d9a/d121 0 2024-04-12T09:11:27.257 INFO:tasks.workunit.client.1.smithi203.stdout:9/308: dwrite f4 [0,4194304] 0 2024-04-12T09:11:27.258 INFO:tasks.workunit.client.1.smithi203.stdout:7/329: dwrite d0/d15/d2d/f66 [0,4194304] 0 2024-04-12T09:11:27.258 INFO:tasks.workunit.client.1.smithi203.stdout:2/361: chown d0/d3/f8 1595892 1 2024-04-12T09:11:27.259 INFO:tasks.workunit.client.0.smithi117.stdout:9/809: creat d1/d8/df/d68/df9/f105 x:0 0 0 2024-04-12T09:11:27.261 INFO:tasks.workunit.client.1.smithi203.stdout:4/312: rename d1a/d20/d5d/c5a to d1a/d21/d60/c65 0 2024-04-12T09:11:27.261 INFO:tasks.workunit.client.0.smithi117.stdout:9/810: write d1/ff2 [715212,27758] 0 2024-04-12T09:11:27.262 INFO:tasks.workunit.client.1.smithi203.stdout:4/313: fsync d1a/d21/d22/d2e/f43 0 2024-04-12T09:11:27.263 INFO:tasks.workunit.client.1.smithi203.stdout:9/309: chown d8/d12/d14/f1f 3483548 1 2024-04-12T09:11:27.264 INFO:tasks.workunit.client.0.smithi117.stdout:6/906: truncate d8/fc9 198174 0 2024-04-12T09:11:27.264 INFO:tasks.workunit.client.0.smithi117.stdout:6/907: chown d8/d2a/d6e/fab 147 1 2024-04-12T09:11:27.264 INFO:tasks.workunit.client.1.smithi203.stdout:5/421: mkdir d0/d6/d9b 0 2024-04-12T09:11:27.264 INFO:tasks.workunit.client.1.smithi203.stdout:1/386: sync 2024-04-12T09:11:27.265 INFO:tasks.workunit.client.1.smithi203.stdout:0/369: creat d0/d1d/d2f/d17/d19/f73 x:0 0 0 2024-04-12T09:11:27.268 INFO:tasks.workunit.client.1.smithi203.stdout:5/422: truncate d0/d6/d16/d9/f10 4387856 0 2024-04-12T09:11:27.269 INFO:tasks.workunit.client.1.smithi203.stdout:3/316: symlink d2/d8/d14/d1b/d2f/l62 0 2024-04-12T09:11:27.270 INFO:tasks.workunit.client.1.smithi203.stdout:0/370: read d0/d1d/d2f/d17/f11 [1888111,78889] 0 2024-04-12T09:11:27.270 INFO:tasks.workunit.client.1.smithi203.stdout:6/322: truncate d1/df/d1b/d3b/f40 6671802 0 2024-04-12T09:11:27.271 INFO:tasks.workunit.client.0.smithi117.stdout:1/940: creat d1/d64/d45/f129 x:0 0 0 2024-04-12T09:11:27.272 INFO:tasks.workunit.client.1.smithi203.stdout:6/323: fdatasync d1/d3/f39 0 2024-04-12T09:11:27.272 INFO:tasks.workunit.client.0.smithi117.stdout:1/941: truncate d1/dc3/f110 216126 0 2024-04-12T09:11:27.273 INFO:tasks.workunit.client.1.smithi203.stdout:2/362: mkdir d0/d67/d86 0 2024-04-12T09:11:27.273 INFO:tasks.workunit.client.0.smithi117.stdout:7/773: getdents d0/d2/d1a/d4f 0 2024-04-12T09:11:27.274 INFO:tasks.workunit.client.1.smithi203.stdout:7/330: dwrite d0/d4/d1c/d5b/f64 [0,4194304] 0 2024-04-12T09:11:27.274 INFO:tasks.workunit.client.1.smithi203.stdout:0/371: dread - d0/d1d/d2f/d17/d19/f73 zero size 2024-04-12T09:11:27.274 INFO:tasks.workunit.client.1.smithi203.stdout:8/308: dread f3 [0,4194304] 0 2024-04-12T09:11:27.275 INFO:tasks.workunit.client.0.smithi117.stdout:7/774: chown d0/d2/d45/d17/d23/d39/d6c/fc1 341903823 1 2024-04-12T09:11:27.276 INFO:tasks.workunit.client.0.smithi117.stdout:9/811: unlink d1/d8/d12/f59 0 2024-04-12T09:11:27.280 INFO:tasks.workunit.client.1.smithi203.stdout:9/310: creat d8/d12/d23/d41/f78 x:0 0 0 2024-04-12T09:11:27.281 INFO:tasks.workunit.client.1.smithi203.stdout:9/311: stat d8/d12/d14/f46 0 2024-04-12T09:11:27.281 INFO:tasks.workunit.client.1.smithi203.stdout:9/312: fdatasync d8/d12/d23/d41/f5e 0 2024-04-12T09:11:27.283 INFO:tasks.workunit.client.0.smithi117.stdout:4/908: getdents d0/d2c/d3c/d10a 0 2024-04-12T09:11:27.286 INFO:tasks.workunit.client.0.smithi117.stdout:1/942: mknod d1/dbd/d3f/db/d16/db6/da9/d9a/d71/d10b/c12a 0 2024-04-12T09:11:27.287 INFO:tasks.workunit.client.0.smithi117.stdout:1/943: dread - d1/dbd/d3f/db/d1d/d78/ffd zero size 2024-04-12T09:11:27.289 INFO:tasks.workunit.client.1.smithi203.stdout:5/423: rmdir d0/d5d 39 2024-04-12T09:11:27.290 INFO:tasks.workunit.client.0.smithi117.stdout:7/775: rename d0/d2/d1a/d4f/dbc to d0/d2/d1a/d4f/df2 0 2024-04-12T09:11:27.292 INFO:tasks.workunit.client.0.smithi117.stdout:6/908: symlink d8/d2a/d60/d89/dfe/l122 0 2024-04-12T09:11:27.295 INFO:tasks.workunit.client.1.smithi203.stdout:3/317: creat d2/d8/d14/d23/d35/d4c/d5c/f63 x:0 0 0 2024-04-12T09:11:27.296 INFO:tasks.workunit.client.1.smithi203.stdout:5/424: dwrite d0/d6/d16/d9/f63 [0,4194304] 0 2024-04-12T09:11:27.297 INFO:tasks.workunit.client.0.smithi117.stdout:2/863: link d0/d43/d30/d41/fc9 d0/d4/d81/f122 0 2024-04-12T09:11:27.298 INFO:tasks.workunit.client.0.smithi117.stdout:2/864: fsync d0/d4/fb 0 2024-04-12T09:11:27.304 INFO:tasks.workunit.client.0.smithi117.stdout:7/776: fsync d0/d2/d1a/d49/f62 0 2024-04-12T09:11:27.305 INFO:tasks.workunit.client.1.smithi203.stdout:2/363: symlink d0/d14/d74/l87 0 2024-04-12T09:11:27.308 INFO:tasks.workunit.client.1.smithi203.stdout:6/324: rename d1/d3/d5b/l63 to d1/df/d65/l69 0 2024-04-12T09:11:27.311 INFO:tasks.workunit.client.1.smithi203.stdout:1/387: unlink df/l27 0 2024-04-12T09:11:27.314 INFO:tasks.workunit.client.0.smithi117.stdout:4/909: mknod d0/d5/d25/d9f/d109/c127 0 2024-04-12T09:11:27.318 INFO:tasks.workunit.client.0.smithi117.stdout:2/865: unlink d0/d4/d81/f10e 0 2024-04-12T09:11:27.320 INFO:tasks.workunit.client.1.smithi203.stdout:0/372: dread d0/d1d/d2f/f33 [0,4194304] 0 2024-04-12T09:11:27.323 INFO:tasks.workunit.client.1.smithi203.stdout:0/373: read - d0/d1d/d2f/d17/d19/f73 zero size 2024-04-12T09:11:27.323 INFO:tasks.workunit.client.1.smithi203.stdout:5/425: symlink d0/d6/d16/d9/d86/l9c 0 2024-04-12T09:11:27.324 INFO:tasks.workunit.client.1.smithi203.stdout:0/374: dread - d0/dd/d40/f62 zero size 2024-04-12T09:11:27.324 INFO:tasks.workunit.client.0.smithi117.stdout:7/777: creat d0/d2/d45/d53/d58/ff3 x:0 0 0 2024-04-12T09:11:27.325 INFO:tasks.workunit.client.1.smithi203.stdout:8/309: dwrite f3 [0,4194304] 0 2024-04-12T09:11:27.326 INFO:tasks.workunit.client.1.smithi203.stdout:7/331: mkdir d0/d34/d7c 0 2024-04-12T09:11:27.327 INFO:tasks.workunit.client.1.smithi203.stdout:7/332: write d0/d4/f57 [953545,66387] 0 2024-04-12T09:11:27.327 INFO:tasks.workunit.client.0.smithi117.stdout:9/812: link d1/d8/d5a/d6e/d71/cd4 d1/d8/dd5/c106 0 2024-04-12T09:11:27.331 INFO:tasks.workunit.client.1.smithi203.stdout:4/314: truncate d1a/d1d/f1e 472412 0 2024-04-12T09:11:27.334 INFO:tasks.workunit.client.1.smithi203.stdout:6/325: unlink d1/d3/d26/d30/f3d 0 2024-04-12T09:11:27.335 INFO:tasks.workunit.client.1.smithi203.stdout:6/326: fsync d1/d3/d26/d30/f3f 0 2024-04-12T09:11:27.335 INFO:tasks.workunit.client.0.smithi117.stdout:1/944: truncate d1/dbd/fae 3645646 0 2024-04-12T09:11:27.342 INFO:tasks.workunit.client.1.smithi203.stdout:3/318: mkdir d2/d64 0 2024-04-12T09:11:27.344 INFO:tasks.workunit.client.0.smithi117.stdout:6/909: creat d8/d9/f123 x:0 0 0 2024-04-12T09:11:27.346 INFO:tasks.workunit.client.0.smithi117.stdout:4/910: write d0/d1/f65 [1988787,100520] 0 2024-04-12T09:11:27.349 INFO:tasks.workunit.client.1.smithi203.stdout:8/310: chown d4/d8/d19/l3c 63 1 2024-04-12T09:11:27.351 INFO:tasks.workunit.client.1.smithi203.stdout:1/388: write df/d2d/f32 [1700070,11356] 0 2024-04-12T09:11:27.353 INFO:tasks.workunit.client.0.smithi117.stdout:1/945: creat d1/dbd/d3f/db/d16/db6/da9/d9a/d54/f12b x:0 0 0 2024-04-12T09:11:27.354 INFO:tasks.workunit.client.0.smithi117.stdout:1/946: fdatasync d1/dbd/d3f/db/dc2/fed 0 2024-04-12T09:11:27.358 INFO:tasks.workunit.client.0.smithi117.stdout:7/778: mkdir d0/da/d9b/df4 0 2024-04-12T09:11:27.361 INFO:tasks.workunit.client.0.smithi117.stdout:6/910: creat d8/d2a/d60/d7d/d8c/deb/f124 x:0 0 0 2024-04-12T09:11:27.362 INFO:tasks.workunit.client.0.smithi117.stdout:6/911: write d8/ff [4424419,76856] 0 2024-04-12T09:11:27.365 INFO:tasks.workunit.client.1.smithi203.stdout:3/319: dread d2/fa [0,4194304] 0 2024-04-12T09:11:27.366 INFO:tasks.workunit.client.1.smithi203.stdout:3/320: fsync d2/d8/d14/d23/d35/d4c/d5c/f34 0 2024-04-12T09:11:27.368 INFO:tasks.workunit.client.0.smithi117.stdout:4/911: dread d0/d1/fbd [0,4194304] 0 2024-04-12T09:11:27.372 INFO:tasks.workunit.client.0.smithi117.stdout:2/866: dwrite d0/d43/d30/d41/fc9 [0,4194304] 0 2024-04-12T09:11:27.372 INFO:tasks.workunit.client.0.smithi117.stdout:9/813: dwrite d1/d8/df/d3e/f1d [8388608,4194304] 0 2024-04-12T09:11:27.372 INFO:tasks.workunit.client.1.smithi203.stdout:1/389: dread df/d20/d54/f3b [0,4194304] 0 2024-04-12T09:11:27.374 INFO:tasks.workunit.client.1.smithi203.stdout:5/426: symlink d0/d6/d11/d1e/l9d 0 2024-04-12T09:11:27.374 INFO:tasks.workunit.client.1.smithi203.stdout:0/375: link d0/d1d/d2f/d4c/f4f d0/d1d/d2f/d4c/f74 0 2024-04-12T09:11:27.377 INFO:tasks.workunit.client.1.smithi203.stdout:8/311: mkdir d4/d8/d1c/d48/d62 0 2024-04-12T09:11:27.382 INFO:tasks.workunit.client.1.smithi203.stdout:7/333: creat d0/d38/d51/f7d x:0 0 0 2024-04-12T09:11:27.384 INFO:tasks.workunit.client.1.smithi203.stdout:4/315: fdatasync d1a/d34/f35 0 2024-04-12T09:11:27.385 INFO:tasks.workunit.client.0.smithi117.stdout:1/947: mknod d1/d64/c12c 0 2024-04-12T09:11:27.387 INFO:tasks.workunit.client.1.smithi203.stdout:7/334: dread d0/d4/f69 [0,4194304] 0 2024-04-12T09:11:27.391 INFO:tasks.workunit.client.0.smithi117.stdout:6/912: write d8/d9/d39/fcb [867116,16339] 0 2024-04-12T09:11:27.392 INFO:tasks.workunit.client.0.smithi117.stdout:4/912: mknod d0/d5/d25/d123/c128 0 2024-04-12T09:11:27.394 INFO:tasks.workunit.client.1.smithi203.stdout:8/312: rename d4/d8/d1c/c41 to d4/d8/d1c/d48/d5e/c63 0 2024-04-12T09:11:27.397 INFO:tasks.workunit.client.0.smithi117.stdout:6/913: dwrite d8/d9/fdc [0,4194304] 0 2024-04-12T09:11:27.398 INFO:tasks.workunit.client.0.smithi117.stdout:9/814: symlink d1/d8/l107 0 2024-04-12T09:11:27.399 INFO:tasks.workunit.client.1.smithi203.stdout:8/313: dwrite d4/f35 [0,4194304] 0 2024-04-12T09:11:27.399 INFO:tasks.workunit.client.1.smithi203.stdout:2/364: getdents d0/d3/d47 0 2024-04-12T09:11:27.400 INFO:tasks.workunit.client.0.smithi117.stdout:2/867: symlink d0/d43/d53/l123 0 2024-04-12T09:11:27.401 INFO:tasks.workunit.client.0.smithi117.stdout:7/779: link d0/d2/d45/d17/d23/d39/ca6 d0/d2/d96/d98/cf5 0 2024-04-12T09:11:27.402 INFO:tasks.workunit.client.1.smithi203.stdout:9/313: sync 2024-04-12T09:11:27.406 INFO:tasks.workunit.client.1.smithi203.stdout:4/316: creat d1a/d20/d5f/f66 x:0 0 0 2024-04-12T09:11:27.407 INFO:tasks.workunit.client.0.smithi117.stdout:1/948: mknod d1/dbd/c12d 0 2024-04-12T09:11:27.407 INFO:tasks.workunit.client.1.smithi203.stdout:7/335: creat d0/d4/d53/f7e x:0 0 0 2024-04-12T09:11:27.408 INFO:tasks.workunit.client.1.smithi203.stdout:4/317: chown d1a/d21/d22 60497 1 2024-04-12T09:11:27.409 INFO:tasks.workunit.client.1.smithi203.stdout:3/321: dwrite d2/d8/d14/d1b/f48 [8388608,4194304] 0 2024-04-12T09:11:27.410 INFO:tasks.workunit.client.1.smithi203.stdout:1/390: getdents df/d2d/d6d 0 2024-04-12T09:11:27.410 INFO:tasks.workunit.client.0.smithi117.stdout:2/868: creat d0/d4/d81/f124 x:0 0 0 2024-04-12T09:11:27.411 INFO:tasks.workunit.client.1.smithi203.stdout:8/314: dwrite d4/d8/f42 [0,4194304] 0 2024-04-12T09:11:27.413 INFO:tasks.workunit.client.1.smithi203.stdout:0/376: creat d0/d48/d5e/f75 x:0 0 0 2024-04-12T09:11:27.414 INFO:tasks.workunit.client.1.smithi203.stdout:4/318: chown d1a/d21/f33 3857 1 2024-04-12T09:11:27.415 INFO:tasks.workunit.client.1.smithi203.stdout:8/315: write d4/d8/d1c/f2c [2936135,86268] 0 2024-04-12T09:11:27.415 INFO:tasks.workunit.client.1.smithi203.stdout:0/377: fsync d0/d1d/d2f/d17/d19/f25 0 2024-04-12T09:11:27.416 INFO:tasks.workunit.client.1.smithi203.stdout:8/316: chown d4/f1f 11451436 1 2024-04-12T09:11:27.420 INFO:tasks.workunit.client.0.smithi117.stdout:2/869: mkdir d0/d43/d30/d125 0 2024-04-12T09:11:27.424 INFO:tasks.workunit.client.1.smithi203.stdout:5/427: creat d0/d6/d11/d18/d1a/f9e x:0 0 0 2024-04-12T09:11:27.425 INFO:tasks.workunit.client.0.smithi117.stdout:1/949: mkdir d1/d64/d45/d12e 0 2024-04-12T09:11:27.426 INFO:tasks.workunit.client.1.smithi203.stdout:7/336: mknod d0/d4/d1c/d5b/c7f 0 2024-04-12T09:11:27.432 INFO:tasks.workunit.client.1.smithi203.stdout:9/314: mknod d8/d12/d23/d27/d4f/c79 0 2024-04-12T09:11:27.433 INFO:tasks.workunit.client.1.smithi203.stdout:7/337: dread d0/d4/f60 [0,4194304] 0 2024-04-12T09:11:27.434 INFO:tasks.workunit.client.1.smithi203.stdout:5/428: creat d0/d6/d16/d9/d86/f9f x:0 0 0 2024-04-12T09:11:27.435 INFO:tasks.workunit.client.0.smithi117.stdout:4/913: dwrite d0/d2c/f93 [0,4194304] 0 2024-04-12T09:11:27.437 INFO:tasks.workunit.client.1.smithi203.stdout:0/378: rename d0/cf to d0/d59/d5d/c76 0 2024-04-12T09:11:27.440 INFO:tasks.workunit.client.1.smithi203.stdout:1/391: creat df/d20/f74 x:0 0 0 2024-04-12T09:11:27.440 INFO:tasks.workunit.client.1.smithi203.stdout:7/338: dwrite d0/d4/d1c/d3b/f4e [4194304,4194304] 0 2024-04-12T09:11:27.441 INFO:tasks.workunit.client.0.smithi117.stdout:4/914: creat d0/d1/d34/f129 x:0 0 0 2024-04-12T09:11:27.443 INFO:tasks.workunit.client.1.smithi203.stdout:9/315: unlink d8/c56 0 2024-04-12T09:11:27.449 INFO:tasks.workunit.client.0.smithi117.stdout:9/815: dwrite d1/d24/fd8 [0,4194304] 0 2024-04-12T09:11:27.451 INFO:tasks.workunit.client.0.smithi117.stdout:6/914: dwrite d8/d9/d17/d33/d101/d97/fb9 [0,4194304] 0 2024-04-12T09:11:27.454 INFO:tasks.workunit.client.0.smithi117.stdout:7/780: truncate d0/f1b 463131 0 2024-04-12T09:11:27.455 INFO:tasks.workunit.client.1.smithi203.stdout:4/319: creat d1a/d21/f67 x:0 0 0 2024-04-12T09:11:27.456 INFO:tasks.workunit.client.1.smithi203.stdout:3/322: dread d2/d8/d14/d23/d35/d4c/d5c/f34 [4194304,4194304] 0 2024-04-12T09:11:27.457 INFO:tasks.workunit.client.0.smithi117.stdout:4/915: dwrite d0/d5/d3b/fdc [0,4194304] 0 2024-04-12T09:11:27.458 INFO:tasks.workunit.client.1.smithi203.stdout:1/392: mkdir df/d2d/d6f/d75 0 2024-04-12T09:11:27.461 INFO:tasks.workunit.client.1.smithi203.stdout:9/316: creat d8/d12/d23/d38/f7a x:0 0 0 2024-04-12T09:11:27.463 INFO:tasks.workunit.client.0.smithi117.stdout:7/781: creat d0/d2/d1a/d5f/ff6 x:0 0 0 2024-04-12T09:11:27.463 INFO:tasks.workunit.client.0.smithi117.stdout:1/950: write d1/dbd/d3f/db/d16/db6/f69 [617131,6705] 0 2024-04-12T09:11:27.465 INFO:tasks.workunit.client.0.smithi117.stdout:2/870: dwrite d0/d4/d10/d27/d9a/f9b [0,4194304] 0 2024-04-12T09:11:27.466 INFO:tasks.workunit.client.0.smithi117.stdout:1/951: write d1/d3b/f116 [638199,38799] 0 2024-04-12T09:11:27.466 INFO:tasks.workunit.client.1.smithi203.stdout:4/320: mkdir d1a/d21/d60/d68 0 2024-04-12T09:11:27.471 INFO:tasks.workunit.client.0.smithi117.stdout:4/916: rmdir d0/d5 39 2024-04-12T09:11:27.474 INFO:tasks.workunit.client.1.smithi203.stdout:3/323: mkdir d2/d51/d65 0 2024-04-12T09:11:27.475 INFO:tasks.workunit.client.1.smithi203.stdout:8/317: dwrite d4/f2a [4194304,4194304] 0 2024-04-12T09:11:27.476 INFO:tasks.workunit.client.0.smithi117.stdout:7/782: symlink d0/da/d7c/dae/lf7 0 2024-04-12T09:11:27.476 INFO:tasks.workunit.client.1.smithi203.stdout:3/324: stat d2/d8/d14/d23/d35/d4c/d5c 0 2024-04-12T09:11:27.477 INFO:tasks.workunit.client.0.smithi117.stdout:7/783: fdatasync d0/d2/d45/d17/d23/d51/fb2 0 2024-04-12T09:11:27.477 INFO:tasks.workunit.client.1.smithi203.stdout:1/393: write df/d20/d54/d5d/f4d [706258,38923] 0 2024-04-12T09:11:27.480 INFO:tasks.workunit.client.0.smithi117.stdout:1/952: dread d1/dbd/d3f/d72/ff5 [0,4194304] 0 2024-04-12T09:11:27.481 INFO:tasks.workunit.client.1.smithi203.stdout:5/429: creat d0/fa0 x:0 0 0 2024-04-12T09:11:27.487 INFO:tasks.workunit.client.1.smithi203.stdout:4/321: readlink d1a/l54 0 2024-04-12T09:11:27.489 INFO:tasks.workunit.client.0.smithi117.stdout:7/784: symlink d0/d2/d71/lf8 0 2024-04-12T09:11:27.490 INFO:tasks.workunit.client.1.smithi203.stdout:4/322: write d1a/d21/d22/f39 [1452871,96594] 0 2024-04-12T09:11:27.491 INFO:tasks.workunit.client.1.smithi203.stdout:1/394: dwrite df/f6e [0,4194304] 0 2024-04-12T09:11:27.492 INFO:tasks.workunit.client.0.smithi117.stdout:2/871: mknod d0/c126 0 2024-04-12T09:11:27.493 INFO:tasks.workunit.client.1.smithi203.stdout:1/395: chown df/d2d/l37 1 1 2024-04-12T09:11:27.494 INFO:tasks.workunit.client.0.smithi117.stdout:1/953: unlink d1/dbd/d3f/d72/d11c/l122 0 2024-04-12T09:11:27.494 INFO:tasks.workunit.client.0.smithi117.stdout:6/915: dread d8/d3f/fd6 [0,4194304] 0 2024-04-12T09:11:27.496 INFO:tasks.workunit.client.1.smithi203.stdout:9/317: symlink d8/l7b 0 2024-04-12T09:11:27.496 INFO:tasks.workunit.client.1.smithi203.stdout:4/323: dwrite f5 [12582912,4194304] 0 2024-04-12T09:11:27.497 INFO:tasks.workunit.client.0.smithi117.stdout:4/917: rmdir d0/d5/d3b/d38/d4f/d79/d9c/dab 39 2024-04-12T09:11:27.499 INFO:tasks.workunit.client.1.smithi203.stdout:0/379: getdents d0/dd 0 2024-04-12T09:11:27.499 INFO:tasks.workunit.client.0.smithi117.stdout:9/816: dwrite d1/d24/fcc [0,4194304] 0 2024-04-12T09:11:27.499 INFO:tasks.workunit.client.1.smithi203.stdout:0/380: chown d0/d59 16264 1 2024-04-12T09:11:27.501 INFO:tasks.workunit.client.0.smithi117.stdout:7/785: dwrite d0/d2/d45/d17/d23/d50/f64 [0,4194304] 0 2024-04-12T09:11:27.504 INFO:tasks.workunit.client.0.smithi117.stdout:4/918: write d0/d1/d34/ffa [4079319,125473] 0 2024-04-12T09:11:27.505 INFO:tasks.workunit.client.0.smithi117.stdout:1/954: fdatasync d1/dbd/f9f 0 2024-04-12T09:11:27.505 INFO:tasks.workunit.client.1.smithi203.stdout:8/318: rename d4/d8/d1c/d48/d5e/c63 to d4/d8/d37/c64 0 2024-04-12T09:11:27.505 INFO:tasks.workunit.client.1.smithi203.stdout:6/327: sync 2024-04-12T09:11:27.506 INFO:tasks.workunit.client.0.smithi117.stdout:7/786: chown d0/d2/d45/d53/d58 27301 1 2024-04-12T09:11:27.507 INFO:tasks.workunit.client.1.smithi203.stdout:3/325: creat d2/d8/d14/d23/d35/d4c/d5c/d55/f66 x:0 0 0 2024-04-12T09:11:27.507 INFO:tasks.workunit.client.0.smithi117.stdout:1/955: dread - d1/dbd/dbf/ffc zero size 2024-04-12T09:11:27.511 INFO:tasks.workunit.client.1.smithi203.stdout:0/381: symlink d0/d48/l77 0 2024-04-12T09:11:27.511 INFO:tasks.workunit.client.0.smithi117.stdout:6/916: read d8/d9/d17/d33/d101/f67 [343910,53962] 0 2024-04-12T09:11:27.512 INFO:tasks.workunit.client.0.smithi117.stdout:9/817: dwrite d1/d8/d12/fee [0,4194304] 0 2024-04-12T09:11:27.514 INFO:tasks.workunit.client.1.smithi203.stdout:5/430: rename d0/d6/d16/d9/d14/d4b/f6b to d0/d6/d11/d1e/d4c/fa1 0 2024-04-12T09:11:27.514 INFO:tasks.workunit.client.0.smithi117.stdout:4/919: symlink d0/d5/d39/l12a 0 2024-04-12T09:11:27.515 INFO:tasks.workunit.client.0.smithi117.stdout:4/920: stat d0/d5/d3b/f5c 0 2024-04-12T09:11:27.516 INFO:tasks.workunit.client.1.smithi203.stdout:5/431: write d0/d6/d16/d9/d86/f8f [607809,76519] 0 2024-04-12T09:11:27.516 INFO:tasks.workunit.client.0.smithi117.stdout:4/921: chown d0/d2c/d67/fda 1263 1 2024-04-12T09:11:27.519 INFO:tasks.workunit.client.0.smithi117.stdout:1/956: symlink d1/d64/d45/d4c/d94/l12f 0 2024-04-12T09:11:27.519 INFO:tasks.workunit.client.1.smithi203.stdout:5/432: write d0/d6/d16/d9/d86/f9f [783812,110013] 0 2024-04-12T09:11:27.520 INFO:tasks.workunit.client.1.smithi203.stdout:4/324: truncate fb 490593 0 2024-04-12T09:11:27.520 INFO:tasks.workunit.client.1.smithi203.stdout:4/325: stat ff 0 2024-04-12T09:11:27.522 INFO:tasks.workunit.client.1.smithi203.stdout:4/326: write d1a/d20/d5d/d2c/f51 [3825001,96840] 0 2024-04-12T09:11:27.522 INFO:tasks.workunit.client.1.smithi203.stdout:6/328: truncate d1/d3/d12/f1f 2220842 0 2024-04-12T09:11:27.522 INFO:tasks.workunit.client.1.smithi203.stdout:1/396: dread df/d20/d54/f46 [0,4194304] 0 2024-04-12T09:11:27.523 INFO:tasks.workunit.client.0.smithi117.stdout:4/922: creat d0/d2c/d3c/d10a/f12b x:0 0 0 2024-04-12T09:11:27.526 INFO:tasks.workunit.client.1.smithi203.stdout:4/327: write d1a/d21/d22/f39 [463478,2063] 0 2024-04-12T09:11:27.526 INFO:tasks.workunit.client.1.smithi203.stdout:1/397: readlink df/d20/d2b/l3d 0 2024-04-12T09:11:27.526 INFO:tasks.workunit.client.1.smithi203.stdout:9/318: link d8/d12/d23/d27/d4f/c79 d8/d12/d23/d38/c7c 0 2024-04-12T09:11:27.528 INFO:tasks.workunit.client.0.smithi117.stdout:9/818: truncate d1/d8/d5a/dc2/f55 2745242 0 2024-04-12T09:11:27.528 INFO:tasks.workunit.client.1.smithi203.stdout:4/328: dread - d1a/d21/f5c zero size 2024-04-12T09:11:27.529 INFO:tasks.workunit.client.0.smithi117.stdout:7/787: getdents d0/d2/d45/d17/d23/dac 0 2024-04-12T09:11:27.530 INFO:tasks.workunit.client.0.smithi117.stdout:7/788: write d0/d2/d45/d17/f31 [1823214,43356] 0 2024-04-12T09:11:27.530 INFO:tasks.workunit.client.1.smithi203.stdout:0/382: mkdir d0/d1d/d2f/d17/d19/d6f/d78 0 2024-04-12T09:11:27.531 INFO:tasks.workunit.client.0.smithi117.stdout:4/923: mkdir d0/d5/d3b/d38/d4f/dce/d12c 0 2024-04-12T09:11:27.532 INFO:tasks.workunit.client.1.smithi203.stdout:5/433: dwrite d0/d6/d11/d18/d1a/f3f [0,4194304] 0 2024-04-12T09:11:27.534 INFO:tasks.workunit.client.1.smithi203.stdout:8/319: link d4/d8/l18 d4/l65 0 2024-04-12T09:11:27.535 INFO:tasks.workunit.client.0.smithi117.stdout:7/789: dread d0/d2/d45/d17/f31 [0,4194304] 0 2024-04-12T09:11:27.535 INFO:tasks.workunit.client.0.smithi117.stdout:9/819: creat d1/d8/d5e/d9f/f108 x:0 0 0 2024-04-12T09:11:27.536 INFO:tasks.workunit.client.0.smithi117.stdout:1/957: dread d1/dbd/d3f/db/d1d/d78/f58 [0,4194304] 0 2024-04-12T09:11:27.537 INFO:tasks.workunit.client.1.smithi203.stdout:9/319: unlink l6 0 2024-04-12T09:11:27.540 INFO:tasks.workunit.client.1.smithi203.stdout:4/329: dwrite f14 [0,4194304] 0 2024-04-12T09:11:27.540 INFO:tasks.workunit.client.1.smithi203.stdout:6/329: rename d1/d3/d26/d36/l59 to d1/df/d1b/d3b/d45/l6a 0 2024-04-12T09:11:27.541 INFO:tasks.workunit.client.1.smithi203.stdout:4/330: chown d1a/d2b/l53 73655 1 2024-04-12T09:11:27.545 INFO:tasks.workunit.client.1.smithi203.stdout:0/383: rename d0/d59/d5d/d72 to d0/d59/d5d/d79 0 2024-04-12T09:11:27.547 INFO:tasks.workunit.client.0.smithi117.stdout:6/917: getdents d8/d9/d17/d33 0 2024-04-12T09:11:27.548 INFO:tasks.workunit.client.1.smithi203.stdout:2/365: sync 2024-04-12T09:11:27.549 INFO:tasks.workunit.client.1.smithi203.stdout:2/366: fsync d0/d14/d23/d3d/f64 0 2024-04-12T09:11:27.550 INFO:tasks.workunit.client.1.smithi203.stdout:8/320: creat d4/f66 x:0 0 0 2024-04-12T09:11:27.551 INFO:tasks.workunit.client.1.smithi203.stdout:8/321: chown d4/c52 1523649 1 2024-04-12T09:11:27.553 INFO:tasks.workunit.client.0.smithi117.stdout:1/958: truncate d1/d64/ff4 758299 0 2024-04-12T09:11:27.554 INFO:tasks.workunit.client.1.smithi203.stdout:0/384: mkdir d0/d1d/d2f/d4c/d7a 0 2024-04-12T09:11:27.556 INFO:tasks.workunit.client.1.smithi203.stdout:1/398: creat df/f76 x:0 0 0 2024-04-12T09:11:27.558 INFO:tasks.workunit.client.1.smithi203.stdout:3/326: dread d2/d8/d14/d1b/d2f/f32 [0,4194304] 0 2024-04-12T09:11:27.558 INFO:tasks.workunit.client.0.smithi117.stdout:9/820: symlink d1/d8/df/l109 0 2024-04-12T09:11:27.559 INFO:tasks.workunit.client.1.smithi203.stdout:0/385: dread - d0/d1d/d2f/d34/f4a zero size 2024-04-12T09:11:27.561 INFO:tasks.workunit.client.1.smithi203.stdout:2/367: dwrite d0/d54/d61/f79 [0,4194304] 0 2024-04-12T09:11:27.563 INFO:tasks.workunit.client.1.smithi203.stdout:8/322: dwrite d4/d8/d19/f54 [0,4194304] 0 2024-04-12T09:11:27.563 INFO:tasks.workunit.client.1.smithi203.stdout:9/320: link d8/d12/d23/d29/d2c/f5a d8/d3b/d6f/f7d 0 2024-04-12T09:11:27.563 INFO:tasks.workunit.client.1.smithi203.stdout:0/386: write d0/d1d/d2f/d17/d19/f37 [2691540,84244] 0 2024-04-12T09:11:27.564 INFO:tasks.workunit.client.1.smithi203.stdout:2/368: chown d0/d14/d23/d33/l53 451785 1 2024-04-12T09:11:27.565 INFO:tasks.workunit.client.1.smithi203.stdout:0/387: chown d0/d1d/f5f 8 1 2024-04-12T09:11:27.566 INFO:tasks.workunit.client.1.smithi203.stdout:4/331: unlink d1a/d21/d60/c65 0 2024-04-12T09:11:27.568 INFO:tasks.workunit.client.0.smithi117.stdout:1/959: mkdir d1/db3/d130 0 2024-04-12T09:11:27.575 INFO:tasks.workunit.client.0.smithi117.stdout:1/960: symlink d1/dbd/d3f/db/d1d/d78/dbc/l131 0 2024-04-12T09:11:27.578 INFO:tasks.workunit.client.1.smithi203.stdout:3/327: unlink d2/le 0 2024-04-12T09:11:27.579 INFO:tasks.workunit.client.1.smithi203.stdout:5/434: link d0/d6/d16/d8/c7f d0/d6/d16/d9/d30/ca2 0 2024-04-12T09:11:27.585 INFO:tasks.workunit.client.1.smithi203.stdout:2/369: chown d0/d19/l25 11928326 1 2024-04-12T09:11:27.586 INFO:tasks.workunit.client.1.smithi203.stdout:4/332: mkdir d1a/d1d/d69 0 2024-04-12T09:11:27.587 INFO:tasks.workunit.client.1.smithi203.stdout:4/333: dread - d1a/d21/f67 zero size 2024-04-12T09:11:27.588 INFO:tasks.workunit.client.1.smithi203.stdout:4/334: truncate f14 4789065 0 2024-04-12T09:11:27.590 INFO:tasks.workunit.client.1.smithi203.stdout:3/328: mkdir d2/d8/d14/d23/d35/d4c/d67 0 2024-04-12T09:11:27.592 INFO:tasks.workunit.client.1.smithi203.stdout:5/435: rename d0/fa0 to d0/d6/d16/d9/d30/d58/d74/fa3 0 2024-04-12T09:11:27.596 INFO:tasks.workunit.client.1.smithi203.stdout:4/335: creat d1a/d21/d22/f6a x:0 0 0 2024-04-12T09:11:27.596 INFO:tasks.workunit.client.1.smithi203.stdout:4/336: stat l17 0 2024-04-12T09:11:27.597 INFO:tasks.workunit.client.1.smithi203.stdout:3/329: creat d2/d8/d14/d23/d35/d4c/d5c/d55/f68 x:0 0 0 2024-04-12T09:11:27.598 INFO:tasks.workunit.client.1.smithi203.stdout:5/436: creat d0/d6/d16/d9/fa4 x:0 0 0 2024-04-12T09:11:27.599 INFO:tasks.workunit.client.1.smithi203.stdout:4/337: read d1a/d21/d22/d2e/f4b [1996306,98756] 0 2024-04-12T09:11:27.600 INFO:tasks.workunit.client.1.smithi203.stdout:0/388: dread d0/d1d/d2f/d4c/f4f [0,4194304] 0 2024-04-12T09:11:27.601 INFO:tasks.workunit.client.1.smithi203.stdout:1/399: creat df/d20/d54/d5d/d4a/f77 x:0 0 0 2024-04-12T09:11:27.603 INFO:tasks.workunit.client.1.smithi203.stdout:1/400: dread - df/d20/d54/f40 zero size 2024-04-12T09:11:27.604 INFO:tasks.workunit.client.1.smithi203.stdout:4/338: symlink d1a/d21/d22/l6b 0 2024-04-12T09:11:27.604 INFO:tasks.workunit.client.0.smithi117.stdout:4/924: write d0/d1/d34/f57 [30874,100903] 0 2024-04-12T09:11:27.604 INFO:tasks.workunit.client.1.smithi203.stdout:9/321: dread d8/fa [0,4194304] 0 2024-04-12T09:11:27.606 INFO:tasks.workunit.client.0.smithi117.stdout:9/821: dread d1/d8/df/d7d/d7e/f78 [0,4194304] 0 2024-04-12T09:11:27.610 INFO:tasks.workunit.client.0.smithi117.stdout:7/790: write d0/d2/d45/d17/d23/d39/d6c/fc1 [149526,18336] 0 2024-04-12T09:11:27.611 INFO:tasks.workunit.client.0.smithi117.stdout:7/791: dread - d0/d2/d1a/d4f/f7b zero size 2024-04-12T09:11:27.615 INFO:tasks.workunit.client.1.smithi203.stdout:8/323: dread d4/d8/f42 [4194304,4194304] 0 2024-04-12T09:11:27.617 INFO:tasks.workunit.client.0.smithi117.stdout:4/925: symlink d0/d5/d25/dfd/d107/l12d 0 2024-04-12T09:11:27.617 INFO:tasks.workunit.client.0.smithi117.stdout:6/918: write d8/d3a/d49/da4/ffa [412216,18060] 0 2024-04-12T09:11:27.619 INFO:tasks.workunit.client.1.smithi203.stdout:1/401: dread df/d20/d54/f3b [0,4194304] 0 2024-04-12T09:11:27.621 INFO:tasks.workunit.client.1.smithi203.stdout:3/330: dread d2/d8/d14/d23/d35/d4c/d5c/f4d [0,4194304] 0 2024-04-12T09:11:27.623 INFO:tasks.workunit.client.1.smithi203.stdout:0/389: unlink d0/d1d/d2f/c15 0 2024-04-12T09:11:27.623 INFO:tasks.workunit.client.1.smithi203.stdout:8/324: symlink d4/d8/d19/l67 0 2024-04-12T09:11:27.624 INFO:tasks.workunit.client.1.smithi203.stdout:8/325: write f3 [4887212,70204] 0 2024-04-12T09:11:27.624 INFO:tasks.workunit.client.1.smithi203.stdout:0/390: dread - d0/d1d/d2f/d34/f4a zero size 2024-04-12T09:11:27.626 INFO:tasks.workunit.client.0.smithi117.stdout:6/919: symlink d8/d3a/d49/da4/d8a/l125 0 2024-04-12T09:11:27.627 INFO:tasks.workunit.client.1.smithi203.stdout:3/331: mkdir d2/d8/d14/d69 0 2024-04-12T09:11:27.627 INFO:tasks.workunit.client.1.smithi203.stdout:3/332: read - d2/d8/d14/d23/d35/d4c/d5c/d55/f66 zero size 2024-04-12T09:11:27.629 INFO:tasks.workunit.client.0.smithi117.stdout:4/926: mkdir d0/d5/d3b/d38/d4f/d79/d9c/dab/d12e 0 2024-04-12T09:11:27.632 INFO:tasks.workunit.client.1.smithi203.stdout:3/333: mknod d2/d8/d14/d23/d35/c6a 0 2024-04-12T09:11:27.634 INFO:tasks.workunit.client.1.smithi203.stdout:8/326: fdatasync d4/d8/fd 0 2024-04-12T09:11:27.634 INFO:tasks.workunit.client.0.smithi117.stdout:1/961: dwrite d1/dbd/d3f/d72/ff5 [0,4194304] 0 2024-04-12T09:11:27.634 INFO:tasks.workunit.client.1.smithi203.stdout:8/327: dread - d4/f5a zero size 2024-04-12T09:11:27.635 INFO:tasks.workunit.client.1.smithi203.stdout:1/402: dread df/d20/d2b/f44 [0,4194304] 0 2024-04-12T09:11:27.636 INFO:tasks.workunit.client.0.smithi117.stdout:4/927: mkdir d0/d5/d25/dfd/d107/da7/dcd/dcf/d12f 0 2024-04-12T09:11:27.640 INFO:tasks.workunit.client.0.smithi117.stdout:1/962: creat d1/d96/f132 x:0 0 0 2024-04-12T09:11:27.646 INFO:tasks.workunit.client.0.smithi117.stdout:6/920: getdents d8/d2a/d60/d7d/d9b 0 2024-04-12T09:11:27.646 INFO:tasks.workunit.client.0.smithi117.stdout:1/963: dwrite d1/dbd/d3f/db/f10f [0,4194304] 0 2024-04-12T09:11:27.653 INFO:tasks.workunit.client.1.smithi203.stdout:7/339: sync 2024-04-12T09:11:27.661 INFO:tasks.workunit.client.1.smithi203.stdout:3/334: rename d2/d8/d14/c1c to d2/d8/d14/c6b 0 2024-04-12T09:11:27.662 INFO:tasks.workunit.client.1.smithi203.stdout:2/370: write d0/d38/d43/f44 [3496684,72490] 0 2024-04-12T09:11:27.662 INFO:tasks.workunit.client.1.smithi203.stdout:8/328: write d4/d8/d19/f27 [1053429,115429] 0 2024-04-12T09:11:27.664 INFO:tasks.workunit.client.1.smithi203.stdout:8/329: chown d4/d8/d1c/d5d 197285 1 2024-04-12T09:11:27.666 INFO:tasks.workunit.client.1.smithi203.stdout:3/335: dread d2/d8/d14/d23/d35/f5a [0,4194304] 0 2024-04-12T09:11:27.668 INFO:tasks.workunit.client.1.smithi203.stdout:7/340: rename d0/d4/d1c/f6b to d0/d34/d7c/f80 0 2024-04-12T09:11:27.668 INFO:tasks.workunit.client.1.smithi203.stdout:8/330: creat d4/d8/d19/d53/f68 x:0 0 0 2024-04-12T09:11:27.671 INFO:tasks.workunit.client.1.smithi203.stdout:3/336: fdatasync d2/d8/d14/d23/d35/f5a 0 2024-04-12T09:11:27.671 INFO:tasks.workunit.client.1.smithi203.stdout:7/341: fdatasync d0/d4/d1c/d61/f74 0 2024-04-12T09:11:27.672 INFO:tasks.workunit.client.1.smithi203.stdout:5/437: creat d0/d6/d16/d9/fa5 x:0 0 0 2024-04-12T09:11:27.673 INFO:tasks.workunit.client.1.smithi203.stdout:2/371: link d0/d2e/c4d d0/d3/c88 0 2024-04-12T09:11:27.677 INFO:tasks.workunit.client.1.smithi203.stdout:2/372: read d0/d54/d61/f79 [366879,24178] 0 2024-04-12T09:11:27.677 INFO:tasks.workunit.client.1.smithi203.stdout:1/403: dwrite df/d20/d54/d5d/d4a/f77 [0,4194304] 0 2024-04-12T09:11:27.681 INFO:tasks.workunit.client.1.smithi203.stdout:8/331: dwrite d4/d8/d1c/d5d/f60 [0,4194304] 0 2024-04-12T09:11:27.683 INFO:tasks.workunit.client.1.smithi203.stdout:8/332: dread - d4/d8/d37/f5f zero size 2024-04-12T09:11:27.684 INFO:tasks.workunit.client.1.smithi203.stdout:7/342: dwrite d0/d4/d1c/d5b/f6c [0,4194304] 0 2024-04-12T09:11:27.713 INFO:tasks.workunit.client.1.smithi203.stdout:4/339: sync 2024-04-12T09:11:27.714 INFO:tasks.workunit.client.1.smithi203.stdout:6/330: sync 2024-04-12T09:11:27.763 INFO:tasks.workunit.client.1.smithi203.stdout:0/391: sync 2024-04-12T09:11:27.775 INFO:tasks.workunit.client.0.smithi117.stdout:4/928: creat d0/d5/d25/dfd/d107/daf/f130 x:0 0 0 2024-04-12T09:11:27.776 INFO:tasks.workunit.client.0.smithi117.stdout:9/822: write d1/d8/d5a/d6e/d71/fa9 [2104690,52354] 0 2024-04-12T09:11:27.778 INFO:tasks.workunit.client.0.smithi117.stdout:4/929: write d0/d2c/d67/fd8 [2406738,100878] 0 2024-04-12T09:11:27.778 INFO:tasks.workunit.client.0.smithi117.stdout:6/921: read d8/d2a/d60/d106/fa3 [77295,90350] 0 2024-04-12T09:11:27.781 INFO:tasks.workunit.client.0.smithi117.stdout:4/930: chown d0/d1/d34/c1e 170845 1 2024-04-12T09:11:27.781 INFO:tasks.workunit.client.0.smithi117.stdout:9/823: write d1/d8/df/d3e/f1d [3113725,85166] 0 2024-04-12T09:11:27.782 INFO:tasks.workunit.client.1.smithi203.stdout:9/322: unlink d8/d12/d23/d29/d2c/c57 0 2024-04-12T09:11:27.783 INFO:tasks.workunit.client.0.smithi117.stdout:7/792: dwrite d0/d2/d45/d17/d23/d50/d5c/fee [0,4194304] 0 2024-04-12T09:11:27.785 INFO:tasks.workunit.client.1.smithi203.stdout:3/337: symlink d2/d8/d14/d45/l6c 0 2024-04-12T09:11:27.785 INFO:tasks.workunit.client.1.smithi203.stdout:5/438: rmdir d0 39 2024-04-12T09:11:27.790 INFO:tasks.workunit.client.1.smithi203.stdout:2/373: mkdir d0/d54/d61/d78/d89 0 2024-04-12T09:11:27.791 INFO:tasks.workunit.client.0.smithi117.stdout:6/922: mkdir d8/d2a/d126 0 2024-04-12T09:11:27.792 INFO:tasks.workunit.client.1.smithi203.stdout:2/374: chown d0/d19/c6f 604 1 2024-04-12T09:11:27.794 INFO:tasks.workunit.client.0.smithi117.stdout:1/964: link d1/dbd/dbf/fd6 d1/dbd/d3f/db/dc2/f133 0 2024-04-12T09:11:27.795 INFO:tasks.workunit.client.1.smithi203.stdout:7/343: chown d0/d15/l42 247549 1 2024-04-12T09:11:27.799 INFO:tasks.workunit.client.0.smithi117.stdout:9/824: unlink d1/d8/df/d68/ddf/fa7 0 2024-04-12T09:11:27.801 INFO:tasks.workunit.client.1.smithi203.stdout:8/333: unlink d4/d8/d1c/d5d/l4c 0 2024-04-12T09:11:27.802 INFO:tasks.workunit.client.0.smithi117.stdout:7/793: symlink d0/d2/d1a/d4f/lf9 0 2024-04-12T09:11:27.803 INFO:tasks.workunit.client.1.smithi203.stdout:6/331: creat d1/df/f6b x:0 0 0 2024-04-12T09:11:27.804 INFO:tasks.workunit.client.0.smithi117.stdout:4/931: mkdir d0/d5/d3b/d38/d4f/d131 0 2024-04-12T09:11:27.805 INFO:tasks.workunit.client.0.smithi117.stdout:4/932: dread - d0/d5/d3b/d38/d4f/f10b zero size 2024-04-12T09:11:27.805 INFO:tasks.workunit.client.0.smithi117.stdout:4/933: fsync d0/d1/d34/fc1 0 2024-04-12T09:11:27.806 INFO:tasks.workunit.client.0.smithi117.stdout:4/934: chown d0/d5/d25/fd7 64808 1 2024-04-12T09:11:27.808 INFO:tasks.workunit.client.0.smithi117.stdout:1/965: rmdir d1/d64/d111 39 2024-04-12T09:11:27.809 INFO:tasks.workunit.client.0.smithi117.stdout:1/966: write d1/dbd/d3f/db/d16/f47 [1392605,50745] 0 2024-04-12T09:11:27.810 INFO:tasks.workunit.client.1.smithi203.stdout:9/323: unlink d8/d12/d23/d41/l4d 0 2024-04-12T09:11:27.815 INFO:tasks.workunit.client.0.smithi117.stdout:7/794: mkdir d0/d20/d4a/dce/dcf/dfa 0 2024-04-12T09:11:27.821 INFO:tasks.workunit.client.1.smithi203.stdout:1/404: symlink df/d20/d54/d5d/d4a/l78 0 2024-04-12T09:11:27.822 INFO:tasks.workunit.client.1.smithi203.stdout:2/375: mkdir d0/d14/d8a 0 2024-04-12T09:11:27.824 INFO:tasks.workunit.client.0.smithi117.stdout:4/935: creat d0/d5/d39/d4e/d6b/f132 x:0 0 0 2024-04-12T09:11:27.825 INFO:tasks.workunit.client.1.smithi203.stdout:7/344: creat d0/d4/d1c/d61/f81 x:0 0 0 2024-04-12T09:11:27.826 INFO:tasks.workunit.client.1.smithi203.stdout:0/392: write d0/d1d/d2f/d17/f11 [2687282,12281] 0 2024-04-12T09:11:27.828 INFO:tasks.workunit.client.1.smithi203.stdout:6/332: rename d1/df/d1b/d3b to d1/d3/d26/d30/d4a/d6c 0 2024-04-12T09:11:27.829 INFO:tasks.workunit.client.1.smithi203.stdout:6/333: chown d1/df/d1b 23 1 2024-04-12T09:11:27.829 INFO:tasks.workunit.client.1.smithi203.stdout:0/393: read d0/d1d/d2f/d17/fa [3114787,119343] 0 2024-04-12T09:11:27.829 INFO:tasks.workunit.client.1.smithi203.stdout:4/340: getdents d1a/d1d/d69 0 2024-04-12T09:11:27.830 INFO:tasks.workunit.client.0.smithi117.stdout:7/795: symlink d0/d2/d45/d15/lfb 0 2024-04-12T09:11:27.830 INFO:tasks.workunit.client.1.smithi203.stdout:6/334: read d1/d3/f39 [1326469,107170] 0 2024-04-12T09:11:27.831 INFO:tasks.workunit.client.1.smithi203.stdout:6/335: chown d1/c50 1165 1 2024-04-12T09:11:27.831 INFO:tasks.workunit.client.0.smithi117.stdout:4/936: mknod d0/d5/d39/da2/c133 0 2024-04-12T09:11:27.831 INFO:tasks.workunit.client.1.smithi203.stdout:6/336: dread - d1/df/f6b zero size 2024-04-12T09:11:27.832 INFO:tasks.workunit.client.0.smithi117.stdout:7/796: chown d0/d2/d45/d17/d23/d50/f46 113499 1 2024-04-12T09:11:27.834 INFO:tasks.workunit.client.0.smithi117.stdout:1/967: symlink d1/dbd/d3f/db/d16/db6/da9/d9a/l134 0 2024-04-12T09:11:27.834 INFO:tasks.workunit.client.0.smithi117.stdout:9/825: dwrite d1/d8/df/d68/ddf/f84 [0,4194304] 0 2024-04-12T09:11:27.835 INFO:tasks.workunit.client.1.smithi203.stdout:5/439: dread d0/d6/d11/d38/f84 [0,4194304] 0 2024-04-12T09:11:27.838 INFO:tasks.workunit.client.0.smithi117.stdout:6/923: truncate d8/d3a/d49/da4/d8a/fe7 1728548 0 2024-04-12T09:11:27.839 INFO:tasks.workunit.client.0.smithi117.stdout:6/924: chown d8/d2a/fd0 10101972 1 2024-04-12T09:11:27.839 INFO:tasks.workunit.client.0.smithi117.stdout:6/925: readlink d8/d3a/d49/l73 0 2024-04-12T09:11:27.841 INFO:tasks.workunit.client.1.smithi203.stdout:3/338: truncate d2/d8/d14/f2c 2079428 0 2024-04-12T09:11:27.843 INFO:tasks.workunit.client.1.smithi203.stdout:1/405: symlink df/d20/d54/l79 0 2024-04-12T09:11:27.844 INFO:tasks.workunit.client.1.smithi203.stdout:1/406: fdatasync df/d20/d2b/f42 0 2024-04-12T09:11:27.845 INFO:tasks.workunit.client.0.smithi117.stdout:9/826: creat d1/d8/df/da2/f10a x:0 0 0 2024-04-12T09:11:27.847 INFO:tasks.workunit.client.1.smithi203.stdout:7/345: mknod d0/d38/d51/c82 0 2024-04-12T09:11:27.848 INFO:tasks.workunit.client.1.smithi203.stdout:7/346: write d0/d38/d51/f7d [362900,99619] 0 2024-04-12T09:11:27.850 INFO:tasks.workunit.client.1.smithi203.stdout:7/347: fdatasync d0/d4/d1c/d61/f81 0 2024-04-12T09:11:27.850 INFO:tasks.workunit.client.1.smithi203.stdout:4/341: creat d1a/d21/d22/d2e/f6c x:0 0 0 2024-04-12T09:11:27.851 INFO:tasks.workunit.client.1.smithi203.stdout:8/334: dwrite d4/d8/f1d [0,4194304] 0 2024-04-12T09:11:27.852 INFO:tasks.workunit.client.1.smithi203.stdout:4/342: write d1a/d21/f33 [830309,26747] 0 2024-04-12T09:11:27.855 INFO:tasks.workunit.client.0.smithi117.stdout:1/968: symlink d1/d64/d111/l135 0 2024-04-12T09:11:27.855 INFO:tasks.workunit.client.0.smithi117.stdout:4/937: dwrite d0/d2c/d3c/f45 [0,4194304] 0 2024-04-12T09:11:27.857 INFO:tasks.workunit.client.0.smithi117.stdout:1/969: dread - d1/d64/d45/f129 zero size 2024-04-12T09:11:27.858 INFO:tasks.workunit.client.0.smithi117.stdout:1/970: stat d1/dbd/d3f/db/d16/db6/f69 0 2024-04-12T09:11:27.860 INFO:tasks.workunit.client.0.smithi117.stdout:4/938: truncate d0/d5/d25/dfd/d107/daf/f130 265205 0 2024-04-12T09:11:27.862 INFO:tasks.workunit.client.0.smithi117.stdout:6/926: link d8/d3a/d49/da4/d8a/de2/df3/f114 d8/d2a/d60/d7d/d8c/d107/f127 0 2024-04-12T09:11:27.862 INFO:tasks.workunit.client.0.smithi117.stdout:4/939: dread - d0/d5/d25/dfd/d107/da7/dcd/fd5 zero size 2024-04-12T09:11:27.864 INFO:tasks.workunit.client.0.smithi117.stdout:7/797: truncate d0/f2b 6890298 0 2024-04-12T09:11:27.864 INFO:tasks.workunit.client.0.smithi117.stdout:4/940: write d0/d5/d39/da2/fb8 [4935193,78470] 0 2024-04-12T09:11:27.865 INFO:tasks.workunit.client.1.smithi203.stdout:5/440: rmdir d0/d6/d16/d44 39 2024-04-12T09:11:27.866 INFO:tasks.workunit.client.0.smithi117.stdout:4/941: chown d0/d5/d3b/d38/d10f/f11a 7 1 2024-04-12T09:11:27.869 INFO:tasks.workunit.client.1.smithi203.stdout:3/339: mknod d2/d51/c6d 0 2024-04-12T09:11:27.871 INFO:tasks.workunit.client.1.smithi203.stdout:5/441: dread d0/d6/d11/d18/d1a/f3f [0,4194304] 0 2024-04-12T09:11:27.872 INFO:tasks.workunit.client.1.smithi203.stdout:6/337: dread d1/d3/d12/f1f [0,4194304] 0 2024-04-12T09:11:27.872 INFO:tasks.workunit.client.0.smithi117.stdout:7/798: mknod d0/d20/d4a/dce/cfc 0 2024-04-12T09:11:27.873 INFO:tasks.workunit.client.1.smithi203.stdout:5/442: chown d0/d6/d11/d1e/c2f 472461933 1 2024-04-12T09:11:27.874 INFO:tasks.workunit.client.1.smithi203.stdout:5/443: fdatasync d0/d6/f93 0 2024-04-12T09:11:27.874 INFO:tasks.workunit.client.1.smithi203.stdout:7/348: symlink d0/d34/l83 0 2024-04-12T09:11:27.874 INFO:tasks.workunit.client.0.smithi117.stdout:6/927: dwrite d8/d3f/faa [0,4194304] 0 2024-04-12T09:11:27.875 INFO:tasks.workunit.client.1.smithi203.stdout:5/444: stat d0/d6/d11/f6c 0 2024-04-12T09:11:27.876 INFO:tasks.workunit.client.1.smithi203.stdout:5/445: dread - d0/d6/d11/d38/f7a zero size 2024-04-12T09:11:27.876 INFO:tasks.workunit.client.1.smithi203.stdout:3/340: dwrite d2/f30 [0,4194304] 0 2024-04-12T09:11:27.877 INFO:tasks.workunit.client.1.smithi203.stdout:5/446: dread - d0/d6/d11/f6c zero size 2024-04-12T09:11:27.879 INFO:tasks.workunit.client.0.smithi117.stdout:4/942: symlink d0/d5/d25/d9f/d109/l134 0 2024-04-12T09:11:27.880 INFO:tasks.workunit.client.0.smithi117.stdout:9/827: dwrite d1/d8/df/d68/ddf/daf/d3b/f42 [0,4194304] 0 2024-04-12T09:11:27.884 INFO:tasks.workunit.client.1.smithi203.stdout:8/335: creat d4/d8/d1c/d5d/f69 x:0 0 0 2024-04-12T09:11:27.885 INFO:tasks.workunit.client.1.smithi203.stdout:9/324: creat d8/d3b/d6f/d74/f7e x:0 0 0 2024-04-12T09:11:27.888 INFO:tasks.workunit.client.0.smithi117.stdout:6/928: dwrite d8/d9/d17/d33/d101/d97/fb9 [4194304,4194304] 0 2024-04-12T09:11:27.894 INFO:tasks.workunit.client.0.smithi117.stdout:9/828: mknod d1/d8/d12/c10b 0 2024-04-12T09:11:27.895 INFO:tasks.workunit.client.0.smithi117.stdout:7/799: dread d0/d2/d1a/f55 [0,4194304] 0 2024-04-12T09:11:27.895 INFO:tasks.workunit.client.0.smithi117.stdout:1/971: dwrite d1/dbd/d51/fdf [0,4194304] 0 2024-04-12T09:11:27.896 INFO:tasks.workunit.client.0.smithi117.stdout:4/943: mkdir d0/d5/d39/d4e/d6b/d83/db1/d135 0 2024-04-12T09:11:27.901 INFO:tasks.workunit.client.1.smithi203.stdout:2/376: creat d0/d14/d23/f8b x:0 0 0 2024-04-12T09:11:27.902 INFO:tasks.workunit.client.0.smithi117.stdout:9/829: write d1/d24/fa5 [2249943,1828] 0 2024-04-12T09:11:27.902 INFO:tasks.workunit.client.1.smithi203.stdout:2/377: fsync d0/d3/f10 0 2024-04-12T09:11:27.902 INFO:tasks.workunit.client.1.smithi203.stdout:6/338: rmdir d1/df 39 2024-04-12T09:11:27.903 INFO:tasks.workunit.client.0.smithi117.stdout:6/929: dwrite d8/d2a/d60/d7d/d8c/db8/fd1 [0,4194304] 0 2024-04-12T09:11:27.904 INFO:tasks.workunit.client.1.smithi203.stdout:6/339: fdatasync d1/d3/d26/d5d/f67 0 2024-04-12T09:11:27.906 INFO:tasks.workunit.client.0.smithi117.stdout:7/800: rename d0/d2/d1a/d4f to d0/d20/d4a/dfd 0 2024-04-12T09:11:27.911 INFO:tasks.workunit.client.0.smithi117.stdout:4/944: creat d0/d5/d3b/f136 x:0 0 0 2024-04-12T09:11:27.912 INFO:tasks.workunit.client.1.smithi203.stdout:8/336: creat d4/d34/f6a x:0 0 0 2024-04-12T09:11:27.917 INFO:tasks.workunit.client.0.smithi117.stdout:1/972: rename d1/dbd/d3f/db/ld9 to d1/dbd/d3f/d72/l136 0 2024-04-12T09:11:27.920 INFO:tasks.workunit.client.1.smithi203.stdout:8/337: dwrite d4/d8/d19/f25 [0,4194304] 0 2024-04-12T09:11:27.922 INFO:tasks.workunit.client.1.smithi203.stdout:1/407: rmdir df/d20/d54/d5d/d6c 0 2024-04-12T09:11:27.922 INFO:tasks.workunit.client.1.smithi203.stdout:8/338: stat d4/f2d 0 2024-04-12T09:11:27.924 INFO:tasks.workunit.client.1.smithi203.stdout:5/447: creat d0/d6/d16/d9/d30/d58/fa6 x:0 0 0 2024-04-12T09:11:27.925 INFO:tasks.workunit.client.1.smithi203.stdout:5/448: dread - d0/d6/d16/d9/d30/d58/d74/fa3 zero size 2024-04-12T09:11:27.933 INFO:tasks.workunit.client.0.smithi117.stdout:7/801: rmdir d0/d2/d45/d17/d23/dac/dad/de8 0 2024-04-12T09:11:27.934 INFO:tasks.workunit.client.1.smithi203.stdout:3/341: creat d2/f6e x:0 0 0 2024-04-12T09:11:27.935 INFO:tasks.workunit.client.1.smithi203.stdout:3/342: chown d2/d8/d14/d23/c4a 4806 1 2024-04-12T09:11:27.936 INFO:tasks.workunit.client.0.smithi117.stdout:9/830: write d1/d8/d5a/d79/d91/fc3 [125780,2603] 0 2024-04-12T09:11:27.936 INFO:tasks.workunit.client.1.smithi203.stdout:0/394: sync 2024-04-12T09:11:27.937 INFO:tasks.workunit.client.1.smithi203.stdout:3/343: dread - d2/d8/d14/d23/d35/d4c/d5c/d55/f66 zero size 2024-04-12T09:11:27.937 INFO:tasks.workunit.client.1.smithi203.stdout:4/343: truncate d1a/d21/d22/f4a 2503904 0 2024-04-12T09:11:27.939 INFO:tasks.workunit.client.1.smithi203.stdout:7/349: link d0/l52 d0/d38/d51/l84 0 2024-04-12T09:11:27.940 INFO:tasks.workunit.client.0.smithi117.stdout:4/945: truncate d0/d5/d3b/d38/d4f/f74 5523437 0 2024-04-12T09:11:27.941 INFO:tasks.workunit.client.0.smithi117.stdout:4/946: readlink d0/d5/d39/d4e/d51/l55 0 2024-04-12T09:11:27.942 INFO:tasks.workunit.client.0.smithi117.stdout:9/831: symlink d1/d8/df/d7d/d7e/l10c 0 2024-04-12T09:11:27.945 INFO:tasks.workunit.client.0.smithi117.stdout:7/802: creat d0/d2/d45/d17/d23/ffe x:0 0 0 2024-04-12T09:11:27.947 INFO:tasks.workunit.client.1.smithi203.stdout:0/395: creat d0/dd/f7b x:0 0 0 2024-04-12T09:11:27.947 INFO:tasks.workunit.client.1.smithi203.stdout:0/396: chown d0/d48 24462 1 2024-04-12T09:11:27.948 INFO:tasks.workunit.client.0.smithi117.stdout:6/930: dread d8/d9/d17/d33/d101/f88 [4194304,4194304] 0 2024-04-12T09:11:27.949 INFO:tasks.workunit.client.0.smithi117.stdout:6/931: chown d8/d3a/d49 43 1 2024-04-12T09:11:27.950 INFO:tasks.workunit.client.0.smithi117.stdout:9/832: rename d1/d8/df/d68/fc1 to d1/d8/df/d68/ddf/daf/d3b/f10d 0 2024-04-12T09:11:27.951 INFO:tasks.workunit.client.0.smithi117.stdout:6/932: fsync d8/d2a/d60/d89/f11d 0 2024-04-12T09:11:27.951 INFO:tasks.workunit.client.0.smithi117.stdout:1/973: dread d1/dbd/d51/f5a [0,4194304] 0 2024-04-12T09:11:27.952 INFO:tasks.workunit.client.1.smithi203.stdout:3/344: unlink d2/d51/l5d 0 2024-04-12T09:11:27.952 INFO:tasks.workunit.client.0.smithi117.stdout:1/974: chown d1/dbd/d3f/db/d16/db6/da9/d9a/l11d 845 1 2024-04-12T09:11:27.952 INFO:tasks.workunit.client.1.smithi203.stdout:4/344: dread fb [0,4194304] 0 2024-04-12T09:11:27.955 INFO:tasks.workunit.client.1.smithi203.stdout:7/350: creat d0/d4/d5d/f85 x:0 0 0 2024-04-12T09:11:27.955 INFO:tasks.workunit.client.1.smithi203.stdout:1/408: creat df/d2d/f7a x:0 0 0 2024-04-12T09:11:27.956 INFO:tasks.workunit.client.1.smithi203.stdout:7/351: write d0/d4/f43 [80051,13189] 0 2024-04-12T09:11:27.957 INFO:tasks.workunit.client.1.smithi203.stdout:1/409: write df/d2d/f5f [479378,28586] 0 2024-04-12T09:11:27.967 INFO:tasks.workunit.client.0.smithi117.stdout:1/975: rename d1/dbd/d3f/db/d16/db6/da9/d9a/l134 to d1/l137 0 2024-04-12T09:11:27.968 INFO:tasks.workunit.client.0.smithi117.stdout:1/976: chown d1/d64/cd3 2 1 2024-04-12T09:11:27.968 INFO:tasks.workunit.client.0.smithi117.stdout:1/977: dread - d1/dbd/dbf/ffc zero size 2024-04-12T09:11:27.969 INFO:tasks.workunit.client.0.smithi117.stdout:4/947: rmdir d0/d5/d3b/d38/d10f/d113 0 2024-04-12T09:11:27.970 INFO:tasks.workunit.client.0.smithi117.stdout:1/978: fdatasync d1/dbd/d3f/db/dc2/fed 0 2024-04-12T09:11:27.971 INFO:tasks.workunit.client.0.smithi117.stdout:1/979: write d1/dbd/d51/f83 [3459475,117197] 0 2024-04-12T09:11:27.973 INFO:tasks.workunit.client.0.smithi117.stdout:6/933: dread d8/d2a/fcf [0,4194304] 0 2024-04-12T09:11:27.973 INFO:tasks.workunit.client.0.smithi117.stdout:7/803: link d0/d2/d45/d53/la3 d0/d2/d45/d17/d23/dac/lff 0 2024-04-12T09:11:27.973 INFO:tasks.workunit.client.1.smithi203.stdout:8/339: getdents d4/d8/d1c 0 2024-04-12T09:11:27.973 INFO:tasks.workunit.client.1.smithi203.stdout:5/449: dwrite d0/d6/d11/d1e/d4c/f42 [0,4194304] 0 2024-04-12T09:11:27.975 INFO:tasks.workunit.client.0.smithi117.stdout:4/948: mknod d0/d2c/da6/c137 0 2024-04-12T09:11:27.976 INFO:tasks.workunit.client.1.smithi203.stdout:1/410: mknod df/d20/d54/d5d/c7b 0 2024-04-12T09:11:27.978 INFO:tasks.workunit.client.1.smithi203.stdout:1/411: chown df/d2d/d6f/d75 2855 1 2024-04-12T09:11:27.979 INFO:tasks.workunit.client.1.smithi203.stdout:4/345: write fb [873386,75216] 0 2024-04-12T09:11:27.979 INFO:tasks.workunit.client.0.smithi117.stdout:1/980: mknod d1/dc3/c138 0 2024-04-12T09:11:27.980 INFO:tasks.workunit.client.1.smithi203.stdout:0/397: dwrite d0/f36 [0,4194304] 0 2024-04-12T09:11:27.981 INFO:tasks.workunit.client.0.smithi117.stdout:9/833: dwrite d1/d8/d5a/d79/fc9 [0,4194304] 0 2024-04-12T09:11:27.981 INFO:tasks.workunit.client.1.smithi203.stdout:1/412: dread - df/d20/d54/f40 zero size 2024-04-12T09:11:27.982 INFO:tasks.workunit.client.1.smithi203.stdout:3/345: creat d2/d64/f6f x:0 0 0 2024-04-12T09:11:27.983 INFO:tasks.workunit.client.1.smithi203.stdout:3/346: dread - d2/f6e zero size 2024-04-12T09:11:27.987 INFO:tasks.workunit.client.1.smithi203.stdout:8/340: creat d4/d8/d19/d53/f6b x:0 0 0 2024-04-12T09:11:27.987 INFO:tasks.workunit.client.1.smithi203.stdout:3/347: dread d2/f2b [0,4194304] 0 2024-04-12T09:11:27.988 INFO:tasks.workunit.client.0.smithi117.stdout:1/981: write d1/d3b/f116 [907152,48776] 0 2024-04-12T09:11:27.989 INFO:tasks.workunit.client.0.smithi117.stdout:4/949: dwrite d0/d5/d3b/d38/d4f/fc4 [0,4194304] 0 2024-04-12T09:11:27.990 INFO:tasks.workunit.client.1.smithi203.stdout:5/450: chown d0/d6/d11/d38/c5b 2374 1 2024-04-12T09:11:27.994 INFO:tasks.workunit.client.1.smithi203.stdout:9/325: sync 2024-04-12T09:11:27.997 INFO:tasks.workunit.client.1.smithi203.stdout:4/346: creat d1a/d20/d5f/f6d x:0 0 0 2024-04-12T09:11:27.998 INFO:tasks.workunit.client.1.smithi203.stdout:7/352: dwrite d0/d15/f4a [4194304,4194304] 0 2024-04-12T09:11:27.998 INFO:tasks.workunit.client.1.smithi203.stdout:0/398: fsync d0/d1d/d2f/d17/fa 0 2024-04-12T09:11:27.999 INFO:tasks.workunit.client.0.smithi117.stdout:6/934: write d8/f1e [2272057,100813] 0 2024-04-12T09:11:28.000 INFO:tasks.workunit.client.1.smithi203.stdout:7/353: write d0/d4/f57 [2794012,63872] 0 2024-04-12T09:11:28.000 INFO:tasks.workunit.client.0.smithi117.stdout:1/982: unlink d1/dbd/d3f/db/d1d/c28 0 2024-04-12T09:11:28.000 INFO:tasks.workunit.client.1.smithi203.stdout:0/399: readlink d0/d1d/d2f/d17/d19/l58 0 2024-04-12T09:11:28.001 INFO:tasks.workunit.client.1.smithi203.stdout:7/354: stat d0/d4/f60 0 2024-04-12T09:11:28.001 INFO:tasks.workunit.client.1.smithi203.stdout:7/355: chown d0/d34 86089 1 2024-04-12T09:11:28.002 INFO:tasks.workunit.client.1.smithi203.stdout:1/413: rename df/f43 to df/d2d/d6f/f7c 0 2024-04-12T09:11:28.003 INFO:tasks.workunit.client.0.smithi117.stdout:4/950: stat d0/d5/d25/l3a 0 2024-04-12T09:11:28.003 INFO:tasks.workunit.client.1.smithi203.stdout:1/414: dread - df/d20/d54/d5d/d67/f6b zero size 2024-04-12T09:11:28.006 INFO:tasks.workunit.client.1.smithi203.stdout:5/451: creat d0/d6/d16/d9/d30/fa7 x:0 0 0 2024-04-12T09:11:28.006 INFO:tasks.workunit.client.0.smithi117.stdout:1/983: mknod d1/dc3/c139 0 2024-04-12T09:11:28.011 INFO:tasks.workunit.client.1.smithi203.stdout:4/347: symlink d1a/d21/d22/l6e 0 2024-04-12T09:11:28.012 INFO:tasks.workunit.client.0.smithi117.stdout:9/834: symlink d1/d8/df/d3e/d92/l10e 0 2024-04-12T09:11:28.013 INFO:tasks.workunit.client.0.smithi117.stdout:9/835: chown d1/d24/fcc 1848691304 1 2024-04-12T09:11:28.019 INFO:tasks.workunit.client.1.smithi203.stdout:0/400: mknod d0/d59/d5d/c7c 0 2024-04-12T09:11:28.021 INFO:tasks.workunit.client.1.smithi203.stdout:7/356: creat d0/d4/d5d/f86 x:0 0 0 2024-04-12T09:11:28.024 INFO:tasks.workunit.client.1.smithi203.stdout:2/378: sync 2024-04-12T09:11:28.024 INFO:tasks.workunit.client.1.smithi203.stdout:6/340: sync 2024-04-12T09:11:28.024 INFO:tasks.workunit.client.1.smithi203.stdout:8/341: rename d4/d8/d1c/d48/f59 to d4/d8/d1c/d48/d62/f6c 0 2024-04-12T09:11:28.025 INFO:tasks.workunit.client.1.smithi203.stdout:9/326: write d8/d3b/d6f/f7d [329960,89216] 0 2024-04-12T09:11:28.026 INFO:tasks.workunit.client.1.smithi203.stdout:6/341: write d1/d3/d12/f1e [719379,104206] 0 2024-04-12T09:11:28.026 INFO:tasks.workunit.client.1.smithi203.stdout:2/379: chown d0/d14/d1e/d2a/f60 2 1 2024-04-12T09:11:28.027 INFO:tasks.workunit.client.1.smithi203.stdout:1/415: symlink df/d20/d2b/l7d 0 2024-04-12T09:11:28.034 INFO:tasks.workunit.client.1.smithi203.stdout:7/357: rename d0/d4/d1c/d5b/f6c to d0/d34/f87 0 2024-04-12T09:11:28.036 INFO:tasks.workunit.client.1.smithi203.stdout:3/348: creat d2/f70 x:0 0 0 2024-04-12T09:11:28.040 INFO:tasks.workunit.client.1.smithi203.stdout:8/342: creat d4/d8/d19/f6d x:0 0 0 2024-04-12T09:11:28.041 INFO:tasks.workunit.client.1.smithi203.stdout:2/380: dread d0/d2e/f34 [0,4194304] 0 2024-04-12T09:11:28.043 INFO:tasks.workunit.client.1.smithi203.stdout:9/327: creat d8/d3b/d6f/d74/f7f x:0 0 0 2024-04-12T09:11:28.044 INFO:tasks.workunit.client.1.smithi203.stdout:2/381: dread d0/d3/f5f [0,4194304] 0 2024-04-12T09:11:28.046 INFO:tasks.workunit.client.1.smithi203.stdout:5/452: symlink d0/d6/d16/d9/d14/d2d/la8 0 2024-04-12T09:11:28.047 INFO:tasks.workunit.client.1.smithi203.stdout:4/348: getdents d1a/d1d/d69 0 2024-04-12T09:11:28.047 INFO:tasks.workunit.client.1.smithi203.stdout:5/453: dread - d0/d6/d11/d4a/f5a zero size 2024-04-12T09:11:28.049 INFO:tasks.workunit.client.1.smithi203.stdout:4/349: chown d1a/d21/d22/d2e/f6c 11 1 2024-04-12T09:11:28.050 INFO:tasks.workunit.client.1.smithi203.stdout:2/382: dwrite d0/d38/d43/f44 [0,4194304] 0 2024-04-12T09:11:28.050 INFO:tasks.workunit.client.1.smithi203.stdout:0/401: truncate d0/dd/d40/f62 10202 0 2024-04-12T09:11:28.051 INFO:tasks.workunit.client.1.smithi203.stdout:7/358: creat d0/d4/f88 x:0 0 0 2024-04-12T09:11:28.051 INFO:tasks.workunit.client.1.smithi203.stdout:2/383: chown d0/d14/d23 14370470 1 2024-04-12T09:11:28.051 INFO:tasks.workunit.client.1.smithi203.stdout:3/349: rmdir d2/d8 39 2024-04-12T09:11:28.052 INFO:tasks.workunit.client.1.smithi203.stdout:7/359: fdatasync d0/d4/f43 0 2024-04-12T09:11:28.053 INFO:tasks.workunit.client.1.smithi203.stdout:0/402: stat d0/d1d/d2f/f33 0 2024-04-12T09:11:28.054 INFO:tasks.workunit.client.1.smithi203.stdout:7/360: write d0/d4/d5d/f5c [66777,18060] 0 2024-04-12T09:11:28.054 INFO:tasks.workunit.client.1.smithi203.stdout:6/342: fdatasync d1/df/f38 0 2024-04-12T09:11:28.056 INFO:tasks.workunit.client.1.smithi203.stdout:6/343: fsync d1/d3/d26/d30/d4a/d6c/d45/f49 0 2024-04-12T09:11:28.058 INFO:tasks.workunit.client.1.smithi203.stdout:0/403: truncate d0/d1d/d2f/d4c/f4f 5580115 0 2024-04-12T09:11:28.061 INFO:tasks.workunit.client.1.smithi203.stdout:6/344: dread d1/d3/d26/d30/d4a/d6c/d45/f49 [0,4194304] 0 2024-04-12T09:11:28.062 INFO:tasks.workunit.client.1.smithi203.stdout:1/416: creat df/d59/f7e x:0 0 0 2024-04-12T09:11:28.065 INFO:tasks.workunit.client.1.smithi203.stdout:5/454: creat d0/d6/d11/d18/d1a/d23/fa9 x:0 0 0 2024-04-12T09:11:28.066 INFO:tasks.workunit.client.1.smithi203.stdout:4/350: creat d1a/d21/d22/d2e/f6f x:0 0 0 2024-04-12T09:11:28.069 INFO:tasks.workunit.client.1.smithi203.stdout:2/384: readlink d0/d19/l4b 0 2024-04-12T09:11:28.070 INFO:tasks.workunit.client.1.smithi203.stdout:2/385: write d0/d14/d23/d3d/f64 [301285,125553] 0 2024-04-12T09:11:28.071 INFO:tasks.workunit.client.1.smithi203.stdout:2/386: chown d0/f1a 0 1 2024-04-12T09:11:28.079 INFO:tasks.workunit.client.1.smithi203.stdout:9/328: mkdir d8/d80 0 2024-04-12T09:11:28.079 INFO:tasks.workunit.client.1.smithi203.stdout:9/329: dread - d8/d3b/d6f/d74/f7f zero size 2024-04-12T09:11:28.080 INFO:tasks.workunit.client.1.smithi203.stdout:0/404: dread d0/d1d/d2f/d4c/f6a [0,4194304] 0 2024-04-12T09:11:28.089 INFO:tasks.workunit.client.1.smithi203.stdout:1/417: mkdir df/d20/d54/d5d/d58/d7f 0 2024-04-12T09:11:28.090 INFO:tasks.workunit.client.0.smithi117.stdout:2/872: sync 2024-04-12T09:11:28.091 INFO:tasks.workunit.client.1.smithi203.stdout:6/345: unlink d1/d3/d26/d30/d4a/d6c/d45/d55/c57 0 2024-04-12T09:11:28.091 INFO:tasks.workunit.client.1.smithi203.stdout:1/418: read df/f17 [2122883,54374] 0 2024-04-12T09:11:28.092 INFO:tasks.workunit.client.1.smithi203.stdout:6/346: write d1/d3/f27 [881764,14027] 0 2024-04-12T09:11:28.098 INFO:tasks.workunit.client.1.smithi203.stdout:5/455: dwrite d0/d6/d16/d9/f24 [0,4194304] 0 2024-04-12T09:11:28.099 INFO:tasks.workunit.client.1.smithi203.stdout:1/419: dwrite df/f1e [4194304,4194304] 0 2024-04-12T09:11:28.114 INFO:tasks.workunit.client.1.smithi203.stdout:3/350: dwrite d2/d8/d59/f61 [4194304,4194304] 0 2024-04-12T09:11:28.115 INFO:tasks.workunit.client.1.smithi203.stdout:2/387: rmdir d0/d38/d43 39 2024-04-12T09:11:28.115 INFO:tasks.workunit.client.1.smithi203.stdout:8/343: creat d4/d8/f6e x:0 0 0 2024-04-12T09:11:28.116 INFO:tasks.workunit.client.1.smithi203.stdout:2/388: dread - d0/d14/d23/f8b zero size 2024-04-12T09:11:28.117 INFO:tasks.workunit.client.1.smithi203.stdout:7/361: mkdir d0/d15/d89 0 2024-04-12T09:11:28.117 INFO:tasks.workunit.client.1.smithi203.stdout:8/344: fdatasync d4/d8/d1c/d5d/f69 0 2024-04-12T09:11:28.117 INFO:tasks.workunit.client.0.smithi117.stdout:1/984: mknod d1/db3/c13a 0 2024-04-12T09:11:28.119 INFO:tasks.workunit.client.0.smithi117.stdout:9/836: truncate d1/d8/d5a/d79/d91/fb4 908918 0 2024-04-12T09:11:28.120 INFO:tasks.workunit.client.1.smithi203.stdout:7/362: dread d0/d38/f5a [0,4194304] 0 2024-04-12T09:11:28.123 INFO:tasks.workunit.client.0.smithi117.stdout:2/873: rename d0/d43/da5/d8f/lb0 to d0/d4/d10/d27/d9a/d121/d116/l127 0 2024-04-12T09:11:28.126 INFO:tasks.workunit.client.0.smithi117.stdout:1/985: symlink d1/dbd/d3f/d72/d11c/l13b 0 2024-04-12T09:11:28.130 INFO:tasks.workunit.client.1.smithi203.stdout:6/347: creat d1/d3/d5b/f6d x:0 0 0 2024-04-12T09:11:28.132 INFO:tasks.workunit.client.0.smithi117.stdout:2/874: truncate d0/d4/f4d 303680 0 2024-04-12T09:11:28.139 INFO:tasks.workunit.client.0.smithi117.stdout:2/875: unlink d0/f117 0 2024-04-12T09:11:28.140 INFO:tasks.workunit.client.1.smithi203.stdout:1/420: rename df/d20 to df/d2d/d6f/d75/d80 0 2024-04-12T09:11:28.142 INFO:tasks.workunit.client.0.smithi117.stdout:1/986: symlink d1/dbd/d3f/db/d1d/d78/d125/l13c 0 2024-04-12T09:11:28.143 INFO:tasks.workunit.client.1.smithi203.stdout:3/351: mknod d2/d8/d14/d45/c71 0 2024-04-12T09:11:28.144 INFO:tasks.workunit.client.0.smithi117.stdout:9/837: dread d1/d8/df/d3e/f1d [4194304,4194304] 0 2024-04-12T09:11:28.145 INFO:tasks.workunit.client.1.smithi203.stdout:2/389: symlink d0/d3/d47/l8c 0 2024-04-12T09:11:28.149 INFO:tasks.workunit.client.1.smithi203.stdout:4/351: dwrite ff [0,4194304] 0 2024-04-12T09:11:28.150 INFO:tasks.workunit.client.1.smithi203.stdout:8/345: symlink d4/d8/d37/l6f 0 2024-04-12T09:11:28.150 INFO:tasks.workunit.client.1.smithi203.stdout:8/346: stat d4/d8/d1c/f2c 0 2024-04-12T09:11:28.153 INFO:tasks.workunit.client.1.smithi203.stdout:7/363: symlink d0/d15/d2d/d5e/l8a 0 2024-04-12T09:11:28.154 INFO:tasks.workunit.client.0.smithi117.stdout:1/987: mknod d1/dbd/d3f/db/d16/db6/da9/d9a/c13d 0 2024-04-12T09:11:28.157 INFO:tasks.workunit.client.1.smithi203.stdout:6/348: symlink d1/df/d28/d43/l6e 0 2024-04-12T09:11:28.158 INFO:tasks.workunit.client.1.smithi203.stdout:9/330: dwrite d8/d12/d14/f1d [0,4194304] 0 2024-04-12T09:11:28.158 INFO:tasks.workunit.client.1.smithi203.stdout:6/349: chown d1/d3/d4/ca 46 1 2024-04-12T09:11:28.164 INFO:tasks.workunit.client.0.smithi117.stdout:9/838: rename d1/d8/df/d1b/l40 to d1/l10f 0 2024-04-12T09:11:28.166 INFO:tasks.workunit.client.0.smithi117.stdout:1/988: mkdir d1/d3b/d13e 0 2024-04-12T09:11:28.170 INFO:tasks.workunit.client.1.smithi203.stdout:1/421: rmdir df 39 2024-04-12T09:11:28.171 INFO:tasks.workunit.client.0.smithi117.stdout:1/989: symlink d1/dbd/d3f/db/d16/l13f 0 2024-04-12T09:11:28.176 INFO:tasks.workunit.client.0.smithi117.stdout:2/876: dread d0/d4/f4d [0,4194304] 0 2024-04-12T09:11:28.177 INFO:tasks.workunit.client.0.smithi117.stdout:1/990: dwrite d1/dbe/d10a/f118 [0,4194304] 0 2024-04-12T09:11:28.178 INFO:tasks.workunit.client.1.smithi203.stdout:7/364: dread d0/d4/d1c/f35 [0,4194304] 0 2024-04-12T09:11:28.178 INFO:tasks.workunit.client.1.smithi203.stdout:9/331: rmdir d8/d12/d3e 39 2024-04-12T09:11:28.180 INFO:tasks.workunit.client.0.smithi117.stdout:1/991: write d1/dbd/d3f/db/d16/db6/da9/d9a/d71/d10b/f119 [192607,47330] 0 2024-04-12T09:11:28.185 INFO:tasks.workunit.client.0.smithi117.stdout:1/992: mknod d1/d96/c140 0 2024-04-12T09:11:28.185 INFO:tasks.workunit.client.1.smithi203.stdout:3/352: creat d2/d8/d14/d23/d35/d4c/d67/f72 x:0 0 0 2024-04-12T09:11:28.186 INFO:tasks.workunit.client.0.smithi117.stdout:1/993: chown d1/d64/d111 492250 1 2024-04-12T09:11:28.186 INFO:tasks.workunit.client.0.smithi117.stdout:1/994: readlink d1/d64/d45/d4c/d94/dd0/le5 0 2024-04-12T09:11:28.187 INFO:tasks.workunit.client.1.smithi203.stdout:2/390: truncate d0/d14/f22 3201070 0 2024-04-12T09:11:28.187 INFO:tasks.workunit.client.1.smithi203.stdout:2/391: dread - d0/d14/d1e/d2a/f5d zero size 2024-04-12T09:11:28.192 INFO:tasks.workunit.client.0.smithi117.stdout:1/995: dread d1/dbd/d3f/db/f10f [0,4194304] 0 2024-04-12T09:11:28.192 INFO:tasks.workunit.client.0.smithi117.stdout:9/839: dwrite d1/d8/df/d68/ddf/daf/d3b/f4a [0,4194304] 0 2024-04-12T09:11:28.193 INFO:tasks.workunit.client.1.smithi203.stdout:7/365: write d0/d4/d54/f77 [410094,86316] 0 2024-04-12T09:11:28.194 INFO:tasks.workunit.client.0.smithi117.stdout:9/840: chown d1/d8/df/d68/ddf/daf/d3b/f42 2450 1 2024-04-12T09:11:28.194 INFO:tasks.workunit.client.1.smithi203.stdout:7/366: write d0/d4/d5d/f86 [536612,5434] 0 2024-04-12T09:11:28.194 INFO:tasks.workunit.client.0.smithi117.stdout:2/877: write d0/d43/d53/f7b [1977538,69982] 0 2024-04-12T09:11:28.196 INFO:tasks.workunit.client.0.smithi117.stdout:9/841: chown d1/d8/d5a/d79/d91/ffa 217934196 1 2024-04-12T09:11:28.197 INFO:tasks.workunit.client.1.smithi203.stdout:5/456: rename d0/d6/d16/d8/c50 to d0/d6/d11/d1e/caa 0 2024-04-12T09:11:28.212 INFO:tasks.workunit.client.0.smithi117.stdout:9/842: write d1/d8/d5a/d6e/d71/fb5 [70442,74926] 0 2024-04-12T09:11:28.212 INFO:tasks.workunit.client.0.smithi117.stdout:1/996: dwrite d1/dbd/d3f/db/d1d/d78/f58 [0,4194304] 0 2024-04-12T09:11:28.215 INFO:tasks.workunit.client.1.smithi203.stdout:0/405: rename d0/l3f to d0/dd/d5b/l7d 0 2024-04-12T09:11:28.219 INFO:tasks.workunit.client.0.smithi117.stdout:2/878: dread d0/d43/d30/d41/f21 [0,4194304] 0 2024-04-12T09:11:28.221 INFO:tasks.workunit.client.0.smithi117.stdout:2/879: chown d0/d43/d4b/dae/dd5/leb 541059 1 2024-04-12T09:11:28.221 INFO:tasks.workunit.client.1.smithi203.stdout:2/392: symlink d0/d54/d61/d82/l8d 0 2024-04-12T09:11:28.224 INFO:tasks.workunit.client.1.smithi203.stdout:1/422: creat df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/f81 x:0 0 0 2024-04-12T09:11:28.224 INFO:tasks.workunit.client.1.smithi203.stdout:3/353: write d2/d8/d14/f2c [1718059,26975] 0 2024-04-12T09:11:28.225 INFO:tasks.workunit.client.0.smithi117.stdout:2/880: dread d0/d43/d30/f62 [0,4194304] 0 2024-04-12T09:11:28.228 INFO:tasks.workunit.client.1.smithi203.stdout:4/352: link d1a/d2b/l4d d1a/d21/d60/l70 0 2024-04-12T09:11:28.228 INFO:tasks.workunit.client.1.smithi203.stdout:4/353: stat d1a/d21/l2f 0 2024-04-12T09:11:28.229 INFO:tasks.workunit.client.0.smithi117.stdout:1/997: mkdir d1/dbd/d3f/db/d16/db6/dc5/d141 0 2024-04-12T09:11:28.229 INFO:tasks.workunit.client.1.smithi203.stdout:8/347: link d4/d8/d19/l36 d4/d8/d1c/d48/d5e/l70 0 2024-04-12T09:11:28.230 INFO:tasks.workunit.client.0.smithi117.stdout:1/998: chown d1/db3/d130 17797 1 2024-04-12T09:11:28.230 INFO:tasks.workunit.client.1.smithi203.stdout:5/457: dread d0/f21 [0,4194304] 0 2024-04-12T09:11:28.231 INFO:tasks.workunit.client.1.smithi203.stdout:9/332: creat d8/d12/f81 x:0 0 0 2024-04-12T09:11:28.232 INFO:tasks.workunit.client.1.smithi203.stdout:7/367: mknod d0/d38/d79/c8b 0 2024-04-12T09:11:28.233 INFO:tasks.workunit.client.0.smithi117.stdout:9/843: dwrite d1/d8/df/d3e/f2b [4194304,4194304] 0 2024-04-12T09:11:28.234 INFO:tasks.workunit.client.1.smithi203.stdout:6/350: rename d1/d3/d26/d30/f3f to d1/d3/d26/d30/d4a/f6f 0 2024-04-12T09:11:28.234 INFO:tasks.workunit.client.0.smithi117.stdout:9/844: chown d1/d8/d52/d99/fbb 1639466 1 2024-04-12T09:11:28.235 INFO:tasks.workunit.client.1.smithi203.stdout:8/348: dwrite d4/d8/d19/d53/f68 [0,4194304] 0 2024-04-12T09:11:28.236 INFO:tasks.workunit.client.1.smithi203.stdout:6/351: chown d1/d3/d26/f61 238887612 1 2024-04-12T09:11:28.237 INFO:tasks.workunit.client.0.smithi117.stdout:1/999: unlink d1/dbd/d3f/db/d1d/d10e/l121 0 2024-04-12T09:11:28.240 INFO:tasks.workunit.client.0.smithi117.stdout:2/881: truncate d0/df/f46 1952205 0 2024-04-12T09:11:28.241 INFO:tasks.workunit.client.1.smithi203.stdout:2/393: mkdir d0/d3/d8e 0 2024-04-12T09:11:28.242 INFO:tasks.workunit.client.1.smithi203.stdout:8/349: dwrite d4/d8/d19/d53/f68 [0,4194304] 0 2024-04-12T09:11:28.243 INFO:tasks.workunit.client.1.smithi203.stdout:2/394: chown d0/d14/d23/f50 0 1 2024-04-12T09:11:28.245 INFO:tasks.workunit.client.0.smithi117.stdout:2/882: dread d0/d43/d53/d61/d8d/ff5 [0,4194304] 0 2024-04-12T09:11:28.246 INFO:tasks.workunit.client.0.smithi117.stdout:9/845: dread d1/d24/f94 [0,4194304] 0 2024-04-12T09:11:28.247 INFO:tasks.workunit.client.1.smithi203.stdout:3/354: creat d2/d8/d14/d23/d35/f73 x:0 0 0 2024-04-12T09:11:28.248 INFO:tasks.workunit.client.1.smithi203.stdout:1/423: mknod df/d2d/d6f/d75/d80/d54/d5d/c82 0 2024-04-12T09:11:28.252 INFO:tasks.workunit.client.0.smithi117.stdout:2/883: truncate d0/d43/d53/d61/d8d/f91 2454949 0 2024-04-12T09:11:28.255 INFO:tasks.workunit.client.1.smithi203.stdout:7/368: rename d0/d4/d1c/d61 to d0/d15/d2d/d5e/d8c 0 2024-04-12T09:11:28.258 INFO:tasks.workunit.client.1.smithi203.stdout:6/352: unlink d1/d3/d4/f1d 0 2024-04-12T09:11:28.258 INFO:tasks.workunit.client.0.smithi117.stdout:9/846: creat d1/d8/df/d3e/d92/f110 x:0 0 0 2024-04-12T09:11:28.259 INFO:tasks.workunit.client.1.smithi203.stdout:1/424: dread df/d2d/f32 [0,4194304] 0 2024-04-12T09:11:28.259 INFO:tasks.workunit.client.0.smithi117.stdout:2/884: mkdir d0/d43/d128 0 2024-04-12T09:11:28.260 INFO:tasks.workunit.client.0.smithi117.stdout:2/885: chown d0/lf0 65390 1 2024-04-12T09:11:28.263 INFO:tasks.workunit.client.1.smithi203.stdout:4/354: mknod d1a/d1d/d69/c71 0 2024-04-12T09:11:28.264 INFO:tasks.workunit.client.1.smithi203.stdout:4/355: chown d1a/d20/f3d 0 1 2024-04-12T09:11:28.266 INFO:tasks.workunit.client.1.smithi203.stdout:9/333: creat d8/d12/d23/d29/d2c/d5d/f82 x:0 0 0 2024-04-12T09:11:28.267 INFO:tasks.workunit.client.1.smithi203.stdout:9/334: chown d8/d12/d23/d41 188832646 1 2024-04-12T09:11:28.272 INFO:tasks.workunit.client.1.smithi203.stdout:8/350: link d4/d8/d1c/f30 d4/d8/d19/f71 0 2024-04-12T09:11:28.273 INFO:tasks.workunit.client.1.smithi203.stdout:3/355: symlink d2/d8/d14/d1b/l74 0 2024-04-12T09:11:28.276 INFO:tasks.workunit.client.1.smithi203.stdout:4/356: mkdir d1a/d20/d5d/d2c/d72 0 2024-04-12T09:11:28.277 INFO:tasks.workunit.client.1.smithi203.stdout:0/406: getdents d0/d48/d5e 0 2024-04-12T09:11:28.277 INFO:tasks.workunit.client.1.smithi203.stdout:8/351: dwrite d4/d8/f38 [0,4194304] 0 2024-04-12T09:11:28.286 INFO:tasks.workunit.client.0.smithi117.stdout:9/847: dwrite d1/d8/df/d68/ddf/daf/f98 [0,4194304] 0 2024-04-12T09:11:28.287 INFO:tasks.workunit.client.1.smithi203.stdout:4/357: mknod d1a/d1d/d69/c73 0 2024-04-12T09:11:28.287 INFO:tasks.workunit.client.1.smithi203.stdout:5/458: fsync d0/d6/d11/f69 0 2024-04-12T09:11:28.288 INFO:tasks.workunit.client.0.smithi117.stdout:2/886: dwrite d0/df/f67 [0,4194304] 0 2024-04-12T09:11:28.288 INFO:tasks.workunit.client.1.smithi203.stdout:5/459: write d0/d6/d16/d9/fa4 [468795,11312] 0 2024-04-12T09:11:28.289 INFO:tasks.workunit.client.0.smithi117.stdout:9/848: truncate d1/d8/d12/fee 5209867 0 2024-04-12T09:11:28.291 INFO:tasks.workunit.client.1.smithi203.stdout:0/407: symlink d0/d1d/d2f/d17/l7e 0 2024-04-12T09:11:28.291 INFO:tasks.workunit.client.0.smithi117.stdout:9/849: write d1/d8/df/d68/df9/f105 [272939,35884] 0 2024-04-12T09:11:28.296 INFO:tasks.workunit.client.0.smithi117.stdout:2/887: dwrite d0/d4/d10/f19 [4194304,4194304] 0 2024-04-12T09:11:28.302 INFO:tasks.workunit.client.1.smithi203.stdout:1/425: link df/f1e df/f83 0 2024-04-12T09:11:28.303 INFO:tasks.workunit.client.0.smithi117.stdout:9/850: mknod d1/d8/d5a/d79/d91/c111 0 2024-04-12T09:11:28.304 INFO:tasks.workunit.client.1.smithi203.stdout:2/395: getdents d0/d14/d1e/d2a 0 2024-04-12T09:11:28.306 INFO:tasks.workunit.client.1.smithi203.stdout:3/356: symlink d2/l75 0 2024-04-12T09:11:28.309 INFO:tasks.workunit.client.1.smithi203.stdout:5/460: fdatasync d0/d6/d11/d38/f84 0 2024-04-12T09:11:28.311 INFO:tasks.workunit.client.1.smithi203.stdout:7/369: getdents d0/d4/d5d 0 2024-04-12T09:11:28.312 INFO:tasks.workunit.client.1.smithi203.stdout:2/396: rename d0/d54/d61/d78/d7f to d0/d3/d8f 0 2024-04-12T09:11:28.314 INFO:tasks.workunit.client.1.smithi203.stdout:7/370: write d0/d15/f19 [1684279,36614] 0 2024-04-12T09:11:28.315 INFO:tasks.workunit.client.1.smithi203.stdout:1/426: mknod df/d2d/c84 0 2024-04-12T09:11:28.317 INFO:tasks.workunit.client.1.smithi203.stdout:8/352: getdents d4 0 2024-04-12T09:11:28.317 INFO:tasks.workunit.client.1.smithi203.stdout:9/335: dwrite d8/d12/d3e/f47 [0,4194304] 0 2024-04-12T09:11:28.318 INFO:tasks.workunit.client.1.smithi203.stdout:2/397: rmdir d0/d54/d61/d82 39 2024-04-12T09:11:28.319 INFO:tasks.workunit.client.1.smithi203.stdout:0/408: dread d0/dd/f16 [4194304,4194304] 0 2024-04-12T09:11:28.320 INFO:tasks.workunit.client.1.smithi203.stdout:1/427: unlink df/d2d/l37 0 2024-04-12T09:11:28.321 INFO:tasks.workunit.client.1.smithi203.stdout:8/353: write d4/d8/f24 [3159883,50199] 0 2024-04-12T09:11:28.322 INFO:tasks.workunit.client.1.smithi203.stdout:5/461: dread d0/d6/d11/d1e/d4c/fa1 [0,4194304] 0 2024-04-12T09:11:28.324 INFO:tasks.workunit.client.1.smithi203.stdout:3/357: rename d2/d8/d14/d1b/d2f/l5f to d2/d8/d14/d1b/d2f/l76 0 2024-04-12T09:11:28.325 INFO:tasks.workunit.client.0.smithi117.stdout:2/888: write d0/d43/d4b/dae/fd0 [202976,111667] 0 2024-04-12T09:11:28.326 INFO:tasks.workunit.client.0.smithi117.stdout:2/889: chown d0/d4/c45 46872 1 2024-04-12T09:11:28.326 INFO:tasks.workunit.client.1.smithi203.stdout:4/358: getdents d1a/d21/d22 0 2024-04-12T09:11:28.327 INFO:tasks.workunit.client.1.smithi203.stdout:2/398: creat d0/d14/d1e/d2a/f90 x:0 0 0 2024-04-12T09:11:28.327 INFO:tasks.workunit.client.1.smithi203.stdout:8/354: stat d4/d8/d1c/f2c 0 2024-04-12T09:11:28.328 INFO:tasks.workunit.client.0.smithi117.stdout:2/890: truncate d0/f3c 412158 0 2024-04-12T09:11:28.332 INFO:tasks.workunit.client.1.smithi203.stdout:1/428: fsync df/d2d/d6f/d75/d80/d2b/f44 0 2024-04-12T09:11:28.334 INFO:tasks.workunit.client.1.smithi203.stdout:8/355: write d4/f5a [707017,116658] 0 2024-04-12T09:11:28.334 INFO:tasks.workunit.client.1.smithi203.stdout:3/358: chown d2/c10 90 1 2024-04-12T09:11:28.334 INFO:tasks.workunit.client.1.smithi203.stdout:5/462: unlink d0/d6/d11/d1e/c2f 0 2024-04-12T09:11:28.335 INFO:tasks.workunit.client.0.smithi117.stdout:2/891: symlink d0/d43/d53/d61/l129 0 2024-04-12T09:11:28.335 INFO:tasks.workunit.client.0.smithi117.stdout:9/851: dread d1/d8/d5a/dc2/f55 [0,4194304] 0 2024-04-12T09:11:28.335 INFO:tasks.workunit.client.1.smithi203.stdout:4/359: truncate d1a/d21/d22/f6a 859062 0 2024-04-12T09:11:28.336 INFO:tasks.workunit.client.1.smithi203.stdout:0/409: mknod d0/d1d/d2f/d17/d19/d6f/d78/c7f 0 2024-04-12T09:11:28.336 INFO:tasks.workunit.client.1.smithi203.stdout:7/371: dwrite d0/d15/d2d/d5e/d8c/f74 [0,4194304] 0 2024-04-12T09:11:28.337 INFO:tasks.workunit.client.1.smithi203.stdout:0/410: stat d0/f1a 0 2024-04-12T09:11:28.338 INFO:tasks.workunit.client.1.smithi203.stdout:1/429: chown df/d2d/f5f 29224757 1 2024-04-12T09:11:28.341 INFO:tasks.workunit.client.1.smithi203.stdout:1/430: chown l2 3994946 1 2024-04-12T09:11:28.342 INFO:tasks.workunit.client.1.smithi203.stdout:9/336: dwrite d8/d12/d23/d29/f6a [4194304,4194304] 0 2024-04-12T09:11:28.342 INFO:tasks.workunit.client.0.smithi117.stdout:9/852: creat d1/d8/df/d3e/d92/f112 x:0 0 0 2024-04-12T09:11:28.343 INFO:tasks.workunit.client.1.smithi203.stdout:9/337: chown d8/d12 0 1 2024-04-12T09:11:28.345 INFO:tasks.workunit.client.1.smithi203.stdout:2/399: link d0/d14/d1e/d2a/f4c d0/d14/d23/d3d/f91 0 2024-04-12T09:11:28.345 INFO:tasks.workunit.client.0.smithi117.stdout:9/853: dread d1/d8/f10 [8388608,4194304] 0 2024-04-12T09:11:28.347 INFO:tasks.workunit.client.1.smithi203.stdout:8/356: creat d4/d8/d19/d53/f72 x:0 0 0 2024-04-12T09:11:28.350 INFO:tasks.workunit.client.1.smithi203.stdout:9/338: fsync d8/d12/d23/d29/f31 0 2024-04-12T09:11:28.352 INFO:tasks.workunit.client.1.smithi203.stdout:4/360: link fb d1a/d21/d60/d68/f74 0 2024-04-12T09:11:28.352 INFO:tasks.workunit.client.1.smithi203.stdout:3/359: dwrite d2/d8/d59/f5b [0,4194304] 0 2024-04-12T09:11:28.355 INFO:tasks.workunit.client.0.smithi117.stdout:9/854: creat d1/d23/f113 x:0 0 0 2024-04-12T09:11:28.355 INFO:tasks.workunit.client.1.smithi203.stdout:0/411: dwrite d0/dd/d4d/f55 [0,4194304] 0 2024-04-12T09:11:28.355 INFO:tasks.workunit.client.1.smithi203.stdout:2/400: fsync d0/d3/fd 0 2024-04-12T09:11:28.358 INFO:tasks.workunit.client.1.smithi203.stdout:5/463: dread d0/d6/d16/d9/f24 [0,4194304] 0 2024-04-12T09:11:28.362 INFO:tasks.workunit.client.1.smithi203.stdout:7/372: mkdir d0/d4/d54/d8d 0 2024-04-12T09:11:28.363 INFO:tasks.workunit.client.1.smithi203.stdout:8/357: readlink d4/d8/l18 0 2024-04-12T09:11:28.364 INFO:tasks.workunit.client.1.smithi203.stdout:3/360: rename d2/d8/d14/d23/f49 to d2/d51/d65/f77 0 2024-04-12T09:11:28.364 INFO:tasks.workunit.client.1.smithi203.stdout:7/373: fsync d0/d4/d5d/f85 0 2024-04-12T09:11:28.365 INFO:tasks.workunit.client.1.smithi203.stdout:8/358: stat d4/d8/f6e 0 2024-04-12T09:11:28.370 INFO:tasks.workunit.client.1.smithi203.stdout:1/431: getdents df/d2d/d6f/d75/d80/d2b 0 2024-04-12T09:11:28.370 INFO:tasks.workunit.client.1.smithi203.stdout:5/464: creat d0/d6/d16/d9/d30/fab x:0 0 0 2024-04-12T09:11:28.371 INFO:tasks.workunit.client.1.smithi203.stdout:6/353: sync 2024-04-12T09:11:28.372 INFO:tasks.workunit.client.1.smithi203.stdout:4/361: dwrite d1a/d20/d5d/d2c/f51 [4194304,4194304] 0 2024-04-12T09:11:28.373 INFO:tasks.workunit.client.1.smithi203.stdout:7/374: creat d0/d4/d1c/d5b/f8e x:0 0 0 2024-04-12T09:11:28.375 INFO:tasks.workunit.client.1.smithi203.stdout:9/339: creat d8/d12/f83 x:0 0 0 2024-04-12T09:11:28.377 INFO:tasks.workunit.client.1.smithi203.stdout:2/401: dwrite d0/d14/d23/f8b [0,4194304] 0 2024-04-12T09:11:28.377 INFO:tasks.workunit.client.1.smithi203.stdout:7/375: readlink d0/l52 0 2024-04-12T09:11:28.379 INFO:tasks.workunit.client.1.smithi203.stdout:7/376: chown d0/d15/d2d/d5e/d8c/l6e 73294 1 2024-04-12T09:11:28.381 INFO:tasks.workunit.client.1.smithi203.stdout:5/465: creat d0/d6/d16/d9/d30/d83/fac x:0 0 0 2024-04-12T09:11:28.384 INFO:tasks.workunit.client.1.smithi203.stdout:4/362: creat d1a/d21/d22/f75 x:0 0 0 2024-04-12T09:11:28.385 INFO:tasks.workunit.client.1.smithi203.stdout:9/340: creat d8/d12/d3e/f84 x:0 0 0 2024-04-12T09:11:28.386 INFO:tasks.workunit.client.1.smithi203.stdout:2/402: dwrite d0/d3/f8 [0,4194304] 0 2024-04-12T09:11:28.390 INFO:tasks.workunit.client.1.smithi203.stdout:6/354: symlink d1/d3/d26/d30/d4a/d6c/d45/l70 0 2024-04-12T09:11:28.391 INFO:tasks.workunit.client.1.smithi203.stdout:7/377: symlink d0/d4/d54/l8f 0 2024-04-12T09:11:28.391 INFO:tasks.workunit.client.1.smithi203.stdout:6/355: fdatasync d1/f37 0 2024-04-12T09:11:28.393 INFO:tasks.workunit.client.1.smithi203.stdout:5/466: chown d0/d6/d11/d18/d2a/l7e 2828119 1 2024-04-12T09:11:28.393 INFO:tasks.workunit.client.1.smithi203.stdout:4/363: mkdir d1a/d1d/d69/d76 0 2024-04-12T09:11:28.395 INFO:tasks.workunit.client.1.smithi203.stdout:4/364: write d1a/d1d/f55 [1047912,23215] 0 2024-04-12T09:11:28.396 INFO:tasks.workunit.client.1.smithi203.stdout:0/412: write d0/d1d/d2f/d17/f47 [1855204,55840] 0 2024-04-12T09:11:28.396 INFO:tasks.workunit.client.1.smithi203.stdout:1/432: mknod df/d2d/d6f/d75/d80/d54/d5d/d4a/c85 0 2024-04-12T09:11:28.399 INFO:tasks.workunit.client.1.smithi203.stdout:7/378: truncate d0/d4/f69 2071660 0 2024-04-12T09:11:28.401 INFO:tasks.workunit.client.1.smithi203.stdout:2/403: creat d0/d54/d61/d78/d89/f92 x:0 0 0 2024-04-12T09:11:28.401 INFO:tasks.workunit.client.1.smithi203.stdout:7/379: truncate d0/d34/d7c/f80 486296 0 2024-04-12T09:11:28.403 INFO:tasks.workunit.client.1.smithi203.stdout:4/365: creat d1a/d21/d60/f77 x:0 0 0 2024-04-12T09:11:28.404 INFO:tasks.workunit.client.1.smithi203.stdout:0/413: unlink d0/dd/d40/f61 0 2024-04-12T09:11:28.406 INFO:tasks.workunit.client.1.smithi203.stdout:3/361: dwrite d2/d8/d59/f5e [0,4194304] 0 2024-04-12T09:11:28.406 INFO:tasks.workunit.client.1.smithi203.stdout:5/467: rename d0/d6/d11/d18/d1a/d23/c26 to d0/d6/d16/d44/cad 0 2024-04-12T09:11:28.407 INFO:tasks.workunit.client.1.smithi203.stdout:7/380: creat d0/d15/d2d/d5e/f90 x:0 0 0 2024-04-12T09:11:28.408 INFO:tasks.workunit.client.1.smithi203.stdout:2/404: unlink d0/d14/d23/d3d/l66 0 2024-04-12T09:11:28.409 INFO:tasks.workunit.client.1.smithi203.stdout:4/366: mkdir d1a/d21/d22/d2e/d78 0 2024-04-12T09:11:28.410 INFO:tasks.workunit.client.1.smithi203.stdout:2/405: truncate d0/d2e/f34 4798733 0 2024-04-12T09:11:28.410 INFO:tasks.workunit.client.1.smithi203.stdout:2/406: chown d0/d3 2054736 1 2024-04-12T09:11:28.411 INFO:tasks.workunit.client.1.smithi203.stdout:4/367: chown d1a/d20/l4c 19 1 2024-04-12T09:11:28.413 INFO:tasks.workunit.client.1.smithi203.stdout:4/368: write d1a/d21/d22/f57 [72985,72108] 0 2024-04-12T09:11:28.413 INFO:tasks.workunit.client.1.smithi203.stdout:7/381: creat d0/d15/d2d/d5e/d8c/f91 x:0 0 0 2024-04-12T09:11:28.414 INFO:tasks.workunit.client.1.smithi203.stdout:4/369: chown d1a/d21/d22/f6a 896546281 1 2024-04-12T09:11:28.414 INFO:tasks.workunit.client.1.smithi203.stdout:6/356: getdents d1/d3/d26/d30/d4a/d6c 0 2024-04-12T09:11:28.416 INFO:tasks.workunit.client.1.smithi203.stdout:2/407: stat d0/d14/f22 0 2024-04-12T09:11:28.416 INFO:tasks.workunit.client.1.smithi203.stdout:6/357: dread - d1/df/f6b zero size 2024-04-12T09:11:28.416 INFO:tasks.workunit.client.1.smithi203.stdout:4/370: chown d1a/d21/d22/d2e/f49 1546317 1 2024-04-12T09:11:28.420 INFO:tasks.workunit.client.1.smithi203.stdout:1/433: link df/d2d/d6f/d75/d80/d2b/l31 df/d2d/l86 0 2024-04-12T09:11:28.422 INFO:tasks.workunit.client.1.smithi203.stdout:7/382: dwrite d0/d4/f57 [0,4194304] 0 2024-04-12T09:11:28.422 INFO:tasks.workunit.client.1.smithi203.stdout:6/358: dread d1/d3/d12/f1f [0,4194304] 0 2024-04-12T09:11:28.425 INFO:tasks.workunit.client.1.smithi203.stdout:3/362: creat d2/d8/d14/d1b/d2f/f78 x:0 0 0 2024-04-12T09:11:28.425 INFO:tasks.workunit.client.1.smithi203.stdout:2/408: truncate d0/d14/d23/f50 1752318 0 2024-04-12T09:11:28.430 INFO:tasks.workunit.client.1.smithi203.stdout:0/414: getdents d0/d1d 0 2024-04-12T09:11:28.430 INFO:tasks.workunit.client.1.smithi203.stdout:6/359: creat d1/d3/d26/d30/d4a/d6c/d45/d55/f71 x:0 0 0 2024-04-12T09:11:28.431 INFO:tasks.workunit.client.1.smithi203.stdout:4/371: dwrite d1a/d20/f3d [0,4194304] 0 2024-04-12T09:11:28.432 INFO:tasks.workunit.client.1.smithi203.stdout:5/468: rename d0/d6/d11/d38/l8a to d0/d6/d16/lae 0 2024-04-12T09:11:28.433 INFO:tasks.workunit.client.1.smithi203.stdout:1/434: symlink df/d2d/d6f/d75/d80/d54/d5d/d67/l87 0 2024-04-12T09:11:28.434 INFO:tasks.workunit.client.1.smithi203.stdout:6/360: write d1/df/f6b [3338,24357] 0 2024-04-12T09:11:28.441 INFO:tasks.workunit.client.1.smithi203.stdout:9/341: dwrite d8/f4a [0,4194304] 0 2024-04-12T09:11:28.443 INFO:tasks.workunit.client.0.smithi117.stdout:9/855: getdents d1/d8/df/d3e/d92 0 2024-04-12T09:11:28.444 INFO:tasks.workunit.client.1.smithi203.stdout:7/383: rename d0/d15/f4a to d0/d4/f92 0 2024-04-12T09:11:28.445 INFO:tasks.workunit.client.1.smithi203.stdout:0/415: unlink d0/d1d/d2f/d17/d19/f37 0 2024-04-12T09:11:28.446 INFO:tasks.workunit.client.0.smithi117.stdout:9/856: rmdir d1/d8/df/d68/ddf/daf 39 2024-04-12T09:11:28.447 INFO:tasks.workunit.client.1.smithi203.stdout:3/363: getdents d2/d8/d14/d69 0 2024-04-12T09:11:28.449 INFO:tasks.workunit.client.0.smithi117.stdout:9/857: mkdir d1/d8/df/d3e/dea/d114 0 2024-04-12T09:11:28.451 INFO:tasks.workunit.client.1.smithi203.stdout:6/361: write d1/d3/d26/d30/d4a/d6c/d45/d55/f71 [1047541,47991] 0 2024-04-12T09:11:28.451 INFO:tasks.workunit.client.1.smithi203.stdout:2/409: dwrite d0/d3/f16 [0,4194304] 0 2024-04-12T09:11:28.454 INFO:tasks.workunit.client.0.smithi117.stdout:9/858: read d1/d24/f57 [3380213,62056] 0 2024-04-12T09:11:28.454 INFO:tasks.workunit.client.1.smithi203.stdout:7/384: symlink d0/d4/d1c/d5b/l93 0 2024-04-12T09:11:28.459 INFO:tasks.workunit.client.1.smithi203.stdout:3/364: fdatasync d2/d8/d14/d23/d35/d4c/d5c/f34 0 2024-04-12T09:11:28.460 INFO:tasks.workunit.client.1.smithi203.stdout:5/469: dwrite d0/d6/f93 [0,4194304] 0 2024-04-12T09:11:28.460 INFO:tasks.workunit.client.1.smithi203.stdout:0/416: read d0/d1d/d2f/d17/d19/f23 [776901,45060] 0 2024-04-12T09:11:28.460 INFO:tasks.workunit.client.1.smithi203.stdout:4/372: dwrite d1a/d20/d5f/f64 [0,4194304] 0 2024-04-12T09:11:28.462 INFO:tasks.workunit.client.1.smithi203.stdout:7/385: chown d0/d15/l67 96920 1 2024-04-12T09:11:28.463 INFO:tasks.workunit.client.1.smithi203.stdout:6/362: creat d1/df/d65/f72 x:0 0 0 2024-04-12T09:11:28.469 INFO:tasks.workunit.client.1.smithi203.stdout:1/435: dwrite df/d2d/d6f/d75/d80/d54/d5d/f4d [0,4194304] 0 2024-04-12T09:11:28.471 INFO:tasks.workunit.client.1.smithi203.stdout:2/410: creat d0/d2e/f93 x:0 0 0 2024-04-12T09:11:28.473 INFO:tasks.workunit.client.1.smithi203.stdout:9/342: dread d8/fa [4194304,4194304] 0 2024-04-12T09:11:28.474 INFO:tasks.workunit.client.1.smithi203.stdout:5/470: chown d0/d6/d16/d9/d14/f85 297234 1 2024-04-12T09:11:28.474 INFO:tasks.workunit.client.1.smithi203.stdout:6/363: symlink d1/d3/d26/d36/l73 0 2024-04-12T09:11:28.475 INFO:tasks.workunit.client.1.smithi203.stdout:7/386: creat d0/d4/d1c/d3b/d4c/f94 x:0 0 0 2024-04-12T09:11:28.475 INFO:tasks.workunit.client.1.smithi203.stdout:2/411: dread - d0/d14/d1e/f48 zero size 2024-04-12T09:11:28.477 INFO:tasks.workunit.client.1.smithi203.stdout:2/412: chown d0/d38/f3e 6 1 2024-04-12T09:11:28.478 INFO:tasks.workunit.client.1.smithi203.stdout:0/417: dread d0/f36 [0,4194304] 0 2024-04-12T09:11:28.478 INFO:tasks.workunit.client.1.smithi203.stdout:6/364: mkdir d1/d3/d26/d30/d4a/d74 0 2024-04-12T09:11:28.479 INFO:tasks.workunit.client.1.smithi203.stdout:4/373: dread d1a/d20/f3d [0,4194304] 0 2024-04-12T09:11:28.480 INFO:tasks.workunit.client.1.smithi203.stdout:3/365: dread d2/d8/d59/f5b [0,4194304] 0 2024-04-12T09:11:28.480 INFO:tasks.workunit.client.1.smithi203.stdout:0/418: chown d0/l45 14692 1 2024-04-12T09:11:28.480 INFO:tasks.workunit.client.1.smithi203.stdout:1/436: mkdir df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/d88 0 2024-04-12T09:11:28.481 INFO:tasks.workunit.client.1.smithi203.stdout:3/366: chown d2/l53 6450 1 2024-04-12T09:11:28.482 INFO:tasks.workunit.client.1.smithi203.stdout:9/343: rename d8/d12/d14 to d8/d12/d23/d85 0 2024-04-12T09:11:28.485 INFO:tasks.workunit.client.1.smithi203.stdout:3/367: rmdir d2 39 2024-04-12T09:11:28.486 INFO:tasks.workunit.client.1.smithi203.stdout:4/374: creat d1a/d21/d22/f79 x:0 0 0 2024-04-12T09:11:28.489 INFO:tasks.workunit.client.1.smithi203.stdout:0/419: mknod d0/c80 0 2024-04-12T09:11:28.491 INFO:tasks.workunit.client.1.smithi203.stdout:4/375: creat d1a/d20/d5f/f7a x:0 0 0 2024-04-12T09:11:28.492 INFO:tasks.workunit.client.1.smithi203.stdout:9/344: dwrite d8/d12/d3e/f73 [0,4194304] 0 2024-04-12T09:11:28.492 INFO:tasks.workunit.client.0.smithi117.stdout:9/859: dwrite d1/d8/fcb [0,4194304] 0 2024-04-12T09:11:28.496 INFO:tasks.workunit.client.1.smithi203.stdout:1/437: dread df/d2d/d6f/d75/d80/d54/d5d/d4a/f62 [0,4194304] 0 2024-04-12T09:11:28.497 INFO:tasks.workunit.client.0.smithi117.stdout:9/860: mkdir d1/d8/d5e/d9f/d115 0 2024-04-12T09:11:28.497 INFO:tasks.workunit.client.1.smithi203.stdout:1/438: write df/f19 [3227515,125411] 0 2024-04-12T09:11:28.498 INFO:tasks.workunit.client.0.smithi117.stdout:9/861: fdatasync d1/d8/d52/fdb 0 2024-04-12T09:11:28.499 INFO:tasks.workunit.client.1.smithi203.stdout:1/439: dread - df/d2d/d6f/d75/d80/d2b/f42 zero size 2024-04-12T09:11:28.501 INFO:tasks.workunit.client.1.smithi203.stdout:4/376: rename d1a/d20/l3b to d1a/d20/d5d/d2c/l7b 0 2024-04-12T09:11:28.502 INFO:tasks.workunit.client.1.smithi203.stdout:4/377: chown d1a/d20/l4c 55 1 2024-04-12T09:11:28.505 INFO:tasks.workunit.client.0.smithi117.stdout:9/862: dwrite d1/d8/d5e/d9f/ff0 [0,4194304] 0 2024-04-12T09:11:28.511 INFO:tasks.workunit.client.0.smithi117.stdout:9/863: unlink d1/d8/d5a/d6e/d71/lfd 0 2024-04-12T09:11:28.513 INFO:tasks.workunit.client.0.smithi117.stdout:9/864: fsync d1/d8/df/d1b/f3f 0 2024-04-12T09:11:28.517 INFO:tasks.workunit.client.0.smithi117.stdout:9/865: creat d1/d24/f116 x:0 0 0 2024-04-12T09:11:28.519 INFO:tasks.workunit.client.0.smithi117.stdout:9/866: write d1/d8/df/d68/df9/f105 [1088681,46213] 0 2024-04-12T09:11:28.522 INFO:tasks.workunit.client.0.smithi117.stdout:9/867: creat d1/d8/f117 x:0 0 0 2024-04-12T09:11:28.530 INFO:tasks.workunit.client.0.smithi117.stdout:9/868: dwrite d1/d8/df/d68/ddf/daf/d3b/f42 [4194304,4194304] 0 2024-04-12T09:11:28.535 INFO:tasks.workunit.client.0.smithi117.stdout:9/869: dwrite d1/d8/d5a/d6e/d71/fa9 [0,4194304] 0 2024-04-12T09:11:28.538 INFO:tasks.workunit.client.1.smithi203.stdout:8/359: sync 2024-04-12T09:11:28.541 INFO:tasks.workunit.client.1.smithi203.stdout:0/420: mknod d0/d1d/d2f/c81 0 2024-04-12T09:11:28.543 INFO:tasks.workunit.client.0.smithi117.stdout:9/870: rename d1/d8/df/d68/ddf/daf/cbe to d1/d8/df/d7d/c118 0 2024-04-12T09:11:28.543 INFO:tasks.workunit.client.1.smithi203.stdout:1/440: rename df/l12 to df/d2d/d6f/d75/d80/d54/d5d/d58/l89 0 2024-04-12T09:11:28.544 INFO:tasks.workunit.client.0.smithi117.stdout:9/871: chown d1/d8/df/da2/f10a 11 1 2024-04-12T09:11:28.544 INFO:tasks.workunit.client.1.smithi203.stdout:4/378: mknod d1a/d20/d5f/c7c 0 2024-04-12T09:11:28.544 INFO:tasks.workunit.client.1.smithi203.stdout:2/413: dread d0/f18 [0,4194304] 0 2024-04-12T09:11:28.545 INFO:tasks.workunit.client.0.smithi117.stdout:9/872: chown d1/d8/df/d68/ddf/daf/cb1 0 1 2024-04-12T09:11:28.547 INFO:tasks.workunit.client.1.smithi203.stdout:6/365: dwrite d1/d3/f1a [0,4194304] 0 2024-04-12T09:11:28.547 INFO:tasks.workunit.client.1.smithi203.stdout:2/414: stat d0/d19/l40 0 2024-04-12T09:11:28.547 INFO:tasks.workunit.client.1.smithi203.stdout:0/421: symlink d0/dd/d4d/l82 0 2024-04-12T09:11:28.549 INFO:tasks.workunit.client.1.smithi203.stdout:8/360: rename d4/d34/f6a to d4/d8/d1c/d5d/f73 0 2024-04-12T09:11:28.551 INFO:tasks.workunit.client.1.smithi203.stdout:4/379: creat d1a/d20/f7d x:0 0 0 2024-04-12T09:11:28.586 INFO:tasks.workunit.client.1.smithi203.stdout:0/422: mknod d0/d1d/d2f/d34/c83 0 2024-04-12T09:11:28.588 INFO:tasks.workunit.client.1.smithi203.stdout:6/366: dread d1/f37 [0,4194304] 0 2024-04-12T09:11:28.588 INFO:tasks.workunit.client.1.smithi203.stdout:8/361: write d4/d8/d19/f3a [2832688,65303] 0 2024-04-12T09:11:28.589 INFO:tasks.workunit.client.1.smithi203.stdout:2/415: creat d0/d38/d43/f94 x:0 0 0 2024-04-12T09:11:28.589 INFO:tasks.workunit.client.1.smithi203.stdout:9/345: dwrite d8/f58 [0,4194304] 0 2024-04-12T09:11:28.589 INFO:tasks.workunit.client.1.smithi203.stdout:4/380: truncate d1a/d21/d22/f6a 1429560 0 2024-04-12T09:11:28.590 INFO:tasks.workunit.client.1.smithi203.stdout:0/423: write d0/d1d/d2f/f1e [246483,73072] 0 2024-04-12T09:11:28.595 INFO:tasks.workunit.client.1.smithi203.stdout:9/346: creat d8/d3b/d6f/d74/f86 x:0 0 0 2024-04-12T09:11:28.597 INFO:tasks.workunit.client.1.smithi203.stdout:2/416: mkdir d0/d14/d1e/d57/d95 0 2024-04-12T09:11:28.599 INFO:tasks.workunit.client.1.smithi203.stdout:8/362: dread d4/d8/d19/f25 [0,4194304] 0 2024-04-12T09:11:28.599 INFO:tasks.workunit.client.1.smithi203.stdout:4/381: rename d1a/d21/d22/f75 to d1a/d20/f7e 0 2024-04-12T09:11:28.601 INFO:tasks.workunit.client.1.smithi203.stdout:6/367: dwrite d1/d3/f27 [0,4194304] 0 2024-04-12T09:11:28.602 INFO:tasks.workunit.client.1.smithi203.stdout:0/424: dwrite d0/d1d/d2f/f1e [0,4194304] 0 2024-04-12T09:11:28.606 INFO:tasks.workunit.client.1.smithi203.stdout:2/417: mkdir d0/d14/d74/d96 0 2024-04-12T09:11:28.607 INFO:tasks.workunit.client.1.smithi203.stdout:9/347: fsync d8/d12/d23/d29/d2c/d5d/f61 0 2024-04-12T09:11:28.608 INFO:tasks.workunit.client.1.smithi203.stdout:4/382: creat d1a/d21/d60/f7f x:0 0 0 2024-04-12T09:11:28.609 INFO:tasks.workunit.client.1.smithi203.stdout:4/383: fdatasync d1a/d21/f5c 0 2024-04-12T09:11:28.611 INFO:tasks.workunit.client.1.smithi203.stdout:6/368: unlink d1/df/d65/f72 0 2024-04-12T09:11:28.612 INFO:tasks.workunit.client.1.smithi203.stdout:0/425: mkdir d0/d48/d5e/d84 0 2024-04-12T09:11:28.613 INFO:tasks.workunit.client.1.smithi203.stdout:8/363: mkdir d4/d8/d74 0 2024-04-12T09:11:28.615 INFO:tasks.workunit.client.1.smithi203.stdout:5/471: sync 2024-04-12T09:11:28.658 INFO:tasks.workunit.client.1.smithi203.stdout:1/441: sync 2024-04-12T09:11:28.658 INFO:tasks.workunit.client.1.smithi203.stdout:7/387: sync 2024-04-12T09:11:28.658 INFO:tasks.workunit.client.1.smithi203.stdout:3/368: sync 2024-04-12T09:11:28.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:28 smithi117 ceph-mon[29277]: pgmap v24: 65 pgs: 65 active+clean; 2.5 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 75 MiB/s rd, 236 MiB/s wr, 523 op/s 2024-04-12T09:11:28.666 INFO:tasks.workunit.client.1.smithi203.stdout:7/388: dwrite d0/d15/d2d/d5e/d8c/f81 [0,4194304] 0 2024-04-12T09:11:28.690 INFO:tasks.workunit.client.1.smithi203.stdout:7/389: dread d0/f2 [0,4194304] 0 2024-04-12T09:11:28.692 INFO:tasks.workunit.client.1.smithi203.stdout:9/348: mknod d8/d12/d23/d85/c87 0 2024-04-12T09:11:28.696 INFO:tasks.workunit.client.1.smithi203.stdout:6/369: symlink d1/d3/d4/l75 0 2024-04-12T09:11:28.705 INFO:tasks.workunit.client.1.smithi203.stdout:7/390: symlink d0/d4/d1c/d5b/l95 0 2024-04-12T09:11:28.711 INFO:tasks.workunit.client.1.smithi203.stdout:6/370: mknod d1/d3/d26/d30/d4a/d6c/d45/c76 0 2024-04-12T09:11:28.712 INFO:tasks.workunit.client.1.smithi203.stdout:0/426: unlink d0/d1d/d2f/d17/d19/l2e 0 2024-04-12T09:11:28.713 INFO:tasks.workunit.client.1.smithi203.stdout:8/364: symlink d4/d8/d74/l75 0 2024-04-12T09:11:28.714 INFO:tasks.workunit.client.1.smithi203.stdout:5/472: mkdir d0/daf 0 2024-04-12T09:11:28.718 INFO:tasks.workunit.client.1.smithi203.stdout:3/369: dread d2/f18 [0,4194304] 0 2024-04-12T09:11:28.719 INFO:tasks.workunit.client.1.smithi203.stdout:9/349: mknod d8/d12/d23/d29/d2c/d70/c88 0 2024-04-12T09:11:28.719 INFO:tasks.workunit.client.1.smithi203.stdout:3/370: dread - d2/d8/d14/f4f zero size 2024-04-12T09:11:28.720 INFO:tasks.workunit.client.1.smithi203.stdout:3/371: truncate d2/f6e 842849 0 2024-04-12T09:11:28.721 INFO:tasks.workunit.client.1.smithi203.stdout:8/365: rmdir d4/d8/d1c/d48/d5e 39 2024-04-12T09:11:28.722 INFO:tasks.workunit.client.1.smithi203.stdout:5/473: fsync d0/d6/d11/d18/f32 0 2024-04-12T09:11:28.728 INFO:tasks.workunit.client.1.smithi203.stdout:3/372: creat d2/d8/d14/d23/d36/f79 x:0 0 0 2024-04-12T09:11:28.728 INFO:tasks.workunit.client.1.smithi203.stdout:3/373: chown d2/c10 0 1 2024-04-12T09:11:28.732 INFO:tasks.workunit.client.1.smithi203.stdout:1/442: getdents df/d2d/d6f/d75/d80/d54/d5d/d4a 0 2024-04-12T09:11:28.733 INFO:tasks.workunit.client.1.smithi203.stdout:1/443: write df/f3f [744215,77013] 0 2024-04-12T09:11:28.735 INFO:tasks.workunit.client.1.smithi203.stdout:0/427: creat d0/dd/d71/f85 x:0 0 0 2024-04-12T09:11:28.736 INFO:tasks.workunit.client.1.smithi203.stdout:1/444: chown df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/d88 7 1 2024-04-12T09:11:28.738 INFO:tasks.workunit.client.1.smithi203.stdout:8/366: dread d4/d8/d19/f2e [0,4194304] 0 2024-04-12T09:11:28.738 INFO:tasks.workunit.client.1.smithi203.stdout:1/445: fsync df/d2d/d6f/d75/d80/d54/f61 0 2024-04-12T09:11:28.738 INFO:tasks.workunit.client.0.smithi117.stdout:9/873: sync 2024-04-12T09:11:28.739 INFO:tasks.workunit.client.0.smithi117.stdout:2/892: sync 2024-04-12T09:11:28.739 INFO:tasks.workunit.client.0.smithi117.stdout:4/951: sync 2024-04-12T09:11:28.739 INFO:tasks.workunit.client.0.smithi117.stdout:6/935: sync 2024-04-12T09:11:28.739 INFO:tasks.workunit.client.0.smithi117.stdout:7/804: sync 2024-04-12T09:11:28.739 INFO:tasks.workunit.client.1.smithi203.stdout:8/367: dread - d4/d8/d1c/d5d/f69 zero size 2024-04-12T09:11:28.741 INFO:tasks.workunit.client.0.smithi117.stdout:7/805: stat d0/d2/d45/lc0 0 2024-04-12T09:11:28.741 INFO:tasks.workunit.client.0.smithi117.stdout:2/893: dread - d0/d43/d53/d61/f11b zero size 2024-04-12T09:11:28.741 INFO:tasks.workunit.client.0.smithi117.stdout:6/936: fdatasync d8/d2a/d60/fa1 0 2024-04-12T09:11:28.741 INFO:tasks.workunit.client.0.smithi117.stdout:4/952: write d0/d2c/f7b [4185464,115367] 0 2024-04-12T09:11:28.742 INFO:tasks.workunit.client.0.smithi117.stdout:2/894: chown d0/d4/f9d 37350971 1 2024-04-12T09:11:28.743 INFO:tasks.workunit.client.0.smithi117.stdout:4/953: read d0/d1/de9/dfe/f96 [2366450,3849] 0 2024-04-12T09:11:28.744 INFO:tasks.workunit.client.1.smithi203.stdout:3/374: link d2/d8/d59/f61 d2/d8/d59/f7a 0 2024-04-12T09:11:28.744 INFO:tasks.workunit.client.0.smithi117.stdout:2/895: read d0/d43/d30/f88 [697727,29806] 0 2024-04-12T09:11:28.749 INFO:tasks.workunit.client.0.smithi117.stdout:9/874: creat d1/d8/df/d7d/d7e/f119 x:0 0 0 2024-04-12T09:11:28.750 INFO:tasks.workunit.client.1.smithi203.stdout:8/368: dwrite d4/d8/d19/f6d [0,4194304] 0 2024-04-12T09:11:28.751 INFO:tasks.workunit.client.1.smithi203.stdout:1/446: dwrite df/d2d/d6f/d75/d80/d54/d5d/d67/f6b [0,4194304] 0 2024-04-12T09:11:28.751 INFO:tasks.workunit.client.0.smithi117.stdout:6/937: creat d8/d9/d17/d33/d101/d97/f128 x:0 0 0 2024-04-12T09:11:28.755 INFO:tasks.workunit.client.0.smithi117.stdout:2/896: dread - d0/d43/da5/d8f/fcc zero size 2024-04-12T09:11:28.757 INFO:tasks.workunit.client.0.smithi117.stdout:9/875: dwrite d1/d23/f113 [0,4194304] 0 2024-04-12T09:11:28.758 INFO:tasks.workunit.client.0.smithi117.stdout:9/876: chown d1/d8/d12/c1c 0 1 2024-04-12T09:11:28.764 INFO:tasks.workunit.client.0.smithi117.stdout:2/897: chown d0/d4/d81/lb9 16041577 1 2024-04-12T09:11:28.770 INFO:tasks.workunit.client.1.smithi203.stdout:1/447: mknod df/d2d/d6f/d75/d80/c8a 0 2024-04-12T09:11:28.773 INFO:tasks.workunit.client.1.smithi203.stdout:1/448: creat df/d2d/d6f/d75/d80/d54/d5d/d67/f8b x:0 0 0 2024-04-12T09:11:28.779 INFO:tasks.workunit.client.1.smithi203.stdout:1/449: mkdir df/d2d/d6f/d75/d80/d8c 0 2024-04-12T09:11:28.780 INFO:tasks.workunit.client.1.smithi203.stdout:1/450: stat df/d2d/d6f/d75/d80/d54/d5d/d67 0 2024-04-12T09:11:28.781 INFO:tasks.workunit.client.1.smithi203.stdout:1/451: fdatasync df/d59/f7e 0 2024-04-12T09:11:28.782 INFO:tasks.workunit.client.1.smithi203.stdout:1/452: write df/d2d/d6f/d75/d80/d54/f40 [809275,83876] 0 2024-04-12T09:11:28.785 INFO:tasks.workunit.client.1.smithi203.stdout:1/453: mkdir df/d2d/d6f/d8d 0 2024-04-12T09:11:28.786 INFO:tasks.workunit.client.1.smithi203.stdout:1/454: write df/d59/f7e [293784,105087] 0 2024-04-12T09:11:28.787 INFO:tasks.workunit.client.1.smithi203.stdout:1/455: fsync df/d2d/f7a 0 2024-04-12T09:11:28.791 INFO:tasks.workunit.client.1.smithi203.stdout:1/456: mkdir df/d2d/d6f/d75/d80/d8c/d8e 0 2024-04-12T09:11:28.792 INFO:tasks.workunit.client.1.smithi203.stdout:1/457: stat df/d2d/d6f/d75/d80/d54/d5d/d4a/f77 0 2024-04-12T09:11:28.795 INFO:tasks.workunit.client.1.smithi203.stdout:1/458: mkdir df/d2d/d6f/d75/d80/d54/d8f 0 2024-04-12T09:11:28.797 INFO:tasks.workunit.client.1.smithi203.stdout:1/459: mkdir df/d2d/d6f/d75/d80/d54/d5d/d90 0 2024-04-12T09:11:28.800 INFO:tasks.workunit.client.1.smithi203.stdout:7/391: sync 2024-04-12T09:11:28.802 INFO:tasks.workunit.client.1.smithi203.stdout:7/392: write d0/d4/d1c/d3b/d4c/f94 [483667,82209] 0 2024-04-12T09:11:28.803 INFO:tasks.workunit.client.1.smithi203.stdout:7/393: write d0/d15/d2d/f4b [3566983,96867] 0 2024-04-12T09:11:28.807 INFO:tasks.workunit.client.1.smithi203.stdout:7/394: unlink d0/d4/d1c/d5b/f71 0 2024-04-12T09:11:28.812 INFO:tasks.workunit.client.1.smithi203.stdout:5/474: creat d0/d6/d11/d1e/fb0 x:0 0 0 2024-04-12T09:11:28.813 INFO:tasks.workunit.client.1.smithi203.stdout:7/395: link d0/d38/d51/l5f d0/d15/d89/l96 0 2024-04-12T09:11:28.820 INFO:tasks.workunit.client.1.smithi203.stdout:5/475: write d0/d6/d16/d9/d30/d58/d74/fa3 [7632,67172] 0 2024-04-12T09:11:28.822 INFO:tasks.workunit.client.1.smithi203.stdout:7/396: dread d0/d15/f20 [0,4194304] 0 2024-04-12T09:11:28.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:28 smithi203 ceph-mon[36428]: pgmap v24: 65 pgs: 65 active+clean; 2.5 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 75 MiB/s rd, 236 MiB/s wr, 523 op/s 2024-04-12T09:11:28.823 INFO:tasks.workunit.client.1.smithi203.stdout:7/397: readlink d0/d4/d1c/d3b/l3d 0 2024-04-12T09:11:28.824 INFO:tasks.workunit.client.1.smithi203.stdout:7/398: readlink d0/d4/d1c/l76 0 2024-04-12T09:11:28.827 INFO:tasks.workunit.client.1.smithi203.stdout:5/476: dwrite d0/d6/d11/d1e/fb0 [0,4194304] 0 2024-04-12T09:11:28.830 INFO:tasks.workunit.client.1.smithi203.stdout:5/477: symlink d0/d6/d11/d38/lb1 0 2024-04-12T09:11:28.831 INFO:tasks.workunit.client.1.smithi203.stdout:2/418: truncate d0/d3/f17 1571867 0 2024-04-12T09:11:28.832 INFO:tasks.workunit.client.1.smithi203.stdout:5/478: fsync d0/d6/f22 0 2024-04-12T09:11:28.833 INFO:tasks.workunit.client.1.smithi203.stdout:2/419: chown d0/d54/d61 7558516 1 2024-04-12T09:11:28.836 INFO:tasks.workunit.client.1.smithi203.stdout:2/420: stat d0/l1f 0 2024-04-12T09:11:28.839 INFO:tasks.workunit.client.1.smithi203.stdout:5/479: dwrite d0/d6/d11/d18/f32 [8388608,4194304] 0 2024-04-12T09:11:28.841 INFO:tasks.workunit.client.1.smithi203.stdout:5/480: creat d0/d6/fb2 x:0 0 0 2024-04-12T09:11:28.844 INFO:tasks.workunit.client.1.smithi203.stdout:5/481: write d0/d6/d16/d9/f63 [2544443,66398] 0 2024-04-12T09:11:28.844 INFO:tasks.workunit.client.1.smithi203.stdout:2/421: link d0/d14/d23/d3d/c59 d0/d54/d61/d78/c97 0 2024-04-12T09:11:28.846 INFO:tasks.workunit.client.1.smithi203.stdout:2/422: read d0/d3/fd [423391,106100] 0 2024-04-12T09:11:28.849 INFO:tasks.workunit.client.1.smithi203.stdout:2/423: mkdir d0/d3/d8f/d98 0 2024-04-12T09:11:28.852 INFO:tasks.workunit.client.1.smithi203.stdout:2/424: creat d0/d3/d8f/d98/f99 x:0 0 0 2024-04-12T09:11:28.853 INFO:tasks.workunit.client.1.smithi203.stdout:9/350: write d8/d12/f16 [1547810,40699] 0 2024-04-12T09:11:28.854 INFO:tasks.workunit.client.1.smithi203.stdout:2/425: dread - d0/d14/d1e/f48 zero size 2024-04-12T09:11:28.855 INFO:tasks.workunit.client.1.smithi203.stdout:9/351: read d8/d12/d23/d29/f59 [902676,84559] 0 2024-04-12T09:11:28.856 INFO:tasks.workunit.client.1.smithi203.stdout:2/426: truncate d0/d67/f6c 135239 0 2024-04-12T09:11:28.861 INFO:tasks.workunit.client.1.smithi203.stdout:0/428: write d0/d1d/d2f/d17/fc [2989111,80168] 0 2024-04-12T09:11:28.862 INFO:tasks.workunit.client.1.smithi203.stdout:0/429: rmdir d0/d48 39 2024-04-12T09:11:28.863 INFO:tasks.workunit.client.1.smithi203.stdout:0/430: chown d0/d1d/d2f/d17/d19/d6f 23257 1 2024-04-12T09:11:28.865 INFO:tasks.workunit.client.1.smithi203.stdout:3/375: unlink d2/f6e 0 2024-04-12T09:11:28.866 INFO:tasks.workunit.client.1.smithi203.stdout:3/376: truncate d2/d8/d14/d23/d35/d4c/f31 5143236 0 2024-04-12T09:11:28.867 INFO:tasks.workunit.client.1.smithi203.stdout:3/377: stat d2/l75 0 2024-04-12T09:11:28.867 INFO:tasks.workunit.client.1.smithi203.stdout:0/431: link d0/d1d/d2f/d17/d19/l58 d0/d1d/d65/l86 0 2024-04-12T09:11:28.871 INFO:tasks.workunit.client.0.smithi117.stdout:4/954: dwrite d0/d2c/f2f [0,4194304] 0 2024-04-12T09:11:28.875 INFO:tasks.workunit.client.0.smithi117.stdout:4/955: dread - d0/d2c/d67/fc5 zero size 2024-04-12T09:11:28.876 INFO:tasks.workunit.client.0.smithi117.stdout:4/956: readlink d0/d1/de9/dfe/ldb 0 2024-04-12T09:11:28.878 INFO:tasks.workunit.client.0.smithi117.stdout:4/957: write d0/d5/d25/d110/f124 [425321,117316] 0 2024-04-12T09:11:28.880 INFO:tasks.workunit.client.0.smithi117.stdout:4/958: rmdir d0/d5/d25/dfd/d107/da7/dcd/de6 39 2024-04-12T09:11:28.882 INFO:tasks.workunit.client.0.smithi117.stdout:4/959: truncate d0/d5/d3b/f136 136145 0 2024-04-12T09:11:28.884 INFO:tasks.workunit.client.0.smithi117.stdout:2/898: creat d0/d43/d53/d61/f12a x:0 0 0 2024-04-12T09:11:28.887 INFO:tasks.workunit.client.0.smithi117.stdout:2/899: unlink d0/d43/d30/d41/l29 0 2024-04-12T09:11:28.888 INFO:tasks.workunit.client.0.smithi117.stdout:4/960: dwrite d0/d2c/d3c/d10a/f12b [0,4194304] 0 2024-04-12T09:11:28.890 INFO:tasks.workunit.client.1.smithi203.stdout:1/460: truncate df/f6e 2846586 0 2024-04-12T09:11:28.890 INFO:tasks.workunit.client.1.smithi203.stdout:1/461: fdatasync df/f33 0 2024-04-12T09:11:28.890 INFO:tasks.workunit.client.0.smithi117.stdout:2/900: mknod d0/d43/d30/d41/dfa/c12b 0 2024-04-12T09:11:28.891 INFO:tasks.workunit.client.1.smithi203.stdout:1/462: fdatasync df/d59/f7e 0 2024-04-12T09:11:28.895 INFO:tasks.workunit.client.1.smithi203.stdout:4/384: rename ff to d1a/d2b/f80 0 2024-04-12T09:11:28.896 INFO:tasks.workunit.client.0.smithi117.stdout:2/901: fsync d0/d43/d4b/f7d 0 2024-04-12T09:11:28.898 INFO:tasks.workunit.client.1.smithi203.stdout:1/463: mkdir df/d2d/d6f/d75/d80/d2b/d91 0 2024-04-12T09:11:28.901 INFO:tasks.workunit.client.1.smithi203.stdout:6/371: rename d1/df/d28 to d1/d3/d26/d30/d4a/d6c/d45/d55/d77 0 2024-04-12T09:11:28.903 INFO:tasks.workunit.client.1.smithi203.stdout:4/385: write d1a/d20/f7e [1037126,18408] 0 2024-04-12T09:11:28.904 INFO:tasks.workunit.client.1.smithi203.stdout:4/386: chown d1a/d2b/l4d 8 1 2024-04-12T09:11:28.905 INFO:tasks.workunit.client.1.smithi203.stdout:1/464: rmdir df/d2d/d6f/d75/d80 39 2024-04-12T09:11:28.912 INFO:tasks.workunit.client.1.smithi203.stdout:7/399: rename d0/d15/d2d/l44 to d0/d4/d54/l97 0 2024-04-12T09:11:28.914 INFO:tasks.workunit.client.1.smithi203.stdout:7/400: write d0/d4/d1c/d3b/d4c/f55 [866292,95014] 0 2024-04-12T09:11:28.914 INFO:tasks.workunit.client.1.smithi203.stdout:6/372: symlink d1/l78 0 2024-04-12T09:11:28.914 INFO:tasks.workunit.client.1.smithi203.stdout:7/401: readlink d0/d4/lb 0 2024-04-12T09:11:28.915 INFO:tasks.workunit.client.1.smithi203.stdout:4/387: mknod d1a/d21/d60/d68/c81 0 2024-04-12T09:11:28.918 INFO:tasks.workunit.client.1.smithi203.stdout:9/352: creat d8/f89 x:0 0 0 2024-04-12T09:11:28.919 INFO:tasks.workunit.client.1.smithi203.stdout:7/402: mkdir d0/d4/d1c/d3b/d98 0 2024-04-12T09:11:28.921 INFO:tasks.workunit.client.1.smithi203.stdout:4/388: rmdir d1a/d34 39 2024-04-12T09:11:28.922 INFO:tasks.workunit.client.1.smithi203.stdout:7/403: mknod d0/d4/d53/c99 0 2024-04-12T09:11:28.924 INFO:tasks.workunit.client.1.smithi203.stdout:8/369: rmdir d4/d8/d74 39 2024-04-12T09:11:28.927 INFO:tasks.workunit.client.1.smithi203.stdout:7/404: rename d0/d15/f19 to d0/d4/d54/d75/f9a 0 2024-04-12T09:11:28.929 INFO:tasks.workunit.client.1.smithi203.stdout:4/389: rename d1a/l29 to d1a/l82 0 2024-04-12T09:11:28.931 INFO:tasks.workunit.client.1.smithi203.stdout:7/405: dread d0/d15/d2d/d5e/d8c/f74 [0,4194304] 0 2024-04-12T09:11:28.932 INFO:tasks.workunit.client.1.smithi203.stdout:7/406: chown d0/d4/f11 11569 1 2024-04-12T09:11:28.933 INFO:tasks.workunit.client.1.smithi203.stdout:9/353: dread d8/d12/d23/d38/f3d [0,4194304] 0 2024-04-12T09:11:28.936 INFO:tasks.workunit.client.1.smithi203.stdout:4/390: creat d1a/d21/d22/d4e/f83 x:0 0 0 2024-04-12T09:11:28.937 INFO:tasks.workunit.client.1.smithi203.stdout:8/370: fdatasync d4/d8/fc 0 2024-04-12T09:11:28.939 INFO:tasks.workunit.client.1.smithi203.stdout:7/407: creat d0/d4/d54/d75/f9b x:0 0 0 2024-04-12T09:11:28.940 INFO:tasks.workunit.client.1.smithi203.stdout:7/408: fdatasync d0/d4/d1c/d3b/f4e 0 2024-04-12T09:11:28.944 INFO:tasks.workunit.client.1.smithi203.stdout:4/391: creat d1a/d20/d5d/f84 x:0 0 0 2024-04-12T09:11:28.945 INFO:tasks.workunit.client.1.smithi203.stdout:9/354: dwrite d8/d12/d23/d29/f59 [0,4194304] 0 2024-04-12T09:11:28.949 INFO:tasks.workunit.client.1.smithi203.stdout:7/409: creat d0/d38/f9c x:0 0 0 2024-04-12T09:11:28.950 INFO:tasks.workunit.client.1.smithi203.stdout:7/410: dread d0/d15/f20 [0,4194304] 0 2024-04-12T09:11:28.951 INFO:tasks.workunit.client.1.smithi203.stdout:7/411: truncate d0/d4/f92 8727655 0 2024-04-12T09:11:28.953 INFO:tasks.workunit.client.1.smithi203.stdout:9/355: unlink d8/d12/d3e/f63 0 2024-04-12T09:11:28.955 INFO:tasks.workunit.client.1.smithi203.stdout:8/371: creat d4/d8/d74/f76 x:0 0 0 2024-04-12T09:11:28.956 INFO:tasks.workunit.client.1.smithi203.stdout:4/392: symlink d1a/d34/l85 0 2024-04-12T09:11:28.957 INFO:tasks.workunit.client.1.smithi203.stdout:2/427: write d0/d14/f22 [421305,59051] 0 2024-04-12T09:11:28.958 INFO:tasks.workunit.client.1.smithi203.stdout:7/412: write d0/f7 [1717636,119433] 0 2024-04-12T09:11:28.959 INFO:tasks.workunit.client.1.smithi203.stdout:7/413: stat d0/d15/d2d/f66 0 2024-04-12T09:11:28.959 INFO:tasks.workunit.client.1.smithi203.stdout:9/356: mkdir d8/d12/d23/d38/d8a 0 2024-04-12T09:11:28.960 INFO:tasks.workunit.client.1.smithi203.stdout:9/357: fsync d8/d3b/d6f/d74/f7f 0 2024-04-12T09:11:28.962 INFO:tasks.workunit.client.1.smithi203.stdout:4/393: unlink d1a/d20/f7d 0 2024-04-12T09:11:28.963 INFO:tasks.workunit.client.1.smithi203.stdout:3/378: write d2/d8/d59/f61 [7031944,24978] 0 2024-04-12T09:11:28.963 INFO:tasks.workunit.client.1.smithi203.stdout:4/394: dread - d1a/d20/d5f/f6d zero size 2024-04-12T09:11:28.965 INFO:tasks.workunit.client.1.smithi203.stdout:0/432: truncate d0/d1d/d2f/d17/fc 508244 0 2024-04-12T09:11:28.967 INFO:tasks.workunit.client.1.smithi203.stdout:9/358: rename d8/d12/d23/d29/f31 to d8/d12/d23/d85/f8b 0 2024-04-12T09:11:28.973 INFO:tasks.workunit.client.1.smithi203.stdout:4/395: mknod d1a/d1d/d69/c86 0 2024-04-12T09:11:28.974 INFO:tasks.workunit.client.1.smithi203.stdout:4/396: dread - d1a/d21/d60/f7f zero size 2024-04-12T09:11:28.974 INFO:tasks.workunit.client.1.smithi203.stdout:8/372: creat d4/d8/f77 x:0 0 0 2024-04-12T09:11:28.975 INFO:tasks.workunit.client.1.smithi203.stdout:5/482: sync 2024-04-12T09:11:28.976 INFO:tasks.workunit.client.1.smithi203.stdout:0/433: fdatasync d0/f36 0 2024-04-12T09:11:28.979 INFO:tasks.workunit.client.1.smithi203.stdout:2/428: dread d0/fc [0,4194304] 0 2024-04-12T09:11:28.980 INFO:tasks.workunit.client.0.smithi117.stdout:4/961: dwrite d0/f37 [4194304,4194304] 0 2024-04-12T09:11:28.980 INFO:tasks.workunit.client.0.smithi117.stdout:7/806: sync 2024-04-12T09:11:28.982 INFO:tasks.workunit.client.1.smithi203.stdout:8/373: dwrite d4/d8/d19/d53/f5b [0,4194304] 0 2024-04-12T09:11:28.984 INFO:tasks.workunit.client.1.smithi203.stdout:9/359: dwrite d8/fb [0,4194304] 0 2024-04-12T09:11:28.985 INFO:tasks.workunit.client.1.smithi203.stdout:0/434: fsync d0/d1d/d2f/d4c/f6a 0 2024-04-12T09:11:28.987 INFO:tasks.workunit.client.1.smithi203.stdout:9/360: stat d8/d12/d23/d85/c52 0 2024-04-12T09:11:28.988 INFO:tasks.workunit.client.0.smithi117.stdout:2/902: dwrite d0/d4/d10/d27/fa7 [0,4194304] 0 2024-04-12T09:11:28.989 INFO:tasks.workunit.client.0.smithi117.stdout:4/962: mknod d0/d5/d39/d4e/d6b/d83/db1/c138 0 2024-04-12T09:11:28.995 INFO:tasks.workunit.client.1.smithi203.stdout:1/465: dwrite df/f83 [4194304,4194304] 0 2024-04-12T09:11:28.995 INFO:tasks.workunit.client.1.smithi203.stdout:4/397: unlink d1a/d2b/l40 0 2024-04-12T09:11:28.995 INFO:tasks.workunit.client.0.smithi117.stdout:7/807: chown d0/d2/d45/d17/d23/dac/dad/d91/dca/fe9 62 1 2024-04-12T09:11:28.996 INFO:tasks.workunit.client.0.smithi117.stdout:7/808: chown d0/d2/d45/d17/d23/d50/c65 10597601 1 2024-04-12T09:11:28.997 INFO:tasks.workunit.client.1.smithi203.stdout:4/398: stat d1a/d20 0 2024-04-12T09:11:28.997 INFO:tasks.workunit.client.1.smithi203.stdout:1/466: fdatasync df/d2d/f68 0 2024-04-12T09:11:28.997 INFO:tasks.workunit.client.0.smithi117.stdout:2/903: fdatasync d0/d43/d53/d61/d8d/fdd 0 2024-04-12T09:11:28.999 INFO:tasks.workunit.client.1.smithi203.stdout:2/429: chown d0/d3/d47/c4a 24 1 2024-04-12T09:11:29.002 INFO:tasks.workunit.client.1.smithi203.stdout:4/399: write d1a/d20/f5e [928112,26849] 0 2024-04-12T09:11:29.002 INFO:tasks.workunit.client.1.smithi203.stdout:0/435: creat d0/d59/f87 x:0 0 0 2024-04-12T09:11:29.006 INFO:tasks.workunit.client.0.smithi117.stdout:7/809: creat d0/d20/d4a/dfd/df2/f100 x:0 0 0 2024-04-12T09:11:29.007 INFO:tasks.workunit.client.1.smithi203.stdout:6/373: dwrite d1/d3/d26/d30/d4a/d6c/f40 [4194304,4194304] 0 2024-04-12T09:11:29.008 INFO:tasks.workunit.client.1.smithi203.stdout:4/400: truncate d1a/d21/d60/f77 1027711 0 2024-04-12T09:11:29.009 INFO:tasks.workunit.client.0.smithi117.stdout:2/904: dread - d0/d4/d10/d27/fd4 zero size 2024-04-12T09:11:29.010 INFO:tasks.workunit.client.1.smithi203.stdout:8/374: dwrite d4/d8/d19/f2e [0,4194304] 0 2024-04-12T09:11:29.011 INFO:tasks.workunit.client.0.smithi117.stdout:4/963: creat d0/d5/d39/d115/f139 x:0 0 0 2024-04-12T09:11:29.017 INFO:tasks.workunit.client.0.smithi117.stdout:2/905: mknod d0/d43/d30/c12c 0 2024-04-12T09:11:29.020 INFO:tasks.workunit.client.0.smithi117.stdout:4/964: dread d0/d2c/f2f [0,4194304] 0 2024-04-12T09:11:29.022 INFO:tasks.workunit.client.0.smithi117.stdout:6/938: sync 2024-04-12T09:11:29.022 INFO:tasks.workunit.client.0.smithi117.stdout:4/965: chown d0/d5/d25/dfd/d107/da7 413614 1 2024-04-12T09:11:29.023 INFO:tasks.workunit.client.1.smithi203.stdout:9/361: symlink d8/d12/d23/d27/d4f/d60/l8c 0 2024-04-12T09:11:29.024 INFO:tasks.workunit.client.1.smithi203.stdout:9/362: write d8/d12/d23/d29/d2c/f5a [1212672,125631] 0 2024-04-12T09:11:29.029 INFO:tasks.workunit.client.0.smithi117.stdout:6/939: dwrite d8/d2a/d60/fa1 [0,4194304] 0 2024-04-12T09:11:29.032 INFO:tasks.workunit.client.1.smithi203.stdout:5/483: link d0/d6/d16/l79 d0/d6/d11/d1e/lb3 0 2024-04-12T09:11:29.033 INFO:tasks.workunit.client.1.smithi203.stdout:7/414: write d0/d4/f69 [1700890,76885] 0 2024-04-12T09:11:29.033 INFO:tasks.workunit.client.1.smithi203.stdout:5/484: write d0/d6/d16/d9/f24 [10981288,56228] 0 2024-04-12T09:11:29.034 INFO:tasks.workunit.client.1.smithi203.stdout:6/374: creat d1/d3/d26/f79 x:0 0 0 2024-04-12T09:11:29.036 INFO:tasks.workunit.client.1.smithi203.stdout:7/415: truncate d0/d4/fe 5627452 0 2024-04-12T09:11:29.038 INFO:tasks.workunit.client.1.smithi203.stdout:4/401: unlink d1a/d21/d60/d68/f74 0 2024-04-12T09:11:29.040 INFO:tasks.workunit.client.1.smithi203.stdout:8/375: fdatasync d4/f4b 0 2024-04-12T09:11:29.041 INFO:tasks.workunit.client.1.smithi203.stdout:3/379: dwrite d2/d8/d14/d1b/d2f/f32 [0,4194304] 0 2024-04-12T09:11:29.041 INFO:tasks.workunit.client.1.smithi203.stdout:1/467: write df/d2d/d6f/d75/d80/f41 [3556637,20275] 0 2024-04-12T09:11:29.048 INFO:tasks.workunit.client.1.smithi203.stdout:2/430: mkdir d0/d14/d74/d96/d9a 0 2024-04-12T09:11:29.051 INFO:tasks.workunit.client.1.smithi203.stdout:0/436: creat d0/d48/f88 x:0 0 0 2024-04-12T09:11:29.052 INFO:tasks.workunit.client.1.smithi203.stdout:0/437: truncate d0/d1d/d2f/d17/d19/f25 17414323 0 2024-04-12T09:11:29.053 INFO:tasks.workunit.client.1.smithi203.stdout:0/438: truncate d0/dd/f7b 1016668 0 2024-04-12T09:11:29.058 INFO:tasks.workunit.client.1.smithi203.stdout:7/416: creat d0/d4/d1c/f9d x:0 0 0 2024-04-12T09:11:29.060 INFO:tasks.workunit.client.1.smithi203.stdout:5/485: dread d0/d6/d16/d9/d86/f8f [0,4194304] 0 2024-04-12T09:11:29.061 INFO:tasks.workunit.client.1.smithi203.stdout:8/376: unlink d4/d8/d19/l67 0 2024-04-12T09:11:29.063 INFO:tasks.workunit.client.1.smithi203.stdout:3/380: symlink d2/d64/l7b 0 2024-04-12T09:11:29.063 INFO:tasks.workunit.client.1.smithi203.stdout:8/377: read d4/d8/d19/f27 [1582155,52757] 0 2024-04-12T09:11:29.064 INFO:tasks.workunit.client.1.smithi203.stdout:1/468: chown df/d2d/d6f/d75/d80/d2b/l63 0 1 2024-04-12T09:11:29.065 INFO:tasks.workunit.client.1.smithi203.stdout:1/469: chown df/d2d/d6f/d75/d80/d54/l5e 19389174 1 2024-04-12T09:11:29.066 INFO:tasks.workunit.client.1.smithi203.stdout:1/470: stat df/d2d/d6f/d75/d80/d54/d5d/d67/l87 0 2024-04-12T09:11:29.067 INFO:tasks.workunit.client.1.smithi203.stdout:2/431: creat d0/d19/f9b x:0 0 0 2024-04-12T09:11:29.068 INFO:tasks.workunit.client.1.smithi203.stdout:0/439: creat d0/d1d/d2f/d17/d19/f89 x:0 0 0 2024-04-12T09:11:29.069 INFO:tasks.workunit.client.0.smithi117.stdout:9/877: sync 2024-04-12T09:11:29.071 INFO:tasks.workunit.client.1.smithi203.stdout:7/417: creat d0/d4/d5d/f9e x:0 0 0 2024-04-12T09:11:29.074 INFO:tasks.workunit.client.1.smithi203.stdout:8/378: dread d4/d8/d19/f27 [0,4194304] 0 2024-04-12T09:11:29.076 INFO:tasks.workunit.client.0.smithi117.stdout:9/878: dwrite d1/d8/d5e/d9f/f108 [0,4194304] 0 2024-04-12T09:11:29.078 INFO:tasks.workunit.client.1.smithi203.stdout:5/486: mkdir d0/d6/d16/d9/d30/d58/db4 0 2024-04-12T09:11:29.079 INFO:tasks.workunit.client.0.smithi117.stdout:9/879: dread d1/d8/df/d7d/d7e/f78 [0,4194304] 0 2024-04-12T09:11:29.080 INFO:tasks.workunit.client.1.smithi203.stdout:3/381: mknod d2/d8/d14/d23/d35/d4c/d5c/c7c 0 2024-04-12T09:11:29.083 INFO:tasks.workunit.client.1.smithi203.stdout:2/432: mkdir d0/d38/d43/d9c 0 2024-04-12T09:11:29.084 INFO:tasks.workunit.client.1.smithi203.stdout:1/471: rename df/d2d/f7a to df/d2d/d6f/d75/d80/d54/d5d/d58/f92 0 2024-04-12T09:11:29.085 INFO:tasks.workunit.client.1.smithi203.stdout:1/472: chown df/f1e 114005052 1 2024-04-12T09:11:29.086 INFO:tasks.workunit.client.1.smithi203.stdout:1/473: chown df/d2d/d6f/d75/d80/d54/l79 259429 1 2024-04-12T09:11:29.088 INFO:tasks.workunit.client.1.smithi203.stdout:1/474: write df/d2d/d6f/d75/d80/d54/d5d/d67/f8b [470361,40113] 0 2024-04-12T09:11:29.089 INFO:tasks.workunit.client.1.smithi203.stdout:5/487: creat d0/d6/d11/d1e/d4c/d48/fb5 x:0 0 0 2024-04-12T09:11:29.093 INFO:tasks.workunit.client.0.smithi117.stdout:2/906: fdatasync d0/d43/d30/d41/f5b 0 2024-04-12T09:11:29.094 INFO:tasks.workunit.client.0.smithi117.stdout:4/966: mkdir d0/d1/de9/d13a 0 2024-04-12T09:11:29.094 INFO:tasks.workunit.client.1.smithi203.stdout:5/488: dwrite d0/f4 [0,4194304] 0 2024-04-12T09:11:29.095 INFO:tasks.workunit.client.1.smithi203.stdout:2/433: creat d0/d14/d74/f9d x:0 0 0 2024-04-12T09:11:29.100 INFO:tasks.workunit.client.1.smithi203.stdout:0/440: link d0/d48/d5e/f75 d0/d1d/d2f/d17/d19/d6f/d78/f8a 0 2024-04-12T09:11:29.103 INFO:tasks.workunit.client.0.smithi117.stdout:9/880: mkdir d1/d8/d90/d11a 0 2024-04-12T09:11:29.105 INFO:tasks.workunit.client.1.smithi203.stdout:4/402: getdents d1a/d20 0 2024-04-12T09:11:29.106 INFO:tasks.workunit.client.0.smithi117.stdout:7/810: link d0/d2/d45/d17/d23/d39/dbd/fbf d0/d2/d96/f101 0 2024-04-12T09:11:29.108 INFO:tasks.workunit.client.1.smithi203.stdout:1/475: unlink df/d2d/l50 0 2024-04-12T09:11:29.109 INFO:tasks.workunit.client.0.smithi117.stdout:9/881: dread d1/d24/f57 [4194304,4194304] 0 2024-04-12T09:11:29.110 INFO:tasks.workunit.client.1.smithi203.stdout:1/476: chown df/d2d/d6f/d75/d80/d54/f61 54385 1 2024-04-12T09:11:29.110 INFO:tasks.workunit.client.1.smithi203.stdout:8/379: rename d4/d8/d19 to d4/d8/d74/d78 0 2024-04-12T09:11:29.111 INFO:tasks.workunit.client.1.smithi203.stdout:4/403: dwrite d1a/d20/d5f/f64 [0,4194304] 0 2024-04-12T09:11:29.111 INFO:tasks.workunit.client.1.smithi203.stdout:1/477: readlink df/d2d/d6f/d75/d80/d2b/l38 0 2024-04-12T09:11:29.113 INFO:tasks.workunit.client.1.smithi203.stdout:9/363: link d8/f34 d8/f8d 0 2024-04-12T09:11:29.115 INFO:tasks.workunit.client.0.smithi117.stdout:2/907: truncate d0/d43/d30/f47 2546393 0 2024-04-12T09:11:29.116 INFO:tasks.workunit.client.0.smithi117.stdout:2/908: readlink d0/d43/d53/l94 0 2024-04-12T09:11:29.117 INFO:tasks.workunit.client.0.smithi117.stdout:9/882: dwrite d1/d8/d5a/d79/d91/ffa [0,4194304] 0 2024-04-12T09:11:29.118 INFO:tasks.workunit.client.1.smithi203.stdout:2/434: symlink d0/d3/d47/l9e 0 2024-04-12T09:11:29.130 INFO:tasks.workunit.client.1.smithi203.stdout:8/380: mkdir d4/d34/d79 0 2024-04-12T09:11:29.134 INFO:tasks.workunit.client.0.smithi117.stdout:4/967: rename d0/d5/f6e to d0/d5/d25/dfd/d107/da7/dcd/de6/f13b 0 2024-04-12T09:11:29.136 INFO:tasks.workunit.client.1.smithi203.stdout:4/404: symlink d1a/d20/d5d/l87 0 2024-04-12T09:11:29.136 INFO:tasks.workunit.client.1.smithi203.stdout:4/405: chown d1a/d21/d22/d2e/l56 59154117 1 2024-04-12T09:11:29.137 INFO:tasks.workunit.client.1.smithi203.stdout:4/406: write d1a/d21/f33 [1738166,25529] 0 2024-04-12T09:11:29.138 INFO:tasks.workunit.client.1.smithi203.stdout:4/407: write d1a/d20/d5d/d2c/f51 [8621038,15860] 0 2024-04-12T09:11:29.139 INFO:tasks.workunit.client.1.smithi203.stdout:4/408: read - d1a/d21/d22/d2e/f6c zero size 2024-04-12T09:11:29.142 INFO:tasks.workunit.client.1.smithi203.stdout:9/364: dread f4 [0,4194304] 0 2024-04-12T09:11:29.142 INFO:tasks.workunit.client.1.smithi203.stdout:4/409: truncate d1a/d21/d22/d4e/f52 590843 0 2024-04-12T09:11:29.143 INFO:tasks.workunit.client.0.smithi117.stdout:7/811: dread d0/d2/d1a/f9d [0,4194304] 0 2024-04-12T09:11:29.146 INFO:tasks.workunit.client.0.smithi117.stdout:4/968: symlink d0/d2c/da6/l13c 0 2024-04-12T09:11:29.151 INFO:tasks.workunit.client.0.smithi117.stdout:6/940: link d8/d9/d17/f68 d8/d9/d17/d33/f129 0 2024-04-12T09:11:29.152 INFO:tasks.workunit.client.0.smithi117.stdout:6/941: truncate d8/d3a/dc8/f10a 10269 0 2024-04-12T09:11:29.154 INFO:tasks.workunit.client.0.smithi117.stdout:7/812: mknod d0/d2/d1a/d49/c102 0 2024-04-12T09:11:29.155 INFO:tasks.workunit.client.0.smithi117.stdout:7/813: readlink d0/d2/d45/d17/d23/d39/d6c/lea 0 2024-04-12T09:11:29.159 INFO:tasks.workunit.client.1.smithi203.stdout:0/441: link d0/f36 d0/d48/d5e/d84/f8b 0 2024-04-12T09:11:29.160 INFO:tasks.workunit.client.1.smithi203.stdout:0/442: write d0/d1d/f68 [4525287,39762] 0 2024-04-12T09:11:29.160 INFO:tasks.workunit.client.1.smithi203.stdout:0/443: stat d0/dd/d71/f85 0 2024-04-12T09:11:29.162 INFO:tasks.workunit.client.0.smithi117.stdout:7/814: dread d0/d2/d1a/d49/f4e [0,4194304] 0 2024-04-12T09:11:29.163 INFO:tasks.workunit.client.1.smithi203.stdout:1/478: symlink df/d2d/d6f/d75/d80/d2b/d91/l93 0 2024-04-12T09:11:29.164 INFO:tasks.workunit.client.0.smithi117.stdout:7/815: fdatasync d0/d2/d45/d17/d23/d50/f64 0 2024-04-12T09:11:29.167 INFO:tasks.workunit.client.1.smithi203.stdout:7/418: write d0/f26 [327019,99457] 0 2024-04-12T09:11:29.168 INFO:tasks.workunit.client.1.smithi203.stdout:9/365: write d8/fa [8786678,98882] 0 2024-04-12T09:11:29.169 INFO:tasks.workunit.client.1.smithi203.stdout:9/366: dread - d8/d12/d23/d41/f5e zero size 2024-04-12T09:11:29.170 INFO:tasks.workunit.client.1.smithi203.stdout:9/367: truncate d8/d3b/d6f/d74/f7e 888254 0 2024-04-12T09:11:29.171 INFO:tasks.workunit.client.1.smithi203.stdout:4/410: rmdir d1a/d21/d22/d2e 39 2024-04-12T09:11:29.174 INFO:tasks.workunit.client.1.smithi203.stdout:6/375: sync 2024-04-12T09:11:29.176 INFO:tasks.workunit.client.1.smithi203.stdout:0/444: mknod d0/d59/d5d/d79/c8c 0 2024-04-12T09:11:29.182 INFO:tasks.workunit.client.1.smithi203.stdout:1/479: mkdir df/d2d/d6f/d75/d80/d54/d5d/d58/d94 0 2024-04-12T09:11:29.183 INFO:tasks.workunit.client.0.smithi117.stdout:2/909: write d0/d43/da5/d8f/fb6 [870717,34691] 0 2024-04-12T09:11:29.183 INFO:tasks.workunit.client.1.smithi203.stdout:1/480: dread df/d2d/d6f/d75/d80/d54/d5d/d58/f66 [0,4194304] 0 2024-04-12T09:11:29.184 INFO:tasks.workunit.client.1.smithi203.stdout:5/489: dwrite d0/d6/d11/d18/f3b [0,4194304] 0 2024-04-12T09:11:29.186 INFO:tasks.workunit.client.1.smithi203.stdout:5/490: read d0/d6/f93 [2836261,90993] 0 2024-04-12T09:11:29.187 INFO:tasks.workunit.client.1.smithi203.stdout:0/445: rename d0/f1a to d0/d1d/d2f/d4c/f8d 0 2024-04-12T09:11:29.188 INFO:tasks.workunit.client.1.smithi203.stdout:5/491: read - d0/d6/d16/d9/d30/d58/d74/d88/f97 zero size 2024-04-12T09:11:29.189 INFO:tasks.workunit.client.1.smithi203.stdout:8/381: link d4/d8/d74/d78/l3c d4/d8/d74/d78/d53/l7a 0 2024-04-12T09:11:29.190 INFO:tasks.workunit.client.1.smithi203.stdout:7/419: mknod d0/d4/d1c/d3b/d98/c9f 0 2024-04-12T09:11:29.190 INFO:tasks.workunit.client.1.smithi203.stdout:9/368: dread d8/d12/d23/d29/d2c/d40/f6d [0,4194304] 0 2024-04-12T09:11:29.191 INFO:tasks.workunit.client.1.smithi203.stdout:8/382: chown d4/l65 99 1 2024-04-12T09:11:29.193 INFO:tasks.workunit.client.1.smithi203.stdout:8/383: write f3 [3895359,75567] 0 2024-04-12T09:11:29.193 INFO:tasks.workunit.client.0.smithi117.stdout:9/883: write d1/d8/d5a/d79/d91/db0/f46 [899283,108801] 0 2024-04-12T09:11:29.194 INFO:tasks.workunit.client.1.smithi203.stdout:4/411: dread d1a/d21/d22/d2e/f3c [0,4194304] 0 2024-04-12T09:11:29.195 INFO:tasks.workunit.client.1.smithi203.stdout:8/384: chown d4/d8/d1c/d5d/c51 3073 1 2024-04-12T09:11:29.196 INFO:tasks.workunit.client.1.smithi203.stdout:0/446: symlink d0/d1d/l8e 0 2024-04-12T09:11:29.198 INFO:tasks.workunit.client.1.smithi203.stdout:0/447: readlink d0/d1d/d2f/d17/l28 0 2024-04-12T09:11:29.198 INFO:tasks.workunit.client.1.smithi203.stdout:2/435: write d0/d14/d1e/d2a/f4c [672049,119831] 0 2024-04-12T09:11:29.199 INFO:tasks.workunit.client.0.smithi117.stdout:6/942: write d8/d3f/fd6 [1023387,13958] 0 2024-04-12T09:11:29.202 INFO:tasks.workunit.client.1.smithi203.stdout:9/369: dwrite d8/d12/d23/d29/d2c/f4c [0,4194304] 0 2024-04-12T09:11:29.206 INFO:tasks.workunit.client.1.smithi203.stdout:1/481: creat df/d2d/d6f/d75/d80/d54/d5d/d90/f95 x:0 0 0 2024-04-12T09:11:29.206 INFO:tasks.workunit.client.0.smithi117.stdout:7/816: write d0/d2/d45/d17/f3a [931891,62660] 0 2024-04-12T09:11:29.207 INFO:tasks.workunit.client.1.smithi203.stdout:5/492: dwrite d0/d6/d16/d9/f10 [0,4194304] 0 2024-04-12T09:11:29.210 INFO:tasks.workunit.client.1.smithi203.stdout:3/382: sync 2024-04-12T09:11:29.213 INFO:tasks.workunit.client.0.smithi117.stdout:7/817: read d0/d2/d45/d17/d23/d39/d6c/fa4 [520797,115605] 0 2024-04-12T09:11:29.216 INFO:tasks.workunit.client.1.smithi203.stdout:5/493: dread d0/d6/d11/d1e/d4c/f8c [0,4194304] 0 2024-04-12T09:11:29.219 INFO:tasks.workunit.client.1.smithi203.stdout:6/376: dwrite d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d3a/f60 [0,4194304] 0 2024-04-12T09:11:29.219 INFO:tasks.workunit.client.1.smithi203.stdout:5/494: chown d0/d6/d11/d18/d2a/ff 3952 1 2024-04-12T09:11:29.220 INFO:tasks.workunit.client.0.smithi117.stdout:2/910: dwrite d0/d4/f54 [0,4194304] 0 2024-04-12T09:11:29.221 INFO:tasks.workunit.client.1.smithi203.stdout:9/370: rename d8/d12/d23/d29 to d8/d3b/d6f/d74/d8e 0 2024-04-12T09:11:29.225 INFO:tasks.workunit.client.1.smithi203.stdout:9/371: dread d8/f58 [0,4194304] 0 2024-04-12T09:11:29.229 INFO:tasks.workunit.client.0.smithi117.stdout:7/818: creat d0/da/d7c/f103 x:0 0 0 2024-04-12T09:11:29.231 INFO:tasks.workunit.client.0.smithi117.stdout:2/911: creat d0/d43/d128/f12d x:0 0 0 2024-04-12T09:11:29.232 INFO:tasks.workunit.client.0.smithi117.stdout:9/884: dwrite d1/d8/d5a/d6e/f9c [0,4194304] 0 2024-04-12T09:11:29.234 INFO:tasks.workunit.client.0.smithi117.stdout:2/912: fdatasync d0/d43/da5/d8f/fb6 0 2024-04-12T09:11:29.236 INFO:tasks.workunit.client.0.smithi117.stdout:2/913: chown d0/d43/fbe 1 1 2024-04-12T09:11:29.236 INFO:tasks.workunit.client.0.smithi117.stdout:7/819: mknod d0/d2/d96/d98/c104 0 2024-04-12T09:11:29.237 INFO:tasks.workunit.client.1.smithi203.stdout:4/412: dwrite d1a/d34/f35 [0,4194304] 0 2024-04-12T09:11:29.238 INFO:tasks.workunit.client.1.smithi203.stdout:2/436: write d0/d67/f75 [3611958,53353] 0 2024-04-12T09:11:29.239 INFO:tasks.workunit.client.0.smithi117.stdout:6/943: dwrite d8/ff9 [0,4194304] 0 2024-04-12T09:11:29.240 INFO:tasks.workunit.client.1.smithi203.stdout:7/420: truncate d0/f2 3768629 0 2024-04-12T09:11:29.241 INFO:tasks.workunit.client.1.smithi203.stdout:5/495: creat d0/d6/d16/d9/d30/d83/fb6 x:0 0 0 2024-04-12T09:11:29.247 INFO:tasks.workunit.client.1.smithi203.stdout:8/385: link d4/d34/f47 d4/d8/f7b 0 2024-04-12T09:11:29.248 INFO:tasks.workunit.client.0.smithi117.stdout:7/820: fsync d0/d2/d45/d17/d23/d39/d6c/fa4 0 2024-04-12T09:11:29.250 INFO:tasks.workunit.client.0.smithi117.stdout:6/944: fsync d8/d2a/d60/d7d/d8c/d107/f127 0 2024-04-12T09:11:29.251 INFO:tasks.workunit.client.0.smithi117.stdout:9/885: mknod d1/d8/d5a/d79/d91/db0/d8a/dfe/c11b 0 2024-04-12T09:11:29.252 INFO:tasks.workunit.client.1.smithi203.stdout:0/448: creat d0/d1d/d2f/f8f x:0 0 0 2024-04-12T09:11:29.253 INFO:tasks.workunit.client.1.smithi203.stdout:0/449: chown d0/d1d/d2f/d17 962940 1 2024-04-12T09:11:29.254 INFO:tasks.workunit.client.1.smithi203.stdout:6/377: mkdir d1/d3/d26/d30/d4a/d74/d7a 0 2024-04-12T09:11:29.256 INFO:tasks.workunit.client.0.smithi117.stdout:7/821: rename d0/d2/d45/d17/f3a to d0/d2/d45/d17/d23/dac/dad/d91/dca/f105 0 2024-04-12T09:11:29.257 INFO:tasks.workunit.client.0.smithi117.stdout:6/945: creat d8/d2a/d60/d89/d99/df5/f12a x:0 0 0 2024-04-12T09:11:29.259 INFO:tasks.workunit.client.0.smithi117.stdout:9/886: creat d1/d8/df/d3e/dea/f11c x:0 0 0 2024-04-12T09:11:29.260 INFO:tasks.workunit.client.1.smithi203.stdout:5/496: rmdir d0/d6/d16/d9/d14 39 2024-04-12T09:11:29.262 INFO:tasks.workunit.client.0.smithi117.stdout:7/822: truncate d0/fc3 74107 0 2024-04-12T09:11:29.264 INFO:tasks.workunit.client.1.smithi203.stdout:1/482: creat df/d2d/d6f/d75/d80/f96 x:0 0 0 2024-04-12T09:11:29.265 INFO:tasks.workunit.client.0.smithi117.stdout:6/946: dwrite d8/d2a/d60/d7d/d8c/deb/f124 [0,4194304] 0 2024-04-12T09:11:29.266 INFO:tasks.workunit.client.1.smithi203.stdout:9/372: rename d8/l37 to d8/d12/d23/d85/l8f 0 2024-04-12T09:11:29.270 INFO:tasks.workunit.client.0.smithi117.stdout:9/887: creat d1/d8/d5a/d79/d91/db0/d8a/de7/f11d x:0 0 0 2024-04-12T09:11:29.271 INFO:tasks.workunit.client.1.smithi203.stdout:4/413: symlink d1a/l88 0 2024-04-12T09:11:29.272 INFO:tasks.workunit.client.0.smithi117.stdout:7/823: creat d0/d20/d4a/dfd/df2/f106 x:0 0 0 2024-04-12T09:11:29.275 INFO:tasks.workunit.client.1.smithi203.stdout:6/378: creat d1/d3/d26/d30/d4a/d6c/d45/d55/f7b x:0 0 0 2024-04-12T09:11:29.277 INFO:tasks.workunit.client.1.smithi203.stdout:2/437: symlink d0/d14/d23/l9f 0 2024-04-12T09:11:29.277 INFO:tasks.workunit.client.1.smithi203.stdout:4/414: dwrite d1a/d20/f7e [0,4194304] 0 2024-04-12T09:11:29.278 INFO:tasks.workunit.client.1.smithi203.stdout:4/415: write f5 [14280462,28787] 0 2024-04-12T09:11:29.279 INFO:tasks.workunit.client.0.smithi117.stdout:2/914: write d0/df/f7e [479209,25756] 0 2024-04-12T09:11:29.279 INFO:tasks.workunit.client.0.smithi117.stdout:9/888: dwrite d1/f61 [0,4194304] 0 2024-04-12T09:11:29.280 INFO:tasks.workunit.client.1.smithi203.stdout:4/416: write d1a/d21/d22/f6a [1743528,100581] 0 2024-04-12T09:11:29.281 INFO:tasks.workunit.client.0.smithi117.stdout:7/824: creat d0/d2/d45/d17/d23/d50/d5c/f107 x:0 0 0 2024-04-12T09:11:29.282 INFO:tasks.workunit.client.1.smithi203.stdout:5/497: truncate d0/d6/d11/d1e/f45 270189 0 2024-04-12T09:11:29.283 INFO:tasks.workunit.client.0.smithi117.stdout:7/825: write d0/d2/d45/d17/d23/d50/d5c/fe5 [429069,45471] 0 2024-04-12T09:11:29.285 INFO:tasks.workunit.client.0.smithi117.stdout:7/826: read d0/d20/d4a/dfd/df2/fda [391522,49952] 0 2024-04-12T09:11:29.285 INFO:tasks.workunit.client.1.smithi203.stdout:3/383: getdents d2/d64 0 2024-04-12T09:11:29.286 INFO:tasks.workunit.client.1.smithi203.stdout:3/384: fsync d2/f37 0 2024-04-12T09:11:29.287 INFO:tasks.workunit.client.0.smithi117.stdout:9/889: mknod d1/d8/df/d7d/d7e/c11e 0 2024-04-12T09:11:29.288 INFO:tasks.workunit.client.0.smithi117.stdout:9/890: chown d1/d8/df/d68/ddf/c66 218 1 2024-04-12T09:11:29.288 INFO:tasks.workunit.client.1.smithi203.stdout:4/417: dwrite d1a/d34/f35 [0,4194304] 0 2024-04-12T09:11:29.289 INFO:tasks.workunit.client.0.smithi117.stdout:9/891: chown d1/d8/df/d68/df9 171 1 2024-04-12T09:11:29.291 INFO:tasks.workunit.client.1.smithi203.stdout:4/418: write d1a/d1d/f55 [94294,19796] 0 2024-04-12T09:11:29.291 INFO:tasks.workunit.client.1.smithi203.stdout:6/379: creat d1/d3/d26/d30/f7c x:0 0 0 2024-04-12T09:11:29.293 INFO:tasks.workunit.client.1.smithi203.stdout:4/419: write d1a/d21/d22/f57 [970944,52425] 0 2024-04-12T09:11:29.297 INFO:tasks.workunit.client.0.smithi117.stdout:7/827: mkdir d0/da/d9b/d108 0 2024-04-12T09:11:29.299 INFO:tasks.workunit.client.1.smithi203.stdout:7/421: write d0/d38/f5a [294551,105328] 0 2024-04-12T09:11:29.300 INFO:tasks.workunit.client.1.smithi203.stdout:4/420: dwrite d1a/d20/d5f/f64 [0,4194304] 0 2024-04-12T09:11:29.301 INFO:tasks.workunit.client.0.smithi117.stdout:6/947: dread d8/d3a/fc7 [0,4194304] 0 2024-04-12T09:11:29.301 INFO:tasks.workunit.client.1.smithi203.stdout:4/421: dread - d1a/d21/d60/f7f zero size 2024-04-12T09:11:29.302 INFO:tasks.workunit.client.0.smithi117.stdout:6/948: stat d8/d9/c35 0 2024-04-12T09:11:29.303 INFO:tasks.workunit.client.0.smithi117.stdout:9/892: truncate d1/d8/df/fcf 633512 0 2024-04-12T09:11:29.309 INFO:tasks.workunit.client.1.smithi203.stdout:8/386: rename d4/d8/d74/d78/l3c to d4/d8/d1c/d5d/l7c 0 2024-04-12T09:11:29.310 INFO:tasks.workunit.client.1.smithi203.stdout:8/387: read - d4/d8/d37/f5f zero size 2024-04-12T09:11:29.310 INFO:tasks.workunit.client.0.smithi117.stdout:7/828: creat d0/d2/d45/d53/d58/f109 x:0 0 0 2024-04-12T09:11:29.312 INFO:tasks.workunit.client.0.smithi117.stdout:6/949: dread d8/d9/d39/fcb [0,4194304] 0 2024-04-12T09:11:29.313 INFO:tasks.workunit.client.1.smithi203.stdout:8/388: dread d4/d8/d74/d78/f6d [0,4194304] 0 2024-04-12T09:11:29.313 INFO:tasks.workunit.client.0.smithi117.stdout:2/915: getdents d0/d4/d81 0 2024-04-12T09:11:29.317 INFO:tasks.workunit.client.1.smithi203.stdout:3/385: unlink d2/d8/d14/d1b/c50 0 2024-04-12T09:11:29.317 INFO:tasks.workunit.client.0.smithi117.stdout:9/893: fsync d1/d24/fd6 0 2024-04-12T09:11:29.321 INFO:tasks.workunit.client.0.smithi117.stdout:7/829: creat d0/da/d9b/f10a x:0 0 0 2024-04-12T09:11:29.323 INFO:tasks.workunit.client.1.smithi203.stdout:6/380: creat d1/d3/d26/d30/d4a/f7d x:0 0 0 2024-04-12T09:11:29.324 INFO:tasks.workunit.client.1.smithi203.stdout:6/381: fdatasync d1/d3/d12/f1e 0 2024-04-12T09:11:29.327 INFO:tasks.workunit.client.0.smithi117.stdout:2/916: read d0/f36 [3951192,81968] 0 2024-04-12T09:11:29.328 INFO:tasks.workunit.client.0.smithi117.stdout:6/950: dwrite d8/d9/d17/d33/d101/f88 [4194304,4194304] 0 2024-04-12T09:11:29.329 INFO:tasks.workunit.client.1.smithi203.stdout:7/422: mkdir d0/d4/d54/da0 0 2024-04-12T09:11:29.331 INFO:tasks.workunit.client.1.smithi203.stdout:4/422: fdatasync d1a/d20/f3d 0 2024-04-12T09:11:29.331 INFO:tasks.workunit.client.0.smithi117.stdout:2/917: dread d0/d43/d30/f62 [0,4194304] 0 2024-04-12T09:11:29.333 INFO:tasks.workunit.client.1.smithi203.stdout:9/373: rename d8/d12/d23/d27/d4f to d8/d12/d3e/d90 0 2024-04-12T09:11:29.343 INFO:tasks.workunit.client.1.smithi203.stdout:6/382: fsync d1/df/f38 0 2024-04-12T09:11:29.343 INFO:tasks.workunit.client.0.smithi117.stdout:6/951: dread f7 [4194304,4194304] 0 2024-04-12T09:11:29.345 INFO:tasks.workunit.client.1.smithi203.stdout:6/383: dread d1/df/f6b [0,4194304] 0 2024-04-12T09:11:29.346 INFO:tasks.workunit.client.1.smithi203.stdout:4/423: creat d1a/d21/d60/f89 x:0 0 0 2024-04-12T09:11:29.347 INFO:tasks.workunit.client.1.smithi203.stdout:6/384: read d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d3a/f60 [2160885,39524] 0 2024-04-12T09:11:29.347 INFO:tasks.workunit.client.1.smithi203.stdout:4/424: dread - d1a/d21/f67 zero size 2024-04-12T09:11:29.348 INFO:tasks.workunit.client.1.smithi203.stdout:8/389: rename d4/d8/d1c/d48/d62 to d4/d8/d37/d57/d7d 0 2024-04-12T09:11:29.349 INFO:tasks.workunit.client.1.smithi203.stdout:8/390: write d4/d8/f24 [2886055,4694] 0 2024-04-12T09:11:29.350 INFO:tasks.workunit.client.0.smithi117.stdout:9/894: getdents d1/d8/df/d1b 0 2024-04-12T09:11:29.350 INFO:tasks.workunit.client.0.smithi117.stdout:7/830: write d0/d2/d45/d15/f25 [4322787,18917] 0 2024-04-12T09:11:29.350 INFO:tasks.workunit.client.1.smithi203.stdout:8/391: write d4/d8/d74/d78/f3a [4083397,50561] 0 2024-04-12T09:11:29.352 INFO:tasks.workunit.client.1.smithi203.stdout:5/498: link d0/d6/d11/d38/c5b d0/d6/d16/d8/cb7 0 2024-04-12T09:11:29.354 INFO:tasks.workunit.client.0.smithi117.stdout:2/918: write d0/df/ff1 [691661,4832] 0 2024-04-12T09:11:29.355 INFO:tasks.workunit.client.0.smithi117.stdout:9/895: read d1/d24/f6a [655014,60743] 0 2024-04-12T09:11:29.356 INFO:tasks.workunit.client.1.smithi203.stdout:8/392: dwrite d4/f2d [0,4194304] 0 2024-04-12T09:11:29.359 INFO:tasks.workunit.client.1.smithi203.stdout:2/438: link d0/d2e/c4d d0/d3/d47/ca0 0 2024-04-12T09:11:29.360 INFO:tasks.workunit.client.0.smithi117.stdout:2/919: symlink d0/d43/d4b/dae/dd5/l12e 0 2024-04-12T09:11:29.363 INFO:tasks.workunit.client.0.smithi117.stdout:6/952: dwrite d8/d2a/d60/fb4 [0,4194304] 0 2024-04-12T09:11:29.365 INFO:tasks.workunit.client.0.smithi117.stdout:7/831: write d0/f1b [462622,66728] 0 2024-04-12T09:11:29.365 INFO:tasks.workunit.client.0.smithi117.stdout:9/896: read - d1/d8/d90/fc0 zero size 2024-04-12T09:11:29.368 INFO:tasks.workunit.client.0.smithi117.stdout:2/920: creat d0/d43/d30/f12f x:0 0 0 2024-04-12T09:11:29.368 INFO:tasks.workunit.client.1.smithi203.stdout:6/385: symlink d1/d3/d26/d30/d4a/d6c/d45/l7e 0 2024-04-12T09:11:29.373 INFO:tasks.workunit.client.0.smithi117.stdout:9/897: dwrite d1/d8/d5a/d79/f96 [0,4194304] 0 2024-04-12T09:11:29.374 INFO:tasks.workunit.client.1.smithi203.stdout:5/499: symlink d0/d6/d11/d4a/lb8 0 2024-04-12T09:11:29.374 INFO:tasks.workunit.client.0.smithi117.stdout:2/921: dread d0/d43/d4b/dae/fd0 [0,4194304] 0 2024-04-12T09:11:29.376 INFO:tasks.workunit.client.1.smithi203.stdout:7/423: truncate d0/d38/d51/f7d 238132 0 2024-04-12T09:11:29.377 INFO:tasks.workunit.client.1.smithi203.stdout:8/393: dread f3 [0,4194304] 0 2024-04-12T09:11:29.377 INFO:tasks.workunit.client.0.smithi117.stdout:6/953: link d8/d2a/d60/d89/fbb d8/d2a/d60/d89/d99/f12b 0 2024-04-12T09:11:29.378 INFO:tasks.workunit.client.1.smithi203.stdout:8/394: chown d4/d8/d74/d78/f27 5693420 1 2024-04-12T09:11:29.378 INFO:tasks.workunit.client.1.smithi203.stdout:5/500: dread d0/f4 [0,4194304] 0 2024-04-12T09:11:29.379 INFO:tasks.workunit.client.1.smithi203.stdout:8/395: truncate d4/f66 913541 0 2024-04-12T09:11:29.380 INFO:tasks.workunit.client.1.smithi203.stdout:2/439: mkdir d0/d14/d1e/d57/da1 0 2024-04-12T09:11:29.381 INFO:tasks.workunit.client.1.smithi203.stdout:5/501: dread d0/d6/d11/d18/f40 [4194304,4194304] 0 2024-04-12T09:11:29.381 INFO:tasks.workunit.client.1.smithi203.stdout:5/502: stat d0/f66 0 2024-04-12T09:11:29.381 INFO:tasks.workunit.client.0.smithi117.stdout:9/898: mknod d1/d8/dd5/c11f 0 2024-04-12T09:11:29.383 INFO:tasks.workunit.client.0.smithi117.stdout:6/954: read d8/d2a/d60/d7d/f112 [1746638,65415] 0 2024-04-12T09:11:29.384 INFO:tasks.workunit.client.1.smithi203.stdout:6/386: symlink d1/df/d1b/d3e/l7f 0 2024-04-12T09:11:29.386 INFO:tasks.workunit.client.0.smithi117.stdout:7/832: getdents d0/d2/d45/d17 0 2024-04-12T09:11:29.390 INFO:tasks.workunit.client.0.smithi117.stdout:9/899: unlink d1/d8/df/d3e/d92/dce/ld2 0 2024-04-12T09:11:29.391 INFO:tasks.workunit.client.0.smithi117.stdout:6/955: creat d8/d2a/d60/d89/f12c x:0 0 0 2024-04-12T09:11:29.392 INFO:tasks.workunit.client.1.smithi203.stdout:8/396: rmdir d4/d8/d37/d57 39 2024-04-12T09:11:29.393 INFO:tasks.workunit.client.0.smithi117.stdout:6/956: truncate d8/d3a/d49/da4/ffa 1455610 0 2024-04-12T09:11:29.395 INFO:tasks.workunit.client.1.smithi203.stdout:2/440: creat d0/d54/d61/d78/d89/fa2 x:0 0 0 2024-04-12T09:11:29.396 INFO:tasks.workunit.client.1.smithi203.stdout:5/503: symlink d0/d6/d16/d9/d30/d58/lb9 0 2024-04-12T09:11:29.397 INFO:tasks.workunit.client.1.smithi203.stdout:5/504: chown d0/d6/d16/d9/d30/d58/d74 64427 1 2024-04-12T09:11:29.398 INFO:tasks.workunit.client.0.smithi117.stdout:9/900: truncate d1/d8/d5e/d9f/fbd 2472788 0 2024-04-12T09:11:29.399 INFO:tasks.workunit.client.1.smithi203.stdout:5/505: read - d0/d6/d11/d1e/d4c/d48/fb5 zero size 2024-04-12T09:11:29.399 INFO:tasks.workunit.client.0.smithi117.stdout:9/901: readlink d1/d8/d5a/d6e/d71/l74 0 2024-04-12T09:11:29.400 INFO:tasks.workunit.client.0.smithi117.stdout:6/957: rename d8/d9/d17/d33/l36 to d8/d3a/d49/da4/d8a/de2/l12d 0 2024-04-12T09:11:29.401 INFO:tasks.workunit.client.0.smithi117.stdout:6/958: write d8/d9/fdc [3667231,54143] 0 2024-04-12T09:11:29.403 INFO:tasks.workunit.client.1.smithi203.stdout:4/425: write fb [1002846,124583] 0 2024-04-12T09:11:29.404 INFO:tasks.workunit.client.1.smithi203.stdout:0/450: sync 2024-04-12T09:11:29.406 INFO:tasks.workunit.client.0.smithi117.stdout:9/902: mknod d1/d8/d5e/d9f/d115/c120 0 2024-04-12T09:11:29.408 INFO:tasks.workunit.client.0.smithi117.stdout:6/959: creat d8/d9/d17/d33/d101/d97/f12e x:0 0 0 2024-04-12T09:11:29.408 INFO:tasks.workunit.client.0.smithi117.stdout:2/922: write d0/d43/d30/d41/fbf [560620,90011] 0 2024-04-12T09:11:29.410 INFO:tasks.workunit.client.1.smithi203.stdout:6/387: symlink d1/l80 0 2024-04-12T09:11:29.411 INFO:tasks.workunit.client.1.smithi203.stdout:6/388: chown d1/d3/d4/l75 95 1 2024-04-12T09:11:29.412 INFO:tasks.workunit.client.0.smithi117.stdout:7/833: dread d0/d2/d45/f28 [4194304,4194304] 0 2024-04-12T09:11:29.412 INFO:tasks.workunit.client.0.smithi117.stdout:9/903: rename d1/d8/d12/c10b to d1/d8/df/da2/dbf/c121 0 2024-04-12T09:11:29.416 INFO:tasks.workunit.client.1.smithi203.stdout:7/424: write d0/d38/d51/f7d [633341,97127] 0 2024-04-12T09:11:29.419 INFO:tasks.workunit.client.1.smithi203.stdout:0/451: write d0/d1d/d2f/d4c/f4f [2503841,19869] 0 2024-04-12T09:11:29.421 INFO:tasks.workunit.client.0.smithi117.stdout:2/923: truncate d0/d4/d10/d27/d9a/f113 1855159 0 2024-04-12T09:11:29.422 INFO:tasks.workunit.client.1.smithi203.stdout:2/441: creat d0/d14/d1e/d57/d95/fa3 x:0 0 0 2024-04-12T09:11:29.422 INFO:tasks.workunit.client.0.smithi117.stdout:7/834: symlink d0/da/d9b/d108/l10b 0 2024-04-12T09:11:29.423 INFO:tasks.workunit.client.1.smithi203.stdout:6/389: creat d1/d3/d26/d30/f81 x:0 0 0 2024-04-12T09:11:29.425 INFO:tasks.workunit.client.1.smithi203.stdout:6/390: read d1/d3/d26/d30/d4a/d6c/d45/d55/f71 [894165,51993] 0 2024-04-12T09:11:29.426 INFO:tasks.workunit.client.1.smithi203.stdout:6/391: dread - d1/d3/d5b/f6d zero size 2024-04-12T09:11:29.428 INFO:tasks.workunit.client.1.smithi203.stdout:7/425: write d0/f40 [3365095,50831] 0 2024-04-12T09:11:29.429 INFO:tasks.workunit.client.1.smithi203.stdout:7/426: chown d0/d4/d54/d75/f9a 89 1 2024-04-12T09:11:29.429 INFO:tasks.workunit.client.1.smithi203.stdout:0/452: mkdir d0/dd/d5b/d90 0 2024-04-12T09:11:29.430 INFO:tasks.workunit.client.0.smithi117.stdout:7/835: dwrite d0/d2/d45/d17/d23/d39/d6c/fc1 [0,4194304] 0 2024-04-12T09:11:29.431 INFO:tasks.workunit.client.1.smithi203.stdout:8/397: link d4/d8/d1c/f30 d4/d8/d74/d78/f7e 0 2024-04-12T09:11:29.433 INFO:tasks.workunit.client.1.smithi203.stdout:8/398: read d4/d8/f38 [1207389,76342] 0 2024-04-12T09:11:29.433 INFO:tasks.workunit.client.1.smithi203.stdout:0/453: dread d0/d48/d5e/d84/f8b [0,4194304] 0 2024-04-12T09:11:29.434 INFO:tasks.workunit.client.0.smithi117.stdout:6/960: dwrite d8/d9/d39/fdb [0,4194304] 0 2024-04-12T09:11:29.437 INFO:tasks.workunit.client.1.smithi203.stdout:5/506: write d0/d6/d11/d1e/f45 [535665,129604] 0 2024-04-12T09:11:29.439 INFO:tasks.workunit.client.0.smithi117.stdout:7/836: rename d0/da/d9b/df4 to d0/d2/d45/d17/d23/dac/dad/daa/d10c 0 2024-04-12T09:11:29.442 INFO:tasks.workunit.client.0.smithi117.stdout:6/961: fsync d8/d9/d39/f8d 0 2024-04-12T09:11:29.448 INFO:tasks.workunit.client.0.smithi117.stdout:6/962: truncate d8/d2a/d60/d7d/d8c/db8/fd7 982916 0 2024-04-12T09:11:29.450 INFO:tasks.workunit.client.1.smithi203.stdout:2/442: truncate d0/fc 1439117 0 2024-04-12T09:11:29.450 INFO:tasks.workunit.client.1.smithi203.stdout:7/427: dread d0/f2 [0,4194304] 0 2024-04-12T09:11:29.451 INFO:tasks.workunit.client.0.smithi117.stdout:6/963: creat d8/d2a/d60/d7d/d8c/f12f x:0 0 0 2024-04-12T09:11:29.452 INFO:tasks.workunit.client.1.smithi203.stdout:0/454: creat d0/d59/f91 x:0 0 0 2024-04-12T09:11:29.452 INFO:tasks.workunit.client.0.smithi117.stdout:6/964: chown d8/d9/d17/d33/d101/f88 346367014 1 2024-04-12T09:11:29.453 INFO:tasks.workunit.client.1.smithi203.stdout:0/455: dread - d0/dd/d71/f85 zero size 2024-04-12T09:11:29.454 INFO:tasks.workunit.client.1.smithi203.stdout:4/426: getdents d1a/d21 0 2024-04-12T09:11:29.454 INFO:tasks.workunit.client.1.smithi203.stdout:4/427: chown l3 121 1 2024-04-12T09:11:29.455 INFO:tasks.workunit.client.0.smithi117.stdout:6/965: creat d8/d2a/d60/d7d/d8c/d107/f130 x:0 0 0 2024-04-12T09:11:29.455 INFO:tasks.workunit.client.0.smithi117.stdout:6/966: fdatasync d8/d3f/faa 0 2024-04-12T09:11:29.457 INFO:tasks.workunit.client.1.smithi203.stdout:8/399: symlink d4/d8/d1c/d48/l7f 0 2024-04-12T09:11:29.460 INFO:tasks.workunit.client.1.smithi203.stdout:0/456: rename d0/d48/l54 to d0/d1d/d2f/d4c/l92 0 2024-04-12T09:11:29.462 INFO:tasks.workunit.client.1.smithi203.stdout:4/428: creat d1a/d21/d22/d4e/f8a x:0 0 0 2024-04-12T09:11:29.464 INFO:tasks.workunit.client.0.smithi117.stdout:7/837: write d0/da/fc9 [623575,54180] 0 2024-04-12T09:11:29.465 INFO:tasks.workunit.client.0.smithi117.stdout:7/838: chown d0/da/d9b/f10a 6102408 1 2024-04-12T09:11:29.466 INFO:tasks.workunit.client.0.smithi117.stdout:7/839: write d0/d2/d45/d17/d23/d39/d6c/fc1 [2519856,45192] 0 2024-04-12T09:11:29.467 INFO:tasks.workunit.client.1.smithi203.stdout:1/483: sync 2024-04-12T09:11:29.467 INFO:tasks.workunit.client.0.smithi117.stdout:6/967: dread d8/f1e [0,4194304] 0 2024-04-12T09:11:29.468 INFO:tasks.workunit.client.1.smithi203.stdout:6/392: dwrite d1/d3/f62 [0,4194304] 0 2024-04-12T09:11:29.469 INFO:tasks.workunit.client.1.smithi203.stdout:1/484: chown df/d2d/d6f/d75/d80/d54/c64 480 1 2024-04-12T09:11:29.470 INFO:tasks.workunit.client.1.smithi203.stdout:6/393: stat d1/d3/d26/d30/d4a/d6c/d45/d55/c68 0 2024-04-12T09:11:29.471 INFO:tasks.workunit.client.1.smithi203.stdout:6/394: chown d1/d3/f1a 0 1 2024-04-12T09:11:29.473 INFO:tasks.workunit.client.0.smithi117.stdout:7/840: creat d0/d20/d4a/dce/dcf/f10d x:0 0 0 2024-04-12T09:11:29.473 INFO:tasks.workunit.client.1.smithi203.stdout:6/395: write d1/d3/d26/d30/d4a/d6c/d45/d55/f7b [66438,50502] 0 2024-04-12T09:11:29.476 INFO:tasks.workunit.client.1.smithi203.stdout:2/443: write d0/d14/d1e/d2a/f60 [530950,15588] 0 2024-04-12T09:11:29.477 INFO:tasks.workunit.client.0.smithi117.stdout:7/841: creat d0/d2/d45/d17/d23/dac/dad/daa/f10e x:0 0 0 2024-04-12T09:11:29.477 INFO:tasks.workunit.client.1.smithi203.stdout:2/444: read - d0/d54/d61/d78/f81 zero size 2024-04-12T09:11:29.478 INFO:tasks.workunit.client.1.smithi203.stdout:5/507: getdents d0/d6/d16/d9/d14 0 2024-04-12T09:11:29.479 INFO:tasks.workunit.client.1.smithi203.stdout:5/508: chown d0/d6/d16/d9/d14/d2d/c77 191457077 1 2024-04-12T09:11:29.480 INFO:tasks.workunit.client.0.smithi117.stdout:7/842: rename d0/d2/d45/lc0 to d0/d2/d45/da1/l10f 0 2024-04-12T09:11:29.481 INFO:tasks.workunit.client.0.smithi117.stdout:7/843: write d0/f1b [291364,58847] 0 2024-04-12T09:11:29.482 INFO:tasks.workunit.client.1.smithi203.stdout:1/485: fdatasync df/d2d/d6f/f7c 0 2024-04-12T09:11:29.482 INFO:tasks.workunit.client.0.smithi117.stdout:7/844: chown d0/d2/d45/d53/d58 10175341 1 2024-04-12T09:11:29.483 INFO:tasks.workunit.client.0.smithi117.stdout:6/968: creat d8/f131 x:0 0 0 2024-04-12T09:11:29.484 INFO:tasks.workunit.client.1.smithi203.stdout:7/428: truncate d0/d4/d1c/d3b/f3f 681057 0 2024-04-12T09:11:29.485 INFO:tasks.workunit.client.1.smithi203.stdout:6/396: creat d1/d3/d26/d5d/f82 x:0 0 0 2024-04-12T09:11:29.485 INFO:tasks.workunit.client.1.smithi203.stdout:7/429: write d0/d4/d1c/d5b/f65 [281523,121016] 0 2024-04-12T09:11:29.485 INFO:tasks.workunit.client.1.smithi203.stdout:4/429: write d1a/d2b/f80 [706305,58202] 0 2024-04-12T09:11:29.487 INFO:tasks.workunit.client.1.smithi203.stdout:8/400: truncate d4/d8/f50 1658278 0 2024-04-12T09:11:29.491 INFO:tasks.workunit.client.1.smithi203.stdout:5/509: symlink d0/d6/d11/d4a/lba 0 2024-04-12T09:11:29.492 INFO:tasks.workunit.client.1.smithi203.stdout:1/486: fdatasync df/d2d/d6f/d75/d80/d54/f3b 0 2024-04-12T09:11:29.493 INFO:tasks.workunit.client.1.smithi203.stdout:3/386: sync 2024-04-12T09:11:29.493 INFO:tasks.workunit.client.1.smithi203.stdout:9/374: sync 2024-04-12T09:11:29.494 INFO:tasks.workunit.client.1.smithi203.stdout:6/397: creat d1/d3/d12/f83 x:0 0 0 2024-04-12T09:11:29.495 INFO:tasks.workunit.client.1.smithi203.stdout:0/457: getdents d0/d48/d5e/d84 0 2024-04-12T09:11:29.496 INFO:tasks.workunit.client.0.smithi117.stdout:7/845: link d0/d2/d45/d53/d58/c81 d0/c110 0 2024-04-12T09:11:29.498 INFO:tasks.workunit.client.1.smithi203.stdout:4/430: mkdir d1a/d21/d22/d2e/d8b 0 2024-04-12T09:11:29.498 INFO:tasks.workunit.client.1.smithi203.stdout:0/458: readlink d0/d1d/l3a 0 2024-04-12T09:11:29.500 INFO:tasks.workunit.client.0.smithi117.stdout:7/846: mkdir d0/d2/d45/d17/d23/d39/dbd/d111 0 2024-04-12T09:11:29.503 INFO:tasks.workunit.client.1.smithi203.stdout:5/510: dread d0/d6/d11/d18/f32 [4194304,4194304] 0 2024-04-12T09:11:29.504 INFO:tasks.workunit.client.0.smithi117.stdout:6/969: dwrite d8/d9/d39/f8e [0,4194304] 0 2024-04-12T09:11:29.505 INFO:tasks.workunit.client.1.smithi203.stdout:1/487: dwrite df/d2d/d6f/d75/d80/d54/d5d/f4d [0,4194304] 0 2024-04-12T09:11:29.508 INFO:tasks.workunit.client.1.smithi203.stdout:3/387: dwrite d2/d8/d14/d23/d35/d4c/d67/f72 [0,4194304] 0 2024-04-12T09:11:29.509 INFO:tasks.workunit.client.0.smithi117.stdout:6/970: creat d8/d2a/d60/d89/dea/f132 x:0 0 0 2024-04-12T09:11:29.510 INFO:tasks.workunit.client.1.smithi203.stdout:9/375: write d8/d12/d23/d85/f8b [3880920,90509] 0 2024-04-12T09:11:29.511 INFO:tasks.workunit.client.1.smithi203.stdout:6/398: creat d1/d3/d12/f84 x:0 0 0 2024-04-12T09:11:29.512 INFO:tasks.workunit.client.1.smithi203.stdout:3/388: readlink d2/d8/d14/d23/l3c 0 2024-04-12T09:11:29.513 INFO:tasks.workunit.client.1.smithi203.stdout:7/430: mknod d0/d4/d54/da0/ca1 0 2024-04-12T09:11:29.514 INFO:tasks.workunit.client.1.smithi203.stdout:2/445: truncate d0/d14/d23/d3d/f91 135055 0 2024-04-12T09:11:29.514 INFO:tasks.workunit.client.1.smithi203.stdout:1/488: read - df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/f81 zero size 2024-04-12T09:11:29.515 INFO:tasks.workunit.client.1.smithi203.stdout:4/431: dwrite d1a/d21/d60/f77 [0,4194304] 0 2024-04-12T09:11:29.518 INFO:tasks.workunit.client.1.smithi203.stdout:4/432: fdatasync d1a/d21/d22/d2e/f43 0 2024-04-12T09:11:29.519 INFO:tasks.workunit.client.1.smithi203.stdout:2/446: write d0/d14/d1e/f2b [3359113,88550] 0 2024-04-12T09:11:29.519 INFO:tasks.workunit.client.1.smithi203.stdout:0/459: creat d0/dd/d5b/f93 x:0 0 0 2024-04-12T09:11:29.521 INFO:tasks.workunit.client.1.smithi203.stdout:2/447: truncate d0/d14/d1e/d2a/f90 250559 0 2024-04-12T09:11:29.524 INFO:tasks.workunit.client.1.smithi203.stdout:4/433: dread d1a/d20/f3d [0,4194304] 0 2024-04-12T09:11:29.528 INFO:tasks.workunit.client.0.smithi117.stdout:6/971: write d8/d3a/d49/da4/d8a/de2/df3/f114 [159983,27427] 0 2024-04-12T09:11:29.531 INFO:tasks.workunit.client.1.smithi203.stdout:4/434: dwrite d1a/d20/f3d [0,4194304] 0 2024-04-12T09:11:29.534 INFO:tasks.workunit.client.1.smithi203.stdout:4/435: chown fb 308915 1 2024-04-12T09:11:29.535 INFO:tasks.workunit.client.1.smithi203.stdout:3/389: creat d2/d8/d14/d23/d35/d4c/d5c/f7d x:0 0 0 2024-04-12T09:11:29.535 INFO:tasks.workunit.client.0.smithi117.stdout:6/972: dwrite d8/d2a/df6/f11a [0,4194304] 0 2024-04-12T09:11:29.537 INFO:tasks.workunit.client.0.smithi117.stdout:6/973: write d8/d9/d17/d33/d101/f88 [5767832,107492] 0 2024-04-12T09:11:29.538 INFO:tasks.workunit.client.1.smithi203.stdout:7/431: dwrite d0/d34/d7c/f80 [0,4194304] 0 2024-04-12T09:11:29.539 INFO:tasks.workunit.client.1.smithi203.stdout:2/448: symlink d0/d38/d43/la4 0 2024-04-12T09:11:29.540 INFO:tasks.workunit.client.1.smithi203.stdout:1/489: creat df/d2d/d6f/d75/d80/d54/d5d/d58/d94/f97 x:0 0 0 2024-04-12T09:11:29.546 INFO:tasks.workunit.client.0.smithi117.stdout:6/974: unlink d8/d9/f40 0 2024-04-12T09:11:29.546 INFO:tasks.workunit.client.0.smithi117.stdout:6/975: chown d8/d2a/d60/fa1 1308 1 2024-04-12T09:11:29.547 INFO:tasks.workunit.client.1.smithi203.stdout:4/436: symlink d1a/d20/d5d/l8c 0 2024-04-12T09:11:29.548 INFO:tasks.workunit.client.1.smithi203.stdout:7/432: symlink d0/d38/d51/la2 0 2024-04-12T09:11:29.548 INFO:tasks.workunit.client.1.smithi203.stdout:7/433: write d0/d38/f9c [709827,1812] 0 2024-04-12T09:11:29.549 INFO:tasks.workunit.client.1.smithi203.stdout:5/511: rename d0/d6/d16/d9/d86/f8f to d0/fbb 0 2024-04-12T09:11:29.550 INFO:tasks.workunit.client.0.smithi117.stdout:6/976: creat d8/d2a/df6/f133 x:0 0 0 2024-04-12T09:11:29.551 INFO:tasks.workunit.client.1.smithi203.stdout:2/449: readlink d0/lf 0 2024-04-12T09:11:29.552 INFO:tasks.workunit.client.0.smithi117.stdout:6/977: fdatasync d8/d9/fb 0 2024-04-12T09:11:29.553 INFO:tasks.workunit.client.1.smithi203.stdout:8/401: getdents d4/d8/d1c/d48/d5e 0 2024-04-12T09:11:29.553 INFO:tasks.workunit.client.0.smithi117.stdout:6/978: truncate d8/d2a/d60/d7d/d8c/deb/f124 5039885 0 2024-04-12T09:11:29.554 INFO:tasks.workunit.client.1.smithi203.stdout:4/437: mkdir d1a/d21/d22/d2e/d8d 0 2024-04-12T09:11:29.554 INFO:tasks.workunit.client.1.smithi203.stdout:7/434: creat d0/d4/d1c/d3b/d4c/fa3 x:0 0 0 2024-04-12T09:11:29.554 INFO:tasks.workunit.client.1.smithi203.stdout:0/460: dwrite d0/f2c [0,4194304] 0 2024-04-12T09:11:29.556 INFO:tasks.workunit.client.1.smithi203.stdout:1/490: mknod df/d2d/c98 0 2024-04-12T09:11:29.561 INFO:tasks.workunit.client.1.smithi203.stdout:7/435: dwrite d0/d15/d2d/f4b [0,4194304] 0 2024-04-12T09:11:29.563 INFO:tasks.workunit.client.1.smithi203.stdout:7/436: truncate d0/d4/d1c/d3b/d4c/f55 1772718 0 2024-04-12T09:11:29.566 INFO:tasks.workunit.client.1.smithi203.stdout:8/402: rmdir d4/d8/d1c/d48 39 2024-04-12T09:11:29.569 INFO:tasks.workunit.client.1.smithi203.stdout:5/512: link d0/d6/d16/d8/f62 d0/d6/d16/d9/d14/d2d/fbc 0 2024-04-12T09:11:29.571 INFO:tasks.workunit.client.1.smithi203.stdout:4/438: mknod d1a/d21/d60/d68/c8e 0 2024-04-12T09:11:29.579 INFO:tasks.workunit.client.1.smithi203.stdout:0/461: rename d0/d1d to d0/dd/d71/d94 0 2024-04-12T09:11:29.580 INFO:tasks.workunit.client.0.smithi117.stdout:6/979: link d8/d2a/d60/l74 d8/d3a/dc8/l134 0 2024-04-12T09:11:29.580 INFO:tasks.workunit.client.1.smithi203.stdout:7/437: dread - d0/d4/d1c/f3a zero size 2024-04-12T09:11:29.582 INFO:tasks.workunit.client.0.smithi117.stdout:6/980: rmdir d8/d2a/d60/d89/da2 39 2024-04-12T09:11:29.586 INFO:tasks.workunit.client.1.smithi203.stdout:5/513: dread d0/d6/f93 [0,4194304] 0 2024-04-12T09:11:29.588 INFO:tasks.workunit.client.0.smithi117.stdout:6/981: creat d8/d9/d17/d2d/d10e/d111/f135 x:0 0 0 2024-04-12T09:11:29.590 INFO:tasks.workunit.client.0.smithi117.stdout:6/982: symlink d8/d9/d17/d2d/l136 0 2024-04-12T09:11:29.595 INFO:tasks.workunit.client.0.smithi117.stdout:6/983: fsync d8/d9/d17/d33/d101/d97/f128 0 2024-04-12T09:11:29.595 INFO:tasks.workunit.client.0.smithi117.stdout:6/984: truncate d8/d2a/d60/d7d/d8c/f113 237657 0 2024-04-12T09:11:29.595 INFO:tasks.workunit.client.0.smithi117.stdout:6/985: chown d8/d3a/dc8/l134 63 1 2024-04-12T09:11:29.595 INFO:tasks.workunit.client.1.smithi203.stdout:4/439: link d1a/d20/d5d/l47 d1a/d20/d5d/d2c/d72/l8f 0 2024-04-12T09:11:29.595 INFO:tasks.workunit.client.1.smithi203.stdout:4/440: truncate d1a/d21/d22/f6a 2018695 0 2024-04-12T09:11:29.595 INFO:tasks.workunit.client.1.smithi203.stdout:1/491: rename df/d2d/d6f/d75/d80/d2b/f51 to df/f99 0 2024-04-12T09:11:29.595 INFO:tasks.workunit.client.1.smithi203.stdout:5/514: mkdir d0/dbd 0 2024-04-12T09:11:29.596 INFO:tasks.workunit.client.1.smithi203.stdout:5/515: write d0/d6/d11/d4a/f5a [844725,54924] 0 2024-04-12T09:11:29.596 INFO:tasks.workunit.client.1.smithi203.stdout:1/492: rmdir df/d2d/d6f/d75/d80/d8c 39 2024-04-12T09:11:29.598 INFO:tasks.workunit.client.0.smithi117.stdout:6/986: mknod d8/d3a/d49/c137 0 2024-04-12T09:11:29.600 INFO:tasks.workunit.client.1.smithi203.stdout:4/441: rename d1a/d20/d5d/l47 to d1a/d20/d5d/l90 0 2024-04-12T09:11:29.600 INFO:tasks.workunit.client.1.smithi203.stdout:5/516: rmdir d0/d6/d16/d9/d86 39 2024-04-12T09:11:29.601 INFO:tasks.workunit.client.1.smithi203.stdout:8/403: dread d4/d8/d74/d78/f3a [0,4194304] 0 2024-04-12T09:11:29.602 INFO:tasks.workunit.client.0.smithi117.stdout:6/987: link d8/d2a/d60/d89/dea/l11b d8/d3a/l138 0 2024-04-12T09:11:29.602 INFO:tasks.workunit.client.1.smithi203.stdout:7/438: dread d0/d4/f92 [0,4194304] 0 2024-04-12T09:11:29.603 INFO:tasks.workunit.client.0.smithi117.stdout:6/988: mknod d8/d2a/d60/d7d/d8c/deb/c139 0 2024-04-12T09:11:29.603 INFO:tasks.workunit.client.1.smithi203.stdout:4/442: write d1a/d21/d60/f89 [558411,72860] 0 2024-04-12T09:11:29.604 INFO:tasks.workunit.client.1.smithi203.stdout:0/462: dread d0/f3 [0,4194304] 0 2024-04-12T09:11:29.605 INFO:tasks.workunit.client.0.smithi117.stdout:6/989: creat d8/d9/d39/d79/f13a x:0 0 0 2024-04-12T09:11:29.605 INFO:tasks.workunit.client.1.smithi203.stdout:7/439: dread - d0/d4/d1c/f3a zero size 2024-04-12T09:11:29.605 INFO:tasks.workunit.client.1.smithi203.stdout:1/493: dwrite df/f33 [0,4194304] 0 2024-04-12T09:11:29.607 INFO:tasks.workunit.client.0.smithi117.stdout:6/990: symlink d8/d2a/d6e/l13b 0 2024-04-12T09:11:29.608 INFO:tasks.workunit.client.1.smithi203.stdout:5/517: symlink d0/d6/d16/d9/d30/d89/lbe 0 2024-04-12T09:11:29.609 INFO:tasks.workunit.client.0.smithi117.stdout:6/991: read d8/d3a/d49/f83 [6928528,15647] 0 2024-04-12T09:11:29.609 INFO:tasks.workunit.client.1.smithi203.stdout:4/443: mknod d1a/d21/d22/d2e/c91 0 2024-04-12T09:11:29.610 INFO:tasks.workunit.client.1.smithi203.stdout:1/494: creat df/d2d/d6f/f9a x:0 0 0 2024-04-12T09:11:29.610 INFO:tasks.workunit.client.1.smithi203.stdout:4/444: write d1a/d21/d60/f89 [1521168,40898] 0 2024-04-12T09:11:29.614 INFO:tasks.workunit.client.1.smithi203.stdout:7/440: rename d0/d4/d1c/d5b/f64 to d0/d38/d51/fa4 0 2024-04-12T09:11:29.615 INFO:tasks.workunit.client.1.smithi203.stdout:4/445: dread d1a/d21/d60/f77 [0,4194304] 0 2024-04-12T09:11:29.616 INFO:tasks.workunit.client.1.smithi203.stdout:5/518: mkdir d0/d6/d16/d9/d30/d58/d74/d88/dbf 0 2024-04-12T09:11:29.618 INFO:tasks.workunit.client.1.smithi203.stdout:0/463: dread d0/dd/d71/d94/f5f [0,4194304] 0 2024-04-12T09:11:29.623 INFO:tasks.workunit.client.1.smithi203.stdout:7/441: creat d0/d4/d53/fa5 x:0 0 0 2024-04-12T09:11:29.624 INFO:tasks.workunit.client.1.smithi203.stdout:4/446: creat d1a/d1d/d69/f92 x:0 0 0 2024-04-12T09:11:29.625 INFO:tasks.workunit.client.0.smithi117.stdout:6/992: getdents d8/d9/d17/d2d 0 2024-04-12T09:11:29.626 INFO:tasks.workunit.client.1.smithi203.stdout:8/404: write d4/d8/d74/d78/f27 [1062324,8356] 0 2024-04-12T09:11:29.627 INFO:tasks.workunit.client.1.smithi203.stdout:0/464: creat d0/dd/d5b/f95 x:0 0 0 2024-04-12T09:11:29.631 INFO:tasks.workunit.client.0.smithi117.stdout:6/993: dwrite d8/d3f/fd6 [0,4194304] 0 2024-04-12T09:11:29.632 INFO:tasks.workunit.client.0.smithi117.stdout:6/994: dread - d8/d3a/d49/da4/df8/d10b/f11c zero size 2024-04-12T09:11:29.633 INFO:tasks.workunit.client.1.smithi203.stdout:4/447: mknod d1a/d1d/c93 0 2024-04-12T09:11:29.634 INFO:tasks.workunit.client.1.smithi203.stdout:4/448: write d1a/d21/f5c [934709,83483] 0 2024-04-12T09:11:29.635 INFO:tasks.workunit.client.0.smithi117.stdout:6/995: mknod d8/d9/d17/d2d/d10e/c13c 0 2024-04-12T09:11:29.636 INFO:tasks.workunit.client.1.smithi203.stdout:0/465: mknod d0/dd/d40/c96 0 2024-04-12T09:11:29.637 INFO:tasks.workunit.client.1.smithi203.stdout:1/495: rmdir df/d2d/d6f/d75/d80/d54/d8f 0 2024-04-12T09:11:29.639 INFO:tasks.workunit.client.0.smithi117.stdout:6/996: mknod d8/d2a/d60/d89/dfe/c13d 0 2024-04-12T09:11:29.641 INFO:tasks.workunit.client.1.smithi203.stdout:5/519: link d0/d6/d11/d18/d1a/d23/fa9 d0/d6/d16/d9/d80/fc0 0 2024-04-12T09:11:29.641 INFO:tasks.workunit.client.1.smithi203.stdout:8/405: creat d4/d34/d79/f80 x:0 0 0 2024-04-12T09:11:29.642 INFO:tasks.workunit.client.1.smithi203.stdout:4/449: dwrite fb [0,4194304] 0 2024-04-12T09:11:29.642 INFO:tasks.workunit.client.0.smithi117.stdout:6/997: truncate d8/d2a/d60/d106/f65 2504699 0 2024-04-12T09:11:29.644 INFO:tasks.workunit.client.1.smithi203.stdout:9/376: sync 2024-04-12T09:11:29.644 INFO:tasks.workunit.client.1.smithi203.stdout:4/450: write d1a/d34/f35 [2629895,23376] 0 2024-04-12T09:11:29.646 INFO:tasks.workunit.client.0.smithi117.stdout:6/998: mknod d8/d9/d17/d33/c13e 0 2024-04-12T09:11:29.646 INFO:tasks.workunit.client.0.smithi117.stdout:6/999: readlink d8/d2a/l59 0 2024-04-12T09:11:29.647 INFO:tasks.workunit.client.1.smithi203.stdout:7/442: link d0/d4/d1c/d3b/f3f d0/d4/d1c/d3b/d4c/fa6 0 2024-04-12T09:11:29.649 INFO:tasks.workunit.client.1.smithi203.stdout:8/406: dread d4/d34/f47 [0,4194304] 0 2024-04-12T09:11:29.649 INFO:tasks.workunit.client.1.smithi203.stdout:0/466: dread d0/f13 [0,4194304] 0 2024-04-12T09:11:29.652 INFO:tasks.workunit.client.1.smithi203.stdout:1/496: mkdir df/d2d/d6f/d75/d80/d8c/d8e/d9b 0 2024-04-12T09:11:29.652 INFO:tasks.workunit.client.1.smithi203.stdout:4/451: mknod d1a/d1d/d69/d76/c94 0 2024-04-12T09:11:29.652 INFO:tasks.workunit.client.1.smithi203.stdout:1/497: fsync df/f76 0 2024-04-12T09:11:29.653 INFO:tasks.workunit.client.1.smithi203.stdout:7/443: creat d0/d38/d79/fa7 x:0 0 0 2024-04-12T09:11:29.653 INFO:tasks.workunit.client.1.smithi203.stdout:4/452: chown d1a/d21/f5c 22897 1 2024-04-12T09:11:29.655 INFO:tasks.workunit.client.1.smithi203.stdout:4/453: dread - d1a/d21/d22/d4e/f83 zero size 2024-04-12T09:11:29.657 INFO:tasks.workunit.client.1.smithi203.stdout:5/520: dread d0/d6/d11/d1e/f45 [0,4194304] 0 2024-04-12T09:11:29.658 INFO:tasks.workunit.client.1.smithi203.stdout:7/444: dread d0/d38/d51/f7d [0,4194304] 0 2024-04-12T09:11:29.659 INFO:tasks.workunit.client.1.smithi203.stdout:1/498: dread df/d2d/d6f/d75/d80/d54/f46 [0,4194304] 0 2024-04-12T09:11:29.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:29 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:29.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:29 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:29.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:29 smithi117 ceph-mon[29277]: Reconfiguring alertmanager.smithi117 (dependencies changed)... 2024-04-12T09:11:29.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:29 smithi117 ceph-mon[29277]: Reconfiguring daemon alertmanager.smithi117 on smithi117 2024-04-12T09:11:29.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:29 smithi117 ceph-mon[29277]: pgmap v25: 65 pgs: 65 active+clean; 2.5 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 47 MiB/s rd, 175 MiB/s wr, 335 op/s 2024-04-12T09:11:29.661 INFO:tasks.workunit.client.1.smithi203.stdout:1/499: write df/f5b [438718,87190] 0 2024-04-12T09:11:29.661 INFO:tasks.workunit.client.1.smithi203.stdout:1/500: readlink df/l3a 0 2024-04-12T09:11:29.662 INFO:tasks.workunit.client.1.smithi203.stdout:5/521: dread d0/d6/d11/d1e/fb0 [0,4194304] 0 2024-04-12T09:11:29.676 INFO:tasks.workunit.client.1.smithi203.stdout:2/450: sync 2024-04-12T09:11:29.677 INFO:tasks.workunit.client.1.smithi203.stdout:3/390: sync 2024-04-12T09:11:29.677 INFO:tasks.workunit.client.1.smithi203.stdout:6/399: sync 2024-04-12T09:11:29.678 INFO:tasks.workunit.client.1.smithi203.stdout:3/391: read - d2/d8/d14/d23/d35/f73 zero size 2024-04-12T09:11:29.682 INFO:tasks.workunit.client.1.smithi203.stdout:2/451: dwrite d0/d67/f75 [4194304,4194304] 0 2024-04-12T09:11:29.691 INFO:tasks.workunit.client.1.smithi203.stdout:3/392: dread d2/d8/d14/d1b/f48 [4194304,4194304] 0 2024-04-12T09:11:29.766 INFO:tasks.workunit.client.0.smithi117.stdout:4/969: sync 2024-04-12T09:11:29.768 INFO:tasks.workunit.client.0.smithi117.stdout:4/970: write d0/d5/d25/dfd/d107/daf/f130 [242205,71222] 0 2024-04-12T09:11:29.813 INFO:tasks.workunit.client.1.smithi203.stdout:7/445: rename d0/d4/d1c/d3b/c47 to d0/d4/ca8 0 2024-04-12T09:11:29.816 INFO:tasks.workunit.client.1.smithi203.stdout:7/446: dread d0/d15/d2d/f4b [0,4194304] 0 2024-04-12T09:11:29.818 INFO:tasks.workunit.client.1.smithi203.stdout:1/501: creat df/d2d/d6f/d75/d80/d54/d5d/f9c x:0 0 0 2024-04-12T09:11:29.822 INFO:tasks.workunit.client.1.smithi203.stdout:5/522: write d0/d6/d16/d9/d86/f9f [908881,92009] 0 2024-04-12T09:11:29.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:29 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:29.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:29 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:29.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:29 smithi203 ceph-mon[36428]: Reconfiguring alertmanager.smithi117 (dependencies changed)... 2024-04-12T09:11:29.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:29 smithi203 ceph-mon[36428]: Reconfiguring daemon alertmanager.smithi117 on smithi117 2024-04-12T09:11:29.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:29 smithi203 ceph-mon[36428]: pgmap v25: 65 pgs: 65 active+clean; 2.5 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 47 MiB/s rd, 175 MiB/s wr, 335 op/s 2024-04-12T09:11:29.826 INFO:tasks.workunit.client.1.smithi203.stdout:3/393: write d2/d51/d65/f77 [153188,130803] 0 2024-04-12T09:11:29.827 INFO:tasks.workunit.client.0.smithi117.stdout:4/971: link d0/d5/d3b/d38/d4f/d79/d9c/ca8 d0/d5/d25/dfd/d107/daf/c13d 0 2024-04-12T09:11:29.828 INFO:tasks.workunit.client.1.smithi203.stdout:3/394: dread - d2/d64/f6f zero size 2024-04-12T09:11:29.829 INFO:tasks.workunit.client.1.smithi203.stdout:4/454: symlink d1a/d21/d22/l95 0 2024-04-12T09:11:29.831 INFO:tasks.workunit.client.1.smithi203.stdout:3/395: fdatasync d2/d8/d14/d23/d35/d4c/d5c/f63 0 2024-04-12T09:11:29.831 INFO:tasks.workunit.client.0.smithi117.stdout:4/972: symlink d0/d5/d25/dfd/d107/daf/l13e 0 2024-04-12T09:11:29.832 INFO:tasks.workunit.client.1.smithi203.stdout:9/377: dwrite d8/d3b/d6f/d74/d8e/d2c/d5d/f61 [0,4194304] 0 2024-04-12T09:11:29.834 INFO:tasks.workunit.client.1.smithi203.stdout:2/452: rename d0/l1f to d0/d3/d47/la5 0 2024-04-12T09:11:29.841 INFO:tasks.workunit.client.1.smithi203.stdout:0/467: write d0/dd/d71/d94/d2f/d17/fa [4219022,87616] 0 2024-04-12T09:11:29.844 INFO:tasks.workunit.client.1.smithi203.stdout:7/447: mknod d0/d15/d2d/ca9 0 2024-04-12T09:11:29.844 INFO:tasks.workunit.client.1.smithi203.stdout:8/407: dwrite d4/d8/d1c/f31 [0,4194304] 0 2024-04-12T09:11:29.846 INFO:tasks.workunit.client.1.smithi203.stdout:5/523: dread d0/d6/d16/d9/d30/f6f [0,4194304] 0 2024-04-12T09:11:29.848 INFO:tasks.workunit.client.1.smithi203.stdout:5/524: write d0/d6/d16/d9/d30/d58/fa6 [908625,94165] 0 2024-04-12T09:11:29.849 INFO:tasks.workunit.client.1.smithi203.stdout:3/396: symlink d2/d64/l7e 0 2024-04-12T09:11:29.849 INFO:tasks.workunit.client.1.smithi203.stdout:9/378: rmdir d8/d3b 39 2024-04-12T09:11:29.852 INFO:tasks.workunit.client.1.smithi203.stdout:2/453: unlink d0/d3/d47/c4a 0 2024-04-12T09:11:29.852 INFO:tasks.workunit.client.1.smithi203.stdout:2/454: dread - d0/d54/f69 zero size 2024-04-12T09:11:29.857 INFO:tasks.workunit.client.1.smithi203.stdout:8/408: unlink d4/d8/d37/f3e 0 2024-04-12T09:11:29.858 INFO:tasks.workunit.client.1.smithi203.stdout:4/455: symlink d1a/d21/d22/l96 0 2024-04-12T09:11:29.858 INFO:tasks.workunit.client.1.smithi203.stdout:5/525: dwrite d0/d6/d16/d9/d30/d58/d74/d88/f97 [0,4194304] 0 2024-04-12T09:11:29.859 INFO:tasks.workunit.client.1.smithi203.stdout:3/397: readlink d2/d8/l3b 0 2024-04-12T09:11:29.864 INFO:tasks.workunit.client.1.smithi203.stdout:8/409: mkdir d4/d8/d81 0 2024-04-12T09:11:29.865 INFO:tasks.workunit.client.0.smithi117.stdout:4/973: write d0/d5/d39/d4e/d6b/d83/fad [1166444,17403] 0 2024-04-12T09:11:29.866 INFO:tasks.workunit.client.1.smithi203.stdout:5/526: truncate d0/f66 5186933 0 2024-04-12T09:11:29.867 INFO:tasks.workunit.client.1.smithi203.stdout:2/455: dwrite d0/d3/d47/f73 [0,4194304] 0 2024-04-12T09:11:29.868 INFO:tasks.workunit.client.1.smithi203.stdout:8/410: chown d4/f66 2777579 1 2024-04-12T09:11:29.868 INFO:tasks.workunit.client.1.smithi203.stdout:6/400: truncate d1/d3/f27 921666 0 2024-04-12T09:11:29.871 INFO:tasks.workunit.client.1.smithi203.stdout:7/448: dread d0/d4/d54/d75/f9a [0,4194304] 0 2024-04-12T09:11:29.872 INFO:tasks.workunit.client.1.smithi203.stdout:9/379: link d8/d3b/d6f/d74/f7f d8/d12/d23/d38/f91 0 2024-04-12T09:11:29.873 INFO:tasks.workunit.client.1.smithi203.stdout:2/456: symlink d0/d19/la6 0 2024-04-12T09:11:29.875 INFO:tasks.workunit.client.1.smithi203.stdout:4/456: dwrite d1a/d21/d22/d2e/f43 [0,4194304] 0 2024-04-12T09:11:29.875 INFO:tasks.workunit.client.1.smithi203.stdout:7/449: write d0/d4/f57 [2074993,69330] 0 2024-04-12T09:11:29.878 INFO:tasks.workunit.client.1.smithi203.stdout:8/411: dwrite d4/d8/f24 [0,4194304] 0 2024-04-12T09:11:29.878 INFO:tasks.workunit.client.1.smithi203.stdout:0/468: write d0/dd/d71/d94/f32 [1354886,100333] 0 2024-04-12T09:11:29.880 INFO:tasks.workunit.client.1.smithi203.stdout:5/527: creat d0/d6/d16/d9/d30/d58/d74/d88/dbf/fc1 x:0 0 0 2024-04-12T09:11:29.882 INFO:tasks.workunit.client.1.smithi203.stdout:7/450: dread d0/d4/d54/d75/f9a [0,4194304] 0 2024-04-12T09:11:29.884 INFO:tasks.workunit.client.1.smithi203.stdout:6/401: rename d1/df/c24 to d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d3a/c85 0 2024-04-12T09:11:29.885 INFO:tasks.workunit.client.1.smithi203.stdout:4/457: symlink d1a/d20/l97 0 2024-04-12T09:11:29.886 INFO:tasks.workunit.client.0.smithi117.stdout:4/974: write d0/d5/d3b/d38/d4f/d79/d9c/fec [261829,5239] 0 2024-04-12T09:11:29.886 INFO:tasks.workunit.client.1.smithi203.stdout:6/402: stat d1/d3/d26/d5d/f67 0 2024-04-12T09:11:29.887 INFO:tasks.workunit.client.1.smithi203.stdout:4/458: fdatasync d1a/d21/d22/d4e/f8a 0 2024-04-12T09:11:29.888 INFO:tasks.workunit.client.1.smithi203.stdout:0/469: stat d0/dd/f1b 0 2024-04-12T09:11:29.888 INFO:tasks.workunit.client.1.smithi203.stdout:7/451: creat d0/d4/d1c/faa x:0 0 0 2024-04-12T09:11:29.892 INFO:tasks.workunit.client.1.smithi203.stdout:4/459: creat d1a/d21/f98 x:0 0 0 2024-04-12T09:11:29.895 INFO:tasks.workunit.client.1.smithi203.stdout:8/412: rename d4/d8/d74/d78/f7e to d4/d8/d1c/f82 0 2024-04-12T09:11:29.897 INFO:tasks.workunit.client.1.smithi203.stdout:7/452: link d0/d4/d5d/f9e d0/d4/d54/d75/fab 0 2024-04-12T09:11:29.898 INFO:tasks.workunit.client.1.smithi203.stdout:8/413: chown d4/d8/d74/d78/d53 212273 1 2024-04-12T09:11:29.899 INFO:tasks.workunit.client.1.smithi203.stdout:0/470: link d0/dd/f46 d0/dd/d71/d94/d2f/d4c/f97 0 2024-04-12T09:11:29.900 INFO:tasks.workunit.client.1.smithi203.stdout:5/528: rename d0/d6/d11/d1e/c49 to d0/d6/d16/d9/d30/d58/d74/d88/cc2 0 2024-04-12T09:11:29.901 INFO:tasks.workunit.client.1.smithi203.stdout:4/460: dwrite d1a/d20/d5f/f7a [0,4194304] 0 2024-04-12T09:11:29.902 INFO:tasks.workunit.client.1.smithi203.stdout:0/471: write d0/dd/d71/d94/f5f [1628073,13249] 0 2024-04-12T09:11:29.903 INFO:tasks.workunit.client.1.smithi203.stdout:7/453: mkdir d0/d4/d54/dac 0 2024-04-12T09:11:29.908 INFO:tasks.workunit.client.1.smithi203.stdout:0/472: mkdir d0/dd/d71/d94/d2f/d34/d98 0 2024-04-12T09:11:29.916 INFO:tasks.workunit.client.1.smithi203.stdout:8/414: truncate f3 3460151 0 2024-04-12T09:11:29.922 INFO:tasks.workunit.client.1.smithi203.stdout:7/454: write d0/d15/d2d/d5e/d8c/f74 [3665907,23793] 0 2024-04-12T09:11:29.922 INFO:tasks.workunit.client.1.smithi203.stdout:6/403: dwrite d1/df/f6b [0,4194304] 0 2024-04-12T09:11:29.922 INFO:tasks.workunit.client.1.smithi203.stdout:2/457: dwrite d0/d3/f17 [0,4194304] 0 2024-04-12T09:11:29.930 INFO:tasks.workunit.client.1.smithi203.stdout:6/404: readlink d1/d3/d26/d30/d4a/d6c/l5f 0 2024-04-12T09:11:29.932 INFO:tasks.workunit.client.1.smithi203.stdout:7/455: mknod d0/d34/d7c/cad 0 2024-04-12T09:11:29.933 INFO:tasks.workunit.client.1.smithi203.stdout:4/461: dwrite d1a/d21/d60/f7f [0,4194304] 0 2024-04-12T09:11:29.936 INFO:tasks.workunit.client.1.smithi203.stdout:8/415: rename l0 to d4/d8/d37/d57/d7d/l83 0 2024-04-12T09:11:29.937 INFO:tasks.workunit.client.1.smithi203.stdout:0/473: dread d0/dd/d71/d94/d2f/d4c/f4f [0,4194304] 0 2024-04-12T09:11:29.939 INFO:tasks.workunit.client.1.smithi203.stdout:2/458: write d0/f1a [7316377,86567] 0 2024-04-12T09:11:29.940 INFO:tasks.workunit.client.1.smithi203.stdout:5/529: dwrite d0/d6/d16/d9/f24 [4194304,4194304] 0 2024-04-12T09:11:29.940 INFO:tasks.workunit.client.1.smithi203.stdout:6/405: truncate d1/d3/f25 1252160 0 2024-04-12T09:11:29.945 INFO:tasks.workunit.client.1.smithi203.stdout:2/459: fsync d0/fc 0 2024-04-12T09:11:29.948 INFO:tasks.workunit.client.1.smithi203.stdout:7/456: dwrite d0/d38/f9c [0,4194304] 0 2024-04-12T09:11:29.950 INFO:tasks.workunit.client.1.smithi203.stdout:6/406: creat d1/df/d65/f86 x:0 0 0 2024-04-12T09:11:29.952 INFO:tasks.workunit.client.1.smithi203.stdout:6/407: chown d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d3a 5347 1 2024-04-12T09:11:29.953 INFO:tasks.workunit.client.1.smithi203.stdout:5/530: link d0/d6/d16/d9/d30/d58/d74/d88/dbf/fc1 d0/d6/d16/d9/d30/d58/d74/fc3 0 2024-04-12T09:11:29.955 INFO:tasks.workunit.client.1.smithi203.stdout:7/457: read d0/d4/d1c/f35 [2485261,37921] 0 2024-04-12T09:11:29.958 INFO:tasks.workunit.client.1.smithi203.stdout:2/460: dwrite d0/d3/f5f [4194304,4194304] 0 2024-04-12T09:11:29.958 INFO:tasks.workunit.client.1.smithi203.stdout:6/408: rename d1/d3/d26/d30/d4a/d74 to d1/df/d87 0 2024-04-12T09:11:29.959 INFO:tasks.workunit.client.1.smithi203.stdout:5/531: symlink d0/d6/d11/d18/d2a/lc4 0 2024-04-12T09:11:29.960 INFO:tasks.workunit.client.1.smithi203.stdout:2/461: readlink d0/l28 0 2024-04-12T09:11:29.961 INFO:tasks.workunit.client.1.smithi203.stdout:2/462: mknod d0/d19/ca7 0 2024-04-12T09:11:29.962 INFO:tasks.workunit.client.1.smithi203.stdout:7/458: link d0/d15/d2d/d5e/l8a d0/d4/d54/d75/lae 0 2024-04-12T09:11:29.964 INFO:tasks.workunit.client.1.smithi203.stdout:2/463: write d0/d2e/f71 [105052,41694] 0 2024-04-12T09:11:29.966 INFO:tasks.workunit.client.1.smithi203.stdout:7/459: write d0/d4/d5d/f86 [274294,9282] 0 2024-04-12T09:11:29.966 INFO:tasks.workunit.client.1.smithi203.stdout:6/409: link d1/d3/d26/d30/d4a/d6c/f5a d1/d3/d4/f88 0 2024-04-12T09:11:29.969 INFO:tasks.workunit.client.1.smithi203.stdout:4/462: truncate f5 10942475 0 2024-04-12T09:11:29.970 INFO:tasks.workunit.client.1.smithi203.stdout:6/410: mkdir d1/df/d89 0 2024-04-12T09:11:29.971 INFO:tasks.workunit.client.1.smithi203.stdout:2/464: creat d0/d14/d8a/fa8 x:0 0 0 2024-04-12T09:11:29.974 INFO:tasks.workunit.client.1.smithi203.stdout:5/532: dwrite d0/d6/d16/d9/d30/d58/d74/fc3 [0,4194304] 0 2024-04-12T09:11:29.974 INFO:tasks.workunit.client.1.smithi203.stdout:6/411: truncate d1/d3/d26/d30/f81 793892 0 2024-04-12T09:11:29.976 INFO:tasks.workunit.client.1.smithi203.stdout:4/463: read d1a/d21/d22/d4e/f52 [528140,66239] 0 2024-04-12T09:11:29.978 INFO:tasks.workunit.client.1.smithi203.stdout:1/502: sync 2024-04-12T09:11:29.979 INFO:tasks.workunit.client.1.smithi203.stdout:6/412: read d1/d3/d26/d30/d4a/d6c/f40 [4373704,121317] 0 2024-04-12T09:11:29.979 INFO:tasks.workunit.client.1.smithi203.stdout:2/465: rename d0/d54/d61/d78/c42 to d0/d38/d43/ca9 0 2024-04-12T09:11:29.979 INFO:tasks.workunit.client.1.smithi203.stdout:5/533: mknod d0/d6/d11/d38/cc5 0 2024-04-12T09:11:29.982 INFO:tasks.workunit.client.1.smithi203.stdout:2/466: write d0/f18 [2843229,22812] 0 2024-04-12T09:11:29.985 INFO:tasks.workunit.client.1.smithi203.stdout:5/534: mknod d0/d6/d16/d9/d30/d89/cc6 0 2024-04-12T09:11:29.985 INFO:tasks.workunit.client.1.smithi203.stdout:2/467: write d0/d14/d1e/f48 [1045426,7528] 0 2024-04-12T09:11:29.987 INFO:tasks.workunit.client.1.smithi203.stdout:0/474: dread d0/dd/d71/d94/d2f/d17/d19/f26 [0,4194304] 0 2024-04-12T09:11:29.988 INFO:tasks.workunit.client.1.smithi203.stdout:1/503: rename df/d2d/d6f/f7c to df/d2d/d6f/d75/d80/d54/f9d 0 2024-04-12T09:11:29.993 INFO:tasks.workunit.client.1.smithi203.stdout:2/468: rename d0/d14/d8a/fa8 to d0/d14/d74/d96/d9a/faa 0 2024-04-12T09:11:29.996 INFO:tasks.workunit.client.1.smithi203.stdout:7/460: write d0/d15/d2d/f4b [4571462,94718] 0 2024-04-12T09:11:29.997 INFO:tasks.workunit.client.1.smithi203.stdout:7/461: read - d0/d4/d54/d75/fab zero size 2024-04-12T09:11:29.999 INFO:tasks.workunit.client.1.smithi203.stdout:1/504: dread df/f2a [0,4194304] 0 2024-04-12T09:11:30.002 INFO:tasks.workunit.client.1.smithi203.stdout:2/469: rename d0/d14/d23/d33/l53 to d0/d14/d23/d33/lab 0 2024-04-12T09:11:30.002 INFO:tasks.workunit.client.1.smithi203.stdout:2/470: read d0/d54/d61/f79 [1631899,117221] 0 2024-04-12T09:11:30.003 INFO:tasks.workunit.client.1.smithi203.stdout:6/413: truncate d1/d3/d12/f5e 1854728 0 2024-04-12T09:11:30.005 INFO:tasks.workunit.client.1.smithi203.stdout:1/505: creat df/d2d/d6f/d75/f9e x:0 0 0 2024-04-12T09:11:30.006 INFO:tasks.workunit.client.1.smithi203.stdout:7/462: dwrite d0/d4/d53/fa5 [0,4194304] 0 2024-04-12T09:11:30.007 INFO:tasks.workunit.client.1.smithi203.stdout:0/475: write d0/dd/d71/d94/d2f/d17/d19/d6f/d78/f8a [1025277,73871] 0 2024-04-12T09:11:30.010 INFO:tasks.workunit.client.1.smithi203.stdout:2/471: rename d0/d2e/f93 to d0/d38/d43/d9c/fac 0 2024-04-12T09:11:30.012 INFO:tasks.workunit.client.1.smithi203.stdout:4/464: dwrite d1a/d21/d22/d2e/f4b [0,4194304] 0 2024-04-12T09:11:30.012 INFO:tasks.workunit.client.1.smithi203.stdout:0/476: readlink d0/dd/d71/d94/l3a 0 2024-04-12T09:11:30.012 INFO:tasks.workunit.client.1.smithi203.stdout:1/506: readlink df/d2d/d6f/d75/d80/d2b/l55 0 2024-04-12T09:11:30.013 INFO:tasks.workunit.client.1.smithi203.stdout:6/414: rmdir d1/d3/d26/d30/d4a/d6c 39 2024-04-12T09:11:30.014 INFO:tasks.workunit.client.1.smithi203.stdout:4/465: fsync d1a/d1d/f55 0 2024-04-12T09:11:30.015 INFO:tasks.workunit.client.1.smithi203.stdout:7/463: symlink d0/d4/d54/da0/laf 0 2024-04-12T09:11:30.019 INFO:tasks.workunit.client.1.smithi203.stdout:5/535: dwrite d0/d6/d11/d1e/d4c/f8c [0,4194304] 0 2024-04-12T09:11:30.019 INFO:tasks.workunit.client.1.smithi203.stdout:0/477: write d0/dd/d71/d94/d2f/d17/d19/f73 [689217,35433] 0 2024-04-12T09:11:30.021 INFO:tasks.workunit.client.1.smithi203.stdout:7/464: truncate d0/d4/d53/f7e 1025456 0 2024-04-12T09:11:30.021 INFO:tasks.workunit.client.1.smithi203.stdout:5/536: fsync d0/d6/d16/d9/d30/fa7 0 2024-04-12T09:11:30.022 INFO:tasks.workunit.client.1.smithi203.stdout:6/415: truncate d1/d3/d26/d30/d4a/f6f 1603792 0 2024-04-12T09:11:30.024 INFO:tasks.workunit.client.1.smithi203.stdout:1/507: fsync df/d2d/d6f/d75/d80/d2b/f44 0 2024-04-12T09:11:30.027 INFO:tasks.workunit.client.1.smithi203.stdout:7/465: creat d0/d4/d1c/d3b/fb0 x:0 0 0 2024-04-12T09:11:30.027 INFO:tasks.workunit.client.1.smithi203.stdout:7/466: fdatasync d0/d4/f11 0 2024-04-12T09:11:30.029 INFO:tasks.workunit.client.1.smithi203.stdout:5/537: rmdir d0/d6/d16/d9/d14/d2d 39 2024-04-12T09:11:30.029 INFO:tasks.workunit.client.1.smithi203.stdout:5/538: stat d0/d6/d11/d1e/d4c/f8c 0 2024-04-12T09:11:30.030 INFO:tasks.workunit.client.1.smithi203.stdout:6/416: read d1/d3/d26/d30/d4a/d6c/d45/f52 [100306,48534] 0 2024-04-12T09:11:30.031 INFO:tasks.workunit.client.1.smithi203.stdout:4/466: creat d1a/d21/d22/d2e/d8b/f99 x:0 0 0 2024-04-12T09:11:30.036 INFO:tasks.workunit.client.1.smithi203.stdout:2/472: rename d0/d2e to d0/d54/dad 0 2024-04-12T09:11:30.037 INFO:tasks.workunit.client.1.smithi203.stdout:7/467: mknod d0/d4/d54/cb1 0 2024-04-12T09:11:30.037 INFO:tasks.workunit.client.1.smithi203.stdout:2/473: truncate d0/d38/d43/f94 312951 0 2024-04-12T09:11:30.043 INFO:tasks.workunit.client.1.smithi203.stdout:4/467: dwrite d1a/d21/f31 [0,4194304] 0 2024-04-12T09:11:30.044 INFO:tasks.workunit.client.1.smithi203.stdout:1/508: rename df/f3f to df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/d88/f9f 0 2024-04-12T09:11:30.048 INFO:tasks.workunit.client.1.smithi203.stdout:5/539: creat d0/dbd/fc7 x:0 0 0 2024-04-12T09:11:30.049 INFO:tasks.workunit.client.1.smithi203.stdout:2/474: chown d0/d14/d23/d3d/c59 1851 1 2024-04-12T09:11:30.050 INFO:tasks.workunit.client.1.smithi203.stdout:0/478: dwrite d0/f3 [0,4194304] 0 2024-04-12T09:11:30.054 INFO:tasks.workunit.client.1.smithi203.stdout:2/475: truncate d0/d3/d47/f73 4851328 0 2024-04-12T09:11:30.054 INFO:tasks.workunit.client.1.smithi203.stdout:4/468: chown le 66028 1 2024-04-12T09:11:30.055 INFO:tasks.workunit.client.1.smithi203.stdout:6/417: link d1/d3/d26/d30/d4a/d6c/d45/d55/c68 d1/df/d87/d7a/c8a 0 2024-04-12T09:11:30.055 INFO:tasks.workunit.client.1.smithi203.stdout:3/398: sync 2024-04-12T09:11:30.056 INFO:tasks.workunit.client.1.smithi203.stdout:5/540: read d0/d6/d16/d9/d30/d58/d74/fa3 [63331,99625] 0 2024-04-12T09:11:30.057 INFO:tasks.workunit.client.1.smithi203.stdout:7/468: dwrite d0/d4/d54/d75/f9a [0,4194304] 0 2024-04-12T09:11:30.060 INFO:tasks.workunit.client.1.smithi203.stdout:7/469: stat d0/d4/lb 0 2024-04-12T09:11:30.064 INFO:tasks.workunit.client.1.smithi203.stdout:4/469: creat d1a/d1d/d69/f9a x:0 0 0 2024-04-12T09:11:30.068 INFO:tasks.workunit.client.0.smithi117.stdout:7/847: sync 2024-04-12T09:11:30.068 INFO:tasks.workunit.client.0.smithi117.stdout:2/924: sync 2024-04-12T09:11:30.068 INFO:tasks.workunit.client.0.smithi117.stdout:9/904: sync 2024-04-12T09:11:30.073 INFO:tasks.workunit.client.0.smithi117.stdout:9/905: unlink d1/d8/d52/f100 0 2024-04-12T09:11:30.074 INFO:tasks.workunit.client.0.smithi117.stdout:9/906: write d1/d8/d5e/d9f/ff0 [90804,111635] 0 2024-04-12T09:11:30.075 INFO:tasks.workunit.client.0.smithi117.stdout:7/848: dwrite d0/d20/d4a/dce/dcf/f10d [0,4194304] 0 2024-04-12T09:11:30.077 INFO:tasks.workunit.client.0.smithi117.stdout:9/907: dread - d1/d8/d5a/d79/d91/db0/d8a/ffc zero size 2024-04-12T09:11:30.078 INFO:tasks.workunit.client.0.smithi117.stdout:7/849: readlink d0/d2/d45/d17/d23/dac/dad/d91/l93 0 2024-04-12T09:11:30.079 INFO:tasks.workunit.client.0.smithi117.stdout:7/850: read - d0/d2/d45/d17/d23/ffe zero size 2024-04-12T09:11:30.091 INFO:tasks.workunit.client.0.smithi117.stdout:7/851: dread d0/d2/d45/d17/d7a/fe0 [0,4194304] 0 2024-04-12T09:11:30.093 INFO:tasks.workunit.client.0.smithi117.stdout:7/852: rmdir d0 39 2024-04-12T09:11:30.094 INFO:tasks.workunit.client.0.smithi117.stdout:7/853: readlink d0/d2/d12/l97 0 2024-04-12T09:11:30.096 INFO:tasks.workunit.client.0.smithi117.stdout:7/854: creat d0/da/d9b/f112 x:0 0 0 2024-04-12T09:11:30.097 INFO:tasks.workunit.client.0.smithi117.stdout:9/908: write d1/d8/df/d68/fc7 [119502,128767] 0 2024-04-12T09:11:30.100 INFO:tasks.workunit.client.0.smithi117.stdout:9/909: chown d1/d8/df/d3e/d92/l10e 3178 1 2024-04-12T09:11:30.101 INFO:tasks.workunit.client.0.smithi117.stdout:2/925: dwrite d0/d43/d53/d61/d8d/ff5 [0,4194304] 0 2024-04-12T09:11:30.102 INFO:tasks.workunit.client.0.smithi117.stdout:2/926: chown d0/d4/d10/f19 1018854 1 2024-04-12T09:11:30.103 INFO:tasks.workunit.client.0.smithi117.stdout:7/855: write d0/d2/d1a/d49/f62 [195388,57088] 0 2024-04-12T09:11:30.104 INFO:tasks.workunit.client.0.smithi117.stdout:9/910: rename d1/d8/d12/l60 to d1/d8/d5a/d6e/d71/l122 0 2024-04-12T09:11:30.105 INFO:tasks.workunit.client.0.smithi117.stdout:2/927: mknod d0/d43/d53/d61/d8d/d109/c130 0 2024-04-12T09:11:30.106 INFO:tasks.workunit.client.0.smithi117.stdout:2/928: chown d0/d43/da5/d8f 30 1 2024-04-12T09:11:30.109 INFO:tasks.workunit.client.0.smithi117.stdout:9/911: dread d1/f4 [0,4194304] 0 2024-04-12T09:11:30.109 INFO:tasks.workunit.client.0.smithi117.stdout:7/856: rename d0/d2/d45/d17/d23/dac/dad/daa/f10e to d0/d2/d45/d17/d23/dac/f113 0 2024-04-12T09:11:30.111 INFO:tasks.workunit.client.0.smithi117.stdout:7/857: write d0/d2/d45/d15/f25 [2392591,68869] 0 2024-04-12T09:11:30.112 INFO:tasks.workunit.client.0.smithi117.stdout:9/912: mkdir d1/d8/d90/d11a/d123 0 2024-04-12T09:11:30.117 INFO:tasks.workunit.client.0.smithi117.stdout:9/913: dwrite d1/d24/fcc [0,4194304] 0 2024-04-12T09:11:30.119 INFO:tasks.workunit.client.0.smithi117.stdout:9/914: chown d1/d8/d5a/d79/d91/lc5 193 1 2024-04-12T09:11:30.120 INFO:tasks.workunit.client.0.smithi117.stdout:9/915: read d1/f61 [2886957,11830] 0 2024-04-12T09:11:30.122 INFO:tasks.workunit.client.0.smithi117.stdout:9/916: symlink d1/d8/d5e/l124 0 2024-04-12T09:11:30.123 INFO:tasks.workunit.client.0.smithi117.stdout:9/917: symlink d1/d8/df/d3e/dea/l125 0 2024-04-12T09:11:30.125 INFO:tasks.workunit.client.0.smithi117.stdout:9/918: symlink d1/d8/d5e/d9f/l126 0 2024-04-12T09:11:30.126 INFO:tasks.workunit.client.0.smithi117.stdout:9/919: dread - d1/d8/d5e/fd3 zero size 2024-04-12T09:11:30.126 INFO:tasks.workunit.client.0.smithi117.stdout:2/929: write d0/d43/d53/d61/d8d/fdd [70606,21980] 0 2024-04-12T09:11:30.127 INFO:tasks.workunit.client.0.smithi117.stdout:2/930: readlink d0/d43/d53/d61/ld3 0 2024-04-12T09:11:30.129 INFO:tasks.workunit.client.0.smithi117.stdout:9/920: write d1/d8/d5e/f6d [549547,101804] 0 2024-04-12T09:11:30.130 INFO:tasks.workunit.client.0.smithi117.stdout:2/931: write d0/d43/d30/dc6/fea [1431254,5222] 0 2024-04-12T09:11:30.133 INFO:tasks.workunit.client.0.smithi117.stdout:2/932: symlink d0/d43/d4b/dae/dd5/l131 0 2024-04-12T09:11:30.138 INFO:tasks.workunit.client.0.smithi117.stdout:7/858: dread d0/d2/d45/d17/d23/d50/f64 [0,4194304] 0 2024-04-12T09:11:30.142 INFO:tasks.workunit.client.1.smithi203.stdout:0/479: dwrite d0/d48/f69 [0,4194304] 0 2024-04-12T09:11:30.144 INFO:tasks.workunit.client.0.smithi117.stdout:9/921: truncate d1/d8/d5a/d79/fc9 1516614 0 2024-04-12T09:11:30.145 INFO:tasks.workunit.client.0.smithi117.stdout:2/933: write d0/d4/d81/f103 [664407,66680] 0 2024-04-12T09:11:30.147 INFO:tasks.workunit.client.1.smithi203.stdout:2/476: dwrite d0/d14/d74/f84 [0,4194304] 0 2024-04-12T09:11:30.148 INFO:tasks.workunit.client.0.smithi117.stdout:9/922: mkdir d1/d8/d90/d11a/d123/d127 0 2024-04-12T09:11:30.148 INFO:tasks.workunit.client.1.smithi203.stdout:5/541: write d0/f4 [1065944,66220] 0 2024-04-12T09:11:30.149 INFO:tasks.workunit.client.1.smithi203.stdout:7/470: rmdir d0/d4/d54/da0 39 2024-04-12T09:11:30.150 INFO:tasks.workunit.client.0.smithi117.stdout:9/923: write d1/d8/fb6 [76790,75537] 0 2024-04-12T09:11:30.151 INFO:tasks.workunit.client.1.smithi203.stdout:2/477: fsync d0/f1a 0 2024-04-12T09:11:30.152 INFO:tasks.workunit.client.1.smithi203.stdout:5/542: fsync d0/dbd/fc7 0 2024-04-12T09:11:30.153 INFO:tasks.workunit.client.1.smithi203.stdout:3/399: dwrite d2/d8/d14/f4f [0,4194304] 0 2024-04-12T09:11:30.154 INFO:tasks.workunit.client.1.smithi203.stdout:4/470: mkdir d1a/d21/d22/d2e/d8d/d9b 0 2024-04-12T09:11:30.154 INFO:tasks.workunit.client.0.smithi117.stdout:2/934: dwrite d0/d43/d30/f12f [0,4194304] 0 2024-04-12T09:11:30.155 INFO:tasks.workunit.client.1.smithi203.stdout:3/400: readlink d2/d8/d14/d23/l3c 0 2024-04-12T09:11:30.156 INFO:tasks.workunit.client.0.smithi117.stdout:4/975: sync 2024-04-12T09:11:30.156 INFO:tasks.workunit.client.1.smithi203.stdout:7/471: rmdir d0/d4/d53 39 2024-04-12T09:11:30.157 INFO:tasks.workunit.client.0.smithi117.stdout:4/976: chown d0/d1/de9/dfe 2714 1 2024-04-12T09:11:30.157 INFO:tasks.workunit.client.1.smithi203.stdout:1/509: dwrite df/d2d/d6f/d75/d80/f26 [0,4194304] 0 2024-04-12T09:11:30.159 INFO:tasks.workunit.client.0.smithi117.stdout:9/924: fsync d1/d8/d52/f6c 0 2024-04-12T09:11:30.160 INFO:tasks.workunit.client.1.smithi203.stdout:2/478: write d0/d38/d43/d9c/fac [551135,75279] 0 2024-04-12T09:11:30.160 INFO:tasks.workunit.client.0.smithi117.stdout:9/925: chown d1/d8/d5e 46626045 1 2024-04-12T09:11:30.162 INFO:tasks.workunit.client.0.smithi117.stdout:9/926: dread d1/f4 [0,4194304] 0 2024-04-12T09:11:30.168 INFO:tasks.workunit.client.0.smithi117.stdout:7/859: dread d0/d2/d45/d17/f21 [0,4194304] 0 2024-04-12T09:11:30.168 INFO:tasks.workunit.client.1.smithi203.stdout:4/471: mkdir d1a/d1d/d9c 0 2024-04-12T09:11:30.170 INFO:tasks.workunit.client.0.smithi117.stdout:4/977: unlink d0/d5/c60 0 2024-04-12T09:11:30.176 INFO:tasks.workunit.client.0.smithi117.stdout:4/978: dwrite d0/d2c/f7b [0,4194304] 0 2024-04-12T09:11:30.177 INFO:tasks.workunit.client.1.smithi203.stdout:1/510: unlink df/d2d/d6f/d75/d80/d54/d5d/d4a/f53 0 2024-04-12T09:11:30.177 INFO:tasks.workunit.client.1.smithi203.stdout:0/480: dread d0/f4 [0,4194304] 0 2024-04-12T09:11:30.179 INFO:tasks.workunit.client.0.smithi117.stdout:2/935: creat d0/d4/d10/d27/d9a/d121/d112/f132 x:0 0 0 2024-04-12T09:11:30.183 INFO:tasks.workunit.client.0.smithi117.stdout:7/860: chown d0/d20/d4a/dfd/d9a/fe3 220 1 2024-04-12T09:11:30.183 INFO:tasks.workunit.client.0.smithi117.stdout:7/861: stat d0/d20/d4a/dce 0 2024-04-12T09:11:30.185 INFO:tasks.workunit.client.1.smithi203.stdout:4/472: symlink d1a/d1d/d69/l9d 0 2024-04-12T09:11:30.189 INFO:tasks.workunit.client.0.smithi117.stdout:2/936: rename d0/d4/c14 to d0/d43/d4b/dae/dd5/c133 0 2024-04-12T09:11:30.191 INFO:tasks.workunit.client.1.smithi203.stdout:1/511: chown df/d2d/l86 17990 1 2024-04-12T09:11:30.191 INFO:tasks.workunit.client.0.smithi117.stdout:4/979: read d0/d5/d3b/f97 [6704561,2068] 0 2024-04-12T09:11:30.191 INFO:tasks.workunit.client.0.smithi117.stdout:7/862: mkdir d0/d2/d45/d15/d114 0 2024-04-12T09:11:30.193 INFO:tasks.workunit.client.0.smithi117.stdout:7/863: dread - d0/d2/d45/d17/d23/dac/f113 zero size 2024-04-12T09:11:30.193 INFO:tasks.workunit.client.0.smithi117.stdout:9/927: creat d1/d8/df/d7d/f128 x:0 0 0 2024-04-12T09:11:30.194 INFO:tasks.workunit.client.1.smithi203.stdout:4/473: write d1a/d21/f5c [1611748,96541] 0 2024-04-12T09:11:30.196 INFO:tasks.workunit.client.1.smithi203.stdout:7/472: rename d0/d38/c4f to d0/d15/cb2 0 2024-04-12T09:11:30.197 INFO:tasks.workunit.client.0.smithi117.stdout:4/980: rename d0/d5/ca4 to d0/d5/d39/d4e/d6b/c13f 0 2024-04-12T09:11:30.197 INFO:tasks.workunit.client.1.smithi203.stdout:8/416: sync 2024-04-12T09:11:30.198 INFO:tasks.workunit.client.1.smithi203.stdout:9/380: sync 2024-04-12T09:11:30.198 INFO:tasks.workunit.client.0.smithi117.stdout:4/981: fdatasync d0/d5/d39/f23 0 2024-04-12T09:11:30.199 INFO:tasks.workunit.client.1.smithi203.stdout:9/381: stat f4 0 2024-04-12T09:11:30.199 INFO:tasks.workunit.client.0.smithi117.stdout:2/937: mknod d0/d43/d53/d61/d66/dd9/d108/c134 0 2024-04-12T09:11:30.199 INFO:tasks.workunit.client.0.smithi117.stdout:4/982: readlink d0/d5/d25/l2a 0 2024-04-12T09:11:30.199 INFO:tasks.workunit.client.0.smithi117.stdout:2/938: stat d0/d43/d30 0 2024-04-12T09:11:30.200 INFO:tasks.workunit.client.1.smithi203.stdout:9/382: fsync d8/d12/d23/d27/f32 0 2024-04-12T09:11:30.200 INFO:tasks.workunit.client.1.smithi203.stdout:9/383: stat d8/d80 0 2024-04-12T09:11:30.201 INFO:tasks.workunit.client.0.smithi117.stdout:4/983: read d0/d5/d25/dfd/d107/daf/f130 [166018,114090] 0 2024-04-12T09:11:30.202 INFO:tasks.workunit.client.0.smithi117.stdout:4/984: fsync d0/d1/de9/dfe/f96 0 2024-04-12T09:11:30.206 INFO:tasks.workunit.client.1.smithi203.stdout:2/479: getdents d0/d67 0 2024-04-12T09:11:30.207 INFO:tasks.workunit.client.0.smithi117.stdout:2/939: creat d0/d4/d10/d27/d9a/d121/d112/f135 x:0 0 0 2024-04-12T09:11:30.207 INFO:tasks.workunit.client.1.smithi203.stdout:2/480: truncate d0/d54/d61/d78/d89/f92 723117 0 2024-04-12T09:11:30.208 INFO:tasks.workunit.client.1.smithi203.stdout:2/481: chown d0/d54/d61/d78/d89 4630 1 2024-04-12T09:11:30.211 INFO:tasks.workunit.client.1.smithi203.stdout:5/543: write d0/fbb [1636144,84243] 0 2024-04-12T09:11:30.213 INFO:tasks.workunit.client.1.smithi203.stdout:7/473: creat d0/d4/d54/d8d/fb3 x:0 0 0 2024-04-12T09:11:30.213 INFO:tasks.workunit.client.0.smithi117.stdout:2/940: mkdir d0/d43/d4b/dae/dd5/d136 0 2024-04-12T09:11:30.215 INFO:tasks.workunit.client.1.smithi203.stdout:2/482: dwrite d0/d14/d23/d3d/f64 [0,4194304] 0 2024-04-12T09:11:30.215 INFO:tasks.workunit.client.1.smithi203.stdout:7/474: chown d0/d15/d2d/d5e/d8c/c6d 87177 1 2024-04-12T09:11:30.215 INFO:tasks.workunit.client.1.smithi203.stdout:8/417: mkdir d4/d8/d81/d84 0 2024-04-12T09:11:30.215 INFO:tasks.workunit.client.0.smithi117.stdout:2/941: read d0/d43/d30/dc6/fea [373082,91868] 0 2024-04-12T09:11:30.216 INFO:tasks.workunit.client.0.smithi117.stdout:2/942: fsync d0/d43/da5/d8f/fb6 0 2024-04-12T09:11:30.218 INFO:tasks.workunit.client.0.smithi117.stdout:4/985: mkdir d0/d5/d25/dfd/d107/da7/dcd/d140 0 2024-04-12T09:11:30.219 INFO:tasks.workunit.client.0.smithi117.stdout:4/986: rename d0 to d0/d2c/d3c/d10a/d141 22 2024-04-12T09:11:30.222 INFO:tasks.workunit.client.1.smithi203.stdout:9/384: truncate d8/f2a 679571 0 2024-04-12T09:11:30.223 INFO:tasks.workunit.client.0.smithi117.stdout:2/943: creat d0/d43/d30/dc6/f137 x:0 0 0 2024-04-12T09:11:30.224 INFO:tasks.workunit.client.1.smithi203.stdout:5/544: mkdir d0/d6/d11/d18/d2a/dc8 0 2024-04-12T09:11:30.227 INFO:tasks.workunit.client.0.smithi117.stdout:7/864: dwrite d0/d2/d45/d17/d23/d39/d6c/fa4 [0,4194304] 0 2024-04-12T09:11:30.227 INFO:tasks.workunit.client.1.smithi203.stdout:8/418: unlink d4/d8/d74/f76 0 2024-04-12T09:11:30.228 INFO:tasks.workunit.client.1.smithi203.stdout:4/474: dwrite d1a/d34/f46 [0,4194304] 0 2024-04-12T09:11:30.229 INFO:tasks.workunit.client.1.smithi203.stdout:4/475: read fb [137419,127066] 0 2024-04-12T09:11:30.229 INFO:tasks.workunit.client.0.smithi117.stdout:4/987: dread d0/d1/d34/fc1 [4194304,4194304] 0 2024-04-12T09:11:30.230 INFO:tasks.workunit.client.1.smithi203.stdout:7/475: mknod d0/d38/d79/cb4 0 2024-04-12T09:11:30.232 INFO:tasks.workunit.client.0.smithi117.stdout:9/928: dwrite d1/d8/df/d3e/d92/dce/fe8 [0,4194304] 0 2024-04-12T09:11:30.232 INFO:tasks.workunit.client.1.smithi203.stdout:1/512: write df/f6e [2976836,84511] 0 2024-04-12T09:11:30.233 INFO:tasks.workunit.client.1.smithi203.stdout:2/483: creat d0/d38/d43/d9c/fae x:0 0 0 2024-04-12T09:11:30.233 INFO:tasks.workunit.client.1.smithi203.stdout:1/513: dread - df/d2d/d6f/f9a zero size 2024-04-12T09:11:30.237 INFO:tasks.workunit.client.0.smithi117.stdout:7/865: creat d0/d2/d45/d15/f115 x:0 0 0 2024-04-12T09:11:30.237 INFO:tasks.workunit.client.0.smithi117.stdout:2/944: dwrite d0/d43/d30/f107 [0,4194304] 0 2024-04-12T09:11:30.240 INFO:tasks.workunit.client.0.smithi117.stdout:2/945: truncate d0/d43/d53/d61/f12a 954266 0 2024-04-12T09:11:30.243 INFO:tasks.workunit.client.1.smithi203.stdout:9/385: dread d8/d12/d23/f3a [0,4194304] 0 2024-04-12T09:11:30.243 INFO:tasks.workunit.client.0.smithi117.stdout:4/988: creat d0/d5/d25/d9f/d109/f142 x:0 0 0 2024-04-12T09:11:30.244 INFO:tasks.workunit.client.0.smithi117.stdout:9/929: write d1/d8/f10 [5899184,117657] 0 2024-04-12T09:11:30.246 INFO:tasks.workunit.client.1.smithi203.stdout:4/476: symlink d1a/d21/d22/d2e/d8b/l9e 0 2024-04-12T09:11:30.247 INFO:tasks.workunit.client.1.smithi203.stdout:7/476: rmdir d0/d4/d1c/d3b/d98 39 2024-04-12T09:11:30.248 INFO:tasks.workunit.client.1.smithi203.stdout:4/477: truncate d1a/d20/d5d/f84 981963 0 2024-04-12T09:11:30.250 INFO:tasks.workunit.client.0.smithi117.stdout:7/866: link d0/da/d7c/dae/faf d0/d2/d45/d17/d7a/f116 0 2024-04-12T09:11:30.251 INFO:tasks.workunit.client.0.smithi117.stdout:7/867: chown d0/d2/d45/d15/d114 54175 1 2024-04-12T09:11:30.253 INFO:tasks.workunit.client.0.smithi117.stdout:9/930: link d1/d8/fcb d1/d8/d5a/d6e/d71/f129 0 2024-04-12T09:11:30.254 INFO:tasks.workunit.client.0.smithi117.stdout:7/868: truncate d0/d2/d45/f28 4709047 0 2024-04-12T09:11:30.254 INFO:tasks.workunit.client.0.smithi117.stdout:4/989: dread d0/d2c/f31 [0,4194304] 0 2024-04-12T09:11:30.257 INFO:tasks.workunit.client.0.smithi117.stdout:9/931: creat d1/d8/d52/f12a x:0 0 0 2024-04-12T09:11:30.258 INFO:tasks.workunit.client.1.smithi203.stdout:2/484: dread d0/d14/d23/f50 [0,4194304] 0 2024-04-12T09:11:30.259 INFO:tasks.workunit.client.0.smithi117.stdout:4/990: creat d0/d5/d25/d9f/f143 x:0 0 0 2024-04-12T09:11:30.261 INFO:tasks.workunit.client.1.smithi203.stdout:4/478: creat d1a/d21/d60/d68/f9f x:0 0 0 2024-04-12T09:11:30.261 INFO:tasks.workunit.client.1.smithi203.stdout:4/479: fsync d1a/d21/d22/d4e/f8a 0 2024-04-12T09:11:30.262 INFO:tasks.workunit.client.1.smithi203.stdout:4/480: chown d1a/d21/d22/d2e/d8b 376265894 1 2024-04-12T09:11:30.262 INFO:tasks.workunit.client.1.smithi203.stdout:4/481: write d1a/d34/f35 [5089059,29905] 0 2024-04-12T09:11:30.264 INFO:tasks.workunit.client.0.smithi117.stdout:9/932: dwrite d1/ff2 [0,4194304] 0 2024-04-12T09:11:30.269 INFO:tasks.workunit.client.0.smithi117.stdout:9/933: dread - d1/d8/d12/fed zero size 2024-04-12T09:11:30.269 INFO:tasks.workunit.client.1.smithi203.stdout:4/482: dwrite d1a/d21/d22/f6a [0,4194304] 0 2024-04-12T09:11:30.273 INFO:tasks.workunit.client.1.smithi203.stdout:9/386: symlink d8/d12/d23/l92 0 2024-04-12T09:11:30.275 INFO:tasks.workunit.client.0.smithi117.stdout:4/991: rename d0/d5/d3b/d38/l41 to d0/d5/d3b/d38/d4f/db6/l144 0 2024-04-12T09:11:30.275 INFO:tasks.workunit.client.0.smithi117.stdout:4/992: chown d0/d5/d3b/d38/d10f 5569 1 2024-04-12T09:11:30.276 INFO:tasks.workunit.client.0.smithi117.stdout:4/993: chown d0/d2c/da6 247 1 2024-04-12T09:11:30.277 INFO:tasks.workunit.client.0.smithi117.stdout:9/934: fdatasync d1/d23/f8f 0 2024-04-12T09:11:30.278 INFO:tasks.workunit.client.0.smithi117.stdout:9/935: chown d1/d8/d12/f38 5 1 2024-04-12T09:11:30.280 INFO:tasks.workunit.client.1.smithi203.stdout:2/485: creat d0/d14/d74/d96/d9a/faf x:0 0 0 2024-04-12T09:11:30.290 INFO:tasks.workunit.client.1.smithi203.stdout:1/514: rename df/d2d/d6f/d75/d80/d54/f9d to df/d2d/d6f/d75/fa0 0 2024-04-12T09:11:30.291 INFO:tasks.workunit.client.1.smithi203.stdout:1/515: write df/d2d/d6f/d75/d80/d54/d5d/d67/f8b [80863,100198] 0 2024-04-12T09:11:30.293 INFO:tasks.workunit.client.0.smithi117.stdout:9/936: rename d1/d8/df/l44 to d1/d8/d52/l12b 0 2024-04-12T09:11:30.294 INFO:tasks.workunit.client.1.smithi203.stdout:4/483: creat d1a/d1d/fa0 x:0 0 0 2024-04-12T09:11:30.296 INFO:tasks.workunit.client.1.smithi203.stdout:9/387: mkdir d8/d3b/d6f/d74/d8e/d2c/d5d/d93 0 2024-04-12T09:11:30.298 INFO:tasks.workunit.client.1.smithi203.stdout:6/418: sync 2024-04-12T09:11:30.301 INFO:tasks.workunit.client.0.smithi117.stdout:9/937: symlink d1/d8/df/l12c 0 2024-04-12T09:11:30.301 INFO:tasks.workunit.client.1.smithi203.stdout:8/419: dwrite d4/d8/d1c/d5d/f4f [0,4194304] 0 2024-04-12T09:11:30.303 INFO:tasks.workunit.client.1.smithi203.stdout:9/388: creat d8/d12/d23/d85/f94 x:0 0 0 2024-04-12T09:11:30.303 INFO:tasks.workunit.client.1.smithi203.stdout:7/477: link d0/d4/d1c/d3b/l3e d0/d34/lb5 0 2024-04-12T09:11:30.305 INFO:tasks.workunit.client.1.smithi203.stdout:5/545: write d0/d6/d16/d9/d14/d2d/fbc [210019,95472] 0 2024-04-12T09:11:30.306 INFO:tasks.workunit.client.0.smithi117.stdout:9/938: truncate d1/d8/df/d3e/f32 1582488 0 2024-04-12T09:11:30.307 INFO:tasks.workunit.client.1.smithi203.stdout:4/484: mkdir d1a/d21/da1 0 2024-04-12T09:11:30.308 INFO:tasks.workunit.client.0.smithi117.stdout:9/939: dread - d1/d8/df/d3e/d92/fc8 zero size 2024-04-12T09:11:30.310 INFO:tasks.workunit.client.0.smithi117.stdout:7/869: dwrite d0/d2/d45/d17/d23/fb0 [0,4194304] 0 2024-04-12T09:11:30.312 INFO:tasks.workunit.client.0.smithi117.stdout:7/870: write d0/d2/d45/d17/d23/dac/dad/d91/dca/fe9 [864257,34621] 0 2024-04-12T09:11:30.312 INFO:tasks.workunit.client.1.smithi203.stdout:9/389: stat d8/l3f 0 2024-04-12T09:11:30.316 INFO:tasks.workunit.client.0.smithi117.stdout:9/940: mkdir d1/d8/df/d68/ddf/daf/d3b/d12d 0 2024-04-12T09:11:30.317 INFO:tasks.workunit.client.1.smithi203.stdout:5/546: rmdir d0/d6/d11/d1e 39 2024-04-12T09:11:30.319 INFO:tasks.workunit.client.0.smithi117.stdout:4/994: write d0/d5/d25/fac [4483277,52818] 0 2024-04-12T09:11:30.320 INFO:tasks.workunit.client.0.smithi117.stdout:9/941: rmdir d1/d8/df/d68/ddf/daf 39 2024-04-12T09:11:30.322 INFO:tasks.workunit.client.1.smithi203.stdout:8/420: mknod d4/d8/d37/c85 0 2024-04-12T09:11:30.323 INFO:tasks.workunit.client.0.smithi117.stdout:7/871: link d0/d2/d45/d17/d23/dac/f113 d0/d2/d45/d17/d23/dac/dad/d91/f117 0 2024-04-12T09:11:30.327 INFO:tasks.workunit.client.0.smithi117.stdout:4/995: creat d0/d5/d39/d4e/d6b/d83/f145 x:0 0 0 2024-04-12T09:11:30.329 INFO:tasks.workunit.client.1.smithi203.stdout:9/390: creat d8/d12/d3e/d90/f95 x:0 0 0 2024-04-12T09:11:30.330 INFO:tasks.workunit.client.1.smithi203.stdout:9/391: write d8/d12/d23/d27/f32 [1056617,101141] 0 2024-04-12T09:11:30.330 INFO:tasks.workunit.client.1.smithi203.stdout:9/392: truncate f4 4997833 0 2024-04-12T09:11:30.331 INFO:tasks.workunit.client.0.smithi117.stdout:9/942: mkdir d1/d8/df/d68/d12e 0 2024-04-12T09:11:30.332 INFO:tasks.workunit.client.1.smithi203.stdout:7/478: truncate d0/d4/d1c/d3b/d4c/fa6 287345 0 2024-04-12T09:11:30.333 INFO:tasks.workunit.client.0.smithi117.stdout:7/872: mknod d0/d2/d45/da1/c118 0 2024-04-12T09:11:30.336 INFO:tasks.workunit.client.0.smithi117.stdout:4/996: unlink d0/d2c/d3c/d10a/l11b 0 2024-04-12T09:11:30.337 INFO:tasks.workunit.client.1.smithi203.stdout:7/479: dwrite d0/d4/d1c/d3b/f46 [0,4194304] 0 2024-04-12T09:11:30.338 INFO:tasks.workunit.client.1.smithi203.stdout:8/421: rmdir d4/d8/d37/d57 39 2024-04-12T09:11:30.340 INFO:tasks.workunit.client.1.smithi203.stdout:9/393: mknod d8/d3b/d6f/d74/c96 0 2024-04-12T09:11:30.341 INFO:tasks.workunit.client.0.smithi117.stdout:7/873: creat d0/d2/d45/d15/f119 x:0 0 0 2024-04-12T09:11:30.345 INFO:tasks.workunit.client.1.smithi203.stdout:5/547: creat d0/d6/d11/d1e/d4c/d48/fc9 x:0 0 0 2024-04-12T09:11:30.346 INFO:tasks.workunit.client.0.smithi117.stdout:9/943: symlink d1/d8/d5a/d79/l12f 0 2024-04-12T09:11:30.349 INFO:tasks.workunit.client.1.smithi203.stdout:7/480: creat d0/d38/fb6 x:0 0 0 2024-04-12T09:11:30.352 INFO:tasks.workunit.client.1.smithi203.stdout:7/481: read d0/d4/d1c/d3b/d4c/f55 [1724591,98061] 0 2024-04-12T09:11:30.352 INFO:tasks.workunit.client.0.smithi117.stdout:9/944: dread - d1/d8/d52/d99/fa8 zero size 2024-04-12T09:11:30.353 INFO:tasks.workunit.client.1.smithi203.stdout:8/422: chown d4/d8/d1c/d48/d5e/l70 111 1 2024-04-12T09:11:30.353 INFO:tasks.workunit.client.1.smithi203.stdout:9/394: dread d8/d12/d23/d85/f8b [0,4194304] 0 2024-04-12T09:11:30.354 INFO:tasks.workunit.client.1.smithi203.stdout:4/485: write d1a/d21/d22/d2e/f49 [978131,119704] 0 2024-04-12T09:11:30.355 INFO:tasks.workunit.client.1.smithi203.stdout:5/548: fsync d0/d6/fe 0 2024-04-12T09:11:30.356 INFO:tasks.workunit.client.0.smithi117.stdout:9/945: fsync d1/d8/df/d68/ddf/daf/d3b/f42 0 2024-04-12T09:11:30.356 INFO:tasks.workunit.client.1.smithi203.stdout:7/482: truncate d0/d15/d2d/d5e/d8c/f81 5028399 0 2024-04-12T09:11:30.357 INFO:tasks.workunit.client.0.smithi117.stdout:9/946: fdatasync d1/d8/df/d68/ddf/daf/d3b/f42 0 2024-04-12T09:11:30.357 INFO:tasks.workunit.client.1.smithi203.stdout:4/486: write d1a/d21/d22/d2e/f49 [1539571,97346] 0 2024-04-12T09:11:30.359 INFO:tasks.workunit.client.1.smithi203.stdout:8/423: rename d4/d8/fc to d4/f86 0 2024-04-12T09:11:30.359 INFO:tasks.workunit.client.1.smithi203.stdout:4/487: write d1a/d21/d22/f62 [3776044,38816] 0 2024-04-12T09:11:30.360 INFO:tasks.workunit.client.0.smithi117.stdout:9/947: mknod d1/d8/df/da2/c130 0 2024-04-12T09:11:30.366 INFO:tasks.workunit.client.0.smithi117.stdout:4/997: truncate d0/f37 8363312 0 2024-04-12T09:11:30.367 INFO:tasks.workunit.client.0.smithi117.stdout:9/948: rename d1/d8/l107 to d1/d8/df/d3e/de3/l131 0 2024-04-12T09:11:30.369 INFO:tasks.workunit.client.0.smithi117.stdout:9/949: fsync d1/d8/df/d68/df9/f105 0 2024-04-12T09:11:30.369 INFO:tasks.workunit.client.0.smithi117.stdout:7/874: dread d0/f2b [0,4194304] 0 2024-04-12T09:11:30.369 INFO:tasks.workunit.client.1.smithi203.stdout:9/395: mkdir d8/d12/d23/d38/d8a/d97 0 2024-04-12T09:11:30.376 INFO:tasks.workunit.client.1.smithi203.stdout:4/488: link d1a/d20/d5f/f64 d1a/d20/d5d/d2c/d72/fa2 0 2024-04-12T09:11:30.377 INFO:tasks.workunit.client.0.smithi117.stdout:4/998: creat d0/d5/d25/dfd/d107/da7/dcd/d140/f146 x:0 0 0 2024-04-12T09:11:30.378 INFO:tasks.workunit.client.1.smithi203.stdout:9/396: creat d8/d12/d3e/d90/f98 x:0 0 0 2024-04-12T09:11:30.379 INFO:tasks.workunit.client.1.smithi203.stdout:9/397: stat d8/d3b/d6f/d74/f86 0 2024-04-12T09:11:30.379 INFO:tasks.workunit.client.0.smithi117.stdout:7/875: mkdir d0/d2/d45/d17/d23/dac/dad/daa/d10c/d11a 0 2024-04-12T09:11:30.380 INFO:tasks.workunit.client.1.smithi203.stdout:4/489: dread d1a/d21/d22/d2e/f43 [0,4194304] 0 2024-04-12T09:11:30.380 INFO:tasks.workunit.client.0.smithi117.stdout:7/876: chown d0/d2/d45/d17/d23/d50/c65 2499096 1 2024-04-12T09:11:30.381 INFO:tasks.workunit.client.1.smithi203.stdout:4/490: write d1a/d20/d5f/f6d [886010,21804] 0 2024-04-12T09:11:30.381 INFO:tasks.workunit.client.1.smithi203.stdout:5/549: link d0/d6/d11/d18/f32 d0/d6/d16/d9/d14/d4b/fca 0 2024-04-12T09:11:30.383 INFO:tasks.workunit.client.0.smithi117.stdout:4/999: rmdir d0/d2c/d8d 39 2024-04-12T09:11:30.385 INFO:tasks.workunit.client.1.smithi203.stdout:9/398: symlink d8/d3b/d6f/d74/d8e/d2c/d5d/l99 0 2024-04-12T09:11:30.385 INFO:tasks.workunit.client.1.smithi203.stdout:9/399: readlink d8/d3b/d6f/d74/d8e/d2c/l68 0 2024-04-12T09:11:30.386 INFO:tasks.workunit.client.0.smithi117.stdout:7/877: readlink d0/d2/d45/d17/d23/dac/lff 0 2024-04-12T09:11:30.389 INFO:tasks.workunit.client.0.smithi117.stdout:7/878: chown d0/d2/d45/d17/d23/c90 33067403 1 2024-04-12T09:11:30.390 INFO:tasks.workunit.client.0.smithi117.stdout:9/950: dwrite d1/d8/df/d3e/d92/fc8 [0,4194304] 0 2024-04-12T09:11:30.396 INFO:tasks.workunit.client.0.smithi117.stdout:9/951: symlink d1/d8/df/da2/dbf/l132 0 2024-04-12T09:11:30.397 INFO:tasks.workunit.client.0.smithi117.stdout:9/952: write d1/d8/d5a/d79/f96 [969471,58542] 0 2024-04-12T09:11:30.402 INFO:tasks.workunit.client.1.smithi203.stdout:4/491: link d1a/d21/d22/c30 d1a/d21/d22/d2e/d78/ca3 0 2024-04-12T09:11:30.405 INFO:tasks.workunit.client.1.smithi203.stdout:4/492: creat d1a/d20/fa4 x:0 0 0 2024-04-12T09:11:30.405 INFO:tasks.workunit.client.1.smithi203.stdout:5/550: link d0/d5d/c75 d0/d6/d16/d9/d86/ccb 0 2024-04-12T09:11:30.406 INFO:tasks.workunit.client.1.smithi203.stdout:4/493: dread - d1a/d21/d22/d4e/f83 zero size 2024-04-12T09:11:30.406 INFO:tasks.workunit.client.1.smithi203.stdout:5/551: fdatasync d0/fbb 0 2024-04-12T09:11:30.410 INFO:tasks.workunit.client.1.smithi203.stdout:4/494: truncate d1a/d2b/f3a 4375208 0 2024-04-12T09:11:30.410 INFO:tasks.workunit.client.1.smithi203.stdout:9/400: truncate d8/d3b/d6f/d74/d8e/f59 550038 0 2024-04-12T09:11:30.411 INFO:tasks.workunit.client.0.smithi117.stdout:7/879: write d0/d2/f43 [511610,15302] 0 2024-04-12T09:11:30.411 INFO:tasks.workunit.client.0.smithi117.stdout:7/880: mknod d0/d2/d1a/da7/c11b 0 2024-04-12T09:11:30.412 INFO:tasks.workunit.client.1.smithi203.stdout:5/552: rename d0/d6/d16/d9/d14/d4b to d0/d6/d11/d18/dcc 0 2024-04-12T09:11:30.418 INFO:tasks.workunit.client.1.smithi203.stdout:4/495: rename d1a/l59 to d1a/d21/d60/la5 0 2024-04-12T09:11:30.418 INFO:tasks.workunit.client.0.smithi117.stdout:7/881: dwrite d0/d2/d45/d15/f119 [0,4194304] 0 2024-04-12T09:11:30.418 INFO:tasks.workunit.client.0.smithi117.stdout:9/953: dwrite d1/d8/d5e/fd3 [0,4194304] 0 2024-04-12T09:11:30.419 INFO:tasks.workunit.client.1.smithi203.stdout:0/481: sync 2024-04-12T09:11:30.419 INFO:tasks.workunit.client.1.smithi203.stdout:3/401: sync 2024-04-12T09:11:30.419 INFO:tasks.workunit.client.0.smithi117.stdout:9/954: chown d1/d8/d12/fee 30015 1 2024-04-12T09:11:30.421 INFO:tasks.workunit.client.0.smithi117.stdout:9/955: write d1/d23/f113 [4477493,47391] 0 2024-04-12T09:11:30.421 INFO:tasks.workunit.client.1.smithi203.stdout:9/401: rmdir d8 39 2024-04-12T09:11:30.422 INFO:tasks.workunit.client.0.smithi117.stdout:9/956: chown d1/d8/d52/d99/fbb 7297 1 2024-04-12T09:11:30.425 INFO:tasks.workunit.client.1.smithi203.stdout:4/496: readlink d1a/l82 0 2024-04-12T09:11:30.427 INFO:tasks.workunit.client.1.smithi203.stdout:3/402: dwrite d2/d8/d14/d23/d35/d4c/d5c/f34 [4194304,4194304] 0 2024-04-12T09:11:30.428 INFO:tasks.workunit.client.0.smithi117.stdout:7/882: rename d0/d2/d1a/d49/f62 to d0/d20/d4a/dfd/f11c 0 2024-04-12T09:11:30.430 INFO:tasks.workunit.client.1.smithi203.stdout:0/482: chown d0/dd/d40/l53 4632342 1 2024-04-12T09:11:30.432 INFO:tasks.workunit.client.1.smithi203.stdout:5/553: symlink d0/d6/d9b/lcd 0 2024-04-12T09:11:30.433 INFO:tasks.workunit.client.1.smithi203.stdout:0/483: read d0/dd/d71/d94/d2f/d4c/f74 [3440142,89352] 0 2024-04-12T09:11:30.434 INFO:tasks.workunit.client.0.smithi117.stdout:9/957: fsync d1/d8/d52/d99/fbb 0 2024-04-12T09:11:30.435 INFO:tasks.workunit.client.1.smithi203.stdout:4/497: dwrite d1a/d21/d22/f25 [0,4194304] 0 2024-04-12T09:11:30.436 INFO:tasks.workunit.client.0.smithi117.stdout:7/883: mknod d0/d2/d45/d53/d58/c11d 0 2024-04-12T09:11:30.437 INFO:tasks.workunit.client.0.smithi117.stdout:7/884: chown d0/d2/d45/f42 2022315291 1 2024-04-12T09:11:30.439 INFO:tasks.workunit.client.0.smithi117.stdout:9/958: chown d1/d8/d5a/d79/d91/fb4 215936 1 2024-04-12T09:11:30.440 INFO:tasks.workunit.client.0.smithi117.stdout:9/959: chown d1/d8/df/d68/ddf/daf/l7a 513026076 1 2024-04-12T09:11:30.440 INFO:tasks.workunit.client.1.smithi203.stdout:4/498: read - d1a/d21/f67 zero size 2024-04-12T09:11:30.443 INFO:tasks.workunit.client.1.smithi203.stdout:9/402: creat d8/d3b/d6f/d74/d8e/f9a x:0 0 0 2024-04-12T09:11:30.443 INFO:tasks.workunit.client.0.smithi117.stdout:9/960: creat d1/d8/df/da2/dbf/f133 x:0 0 0 2024-04-12T09:11:30.443 INFO:tasks.workunit.client.1.smithi203.stdout:5/554: dwrite d0/f21 [0,4194304] 0 2024-04-12T09:11:30.444 INFO:tasks.workunit.client.1.smithi203.stdout:4/499: stat d1a/d21/l44 0 2024-04-12T09:11:30.445 INFO:tasks.workunit.client.1.smithi203.stdout:4/500: read - d1a/d1d/fa0 zero size 2024-04-12T09:11:30.448 INFO:tasks.workunit.client.1.smithi203.stdout:0/484: rename d0/dd/d4d/f55 to d0/dd/f99 0 2024-04-12T09:11:30.448 INFO:tasks.workunit.client.0.smithi117.stdout:9/961: dwrite d1/ff2 [0,4194304] 0 2024-04-12T09:11:30.450 INFO:tasks.workunit.client.0.smithi117.stdout:9/962: dread - d1/d8/d5a/d79/d91/db0/d8a/de7/f11d zero size 2024-04-12T09:11:30.451 INFO:tasks.workunit.client.1.smithi203.stdout:9/403: dwrite d8/d12/f81 [0,4194304] 0 2024-04-12T09:11:30.452 INFO:tasks.workunit.client.0.smithi117.stdout:9/963: readlink d1/d24/l47 0 2024-04-12T09:11:30.453 INFO:tasks.workunit.client.1.smithi203.stdout:5/555: creat d0/d6/d11/d18/d2a/dc8/fce x:0 0 0 2024-04-12T09:11:30.456 INFO:tasks.workunit.client.1.smithi203.stdout:5/556: chown d0/d6/d16/d9/d30/d89/cc6 71 1 2024-04-12T09:11:30.457 INFO:tasks.workunit.client.1.smithi203.stdout:4/501: dread d1a/d21/d22/d2e/f43 [0,4194304] 0 2024-04-12T09:11:30.458 INFO:tasks.workunit.client.0.smithi117.stdout:9/964: dwrite d1/d24/fa5 [0,4194304] 0 2024-04-12T09:11:30.461 INFO:tasks.workunit.client.1.smithi203.stdout:5/557: creat d0/d6/d9b/fcf x:0 0 0 2024-04-12T09:11:30.461 INFO:tasks.workunit.client.0.smithi117.stdout:9/965: symlink d1/d8/d52/l134 0 2024-04-12T09:11:30.463 INFO:tasks.workunit.client.1.smithi203.stdout:9/404: link d8/d3b/d6f/d74/d8e/c33 d8/d3b/d6f/c9b 0 2024-04-12T09:11:30.467 INFO:tasks.workunit.client.1.smithi203.stdout:5/558: mkdir d0/dbd/dd0 0 2024-04-12T09:11:30.468 INFO:tasks.workunit.client.0.smithi117.stdout:9/966: dwrite d1/d8/d5a/d6e/d71/fe5 [0,4194304] 0 2024-04-12T09:11:30.470 INFO:tasks.workunit.client.1.smithi203.stdout:4/502: dwrite d1a/d21/d22/f25 [4194304,4194304] 0 2024-04-12T09:11:30.471 INFO:tasks.workunit.client.1.smithi203.stdout:0/485: rename d0/l45 to d0/dd/d71/d94/d2f/l9a 0 2024-04-12T09:11:30.474 INFO:tasks.workunit.client.1.smithi203.stdout:9/405: creat d8/d3b/d6f/d74/d8e/d2c/d70/f9c x:0 0 0 2024-04-12T09:11:30.477 INFO:tasks.workunit.client.0.smithi117.stdout:9/967: getdents d1/d8/df/d3e/dea 0 2024-04-12T09:11:30.479 INFO:tasks.workunit.client.0.smithi117.stdout:7/885: dwrite d0/d2/d45/d17/d23/fd8 [0,4194304] 0 2024-04-12T09:11:30.482 INFO:tasks.workunit.client.1.smithi203.stdout:4/503: truncate d1a/d20/fa4 614979 0 2024-04-12T09:11:30.482 INFO:tasks.workunit.client.0.smithi117.stdout:9/968: mkdir d1/d8/d90/d11a/d123/d127/d135 0 2024-04-12T09:11:30.486 INFO:tasks.workunit.client.1.smithi203.stdout:3/403: dwrite d2/f18 [0,4194304] 0 2024-04-12T09:11:30.487 INFO:tasks.workunit.client.0.smithi117.stdout:9/969: rename d1/ld9 to d1/d8/df/l136 0 2024-04-12T09:11:30.489 INFO:tasks.workunit.client.1.smithi203.stdout:5/559: dwrite d0/d6/d11/d38/f7a [0,4194304] 0 2024-04-12T09:11:30.489 INFO:tasks.workunit.client.0.smithi117.stdout:7/886: getdents d0/d2/d45/d17/d23/dac/dad/daa 0 2024-04-12T09:11:30.490 INFO:tasks.workunit.client.1.smithi203.stdout:9/406: creat d8/d3b/d6f/d74/d8e/f9d x:0 0 0 2024-04-12T09:11:30.491 INFO:tasks.workunit.client.0.smithi117.stdout:7/887: rmdir d0/d20/d4a/dfd 39 2024-04-12T09:11:30.492 INFO:tasks.workunit.client.0.smithi117.stdout:9/970: symlink d1/d8/df/l137 0 2024-04-12T09:11:30.494 INFO:tasks.workunit.client.0.smithi117.stdout:9/971: write d1/d8/df/d3e/d92/fa0 [1163567,61877] 0 2024-04-12T09:11:30.495 INFO:tasks.workunit.client.0.smithi117.stdout:7/888: truncate d0/d2/d45/d17/d23/d50/f3d 483910 0 2024-04-12T09:11:30.496 INFO:tasks.workunit.client.1.smithi203.stdout:3/404: creat d2/d8/d14/d45/f7f x:0 0 0 2024-04-12T09:11:30.498 INFO:tasks.workunit.client.0.smithi117.stdout:7/889: stat d0/d2/d45/lba 0 2024-04-12T09:11:30.500 INFO:tasks.workunit.client.0.smithi117.stdout:9/972: symlink d1/d8/d5a/d79/l138 0 2024-04-12T09:11:30.500 INFO:tasks.workunit.client.1.smithi203.stdout:5/560: read d0/d6/d16/d9/d14/f85 [419119,1878] 0 2024-04-12T09:11:30.500 INFO:tasks.workunit.client.1.smithi203.stdout:0/486: getdents d0/dd/d71/d94/d2f/d17/d19/d6f/d78 0 2024-04-12T09:11:30.501 INFO:tasks.workunit.client.0.smithi117.stdout:7/890: mknod d0/d2/d45/d15/d114/c11e 0 2024-04-12T09:11:30.501 INFO:tasks.workunit.client.0.smithi117.stdout:9/973: chown d1/d8/df/d68/ddf/daf/d3b/f4a 3 1 2024-04-12T09:11:30.502 INFO:tasks.workunit.client.1.smithi203.stdout:4/504: dwrite d1a/d21/d22/f57 [0,4194304] 0 2024-04-12T09:11:30.503 INFO:tasks.workunit.client.0.smithi117.stdout:7/891: truncate d0/f2b 6560430 0 2024-04-12T09:11:30.505 INFO:tasks.workunit.client.0.smithi117.stdout:9/974: dread d1/d8/d52/f6c [0,4194304] 0 2024-04-12T09:11:30.506 INFO:tasks.workunit.client.1.smithi203.stdout:0/487: readlink d0/dd/d71/d94/d2f/d4c/l92 0 2024-04-12T09:11:30.507 INFO:tasks.workunit.client.1.smithi203.stdout:9/407: dwrite d8/d12/d3e/d90/f95 [0,4194304] 0 2024-04-12T09:11:30.508 INFO:tasks.workunit.client.1.smithi203.stdout:5/561: dread d0/d6/d16/d9/fa4 [0,4194304] 0 2024-04-12T09:11:30.512 INFO:tasks.workunit.client.1.smithi203.stdout:3/405: dwrite d2/d8/d14/d23/f42 [0,4194304] 0 2024-04-12T09:11:30.513 INFO:tasks.workunit.client.1.smithi203.stdout:3/406: dread - d2/d8/d14/d23/d35/d4c/d5c/f56 zero size 2024-04-12T09:11:30.514 INFO:tasks.workunit.client.1.smithi203.stdout:3/407: dread - d2/d8/d14/d23/d35/f73 zero size 2024-04-12T09:11:30.515 INFO:tasks.workunit.client.1.smithi203.stdout:4/505: unlink d1a/d21/d22/f25 0 2024-04-12T09:11:30.516 INFO:tasks.workunit.client.1.smithi203.stdout:1/516: sync 2024-04-12T09:11:30.516 INFO:tasks.workunit.client.1.smithi203.stdout:2/486: sync 2024-04-12T09:11:30.518 INFO:tasks.workunit.client.1.smithi203.stdout:1/517: chown df/d2d/d6f/d75/d80/d8c/d8e 13 1 2024-04-12T09:11:30.520 INFO:tasks.workunit.client.1.smithi203.stdout:1/518: write df/d2d/d6f/d75/d80/d54/d5d/f4d [2561920,27791] 0 2024-04-12T09:11:30.520 INFO:tasks.workunit.client.0.smithi117.stdout:9/975: mkdir d1/d139 0 2024-04-12T09:11:30.522 INFO:tasks.workunit.client.1.smithi203.stdout:4/506: dwrite d1a/d20/f2a [0,4194304] 0 2024-04-12T09:11:30.522 INFO:tasks.workunit.client.0.smithi117.stdout:9/976: write d1/f15 [8926448,25779] 0 2024-04-12T09:11:30.524 INFO:tasks.workunit.client.1.smithi203.stdout:0/488: symlink d0/d48/d5e/d84/l9b 0 2024-04-12T09:11:30.525 INFO:tasks.workunit.client.1.smithi203.stdout:3/408: creat d2/d64/f80 x:0 0 0 2024-04-12T09:11:30.526 INFO:tasks.workunit.client.1.smithi203.stdout:2/487: unlink d0/d14/d23/d3d/c3f 0 2024-04-12T09:11:30.528 INFO:tasks.workunit.client.0.smithi117.stdout:9/977: creat d1/d23/f13a x:0 0 0 2024-04-12T09:11:30.529 INFO:tasks.workunit.client.1.smithi203.stdout:3/409: mkdir d2/d8/d59/d81 0 2024-04-12T09:11:30.530 INFO:tasks.workunit.client.0.smithi117.stdout:9/978: fsync d1/d8/df/d68/ddf/f50 0 2024-04-12T09:11:30.533 INFO:tasks.workunit.client.1.smithi203.stdout:0/489: read d0/dd/d71/d94/d2f/d17/f11 [3483453,55009] 0 2024-04-12T09:11:30.533 INFO:tasks.workunit.client.1.smithi203.stdout:4/507: dwrite d1a/d21/d22/f62 [0,4194304] 0 2024-04-12T09:11:30.534 INFO:tasks.workunit.client.1.smithi203.stdout:1/519: getdents df/d2d/d6f/d75 0 2024-04-12T09:11:30.536 INFO:tasks.workunit.client.0.smithi117.stdout:9/979: getdents d1/d8 0 2024-04-12T09:11:30.538 INFO:tasks.workunit.client.1.smithi203.stdout:0/490: mknod d0/d48/d5e/c9c 0 2024-04-12T09:11:30.543 INFO:tasks.workunit.client.1.smithi203.stdout:1/520: write df/d2d/d6f/d75/d80/d54/d5d/f9c [348658,21506] 0 2024-04-12T09:11:30.545 INFO:tasks.workunit.client.1.smithi203.stdout:6/419: sync 2024-04-12T09:11:30.545 INFO:tasks.workunit.client.1.smithi203.stdout:8/424: sync 2024-04-12T09:11:30.545 INFO:tasks.workunit.client.1.smithi203.stdout:7/483: sync 2024-04-12T09:11:30.545 INFO:tasks.workunit.client.1.smithi203.stdout:2/488: dwrite d0/d14/d74/d96/d9a/faf [0,4194304] 0 2024-04-12T09:11:30.545 INFO:tasks.workunit.client.1.smithi203.stdout:3/410: dwrite d2/d8/d14/d23/d36/f4b [0,4194304] 0 2024-04-12T09:11:30.548 INFO:tasks.workunit.client.1.smithi203.stdout:8/425: chown d4/d34/d79/f80 41205 1 2024-04-12T09:11:30.548 INFO:tasks.workunit.client.1.smithi203.stdout:7/484: write d0/d4/d5d/f86 [634764,98097] 0 2024-04-12T09:11:30.550 INFO:tasks.workunit.client.1.smithi203.stdout:2/489: creat d0/d14/d1e/d57/d95/fb0 x:0 0 0 2024-04-12T09:11:30.554 INFO:tasks.workunit.client.1.smithi203.stdout:1/521: read df/d2d/d6f/d75/d80/d54/d5d/d4a/f77 [700315,109944] 0 2024-04-12T09:11:30.559 INFO:tasks.workunit.client.1.smithi203.stdout:2/490: dwrite d0/d3/f10 [0,4194304] 0 2024-04-12T09:11:30.561 INFO:tasks.workunit.client.1.smithi203.stdout:8/426: mknod d4/d8/c87 0 2024-04-12T09:11:30.561 INFO:tasks.workunit.client.1.smithi203.stdout:8/427: dread - d4/f4b zero size 2024-04-12T09:11:30.568 INFO:tasks.workunit.client.1.smithi203.stdout:3/411: link d2/d8/d14/d23/d35/d4c/f31 d2/f82 0 2024-04-12T09:11:30.570 INFO:tasks.workunit.client.1.smithi203.stdout:9/408: rename d8/d3b/d6f to d8/d12/d23/d38/d8a/d97/d9e 0 2024-04-12T09:11:30.570 INFO:tasks.workunit.client.0.smithi117.stdout:7/892: rename d0/d2/d45/d17 to d0/d20/d4a/d11f 0 2024-04-12T09:11:30.571 INFO:tasks.workunit.client.1.smithi203.stdout:8/428: chown d4/d8/l14 4 1 2024-04-12T09:11:30.571 INFO:tasks.workunit.client.0.smithi117.stdout:7/893: chown d0/d2/d45/d15/f25 360447 1 2024-04-12T09:11:30.572 INFO:tasks.workunit.client.0.smithi117.stdout:7/894: fdatasync d0/d20/d4a/d11f/d23/ffe 0 2024-04-12T09:11:30.573 INFO:tasks.workunit.client.1.smithi203.stdout:3/412: write d2/d8/d59/f61 [8543103,25545] 0 2024-04-12T09:11:30.574 INFO:tasks.workunit.client.1.smithi203.stdout:5/562: rename d0/d6/d11/d18/d1a/l1f to d0/d6/d16/d9/d30/d58/d74/d88/ld1 0 2024-04-12T09:11:30.575 INFO:tasks.workunit.client.1.smithi203.stdout:5/563: stat d0/d6/d11/d18/d2a/l28 0 2024-04-12T09:11:30.578 INFO:tasks.workunit.client.1.smithi203.stdout:8/429: symlink d4/d8/d1c/d5d/l88 0 2024-04-12T09:11:30.578 INFO:tasks.workunit.client.1.smithi203.stdout:5/564: dread d0/d6/d16/d9/d30/d58/fa6 [0,4194304] 0 2024-04-12T09:11:30.579 INFO:tasks.workunit.client.0.smithi117.stdout:7/895: mkdir d0/d20/d4a/d11f/d23/dac/dad/daa/d10c/d11a/d120 0 2024-04-12T09:11:30.579 INFO:tasks.workunit.client.0.smithi117.stdout:7/896: stat d0/d20/d4a/dce/dcf/f10d 0 2024-04-12T09:11:30.582 INFO:tasks.workunit.client.1.smithi203.stdout:4/508: rename d1a/d21/d22/f4a to d1a/d21/d60/fa6 0 2024-04-12T09:11:30.583 INFO:tasks.workunit.client.0.smithi117.stdout:7/897: rmdir d0/d20/d4a/d11f/d23/dac/dad 39 2024-04-12T09:11:30.584 INFO:tasks.workunit.client.1.smithi203.stdout:5/565: dwrite d0/d6/d11/d1e/f78 [0,4194304] 0 2024-04-12T09:11:30.587 INFO:tasks.workunit.client.1.smithi203.stdout:8/430: read d4/d8/d74/d78/f6d [2411877,66495] 0 2024-04-12T09:11:30.594 INFO:tasks.workunit.client.1.smithi203.stdout:0/491: rename d0/dd/d71/f85 to d0/dd/d71/d94/d2f/d17/d19/f9d 0 2024-04-12T09:11:30.595 INFO:tasks.workunit.client.0.smithi117.stdout:7/898: link d0/d20/d4a/d11f/d23/d50/d5c/l77 d0/da/d9b/l121 0 2024-04-12T09:11:30.597 INFO:tasks.workunit.client.1.smithi203.stdout:5/566: creat d0/dbd/fd2 x:0 0 0 2024-04-12T09:11:30.598 INFO:tasks.workunit.client.1.smithi203.stdout:8/431: chown d4/d8/d37/d57/d7d 13066693 1 2024-04-12T09:11:30.599 INFO:tasks.workunit.client.0.smithi117.stdout:9/980: truncate d1/d8/d5a/d6e/d71/f72 165469 0 2024-04-12T09:11:30.599 INFO:tasks.workunit.client.1.smithi203.stdout:8/432: dread - d4/d8/d1c/d5d/f69 zero size 2024-04-12T09:11:30.600 INFO:tasks.workunit.client.1.smithi203.stdout:9/409: creat d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/f9f x:0 0 0 2024-04-12T09:11:30.602 INFO:tasks.workunit.client.1.smithi203.stdout:9/410: stat d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/f9d 0 2024-04-12T09:11:30.602 INFO:tasks.workunit.client.1.smithi203.stdout:3/413: creat d2/f83 x:0 0 0 2024-04-12T09:11:30.603 INFO:tasks.workunit.client.0.smithi117.stdout:7/899: rmdir d0/d20/d4a/dfd/d9a 39 2024-04-12T09:11:30.604 INFO:tasks.workunit.client.0.smithi117.stdout:9/981: truncate d1/d8/d52/d99/fbb 97211 0 2024-04-12T09:11:30.606 INFO:tasks.workunit.client.1.smithi203.stdout:4/509: mknod d1a/d21/d22/d2e/d78/ca7 0 2024-04-12T09:11:30.608 INFO:tasks.workunit.client.1.smithi203.stdout:4/510: stat d1a/d2b/f3a 0 2024-04-12T09:11:30.608 INFO:tasks.workunit.client.0.smithi117.stdout:9/982: truncate d1/d8/d5a/d79/d91/fb2 112610 0 2024-04-12T09:11:30.609 INFO:tasks.workunit.client.1.smithi203.stdout:0/492: fsync d0/dd/d40/f62 0 2024-04-12T09:11:30.609 INFO:tasks.workunit.client.0.smithi117.stdout:2/946: sync 2024-04-12T09:11:30.614 INFO:tasks.workunit.client.1.smithi203.stdout:9/411: dwrite d8/d12/d23/d85/f1d [0,4194304] 0 2024-04-12T09:11:30.615 INFO:tasks.workunit.client.1.smithi203.stdout:6/420: dwrite d1/d3/d26/d30/d4a/d6c/d45/f52 [0,4194304] 0 2024-04-12T09:11:30.615 INFO:tasks.workunit.client.0.smithi117.stdout:2/947: creat d0/d43/d128/f138 x:0 0 0 2024-04-12T09:11:30.615 INFO:tasks.workunit.client.1.smithi203.stdout:8/433: symlink d4/d8/d1c/d5d/l89 0 2024-04-12T09:11:30.620 INFO:tasks.workunit.client.0.smithi117.stdout:9/983: link d1/d8/d5e/l124 d1/d8/d52/l13b 0 2024-04-12T09:11:30.622 INFO:tasks.workunit.client.0.smithi117.stdout:9/984: write d1/d8/df/d3e/d92/fa0 [1371183,90955] 0 2024-04-12T09:11:30.625 INFO:tasks.workunit.client.1.smithi203.stdout:1/522: dwrite df/d2d/d6f/d75/d80/d54/f46 [0,4194304] 0 2024-04-12T09:11:30.627 INFO:tasks.workunit.client.0.smithi117.stdout:9/985: dread d1/d8/d5a/d6e/d71/fe5 [0,4194304] 0 2024-04-12T09:11:30.627 INFO:tasks.workunit.client.1.smithi203.stdout:2/491: dwrite d0/d14/d1e/d2a/f52 [4194304,4194304] 0 2024-04-12T09:11:30.627 INFO:tasks.workunit.client.0.smithi117.stdout:2/948: mknod d0/d43/d4b/c139 0 2024-04-12T09:11:30.628 INFO:tasks.workunit.client.1.smithi203.stdout:0/493: dread d0/d48/f69 [0,4194304] 0 2024-04-12T09:11:30.635 INFO:tasks.workunit.client.1.smithi203.stdout:3/414: creat d2/d8/d59/d81/f84 x:0 0 0 2024-04-12T09:11:30.638 INFO:tasks.workunit.client.0.smithi117.stdout:2/949: truncate d0/d43/d53/d61/d66/fa2 4773783 0 2024-04-12T09:11:30.639 INFO:tasks.workunit.client.1.smithi203.stdout:3/415: truncate d2/d8/d14/d23/d36/f79 175111 0 2024-04-12T09:11:30.640 INFO:tasks.workunit.client.1.smithi203.stdout:6/421: read d1/d3/f39 [371544,27130] 0 2024-04-12T09:11:30.640 INFO:tasks.workunit.client.0.smithi117.stdout:2/950: write d0/f99 [2295777,3739] 0 2024-04-12T09:11:30.640 INFO:tasks.workunit.client.1.smithi203.stdout:6/422: chown d1/d3/d4/l48 6731521 1 2024-04-12T09:11:30.643 INFO:tasks.workunit.client.1.smithi203.stdout:4/511: creat d1a/d21/da1/fa8 x:0 0 0 2024-04-12T09:11:30.644 INFO:tasks.workunit.client.0.smithi117.stdout:7/900: dwrite d0/d2/d45/f5a [4194304,4194304] 0 2024-04-12T09:11:30.644 INFO:tasks.workunit.client.1.smithi203.stdout:4/512: fdatasync d1a/d21/d22/d4e/f83 0 2024-04-12T09:11:30.645 INFO:tasks.workunit.client.1.smithi203.stdout:5/567: dwrite d0/d6/d16/d9/f24 [8388608,4194304] 0 2024-04-12T09:11:30.646 INFO:tasks.workunit.client.0.smithi117.stdout:2/951: dread d0/d43/d30/f12f [0,4194304] 0 2024-04-12T09:11:30.646 INFO:tasks.workunit.client.1.smithi203.stdout:5/568: dread - d0/dbd/fc7 zero size 2024-04-12T09:11:30.648 INFO:tasks.workunit.client.1.smithi203.stdout:8/434: mknod d4/d8/d1c/d48/d5e/c8a 0 2024-04-12T09:11:30.655 INFO:tasks.workunit.client.0.smithi117.stdout:9/986: link d1/d8/d5a/lab d1/d8/df/d3e/d92/l13c 0 2024-04-12T09:11:30.655 INFO:tasks.workunit.client.1.smithi203.stdout:7/485: sync 2024-04-12T09:11:30.658 INFO:tasks.workunit.client.0.smithi117.stdout:2/952: creat d0/d43/d128/f13a x:0 0 0 2024-04-12T09:11:30.658 INFO:tasks.workunit.client.1.smithi203.stdout:8/435: dwrite d4/d8/d74/d78/f27 [0,4194304] 0 2024-04-12T09:11:30.659 INFO:tasks.workunit.client.0.smithi117.stdout:2/953: fsync d0/d4/d10/d27/d9a/d121/d112/f135 0 2024-04-12T09:11:30.661 INFO:tasks.workunit.client.0.smithi117.stdout:7/901: truncate d0/f2b 3703889 0 2024-04-12T09:11:30.662 INFO:tasks.workunit.client.0.smithi117.stdout:7/902: truncate d0/da/d7c/f103 519748 0 2024-04-12T09:11:30.665 INFO:tasks.workunit.client.0.smithi117.stdout:9/987: creat d1/d8/df/d3e/de3/f13d x:0 0 0 2024-04-12T09:11:30.668 INFO:tasks.workunit.client.0.smithi117.stdout:2/954: mkdir d0/d4/d10/d27/d9a/d13b 0 2024-04-12T09:11:30.669 INFO:tasks.workunit.client.1.smithi203.stdout:4/513: fdatasync d1a/d21/f5c 0 2024-04-12T09:11:30.669 INFO:tasks.workunit.client.1.smithi203.stdout:0/494: dwrite d0/dd/f99 [0,4194304] 0 2024-04-12T09:11:30.669 INFO:tasks.workunit.client.0.smithi117.stdout:2/955: write d0/d43/d53/d61/d8d/fdd [1998848,65637] 0 2024-04-12T09:11:30.670 INFO:tasks.workunit.client.1.smithi203.stdout:1/523: dread df/d2d/f32 [0,4194304] 0 2024-04-12T09:11:30.672 INFO:tasks.workunit.client.1.smithi203.stdout:2/492: creat d0/d67/d86/fb1 x:0 0 0 2024-04-12T09:11:30.674 INFO:tasks.workunit.client.0.smithi117.stdout:2/956: creat d0/d43/d53/d61/d8d/d109/f13c x:0 0 0 2024-04-12T09:11:30.676 INFO:tasks.workunit.client.1.smithi203.stdout:6/423: dwrite d1/d3/d26/d30/d4a/f6f [0,4194304] 0 2024-04-12T09:11:30.676 INFO:tasks.workunit.client.1.smithi203.stdout:5/569: mkdir d0/d6/d11/dd3 0 2024-04-12T09:11:30.676 INFO:tasks.workunit.client.1.smithi203.stdout:2/493: write d0/d14/d1e/f2b [2813684,108508] 0 2024-04-12T09:11:30.679 INFO:tasks.workunit.client.1.smithi203.stdout:5/570: stat d0/d6/d11/d38 0 2024-04-12T09:11:30.679 INFO:tasks.workunit.client.0.smithi117.stdout:2/957: rename d0/df/de1 to d0/d4/d10/d27/d9a/d121/d111/d13d 0 2024-04-12T09:11:30.679 INFO:tasks.workunit.client.0.smithi117.stdout:7/903: link d0/d20/d4a/d11f/d23/d39/d6c/l88 d0/d2/d1a/da7/l122 0 2024-04-12T09:11:30.680 INFO:tasks.workunit.client.0.smithi117.stdout:2/958: chown d0/d4/f4d 29920 1 2024-04-12T09:11:30.681 INFO:tasks.workunit.client.1.smithi203.stdout:4/514: mknod d1a/d21/d22/d2e/ca9 0 2024-04-12T09:11:30.682 INFO:tasks.workunit.client.1.smithi203.stdout:9/412: getdents d8/d12/d3e/d90/d60 0 2024-04-12T09:11:30.683 INFO:tasks.workunit.client.1.smithi203.stdout:7/486: dread d0/d4/d53/fa5 [0,4194304] 0 2024-04-12T09:11:30.684 INFO:tasks.workunit.client.1.smithi203.stdout:3/416: creat d2/d8/f85 x:0 0 0 2024-04-12T09:11:30.685 INFO:tasks.workunit.client.1.smithi203.stdout:5/571: read d0/d6/d11/d18/d2a/ff [1883389,5539] 0 2024-04-12T09:11:30.685 INFO:tasks.workunit.client.1.smithi203.stdout:9/413: write d8/d12/d23/d38/d8a/d97/d9e/f7d [40707,126326] 0 2024-04-12T09:11:30.686 INFO:tasks.workunit.client.1.smithi203.stdout:3/417: stat d2/d8/d14/d1b/f48 0 2024-04-12T09:11:30.686 INFO:tasks.workunit.client.0.smithi117.stdout:2/959: rename d0/d4/d81/d8b/cc0 to d0/d4/d10/d27/d9a/d121/d111/c13e 0 2024-04-12T09:11:30.690 INFO:tasks.workunit.client.1.smithi203.stdout:1/524: symlink df/d2d/d6f/d75/d80/d54/d5d/d58/d94/la1 0 2024-04-12T09:11:30.690 INFO:tasks.workunit.client.1.smithi203.stdout:9/414: dread d8/d12/f81 [0,4194304] 0 2024-04-12T09:11:30.691 INFO:tasks.workunit.client.1.smithi203.stdout:0/495: unlink d0/dd/d5b/f95 0 2024-04-12T09:11:30.691 INFO:tasks.workunit.client.1.smithi203.stdout:1/525: readlink df/d2d/d6f/d75/d80/d2b/l3d 0 2024-04-12T09:11:30.692 INFO:tasks.workunit.client.1.smithi203.stdout:6/424: rename d1/df/d1b/d3e/f53 to d1/d3/d26/d5d/f8b 0 2024-04-12T09:11:30.694 INFO:tasks.workunit.client.1.smithi203.stdout:2/494: unlink d0/d54/d61/d78/d89/f92 0 2024-04-12T09:11:30.694 INFO:tasks.workunit.client.1.smithi203.stdout:6/425: truncate d1/d3/d26/d30/d4a/f7d 875559 0 2024-04-12T09:11:30.695 INFO:tasks.workunit.client.1.smithi203.stdout:4/515: mkdir d1a/d21/d60/daa 0 2024-04-12T09:11:30.697 INFO:tasks.workunit.client.1.smithi203.stdout:7/487: symlink d0/d38/lb7 0 2024-04-12T09:11:30.698 INFO:tasks.workunit.client.1.smithi203.stdout:5/572: symlink d0/d6/d16/d9/d30/d83/ld4 0 2024-04-12T09:11:30.699 INFO:tasks.workunit.client.1.smithi203.stdout:3/418: mkdir d2/d8/d14/d23/d35/d4c/d67/d86 0 2024-04-12T09:11:30.700 INFO:tasks.workunit.client.1.smithi203.stdout:0/496: creat d0/dd/d71/d94/d2f/d17/f9e x:0 0 0 2024-04-12T09:11:30.703 INFO:tasks.workunit.client.1.smithi203.stdout:9/415: symlink d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d40/la0 0 2024-04-12T09:11:30.703 INFO:tasks.workunit.client.1.smithi203.stdout:2/495: rmdir d0/d3/d47 39 2024-04-12T09:11:30.706 INFO:tasks.workunit.client.1.smithi203.stdout:4/516: creat d1a/d20/fab x:0 0 0 2024-04-12T09:11:30.706 INFO:tasks.workunit.client.1.smithi203.stdout:7/488: creat d0/d38/d79/fb8 x:0 0 0 2024-04-12T09:11:30.708 INFO:tasks.workunit.client.0.smithi117.stdout:9/988: dread d1/d8/df/d1b/f3f [0,4194304] 0 2024-04-12T09:11:30.708 INFO:tasks.workunit.client.1.smithi203.stdout:9/416: mkdir d8/d12/da1 0 2024-04-12T09:11:30.708 INFO:tasks.workunit.client.1.smithi203.stdout:5/573: write d0/d6/d16/d9/d30/f6f [3090561,68124] 0 2024-04-12T09:11:30.709 INFO:tasks.workunit.client.0.smithi117.stdout:9/989: symlink d1/d8/df/d68/l13e 0 2024-04-12T09:11:30.710 INFO:tasks.workunit.client.1.smithi203.stdout:3/419: dwrite d2/d8/d59/d81/f84 [0,4194304] 0 2024-04-12T09:11:30.711 INFO:tasks.workunit.client.1.smithi203.stdout:4/517: dread - d1a/d21/d22/f79 zero size 2024-04-12T09:11:30.715 INFO:tasks.workunit.client.1.smithi203.stdout:4/518: write d1a/d1d/d69/f92 [205507,113007] 0 2024-04-12T09:11:30.717 INFO:tasks.workunit.client.1.smithi203.stdout:0/497: dwrite d0/dd/d5b/f93 [0,4194304] 0 2024-04-12T09:11:30.719 INFO:tasks.workunit.client.1.smithi203.stdout:3/420: chown d2/d8/d59/d81/f84 505939774 1 2024-04-12T09:11:30.724 INFO:tasks.workunit.client.1.smithi203.stdout:4/519: creat d1a/d21/d22/d4e/fac x:0 0 0 2024-04-12T09:11:30.725 INFO:tasks.workunit.client.0.smithi117.stdout:2/960: write d0/d43/d4b/dae/fb4 [3441429,66626] 0 2024-04-12T09:11:30.726 INFO:tasks.workunit.client.1.smithi203.stdout:4/520: chown d1a/d21/d22/d2e/f6f 10954448 1 2024-04-12T09:11:30.728 INFO:tasks.workunit.client.1.smithi203.stdout:8/436: truncate d4/d8/d1c/f31 29771 0 2024-04-12T09:11:30.729 INFO:tasks.workunit.client.1.smithi203.stdout:2/496: dwrite d0/d54/d61/d78/f81 [0,4194304] 0 2024-04-12T09:11:30.730 INFO:tasks.workunit.client.1.smithi203.stdout:3/421: mkdir d2/d8/d59/d87 0 2024-04-12T09:11:30.730 INFO:tasks.workunit.client.0.smithi117.stdout:2/961: symlink d0/d43/d30/d41/dfa/l13f 0 2024-04-12T09:11:30.730 INFO:tasks.workunit.client.0.smithi117.stdout:2/962: readlink d0/d43/d53/l86 0 2024-04-12T09:11:30.731 INFO:tasks.workunit.client.1.smithi203.stdout:6/426: rename d1/df/d1b to d1/d3/d5b/d8c 0 2024-04-12T09:11:30.731 INFO:tasks.workunit.client.1.smithi203.stdout:8/437: fsync d4/d8/f77 0 2024-04-12T09:11:30.734 INFO:tasks.workunit.client.1.smithi203.stdout:2/497: write d0/d14/d1e/d2a/f60 [731530,63876] 0 2024-04-12T09:11:30.734 INFO:tasks.workunit.client.1.smithi203.stdout:5/574: dwrite d0/d6/d16/d9/f10 [4194304,4194304] 0 2024-04-12T09:11:30.735 INFO:tasks.workunit.client.1.smithi203.stdout:4/521: mknod d1a/d1d/d69/cad 0 2024-04-12T09:11:30.739 INFO:tasks.workunit.client.1.smithi203.stdout:7/489: rename d0/d4/f57 to d0/d4/d54/dac/fb9 0 2024-04-12T09:11:30.740 INFO:tasks.workunit.client.1.smithi203.stdout:4/522: write f14 [2735451,57023] 0 2024-04-12T09:11:30.740 INFO:tasks.workunit.client.1.smithi203.stdout:8/438: creat d4/d8/d81/f8b x:0 0 0 2024-04-12T09:11:30.742 INFO:tasks.workunit.client.1.smithi203.stdout:4/523: stat d1a/d20/d5f/f7a 0 2024-04-12T09:11:30.742 INFO:tasks.workunit.client.1.smithi203.stdout:7/490: write d0/d4/f43 [4113246,29498] 0 2024-04-12T09:11:30.745 INFO:tasks.workunit.client.1.smithi203.stdout:4/524: read d1a/d20/f5e [30425,43396] 0 2024-04-12T09:11:30.746 INFO:tasks.workunit.client.1.smithi203.stdout:0/498: dwrite d0/dd/d71/d94/d2f/d17/f11 [0,4194304] 0 2024-04-12T09:11:30.747 INFO:tasks.workunit.client.1.smithi203.stdout:4/525: dread - d1a/d21/f67 zero size 2024-04-12T09:11:30.749 INFO:tasks.workunit.client.1.smithi203.stdout:7/491: mkdir d0/d15/d2d/d5e/dba 0 2024-04-12T09:11:30.750 INFO:tasks.workunit.client.1.smithi203.stdout:9/417: write d8/f2a [1209626,16607] 0 2024-04-12T09:11:30.752 INFO:tasks.workunit.client.1.smithi203.stdout:3/422: getdents d2/d51/d65 0 2024-04-12T09:11:30.755 INFO:tasks.workunit.client.1.smithi203.stdout:1/526: dwrite df/d2d/d6f/d75/d80/d2b/f44 [0,4194304] 0 2024-04-12T09:11:30.755 INFO:tasks.workunit.client.1.smithi203.stdout:9/418: creat d8/d12/d3e/fa2 x:0 0 0 2024-04-12T09:11:30.756 INFO:tasks.workunit.client.1.smithi203.stdout:6/427: getdents d1/d3/d5b/d8c 0 2024-04-12T09:11:30.756 INFO:tasks.workunit.client.1.smithi203.stdout:7/492: mknod d0/d15/cbb 0 2024-04-12T09:11:30.757 INFO:tasks.workunit.client.1.smithi203.stdout:3/423: symlink d2/d8/d14/d45/l88 0 2024-04-12T09:11:30.759 INFO:tasks.workunit.client.1.smithi203.stdout:4/526: link d1a/d20/d5d/d2c/f51 d1a/d21/d22/d2e/d8d/d9b/fae 0 2024-04-12T09:11:30.759 INFO:tasks.workunit.client.1.smithi203.stdout:9/419: write d8/d12/d3e/fa2 [916442,96551] 0 2024-04-12T09:11:30.760 INFO:tasks.workunit.client.1.smithi203.stdout:7/493: dread - d0/d4/d1c/d5b/f8e zero size 2024-04-12T09:11:30.760 INFO:tasks.workunit.client.1.smithi203.stdout:0/499: dread d0/dd/d5b/f93 [0,4194304] 0 2024-04-12T09:11:30.761 INFO:tasks.workunit.client.1.smithi203.stdout:3/424: mkdir d2/d51/d65/d89 0 2024-04-12T09:11:30.762 INFO:tasks.workunit.client.1.smithi203.stdout:4/527: creat d1a/d1d/faf x:0 0 0 2024-04-12T09:11:30.763 INFO:tasks.workunit.client.1.smithi203.stdout:0/500: chown d0/dd/f70 2994 1 2024-04-12T09:11:30.763 INFO:tasks.workunit.client.1.smithi203.stdout:7/494: chown d0/d4/d1c/d3b/d98 256993 1 2024-04-12T09:11:30.763 INFO:tasks.workunit.client.1.smithi203.stdout:3/425: write d2/d64/f6f [129551,46500] 0 2024-04-12T09:11:30.766 INFO:tasks.workunit.client.1.smithi203.stdout:0/501: mkdir d0/dd/d5b/d9f 0 2024-04-12T09:11:30.769 INFO:tasks.workunit.client.1.smithi203.stdout:3/426: rename d2/d8/d14/d1b/d2f/l62 to d2/d8/d59/l8a 0 2024-04-12T09:11:30.770 INFO:tasks.workunit.client.0.smithi117.stdout:2/963: write d0/d43/d128/f13a [42407,72291] 0 2024-04-12T09:11:30.771 INFO:tasks.workunit.client.1.smithi203.stdout:0/502: truncate d0/dd/d71/d94/f3d 481898 0 2024-04-12T09:11:30.772 INFO:tasks.workunit.client.1.smithi203.stdout:9/420: dwrite d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/f4c [4194304,4194304] 0 2024-04-12T09:11:30.773 INFO:tasks.workunit.client.1.smithi203.stdout:7/495: truncate d0/d4/f11 2479036 0 2024-04-12T09:11:30.775 INFO:tasks.workunit.client.1.smithi203.stdout:0/503: write d0/dd/d71/d94/d2f/f66 [922096,77576] 0 2024-04-12T09:11:30.777 INFO:tasks.workunit.client.0.smithi117.stdout:2/964: rmdir d0/d4/d81/d8b 39 2024-04-12T09:11:30.778 INFO:tasks.workunit.client.1.smithi203.stdout:8/439: dread d4/d8/f42 [0,4194304] 0 2024-04-12T09:11:30.779 INFO:tasks.workunit.client.0.smithi117.stdout:9/990: dwrite d1/d8/df/d1b/f3f [4194304,4194304] 0 2024-04-12T09:11:30.782 INFO:tasks.workunit.client.0.smithi117.stdout:9/991: dread - d1/d24/fd6 zero size 2024-04-12T09:11:30.783 INFO:tasks.workunit.client.0.smithi117.stdout:2/965: write d0/d43/d4b/dff/f118 [366602,80800] 0 2024-04-12T09:11:30.784 INFO:tasks.workunit.client.1.smithi203.stdout:0/504: unlink d0/dd/d71/d94/d2f/d34/f4a 0 2024-04-12T09:11:30.785 INFO:tasks.workunit.client.1.smithi203.stdout:4/528: dread d1a/d20/d5f/f64 [0,4194304] 0 2024-04-12T09:11:30.785 INFO:tasks.workunit.client.1.smithi203.stdout:4/529: readlink d1a/d21/l44 0 2024-04-12T09:11:30.786 INFO:tasks.workunit.client.0.smithi117.stdout:9/992: fsync d1/d24/f57 0 2024-04-12T09:11:30.792 INFO:tasks.workunit.client.1.smithi203.stdout:8/440: creat d4/d34/d79/f8c x:0 0 0 2024-04-12T09:11:30.793 INFO:tasks.workunit.client.1.smithi203.stdout:8/441: stat d4/d8/fd 0 2024-04-12T09:11:30.794 INFO:tasks.workunit.client.1.smithi203.stdout:8/442: write d4/d8/d37/f61 [593679,11284] 0 2024-04-12T09:11:30.795 INFO:tasks.workunit.client.0.smithi117.stdout:9/993: symlink d1/d8/df/d7d/d7e/l13f 0 2024-04-12T09:11:30.799 INFO:tasks.workunit.client.0.smithi117.stdout:2/966: link d0/f10f d0/d43/d53/d61/d66/dd9/d108/f140 0 2024-04-12T09:11:30.799 INFO:tasks.workunit.client.1.smithi203.stdout:4/530: symlink d1a/d21/d22/d2e/d78/lb0 0 2024-04-12T09:11:30.800 INFO:tasks.workunit.client.0.smithi117.stdout:9/994: mkdir d1/d8/df/d3e/dea/d140 0 2024-04-12T09:11:30.804 INFO:tasks.workunit.client.0.smithi117.stdout:9/995: read d1/f15 [1098888,99305] 0 2024-04-12T09:11:30.806 INFO:tasks.workunit.client.0.smithi117.stdout:2/967: link d0/d43/d30/d41/fc9 d0/d4/f141 0 2024-04-12T09:11:30.806 INFO:tasks.workunit.client.1.smithi203.stdout:0/505: getdents d0/dd/d71/d94/d2f/d17/d19/d6f 0 2024-04-12T09:11:30.807 INFO:tasks.workunit.client.0.smithi117.stdout:9/996: write d1/d8/d5a/d6e/d71/fa9 [727672,27784] 0 2024-04-12T09:11:30.807 INFO:tasks.workunit.client.1.smithi203.stdout:4/531: dwrite d1a/d21/d22/d2e/f49 [0,4194304] 0 2024-04-12T09:11:30.809 INFO:tasks.workunit.client.1.smithi203.stdout:4/532: write d1a/d20/f3d [202140,28064] 0 2024-04-12T09:11:30.810 INFO:tasks.workunit.client.1.smithi203.stdout:4/533: chown d1a/d21/d22/d2e/d8b 53 1 2024-04-12T09:11:30.810 INFO:tasks.workunit.client.1.smithi203.stdout:4/534: fdatasync d1a/d21/d22/d4e/f8a 0 2024-04-12T09:11:30.812 INFO:tasks.workunit.client.0.smithi117.stdout:9/997: creat d1/d8/df/d1b/f141 x:0 0 0 2024-04-12T09:11:30.818 INFO:tasks.workunit.client.1.smithi203.stdout:0/506: unlink d0/dd/d5b/l7d 0 2024-04-12T09:11:30.818 INFO:tasks.workunit.client.1.smithi203.stdout:8/443: rmdir d4/d8/d81 39 2024-04-12T09:11:30.818 INFO:tasks.workunit.client.1.smithi203.stdout:6/428: dread d1/d3/f1a [0,4194304] 0 2024-04-12T09:11:30.820 INFO:tasks.workunit.client.1.smithi203.stdout:4/535: symlink d1a/d20/d5d/d2c/lb1 0 2024-04-12T09:11:30.821 INFO:tasks.workunit.client.1.smithi203.stdout:5/575: write d0/d6/d11/d1e/d4c/f64 [1099238,58345] 0 2024-04-12T09:11:30.822 INFO:tasks.workunit.client.1.smithi203.stdout:5/576: chown d0/dbd 1184 1 2024-04-12T09:11:30.823 INFO:tasks.workunit.client.1.smithi203.stdout:0/507: symlink d0/dd/d71/d94/d2f/d17/la0 0 2024-04-12T09:11:30.823 INFO:tasks.workunit.client.1.smithi203.stdout:4/536: read d1a/d20/d5d/f84 [723718,115765] 0 2024-04-12T09:11:30.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:30 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:11:30.824 INFO:tasks.workunit.client.1.smithi203.stdout:6/429: dwrite d1/d3/d12/f1e [0,4194304] 0 2024-04-12T09:11:30.824 INFO:tasks.workunit.client.1.smithi203.stdout:5/577: write d0/d6/d11/d18/f3b [8587365,61997] 0 2024-04-12T09:11:30.824 INFO:tasks.workunit.client.1.smithi203.stdout:8/444: creat d4/d8/d37/d57/f8d x:0 0 0 2024-04-12T09:11:30.825 INFO:tasks.workunit.client.1.smithi203.stdout:0/508: write d0/dd/d71/d94/f5f [2167062,6843] 0 2024-04-12T09:11:30.827 INFO:tasks.workunit.client.1.smithi203.stdout:0/509: chown d0/dd/d71/d94/d2f/d4c/f74 1 1 2024-04-12T09:11:30.827 INFO:tasks.workunit.client.1.smithi203.stdout:6/430: truncate d1/d3/d26/f79 890332 0 2024-04-12T09:11:30.828 INFO:tasks.workunit.client.1.smithi203.stdout:8/445: write d4/d8/d74/d78/d53/f5b [3227197,33177] 0 2024-04-12T09:11:30.830 INFO:tasks.workunit.client.1.smithi203.stdout:8/446: dread - d4/f4b zero size 2024-04-12T09:11:30.831 INFO:tasks.workunit.client.0.smithi117.stdout:9/998: dwrite d1/d8/df/d3e/d92/f110 [0,4194304] 0 2024-04-12T09:11:30.833 INFO:tasks.workunit.client.1.smithi203.stdout:8/447: dread d4/d8/f7b [0,4194304] 0 2024-04-12T09:11:30.833 INFO:tasks.workunit.client.1.smithi203.stdout:2/498: truncate d0/d3/f10 6828295 0 2024-04-12T09:11:30.838 INFO:tasks.workunit.client.1.smithi203.stdout:5/578: symlink d0/d6/d16/d9/d80/ld5 0 2024-04-12T09:11:30.838 INFO:tasks.workunit.client.1.smithi203.stdout:9/421: rmdir d8/d12/d3e 39 2024-04-12T09:11:30.839 INFO:tasks.workunit.client.0.smithi117.stdout:9/999: mknod d1/d8/df/d68/d12e/c142 0 2024-04-12T09:11:30.848 INFO:tasks.workunit.client.1.smithi203.stdout:2/499: rmdir d0/d38/d43 39 2024-04-12T09:11:30.848 INFO:tasks.workunit.client.1.smithi203.stdout:8/448: write d4/d8/d81/f8b [1024706,25675] 0 2024-04-12T09:11:30.849 INFO:tasks.workunit.client.1.smithi203.stdout:0/510: dread d0/d48/d5e/d84/f8b [0,4194304] 0 2024-04-12T09:11:30.849 INFO:tasks.workunit.client.1.smithi203.stdout:9/422: mkdir d8/d3b/da3 0 2024-04-12T09:11:30.851 INFO:tasks.workunit.client.1.smithi203.stdout:2/500: readlink d0/d54/dad/l7a 0 2024-04-12T09:11:30.855 INFO:tasks.workunit.client.1.smithi203.stdout:9/423: write f5 [1981951,70511] 0 2024-04-12T09:11:30.857 INFO:tasks.workunit.client.1.smithi203.stdout:1/527: dwrite df/d2d/d6f/d75/d80/f21 [0,4194304] 0 2024-04-12T09:11:30.860 INFO:tasks.workunit.client.1.smithi203.stdout:3/427: write d2/d8/d14/d1b/f48 [2780413,10629] 0 2024-04-12T09:11:30.863 INFO:tasks.workunit.client.1.smithi203.stdout:4/537: link d1a/d21/d22/c30 d1a/d21/d60/d68/cb2 0 2024-04-12T09:11:30.865 INFO:tasks.workunit.client.1.smithi203.stdout:0/511: dread d0/dd/d71/d94/d2f/d4c/f6a [0,4194304] 0 2024-04-12T09:11:30.865 INFO:tasks.workunit.client.1.smithi203.stdout:7/496: truncate d0/d15/d2d/f66 4058371 0 2024-04-12T09:11:30.866 INFO:tasks.workunit.client.1.smithi203.stdout:2/501: write d0/d38/d43/d9c/fac [1510217,92078] 0 2024-04-12T09:11:30.866 INFO:tasks.workunit.client.1.smithi203.stdout:3/428: readlink d2/d8/lf 0 2024-04-12T09:11:30.867 INFO:tasks.workunit.client.1.smithi203.stdout:9/424: mknod d8/d12/d23/d38/d8a/d97/d9e/ca4 0 2024-04-12T09:11:30.868 INFO:tasks.workunit.client.1.smithi203.stdout:6/431: dread d1/d3/f2d [0,4194304] 0 2024-04-12T09:11:30.871 INFO:tasks.workunit.client.1.smithi203.stdout:4/538: creat d1a/d21/d22/d2e/d78/fb3 x:0 0 0 2024-04-12T09:11:30.872 INFO:tasks.workunit.client.1.smithi203.stdout:0/512: write d0/dd/d71/d94/d2f/d17/d19/d6f/d78/f8a [1901683,115775] 0 2024-04-12T09:11:30.873 INFO:tasks.workunit.client.1.smithi203.stdout:5/579: dread d0/d6/d16/d9/f10 [0,4194304] 0 2024-04-12T09:11:30.876 INFO:tasks.workunit.client.1.smithi203.stdout:9/425: read d8/d12/d23/d85/f1f [271691,28434] 0 2024-04-12T09:11:30.881 INFO:tasks.workunit.client.1.smithi203.stdout:6/432: chown d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d3a/c85 355024 1 2024-04-12T09:11:30.882 INFO:tasks.workunit.client.1.smithi203.stdout:4/539: fdatasync d1a/d21/d60/f77 0 2024-04-12T09:11:30.883 INFO:tasks.workunit.client.1.smithi203.stdout:4/540: dread - d1a/d21/d22/d2e/d8b/f99 zero size 2024-04-12T09:11:30.884 INFO:tasks.workunit.client.0.smithi117.stdout:2/968: truncate d0/f99 3800108 0 2024-04-12T09:11:30.884 INFO:tasks.workunit.client.1.smithi203.stdout:0/513: read d0/dd/f1b [519023,13885] 0 2024-04-12T09:11:30.885 INFO:tasks.workunit.client.1.smithi203.stdout:0/514: fsync d0/dd/d71/d94/d2f/d17/f11 0 2024-04-12T09:11:30.886 INFO:tasks.workunit.client.1.smithi203.stdout:5/580: rmdir d0/d6/d11/d18/d2a/dc8 39 2024-04-12T09:11:30.887 INFO:tasks.workunit.client.1.smithi203.stdout:8/449: getdents d4/d8/d37/d57/d7d 0 2024-04-12T09:11:30.889 INFO:tasks.workunit.client.1.smithi203.stdout:5/581: truncate d0/d6/d11/d1e/d4c/d48/fb5 612252 0 2024-04-12T09:11:30.890 INFO:tasks.workunit.client.0.smithi117.stdout:2/969: mknod d0/d4/d10/d27/d9a/d13b/c142 0 2024-04-12T09:11:30.890 INFO:tasks.workunit.client.1.smithi203.stdout:0/515: dwrite d0/dd/d71/d94/f68 [0,4194304] 0 2024-04-12T09:11:30.893 INFO:tasks.workunit.client.1.smithi203.stdout:2/502: link d0/d54/f69 d0/fb2 0 2024-04-12T09:11:30.893 INFO:tasks.workunit.client.1.smithi203.stdout:5/582: dread d0/d6/d11/f69 [0,4194304] 0 2024-04-12T09:11:30.895 INFO:tasks.workunit.client.1.smithi203.stdout:6/433: symlink d1/d3/d26/d30/d4a/d6c/d45/d55/l8d 0 2024-04-12T09:11:30.896 INFO:tasks.workunit.client.0.smithi117.stdout:2/970: fsync d0/d43/d53/d61/d66/fa2 0 2024-04-12T09:11:30.900 INFO:tasks.workunit.client.1.smithi203.stdout:3/429: creat d2/d8/d14/d1b/f8b x:0 0 0 2024-04-12T09:11:30.902 INFO:tasks.workunit.client.0.smithi117.stdout:2/971: dwrite d0/de6/f11c [0,4194304] 0 2024-04-12T09:11:30.906 INFO:tasks.workunit.client.1.smithi203.stdout:3/430: dwrite d2/d64/f6f [0,4194304] 0 2024-04-12T09:11:30.908 INFO:tasks.workunit.client.1.smithi203.stdout:0/516: unlink d0/d48/f88 0 2024-04-12T09:11:30.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:30 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:11:30.911 INFO:tasks.workunit.client.1.smithi203.stdout:5/583: creat d0/d6/d16/d9/d80/fd6 x:0 0 0 2024-04-12T09:11:30.913 INFO:tasks.workunit.client.0.smithi117.stdout:2/972: link d0/d4/f9d d0/d4/d81/d8b/f143 0 2024-04-12T09:11:30.914 INFO:tasks.workunit.client.0.smithi117.stdout:2/973: stat d0/d43/d53/d61/d66/c11d 0 2024-04-12T09:11:30.918 INFO:tasks.workunit.client.1.smithi203.stdout:4/541: dread fb [0,4194304] 0 2024-04-12T09:11:30.918 INFO:tasks.workunit.client.0.smithi117.stdout:2/974: truncate d0/d43/da5/d8f/fcc 688637 0 2024-04-12T09:11:30.920 INFO:tasks.workunit.client.1.smithi203.stdout:6/434: fsync d1/d3/f27 0 2024-04-12T09:11:30.921 INFO:tasks.workunit.client.0.smithi117.stdout:2/975: read d0/d43/d30/d41/fbf [400448,88192] 0 2024-04-12T09:11:30.925 INFO:tasks.workunit.client.1.smithi203.stdout:9/426: rename d8/l7b to d8/la5 0 2024-04-12T09:11:30.926 INFO:tasks.workunit.client.0.smithi117.stdout:2/976: dread - d0/d4/f106 zero size 2024-04-12T09:11:30.927 INFO:tasks.workunit.client.1.smithi203.stdout:3/431: creat d2/d8/d59/d87/f8c x:0 0 0 2024-04-12T09:11:30.928 INFO:tasks.workunit.client.1.smithi203.stdout:3/432: write d2/d8/d14/d1b/d2f/f32 [4932581,52316] 0 2024-04-12T09:11:30.929 INFO:tasks.workunit.client.0.smithi117.stdout:2/977: dread d0/d43/f56 [0,4194304] 0 2024-04-12T09:11:30.929 INFO:tasks.workunit.client.1.smithi203.stdout:0/517: symlink d0/dd/la1 0 2024-04-12T09:11:30.930 INFO:tasks.workunit.client.0.smithi117.stdout:2/978: readlink d0/d43/d30/dc6/ld6 0 2024-04-12T09:11:30.930 INFO:tasks.workunit.client.1.smithi203.stdout:0/518: fdatasync d0/f3 0 2024-04-12T09:11:30.931 INFO:tasks.workunit.client.1.smithi203.stdout:3/433: chown d2/d8/d14/d23/d35/f73 490598379 1 2024-04-12T09:11:30.931 INFO:tasks.workunit.client.1.smithi203.stdout:1/528: truncate df/d2d/d6f/d75/d80/f41 2423760 0 2024-04-12T09:11:30.932 INFO:tasks.workunit.client.1.smithi203.stdout:4/542: symlink d1a/d21/da1/lb4 0 2024-04-12T09:11:30.934 INFO:tasks.workunit.client.0.smithi117.stdout:2/979: chown d0/d43/le9 1430698 1 2024-04-12T09:11:30.934 INFO:tasks.workunit.client.1.smithi203.stdout:7/497: truncate d0/d4/f43 2668035 0 2024-04-12T09:11:30.936 INFO:tasks.workunit.client.1.smithi203.stdout:6/435: mkdir d1/d3/d26/d30/d4a/d6c/d45/d55/d8e 0 2024-04-12T09:11:30.937 INFO:tasks.workunit.client.1.smithi203.stdout:9/427: mknod d8/d12/d23/d85/ca6 0 2024-04-12T09:11:30.938 INFO:tasks.workunit.client.1.smithi203.stdout:1/529: dwrite df/d2d/f32 [0,4194304] 0 2024-04-12T09:11:30.938 INFO:tasks.workunit.client.1.smithi203.stdout:3/434: dread d2/d8/f52 [0,4194304] 0 2024-04-12T09:11:30.941 INFO:tasks.workunit.client.1.smithi203.stdout:1/530: truncate df/d2d/d6f/d75/fa0 1048435 0 2024-04-12T09:11:30.943 INFO:tasks.workunit.client.1.smithi203.stdout:5/584: dread d0/d6/d11/d18/d1a/f3f [0,4194304] 0 2024-04-12T09:11:30.945 INFO:tasks.workunit.client.0.smithi117.stdout:2/980: link d0/df/f93 d0/d43/d4b/dff/f144 0 2024-04-12T09:11:30.950 INFO:tasks.workunit.client.1.smithi203.stdout:4/543: symlink d1a/d1d/d69/lb5 0 2024-04-12T09:11:30.952 INFO:tasks.workunit.client.1.smithi203.stdout:7/498: readlink d0/d38/d51/l5f 0 2024-04-12T09:11:30.952 INFO:tasks.workunit.client.1.smithi203.stdout:2/503: write d0/fc [1665776,112719] 0 2024-04-12T09:11:30.953 INFO:tasks.workunit.client.0.smithi117.stdout:2/981: dread d0/d4/d10/d27/d9a/f113 [0,4194304] 0 2024-04-12T09:11:30.953 INFO:tasks.workunit.client.1.smithi203.stdout:6/436: rmdir d1/d3/d12 39 2024-04-12T09:11:30.960 INFO:tasks.workunit.client.1.smithi203.stdout:1/531: unlink df/d2d/c69 0 2024-04-12T09:11:30.963 INFO:tasks.workunit.client.1.smithi203.stdout:0/519: symlink d0/dd/d5b/d9f/la2 0 2024-04-12T09:11:30.963 INFO:tasks.workunit.client.1.smithi203.stdout:4/544: creat d1a/d1d/fb6 x:0 0 0 2024-04-12T09:11:30.964 INFO:tasks.workunit.client.1.smithi203.stdout:4/545: stat d1a/d21/d22/d2e/d8d/d9b/fae 0 2024-04-12T09:11:30.965 INFO:tasks.workunit.client.1.smithi203.stdout:4/546: write d1a/d1d/f55 [923964,61895] 0 2024-04-12T09:11:30.965 INFO:tasks.workunit.client.1.smithi203.stdout:2/504: symlink d0/d14/d8a/lb3 0 2024-04-12T09:11:30.966 INFO:tasks.workunit.client.1.smithi203.stdout:4/547: chown d1a/d20/f3d 286 1 2024-04-12T09:11:30.970 INFO:tasks.workunit.client.1.smithi203.stdout:1/532: symlink df/d2d/d6f/d75/d80/d54/la2 0 2024-04-12T09:11:30.973 INFO:tasks.workunit.client.1.smithi203.stdout:1/533: dread df/d2d/d6f/d75/d80/d54/d5d/d67/f8b [0,4194304] 0 2024-04-12T09:11:30.974 INFO:tasks.workunit.client.1.smithi203.stdout:1/534: chown df/d2d/d6f/d75/d80/d8c 0 1 2024-04-12T09:11:30.975 INFO:tasks.workunit.client.1.smithi203.stdout:1/535: truncate df/f6e 3339664 0 2024-04-12T09:11:30.976 INFO:tasks.workunit.client.1.smithi203.stdout:8/450: write d4/d8/d1c/f31 [70364,10420] 0 2024-04-12T09:11:30.978 INFO:tasks.workunit.client.1.smithi203.stdout:8/451: write d4/d8/d1c/d5d/f60 [4244199,596] 0 2024-04-12T09:11:30.979 INFO:tasks.workunit.client.1.smithi203.stdout:2/505: dread d0/d14/d23/d3d/f91 [0,4194304] 0 2024-04-12T09:11:30.980 INFO:tasks.workunit.client.1.smithi203.stdout:5/585: rename d0/d6/d11/d18/d1a/f9e to d0/d6/d16/fd7 0 2024-04-12T09:11:30.980 INFO:tasks.workunit.client.1.smithi203.stdout:1/536: dread df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/d88/f9f [0,4194304] 0 2024-04-12T09:11:30.981 INFO:tasks.workunit.client.1.smithi203.stdout:1/537: readlink l2 0 2024-04-12T09:11:30.982 INFO:tasks.workunit.client.1.smithi203.stdout:0/520: symlink d0/dd/d71/d94/d65/la3 0 2024-04-12T09:11:30.982 INFO:tasks.workunit.client.1.smithi203.stdout:5/586: write d0/d6/d11/d4a/f82 [890053,952] 0 2024-04-12T09:11:30.986 INFO:tasks.workunit.client.1.smithi203.stdout:4/548: dwrite d1a/d21/f31 [0,4194304] 0 2024-04-12T09:11:30.986 INFO:tasks.workunit.client.1.smithi203.stdout:4/549: chown d1a 3257833 1 2024-04-12T09:11:30.987 INFO:tasks.workunit.client.1.smithi203.stdout:4/550: chown d1a/d21/d60/d68/c8e 7 1 2024-04-12T09:11:30.988 INFO:tasks.workunit.client.1.smithi203.stdout:8/452: mkdir d4/d8/d81/d8e 0 2024-04-12T09:11:30.989 INFO:tasks.workunit.client.1.smithi203.stdout:9/428: dwrite d8/d12/d23/d85/f1f [0,4194304] 0 2024-04-12T09:11:30.990 INFO:tasks.workunit.client.1.smithi203.stdout:8/453: chown d4/d8/d74/d78/f25 3203669 1 2024-04-12T09:11:30.991 INFO:tasks.workunit.client.1.smithi203.stdout:2/506: rmdir d0/d14/d74/d96 39 2024-04-12T09:11:30.994 INFO:tasks.workunit.client.1.smithi203.stdout:3/435: truncate d2/d51/d65/f77 2147241 0 2024-04-12T09:11:30.996 INFO:tasks.workunit.client.1.smithi203.stdout:6/437: getdents d1/df 0 2024-04-12T09:11:30.996 INFO:tasks.workunit.client.1.smithi203.stdout:0/521: creat d0/d48/d5e/d84/fa4 x:0 0 0 2024-04-12T09:11:30.999 INFO:tasks.workunit.client.1.smithi203.stdout:7/499: read d0/d4/d54/d75/f9a [1219841,20023] 0 2024-04-12T09:11:31.000 INFO:tasks.workunit.client.1.smithi203.stdout:8/454: dwrite d4/d8/d1c/d5d/f60 [0,4194304] 0 2024-04-12T09:11:31.002 INFO:tasks.workunit.client.0.smithi117.stdout:7/904: sync 2024-04-12T09:11:31.002 INFO:tasks.workunit.client.1.smithi203.stdout:1/538: mknod df/ca3 0 2024-04-12T09:11:31.005 INFO:tasks.workunit.client.1.smithi203.stdout:7/500: dwrite d0/f40 [0,4194304] 0 2024-04-12T09:11:31.007 INFO:tasks.workunit.client.1.smithi203.stdout:3/436: mkdir d2/d64/d8d 0 2024-04-12T09:11:31.015 INFO:tasks.workunit.client.1.smithi203.stdout:4/551: write d1a/d20/d5d/f84 [1337983,84012] 0 2024-04-12T09:11:31.015 INFO:tasks.workunit.client.1.smithi203.stdout:4/552: fsync d1a/d21/f67 0 2024-04-12T09:11:31.022 INFO:tasks.workunit.client.1.smithi203.stdout:2/507: truncate d0/f1a 4489439 0 2024-04-12T09:11:31.022 INFO:tasks.workunit.client.1.smithi203.stdout:8/455: dread f3 [0,4194304] 0 2024-04-12T09:11:31.023 INFO:tasks.workunit.client.1.smithi203.stdout:7/501: creat d0/d4/d54/d75/fbc x:0 0 0 2024-04-12T09:11:31.026 INFO:tasks.workunit.client.1.smithi203.stdout:1/539: truncate df/d2d/d6f/d75/d80/d54/d5d/d4a/f77 4070236 0 2024-04-12T09:11:31.026 INFO:tasks.workunit.client.0.smithi117.stdout:2/982: dwrite d0/f99 [4194304,4194304] 0 2024-04-12T09:11:31.027 INFO:tasks.workunit.client.1.smithi203.stdout:5/587: truncate d0/d6/d16/d9/f10 2938369 0 2024-04-12T09:11:31.028 INFO:tasks.workunit.client.0.smithi117.stdout:2/983: chown d0/d43/d53/d61/d8d 1443869 1 2024-04-12T09:11:31.029 INFO:tasks.workunit.client.0.smithi117.stdout:7/905: dwrite d0/d2/d45/d15/f54 [0,4194304] 0 2024-04-12T09:11:31.029 INFO:tasks.workunit.client.0.smithi117.stdout:2/984: chown d0/d4/c71 28364 1 2024-04-12T09:11:31.036 INFO:tasks.workunit.client.1.smithi203.stdout:0/522: creat d0/dd/d4d/fa5 x:0 0 0 2024-04-12T09:11:31.039 INFO:tasks.workunit.client.1.smithi203.stdout:4/553: symlink d1a/d21/d60/d68/lb7 0 2024-04-12T09:11:31.042 INFO:tasks.workunit.client.1.smithi203.stdout:8/456: mkdir d4/d8/d74/d78/d53/d8f 0 2024-04-12T09:11:31.046 INFO:tasks.workunit.client.1.smithi203.stdout:3/437: symlink d2/d8/d14/d23/d35/d4c/d67/d86/l8e 0 2024-04-12T09:11:31.051 INFO:tasks.workunit.client.1.smithi203.stdout:6/438: creat d1/d3/f8f x:0 0 0 2024-04-12T09:11:31.052 INFO:tasks.workunit.client.1.smithi203.stdout:3/438: dwrite d2/d8/d59/d87/f8c [0,4194304] 0 2024-04-12T09:11:31.058 INFO:tasks.workunit.client.1.smithi203.stdout:9/429: getdents d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d40 0 2024-04-12T09:11:31.062 INFO:tasks.workunit.client.1.smithi203.stdout:2/508: rename d0/d54/dad/f34 to d0/d3/d47/fb4 0 2024-04-12T09:11:31.063 INFO:tasks.workunit.client.1.smithi203.stdout:2/509: write d0/d38/d43/d9c/fac [1159161,80276] 0 2024-04-12T09:11:31.064 INFO:tasks.workunit.client.1.smithi203.stdout:8/457: creat d4/d8/d37/d57/f90 x:0 0 0 2024-04-12T09:11:31.067 INFO:tasks.workunit.client.1.smithi203.stdout:7/502: fdatasync d0/d4/d1c/d3b/d4c/fa6 0 2024-04-12T09:11:31.073 INFO:tasks.workunit.client.1.smithi203.stdout:5/588: write d0/d6/d11/d18/f40 [3256421,46524] 0 2024-04-12T09:11:31.074 INFO:tasks.workunit.client.1.smithi203.stdout:0/523: symlink d0/dd/la6 0 2024-04-12T09:11:31.075 INFO:tasks.workunit.client.1.smithi203.stdout:1/540: dread df/f17 [0,4194304] 0 2024-04-12T09:11:31.076 INFO:tasks.workunit.client.1.smithi203.stdout:3/439: mknod d2/d8/d14/d23/d35/d4c/d5c/d55/c8f 0 2024-04-12T09:11:31.077 INFO:tasks.workunit.client.1.smithi203.stdout:3/440: write d2/d8/d14/d23/d36/f79 [341347,91023] 0 2024-04-12T09:11:31.079 INFO:tasks.workunit.client.1.smithi203.stdout:3/441: read d2/d8/d59/f7a [2396643,125347] 0 2024-04-12T09:11:31.082 INFO:tasks.workunit.client.1.smithi203.stdout:2/510: rmdir d0/d38/d43 39 2024-04-12T09:11:31.083 INFO:tasks.workunit.client.1.smithi203.stdout:4/554: write d1a/d21/d22/d4e/f52 [1438574,13095] 0 2024-04-12T09:11:31.086 INFO:tasks.workunit.client.1.smithi203.stdout:4/555: dread d1a/d21/f31 [0,4194304] 0 2024-04-12T09:11:31.087 INFO:tasks.workunit.client.0.smithi117.stdout:7/906: rmdir d0 39 2024-04-12T09:11:31.089 INFO:tasks.workunit.client.1.smithi203.stdout:0/524: stat d0/dd/d71/d94/d2f/l12 0 2024-04-12T09:11:31.091 INFO:tasks.workunit.client.1.smithi203.stdout:5/589: creat d0/d6/d16/d9/d30/d58/d74/d88/fd8 x:0 0 0 2024-04-12T09:11:31.091 INFO:tasks.workunit.client.1.smithi203.stdout:1/541: chown df/d2d/d6f/d75/d80/d54/d5d/d4a/l78 4219559 1 2024-04-12T09:11:31.092 INFO:tasks.workunit.client.1.smithi203.stdout:5/590: chown d0/d6/d16/d9/d30/d58/d74 242371836 1 2024-04-12T09:11:31.092 INFO:tasks.workunit.client.0.smithi117.stdout:7/907: symlink d0/d2/d96/l123 0 2024-04-12T09:11:31.093 INFO:tasks.workunit.client.0.smithi117.stdout:7/908: fsync d0/d13/f3e 0 2024-04-12T09:11:31.093 INFO:tasks.workunit.client.1.smithi203.stdout:5/591: write d0/d6/d16/d9/f24 [5117886,105681] 0 2024-04-12T09:11:31.095 INFO:tasks.workunit.client.1.smithi203.stdout:5/592: chown d0/d6/d16/d9/d30/d58/d74 44912 1 2024-04-12T09:11:31.095 INFO:tasks.workunit.client.1.smithi203.stdout:3/442: dread d2/d8/d14/d1b/d2f/f32 [0,4194304] 0 2024-04-12T09:11:31.096 INFO:tasks.workunit.client.1.smithi203.stdout:9/430: truncate d8/f4a 123200 0 2024-04-12T09:11:31.097 INFO:tasks.workunit.client.1.smithi203.stdout:5/593: write d0/d6/d16/d9/d80/fd6 [791651,93054] 0 2024-04-12T09:11:31.101 INFO:tasks.workunit.client.1.smithi203.stdout:8/458: symlink d4/d8/d81/d8e/l91 0 2024-04-12T09:11:31.101 INFO:tasks.workunit.client.1.smithi203.stdout:2/511: truncate d0/d38/d43/f94 424099 0 2024-04-12T09:11:31.101 INFO:tasks.workunit.client.1.smithi203.stdout:8/459: chown d4 2119951323 1 2024-04-12T09:11:31.103 INFO:tasks.workunit.client.1.smithi203.stdout:3/443: dwrite d2/fa [8388608,4194304] 0 2024-04-12T09:11:31.106 INFO:tasks.workunit.client.1.smithi203.stdout:3/444: truncate d2/d8/d14/d1b/d2f/f78 705114 0 2024-04-12T09:11:31.109 INFO:tasks.workunit.client.1.smithi203.stdout:2/512: dwrite d0/d38/d43/d9c/fac [0,4194304] 0 2024-04-12T09:11:31.110 INFO:tasks.workunit.client.1.smithi203.stdout:2/513: truncate d0/fb2 647934 0 2024-04-12T09:11:31.111 INFO:tasks.workunit.client.1.smithi203.stdout:2/514: readlink d0/d14/d23/l9f 0 2024-04-12T09:11:31.112 INFO:tasks.workunit.client.1.smithi203.stdout:2/515: fdatasync d0/d3/f36 0 2024-04-12T09:11:31.115 INFO:tasks.workunit.client.1.smithi203.stdout:9/431: dread d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/f61 [0,4194304] 0 2024-04-12T09:11:31.121 INFO:tasks.workunit.client.1.smithi203.stdout:8/460: dread d4/d8/d74/d78/f2e [0,4194304] 0 2024-04-12T09:11:31.127 INFO:tasks.workunit.client.1.smithi203.stdout:8/461: dwrite d4/d34/d79/f80 [0,4194304] 0 2024-04-12T09:11:31.196 INFO:tasks.workunit.client.1.smithi203.stdout:0/525: mknod d0/dd/d71/d94/d65/ca7 0 2024-04-12T09:11:31.211 INFO:tasks.workunit.client.0.smithi117.stdout:7/909: write d0/d13/f8a [1973470,3797] 0 2024-04-12T09:11:31.213 INFO:tasks.workunit.client.1.smithi203.stdout:8/462: chown d4/d8/d1c/f30 208269 1 2024-04-12T09:11:31.220 INFO:tasks.workunit.client.1.smithi203.stdout:8/463: dwrite d4/d8/d74/d78/d53/f68 [0,4194304] 0 2024-04-12T09:11:31.221 INFO:tasks.workunit.client.1.smithi203.stdout:4/556: truncate d1a/d21/f31 2125592 0 2024-04-12T09:11:31.226 INFO:tasks.workunit.client.1.smithi203.stdout:7/503: dwrite d0/d15/d2d/f4d [0,4194304] 0 2024-04-12T09:11:31.227 INFO:tasks.workunit.client.1.smithi203.stdout:9/432: dread d8/f8d [0,4194304] 0 2024-04-12T09:11:31.227 INFO:tasks.workunit.client.1.smithi203.stdout:8/464: dread - d4/d8/d37/d57/d7d/f6c zero size 2024-04-12T09:11:31.227 INFO:tasks.workunit.client.1.smithi203.stdout:6/439: sync 2024-04-12T09:11:31.227 INFO:tasks.workunit.client.1.smithi203.stdout:1/542: link df/d2d/f5f df/d2d/d6f/d75/d80/d54/d5d/fa4 0 2024-04-12T09:11:31.228 INFO:tasks.workunit.client.1.smithi203.stdout:5/594: dwrite d0/d6/d11/d1e/d4c/fa1 [0,4194304] 0 2024-04-12T09:11:31.231 INFO:tasks.workunit.client.1.smithi203.stdout:2/516: creat d0/d54/d61/d82/fb5 x:0 0 0 2024-04-12T09:11:31.232 INFO:tasks.workunit.client.0.smithi117.stdout:7/910: dwrite d0/d20/d4a/d11f/d23/d50/d5c/f79 [4194304,4194304] 0 2024-04-12T09:11:31.233 INFO:tasks.workunit.client.1.smithi203.stdout:2/517: readlink d0/d3/d47/l8c 0 2024-04-12T09:11:31.233 INFO:tasks.workunit.client.0.smithi117.stdout:7/911: stat d0/d20/d4a/dce 0 2024-04-12T09:11:31.235 INFO:tasks.workunit.client.1.smithi203.stdout:9/433: dwrite d8/d12/f16 [0,4194304] 0 2024-04-12T09:11:31.238 INFO:tasks.workunit.client.1.smithi203.stdout:4/557: mkdir d1a/d21/d22/d2e/d8d/db8 0 2024-04-12T09:11:31.241 INFO:tasks.workunit.client.1.smithi203.stdout:5/595: dwrite d0/d6/fb2 [0,4194304] 0 2024-04-12T09:11:31.242 INFO:tasks.workunit.client.0.smithi117.stdout:7/912: creat d0/d20/d4a/dfd/d9a/f124 x:0 0 0 2024-04-12T09:11:31.245 INFO:tasks.workunit.client.1.smithi203.stdout:5/596: write d0/d6/d11/d18/f40 [2548519,15788] 0 2024-04-12T09:11:31.246 INFO:tasks.workunit.client.0.smithi117.stdout:7/913: mknod d0/d20/c125 0 2024-04-12T09:11:31.248 INFO:tasks.workunit.client.1.smithi203.stdout:6/440: mkdir d1/d3/d26/d30/d4a/d6c/d45/d55/d90 0 2024-04-12T09:11:31.249 INFO:tasks.workunit.client.0.smithi117.stdout:7/914: stat d0/d20/d4a/d11f/d23/dac/dad/d91/dca/fe9 0 2024-04-12T09:11:31.252 INFO:tasks.workunit.client.1.smithi203.stdout:8/465: getdents d4/d8/d74/d78/d53/d8f 0 2024-04-12T09:11:31.252 INFO:tasks.workunit.client.1.smithi203.stdout:9/434: rename d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/f9d to d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/d93/fa7 0 2024-04-12T09:11:31.253 INFO:tasks.workunit.client.1.smithi203.stdout:1/543: fsync df/d2d/d6f/d75/d80/f26 0 2024-04-12T09:11:31.254 INFO:tasks.workunit.client.1.smithi203.stdout:9/435: dread - d8/d12/d23/d41/f5e zero size 2024-04-12T09:11:31.254 INFO:tasks.workunit.client.0.smithi117.stdout:7/915: fdatasync d0/d2/d45/fbe 0 2024-04-12T09:11:31.256 INFO:tasks.workunit.client.0.smithi117.stdout:7/916: dread d0/da/d7c/f103 [0,4194304] 0 2024-04-12T09:11:31.263 INFO:tasks.workunit.client.0.smithi117.stdout:7/917: rename d0/d20/d4a/d11f/d23/dac/dad/d91/dca/fe9 to d0/d20/d4a/d11f/d23/dac/dad/daa/d10c/d11a/d120/f126 0 2024-04-12T09:11:31.266 INFO:tasks.workunit.client.1.smithi203.stdout:1/544: symlink df/d59/la5 0 2024-04-12T09:11:31.269 INFO:tasks.workunit.client.1.smithi203.stdout:9/436: symlink d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d70/la8 0 2024-04-12T09:11:31.271 INFO:tasks.workunit.client.1.smithi203.stdout:3/445: dwrite d2/d51/d65/f77 [0,4194304] 0 2024-04-12T09:11:31.272 INFO:tasks.workunit.client.1.smithi203.stdout:0/526: truncate d0/dd/d71/d94/d2f/d17/f60 234672 0 2024-04-12T09:11:31.275 INFO:tasks.workunit.client.1.smithi203.stdout:0/527: truncate d0/dd/d71/d94/d2f/d17/f9e 977172 0 2024-04-12T09:11:31.276 INFO:tasks.workunit.client.1.smithi203.stdout:2/518: getdents d0/d54/d61/d78/d89 0 2024-04-12T09:11:31.276 INFO:tasks.workunit.client.1.smithi203.stdout:7/504: write d0/d4/d54/d75/f9a [168530,25674] 0 2024-04-12T09:11:31.277 INFO:tasks.workunit.client.1.smithi203.stdout:1/545: rename df/d2d/d6f/d75/d80/d2b/c39 to df/d2d/d6f/d75/d80/d54/d5d/d67/ca6 0 2024-04-12T09:11:31.278 INFO:tasks.workunit.client.1.smithi203.stdout:2/519: chown d0/d14/d1e/d57/d95 8779215 1 2024-04-12T09:11:31.279 INFO:tasks.workunit.client.1.smithi203.stdout:4/558: getdents d1a/d21/d60 0 2024-04-12T09:11:31.279 INFO:tasks.workunit.client.1.smithi203.stdout:8/466: dread d4/d8/d74/d78/f6d [0,4194304] 0 2024-04-12T09:11:31.280 INFO:tasks.workunit.client.1.smithi203.stdout:9/437: mkdir d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/da9 0 2024-04-12T09:11:31.280 INFO:tasks.workunit.client.1.smithi203.stdout:2/520: chown d0/d14/d1e 1885130023 1 2024-04-12T09:11:31.284 INFO:tasks.workunit.client.1.smithi203.stdout:5/597: creat d0/d6/d11/d1e/fd9 x:0 0 0 2024-04-12T09:11:31.286 INFO:tasks.workunit.client.1.smithi203.stdout:3/446: link d2/f30 d2/d8/d14/f90 0 2024-04-12T09:11:31.287 INFO:tasks.workunit.client.1.smithi203.stdout:0/528: dwrite d0/dd/d4d/f6c [0,4194304] 0 2024-04-12T09:11:31.288 INFO:tasks.workunit.client.1.smithi203.stdout:9/438: chown d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/f9f 373187 1 2024-04-12T09:11:31.289 INFO:tasks.workunit.client.1.smithi203.stdout:7/505: rename d0/d15/d2d/f32 to d0/d38/d79/fbd 0 2024-04-12T09:11:31.290 INFO:tasks.workunit.client.1.smithi203.stdout:6/441: getdents d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43 0 2024-04-12T09:11:31.291 INFO:tasks.workunit.client.1.smithi203.stdout:9/439: stat d8/d12/d23/d41/f5e 0 2024-04-12T09:11:31.291 INFO:tasks.workunit.client.1.smithi203.stdout:4/559: mkdir d1a/d21/d60/d68/db9 0 2024-04-12T09:11:31.293 INFO:tasks.workunit.client.1.smithi203.stdout:1/546: mkdir df/d2d/d6f/d8d/da7 0 2024-04-12T09:11:31.295 INFO:tasks.workunit.client.1.smithi203.stdout:8/467: dwrite d4/d8/d74/d78/f54 [4194304,4194304] 0 2024-04-12T09:11:31.296 INFO:tasks.workunit.client.1.smithi203.stdout:5/598: mkdir d0/d6/d16/d44/dda 0 2024-04-12T09:11:31.301 INFO:tasks.workunit.client.1.smithi203.stdout:0/529: creat d0/dd/d71/d94/d2f/d34/fa8 x:0 0 0 2024-04-12T09:11:31.303 INFO:tasks.workunit.client.0.smithi117.stdout:7/918: dwrite d0/d20/d4a/d11f/d23/d50/f3b [0,4194304] 0 2024-04-12T09:11:31.304 INFO:tasks.workunit.client.1.smithi203.stdout:7/506: rmdir d0/d4/d54/dac 39 2024-04-12T09:11:31.305 INFO:tasks.workunit.client.1.smithi203.stdout:7/507: stat d0/d4/d1c/d5b/l95 0 2024-04-12T09:11:31.306 INFO:tasks.workunit.client.1.smithi203.stdout:9/440: dread - d8/d3b/f4b zero size 2024-04-12T09:11:31.307 INFO:tasks.workunit.client.1.smithi203.stdout:4/560: creat d1a/d21/d22/d2e/d8d/fba x:0 0 0 2024-04-12T09:11:31.311 INFO:tasks.workunit.client.0.smithi117.stdout:7/919: rename d0/d20/d4a/d11f/d23/d50/d5c/lab to d0/d20/d4a/dfd/d9a/l127 0 2024-04-12T09:11:31.312 INFO:tasks.workunit.client.1.smithi203.stdout:6/442: dread d1/d3/f39 [0,4194304] 0 2024-04-12T09:11:31.313 INFO:tasks.workunit.client.1.smithi203.stdout:8/468: rmdir d4/d8/d1c 39 2024-04-12T09:11:31.315 INFO:tasks.workunit.client.1.smithi203.stdout:6/443: stat d1/d3/d26/c56 0 2024-04-12T09:11:31.317 INFO:tasks.workunit.client.0.smithi117.stdout:7/920: rename d0/da/fc9 to d0/d20/d4a/dce/dcf/f128 0 2024-04-12T09:11:31.319 INFO:tasks.workunit.client.1.smithi203.stdout:4/561: dwrite d1a/d1d/d69/f9a [0,4194304] 0 2024-04-12T09:11:31.319 INFO:tasks.workunit.client.1.smithi203.stdout:9/441: dwrite d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/f82 [0,4194304] 0 2024-04-12T09:11:31.320 INFO:tasks.workunit.client.1.smithi203.stdout:4/562: fsync d1a/d1d/fb6 0 2024-04-12T09:11:31.321 INFO:tasks.workunit.client.1.smithi203.stdout:9/442: write d8/d12/f83 [1013944,37897] 0 2024-04-12T09:11:31.321 INFO:tasks.workunit.client.1.smithi203.stdout:2/521: rename d0/d54/d61/d78/l76 to d0/d54/d61/d82/lb6 0 2024-04-12T09:11:31.322 INFO:tasks.workunit.client.0.smithi117.stdout:7/921: creat d0/d2/d1a/da7/f129 x:0 0 0 2024-04-12T09:11:31.323 INFO:tasks.workunit.client.1.smithi203.stdout:0/530: creat d0/dd/d4d/fa9 x:0 0 0 2024-04-12T09:11:31.326 INFO:tasks.workunit.client.1.smithi203.stdout:5/599: dread d0/d6/d16/d9/d30/d58/d74/fc3 [0,4194304] 0 2024-04-12T09:11:31.327 INFO:tasks.workunit.client.1.smithi203.stdout:2/522: read d0/d14/d1e/d2a/f52 [1036622,64849] 0 2024-04-12T09:11:31.332 INFO:tasks.workunit.client.0.smithi117.stdout:7/922: creat d0/d20/d4a/d11f/d23/df1/f12a x:0 0 0 2024-04-12T09:11:31.333 INFO:tasks.workunit.client.1.smithi203.stdout:3/447: rmdir d2/d51/d65/d89 0 2024-04-12T09:11:31.337 INFO:tasks.workunit.client.0.smithi117.stdout:7/923: creat d0/d20/d4a/d11f/d23/dac/dad/daa/d10c/d11a/f12b x:0 0 0 2024-04-12T09:11:31.338 INFO:tasks.workunit.client.0.smithi117.stdout:2/985: sync 2024-04-12T09:11:31.338 INFO:tasks.workunit.client.0.smithi117.stdout:7/924: stat d0/d2/d45/d15/cc6 0 2024-04-12T09:11:31.340 INFO:tasks.workunit.client.1.smithi203.stdout:9/443: unlink d8/d12/d23/d38/d8a/d97/d9e/f7d 0 2024-04-12T09:11:31.341 INFO:tasks.workunit.client.1.smithi203.stdout:5/600: mknod d0/d6/d16/d9/d30/d58/d74/d88/cdb 0 2024-04-12T09:11:31.342 INFO:tasks.workunit.client.0.smithi117.stdout:2/986: rename d0/d4/d81/f124 to d0/d43/da5/f145 0 2024-04-12T09:11:31.344 INFO:tasks.workunit.client.1.smithi203.stdout:6/444: mkdir d1/d3/d91 0 2024-04-12T09:11:31.346 INFO:tasks.workunit.client.0.smithi117.stdout:7/925: creat d0/f12c x:0 0 0 2024-04-12T09:11:31.347 INFO:tasks.workunit.client.0.smithi117.stdout:7/926: stat d0/d20/d4a/d11f/d23/df1 0 2024-04-12T09:11:31.347 INFO:tasks.workunit.client.1.smithi203.stdout:4/563: dread d1a/d21/d60/fa6 [0,4194304] 0 2024-04-12T09:11:31.348 INFO:tasks.workunit.client.1.smithi203.stdout:7/508: rename d0/d15/l37 to d0/d15/d89/lbe 0 2024-04-12T09:11:31.349 INFO:tasks.workunit.client.0.smithi117.stdout:2/987: fsync d0/d43/d30/dc6/fea 0 2024-04-12T09:11:31.352 INFO:tasks.workunit.client.1.smithi203.stdout:1/547: getdents df/d2d/d6f/d75/d80/d8c/d8e 0 2024-04-12T09:11:31.353 INFO:tasks.workunit.client.1.smithi203.stdout:7/509: dwrite d0/d4/d5d/f86 [0,4194304] 0 2024-04-12T09:11:31.355 INFO:tasks.workunit.client.0.smithi117.stdout:2/988: read d0/d43/da5/d8f/fcc [358734,65756] 0 2024-04-12T09:11:31.359 INFO:tasks.workunit.client.0.smithi117.stdout:2/989: creat d0/d43/d128/f146 x:0 0 0 2024-04-12T09:11:31.360 INFO:tasks.workunit.client.0.smithi117.stdout:2/990: read - d0/d43/d53/d61/d66/f114 zero size 2024-04-12T09:11:31.360 INFO:tasks.workunit.client.1.smithi203.stdout:5/601: symlink d0/d6/d11/d18/dcc/ldc 0 2024-04-12T09:11:31.361 INFO:tasks.workunit.client.1.smithi203.stdout:8/469: write d4/d34/f47 [808380,111489] 0 2024-04-12T09:11:31.362 INFO:tasks.workunit.client.1.smithi203.stdout:6/445: creat d1/d3/d26/d30/d4a/d6c/f92 x:0 0 0 2024-04-12T09:11:31.366 INFO:tasks.workunit.client.0.smithi117.stdout:2/991: unlink d0/d43/d53/d61/d8d/d109/f13c 0 2024-04-12T09:11:31.368 INFO:tasks.workunit.client.1.smithi203.stdout:4/564: fdatasync d1a/d21/f33 0 2024-04-12T09:11:31.372 INFO:tasks.workunit.client.1.smithi203.stdout:3/448: rename d2/d8/d59 to d2/d8/d14/d23/d35/d91 0 2024-04-12T09:11:31.373 INFO:tasks.workunit.client.0.smithi117.stdout:2/992: creat d0/d96/f147 x:0 0 0 2024-04-12T09:11:31.376 INFO:tasks.workunit.client.1.smithi203.stdout:7/510: mkdir d0/d4/d1c/d5b/dbf 0 2024-04-12T09:11:31.380 INFO:tasks.workunit.client.0.smithi117.stdout:7/927: write d0/d20/d4a/d11f/d23/dac/dad/d91/f117 [942553,66767] 0 2024-04-12T09:11:31.381 INFO:tasks.workunit.client.1.smithi203.stdout:7/511: dwrite d0/f40 [4194304,4194304] 0 2024-04-12T09:11:31.382 INFO:tasks.workunit.client.1.smithi203.stdout:7/512: chown d0/d38/d51/l84 24155 1 2024-04-12T09:11:31.383 INFO:tasks.workunit.client.1.smithi203.stdout:7/513: chown d0/d4/d1c/c22 45 1 2024-04-12T09:11:31.384 INFO:tasks.workunit.client.1.smithi203.stdout:0/531: truncate d0/dd/f70 207277 0 2024-04-12T09:11:31.385 INFO:tasks.workunit.client.1.smithi203.stdout:8/470: dread d4/d8/f50 [0,4194304] 0 2024-04-12T09:11:31.386 INFO:tasks.workunit.client.1.smithi203.stdout:8/471: chown d4/f5a 88 1 2024-04-12T09:11:31.386 INFO:tasks.workunit.client.1.smithi203.stdout:4/565: symlink d1a/d34/lbb 0 2024-04-12T09:11:31.386 INFO:tasks.workunit.client.1.smithi203.stdout:4/566: chown d1a/d2b 246620 1 2024-04-12T09:11:31.387 INFO:tasks.workunit.client.1.smithi203.stdout:3/449: mkdir d2/d8/d14/d23/d35/d91/d87/d92 0 2024-04-12T09:11:31.391 INFO:tasks.workunit.client.0.smithi117.stdout:7/928: creat d0/d20/d4a/d11f/d23/dac/f12d x:0 0 0 2024-04-12T09:11:31.392 INFO:tasks.workunit.client.0.smithi117.stdout:7/929: stat d0/d20/d4a/d11f/d23/d39/dbd/lf0 0 2024-04-12T09:11:31.393 INFO:tasks.workunit.client.1.smithi203.stdout:2/523: getdents d0/d3 0 2024-04-12T09:11:31.394 INFO:tasks.workunit.client.0.smithi117.stdout:2/993: write d0/d4/f4d [706772,29257] 0 2024-04-12T09:11:31.394 INFO:tasks.workunit.client.1.smithi203.stdout:2/524: read d0/d14/d1e/f48 [250422,77284] 0 2024-04-12T09:11:31.394 INFO:tasks.workunit.client.1.smithi203.stdout:9/444: write d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/f59 [344672,14902] 0 2024-04-12T09:11:31.395 INFO:tasks.workunit.client.0.smithi117.stdout:7/930: symlink d0/d2/d45/d53/l12e 0 2024-04-12T09:11:31.396 INFO:tasks.workunit.client.1.smithi203.stdout:0/532: mknod d0/dd/d5b/d9f/caa 0 2024-04-12T09:11:31.397 INFO:tasks.workunit.client.1.smithi203.stdout:2/525: write d0/d3/d47/f73 [4007810,15537] 0 2024-04-12T09:11:31.397 INFO:tasks.workunit.client.1.smithi203.stdout:6/446: write d1/d3/d26/d30/d4a/d6c/f5a [882138,44725] 0 2024-04-12T09:11:31.397 INFO:tasks.workunit.client.0.smithi117.stdout:2/994: mkdir d0/d4/d81/d10d/d148 0 2024-04-12T09:11:31.398 INFO:tasks.workunit.client.0.smithi117.stdout:2/995: chown d0/d4/d10/d27/fd4 24886 1 2024-04-12T09:11:31.400 INFO:tasks.workunit.client.1.smithi203.stdout:8/472: rename d4/d34/d79 to d4/d8/d81/d84/d92 0 2024-04-12T09:11:31.401 INFO:tasks.workunit.client.1.smithi203.stdout:2/526: write d0/d14/d74/f84 [2368267,3667] 0 2024-04-12T09:11:31.403 INFO:tasks.workunit.client.1.smithi203.stdout:7/514: dwrite d0/d4/d1c/f35 [0,4194304] 0 2024-04-12T09:11:31.404 INFO:tasks.workunit.client.1.smithi203.stdout:3/450: mknod d2/d8/d14/d23/d35/d91/c93 0 2024-04-12T09:11:31.404 INFO:tasks.workunit.client.1.smithi203.stdout:2/527: chown d0/d14/d23/d3d/c59 778959 1 2024-04-12T09:11:31.405 INFO:tasks.workunit.client.1.smithi203.stdout:7/515: dread - d0/d38/fb6 zero size 2024-04-12T09:11:31.405 INFO:tasks.workunit.client.0.smithi117.stdout:2/996: mknod d0/d43/d30/dc6/c149 0 2024-04-12T09:11:31.412 INFO:tasks.workunit.client.0.smithi117.stdout:2/997: fdatasync d0/d43/d53/d61/d66/f79 0 2024-04-12T09:11:31.417 INFO:tasks.workunit.client.0.smithi117.stdout:2/998: symlink d0/d43/d128/l14a 0 2024-04-12T09:11:31.418 INFO:tasks.workunit.client.0.smithi117.stdout:7/931: truncate d0/d20/d4a/d11f/d23/dac/dad/d91/f117 593644 0 2024-04-12T09:11:31.420 INFO:tasks.workunit.client.1.smithi203.stdout:0/533: dread d0/dd/d71/d94/d2f/d4c/f4f [0,4194304] 0 2024-04-12T09:11:31.422 INFO:tasks.workunit.client.0.smithi117.stdout:2/999: creat d0/d43/d30/d41/dfa/f14b x:0 0 0 2024-04-12T09:11:31.425 INFO:tasks.workunit.client.1.smithi203.stdout:4/567: truncate d1a/d20/d5f/f7a 2326912 0 2024-04-12T09:11:31.431 INFO:tasks.workunit.client.1.smithi203.stdout:3/451: mkdir d2/d8/d14/d23/d35/d94 0 2024-04-12T09:11:31.431 INFO:tasks.workunit.client.1.smithi203.stdout:3/452: write d2/d8/d14/d23/d35/d91/f60 [827661,21381] 0 2024-04-12T09:11:31.431 INFO:tasks.workunit.client.1.smithi203.stdout:2/528: dread d0/d3/d47/f73 [0,4194304] 0 2024-04-12T09:11:31.431 INFO:tasks.workunit.client.1.smithi203.stdout:7/516: rename d0/d4/d54/d8d to d0/d4/d54/d75/dc0 0 2024-04-12T09:11:31.432 INFO:tasks.workunit.client.1.smithi203.stdout:9/445: mknod d8/d12/d3e/caa 0 2024-04-12T09:11:31.433 INFO:tasks.workunit.client.1.smithi203.stdout:9/446: fdatasync f5 0 2024-04-12T09:11:31.433 INFO:tasks.workunit.client.1.smithi203.stdout:7/517: dread - d0/d4/d1c/f9d zero size 2024-04-12T09:11:31.433 INFO:tasks.workunit.client.0.smithi117.stdout:7/932: write d0/d2/d1a/d5f/f7f [430060,21023] 0 2024-04-12T09:11:31.435 INFO:tasks.workunit.client.1.smithi203.stdout:6/447: dwrite d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d3a/f60 [0,4194304] 0 2024-04-12T09:11:31.440 INFO:tasks.workunit.client.1.smithi203.stdout:4/568: rename d1a/d21/d22/d4e to d1a/d21/d22/d2e/d8d/d9b/dbc 0 2024-04-12T09:11:31.440 INFO:tasks.workunit.client.1.smithi203.stdout:9/447: dwrite d8/d12/f16 [0,4194304] 0 2024-04-12T09:11:31.440 INFO:tasks.workunit.client.1.smithi203.stdout:4/569: fsync d1a/d20/d5d/f84 0 2024-04-12T09:11:31.442 INFO:tasks.workunit.client.1.smithi203.stdout:7/518: read d0/d38/d51/fa4 [33854,92606] 0 2024-04-12T09:11:31.445 INFO:tasks.workunit.client.1.smithi203.stdout:8/473: creat d4/d8/d37/f93 x:0 0 0 2024-04-12T09:11:31.446 INFO:tasks.workunit.client.1.smithi203.stdout:0/534: write d0/dd/f1b [2690084,51219] 0 2024-04-12T09:11:31.447 INFO:tasks.workunit.client.1.smithi203.stdout:0/535: chown d0/d59/f91 0 1 2024-04-12T09:11:31.447 INFO:tasks.workunit.client.1.smithi203.stdout:8/474: write d4/d8/f7b [1580204,97926] 0 2024-04-12T09:11:31.447 INFO:tasks.workunit.client.0.smithi117.stdout:7/933: write d0/d20/d4a/d11f/d23/dac/f113 [1134339,106733] 0 2024-04-12T09:11:31.448 INFO:tasks.workunit.client.1.smithi203.stdout:1/548: sync 2024-04-12T09:11:31.449 INFO:tasks.workunit.client.1.smithi203.stdout:1/549: chown lc 181122431 1 2024-04-12T09:11:31.449 INFO:tasks.workunit.client.1.smithi203.stdout:0/536: fsync d0/dd/d71/d94/f68 0 2024-04-12T09:11:31.450 INFO:tasks.workunit.client.1.smithi203.stdout:2/529: mkdir d0/d54/d61/db7 0 2024-04-12T09:11:31.450 INFO:tasks.workunit.client.0.smithi117.stdout:7/934: truncate d0/d2/f6f 1771712 0 2024-04-12T09:11:31.451 INFO:tasks.workunit.client.1.smithi203.stdout:4/570: rmdir d1a/d20/d5d/d2c 39 2024-04-12T09:11:31.451 INFO:tasks.workunit.client.1.smithi203.stdout:6/448: write d1/d3/f2d [674254,71465] 0 2024-04-12T09:11:31.452 INFO:tasks.workunit.client.1.smithi203.stdout:9/448: creat d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d70/fab x:0 0 0 2024-04-12T09:11:31.453 INFO:tasks.workunit.client.1.smithi203.stdout:7/519: symlink d0/d4/d1c/d3b/d4c/lc1 0 2024-04-12T09:11:31.453 INFO:tasks.workunit.client.0.smithi117.stdout:7/935: write d0/d20/d4a/dce/dcf/f128 [217254,58671] 0 2024-04-12T09:11:31.454 INFO:tasks.workunit.client.1.smithi203.stdout:0/537: truncate d0/dd/d71/d94/d2f/f8f 508328 0 2024-04-12T09:11:31.454 INFO:tasks.workunit.client.1.smithi203.stdout:4/571: truncate d1a/d21/d22/d2e/f3c 2551697 0 2024-04-12T09:11:31.455 INFO:tasks.workunit.client.1.smithi203.stdout:0/538: dread - d0/d48/d5e/d84/fa4 zero size 2024-04-12T09:11:31.458 INFO:tasks.workunit.client.0.smithi117.stdout:7/936: creat d0/d20/d4a/d11f/d23/d51/f12f x:0 0 0 2024-04-12T09:11:31.460 INFO:tasks.workunit.client.0.smithi117.stdout:7/937: chown d0/d20/d4a/d11f/d23/d50/d5c/f107 44 1 2024-04-12T09:11:31.460 INFO:tasks.workunit.client.1.smithi203.stdout:9/449: dwrite d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d70/f9c [0,4194304] 0 2024-04-12T09:11:31.463 INFO:tasks.workunit.client.1.smithi203.stdout:7/520: creat d0/d15/d2d/fc2 x:0 0 0 2024-04-12T09:11:31.465 INFO:tasks.workunit.client.1.smithi203.stdout:3/453: rename d2/d8/d14/d23/d35/d91/d87 to d2/d8/d14/d1b/d95 0 2024-04-12T09:11:31.466 INFO:tasks.workunit.client.0.smithi117.stdout:7/938: mknod d0/d20/d4a/d11f/d23/d39/d6c/c130 0 2024-04-12T09:11:31.468 INFO:tasks.workunit.client.1.smithi203.stdout:0/539: symlink d0/dd/d71/lab 0 2024-04-12T09:11:31.469 INFO:tasks.workunit.client.1.smithi203.stdout:0/540: readlink d0/dd/la6 0 2024-04-12T09:11:31.472 INFO:tasks.workunit.client.1.smithi203.stdout:6/449: dwrite d1/d3/d12/f5e [0,4194304] 0 2024-04-12T09:11:31.477 INFO:tasks.workunit.client.1.smithi203.stdout:7/521: fsync d0/d15/f63 0 2024-04-12T09:11:31.479 INFO:tasks.workunit.client.1.smithi203.stdout:1/550: rename df/d2d/d6f/d75/d80/d54/f40 to df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/fa8 0 2024-04-12T09:11:31.484 INFO:tasks.workunit.client.1.smithi203.stdout:6/450: dwrite d1/d3/d4/f88 [0,4194304] 0 2024-04-12T09:11:31.485 INFO:tasks.workunit.client.1.smithi203.stdout:6/451: fsync d1/df/f38 0 2024-04-12T09:11:31.486 INFO:tasks.workunit.client.1.smithi203.stdout:2/530: dwrite d0/d38/d43/f5a [0,4194304] 0 2024-04-12T09:11:31.490 INFO:tasks.workunit.client.1.smithi203.stdout:8/475: rename d4/d8/d37/d57/d7d/f6c to d4/d8/d1c/d5d/f94 0 2024-04-12T09:11:31.490 INFO:tasks.workunit.client.0.smithi117.stdout:7/939: dwrite d0/d2/d96/d98/fd3 [0,4194304] 0 2024-04-12T09:11:31.491 INFO:tasks.workunit.client.1.smithi203.stdout:0/541: write d0/f36 [3257421,76665] 0 2024-04-12T09:11:31.492 INFO:tasks.workunit.client.0.smithi117.stdout:7/940: dread - d0/d20/d4a/d11f/d23/df1/f12a zero size 2024-04-12T09:11:31.493 INFO:tasks.workunit.client.1.smithi203.stdout:0/542: chown d0/dd/d71/d94/d2f/d17 31 1 2024-04-12T09:11:31.496 INFO:tasks.workunit.client.1.smithi203.stdout:1/551: fdatasync df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/fa8 0 2024-04-12T09:11:31.500 INFO:tasks.workunit.client.1.smithi203.stdout:6/452: creat d1/d3/d26/d30/d4a/d6c/d45/d55/d77/f93 x:0 0 0 2024-04-12T09:11:31.500 INFO:tasks.workunit.client.1.smithi203.stdout:0/543: dwrite d0/dd/d4d/fa9 [0,4194304] 0 2024-04-12T09:11:31.501 INFO:tasks.workunit.client.1.smithi203.stdout:3/454: dread d2/f18 [0,4194304] 0 2024-04-12T09:11:31.502 INFO:tasks.workunit.client.1.smithi203.stdout:6/453: chown d1/d3/d12/f1e 62189 1 2024-04-12T09:11:31.502 INFO:tasks.workunit.client.0.smithi117.stdout:7/941: rename d0/d2/d45/lba to d0/d2/d45/d15/d114/l131 0 2024-04-12T09:11:31.504 INFO:tasks.workunit.client.1.smithi203.stdout:2/531: mknod d0/d54/cb8 0 2024-04-12T09:11:31.505 INFO:tasks.workunit.client.0.smithi117.stdout:7/942: write d0/d20/d4a/d11f/f31 [4532330,96594] 0 2024-04-12T09:11:31.506 INFO:tasks.workunit.client.1.smithi203.stdout:9/450: getdents d8/d12/d23/d41 0 2024-04-12T09:11:31.509 INFO:tasks.workunit.client.1.smithi203.stdout:1/552: mknod df/d2d/d6f/d75/d80/d54/d5d/d58/ca9 0 2024-04-12T09:11:31.509 INFO:tasks.workunit.client.1.smithi203.stdout:8/476: write d4/d8/d74/d78/f25 [3076920,8791] 0 2024-04-12T09:11:31.511 INFO:tasks.workunit.client.0.smithi117.stdout:7/943: rename d0/d20/d4a/d11f/d23/d50/f3b to d0/da/d9b/d108/f132 0 2024-04-12T09:11:31.513 INFO:tasks.workunit.client.1.smithi203.stdout:8/477: dread - d4/d8/d1c/f30 zero size 2024-04-12T09:11:31.515 INFO:tasks.workunit.client.1.smithi203.stdout:9/451: dwrite d8/f2a [0,4194304] 0 2024-04-12T09:11:31.516 INFO:tasks.workunit.client.1.smithi203.stdout:3/455: read d2/d8/d14/d23/d35/d91/f7a [3067246,100980] 0 2024-04-12T09:11:31.517 INFO:tasks.workunit.client.1.smithi203.stdout:9/452: read - d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/f9a zero size 2024-04-12T09:11:31.520 INFO:tasks.workunit.client.0.smithi117.stdout:7/944: dwrite d0/d20/d4a/d11f/d23/dac/dad/d91/f117 [0,4194304] 0 2024-04-12T09:11:31.522 INFO:tasks.workunit.client.1.smithi203.stdout:7/522: getdents d0/d38/d79 0 2024-04-12T09:11:31.526 INFO:tasks.workunit.client.1.smithi203.stdout:1/553: rename df/d2d/d6f/d75/d80/d54/d5d/d4a to df/d2d/d6f/daa 0 2024-04-12T09:11:31.528 INFO:tasks.workunit.client.1.smithi203.stdout:1/554: truncate df/d2d/f32 4897313 0 2024-04-12T09:11:31.529 INFO:tasks.workunit.client.1.smithi203.stdout:1/555: stat df/d2d/d6f/d75/d80/d8c/d8e 0 2024-04-12T09:11:31.529 INFO:tasks.workunit.client.1.smithi203.stdout:3/456: mknod d2/d8/d14/d23/d35/d4c/d5c/c96 0 2024-04-12T09:11:31.531 INFO:tasks.workunit.client.1.smithi203.stdout:0/544: truncate d0/dd/d71/d94/f68 2816398 0 2024-04-12T09:11:31.533 INFO:tasks.workunit.client.1.smithi203.stdout:2/532: mknod d0/d54/dad/cb9 0 2024-04-12T09:11:31.534 INFO:tasks.workunit.client.1.smithi203.stdout:3/457: fdatasync d2/f30 0 2024-04-12T09:11:31.536 INFO:tasks.workunit.client.1.smithi203.stdout:1/556: rmdir df/d2d/d6f/d75/d80/d2b 39 2024-04-12T09:11:31.538 INFO:tasks.workunit.client.1.smithi203.stdout:7/523: mkdir d0/d4/d1c/d5b/dbf/dc3 0 2024-04-12T09:11:31.539 INFO:tasks.workunit.client.1.smithi203.stdout:1/557: dread df/d2d/f32 [0,4194304] 0 2024-04-12T09:11:31.540 INFO:tasks.workunit.client.1.smithi203.stdout:1/558: write df/f1e [2029616,90057] 0 2024-04-12T09:11:31.541 INFO:tasks.workunit.client.1.smithi203.stdout:2/533: symlink d0/d14/d1e/d2a/lba 0 2024-04-12T09:11:31.542 INFO:tasks.workunit.client.1.smithi203.stdout:6/454: dread d1/d3/d26/d30/d4a/d6c/f40 [4194304,4194304] 0 2024-04-12T09:11:31.544 INFO:tasks.workunit.client.1.smithi203.stdout:6/455: truncate d1/d3/d26/d5d/f8b 872242 0 2024-04-12T09:11:31.544 INFO:tasks.workunit.client.1.smithi203.stdout:3/458: symlink d2/d8/d14/d23/d35/d4c/d67/d86/l97 0 2024-04-12T09:11:31.546 INFO:tasks.workunit.client.1.smithi203.stdout:3/459: chown d2/d8/d14/d23/d35/d4c/d5c/f4d 18 1 2024-04-12T09:11:31.548 INFO:tasks.workunit.client.1.smithi203.stdout:0/545: mknod d0/dd/d5b/d90/cac 0 2024-04-12T09:11:31.549 INFO:tasks.workunit.client.1.smithi203.stdout:0/546: write d0/dd/d71/d94/d2f/d17/fa [2102470,12582] 0 2024-04-12T09:11:31.550 INFO:tasks.workunit.client.1.smithi203.stdout:0/547: write d0/dd/d71/d94/f5f [785366,30802] 0 2024-04-12T09:11:31.551 INFO:tasks.workunit.client.1.smithi203.stdout:0/548: stat d0/dd/d71/d94/d2f/d34/d98 0 2024-04-12T09:11:31.551 INFO:tasks.workunit.client.1.smithi203.stdout:6/456: rmdir d1/d3/d4 39 2024-04-12T09:11:31.552 INFO:tasks.workunit.client.1.smithi203.stdout:0/549: chown d0/dd/d71/d94/c2a 0 1 2024-04-12T09:11:31.554 INFO:tasks.workunit.client.1.smithi203.stdout:3/460: creat d2/d51/d65/f98 x:0 0 0 2024-04-12T09:11:31.555 INFO:tasks.workunit.client.1.smithi203.stdout:9/453: getdents d8/d12/d23/d38/d8a/d97/d9e/d74 0 2024-04-12T09:11:31.555 INFO:tasks.workunit.client.1.smithi203.stdout:3/461: write d2/d64/f80 [415139,72518] 0 2024-04-12T09:11:31.556 INFO:tasks.workunit.client.1.smithi203.stdout:5/602: sync 2024-04-12T09:11:31.558 INFO:tasks.workunit.client.1.smithi203.stdout:1/559: symlink df/d2d/d6f/d75/d80/d8c/d8e/d9b/lab 0 2024-04-12T09:11:31.559 INFO:tasks.workunit.client.1.smithi203.stdout:1/560: fsync df/f16 0 2024-04-12T09:11:31.562 INFO:tasks.workunit.client.1.smithi203.stdout:3/462: dwrite d2/d8/f33 [0,4194304] 0 2024-04-12T09:11:31.563 INFO:tasks.workunit.client.0.smithi117.stdout:7/945: dread d0/d20/d4a/d11f/d23/d39/f78 [0,4194304] 0 2024-04-12T09:11:31.565 INFO:tasks.workunit.client.1.smithi203.stdout:3/463: dread d2/d8/d14/d23/d35/d4c/d5c/f38 [0,4194304] 0 2024-04-12T09:11:31.565 INFO:tasks.workunit.client.1.smithi203.stdout:3/464: stat d2/d8/f39 0 2024-04-12T09:11:31.566 INFO:tasks.workunit.client.1.smithi203.stdout:2/534: creat d0/d38/fbb x:0 0 0 2024-04-12T09:11:31.568 INFO:tasks.workunit.client.1.smithi203.stdout:1/561: unlink df/d2d/d6f/d75/d80/c8a 0 2024-04-12T09:11:31.568 INFO:tasks.workunit.client.1.smithi203.stdout:1/562: chown df/d2d/d6f/d8d/da7 188126 1 2024-04-12T09:11:31.570 INFO:tasks.workunit.client.0.smithi117.stdout:7/946: mknod d0/d20/d4a/dfd/d9a/c133 0 2024-04-12T09:11:31.573 INFO:tasks.workunit.client.1.smithi203.stdout:0/550: creat d0/dd/d71/d94/d2f/d4c/d7a/fad x:0 0 0 2024-04-12T09:11:31.574 INFO:tasks.workunit.client.1.smithi203.stdout:6/457: dread d1/d3/d26/d30/d4a/d6c/f44 [0,4194304] 0 2024-04-12T09:11:31.575 INFO:tasks.workunit.client.1.smithi203.stdout:6/458: readlink d1/d3/d26/d30/d4a/d6c/l5f 0 2024-04-12T09:11:31.578 INFO:tasks.workunit.client.0.smithi117.stdout:7/947: unlink d0/f2b 0 2024-04-12T09:11:31.580 INFO:tasks.workunit.client.1.smithi203.stdout:2/535: rename d0/lf to d0/d14/d1e/d2a/lbc 0 2024-04-12T09:11:31.581 INFO:tasks.workunit.client.1.smithi203.stdout:1/563: creat df/d2d/d6f/fac x:0 0 0 2024-04-12T09:11:31.586 INFO:tasks.workunit.client.0.smithi117.stdout:7/948: creat d0/d20/d4a/d11f/d23/d39/dbd/d111/f134 x:0 0 0 2024-04-12T09:11:31.587 INFO:tasks.workunit.client.0.smithi117.stdout:7/949: chown d0/d20/d4a/dfd/df2/fda 22 1 2024-04-12T09:11:31.589 INFO:tasks.workunit.client.1.smithi203.stdout:6/459: fdatasync d1/d3/d5b/d8c/f23 0 2024-04-12T09:11:31.589 INFO:tasks.workunit.client.1.smithi203.stdout:1/564: dread df/f5b [0,4194304] 0 2024-04-12T09:11:31.590 INFO:tasks.workunit.client.1.smithi203.stdout:3/465: mknod d2/d8/d14/d1b/d2f/c99 0 2024-04-12T09:11:31.593 INFO:tasks.workunit.client.1.smithi203.stdout:5/603: dwrite d0/d6/d16/d9/d14/f25 [0,4194304] 0 2024-04-12T09:11:31.596 INFO:tasks.workunit.client.1.smithi203.stdout:0/551: write d0/dd/f16 [2931954,33139] 0 2024-04-12T09:11:31.597 INFO:tasks.workunit.client.1.smithi203.stdout:0/552: write d0/dd/d71/d94/f5f [843636,114729] 0 2024-04-12T09:11:31.598 INFO:tasks.workunit.client.1.smithi203.stdout:6/460: mknod d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/c94 0 2024-04-12T09:11:31.600 INFO:tasks.workunit.client.1.smithi203.stdout:1/565: creat df/d2d/d6f/d75/d80/d54/d5d/d58/d94/fad x:0 0 0 2024-04-12T09:11:31.600 INFO:tasks.workunit.client.1.smithi203.stdout:0/553: stat d0/dd/d40/l43 0 2024-04-12T09:11:31.600 INFO:tasks.workunit.client.1.smithi203.stdout:6/461: chown d1/df/d87 1722841 1 2024-04-12T09:11:31.601 INFO:tasks.workunit.client.1.smithi203.stdout:0/554: fdatasync d0/dd/d71/d94/f3d 0 2024-04-12T09:11:31.602 INFO:tasks.workunit.client.1.smithi203.stdout:1/566: chown df/d2d/d6f/d75/f9e 12 1 2024-04-12T09:11:31.604 INFO:tasks.workunit.client.0.smithi117.stdout:7/950: dwrite d0/d2/d1a/d49/f4e [0,4194304] 0 2024-04-12T09:11:31.607 INFO:tasks.workunit.client.1.smithi203.stdout:2/536: dread d0/d3/f36 [4194304,4194304] 0 2024-04-12T09:11:31.607 INFO:tasks.workunit.client.1.smithi203.stdout:6/462: dwrite d1/d3/d26/d30/d4a/d6c/d45/f49 [0,4194304] 0 2024-04-12T09:11:31.609 INFO:tasks.workunit.client.1.smithi203.stdout:6/463: dread - d1/d3/d26/d30/f7c zero size 2024-04-12T09:11:31.611 INFO:tasks.workunit.client.0.smithi117.stdout:7/951: creat d0/d2/d12/f135 x:0 0 0 2024-04-12T09:11:31.614 INFO:tasks.workunit.client.1.smithi203.stdout:1/567: chown df/d2d/c3e 21127199 1 2024-04-12T09:11:31.615 INFO:tasks.workunit.client.1.smithi203.stdout:3/466: truncate d2/d8/d14/d23/d35/d4c/d5c/f34 2690913 0 2024-04-12T09:11:31.616 INFO:tasks.workunit.client.1.smithi203.stdout:0/555: rmdir d0/dd/d5b 39 2024-04-12T09:11:31.619 INFO:tasks.workunit.client.1.smithi203.stdout:6/464: dwrite d1/d3/d12/f84 [0,4194304] 0 2024-04-12T09:11:31.620 INFO:tasks.workunit.client.1.smithi203.stdout:3/467: chown d2/d8/d14/d1b/d2f/f32 20053624 1 2024-04-12T09:11:31.620 INFO:tasks.workunit.client.1.smithi203.stdout:2/537: creat d0/d54/d61/d78/d89/fbd x:0 0 0 2024-04-12T09:11:31.624 INFO:tasks.workunit.client.1.smithi203.stdout:5/604: dwrite d0/d6/d11/d18/d2a/f2b [0,4194304] 0 2024-04-12T09:11:31.626 INFO:tasks.workunit.client.1.smithi203.stdout:6/465: symlink d1/d3/d5b/d8c/d3e/l95 0 2024-04-12T09:11:31.627 INFO:tasks.workunit.client.1.smithi203.stdout:2/538: write d0/d54/d61/d82/fb5 [778482,17692] 0 2024-04-12T09:11:31.629 INFO:tasks.workunit.client.1.smithi203.stdout:0/556: rename d0/dd/d71/d94/d2f/d17/l3c to d0/dd/d71/d94/d2f/d34/lae 0 2024-04-12T09:11:31.634 INFO:tasks.workunit.client.1.smithi203.stdout:2/539: chown d0/d54/d61/d82/l8d 0 1 2024-04-12T09:11:31.634 INFO:tasks.workunit.client.1.smithi203.stdout:3/468: creat d2/d8/d14/d23/d35/d4c/d5c/f9a x:0 0 0 2024-04-12T09:11:31.634 INFO:tasks.workunit.client.1.smithi203.stdout:1/568: dwrite df/d2d/d6f/d75/d80/d2b/f44 [4194304,4194304] 0 2024-04-12T09:11:31.637 INFO:tasks.workunit.client.1.smithi203.stdout:3/469: fsync d2/d8/d14/d23/d35/d91/d81/f84 0 2024-04-12T09:11:31.637 INFO:tasks.workunit.client.1.smithi203.stdout:2/540: write d0/d14/d1e/d57/d95/fb0 [66206,6032] 0 2024-04-12T09:11:31.639 INFO:tasks.workunit.client.1.smithi203.stdout:6/466: dread d1/d3/f39 [0,4194304] 0 2024-04-12T09:11:31.641 INFO:tasks.workunit.client.1.smithi203.stdout:0/557: symlink d0/d48/d5e/d84/laf 0 2024-04-12T09:11:31.641 INFO:tasks.workunit.client.1.smithi203.stdout:6/467: read d1/d3/d26/d30/d4a/d6c/d45/f52 [2510416,5651] 0 2024-04-12T09:11:31.647 INFO:tasks.workunit.client.1.smithi203.stdout:5/605: link d0/d6/d11/f69 d0/d6/d11/d18/dcc/fdd 0 2024-04-12T09:11:31.648 INFO:tasks.workunit.client.1.smithi203.stdout:1/569: truncate df/d2d/d6f/d75/d80/d54/d5d/d58/f66 890989 0 2024-04-12T09:11:31.652 INFO:tasks.workunit.client.1.smithi203.stdout:2/541: symlink d0/d14/d74/d96/d9a/lbe 0 2024-04-12T09:11:31.653 INFO:tasks.workunit.client.1.smithi203.stdout:5/606: creat d0/d6/d11/d1e/d4c/d6a/fde x:0 0 0 2024-04-12T09:11:31.654 INFO:tasks.workunit.client.1.smithi203.stdout:5/607: chown d0/d6/d11/d38/lb1 27 1 2024-04-12T09:11:31.655 INFO:tasks.workunit.client.0.smithi117.stdout:7/952: dread d0/d2/d45/f42 [4194304,4194304] 0 2024-04-12T09:11:31.655 INFO:tasks.workunit.client.1.smithi203.stdout:2/542: chown d0/d14/d23/d33/lab 24449 1 2024-04-12T09:11:31.656 INFO:tasks.workunit.client.1.smithi203.stdout:1/570: symlink df/d2d/d6f/d8d/da7/lae 0 2024-04-12T09:11:31.658 INFO:tasks.workunit.client.1.smithi203.stdout:2/543: rmdir d0/d54/d61/d78/d89 39 2024-04-12T09:11:31.658 INFO:tasks.workunit.client.1.smithi203.stdout:0/558: dread d0/f36 [0,4194304] 0 2024-04-12T09:11:31.661 INFO:tasks.workunit.client.1.smithi203.stdout:5/608: creat d0/d6/d16/d9/fdf x:0 0 0 2024-04-12T09:11:31.664 INFO:tasks.workunit.client.0.smithi117.stdout:7/953: link d0/d20/d4a/d11f/d23/d51/f12f d0/d20/d4a/d11f/d7a/f136 0 2024-04-12T09:11:31.667 INFO:tasks.workunit.client.1.smithi203.stdout:5/609: rmdir d0/d6/d16/d9/d14 39 2024-04-12T09:11:31.669 INFO:tasks.workunit.client.1.smithi203.stdout:5/610: read d0/d6/d16/d9/fa4 [271820,87961] 0 2024-04-12T09:11:31.669 INFO:tasks.workunit.client.1.smithi203.stdout:2/544: rename d0/d54/dad/c4d to d0/d54/d61/d78/d89/cbf 0 2024-04-12T09:11:31.670 INFO:tasks.workunit.client.1.smithi203.stdout:0/559: dread d0/dd/d71/d94/d2f/d17/d19/f26 [0,4194304] 0 2024-04-12T09:11:31.670 INFO:tasks.workunit.client.1.smithi203.stdout:5/611: fdatasync d0/d6/d11/d1e/d4c/f64 0 2024-04-12T09:11:31.673 INFO:tasks.workunit.client.1.smithi203.stdout:3/470: dread d2/f2b [0,4194304] 0 2024-04-12T09:11:31.673 INFO:tasks.workunit.client.1.smithi203.stdout:3/471: dread - d2/d8/d14/d23/d35/d4c/d5c/d55/f66 zero size 2024-04-12T09:11:31.674 INFO:tasks.workunit.client.1.smithi203.stdout:3/472: fdatasync d2/d8/d14/d23/d35/d4c/d5c/d55/f68 0 2024-04-12T09:11:31.676 INFO:tasks.workunit.client.0.smithi117.stdout:7/954: link d0/d20/d4a/d11f/d23/d39/d6c/lc4 d0/d20/d4a/d11f/d23/dac/dad/d91/l137 0 2024-04-12T09:11:31.682 INFO:tasks.workunit.client.0.smithi117.stdout:7/955: mkdir d0/da/d9b/d138 0 2024-04-12T09:11:31.685 INFO:tasks.workunit.client.1.smithi203.stdout:4/572: sync 2024-04-12T09:11:31.686 INFO:tasks.workunit.client.1.smithi203.stdout:5/612: rename d0/d6/l2c to d0/dbd/dd0/le0 0 2024-04-12T09:11:31.686 INFO:tasks.workunit.client.1.smithi203.stdout:6/468: dwrite d1/d3/d12/f1f [0,4194304] 0 2024-04-12T09:11:31.686 INFO:tasks.workunit.client.1.smithi203.stdout:0/560: unlink d0/dd/d71/d94/d2f/l9a 0 2024-04-12T09:11:31.687 INFO:tasks.workunit.client.1.smithi203.stdout:1/571: fsync df/d2d/d6f/d75/fa0 0 2024-04-12T09:11:31.687 INFO:tasks.workunit.client.1.smithi203.stdout:6/469: stat d1/d3/d12/f1e 0 2024-04-12T09:11:31.688 INFO:tasks.workunit.client.1.smithi203.stdout:0/561: stat d0/d48/d5e/f75 0 2024-04-12T09:11:31.689 INFO:tasks.workunit.client.1.smithi203.stdout:4/573: creat d1a/d34/fbd x:0 0 0 2024-04-12T09:11:31.690 INFO:tasks.workunit.client.1.smithi203.stdout:1/572: write df/d2d/d6f/fac [57467,5602] 0 2024-04-12T09:11:31.692 INFO:tasks.workunit.client.0.smithi117.stdout:7/956: getdents d0/d20/d4a/dfd/d9a 0 2024-04-12T09:11:31.692 INFO:tasks.workunit.client.1.smithi203.stdout:6/470: mkdir d1/df/d65/d96 0 2024-04-12T09:11:31.694 INFO:tasks.workunit.client.1.smithi203.stdout:3/473: dread d2/d8/d14/d1b/d2f/f32 [0,4194304] 0 2024-04-12T09:11:31.694 INFO:tasks.workunit.client.1.smithi203.stdout:4/574: mkdir d1a/d21/d60/d68/dbe 0 2024-04-12T09:11:31.695 INFO:tasks.workunit.client.1.smithi203.stdout:6/471: truncate d1/d3/d26/f61 435245 0 2024-04-12T09:11:31.697 INFO:tasks.workunit.client.1.smithi203.stdout:5/613: rename d0/d6/d16/d9/d30/d89/lbe to d0/d6/d16/d9/d30/d58/d74/d88/le1 0 2024-04-12T09:11:31.698 INFO:tasks.workunit.client.1.smithi203.stdout:0/562: dwrite d0/dd/d71/d94/d2f/d17/fa [0,4194304] 0 2024-04-12T09:11:31.698 INFO:tasks.workunit.client.1.smithi203.stdout:5/614: stat d0/d6/d11/d18/d1a 0 2024-04-12T09:11:31.699 INFO:tasks.workunit.client.0.smithi117.stdout:7/957: creat d0/d20/d4a/d11f/d23/dac/dad/d91/dca/f139 x:0 0 0 2024-04-12T09:11:31.699 INFO:tasks.workunit.client.1.smithi203.stdout:6/472: dread d1/d3/d26/f79 [0,4194304] 0 2024-04-12T09:11:31.700 INFO:tasks.workunit.client.1.smithi203.stdout:1/573: symlink df/d2d/d6f/d75/laf 0 2024-04-12T09:11:31.705 INFO:tasks.workunit.client.1.smithi203.stdout:5/615: dread - d0/d6/d11/d18/d2a/dc8/fce zero size 2024-04-12T09:11:31.707 INFO:tasks.workunit.client.1.smithi203.stdout:6/473: unlink d1/d3/d26/d36/l73 0 2024-04-12T09:11:31.711 INFO:tasks.workunit.client.1.smithi203.stdout:0/563: truncate d0/dd/d71/d94/d2f/f33 3504917 0 2024-04-12T09:11:31.718 INFO:tasks.workunit.client.0.smithi117.stdout:7/958: dwrite d0/d20/d4a/d11f/d23/d39/f78 [0,4194304] 0 2024-04-12T09:11:31.718 INFO:tasks.workunit.client.1.smithi203.stdout:0/564: dread d0/d48/d5e/f75 [0,4194304] 0 2024-04-12T09:11:31.721 INFO:tasks.workunit.client.1.smithi203.stdout:5/616: write d0/d6/f46 [626696,34608] 0 2024-04-12T09:11:31.724 INFO:tasks.workunit.client.1.smithi203.stdout:1/574: rename df/d2d/d6f/d75/d80/d8c/d8e to df/d59/db0 0 2024-04-12T09:11:31.725 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:31 smithi203 ceph-mon[36428]: pgmap v26: 65 pgs: 65 active+clean; 2.5 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 47 MiB/s rd, 175 MiB/s wr, 335 op/s 2024-04-12T09:11:31.728 INFO:tasks.workunit.client.1.smithi203.stdout:0/565: mknod d0/dd/d71/d94/d2f/d34/d98/cb0 0 2024-04-12T09:11:31.728 INFO:tasks.workunit.client.1.smithi203.stdout:5/617: read d0/d6/d11/d18/d1a/d23/f4f [1992059,86217] 0 2024-04-12T09:11:31.728 INFO:tasks.workunit.client.1.smithi203.stdout:3/474: dwrite d2/d8/d14/d23/d35/d4c/d5c/f34 [0,4194304] 0 2024-04-12T09:11:31.730 INFO:tasks.workunit.client.1.smithi203.stdout:6/474: dwrite d1/d3/f27 [0,4194304] 0 2024-04-12T09:11:31.732 INFO:tasks.workunit.client.1.smithi203.stdout:1/575: chown df/d2d/d6f/daa/f62 2898 1 2024-04-12T09:11:31.732 INFO:tasks.workunit.client.1.smithi203.stdout:6/475: dread - d1/df/f41 zero size 2024-04-12T09:11:31.733 INFO:tasks.workunit.client.1.smithi203.stdout:5/618: mkdir d0/d6/d16/d44/de2 0 2024-04-12T09:11:31.736 INFO:tasks.workunit.client.0.smithi117.stdout:7/959: dwrite d0/da/d7c/dae/faf [0,4194304] 0 2024-04-12T09:11:31.738 INFO:tasks.workunit.client.1.smithi203.stdout:1/576: rmdir df/d2d/d6f/daa 39 2024-04-12T09:11:31.738 INFO:tasks.workunit.client.0.smithi117.stdout:7/960: dread - d0/d20/d4a/d11f/d23/df1/f12a zero size 2024-04-12T09:11:31.740 INFO:tasks.workunit.client.1.smithi203.stdout:3/475: truncate d2/d8/d14/d23/d35/d4c/d5c/f34 5172568 0 2024-04-12T09:11:31.740 INFO:tasks.workunit.client.1.smithi203.stdout:0/566: dwrite d0/d59/f87 [0,4194304] 0 2024-04-12T09:11:31.741 INFO:tasks.workunit.client.1.smithi203.stdout:5/619: readlink d0/d6/d16/d9/d30/d58/d74/d88/ld1 0 2024-04-12T09:11:31.742 INFO:tasks.workunit.client.1.smithi203.stdout:1/577: fdatasync df/d2d/d6f/d75/d80/d54/d5d/d58/d94/f97 0 2024-04-12T09:11:31.745 INFO:tasks.workunit.client.0.smithi117.stdout:7/961: truncate d0/d20/d4a/dfd/f7b 59961 0 2024-04-12T09:11:31.746 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:31 smithi117 ceph-mon[29277]: pgmap v26: 65 pgs: 65 active+clean; 2.5 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 47 MiB/s rd, 175 MiB/s wr, 335 op/s 2024-04-12T09:11:31.750 INFO:tasks.workunit.client.1.smithi203.stdout:0/567: chown d0/dd/d71/d94/d2f/d34/lae 985 1 2024-04-12T09:11:31.752 INFO:tasks.workunit.client.1.smithi203.stdout:0/568: chown d0/d59/f91 38555206 1 2024-04-12T09:11:31.752 INFO:tasks.workunit.client.1.smithi203.stdout:3/476: dwrite d2/f18 [0,4194304] 0 2024-04-12T09:11:31.752 INFO:tasks.workunit.client.1.smithi203.stdout:1/578: dread df/d2d/d6f/d75/d80/d54/d5d/fa4 [0,4194304] 0 2024-04-12T09:11:31.752 INFO:tasks.workunit.client.1.smithi203.stdout:5/620: symlink d0/d6/d11/le3 0 2024-04-12T09:11:31.753 INFO:tasks.workunit.client.1.smithi203.stdout:1/579: chown df/d2d/c3e 540 1 2024-04-12T09:11:31.754 INFO:tasks.workunit.client.1.smithi203.stdout:0/569: write d0/d48/d5e/d84/fa4 [308152,73461] 0 2024-04-12T09:11:31.754 INFO:tasks.workunit.client.1.smithi203.stdout:6/476: getdents d1/d3/d26/d30/d4a/d6c/d45/d55/d77 0 2024-04-12T09:11:31.757 INFO:tasks.workunit.client.0.smithi117.stdout:7/962: dwrite d0/d20/d4a/d11f/d23/dac/dad/daa/d10c/d11a/d120/f126 [0,4194304] 0 2024-04-12T09:11:31.757 INFO:tasks.workunit.client.1.smithi203.stdout:6/477: readlink d1/d3/d5b/d8c/d3e/l95 0 2024-04-12T09:11:31.761 INFO:tasks.workunit.client.1.smithi203.stdout:5/621: unlink d0/d6/d16/l79 0 2024-04-12T09:11:31.765 INFO:tasks.workunit.client.0.smithi117.stdout:7/963: dwrite d0/d20/d4a/d11f/d23/d39/d6c/fc1 [0,4194304] 0 2024-04-12T09:11:31.766 INFO:tasks.workunit.client.1.smithi203.stdout:3/477: dwrite d2/d8/d14/d23/d35/d4c/d5c/f7d [0,4194304] 0 2024-04-12T09:11:31.768 INFO:tasks.workunit.client.1.smithi203.stdout:5/622: chown d0/dbd/dd0/le0 1966 1 2024-04-12T09:11:31.768 INFO:tasks.workunit.client.0.smithi117.stdout:7/964: write d0/d20/d4a/d11f/d23/d39/d6c/fa4 [5087074,30967] 0 2024-04-12T09:11:31.769 INFO:tasks.workunit.client.0.smithi117.stdout:7/965: read - d0/d20/d4a/d11f/d23/df1/f12a zero size 2024-04-12T09:11:31.773 INFO:tasks.workunit.client.1.smithi203.stdout:6/478: dwrite d1/d3/d26/d30/d4a/d6c/f92 [0,4194304] 0 2024-04-12T09:11:31.774 INFO:tasks.workunit.client.0.smithi117.stdout:7/966: creat d0/d2/d1a/d49/f13a x:0 0 0 2024-04-12T09:11:31.779 INFO:tasks.workunit.client.1.smithi203.stdout:5/623: dread d0/d6/d11/d1e/d4c/d48/fb5 [0,4194304] 0 2024-04-12T09:11:31.782 INFO:tasks.workunit.client.1.smithi203.stdout:1/580: dwrite df/d2d/d6f/d75/d80/d2b/f52 [0,4194304] 0 2024-04-12T09:11:31.783 INFO:tasks.workunit.client.1.smithi203.stdout:8/478: sync 2024-04-12T09:11:31.785 INFO:tasks.workunit.client.0.smithi117.stdout:7/967: creat d0/d20/d4a/d11f/d23/dac/dad/daa/d10c/f13b x:0 0 0 2024-04-12T09:11:31.785 INFO:tasks.workunit.client.1.smithi203.stdout:3/478: dwrite d2/d51/d65/f98 [0,4194304] 0 2024-04-12T09:11:31.788 INFO:tasks.workunit.client.1.smithi203.stdout:1/581: truncate df/d2d/d6f/d75/d80/d54/d5d/f9c 877538 0 2024-04-12T09:11:31.788 INFO:tasks.workunit.client.1.smithi203.stdout:3/479: chown d2/d8/d14/d23/c4a 897723 1 2024-04-12T09:11:31.791 INFO:tasks.workunit.client.0.smithi117.stdout:7/968: rmdir d0/d20/d4a/dce 39 2024-04-12T09:11:31.792 INFO:tasks.workunit.client.1.smithi203.stdout:8/479: rmdir d4/d34 39 2024-04-12T09:11:31.793 INFO:tasks.workunit.client.1.smithi203.stdout:1/582: symlink df/d59/db0/d9b/lb1 0 2024-04-12T09:11:31.795 INFO:tasks.workunit.client.1.smithi203.stdout:3/480: unlink d2/d8/d14/d45/c71 0 2024-04-12T09:11:31.796 INFO:tasks.workunit.client.1.smithi203.stdout:3/481: write d2/d64/f6f [2889225,92484] 0 2024-04-12T09:11:31.796 INFO:tasks.workunit.client.1.smithi203.stdout:5/624: mkdir d0/d6/d11/d1e/d4c/d48/de4 0 2024-04-12T09:11:31.798 INFO:tasks.workunit.client.0.smithi117.stdout:7/969: getdents d0/d2 0 2024-04-12T09:11:31.803 INFO:tasks.workunit.client.0.smithi117.stdout:7/970: mknod d0/d20/d4a/d11f/d23/df1/c13c 0 2024-04-12T09:11:31.804 INFO:tasks.workunit.client.0.smithi117.stdout:7/971: dread - d0/d20/d4a/dfd/df2/f106 zero size 2024-04-12T09:11:31.805 INFO:tasks.workunit.client.1.smithi203.stdout:0/570: dread d0/dd/d71/d94/d2f/f1e [0,4194304] 0 2024-04-12T09:11:31.805 INFO:tasks.workunit.client.1.smithi203.stdout:1/583: getdents df/d2d 0 2024-04-12T09:11:31.806 INFO:tasks.workunit.client.0.smithi117.stdout:7/972: symlink d0/l13d 0 2024-04-12T09:11:31.807 INFO:tasks.workunit.client.1.smithi203.stdout:8/480: dwrite d4/d8/d1c/d5d/f73 [0,4194304] 0 2024-04-12T09:11:31.809 INFO:tasks.workunit.client.1.smithi203.stdout:5/625: dwrite d0/d6/d16/d8/f62 [0,4194304] 0 2024-04-12T09:11:31.810 INFO:tasks.workunit.client.1.smithi203.stdout:3/482: dwrite d2/d8/d14/d23/d35/d4c/d5c/f7d [0,4194304] 0 2024-04-12T09:11:31.817 INFO:tasks.workunit.client.1.smithi203.stdout:0/571: rename d0/dd/d4d to d0/dd/d71/d94/d2f/d34/db1 0 2024-04-12T09:11:31.820 INFO:tasks.workunit.client.1.smithi203.stdout:3/483: dwrite d2/fa [4194304,4194304] 0 2024-04-12T09:11:31.822 INFO:tasks.workunit.client.1.smithi203.stdout:3/484: write d2/d8/d14/d23/f57 [663255,51358] 0 2024-04-12T09:11:31.832 INFO:tasks.workunit.client.1.smithi203.stdout:0/572: link d0/dd/d5b/d9f/caa d0/dd/d71/d94/d2f/d4c/cb2 0 2024-04-12T09:11:31.833 INFO:tasks.workunit.client.1.smithi203.stdout:0/573: chown d0/dd 113454225 1 2024-04-12T09:11:31.839 INFO:tasks.workunit.client.0.smithi117.stdout:7/973: dwrite d0/d2/d1a/d49/f5e [0,4194304] 0 2024-04-12T09:11:31.840 INFO:tasks.workunit.client.1.smithi203.stdout:0/574: link d0/d48/d5e/f75 d0/dd/d71/d94/d2f/d17/d19/fb3 0 2024-04-12T09:11:31.840 INFO:tasks.workunit.client.1.smithi203.stdout:8/481: truncate d4/d8/d74/d78/f27 3187448 0 2024-04-12T09:11:31.840 INFO:tasks.workunit.client.1.smithi203.stdout:5/626: truncate d0/d6/d11/d18/f3b 8202800 0 2024-04-12T09:11:31.844 INFO:tasks.workunit.client.1.smithi203.stdout:5/627: getdents d0/d6/d16/d9/d30/d58/db4 0 2024-04-12T09:11:31.847 INFO:tasks.workunit.client.1.smithi203.stdout:8/482: dread d4/d34/f47 [0,4194304] 0 2024-04-12T09:11:31.848 INFO:tasks.workunit.client.1.smithi203.stdout:5/628: symlink d0/d6/d16/d9/d30/d58/d74/le5 0 2024-04-12T09:11:31.850 INFO:tasks.workunit.client.1.smithi203.stdout:5/629: fdatasync d0/d6/d16/d9/d30/fab 0 2024-04-12T09:11:31.850 INFO:tasks.workunit.client.1.smithi203.stdout:8/483: rmdir d4/d8/d37/d57/d7d 39 2024-04-12T09:11:31.851 INFO:tasks.workunit.client.1.smithi203.stdout:8/484: chown d4/d8/d74/d78/f25 1 1 2024-04-12T09:11:31.852 INFO:tasks.workunit.client.1.smithi203.stdout:8/485: chown d4/d8/d74/d78 849730 1 2024-04-12T09:11:31.854 INFO:tasks.workunit.client.1.smithi203.stdout:5/630: mknod d0/d6/d11/d1e/d4c/d6a/ce6 0 2024-04-12T09:11:31.855 INFO:tasks.workunit.client.1.smithi203.stdout:5/631: chown d0/d6/d11/d18 1 1 2024-04-12T09:11:31.857 INFO:tasks.workunit.client.0.smithi117.stdout:7/974: dwrite d0/da/d7c/f9f [0,4194304] 0 2024-04-12T09:11:31.858 INFO:tasks.workunit.client.0.smithi117.stdout:7/975: write d0/da/d9b/f10a [576922,36958] 0 2024-04-12T09:11:31.859 INFO:tasks.workunit.client.1.smithi203.stdout:8/486: link f3 d4/d8/d74/f95 0 2024-04-12T09:11:31.868 INFO:tasks.workunit.client.1.smithi203.stdout:0/575: dread d0/f4e [0,4194304] 0 2024-04-12T09:11:31.868 INFO:tasks.workunit.client.0.smithi117.stdout:7/976: link d0/d2/d45/da1/fb3 d0/d20/d4a/d11f/d23/dac/de4/f13e 0 2024-04-12T09:11:31.871 INFO:tasks.workunit.client.1.smithi203.stdout:0/576: creat d0/dd/d71/d94/d2f/d17/d19/d6f/d78/fb4 x:0 0 0 2024-04-12T09:11:31.872 INFO:tasks.workunit.client.1.smithi203.stdout:5/632: dread d0/d6/d11/d1e/f45 [0,4194304] 0 2024-04-12T09:11:31.875 INFO:tasks.workunit.client.0.smithi117.stdout:7/977: dwrite d0/d20/d4a/d11f/f31 [0,4194304] 0 2024-04-12T09:11:31.875 INFO:tasks.workunit.client.1.smithi203.stdout:0/577: mknod d0/dd/d71/d94/d2f/d17/d19/cb5 0 2024-04-12T09:11:31.876 INFO:tasks.workunit.client.1.smithi203.stdout:8/487: dwrite d4/f1f [0,4194304] 0 2024-04-12T09:11:31.879 INFO:tasks.workunit.client.0.smithi117.stdout:7/978: unlink d0/d20/d4a/d11f/d23/d39/dbd/lf0 0 2024-04-12T09:11:31.882 INFO:tasks.workunit.client.1.smithi203.stdout:5/633: dwrite d0/d6/d16/d9/d30/d58/d74/d88/fd8 [0,4194304] 0 2024-04-12T09:11:31.883 INFO:tasks.workunit.client.1.smithi203.stdout:8/488: truncate d4/d8/f38 290737 0 2024-04-12T09:11:31.884 INFO:tasks.workunit.client.0.smithi117.stdout:7/979: creat d0/d20/f13f x:0 0 0 2024-04-12T09:11:31.884 INFO:tasks.workunit.client.0.smithi117.stdout:7/980: chown d0/f1b 53 1 2024-04-12T09:11:31.886 INFO:tasks.workunit.client.1.smithi203.stdout:8/489: write d4/d8/d1c/d5d/f73 [612748,13915] 0 2024-04-12T09:11:31.886 INFO:tasks.workunit.client.0.smithi117.stdout:7/981: write d0/d20/d4a/d11f/d23/ffe [512892,122055] 0 2024-04-12T09:11:31.888 INFO:tasks.workunit.client.1.smithi203.stdout:5/634: rename d0/d6/d11/le3 to d0/d5d/le7 0 2024-04-12T09:11:31.893 INFO:tasks.workunit.client.1.smithi203.stdout:8/490: mknod d4/d8/d37/c96 0 2024-04-12T09:11:31.895 INFO:tasks.workunit.client.1.smithi203.stdout:0/578: read d0/dd/d71/d94/d2f/f33 [1656831,18605] 0 2024-04-12T09:11:31.896 INFO:tasks.workunit.client.1.smithi203.stdout:5/635: dwrite d0/d6/d16/d9/d14/d2d/fbc [0,4194304] 0 2024-04-12T09:11:31.904 INFO:tasks.workunit.client.1.smithi203.stdout:8/491: dread d4/d8/d74/f95 [0,4194304] 0 2024-04-12T09:11:31.909 INFO:tasks.workunit.client.1.smithi203.stdout:7/524: sync 2024-04-12T09:11:31.910 INFO:tasks.workunit.client.1.smithi203.stdout:8/492: dwrite d4/d8/d1c/f2c [0,4194304] 0 2024-04-12T09:11:31.910 INFO:tasks.workunit.client.1.smithi203.stdout:7/525: write d0/d4/d1c/faa [546118,21771] 0 2024-04-12T09:11:31.912 INFO:tasks.workunit.client.1.smithi203.stdout:7/526: chown d0/d4/f88 1891447885 1 2024-04-12T09:11:31.914 INFO:tasks.workunit.client.1.smithi203.stdout:8/493: creat d4/f97 x:0 0 0 2024-04-12T09:11:31.916 INFO:tasks.workunit.client.1.smithi203.stdout:0/579: dwrite d0/dd/d71/d94/d2f/f33 [0,4194304] 0 2024-04-12T09:11:31.921 INFO:tasks.workunit.client.1.smithi203.stdout:8/494: creat d4/d8/d37/f98 x:0 0 0 2024-04-12T09:11:31.921 INFO:tasks.workunit.client.1.smithi203.stdout:7/527: write d0/f7 [245632,39815] 0 2024-04-12T09:11:31.923 INFO:tasks.workunit.client.1.smithi203.stdout:0/580: symlink d0/dd/d71/d94/d2f/lb6 0 2024-04-12T09:11:31.926 INFO:tasks.workunit.client.1.smithi203.stdout:0/581: creat d0/dd/d71/fb7 x:0 0 0 2024-04-12T09:11:31.928 INFO:tasks.workunit.client.1.smithi203.stdout:7/528: dwrite d0/d34/d7c/f80 [0,4194304] 0 2024-04-12T09:11:31.934 INFO:tasks.workunit.client.0.smithi117.stdout:7/982: dread d0/da/f10 [4194304,4194304] 0 2024-04-12T09:11:31.935 INFO:tasks.workunit.client.1.smithi203.stdout:0/582: dwrite d0/dd/d71/d94/d2f/d17/f9e [0,4194304] 0 2024-04-12T09:11:31.935 INFO:tasks.workunit.client.0.smithi117.stdout:7/983: fdatasync d0/f12c 0 2024-04-12T09:11:31.939 INFO:tasks.workunit.client.1.smithi203.stdout:0/583: creat d0/dd/d71/d94/d2f/d34/db1/fb8 x:0 0 0 2024-04-12T09:11:31.940 INFO:tasks.workunit.client.1.smithi203.stdout:0/584: fdatasync d0/dd/d71/d94/d2f/f66 0 2024-04-12T09:11:31.941 INFO:tasks.workunit.client.1.smithi203.stdout:7/529: write d0/d4/d53/fa5 [835786,38978] 0 2024-04-12T09:11:31.946 INFO:tasks.workunit.client.0.smithi117.stdout:7/984: getdents d0/d20/d4a/d11f/d23/d50 0 2024-04-12T09:11:31.948 INFO:tasks.workunit.client.0.smithi117.stdout:7/985: chown d0/da/d7c/f103 2892 1 2024-04-12T09:11:31.949 INFO:tasks.workunit.client.1.smithi203.stdout:7/530: link d0/d38/f9c d0/d15/d2d/d5e/d8c/fc4 0 2024-04-12T09:11:31.964 INFO:tasks.workunit.client.1.smithi203.stdout:0/585: write d0/dd/d71/d94/d2f/d17/d19/f3b [7756980,21066] 0 2024-04-12T09:11:31.965 INFO:tasks.workunit.client.1.smithi203.stdout:7/531: write d0/d4/d1c/d3b/f3f [1250497,20681] 0 2024-04-12T09:11:31.966 INFO:tasks.workunit.client.1.smithi203.stdout:8/495: dread d4/f86 [0,4194304] 0 2024-04-12T09:11:31.968 INFO:tasks.workunit.client.0.smithi117.stdout:7/986: dread d0/d2/d1a/f9d [0,4194304] 0 2024-04-12T09:11:31.968 INFO:tasks.workunit.client.1.smithi203.stdout:0/586: rename d0/dd/d40/c50 to d0/dd/d71/d94/d2f/d17/d19/cb9 0 2024-04-12T09:11:31.969 INFO:tasks.workunit.client.1.smithi203.stdout:7/532: mkdir d0/d4/d1c/d5b/dbf/dc5 0 2024-04-12T09:11:31.969 INFO:tasks.workunit.client.1.smithi203.stdout:0/587: chown d0/d48/d5e/d84/l9b 184 1 2024-04-12T09:11:31.970 INFO:tasks.workunit.client.1.smithi203.stdout:7/533: dread - d0/d4/d1c/d3b/f78 zero size 2024-04-12T09:11:31.971 INFO:tasks.workunit.client.0.smithi117.stdout:7/987: rename d0/d20/d4a/d11f/d23/dac/dad/d91/dca/f105 to d0/d20/d4a/dfd/df2/f140 0 2024-04-12T09:11:31.971 INFO:tasks.workunit.client.1.smithi203.stdout:8/496: mknod d4/d8/c99 0 2024-04-12T09:11:31.973 INFO:tasks.workunit.client.1.smithi203.stdout:7/534: mknod d0/d38/d79/cc6 0 2024-04-12T09:11:31.974 INFO:tasks.workunit.client.1.smithi203.stdout:7/535: dread - d0/d4/d1c/d3b/f78 zero size 2024-04-12T09:11:31.976 INFO:tasks.workunit.client.1.smithi203.stdout:8/497: getdents d4/d8/d74/d78/d53/d8f 0 2024-04-12T09:11:31.977 INFO:tasks.workunit.client.1.smithi203.stdout:0/588: write d0/dd/f46 [949624,125315] 0 2024-04-12T09:11:31.977 INFO:tasks.workunit.client.1.smithi203.stdout:8/498: chown d4/d8/d1c/l4e 983 1 2024-04-12T09:11:31.978 INFO:tasks.workunit.client.0.smithi117.stdout:7/988: getdents d0/d20/d4a/d11f/d23/d39/dbd 0 2024-04-12T09:11:31.979 INFO:tasks.workunit.client.1.smithi203.stdout:7/536: creat d0/d4/d1c/d3b/fc7 x:0 0 0 2024-04-12T09:11:31.980 INFO:tasks.workunit.client.1.smithi203.stdout:0/589: creat d0/dd/d5b/fba x:0 0 0 2024-04-12T09:11:31.980 INFO:tasks.workunit.client.1.smithi203.stdout:0/590: readlink d0/dd/d71/d94/d2f/d34/db1/l57 0 2024-04-12T09:11:31.981 INFO:tasks.workunit.client.1.smithi203.stdout:8/499: creat d4/d34/f9a x:0 0 0 2024-04-12T09:11:31.985 INFO:tasks.workunit.client.0.smithi117.stdout:7/989: rename d0/d20/d4a/dce/dcf/f10d to d0/d2/d45/d15/d114/f141 0 2024-04-12T09:11:31.985 INFO:tasks.workunit.client.1.smithi203.stdout:0/591: dwrite d0/dd/d71/d94/d2f/d17/d19/f3b [4194304,4194304] 0 2024-04-12T09:11:31.988 INFO:tasks.workunit.client.1.smithi203.stdout:7/537: link d0/d15/cbb d0/d4/d1c/d3b/d98/cc8 0 2024-04-12T09:11:31.989 INFO:tasks.workunit.client.1.smithi203.stdout:8/500: creat d4/d8/d37/f9b x:0 0 0 2024-04-12T09:11:31.989 INFO:tasks.workunit.client.1.smithi203.stdout:0/592: dread d0/f13 [0,4194304] 0 2024-04-12T09:11:31.992 INFO:tasks.workunit.client.1.smithi203.stdout:7/538: symlink d0/d4/d1c/d3b/lc9 0 2024-04-12T09:11:31.994 INFO:tasks.workunit.client.1.smithi203.stdout:0/593: dread d0/dd/d71/d94/f3d [0,4194304] 0 2024-04-12T09:11:31.994 INFO:tasks.workunit.client.0.smithi117.stdout:7/990: dwrite d0/d2/d1a/d5f/f7f [0,4194304] 0 2024-04-12T09:11:31.995 INFO:tasks.workunit.client.1.smithi203.stdout:8/501: rename d4/d8/l17 to d4/d8/d74/d78/l9c 0 2024-04-12T09:11:31.997 INFO:tasks.workunit.client.1.smithi203.stdout:7/539: dwrite d0/d15/d2d/d5e/d8c/f81 [0,4194304] 0 2024-04-12T09:11:32.001 INFO:tasks.workunit.client.0.smithi117.stdout:7/991: creat d0/d2/d45/d53/d58/f142 x:0 0 0 2024-04-12T09:11:32.004 INFO:tasks.workunit.client.1.smithi203.stdout:7/540: mknod d0/d4/d1c/cca 0 2024-04-12T09:11:32.004 INFO:tasks.workunit.client.0.smithi117.stdout:7/992: write d0/d20/d4a/d11f/d23/d50/f66 [4889975,61417] 0 2024-04-12T09:11:32.006 INFO:tasks.workunit.client.1.smithi203.stdout:7/541: stat d0/d38/d79/cc6 0 2024-04-12T09:11:32.007 INFO:tasks.workunit.client.1.smithi203.stdout:9/454: sync 2024-04-12T09:11:32.008 INFO:tasks.workunit.client.1.smithi203.stdout:0/594: dwrite d0/d48/f69 [0,4194304] 0 2024-04-12T09:11:32.009 INFO:tasks.workunit.client.1.smithi203.stdout:7/542: readlink d0/d4/d54/da0/laf 0 2024-04-12T09:11:32.010 INFO:tasks.workunit.client.1.smithi203.stdout:9/455: write d8/f6b [4707819,89168] 0 2024-04-12T09:11:32.010 INFO:tasks.workunit.client.1.smithi203.stdout:0/595: chown d0/dd/d71/d94/d2f/f8f 1 1 2024-04-12T09:11:32.011 INFO:tasks.workunit.client.0.smithi117.stdout:7/993: dwrite d0/d2/d12/f135 [0,4194304] 0 2024-04-12T09:11:32.011 INFO:tasks.workunit.client.1.smithi203.stdout:7/543: truncate d0/d38/d79/fa7 365703 0 2024-04-12T09:11:32.013 INFO:tasks.workunit.client.1.smithi203.stdout:0/596: write d0/dd/d71/d94/d2f/d34/db1/fb8 [538939,80193] 0 2024-04-12T09:11:32.015 INFO:tasks.workunit.client.0.smithi117.stdout:7/994: unlink d0/da/d7c/f103 0 2024-04-12T09:11:32.016 INFO:tasks.workunit.client.1.smithi203.stdout:0/597: mkdir d0/dd/d71/d94/d65/dbb 0 2024-04-12T09:11:32.017 INFO:tasks.workunit.client.1.smithi203.stdout:0/598: dread - d0/dd/d71/fb7 zero size 2024-04-12T09:11:32.022 INFO:tasks.workunit.client.0.smithi117.stdout:7/995: dread d0/d20/d4a/d11f/d23/d39/fb8 [0,4194304] 0 2024-04-12T09:11:32.024 INFO:tasks.workunit.client.1.smithi203.stdout:0/599: link d0/dd/d71/d94/d2f/c81 d0/dd/d71/d94/d2f/d17/d19/d6f/d78/cbc 0 2024-04-12T09:11:32.026 INFO:tasks.workunit.client.0.smithi117.stdout:7/996: mknod d0/d20/d4a/dce/c143 0 2024-04-12T09:11:32.028 INFO:tasks.workunit.client.0.smithi117.stdout:7/997: stat d0/d20/d4a/d11f/d23/dac/dad/daa/fef 0 2024-04-12T09:11:32.028 INFO:tasks.workunit.client.1.smithi203.stdout:0/600: rmdir d0/d48/d5e 39 2024-04-12T09:11:32.028 INFO:tasks.workunit.client.1.smithi203.stdout:8/502: write d4/d8/d74/d78/f43 [487976,121264] 0 2024-04-12T09:11:32.033 INFO:tasks.workunit.client.1.smithi203.stdout:9/456: write d8/d12/f81 [919624,91545] 0 2024-04-12T09:11:32.034 INFO:tasks.workunit.client.1.smithi203.stdout:8/503: dwrite d4/d8/d74/d78/f54 [4194304,4194304] 0 2024-04-12T09:11:32.036 INFO:tasks.workunit.client.1.smithi203.stdout:0/601: mkdir d0/dd/dbd 0 2024-04-12T09:11:32.036 INFO:tasks.workunit.client.1.smithi203.stdout:8/504: write d4/f6 [328301,120949] 0 2024-04-12T09:11:32.042 INFO:tasks.workunit.client.1.smithi203.stdout:7/544: dread d0/d4/f11 [0,4194304] 0 2024-04-12T09:11:32.042 INFO:tasks.workunit.client.1.smithi203.stdout:4/575: sync 2024-04-12T09:11:32.043 INFO:tasks.workunit.client.1.smithi203.stdout:2/545: sync 2024-04-12T09:11:32.043 INFO:tasks.workunit.client.1.smithi203.stdout:9/457: dwrite d8/d12/d3e/fa2 [0,4194304] 0 2024-04-12T09:11:32.045 INFO:tasks.workunit.client.1.smithi203.stdout:2/546: fsync d0/d14/d23/f8b 0 2024-04-12T09:11:32.045 INFO:tasks.workunit.client.1.smithi203.stdout:9/458: chown d8/fb 1 1 2024-04-12T09:11:32.051 INFO:tasks.workunit.client.1.smithi203.stdout:2/547: truncate d0/d54/d61/d82/fb5 1285084 0 2024-04-12T09:11:32.051 INFO:tasks.workunit.client.1.smithi203.stdout:7/545: chown d0/d15/c33 13724 1 2024-04-12T09:11:32.053 INFO:tasks.workunit.client.1.smithi203.stdout:4/576: dwrite f14 [0,4194304] 0 2024-04-12T09:11:32.057 INFO:tasks.workunit.client.1.smithi203.stdout:9/459: symlink d8/d12/d23/d38/d8a/d97/d9e/d74/lac 0 2024-04-12T09:11:32.062 INFO:tasks.workunit.client.1.smithi203.stdout:7/546: creat d0/d38/d51/fcb x:0 0 0 2024-04-12T09:11:32.066 INFO:tasks.workunit.client.1.smithi203.stdout:4/577: symlink d1a/d2b/lbf 0 2024-04-12T09:11:32.069 INFO:tasks.workunit.client.1.smithi203.stdout:8/505: creat d4/d8/d37/d57/f9d x:0 0 0 2024-04-12T09:11:32.073 INFO:tasks.workunit.client.1.smithi203.stdout:4/578: dwrite d1a/d21/f33 [0,4194304] 0 2024-04-12T09:11:32.073 INFO:tasks.workunit.client.1.smithi203.stdout:9/460: creat d8/d12/fad x:0 0 0 2024-04-12T09:11:32.073 INFO:tasks.workunit.client.1.smithi203.stdout:0/602: dread d0/dd/f99 [0,4194304] 0 2024-04-12T09:11:32.074 INFO:tasks.workunit.client.1.smithi203.stdout:9/461: write d8/d12/d3e/f73 [2050846,116936] 0 2024-04-12T09:11:32.082 INFO:tasks.workunit.client.1.smithi203.stdout:4/579: creat d1a/d21/da1/fc0 x:0 0 0 2024-04-12T09:11:32.083 INFO:tasks.workunit.client.1.smithi203.stdout:9/462: dwrite d8/d12/f83 [0,4194304] 0 2024-04-12T09:11:32.083 INFO:tasks.workunit.client.1.smithi203.stdout:4/580: chown d1a/d21/da1/fc0 2131721 1 2024-04-12T09:11:32.083 INFO:tasks.workunit.client.1.smithi203.stdout:2/548: write d0/d14/d1e/d2a/f4c [200575,98893] 0 2024-04-12T09:11:32.085 INFO:tasks.workunit.client.1.smithi203.stdout:4/581: fsync d1a/d1d/d69/f92 0 2024-04-12T09:11:32.086 INFO:tasks.workunit.client.1.smithi203.stdout:0/603: unlink d0/dd/d71/d94/d2f/d4c/c6e 0 2024-04-12T09:11:32.091 INFO:tasks.workunit.client.1.smithi203.stdout:0/604: dread d0/dd/d71/d94/d2f/f1e [0,4194304] 0 2024-04-12T09:11:32.093 INFO:tasks.workunit.client.1.smithi203.stdout:2/549: creat d0/d19/fc0 x:0 0 0 2024-04-12T09:11:32.098 INFO:tasks.workunit.client.0.smithi117.stdout:7/998: creat d0/d2/d12/f144 x:0 0 0 2024-04-12T09:11:32.100 INFO:tasks.workunit.client.1.smithi203.stdout:8/506: dread d4/d8/d74/d78/f27 [0,4194304] 0 2024-04-12T09:11:32.100 INFO:tasks.workunit.client.1.smithi203.stdout:2/550: chown d0/d3/d47/la5 43155521 1 2024-04-12T09:11:32.101 INFO:tasks.workunit.client.0.smithi117.stdout:7/999: creat d0/d2/f145 x:0 0 0 2024-04-12T09:11:32.102 INFO:tasks.workunit.client.1.smithi203.stdout:8/507: fsync d4/d8/d74/d78/f2e 0 2024-04-12T09:11:32.104 INFO:tasks.workunit.client.1.smithi203.stdout:8/508: truncate d4/d8/d1c/d5d/f4f 4418495 0 2024-04-12T09:11:32.104 INFO:tasks.workunit.client.1.smithi203.stdout:9/463: getdents d8/d12/d23/d38/d8a 0 2024-04-12T09:11:32.105 INFO:tasks.workunit.client.0.smithi117.stderr:+ rm -rf -- ./tmp.ImjvkznEsQ 2024-04-12T09:11:32.106 INFO:tasks.workunit.client.1.smithi203.stdout:8/509: write d4/d8/d37/f98 [630439,37229] 0 2024-04-12T09:11:32.107 INFO:tasks.workunit.client.1.smithi203.stdout:4/582: dread d1a/d20/d5f/f7a [0,4194304] 0 2024-04-12T09:11:32.108 INFO:tasks.workunit.client.1.smithi203.stdout:2/551: getdents d0/d38/d43/d9c 0 2024-04-12T09:11:32.109 INFO:tasks.workunit.client.1.smithi203.stdout:4/583: chown d1a/d2b/f3a 65628487 1 2024-04-12T09:11:32.110 INFO:tasks.workunit.client.1.smithi203.stdout:8/510: symlink d4/d8/l9e 0 2024-04-12T09:11:32.111 INFO:tasks.workunit.client.1.smithi203.stdout:0/605: dread d0/dd/f16 [0,4194304] 0 2024-04-12T09:11:32.111 INFO:tasks.workunit.client.1.smithi203.stdout:2/552: truncate d0/d14/d1e/d2a/f5d 54878 0 2024-04-12T09:11:32.111 INFO:tasks.workunit.client.1.smithi203.stdout:4/584: dread - d1a/d21/d22/d2e/d78/fb3 zero size 2024-04-12T09:11:32.113 INFO:tasks.workunit.client.1.smithi203.stdout:2/553: write d0/d14/d1e/d2a/f90 [579620,6118] 0 2024-04-12T09:11:32.114 INFO:tasks.workunit.client.1.smithi203.stdout:4/585: truncate d1a/d21/d22/d2e/d78/fb3 387399 0 2024-04-12T09:11:32.115 INFO:tasks.workunit.client.1.smithi203.stdout:2/554: write d0/d38/f3e [912620,121071] 0 2024-04-12T09:11:32.116 INFO:tasks.workunit.client.1.smithi203.stdout:4/586: write d1a/d2b/f3a [5067819,70809] 0 2024-04-12T09:11:32.116 INFO:tasks.workunit.client.1.smithi203.stdout:0/606: mknod d0/d59/d5d/d79/cbe 0 2024-04-12T09:11:32.117 INFO:tasks.workunit.client.1.smithi203.stdout:8/511: creat d4/d8/d37/d57/f9f x:0 0 0 2024-04-12T09:11:32.120 INFO:tasks.workunit.client.1.smithi203.stdout:9/464: dread d8/d12/d3e/d90/f95 [0,4194304] 0 2024-04-12T09:11:32.122 INFO:tasks.workunit.client.1.smithi203.stdout:2/555: creat d0/d3/d47/fc1 x:0 0 0 2024-04-12T09:11:32.124 INFO:tasks.workunit.client.1.smithi203.stdout:0/607: symlink d0/dd/d5b/d9f/lbf 0 2024-04-12T09:11:32.126 INFO:tasks.workunit.client.1.smithi203.stdout:9/465: unlink d8/d12/d3e/caa 0 2024-04-12T09:11:32.127 INFO:tasks.workunit.client.1.smithi203.stdout:9/466: fdatasync d8/d12/d23/d85/f8b 0 2024-04-12T09:11:32.128 INFO:tasks.workunit.client.1.smithi203.stdout:8/512: creat d4/d8/d74/d78/d53/d8f/fa0 x:0 0 0 2024-04-12T09:11:32.129 INFO:tasks.workunit.client.1.smithi203.stdout:2/556: dwrite d0/d38/d43/f5a [4194304,4194304] 0 2024-04-12T09:11:32.129 INFO:tasks.workunit.client.1.smithi203.stdout:0/608: symlink d0/dd/d40/lc0 0 2024-04-12T09:11:32.131 INFO:tasks.workunit.client.1.smithi203.stdout:9/467: write d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/f82 [4323095,105334] 0 2024-04-12T09:11:32.134 INFO:tasks.workunit.client.1.smithi203.stdout:9/468: chown d8/d12/l20 522430971 1 2024-04-12T09:11:32.135 INFO:tasks.workunit.client.1.smithi203.stdout:6/479: sync 2024-04-12T09:11:32.135 INFO:tasks.workunit.client.1.smithi203.stdout:3/485: sync 2024-04-12T09:11:32.135 INFO:tasks.workunit.client.1.smithi203.stdout:1/584: sync 2024-04-12T09:11:32.135 INFO:tasks.workunit.client.1.smithi203.stdout:5/636: sync 2024-04-12T09:11:32.137 INFO:tasks.workunit.client.1.smithi203.stdout:0/609: mkdir d0/d48/dc1 0 2024-04-12T09:11:32.140 INFO:tasks.workunit.client.1.smithi203.stdout:9/469: unlink d8/d3b/f4b 0 2024-04-12T09:11:32.140 INFO:tasks.workunit.client.1.smithi203.stdout:4/587: dread f5 [0,4194304] 0 2024-04-12T09:11:32.140 INFO:tasks.workunit.client.1.smithi203.stdout:3/486: dread d2/d8/d14/d23/f57 [0,4194304] 0 2024-04-12T09:11:32.149 INFO:tasks.workunit.client.1.smithi203.stdout:0/610: write d0/dd/d71/d94/d2f/d17/d19/f26 [2864827,120762] 0 2024-04-12T09:11:32.149 INFO:tasks.workunit.client.1.smithi203.stdout:4/588: dread d1a/d21/d22/d2e/d78/fb3 [0,4194304] 0 2024-04-12T09:11:32.149 INFO:tasks.workunit.client.1.smithi203.stdout:9/470: readlink d8/d12/d23/d85/l8f 0 2024-04-12T09:11:32.151 INFO:tasks.workunit.client.1.smithi203.stdout:3/487: creat d2/d8/d14/d23/d35/d91/f9b x:0 0 0 2024-04-12T09:11:32.153 INFO:tasks.workunit.client.1.smithi203.stdout:1/585: dwrite df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/f81 [0,4194304] 0 2024-04-12T09:11:32.153 INFO:tasks.workunit.client.1.smithi203.stdout:9/471: fsync d8/d12/d3e/f47 0 2024-04-12T09:11:32.154 INFO:tasks.workunit.client.1.smithi203.stdout:9/472: stat d8/d12/d23/d85/c52 0 2024-04-12T09:11:32.158 INFO:tasks.workunit.client.1.smithi203.stdout:6/480: rename d1/d3/d26/d30/f81 to d1/d3/f97 0 2024-04-12T09:11:32.159 INFO:tasks.workunit.client.1.smithi203.stdout:6/481: readlink d1/l22 0 2024-04-12T09:11:32.162 INFO:tasks.workunit.client.1.smithi203.stdout:3/488: dwrite d2/d8/d14/d23/d35/d91/f9b [0,4194304] 0 2024-04-12T09:11:32.162 INFO:tasks.workunit.client.1.smithi203.stdout:1/586: truncate df/d2d/d6f/d75/d80/f21 729947 0 2024-04-12T09:11:32.163 INFO:tasks.workunit.client.1.smithi203.stdout:2/557: dread d0/d38/d43/d9c/fac [0,4194304] 0 2024-04-12T09:11:32.166 INFO:tasks.workunit.client.1.smithi203.stdout:5/637: getdents d0/d6/d16/d9/d14/d2d 0 2024-04-12T09:11:32.168 INFO:tasks.workunit.client.1.smithi203.stdout:0/611: creat d0/d48/dc1/fc2 x:0 0 0 2024-04-12T09:11:32.171 INFO:tasks.workunit.client.1.smithi203.stdout:6/482: unlink d1/d3/l14 0 2024-04-12T09:11:32.172 INFO:tasks.workunit.client.1.smithi203.stdout:9/473: mknod d8/cae 0 2024-04-12T09:11:32.173 INFO:tasks.workunit.client.1.smithi203.stdout:9/474: chown d8/d12/d23/d27/f32 87 1 2024-04-12T09:11:32.174 INFO:tasks.workunit.client.1.smithi203.stdout:2/558: chown d0/f32 263640 1 2024-04-12T09:11:32.175 INFO:tasks.workunit.client.1.smithi203.stdout:2/559: fsync d0/d14/d1e/d2a/f90 0 2024-04-12T09:11:32.176 INFO:tasks.workunit.client.1.smithi203.stdout:3/489: unlink d2/d8/d14/d23/d35/d91/f61 0 2024-04-12T09:11:32.179 INFO:tasks.workunit.client.1.smithi203.stdout:3/490: read d2/d8/d14/f27 [2400590,6679] 0 2024-04-12T09:11:32.179 INFO:tasks.workunit.client.1.smithi203.stdout:1/587: symlink df/d2d/d6f/d75/d80/d54/d5d/d67/lb2 0 2024-04-12T09:11:32.184 INFO:tasks.workunit.client.1.smithi203.stdout:1/588: dwrite df/d2d/d6f/d75/d80/d2b/f52 [0,4194304] 0 2024-04-12T09:11:32.185 INFO:tasks.workunit.client.1.smithi203.stdout:9/475: mkdir d8/d12/d3e/d90/d60/daf 0 2024-04-12T09:11:32.186 INFO:tasks.workunit.client.1.smithi203.stdout:9/476: chown d8/d12/d23/d85/c52 5555 1 2024-04-12T09:11:32.190 INFO:tasks.workunit.client.1.smithi203.stdout:2/560: creat d0/d3/d8f/fc2 x:0 0 0 2024-04-12T09:11:32.191 INFO:tasks.workunit.client.1.smithi203.stdout:1/589: dwrite df/f1e [0,4194304] 0 2024-04-12T09:11:32.192 INFO:tasks.workunit.client.1.smithi203.stdout:3/491: mknod d2/d51/c9c 0 2024-04-12T09:11:32.193 INFO:tasks.workunit.client.1.smithi203.stdout:5/638: fsync d0/d6/d16/d9/f2e 0 2024-04-12T09:11:32.195 INFO:tasks.workunit.client.1.smithi203.stdout:4/589: getdents d1a 0 2024-04-12T09:11:32.196 INFO:tasks.workunit.client.1.smithi203.stdout:0/612: symlink d0/dd/d71/d94/d65/dbb/lc3 0 2024-04-12T09:11:32.200 INFO:tasks.workunit.client.1.smithi203.stdout:4/590: dread d1a/d20/fa4 [0,4194304] 0 2024-04-12T09:11:32.203 INFO:tasks.workunit.client.1.smithi203.stdout:0/613: dwrite d0/dd/d71/d94/d2f/d17/d19/f73 [0,4194304] 0 2024-04-12T09:11:32.205 INFO:tasks.workunit.client.1.smithi203.stdout:9/477: rmdir d8/d12/d23/d38/d8a/d97/d9e/d74/d8e 39 2024-04-12T09:11:32.207 INFO:tasks.workunit.client.1.smithi203.stdout:0/614: truncate d0/dd/d71/d94/d2f/d17/d19/d6f/d78/fb4 29977 0 2024-04-12T09:11:32.208 INFO:tasks.workunit.client.1.smithi203.stdout:7/547: sync 2024-04-12T09:11:32.211 INFO:tasks.workunit.client.1.smithi203.stdout:1/590: symlink df/d2d/d6f/d75/d80/d2b/lb3 0 2024-04-12T09:11:32.214 INFO:tasks.workunit.client.1.smithi203.stdout:1/591: dread df/d2d/d6f/d75/d80/d2b/f52 [0,4194304] 0 2024-04-12T09:11:32.215 INFO:tasks.workunit.client.1.smithi203.stdout:1/592: dread - df/d2d/d6f/d75/d80/d54/f61 zero size 2024-04-12T09:11:32.217 INFO:tasks.workunit.client.1.smithi203.stdout:1/593: write df/d2d/d6f/d75/d80/f26 [2421736,84588] 0 2024-04-12T09:11:32.222 INFO:tasks.workunit.client.1.smithi203.stdout:9/478: dread - d8/d12/d23/f77 zero size 2024-04-12T09:11:32.225 INFO:tasks.workunit.client.1.smithi203.stdout:0/615: rename d0/dd/f46 to d0/dd/dbd/fc4 0 2024-04-12T09:11:32.226 INFO:tasks.workunit.client.1.smithi203.stdout:5/639: dread d0/f21 [0,4194304] 0 2024-04-12T09:11:32.226 INFO:tasks.workunit.client.1.smithi203.stdout:3/492: mknod d2/c9d 0 2024-04-12T09:11:32.227 INFO:tasks.workunit.client.1.smithi203.stdout:0/616: write d0/dd/d71/d94/d2f/d17/f11 [153169,129226] 0 2024-04-12T09:11:32.230 INFO:tasks.workunit.client.1.smithi203.stdout:2/561: link d0/d38/d43/d9c/fae d0/d38/d43/d9c/fc3 0 2024-04-12T09:11:32.232 INFO:tasks.workunit.client.1.smithi203.stdout:6/483: getdents d1/d3/d26/d30 0 2024-04-12T09:11:32.235 INFO:tasks.workunit.client.1.smithi203.stdout:4/591: link d1a/d21/d22/f57 d1a/d1d/d69/fc1 0 2024-04-12T09:11:32.239 INFO:tasks.workunit.client.1.smithi203.stdout:9/479: mknod d8/d12/d23/d38/d8a/cb0 0 2024-04-12T09:11:32.240 INFO:tasks.workunit.client.1.smithi203.stdout:5/640: symlink d0/d6/d11/d18/dcc/le8 0 2024-04-12T09:11:32.241 INFO:tasks.workunit.client.1.smithi203.stdout:3/493: mknod d2/d8/d14/d1b/d95/c9e 0 2024-04-12T09:11:32.244 INFO:tasks.workunit.client.1.smithi203.stdout:0/617: dread - d0/dd/d71/d94/d2f/d34/f52 zero size 2024-04-12T09:11:32.246 INFO:tasks.workunit.client.1.smithi203.stdout:2/562: rmdir d0/d54/d61/d82 39 2024-04-12T09:11:32.249 INFO:tasks.workunit.client.1.smithi203.stdout:3/494: dread d2/fa [4194304,4194304] 0 2024-04-12T09:11:32.250 INFO:tasks.workunit.client.1.smithi203.stdout:8/513: sync 2024-04-12T09:11:32.252 INFO:tasks.workunit.client.1.smithi203.stdout:3/495: dread - d2/f83 zero size 2024-04-12T09:11:32.252 INFO:tasks.workunit.client.1.smithi203.stdout:5/641: dwrite d0/d6/d16/d9/d30/d58/f99 [0,4194304] 0 2024-04-12T09:11:32.253 INFO:tasks.workunit.client.1.smithi203.stdout:9/480: dread d8/d12/d23/d27/f32 [0,4194304] 0 2024-04-12T09:11:32.254 INFO:tasks.workunit.client.1.smithi203.stdout:1/594: dwrite df/d2d/d6f/d75/d80/d54/d5d/d67/f8b [0,4194304] 0 2024-04-12T09:11:32.256 INFO:tasks.workunit.client.1.smithi203.stdout:8/514: fsync d4/d8/d37/d57/f9f 0 2024-04-12T09:11:32.262 INFO:tasks.workunit.client.1.smithi203.stdout:0/618: symlink d0/d59/d5d/d79/lc5 0 2024-04-12T09:11:32.263 INFO:tasks.workunit.client.1.smithi203.stdout:1/595: write df/d2d/d6f/d75/d80/f74 [519685,539] 0 2024-04-12T09:11:32.265 INFO:tasks.workunit.client.1.smithi203.stdout:6/484: dwrite d1/d3/f39 [0,4194304] 0 2024-04-12T09:11:32.266 INFO:tasks.workunit.client.1.smithi203.stdout:0/619: write d0/dd/d71/d94/f3d [1208767,119059] 0 2024-04-12T09:11:32.268 INFO:tasks.workunit.client.1.smithi203.stdout:1/596: chown df/d2d/d6f/d75/d80/c22 6 1 2024-04-12T09:11:32.270 INFO:tasks.workunit.client.1.smithi203.stdout:4/592: dwrite d1a/d21/d22/d2e/f3c [0,4194304] 0 2024-04-12T09:11:32.271 INFO:tasks.workunit.client.1.smithi203.stdout:4/593: readlink d1a/d20/l4f 0 2024-04-12T09:11:32.274 INFO:tasks.workunit.client.1.smithi203.stdout:3/496: unlink d2/d8/d14/d1b/d95/f8c 0 2024-04-12T09:11:32.276 INFO:tasks.workunit.client.1.smithi203.stdout:9/481: write d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/f9f [422479,120893] 0 2024-04-12T09:11:32.278 INFO:tasks.workunit.client.1.smithi203.stdout:8/515: creat d4/d8/d81/d8e/fa1 x:0 0 0 2024-04-12T09:11:32.302 INFO:tasks.workunit.client.1.smithi203.stdout:7/548: getdents d0/d4/d54/dac 0 2024-04-12T09:11:32.303 INFO:tasks.workunit.client.1.smithi203.stdout:6/485: write d1/d3/f29 [139684,127069] 0 2024-04-12T09:11:32.303 INFO:tasks.workunit.client.1.smithi203.stdout:3/497: creat d2/d8/d14/d23/d35/d4c/d67/f9f x:0 0 0 2024-04-12T09:11:32.303 INFO:tasks.workunit.client.1.smithi203.stdout:9/482: rmdir d8/d12/d23/d38/d8a/d97/d9e/d74 39 2024-04-12T09:11:32.304 INFO:tasks.workunit.client.1.smithi203.stdout:8/516: dwrite d4/d8/d37/f5f [0,4194304] 0 2024-04-12T09:11:32.304 INFO:tasks.workunit.client.1.smithi203.stdout:7/549: fsync d0/f26 0 2024-04-12T09:11:32.305 INFO:tasks.workunit.client.1.smithi203.stdout:5/642: link d0/d6/d16/d9/d30/d58/f99 d0/d6/d16/d9/d30/d89/fe9 0 2024-04-12T09:11:32.306 INFO:tasks.workunit.client.1.smithi203.stdout:6/486: read - d1/df/f41 zero size 2024-04-12T09:11:32.306 INFO:tasks.workunit.client.1.smithi203.stdout:2/563: creat d0/d54/d61/fc4 x:0 0 0 2024-04-12T09:11:32.307 INFO:tasks.workunit.client.1.smithi203.stdout:9/483: chown d8/fb 333593195 1 2024-04-12T09:11:32.309 INFO:tasks.workunit.client.1.smithi203.stdout:0/620: mkdir d0/dd/d71/d94/d2f/dc6 0 2024-04-12T09:11:32.311 INFO:tasks.workunit.client.1.smithi203.stdout:1/597: dwrite df/f17 [0,4194304] 0 2024-04-12T09:11:32.312 INFO:tasks.workunit.client.1.smithi203.stdout:5/643: mknod d0/dbd/cea 0 2024-04-12T09:11:32.312 INFO:tasks.workunit.client.1.smithi203.stdout:3/498: mknod d2/d8/d14/d23/d35/d4c/d5c/ca0 0 2024-04-12T09:11:32.314 INFO:tasks.workunit.client.1.smithi203.stdout:2/564: creat d0/d14/d1e/d2a/fc5 x:0 0 0 2024-04-12T09:11:32.317 INFO:tasks.workunit.client.1.smithi203.stdout:0/621: symlink d0/d59/lc7 0 2024-04-12T09:11:32.318 INFO:tasks.workunit.client.1.smithi203.stdout:0/622: stat d0/dd 0 2024-04-12T09:11:32.318 INFO:tasks.workunit.client.1.smithi203.stdout:6/487: mknod d1/d3/d26/d30/d4a/d6c/d45/d55/d77/c98 0 2024-04-12T09:11:32.320 INFO:tasks.workunit.client.1.smithi203.stdout:0/623: read d0/dd/d71/d94/d2f/d17/f9e [3482374,27306] 0 2024-04-12T09:11:32.321 INFO:tasks.workunit.client.1.smithi203.stdout:0/624: write d0/f3 [3006593,44148] 0 2024-04-12T09:11:32.321 INFO:tasks.workunit.client.1.smithi203.stdout:7/550: creat d0/d4/d1c/d5b/dbf/dc5/fcc x:0 0 0 2024-04-12T09:11:32.323 INFO:tasks.workunit.client.1.smithi203.stdout:0/625: chown d0/dd/d71/d94/d2f/d17/d19/d6f/d78/c7f 68 1 2024-04-12T09:11:32.323 INFO:tasks.workunit.client.1.smithi203.stdout:5/644: creat d0/d6/d11/d18/d2a/dc8/feb x:0 0 0 2024-04-12T09:11:32.324 INFO:tasks.workunit.client.1.smithi203.stdout:5/645: write d0/d6/d16/d9/d86/f9f [556947,31128] 0 2024-04-12T09:11:32.325 INFO:tasks.workunit.client.1.smithi203.stdout:6/488: fdatasync d1/d3/d26/d5d/f8b 0 2024-04-12T09:11:32.327 INFO:tasks.workunit.client.1.smithi203.stdout:1/598: creat df/d2d/d6d/fb4 x:0 0 0 2024-04-12T09:11:32.327 INFO:tasks.workunit.client.1.smithi203.stdout:1/599: chown df/d2d/d6f/d75/d80/l2e 197573 1 2024-04-12T09:11:32.330 INFO:tasks.workunit.client.1.smithi203.stdout:7/551: creat d0/d34/d7c/fcd x:0 0 0 2024-04-12T09:11:32.331 INFO:tasks.workunit.client.1.smithi203.stdout:0/626: truncate d0/d48/d5e/d84/f8b 5116835 0 2024-04-12T09:11:32.334 INFO:tasks.workunit.client.1.smithi203.stdout:5/646: mknod d0/dbd/cec 0 2024-04-12T09:11:32.335 INFO:tasks.workunit.client.1.smithi203.stdout:9/484: link d8/d12/d23/f26 d8/fb1 0 2024-04-12T09:11:32.336 INFO:tasks.workunit.client.1.smithi203.stdout:5/647: dread - d0/d6/d16/d9/d30/fab zero size 2024-04-12T09:11:32.336 INFO:tasks.workunit.client.1.smithi203.stdout:3/499: dwrite d2/d8/d14/d1b/d2f/f32 [0,4194304] 0 2024-04-12T09:11:32.339 INFO:tasks.workunit.client.1.smithi203.stdout:0/627: mknod d0/d59/d5d/d79/cc8 0 2024-04-12T09:11:32.339 INFO:tasks.workunit.client.1.smithi203.stdout:5/648: read d0/d6/d11/d1e/d4c/f64 [1975553,97735] 0 2024-04-12T09:11:32.341 INFO:tasks.workunit.client.1.smithi203.stdout:2/565: rename d0/d14/d1e/f2b to d0/fc6 0 2024-04-12T09:11:32.343 INFO:tasks.workunit.client.1.smithi203.stdout:6/489: mknod d1/d3/c99 0 2024-04-12T09:11:32.348 INFO:tasks.workunit.client.1.smithi203.stdout:7/552: mknod d0/d4/d1c/d3b/cce 0 2024-04-12T09:11:32.349 INFO:tasks.workunit.client.1.smithi203.stdout:3/500: creat d2/d8/d14/d23/d35/fa1 x:0 0 0 2024-04-12T09:11:32.350 INFO:tasks.workunit.client.1.smithi203.stdout:3/501: truncate d2/d8/d14/d23/d35/d4c/d5c/f63 300754 0 2024-04-12T09:11:32.351 INFO:tasks.workunit.client.1.smithi203.stdout:0/628: mkdir d0/dd/d71/d94/d2f/d17/dc9 0 2024-04-12T09:11:32.354 INFO:tasks.workunit.client.1.smithi203.stdout:0/629: dread d0/dd/f99 [0,4194304] 0 2024-04-12T09:11:32.355 INFO:tasks.workunit.client.1.smithi203.stdout:0/630: stat d0/dd/d40/lc0 0 2024-04-12T09:11:32.356 INFO:tasks.workunit.client.1.smithi203.stdout:0/631: fsync d0/dd/d71/d94/d2f/d17/d19/f3b 0 2024-04-12T09:11:32.359 INFO:tasks.workunit.client.1.smithi203.stdout:5/649: rename d0/d6/d11/d1e/fb0 to d0/d6/d16/d9/d14/d2d/fed 0 2024-04-12T09:11:32.361 INFO:tasks.workunit.client.1.smithi203.stdout:6/490: truncate d1/df/f38 564429 0 2024-04-12T09:11:32.373 INFO:tasks.workunit.client.1.smithi203.stdout:3/502: dwrite d2/d8/d14/d23/d35/d91/f9b [0,4194304] 0 2024-04-12T09:11:32.379 INFO:tasks.workunit.client.1.smithi203.stdout:7/553: truncate d0/d4/d1c/f35 1399293 0 2024-04-12T09:11:32.381 INFO:tasks.workunit.client.1.smithi203.stdout:9/485: rename d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/c45 to d8/d12/d23/d38/d8a/cb2 0 2024-04-12T09:11:32.383 INFO:tasks.workunit.client.1.smithi203.stdout:9/486: write d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/f82 [634368,128012] 0 2024-04-12T09:11:32.383 INFO:tasks.workunit.client.1.smithi203.stdout:9/487: readlink d8/d12/d23/d41/l64 0 2024-04-12T09:11:32.384 INFO:tasks.workunit.client.1.smithi203.stdout:9/488: chown d8/d12/d23/d38 119373446 1 2024-04-12T09:11:32.385 INFO:tasks.workunit.client.1.smithi203.stdout:5/650: creat d0/d6/d16/d8/fee x:0 0 0 2024-04-12T09:11:32.386 INFO:tasks.workunit.client.1.smithi203.stdout:2/566: truncate d0/d54/d61/d82/fb5 1277307 0 2024-04-12T09:11:32.386 INFO:tasks.workunit.client.1.smithi203.stdout:2/567: chown d0/fc6 5556 1 2024-04-12T09:11:32.388 INFO:tasks.workunit.client.1.smithi203.stdout:6/491: creat d1/d3/d26/f9a x:0 0 0 2024-04-12T09:11:32.401 INFO:tasks.workunit.client.1.smithi203.stdout:7/554: mknod d0/d15/d2d/ccf 0 2024-04-12T09:11:32.401 INFO:tasks.workunit.client.1.smithi203.stdout:5/651: dread d0/d6/d16/d9/f2e [0,4194304] 0 2024-04-12T09:11:32.408 INFO:tasks.workunit.client.1.smithi203.stdout:6/492: mkdir d1/d3/d26/d9b 0 2024-04-12T09:11:32.408 INFO:tasks.workunit.client.1.smithi203.stdout:0/632: write d0/dd/d71/d94/d2f/d17/f60 [116027,53307] 0 2024-04-12T09:11:32.409 INFO:tasks.workunit.client.1.smithi203.stdout:1/600: link df/d2d/d6f/daa/l70 df/lb5 0 2024-04-12T09:11:32.410 INFO:tasks.workunit.client.1.smithi203.stdout:0/633: dread d0/f13 [0,4194304] 0 2024-04-12T09:11:32.412 INFO:tasks.workunit.client.1.smithi203.stdout:7/555: rmdir d0/d4/d1c/d3b 39 2024-04-12T09:11:32.414 INFO:tasks.workunit.client.1.smithi203.stdout:5/652: creat d0/d6/d11/d1e/d4c/d6a/fef x:0 0 0 2024-04-12T09:11:32.415 INFO:tasks.workunit.client.1.smithi203.stdout:9/489: mkdir d8/d12/d23/db3 0 2024-04-12T09:11:32.416 INFO:tasks.workunit.client.1.smithi203.stdout:9/490: truncate d8/f89 138630 0 2024-04-12T09:11:32.417 INFO:tasks.workunit.client.1.smithi203.stdout:4/594: sync 2024-04-12T09:11:32.417 INFO:tasks.workunit.client.1.smithi203.stdout:2/568: creat d0/d54/d61/db7/fc7 x:0 0 0 2024-04-12T09:11:32.418 INFO:tasks.workunit.client.1.smithi203.stdout:1/601: creat df/d2d/fb6 x:0 0 0 2024-04-12T09:11:32.419 INFO:tasks.workunit.client.1.smithi203.stdout:2/569: write d0/d54/dad/f71 [1044500,85926] 0 2024-04-12T09:11:32.419 INFO:tasks.workunit.client.1.smithi203.stdout:6/493: mkdir d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/d9c 0 2024-04-12T09:11:32.421 INFO:tasks.workunit.client.1.smithi203.stdout:0/634: mkdir d0/d48/d5e/dca 0 2024-04-12T09:11:32.422 INFO:tasks.workunit.client.1.smithi203.stdout:3/503: creat d2/d8/fa2 x:0 0 0 2024-04-12T09:11:32.424 INFO:tasks.workunit.client.1.smithi203.stdout:5/653: unlink d0/d6/d16/d9/d30/d58/d74/le5 0 2024-04-12T09:11:32.424 INFO:tasks.workunit.client.1.smithi203.stdout:4/595: dwrite d1a/d21/d22/d2e/f6f [0,4194304] 0 2024-04-12T09:11:32.427 INFO:tasks.workunit.client.1.smithi203.stdout:9/491: dread d8/d12/d23/f26 [0,4194304] 0 2024-04-12T09:11:32.428 INFO:tasks.workunit.client.1.smithi203.stdout:2/570: fdatasync d0/d14/d1e/f48 0 2024-04-12T09:11:32.429 INFO:tasks.workunit.client.1.smithi203.stdout:2/571: chown d0/d14/d1e/d57 235 1 2024-04-12T09:11:32.430 INFO:tasks.workunit.client.1.smithi203.stdout:9/492: chown d8/d12/d23/d38/d8a/d97/d9e/d74/d8e 205525 1 2024-04-12T09:11:32.430 INFO:tasks.workunit.client.1.smithi203.stdout:2/572: readlink d0/d14/d74/l87 0 2024-04-12T09:11:32.431 INFO:tasks.workunit.client.1.smithi203.stdout:4/596: dwrite d1a/d21/d22/d2e/d8d/d9b/dbc/f83 [0,4194304] 0 2024-04-12T09:11:32.431 INFO:tasks.workunit.client.1.smithi203.stdout:9/493: chown d8/d12/d23/d38/f3d 1123801960 1 2024-04-12T09:11:32.435 INFO:tasks.workunit.client.1.smithi203.stdout:9/494: dread d8/d12/d3e/d90/f95 [0,4194304] 0 2024-04-12T09:11:32.440 INFO:tasks.workunit.client.1.smithi203.stdout:0/635: fsync d0/dd/d71/d94/d2f/d17/d19/fb3 0 2024-04-12T09:11:32.440 INFO:tasks.workunit.client.1.smithi203.stdout:3/504: dwrite d2/d8/d14/d23/d35/d91/f5e [0,4194304] 0 2024-04-12T09:11:32.441 INFO:tasks.workunit.client.1.smithi203.stdout:8/517: sync 2024-04-12T09:11:32.443 INFO:tasks.workunit.client.1.smithi203.stdout:5/654: unlink d0/fbb 0 2024-04-12T09:11:32.450 INFO:tasks.workunit.client.1.smithi203.stdout:3/505: dwrite d2/f83 [0,4194304] 0 2024-04-12T09:11:32.451 INFO:tasks.workunit.client.1.smithi203.stdout:6/494: symlink d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/d9c/l9d 0 2024-04-12T09:11:32.452 INFO:tasks.workunit.client.1.smithi203.stdout:2/573: creat d0/d3/d47/fc8 x:0 0 0 2024-04-12T09:11:32.456 INFO:tasks.workunit.client.1.smithi203.stdout:7/556: write d0/d15/d2d/f66 [2105335,9153] 0 2024-04-12T09:11:32.464 INFO:tasks.workunit.client.1.smithi203.stdout:8/518: mknod d4/d34/ca2 0 2024-04-12T09:11:32.466 INFO:tasks.workunit.client.1.smithi203.stdout:8/519: truncate d4/d8/d74/d78/d53/f5b 4993409 0 2024-04-12T09:11:32.466 INFO:tasks.workunit.client.1.smithi203.stdout:6/495: creat d1/df/d87/f9e x:0 0 0 2024-04-12T09:11:32.467 INFO:tasks.workunit.client.1.smithi203.stdout:6/496: write d1/d3/d26/d30/d4a/f6f [725754,69248] 0 2024-04-12T09:11:32.469 INFO:tasks.workunit.client.1.smithi203.stdout:2/574: fsync d0/d3/d47/fc8 0 2024-04-12T09:11:32.471 INFO:tasks.workunit.client.1.smithi203.stdout:2/575: read - d0/d14/d74/f9d zero size 2024-04-12T09:11:32.472 INFO:tasks.workunit.client.1.smithi203.stdout:4/597: write d1a/d21/d22/f39 [5919489,40443] 0 2024-04-12T09:11:32.473 INFO:tasks.workunit.client.1.smithi203.stdout:1/602: chown df/d2d/d6f/daa/c85 587 1 2024-04-12T09:11:32.474 INFO:tasks.workunit.client.1.smithi203.stdout:6/497: dwrite d1/f37 [0,4194304] 0 2024-04-12T09:11:32.476 INFO:tasks.workunit.client.1.smithi203.stdout:6/498: chown d1/d3/d26/d30/d4a/d6c/d45/d55 4903 1 2024-04-12T09:11:32.476 INFO:tasks.workunit.client.1.smithi203.stdout:8/520: symlink d4/d8/d1c/d5d/la3 0 2024-04-12T09:11:32.478 INFO:tasks.workunit.client.1.smithi203.stdout:7/557: write d0/d4/fe [954721,115640] 0 2024-04-12T09:11:32.484 INFO:tasks.workunit.client.1.smithi203.stdout:9/495: dread d8/f58 [0,4194304] 0 2024-04-12T09:11:32.484 INFO:tasks.workunit.client.1.smithi203.stdout:8/521: dwrite d4/d8/d37/f9b [0,4194304] 0 2024-04-12T09:11:32.484 INFO:tasks.workunit.client.1.smithi203.stdout:9/496: dread - d8/d12/fad zero size 2024-04-12T09:11:32.485 INFO:tasks.workunit.client.1.smithi203.stdout:3/506: rename d2/d8/d14/d45/l88 to d2/d8/d14/d1b/d2f/la3 0 2024-04-12T09:11:32.492 INFO:tasks.workunit.client.1.smithi203.stdout:1/603: write df/d2d/d6f/d75/fa0 [1276973,3611] 0 2024-04-12T09:11:32.494 INFO:tasks.workunit.client.1.smithi203.stdout:1/604: chown df/d2d/d6f/d75/d80/d54/d5d/c7b 30 1 2024-04-12T09:11:32.498 INFO:tasks.workunit.client.1.smithi203.stdout:5/655: truncate d0/d6/d11/d1e/f78 3869765 0 2024-04-12T09:11:32.501 INFO:tasks.workunit.client.1.smithi203.stdout:8/522: creat d4/d8/d81/d84/fa4 x:0 0 0 2024-04-12T09:11:32.505 INFO:tasks.workunit.client.1.smithi203.stdout:3/507: rmdir d2/d8/d14/d1b 39 2024-04-12T09:11:32.505 INFO:tasks.workunit.client.1.smithi203.stdout:5/656: dwrite d0/d6/d16/d9/d86/f9f [0,4194304] 0 2024-04-12T09:11:32.509 INFO:tasks.workunit.client.1.smithi203.stdout:4/598: truncate d1a/d2b/f80 603674 0 2024-04-12T09:11:32.510 INFO:tasks.workunit.client.1.smithi203.stdout:4/599: stat d1a/d21/d22/d2e/f3c 0 2024-04-12T09:11:32.511 INFO:tasks.workunit.client.1.smithi203.stdout:4/600: fsync d1a/d20/f3d 0 2024-04-12T09:11:32.512 INFO:tasks.workunit.client.1.smithi203.stdout:1/605: write df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/d88/f9f [1562745,62730] 0 2024-04-12T09:11:32.517 INFO:tasks.workunit.client.1.smithi203.stdout:2/576: rename d0/d38/d43/c65 to d0/d14/d1e/d57/d95/cc9 0 2024-04-12T09:11:32.518 INFO:tasks.workunit.client.1.smithi203.stdout:2/577: fdatasync d0/d14/d1e/d2a/f60 0 2024-04-12T09:11:32.526 INFO:tasks.workunit.client.1.smithi203.stdout:6/499: link d1/d3/d26/l32 d1/d3/d26/d30/d4a/d6c/l9f 0 2024-04-12T09:11:32.533 INFO:tasks.workunit.client.1.smithi203.stdout:7/558: link d0/d4/lb d0/d15/d2d/ld0 0 2024-04-12T09:11:32.534 INFO:tasks.workunit.client.1.smithi203.stdout:7/559: write d0/d4/f11 [2155955,85621] 0 2024-04-12T09:11:32.535 INFO:tasks.workunit.client.1.smithi203.stdout:7/560: chown d0/d4/l24 493726 1 2024-04-12T09:11:32.538 INFO:tasks.workunit.client.1.smithi203.stdout:0/636: sync 2024-04-12T09:11:32.538 INFO:tasks.workunit.client.1.smithi203.stdout:2/578: mkdir d0/d14/d8a/dca 0 2024-04-12T09:11:32.539 INFO:tasks.workunit.client.1.smithi203.stdout:9/497: rmdir d8/d3b/da3 0 2024-04-12T09:11:32.539 INFO:tasks.workunit.client.1.smithi203.stdout:7/561: read d0/d4/d54/d75/f9a [2405616,94703] 0 2024-04-12T09:11:32.541 INFO:tasks.workunit.client.1.smithi203.stdout:5/657: dread d0/d6/d16/d9/d14/f25 [0,4194304] 0 2024-04-12T09:11:32.541 INFO:tasks.workunit.client.1.smithi203.stdout:2/579: write d0/d19/fc0 [470154,26873] 0 2024-04-12T09:11:32.543 INFO:tasks.workunit.client.1.smithi203.stdout:4/601: dwrite fb [0,4194304] 0 2024-04-12T09:11:32.545 INFO:tasks.workunit.client.1.smithi203.stdout:4/602: stat d1a/d1d/d69/f92 0 2024-04-12T09:11:32.545 INFO:tasks.workunit.client.1.smithi203.stdout:4/603: dread - d1a/d21/f67 zero size 2024-04-12T09:11:32.547 INFO:tasks.workunit.client.1.smithi203.stdout:6/500: write d1/d3/d4/f88 [1456762,16779] 0 2024-04-12T09:11:32.548 INFO:tasks.workunit.client.1.smithi203.stdout:0/637: dread d0/dd/d71/d94/d2f/d17/d19/f3b [4194304,4194304] 0 2024-04-12T09:11:32.550 INFO:tasks.workunit.client.1.smithi203.stdout:7/562: dwrite d0/d4/d1c/f9d [0,4194304] 0 2024-04-12T09:11:32.554 INFO:tasks.workunit.client.1.smithi203.stdout:8/523: truncate d4/d8/d81/f8b 823587 0 2024-04-12T09:11:32.556 INFO:tasks.workunit.client.1.smithi203.stdout:6/501: dwrite d1/d3/d5b/d8c/f66 [0,4194304] 0 2024-04-12T09:11:32.558 INFO:tasks.workunit.client.1.smithi203.stdout:1/606: truncate df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/d88/f9f 40288 0 2024-04-12T09:11:32.559 INFO:tasks.workunit.client.1.smithi203.stdout:3/508: creat d2/d8/d14/d1b/d95/d92/fa4 x:0 0 0 2024-04-12T09:11:32.560 INFO:tasks.workunit.client.1.smithi203.stdout:9/498: creat d8/d12/d3e/fb4 x:0 0 0 2024-04-12T09:11:32.560 INFO:tasks.workunit.client.1.smithi203.stdout:1/607: readlink df/d2d/d6f/daa/l78 0 2024-04-12T09:11:32.563 INFO:tasks.workunit.client.1.smithi203.stdout:5/658: fdatasync d0/d6/f22 0 2024-04-12T09:11:32.564 INFO:tasks.workunit.client.1.smithi203.stdout:1/608: chown df/d2d/d6f/d75/d80/d2b/l7d 804 1 2024-04-12T09:11:32.564 INFO:tasks.workunit.client.1.smithi203.stdout:6/502: dwrite d1/d3/d26/d30/d4a/f7d [0,4194304] 0 2024-04-12T09:11:32.568 INFO:tasks.workunit.client.1.smithi203.stdout:0/638: mkdir d0/dd/d71/d94/d2f/d17/d19/d6f/dcb 0 2024-04-12T09:11:32.569 INFO:tasks.workunit.client.1.smithi203.stdout:7/563: unlink d0/d4/d53/c99 0 2024-04-12T09:11:32.572 INFO:tasks.workunit.client.1.smithi203.stdout:8/524: mkdir d4/d8/d1c/d48/d5e/da5 0 2024-04-12T09:11:32.575 INFO:tasks.workunit.client.1.smithi203.stdout:3/509: unlink d2/d8/d14/d23/d35/d91/f5e 0 2024-04-12T09:11:32.578 INFO:tasks.workunit.client.1.smithi203.stdout:1/609: rmdir df/d59/db0 39 2024-04-12T09:11:32.580 INFO:tasks.workunit.client.1.smithi203.stdout:6/503: mkdir d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/da0 0 2024-04-12T09:11:32.582 INFO:tasks.workunit.client.1.smithi203.stdout:0/639: creat d0/dd/dbd/fcc x:0 0 0 2024-04-12T09:11:32.584 INFO:tasks.workunit.client.1.smithi203.stdout:7/564: unlink d0/d4/l24 0 2024-04-12T09:11:32.587 INFO:tasks.workunit.client.1.smithi203.stdout:8/525: mkdir d4/d8/d74/da6 0 2024-04-12T09:11:32.588 INFO:tasks.workunit.client.1.smithi203.stdout:7/565: dread d0/d4/d1c/faa [0,4194304] 0 2024-04-12T09:11:32.591 INFO:tasks.workunit.client.1.smithi203.stdout:5/659: symlink d0/d6/d11/d18/d2a/lf0 0 2024-04-12T09:11:32.595 INFO:tasks.workunit.client.1.smithi203.stdout:4/604: creat d1a/d20/d5d/d2c/d72/fc2 x:0 0 0 2024-04-12T09:11:32.595 INFO:tasks.workunit.client.1.smithi203.stdout:4/605: dread - d1a/d20/fab zero size 2024-04-12T09:11:32.598 INFO:tasks.workunit.client.1.smithi203.stdout:2/580: dread d0/d14/d1e/d2a/f52 [4194304,4194304] 0 2024-04-12T09:11:32.600 INFO:tasks.workunit.client.1.smithi203.stdout:0/640: mkdir d0/dd/d71/d94/d2f/d17/d19/d6f/d78/dcd 0 2024-04-12T09:11:32.604 INFO:tasks.workunit.client.1.smithi203.stdout:8/526: fdatasync d4/d8/f7b 0 2024-04-12T09:11:32.604 INFO:tasks.workunit.client.1.smithi203.stdout:8/527: stat d4/d8/d74/d78/f6d 0 2024-04-12T09:11:32.605 INFO:tasks.workunit.client.1.smithi203.stdout:8/528: fdatasync d4/f2d 0 2024-04-12T09:11:32.605 INFO:tasks.workunit.client.1.smithi203.stdout:8/529: chown d4/f5a 646763 1 2024-04-12T09:11:32.608 INFO:tasks.workunit.client.1.smithi203.stdout:7/566: unlink d0/d4/f60 0 2024-04-12T09:11:32.611 INFO:tasks.workunit.client.1.smithi203.stdout:9/499: creat d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/fb5 x:0 0 0 2024-04-12T09:11:32.615 INFO:tasks.workunit.client.1.smithi203.stdout:4/606: truncate d1a/d20/fa4 144300 0 2024-04-12T09:11:32.616 INFO:tasks.workunit.client.1.smithi203.stdout:5/660: dwrite d0/d6/d16/d9/d30/d58/f99 [0,4194304] 0 2024-04-12T09:11:32.617 INFO:tasks.workunit.client.1.smithi203.stdout:2/581: creat d0/d3/d8f/d98/fcb x:0 0 0 2024-04-12T09:11:32.621 INFO:tasks.workunit.client.1.smithi203.stdout:8/530: mkdir d4/d8/d1c/d5d/da7 0 2024-04-12T09:11:32.624 INFO:tasks.workunit.client.1.smithi203.stdout:7/567: write d0/d4/d1c/d3b/d4c/fa3 [946273,33794] 0 2024-04-12T09:11:32.624 INFO:tasks.workunit.client.1.smithi203.stdout:8/531: read d4/f6 [2496123,7050] 0 2024-04-12T09:11:32.625 INFO:tasks.workunit.client.1.smithi203.stdout:3/510: rmdir d2/d8/d14/d69 0 2024-04-12T09:11:32.626 INFO:tasks.workunit.client.1.smithi203.stdout:9/500: symlink d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/d93/lb6 0 2024-04-12T09:11:32.627 INFO:tasks.workunit.client.1.smithi203.stdout:7/568: chown d0/d4/d1c/d5b/f8e 125 1 2024-04-12T09:11:32.628 INFO:tasks.workunit.client.1.smithi203.stdout:6/504: dwrite d1/d3/d26/f79 [0,4194304] 0 2024-04-12T09:11:32.633 INFO:tasks.workunit.client.1.smithi203.stdout:8/532: dwrite d4/d8/d37/f9b [0,4194304] 0 2024-04-12T09:11:32.634 INFO:tasks.workunit.client.1.smithi203.stdout:1/610: truncate df/d2d/d6f/d75/d80/d54/d5d/d67/f8b 3890155 0 2024-04-12T09:11:32.635 INFO:tasks.workunit.client.1.smithi203.stdout:0/641: dread d0/dd/d71/d94/d2f/d34/db1/f6c [0,4194304] 0 2024-04-12T09:11:32.637 INFO:tasks.workunit.client.1.smithi203.stdout:9/501: dread d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/f59 [0,4194304] 0 2024-04-12T09:11:32.637 INFO:tasks.workunit.client.1.smithi203.stdout:2/582: unlink d0/d19/fc0 0 2024-04-12T09:11:32.639 INFO:tasks.workunit.client.1.smithi203.stdout:2/583: chown d0/d54/d61/d78 212 1 2024-04-12T09:11:32.643 INFO:tasks.workunit.client.1.smithi203.stdout:8/533: dwrite d4/f4b [0,4194304] 0 2024-04-12T09:11:32.647 INFO:tasks.workunit.client.1.smithi203.stdout:0/642: dwrite d0/dd/d71/d94/f3d [0,4194304] 0 2024-04-12T09:11:32.647 INFO:tasks.workunit.client.1.smithi203.stdout:3/511: fsync d2/f82 0 2024-04-12T09:11:32.654 INFO:tasks.workunit.client.1.smithi203.stdout:4/607: mknod d1a/d21/d60/d68/dbe/cc3 0 2024-04-12T09:11:32.654 INFO:tasks.workunit.client.1.smithi203.stdout:4/608: chown d1a/d21/d60/l70 37405649 1 2024-04-12T09:11:32.659 INFO:tasks.workunit.client.1.smithi203.stdout:5/661: write d0/d6/d11/d1e/d4c/d48/fb5 [169750,55192] 0 2024-04-12T09:11:32.660 INFO:tasks.workunit.client.1.smithi203.stdout:5/662: fsync d0/d6/fb2 0 2024-04-12T09:11:32.668 INFO:tasks.workunit.client.1.smithi203.stdout:9/502: mkdir d8/d3b/db7 0 2024-04-12T09:11:32.668 INFO:tasks.workunit.client.1.smithi203.stdout:1/611: dread df/d2d/d6f/d75/d80/d2b/f52 [0,4194304] 0 2024-04-12T09:11:32.669 INFO:tasks.workunit.client.1.smithi203.stdout:1/612: chown df/d2d/d6f/d75/d80/d54/d5d/d58/d94/f97 1661733215 1 2024-04-12T09:11:32.670 INFO:tasks.workunit.client.1.smithi203.stdout:1/613: fsync df/d2d/d6f/d75/d80/d54/f46 0 2024-04-12T09:11:32.672 INFO:tasks.workunit.client.1.smithi203.stdout:3/512: creat d2/d51/fa5 x:0 0 0 2024-04-12T09:11:32.672 INFO:tasks.workunit.client.1.smithi203.stdout:4/609: read d1a/d21/d22/d2e/d78/fb3 [76196,115419] 0 2024-04-12T09:11:32.673 INFO:tasks.workunit.client.1.smithi203.stdout:6/505: unlink d1/d3/f62 0 2024-04-12T09:11:32.674 INFO:tasks.workunit.client.1.smithi203.stdout:6/506: fsync d1/d3/f2d 0 2024-04-12T09:11:32.677 INFO:tasks.workunit.client.1.smithi203.stdout:5/663: mkdir d0/d6/d11/d1e/d4c/d48/df1 0 2024-04-12T09:11:32.680 INFO:tasks.workunit.client.1.smithi203.stdout:7/569: truncate d0/d15/d2d/d5e/d8c/fc4 3780039 0 2024-04-12T09:11:32.683 INFO:tasks.workunit.client.1.smithi203.stdout:2/584: mkdir d0/d3/d8e/dcc 0 2024-04-12T09:11:32.683 INFO:tasks.workunit.client.1.smithi203.stdout:9/503: dread d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/f59 [0,4194304] 0 2024-04-12T09:11:32.684 INFO:tasks.workunit.client.1.smithi203.stdout:9/504: stat d8/d3b/c48 0 2024-04-12T09:11:32.686 INFO:tasks.workunit.client.1.smithi203.stdout:9/505: dread - d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/d93/fa7 zero size 2024-04-12T09:11:32.689 INFO:tasks.workunit.client.1.smithi203.stdout:1/614: mknod df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/cb7 0 2024-04-12T09:11:32.691 INFO:tasks.workunit.client.1.smithi203.stdout:1/615: chown df/d2d/d6f/d75/d80/d54 4158289 1 2024-04-12T09:11:32.691 INFO:tasks.workunit.client.1.smithi203.stdout:6/507: dread d1/d3/d26/d30/d4a/d6c/f92 [0,4194304] 0 2024-04-12T09:11:32.692 INFO:tasks.workunit.client.1.smithi203.stdout:1/616: write df/d59/f7e [271236,116824] 0 2024-04-12T09:11:32.693 INFO:tasks.workunit.client.1.smithi203.stdout:6/508: truncate d1/d3/d26/f61 981099 0 2024-04-12T09:11:32.694 INFO:tasks.workunit.client.1.smithi203.stdout:6/509: chown d1/d3/d26/d30/d4a/d6c/l9f 41 1 2024-04-12T09:11:32.695 INFO:tasks.workunit.client.1.smithi203.stdout:6/510: read d1/d3/f29 [147598,3731] 0 2024-04-12T09:11:32.697 INFO:tasks.workunit.client.1.smithi203.stdout:5/664: mkdir d0/d6/d16/d9/d80/df2 0 2024-04-12T09:11:32.698 INFO:tasks.workunit.client.1.smithi203.stdout:4/610: dread d1a/d20/f5e [0,4194304] 0 2024-04-12T09:11:32.698 INFO:tasks.workunit.client.1.smithi203.stdout:7/570: symlink d0/d4/d1c/d3b/d4c/ld1 0 2024-04-12T09:11:32.704 INFO:tasks.workunit.client.1.smithi203.stdout:2/585: mkdir d0/d14/d1e/d2a/dcd 0 2024-04-12T09:11:32.705 INFO:tasks.workunit.client.1.smithi203.stdout:2/586: readlink d0/d3/d47/l8c 0 2024-04-12T09:11:32.706 INFO:tasks.workunit.client.1.smithi203.stdout:8/534: link d4/d8/f77 d4/fa8 0 2024-04-12T09:11:32.706 INFO:tasks.workunit.client.1.smithi203.stdout:2/587: truncate d0/d38/fbb 338154 0 2024-04-12T09:11:32.709 INFO:tasks.workunit.client.1.smithi203.stdout:9/506: mkdir d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d40/db8 0 2024-04-12T09:11:32.711 INFO:tasks.workunit.client.1.smithi203.stdout:1/617: mkdir df/d2d/d6f/d75/d80/d2b/d91/db8 0 2024-04-12T09:11:32.712 INFO:tasks.workunit.client.1.smithi203.stdout:8/535: dwrite d4/f97 [0,4194304] 0 2024-04-12T09:11:32.714 INFO:tasks.workunit.client.1.smithi203.stdout:2/588: dwrite d0/d14/d23/f8b [0,4194304] 0 2024-04-12T09:11:32.714 INFO:tasks.workunit.client.1.smithi203.stdout:6/511: mkdir d1/d3/d5b/d8c/d3e/da1 0 2024-04-12T09:11:32.714 INFO:tasks.workunit.client.1.smithi203.stdout:9/507: write d8/d12/d23/d38/d8a/d97/d9e/d74/f86 [645616,13145] 0 2024-04-12T09:11:32.716 INFO:tasks.workunit.client.1.smithi203.stdout:9/508: chown d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d40 963051347 1 2024-04-12T09:11:32.724 INFO:tasks.workunit.client.1.smithi203.stdout:3/513: creat d2/d8/d14/fa6 x:0 0 0 2024-04-12T09:11:32.724 INFO:tasks.workunit.client.1.smithi203.stdout:3/514: readlink d2/d8/d14/d45/l4e 0 2024-04-12T09:11:32.730 INFO:tasks.workunit.client.1.smithi203.stdout:5/665: dread d0/d6/d16/d9/d30/f6f [0,4194304] 0 2024-04-12T09:11:32.734 INFO:tasks.workunit.client.1.smithi203.stdout:2/589: fdatasync d0/d14/d74/f7d 0 2024-04-12T09:11:32.734 INFO:tasks.workunit.client.1.smithi203.stdout:0/643: sync 2024-04-12T09:11:32.735 INFO:tasks.workunit.client.1.smithi203.stdout:0/644: fsync d0/d48/dc1/fc2 0 2024-04-12T09:11:32.736 INFO:tasks.workunit.client.1.smithi203.stdout:9/509: read - d8/d12/d3e/f76 zero size 2024-04-12T09:11:32.739 INFO:tasks.workunit.client.1.smithi203.stdout:4/611: mknod d1a/d21/d22/cc4 0 2024-04-12T09:11:32.740 INFO:tasks.workunit.client.1.smithi203.stdout:7/571: write d0/d15/f63 [854745,15799] 0 2024-04-12T09:11:32.740 INFO:tasks.workunit.client.1.smithi203.stdout:2/590: dwrite d0/d14/d1e/d2a/fc5 [0,4194304] 0 2024-04-12T09:11:32.741 INFO:tasks.workunit.client.1.smithi203.stdout:4/612: stat d1a/d21/d60/fa6 0 2024-04-12T09:11:32.742 INFO:tasks.workunit.client.1.smithi203.stdout:2/591: stat d0/d54/d61/d78/d89/fa2 0 2024-04-12T09:11:32.742 INFO:tasks.workunit.client.1.smithi203.stdout:4/613: chown l18 5008112 1 2024-04-12T09:11:32.744 INFO:tasks.workunit.client.1.smithi203.stdout:8/536: mknod d4/d8/d1c/d48/ca9 0 2024-04-12T09:11:32.744 INFO:tasks.workunit.client.1.smithi203.stdout:8/537: fdatasync d4/d8/d74/d78/d53/f68 0 2024-04-12T09:11:32.753 INFO:tasks.workunit.client.1.smithi203.stdout:9/510: fsync d8/fb1 0 2024-04-12T09:11:32.755 INFO:tasks.workunit.client.1.smithi203.stdout:7/572: symlink d0/d4/d1c/d3b/d4c/ld2 0 2024-04-12T09:11:32.759 INFO:tasks.workunit.client.1.smithi203.stdout:9/511: dwrite d8/d12/d3e/fa2 [0,4194304] 0 2024-04-12T09:11:32.760 INFO:tasks.workunit.client.1.smithi203.stdout:1/618: link df/d2d/d6f/daa/f62 df/d2d/d6f/d75/d80/fb9 0 2024-04-12T09:11:32.766 INFO:tasks.workunit.client.1.smithi203.stdout:1/619: dwrite df/d2d/d6f/d75/d80/d54/d5d/d67/f6b [0,4194304] 0 2024-04-12T09:11:32.767 INFO:tasks.workunit.client.1.smithi203.stdout:3/515: rename d2/d8/l3b to d2/d8/d14/d1b/la7 0 2024-04-12T09:11:32.768 INFO:tasks.workunit.client.1.smithi203.stdout:4/614: mkdir d1a/d21/d60/daa/dc5 0 2024-04-12T09:11:32.769 INFO:tasks.workunit.client.1.smithi203.stdout:7/573: rmdir d0/d15/d89 39 2024-04-12T09:11:32.771 INFO:tasks.workunit.client.1.smithi203.stdout:7/574: write d0/d4/d1c/d3b/fc7 [71528,53206] 0 2024-04-12T09:11:32.772 INFO:tasks.workunit.client.1.smithi203.stdout:6/512: write d1/df/f38 [1454577,87447] 0 2024-04-12T09:11:32.774 INFO:tasks.workunit.client.1.smithi203.stdout:8/538: mknod d4/d8/d1c/d48/caa 0 2024-04-12T09:11:32.779 INFO:tasks.workunit.client.1.smithi203.stdout:3/516: mknod d2/d64/ca8 0 2024-04-12T09:11:32.782 INFO:tasks.workunit.client.1.smithi203.stdout:1/620: creat df/d2d/d6f/d75/d80/d54/d5d/d58/fba x:0 0 0 2024-04-12T09:11:32.782 INFO:tasks.workunit.client.1.smithi203.stdout:5/666: dwrite d0/d6/d11/d18/dcc/fdd [0,4194304] 0 2024-04-12T09:11:32.783 INFO:tasks.workunit.client.1.smithi203.stdout:4/615: mknod d1a/d21/d22/d2e/d8d/d9b/cc6 0 2024-04-12T09:11:32.784 INFO:tasks.workunit.client.1.smithi203.stdout:5/667: stat d0/dbd/dd0/le0 0 2024-04-12T09:11:32.785 INFO:tasks.workunit.client.1.smithi203.stdout:5/668: chown d0/d6/d16/d8 6883658 1 2024-04-12T09:11:32.785 INFO:tasks.workunit.client.1.smithi203.stdout:7/575: unlink d0/d4/d1c/d3b/d4c/fa3 0 2024-04-12T09:11:32.786 INFO:tasks.workunit.client.1.smithi203.stdout:9/512: dwrite d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/f59 [0,4194304] 0 2024-04-12T09:11:32.794 INFO:tasks.workunit.client.1.smithi203.stdout:5/669: dwrite d0/d6/d11/d1e/d4c/f8c [0,4194304] 0 2024-04-12T09:11:32.796 INFO:tasks.workunit.client.1.smithi203.stdout:3/517: fsync d2/d8/d14/f40 0 2024-04-12T09:11:32.797 INFO:tasks.workunit.client.1.smithi203.stdout:1/621: symlink df/d2d/d6f/d75/d80/d2b/lbb 0 2024-04-12T09:11:32.798 INFO:tasks.workunit.client.1.smithi203.stdout:1/622: chown df/ca3 23 1 2024-04-12T09:11:32.800 INFO:tasks.workunit.client.1.smithi203.stdout:9/513: creat d8/d12/d23/d85/fb9 x:0 0 0 2024-04-12T09:11:32.802 INFO:tasks.workunit.client.1.smithi203.stdout:0/645: rename d0/d48/d5e/d84/l9b to d0/lce 0 2024-04-12T09:11:32.804 INFO:tasks.workunit.client.1.smithi203.stdout:5/670: stat d0/d5d/c75 0 2024-04-12T09:11:32.805 INFO:tasks.workunit.client.1.smithi203.stdout:3/518: creat d2/d8/d14/d45/fa9 x:0 0 0 2024-04-12T09:11:32.806 INFO:tasks.workunit.client.1.smithi203.stdout:9/514: dread d8/d12/d23/d38/d8a/d97/d9e/d74/f86 [0,4194304] 0 2024-04-12T09:11:32.808 INFO:tasks.workunit.client.1.smithi203.stdout:1/623: creat df/d2d/d6f/d75/d80/d2b/fbc x:0 0 0 2024-04-12T09:11:32.809 INFO:tasks.workunit.client.1.smithi203.stdout:8/539: link d4/d8/d74/d78/f3a d4/d8/d1c/fab 0 2024-04-12T09:11:32.816 INFO:tasks.workunit.client.1.smithi203.stdout:9/515: symlink d8/d12/d23/d38/d8a/lba 0 2024-04-12T09:11:32.832 INFO:tasks.workunit.client.1.smithi203.stdout:0/646: truncate d0/dd/d71/d94/d2f/f66 856290 0 2024-04-12T09:11:32.834 INFO:tasks.workunit.client.1.smithi203.stdout:4/616: getdents d1a/d2b 0 2024-04-12T09:11:32.835 INFO:tasks.workunit.client.1.smithi203.stdout:2/592: sync 2024-04-12T09:11:32.835 INFO:tasks.workunit.client.1.smithi203.stdout:2/593: chown d0/d3/d8f/fc2 31688 1 2024-04-12T09:11:32.838 INFO:tasks.workunit.client.1.smithi203.stdout:9/516: creat d8/d12/d3e/fbb x:0 0 0 2024-04-12T09:11:32.839 INFO:tasks.workunit.client.1.smithi203.stdout:9/517: write d8/d12/f83 [3434308,37312] 0 2024-04-12T09:11:32.839 INFO:tasks.workunit.client.1.smithi203.stdout:1/624: mknod df/d59/cbd 0 2024-04-12T09:11:32.847 INFO:tasks.workunit.client.1.smithi203.stdout:6/513: rename d1/d3/d26/d30/d4a/d6c/d45/d55/d77/c98 to d1/d3/ca2 0 2024-04-12T09:11:32.849 INFO:tasks.workunit.client.1.smithi203.stdout:4/617: mkdir d1a/d21/d22/d2e/d8d/d9b/dbc/dc7 0 2024-04-12T09:11:32.849 INFO:tasks.workunit.client.1.smithi203.stdout:4/618: stat d1a/d21/d60 0 2024-04-12T09:11:32.850 INFO:tasks.workunit.client.1.smithi203.stdout:6/514: truncate d1/d3/d26/f9a 577091 0 2024-04-12T09:11:32.853 INFO:tasks.workunit.client.1.smithi203.stdout:2/594: unlink d0/d38/f77 0 2024-04-12T09:11:32.854 INFO:tasks.workunit.client.1.smithi203.stdout:2/595: readlink d0/d14/d74/l87 0 2024-04-12T09:11:32.859 INFO:tasks.workunit.client.1.smithi203.stdout:9/518: creat d8/d12/d23/d27/fbc x:0 0 0 2024-04-12T09:11:32.861 INFO:tasks.workunit.client.1.smithi203.stdout:0/647: dread d0/dd/dbd/fc4 [0,4194304] 0 2024-04-12T09:11:32.865 INFO:tasks.workunit.client.1.smithi203.stdout:7/576: rename d0/d4/d1c/d3b/d4c/lc1 to d0/d15/d2d/ld3 0 2024-04-12T09:11:32.867 INFO:tasks.workunit.client.1.smithi203.stdout:6/515: truncate d1/d3/d5b/d8c/f23 2683573 0 2024-04-12T09:11:32.872 INFO:tasks.workunit.client.1.smithi203.stdout:1/625: creat df/d2d/d6f/d75/d80/d2b/d91/db8/fbe x:0 0 0 2024-04-12T09:11:32.875 INFO:tasks.workunit.client.1.smithi203.stdout:9/519: truncate d8/d12/d23/f77 246796 0 2024-04-12T09:11:32.875 INFO:tasks.workunit.client.1.smithi203.stdout:8/540: getdents d4/d8/d74/d78/d53/d8f 0 2024-04-12T09:11:32.875 INFO:tasks.workunit.client.1.smithi203.stdout:9/520: truncate d8/f6b 5206853 0 2024-04-12T09:11:32.875 INFO:tasks.workunit.client.1.smithi203.stdout:8/541: chown d4/d8/c99 17706 1 2024-04-12T09:11:32.884 INFO:tasks.workunit.client.1.smithi203.stdout:4/619: link f14 d1a/d20/d5d/d2c/d72/fc8 0 2024-04-12T09:11:32.884 INFO:tasks.workunit.client.1.smithi203.stdout:2/596: write d0/d14/d23/f2d [199206,110034] 0 2024-04-12T09:11:32.885 INFO:tasks.workunit.client.1.smithi203.stdout:4/620: chown d1a/d34/f35 3597094 1 2024-04-12T09:11:32.888 INFO:tasks.workunit.client.1.smithi203.stdout:5/671: rename d0/d6/d11/l53 to d0/d6/d16/d8/lf3 0 2024-04-12T09:11:32.889 INFO:tasks.workunit.client.1.smithi203.stdout:7/577: rmdir d0/d4/d54/d75/dc0 39 2024-04-12T09:11:32.896 INFO:tasks.workunit.client.1.smithi203.stdout:1/626: write df/d2d/d6d/fb4 [544311,105781] 0 2024-04-12T09:11:32.900 INFO:tasks.workunit.client.1.smithi203.stdout:7/578: dread d0/d4/f11 [0,4194304] 0 2024-04-12T09:11:32.905 INFO:tasks.workunit.client.1.smithi203.stdout:2/597: mkdir d0/d14/d1e/d2a/dce 0 2024-04-12T09:11:32.905 INFO:tasks.workunit.client.1.smithi203.stdout:5/672: dread d0/d6/d11/d1e/d4c/f42 [0,4194304] 0 2024-04-12T09:11:32.907 INFO:tasks.workunit.client.1.smithi203.stdout:4/621: symlink d1a/d20/d5d/d2c/d72/lc9 0 2024-04-12T09:11:32.910 INFO:tasks.workunit.client.1.smithi203.stdout:3/519: rename d2/d8/d14/d23/d35/d4c/d67/f72 to d2/d8/d14/d1b/d95/d92/faa 0 2024-04-12T09:11:32.911 INFO:tasks.workunit.client.1.smithi203.stdout:3/520: chown d2/d8/d14/d23/d35/d94 57842 1 2024-04-12T09:11:32.913 INFO:tasks.workunit.client.1.smithi203.stdout:9/521: write d8/d12/d23/d27/f32 [2332247,50046] 0 2024-04-12T09:11:32.918 INFO:tasks.workunit.client.1.smithi203.stdout:3/521: dwrite d2/d8/d14/d23/d35/d4c/d5c/f63 [0,4194304] 0 2024-04-12T09:11:32.926 INFO:tasks.workunit.client.1.smithi203.stdout:6/516: mknod d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/da0/ca3 0 2024-04-12T09:11:32.930 INFO:tasks.workunit.client.1.smithi203.stdout:6/517: dread d1/d3/d12/f5e [0,4194304] 0 2024-04-12T09:11:32.933 INFO:tasks.workunit.client.1.smithi203.stdout:7/579: mkdir d0/d4/d54/dac/dd4 0 2024-04-12T09:11:32.934 INFO:tasks.workunit.client.1.smithi203.stdout:7/580: dread - d0/d38/d51/fcb zero size 2024-04-12T09:11:32.937 INFO:tasks.workunit.client.1.smithi203.stdout:8/542: mknod d4/d8/d37/d57/d7d/cac 0 2024-04-12T09:11:32.937 INFO:tasks.workunit.client.1.smithi203.stdout:8/543: chown l2 305 1 2024-04-12T09:11:32.937 INFO:tasks.workunit.client.1.smithi203.stdout:7/581: dread d0/d4/d54/f77 [0,4194304] 0 2024-04-12T09:11:32.941 INFO:tasks.workunit.client.1.smithi203.stdout:2/598: truncate d0/d3/f10 605741 0 2024-04-12T09:11:32.943 INFO:tasks.workunit.client.1.smithi203.stdout:7/582: dread d0/f26 [0,4194304] 0 2024-04-12T09:11:32.943 INFO:tasks.workunit.client.1.smithi203.stdout:7/583: chown d0/d4/c31 3782666 1 2024-04-12T09:11:32.944 INFO:tasks.workunit.client.1.smithi203.stdout:5/673: unlink d0/d6/d16/d9/d80/c96 0 2024-04-12T09:11:32.946 INFO:tasks.workunit.client.1.smithi203.stdout:4/622: chown c13 2884398 1 2024-04-12T09:11:32.954 INFO:tasks.workunit.client.1.smithi203.stdout:9/522: symlink d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d70/lbd 0 2024-04-12T09:11:32.954 INFO:tasks.workunit.client.1.smithi203.stdout:9/523: truncate d8/f4a 4283696 0 2024-04-12T09:11:32.959 INFO:tasks.workunit.client.1.smithi203.stdout:3/522: unlink d2/d51/d65/f98 0 2024-04-12T09:11:32.959 INFO:tasks.workunit.client.1.smithi203.stdout:9/524: dwrite d8/d12/d23/d41/f5e [0,4194304] 0 2024-04-12T09:11:32.959 INFO:tasks.workunit.client.1.smithi203.stdout:9/525: chown d8/d12/d23/d38 8646362 1 2024-04-12T09:11:32.962 INFO:tasks.workunit.client.1.smithi203.stdout:1/627: mknod df/d2d/d6f/d75/cbf 0 2024-04-12T09:11:32.964 INFO:tasks.workunit.client.1.smithi203.stdout:6/518: symlink d1/d3/d26/d30/d4a/d6c/d45/d55/d77/la4 0 2024-04-12T09:11:32.967 INFO:tasks.workunit.client.1.smithi203.stdout:8/544: creat d4/d8/d1c/d5d/fad x:0 0 0 2024-04-12T09:11:32.967 INFO:tasks.workunit.client.1.smithi203.stdout:0/648: getdents d0/d48/d5e 0 2024-04-12T09:11:32.969 INFO:tasks.workunit.client.1.smithi203.stdout:7/584: mknod d0/d38/d79/cd5 0 2024-04-12T09:11:32.971 INFO:tasks.workunit.client.1.smithi203.stdout:5/674: mkdir d0/d6/d11/d4a/df4 0 2024-04-12T09:11:32.972 INFO:tasks.workunit.client.1.smithi203.stdout:4/623: unlink d1a/d21/d22/d2e/d78/lb0 0 2024-04-12T09:11:32.978 INFO:tasks.workunit.client.1.smithi203.stdout:5/675: dwrite d0/d6/d16/d9/d30/d58/d74/d88/f97 [4194304,4194304] 0 2024-04-12T09:11:32.980 INFO:tasks.workunit.client.1.smithi203.stdout:4/624: dwrite d1a/d1d/d69/f9a [0,4194304] 0 2024-04-12T09:11:32.981 INFO:tasks.workunit.client.1.smithi203.stdout:4/625: write d1a/d21/d60/f89 [2118341,29350] 0 2024-04-12T09:11:32.982 INFO:tasks.workunit.client.1.smithi203.stdout:3/523: mknod d2/d8/d14/d23/d35/d4c/d67/d86/cab 0 2024-04-12T09:11:32.987 INFO:tasks.workunit.client.1.smithi203.stdout:9/526: symlink d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d40/lbe 0 2024-04-12T09:11:32.995 INFO:tasks.workunit.client.1.smithi203.stdout:1/628: truncate df/d2d/f68 1984262 0 2024-04-12T09:11:32.995 INFO:tasks.workunit.client.1.smithi203.stdout:3/524: dread d2/f37 [0,4194304] 0 2024-04-12T09:11:32.996 INFO:tasks.workunit.client.1.smithi203.stdout:2/599: link d0/d38/d43/d9c/fac d0/d38/d43/d9c/fcf 0 2024-04-12T09:11:32.998 INFO:tasks.workunit.client.1.smithi203.stdout:8/545: dread d4/d8/d1c/d5d/f4f [0,4194304] 0 2024-04-12T09:11:32.999 INFO:tasks.workunit.client.1.smithi203.stdout:7/585: mknod d0/d4/d1c/d5b/cd6 0 2024-04-12T09:11:33.002 INFO:tasks.workunit.client.1.smithi203.stdout:1/629: dwrite df/f33 [0,4194304] 0 2024-04-12T09:11:33.003 INFO:tasks.workunit.client.1.smithi203.stdout:5/676: mkdir d0/d6/d16/d9/d86/df5 0 2024-04-12T09:11:33.003 INFO:tasks.workunit.client.1.smithi203.stdout:1/630: stat df/d2d/d6f/d8d/da7 0 2024-04-12T09:11:33.005 INFO:tasks.workunit.client.1.smithi203.stdout:4/626: creat d1a/d1d/d69/fca x:0 0 0 2024-04-12T09:11:33.006 INFO:tasks.workunit.client.1.smithi203.stdout:9/527: symlink d8/d12/d23/d38/d8a/lbf 0 2024-04-12T09:11:33.015 INFO:tasks.workunit.client.1.smithi203.stdout:8/546: truncate d4/d8/d74/f95 3261151 0 2024-04-12T09:11:33.015 INFO:tasks.workunit.client.1.smithi203.stdout:8/547: readlink d4/d8/d1c/d48/l7f 0 2024-04-12T09:11:33.019 INFO:tasks.workunit.client.1.smithi203.stdout:5/677: rename d0/d6/d11/d18/dcc/fca to d0/d6/d16/d9/d30/d58/ff6 0 2024-04-12T09:11:33.021 INFO:tasks.workunit.client.1.smithi203.stdout:5/678: write d0/d6/d16/d8/fee [750964,35942] 0 2024-04-12T09:11:33.022 INFO:tasks.workunit.client.1.smithi203.stdout:8/548: dwrite d4/f35 [0,4194304] 0 2024-04-12T09:11:33.022 INFO:tasks.workunit.client.1.smithi203.stdout:1/631: write df/d2d/d6f/d75/d80/d54/d5d/d58/d94/fad [920690,5495] 0 2024-04-12T09:11:33.025 INFO:tasks.workunit.client.1.smithi203.stdout:2/600: symlink d0/d38/ld0 0 2024-04-12T09:11:33.026 INFO:tasks.workunit.client.1.smithi203.stdout:7/586: creat d0/d4/d1c/d5b/dbf/dc3/fd7 x:0 0 0 2024-04-12T09:11:33.027 INFO:tasks.workunit.client.1.smithi203.stdout:7/587: readlink d0/d4/d54/da0/laf 0 2024-04-12T09:11:33.035 INFO:tasks.workunit.client.1.smithi203.stdout:4/627: rename c13 to d1a/d21/d22/d2e/d8d/d9b/dbc/dc7/ccb 0 2024-04-12T09:11:33.040 INFO:tasks.workunit.client.1.smithi203.stdout:3/525: creat d2/d8/d14/fac x:0 0 0 2024-04-12T09:11:33.042 INFO:tasks.workunit.client.1.smithi203.stdout:1/632: dread df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/f81 [0,4194304] 0 2024-04-12T09:11:33.042 INFO:tasks.workunit.client.1.smithi203.stdout:5/679: symlink d0/d6/d16/d9/d30/d83/lf7 0 2024-04-12T09:11:33.043 INFO:tasks.workunit.client.1.smithi203.stdout:6/519: truncate d1/d3/d26/f9a 337117 0 2024-04-12T09:11:33.045 INFO:tasks.workunit.client.1.smithi203.stdout:0/649: getdents d0/dd/d71 0 2024-04-12T09:11:33.047 INFO:tasks.workunit.client.1.smithi203.stdout:5/680: dread d0/d6/d16/d9/d30/d89/fe9 [0,4194304] 0 2024-04-12T09:11:33.051 INFO:tasks.workunit.client.1.smithi203.stdout:8/549: creat d4/d8/d81/d84/d92/fae x:0 0 0 2024-04-12T09:11:33.072 INFO:tasks.workunit.client.1.smithi203.stdout:2/601: mknod d0/d14/d8a/cd1 0 2024-04-12T09:11:33.073 INFO:tasks.workunit.client.1.smithi203.stdout:5/681: dwrite d0/d6/d9b/fcf [0,4194304] 0 2024-04-12T09:11:33.073 INFO:tasks.workunit.client.1.smithi203.stdout:4/628: creat d1a/d21/da1/fcc x:0 0 0 2024-04-12T09:11:33.075 INFO:tasks.workunit.client.1.smithi203.stdout:0/650: mknod d0/dd/d71/d94/d65/ccf 0 2024-04-12T09:11:33.078 INFO:tasks.workunit.client.1.smithi203.stdout:4/629: chown d1a/d21/d60/d68/dbe/cc3 62 1 2024-04-12T09:11:33.078 INFO:tasks.workunit.client.1.smithi203.stdout:9/528: dwrite d8/d12/d23/f71 [0,4194304] 0 2024-04-12T09:11:33.082 INFO:tasks.workunit.client.1.smithi203.stdout:7/588: dread d0/d4/d5d/f5c [4194304,4194304] 0 2024-04-12T09:11:33.084 INFO:tasks.workunit.client.1.smithi203.stdout:7/589: chown d0/d4/lb 171 1 2024-04-12T09:11:33.085 INFO:tasks.workunit.client.1.smithi203.stdout:7/590: chown d0/d38/f5a 151075596 1 2024-04-12T09:11:33.086 INFO:tasks.workunit.client.1.smithi203.stdout:4/630: dread d1a/d21/d22/d2e/f6f [0,4194304] 0 2024-04-12T09:11:33.087 INFO:tasks.workunit.client.1.smithi203.stdout:0/651: dwrite d0/d48/d5e/d84/fa4 [0,4194304] 0 2024-04-12T09:11:33.088 INFO:tasks.workunit.client.1.smithi203.stdout:0/652: fdatasync d0/f3 0 2024-04-12T09:11:33.088 INFO:tasks.workunit.client.1.smithi203.stdout:4/631: readlink d1a/d21/d60/d68/lb7 0 2024-04-12T09:11:33.089 INFO:tasks.workunit.client.1.smithi203.stdout:4/632: write d1a/d20/d5f/f6d [781148,8730] 0 2024-04-12T09:11:33.091 INFO:tasks.workunit.client.1.smithi203.stdout:8/550: mknod d4/caf 0 2024-04-12T09:11:33.091 INFO:tasks.workunit.client.1.smithi203.stdout:4/633: dread - d1a/d21/d22/d2e/f6c zero size 2024-04-12T09:11:33.094 INFO:tasks.workunit.client.1.smithi203.stdout:3/526: creat d2/d8/d14/d23/d35/d91/fad x:0 0 0 2024-04-12T09:11:33.095 INFO:tasks.workunit.client.1.smithi203.stdout:3/527: write d2/d8/d14/fa6 [396942,7146] 0 2024-04-12T09:11:33.095 INFO:tasks.workunit.client.1.smithi203.stdout:1/633: rename df/d2d/d6f/d75/d80/d54/l79 to df/d2d/d6f/lc0 0 2024-04-12T09:11:33.102 INFO:tasks.workunit.client.1.smithi203.stdout:7/591: mknod d0/d15/d2d/d5e/cd8 0 2024-04-12T09:11:33.105 INFO:tasks.workunit.client.1.smithi203.stdout:0/653: unlink d0/f13 0 2024-04-12T09:11:33.110 INFO:tasks.workunit.client.1.smithi203.stdout:4/634: creat d1a/d21/d60/d68/fcd x:0 0 0 2024-04-12T09:11:33.116 INFO:tasks.workunit.client.1.smithi203.stdout:3/528: write d2/fa [8100951,108292] 0 2024-04-12T09:11:33.117 INFO:tasks.workunit.client.1.smithi203.stdout:1/634: mknod df/d2d/d6f/d75/d80/d8c/cc1 0 2024-04-12T09:11:33.118 INFO:tasks.workunit.client.1.smithi203.stdout:8/551: dread d4/d8/d74/d78/f54 [4194304,4194304] 0 2024-04-12T09:11:33.118 INFO:tasks.workunit.client.1.smithi203.stdout:9/529: mknod d8/d12/da1/cc0 0 2024-04-12T09:11:33.119 INFO:tasks.workunit.client.1.smithi203.stdout:9/530: write d8/d12/d23/d38/f7a [1028420,104989] 0 2024-04-12T09:11:33.120 INFO:tasks.workunit.client.1.smithi203.stdout:9/531: dread - d8/d12/d23/d38/f91 zero size 2024-04-12T09:11:33.125 INFO:tasks.workunit.client.1.smithi203.stdout:0/654: read d0/dd/f2d [2746133,25870] 0 2024-04-12T09:11:33.125 INFO:tasks.workunit.client.1.smithi203.stdout:4/635: rmdir d1a/d1d 39 2024-04-12T09:11:33.125 INFO:tasks.workunit.client.1.smithi203.stdout:0/655: fsync d0/dd/d40/f62 0 2024-04-12T09:11:33.135 INFO:tasks.workunit.client.1.smithi203.stdout:2/602: link d0/d38/d43/d9c/fac d0/d54/dad/fd2 0 2024-04-12T09:11:33.136 INFO:tasks.workunit.client.1.smithi203.stdout:4/636: dread d1a/d20/d5f/f64 [0,4194304] 0 2024-04-12T09:11:33.138 INFO:tasks.workunit.client.1.smithi203.stdout:4/637: fsync d1a/d21/d60/d68/fcd 0 2024-04-12T09:11:33.139 INFO:tasks.workunit.client.1.smithi203.stdout:4/638: readlink d1a/d20/d5d/d2c/d72/lc9 0 2024-04-12T09:11:33.139 INFO:tasks.workunit.client.1.smithi203.stdout:4/639: write d1a/d21/f67 [413453,4382] 0 2024-04-12T09:11:33.141 INFO:tasks.workunit.client.1.smithi203.stdout:0/656: mkdir d0/d48/d5e/d84/dd0 0 2024-04-12T09:11:33.144 INFO:tasks.workunit.client.1.smithi203.stdout:5/682: rename d0/d6/d16/d9/d30/d58/db4 to d0/d6/d16/df8 0 2024-04-12T09:11:33.145 INFO:tasks.workunit.client.1.smithi203.stdout:3/529: creat d2/d64/d8d/fae x:0 0 0 2024-04-12T09:11:33.146 INFO:tasks.workunit.client.1.smithi203.stdout:3/530: chown d2/c10 2835059 1 2024-04-12T09:11:33.169 INFO:tasks.workunit.client.1.smithi203.stdout:8/552: symlink d4/d8/d74/da6/lb0 0 2024-04-12T09:11:33.170 INFO:tasks.workunit.client.1.smithi203.stdout:7/592: write d0/d4/d1c/d3b/d4c/f55 [1781948,31649] 0 2024-04-12T09:11:33.170 INFO:tasks.workunit.client.1.smithi203.stdout:4/640: mknod d1a/d21/d60/d68/dbe/cce 0 2024-04-12T09:11:33.171 INFO:tasks.workunit.client.1.smithi203.stdout:0/657: fsync d0/dd/d71/d94/d2f/d17/d19/fb3 0 2024-04-12T09:11:33.172 INFO:tasks.workunit.client.1.smithi203.stdout:7/593: fdatasync d0/d4/d1c/d3b/d4c/f94 0 2024-04-12T09:11:33.173 INFO:tasks.workunit.client.1.smithi203.stdout:1/635: creat df/d2d/fc2 x:0 0 0 2024-04-12T09:11:33.173 INFO:tasks.workunit.client.1.smithi203.stdout:5/683: write d0/d6/d16/d9/d80/fc0 [690570,126520] 0 2024-04-12T09:11:33.180 INFO:tasks.workunit.client.1.smithi203.stdout:0/658: dwrite d0/dd/d40/f62 [0,4194304] 0 2024-04-12T09:11:33.200 INFO:tasks.workunit.client.1.smithi203.stdout:3/531: creat d2/d8/d14/d1b/d95/d92/faf x:0 0 0 2024-04-12T09:11:33.202 INFO:tasks.workunit.client.1.smithi203.stdout:8/553: symlink d4/d8/d74/da6/lb1 0 2024-04-12T09:11:33.202 INFO:tasks.workunit.client.1.smithi203.stdout:3/532: chown d2/d8/d14/d23/d35/d4c/d5c/f34 40295812 1 2024-04-12T09:11:33.205 INFO:tasks.workunit.client.1.smithi203.stdout:7/594: symlink d0/d4/d1c/d3b/d98/ld9 0 2024-04-12T09:11:33.206 INFO:tasks.workunit.client.1.smithi203.stdout:7/595: chown d0/d38/fb6 404 1 2024-04-12T09:11:33.207 INFO:tasks.workunit.client.1.smithi203.stdout:7/596: dread - d0/d4/d1c/f3a zero size 2024-04-12T09:11:33.207 INFO:tasks.workunit.client.1.smithi203.stdout:5/684: unlink d0/d6/d11/d38/cc5 0 2024-04-12T09:11:33.208 INFO:tasks.workunit.client.1.smithi203.stdout:5/685: chown d0/d6/l71 251 1 2024-04-12T09:11:33.211 INFO:tasks.workunit.client.1.smithi203.stdout:9/532: getdents d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d40 0 2024-04-12T09:11:33.212 INFO:tasks.workunit.client.1.smithi203.stdout:7/597: dread d0/d4/d1c/d3b/d4c/fa6 [0,4194304] 0 2024-04-12T09:11:33.217 INFO:tasks.workunit.client.1.smithi203.stdout:8/554: rename d4/d8/c87 to d4/d8/d37/d57/d7d/cb2 0 2024-04-12T09:11:33.217 INFO:tasks.workunit.client.1.smithi203.stdout:3/533: rmdir d2/d8/d14/d1b/d95/d92 39 2024-04-12T09:11:33.218 INFO:tasks.workunit.client.1.smithi203.stdout:8/555: write d4/d8/d81/d84/d92/f80 [653378,112747] 0 2024-04-12T09:11:33.221 INFO:tasks.workunit.client.1.smithi203.stdout:1/636: dread df/d2d/d6f/d75/d80/d54/d5d/f4d [0,4194304] 0 2024-04-12T09:11:33.223 INFO:tasks.workunit.client.1.smithi203.stdout:1/637: write df/d2d/d6f/d75/d80/d54/d5d/d58/fba [213839,54802] 0 2024-04-12T09:11:33.224 INFO:tasks.workunit.client.1.smithi203.stdout:5/686: symlink d0/d6/d16/d9/d30/d89/lf9 0 2024-04-12T09:11:33.225 INFO:tasks.workunit.client.1.smithi203.stdout:0/659: fdatasync d0/dd/f70 0 2024-04-12T09:11:33.225 INFO:tasks.workunit.client.1.smithi203.stdout:5/687: readlink d0/d6/d16/d9/d30/d89/lf9 0 2024-04-12T09:11:33.225 INFO:tasks.workunit.client.1.smithi203.stdout:0/660: readlink d0/dd/la1 0 2024-04-12T09:11:33.226 INFO:tasks.workunit.client.1.smithi203.stdout:0/661: chown d0/dd/d71/d94/d2f/lb6 0 1 2024-04-12T09:11:33.227 INFO:tasks.workunit.client.1.smithi203.stdout:0/662: read d0/dd/d40/f62 [1561820,43972] 0 2024-04-12T09:11:33.228 INFO:tasks.workunit.client.1.smithi203.stdout:6/520: sync 2024-04-12T09:11:33.233 INFO:tasks.workunit.client.1.smithi203.stdout:3/534: unlink d2/d8/d14/fa6 0 2024-04-12T09:11:33.234 INFO:tasks.workunit.client.1.smithi203.stdout:7/598: dwrite d0/d34/f87 [0,4194304] 0 2024-04-12T09:11:33.240 INFO:tasks.workunit.client.1.smithi203.stdout:0/663: creat d0/dd/d71/d94/fd1 x:0 0 0 2024-04-12T09:11:33.242 INFO:tasks.workunit.client.1.smithi203.stdout:9/533: dwrite d8/d12/d23/f26 [0,4194304] 0 2024-04-12T09:11:33.243 INFO:tasks.workunit.client.1.smithi203.stdout:8/556: dread d4/d8/d74/d78/f6d [0,4194304] 0 2024-04-12T09:11:33.243 INFO:tasks.workunit.client.1.smithi203.stdout:6/521: creat d1/d3/d26/fa5 x:0 0 0 2024-04-12T09:11:33.246 INFO:tasks.workunit.client.1.smithi203.stdout:7/599: dwrite d0/d4/d5d/f5c [0,4194304] 0 2024-04-12T09:11:33.247 INFO:tasks.workunit.client.1.smithi203.stdout:5/688: getdents d0/d6/d11/dd3 0 2024-04-12T09:11:33.248 INFO:tasks.workunit.client.1.smithi203.stdout:7/600: read - d0/d4/d5d/f9e zero size 2024-04-12T09:11:33.248 INFO:tasks.workunit.client.1.smithi203.stdout:9/534: read d8/d12/d23/d85/f8b [2161320,101395] 0 2024-04-12T09:11:33.251 INFO:tasks.workunit.client.1.smithi203.stdout:9/535: write d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/f9a [729724,108339] 0 2024-04-12T09:11:33.253 INFO:tasks.workunit.client.1.smithi203.stdout:3/535: symlink d2/lb0 0 2024-04-12T09:11:33.254 INFO:tasks.workunit.client.1.smithi203.stdout:3/536: readlink d2/d64/l7e 0 2024-04-12T09:11:33.256 INFO:tasks.workunit.client.1.smithi203.stdout:6/522: rename d1/d3/d4/ca to d1/d3/d26/d9b/ca6 0 2024-04-12T09:11:33.258 INFO:tasks.workunit.client.1.smithi203.stdout:5/689: fdatasync d0/d6/d16/d9/d14/f25 0 2024-04-12T09:11:33.260 INFO:tasks.workunit.client.1.smithi203.stdout:0/664: creat d0/dd/d71/d94/d2f/d17/d19/d6f/dcb/fd2 x:0 0 0 2024-04-12T09:11:33.262 INFO:tasks.workunit.client.1.smithi203.stdout:9/536: mkdir d8/d12/d3e/dc1 0 2024-04-12T09:11:33.262 INFO:tasks.workunit.client.1.smithi203.stdout:0/665: write d0/dd/d71/fb7 [268385,50459] 0 2024-04-12T09:11:33.264 INFO:tasks.workunit.client.1.smithi203.stdout:9/537: readlink d8/d12/l49 0 2024-04-12T09:11:33.267 INFO:tasks.workunit.client.1.smithi203.stdout:0/666: write d0/d48/dc1/fc2 [735139,17199] 0 2024-04-12T09:11:33.268 INFO:tasks.workunit.client.1.smithi203.stdout:7/601: dwrite d0/d15/f20 [0,4194304] 0 2024-04-12T09:11:33.270 INFO:tasks.workunit.client.1.smithi203.stdout:6/523: creat d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/d9c/fa7 x:0 0 0 2024-04-12T09:11:33.274 INFO:tasks.workunit.client.1.smithi203.stdout:5/690: unlink d0/dbd/cec 0 2024-04-12T09:11:33.277 INFO:tasks.workunit.client.1.smithi203.stdout:8/557: dwrite d4/d8/d74/d78/f27 [0,4194304] 0 2024-04-12T09:11:33.279 INFO:tasks.workunit.client.1.smithi203.stdout:6/524: dwrite d1/d3/d26/fa5 [0,4194304] 0 2024-04-12T09:11:33.279 INFO:tasks.workunit.client.1.smithi203.stdout:8/558: dread - d4/d8/d74/d78/f71 zero size 2024-04-12T09:11:33.285 INFO:tasks.workunit.client.1.smithi203.stdout:1/638: link df/d2d/d6f/d75/d80/f41 df/d2d/d6f/fc3 0 2024-04-12T09:11:33.290 INFO:tasks.workunit.client.1.smithi203.stdout:0/667: mkdir d0/dd/d5b/d90/dd3 0 2024-04-12T09:11:33.291 INFO:tasks.workunit.client.1.smithi203.stdout:7/602: dread - d0/d4/d1c/d3b/d4c/f59 zero size 2024-04-12T09:11:33.295 INFO:tasks.workunit.client.1.smithi203.stdout:5/691: rmdir d0/d6/d11/d18/d2a/dc8 39 2024-04-12T09:11:33.297 INFO:tasks.workunit.client.1.smithi203.stdout:5/692: stat d0/d6/d16/d9/d80/fc0 0 2024-04-12T09:11:33.297 INFO:tasks.workunit.client.1.smithi203.stdout:7/603: dwrite d0/d38/fb6 [0,4194304] 0 2024-04-12T09:11:33.300 INFO:tasks.workunit.client.1.smithi203.stdout:3/537: creat d2/d8/d14/d1b/d95/fb1 x:0 0 0 2024-04-12T09:11:33.301 INFO:tasks.workunit.client.1.smithi203.stdout:3/538: stat d2/d8/f33 0 2024-04-12T09:11:33.305 INFO:tasks.workunit.client.1.smithi203.stdout:6/525: dread d1/d3/d26/d30/d4a/d6c/f40 [0,4194304] 0 2024-04-12T09:11:33.311 INFO:tasks.workunit.client.1.smithi203.stdout:2/603: sync 2024-04-12T09:11:33.316 INFO:tasks.workunit.client.1.smithi203.stdout:5/693: dwrite d0/f21 [0,4194304] 0 2024-04-12T09:11:33.318 INFO:tasks.workunit.client.1.smithi203.stdout:8/559: mknod d4/cb3 0 2024-04-12T09:11:33.320 INFO:tasks.workunit.client.1.smithi203.stdout:8/560: chown d4/d8/d1c/l56 31621 1 2024-04-12T09:11:33.320 INFO:tasks.workunit.client.1.smithi203.stdout:5/694: dread d0/d6/d16/d9/d14/f85 [0,4194304] 0 2024-04-12T09:11:33.321 INFO:tasks.workunit.client.1.smithi203.stdout:5/695: truncate d0/d6/fb2 4572420 0 2024-04-12T09:11:33.324 INFO:tasks.workunit.client.1.smithi203.stdout:6/526: creat d1/d3/d26/d30/d4a/d6c/d45/d55/fa8 x:0 0 0 2024-04-12T09:11:33.324 INFO:tasks.workunit.client.1.smithi203.stdout:6/527: fsync d1/d3/d26/d30/d4a/f6f 0 2024-04-12T09:11:33.330 INFO:tasks.workunit.client.1.smithi203.stdout:2/604: write d0/fc6 [4167990,100839] 0 2024-04-12T09:11:33.331 INFO:tasks.workunit.client.1.smithi203.stdout:7/604: creat d0/d15/d89/fda x:0 0 0 2024-04-12T09:11:33.332 INFO:tasks.workunit.client.1.smithi203.stdout:3/539: mknod d2/d8/d14/d1b/d95/cb2 0 2024-04-12T09:11:33.333 INFO:tasks.workunit.client.1.smithi203.stdout:8/561: unlink d4/d34/ca2 0 2024-04-12T09:11:33.335 INFO:tasks.workunit.client.1.smithi203.stdout:9/538: getdents d8/d12/d23/d38/d8a/d97 0 2024-04-12T09:11:33.337 INFO:tasks.workunit.client.1.smithi203.stdout:5/696: rename d0/d6/d16/d9/d80/ld5 to d0/d6/d16/d9/d86/df5/lfa 0 2024-04-12T09:11:33.341 INFO:tasks.workunit.client.1.smithi203.stdout:6/528: creat d1/d3/d26/d30/fa9 x:0 0 0 2024-04-12T09:11:33.342 INFO:tasks.workunit.client.1.smithi203.stdout:1/639: link df/d2d/d6f/d75/d80/d2b/d91/l93 df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/lc4 0 2024-04-12T09:11:33.342 INFO:tasks.workunit.client.1.smithi203.stdout:6/529: fdatasync d1/d3/d26/d5d/f8b 0 2024-04-12T09:11:33.343 INFO:tasks.workunit.client.1.smithi203.stdout:0/668: creat d0/d48/fd4 x:0 0 0 2024-04-12T09:11:33.344 INFO:tasks.workunit.client.1.smithi203.stdout:7/605: write d0/d4/d54/dac/fb9 [1198172,49572] 0 2024-04-12T09:11:33.352 INFO:tasks.workunit.client.1.smithi203.stdout:9/539: rename d8/d12/d3e/f47 to d8/d12/d3e/d90/fc2 0 2024-04-12T09:11:33.352 INFO:tasks.workunit.client.1.smithi203.stdout:8/562: dwrite d4/d8/f50 [0,4194304] 0 2024-04-12T09:11:33.352 INFO:tasks.workunit.client.1.smithi203.stdout:4/641: sync 2024-04-12T09:11:33.353 INFO:tasks.workunit.client.1.smithi203.stdout:5/697: chown d0/d6/d11/d1e/lb3 51485520 1 2024-04-12T09:11:33.354 INFO:tasks.workunit.client.1.smithi203.stdout:4/642: stat d1a/d21/d22/d2e/f43 0 2024-04-12T09:11:33.356 INFO:tasks.workunit.client.1.smithi203.stdout:8/563: dread d4/d8/d74/d78/f54 [4194304,4194304] 0 2024-04-12T09:11:33.357 INFO:tasks.workunit.client.1.smithi203.stdout:0/669: creat d0/d48/d5e/fd5 x:0 0 0 2024-04-12T09:11:33.360 INFO:tasks.workunit.client.1.smithi203.stdout:2/605: truncate d0/d14/d1e/d2a/f60 505679 0 2024-04-12T09:11:33.363 INFO:tasks.workunit.client.1.smithi203.stdout:0/670: dwrite d0/dd/d71/d94/d2f/f42 [0,4194304] 0 2024-04-12T09:11:33.369 INFO:tasks.workunit.client.1.smithi203.stdout:5/698: write d0/d6/d11/d18/d2a/dc8/fce [265196,4540] 0 2024-04-12T09:11:33.371 INFO:tasks.workunit.client.1.smithi203.stdout:1/640: fdatasync df/d2d/f5f 0 2024-04-12T09:11:33.372 INFO:tasks.workunit.client.1.smithi203.stdout:1/641: chown df/f35 9596 1 2024-04-12T09:11:33.376 INFO:tasks.workunit.client.1.smithi203.stdout:8/564: mkdir d4/d8/d81/db4 0 2024-04-12T09:11:33.379 INFO:tasks.workunit.client.1.smithi203.stdout:7/606: write d0/d4/d1c/d3b/d4c/f59 [364249,17757] 0 2024-04-12T09:11:33.382 INFO:tasks.workunit.client.1.smithi203.stdout:4/643: mkdir d1a/d1d/d69/dcf 0 2024-04-12T09:11:33.383 INFO:tasks.workunit.client.1.smithi203.stdout:4/644: stat d1a/d21/d60/l70 0 2024-04-12T09:11:33.384 INFO:tasks.workunit.client.1.smithi203.stdout:1/642: rmdir df/d2d/d6f/d75/d80/d54/d5d/d67 39 2024-04-12T09:11:33.385 INFO:tasks.workunit.client.1.smithi203.stdout:9/540: dwrite d8/d12/d23/d41/f78 [0,4194304] 0 2024-04-12T09:11:33.387 INFO:tasks.workunit.client.1.smithi203.stdout:6/530: link d1/d3/d26/d30/d4a/d6c/d45/d55/d77/c2f d1/df/d87/d7a/caa 0 2024-04-12T09:11:33.390 INFO:tasks.workunit.client.1.smithi203.stdout:5/699: dread d0/d6/d11/d18/d1a/d23/f4f [0,4194304] 0 2024-04-12T09:11:33.393 INFO:tasks.workunit.client.1.smithi203.stdout:2/606: mkdir d0/dd3 0 2024-04-12T09:11:33.395 INFO:tasks.workunit.client.1.smithi203.stdout:3/540: getdents d2/d8/d14/d1b 0 2024-04-12T09:11:33.397 INFO:tasks.workunit.client.1.smithi203.stdout:0/671: mkdir d0/d48/d5e/dca/dd6 0 2024-04-12T09:11:33.399 INFO:tasks.workunit.client.1.smithi203.stdout:0/672: read - d0/d48/d5e/fd5 zero size 2024-04-12T09:11:33.399 INFO:tasks.workunit.client.1.smithi203.stdout:7/607: mknod d0/d4/d1c/d5b/dbf/cdb 0 2024-04-12T09:11:33.400 INFO:tasks.workunit.client.1.smithi203.stdout:2/607: dwrite d0/d14/d74/f84 [0,4194304] 0 2024-04-12T09:11:33.404 INFO:tasks.workunit.client.1.smithi203.stdout:3/541: dwrite d2/d8/d14/d23/d36/f79 [0,4194304] 0 2024-04-12T09:11:33.404 INFO:tasks.workunit.client.1.smithi203.stdout:4/645: symlink d1a/d1d/ld0 0 2024-04-12T09:11:33.405 INFO:tasks.workunit.client.1.smithi203.stdout:3/542: chown d2/f82 21117003 1 2024-04-12T09:11:33.405 INFO:tasks.workunit.client.1.smithi203.stdout:4/646: write d1a/d1d/f55 [813104,116632] 0 2024-04-12T09:11:33.406 INFO:tasks.workunit.client.1.smithi203.stdout:4/647: stat d1a/d21/l44 0 2024-04-12T09:11:33.407 INFO:tasks.workunit.client.1.smithi203.stdout:4/648: dread - d1a/d21/f98 zero size 2024-04-12T09:11:33.408 INFO:tasks.workunit.client.1.smithi203.stdout:1/643: mkdir df/d2d/d6f/d75/d80/d54/d5d/d58/dc5 0 2024-04-12T09:11:33.418 INFO:tasks.workunit.client.1.smithi203.stdout:5/700: mknod d0/d6/d16/d9/d30/d58/d74/cfb 0 2024-04-12T09:11:33.420 INFO:tasks.workunit.client.1.smithi203.stdout:7/608: symlink d0/d4/d54/da0/ldc 0 2024-04-12T09:11:33.421 INFO:tasks.workunit.client.1.smithi203.stdout:7/609: chown d0/d4/d1c/d3b/d4c/f55 59316 1 2024-04-12T09:11:33.421 INFO:tasks.workunit.client.1.smithi203.stdout:7/610: stat d0/d4/f92 0 2024-04-12T09:11:33.426 INFO:tasks.workunit.client.1.smithi203.stdout:7/611: dread d0/d15/f63 [0,4194304] 0 2024-04-12T09:11:33.427 INFO:tasks.workunit.client.1.smithi203.stdout:0/673: dwrite d0/dd/d71/d94/d2f/d4c/f97 [4194304,4194304] 0 2024-04-12T09:11:33.427 INFO:tasks.workunit.client.1.smithi203.stdout:0/674: stat d0/dd/d5b 0 2024-04-12T09:11:33.428 INFO:tasks.workunit.client.1.smithi203.stdout:0/675: readlink d0/d48/d5e/d84/laf 0 2024-04-12T09:11:33.431 INFO:tasks.workunit.client.1.smithi203.stdout:1/644: rmdir df/d2d/d6f 39 2024-04-12T09:11:33.432 INFO:tasks.workunit.client.1.smithi203.stdout:0/676: dread - d0/dd/d71/d94/d2f/d17/d19/f89 zero size 2024-04-12T09:11:33.434 INFO:tasks.workunit.client.1.smithi203.stdout:8/565: rmdir d4/d8/d1c/d48/d5e/da5 0 2024-04-12T09:11:33.437 INFO:tasks.workunit.client.1.smithi203.stdout:5/701: write d0/d6/d16/d9/d30/d58/d74/d88/dbf/fc1 [4235516,45900] 0 2024-04-12T09:11:33.437 INFO:tasks.workunit.client.1.smithi203.stdout:7/612: dwrite d0/d4/d54/dac/fb9 [4194304,4194304] 0 2024-04-12T09:11:33.439 INFO:tasks.workunit.client.1.smithi203.stdout:8/566: write d4/d8/d81/d84/fa4 [611789,67085] 0 2024-04-12T09:11:33.439 INFO:tasks.workunit.client.1.smithi203.stdout:0/677: write d0/dd/d71/d94/d2f/d34/db1/fa9 [480370,60307] 0 2024-04-12T09:11:33.442 INFO:tasks.workunit.client.1.smithi203.stdout:6/531: dwrite d1/d3/d4/f42 [0,4194304] 0 2024-04-12T09:11:33.443 INFO:tasks.workunit.client.1.smithi203.stdout:7/613: write d0/d4/d5d/f5c [3738769,93842] 0 2024-04-12T09:11:33.446 INFO:tasks.workunit.client.1.smithi203.stdout:3/543: rename d2/d8/d14/d1b/d2f/la3 to d2/d8/d14/d23/d35/d4c/d67/lb3 0 2024-04-12T09:11:33.447 INFO:tasks.workunit.client.1.smithi203.stdout:9/541: creat d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/fc3 x:0 0 0 2024-04-12T09:11:33.448 INFO:tasks.workunit.client.1.smithi203.stdout:9/542: fsync d8/d12/d23/f71 0 2024-04-12T09:11:33.451 INFO:tasks.workunit.client.1.smithi203.stdout:1/645: chown df/d2d/c5c 143727 1 2024-04-12T09:11:33.457 INFO:tasks.workunit.client.1.smithi203.stdout:1/646: dwrite df/f1e [0,4194304] 0 2024-04-12T09:11:33.461 INFO:tasks.workunit.client.1.smithi203.stdout:8/567: mknod d4/d8/d1c/d48/d5e/cb5 0 2024-04-12T09:11:33.462 INFO:tasks.workunit.client.1.smithi203.stdout:7/614: rmdir d0/d4/d1c/d3b/d98 39 2024-04-12T09:11:33.462 INFO:tasks.workunit.client.1.smithi203.stdout:0/678: read d0/dd/d71/d94/d2f/f66 [752612,20570] 0 2024-04-12T09:11:33.463 INFO:tasks.workunit.client.1.smithi203.stdout:7/615: fdatasync d0/d15/d2d/d5e/d8c/f81 0 2024-04-12T09:11:33.466 INFO:tasks.workunit.client.1.smithi203.stdout:3/544: rmdir d2/d8 39 2024-04-12T09:11:33.469 INFO:tasks.workunit.client.1.smithi203.stdout:8/568: dwrite d4/d8/d81/d84/d92/fae [0,4194304] 0 2024-04-12T09:11:33.470 INFO:tasks.workunit.client.1.smithi203.stdout:4/649: link d1a/d1d/d69/c73 d1a/d21/d22/d2e/d78/cd1 0 2024-04-12T09:11:33.474 INFO:tasks.workunit.client.1.smithi203.stdout:0/679: dread d0/dd/f99 [0,4194304] 0 2024-04-12T09:11:33.479 INFO:tasks.workunit.client.1.smithi203.stdout:2/608: link d0/d54/dad/fd2 d0/d14/d1e/d2a/dce/fd4 0 2024-04-12T09:11:33.483 INFO:tasks.workunit.client.1.smithi203.stdout:7/616: mknod d0/d15/d2d/cdd 0 2024-04-12T09:11:33.483 INFO:tasks.workunit.client.1.smithi203.stdout:7/617: dread - d0/d4/d1c/d5b/dbf/dc5/fcc zero size 2024-04-12T09:11:33.485 INFO:tasks.workunit.client.1.smithi203.stdout:7/618: truncate d0/d4/d1c/d3b/fc7 361987 0 2024-04-12T09:11:33.486 INFO:tasks.workunit.client.1.smithi203.stdout:3/545: symlink d2/d64/d8d/lb4 0 2024-04-12T09:11:33.486 INFO:tasks.workunit.client.1.smithi203.stdout:8/569: mkdir d4/d8/d74/db6 0 2024-04-12T09:11:33.488 INFO:tasks.workunit.client.1.smithi203.stdout:7/619: dread d0/d4/d5d/f5c [4194304,4194304] 0 2024-04-12T09:11:33.488 INFO:tasks.workunit.client.1.smithi203.stdout:4/650: creat d1a/d20/d5d/d2c/d72/fd2 x:0 0 0 2024-04-12T09:11:33.489 INFO:tasks.workunit.client.1.smithi203.stdout:4/651: chown d1a/d20/d5d/d2c/d72/fc8 885675 1 2024-04-12T09:11:33.489 INFO:tasks.workunit.client.1.smithi203.stdout:0/680: unlink d0/dd/d71/d94/d2f/d34/db1/f6c 0 2024-04-12T09:11:33.491 INFO:tasks.workunit.client.1.smithi203.stdout:5/702: creat d0/d6/d11/ffc x:0 0 0 2024-04-12T09:11:33.493 INFO:tasks.workunit.client.1.smithi203.stdout:1/647: write df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/f81 [2742086,49206] 0 2024-04-12T09:11:33.497 INFO:tasks.workunit.client.1.smithi203.stdout:0/681: dwrite d0/dd/d71/d94/d2f/d34/db1/fb8 [0,4194304] 0 2024-04-12T09:11:33.498 INFO:tasks.workunit.client.1.smithi203.stdout:4/652: creat d1a/d21/d60/d68/dbe/fd3 x:0 0 0 2024-04-12T09:11:33.503 INFO:tasks.workunit.client.1.smithi203.stdout:4/653: dread d1a/d1d/d69/f92 [0,4194304] 0 2024-04-12T09:11:33.505 INFO:tasks.workunit.client.1.smithi203.stdout:3/546: write d2/f70 [687942,31985] 0 2024-04-12T09:11:33.507 INFO:tasks.workunit.client.1.smithi203.stdout:9/543: link d8/d12/d23/c4e d8/d3b/cc4 0 2024-04-12T09:11:33.510 INFO:tasks.workunit.client.1.smithi203.stdout:5/703: dread d0/d6/d11/d1e/d4c/d48/f55 [0,4194304] 0 2024-04-12T09:11:33.510 INFO:tasks.workunit.client.1.smithi203.stdout:2/609: creat d0/fd5 x:0 0 0 2024-04-12T09:11:33.511 INFO:tasks.workunit.client.1.smithi203.stdout:0/682: symlink d0/dd/d71/d94/d2f/d17/d19/d6f/ld7 0 2024-04-12T09:11:33.512 INFO:tasks.workunit.client.1.smithi203.stdout:1/648: mknod df/d2d/cc6 0 2024-04-12T09:11:33.513 INFO:tasks.workunit.client.1.smithi203.stdout:8/570: creat d4/d8/d37/fb7 x:0 0 0 2024-04-12T09:11:33.514 INFO:tasks.workunit.client.1.smithi203.stdout:1/649: dread - df/d2d/d6f/d75/d80/d2b/f42 zero size 2024-04-12T09:11:33.514 INFO:tasks.workunit.client.1.smithi203.stdout:1/650: chown df/d2d/d6f/f9a 954236 1 2024-04-12T09:11:33.521 INFO:tasks.workunit.client.1.smithi203.stdout:5/704: chown d0/d6/d16/d8/c7f 21 1 2024-04-12T09:11:33.522 INFO:tasks.workunit.client.1.smithi203.stdout:2/610: unlink d0/d3/f5f 0 2024-04-12T09:11:33.527 INFO:tasks.workunit.client.1.smithi203.stdout:4/654: write d1a/d21/d22/d2e/f43 [2237726,85865] 0 2024-04-12T09:11:33.528 INFO:tasks.workunit.client.1.smithi203.stdout:7/620: getdents d0/d34 0 2024-04-12T09:11:33.530 INFO:tasks.workunit.client.1.smithi203.stdout:7/621: chown d0/d38/d79/cc6 896295 1 2024-04-12T09:11:33.530 INFO:tasks.workunit.client.1.smithi203.stdout:9/544: symlink d8/d12/d23/db3/lc5 0 2024-04-12T09:11:33.532 INFO:tasks.workunit.client.1.smithi203.stdout:5/705: creat d0/d6/d16/d9/d30/d58/d74/d88/ffd x:0 0 0 2024-04-12T09:11:33.532 INFO:tasks.workunit.client.1.smithi203.stdout:3/547: write d2/d8/f52 [1052171,102644] 0 2024-04-12T09:11:33.533 INFO:tasks.workunit.client.1.smithi203.stdout:2/611: mkdir d0/d14/d1e/d57/d95/dd6 0 2024-04-12T09:11:33.535 INFO:tasks.workunit.client.1.smithi203.stdout:4/655: dwrite d1a/d21/da1/fcc [0,4194304] 0 2024-04-12T09:11:33.536 INFO:tasks.workunit.client.1.smithi203.stdout:2/612: chown d0/d14/d1e/d2a/f4c 112 1 2024-04-12T09:11:33.541 INFO:tasks.workunit.client.1.smithi203.stdout:7/622: mkdir d0/d4/d53/dde 0 2024-04-12T09:11:33.541 INFO:tasks.workunit.client.1.smithi203.stdout:0/683: link d0/dd/d71/d94/d2f/d17/d19/c30 d0/d48/dc1/cd8 0 2024-04-12T09:11:33.543 INFO:tasks.workunit.client.1.smithi203.stdout:9/545: unlink d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d40/f6d 0 2024-04-12T09:11:33.544 INFO:tasks.workunit.client.1.smithi203.stdout:5/706: write d0/d6/d16/d9/d30/d58/ff6 [3533451,105970] 0 2024-04-12T09:11:33.546 INFO:tasks.workunit.client.1.smithi203.stdout:5/707: dread d0/d6/d16/d9/d14/f85 [0,4194304] 0 2024-04-12T09:11:33.546 INFO:tasks.workunit.client.1.smithi203.stdout:8/571: write d4/d8/f38 [579277,108228] 0 2024-04-12T09:11:33.546 INFO:tasks.workunit.client.1.smithi203.stdout:1/651: write df/f99 [3474614,25122] 0 2024-04-12T09:11:33.550 INFO:tasks.workunit.client.1.smithi203.stdout:2/613: mkdir d0/d54/d61/d78/d89/dd7 0 2024-04-12T09:11:33.551 INFO:tasks.workunit.client.1.smithi203.stdout:7/623: rmdir d0/d15/d2d/d5e 39 2024-04-12T09:11:33.555 INFO:tasks.workunit.client.1.smithi203.stdout:4/656: write d1a/d20/d5f/f7a [417660,75801] 0 2024-04-12T09:11:33.555 INFO:tasks.workunit.client.1.smithi203.stdout:9/546: mkdir d8/d12/d23/d38/d8a/dc6 0 2024-04-12T09:11:33.556 INFO:tasks.workunit.client.1.smithi203.stdout:4/657: fdatasync d1a/d20/fab 0 2024-04-12T09:11:33.557 INFO:tasks.workunit.client.1.smithi203.stdout:4/658: truncate d1a/d1d/fa0 248530 0 2024-04-12T09:11:33.563 INFO:tasks.workunit.client.1.smithi203.stdout:2/614: write d0/d14/d1e/d2a/f52 [2064295,5344] 0 2024-04-12T09:11:33.565 INFO:tasks.workunit.client.1.smithi203.stdout:0/684: rename d0/c44 to d0/dd/d5b/cd9 0 2024-04-12T09:11:33.567 INFO:tasks.workunit.client.1.smithi203.stdout:0/685: read - d0/dd/d71/d94/fd1 zero size 2024-04-12T09:11:33.568 INFO:tasks.workunit.client.1.smithi203.stdout:5/708: dwrite d0/d6/d11/d38/f84 [0,4194304] 0 2024-04-12T09:11:33.572 INFO:tasks.workunit.client.1.smithi203.stdout:3/548: rmdir d2/d8/d14/d23/d35/d94 0 2024-04-12T09:11:33.573 INFO:tasks.workunit.client.1.smithi203.stdout:4/659: dread d1a/d20/d5d/d2c/f51 [0,4194304] 0 2024-04-12T09:11:33.575 INFO:tasks.workunit.client.1.smithi203.stdout:8/572: symlink d4/d8/d81/db4/lb8 0 2024-04-12T09:11:33.578 INFO:tasks.workunit.client.1.smithi203.stdout:1/652: truncate df/d2d/d6f/d75/d80/d54/f46 580098 0 2024-04-12T09:11:33.578 INFO:tasks.workunit.client.1.smithi203.stdout:6/532: sync 2024-04-12T09:11:33.579 INFO:tasks.workunit.client.1.smithi203.stdout:3/549: dwrite d2/d8/d14/d23/d35/d91/fad [0,4194304] 0 2024-04-12T09:11:33.580 INFO:tasks.workunit.client.1.smithi203.stdout:6/533: stat d1/d3/d12/l5c 0 2024-04-12T09:11:33.581 INFO:tasks.workunit.client.1.smithi203.stdout:7/624: creat d0/d4/d53/dde/fdf x:0 0 0 2024-04-12T09:11:33.581 INFO:tasks.workunit.client.1.smithi203.stdout:1/653: chown df/l1f 2034545 1 2024-04-12T09:11:33.581 INFO:tasks.workunit.client.1.smithi203.stdout:2/615: stat d0/d54/d61/d78/d89/cbf 0 2024-04-12T09:11:33.583 INFO:tasks.workunit.client.1.smithi203.stdout:9/547: mkdir d8/d12/d23/d38/d8a/d97/d9e/d74/dc7 0 2024-04-12T09:11:33.588 INFO:tasks.workunit.client.1.smithi203.stdout:1/654: dwrite df/f16 [0,4194304] 0 2024-04-12T09:11:33.590 INFO:tasks.workunit.client.1.smithi203.stdout:2/616: dwrite d0/d14/d74/d96/d9a/faf [0,4194304] 0 2024-04-12T09:11:33.591 INFO:tasks.workunit.client.1.smithi203.stdout:2/617: readlink d0/l28 0 2024-04-12T09:11:33.595 INFO:tasks.workunit.client.1.smithi203.stdout:8/573: creat d4/d8/d81/d84/fb9 x:0 0 0 2024-04-12T09:11:33.597 INFO:tasks.workunit.client.1.smithi203.stdout:1/655: dwrite df/d2d/d6f/d75/d80/d2b/f42 [0,4194304] 0 2024-04-12T09:11:33.599 INFO:tasks.workunit.client.1.smithi203.stdout:6/534: creat d1/d3/d26/d30/fab x:0 0 0 2024-04-12T09:11:33.601 INFO:tasks.workunit.client.1.smithi203.stdout:0/686: getdents d0/dd/d71/d94/d2f/d17/dc9 0 2024-04-12T09:11:33.602 INFO:tasks.workunit.client.1.smithi203.stdout:9/548: rmdir d8/d12/d3e/d90/d60 39 2024-04-12T09:11:33.605 INFO:tasks.workunit.client.1.smithi203.stdout:0/687: dread d0/dd/d71/d94/d2f/d4c/f97 [4194304,4194304] 0 2024-04-12T09:11:33.609 INFO:tasks.workunit.client.1.smithi203.stdout:8/574: mknod d4/d8/d81/d84/cba 0 2024-04-12T09:11:33.614 INFO:tasks.workunit.client.1.smithi203.stdout:0/688: dread d0/d48/dc1/fc2 [0,4194304] 0 2024-04-12T09:11:33.618 INFO:tasks.workunit.client.1.smithi203.stdout:4/660: dwrite d1a/d1d/d69/fc1 [0,4194304] 0 2024-04-12T09:11:33.619 INFO:tasks.workunit.client.1.smithi203.stdout:6/535: dread d1/d3/d26/d30/d4a/d6c/f5a [0,4194304] 0 2024-04-12T09:11:33.621 INFO:tasks.workunit.client.1.smithi203.stdout:4/661: truncate d1a/d21/da1/fa8 820573 0 2024-04-12T09:11:33.628 INFO:tasks.workunit.client.1.smithi203.stdout:6/536: dwrite d1/d3/f2d [4194304,4194304] 0 2024-04-12T09:11:33.718 INFO:tasks.workunit.client.1.smithi203.stdout:8/575: mkdir d4/d8/d81/db4/dbb 0 2024-04-12T09:11:33.720 INFO:tasks.workunit.client.1.smithi203.stdout:7/625: rename d0/d38/d51/la2 to d0/d4/le0 0 2024-04-12T09:11:33.725 INFO:tasks.workunit.client.1.smithi203.stdout:8/576: dwrite d4/d8/d37/d57/f9f [0,4194304] 0 2024-04-12T09:11:33.730 INFO:tasks.workunit.client.1.smithi203.stdout:5/709: link d0/d6/d16/d9/d30/d58/f99 d0/ffe 0 2024-04-12T09:11:33.735 INFO:tasks.workunit.client.1.smithi203.stdout:4/662: creat d1a/d21/d22/d2e/fd4 x:0 0 0 2024-04-12T09:11:33.746 INFO:tasks.workunit.client.1.smithi203.stdout:8/577: read - d4/d8/d74/d78/d53/f6b zero size 2024-04-12T09:11:33.750 INFO:tasks.workunit.client.1.smithi203.stdout:0/689: symlink d0/dd/d71/d94/d2f/dc6/lda 0 2024-04-12T09:11:33.751 INFO:tasks.workunit.client.1.smithi203.stdout:4/663: mknod d1a/d21/d22/d2e/cd5 0 2024-04-12T09:11:33.753 INFO:tasks.workunit.client.1.smithi203.stdout:2/618: rename d0/d19/l72 to d0/d38/d43/ld8 0 2024-04-12T09:11:33.753 INFO:tasks.workunit.client.1.smithi203.stdout:2/619: read - d0/fd5 zero size 2024-04-12T09:11:33.755 INFO:tasks.workunit.client.1.smithi203.stdout:8/578: mknod d4/d8/d81/d84/d92/cbc 0 2024-04-12T09:11:33.756 INFO:tasks.workunit.client.1.smithi203.stdout:8/579: read - d4/d8/d74/d78/f71 zero size 2024-04-12T09:11:33.757 INFO:tasks.workunit.client.1.smithi203.stdout:8/580: write d4/d8/d37/fb7 [71322,110294] 0 2024-04-12T09:11:33.758 INFO:tasks.workunit.client.1.smithi203.stdout:4/664: mkdir d1a/d1d/d69/d76/dd6 0 2024-04-12T09:11:33.762 INFO:tasks.workunit.client.1.smithi203.stdout:4/665: dread d1a/d21/d22/d2e/d8d/d9b/fae [4194304,4194304] 0 2024-04-12T09:11:33.763 INFO:tasks.workunit.client.1.smithi203.stdout:4/666: fsync d1a/d21/d22/d2e/f4b 0 2024-04-12T09:11:33.765 INFO:tasks.workunit.client.1.smithi203.stdout:8/581: mknod d4/d8/d81/d8e/cbd 0 2024-04-12T09:11:33.766 INFO:tasks.workunit.client.1.smithi203.stdout:7/626: getdents d0/d4/d1c/d5b/dbf 0 2024-04-12T09:11:33.771 INFO:tasks.workunit.client.1.smithi203.stdout:8/582: dwrite d4/f35 [0,4194304] 0 2024-04-12T09:11:33.773 INFO:tasks.workunit.client.1.smithi203.stdout:7/627: mkdir d0/d4/d1c/d5b/dbf/de1 0 2024-04-12T09:11:33.775 INFO:tasks.workunit.client.1.smithi203.stdout:7/628: chown d0/d38/d79/fa7 7 1 2024-04-12T09:11:33.777 INFO:tasks.workunit.client.1.smithi203.stdout:7/629: fdatasync d0/d4/d1c/d5b/dbf/dc5/fcc 0 2024-04-12T09:11:33.778 INFO:tasks.workunit.client.1.smithi203.stdout:8/583: dwrite d4/d8/d1c/d5d/f69 [0,4194304] 0 2024-04-12T09:11:33.780 INFO:tasks.workunit.client.1.smithi203.stdout:2/620: getdents d0/d54 0 2024-04-12T09:11:33.785 INFO:tasks.workunit.client.1.smithi203.stdout:7/630: read d0/d4/f43 [861636,16738] 0 2024-04-12T09:11:33.787 INFO:tasks.workunit.client.1.smithi203.stdout:2/621: mkdir d0/d67/d86/dd9 0 2024-04-12T09:11:33.790 INFO:tasks.workunit.client.1.smithi203.stdout:7/631: truncate d0/d4/f11 1145390 0 2024-04-12T09:11:33.795 INFO:tasks.workunit.client.1.smithi203.stdout:2/622: readlink d0/d3/d47/l5c 0 2024-04-12T09:11:33.800 INFO:tasks.workunit.client.1.smithi203.stdout:2/623: dwrite d0/d54/d61/fc4 [0,4194304] 0 2024-04-12T09:11:33.807 INFO:tasks.workunit.client.1.smithi203.stdout:2/624: dwrite d0/d14/d1e/d2a/fc5 [0,4194304] 0 2024-04-12T09:11:33.811 INFO:tasks.workunit.client.1.smithi203.stdout:2/625: mknod d0/d3/cda 0 2024-04-12T09:11:33.840 INFO:tasks.workunit.client.1.smithi203.stdout:9/549: rename d8/d12/d3e/d90/f95 to d8/d12/d23/d27/fc8 0 2024-04-12T09:11:33.845 INFO:tasks.workunit.client.1.smithi203.stdout:9/550: creat d8/d3b/fc9 x:0 0 0 2024-04-12T09:11:33.845 INFO:tasks.workunit.client.1.smithi203.stdout:9/551: dread - d8/d12/d23/d38/d8a/d97/d9e/d74/f7f zero size 2024-04-12T09:11:33.851 INFO:tasks.workunit.client.1.smithi203.stdout:9/552: dwrite d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/f9f [0,4194304] 0 2024-04-12T09:11:33.852 INFO:tasks.workunit.client.1.smithi203.stdout:9/553: write d8/d12/fad [49610,80764] 0 2024-04-12T09:11:33.853 INFO:tasks.workunit.client.1.smithi203.stdout:3/550: truncate d2/d8/d14/d23/d35/d91/f5b 1432101 0 2024-04-12T09:11:33.859 INFO:tasks.workunit.client.1.smithi203.stdout:9/554: mkdir d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/dca 0 2024-04-12T09:11:33.860 INFO:tasks.workunit.client.1.smithi203.stdout:1/656: dwrite df/d2d/d6f/d75/d80/d54/d5d/d58/f66 [0,4194304] 0 2024-04-12T09:11:33.862 INFO:tasks.workunit.client.1.smithi203.stdout:9/555: write d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/fc3 [689857,39328] 0 2024-04-12T09:11:33.862 INFO:tasks.workunit.client.1.smithi203.stdout:3/551: getdents d2/d8 0 2024-04-12T09:11:33.864 INFO:tasks.workunit.client.1.smithi203.stdout:1/657: mkdir df/d2d/d6f/d75/d80/d54/d5d/d90/dc7 0 2024-04-12T09:11:33.869 INFO:tasks.workunit.client.1.smithi203.stdout:3/552: unlink d2/d8/d14/d23/d35/d91/f60 0 2024-04-12T09:11:33.870 INFO:tasks.workunit.client.1.smithi203.stdout:3/553: dread - d2/d8/d14/d23/d35/d4c/d5c/f56 zero size 2024-04-12T09:11:33.871 INFO:tasks.workunit.client.1.smithi203.stdout:9/556: symlink d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/lcb 0 2024-04-12T09:11:33.876 INFO:tasks.workunit.client.1.smithi203.stdout:3/554: dwrite d2/d8/d14/f4f [0,4194304] 0 2024-04-12T09:11:33.885 INFO:tasks.workunit.client.1.smithi203.stdout:3/555: dwrite d2/d8/d14/d23/d35/d91/f9b [0,4194304] 0 2024-04-12T09:11:33.885 INFO:tasks.workunit.client.1.smithi203.stdout:3/556: stat d2/d51/c9c 0 2024-04-12T09:11:33.891 INFO:tasks.workunit.client.1.smithi203.stdout:3/557: fsync d2/d8/d14/d23/d35/d91/f7a 0 2024-04-12T09:11:33.897 INFO:tasks.workunit.client.1.smithi203.stdout:3/558: truncate d2/d8/d14/d23/f57 475919 0 2024-04-12T09:11:33.898 INFO:tasks.workunit.client.1.smithi203.stdout:3/559: write d2/d8/d14/d23/d35/d4c/d5c/f56 [511918,123625] 0 2024-04-12T09:11:33.901 INFO:tasks.workunit.client.1.smithi203.stdout:3/560: creat d2/d8/d14/d23/d35/d4c/d67/d86/fb5 x:0 0 0 2024-04-12T09:11:33.904 INFO:tasks.workunit.client.1.smithi203.stdout:0/690: sync 2024-04-12T09:11:33.905 INFO:tasks.workunit.client.1.smithi203.stdout:0/691: write d0/dd/d71/fb7 [94867,10806] 0 2024-04-12T09:11:33.910 INFO:tasks.workunit.client.1.smithi203.stdout:4/667: truncate d1a/d20/d5f/f7a 825061 0 2024-04-12T09:11:33.915 INFO:tasks.workunit.client.1.smithi203.stdout:3/561: creat d2/d8/d14/d23/d35/d4c/fb6 x:0 0 0 2024-04-12T09:11:33.917 INFO:tasks.workunit.client.1.smithi203.stdout:8/584: dwrite d4/d8/d1c/f82 [0,4194304] 0 2024-04-12T09:11:33.918 INFO:tasks.workunit.client.1.smithi203.stdout:8/585: dread - d4/d8/d81/d84/d92/f8c zero size 2024-04-12T09:11:33.919 INFO:tasks.workunit.client.1.smithi203.stdout:3/562: creat d2/d8/d14/d23/d35/d4c/fb7 x:0 0 0 2024-04-12T09:11:33.919 INFO:tasks.workunit.client.1.smithi203.stdout:8/586: chown d4/d8/f42 120788 1 2024-04-12T09:11:33.921 INFO:tasks.workunit.client.1.smithi203.stdout:3/563: mkdir d2/d51/db8 0 2024-04-12T09:11:33.921 INFO:tasks.workunit.client.1.smithi203.stdout:7/632: write d0/d4/f88 [389836,77640] 0 2024-04-12T09:11:33.926 INFO:tasks.workunit.client.1.smithi203.stdout:3/564: creat d2/d64/d8d/fb9 x:0 0 0 2024-04-12T09:11:33.929 INFO:tasks.workunit.client.1.smithi203.stdout:3/565: mknod d2/d51/d65/cba 0 2024-04-12T09:11:33.930 INFO:tasks.workunit.client.1.smithi203.stdout:8/587: getdents d4/d34 0 2024-04-12T09:11:33.931 INFO:tasks.workunit.client.1.smithi203.stdout:8/588: read d4/d8/d1c/f82 [2528099,83722] 0 2024-04-12T09:11:33.934 INFO:tasks.workunit.client.1.smithi203.stdout:7/633: link d0/d4/d1c/d3b/fb0 d0/fe2 0 2024-04-12T09:11:33.935 INFO:tasks.workunit.client.1.smithi203.stdout:7/634: write d0/d4/f88 [1469835,126219] 0 2024-04-12T09:11:33.936 INFO:tasks.workunit.client.1.smithi203.stdout:7/635: chown d0/d4/d1c/c1e 249513870 1 2024-04-12T09:11:33.937 INFO:tasks.workunit.client.1.smithi203.stdout:3/566: symlink d2/d8/d14/d1b/d2f/lbb 0 2024-04-12T09:11:33.937 INFO:tasks.workunit.client.1.smithi203.stdout:7/636: truncate d0/d4/d1c/d5b/f8e 657843 0 2024-04-12T09:11:33.937 INFO:tasks.workunit.client.1.smithi203.stdout:3/567: dread - d2/d8/d14/d45/fa9 zero size 2024-04-12T09:11:33.940 INFO:tasks.workunit.client.1.smithi203.stdout:7/637: fdatasync d0/d4/d54/f77 0 2024-04-12T09:11:33.945 INFO:tasks.workunit.client.1.smithi203.stdout:5/710: mknod d0/d6/d11/cff 0 2024-04-12T09:11:33.947 INFO:tasks.workunit.client.1.smithi203.stdout:0/692: symlink d0/ldb 0 2024-04-12T09:11:33.947 INFO:tasks.workunit.client.1.smithi203.stdout:2/626: dwrite d0/d14/d1e/d2a/f60 [0,4194304] 0 2024-04-12T09:11:33.949 INFO:tasks.workunit.client.1.smithi203.stdout:7/638: dwrite d0/d4/d1c/d5b/f65 [0,4194304] 0 2024-04-12T09:11:33.954 INFO:tasks.workunit.client.1.smithi203.stdout:4/668: unlink d1a/d21/d22/l6e 0 2024-04-12T09:11:33.958 INFO:tasks.workunit.client.1.smithi203.stdout:2/627: creat d0/d14/d1e/d2a/dcd/fdb x:0 0 0 2024-04-12T09:11:33.958 INFO:tasks.workunit.client.1.smithi203.stdout:5/711: dwrite d0/d6/d16/d9/d86/f9f [0,4194304] 0 2024-04-12T09:11:33.959 INFO:tasks.workunit.client.1.smithi203.stdout:2/628: readlink d0/d19/l25 0 2024-04-12T09:11:33.962 INFO:tasks.workunit.client.1.smithi203.stdout:6/537: creat d1/d3/d26/d30/fac x:0 0 0 2024-04-12T09:11:33.964 INFO:tasks.workunit.client.1.smithi203.stdout:2/629: creat d0/d38/d43/fdc x:0 0 0 2024-04-12T09:11:33.964 INFO:tasks.workunit.client.1.smithi203.stdout:4/669: read d1a/d21/d22/d2e/d8d/d9b/dbc/f83 [2855184,96751] 0 2024-04-12T09:11:33.967 INFO:tasks.workunit.client.1.smithi203.stdout:4/670: fsync d1a/d21/d22/f6a 0 2024-04-12T09:11:33.968 INFO:tasks.workunit.client.1.smithi203.stdout:1/658: getdents df/d2d/d6f/d75/d80/d54/d5d/d90 0 2024-04-12T09:11:33.972 INFO:tasks.workunit.client.1.smithi203.stdout:4/671: write d1a/d21/d22/d2e/fd4 [666895,26812] 0 2024-04-12T09:11:33.972 INFO:tasks.workunit.client.1.smithi203.stdout:5/712: dwrite d0/d6/d11/d4a/f5a [0,4194304] 0 2024-04-12T09:11:33.976 INFO:tasks.workunit.client.1.smithi203.stdout:2/630: creat d0/d3/d8e/fdd x:0 0 0 2024-04-12T09:11:33.977 INFO:tasks.workunit.client.1.smithi203.stdout:6/538: creat d1/d3/fad x:0 0 0 2024-04-12T09:11:33.978 INFO:tasks.workunit.client.1.smithi203.stdout:4/672: write d1a/d1d/faf [777874,104122] 0 2024-04-12T09:11:33.979 INFO:tasks.workunit.client.1.smithi203.stdout:1/659: chown df/d59/db0/d9b/lab 12424383 1 2024-04-12T09:11:33.980 INFO:tasks.workunit.client.1.smithi203.stdout:1/660: readlink l2 0 2024-04-12T09:11:33.981 INFO:tasks.workunit.client.1.smithi203.stdout:9/557: dwrite d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/f61 [0,4194304] 0 2024-04-12T09:11:33.981 INFO:tasks.workunit.client.1.smithi203.stdout:1/661: fsync df/f76 0 2024-04-12T09:11:33.988 INFO:tasks.workunit.client.1.smithi203.stdout:2/631: creat d0/d14/d1e/fde x:0 0 0 2024-04-12T09:11:33.988 INFO:tasks.workunit.client.1.smithi203.stdout:6/539: creat d1/d3/d4/fae x:0 0 0 2024-04-12T09:11:33.989 INFO:tasks.workunit.client.1.smithi203.stdout:5/713: rename d0/d6/d11/d4a/lb8 to d0/d6/d16/d9/d30/d58/d74/d88/dbf/l100 0 2024-04-12T09:11:33.990 INFO:tasks.workunit.client.1.smithi203.stdout:1/662: read - df/d2d/d6f/d75/d80/d54/d5d/d58/f92 zero size 2024-04-12T09:11:33.991 INFO:tasks.workunit.client.1.smithi203.stdout:1/663: write df/f76 [89565,111803] 0 2024-04-12T09:11:33.992 INFO:tasks.workunit.client.1.smithi203.stdout:5/714: chown d0/d6/d16/d9/d14/d2d/l90 485257982 1 2024-04-12T09:11:33.994 INFO:tasks.workunit.client.1.smithi203.stdout:7/639: dread d0/d4/d54/dac/fb9 [0,4194304] 0 2024-04-12T09:11:33.994 INFO:tasks.workunit.client.1.smithi203.stdout:5/715: write d0/d6/d16/d9/d80/fc0 [1683051,55435] 0 2024-04-12T09:11:33.996 INFO:tasks.workunit.client.1.smithi203.stdout:7/640: chown d0/d4/d1c/d3b/d4c/ld1 6328 1 2024-04-12T09:11:33.998 INFO:tasks.workunit.client.1.smithi203.stdout:6/540: mkdir d1/d3/d26/d9b/daf 0 2024-04-12T09:11:33.998 INFO:tasks.workunit.client.1.smithi203.stdout:0/693: dread d0/dd/d71/d94/d2f/d4c/f8d [4194304,4194304] 0 2024-04-12T09:11:34.000 INFO:tasks.workunit.client.1.smithi203.stdout:6/541: write d1/d3/d26/d30/fab [172214,122308] 0 2024-04-12T09:11:34.001 INFO:tasks.workunit.client.1.smithi203.stdout:6/542: chown d1/d3/d26/d5d/f82 3333718 1 2024-04-12T09:11:34.004 INFO:tasks.workunit.client.1.smithi203.stdout:0/694: dwrite d0/d48/fd4 [0,4194304] 0 2024-04-12T09:11:34.004 INFO:tasks.workunit.client.1.smithi203.stdout:4/673: rename d1a/d21/d22/d2e/d8d/d9b/dbc/dc7/ccb to d1a/d1d/d69/cd7 0 2024-04-12T09:11:34.006 INFO:tasks.workunit.client.1.smithi203.stdout:0/695: read d0/dd/d71/d94/d2f/f42 [1801198,4084] 0 2024-04-12T09:11:34.007 INFO:tasks.workunit.client.1.smithi203.stdout:8/589: write d4/d8/d74/d78/f2e [827428,92733] 0 2024-04-12T09:11:34.010 INFO:tasks.workunit.client.1.smithi203.stdout:9/558: link d8/d3b/c51 d8/d3b/db7/ccc 0 2024-04-12T09:11:34.013 INFO:tasks.workunit.client.1.smithi203.stdout:1/664: creat df/d2d/d6f/d75/d80/d54/d5d/d90/dc7/fc8 x:0 0 0 2024-04-12T09:11:34.013 INFO:tasks.workunit.client.1.smithi203.stdout:3/568: truncate d2/d8/d14/f27 2523693 0 2024-04-12T09:11:34.015 INFO:tasks.workunit.client.1.smithi203.stdout:0/696: dwrite d0/f3 [0,4194304] 0 2024-04-12T09:11:34.021 INFO:tasks.workunit.client.1.smithi203.stdout:5/716: mkdir d0/d6/d11/dd3/d101 0 2024-04-12T09:11:34.022 INFO:tasks.workunit.client.1.smithi203.stdout:5/717: readlink d0/d6/d16/d9/d30/d58/d74/d88/ld1 0 2024-04-12T09:11:34.025 INFO:tasks.workunit.client.1.smithi203.stdout:7/641: mknod d0/d15/d2d/d5e/ce3 0 2024-04-12T09:11:34.027 INFO:tasks.workunit.client.1.smithi203.stdout:7/642: dread - d0/d4/d1c/d3b/f78 zero size 2024-04-12T09:11:34.028 INFO:tasks.workunit.client.1.smithi203.stdout:9/559: rmdir d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d70 39 2024-04-12T09:11:34.029 INFO:tasks.workunit.client.1.smithi203.stdout:5/718: dwrite d0/d6/d16/d9/d30/d83/fac [0,4194304] 0 2024-04-12T09:11:34.030 INFO:tasks.workunit.client.1.smithi203.stdout:6/543: mknod d1/df/d87/d7a/cb0 0 2024-04-12T09:11:34.030 INFO:tasks.workunit.client.1.smithi203.stdout:7/643: chown d0/d15/d2d/d5e/d8c/l6e 197 1 2024-04-12T09:11:34.032 INFO:tasks.workunit.client.1.smithi203.stdout:3/569: mkdir d2/d51/dbc 0 2024-04-12T09:11:34.032 INFO:tasks.workunit.client.1.smithi203.stdout:6/544: readlink d1/d3/d26/d30/d4a/d6c/l5f 0 2024-04-12T09:11:34.036 INFO:tasks.workunit.client.1.smithi203.stdout:0/697: write d0/dd/d71/d94/d2f/f1e [3618044,102130] 0 2024-04-12T09:11:34.043 INFO:tasks.workunit.client.1.smithi203.stdout:2/632: write d0/fb2 [1659951,96858] 0 2024-04-12T09:11:34.045 INFO:tasks.workunit.client.1.smithi203.stdout:2/633: dread d0/d38/fbb [0,4194304] 0 2024-04-12T09:11:34.047 INFO:tasks.workunit.client.1.smithi203.stdout:5/719: creat d0/d6/d16/d9/d30/f102 x:0 0 0 2024-04-12T09:11:34.055 INFO:tasks.workunit.client.1.smithi203.stdout:4/674: write d1a/d20/d5d/d2c/d72/fc8 [3047876,118540] 0 2024-04-12T09:11:34.055 INFO:tasks.workunit.client.1.smithi203.stdout:0/698: mknod d0/dd/d40/cdc 0 2024-04-12T09:11:34.062 INFO:tasks.workunit.client.1.smithi203.stdout:0/699: dread d0/f4e [0,4194304] 0 2024-04-12T09:11:34.063 INFO:tasks.workunit.client.1.smithi203.stdout:8/590: dwrite d4/d8/f77 [0,4194304] 0 2024-04-12T09:11:34.064 INFO:tasks.workunit.client.1.smithi203.stdout:0/700: stat d0/dd/d5b/d9f/lbf 0 2024-04-12T09:11:34.069 INFO:tasks.workunit.client.1.smithi203.stdout:3/570: getdents d2/d51/db8 0 2024-04-12T09:11:34.071 INFO:tasks.workunit.client.1.smithi203.stdout:3/571: truncate d2/d8/d14/d23/d35/d4c/d67/f9f 928626 0 2024-04-12T09:11:34.072 INFO:tasks.workunit.client.1.smithi203.stdout:6/545: mkdir d1/d3/d5b/d8c/d3e/da1/db1 0 2024-04-12T09:11:34.074 INFO:tasks.workunit.client.1.smithi203.stdout:6/546: write d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/d9c/fa7 [949811,48159] 0 2024-04-12T09:11:34.074 INFO:tasks.workunit.client.1.smithi203.stdout:4/675: rmdir d1a/d1d 39 2024-04-12T09:11:34.078 INFO:tasks.workunit.client.1.smithi203.stdout:2/634: creat d0/d14/d8a/dca/fdf x:0 0 0 2024-04-12T09:11:34.080 INFO:tasks.workunit.client.1.smithi203.stdout:5/720: getdents d0/d6/d16/d44/de2 0 2024-04-12T09:11:34.081 INFO:tasks.workunit.client.1.smithi203.stdout:7/644: creat d0/d4/d54/fe4 x:0 0 0 2024-04-12T09:11:34.084 INFO:tasks.workunit.client.1.smithi203.stdout:0/701: truncate d0/dd/dbd/fc4 7508770 0 2024-04-12T09:11:34.085 INFO:tasks.workunit.client.1.smithi203.stdout:9/560: truncate d8/d12/d3e/f73 502611 0 2024-04-12T09:11:34.086 INFO:tasks.workunit.client.1.smithi203.stdout:5/721: dwrite d0/dbd/fc7 [0,4194304] 0 2024-04-12T09:11:34.088 INFO:tasks.workunit.client.1.smithi203.stdout:1/665: getdents df/d2d/d6f/daa 0 2024-04-12T09:11:34.090 INFO:tasks.workunit.client.1.smithi203.stdout:1/666: chown df/d2d/d6f/f9a 997619 1 2024-04-12T09:11:34.096 INFO:tasks.workunit.client.1.smithi203.stdout:2/635: chown d0/d3/c31 14532 1 2024-04-12T09:11:34.097 INFO:tasks.workunit.client.1.smithi203.stdout:2/636: write d0/fc [1233541,87449] 0 2024-04-12T09:11:34.101 INFO:tasks.workunit.client.1.smithi203.stdout:1/667: dread df/f17 [0,4194304] 0 2024-04-12T09:11:34.103 INFO:tasks.workunit.client.1.smithi203.stdout:8/591: write d4/d8/fd [10058083,91193] 0 2024-04-12T09:11:34.104 INFO:tasks.workunit.client.1.smithi203.stdout:4/676: truncate d1a/d20/fa4 460208 0 2024-04-12T09:11:34.107 INFO:tasks.workunit.client.1.smithi203.stdout:2/637: mkdir d0/d14/d1e/d2a/dcd/de0 0 2024-04-12T09:11:34.108 INFO:tasks.workunit.client.1.smithi203.stdout:7/645: creat d0/d15/d2d/d5e/dba/fe5 x:0 0 0 2024-04-12T09:11:34.108 INFO:tasks.workunit.client.1.smithi203.stdout:1/668: dread df/d2d/d6f/d75/d80/d54/d5d/d58/f66 [0,4194304] 0 2024-04-12T09:11:34.109 INFO:tasks.workunit.client.1.smithi203.stdout:0/702: dwrite d0/dd/d71/d94/d2f/d4c/f74 [0,4194304] 0 2024-04-12T09:11:34.110 INFO:tasks.workunit.client.1.smithi203.stdout:2/638: write d0/d67/f6c [987275,102853] 0 2024-04-12T09:11:34.110 INFO:tasks.workunit.client.1.smithi203.stdout:5/722: creat d0/daf/f103 x:0 0 0 2024-04-12T09:11:34.113 INFO:tasks.workunit.client.1.smithi203.stdout:7/646: write d0/d4/d53/fa5 [5130957,30224] 0 2024-04-12T09:11:34.116 INFO:tasks.workunit.client.1.smithi203.stdout:3/572: write d2/d8/f39 [289186,9395] 0 2024-04-12T09:11:34.118 INFO:tasks.workunit.client.1.smithi203.stdout:1/669: dread - df/d2d/d6f/d75/d80/d54/d5d/d90/dc7/fc8 zero size 2024-04-12T09:11:34.120 INFO:tasks.workunit.client.1.smithi203.stdout:1/670: dread - df/d2d/d6f/f9a zero size 2024-04-12T09:11:34.120 INFO:tasks.workunit.client.1.smithi203.stdout:3/573: stat d2/d8/d14/d23/d35/d4c/fb6 0 2024-04-12T09:11:34.121 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:33 smithi117 ceph-mon[29277]: pgmap v27: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 78 MiB/s rd, 265 MiB/s wr, 484 op/s 2024-04-12T09:11:34.122 INFO:tasks.workunit.client.1.smithi203.stdout:4/677: mkdir d1a/d21/d22/d2e/d8d/d9b/dd8 0 2024-04-12T09:11:34.124 INFO:tasks.workunit.client.1.smithi203.stdout:2/639: dwrite d0/d14/d23/d3d/f64 [0,4194304] 0 2024-04-12T09:11:34.135 INFO:tasks.workunit.client.1.smithi203.stdout:6/547: getdents d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43 0 2024-04-12T09:11:34.139 INFO:tasks.workunit.client.1.smithi203.stdout:6/548: dread d1/d3/d4/f88 [0,4194304] 0 2024-04-12T09:11:34.139 INFO:tasks.workunit.client.1.smithi203.stdout:1/671: symlink df/d2d/d6f/d75/d80/d54/d5d/d90/lc9 0 2024-04-12T09:11:34.143 INFO:tasks.workunit.client.1.smithi203.stdout:8/592: dread d4/f6 [0,4194304] 0 2024-04-12T09:11:34.143 INFO:tasks.workunit.client.1.smithi203.stdout:4/678: creat d1a/d20/d5d/d2c/fd9 x:0 0 0 2024-04-12T09:11:34.145 INFO:tasks.workunit.client.1.smithi203.stdout:8/593: chown d4/f1f 599767017 1 2024-04-12T09:11:34.145 INFO:tasks.workunit.client.1.smithi203.stdout:0/703: dread d0/dd/d71/d94/d2f/d17/d19/f3b [0,4194304] 0 2024-04-12T09:11:34.146 INFO:tasks.workunit.client.1.smithi203.stdout:6/549: dwrite d1/d3/d5b/d8c/f66 [0,4194304] 0 2024-04-12T09:11:34.146 INFO:tasks.workunit.client.1.smithi203.stdout:7/647: rename d0/d15/cb2 to d0/d15/d2d/d5e/ce6 0 2024-04-12T09:11:34.147 INFO:tasks.workunit.client.1.smithi203.stdout:0/704: stat d0/dd/d71/d94/d2f/f8f 0 2024-04-12T09:11:34.149 INFO:tasks.workunit.client.1.smithi203.stdout:5/723: write d0/ffe [4878364,109195] 0 2024-04-12T09:11:34.151 INFO:tasks.workunit.client.1.smithi203.stdout:5/724: stat d0/d6/d11/d1e/d4c/d48/f55 0 2024-04-12T09:11:34.154 INFO:tasks.workunit.client.1.smithi203.stdout:1/672: unlink df/d2d/d6f/d75/d80/d54/c64 0 2024-04-12T09:11:34.160 INFO:tasks.workunit.client.1.smithi203.stdout:7/648: read d0/d4/d1c/faa [349640,95778] 0 2024-04-12T09:11:34.163 INFO:tasks.workunit.client.1.smithi203.stdout:8/594: rename d4/d8/d81/d84/d92/cbc to d4/d8/d1c/d48/d5e/cbe 0 2024-04-12T09:11:34.165 INFO:tasks.workunit.client.1.smithi203.stdout:6/550: mknod d1/d3/d26/d5d/cb2 0 2024-04-12T09:11:34.167 INFO:tasks.workunit.client.1.smithi203.stdout:2/640: dwrite d0/d38/d43/d9c/fcf [0,4194304] 0 2024-04-12T09:11:34.167 INFO:tasks.workunit.client.1.smithi203.stdout:0/705: mknod d0/dd/d71/d94/d2f/d17/cdd 0 2024-04-12T09:11:34.174 INFO:tasks.workunit.client.1.smithi203.stdout:3/574: write d2/d8/d14/f27 [2661085,50356] 0 2024-04-12T09:11:34.175 INFO:tasks.workunit.client.1.smithi203.stdout:4/679: write d1a/d20/d5f/f64 [3765071,29850] 0 2024-04-12T09:11:34.175 INFO:tasks.workunit.client.1.smithi203.stdout:5/725: chown d0/f66 11381 1 2024-04-12T09:11:34.176 INFO:tasks.workunit.client.1.smithi203.stdout:1/673: symlink df/d2d/d6f/d75/d80/d54/d5d/d90/dc7/lca 0 2024-04-12T09:11:34.178 INFO:tasks.workunit.client.1.smithi203.stdout:4/680: write d1a/d21/d22/d2e/d8d/d9b/dbc/f8a [38680,61371] 0 2024-04-12T09:11:34.179 INFO:tasks.workunit.client.1.smithi203.stdout:8/595: symlink d4/d8/d74/lbf 0 2024-04-12T09:11:34.179 INFO:tasks.workunit.client.1.smithi203.stdout:1/674: truncate df/d2d/d6f/d75/d80/d54/d5d/d90/f95 963184 0 2024-04-12T09:11:34.180 INFO:tasks.workunit.client.1.smithi203.stdout:6/551: truncate d1/d3/d26/d30/d4a/d6c/f44 2342978 0 2024-04-12T09:11:34.181 INFO:tasks.workunit.client.1.smithi203.stdout:2/641: creat d0/d14/d74/d96/d9a/fe1 x:0 0 0 2024-04-12T09:11:34.182 INFO:tasks.workunit.client.1.smithi203.stdout:0/706: rmdir d0/dd/d71/d94/d2f/d17/d19 39 2024-04-12T09:11:34.214 INFO:tasks.workunit.client.1.smithi203.stdout:5/726: rename d0/d6/d16/d9/d14 to d0/d6/d16/d9/d80/df2/d104 0 2024-04-12T09:11:34.214 INFO:tasks.workunit.client.1.smithi203.stdout:9/561: sync 2024-04-12T09:11:34.215 INFO:tasks.workunit.client.1.smithi203.stdout:7/649: creat d0/d4/d1c/d5b/dbf/de1/fe7 x:0 0 0 2024-04-12T09:11:34.216 INFO:tasks.workunit.client.1.smithi203.stdout:7/650: chown d0/d15/d2d/cdd 47796 1 2024-04-12T09:11:34.218 INFO:tasks.workunit.client.1.smithi203.stdout:8/596: mkdir d4/d8/d1c/d5d/dc0 0 2024-04-12T09:11:34.219 INFO:tasks.workunit.client.1.smithi203.stdout:1/675: mknod df/d2d/d6f/daa/ccb 0 2024-04-12T09:11:34.221 INFO:tasks.workunit.client.1.smithi203.stdout:9/562: dwrite d8/fa [0,4194304] 0 2024-04-12T09:11:34.222 INFO:tasks.workunit.client.1.smithi203.stdout:1/676: write df/d2d/d6f/d75/d80/d54/f61 [451592,19894] 0 2024-04-12T09:11:34.225 INFO:tasks.workunit.client.1.smithi203.stdout:2/642: mkdir d0/d14/de2 0 2024-04-12T09:11:34.230 INFO:tasks.workunit.client.1.smithi203.stdout:3/575: mknod d2/d8/d14/d1b/d2f/cbd 0 2024-04-12T09:11:34.231 INFO:tasks.workunit.client.1.smithi203.stdout:5/727: dread d0/d6/d16/d9/f24 [0,4194304] 0 2024-04-12T09:11:34.232 INFO:tasks.workunit.client.1.smithi203.stdout:0/707: dwrite d0/dd/d71/d94/d2f/d4c/f8d [8388608,4194304] 0 2024-04-12T09:11:34.233 INFO:tasks.workunit.client.1.smithi203.stdout:5/728: chown d0/d6/d16/d9/d80/df2/d104/d2d/l90 1 1 2024-04-12T09:11:34.236 INFO:tasks.workunit.client.1.smithi203.stdout:3/576: read d2/d51/d65/f77 [2087434,71401] 0 2024-04-12T09:11:34.238 INFO:tasks.workunit.client.1.smithi203.stdout:3/577: chown d2/d8/d14/d1b/l74 92 1 2024-04-12T09:11:34.238 INFO:tasks.workunit.client.1.smithi203.stdout:4/681: symlink d1a/d20/d5d/lda 0 2024-04-12T09:11:34.241 INFO:tasks.workunit.client.1.smithi203.stdout:9/563: unlink d8/d12/d3e/d90/fc2 0 2024-04-12T09:11:34.242 INFO:tasks.workunit.client.1.smithi203.stdout:9/564: truncate d8/d12/f83 4348927 0 2024-04-12T09:11:34.243 INFO:tasks.workunit.client.1.smithi203.stdout:1/677: unlink df/f17 0 2024-04-12T09:11:34.244 INFO:tasks.workunit.client.1.smithi203.stdout:1/678: write df/d2d/d6f/d75/d80/d2b/d91/db8/fbe [70274,109229] 0 2024-04-12T09:11:34.246 INFO:tasks.workunit.client.1.smithi203.stdout:0/708: mknod d0/d48/d5e/cde 0 2024-04-12T09:11:34.249 INFO:tasks.workunit.client.1.smithi203.stdout:7/651: symlink d0/d4/d54/dac/dd4/le8 0 2024-04-12T09:11:34.253 INFO:tasks.workunit.client.1.smithi203.stdout:4/682: fsync d1a/d20/d5d/d2c/f51 0 2024-04-12T09:11:34.256 INFO:tasks.workunit.client.1.smithi203.stdout:6/552: write d1/df/f41 [1030733,114701] 0 2024-04-12T09:11:34.257 INFO:tasks.workunit.client.1.smithi203.stdout:0/709: creat d0/d48/d5e/d84/fdf x:0 0 0 2024-04-12T09:11:34.259 INFO:tasks.workunit.client.1.smithi203.stdout:7/652: creat d0/d34/d7c/fe9 x:0 0 0 2024-04-12T09:11:34.260 INFO:tasks.workunit.client.1.smithi203.stdout:3/578: rmdir d2/d8/d14/d23/d35/d91/d81 39 2024-04-12T09:11:34.264 INFO:tasks.workunit.client.1.smithi203.stdout:4/683: rename d1a/d20/l4f to d1a/d21/d22/d2e/d8d/db8/ldb 0 2024-04-12T09:11:34.270 INFO:tasks.workunit.client.1.smithi203.stdout:0/710: symlink d0/dd/d5b/d90/le0 0 2024-04-12T09:11:34.272 INFO:tasks.workunit.client.1.smithi203.stdout:5/729: write d0/d6/d16/d9/f63 [1363452,56093] 0 2024-04-12T09:11:34.274 INFO:tasks.workunit.client.1.smithi203.stdout:7/653: unlink d0/d38/d51/l84 0 2024-04-12T09:11:34.278 INFO:tasks.workunit.client.1.smithi203.stdout:8/597: truncate d4/d8/f24 1756439 0 2024-04-12T09:11:34.281 INFO:tasks.workunit.client.1.smithi203.stdout:2/643: getdents d0/d54/dad 0 2024-04-12T09:11:34.282 INFO:tasks.workunit.client.1.smithi203.stdout:6/553: write d1/df/f19 [3877658,71199] 0 2024-04-12T09:11:34.283 INFO:tasks.workunit.client.1.smithi203.stdout:8/598: dwrite d4/d8/d74/d78/d53/f68 [0,4194304] 0 2024-04-12T09:11:34.283 INFO:tasks.workunit.client.1.smithi203.stdout:1/679: creat df/d2d/d6f/d75/fcc x:0 0 0 2024-04-12T09:11:34.291 INFO:tasks.workunit.client.1.smithi203.stdout:9/565: dwrite d8/d12/d23/f77 [0,4194304] 0 2024-04-12T09:11:34.291 INFO:tasks.workunit.client.1.smithi203.stdout:1/680: chown df/d2d/d6f/d75/laf 586 1 2024-04-12T09:11:34.291 INFO:tasks.workunit.client.1.smithi203.stdout:4/684: mkdir d1a/d21/d60/daa/dc5/ddc 0 2024-04-12T09:11:34.293 INFO:tasks.workunit.client.1.smithi203.stdout:2/644: mknod d0/d54/d61/db7/ce3 0 2024-04-12T09:11:34.294 INFO:tasks.workunit.client.1.smithi203.stdout:0/711: dwrite d0/dd/f16 [0,4194304] 0 2024-04-12T09:11:34.297 INFO:tasks.workunit.client.1.smithi203.stdout:2/645: write d0/d14/d1e/d2a/f90 [1150697,123265] 0 2024-04-12T09:11:34.297 INFO:tasks.workunit.client.1.smithi203.stdout:3/579: link d2/d8/d14/d1b/d95/d92/faa d2/d8/d14/d23/d35/d4c/d5c/d55/fbe 0 2024-04-12T09:11:34.298 INFO:tasks.workunit.client.1.smithi203.stdout:7/654: creat d0/d4/d54/d75/dc0/fea x:0 0 0 2024-04-12T09:11:34.302 INFO:tasks.workunit.client.1.smithi203.stdout:9/566: mkdir d8/d3b/dcd 0 2024-04-12T09:11:34.303 INFO:tasks.workunit.client.1.smithi203.stdout:7/655: stat d0/d15/d2d/d5e/f90 0 2024-04-12T09:11:34.308 INFO:tasks.workunit.client.1.smithi203.stdout:6/554: rename d1/df/l4b to d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d3a/lb3 0 2024-04-12T09:11:34.310 INFO:tasks.workunit.client.1.smithi203.stdout:3/580: read d2/d8/d14/d23/d35/d91/f5b [1215205,34576] 0 2024-04-12T09:11:34.310 INFO:tasks.workunit.client.1.smithi203.stdout:2/646: rmdir d0/d14/d1e/d2a 39 2024-04-12T09:11:34.312 INFO:tasks.workunit.client.1.smithi203.stdout:2/647: write d0/d38/d43/f94 [1290587,33772] 0 2024-04-12T09:11:34.313 INFO:tasks.workunit.client.1.smithi203.stdout:9/567: dwrite d8/d12/d23/d85/fb9 [0,4194304] 0 2024-04-12T09:11:34.318 INFO:tasks.workunit.client.1.smithi203.stdout:7/656: creat d0/d34/feb x:0 0 0 2024-04-12T09:11:34.323 INFO:tasks.workunit.client.1.smithi203.stdout:3/581: dwrite d2/d8/d14/d23/d35/f73 [0,4194304] 0 2024-04-12T09:11:34.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:33 smithi203 ceph-mon[36428]: pgmap v27: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 78 MiB/s rd, 265 MiB/s wr, 484 op/s 2024-04-12T09:11:34.325 INFO:tasks.workunit.client.1.smithi203.stdout:4/685: dread d1a/d21/d22/d2e/f4b [0,4194304] 0 2024-04-12T09:11:34.326 INFO:tasks.workunit.client.1.smithi203.stdout:8/599: write d4/f86 [1858193,86967] 0 2024-04-12T09:11:34.329 INFO:tasks.workunit.client.1.smithi203.stdout:2/648: mknod d0/d19/ce4 0 2024-04-12T09:11:34.332 INFO:tasks.workunit.client.1.smithi203.stdout:7/657: chown d0/l52 62585 1 2024-04-12T09:11:34.335 INFO:tasks.workunit.client.1.smithi203.stdout:6/555: creat d1/fb4 x:0 0 0 2024-04-12T09:11:34.335 INFO:tasks.workunit.client.1.smithi203.stdout:3/582: dwrite d2/d8/d14/d45/f7f [0,4194304] 0 2024-04-12T09:11:34.336 INFO:tasks.workunit.client.1.smithi203.stdout:2/649: readlink d0/d3/d47/l9e 0 2024-04-12T09:11:34.339 INFO:tasks.workunit.client.1.smithi203.stdout:4/686: dwrite d1a/d21/d22/f62 [4194304,4194304] 0 2024-04-12T09:11:34.340 INFO:tasks.workunit.client.1.smithi203.stdout:3/583: creat d2/d8/fbf x:0 0 0 2024-04-12T09:11:34.344 INFO:tasks.workunit.client.1.smithi203.stdout:1/681: write df/d2d/d6f/d75/d80/f41 [2092362,111459] 0 2024-04-12T09:11:34.345 INFO:tasks.workunit.client.1.smithi203.stdout:6/556: rmdir d1/d3/d26/d30/d4a/d6c/d45/d55 39 2024-04-12T09:11:34.346 INFO:tasks.workunit.client.1.smithi203.stdout:0/712: write d0/dd/d71/d94/d2f/d17/d19/fb3 [1405090,15095] 0 2024-04-12T09:11:34.347 INFO:tasks.workunit.client.1.smithi203.stdout:9/568: dread d8/f8d [0,4194304] 0 2024-04-12T09:11:34.349 INFO:tasks.workunit.client.1.smithi203.stdout:2/650: unlink d0/d3/ce 0 2024-04-12T09:11:34.354 INFO:tasks.workunit.client.1.smithi203.stdout:6/557: fsync d1/d3/f29 0 2024-04-12T09:11:34.357 INFO:tasks.workunit.client.1.smithi203.stdout:0/713: mknod d0/dd/d71/d94/d2f/d17/d19/ce1 0 2024-04-12T09:11:34.358 INFO:tasks.workunit.client.1.smithi203.stdout:9/569: readlink d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d70/lbd 0 2024-04-12T09:11:34.360 INFO:tasks.workunit.client.1.smithi203.stdout:4/687: mkdir d1a/d21/d22/ddd 0 2024-04-12T09:11:34.364 INFO:tasks.workunit.client.1.smithi203.stdout:7/658: dread d0/d38/f9c [0,4194304] 0 2024-04-12T09:11:34.366 INFO:tasks.workunit.client.1.smithi203.stdout:1/682: creat df/d2d/d6f/d75/d80/d54/d5d/d67/fcd x:0 0 0 2024-04-12T09:11:34.368 INFO:tasks.workunit.client.1.smithi203.stdout:1/683: dread df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/d88/f9f [0,4194304] 0 2024-04-12T09:11:34.369 INFO:tasks.workunit.client.1.smithi203.stdout:2/651: creat d0/d3/d8e/dcc/fe5 x:0 0 0 2024-04-12T09:11:34.369 INFO:tasks.workunit.client.1.smithi203.stdout:9/570: chown d8/d12/d23/d38/d8a/cb2 0 1 2024-04-12T09:11:34.372 INFO:tasks.workunit.client.1.smithi203.stdout:6/558: mkdir d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/db5 0 2024-04-12T09:11:34.373 INFO:tasks.workunit.client.1.smithi203.stdout:7/659: chown d0/d4/d1c/d3b/d98/ld9 43674 1 2024-04-12T09:11:34.374 INFO:tasks.workunit.client.1.smithi203.stdout:7/660: chown d0/d34/d7c/fcd 1 1 2024-04-12T09:11:34.374 INFO:tasks.workunit.client.1.smithi203.stdout:0/714: mkdir d0/dd/d71/d94/d2f/d17/dc9/de2 0 2024-04-12T09:11:34.375 INFO:tasks.workunit.client.1.smithi203.stdout:1/684: mkdir df/d2d/d6f/d75/d80/d54/d5d/d58/dce 0 2024-04-12T09:11:34.375 INFO:tasks.workunit.client.1.smithi203.stdout:2/652: dread d0/fb2 [0,4194304] 0 2024-04-12T09:11:34.378 INFO:tasks.workunit.client.1.smithi203.stdout:7/661: dread d0/d4/d1c/d3b/d4c/f59 [0,4194304] 0 2024-04-12T09:11:34.379 INFO:tasks.workunit.client.1.smithi203.stdout:6/559: creat d1/d3/d26/d30/d4a/d6c/fb6 x:0 0 0 2024-04-12T09:11:34.380 INFO:tasks.workunit.client.1.smithi203.stdout:3/584: mknod d2/d8/d14/d23/d35/cc0 0 2024-04-12T09:11:34.387 INFO:tasks.workunit.client.1.smithi203.stdout:0/715: dread d0/dd/f99 [0,4194304] 0 2024-04-12T09:11:34.388 INFO:tasks.workunit.client.1.smithi203.stdout:0/716: write d0/dd/d71/d94/d2f/d34/db1/fb8 [598158,61966] 0 2024-04-12T09:11:34.390 INFO:tasks.workunit.client.1.smithi203.stdout:9/571: write d8/fb [1019209,13211] 0 2024-04-12T09:11:34.391 INFO:tasks.workunit.client.1.smithi203.stdout:1/685: mknod df/d2d/d6f/d75/d80/d54/d5d/d58/d94/ccf 0 2024-04-12T09:11:34.393 INFO:tasks.workunit.client.1.smithi203.stdout:3/585: creat d2/d51/d65/fc1 x:0 0 0 2024-04-12T09:11:34.396 INFO:tasks.workunit.client.1.smithi203.stdout:5/730: sync 2024-04-12T09:11:34.396 INFO:tasks.workunit.client.1.smithi203.stdout:4/688: truncate d1a/d1d/d69/fc1 3175926 0 2024-04-12T09:11:34.397 INFO:tasks.workunit.client.1.smithi203.stdout:6/560: truncate d1/d3/d26/d30/d4a/d6c/d45/f52 956427 0 2024-04-12T09:11:34.397 INFO:tasks.workunit.client.1.smithi203.stdout:4/689: write d1a/d34/f46 [6972940,109237] 0 2024-04-12T09:11:34.398 INFO:tasks.workunit.client.1.smithi203.stdout:6/561: chown d1/d3/d4/f42 391998 1 2024-04-12T09:11:34.401 INFO:tasks.workunit.client.1.smithi203.stdout:6/562: dread d1/d3/d12/f1e [4194304,4194304] 0 2024-04-12T09:11:34.408 INFO:tasks.workunit.client.1.smithi203.stdout:0/717: mknod d0/dd/d71/d94/d2f/d17/dc9/ce3 0 2024-04-12T09:11:34.409 INFO:tasks.workunit.client.1.smithi203.stdout:0/718: truncate d0/dd/d71/d94/d2f/d34/db1/fa5 537570 0 2024-04-12T09:11:34.410 INFO:tasks.workunit.client.1.smithi203.stdout:1/686: chown df/c57 73312470 1 2024-04-12T09:11:34.411 INFO:tasks.workunit.client.1.smithi203.stdout:7/662: mkdir d0/d15/d2d/dec 0 2024-04-12T09:11:34.412 INFO:tasks.workunit.client.1.smithi203.stdout:3/586: truncate d2/d8/fa2 890588 0 2024-04-12T09:11:34.414 INFO:tasks.workunit.client.1.smithi203.stdout:4/690: creat d1a/d21/d22/d2e/d8d/db8/fde x:0 0 0 2024-04-12T09:11:34.416 INFO:tasks.workunit.client.1.smithi203.stdout:2/653: rename d0/d14/d23/d3d/c70 to d0/d14/d74/ce6 0 2024-04-12T09:11:34.417 INFO:tasks.workunit.client.1.smithi203.stdout:6/563: write d1/d3/f97 [1481146,110067] 0 2024-04-12T09:11:34.419 INFO:tasks.workunit.client.1.smithi203.stdout:9/572: creat d8/d80/fce x:0 0 0 2024-04-12T09:11:34.420 INFO:tasks.workunit.client.1.smithi203.stdout:9/573: readlink d8/d12/d23/d85/l8f 0 2024-04-12T09:11:34.421 INFO:tasks.workunit.client.1.smithi203.stdout:6/564: dread d1/d3/d12/f5e [0,4194304] 0 2024-04-12T09:11:34.421 INFO:tasks.workunit.client.1.smithi203.stdout:0/719: mkdir d0/dd/d71/d94/d2f/d17/d19/de4 0 2024-04-12T09:11:34.423 INFO:tasks.workunit.client.1.smithi203.stdout:1/687: dread - df/d2d/d6f/d75/f9e zero size 2024-04-12T09:11:34.423 INFO:tasks.workunit.client.1.smithi203.stdout:7/663: symlink d0/d4/d1c/d5b/dbf/de1/led 0 2024-04-12T09:11:34.424 INFO:tasks.workunit.client.1.smithi203.stdout:3/587: creat d2/d8/d14/d23/d35/d4c/fc2 x:0 0 0 2024-04-12T09:11:34.426 INFO:tasks.workunit.client.1.smithi203.stdout:4/691: mkdir d1a/d21/d22/d2e/d8d/d9b/ddf 0 2024-04-12T09:11:34.426 INFO:tasks.workunit.client.1.smithi203.stdout:9/574: dwrite d8/d80/fce [0,4194304] 0 2024-04-12T09:11:34.428 INFO:tasks.workunit.client.1.smithi203.stdout:4/692: write d1a/d21/da1/fc0 [232228,39124] 0 2024-04-12T09:11:34.430 INFO:tasks.workunit.client.1.smithi203.stdout:1/688: creat df/d2d/d6f/d75/d80/d8c/fd0 x:0 0 0 2024-04-12T09:11:34.432 INFO:tasks.workunit.client.1.smithi203.stdout:3/588: mkdir d2/d8/d14/d23/d35/d4c/d5c/dc3 0 2024-04-12T09:11:34.436 INFO:tasks.workunit.client.1.smithi203.stdout:4/693: dread d1a/d21/d22/f39 [0,4194304] 0 2024-04-12T09:11:34.437 INFO:tasks.workunit.client.1.smithi203.stdout:2/654: dread d0/d3/fd [0,4194304] 0 2024-04-12T09:11:34.438 INFO:tasks.workunit.client.1.smithi203.stdout:5/731: rename d0/d6/fe to d0/d6/d16/d9/d80/df2/d104/f105 0 2024-04-12T09:11:34.443 INFO:tasks.workunit.client.1.smithi203.stdout:7/664: link d0/d4/d1c/d3b/d4c/f94 d0/d4/d1c/d3b/d4c/fee 0 2024-04-12T09:11:34.446 INFO:tasks.workunit.client.1.smithi203.stdout:2/655: symlink d0/d14/le7 0 2024-04-12T09:11:34.448 INFO:tasks.workunit.client.1.smithi203.stdout:5/732: fsync d0/d6/d16/d9/d30/f6f 0 2024-04-12T09:11:34.449 INFO:tasks.workunit.client.1.smithi203.stdout:7/665: mknod d0/d4/d54/dac/dd4/cef 0 2024-04-12T09:11:34.450 INFO:tasks.workunit.client.1.smithi203.stdout:7/666: chown d0/d4/d54/da0/laf 92333517 1 2024-04-12T09:11:34.450 INFO:tasks.workunit.client.1.smithi203.stdout:9/575: rename d8/f89 to d8/fcf 0 2024-04-12T09:11:34.450 INFO:tasks.workunit.client.1.smithi203.stdout:7/667: chown d0/d38/fb6 0 1 2024-04-12T09:11:34.452 INFO:tasks.workunit.client.1.smithi203.stdout:1/689: creat df/d2d/fd1 x:0 0 0 2024-04-12T09:11:34.455 INFO:tasks.workunit.client.1.smithi203.stdout:6/565: rename d1/fb4 to d1/d3/d26/d30/d4a/d6c/d45/fb7 0 2024-04-12T09:11:34.456 INFO:tasks.workunit.client.1.smithi203.stdout:4/694: dread d1a/d21/d22/d2e/d8d/d9b/dbc/f83 [0,4194304] 0 2024-04-12T09:11:34.456 INFO:tasks.workunit.client.1.smithi203.stdout:6/566: dread - d1/d3/d12/f83 zero size 2024-04-12T09:11:34.456 INFO:tasks.workunit.client.1.smithi203.stdout:2/656: creat d0/d14/d1e/d2a/fe8 x:0 0 0 2024-04-12T09:11:34.458 INFO:tasks.workunit.client.1.smithi203.stdout:7/668: mkdir d0/d15/d2d/d5e/d8c/df0 0 2024-04-12T09:11:34.463 INFO:tasks.workunit.client.1.smithi203.stdout:5/733: mkdir d0/d9a/d106 0 2024-04-12T09:11:34.465 INFO:tasks.workunit.client.1.smithi203.stdout:4/695: mknod d1a/d34/ce0 0 2024-04-12T09:11:34.467 INFO:tasks.workunit.client.1.smithi203.stdout:7/669: unlink d0/d4/d5d/f5c 0 2024-04-12T09:11:34.473 INFO:tasks.workunit.client.1.smithi203.stdout:6/567: creat d1/df/d65/d96/fb8 x:0 0 0 2024-04-12T09:11:34.480 INFO:tasks.workunit.client.1.smithi203.stdout:9/576: link d8/d12/d3e/fa2 d8/d12/d23/d38/d8a/d97/d9e/d74/fd0 0 2024-04-12T09:11:34.481 INFO:tasks.workunit.client.1.smithi203.stdout:1/690: write df/d2d/f32 [772667,65183] 0 2024-04-12T09:11:34.482 INFO:tasks.workunit.client.1.smithi203.stdout:6/568: symlink d1/d3/d26/d30/lb9 0 2024-04-12T09:11:34.486 INFO:tasks.workunit.client.1.smithi203.stdout:8/600: sync 2024-04-12T09:11:34.486 INFO:tasks.workunit.client.1.smithi203.stdout:2/657: truncate d0/d3/f36 3485533 0 2024-04-12T09:11:34.488 INFO:tasks.workunit.client.1.smithi203.stdout:6/569: dwrite d1/df/f19 [0,4194304] 0 2024-04-12T09:11:34.489 INFO:tasks.workunit.client.1.smithi203.stdout:9/577: fdatasync d8/f8d 0 2024-04-12T09:11:34.490 INFO:tasks.workunit.client.1.smithi203.stdout:6/570: write d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/d9c/fa7 [1591542,46082] 0 2024-04-12T09:11:34.495 INFO:tasks.workunit.client.1.smithi203.stdout:5/734: creat d0/d6/d16/d9/f107 x:0 0 0 2024-04-12T09:11:34.495 INFO:tasks.workunit.client.1.smithi203.stdout:1/691: symlink df/d2d/d6f/d75/d80/d8c/ld2 0 2024-04-12T09:11:34.495 INFO:tasks.workunit.client.1.smithi203.stdout:6/571: truncate d1/d3/d26/d30/fac 370188 0 2024-04-12T09:11:34.496 INFO:tasks.workunit.client.1.smithi203.stdout:4/696: link d1a/d2b/l53 d1a/d20/d5f/le1 0 2024-04-12T09:11:34.497 INFO:tasks.workunit.client.1.smithi203.stdout:4/697: chown d1a/d20/d5d/d2c/f51 4318724 1 2024-04-12T09:11:34.498 INFO:tasks.workunit.client.1.smithi203.stdout:7/670: creat d0/d4/ff1 x:0 0 0 2024-04-12T09:11:34.501 INFO:tasks.workunit.client.1.smithi203.stdout:8/601: creat d4/d8/d37/d57/d7d/fc1 x:0 0 0 2024-04-12T09:11:34.502 INFO:tasks.workunit.client.1.smithi203.stdout:8/602: write d4/d8/f38 [921549,106280] 0 2024-04-12T09:11:34.508 INFO:tasks.workunit.client.1.smithi203.stdout:4/698: mknod d1a/d21/d60/d68/dbe/ce2 0 2024-04-12T09:11:34.509 INFO:tasks.workunit.client.1.smithi203.stdout:4/699: write d1a/d21/f67 [116058,43264] 0 2024-04-12T09:11:34.520 INFO:tasks.workunit.client.1.smithi203.stdout:1/692: mknod df/d2d/d6f/d75/d80/d54/d5d/d58/dce/cd3 0 2024-04-12T09:11:34.522 INFO:tasks.workunit.client.1.smithi203.stdout:9/578: dwrite d8/d12/d23/d38/d8a/d97/d9e/d74/f7f [0,4194304] 0 2024-04-12T09:11:34.523 INFO:tasks.workunit.client.1.smithi203.stdout:5/735: dwrite d0/f8e [0,4194304] 0 2024-04-12T09:11:34.524 INFO:tasks.workunit.client.1.smithi203.stdout:4/700: mknod d1a/d1d/d69/d76/ce3 0 2024-04-12T09:11:34.525 INFO:tasks.workunit.client.1.smithi203.stdout:4/701: readlink d1a/l32 0 2024-04-12T09:11:34.526 INFO:tasks.workunit.client.1.smithi203.stdout:6/572: truncate d1/d3/f1a 599433 0 2024-04-12T09:11:34.529 INFO:tasks.workunit.client.1.smithi203.stdout:6/573: chown d1/d3/d26/d30/d4a/d6c/d45/d55/d77/f2c 4 1 2024-04-12T09:11:34.538 INFO:tasks.workunit.client.1.smithi203.stdout:1/693: mknod df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/cd4 0 2024-04-12T09:11:34.540 INFO:tasks.workunit.client.1.smithi203.stdout:5/736: symlink d0/d6/d16/d9/d80/df2/d104/d2d/l108 0 2024-04-12T09:11:34.541 INFO:tasks.workunit.client.1.smithi203.stdout:5/737: readlink d0/d6/d11/d18/d2a/l7e 0 2024-04-12T09:11:34.542 INFO:tasks.workunit.client.1.smithi203.stdout:2/658: getdents d0/d19 0 2024-04-12T09:11:34.543 INFO:tasks.workunit.client.1.smithi203.stdout:4/702: stat d1a/d20/d5d/d2c/l7b 0 2024-04-12T09:11:34.543 INFO:tasks.workunit.client.1.smithi203.stdout:4/703: chown d1a/d34/lbb 209403 1 2024-04-12T09:11:34.544 INFO:tasks.workunit.client.1.smithi203.stdout:5/738: read d0/f4 [582142,42371] 0 2024-04-12T09:11:34.544 INFO:tasks.workunit.client.1.smithi203.stdout:2/659: write d0/d14/d23/d3d/f91 [568384,10698] 0 2024-04-12T09:11:34.544 INFO:tasks.workunit.client.1.smithi203.stdout:7/671: rename d0/d4/d1c/d3b/d98 to d0/d15/d2d/df2 0 2024-04-12T09:11:34.545 INFO:tasks.workunit.client.1.smithi203.stdout:5/739: chown d0/d6/d9b/fcf 52433 1 2024-04-12T09:11:34.548 INFO:tasks.workunit.client.1.smithi203.stdout:4/704: dread d1a/d20/d5d/d2c/f51 [0,4194304] 0 2024-04-12T09:11:34.548 INFO:tasks.workunit.client.1.smithi203.stdout:6/574: creat d1/df/fba x:0 0 0 2024-04-12T09:11:34.550 INFO:tasks.workunit.client.1.smithi203.stdout:9/579: dread d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/f5a [0,4194304] 0 2024-04-12T09:11:34.550 INFO:tasks.workunit.client.1.smithi203.stdout:9/580: write d8/d80/fce [3172009,91913] 0 2024-04-12T09:11:34.555 INFO:tasks.workunit.client.1.smithi203.stdout:7/672: fsync d0/d38/d51/fa4 0 2024-04-12T09:11:34.557 INFO:tasks.workunit.client.1.smithi203.stdout:3/589: sync 2024-04-12T09:11:34.557 INFO:tasks.workunit.client.1.smithi203.stdout:0/720: sync 2024-04-12T09:11:34.557 INFO:tasks.workunit.client.1.smithi203.stdout:8/603: link d4/d8/d1c/l4e d4/d8/d74/lc2 0 2024-04-12T09:11:34.558 INFO:tasks.workunit.client.1.smithi203.stdout:5/740: unlink d0/dbd/fd2 0 2024-04-12T09:11:34.558 INFO:tasks.workunit.client.1.smithi203.stdout:8/604: write d4/d8/f77 [4766278,38630] 0 2024-04-12T09:11:34.559 INFO:tasks.workunit.client.1.smithi203.stdout:4/705: mkdir d1a/d34/de4 0 2024-04-12T09:11:34.559 INFO:tasks.workunit.client.1.smithi203.stdout:7/673: dread d0/d4/d1c/d3b/d4c/f94 [0,4194304] 0 2024-04-12T09:11:34.561 INFO:tasks.workunit.client.1.smithi203.stdout:0/721: write d0/dd/d71/d94/d2f/d17/d19/f89 [778913,38319] 0 2024-04-12T09:11:34.561 INFO:tasks.workunit.client.1.smithi203.stdout:1/694: readlink df/d2d/d6f/daa/l78 0 2024-04-12T09:11:34.577 INFO:tasks.workunit.client.1.smithi203.stdout:1/695: dread df/d2d/d6f/d75/d80/d54/d5d/d67/f6b [0,4194304] 0 2024-04-12T09:11:34.577 INFO:tasks.workunit.client.1.smithi203.stdout:7/674: unlink d0/f2 0 2024-04-12T09:11:34.578 INFO:tasks.workunit.client.1.smithi203.stdout:6/575: write d1/d3/d26/d30/d4a/d6c/d45/d55/f71 [61278,68836] 0 2024-04-12T09:11:34.579 INFO:tasks.workunit.client.1.smithi203.stdout:3/590: dread d2/d8/d14/f4f [0,4194304] 0 2024-04-12T09:11:34.580 INFO:tasks.workunit.client.1.smithi203.stdout:5/741: symlink d0/d6/d16/d9/d30/d58/l109 0 2024-04-12T09:11:34.580 INFO:tasks.workunit.client.1.smithi203.stdout:1/696: read df/d2d/d6f/d75/d80/f41 [1540373,87929] 0 2024-04-12T09:11:34.584 INFO:tasks.workunit.client.1.smithi203.stdout:2/660: rename d0/d14/d8a/dca/fdf to d0/d38/fe9 0 2024-04-12T09:11:34.588 INFO:tasks.workunit.client.1.smithi203.stdout:7/675: rmdir d0/d15 39 2024-04-12T09:11:34.590 INFO:tasks.workunit.client.1.smithi203.stdout:6/576: mknod d1/df/cbb 0 2024-04-12T09:11:34.591 INFO:tasks.workunit.client.1.smithi203.stdout:6/577: read d1/d3/f27 [2918561,18901] 0 2024-04-12T09:11:34.591 INFO:tasks.workunit.client.1.smithi203.stdout:0/722: creat d0/d48/d5e/dca/dd6/fe5 x:0 0 0 2024-04-12T09:11:34.594 INFO:tasks.workunit.client.1.smithi203.stdout:1/697: rmdir df/d2d/d6f/d75/d80/d54/d5d/d58/dce 39 2024-04-12T09:11:34.595 INFO:tasks.workunit.client.1.smithi203.stdout:1/698: fsync df/d2d/d6f/d75/d80/d2b/fbc 0 2024-04-12T09:11:34.596 INFO:tasks.workunit.client.1.smithi203.stdout:2/661: symlink d0/d54/d61/db7/lea 0 2024-04-12T09:11:34.609 INFO:tasks.workunit.client.1.smithi203.stdout:4/706: creat d1a/fe5 x:0 0 0 2024-04-12T09:11:34.610 INFO:tasks.workunit.client.1.smithi203.stdout:8/605: creat d4/d8/fc3 x:0 0 0 2024-04-12T09:11:34.611 INFO:tasks.workunit.client.1.smithi203.stdout:0/723: dwrite d0/d48/d5e/d84/fdf [0,4194304] 0 2024-04-12T09:11:34.611 INFO:tasks.workunit.client.1.smithi203.stdout:5/742: mknod d0/d6/d16/d44/dda/c10a 0 2024-04-12T09:11:34.611 INFO:tasks.workunit.client.1.smithi203.stdout:8/606: fdatasync d4/f66 0 2024-04-12T09:11:34.612 INFO:tasks.workunit.client.1.smithi203.stdout:9/581: rename d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/d93 to d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/dca/dd1 0 2024-04-12T09:11:34.613 INFO:tasks.workunit.client.1.smithi203.stdout:1/699: mkdir df/d59/db0/d9b/dd5 0 2024-04-12T09:11:34.615 INFO:tasks.workunit.client.1.smithi203.stdout:7/676: mknod d0/d4/d1c/cf3 0 2024-04-12T09:11:34.619 INFO:tasks.workunit.client.1.smithi203.stdout:3/591: dread d2/d8/d14/d23/d35/d4c/f31 [0,4194304] 0 2024-04-12T09:11:34.621 INFO:tasks.workunit.client.1.smithi203.stdout:3/592: readlink d2/l75 0 2024-04-12T09:11:34.621 INFO:tasks.workunit.client.1.smithi203.stdout:2/662: dwrite d0/d14/d1e/fde [0,4194304] 0 2024-04-12T09:11:34.624 INFO:tasks.workunit.client.1.smithi203.stdout:1/700: dread df/d2d/d6f/d75/d80/d54/d5d/d58/d94/fad [0,4194304] 0 2024-04-12T09:11:34.625 INFO:tasks.workunit.client.1.smithi203.stdout:0/724: dwrite d0/dd/d71/d94/f32 [0,4194304] 0 2024-04-12T09:11:34.625 INFO:tasks.workunit.client.1.smithi203.stdout:3/593: stat d2/d8/d14/d23/d35/d4c/d5c/f9a 0 2024-04-12T09:11:34.628 INFO:tasks.workunit.client.1.smithi203.stdout:9/582: rmdir d8/d12/d3e/d90 39 2024-04-12T09:11:34.636 INFO:tasks.workunit.client.1.smithi203.stdout:3/594: dwrite d2/d8/d14/d1b/f8b [0,4194304] 0 2024-04-12T09:11:34.638 INFO:tasks.workunit.client.1.smithi203.stdout:3/595: dread - d2/d8/d14/d23/d35/d4c/d5c/f9a zero size 2024-04-12T09:11:34.639 INFO:tasks.workunit.client.1.smithi203.stdout:9/583: dwrite d8/d3b/fc9 [0,4194304] 0 2024-04-12T09:11:34.641 INFO:tasks.workunit.client.1.smithi203.stdout:5/743: rename d0/d6/d11/d18/d2a/lf0 to d0/d6/d11/d18/dcc/l10b 0 2024-04-12T09:11:34.642 INFO:tasks.workunit.client.1.smithi203.stdout:9/584: fsync d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/f61 0 2024-04-12T09:11:34.643 INFO:tasks.workunit.client.1.smithi203.stdout:9/585: readlink d8/d12/d23/d41/l64 0 2024-04-12T09:11:34.643 INFO:tasks.workunit.client.1.smithi203.stdout:2/663: mkdir d0/d14/d1e/d57/deb 0 2024-04-12T09:11:34.646 INFO:tasks.workunit.client.1.smithi203.stdout:0/725: symlink d0/dd/d40/le6 0 2024-04-12T09:11:34.647 INFO:tasks.workunit.client.1.smithi203.stdout:1/701: dread df/d2d/f32 [0,4194304] 0 2024-04-12T09:11:34.648 INFO:tasks.workunit.client.1.smithi203.stdout:1/702: read df/d59/f7e [177557,11050] 0 2024-04-12T09:11:34.649 INFO:tasks.workunit.client.1.smithi203.stdout:1/703: write df/d59/f7e [409054,41169] 0 2024-04-12T09:11:34.657 INFO:tasks.workunit.client.1.smithi203.stdout:3/596: fdatasync d2/d8/d14/d23/d35/d91/d81/f84 0 2024-04-12T09:11:34.662 INFO:tasks.workunit.client.1.smithi203.stdout:2/664: creat d0/d14/fec x:0 0 0 2024-04-12T09:11:34.663 INFO:tasks.workunit.client.1.smithi203.stdout:9/586: mknod d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d40/cd2 0 2024-04-12T09:11:34.666 INFO:tasks.workunit.client.1.smithi203.stdout:1/704: unlink df/d2d/d6f/d75/d80/d2b/lbb 0 2024-04-12T09:11:34.666 INFO:tasks.workunit.client.1.smithi203.stdout:8/607: truncate d4/fa8 3866937 0 2024-04-12T09:11:34.667 INFO:tasks.workunit.client.1.smithi203.stdout:7/677: fsync d0/d4/f92 0 2024-04-12T09:11:34.668 INFO:tasks.workunit.client.1.smithi203.stdout:5/744: symlink d0/d6/d11/d18/d1a/l10c 0 2024-04-12T09:11:34.669 INFO:tasks.workunit.client.1.smithi203.stdout:9/587: dwrite d8/d80/fce [0,4194304] 0 2024-04-12T09:11:34.671 INFO:tasks.workunit.client.1.smithi203.stdout:2/665: unlink d0/d38/c6d 0 2024-04-12T09:11:34.671 INFO:tasks.workunit.client.1.smithi203.stdout:2/666: dread - d0/d19/f9b zero size 2024-04-12T09:11:34.672 INFO:tasks.workunit.client.1.smithi203.stdout:0/726: symlink d0/dd/le7 0 2024-04-12T09:11:34.678 INFO:tasks.workunit.client.1.smithi203.stdout:0/727: dwrite d0/dd/d71/d94/d2f/f33 [0,4194304] 0 2024-04-12T09:11:34.680 INFO:tasks.workunit.client.1.smithi203.stdout:1/705: rename l2 to df/d2d/d6f/d75/d80/d54/d5d/d90/ld6 0 2024-04-12T09:11:34.682 INFO:tasks.workunit.client.1.smithi203.stdout:0/728: write d0/dd/d71/d94/d2f/d17/d19/f26 [3736294,55421] 0 2024-04-12T09:11:34.686 INFO:tasks.workunit.client.1.smithi203.stdout:8/608: getdents d4/d8/d1c/d5d/dc0 0 2024-04-12T09:11:34.690 INFO:tasks.workunit.client.1.smithi203.stdout:4/707: sync 2024-04-12T09:11:34.690 INFO:tasks.workunit.client.1.smithi203.stdout:6/578: sync 2024-04-12T09:11:34.691 INFO:tasks.workunit.client.1.smithi203.stdout:9/588: readlink d8/d12/d3e/d90/d60/l8c 0 2024-04-12T09:11:34.694 INFO:tasks.workunit.client.1.smithi203.stdout:5/745: rename d0/d6/d16/d9/f107 to d0/d6/d11/d1e/d4c/f10d 0 2024-04-12T09:11:34.694 INFO:tasks.workunit.client.1.smithi203.stdout:9/589: write d8/d12/d23/d38/f7a [964548,42804] 0 2024-04-12T09:11:34.697 INFO:tasks.workunit.client.1.smithi203.stdout:3/597: dread d2/d8/d14/d23/d35/d4c/d5c/f4d [0,4194304] 0 2024-04-12T09:11:34.697 INFO:tasks.workunit.client.1.smithi203.stdout:9/590: read f5 [1336651,68632] 0 2024-04-12T09:11:34.697 INFO:tasks.workunit.client.1.smithi203.stdout:2/667: mknod d0/d14/d74/ced 0 2024-04-12T09:11:34.699 INFO:tasks.workunit.client.1.smithi203.stdout:0/729: creat d0/d48/d5e/dca/fe8 x:0 0 0 2024-04-12T09:11:34.699 INFO:tasks.workunit.client.1.smithi203.stdout:3/598: read d2/f37 [1680986,51593] 0 2024-04-12T09:11:34.701 INFO:tasks.workunit.client.1.smithi203.stdout:4/708: creat d1a/d21/d22/d2e/d8d/d9b/dbc/dc7/fe6 x:0 0 0 2024-04-12T09:11:34.703 INFO:tasks.workunit.client.1.smithi203.stdout:0/730: dread d0/dd/d71/d94/d2f/d4c/f74 [0,4194304] 0 2024-04-12T09:11:34.704 INFO:tasks.workunit.client.1.smithi203.stdout:1/706: creat df/d59/db0/d9b/dd5/fd7 x:0 0 0 2024-04-12T09:11:34.705 INFO:tasks.workunit.client.1.smithi203.stdout:0/731: write d0/dd/d71/fb7 [129851,13144] 0 2024-04-12T09:11:34.705 INFO:tasks.workunit.client.1.smithi203.stdout:1/707: chown df/d2d/d6f/d75/d80/d2b/c5a 998 1 2024-04-12T09:11:34.706 INFO:tasks.workunit.client.1.smithi203.stdout:0/732: stat d0/dd/d71/d94/d2f/d17/dc9 0 2024-04-12T09:11:34.708 INFO:tasks.workunit.client.1.smithi203.stdout:5/746: symlink d0/d6/d16/d9/d30/d58/d74/l10e 0 2024-04-12T09:11:34.708 INFO:tasks.workunit.client.1.smithi203.stdout:2/668: symlink d0/d14/d1e/d57/d95/lee 0 2024-04-12T09:11:34.709 INFO:tasks.workunit.client.1.smithi203.stdout:7/678: dread d0/d34/d7c/f80 [0,4194304] 0 2024-04-12T09:11:34.709 INFO:tasks.workunit.client.1.smithi203.stdout:2/669: dread - d0/d19/f9b zero size 2024-04-12T09:11:34.714 INFO:tasks.workunit.client.1.smithi203.stdout:8/609: dread d4/d8/d1c/f30 [0,4194304] 0 2024-04-12T09:11:34.718 INFO:tasks.workunit.client.1.smithi203.stdout:9/591: mknod d8/d12/d3e/dc1/cd3 0 2024-04-12T09:11:34.722 INFO:tasks.workunit.client.1.smithi203.stdout:6/579: write d1/d3/d5b/d8c/f23 [565396,121314] 0 2024-04-12T09:11:34.722 INFO:tasks.workunit.client.1.smithi203.stdout:5/747: dread d0/d6/d11/d38/f7a [0,4194304] 0 2024-04-12T09:11:34.724 INFO:tasks.workunit.client.1.smithi203.stdout:6/580: read d1/d3/d26/d30/d4a/d6c/f40 [808328,32203] 0 2024-04-12T09:11:34.725 INFO:tasks.workunit.client.1.smithi203.stdout:3/599: creat d2/d8/d14/d23/d35/d4c/d5c/dc3/fc4 x:0 0 0 2024-04-12T09:11:34.726 INFO:tasks.workunit.client.1.smithi203.stdout:6/581: truncate d1/d3/f8f 305637 0 2024-04-12T09:11:34.726 INFO:tasks.workunit.client.1.smithi203.stdout:3/600: chown d2/c3f 153735 1 2024-04-12T09:11:34.727 INFO:tasks.workunit.client.1.smithi203.stdout:4/709: creat d1a/d1d/d69/d76/dd6/fe7 x:0 0 0 2024-04-12T09:11:34.728 INFO:tasks.workunit.client.1.smithi203.stdout:8/610: symlink d4/d8/d74/d78/lc4 0 2024-04-12T09:11:34.730 INFO:tasks.workunit.client.1.smithi203.stdout:6/582: dread d1/df/f19 [0,4194304] 0 2024-04-12T09:11:34.732 INFO:tasks.workunit.client.1.smithi203.stdout:3/601: dwrite d2/d64/d8d/fae [0,4194304] 0 2024-04-12T09:11:34.733 INFO:tasks.workunit.client.1.smithi203.stdout:3/602: dread - d2/d8/d14/d1b/d95/d92/faf zero size 2024-04-12T09:11:34.738 INFO:tasks.workunit.client.1.smithi203.stdout:5/748: readlink d0/d5d/le7 0 2024-04-12T09:11:34.739 INFO:tasks.workunit.client.1.smithi203.stdout:1/708: truncate df/f83 5559229 0 2024-04-12T09:11:34.739 INFO:tasks.workunit.client.1.smithi203.stdout:2/670: link d0/d14/d1e/d2a/f60 d0/d14/d1e/d57/da1/fef 0 2024-04-12T09:11:34.741 INFO:tasks.workunit.client.1.smithi203.stdout:3/603: dwrite d2/d8/d14/d1b/d2f/f32 [0,4194304] 0 2024-04-12T09:11:34.741 INFO:tasks.workunit.client.1.smithi203.stdout:1/709: write df/d2d/d6f/d75/d80/d2b/fbc [525621,72437] 0 2024-04-12T09:11:34.742 INFO:tasks.workunit.client.1.smithi203.stdout:4/710: symlink d1a/d1d/d69/d76/dd6/le8 0 2024-04-12T09:11:34.745 INFO:tasks.workunit.client.1.smithi203.stdout:9/592: symlink d8/d12/d23/ld4 0 2024-04-12T09:11:34.745 INFO:tasks.workunit.client.1.smithi203.stdout:3/604: chown d2/d8/d14/d23/f42 131082 1 2024-04-12T09:11:34.746 INFO:tasks.workunit.client.1.smithi203.stdout:5/749: symlink d0/d6/d16/d44/l10f 0 2024-04-12T09:11:34.757 INFO:tasks.workunit.client.1.smithi203.stdout:6/583: dread d1/d3/f2d [0,4194304] 0 2024-04-12T09:11:34.758 INFO:tasks.workunit.client.1.smithi203.stdout:8/611: dwrite d4/d8/f42 [8388608,4194304] 0 2024-04-12T09:11:34.759 INFO:tasks.workunit.client.1.smithi203.stdout:2/671: rmdir d0/d14 39 2024-04-12T09:11:34.762 INFO:tasks.workunit.client.1.smithi203.stdout:1/710: dwrite df/d2d/d6f/fac [0,4194304] 0 2024-04-12T09:11:34.764 INFO:tasks.workunit.client.1.smithi203.stdout:9/593: rmdir d8/d12/d23/d38/d8a 39 2024-04-12T09:11:34.764 INFO:tasks.workunit.client.1.smithi203.stdout:4/711: dwrite d1a/d21/d60/f89 [0,4194304] 0 2024-04-12T09:11:34.766 INFO:tasks.workunit.client.1.smithi203.stdout:5/750: rename d0/d6/fb2 to d0/d6/d11/d18/d2a/dc8/f110 0 2024-04-12T09:11:34.769 INFO:tasks.workunit.client.1.smithi203.stdout:7/679: getdents d0/d15/d89 0 2024-04-12T09:11:34.772 INFO:tasks.workunit.client.1.smithi203.stdout:3/605: dwrite d2/d8/d14/d23/d35/d4c/fc2 [0,4194304] 0 2024-04-12T09:11:34.775 INFO:tasks.workunit.client.1.smithi203.stdout:2/672: chown d0/d3/d8e/dcc/fe5 5087420 1 2024-04-12T09:11:34.776 INFO:tasks.workunit.client.1.smithi203.stdout:6/584: truncate d1/df/f18 5159672 0 2024-04-12T09:11:34.778 INFO:tasks.workunit.client.1.smithi203.stdout:7/680: chown d0/d38/d79/cb4 14364430 1 2024-04-12T09:11:34.779 INFO:tasks.workunit.client.1.smithi203.stdout:4/712: rename d1a/d21/d22/f79 to d1a/d21/d60/daa/dc5/ddc/fe9 0 2024-04-12T09:11:34.782 INFO:tasks.workunit.client.1.smithi203.stdout:0/733: sync 2024-04-12T09:11:34.782 INFO:tasks.workunit.client.1.smithi203.stdout:5/751: creat d0/d6/d11/d18/d1a/d23/f111 x:0 0 0 2024-04-12T09:11:34.783 INFO:tasks.workunit.client.1.smithi203.stdout:4/713: dread d1a/d21/f67 [0,4194304] 0 2024-04-12T09:11:34.787 INFO:tasks.workunit.client.1.smithi203.stdout:8/612: dwrite d4/f2a [4194304,4194304] 0 2024-04-12T09:11:34.788 INFO:tasks.workunit.client.1.smithi203.stdout:9/594: unlink d8/d12/d23/d38/d8a/d97/d9e/d74/c96 0 2024-04-12T09:11:34.789 INFO:tasks.workunit.client.1.smithi203.stdout:8/613: truncate d4/d8/d1c/d5d/fad 779688 0 2024-04-12T09:11:34.792 INFO:tasks.workunit.client.1.smithi203.stdout:6/585: mkdir d1/df/d65/dbc 0 2024-04-12T09:11:34.794 INFO:tasks.workunit.client.1.smithi203.stdout:5/752: read - d0/d6/d11/f6c zero size 2024-04-12T09:11:34.795 INFO:tasks.workunit.client.1.smithi203.stdout:0/734: rename d0/dd/d71/d94/l29 to d0/dd/d71/d94/d2f/dc6/le9 0 2024-04-12T09:11:34.803 INFO:tasks.workunit.client.1.smithi203.stdout:2/673: dwrite d0/d54/f69 [0,4194304] 0 2024-04-12T09:11:34.804 INFO:tasks.workunit.client.1.smithi203.stdout:1/711: getdents df/d2d/d6f/d8d 0 2024-04-12T09:11:34.808 INFO:tasks.workunit.client.1.smithi203.stdout:3/606: dwrite d2/d8/d14/d23/d35/d4c/d5c/f38 [0,4194304] 0 2024-04-12T09:11:34.809 INFO:tasks.workunit.client.1.smithi203.stdout:3/607: fsync d2/d8/d14/d23/d35/d4c/d5c/d55/f66 0 2024-04-12T09:11:34.810 INFO:tasks.workunit.client.1.smithi203.stdout:5/753: rmdir d0/d9a 39 2024-04-12T09:11:34.811 INFO:tasks.workunit.client.1.smithi203.stdout:3/608: chown d2/d8/d14/d23/d36/f4b 30339839 1 2024-04-12T09:11:34.812 INFO:tasks.workunit.client.1.smithi203.stdout:5/754: readlink d0/d6/d11/d18/dcc/le8 0 2024-04-12T09:11:34.815 INFO:tasks.workunit.client.1.smithi203.stdout:0/735: rmdir d0/dd/d71/d94 39 2024-04-12T09:11:34.819 INFO:tasks.workunit.client.1.smithi203.stdout:9/595: mknod d8/d12/d23/d38/cd5 0 2024-04-12T09:11:34.822 INFO:tasks.workunit.client.1.smithi203.stdout:6/586: dread d1/d3/d26/d30/d4a/d6c/d45/f49 [0,4194304] 0 2024-04-12T09:11:34.822 INFO:tasks.workunit.client.1.smithi203.stdout:4/714: write d1a/d20/fa4 [461189,94122] 0 2024-04-12T09:11:34.823 INFO:tasks.workunit.client.1.smithi203.stdout:6/587: chown d1/d3/f39 14521291 1 2024-04-12T09:11:34.828 INFO:tasks.workunit.client.1.smithi203.stdout:4/715: dwrite d1a/d20/fab [0,4194304] 0 2024-04-12T09:11:34.830 INFO:tasks.workunit.client.1.smithi203.stdout:3/609: creat d2/d51/fc5 x:0 0 0 2024-04-12T09:11:34.833 INFO:tasks.workunit.client.1.smithi203.stdout:5/755: mknod d0/d6/d11/d4a/c112 0 2024-04-12T09:11:34.834 INFO:tasks.workunit.client.1.smithi203.stdout:5/756: readlink d0/d6/d16/d9/d80/df2/d104/d2d/l108 0 2024-04-12T09:11:34.835 INFO:tasks.workunit.client.1.smithi203.stdout:0/736: write d0/dd/d71/d94/f5f [2131360,109850] 0 2024-04-12T09:11:34.836 INFO:tasks.workunit.client.1.smithi203.stdout:7/681: getdents d0/d38/d51 0 2024-04-12T09:11:34.836 INFO:tasks.workunit.client.1.smithi203.stdout:8/614: write d4/d8/f24 [461276,86464] 0 2024-04-12T09:11:34.837 INFO:tasks.workunit.client.1.smithi203.stdout:7/682: chown d0/d34 56118 1 2024-04-12T09:11:34.845 INFO:tasks.workunit.client.1.smithi203.stdout:5/757: stat d0/d6/d16/d44/cad 0 2024-04-12T09:11:34.847 INFO:tasks.workunit.client.1.smithi203.stdout:0/737: symlink d0/d59/d5d/lea 0 2024-04-12T09:11:34.851 INFO:tasks.workunit.client.1.smithi203.stdout:4/716: creat d1a/d21/d22/d2e/d8d/d9b/dd8/fea x:0 0 0 2024-04-12T09:11:34.852 INFO:tasks.workunit.client.1.smithi203.stdout:2/674: truncate d0/d54/f69 586655 0 2024-04-12T09:11:34.853 INFO:tasks.workunit.client.1.smithi203.stdout:5/758: unlink d0/d6/d11/d1e/d4c/fa1 0 2024-04-12T09:11:34.855 INFO:tasks.workunit.client.1.smithi203.stdout:0/738: dwrite d0/dd/d71/d94/d2f/d17/d19/d6f/dcb/fd2 [0,4194304] 0 2024-04-12T09:11:34.859 INFO:tasks.workunit.client.1.smithi203.stdout:1/712: getdents df/d2d/d6f/d75/d80/d54/d5d/d90/dc7 0 2024-04-12T09:11:34.860 INFO:tasks.workunit.client.1.smithi203.stdout:3/610: dread d2/d8/d14/d1b/f48 [4194304,4194304] 0 2024-04-12T09:11:34.861 INFO:tasks.workunit.client.1.smithi203.stdout:4/717: dwrite fb [0,4194304] 0 2024-04-12T09:11:34.861 INFO:tasks.workunit.client.1.smithi203.stdout:8/615: dread d4/d8/d74/d78/f2e [0,4194304] 0 2024-04-12T09:11:34.863 INFO:tasks.workunit.client.1.smithi203.stdout:8/616: chown d4/d8/d74/d78/d53 60096 1 2024-04-12T09:11:34.864 INFO:tasks.workunit.client.1.smithi203.stdout:8/617: readlink d4/d8/d81/db4/lb8 0 2024-04-12T09:11:34.869 INFO:tasks.workunit.client.1.smithi203.stdout:5/759: rmdir d0/d6/d16/d9/d30/d58/d74/d88/dbf 39 2024-04-12T09:11:34.869 INFO:tasks.workunit.client.1.smithi203.stdout:8/618: dwrite d4/f4b [0,4194304] 0 2024-04-12T09:11:34.871 INFO:tasks.workunit.client.1.smithi203.stdout:5/760: stat d0/d6/d11/d1e/d4c/d48/de4 0 2024-04-12T09:11:34.871 INFO:tasks.workunit.client.1.smithi203.stdout:8/619: chown d4/d8/d74/d78/c22 0 1 2024-04-12T09:11:34.872 INFO:tasks.workunit.client.1.smithi203.stdout:8/620: chown d4/c3f 31 1 2024-04-12T09:11:34.873 INFO:tasks.workunit.client.1.smithi203.stdout:0/739: creat d0/d48/d5e/d84/feb x:0 0 0 2024-04-12T09:11:34.873 INFO:tasks.workunit.client.1.smithi203.stdout:8/621: dread - d4/d8/fc3 zero size 2024-04-12T09:11:34.873 INFO:tasks.workunit.client.1.smithi203.stdout:6/588: link d1/df/f18 d1/df/d65/dbc/fbd 0 2024-04-12T09:11:34.875 INFO:tasks.workunit.client.1.smithi203.stdout:6/589: write d1/d3/f8f [1047988,604] 0 2024-04-12T09:11:34.875 INFO:tasks.workunit.client.1.smithi203.stdout:1/713: fsync df/d2d/d6f/d75/d80/f41 0 2024-04-12T09:11:34.879 INFO:tasks.workunit.client.1.smithi203.stdout:4/718: rename d1a/d21/d22/d2e/f6c to d1a/d2b/feb 0 2024-04-12T09:11:34.881 INFO:tasks.workunit.client.1.smithi203.stdout:7/683: dwrite d0/d4/d54/d75/f9a [0,4194304] 0 2024-04-12T09:11:34.882 INFO:tasks.workunit.client.1.smithi203.stdout:4/719: write d1a/d21/d22/d2e/d8b/f99 [730823,122708] 0 2024-04-12T09:11:34.883 INFO:tasks.workunit.client.1.smithi203.stdout:2/675: mknod d0/d14/d1e/d57/cf0 0 2024-04-12T09:11:34.889 INFO:tasks.workunit.client.1.smithi203.stdout:8/622: fdatasync d4/d8/d74/d78/d53/f6b 0 2024-04-12T09:11:34.890 INFO:tasks.workunit.client.1.smithi203.stdout:3/611: dread d2/d8/d14/d23/d35/d91/f9b [0,4194304] 0 2024-04-12T09:11:34.898 INFO:tasks.workunit.client.1.smithi203.stdout:7/684: fsync d0/d4/d1c/d3b/d4c/fee 0 2024-04-12T09:11:34.899 INFO:tasks.workunit.client.1.smithi203.stdout:7/685: fsync d0/d4/d1c/d3b/d4c/f55 0 2024-04-12T09:11:34.900 INFO:tasks.workunit.client.1.smithi203.stdout:7/686: chown d0/d15/d2d/d5e/l6a 326 1 2024-04-12T09:11:34.901 INFO:tasks.workunit.client.1.smithi203.stdout:7/687: stat d0/d4/d1c/d5b/dbf/de1/fe7 0 2024-04-12T09:11:34.902 INFO:tasks.workunit.client.1.smithi203.stdout:7/688: write d0/d4/d1c/f9d [804486,44717] 0 2024-04-12T09:11:34.902 INFO:tasks.workunit.client.1.smithi203.stdout:4/720: unlink d1a/d21/d60/d68/f9f 0 2024-04-12T09:11:34.905 INFO:tasks.workunit.client.1.smithi203.stdout:5/761: unlink d0/d6/d11/d18/d1a/l7d 0 2024-04-12T09:11:34.907 INFO:tasks.workunit.client.1.smithi203.stdout:3/612: symlink d2/d8/d14/d23/d35/lc6 0 2024-04-12T09:11:34.907 INFO:tasks.workunit.client.1.smithi203.stdout:9/596: sync 2024-04-12T09:11:34.908 INFO:tasks.workunit.client.1.smithi203.stdout:9/597: chown d8/d12/d23/db3/lc5 356027003 1 2024-04-12T09:11:34.908 INFO:tasks.workunit.client.1.smithi203.stdout:3/613: chown d2/d8/d14/d23/d35/d91/fad 22793998 1 2024-04-12T09:11:34.909 INFO:tasks.workunit.client.1.smithi203.stdout:3/614: chown d2/d8/d14/d23/l3c 21384556 1 2024-04-12T09:11:34.910 INFO:tasks.workunit.client.1.smithi203.stdout:6/590: unlink d1/df/d65/dbc/fbd 0 2024-04-12T09:11:34.921 INFO:tasks.workunit.client.1.smithi203.stdout:2/676: mknod d0/d67/d86/dd9/cf1 0 2024-04-12T09:11:34.924 INFO:tasks.workunit.client.1.smithi203.stdout:7/689: mkdir d0/d15/d89/df4 0 2024-04-12T09:11:34.926 INFO:tasks.workunit.client.1.smithi203.stdout:5/762: truncate d0/d6/f22 671668 0 2024-04-12T09:11:34.928 INFO:tasks.workunit.client.1.smithi203.stdout:0/740: link d0/dd/d71/d94/d2f/d17/d19/d6f/ld7 d0/dd/d71/d94/lec 0 2024-04-12T09:11:34.929 INFO:tasks.workunit.client.1.smithi203.stdout:0/741: write d0/d59/f87 [4447128,59888] 0 2024-04-12T09:11:34.931 INFO:tasks.workunit.client.1.smithi203.stdout:3/615: unlink d2/d8/d14/f4f 0 2024-04-12T09:11:34.933 INFO:tasks.workunit.client.1.smithi203.stdout:6/591: symlink d1/df/d65/dbc/lbe 0 2024-04-12T09:11:34.934 INFO:tasks.workunit.client.1.smithi203.stdout:6/592: stat d1/d3/d26/d30/fa9 0 2024-04-12T09:11:34.934 INFO:tasks.workunit.client.1.smithi203.stdout:4/721: symlink d1a/d1d/d9c/lec 0 2024-04-12T09:11:34.936 INFO:tasks.workunit.client.1.smithi203.stdout:7/690: creat d0/d34/d7c/ff5 x:0 0 0 2024-04-12T09:11:34.936 INFO:tasks.workunit.client.1.smithi203.stdout:3/616: read d2/d8/d14/d23/d35/d91/fad [95249,24941] 0 2024-04-12T09:11:34.938 INFO:tasks.workunit.client.1.smithi203.stdout:5/763: mknod d0/d6/d16/d9/d80/df2/c113 0 2024-04-12T09:11:34.943 INFO:tasks.workunit.client.1.smithi203.stdout:0/742: unlink d0/dd/d71/d94/d2f/d17/d19/f3b 0 2024-04-12T09:11:34.947 INFO:tasks.workunit.client.1.smithi203.stdout:1/714: dwrite df/d2d/d6f/d75/d80/d2b/f52 [0,4194304] 0 2024-04-12T09:11:34.948 INFO:tasks.workunit.client.1.smithi203.stdout:2/677: mknod d0/d14/d1e/cf2 0 2024-04-12T09:11:34.949 INFO:tasks.workunit.client.1.smithi203.stdout:6/593: rmdir d1/df/d65/dbc 39 2024-04-12T09:11:34.951 INFO:tasks.workunit.client.1.smithi203.stdout:6/594: write d1/d3/d26/d30/d4a/d6c/d45/d55/d77/f93 [829475,118553] 0 2024-04-12T09:11:34.952 INFO:tasks.workunit.client.1.smithi203.stdout:7/691: rmdir d0/d38 39 2024-04-12T09:11:34.953 INFO:tasks.workunit.client.1.smithi203.stdout:6/595: write d1/df/d65/f86 [183721,113060] 0 2024-04-12T09:11:34.953 INFO:tasks.workunit.client.1.smithi203.stdout:3/617: symlink d2/d64/lc7 0 2024-04-12T09:11:34.955 INFO:tasks.workunit.client.1.smithi203.stdout:3/618: write d2/d8/d14/d23/d35/d4c/fb6 [376373,65151] 0 2024-04-12T09:11:34.957 INFO:tasks.workunit.client.1.smithi203.stdout:5/764: dread - d0/d6/d16/d9/fa5 zero size 2024-04-12T09:11:34.962 INFO:tasks.workunit.client.1.smithi203.stdout:0/743: unlink d0/dd/d71/d94/d2f/dc6/lda 0 2024-04-12T09:11:34.964 INFO:tasks.workunit.client.1.smithi203.stdout:1/715: creat df/d2d/d6f/d8d/da7/fd8 x:0 0 0 2024-04-12T09:11:34.967 INFO:tasks.workunit.client.1.smithi203.stdout:7/692: dread - d0/d38/d51/fcb zero size 2024-04-12T09:11:34.968 INFO:tasks.workunit.client.1.smithi203.stdout:7/693: read - d0/d34/feb zero size 2024-04-12T09:11:34.968 INFO:tasks.workunit.client.1.smithi203.stdout:3/619: truncate d2/d8/d14/d23/d35/d4c/f31 4697468 0 2024-04-12T09:11:34.971 INFO:tasks.workunit.client.1.smithi203.stdout:0/744: rename d0/d59/d5d/c7c to d0/d48/d5e/d84/ced 0 2024-04-12T09:11:34.974 INFO:tasks.workunit.client.1.smithi203.stdout:2/678: creat d0/d3/d8f/ff3 x:0 0 0 2024-04-12T09:11:34.976 INFO:tasks.workunit.client.1.smithi203.stdout:7/694: dwrite d0/d15/d2d/f4d [4194304,4194304] 0 2024-04-12T09:11:34.977 INFO:tasks.workunit.client.1.smithi203.stdout:3/620: dwrite d2/d8/d14/fac [0,4194304] 0 2024-04-12T09:11:34.977 INFO:tasks.workunit.client.1.smithi203.stdout:7/695: stat d0/d4/d54/d75/f9b 0 2024-04-12T09:11:34.978 INFO:tasks.workunit.client.1.smithi203.stdout:0/745: symlink d0/dd/d71/d94/d2f/d17/d19/d6f/d78/lee 0 2024-04-12T09:11:34.978 INFO:tasks.workunit.client.1.smithi203.stdout:7/696: chown d0/d4/d53/fa5 64986 1 2024-04-12T09:11:34.978 INFO:tasks.workunit.client.1.smithi203.stdout:2/679: mkdir d0/d3/d8e/df4 0 2024-04-12T09:11:34.981 INFO:tasks.workunit.client.1.smithi203.stdout:0/746: read d0/f2c [3952693,79298] 0 2024-04-12T09:11:34.982 INFO:tasks.workunit.client.1.smithi203.stdout:3/621: creat d2/d64/d8d/fc8 x:0 0 0 2024-04-12T09:11:34.985 INFO:tasks.workunit.client.1.smithi203.stdout:2/680: truncate d0/d14/d23/f50 1325532 0 2024-04-12T09:11:34.986 INFO:tasks.workunit.client.1.smithi203.stdout:9/598: truncate d8/d12/d3e/d90/f5b 994975 0 2024-04-12T09:11:34.990 INFO:tasks.workunit.client.1.smithi203.stdout:4/722: write d1a/d21/d22/d2e/d78/fb3 [347970,32583] 0 2024-04-12T09:11:34.990 INFO:tasks.workunit.client.1.smithi203.stdout:2/681: fdatasync d0/d38/fe9 0 2024-04-12T09:11:34.991 INFO:tasks.workunit.client.1.smithi203.stdout:9/599: dwrite d8/d12/f83 [0,4194304] 0 2024-04-12T09:11:34.997 INFO:tasks.workunit.client.1.smithi203.stdout:9/600: dread d8/d12/d23/d38/d8a/d97/d9e/d74/f7f [0,4194304] 0 2024-04-12T09:11:35.002 INFO:tasks.workunit.client.1.smithi203.stdout:0/747: creat d0/d48/fef x:0 0 0 2024-04-12T09:11:35.004 INFO:tasks.workunit.client.1.smithi203.stdout:1/716: dwrite df/d2d/d6f/d75/d80/d54/f3b [0,4194304] 0 2024-04-12T09:11:35.004 INFO:tasks.workunit.client.1.smithi203.stdout:0/748: dread - d0/dd/d71/d94/d2f/d17/d19/f9d zero size 2024-04-12T09:11:35.006 INFO:tasks.workunit.client.1.smithi203.stdout:4/723: creat d1a/d21/d60/d68/db9/fed x:0 0 0 2024-04-12T09:11:35.006 INFO:tasks.workunit.client.1.smithi203.stdout:1/717: read - df/d2d/d6f/d75/d80/d54/d5d/d58/f92 zero size 2024-04-12T09:11:35.006 INFO:tasks.workunit.client.1.smithi203.stdout:9/601: rmdir d8/d12/d23/d41 39 2024-04-12T09:11:35.007 INFO:tasks.workunit.client.1.smithi203.stdout:2/682: symlink d0/d14/d1e/d2a/dcd/de0/lf5 0 2024-04-12T09:11:35.008 INFO:tasks.workunit.client.1.smithi203.stdout:0/749: write d0/dd/d71/d94/d2f/d17/d19/d6f/d78/f8a [1008261,56186] 0 2024-04-12T09:11:35.008 INFO:tasks.workunit.client.1.smithi203.stdout:1/718: write df/f33 [2794045,36281] 0 2024-04-12T09:11:35.012 INFO:tasks.workunit.client.1.smithi203.stdout:3/622: link d2/d8/f33 d2/d8/d14/d1b/d2f/fc9 0 2024-04-12T09:11:35.014 INFO:tasks.workunit.client.1.smithi203.stdout:7/697: dread d0/d4/f92 [4194304,4194304] 0 2024-04-12T09:11:35.016 INFO:tasks.workunit.client.1.smithi203.stdout:4/724: dwrite d1a/d20/fab [0,4194304] 0 2024-04-12T09:11:35.016 INFO:tasks.workunit.client.1.smithi203.stdout:4/725: readlink l18 0 2024-04-12T09:11:35.018 INFO:tasks.workunit.client.1.smithi203.stdout:2/683: rmdir d0/d67 39 2024-04-12T09:11:35.018 INFO:tasks.workunit.client.1.smithi203.stdout:7/698: truncate d0/d4/d1c/d5b/dbf/dc5/fcc 893997 0 2024-04-12T09:11:35.019 INFO:tasks.workunit.client.1.smithi203.stdout:2/684: chown d0/d3/c31 688 1 2024-04-12T09:11:35.020 INFO:tasks.workunit.client.1.smithi203.stdout:0/750: symlink d0/dd/d71/d94/d2f/d34/d98/lf0 0 2024-04-12T09:11:35.024 INFO:tasks.workunit.client.1.smithi203.stdout:4/726: chown d1a/d1d/d69/cd7 34358 1 2024-04-12T09:11:35.025 INFO:tasks.workunit.client.1.smithi203.stdout:7/699: write d0/f26 [1528604,111401] 0 2024-04-12T09:11:35.027 INFO:tasks.workunit.client.1.smithi203.stdout:9/602: symlink d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/ld6 0 2024-04-12T09:11:35.030 INFO:tasks.workunit.client.1.smithi203.stdout:9/603: dread d8/d12/d23/d38/d8a/d97/d9e/d74/f7e [0,4194304] 0 2024-04-12T09:11:35.036 INFO:tasks.workunit.client.1.smithi203.stdout:2/685: mkdir d0/d67/d86/df6 0 2024-04-12T09:11:35.038 INFO:tasks.workunit.client.1.smithi203.stdout:7/700: truncate d0/d38/d79/fbd 682225 0 2024-04-12T09:11:35.041 INFO:tasks.workunit.client.1.smithi203.stdout:0/751: symlink d0/dd/d5b/d90/dd3/lf1 0 2024-04-12T09:11:35.042 INFO:tasks.workunit.client.1.smithi203.stdout:1/719: dread df/d2d/d6f/d75/d80/f41 [0,4194304] 0 2024-04-12T09:11:35.043 INFO:tasks.workunit.client.1.smithi203.stdout:9/604: read - d8/d12/d23/d85/f46 zero size 2024-04-12T09:11:35.043 INFO:tasks.workunit.client.1.smithi203.stdout:1/720: chown df/d2d/d6f/daa/f77 1 1 2024-04-12T09:11:35.044 INFO:tasks.workunit.client.1.smithi203.stdout:1/721: chown df/d2d/d6f/d75/d80/d54/d5d/d58/d94/la1 0 1 2024-04-12T09:11:35.045 INFO:tasks.workunit.client.1.smithi203.stdout:2/686: rmdir d0/d3/d8f 39 2024-04-12T09:11:35.047 INFO:tasks.workunit.client.1.smithi203.stdout:7/701: stat d0/d15/d2d/d5e/l8a 0 2024-04-12T09:11:35.054 INFO:tasks.workunit.client.1.smithi203.stdout:0/752: creat d0/d48/d5e/dca/ff2 x:0 0 0 2024-04-12T09:11:35.057 INFO:tasks.workunit.client.1.smithi203.stdout:8/623: sync 2024-04-12T09:11:35.058 INFO:tasks.workunit.client.1.smithi203.stdout:3/623: rename d2/d8/f52 to d2/d8/d14/d1b/d95/fca 0 2024-04-12T09:11:35.067 INFO:tasks.workunit.client.1.smithi203.stdout:0/753: symlink d0/dd/d71/d94/d2f/d17/d19/lf3 0 2024-04-12T09:11:35.068 INFO:tasks.workunit.client.1.smithi203.stdout:7/702: read d0/d15/f63 [75603,8688] 0 2024-04-12T09:11:35.069 INFO:tasks.workunit.client.1.smithi203.stdout:8/624: creat d4/d8/d74/da6/fc5 x:0 0 0 2024-04-12T09:11:35.074 INFO:tasks.workunit.client.1.smithi203.stdout:2/687: rename d0/d14/d1e/f48 to d0/d19/ff7 0 2024-04-12T09:11:35.077 INFO:tasks.workunit.client.1.smithi203.stdout:4/727: getdents d1a 0 2024-04-12T09:11:35.083 INFO:tasks.workunit.client.1.smithi203.stdout:0/754: creat d0/dd/d71/d94/d2f/dc6/ff4 x:0 0 0 2024-04-12T09:11:35.084 INFO:tasks.workunit.client.1.smithi203.stdout:8/625: dread d4/d8/d74/d78/f6d [0,4194304] 0 2024-04-12T09:11:35.084 INFO:tasks.workunit.client.1.smithi203.stdout:0/755: stat d0/dd/d71/d94/c2a 0 2024-04-12T09:11:35.084 INFO:tasks.workunit.client.1.smithi203.stdout:8/626: chown d4/d8/l9e 2 1 2024-04-12T09:11:35.091 INFO:tasks.workunit.client.1.smithi203.stdout:3/624: dread - d2/d8/d14/d23/d35/d4c/d5c/d55/f68 zero size 2024-04-12T09:11:35.093 INFO:tasks.workunit.client.1.smithi203.stdout:4/728: rename d1a/d1d/d69/d76/dd6/fe7 to d1a/d21/d22/d2e/d8d/d9b/ddf/fee 0 2024-04-12T09:11:35.095 INFO:tasks.workunit.client.1.smithi203.stdout:1/722: creat df/d2d/d6f/d75/d80/d54/d5d/d58/fd9 x:0 0 0 2024-04-12T09:11:35.097 INFO:tasks.workunit.client.1.smithi203.stdout:7/703: mknod d0/d15/d89/df4/cf6 0 2024-04-12T09:11:35.097 INFO:tasks.workunit.client.1.smithi203.stdout:7/704: read - d0/d4/d54/d75/fbc zero size 2024-04-12T09:11:35.098 INFO:tasks.workunit.client.1.smithi203.stdout:7/705: truncate d0/d34/d7c/fe9 990871 0 2024-04-12T09:11:35.101 INFO:tasks.workunit.client.1.smithi203.stdout:2/688: creat d0/dd3/ff8 x:0 0 0 2024-04-12T09:11:35.106 INFO:tasks.workunit.client.1.smithi203.stdout:4/729: mknod d1a/d21/d22/d2e/d8d/d9b/dbc/dc7/cef 0 2024-04-12T09:11:35.106 INFO:tasks.workunit.client.1.smithi203.stdout:3/625: dread d2/d8/d14/d23/d36/f4b [0,4194304] 0 2024-04-12T09:11:35.112 INFO:tasks.workunit.client.1.smithi203.stdout:7/706: creat d0/d4/d54/d75/dc0/ff7 x:0 0 0 2024-04-12T09:11:35.112 INFO:tasks.workunit.client.1.smithi203.stdout:3/626: dwrite d2/d8/d14/d23/d35/d4c/d5c/f34 [0,4194304] 0 2024-04-12T09:11:35.116 INFO:tasks.workunit.client.1.smithi203.stdout:1/723: dread df/f16 [0,4194304] 0 2024-04-12T09:11:35.117 INFO:tasks.workunit.client.1.smithi203.stdout:2/689: creat d0/d14/d8a/ff9 x:0 0 0 2024-04-12T09:11:35.120 INFO:tasks.workunit.client.1.smithi203.stdout:4/730: dread d1a/d21/d22/d2e/d8d/d9b/fae [4194304,4194304] 0 2024-04-12T09:11:35.122 INFO:tasks.workunit.client.1.smithi203.stdout:0/756: creat d0/ff5 x:0 0 0 2024-04-12T09:11:35.124 INFO:tasks.workunit.client.1.smithi203.stdout:0/757: dread d0/dd/d71/d94/d2f/f8f [0,4194304] 0 2024-04-12T09:11:35.125 INFO:tasks.workunit.client.1.smithi203.stdout:3/627: mkdir d2/d8/d14/d45/dcb 0 2024-04-12T09:11:35.125 INFO:tasks.workunit.client.1.smithi203.stdout:3/628: stat d2/d8/d14/d45/f7f 0 2024-04-12T09:11:35.126 INFO:tasks.workunit.client.1.smithi203.stdout:8/627: creat d4/d8/d1c/d48/fc6 x:0 0 0 2024-04-12T09:11:35.128 INFO:tasks.workunit.client.1.smithi203.stdout:1/724: write df/f2a [4014774,62048] 0 2024-04-12T09:11:35.131 INFO:tasks.workunit.client.1.smithi203.stdout:7/707: symlink d0/lf8 0 2024-04-12T09:11:35.132 INFO:tasks.workunit.client.1.smithi203.stdout:7/708: write d0/d15/d2d/d5e/d8c/f81 [4775074,73987] 0 2024-04-12T09:11:35.133 INFO:tasks.workunit.client.1.smithi203.stdout:0/758: creat d0/dd/d71/d94/d2f/d34/ff6 x:0 0 0 2024-04-12T09:11:35.133 INFO:tasks.workunit.client.1.smithi203.stdout:3/629: dwrite d2/d8/d14/d23/d35/d4c/d5c/dc3/fc4 [0,4194304] 0 2024-04-12T09:11:35.134 INFO:tasks.workunit.client.1.smithi203.stdout:7/709: write d0/d15/d2d/f4d [5087180,36987] 0 2024-04-12T09:11:35.137 INFO:tasks.workunit.client.1.smithi203.stdout:7/710: fsync d0/d4/d1c/d3b/f78 0 2024-04-12T09:11:35.138 INFO:tasks.workunit.client.1.smithi203.stdout:7/711: read - d0/d4/d1c/f3a zero size 2024-04-12T09:11:35.138 INFO:tasks.workunit.client.1.smithi203.stdout:7/712: readlink d0/d34/l83 0 2024-04-12T09:11:35.138 INFO:tasks.workunit.client.1.smithi203.stdout:7/713: chown d0/d15/d89 637 1 2024-04-12T09:11:35.144 INFO:tasks.workunit.client.1.smithi203.stdout:3/630: creat d2/d8/d14/d45/fcc x:0 0 0 2024-04-12T09:11:35.146 INFO:tasks.workunit.client.1.smithi203.stdout:2/690: link d0/d3/d8f/ff3 d0/d14/d23/d3d/ffa 0 2024-04-12T09:11:35.147 INFO:tasks.workunit.client.1.smithi203.stdout:0/759: mknod d0/dd/d71/d94/d2f/d17/d19/d6f/d78/dcd/cf7 0 2024-04-12T09:11:35.148 INFO:tasks.workunit.client.1.smithi203.stdout:3/631: truncate d2/d8/d14/f90 3298537 0 2024-04-12T09:11:35.149 INFO:tasks.workunit.client.1.smithi203.stdout:3/632: truncate d2/f70 1600220 0 2024-04-12T09:11:35.152 INFO:tasks.workunit.client.1.smithi203.stdout:3/633: write d2/d8/d14/d23/d35/fa1 [412248,9874] 0 2024-04-12T09:11:35.152 INFO:tasks.workunit.client.1.smithi203.stdout:1/725: link df/d2d/l86 df/d2d/d6f/d75/d80/d2b/lda 0 2024-04-12T09:11:35.154 INFO:tasks.workunit.client.1.smithi203.stdout:0/760: dwrite d0/d48/d5e/dca/ff2 [0,4194304] 0 2024-04-12T09:11:35.154 INFO:tasks.workunit.client.1.smithi203.stdout:3/634: dread - d2/d8/d14/d1b/d95/d92/fa4 zero size 2024-04-12T09:11:35.159 INFO:tasks.workunit.client.1.smithi203.stdout:0/761: mknod d0/dd/d71/cf8 0 2024-04-12T09:11:35.159 INFO:tasks.workunit.client.1.smithi203.stdout:1/726: getdents df/d2d/d6f/d75/d80/d54/d5d/d90/dc7 0 2024-04-12T09:11:35.164 INFO:tasks.workunit.client.1.smithi203.stdout:1/727: mkdir df/d2d/d6f/d75/d80/d8c/ddb 0 2024-04-12T09:11:35.165 INFO:tasks.workunit.client.1.smithi203.stdout:0/762: mknod d0/dd/cf9 0 2024-04-12T09:11:35.165 INFO:tasks.workunit.client.1.smithi203.stdout:0/763: fsync d0/dd/d5b/fba 0 2024-04-12T09:11:35.168 INFO:tasks.workunit.client.1.smithi203.stdout:1/728: mknod df/d2d/d6f/cdc 0 2024-04-12T09:11:35.170 INFO:tasks.workunit.client.1.smithi203.stdout:8/628: dwrite d4/d8/d1c/fab [0,4194304] 0 2024-04-12T09:11:35.171 INFO:tasks.workunit.client.1.smithi203.stdout:8/629: fsync d4/d8/d74/d78/f27 0 2024-04-12T09:11:35.180 INFO:tasks.workunit.client.1.smithi203.stdout:2/691: write d0/d14/f22 [2377897,92639] 0 2024-04-12T09:11:35.180 INFO:tasks.workunit.client.1.smithi203.stdout:8/630: fdatasync d4/d8/d74/d78/f54 0 2024-04-12T09:11:35.181 INFO:tasks.workunit.client.1.smithi203.stdout:2/692: chown d0/d38/f3e 1 1 2024-04-12T09:11:35.182 INFO:tasks.workunit.client.1.smithi203.stdout:2/693: dread - d0/d14/d23/d3d/ffa zero size 2024-04-12T09:11:35.192 INFO:tasks.workunit.client.1.smithi203.stdout:0/764: dread d0/dd/dbd/fc4 [0,4194304] 0 2024-04-12T09:11:35.193 INFO:tasks.workunit.client.1.smithi203.stdout:0/765: chown d0/dd/d71/d94/d2f/d17/d19/d6f/d78/fb4 1400 1 2024-04-12T09:11:35.195 INFO:tasks.workunit.client.1.smithi203.stdout:6/596: sync 2024-04-12T09:11:35.198 INFO:tasks.workunit.client.1.smithi203.stdout:0/766: dwrite d0/dd/d71/d94/d2f/f1e [0,4194304] 0 2024-04-12T09:11:35.204 INFO:tasks.workunit.client.1.smithi203.stdout:8/631: symlink d4/d8/d1c/d48/d5e/lc7 0 2024-04-12T09:11:35.208 INFO:tasks.workunit.client.1.smithi203.stdout:1/729: getdents df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/d88 0 2024-04-12T09:11:35.209 INFO:tasks.workunit.client.1.smithi203.stdout:8/632: symlink d4/d8/d1c/d5d/lc8 0 2024-04-12T09:11:35.210 INFO:tasks.workunit.client.1.smithi203.stdout:6/597: rmdir d1/d3/d26/d9b/daf 0 2024-04-12T09:11:35.211 INFO:tasks.workunit.client.1.smithi203.stdout:1/730: mknod df/d59/cdd 0 2024-04-12T09:11:35.213 INFO:tasks.workunit.client.1.smithi203.stdout:1/731: chown df/d2d/d6f/d75/d80/c4f 402 1 2024-04-12T09:11:35.214 INFO:tasks.workunit.client.1.smithi203.stdout:6/598: creat d1/d3/d26/d30/d4a/d6c/d45/d55/d8e/fbf x:0 0 0 2024-04-12T09:11:35.216 INFO:tasks.workunit.client.1.smithi203.stdout:8/633: dwrite d4/d8/d1c/f82 [0,4194304] 0 2024-04-12T09:11:35.218 INFO:tasks.workunit.client.1.smithi203.stdout:6/599: creat d1/d3/d5b/d8c/fc0 x:0 0 0 2024-04-12T09:11:35.221 INFO:tasks.workunit.client.1.smithi203.stdout:0/767: dread d0/dd/d71/d94/d2f/d34/db1/fa9 [0,4194304] 0 2024-04-12T09:11:35.221 INFO:tasks.workunit.client.1.smithi203.stdout:8/634: mkdir d4/d8/d1c/d5d/dc9 0 2024-04-12T09:11:35.222 INFO:tasks.workunit.client.1.smithi203.stdout:1/732: dwrite df/d2d/d6f/d75/fcc [0,4194304] 0 2024-04-12T09:11:35.223 INFO:tasks.workunit.client.1.smithi203.stdout:6/600: stat d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/da0/ca3 0 2024-04-12T09:11:35.226 INFO:tasks.workunit.client.1.smithi203.stdout:0/768: write d0/f36 [1284959,4903] 0 2024-04-12T09:11:35.229 INFO:tasks.workunit.client.1.smithi203.stdout:2/694: dread d0/d3/d47/fb4 [0,4194304] 0 2024-04-12T09:11:35.231 INFO:tasks.workunit.client.1.smithi203.stdout:6/601: rmdir d1/df/d65 39 2024-04-12T09:11:35.233 INFO:tasks.workunit.client.1.smithi203.stdout:1/733: creat df/d59/db0/d9b/fde x:0 0 0 2024-04-12T09:11:35.235 INFO:tasks.workunit.client.1.smithi203.stdout:8/635: creat d4/d8/d74/db6/fca x:0 0 0 2024-04-12T09:11:35.236 INFO:tasks.workunit.client.1.smithi203.stdout:0/769: unlink d0/dd/d40/l53 0 2024-04-12T09:11:35.239 INFO:tasks.workunit.client.1.smithi203.stdout:6/602: unlink d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/c4e 0 2024-04-12T09:11:35.239 INFO:tasks.workunit.client.1.smithi203.stdout:6/603: chown d1/d3/d26/d30/l46 75216 1 2024-04-12T09:11:35.240 INFO:tasks.workunit.client.1.smithi203.stdout:1/734: mknod df/d2d/d6f/d75/d80/d2b/cdf 0 2024-04-12T09:11:35.241 INFO:tasks.workunit.client.1.smithi203.stdout:8/636: chown d4/d8/d1c/c3b 3186 1 2024-04-12T09:11:35.243 INFO:tasks.workunit.client.1.smithi203.stdout:0/770: creat d0/dd/d71/d94/d2f/d17/dc9/ffa x:0 0 0 2024-04-12T09:11:35.245 INFO:tasks.workunit.client.1.smithi203.stdout:6/604: unlink d1/d3/d26/d30/d4a/d6c/l5f 0 2024-04-12T09:11:35.248 INFO:tasks.workunit.client.1.smithi203.stdout:8/637: mknod d4/d8/d81/ccb 0 2024-04-12T09:11:35.249 INFO:tasks.workunit.client.1.smithi203.stdout:5/765: sync 2024-04-12T09:11:35.249 INFO:tasks.workunit.client.1.smithi203.stdout:9/605: sync 2024-04-12T09:11:35.251 INFO:tasks.workunit.client.1.smithi203.stdout:6/605: rmdir d1/d3/d12 39 2024-04-12T09:11:35.254 INFO:tasks.workunit.client.1.smithi203.stdout:8/638: rename d4/caf to d4/d8/d1c/d5d/dc0/ccc 0 2024-04-12T09:11:35.254 INFO:tasks.workunit.client.1.smithi203.stdout:8/639: chown d4/d8/d1c/fab 1617016758 1 2024-04-12T09:11:35.257 INFO:tasks.workunit.client.1.smithi203.stdout:5/766: creat d0/dbd/dd0/f114 x:0 0 0 2024-04-12T09:11:35.261 INFO:tasks.workunit.client.1.smithi203.stdout:8/640: creat d4/d8/d1c/d5d/dc0/fcd x:0 0 0 2024-04-12T09:11:35.263 INFO:tasks.workunit.client.1.smithi203.stdout:8/641: readlink d4/d8/d37/l6f 0 2024-04-12T09:11:35.264 INFO:tasks.workunit.client.1.smithi203.stdout:2/695: dwrite d0/d3/d8f/d98/f99 [0,4194304] 0 2024-04-12T09:11:35.264 INFO:tasks.workunit.client.1.smithi203.stdout:5/767: creat d0/d6/d16/d44/dda/f115 x:0 0 0 2024-04-12T09:11:35.265 INFO:tasks.workunit.client.1.smithi203.stdout:6/606: symlink d1/d3/d91/lc1 0 2024-04-12T09:11:35.266 INFO:tasks.workunit.client.1.smithi203.stdout:6/607: fdatasync d1/d3/fad 0 2024-04-12T09:11:35.269 INFO:tasks.workunit.client.1.smithi203.stdout:9/606: creat d8/d12/d23/fd7 x:0 0 0 2024-04-12T09:11:35.269 INFO:tasks.workunit.client.1.smithi203.stdout:1/735: write df/d2d/d6f/daa/f62 [1102925,51509] 0 2024-04-12T09:11:35.272 INFO:tasks.workunit.client.1.smithi203.stdout:1/736: chown df/d2d/d6f/d75/d80/d2b/c5a 6 1 2024-04-12T09:11:35.273 INFO:tasks.workunit.client.1.smithi203.stdout:0/771: dwrite d0/d48/f69 [4194304,4194304] 0 2024-04-12T09:11:35.273 INFO:tasks.workunit.client.1.smithi203.stdout:6/608: mknod d1/d3/d26/d30/d4a/d6c/d45/d55/cc2 0 2024-04-12T09:11:35.278 INFO:tasks.workunit.client.1.smithi203.stdout:9/607: unlink d8/d12/d23/d27/f32 0 2024-04-12T09:11:35.282 INFO:tasks.workunit.client.1.smithi203.stdout:7/714: sync 2024-04-12T09:11:35.282 INFO:tasks.workunit.client.1.smithi203.stdout:4/731: sync 2024-04-12T09:11:35.282 INFO:tasks.workunit.client.1.smithi203.stdout:3/635: sync 2024-04-12T09:11:35.284 INFO:tasks.workunit.client.1.smithi203.stdout:6/609: readlink d1/d3/d4/l48 0 2024-04-12T09:11:35.291 INFO:tasks.workunit.client.1.smithi203.stdout:5/768: creat d0/d6/d11/f116 x:0 0 0 2024-04-12T09:11:35.291 INFO:tasks.workunit.client.1.smithi203.stdout:5/769: chown d0/d6/d9b 119929 1 2024-04-12T09:11:35.292 INFO:tasks.workunit.client.1.smithi203.stdout:1/737: mknod df/d2d/d6f/daa/ce0 0 2024-04-12T09:11:35.293 INFO:tasks.workunit.client.1.smithi203.stdout:5/770: stat d0/d6/d11/d18/dcc/ldc 0 2024-04-12T09:11:35.294 INFO:tasks.workunit.client.1.smithi203.stdout:2/696: dwrite d0/d67/f75 [0,4194304] 0 2024-04-12T09:11:35.295 INFO:tasks.workunit.client.1.smithi203.stdout:4/732: mkdir d1a/d21/d60/daa/df0 0 2024-04-12T09:11:35.298 INFO:tasks.workunit.client.1.smithi203.stdout:8/642: getdents d4/d8/d81/d84 0 2024-04-12T09:11:35.298 INFO:tasks.workunit.client.1.smithi203.stdout:8/643: stat d4/f2a 0 2024-04-12T09:11:35.299 INFO:tasks.workunit.client.1.smithi203.stdout:3/636: creat d2/d8/d14/d23/d35/d91/d81/fcd x:0 0 0 2024-04-12T09:11:35.300 INFO:tasks.workunit.client.1.smithi203.stdout:3/637: read d2/d8/d14/d23/d36/f4b [3641310,40133] 0 2024-04-12T09:11:35.302 INFO:tasks.workunit.client.1.smithi203.stdout:6/610: stat d1/d3/d26/d30/d4a/d6c/d45/l6a 0 2024-04-12T09:11:35.303 INFO:tasks.workunit.client.1.smithi203.stdout:9/608: getdents d8/d12/d23/d38/d8a/dc6 0 2024-04-12T09:11:35.304 INFO:tasks.workunit.client.1.smithi203.stdout:8/644: dread d4/d8/d74/d78/f3a [0,4194304] 0 2024-04-12T09:11:35.305 INFO:tasks.workunit.client.1.smithi203.stdout:1/738: mknod df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/ce1 0 2024-04-12T09:11:35.305 INFO:tasks.workunit.client.1.smithi203.stdout:0/772: dread d0/d48/f69 [0,4194304] 0 2024-04-12T09:11:35.306 INFO:tasks.workunit.client.1.smithi203.stdout:4/733: symlink d1a/d21/d22/d2e/d8d/d9b/dd8/lf1 0 2024-04-12T09:11:35.311 INFO:tasks.workunit.client.1.smithi203.stdout:7/715: dread d0/d38/fb6 [0,4194304] 0 2024-04-12T09:11:35.311 INFO:tasks.workunit.client.1.smithi203.stdout:1/739: fdatasync df/d2d/f68 0 2024-04-12T09:11:35.311 INFO:tasks.workunit.client.1.smithi203.stdout:8/645: creat d4/d8/d1c/d48/d5e/fce x:0 0 0 2024-04-12T09:11:35.311 INFO:tasks.workunit.client.1.smithi203.stdout:8/646: stat d4/d8/d81/d84 0 2024-04-12T09:11:35.313 INFO:tasks.workunit.client.1.smithi203.stdout:2/697: rmdir d0/d14/de2 0 2024-04-12T09:11:35.313 INFO:tasks.workunit.client.1.smithi203.stdout:2/698: chown d0/d38/ld0 18454 1 2024-04-12T09:11:35.317 INFO:tasks.workunit.client.1.smithi203.stdout:9/609: write d8/d12/d3e/f84 [637221,109914] 0 2024-04-12T09:11:35.322 INFO:tasks.workunit.client.1.smithi203.stdout:8/647: creat d4/d8/d1c/d5d/dc0/fcf x:0 0 0 2024-04-12T09:11:35.326 INFO:tasks.workunit.client.1.smithi203.stdout:0/773: mknod d0/dd/d71/d94/d2f/d17/cfb 0 2024-04-12T09:11:35.327 INFO:tasks.workunit.client.1.smithi203.stdout:0/774: chown d0/d48/d5e/d84/laf 46700459 1 2024-04-12T09:11:35.327 INFO:tasks.workunit.client.1.smithi203.stdout:4/734: write d1a/d1d/d69/fc1 [3580424,72496] 0 2024-04-12T09:11:35.330 INFO:tasks.workunit.client.1.smithi203.stdout:7/716: dread d0/d4/d1c/d5b/f65 [0,4194304] 0 2024-04-12T09:11:35.330 INFO:tasks.workunit.client.1.smithi203.stdout:7/717: readlink d0/d38/d51/l5f 0 2024-04-12T09:11:35.332 INFO:tasks.workunit.client.1.smithi203.stdout:1/740: symlink df/d2d/d6f/daa/le2 0 2024-04-12T09:11:35.332 INFO:tasks.workunit.client.1.smithi203.stdout:2/699: dwrite d0/d14/d74/d96/d9a/faa [0,4194304] 0 2024-04-12T09:11:35.332 INFO:tasks.workunit.client.1.smithi203.stdout:2/700: chown d0/d54 22 1 2024-04-12T09:11:35.335 INFO:tasks.workunit.client.1.smithi203.stdout:6/611: getdents d1/df 0 2024-04-12T09:11:35.337 INFO:tasks.workunit.client.1.smithi203.stdout:8/648: creat d4/d8/d74/da6/fd0 x:0 0 0 2024-04-12T09:11:35.338 INFO:tasks.workunit.client.1.smithi203.stdout:0/775: symlink d0/d59/d5d/lfc 0 2024-04-12T09:11:35.341 INFO:tasks.workunit.client.1.smithi203.stdout:4/735: fdatasync d1a/d21/d22/d2e/d8d/d9b/ddf/fee 0 2024-04-12T09:11:35.341 INFO:tasks.workunit.client.1.smithi203.stdout:4/736: write d1a/d21/d22/d2e/f43 [3297373,23869] 0 2024-04-12T09:11:35.343 INFO:tasks.workunit.client.1.smithi203.stdout:7/718: rmdir d0/d4/d1c/d5b/dbf 39 2024-04-12T09:11:35.345 INFO:tasks.workunit.client.1.smithi203.stdout:2/701: mknod d0/d67/d86/cfb 0 2024-04-12T09:11:35.346 INFO:tasks.workunit.client.1.smithi203.stdout:9/610: mkdir d8/d12/d3e/d90/dd8 0 2024-04-12T09:11:35.347 INFO:tasks.workunit.client.1.smithi203.stdout:7/719: dread d0/d34/d7c/fe9 [0,4194304] 0 2024-04-12T09:11:35.348 INFO:tasks.workunit.client.1.smithi203.stdout:4/737: dwrite d1a/d1d/d69/fc1 [0,4194304] 0 2024-04-12T09:11:35.350 INFO:tasks.workunit.client.1.smithi203.stdout:8/649: rename d4/d8/d81/d84/d92/f8c to d4/d8/d1c/d48/d5e/fd1 0 2024-04-12T09:11:35.351 INFO:tasks.workunit.client.1.smithi203.stdout:8/650: chown d4/d34 50 1 2024-04-12T09:11:35.351 INFO:tasks.workunit.client.1.smithi203.stdout:8/651: write d4/f2a [6448647,8170] 0 2024-04-12T09:11:35.354 INFO:tasks.workunit.client.1.smithi203.stdout:0/776: symlink d0/dd/d40/lfd 0 2024-04-12T09:11:35.369 INFO:tasks.workunit.client.1.smithi203.stdout:2/702: rename d0/d38/d43 to d0/d14/d1e/d2a/dcd/dfc 0 2024-04-12T09:11:35.370 INFO:tasks.workunit.client.1.smithi203.stdout:8/652: readlink d4/d8/d74/d78/d53/l7a 0 2024-04-12T09:11:35.377 INFO:tasks.workunit.client.1.smithi203.stdout:9/611: dread d8/d3b/fc9 [0,4194304] 0 2024-04-12T09:11:35.378 INFO:tasks.workunit.client.1.smithi203.stdout:2/703: mkdir d0/d67/d86/dd9/dfd 0 2024-04-12T09:11:35.381 INFO:tasks.workunit.client.1.smithi203.stdout:8/653: rename d4/d8/f6e to d4/d8/d74/d78/fd2 0 2024-04-12T09:11:35.381 INFO:tasks.workunit.client.1.smithi203.stdout:8/654: dread - d4/d8/d74/db6/fca zero size 2024-04-12T09:11:35.382 INFO:tasks.workunit.client.1.smithi203.stdout:6/612: getdents d1/df/d87/d7a 0 2024-04-12T09:11:35.384 INFO:tasks.workunit.client.1.smithi203.stdout:7/720: truncate d0/d4/d1c/d5b/f65 3722556 0 2024-04-12T09:11:35.386 INFO:tasks.workunit.client.1.smithi203.stdout:2/704: mknod d0/d14/d74/d96/d9a/cfe 0 2024-04-12T09:11:35.386 INFO:tasks.workunit.client.1.smithi203.stdout:2/705: stat d0/d14/d74/d96/d9a/lbe 0 2024-04-12T09:11:35.389 INFO:tasks.workunit.client.1.smithi203.stdout:4/738: getdents d1a/d21/da1 0 2024-04-12T09:11:35.390 INFO:tasks.workunit.client.1.smithi203.stdout:2/706: dread d0/d3/fd [0,4194304] 0 2024-04-12T09:11:35.391 INFO:tasks.workunit.client.1.smithi203.stdout:2/707: stat d0/d14/d23/d33/lab 0 2024-04-12T09:11:35.393 INFO:tasks.workunit.client.1.smithi203.stdout:2/708: truncate d0/d14/fec 23747 0 2024-04-12T09:11:35.393 INFO:tasks.workunit.client.1.smithi203.stdout:2/709: fdatasync d0/d14/f22 0 2024-04-12T09:11:35.393 INFO:tasks.workunit.client.1.smithi203.stdout:7/721: unlink d0/d4/d5d/c7b 0 2024-04-12T09:11:35.396 INFO:tasks.workunit.client.1.smithi203.stdout:9/612: dread d8/fa [0,4194304] 0 2024-04-12T09:11:35.396 INFO:tasks.workunit.client.1.smithi203.stdout:0/777: getdents d0/dd/dbd 0 2024-04-12T09:11:35.399 INFO:tasks.workunit.client.1.smithi203.stdout:4/739: symlink d1a/d21/d22/d2e/d8d/d9b/dbc/dc7/lf2 0 2024-04-12T09:11:35.399 INFO:tasks.workunit.client.1.smithi203.stdout:7/722: dwrite d0/d4/d1c/d3b/f78 [0,4194304] 0 2024-04-12T09:11:35.400 INFO:tasks.workunit.client.1.smithi203.stdout:4/740: stat d1a/d20/d5f/c7c 0 2024-04-12T09:11:35.402 INFO:tasks.workunit.client.1.smithi203.stdout:6/613: rename d1/d3/f1a to d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/db5/fc3 0 2024-04-12T09:11:35.406 INFO:tasks.workunit.client.1.smithi203.stdout:8/655: truncate d4/f35 4135064 0 2024-04-12T09:11:35.412 INFO:tasks.workunit.client.1.smithi203.stdout:0/778: mkdir d0/dd/d71/d94/d2f/d34/dfe 0 2024-04-12T09:11:35.412 INFO:tasks.workunit.client.1.smithi203.stdout:0/779: stat d0/dd/f99 0 2024-04-12T09:11:35.415 INFO:tasks.workunit.client.1.smithi203.stdout:2/710: symlink d0/d14/d1e/d2a/dce/lff 0 2024-04-12T09:11:35.418 INFO:tasks.workunit.client.1.smithi203.stdout:7/723: mknod d0/d4/d1c/d5b/cf9 0 2024-04-12T09:11:35.418 INFO:tasks.workunit.client.1.smithi203.stdout:7/724: fsync d0/d4/f88 0 2024-04-12T09:11:35.419 INFO:tasks.workunit.client.1.smithi203.stdout:7/725: stat d0/d38 0 2024-04-12T09:11:35.420 INFO:tasks.workunit.client.1.smithi203.stdout:7/726: chown d0/d34/d7c/fe9 37 1 2024-04-12T09:11:35.425 INFO:tasks.workunit.client.1.smithi203.stdout:4/741: rename d1a/d1d/d69/d76/c94 to d1a/d20/d5d/cf3 0 2024-04-12T09:11:35.425 INFO:tasks.workunit.client.1.smithi203.stdout:2/711: mkdir d0/d14/d1e/d57/d95/dd6/d100 0 2024-04-12T09:11:35.426 INFO:tasks.workunit.client.1.smithi203.stdout:4/742: fsync d1a/d20/d5d/d2c/d72/fc8 0 2024-04-12T09:11:35.427 INFO:tasks.workunit.client.1.smithi203.stdout:7/727: creat d0/d4/d5d/ffa x:0 0 0 2024-04-12T09:11:35.427 INFO:tasks.workunit.client.1.smithi203.stdout:2/712: write d0/d14/d23/f2d [3497564,43731] 0 2024-04-12T09:11:35.429 INFO:tasks.workunit.client.1.smithi203.stdout:4/743: write d1a/d21/f98 [861484,12035] 0 2024-04-12T09:11:35.429 INFO:tasks.workunit.client.1.smithi203.stdout:0/780: dread d0/dd/f16 [0,4194304] 0 2024-04-12T09:11:35.430 INFO:tasks.workunit.client.1.smithi203.stdout:6/614: rename d1/d3/f25 to d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d3a/fc4 0 2024-04-12T09:11:35.432 INFO:tasks.workunit.client.1.smithi203.stdout:7/728: symlink d0/d15/d2d/d5e/d8c/lfb 0 2024-04-12T09:11:35.433 INFO:tasks.workunit.client.1.smithi203.stdout:6/615: dread d1/d3/d26/d30/fac [0,4194304] 0 2024-04-12T09:11:35.434 INFO:tasks.workunit.client.1.smithi203.stdout:4/744: dread d1a/d20/fab [0,4194304] 0 2024-04-12T09:11:35.434 INFO:tasks.workunit.client.1.smithi203.stdout:4/745: chown d1a/l88 0 1 2024-04-12T09:11:35.435 INFO:tasks.workunit.client.1.smithi203.stdout:0/781: mknod d0/dd/d71/d94/d2f/d17/d19/d6f/dcb/cff 0 2024-04-12T09:11:35.435 INFO:tasks.workunit.client.1.smithi203.stdout:5/771: sync 2024-04-12T09:11:35.442 INFO:tasks.workunit.client.1.smithi203.stdout:6/616: rename d1/d3/d26/d30/d4a/d6c/d45/d55/d77/f2c to d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/db5/fc5 0 2024-04-12T09:11:35.444 INFO:tasks.workunit.client.1.smithi203.stdout:2/713: getdents d0/d14/d1e/d57 0 2024-04-12T09:11:35.447 INFO:tasks.workunit.client.1.smithi203.stdout:5/772: symlink d0/d6/d16/l117 0 2024-04-12T09:11:35.451 INFO:tasks.workunit.client.1.smithi203.stdout:6/617: creat d1/d3/d91/fc6 x:0 0 0 2024-04-12T09:11:35.453 INFO:tasks.workunit.client.1.smithi203.stdout:4/746: link d1a/d20/d5d/d2c/c3e d1a/d2b/cf4 0 2024-04-12T09:11:35.453 INFO:tasks.workunit.client.1.smithi203.stdout:6/618: dread d1/df/d65/f86 [0,4194304] 0 2024-04-12T09:11:35.456 INFO:tasks.workunit.client.1.smithi203.stdout:7/729: write d0/d4/d54/d75/f9b [360543,18626] 0 2024-04-12T09:11:35.459 INFO:tasks.workunit.client.1.smithi203.stdout:4/747: dwrite d1a/d21/d22/d2e/d8d/d9b/dbc/dc7/fe6 [0,4194304] 0 2024-04-12T09:11:35.463 INFO:tasks.workunit.client.1.smithi203.stdout:7/730: dwrite d0/d4/d1c/d3b/f46 [0,4194304] 0 2024-04-12T09:11:35.466 INFO:tasks.workunit.client.1.smithi203.stdout:5/773: mkdir d0/d6/d11/d1e/d4c/d48/df1/d118 0 2024-04-12T09:11:35.471 INFO:tasks.workunit.client.1.smithi203.stdout:2/714: dwrite d0/d14/d1e/d2a/f60 [0,4194304] 0 2024-04-12T09:11:35.472 INFO:tasks.workunit.client.1.smithi203.stdout:2/715: chown d0/d14/d74/d96/d9a/fe1 3 1 2024-04-12T09:11:35.480 INFO:tasks.workunit.client.1.smithi203.stdout:4/748: truncate d1a/d20/d5d/d2c/f51 1869841 0 2024-04-12T09:11:35.481 INFO:tasks.workunit.client.1.smithi203.stdout:2/716: mknod d0/d3/d8e/c101 0 2024-04-12T09:11:35.481 INFO:tasks.workunit.client.1.smithi203.stdout:2/717: stat d0/d67/d86/dd9/cf1 0 2024-04-12T09:11:35.484 INFO:tasks.workunit.client.1.smithi203.stdout:6/619: getdents d1/d3/d26/d30/d4a 0 2024-04-12T09:11:35.485 INFO:tasks.workunit.client.1.smithi203.stdout:5/774: dread d0/d6/d16/d9/d80/fc0 [0,4194304] 0 2024-04-12T09:11:35.486 INFO:tasks.workunit.client.1.smithi203.stdout:2/718: truncate d0/d14/d1e/d57/d95/fa3 865925 0 2024-04-12T09:11:35.487 INFO:tasks.workunit.client.1.smithi203.stdout:2/719: write d0/d14/d1e/d57/d95/fb0 [776107,93235] 0 2024-04-12T09:11:35.495 INFO:tasks.workunit.client.1.smithi203.stdout:4/749: rename d1a/d21/d60/d68/dbe/fd3 to d1a/d21/d22/ff5 0 2024-04-12T09:11:35.495 INFO:tasks.workunit.client.1.smithi203.stdout:6/620: dwrite d1/d3/d12/f1f [0,4194304] 0 2024-04-12T09:11:35.495 INFO:tasks.workunit.client.1.smithi203.stdout:7/731: write d0/d15/d2d/f4b [1029072,9889] 0 2024-04-12T09:11:35.498 INFO:tasks.workunit.client.1.smithi203.stdout:6/621: read d1/d3/f2d [8008972,74840] 0 2024-04-12T09:11:35.499 INFO:tasks.workunit.client.1.smithi203.stdout:2/720: creat d0/d3/d47/f102 x:0 0 0 2024-04-12T09:11:35.502 INFO:tasks.workunit.client.1.smithi203.stdout:2/721: write d0/d14/d23/d3d/f91 [36837,12506] 0 2024-04-12T09:11:35.505 INFO:tasks.workunit.client.1.smithi203.stdout:4/750: symlink d1a/d20/d5d/lf6 0 2024-04-12T09:11:35.511 INFO:tasks.workunit.client.1.smithi203.stdout:5/775: dread d0/d6/d16/d9/f10 [0,4194304] 0 2024-04-12T09:11:35.511 INFO:tasks.workunit.client.1.smithi203.stdout:4/751: symlink d1a/d21/d22/d2e/d8d/d9b/ddf/lf7 0 2024-04-12T09:11:35.512 INFO:tasks.workunit.client.1.smithi203.stdout:4/752: chown d1a/d21/d22/d2e/d8d/db8/fde 898941 1 2024-04-12T09:11:35.515 INFO:tasks.workunit.client.1.smithi203.stdout:5/776: mknod d0/d6/d11/dd3/c119 0 2024-04-12T09:11:35.517 INFO:tasks.workunit.client.1.smithi203.stdout:6/622: write d1/d3/d26/d30/d4a/d6c/f44 [2981623,28214] 0 2024-04-12T09:11:35.517 INFO:tasks.workunit.client.1.smithi203.stdout:5/777: mknod d0/d6/d11/d18/dcc/c11a 0 2024-04-12T09:11:35.518 INFO:tasks.workunit.client.1.smithi203.stdout:6/623: dread - d1/d3/d26/d30/f7c zero size 2024-04-12T09:11:35.520 INFO:tasks.workunit.client.1.smithi203.stdout:5/778: fdatasync d0/d6/d16/d9/d30/d58/d74/fc3 0 2024-04-12T09:11:35.520 INFO:tasks.workunit.client.1.smithi203.stdout:2/722: getdents d0/d14/d1e/d57/d95/dd6 0 2024-04-12T09:11:35.521 INFO:tasks.workunit.client.1.smithi203.stdout:4/753: dwrite d1a/d20/fab [0,4194304] 0 2024-04-12T09:11:35.528 INFO:tasks.workunit.client.1.smithi203.stdout:2/723: truncate d0/d3/f10 1459942 0 2024-04-12T09:11:35.529 INFO:tasks.workunit.client.1.smithi203.stdout:6/624: dwrite d1/df/d87/f9e [0,4194304] 0 2024-04-12T09:11:35.530 INFO:tasks.workunit.client.1.smithi203.stdout:5/779: link d0/d6/d11/d4a/c112 d0/d6/d16/d9/c11b 0 2024-04-12T09:11:35.532 INFO:tasks.workunit.client.1.smithi203.stdout:4/754: dwrite d1a/d21/f98 [0,4194304] 0 2024-04-12T09:11:35.535 INFO:tasks.workunit.client.1.smithi203.stdout:2/724: mkdir d0/d67/d86/dd9/d103 0 2024-04-12T09:11:35.539 INFO:tasks.workunit.client.1.smithi203.stdout:4/755: write d1a/d2b/feb [288398,35322] 0 2024-04-12T09:11:35.543 INFO:tasks.workunit.client.1.smithi203.stdout:2/725: dwrite d0/fc6 [0,4194304] 0 2024-04-12T09:11:35.543 INFO:tasks.workunit.client.1.smithi203.stdout:5/780: truncate d0/d6/d11/d1e/d4c/f64 2085601 0 2024-04-12T09:11:35.544 INFO:tasks.workunit.client.1.smithi203.stdout:2/726: stat d0/d14/d1e/d2a/f4c 0 2024-04-12T09:11:35.546 INFO:tasks.workunit.client.1.smithi203.stdout:2/727: truncate d0/d14/d1e/d57/d95/fb0 1582410 0 2024-04-12T09:11:35.549 INFO:tasks.workunit.client.1.smithi203.stdout:4/756: creat d1a/d1d/d69/dcf/ff8 x:0 0 0 2024-04-12T09:11:35.549 INFO:tasks.workunit.client.1.smithi203.stdout:2/728: dread d0/fc6 [0,4194304] 0 2024-04-12T09:11:35.551 INFO:tasks.workunit.client.1.smithi203.stdout:5/781: truncate d0/d6/d16/d9/d30/d58/fa6 77713 0 2024-04-12T09:11:35.554 INFO:tasks.workunit.client.1.smithi203.stdout:2/729: fdatasync d0/d38/fbb 0 2024-04-12T09:11:35.555 INFO:tasks.workunit.client.1.smithi203.stdout:5/782: mknod d0/d6/d9b/c11c 0 2024-04-12T09:11:35.559 INFO:tasks.workunit.client.1.smithi203.stdout:5/783: mknod d0/d6/d16/d44/c11d 0 2024-04-12T09:11:35.562 INFO:tasks.workunit.client.1.smithi203.stdout:2/730: creat d0/d54/d61/d78/f104 x:0 0 0 2024-04-12T09:11:35.566 INFO:tasks.workunit.client.1.smithi203.stdout:5/784: creat d0/d6/d11/d1e/d4c/d48/df1/d118/f11e x:0 0 0 2024-04-12T09:11:35.567 INFO:tasks.workunit.client.1.smithi203.stdout:5/785: write d0/d6/d16/d9/fdf [353608,87619] 0 2024-04-12T09:11:35.574 INFO:tasks.workunit.client.1.smithi203.stdout:2/731: getdents d0/d67/d86/dd9 0 2024-04-12T09:11:35.574 INFO:tasks.workunit.client.1.smithi203.stdout:5/786: dwrite d0/d6/d11/d18/f40 [4194304,4194304] 0 2024-04-12T09:11:35.576 INFO:tasks.workunit.client.1.smithi203.stdout:4/757: dread d1a/d21/d22/d2e/f49 [0,4194304] 0 2024-04-12T09:11:35.576 INFO:tasks.workunit.client.1.smithi203.stdout:4/758: chown fb 9 1 2024-04-12T09:11:35.577 INFO:tasks.workunit.client.1.smithi203.stdout:4/759: stat d1a/d21/d22/d2e/fd4 0 2024-04-12T09:11:35.578 INFO:tasks.workunit.client.1.smithi203.stdout:4/760: dread - d1a/d20/d5d/d2c/d72/fd2 zero size 2024-04-12T09:11:35.578 INFO:tasks.workunit.client.1.smithi203.stdout:4/761: chown d1a/d1d/d69/d76/dd6 569302886 1 2024-04-12T09:11:35.579 INFO:tasks.workunit.client.1.smithi203.stdout:2/732: mkdir d0/d3/d105 0 2024-04-12T09:11:35.582 INFO:tasks.workunit.client.1.smithi203.stdout:4/762: symlink d1a/d21/d60/daa/dc5/lf9 0 2024-04-12T09:11:35.585 INFO:tasks.workunit.client.1.smithi203.stdout:5/787: rename d0/d6/d11/d1e/d4c/d48/df1 to d0/d6/d16/d11f 0 2024-04-12T09:11:35.587 INFO:tasks.workunit.client.1.smithi203.stdout:2/733: link d0/d54/cb8 d0/d14/d1e/d57/d95/dd6/d100/c106 0 2024-04-12T09:11:35.587 INFO:tasks.workunit.client.1.smithi203.stdout:2/734: chown d0/fb2 8663433 1 2024-04-12T09:11:35.589 INFO:tasks.workunit.client.1.smithi203.stdout:5/788: symlink d0/d6/d16/d9/d30/d83/l120 0 2024-04-12T09:11:35.589 INFO:tasks.workunit.client.1.smithi203.stdout:2/735: dread d0/d38/fbb [0,4194304] 0 2024-04-12T09:11:35.590 INFO:tasks.workunit.client.1.smithi203.stdout:5/789: read d0/d6/d11/d1e/d4c/d48/fb5 [470830,37586] 0 2024-04-12T09:11:35.590 INFO:tasks.workunit.client.1.smithi203.stdout:4/763: link d1a/d34/f35 d1a/d1d/d69/dcf/ffa 0 2024-04-12T09:11:35.591 INFO:tasks.workunit.client.1.smithi203.stdout:2/736: fsync d0/d14/d23/d33/f83 0 2024-04-12T09:11:35.595 INFO:tasks.workunit.client.1.smithi203.stdout:5/790: dwrite d0/d6/d16/d8/fee [0,4194304] 0 2024-04-12T09:11:35.597 INFO:tasks.workunit.client.1.smithi203.stdout:3/638: sync 2024-04-12T09:11:35.597 INFO:tasks.workunit.client.1.smithi203.stdout:4/764: mknod d1a/d21/d22/d2e/d8d/db8/cfb 0 2024-04-12T09:11:35.598 INFO:tasks.workunit.client.1.smithi203.stdout:4/765: stat d1a/d21/d22/d2e/fd4 0 2024-04-12T09:11:35.598 INFO:tasks.workunit.client.1.smithi203.stdout:3/639: fdatasync d2/d8/d14/d1b/d2f/f32 0 2024-04-12T09:11:35.599 INFO:tasks.workunit.client.1.smithi203.stdout:4/766: write f14 [2913387,51993] 0 2024-04-12T09:11:35.599 INFO:tasks.workunit.client.1.smithi203.stdout:2/737: mkdir d0/d67/d107 0 2024-04-12T09:11:35.604 INFO:tasks.workunit.client.1.smithi203.stdout:5/791: mkdir d0/d6/d11/dd3/d121 0 2024-04-12T09:11:35.605 INFO:tasks.workunit.client.1.smithi203.stdout:5/792: chown d0/d6/d11/d18 35 1 2024-04-12T09:11:35.605 INFO:tasks.workunit.client.1.smithi203.stdout:4/767: dwrite d1a/d21/d22/d2e/f43 [0,4194304] 0 2024-04-12T09:11:35.606 INFO:tasks.workunit.client.1.smithi203.stdout:3/640: mknod d2/d64/d8d/cce 0 2024-04-12T09:11:35.607 INFO:tasks.workunit.client.1.smithi203.stdout:2/738: dwrite d0/d3/d8f/fc2 [0,4194304] 0 2024-04-12T09:11:35.608 INFO:tasks.workunit.client.1.smithi203.stdout:4/768: write d1a/d1d/fb6 [638106,119334] 0 2024-04-12T09:11:35.610 INFO:tasks.workunit.client.1.smithi203.stdout:5/793: write d0/d6/d16/d9/d80/df2/d104/d2d/fbc [2532832,57620] 0 2024-04-12T09:11:35.611 INFO:tasks.workunit.client.1.smithi203.stdout:4/769: truncate d1a/d34/fbd 697511 0 2024-04-12T09:11:35.613 INFO:tasks.workunit.client.1.smithi203.stdout:3/641: mknod d2/d8/d14/d1b/ccf 0 2024-04-12T09:11:35.614 INFO:tasks.workunit.client.1.smithi203.stdout:2/739: truncate d0/d54/d61/f79 4547531 0 2024-04-12T09:11:35.624 INFO:tasks.workunit.client.1.smithi203.stdout:4/770: creat d1a/d34/de4/ffc x:0 0 0 2024-04-12T09:11:35.634 INFO:tasks.workunit.client.1.smithi203.stdout:2/740: rename d0/d14/d1e/d2a/dcd/dfc/ca9 to d0/d54/d61/c108 0 2024-04-12T09:11:35.636 INFO:tasks.workunit.client.1.smithi203.stdout:5/794: truncate d0/d6/d11/d18/d2a/f2b 1146801 0 2024-04-12T09:11:35.637 INFO:tasks.workunit.client.1.smithi203.stdout:5/795: stat d0/d6/d11/d4a/lba 0 2024-04-12T09:11:35.639 INFO:tasks.workunit.client.1.smithi203.stdout:3/642: dwrite d2/d8/d14/d23/d35/d4c/d5c/d55/fbe [0,4194304] 0 2024-04-12T09:11:35.641 INFO:tasks.workunit.client.1.smithi203.stdout:3/643: stat d2/d8/d14/d23/d35/d4c/f54 0 2024-04-12T09:11:35.643 INFO:tasks.workunit.client.1.smithi203.stdout:4/771: dwrite d1a/d2b/f80 [0,4194304] 0 2024-04-12T09:11:35.650 INFO:tasks.workunit.client.1.smithi203.stdout:3/644: symlink d2/d51/ld0 0 2024-04-12T09:11:35.650 INFO:tasks.workunit.client.1.smithi203.stdout:2/741: write d0/d19/f9b [587107,90111] 0 2024-04-12T09:11:35.657 INFO:tasks.workunit.client.1.smithi203.stdout:5/796: dwrite d0/d6/d16/d9/d30/d83/fb6 [0,4194304] 0 2024-04-12T09:11:35.658 INFO:tasks.workunit.client.1.smithi203.stdout:2/742: mkdir d0/d14/d1e/d57/d95/d109 0 2024-04-12T09:11:35.661 INFO:tasks.workunit.client.1.smithi203.stdout:4/772: link fb d1a/d1d/d69/d76/dd6/ffd 0 2024-04-12T09:11:35.670 INFO:tasks.workunit.client.1.smithi203.stdout:3/645: dwrite d2/d8/d14/d1b/d2f/f78 [0,4194304] 0 2024-04-12T09:11:35.680 INFO:tasks.workunit.client.1.smithi203.stdout:3/646: creat d2/d8/d14/d23/d35/d91/fd1 x:0 0 0 2024-04-12T09:11:35.681 INFO:tasks.workunit.client.1.smithi203.stdout:2/743: link d0/d3/ca d0/d14/d74/c10a 0 2024-04-12T09:11:35.683 INFO:tasks.workunit.client.1.smithi203.stdout:3/647: fdatasync d2/d51/d65/f77 0 2024-04-12T09:11:35.687 INFO:tasks.workunit.client.1.smithi203.stdout:2/744: rename d0/d54/dad to d0/d14/d1e/d2a/dcd/dfc/d10b 0 2024-04-12T09:11:35.687 INFO:tasks.workunit.client.1.smithi203.stdout:4/773: write d1a/d21/f67 [1339465,99821] 0 2024-04-12T09:11:35.689 INFO:tasks.workunit.client.1.smithi203.stdout:2/745: dread d0/d38/fbb [0,4194304] 0 2024-04-12T09:11:35.690 INFO:tasks.workunit.client.1.smithi203.stdout:3/648: unlink d2/d8/d14/d23/f42 0 2024-04-12T09:11:35.690 INFO:tasks.workunit.client.1.smithi203.stdout:5/797: dwrite d0/d6/d11/d1e/d4c/d48/f55 [0,4194304] 0 2024-04-12T09:11:35.692 INFO:tasks.workunit.client.1.smithi203.stdout:9/613: sync 2024-04-12T09:11:35.692 INFO:tasks.workunit.client.1.smithi203.stdout:1/741: sync 2024-04-12T09:11:35.693 INFO:tasks.workunit.client.1.smithi203.stdout:9/614: chown d8/d12/d23/d85/f1d 628765971 1 2024-04-12T09:11:35.694 INFO:tasks.workunit.client.1.smithi203.stdout:4/774: readlink d1a/d21/l63 0 2024-04-12T09:11:35.699 INFO:tasks.workunit.client.1.smithi203.stdout:9/615: dwrite d8/d12/f81 [0,4194304] 0 2024-04-12T09:11:35.703 INFO:tasks.workunit.client.1.smithi203.stdout:9/616: truncate d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/f4c 9235197 0 2024-04-12T09:11:35.704 INFO:tasks.workunit.client.1.smithi203.stdout:1/742: creat df/d2d/d6f/d75/d80/d54/d5d/d90/fe3 x:0 0 0 2024-04-12T09:11:35.706 INFO:tasks.workunit.client.1.smithi203.stdout:4/775: mkdir d1a/d21/d60/dfe 0 2024-04-12T09:11:35.707 INFO:tasks.workunit.client.1.smithi203.stdout:1/743: write df/d2d/d6f/d75/d80/d54/d5d/f9c [1005482,66596] 0 2024-04-12T09:11:35.709 INFO:tasks.workunit.client.1.smithi203.stdout:2/746: dwrite d0/f32 [0,4194304] 0 2024-04-12T09:11:35.712 INFO:tasks.workunit.client.1.smithi203.stdout:3/649: rmdir d2/d51/db8 0 2024-04-12T09:11:35.713 INFO:tasks.workunit.client.1.smithi203.stdout:4/776: symlink d1a/d21/d60/daa/dc5/lff 0 2024-04-12T09:11:35.718 INFO:tasks.workunit.client.1.smithi203.stdout:1/744: unlink df/d2d/d6f/d75/d80/d2b/l55 0 2024-04-12T09:11:35.719 INFO:tasks.workunit.client.1.smithi203.stdout:1/745: write df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/f81 [2210220,123976] 0 2024-04-12T09:11:35.719 INFO:tasks.workunit.client.1.smithi203.stdout:2/747: unlink d0/d38/f3e 0 2024-04-12T09:11:35.720 INFO:tasks.workunit.client.1.smithi203.stdout:2/748: chown d0/d14/d1e/d2a/dcd/dfc/f5b 1916 1 2024-04-12T09:11:35.722 INFO:tasks.workunit.client.1.smithi203.stdout:5/798: dread d0/d6/d16/d9/d80/df2/d104/d2d/fed [0,4194304] 0 2024-04-12T09:11:35.722 INFO:tasks.workunit.client.1.smithi203.stdout:3/650: rename d2/d8/d14/d23/d36/f4b to d2/d51/d65/fd2 0 2024-04-12T09:11:35.723 INFO:tasks.workunit.client.1.smithi203.stdout:9/617: write d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/f6a [5896008,101794] 0 2024-04-12T09:11:35.724 INFO:tasks.workunit.client.1.smithi203.stdout:3/651: chown d2/d8/d14/d23/d35/d4c/d5c 270 1 2024-04-12T09:11:35.726 INFO:tasks.workunit.client.1.smithi203.stdout:1/746: creat df/d2d/d6f/d75/d80/d2b/fe4 x:0 0 0 2024-04-12T09:11:35.727 INFO:tasks.workunit.client.1.smithi203.stdout:6/625: sync 2024-04-12T09:11:35.727 INFO:tasks.workunit.client.1.smithi203.stdout:8/656: sync 2024-04-12T09:11:35.727 INFO:tasks.workunit.client.1.smithi203.stdout:0/782: sync 2024-04-12T09:11:35.727 INFO:tasks.workunit.client.1.smithi203.stdout:7/732: sync 2024-04-12T09:11:35.730 INFO:tasks.workunit.client.1.smithi203.stdout:5/799: mkdir d0/d6/d16/d9/d122 0 2024-04-12T09:11:35.731 INFO:tasks.workunit.client.1.smithi203.stdout:6/626: rmdir d1/d3/d26/d36 39 2024-04-12T09:11:35.736 INFO:tasks.workunit.client.1.smithi203.stdout:0/783: dwrite d0/dd/d71/d94/d2f/d17/dc9/ffa [0,4194304] 0 2024-04-12T09:11:35.737 INFO:tasks.workunit.client.1.smithi203.stdout:3/652: unlink d2/d8/d14/d1b/la7 0 2024-04-12T09:11:35.741 INFO:tasks.workunit.client.1.smithi203.stdout:7/733: dwrite d0/d4/d1c/d5b/dbf/dc5/fcc [0,4194304] 0 2024-04-12T09:11:35.741 INFO:tasks.workunit.client.1.smithi203.stdout:0/784: truncate d0/dd/d71/d94/d2f/d17/d19/d6f/d78/fb4 200866 0 2024-04-12T09:11:35.742 INFO:tasks.workunit.client.1.smithi203.stdout:1/747: unlink df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/ce1 0 2024-04-12T09:11:35.746 INFO:tasks.workunit.client.1.smithi203.stdout:9/618: dread d8/d12/d23/d85/f1d [0,4194304] 0 2024-04-12T09:11:35.746 INFO:tasks.workunit.client.1.smithi203.stdout:5/800: read d0/d6/d16/d9/d30/d58/d74/fa3 [10362,33478] 0 2024-04-12T09:11:35.747 INFO:tasks.workunit.client.1.smithi203.stdout:9/619: write d8/d12/d23/d27/fbc [298615,103060] 0 2024-04-12T09:11:35.750 INFO:tasks.workunit.client.1.smithi203.stdout:9/620: fdatasync d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/f61 0 2024-04-12T09:11:35.751 INFO:tasks.workunit.client.1.smithi203.stdout:4/777: rename d1a/d21/d22/d2e/f3c to d1a/d21/f100 0 2024-04-12T09:11:35.754 INFO:tasks.workunit.client.1.smithi203.stdout:6/627: rmdir d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43 39 2024-04-12T09:11:35.754 INFO:tasks.workunit.client.1.smithi203.stdout:6/628: chown d1/df/cbb 1 1 2024-04-12T09:11:35.755 INFO:tasks.workunit.client.1.smithi203.stdout:6/629: chown d1/d3/d12/l5c 0 1 2024-04-12T09:11:35.755 INFO:tasks.workunit.client.1.smithi203.stdout:6/630: readlink d1/l80 0 2024-04-12T09:11:35.764 INFO:tasks.workunit.client.1.smithi203.stdout:0/785: dread d0/dd/d71/d94/d2f/d17/fc [0,4194304] 0 2024-04-12T09:11:35.768 INFO:tasks.workunit.client.1.smithi203.stdout:4/778: symlink d1a/d21/d22/d2e/d8d/d9b/dbc/dc7/l101 0 2024-04-12T09:11:35.769 INFO:tasks.workunit.client.1.smithi203.stdout:4/779: write d1a/d20/fa4 [167553,110222] 0 2024-04-12T09:11:35.769 INFO:tasks.workunit.client.1.smithi203.stdout:2/749: link d0/d54/d61/d82/fb5 d0/d14/d1e/d57/da1/f10c 0 2024-04-12T09:11:35.770 INFO:tasks.workunit.client.1.smithi203.stdout:1/748: dread df/d2d/d6f/d75/d80/f26 [0,4194304] 0 2024-04-12T09:11:35.772 INFO:tasks.workunit.client.1.smithi203.stdout:2/750: write d0/d14/d74/f84 [2196879,40709] 0 2024-04-12T09:11:35.772 INFO:tasks.workunit.client.1.smithi203.stdout:1/749: write df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/f81 [85434,41950] 0 2024-04-12T09:11:35.773 INFO:tasks.workunit.client.1.smithi203.stdout:7/734: dread d0/f40 [0,4194304] 0 2024-04-12T09:11:35.775 INFO:tasks.workunit.client.1.smithi203.stdout:7/735: write d0/d38/d51/fa4 [4822842,28203] 0 2024-04-12T09:11:35.777 INFO:tasks.workunit.client.1.smithi203.stdout:5/801: creat d0/d6/d11/d1e/d4c/d48/de4/f123 x:0 0 0 2024-04-12T09:11:35.782 INFO:tasks.workunit.client.1.smithi203.stdout:8/657: link d4/d34/l3d d4/d8/d37/ld3 0 2024-04-12T09:11:35.783 INFO:tasks.workunit.client.1.smithi203.stdout:3/653: getdents d2/d8 0 2024-04-12T09:11:35.784 INFO:tasks.workunit.client.1.smithi203.stdout:8/658: write d4/d8/f50 [2702918,93592] 0 2024-04-12T09:11:35.785 INFO:tasks.workunit.client.1.smithi203.stdout:4/780: dwrite d1a/d21/d22/ff5 [0,4194304] 0 2024-04-12T09:11:35.787 INFO:tasks.workunit.client.1.smithi203.stdout:4/781: stat d1a/d20/d5d/d2c/d72 0 2024-04-12T09:11:35.787 INFO:tasks.workunit.client.1.smithi203.stdout:1/750: symlink df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/le5 0 2024-04-12T09:11:35.789 INFO:tasks.workunit.client.1.smithi203.stdout:1/751: write df/d2d/d6f/d75/d80/d54/d5d/d90/dc7/fc8 [223933,18163] 0 2024-04-12T09:11:35.794 INFO:tasks.workunit.client.1.smithi203.stdout:7/736: write d0/d15/d2d/d5e/d8c/f91 [700651,39480] 0 2024-04-12T09:11:35.796 INFO:tasks.workunit.client.1.smithi203.stdout:2/751: dwrite d0/d14/d23/d3d/ffa [0,4194304] 0 2024-04-12T09:11:35.797 INFO:tasks.workunit.client.1.smithi203.stdout:8/659: creat d4/d8/d74/da6/fd4 x:0 0 0 2024-04-12T09:11:35.798 INFO:tasks.workunit.client.1.smithi203.stdout:3/654: creat d2/d8/d14/d23/d35/d4c/d5c/dc3/fd3 x:0 0 0 2024-04-12T09:11:35.799 INFO:tasks.workunit.client.1.smithi203.stdout:4/782: stat d1a/d21/d22/d2e/d78/cd1 0 2024-04-12T09:11:35.799 INFO:tasks.workunit.client.1.smithi203.stdout:1/752: stat df/d2d/d6f/lc0 0 2024-04-12T09:11:35.800 INFO:tasks.workunit.client.1.smithi203.stdout:4/783: chown d1a/d21/d22/d2e/d78/ca7 16340669 1 2024-04-12T09:11:35.801 INFO:tasks.workunit.client.1.smithi203.stdout:0/786: creat d0/dd/d71/f100 x:0 0 0 2024-04-12T09:11:35.801 INFO:tasks.workunit.client.1.smithi203.stdout:5/802: truncate d0/d6/f22 719965 0 2024-04-12T09:11:35.801 INFO:tasks.workunit.client.1.smithi203.stdout:4/784: readlink d1a/d21/d22/d2e/d8b/l9e 0 2024-04-12T09:11:35.802 INFO:tasks.workunit.client.1.smithi203.stdout:5/803: fdatasync d0/d6/d16/d9/f63 0 2024-04-12T09:11:35.804 INFO:tasks.workunit.client.1.smithi203.stdout:7/737: symlink d0/d4/d54/d75/dc0/lfc 0 2024-04-12T09:11:35.805 INFO:tasks.workunit.client.1.smithi203.stdout:2/752: rmdir d0/d67/d86 39 2024-04-12T09:11:35.809 INFO:tasks.workunit.client.1.smithi203.stdout:0/787: mkdir d0/d48/d5e/dca/d101 0 2024-04-12T09:11:35.812 INFO:tasks.workunit.client.1.smithi203.stdout:5/804: rename d0/d6/d16/d44/dda/f115 to d0/d6/d16/d11f/f124 0 2024-04-12T09:11:35.813 INFO:tasks.workunit.client.1.smithi203.stdout:7/738: read d0/d34/d7c/fe9 [613156,11683] 0 2024-04-12T09:11:35.814 INFO:tasks.workunit.client.1.smithi203.stdout:7/739: stat d0/d4/d1c/cca 0 2024-04-12T09:11:35.816 INFO:tasks.workunit.client.1.smithi203.stdout:0/788: readlink d0/dd/d71/d94/d2f/l1c 0 2024-04-12T09:11:35.817 INFO:tasks.workunit.client.1.smithi203.stdout:4/785: mkdir d1a/d21/d22/d102 0 2024-04-12T09:11:35.818 INFO:tasks.workunit.client.1.smithi203.stdout:4/786: dread - d1a/d21/d60/daa/dc5/ddc/fe9 zero size 2024-04-12T09:11:35.819 INFO:tasks.workunit.client.1.smithi203.stdout:5/805: mknod d0/d6/d11/dd3/c125 0 2024-04-12T09:11:35.820 INFO:tasks.workunit.client.1.smithi203.stdout:8/660: link d4/d8/f1d d4/d8/d1c/d5d/dc0/fd5 0 2024-04-12T09:11:35.821 INFO:tasks.workunit.client.1.smithi203.stdout:0/789: mkdir d0/d48/dc1/d102 0 2024-04-12T09:11:35.821 INFO:tasks.workunit.client.1.smithi203.stdout:8/661: fsync d4/d8/d81/d84/fa4 0 2024-04-12T09:11:35.822 INFO:tasks.workunit.client.1.smithi203.stdout:1/753: dread df/d2d/d6f/d75/d80/d2b/f52 [0,4194304] 0 2024-04-12T09:11:35.823 INFO:tasks.workunit.client.1.smithi203.stdout:4/787: mkdir d1a/d21/d60/daa/d103 0 2024-04-12T09:11:35.827 INFO:tasks.workunit.client.1.smithi203.stdout:8/662: dread - d4/d8/d74/d78/fd2 zero size 2024-04-12T09:11:35.830 INFO:tasks.workunit.client.1.smithi203.stdout:0/790: rename d0/dd/d71/d94/d2f/d17/l28 to d0/d59/d5d/d79/l103 0 2024-04-12T09:11:35.831 INFO:tasks.workunit.client.1.smithi203.stdout:2/753: dwrite d0/d3/f8 [0,4194304] 0 2024-04-12T09:11:35.832 INFO:tasks.workunit.client.1.smithi203.stdout:0/791: write d0/f3 [4838889,38732] 0 2024-04-12T09:11:35.839 INFO:tasks.workunit.client.1.smithi203.stdout:1/754: creat df/d2d/d6d/fe6 x:0 0 0 2024-04-12T09:11:35.840 INFO:tasks.workunit.client.1.smithi203.stdout:2/754: dwrite d0/d14/d74/d96/d9a/faa [0,4194304] 0 2024-04-12T09:11:35.841 INFO:tasks.workunit.client.1.smithi203.stdout:2/755: write d0/d14/d74/f9d [300460,126620] 0 2024-04-12T09:11:35.843 INFO:tasks.workunit.client.1.smithi203.stdout:2/756: chown d0/d14/f22 3439 1 2024-04-12T09:11:35.846 INFO:tasks.workunit.client.1.smithi203.stdout:2/757: write d0/d14/d23/f2d [2820076,9057] 0 2024-04-12T09:11:35.847 INFO:tasks.workunit.client.1.smithi203.stdout:1/755: symlink df/d2d/d6f/d75/d80/d54/d5d/d90/le7 0 2024-04-12T09:11:35.849 INFO:tasks.workunit.client.1.smithi203.stdout:5/806: dwrite d0/d6/d11/d18/d2a/f2b [0,4194304] 0 2024-04-12T09:11:35.850 INFO:tasks.workunit.client.1.smithi203.stdout:8/663: rename d4/d8/d37/c96 to d4/cd6 0 2024-04-12T09:11:35.853 INFO:tasks.workunit.client.1.smithi203.stdout:2/758: read - d0/d67/d86/fb1 zero size 2024-04-12T09:11:35.856 INFO:tasks.workunit.client.1.smithi203.stdout:2/759: rmdir d0/d14/d1e/d2a 39 2024-04-12T09:11:35.857 INFO:tasks.workunit.client.1.smithi203.stdout:1/756: dwrite df/d2d/d6f/d75/d80/d2b/fbc [0,4194304] 0 2024-04-12T09:11:35.859 INFO:tasks.workunit.client.1.smithi203.stdout:8/664: dwrite d4/d8/f7b [0,4194304] 0 2024-04-12T09:11:35.863 INFO:tasks.workunit.client.1.smithi203.stdout:0/792: rename d0/dd/d71/d94/d2f/f1e to d0/d48/f104 0 2024-04-12T09:11:35.867 INFO:tasks.workunit.client.1.smithi203.stdout:5/807: creat d0/d6/d16/d9/d30/d58/d74/d88/f126 x:0 0 0 2024-04-12T09:11:35.870 INFO:tasks.workunit.client.1.smithi203.stdout:8/665: rename d4/d8/d81/d84/fb9 to d4/d8/d81/d84/d92/fd7 0 2024-04-12T09:11:35.872 INFO:tasks.workunit.client.1.smithi203.stdout:8/666: fsync d4/d8/d1c/d5d/f60 0 2024-04-12T09:11:35.874 INFO:tasks.workunit.client.1.smithi203.stdout:2/760: dwrite d0/d14/d1e/d2a/f5d [0,4194304] 0 2024-04-12T09:11:35.874 INFO:tasks.workunit.client.1.smithi203.stdout:0/793: creat d0/dd/d71/d94/d2f/d17/d19/d6f/f105 x:0 0 0 2024-04-12T09:11:35.877 INFO:tasks.workunit.client.1.smithi203.stdout:2/761: read d0/d54/d61/d82/fb5 [525511,12735] 0 2024-04-12T09:11:35.881 INFO:tasks.workunit.client.1.smithi203.stdout:0/794: dread d0/dd/d71/d94/d2f/d17/f60 [0,4194304] 0 2024-04-12T09:11:35.888 INFO:tasks.workunit.client.1.smithi203.stdout:8/667: truncate d4/f2d 4167340 0 2024-04-12T09:11:35.889 INFO:tasks.workunit.client.1.smithi203.stdout:2/762: symlink d0/d67/d86/df6/l10d 0 2024-04-12T09:11:35.890 INFO:tasks.workunit.client.1.smithi203.stdout:2/763: stat d0/d14/d23/d33/f83 0 2024-04-12T09:11:35.896 INFO:tasks.workunit.client.1.smithi203.stdout:8/668: mknod d4/d8/d37/cd8 0 2024-04-12T09:11:35.896 INFO:tasks.workunit.client.1.smithi203.stdout:2/764: unlink d0/d3/d47/fc1 0 2024-04-12T09:11:35.897 INFO:tasks.workunit.client.1.smithi203.stdout:2/765: chown d0/fd5 418 1 2024-04-12T09:11:35.898 INFO:tasks.workunit.client.1.smithi203.stdout:8/669: mknod d4/d8/d81/d8e/cd9 0 2024-04-12T09:11:35.901 INFO:tasks.workunit.client.1.smithi203.stdout:8/670: write d4/d8/f7b [3016677,57335] 0 2024-04-12T09:11:35.903 INFO:tasks.workunit.client.1.smithi203.stdout:8/671: write d4/d8/d37/d57/f90 [579822,122817] 0 2024-04-12T09:11:35.903 INFO:tasks.workunit.client.1.smithi203.stdout:5/808: dread d0/d6/d11/d38/f84 [0,4194304] 0 2024-04-12T09:11:35.905 INFO:tasks.workunit.client.1.smithi203.stdout:5/809: chown d0/d6/d11/d18/d2a/dc8/fce 1767 1 2024-04-12T09:11:35.907 INFO:tasks.workunit.client.1.smithi203.stdout:8/672: symlink d4/d8/d74/db6/lda 0 2024-04-12T09:11:35.909 INFO:tasks.workunit.client.1.smithi203.stdout:8/673: chown d4/d8/d81/d8e/cbd 7 1 2024-04-12T09:11:35.910 INFO:tasks.workunit.client.1.smithi203.stdout:5/810: rmdir d0/d6/d9b 39 2024-04-12T09:11:35.917 INFO:tasks.workunit.client.1.smithi203.stdout:8/674: dwrite d4/d8/f50 [0,4194304] 0 2024-04-12T09:11:35.922 INFO:tasks.workunit.client.1.smithi203.stdout:8/675: write d4/d8/d1c/d5d/dc0/fcd [598425,108939] 0 2024-04-12T09:11:35.924 INFO:tasks.workunit.client.1.smithi203.stdout:8/676: creat d4/d8/d1c/d5d/dc0/fdb x:0 0 0 2024-04-12T09:11:35.924 INFO:tasks.workunit.client.1.smithi203.stdout:8/677: stat d4/d8/d37/l6f 0 2024-04-12T09:11:35.925 INFO:tasks.workunit.client.1.smithi203.stdout:8/678: read - d4/d8/d74/d78/d53/d8f/fa0 zero size 2024-04-12T09:11:35.930 INFO:tasks.workunit.client.1.smithi203.stdout:8/679: mkdir d4/d8/d81/d84/d92/ddc 0 2024-04-12T09:11:35.934 INFO:tasks.workunit.client.1.smithi203.stdout:8/680: creat d4/d8/d81/d84/d92/fdd x:0 0 0 2024-04-12T09:11:35.939 INFO:tasks.workunit.client.1.smithi203.stdout:8/681: link d4/d8/d74/d78/c22 d4/d8/d81/d84/d92/ddc/cde 0 2024-04-12T09:11:35.941 INFO:tasks.workunit.client.1.smithi203.stdout:0/795: dwrite d0/dd/d71/d94/d2f/f8f [0,4194304] 0 2024-04-12T09:11:35.945 INFO:tasks.workunit.client.1.smithi203.stdout:0/796: symlink d0/dd/d71/d94/d65/l106 0 2024-04-12T09:11:35.945 INFO:tasks.workunit.client.1.smithi203.stdout:8/682: dread d4/d8/d37/fb7 [0,4194304] 0 2024-04-12T09:11:35.946 INFO:tasks.workunit.client.1.smithi203.stdout:8/683: read d4/d8/d74/d78/f6d [32177,126312] 0 2024-04-12T09:11:35.947 INFO:tasks.workunit.client.1.smithi203.stdout:0/797: mknod d0/dd/d5b/d9f/c107 0 2024-04-12T09:11:35.951 INFO:tasks.workunit.client.1.smithi203.stdout:8/684: dread d4/d34/f47 [0,4194304] 0 2024-04-12T09:11:35.953 INFO:tasks.workunit.client.1.smithi203.stdout:8/685: write d4/d8/d74/da6/fd4 [804601,93571] 0 2024-04-12T09:11:35.954 INFO:tasks.workunit.client.1.smithi203.stdout:0/798: rename d0/dd/d71/d94/d2f/d4c/l92 to d0/dd/d71/d94/l108 0 2024-04-12T09:11:35.954 INFO:tasks.workunit.client.1.smithi203.stdout:8/686: write d4/d8/d1c/d5d/fad [7320,75636] 0 2024-04-12T09:11:35.958 INFO:tasks.workunit.client.1.smithi203.stdout:2/766: getdents d0/d3/d47 0 2024-04-12T09:11:35.960 INFO:tasks.workunit.client.1.smithi203.stdout:0/799: dwrite d0/d48/d5e/f75 [0,4194304] 0 2024-04-12T09:11:35.964 INFO:tasks.workunit.client.1.smithi203.stdout:8/687: unlink d4/d8/d74/da6/fc5 0 2024-04-12T09:11:35.965 INFO:tasks.workunit.client.1.smithi203.stdout:2/767: mkdir d0/d3/d8f/d10e 0 2024-04-12T09:11:35.965 INFO:tasks.workunit.client.1.smithi203.stdout:5/811: write d0/d6/d16/d9/d30/fa7 [750648,15105] 0 2024-04-12T09:11:35.968 INFO:tasks.workunit.client.1.smithi203.stdout:5/812: dread - d0/d6/d11/d1e/d4c/d48/fc9 zero size 2024-04-12T09:11:35.968 INFO:tasks.workunit.client.1.smithi203.stdout:0/800: dwrite d0/d48/d5e/d84/feb [0,4194304] 0 2024-04-12T09:11:35.978 INFO:tasks.workunit.client.1.smithi203.stdout:2/768: symlink d0/d3/d47/l10f 0 2024-04-12T09:11:35.981 INFO:tasks.workunit.client.1.smithi203.stdout:8/688: mkdir d4/ddf 0 2024-04-12T09:11:35.981 INFO:tasks.workunit.client.1.smithi203.stdout:5/813: fdatasync d0/d6/d16/d11f/f124 0 2024-04-12T09:11:35.982 INFO:tasks.workunit.client.1.smithi203.stdout:0/801: mknod d0/dd/d71/d94/d2f/d17/d19/d6f/c109 0 2024-04-12T09:11:35.983 INFO:tasks.workunit.client.1.smithi203.stdout:2/769: rmdir d0/d14 39 2024-04-12T09:11:35.985 INFO:tasks.workunit.client.1.smithi203.stdout:0/802: creat d0/dd/d5b/d90/f10a x:0 0 0 2024-04-12T09:11:35.988 INFO:tasks.workunit.client.1.smithi203.stdout:0/803: mknod d0/dd/d5b/d90/c10b 0 2024-04-12T09:11:35.989 INFO:tasks.workunit.client.1.smithi203.stdout:2/770: mkdir d0/d14/d1e/d57/da1/d110 0 2024-04-12T09:11:35.990 INFO:tasks.workunit.client.1.smithi203.stdout:8/689: getdents d4/d8/d1c/d48 0 2024-04-12T09:11:35.993 INFO:tasks.workunit.client.1.smithi203.stdout:2/771: truncate d0/d14/d74/f7d 317305 0 2024-04-12T09:11:35.994 INFO:tasks.workunit.client.1.smithi203.stdout:6/631: sync 2024-04-12T09:11:35.994 INFO:tasks.workunit.client.1.smithi203.stdout:9/621: sync 2024-04-12T09:11:35.994 INFO:tasks.workunit.client.1.smithi203.stdout:2/772: readlink d0/d14/d23/l9f 0 2024-04-12T09:11:35.995 INFO:tasks.workunit.client.1.smithi203.stdout:5/814: dread d0/d6/d16/d9/d30/d58/d74/fc3 [0,4194304] 0 2024-04-12T09:11:35.996 INFO:tasks.workunit.client.1.smithi203.stdout:6/632: fdatasync d1/d3/d12/f84 0 2024-04-12T09:11:35.998 INFO:tasks.workunit.client.1.smithi203.stdout:8/690: dwrite d4/d8/fc3 [0,4194304] 0 2024-04-12T09:11:35.998 INFO:tasks.workunit.client.1.smithi203.stdout:9/622: readlink d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/ld6 0 2024-04-12T09:11:35.999 INFO:tasks.workunit.client.1.smithi203.stdout:2/773: read d0/d14/d1e/d2a/dcd/dfc/d10b/fd2 [1543523,28175] 0 2024-04-12T09:11:36.001 INFO:tasks.workunit.client.1.smithi203.stdout:5/815: mkdir d0/d6/d16/d127 0 2024-04-12T09:11:36.003 INFO:tasks.workunit.client.1.smithi203.stdout:8/691: unlink d4/f6 0 2024-04-12T09:11:36.008 INFO:tasks.workunit.client.1.smithi203.stdout:9/623: dread d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/f5a [0,4194304] 0 2024-04-12T09:11:36.009 INFO:tasks.workunit.client.1.smithi203.stdout:5/816: mkdir d0/d6/d11/d18/dcc/d128 0 2024-04-12T09:11:36.009 INFO:tasks.workunit.client.1.smithi203.stdout:2/774: stat d0/d14/d74/f7d 0 2024-04-12T09:11:36.011 INFO:tasks.workunit.client.1.smithi203.stdout:9/624: rmdir d8/d3b 39 2024-04-12T09:11:36.014 INFO:tasks.workunit.client.1.smithi203.stdout:2/775: creat d0/d14/d23/d3d/f111 x:0 0 0 2024-04-12T09:11:36.018 INFO:tasks.workunit.client.1.smithi203.stdout:0/804: getdents d0/dd/d5b/d90 0 2024-04-12T09:11:36.023 INFO:tasks.workunit.client.1.smithi203.stdout:0/805: dwrite d0/d48/fef [0,4194304] 0 2024-04-12T09:11:36.024 INFO:tasks.workunit.client.1.smithi203.stdout:6/633: write d1/d3/d12/f1e [357675,47606] 0 2024-04-12T09:11:36.028 INFO:tasks.workunit.client.1.smithi203.stdout:9/625: creat d8/d12/d23/d38/fd9 x:0 0 0 2024-04-12T09:11:36.035 INFO:tasks.workunit.client.1.smithi203.stdout:2/776: creat d0/d67/d86/dd9/dfd/f112 x:0 0 0 2024-04-12T09:11:36.036 INFO:tasks.workunit.client.1.smithi203.stdout:2/777: write d0/d67/d86/fb1 [283273,93960] 0 2024-04-12T09:11:36.037 INFO:tasks.workunit.client.1.smithi203.stdout:2/778: fdatasync d0/d14/d1e/d2a/fc5 0 2024-04-12T09:11:36.038 INFO:tasks.workunit.client.1.smithi203.stdout:6/634: dread d1/d3/d26/d30/d4a/f7d [0,4194304] 0 2024-04-12T09:11:36.038 INFO:tasks.workunit.client.1.smithi203.stdout:2/779: stat d0/fc 0 2024-04-12T09:11:36.041 INFO:tasks.workunit.client.1.smithi203.stdout:5/817: getdents d0/daf 0 2024-04-12T09:11:36.043 INFO:tasks.workunit.client.1.smithi203.stdout:0/806: mkdir d0/dd/d71/d94/d65/dbb/d10c 0 2024-04-12T09:11:36.046 INFO:tasks.workunit.client.1.smithi203.stdout:9/626: symlink d8/d12/d23/d85/lda 0 2024-04-12T09:11:36.049 INFO:tasks.workunit.client.1.smithi203.stdout:0/807: dwrite d0/d48/d5e/dca/fe8 [0,4194304] 0 2024-04-12T09:11:36.050 INFO:tasks.workunit.client.1.smithi203.stdout:6/635: rmdir d1/d3 39 2024-04-12T09:11:36.055 INFO:tasks.workunit.client.1.smithi203.stdout:5/818: creat d0/d6/d11/d1e/d4c/f129 x:0 0 0 2024-04-12T09:11:36.062 INFO:tasks.workunit.client.1.smithi203.stdout:6/636: unlink d1/l22 0 2024-04-12T09:11:36.063 INFO:tasks.workunit.client.1.smithi203.stdout:6/637: stat d1/f37 0 2024-04-12T09:11:36.064 INFO:tasks.workunit.client.1.smithi203.stdout:0/808: rename d0/dd/d71/d94/d2f/d17/d19/d6f/d78/dcd/cf7 to d0/d48/d5e/d84/c10d 0 2024-04-12T09:11:36.069 INFO:tasks.workunit.client.1.smithi203.stdout:9/627: mkdir d8/d12/d23/d38/d8a/d97/d9e/ddb 0 2024-04-12T09:11:36.072 INFO:tasks.workunit.client.1.smithi203.stdout:0/809: symlink d0/d48/dc1/l10e 0 2024-04-12T09:11:36.073 INFO:tasks.workunit.client.1.smithi203.stdout:2/780: creat d0/d14/d23/f113 x:0 0 0 2024-04-12T09:11:36.074 INFO:tasks.workunit.client.1.smithi203.stdout:2/781: dread - d0/d14/d1e/d2a/dcd/dfc/d9c/fae zero size 2024-04-12T09:11:36.075 INFO:tasks.workunit.client.1.smithi203.stdout:5/819: mkdir d0/d6/d16/d9/d12a 0 2024-04-12T09:11:36.077 INFO:tasks.workunit.client.1.smithi203.stdout:9/628: rename d8/d12/da1/cc0 to d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d40/db8/cdc 0 2024-04-12T09:11:36.077 INFO:tasks.workunit.client.1.smithi203.stdout:9/629: dread - d8/d12/d23/fd7 zero size 2024-04-12T09:11:36.077 INFO:tasks.workunit.client.1.smithi203.stdout:6/638: dread - d1/d3/d26/d5d/f82 zero size 2024-04-12T09:11:36.079 INFO:tasks.workunit.client.1.smithi203.stdout:0/810: creat d0/dd/d5b/d90/f10f x:0 0 0 2024-04-12T09:11:36.083 INFO:tasks.workunit.client.1.smithi203.stdout:5/820: mkdir d0/d6/d16/d9/d80/df2/d104/d2d/d12b 0 2024-04-12T09:11:36.084 INFO:tasks.workunit.client.1.smithi203.stdout:5/821: dread - d0/d6/d11/d18/d1a/d23/f111 zero size 2024-04-12T09:11:36.095 INFO:tasks.workunit.client.1.smithi203.stdout:5/822: dwrite d0/d6/d9b/fcf [0,4194304] 0 2024-04-12T09:11:36.097 INFO:tasks.workunit.client.1.smithi203.stdout:5/823: write d0/d6/d11/d18/d2a/f2b [2402028,63818] 0 2024-04-12T09:11:36.102 INFO:tasks.workunit.client.1.smithi203.stdout:0/811: link d0/dd/d71/d94/d2f/f33 d0/dd/d71/d94/d2f/d34/db1/f110 0 2024-04-12T09:11:36.102 INFO:tasks.workunit.client.1.smithi203.stdout:3/655: sync 2024-04-12T09:11:36.102 INFO:tasks.workunit.client.1.smithi203.stdout:4/788: sync 2024-04-12T09:11:36.102 INFO:tasks.workunit.client.1.smithi203.stdout:7/740: sync 2024-04-12T09:11:36.107 INFO:tasks.workunit.client.1.smithi203.stdout:9/630: creat d8/d12/d3e/fdd x:0 0 0 2024-04-12T09:11:36.108 INFO:tasks.workunit.client.1.smithi203.stdout:4/789: dwrite d1a/d20/fab [0,4194304] 0 2024-04-12T09:11:36.110 INFO:tasks.workunit.client.1.smithi203.stdout:5/824: mknod d0/d6/d16/d44/c12c 0 2024-04-12T09:11:36.112 INFO:tasks.workunit.client.1.smithi203.stdout:0/812: symlink d0/d59/l111 0 2024-04-12T09:11:36.113 INFO:tasks.workunit.client.1.smithi203.stdout:2/782: truncate d0/d14/d1e/d57/da1/fef 3395197 0 2024-04-12T09:11:36.115 INFO:tasks.workunit.client.1.smithi203.stdout:7/741: mknod d0/d34/cfd 0 2024-04-12T09:11:36.122 INFO:tasks.workunit.client.1.smithi203.stdout:5/825: mknod d0/dbd/dd0/c12d 0 2024-04-12T09:11:36.123 INFO:tasks.workunit.client.1.smithi203.stdout:5/826: chown d0/daf 167777 1 2024-04-12T09:11:36.123 INFO:tasks.workunit.client.1.smithi203.stdout:5/827: chown d0/d6/d11/d18/l98 3599 1 2024-04-12T09:11:36.132 INFO:tasks.workunit.client.1.smithi203.stdout:6/639: getdents d1/df 0 2024-04-12T09:11:36.138 INFO:tasks.workunit.client.1.smithi203.stdout:9/631: getdents d8/d12/d23/d38/d8a/d97 0 2024-04-12T09:11:36.140 INFO:tasks.workunit.client.1.smithi203.stdout:2/783: write d0/d14/d1e/d2a/dcd/dfc/f44 [4704656,85371] 0 2024-04-12T09:11:36.146 INFO:tasks.workunit.client.1.smithi203.stdout:3/656: getdents d2/d8/d14/d23/d35/d91/d81 0 2024-04-12T09:11:36.149 INFO:tasks.workunit.client.1.smithi203.stdout:4/790: getdents d1a/d21/d60/daa/dc5 0 2024-04-12T09:11:36.156 INFO:tasks.workunit.client.1.smithi203.stdout:5/828: rename d0/d6/d11/l20 to d0/l12e 0 2024-04-12T09:11:36.161 INFO:tasks.workunit.client.1.smithi203.stdout:0/813: link d0/dd/d5b/cd9 d0/d48/c112 0 2024-04-12T09:11:36.163 INFO:tasks.workunit.client.1.smithi203.stdout:6/640: link d1/d3/d26/d30/d4a/d6c/d45/d55/d77/la4 d1/d3/d4/lc7 0 2024-04-12T09:11:36.163 INFO:tasks.workunit.client.1.smithi203.stdout:3/657: dread d2/d51/d65/f77 [0,4194304] 0 2024-04-12T09:11:36.164 INFO:tasks.workunit.client.1.smithi203.stdout:0/814: write d0/dd/d71/d94/d2f/d17/d19/d6f/dcb/fd2 [1507355,94498] 0 2024-04-12T09:11:36.167 INFO:tasks.workunit.client.1.smithi203.stdout:0/815: chown d0/dd/d5b/d90/f10a 144506847 1 2024-04-12T09:11:36.167 INFO:tasks.workunit.client.1.smithi203.stdout:9/632: dread d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/f82 [0,4194304] 0 2024-04-12T09:11:36.169 INFO:tasks.workunit.client.1.smithi203.stdout:1/757: sync 2024-04-12T09:11:36.169 INFO:tasks.workunit.client.1.smithi203.stdout:8/692: sync 2024-04-12T09:11:36.169 INFO:tasks.workunit.client.1.smithi203.stdout:2/784: dwrite d0/d3/fd [0,4194304] 0 2024-04-12T09:11:36.169 INFO:tasks.workunit.client.1.smithi203.stdout:5/829: creat d0/d6/d16/d9/d80/df2/f12f x:0 0 0 2024-04-12T09:11:36.169 INFO:tasks.workunit.client.1.smithi203.stdout:8/693: chown d4/d8/c99 8400 1 2024-04-12T09:11:36.173 INFO:tasks.workunit.client.1.smithi203.stdout:5/830: dread d0/d6/d16/d8/fee [0,4194304] 0 2024-04-12T09:11:36.174 INFO:tasks.workunit.client.1.smithi203.stdout:5/831: dread - d0/d6/d11/d18/d1a/f91 zero size 2024-04-12T09:11:36.175 INFO:tasks.workunit.client.1.smithi203.stdout:5/832: write d0/f21 [4081770,106343] 0 2024-04-12T09:11:36.176 INFO:tasks.workunit.client.1.smithi203.stdout:5/833: chown d0/d6/d16/d44/c95 0 1 2024-04-12T09:11:36.184 INFO:tasks.workunit.client.1.smithi203.stdout:0/816: fdatasync d0/d48/f104 0 2024-04-12T09:11:36.185 INFO:tasks.workunit.client.1.smithi203.stdout:2/785: unlink d0/d14/d1e/d2a/f52 0 2024-04-12T09:11:36.185 INFO:tasks.workunit.client.1.smithi203.stdout:7/742: sync 2024-04-12T09:11:36.186 INFO:tasks.workunit.client.1.smithi203.stdout:8/694: creat d4/d8/d74/d78/d53/fe0 x:0 0 0 2024-04-12T09:11:36.186 INFO:tasks.workunit.client.1.smithi203.stdout:2/786: dread - d0/d54/d61/db7/fc7 zero size 2024-04-12T09:11:36.187 INFO:tasks.workunit.client.1.smithi203.stdout:4/791: link d1a/d21/d60/d68/dbe/ce2 d1a/d20/d5d/d2c/d72/c104 0 2024-04-12T09:11:36.189 INFO:tasks.workunit.client.1.smithi203.stdout:3/658: mkdir d2/d8/d14/d1b/d2f/dd4 0 2024-04-12T09:11:36.190 INFO:tasks.workunit.client.1.smithi203.stdout:8/695: read d4/d8/d74/d78/f2e [312188,18486] 0 2024-04-12T09:11:36.192 INFO:tasks.workunit.client.1.smithi203.stdout:8/696: stat d4/d8/d1c/d48/fc6 0 2024-04-12T09:11:36.193 INFO:tasks.workunit.client.1.smithi203.stdout:8/697: write d4/f1f [4093921,51119] 0 2024-04-12T09:11:36.193 INFO:tasks.workunit.client.1.smithi203.stdout:2/787: dwrite d0/d14/d1e/d57/d95/fb0 [0,4194304] 0 2024-04-12T09:11:36.194 INFO:tasks.workunit.client.1.smithi203.stdout:6/641: symlink d1/d3/d26/d30/d4a/d6c/d45/lc8 0 2024-04-12T09:11:36.196 INFO:tasks.workunit.client.1.smithi203.stdout:8/698: stat d4/d8/d74/da6/lb0 0 2024-04-12T09:11:36.199 INFO:tasks.workunit.client.1.smithi203.stdout:7/743: dread d0/d4/f43 [0,4194304] 0 2024-04-12T09:11:36.199 INFO:tasks.workunit.client.1.smithi203.stdout:7/744: readlink d0/d15/l42 0 2024-04-12T09:11:36.214 INFO:tasks.workunit.client.1.smithi203.stdout:1/758: mknod df/d2d/d6f/d75/d80/ce8 0 2024-04-12T09:11:36.220 INFO:tasks.workunit.client.1.smithi203.stdout:0/817: dwrite d0/dd/f99 [4194304,4194304] 0 2024-04-12T09:11:36.223 INFO:tasks.workunit.client.1.smithi203.stdout:6/642: creat d1/d3/d5b/d8c/d3e/da1/fc9 x:0 0 0 2024-04-12T09:11:36.224 INFO:tasks.workunit.client.1.smithi203.stdout:2/788: rmdir d0/d14/d1e/d57/d95/dd6/d100 39 2024-04-12T09:11:36.225 INFO:tasks.workunit.client.1.smithi203.stdout:6/643: write d1/d3/d5b/d8c/f66 [4301759,72112] 0 2024-04-12T09:11:36.225 INFO:tasks.workunit.client.1.smithi203.stdout:2/789: chown d0/d14/f22 1936444 1 2024-04-12T09:11:36.226 INFO:tasks.workunit.client.1.smithi203.stdout:9/633: getdents d8/d12/d23/d41 0 2024-04-12T09:11:36.232 INFO:tasks.workunit.client.1.smithi203.stdout:1/759: truncate df/f35 104599 0 2024-04-12T09:11:36.241 INFO:tasks.workunit.client.1.smithi203.stdout:0/818: mknod d0/dd/d71/d94/d2f/d4c/d7a/c113 0 2024-04-12T09:11:36.242 INFO:tasks.workunit.client.1.smithi203.stdout:7/745: symlink d0/d4/d1c/d5b/lfe 0 2024-04-12T09:11:36.243 INFO:tasks.workunit.client.1.smithi203.stdout:5/834: dread d0/f21 [0,4194304] 0 2024-04-12T09:11:36.246 INFO:tasks.workunit.client.1.smithi203.stdout:7/746: fdatasync d0/d34/d7c/fe9 0 2024-04-12T09:11:36.247 INFO:tasks.workunit.client.1.smithi203.stdout:7/747: readlink d0/d15/d2d/l2f 0 2024-04-12T09:11:36.248 INFO:tasks.workunit.client.1.smithi203.stdout:6/644: fsync d1/d3/d26/d30/d4a/d6c/d45/f52 0 2024-04-12T09:11:36.257 INFO:tasks.workunit.client.1.smithi203.stdout:0/819: creat d0/d48/d5e/dca/d101/f114 x:0 0 0 2024-04-12T09:11:36.257 INFO:tasks.workunit.client.1.smithi203.stdout:0/820: readlink d0/d59/lc7 0 2024-04-12T09:11:36.258 INFO:tasks.workunit.client.1.smithi203.stdout:8/699: dread d4/d8/d1c/d5d/f60 [0,4194304] 0 2024-04-12T09:11:36.258 INFO:tasks.workunit.client.1.smithi203.stdout:0/821: dread - d0/dd/d71/f100 zero size 2024-04-12T09:11:36.259 INFO:tasks.workunit.client.1.smithi203.stdout:8/700: chown d4/d8/d81/d8e/fa1 143579 1 2024-04-12T09:11:36.264 INFO:tasks.workunit.client.1.smithi203.stdout:8/701: dwrite d4/d8/d1c/d5d/dc0/fdb [0,4194304] 0 2024-04-12T09:11:36.264 INFO:tasks.workunit.client.1.smithi203.stdout:5/835: mknod d0/d6/d11/d18/c130 0 2024-04-12T09:11:36.265 INFO:tasks.workunit.client.1.smithi203.stdout:3/659: truncate d2/d64/f80 131196 0 2024-04-12T09:11:36.269 INFO:tasks.workunit.client.1.smithi203.stdout:9/634: write d8/fa [4687966,117206] 0 2024-04-12T09:11:36.276 INFO:tasks.workunit.client.1.smithi203.stdout:8/702: creat d4/d8/d74/d78/d53/d8f/fe1 x:0 0 0 2024-04-12T09:11:36.277 INFO:tasks.workunit.client.1.smithi203.stdout:1/760: truncate df/f2a 697385 0 2024-04-12T09:11:36.279 INFO:tasks.workunit.client.1.smithi203.stdout:9/635: fsync d8/d12/d3e/d90/f98 0 2024-04-12T09:11:36.284 INFO:tasks.workunit.client.1.smithi203.stdout:1/761: creat df/d2d/d6f/d75/d80/d54/d5d/d90/fe9 x:0 0 0 2024-04-12T09:11:36.285 INFO:tasks.workunit.client.1.smithi203.stdout:1/762: chown df/d2d/d6f/d75/f9e 122677413 1 2024-04-12T09:11:36.288 INFO:tasks.workunit.client.1.smithi203.stdout:4/792: getdents d1a 0 2024-04-12T09:11:36.288 INFO:tasks.workunit.client.1.smithi203.stdout:0/822: write d0/dd/f7b [1798797,5231] 0 2024-04-12T09:11:36.295 INFO:tasks.workunit.client.1.smithi203.stdout:1/763: unlink df/d59/f7e 0 2024-04-12T09:11:36.295 INFO:tasks.workunit.client.1.smithi203.stdout:1/764: stat df/f5b 0 2024-04-12T09:11:36.296 INFO:tasks.workunit.client.1.smithi203.stdout:1/765: stat df/d2d/d6f/d75/d80/d54/d5d/d90 0 2024-04-12T09:11:36.297 INFO:tasks.workunit.client.1.smithi203.stdout:1/766: fsync df/d2d/d6f/d75/f9e 0 2024-04-12T09:11:36.297 INFO:tasks.workunit.client.1.smithi203.stdout:8/703: rmdir d4/d8/d74/d78/d53/d8f 39 2024-04-12T09:11:36.299 INFO:tasks.workunit.client.1.smithi203.stdout:0/823: fsync d0/dd/f70 0 2024-04-12T09:11:36.301 INFO:tasks.workunit.client.1.smithi203.stdout:1/767: dread df/d2d/d6f/d75/d80/d2b/f52 [0,4194304] 0 2024-04-12T09:11:36.302 INFO:tasks.workunit.client.1.smithi203.stdout:4/793: mkdir d1a/d34/de4/d105 0 2024-04-12T09:11:36.302 INFO:tasks.workunit.client.1.smithi203.stdout:9/636: symlink d8/d12/lde 0 2024-04-12T09:11:36.303 INFO:tasks.workunit.client.1.smithi203.stdout:4/794: chown d1a/d21/d22/d2e/d8d/d9b/cc6 6177789 1 2024-04-12T09:11:36.308 INFO:tasks.workunit.client.1.smithi203.stdout:3/660: dread d2/d8/d14/d1b/f8b [0,4194304] 0 2024-04-12T09:11:36.309 INFO:tasks.workunit.client.1.smithi203.stdout:3/661: chown d2/d8/d14/d23/d35/d4c/d5c/c7c 32 1 2024-04-12T09:11:36.310 INFO:tasks.workunit.client.1.smithi203.stdout:0/824: symlink d0/d48/d5e/dca/d101/l115 0 2024-04-12T09:11:36.314 INFO:tasks.workunit.client.1.smithi203.stdout:1/768: mknod df/d2d/d6f/d75/d80/d54/d5d/d67/cea 0 2024-04-12T09:11:36.321 INFO:tasks.workunit.client.1.smithi203.stdout:3/662: dread - d2/d8/d14/d1b/d95/d92/faf zero size 2024-04-12T09:11:36.322 INFO:tasks.workunit.client.1.smithi203.stdout:3/663: chown d2/d8/d14/l28 2139840643 1 2024-04-12T09:11:36.322 INFO:tasks.workunit.client.1.smithi203.stdout:3/664: readlink d2/d51/ld0 0 2024-04-12T09:11:36.327 INFO:tasks.workunit.client.1.smithi203.stdout:3/665: dwrite d2/d64/d8d/fc8 [0,4194304] 0 2024-04-12T09:11:36.348 INFO:tasks.workunit.client.1.smithi203.stdout:2/790: sync 2024-04-12T09:11:36.358 INFO:tasks.workunit.client.1.smithi203.stdout:0/825: creat d0/dd/d71/f116 x:0 0 0 2024-04-12T09:11:36.358 INFO:tasks.workunit.client.1.smithi203.stdout:4/795: dread d1a/d21/d60/f77 [0,4194304] 0 2024-04-12T09:11:36.360 INFO:tasks.workunit.client.1.smithi203.stdout:9/637: dread d8/fb1 [0,4194304] 0 2024-04-12T09:11:36.360 INFO:tasks.workunit.client.1.smithi203.stdout:8/704: dread d4/d8/d74/d78/f3a [0,4194304] 0 2024-04-12T09:11:36.361 INFO:tasks.workunit.client.1.smithi203.stdout:3/666: creat d2/d8/d14/d1b/d2f/fd5 x:0 0 0 2024-04-12T09:11:36.361 INFO:tasks.workunit.client.1.smithi203.stdout:0/826: dread - d0/dd/d71/d94/d2f/d4c/d7a/fad zero size 2024-04-12T09:11:36.362 INFO:tasks.workunit.client.1.smithi203.stdout:2/791: symlink d0/d67/d107/l114 0 2024-04-12T09:11:36.363 INFO:tasks.workunit.client.1.smithi203.stdout:8/705: chown d4/d8/d1c/f31 220473 1 2024-04-12T09:11:36.364 INFO:tasks.workunit.client.1.smithi203.stdout:2/792: fdatasync d0/d38/f3b 0 2024-04-12T09:11:36.365 INFO:tasks.workunit.client.1.smithi203.stdout:3/667: dread - d2/d8/f85 zero size 2024-04-12T09:11:36.365 INFO:tasks.workunit.client.1.smithi203.stdout:1/769: dwrite df/d2d/d6f/fac [4194304,4194304] 0 2024-04-12T09:11:36.367 INFO:tasks.workunit.client.1.smithi203.stdout:3/668: write d2/d8/d14/f27 [491124,18454] 0 2024-04-12T09:11:36.370 INFO:tasks.workunit.client.1.smithi203.stdout:9/638: read f4 [759348,108367] 0 2024-04-12T09:11:36.373 INFO:tasks.workunit.client.1.smithi203.stdout:4/796: dread d1a/d21/f31 [0,4194304] 0 2024-04-12T09:11:36.375 INFO:tasks.workunit.client.1.smithi203.stdout:3/669: creat d2/d8/d14/d23/d35/d91/d81/fd6 x:0 0 0 2024-04-12T09:11:36.378 INFO:tasks.workunit.client.1.smithi203.stdout:0/827: getdents d0/dd/d71/d94/d2f 0 2024-04-12T09:11:36.380 INFO:tasks.workunit.client.1.smithi203.stdout:4/797: symlink d1a/d21/d60/d68/db9/l106 0 2024-04-12T09:11:36.382 INFO:tasks.workunit.client.1.smithi203.stdout:3/670: creat d2/d8/d14/d23/d35/d4c/d5c/fd7 x:0 0 0 2024-04-12T09:11:36.384 INFO:tasks.workunit.client.1.smithi203.stdout:8/706: truncate d4/d8/d74/d78/f25 2492584 0 2024-04-12T09:11:36.385 INFO:tasks.workunit.client.1.smithi203.stdout:2/793: getdents d0/d14/d1e/d2a/dce 0 2024-04-12T09:11:36.385 INFO:tasks.workunit.client.1.smithi203.stdout:9/639: dread d8/d12/d23/d38/d8a/d97/d9e/d74/fd0 [0,4194304] 0 2024-04-12T09:11:36.386 INFO:tasks.workunit.client.1.smithi203.stdout:0/828: dwrite d0/dd/d71/d94/d2f/d17/f11 [0,4194304] 0 2024-04-12T09:11:36.388 INFO:tasks.workunit.client.1.smithi203.stdout:3/671: truncate d2/d8/d14/d23/d35/d4c/d5c/d55/f68 696231 0 2024-04-12T09:11:36.388 INFO:tasks.workunit.client.1.smithi203.stdout:4/798: creat d1a/d34/f107 x:0 0 0 2024-04-12T09:11:36.388 INFO:tasks.workunit.client.1.smithi203.stdout:0/829: write d0/d48/d5e/fd5 [141904,90971] 0 2024-04-12T09:11:36.389 INFO:tasks.workunit.client.1.smithi203.stdout:1/770: getdents df/d59/db0/d9b 0 2024-04-12T09:11:36.391 INFO:tasks.workunit.client.1.smithi203.stdout:3/672: chown d2/d8/d14/d23/d35/d4c/d5c/d55/c8f 18 1 2024-04-12T09:11:36.391 INFO:tasks.workunit.client.1.smithi203.stdout:8/707: mkdir d4/d8/d74/de2 0 2024-04-12T09:11:36.392 INFO:tasks.workunit.client.1.smithi203.stdout:2/794: symlink d0/d3/d8e/l115 0 2024-04-12T09:11:36.393 INFO:tasks.workunit.client.1.smithi203.stdout:1/771: fdatasync df/d2d/d6f/d75/d80/d2b/fe4 0 2024-04-12T09:11:36.398 INFO:tasks.workunit.client.1.smithi203.stdout:1/772: write df/d2d/d6f/d75/d80/d54/d5d/d90/dc7/fc8 [90518,91797] 0 2024-04-12T09:11:36.399 INFO:tasks.workunit.client.1.smithi203.stdout:0/830: truncate d0/dd/d71/d94/d2f/d17/f60 674589 0 2024-04-12T09:11:36.399 INFO:tasks.workunit.client.1.smithi203.stdout:4/799: dwrite d1a/d20/d5d/d2c/d72/fc2 [0,4194304] 0 2024-04-12T09:11:36.404 INFO:tasks.workunit.client.1.smithi203.stdout:9/640: rmdir d8/d12/d23/d38/d8a/d97/d9e/ddb 0 2024-04-12T09:11:36.407 INFO:tasks.workunit.client.1.smithi203.stdout:2/795: creat d0/d14/d1e/d57/da1/d110/f116 x:0 0 0 2024-04-12T09:11:36.407 INFO:tasks.workunit.client.1.smithi203.stdout:2/796: chown d0/d14/d23/d33/f83 1 1 2024-04-12T09:11:36.408 INFO:tasks.workunit.client.1.smithi203.stdout:1/773: fdatasync df/d2d/d6f/d75/d80/d54/d5d/f4d 0 2024-04-12T09:11:36.410 INFO:tasks.workunit.client.1.smithi203.stdout:4/800: mkdir d1a/d21/d60/d108 0 2024-04-12T09:11:36.412 INFO:tasks.workunit.client.1.smithi203.stdout:0/831: write d0/dd/d71/d94/d2f/d17/f9e [4328785,89491] 0 2024-04-12T09:11:36.418 INFO:tasks.workunit.client.1.smithi203.stdout:8/708: dwrite d4/d8/d74/d78/f3a [0,4194304] 0 2024-04-12T09:11:36.418 INFO:tasks.workunit.client.1.smithi203.stdout:8/709: readlink d4/d8/d74/da6/lb0 0 2024-04-12T09:11:36.419 INFO:tasks.workunit.client.1.smithi203.stdout:8/710: chown d4/d8/d81/d84/d92/fdd 16 1 2024-04-12T09:11:36.420 INFO:tasks.workunit.client.1.smithi203.stdout:8/711: chown d4/d8/d1c/f2c 9769527 1 2024-04-12T09:11:36.420 INFO:tasks.workunit.client.1.smithi203.stdout:3/673: truncate d2/d8/d14/f27 1840479 0 2024-04-12T09:11:36.421 INFO:tasks.workunit.client.1.smithi203.stdout:8/712: write d4/d8/fd [7759778,18294] 0 2024-04-12T09:11:36.422 INFO:tasks.workunit.client.1.smithi203.stdout:3/674: stat d2/d8/d14/d23/d35/d4c/d5c/c96 0 2024-04-12T09:11:36.429 INFO:tasks.workunit.client.1.smithi203.stdout:4/801: creat d1a/d21/d22/f109 x:0 0 0 2024-04-12T09:11:36.431 INFO:tasks.workunit.client.1.smithi203.stdout:8/713: rename d4/d8/d1c/f2c to d4/d8/d74/d78/d53/fe3 0 2024-04-12T09:11:36.433 INFO:tasks.workunit.client.1.smithi203.stdout:3/675: dwrite d2/d8/d14/d23/d35/d91/f9b [0,4194304] 0 2024-04-12T09:11:36.435 INFO:tasks.workunit.client.1.smithi203.stdout:8/714: creat d4/d8/d1c/d5d/dc0/fe4 x:0 0 0 2024-04-12T09:11:36.437 INFO:tasks.workunit.client.1.smithi203.stdout:8/715: write d4/d8/d81/d84/fa4 [1613435,110364] 0 2024-04-12T09:11:36.438 INFO:tasks.workunit.client.1.smithi203.stdout:9/641: truncate d8/d12/d23/d85/fb9 3018060 0 2024-04-12T09:11:36.438 INFO:tasks.workunit.client.1.smithi203.stdout:3/676: fsync d2/d8/d14/f40 0 2024-04-12T09:11:36.440 INFO:tasks.workunit.client.1.smithi203.stdout:2/797: truncate d0/d14/d74/f84 2881267 0 2024-04-12T09:11:36.441 INFO:tasks.workunit.client.1.smithi203.stdout:3/677: fdatasync d2/d8/d14/d23/d35/d4c/d5c/dc3/fd3 0 2024-04-12T09:11:36.441 INFO:tasks.workunit.client.1.smithi203.stdout:2/798: readlink d0/d14/d1e/d2a/dcd/dfc/la4 0 2024-04-12T09:11:36.443 INFO:tasks.workunit.client.1.smithi203.stdout:2/799: truncate d0/d3/fd 5022160 0 2024-04-12T09:11:36.446 INFO:tasks.workunit.client.1.smithi203.stdout:9/642: rename d8/d80 to d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d40/db8/ddf 0 2024-04-12T09:11:36.447 INFO:tasks.workunit.client.1.smithi203.stdout:9/643: write d8/fb [3159372,30231] 0 2024-04-12T09:11:36.449 INFO:tasks.workunit.client.1.smithi203.stdout:8/716: creat d4/d8/d74/de2/fe5 x:0 0 0 2024-04-12T09:11:36.455 INFO:tasks.workunit.client.1.smithi203.stdout:3/678: unlink d2/d8/d14/c6b 0 2024-04-12T09:11:36.456 INFO:tasks.workunit.client.1.smithi203.stdout:0/832: dread d0/f3 [0,4194304] 0 2024-04-12T09:11:36.458 INFO:tasks.workunit.client.1.smithi203.stdout:8/717: mkdir d4/d8/d37/d57/d7d/de6 0 2024-04-12T09:11:36.460 INFO:tasks.workunit.client.1.smithi203.stdout:7/748: sync 2024-04-12T09:11:36.461 INFO:tasks.workunit.client.1.smithi203.stdout:3/679: dwrite d2/d8/d14/d23/d35/d4c/fc2 [0,4194304] 0 2024-04-12T09:11:36.462 INFO:tasks.workunit.client.1.smithi203.stdout:7/749: dread - d0/d4/d54/fe4 zero size 2024-04-12T09:11:36.468 INFO:tasks.workunit.client.1.smithi203.stdout:0/833: write d0/dd/f16 [1362590,69094] 0 2024-04-12T09:11:36.469 INFO:tasks.workunit.client.1.smithi203.stdout:3/680: read d2/d8/d14/d23/d35/d4c/d5c/d55/fbe [345595,83015] 0 2024-04-12T09:11:36.470 INFO:tasks.workunit.client.1.smithi203.stdout:8/718: creat d4/d8/d81/db4/fe7 x:0 0 0 2024-04-12T09:11:36.470 INFO:tasks.workunit.client.1.smithi203.stdout:2/800: write d0/d3/d47/fb4 [1257297,88976] 0 2024-04-12T09:11:36.472 INFO:tasks.workunit.client.1.smithi203.stdout:8/719: dread - d4/d8/d1c/d5d/dc0/fcf zero size 2024-04-12T09:11:36.473 INFO:tasks.workunit.client.1.smithi203.stdout:6/645: sync 2024-04-12T09:11:36.474 INFO:tasks.workunit.client.1.smithi203.stdout:6/646: fdatasync d1/d3/d4/f42 0 2024-04-12T09:11:36.476 INFO:tasks.workunit.client.1.smithi203.stdout:7/750: rename d0/d4/d1c/d3b to d0/d4/d54/da0/dff 0 2024-04-12T09:11:36.477 INFO:tasks.workunit.client.1.smithi203.stdout:3/681: dwrite d2/d8/d14/d23/d35/d4c/d5c/d55/f68 [0,4194304] 0 2024-04-12T09:11:36.478 INFO:tasks.workunit.client.1.smithi203.stdout:0/834: creat d0/dd/d5b/f117 x:0 0 0 2024-04-12T09:11:36.480 INFO:tasks.workunit.client.1.smithi203.stdout:9/644: rmdir d8/d12/d23/d38/d8a/dc6 0 2024-04-12T09:11:36.480 INFO:tasks.workunit.client.1.smithi203.stdout:0/835: write d0/dd/d71/d94/d2f/d34/ff6 [896394,51875] 0 2024-04-12T09:11:36.482 INFO:tasks.workunit.client.1.smithi203.stdout:9/645: write d8/d12/d23/f77 [1749799,68782] 0 2024-04-12T09:11:36.483 INFO:tasks.workunit.client.1.smithi203.stdout:8/720: dread - d4/d8/d37/d57/f8d zero size 2024-04-12T09:11:36.484 INFO:tasks.workunit.client.1.smithi203.stdout:8/721: readlink d4/d8/d1c/d48/l7f 0 2024-04-12T09:11:36.493 INFO:tasks.workunit.client.1.smithi203.stdout:3/682: creat d2/d8/d14/d23/d35/d91/d81/fd8 x:0 0 0 2024-04-12T09:11:36.495 INFO:tasks.workunit.client.1.smithi203.stdout:2/801: mknod d0/d3/d8f/d10e/c117 0 2024-04-12T09:11:36.495 INFO:tasks.workunit.client.1.smithi203.stdout:2/802: chown d0/d3/c31 70957843 1 2024-04-12T09:11:36.499 INFO:tasks.workunit.client.1.smithi203.stdout:3/683: creat d2/d8/d14/d23/d35/d4c/d67/d86/fd9 x:0 0 0 2024-04-12T09:11:36.503 INFO:tasks.workunit.client.1.smithi203.stdout:2/803: unlink d0/d54/f69 0 2024-04-12T09:11:36.504 INFO:tasks.workunit.client.1.smithi203.stdout:3/684: symlink d2/d8/d14/d23/d35/d4c/d67/d86/lda 0 2024-04-12T09:11:36.506 INFO:tasks.workunit.client.1.smithi203.stdout:3/685: write d2/d8/d14/d23/d35/d4c/d5c/f7d [5067020,96555] 0 2024-04-12T09:11:36.510 INFO:tasks.workunit.client.1.smithi203.stdout:2/804: rmdir d0/d3/d105 0 2024-04-12T09:11:36.512 INFO:tasks.workunit.client.1.smithi203.stdout:7/751: dread d0/d4/d54/da0/dff/f78 [0,4194304] 0 2024-04-12T09:11:36.512 INFO:tasks.workunit.client.1.smithi203.stdout:5/836: sync 2024-04-12T09:11:36.514 INFO:tasks.workunit.client.1.smithi203.stdout:9/646: dread d8/d12/d23/f71 [0,4194304] 0 2024-04-12T09:11:36.514 INFO:tasks.workunit.client.1.smithi203.stdout:3/686: dwrite d2/f83 [4194304,4194304] 0 2024-04-12T09:11:36.514 INFO:tasks.workunit.client.1.smithi203.stdout:9/647: chown d8 28201 1 2024-04-12T09:11:36.516 INFO:tasks.workunit.client.1.smithi203.stdout:6/647: dread d1/d3/d12/f1e [0,4194304] 0 2024-04-12T09:11:36.517 INFO:tasks.workunit.client.1.smithi203.stdout:2/805: creat d0/d3/f118 x:0 0 0 2024-04-12T09:11:36.520 INFO:tasks.workunit.client.1.smithi203.stdout:9/648: rmdir d8/d12/d23/d38/d8a/d97 39 2024-04-12T09:11:36.521 INFO:tasks.workunit.client.1.smithi203.stdout:9/649: dread - d8/d12/d3e/fbb zero size 2024-04-12T09:11:36.546 INFO:tasks.workunit.client.1.smithi203.stdout:5/837: mkdir d0/d9a/d131 0 2024-04-12T09:11:36.547 INFO:tasks.workunit.client.1.smithi203.stdout:6/648: unlink d1/d3/d26/d5d/f67 0 2024-04-12T09:11:36.547 INFO:tasks.workunit.client.1.smithi203.stdout:9/650: fdatasync d8/d12/d23/d41/f5e 0 2024-04-12T09:11:36.548 INFO:tasks.workunit.client.1.smithi203.stdout:2/806: rename d0/d3/f118 to d0/d54/d61/d82/f119 0 2024-04-12T09:11:36.549 INFO:tasks.workunit.client.1.smithi203.stdout:8/722: write d4/d8/d74/d78/f6d [4933304,23322] 0 2024-04-12T09:11:36.549 INFO:tasks.workunit.client.1.smithi203.stdout:0/836: truncate d0/d48/d5e/d84/fdf 1097042 0 2024-04-12T09:11:36.550 INFO:tasks.workunit.client.1.smithi203.stdout:7/752: dwrite d0/d4/d54/da0/dff/f78 [4194304,4194304] 0 2024-04-12T09:11:36.552 INFO:tasks.workunit.client.1.smithi203.stdout:5/838: write d0/d6/d16/d9/d30/d58/f99 [270852,99747] 0 2024-04-12T09:11:36.554 INFO:tasks.workunit.client.1.smithi203.stdout:7/753: dread - d0/d4/d54/d75/dc0/fea zero size 2024-04-12T09:11:36.559 INFO:tasks.workunit.client.1.smithi203.stdout:2/807: symlink d0/d67/d86/df6/l11a 0 2024-04-12T09:11:36.559 INFO:tasks.workunit.client.1.smithi203.stdout:6/649: dwrite d1/d3/f97 [0,4194304] 0 2024-04-12T09:11:36.561 INFO:tasks.workunit.client.1.smithi203.stdout:6/650: write d1/d3/d26/d30/d4a/f6f [546207,59993] 0 2024-04-12T09:11:36.561 INFO:tasks.workunit.client.1.smithi203.stdout:6/651: fdatasync d1/d3/d4/f42 0 2024-04-12T09:11:36.569 INFO:tasks.workunit.client.1.smithi203.stdout:8/723: rename d4/d8/d74/de2 to d4/d8/d1c/d48/d5e/de8 0 2024-04-12T09:11:36.572 INFO:tasks.workunit.client.1.smithi203.stdout:7/754: mkdir d0/d4/d54/da0/d100 0 2024-04-12T09:11:36.572 INFO:tasks.workunit.client.1.smithi203.stdout:5/839: readlink d0/d6/d16/d9/d80/df2/d104/l39 0 2024-04-12T09:11:36.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:36 smithi203 ceph-mon[36428]: pgmap v28: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 59 MiB/s rd, 203 MiB/s wr, 388 op/s 2024-04-12T09:11:36.576 INFO:tasks.workunit.client.1.smithi203.stdout:9/651: mkdir d8/d12/d23/d38/d8a/d97/de0 0 2024-04-12T09:11:36.577 INFO:tasks.workunit.client.1.smithi203.stdout:9/652: dread - d8/d12/d3e/f76 zero size 2024-04-12T09:11:36.578 INFO:tasks.workunit.client.1.smithi203.stdout:5/840: rmdir d0/d6/d16/d11f/d118 39 2024-04-12T09:11:36.579 INFO:tasks.workunit.client.1.smithi203.stdout:5/841: readlink d0/d6/d16/d9/d30/d83/l120 0 2024-04-12T09:11:36.580 INFO:tasks.workunit.client.1.smithi203.stdout:5/842: chown d0/d6/d16/d9/d30/d89/fe9 375 1 2024-04-12T09:11:36.580 INFO:tasks.workunit.client.1.smithi203.stdout:8/724: symlink d4/d8/d37/d57/le9 0 2024-04-12T09:11:36.582 INFO:tasks.workunit.client.1.smithi203.stdout:8/725: write d4/f4b [2794315,105370] 0 2024-04-12T09:11:36.582 INFO:tasks.workunit.client.1.smithi203.stdout:6/652: dread d1/f37 [0,4194304] 0 2024-04-12T09:11:36.582 INFO:tasks.workunit.client.1.smithi203.stdout:5/843: truncate d0/d6/d16/d8/f62 4615470 0 2024-04-12T09:11:36.584 INFO:tasks.workunit.client.1.smithi203.stdout:9/653: mkdir d8/d12/d23/d85/de1 0 2024-04-12T09:11:36.585 INFO:tasks.workunit.client.1.smithi203.stdout:8/726: dread d4/d8/d1c/d5d/dc0/fcd [0,4194304] 0 2024-04-12T09:11:36.586 INFO:tasks.workunit.client.1.smithi203.stdout:2/808: mknod d0/d14/d74/d96/c11b 0 2024-04-12T09:11:36.588 INFO:tasks.workunit.client.1.smithi203.stdout:8/727: read d4/d8/d74/d78/d53/fe3 [674612,61292] 0 2024-04-12T09:11:36.588 INFO:tasks.workunit.client.1.smithi203.stdout:8/728: stat d4/d8/d1c/d5d/f94 0 2024-04-12T09:11:36.589 INFO:tasks.workunit.client.1.smithi203.stdout:8/729: fdatasync d4/d8/d37/d57/d7d/fc1 0 2024-04-12T09:11:36.592 INFO:tasks.workunit.client.1.smithi203.stdout:2/809: dwrite d0/d14/d1e/d2a/dcd/dfc/f94 [0,4194304] 0 2024-04-12T09:11:36.593 INFO:tasks.workunit.client.1.smithi203.stdout:6/653: rename d1/d3/cd to d1/d3/d5b/d8c/d3e/cca 0 2024-04-12T09:11:36.594 INFO:tasks.workunit.client.1.smithi203.stdout:4/802: sync 2024-04-12T09:11:36.594 INFO:tasks.workunit.client.1.smithi203.stdout:1/774: sync 2024-04-12T09:11:36.595 INFO:tasks.workunit.client.1.smithi203.stdout:5/844: rmdir d0/d6/d11/d1e/d4c/d48/de4 39 2024-04-12T09:11:36.596 INFO:tasks.workunit.client.1.smithi203.stdout:1/775: dread - df/d2d/d6f/d75/d80/d54/d5d/d90/fe9 zero size 2024-04-12T09:11:36.597 INFO:tasks.workunit.client.1.smithi203.stdout:2/810: dread d0/d14/d1e/d2a/f4c [0,4194304] 0 2024-04-12T09:11:36.597 INFO:tasks.workunit.client.1.smithi203.stdout:4/803: truncate d1a/d21/d22/d2e/d8d/d9b/ddf/fee 314466 0 2024-04-12T09:11:36.600 INFO:tasks.workunit.client.1.smithi203.stdout:9/654: fsync d8/d12/d23/d38/f6c 0 2024-04-12T09:11:36.601 INFO:tasks.workunit.client.1.smithi203.stdout:7/755: getdents d0/d4/d1c/d5b/dbf/dc3 0 2024-04-12T09:11:36.604 INFO:tasks.workunit.client.1.smithi203.stdout:4/804: dwrite d1a/d20/d5d/d2c/d72/fa2 [4194304,4194304] 0 2024-04-12T09:11:36.607 INFO:tasks.workunit.client.1.smithi203.stdout:1/776: mkdir df/d2d/d6f/d75/d80/d54/d5d/d58/d94/deb 0 2024-04-12T09:11:36.608 INFO:tasks.workunit.client.1.smithi203.stdout:1/777: readlink df/d2d/d6f/d75/d80/d2b/l63 0 2024-04-12T09:11:36.608 INFO:tasks.workunit.client.1.smithi203.stdout:1/778: fdatasync df/d2d/fc2 0 2024-04-12T09:11:36.608 INFO:tasks.workunit.client.1.smithi203.stdout:9/655: creat d8/d12/da1/fe2 x:0 0 0 2024-04-12T09:11:36.609 INFO:tasks.workunit.client.1.smithi203.stdout:1/779: chown df/d2d/d6f/d75/d80/f41 3012 1 2024-04-12T09:11:36.615 INFO:tasks.workunit.client.1.smithi203.stdout:2/811: symlink d0/d67/d86/dd9/l11c 0 2024-04-12T09:11:36.617 INFO:tasks.workunit.client.1.smithi203.stdout:7/756: mknod d0/d15/c101 0 2024-04-12T09:11:36.624 INFO:tasks.workunit.client.1.smithi203.stdout:5/845: dwrite d0/f66 [4194304,4194304] 0 2024-04-12T09:11:36.626 INFO:tasks.workunit.client.1.smithi203.stdout:1/780: mknod df/d2d/cec 0 2024-04-12T09:11:36.628 INFO:tasks.workunit.client.1.smithi203.stdout:6/654: getdents d1/d3/d5b 0 2024-04-12T09:11:36.631 INFO:tasks.workunit.client.1.smithi203.stdout:2/812: truncate d0/d14/d74/f84 2716527 0 2024-04-12T09:11:36.632 INFO:tasks.workunit.client.1.smithi203.stdout:9/656: write d8/f8d [3013419,15495] 0 2024-04-12T09:11:36.635 INFO:tasks.workunit.client.1.smithi203.stdout:4/805: dread d1a/d21/d22/d2e/d8d/d9b/dbc/f83 [0,4194304] 0 2024-04-12T09:11:36.636 INFO:tasks.workunit.client.1.smithi203.stdout:5/846: dwrite d0/d6/d11/d18/d2a/dc8/fce [0,4194304] 0 2024-04-12T09:11:36.636 INFO:tasks.workunit.client.1.smithi203.stdout:1/781: mknod df/d2d/ced 0 2024-04-12T09:11:36.637 INFO:tasks.workunit.client.1.smithi203.stdout:6/655: truncate d1/d3/d26/d30/d4a/d6c/d45/d55/fa8 1001502 0 2024-04-12T09:11:36.639 INFO:tasks.workunit.client.1.smithi203.stdout:1/782: unlink ld 0 2024-04-12T09:11:36.642 INFO:tasks.workunit.client.1.smithi203.stdout:4/806: mkdir d1a/d20/d5d/d2c/d72/d10a 0 2024-04-12T09:11:36.647 INFO:tasks.workunit.client.1.smithi203.stdout:1/783: dwrite df/d2d/d6f/d75/d80/d54/d5d/f4d [4194304,4194304] 0 2024-04-12T09:11:36.648 INFO:tasks.workunit.client.1.smithi203.stdout:5/847: rename d0/l12e to d0/d6/d16/d9/d80/df2/l132 0 2024-04-12T09:11:36.648 INFO:tasks.workunit.client.1.smithi203.stdout:7/757: dread d0/f7 [0,4194304] 0 2024-04-12T09:11:36.650 INFO:tasks.workunit.client.1.smithi203.stdout:5/848: stat d0/d6/d16/d9/d30/d58/f99 0 2024-04-12T09:11:36.650 INFO:tasks.workunit.client.1.smithi203.stdout:1/784: write df/d2d/d6f/d8d/da7/fd8 [199266,46754] 0 2024-04-12T09:11:36.658 INFO:tasks.workunit.client.1.smithi203.stdout:9/657: dread d8/d12/f16 [0,4194304] 0 2024-04-12T09:11:36.658 INFO:tasks.workunit.client.1.smithi203.stdout:9/658: chown d8/f8d 232641 1 2024-04-12T09:11:36.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:36 smithi117 ceph-mon[29277]: pgmap v28: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 59 MiB/s rd, 203 MiB/s wr, 388 op/s 2024-04-12T09:11:36.660 INFO:tasks.workunit.client.1.smithi203.stdout:4/807: symlink d1a/d21/d22/d102/l10b 0 2024-04-12T09:11:36.664 INFO:tasks.workunit.client.1.smithi203.stdout:2/813: truncate d0/d14/d1e/d2a/dcd/dfc/f44 1767397 0 2024-04-12T09:11:36.668 INFO:tasks.workunit.client.1.smithi203.stdout:9/659: mknod d8/d12/d23/d85/ce3 0 2024-04-12T09:11:36.670 INFO:tasks.workunit.client.1.smithi203.stdout:9/660: read d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d70/f9c [814886,20420] 0 2024-04-12T09:11:36.671 INFO:tasks.workunit.client.1.smithi203.stdout:5/849: mkdir d0/d6/d11/d4a/df4/d133 0 2024-04-12T09:11:36.672 INFO:tasks.workunit.client.1.smithi203.stdout:2/814: creat d0/d14/d1e/d57/f11d x:0 0 0 2024-04-12T09:11:36.675 INFO:tasks.workunit.client.1.smithi203.stdout:6/656: rename d1/df/d89 to d1/d3/d26/dcb 0 2024-04-12T09:11:36.677 INFO:tasks.workunit.client.1.smithi203.stdout:1/785: dread df/d2d/d6f/d75/d80/d54/d5d/d67/f6b [0,4194304] 0 2024-04-12T09:11:36.680 INFO:tasks.workunit.client.1.smithi203.stdout:5/850: creat d0/d6/d16/d9/d86/df5/f134 x:0 0 0 2024-04-12T09:11:36.688 INFO:tasks.workunit.client.1.smithi203.stdout:1/786: write df/d2d/d6f/d75/d80/d54/d5d/d58/f92 [49127,91717] 0 2024-04-12T09:11:36.689 INFO:tasks.workunit.client.1.smithi203.stdout:1/787: write df/d2d/d6f/d75/d80/d54/d5d/d90/f95 [1730700,86931] 0 2024-04-12T09:11:36.695 INFO:tasks.workunit.client.1.smithi203.stdout:7/758: rename d0/d15/d89/lbe to d0/d4/d1c/d5b/dbf/dc3/l102 0 2024-04-12T09:11:36.697 INFO:tasks.workunit.client.1.smithi203.stdout:1/788: rmdir df/d2d/d6f/daa 39 2024-04-12T09:11:36.699 INFO:tasks.workunit.client.1.smithi203.stdout:6/657: dwrite d1/df/f6b [0,4194304] 0 2024-04-12T09:11:36.701 INFO:tasks.workunit.client.1.smithi203.stdout:9/661: mknod d8/d3b/db7/ce4 0 2024-04-12T09:11:36.715 INFO:tasks.workunit.client.1.smithi203.stdout:9/662: chown d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/da9 0 1 2024-04-12T09:11:36.717 INFO:tasks.workunit.client.1.smithi203.stdout:5/851: getdents d0/d6/d11/d1e/d4c/d48/de4 0 2024-04-12T09:11:36.718 INFO:tasks.workunit.client.1.smithi203.stdout:2/815: dwrite d0/d14/d74/f84 [0,4194304] 0 2024-04-12T09:11:36.719 INFO:tasks.workunit.client.1.smithi203.stdout:3/687: sync 2024-04-12T09:11:36.719 INFO:tasks.workunit.client.1.smithi203.stdout:9/663: rename d8/d12/d23/d85/f8b to d8/d12/d23/d41/fe5 0 2024-04-12T09:11:36.720 INFO:tasks.workunit.client.1.smithi203.stdout:7/759: write d0/f7 [1999329,95053] 0 2024-04-12T09:11:36.721 INFO:tasks.workunit.client.1.smithi203.stdout:1/789: write df/f5b [1575309,40079] 0 2024-04-12T09:11:36.722 INFO:tasks.workunit.client.1.smithi203.stdout:5/852: mknod d0/d6/d11/d4a/df4/d133/c135 0 2024-04-12T09:11:36.724 INFO:tasks.workunit.client.1.smithi203.stdout:6/658: write d1/d3/d12/f5e [5187496,93772] 0 2024-04-12T09:11:36.725 INFO:tasks.workunit.client.1.smithi203.stdout:3/688: chown d2/d8/d14/d1b/d2f/l76 949 1 2024-04-12T09:11:36.728 INFO:tasks.workunit.client.1.smithi203.stdout:2/816: dwrite d0/d67/d86/fb1 [0,4194304] 0 2024-04-12T09:11:36.728 INFO:tasks.workunit.client.1.smithi203.stdout:7/760: fdatasync d0/d4/d54/da0/dff/f3f 0 2024-04-12T09:11:36.729 INFO:tasks.workunit.client.1.smithi203.stdout:9/664: mkdir d8/d12/d23/d85/de1/de6 0 2024-04-12T09:11:36.730 INFO:tasks.workunit.client.1.smithi203.stdout:2/817: dread - d0/d14/d1e/d57/da1/d110/f116 zero size 2024-04-12T09:11:36.732 INFO:tasks.workunit.client.1.smithi203.stdout:2/818: dread d0/d14/fec [0,4194304] 0 2024-04-12T09:11:36.733 INFO:tasks.workunit.client.1.smithi203.stdout:1/790: rename df/f5b to df/d2d/d6f/d75/d80/d54/d5d/d90/fee 0 2024-04-12T09:11:36.738 INFO:tasks.workunit.client.1.smithi203.stdout:7/761: creat d0/d4/d1c/d5b/dbf/dc3/f103 x:0 0 0 2024-04-12T09:11:36.738 INFO:tasks.workunit.client.1.smithi203.stdout:2/819: stat d0/d38 0 2024-04-12T09:11:36.742 INFO:tasks.workunit.client.1.smithi203.stdout:3/689: rename d2/d8/d14/d23/d36 to d2/d8/d14/d1b/d95/d92/ddb 0 2024-04-12T09:11:36.742 INFO:tasks.workunit.client.1.smithi203.stdout:7/762: dwrite d0/d15/d89/fda [0,4194304] 0 2024-04-12T09:11:36.747 INFO:tasks.workunit.client.1.smithi203.stdout:1/791: symlink df/d2d/d6f/d75/d80/d8c/ddb/lef 0 2024-04-12T09:11:36.747 INFO:tasks.workunit.client.1.smithi203.stdout:2/820: dwrite d0/d14/d1e/d2a/dcd/dfc/f5a [0,4194304] 0 2024-04-12T09:11:36.749 INFO:tasks.workunit.client.1.smithi203.stdout:2/821: fsync d0/d14/d74/d96/d9a/faf 0 2024-04-12T09:11:36.750 INFO:tasks.workunit.client.1.smithi203.stdout:9/665: rename d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/f59 to d8/d12/d3e/d90/dd8/fe7 0 2024-04-12T09:11:36.752 INFO:tasks.workunit.client.1.smithi203.stdout:3/690: stat d2/d8/d14/f90 0 2024-04-12T09:11:36.754 INFO:tasks.workunit.client.1.smithi203.stdout:7/763: mknod d0/d38/c104 0 2024-04-12T09:11:36.754 INFO:tasks.workunit.client.1.smithi203.stdout:1/792: dread df/d2d/d6f/d75/d80/d54/d5d/d90/f95 [0,4194304] 0 2024-04-12T09:11:36.764 INFO:tasks.workunit.client.1.smithi203.stdout:7/764: readlink d0/d4/d1c/d5b/dbf/dc3/l102 0 2024-04-12T09:11:36.766 INFO:tasks.workunit.client.1.smithi203.stdout:1/793: truncate df/f35 1126577 0 2024-04-12T09:11:36.766 INFO:tasks.workunit.client.1.smithi203.stdout:9/666: link d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/l53 d8/d3b/dcd/le8 0 2024-04-12T09:11:36.767 INFO:tasks.workunit.client.1.smithi203.stdout:9/667: write d8/d12/f81 [4391802,945] 0 2024-04-12T09:11:36.768 INFO:tasks.workunit.client.1.smithi203.stdout:7/765: symlink d0/d4/d54/d75/l105 0 2024-04-12T09:11:36.770 INFO:tasks.workunit.client.1.smithi203.stdout:7/766: chown d0/d4/d5d/f9e 519 1 2024-04-12T09:11:36.772 INFO:tasks.workunit.client.1.smithi203.stdout:3/691: dread d2/d8/d14/f90 [0,4194304] 0 2024-04-12T09:11:36.774 INFO:tasks.workunit.client.1.smithi203.stdout:1/794: dwrite df/d2d/fc2 [0,4194304] 0 2024-04-12T09:11:36.775 INFO:tasks.workunit.client.1.smithi203.stdout:3/692: read d2/d64/f6f [3285534,5304] 0 2024-04-12T09:11:36.782 INFO:tasks.workunit.client.1.smithi203.stdout:2/822: dwrite d0/d14/d23/d3d/f91 [0,4194304] 0 2024-04-12T09:11:36.787 INFO:tasks.workunit.client.1.smithi203.stdout:7/767: dread d0/d4/f92 [4194304,4194304] 0 2024-04-12T09:11:36.791 INFO:tasks.workunit.client.1.smithi203.stdout:7/768: write d0/d4/d54/fe4 [103728,105606] 0 2024-04-12T09:11:36.794 INFO:tasks.workunit.client.1.smithi203.stdout:9/668: dwrite d8/d12/d23/d38/f3d [4194304,4194304] 0 2024-04-12T09:11:36.798 INFO:tasks.workunit.client.1.smithi203.stdout:2/823: rename d0/d14/d8a/cd1 to d0/d14/d8a/c11e 0 2024-04-12T09:11:36.799 INFO:tasks.workunit.client.1.smithi203.stdout:2/824: dread - d0/d54/d61/d82/f119 zero size 2024-04-12T09:11:36.802 INFO:tasks.workunit.client.1.smithi203.stdout:3/693: truncate d2/d64/d8d/fae 2521264 0 2024-04-12T09:11:36.807 INFO:tasks.workunit.client.1.smithi203.stdout:7/769: rename d0/d15/d2d/d5e/d8c to d0/d4/d54/da0/d106 0 2024-04-12T09:11:36.807 INFO:tasks.workunit.client.1.smithi203.stdout:7/770: stat d0/d4/f43 0 2024-04-12T09:11:36.811 INFO:tasks.workunit.client.1.smithi203.stdout:1/795: truncate df/d2d/d6f/d8d/da7/fd8 95972 0 2024-04-12T09:11:36.812 INFO:tasks.workunit.client.1.smithi203.stdout:2/825: mknod d0/d14/d1e/d57/da1/d110/c11f 0 2024-04-12T09:11:36.816 INFO:tasks.workunit.client.1.smithi203.stdout:3/694: creat d2/d8/d14/d23/d35/d4c/d5c/d55/fdc x:0 0 0 2024-04-12T09:11:36.817 INFO:tasks.workunit.client.1.smithi203.stdout:7/771: mknod d0/d4/d54/d75/dc0/c107 0 2024-04-12T09:11:36.817 INFO:tasks.workunit.client.1.smithi203.stdout:9/669: write d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/f9f [4957303,108415] 0 2024-04-12T09:11:36.818 INFO:tasks.workunit.client.1.smithi203.stdout:7/772: readlink d0/d15/d2d/l2f 0 2024-04-12T09:11:36.827 INFO:tasks.workunit.client.1.smithi203.stdout:7/773: rename d0/d15/d2d/d5e to d0/d15/d2d/df2/d108 0 2024-04-12T09:11:36.833 INFO:tasks.workunit.client.1.smithi203.stdout:7/774: dwrite d0/d34/d7c/ff5 [0,4194304] 0 2024-04-12T09:11:36.833 INFO:tasks.workunit.client.1.smithi203.stdout:1/796: dread df/f6e [0,4194304] 0 2024-04-12T09:11:36.837 INFO:tasks.workunit.client.1.smithi203.stdout:0/837: sync 2024-04-12T09:11:36.842 INFO:tasks.workunit.client.1.smithi203.stdout:2/826: link d0/d3/d47/fb4 d0/d14/d1e/d57/da1/d110/f120 0 2024-04-12T09:11:36.843 INFO:tasks.workunit.client.1.smithi203.stdout:3/695: truncate d2/d8/f39 213805 0 2024-04-12T09:11:36.846 INFO:tasks.workunit.client.1.smithi203.stdout:7/775: rmdir d0/d4/d53/dde 39 2024-04-12T09:11:36.849 INFO:tasks.workunit.client.1.smithi203.stdout:3/696: dwrite d2/d8/d14/d23/d35/d4c/d5c/dc3/fc4 [0,4194304] 0 2024-04-12T09:11:36.850 INFO:tasks.workunit.client.1.smithi203.stdout:9/670: link d8/fa d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/fe9 0 2024-04-12T09:11:36.850 INFO:tasks.workunit.client.1.smithi203.stdout:0/838: mknod d0/dd/d5b/d90/dd3/c118 0 2024-04-12T09:11:36.858 INFO:tasks.workunit.client.1.smithi203.stdout:1/797: dread df/d2d/d6f/d75/d80/f41 [0,4194304] 0 2024-04-12T09:11:36.861 INFO:tasks.workunit.client.1.smithi203.stdout:3/697: creat d2/d8/d14/d23/d35/d4c/d5c/fdd x:0 0 0 2024-04-12T09:11:36.867 INFO:tasks.workunit.client.1.smithi203.stdout:0/839: rename d0/dd/d71/d94/c2a to d0/d59/d5d/d79/c119 0 2024-04-12T09:11:36.869 INFO:tasks.workunit.client.1.smithi203.stdout:2/827: fdatasync d0/d14/d1e/d57/da1/fef 0 2024-04-12T09:11:36.873 INFO:tasks.workunit.client.1.smithi203.stdout:5/853: sync 2024-04-12T09:11:36.873 INFO:tasks.workunit.client.1.smithi203.stdout:6/659: sync 2024-04-12T09:11:36.873 INFO:tasks.workunit.client.1.smithi203.stdout:4/808: sync 2024-04-12T09:11:36.873 INFO:tasks.workunit.client.1.smithi203.stdout:8/730: sync 2024-04-12T09:11:36.873 INFO:tasks.workunit.client.1.smithi203.stdout:7/776: symlink d0/d4/l109 0 2024-04-12T09:11:36.874 INFO:tasks.workunit.client.1.smithi203.stdout:8/731: fsync d4/d8/d1c/d5d/f69 0 2024-04-12T09:11:36.875 INFO:tasks.workunit.client.1.smithi203.stdout:3/698: fdatasync d2/d8/d14/d23/d35/d91/f7a 0 2024-04-12T09:11:36.875 INFO:tasks.workunit.client.1.smithi203.stdout:7/777: chown d0/d4/d54/dac/dd4/cef 507 1 2024-04-12T09:11:36.876 INFO:tasks.workunit.client.1.smithi203.stdout:3/699: fdatasync d2/d64/d8d/fb9 0 2024-04-12T09:11:36.877 INFO:tasks.workunit.client.1.smithi203.stdout:0/840: symlink d0/dd/d71/d94/d2f/d17/d19/d6f/dcb/l11a 0 2024-04-12T09:11:36.881 INFO:tasks.workunit.client.1.smithi203.stdout:2/828: rename d0/d67/d107/l114 to d0/d3/d8f/d98/l121 0 2024-04-12T09:11:36.888 INFO:tasks.workunit.client.1.smithi203.stdout:8/732: dread d4/d8/d74/d78/d53/fe3 [0,4194304] 0 2024-04-12T09:11:36.890 INFO:tasks.workunit.client.1.smithi203.stdout:3/700: read d2/d8/d14/d23/d35/d4c/f54 [140113,67103] 0 2024-04-12T09:11:36.890 INFO:tasks.workunit.client.1.smithi203.stdout:0/841: write d0/dd/d71/d94/d2f/d34/db1/fa9 [902342,66525] 0 2024-04-12T09:11:36.891 INFO:tasks.workunit.client.1.smithi203.stdout:5/854: dread d0/d6/d16/d9/f63 [0,4194304] 0 2024-04-12T09:11:36.892 INFO:tasks.workunit.client.1.smithi203.stdout:2/829: chown d0/c21 79 1 2024-04-12T09:11:36.892 INFO:tasks.workunit.client.1.smithi203.stdout:3/701: readlink d2/d8/d14/d45/l4e 0 2024-04-12T09:11:36.895 INFO:tasks.workunit.client.1.smithi203.stdout:9/671: getdents d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/dca 0 2024-04-12T09:11:36.897 INFO:tasks.workunit.client.1.smithi203.stdout:8/733: mkdir d4/d8/d1c/d5d/dea 0 2024-04-12T09:11:36.899 INFO:tasks.workunit.client.1.smithi203.stdout:1/798: link df/d2d/d6f/d75/d80/d54/d5d/d58/l89 df/d2d/d6f/d8d/lf0 0 2024-04-12T09:11:36.900 INFO:tasks.workunit.client.1.smithi203.stdout:0/842: write d0/dd/d71/d94/d2f/d17/d19/f9d [876042,25058] 0 2024-04-12T09:11:36.901 INFO:tasks.workunit.client.1.smithi203.stdout:2/830: dwrite d0/d14/d8a/ff9 [0,4194304] 0 2024-04-12T09:11:36.903 INFO:tasks.workunit.client.1.smithi203.stdout:3/702: dwrite d2/d8/d14/d23/d35/d4c/d67/f9f [0,4194304] 0 2024-04-12T09:11:36.910 INFO:tasks.workunit.client.1.smithi203.stdout:8/734: creat d4/d8/d1c/d5d/dc0/feb x:0 0 0 2024-04-12T09:11:36.912 INFO:tasks.workunit.client.1.smithi203.stdout:1/799: rmdir df/d2d/d6f/d75/d80/d54/d5d/d58/d7f 39 2024-04-12T09:11:36.913 INFO:tasks.workunit.client.1.smithi203.stdout:5/855: dwrite d0/d6/d16/d9/fa4 [0,4194304] 0 2024-04-12T09:11:36.917 INFO:tasks.workunit.client.1.smithi203.stdout:2/831: mknod d0/d3/d8f/d98/c122 0 2024-04-12T09:11:36.917 INFO:tasks.workunit.client.1.smithi203.stdout:4/809: write f5 [4915344,23359] 0 2024-04-12T09:11:36.919 INFO:tasks.workunit.client.1.smithi203.stdout:8/735: dwrite d4/d8/d1c/d5d/f4f [0,4194304] 0 2024-04-12T09:11:36.924 INFO:tasks.workunit.client.1.smithi203.stdout:0/843: dwrite d0/f4e [0,4194304] 0 2024-04-12T09:11:36.934 INFO:tasks.workunit.client.1.smithi203.stdout:7/778: dwrite d0/d4/d54/d75/f9a [0,4194304] 0 2024-04-12T09:11:36.935 INFO:tasks.workunit.client.1.smithi203.stdout:5/856: readlink d0/d6/d11/d1e/l9d 0 2024-04-12T09:11:36.943 INFO:tasks.workunit.client.1.smithi203.stdout:0/844: rename d0/d48/d5e/d84/fa4 to d0/d48/d5e/dca/dd6/f11b 0 2024-04-12T09:11:36.943 INFO:tasks.workunit.client.1.smithi203.stdout:0/845: write d0/dd/d5b/d90/f10f [954347,122347] 0 2024-04-12T09:11:36.943 INFO:tasks.workunit.client.1.smithi203.stdout:5/857: fdatasync d0/d6/d11/d38/f84 0 2024-04-12T09:11:36.944 INFO:tasks.workunit.client.1.smithi203.stdout:6/660: truncate d1/d3/d26/fa5 789028 0 2024-04-12T09:11:36.946 INFO:tasks.workunit.client.1.smithi203.stdout:8/736: mkdir d4/d8/d1c/d5d/dea/dec 0 2024-04-12T09:11:36.951 INFO:tasks.workunit.client.1.smithi203.stdout:0/846: mknod d0/d48/d5e/dca/dd6/c11c 0 2024-04-12T09:11:36.952 INFO:tasks.workunit.client.1.smithi203.stdout:0/847: readlink d0/ldb 0 2024-04-12T09:11:36.954 INFO:tasks.workunit.client.1.smithi203.stdout:5/858: unlink d0/d6/d11/d4a/df4/d133/c135 0 2024-04-12T09:11:36.956 INFO:tasks.workunit.client.1.smithi203.stdout:2/832: dread d0/d14/d74/d96/d9a/faf [0,4194304] 0 2024-04-12T09:11:36.956 INFO:tasks.workunit.client.1.smithi203.stdout:6/661: dwrite d1/d3/d5b/d8c/f66 [0,4194304] 0 2024-04-12T09:11:36.959 INFO:tasks.workunit.client.1.smithi203.stdout:0/848: truncate d0/dd/d71/d94/d2f/dc6/ff4 888028 0 2024-04-12T09:11:36.961 INFO:tasks.workunit.client.1.smithi203.stdout:8/737: mknod d4/d8/d1c/d5d/dea/ced 0 2024-04-12T09:11:36.962 INFO:tasks.workunit.client.1.smithi203.stdout:2/833: chown d0/fc6 696 1 2024-04-12T09:11:36.962 INFO:tasks.workunit.client.1.smithi203.stdout:0/849: chown d0/d48/d5e/c9c 0 1 2024-04-12T09:11:36.966 INFO:tasks.workunit.client.1.smithi203.stdout:8/738: truncate d4/d8/d37/f93 179823 0 2024-04-12T09:11:36.967 INFO:tasks.workunit.client.1.smithi203.stdout:8/739: fsync d4/d8/d1c/d5d/dc0/fcf 0 2024-04-12T09:11:36.967 INFO:tasks.workunit.client.1.smithi203.stdout:6/662: symlink d1/d3/d26/lcc 0 2024-04-12T09:11:36.969 INFO:tasks.workunit.client.1.smithi203.stdout:2/834: truncate d0/d54/d61/d78/d89/fbd 303630 0 2024-04-12T09:11:36.973 INFO:tasks.workunit.client.1.smithi203.stdout:8/740: mkdir d4/d8/d74/da6/dee 0 2024-04-12T09:11:36.974 INFO:tasks.workunit.client.1.smithi203.stdout:0/850: mknod d0/dd/d71/d94/d2f/d17/d19/de4/c11d 0 2024-04-12T09:11:36.974 INFO:tasks.workunit.client.1.smithi203.stdout:8/741: chown d4/d8/d81/d84/fa4 5510 1 2024-04-12T09:11:36.975 INFO:tasks.workunit.client.1.smithi203.stdout:2/835: symlink d0/d14/d74/d96/l123 0 2024-04-12T09:11:36.978 INFO:tasks.workunit.client.1.smithi203.stdout:0/851: write d0/dd/d71/d94/d2f/d17/d19/f25 [3518027,99832] 0 2024-04-12T09:11:36.982 INFO:tasks.workunit.client.1.smithi203.stdout:9/672: truncate d8/f2a 683498 0 2024-04-12T09:11:36.984 INFO:tasks.workunit.client.1.smithi203.stdout:5/859: getdents d0/d6/d16/d11f/d118 0 2024-04-12T09:11:36.984 INFO:tasks.workunit.client.1.smithi203.stdout:3/703: write d2/d8/d14/d23/d35/d91/f7a [1240011,49114] 0 2024-04-12T09:11:36.988 INFO:tasks.workunit.client.1.smithi203.stdout:0/852: rmdir d0/dd/d71/d94/d2f/d34 39 2024-04-12T09:11:36.996 INFO:tasks.workunit.client.1.smithi203.stdout:5/860: mknod d0/d6/d9b/c136 0 2024-04-12T09:11:36.997 INFO:tasks.workunit.client.1.smithi203.stdout:9/673: creat d8/d12/d23/d85/de1/de6/fea x:0 0 0 2024-04-12T09:11:36.999 INFO:tasks.workunit.client.1.smithi203.stdout:5/861: fdatasync d0/d6/d11/d1e/d4c/d48/fb5 0 2024-04-12T09:11:37.000 INFO:tasks.workunit.client.1.smithi203.stdout:5/862: stat d0/d6/d16/d9/d30/d58/lb9 0 2024-04-12T09:11:37.001 INFO:tasks.workunit.client.1.smithi203.stdout:5/863: readlink d0/d6/d16/d9/d80/df2/d104/l39 0 2024-04-12T09:11:37.001 INFO:tasks.workunit.client.1.smithi203.stdout:2/836: rename d0/l26 to d0/d38/l124 0 2024-04-12T09:11:37.003 INFO:tasks.workunit.client.1.smithi203.stdout:2/837: read d0/d3/fd [1125711,45236] 0 2024-04-12T09:11:37.006 INFO:tasks.workunit.client.1.smithi203.stdout:5/864: readlink d0/d6/d16/lae 0 2024-04-12T09:11:37.009 INFO:tasks.workunit.client.1.smithi203.stdout:4/810: write d1a/d21/d60/f7f [1139299,54570] 0 2024-04-12T09:11:37.012 INFO:tasks.workunit.client.1.smithi203.stdout:5/865: dwrite d0/d6/d16/d9/d30/d58/d74/fc3 [0,4194304] 0 2024-04-12T09:11:37.019 INFO:tasks.workunit.client.1.smithi203.stdout:8/742: rename d4/d8/d74/d78/l36 to d4/d8/d37/d57/lef 0 2024-04-12T09:11:37.019 INFO:tasks.workunit.client.1.smithi203.stdout:1/800: dwrite df/d2d/d6f/d8d/da7/fd8 [0,4194304] 0 2024-04-12T09:11:37.026 INFO:tasks.workunit.client.1.smithi203.stdout:7/779: truncate d0/d34/d7c/ff5 2737341 0 2024-04-12T09:11:37.029 INFO:tasks.workunit.client.1.smithi203.stdout:8/743: dwrite d4/d8/d74/d78/d53/f5b [4194304,4194304] 0 2024-04-12T09:11:37.029 INFO:tasks.workunit.client.1.smithi203.stdout:5/866: mkdir d0/d137 0 2024-04-12T09:11:37.030 INFO:tasks.workunit.client.1.smithi203.stdout:8/744: write d4/d8/d37/f5f [1534277,49496] 0 2024-04-12T09:11:37.030 INFO:tasks.workunit.client.1.smithi203.stdout:1/801: unlink df/d2d/d6f/d75/d80/d54/d5d/d90/fee 0 2024-04-12T09:11:37.032 INFO:tasks.workunit.client.1.smithi203.stdout:8/745: truncate d4/d8/d1c/d5d/dc0/fcf 810607 0 2024-04-12T09:11:37.035 INFO:tasks.workunit.client.1.smithi203.stdout:2/838: getdents d0/d14/d23/d3d 0 2024-04-12T09:11:37.037 INFO:tasks.workunit.client.1.smithi203.stdout:7/780: rmdir d0/d38 39 2024-04-12T09:11:37.044 INFO:tasks.workunit.client.1.smithi203.stdout:5/867: symlink d0/d6/d16/d9/d80/df2/l138 0 2024-04-12T09:11:37.044 INFO:tasks.workunit.client.1.smithi203.stdout:3/704: write d2/f30 [2605612,126251] 0 2024-04-12T09:11:37.046 INFO:tasks.workunit.client.1.smithi203.stdout:3/705: read - d2/d8/d14/d23/d35/d4c/d5c/fd7 zero size 2024-04-12T09:11:37.051 INFO:tasks.workunit.client.1.smithi203.stdout:9/674: write d8/d12/d23/f3a [342131,89407] 0 2024-04-12T09:11:37.054 INFO:tasks.workunit.client.1.smithi203.stdout:8/746: dwrite d4/d8/d74/d78/d53/d8f/fe1 [0,4194304] 0 2024-04-12T09:11:37.059 INFO:tasks.workunit.client.1.smithi203.stdout:3/706: rmdir d2/d8/d14/d1b/d95 39 2024-04-12T09:11:37.061 INFO:tasks.workunit.client.1.smithi203.stdout:3/707: write d2/d8/fa2 [1929163,70292] 0 2024-04-12T09:11:37.065 INFO:tasks.workunit.client.1.smithi203.stdout:6/663: dwrite d1/d3/d26/fa5 [0,4194304] 0 2024-04-12T09:11:37.065 INFO:tasks.workunit.client.1.smithi203.stdout:4/811: dwrite d1a/d21/d60/fa6 [0,4194304] 0 2024-04-12T09:11:37.066 INFO:tasks.workunit.client.1.smithi203.stdout:3/708: fsync d2/d8/d14/d23/d35/d4c/d67/d86/fd9 0 2024-04-12T09:11:37.067 INFO:tasks.workunit.client.1.smithi203.stdout:6/664: dread - d1/d3/d5b/d8c/fc0 zero size 2024-04-12T09:11:37.068 INFO:tasks.workunit.client.1.smithi203.stdout:4/812: stat d1a/d20/d5d/d2c/d72/fa2 0 2024-04-12T09:11:37.076 INFO:tasks.workunit.client.1.smithi203.stdout:7/781: unlink d0/d4/ca8 0 2024-04-12T09:11:37.087 INFO:tasks.workunit.client.1.smithi203.stdout:1/802: link df/c28 df/d2d/d6f/d75/d80/d8c/cf1 0 2024-04-12T09:11:37.087 INFO:tasks.workunit.client.1.smithi203.stdout:2/839: dwrite d0/d14/d23/d33/f83 [0,4194304] 0 2024-04-12T09:11:37.091 INFO:tasks.workunit.client.1.smithi203.stdout:0/853: sync 2024-04-12T09:11:37.091 INFO:tasks.workunit.client.1.smithi203.stdout:6/665: fsync d1/d3/d26/d30/d4a/d6c/f92 0 2024-04-12T09:11:37.092 INFO:tasks.workunit.client.1.smithi203.stdout:0/854: write d0/dd/d71/d94/f3d [588760,50168] 0 2024-04-12T09:11:37.098 INFO:tasks.workunit.client.1.smithi203.stdout:8/747: mknod d4/d8/d74/d78/d53/cf0 0 2024-04-12T09:11:37.104 INFO:tasks.workunit.client.1.smithi203.stdout:2/840: write d0/d14/d1e/d2a/dce/fd4 [2402828,105359] 0 2024-04-12T09:11:37.106 INFO:tasks.workunit.client.1.smithi203.stdout:3/709: symlink d2/d8/d14/d1b/lde 0 2024-04-12T09:11:37.108 INFO:tasks.workunit.client.1.smithi203.stdout:6/666: readlink d1/df/d65/dbc/lbe 0 2024-04-12T09:11:37.111 INFO:tasks.workunit.client.1.smithi203.stdout:3/710: dwrite d2/d51/d65/fc1 [0,4194304] 0 2024-04-12T09:11:37.111 INFO:tasks.workunit.client.1.smithi203.stdout:3/711: readlink d2/l75 0 2024-04-12T09:11:37.112 INFO:tasks.workunit.client.1.smithi203.stdout:3/712: read - d2/d8/d14/d23/d35/d4c/d5c/fd7 zero size 2024-04-12T09:11:37.114 INFO:tasks.workunit.client.1.smithi203.stdout:4/813: mkdir d1a/d20/d5d/d10c 0 2024-04-12T09:11:37.117 INFO:tasks.workunit.client.1.smithi203.stdout:8/748: truncate d4/f5a 804847 0 2024-04-12T09:11:37.118 INFO:tasks.workunit.client.1.smithi203.stdout:9/675: rename d8/d12/d3e/d90/dd8/fe7 to d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/feb 0 2024-04-12T09:11:37.120 INFO:tasks.workunit.client.1.smithi203.stdout:5/868: getdents d0/d6/d16/d9 0 2024-04-12T09:11:37.122 INFO:tasks.workunit.client.1.smithi203.stdout:5/869: write d0/f8e [2518755,23022] 0 2024-04-12T09:11:37.124 INFO:tasks.workunit.client.1.smithi203.stdout:3/713: creat d2/d8/d14/d23/d35/d4c/fdf x:0 0 0 2024-04-12T09:11:37.124 INFO:tasks.workunit.client.1.smithi203.stdout:5/870: fdatasync d0/d6/d11/d18/d2a/f2b 0 2024-04-12T09:11:37.126 INFO:tasks.workunit.client.1.smithi203.stdout:9/676: dwrite d8/d12/d23/f71 [0,4194304] 0 2024-04-12T09:11:37.126 INFO:tasks.workunit.client.1.smithi203.stdout:8/749: creat d4/d8/d1c/d5d/dc0/ff1 x:0 0 0 2024-04-12T09:11:37.127 INFO:tasks.workunit.client.1.smithi203.stdout:1/803: creat df/d2d/d6f/d75/ff2 x:0 0 0 2024-04-12T09:11:37.129 INFO:tasks.workunit.client.1.smithi203.stdout:9/677: fdatasync d8/d12/f81 0 2024-04-12T09:11:37.130 INFO:tasks.workunit.client.1.smithi203.stdout:2/841: unlink d0/d19/l25 0 2024-04-12T09:11:37.134 INFO:tasks.workunit.client.1.smithi203.stdout:2/842: fsync d0/d14/d23/d3d/f111 0 2024-04-12T09:11:37.134 INFO:tasks.workunit.client.1.smithi203.stdout:7/782: dwrite d0/d4/d54/da0/dff/d4c/f94 [0,4194304] 0 2024-04-12T09:11:37.136 INFO:tasks.workunit.client.1.smithi203.stdout:3/714: truncate d2/d8/d14/d23/d35/d4c/d5c/d55/fdc 363466 0 2024-04-12T09:11:37.139 INFO:tasks.workunit.client.1.smithi203.stdout:8/750: rmdir d4/d8/d1c/d48/d5e/de8 39 2024-04-12T09:11:37.139 INFO:tasks.workunit.client.1.smithi203.stdout:3/715: stat d2/d64/l7b 0 2024-04-12T09:11:37.140 INFO:tasks.workunit.client.1.smithi203.stdout:5/871: dwrite d0/ffe [0,4194304] 0 2024-04-12T09:11:37.142 INFO:tasks.workunit.client.1.smithi203.stdout:3/716: chown d2/d8/d14/d45/fa9 8 1 2024-04-12T09:11:37.146 INFO:tasks.workunit.client.1.smithi203.stdout:1/804: dwrite df/d2d/d6f/f9a [0,4194304] 0 2024-04-12T09:11:37.147 INFO:tasks.workunit.client.1.smithi203.stdout:9/678: read d8/f28 [211036,38345] 0 2024-04-12T09:11:37.160 INFO:tasks.workunit.client.1.smithi203.stdout:8/751: chown d4/d8/f1d 372960141 1 2024-04-12T09:11:37.163 INFO:tasks.workunit.client.1.smithi203.stdout:4/814: getdents d1a/d21/d60/daa/dc5/ddc 0 2024-04-12T09:11:37.164 INFO:tasks.workunit.client.1.smithi203.stdout:4/815: truncate d1a/d1d/d69/fca 394523 0 2024-04-12T09:11:37.167 INFO:tasks.workunit.client.1.smithi203.stdout:1/805: stat df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/d88 0 2024-04-12T09:11:37.169 INFO:tasks.workunit.client.1.smithi203.stdout:9/679: unlink d8/fb1 0 2024-04-12T09:11:37.171 INFO:tasks.workunit.client.1.smithi203.stdout:9/680: write d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/f61 [790723,91461] 0 2024-04-12T09:11:37.171 INFO:tasks.workunit.client.1.smithi203.stdout:2/843: creat d0/dd3/f125 x:0 0 0 2024-04-12T09:11:37.172 INFO:tasks.workunit.client.1.smithi203.stdout:7/783: truncate d0/d38/f9c 4466539 0 2024-04-12T09:11:37.172 INFO:tasks.workunit.client.1.smithi203.stdout:9/681: stat d8/d12/d23/d38/d8a/d97/d9e/d74/lac 0 2024-04-12T09:11:37.173 INFO:tasks.workunit.client.1.smithi203.stdout:7/784: dread - d0/d4/d54/d75/dc0/ff7 zero size 2024-04-12T09:11:37.178 INFO:tasks.workunit.client.1.smithi203.stdout:5/872: rename d0/d6/d16/d9/d80/df2/d104/l31 to d0/d9a/d131/l139 0 2024-04-12T09:11:37.181 INFO:tasks.workunit.client.1.smithi203.stdout:0/855: getdents d0/dd/d71/d94/d2f/d17/d19/de4 0 2024-04-12T09:11:37.188 INFO:tasks.workunit.client.1.smithi203.stdout:2/844: mknod d0/d3/d8e/dcc/c126 0 2024-04-12T09:11:37.188 INFO:tasks.workunit.client.1.smithi203.stdout:7/785: unlink d0/d4/d1c/cca 0 2024-04-12T09:11:37.189 INFO:tasks.workunit.client.1.smithi203.stdout:7/786: fsync d0/d38/d51/fcb 0 2024-04-12T09:11:37.192 INFO:tasks.workunit.client.1.smithi203.stdout:8/752: rename d4/d8/d74/da6 to d4/d8/d81/d84/d92/ddc/df2 0 2024-04-12T09:11:37.194 INFO:tasks.workunit.client.1.smithi203.stdout:8/753: dread d4/d8/d1c/d5d/dc0/fcf [0,4194304] 0 2024-04-12T09:11:37.195 INFO:tasks.workunit.client.1.smithi203.stdout:5/873: chown d0/d6/d11/d1e/c41 2511 1 2024-04-12T09:11:37.200 INFO:tasks.workunit.client.1.smithi203.stdout:0/856: creat d0/dd/d5b/f11e x:0 0 0 2024-04-12T09:11:37.201 INFO:tasks.workunit.client.1.smithi203.stdout:0/857: chown d0/d59/d5d/lfc 101980541 1 2024-04-12T09:11:37.201 INFO:tasks.workunit.client.1.smithi203.stdout:1/806: mkdir df/d2d/d6f/d75/d80/df3 0 2024-04-12T09:11:37.202 INFO:tasks.workunit.client.1.smithi203.stdout:1/807: dread - df/d2d/d6f/d75/d80/d2b/fe4 zero size 2024-04-12T09:11:37.203 INFO:tasks.workunit.client.1.smithi203.stdout:1/808: stat df/d2d/d6f/d75/d80/d54/d5d/d58/d94/ccf 0 2024-04-12T09:11:37.204 INFO:tasks.workunit.client.1.smithi203.stdout:4/816: truncate d1a/d20/d5d/d2c/d72/fa2 7619518 0 2024-04-12T09:11:37.209 INFO:tasks.workunit.client.1.smithi203.stdout:1/809: dwrite df/d2d/d6f/d75/d80/d54/d5d/f9c [0,4194304] 0 2024-04-12T09:11:37.211 INFO:tasks.workunit.client.1.smithi203.stdout:4/817: dwrite d1a/d21/d22/d2e/d8d/d9b/dbc/dc7/fe6 [4194304,4194304] 0 2024-04-12T09:11:37.213 INFO:tasks.workunit.client.1.smithi203.stdout:4/818: write d1a/d34/f46 [5038728,104371] 0 2024-04-12T09:11:37.215 INFO:tasks.workunit.client.1.smithi203.stdout:6/667: sync 2024-04-12T09:11:37.217 INFO:tasks.workunit.client.1.smithi203.stdout:6/668: write d1/d3/d4/f42 [3607098,39693] 0 2024-04-12T09:11:37.220 INFO:tasks.workunit.client.1.smithi203.stdout:4/819: dwrite d1a/d1d/fa0 [0,4194304] 0 2024-04-12T09:11:37.227 INFO:tasks.workunit.client.1.smithi203.stdout:6/669: dwrite d1/d3/d26/d30/d4a/d6c/d45/d55/fa8 [0,4194304] 0 2024-04-12T09:11:37.236 INFO:tasks.workunit.client.1.smithi203.stdout:2/845: symlink d0/d14/d1e/d2a/l127 0 2024-04-12T09:11:37.237 INFO:tasks.workunit.client.1.smithi203.stdout:7/787: creat d0/d38/d51/f10a x:0 0 0 2024-04-12T09:11:37.239 INFO:tasks.workunit.client.1.smithi203.stdout:3/717: rename d2/d8/d14/l28 to d2/d8/d14/d1b/d95/d92/ddb/le0 0 2024-04-12T09:11:37.239 INFO:tasks.workunit.client.1.smithi203.stdout:3/718: stat d2/d8/lf 0 2024-04-12T09:11:37.241 INFO:tasks.workunit.client.1.smithi203.stdout:5/874: truncate d0/d6/d16/d9/d80/df2/d104/f85 1308653 0 2024-04-12T09:11:37.244 INFO:tasks.workunit.client.1.smithi203.stdout:0/858: mknod d0/dd/d71/d94/d2f/d17/d19/c11f 0 2024-04-12T09:11:37.254 INFO:tasks.workunit.client.1.smithi203.stdout:4/820: chown d1a/d21/d22/d2e/d8d/d9b/fae 14572 1 2024-04-12T09:11:37.255 INFO:tasks.workunit.client.1.smithi203.stdout:4/821: chown d1a/d21/d22/d2e/d8d/d9b/dbc/dc7/lf2 259 1 2024-04-12T09:11:37.257 INFO:tasks.workunit.client.1.smithi203.stdout:9/682: link d8/l3f d8/d12/da1/lec 0 2024-04-12T09:11:37.260 INFO:tasks.workunit.client.1.smithi203.stdout:8/754: creat d4/d8/d81/db4/dbb/ff3 x:0 0 0 2024-04-12T09:11:37.261 INFO:tasks.workunit.client.1.smithi203.stdout:7/788: dread d0/d15/d2d/f4b [0,4194304] 0 2024-04-12T09:11:37.261 INFO:tasks.workunit.client.1.smithi203.stdout:7/789: fdatasync d0/d4/d54/d75/dc0/ff7 0 2024-04-12T09:11:37.262 INFO:tasks.workunit.client.1.smithi203.stdout:5/875: write d0/d6/d16/d8/fee [2472664,95847] 0 2024-04-12T09:11:37.263 INFO:tasks.workunit.client.1.smithi203.stdout:0/859: rmdir d0/dd/d5b/d90 39 2024-04-12T09:11:37.267 INFO:tasks.workunit.client.1.smithi203.stdout:4/822: write d1a/d2b/f3a [2662345,49492] 0 2024-04-12T09:11:37.268 INFO:tasks.workunit.client.1.smithi203.stdout:5/876: dwrite d0/d6/d16/d11f/d118/f11e [0,4194304] 0 2024-04-12T09:11:37.280 INFO:tasks.workunit.client.1.smithi203.stdout:1/810: creat df/d59/ff4 x:0 0 0 2024-04-12T09:11:37.281 INFO:tasks.workunit.client.1.smithi203.stdout:1/811: stat ca 0 2024-04-12T09:11:37.283 INFO:tasks.workunit.client.1.smithi203.stdout:0/860: mknod d0/dd/d71/d94/d2f/d17/d19/d6f/c120 0 2024-04-12T09:11:37.284 INFO:tasks.workunit.client.1.smithi203.stdout:0/861: write d0/d59/f87 [5277110,31594] 0 2024-04-12T09:11:37.289 INFO:tasks.workunit.client.1.smithi203.stdout:5/877: unlink d0/d6/d11/d1e/f45 0 2024-04-12T09:11:37.297 INFO:tasks.workunit.client.1.smithi203.stdout:7/790: truncate d0/d4/d1c/d5b/f65 882816 0 2024-04-12T09:11:37.298 INFO:tasks.workunit.client.1.smithi203.stdout:1/812: fsync df/d2d/d6f/d75/d80/d54/d5d/d58/d94/fad 0 2024-04-12T09:11:37.300 INFO:tasks.workunit.client.1.smithi203.stdout:6/670: truncate d1/d3/d26/f61 408883 0 2024-04-12T09:11:37.301 INFO:tasks.workunit.client.1.smithi203.stdout:0/862: mknod d0/d48/d5e/dca/c121 0 2024-04-12T09:11:37.302 INFO:tasks.workunit.client.1.smithi203.stdout:9/683: write d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/f43 [390900,77938] 0 2024-04-12T09:11:37.304 INFO:tasks.workunit.client.1.smithi203.stdout:9/684: fsync d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/fc3 0 2024-04-12T09:11:37.305 INFO:tasks.workunit.client.1.smithi203.stdout:5/878: unlink d0/d6/d11/d1e/c41 0 2024-04-12T09:11:37.307 INFO:tasks.workunit.client.1.smithi203.stdout:8/755: dwrite d4/d8/d74/d78/d53/f72 [0,4194304] 0 2024-04-12T09:11:37.309 INFO:tasks.workunit.client.1.smithi203.stdout:2/846: getdents d0/d54/d61/d78 0 2024-04-12T09:11:37.311 INFO:tasks.workunit.client.1.smithi203.stdout:2/847: truncate d0/d14/d1e/d2a/fc5 4631053 0 2024-04-12T09:11:37.312 INFO:tasks.workunit.client.1.smithi203.stdout:3/719: getdents d2/d8/d14/d23/d35 0 2024-04-12T09:11:37.315 INFO:tasks.workunit.client.1.smithi203.stdout:4/823: dwrite d1a/d20/d5f/f66 [0,4194304] 0 2024-04-12T09:11:37.315 INFO:tasks.workunit.client.1.smithi203.stdout:3/720: chown d2/d8/d14/d23/d35/d4c/d5c/dc3/fc4 32 1 2024-04-12T09:11:37.317 INFO:tasks.workunit.client.1.smithi203.stdout:1/813: creat df/d2d/d6f/d75/d80/d2b/d91/ff5 x:0 0 0 2024-04-12T09:11:37.319 INFO:tasks.workunit.client.1.smithi203.stdout:0/863: mknod d0/dd/d71/d94/d2f/d17/dc9/c122 0 2024-04-12T09:11:37.324 INFO:tasks.workunit.client.1.smithi203.stdout:5/879: mkdir d0/d6/d11/d1e/d4c/d48/de4/d13a 0 2024-04-12T09:11:37.326 INFO:tasks.workunit.client.1.smithi203.stdout:5/880: chown d0/d6/d11/d18/d1a/d23/f111 13529 1 2024-04-12T09:11:37.358 INFO:tasks.workunit.client.1.smithi203.stdout:9/685: truncate d8/d12/d3e/d90/f5b 1232593 0 2024-04-12T09:11:37.359 INFO:tasks.workunit.client.1.smithi203.stdout:2/848: getdents d0/d14/d23/d3d 0 2024-04-12T09:11:37.359 INFO:tasks.workunit.client.1.smithi203.stdout:3/721: mknod d2/d8/d14/d23/d35/d91/ce1 0 2024-04-12T09:11:37.361 INFO:tasks.workunit.client.1.smithi203.stdout:6/671: write d1/d3/d26/f9a [1376764,104593] 0 2024-04-12T09:11:37.363 INFO:tasks.workunit.client.1.smithi203.stdout:1/814: creat df/d2d/d6f/d75/d80/d54/d5d/d58/dce/ff6 x:0 0 0 2024-04-12T09:11:37.364 INFO:tasks.workunit.client.1.smithi203.stdout:0/864: dread d0/dd/d71/d94/d2f/d34/ff6 [0,4194304] 0 2024-04-12T09:11:37.364 INFO:tasks.workunit.client.1.smithi203.stdout:5/881: mkdir d0/d6/d16/d9/d80/df2/d104/d13b 0 2024-04-12T09:11:37.364 INFO:tasks.workunit.client.1.smithi203.stdout:9/686: mknod d8/d12/d3e/d90/dd8/ced 0 2024-04-12T09:11:37.367 INFO:tasks.workunit.client.1.smithi203.stdout:2/849: creat d0/d14/d1e/d57/d95/f128 x:0 0 0 2024-04-12T09:11:37.368 INFO:tasks.workunit.client.1.smithi203.stdout:0/865: write d0/ff5 [190664,3695] 0 2024-04-12T09:11:37.369 INFO:tasks.workunit.client.1.smithi203.stdout:7/791: dwrite d0/d4/d53/f7e [0,4194304] 0 2024-04-12T09:11:37.370 INFO:tasks.workunit.client.1.smithi203.stdout:6/672: chown d1/d3/d26/d30/d4a/d6c/d45/d55/f71 9 1 2024-04-12T09:11:37.370 INFO:tasks.workunit.client.1.smithi203.stdout:3/722: mknod d2/d8/d14/d45/dcb/ce2 0 2024-04-12T09:11:37.372 INFO:tasks.workunit.client.1.smithi203.stdout:8/756: dwrite d4/d8/d81/f8b [0,4194304] 0 2024-04-12T09:11:37.380 INFO:tasks.workunit.client.1.smithi203.stdout:1/815: mknod df/d2d/d6f/d75/d80/d2b/d91/db8/cf7 0 2024-04-12T09:11:37.381 INFO:tasks.workunit.client.1.smithi203.stdout:9/687: write d8/d12/d3e/f76 [224212,41309] 0 2024-04-12T09:11:37.384 INFO:tasks.workunit.client.1.smithi203.stdout:0/866: creat d0/dd/d71/d94/d2f/d17/d19/f123 x:0 0 0 2024-04-12T09:11:37.386 INFO:tasks.workunit.client.1.smithi203.stdout:7/792: unlink d0/d4/d1c/d5b/dbf/de1/led 0 2024-04-12T09:11:37.386 INFO:tasks.workunit.client.1.smithi203.stdout:7/793: chown d0/d4/d1c/d5b/dbf/de1/fe7 0 1 2024-04-12T09:11:37.390 INFO:tasks.workunit.client.1.smithi203.stdout:6/673: mkdir d1/dcd 0 2024-04-12T09:11:37.391 INFO:tasks.workunit.client.1.smithi203.stdout:3/723: mknod d2/d8/d14/ce3 0 2024-04-12T09:11:37.393 INFO:tasks.workunit.client.1.smithi203.stdout:9/688: write d8/d12/d23/d85/f1d [2954210,75296] 0 2024-04-12T09:11:37.393 INFO:tasks.workunit.client.1.smithi203.stdout:2/850: dread d0/fc [0,4194304] 0 2024-04-12T09:11:37.395 INFO:tasks.workunit.client.1.smithi203.stdout:2/851: truncate d0/d14/d74/d96/d9a/fe1 501573 0 2024-04-12T09:11:37.395 INFO:tasks.workunit.client.1.smithi203.stdout:0/867: symlink d0/d48/d5e/dca/d101/l124 0 2024-04-12T09:11:37.396 INFO:tasks.workunit.client.1.smithi203.stdout:2/852: dread - d0/d14/d1e/d2a/dcd/dfc/d9c/fae zero size 2024-04-12T09:11:37.399 INFO:tasks.workunit.client.1.smithi203.stdout:6/674: readlink d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/l6e 0 2024-04-12T09:11:37.400 INFO:tasks.workunit.client.1.smithi203.stdout:5/882: truncate d0/d6/d11/d18/d1a/d23/f4f 74783 0 2024-04-12T09:11:37.400 INFO:tasks.workunit.client.1.smithi203.stdout:3/724: mknod d2/d64/d8d/ce4 0 2024-04-12T09:11:37.403 INFO:tasks.workunit.client.1.smithi203.stdout:8/757: creat d4/d8/d37/d57/ff4 x:0 0 0 2024-04-12T09:11:37.404 INFO:tasks.workunit.client.1.smithi203.stdout:1/816: dread df/d2d/d6f/daa/f77 [0,4194304] 0 2024-04-12T09:11:37.404 INFO:tasks.workunit.client.1.smithi203.stdout:1/817: fsync df/d2d/d6f/d75/d80/fb9 0 2024-04-12T09:11:37.408 INFO:tasks.workunit.client.1.smithi203.stdout:2/853: mkdir d0/d14/d1e/d2a/dce/d129 0 2024-04-12T09:11:37.412 INFO:tasks.workunit.client.1.smithi203.stdout:9/689: write d8/d12/d23/d38/d8a/d97/d9e/d74/f7e [1384758,107348] 0 2024-04-12T09:11:37.413 INFO:tasks.workunit.client.1.smithi203.stdout:6/675: mknod d1/d3/d5b/d8c/d3e/cce 0 2024-04-12T09:11:37.414 INFO:tasks.workunit.client.1.smithi203.stdout:9/690: truncate d8/d12/d23/d27/fbc 653910 0 2024-04-12T09:11:37.415 INFO:tasks.workunit.client.1.smithi203.stdout:5/883: creat d0/d6/d11/d1e/d4c/d6a/f13c x:0 0 0 2024-04-12T09:11:37.417 INFO:tasks.workunit.client.1.smithi203.stdout:3/725: dread d2/f2b [0,4194304] 0 2024-04-12T09:11:37.418 INFO:tasks.workunit.client.1.smithi203.stdout:1/818: unlink df/d2d/d6f/daa/ccb 0 2024-04-12T09:11:37.419 INFO:tasks.workunit.client.1.smithi203.stdout:7/794: truncate d0/d34/d7c/f80 770107 0 2024-04-12T09:11:37.420 INFO:tasks.workunit.client.1.smithi203.stdout:2/854: rmdir d0/d67/d86/dd9 39 2024-04-12T09:11:37.425 INFO:tasks.workunit.client.1.smithi203.stdout:9/691: dread d8/d12/f81 [0,4194304] 0 2024-04-12T09:11:37.426 INFO:tasks.workunit.client.1.smithi203.stdout:0/868: rename d0/dd/d71 to d0/d125 0 2024-04-12T09:11:37.426 INFO:tasks.workunit.client.1.smithi203.stdout:2/855: dwrite d0/d14/d23/d3d/f64 [0,4194304] 0 2024-04-12T09:11:37.428 INFO:tasks.workunit.client.1.smithi203.stdout:2/856: read d0/d3/f36 [2023608,32744] 0 2024-04-12T09:11:37.431 INFO:tasks.workunit.client.1.smithi203.stdout:5/884: creat d0/d6/d16/d9/d30/d58/d74/d88/dbf/f13d x:0 0 0 2024-04-12T09:11:37.433 INFO:tasks.workunit.client.1.smithi203.stdout:3/726: symlink d2/d8/d14/d1b/d95/le5 0 2024-04-12T09:11:37.436 INFO:tasks.workunit.client.1.smithi203.stdout:1/819: fdatasync df/f35 0 2024-04-12T09:11:37.437 INFO:tasks.workunit.client.1.smithi203.stdout:9/692: stat d8/d12/d3e/d90/c79 0 2024-04-12T09:11:37.440 INFO:tasks.workunit.client.1.smithi203.stdout:7/795: symlink d0/d4/d1c/d5b/l10b 0 2024-04-12T09:11:37.441 INFO:tasks.workunit.client.1.smithi203.stdout:1/820: dwrite df/d2d/d6f/fac [4194304,4194304] 0 2024-04-12T09:11:37.448 INFO:tasks.workunit.client.1.smithi203.stdout:3/727: mkdir d2/d64/d8d/de6 0 2024-04-12T09:11:37.449 INFO:tasks.workunit.client.1.smithi203.stdout:4/824: sync 2024-04-12T09:11:37.456 INFO:tasks.workunit.client.1.smithi203.stdout:2/857: write d0/d54/d61/d82/fb5 [2102553,71237] 0 2024-04-12T09:11:37.458 INFO:tasks.workunit.client.1.smithi203.stdout:0/869: creat d0/d125/d94/d2f/d17/dc9/de2/f126 x:0 0 0 2024-04-12T09:11:37.461 INFO:tasks.workunit.client.1.smithi203.stdout:3/728: mknod d2/d8/d14/d23/d35/d4c/d67/d86/ce7 0 2024-04-12T09:11:37.462 INFO:tasks.workunit.client.1.smithi203.stdout:3/729: truncate d2/d8/fbf 650224 0 2024-04-12T09:11:37.462 INFO:tasks.workunit.client.1.smithi203.stdout:4/825: creat d1a/d34/de4/f10d x:0 0 0 2024-04-12T09:11:37.463 INFO:tasks.workunit.client.1.smithi203.stdout:7/796: write d0/d4/d5d/f85 [637504,76841] 0 2024-04-12T09:11:37.510 INFO:tasks.workunit.client.1.smithi203.stdout:2/858: mknod d0/d54/d61/d78/c12a 0 2024-04-12T09:11:37.511 INFO:tasks.workunit.client.1.smithi203.stdout:5/885: write d0/d6/f22 [1248430,103744] 0 2024-04-12T09:11:37.511 INFO:tasks.workunit.client.1.smithi203.stdout:3/730: creat d2/d8/d14/d23/d35/d4c/d67/d86/fe8 x:0 0 0 2024-04-12T09:11:37.512 INFO:tasks.workunit.client.1.smithi203.stdout:1/821: getdents df/d2d/d6f/d8d/da7 0 2024-04-12T09:11:37.516 INFO:tasks.workunit.client.1.smithi203.stdout:4/826: dwrite d1a/d20/d5f/f6d [0,4194304] 0 2024-04-12T09:11:37.517 INFO:tasks.workunit.client.1.smithi203.stdout:4/827: readlink d1a/d21/d22/l96 0 2024-04-12T09:11:37.519 INFO:tasks.workunit.client.1.smithi203.stdout:3/731: creat d2/d8/d14/d1b/d95/d92/fe9 x:0 0 0 2024-04-12T09:11:37.520 INFO:tasks.workunit.client.1.smithi203.stdout:1/822: unlink df/d2d/d6f/d75/d80/f41 0 2024-04-12T09:11:37.520 INFO:tasks.workunit.client.1.smithi203.stdout:2/859: dwrite d0/d14/d1e/d57/da1/d110/f116 [0,4194304] 0 2024-04-12T09:11:37.522 INFO:tasks.workunit.client.1.smithi203.stdout:1/823: write df/d2d/d6f/d75/d80/d2b/d91/db8/fbe [590987,68422] 0 2024-04-12T09:11:37.525 INFO:tasks.workunit.client.1.smithi203.stdout:3/732: creat d2/d8/d14/d23/d35/d4c/d5c/dc3/fea x:0 0 0 2024-04-12T09:11:37.526 INFO:tasks.workunit.client.1.smithi203.stdout:3/733: chown d2/d51 46269 1 2024-04-12T09:11:37.527 INFO:tasks.workunit.client.1.smithi203.stdout:3/734: fsync d2/d8/d14/d23/d35/d91/d81/fd8 0 2024-04-12T09:11:37.528 INFO:tasks.workunit.client.1.smithi203.stdout:1/824: readlink df/d2d/d6f/d75/d80/d54/d5d/d58/l89 0 2024-04-12T09:11:37.532 INFO:tasks.workunit.client.1.smithi203.stdout:5/886: link d0/d6/d16/d9/l43 d0/d6/d11/d18/d1a/l13e 0 2024-04-12T09:11:37.533 INFO:tasks.workunit.client.1.smithi203.stdout:1/825: symlink df/d2d/d6f/d75/d80/d54/d5d/d58/d94/deb/lf8 0 2024-04-12T09:11:37.536 INFO:tasks.workunit.client.1.smithi203.stdout:3/735: dwrite d2/d8/fbf [0,4194304] 0 2024-04-12T09:11:37.538 INFO:tasks.workunit.client.1.smithi203.stdout:8/758: sync 2024-04-12T09:11:37.540 INFO:tasks.workunit.client.1.smithi203.stdout:5/887: truncate d0/d6/d11/d1e/d4c/d48/fc9 1035548 0 2024-04-12T09:11:37.540 INFO:tasks.workunit.client.1.smithi203.stdout:2/860: dwrite d0/fb2 [0,4194304] 0 2024-04-12T09:11:37.542 INFO:tasks.workunit.client.1.smithi203.stdout:3/736: truncate d2/f17 3823229 0 2024-04-12T09:11:37.544 INFO:tasks.workunit.client.1.smithi203.stdout:1/826: getdents df/d2d/d6f/d8d 0 2024-04-12T09:11:37.547 INFO:tasks.workunit.client.1.smithi203.stdout:2/861: rename d0/d14/d8a/ff9 to d0/d14/d1e/d57/d95/f12b 0 2024-04-12T09:11:37.549 INFO:tasks.workunit.client.1.smithi203.stdout:5/888: dwrite d0/d6/d16/d9/d80/df2/f12f [0,4194304] 0 2024-04-12T09:11:37.555 INFO:tasks.workunit.client.1.smithi203.stdout:1/827: write df/d2d/d6f/d75/fa0 [646271,41761] 0 2024-04-12T09:11:37.559 INFO:tasks.workunit.client.1.smithi203.stdout:2/862: symlink d0/d3/d47/l12c 0 2024-04-12T09:11:37.563 INFO:tasks.workunit.client.1.smithi203.stdout:5/889: creat d0/d6/d16/d9/d80/f13f x:0 0 0 2024-04-12T09:11:37.564 INFO:tasks.workunit.client.1.smithi203.stdout:4/828: dread d1a/d1d/d69/dcf/ffa [0,4194304] 0 2024-04-12T09:11:37.566 INFO:tasks.workunit.client.1.smithi203.stdout:2/863: dwrite d0/d14/d1e/d57/da1/f10c [0,4194304] 0 2024-04-12T09:11:37.579 INFO:tasks.workunit.client.1.smithi203.stdout:4/829: symlink d1a/l10e 0 2024-04-12T09:11:37.582 INFO:tasks.workunit.client.1.smithi203.stdout:5/890: rename d0/d6/d11/d4a to d0/d6/d16/d44/dda/d140 0 2024-04-12T09:11:37.583 INFO:tasks.workunit.client.1.smithi203.stdout:3/737: link d2/d8/d14/d23/d35/d4c/d5c/c96 d2/d8/ceb 0 2024-04-12T09:11:37.586 INFO:tasks.workunit.client.1.smithi203.stdout:4/830: creat d1a/d21/d60/daa/dc5/f10f x:0 0 0 2024-04-12T09:11:37.587 INFO:tasks.workunit.client.1.smithi203.stdout:4/831: write d1a/d21/d22/ff5 [385568,61700] 0 2024-04-12T09:11:37.587 INFO:tasks.workunit.client.1.smithi203.stdout:5/891: truncate d0/d6/f46 2272022 0 2024-04-12T09:11:37.588 INFO:tasks.workunit.client.1.smithi203.stdout:8/759: getdents d4/d8/d1c/d48/d5e/de8 0 2024-04-12T09:11:37.589 INFO:tasks.workunit.client.1.smithi203.stdout:8/760: fsync d4/f4b 0 2024-04-12T09:11:37.591 INFO:tasks.workunit.client.1.smithi203.stdout:2/864: mknod d0/d67/d86/dd9/d103/c12d 0 2024-04-12T09:11:37.600 INFO:tasks.workunit.client.1.smithi203.stdout:1/828: dwrite df/d2d/d6f/d75/d80/d54/d5d/d58/f66 [0,4194304] 0 2024-04-12T09:11:37.601 INFO:tasks.workunit.client.1.smithi203.stdout:2/865: read d0/d14/fec [20347,43478] 0 2024-04-12T09:11:37.603 INFO:tasks.workunit.client.1.smithi203.stdout:5/892: mkdir d0/d6/d16/d9/d122/d141 0 2024-04-12T09:11:37.604 INFO:tasks.workunit.client.1.smithi203.stdout:4/832: truncate d1a/d1d/fa0 950020 0 2024-04-12T09:11:37.607 INFO:tasks.workunit.client.1.smithi203.stdout:8/761: creat d4/d8/d81/d84/d92/ddc/df2/dee/ff5 x:0 0 0 2024-04-12T09:11:37.608 INFO:tasks.workunit.client.1.smithi203.stdout:3/738: rename d2/d8/d14/d23/d35/d4c/d5c/f4d to d2/d8/d14/d1b/d95/d92/fec 0 2024-04-12T09:11:37.610 INFO:tasks.workunit.client.1.smithi203.stdout:4/833: dwrite d1a/d2b/f3a [0,4194304] 0 2024-04-12T09:11:37.613 INFO:tasks.workunit.client.1.smithi203.stdout:2/866: mkdir d0/d67/d86/df6/d12e 0 2024-04-12T09:11:37.616 INFO:tasks.workunit.client.1.smithi203.stdout:5/893: symlink d0/d6/d11/dd3/d101/l142 0 2024-04-12T09:11:37.617 INFO:tasks.workunit.client.1.smithi203.stdout:5/894: fdatasync d0/d6/d11/f116 0 2024-04-12T09:11:37.618 INFO:tasks.workunit.client.1.smithi203.stdout:4/834: dwrite d1a/d34/de4/ffc [0,4194304] 0 2024-04-12T09:11:37.620 INFO:tasks.workunit.client.1.smithi203.stdout:8/762: link d4/d8/d81/d84/d92/ddc/df2/fd0 d4/d8/d81/db4/dbb/ff6 0 2024-04-12T09:11:37.622 INFO:tasks.workunit.client.1.smithi203.stdout:3/739: link d2/d8/d14/d1b/d95/fb1 d2/d8/d14/d23/d35/d4c/d5c/fed 0 2024-04-12T09:11:37.625 INFO:tasks.workunit.client.1.smithi203.stdout:1/829: write df/f6e [3528327,93962] 0 2024-04-12T09:11:37.627 INFO:tasks.workunit.client.1.smithi203.stdout:8/763: dwrite d4/d8/d74/d78/d53/d8f/fa0 [0,4194304] 0 2024-04-12T09:11:37.629 INFO:tasks.workunit.client.1.smithi203.stdout:4/835: creat d1a/d21/d22/d2e/d8d/d9b/dbc/f110 x:0 0 0 2024-04-12T09:11:37.634 INFO:tasks.workunit.client.1.smithi203.stdout:5/895: truncate d0/d6/d11/d1e/f78 1520894 0 2024-04-12T09:11:37.641 INFO:tasks.workunit.client.1.smithi203.stdout:1/830: symlink df/d2d/d6f/d75/d80/df3/lf9 0 2024-04-12T09:11:37.644 INFO:tasks.workunit.client.1.smithi203.stdout:8/764: mknod d4/d8/d1c/d5d/da7/cf7 0 2024-04-12T09:11:37.644 INFO:tasks.workunit.client.1.smithi203.stdout:5/896: mkdir d0/d6/d16/df8/d143 0 2024-04-12T09:11:37.646 INFO:tasks.workunit.client.1.smithi203.stdout:1/831: dwrite df/d2d/d6f/d75/d80/d8c/fd0 [0,4194304] 0 2024-04-12T09:11:37.647 INFO:tasks.workunit.client.1.smithi203.stdout:4/836: creat d1a/d21/d22/ddd/f111 x:0 0 0 2024-04-12T09:11:37.648 INFO:tasks.workunit.client.1.smithi203.stdout:3/740: link d2/d8/ceb d2/d8/d14/d45/dcb/cee 0 2024-04-12T09:11:37.649 INFO:tasks.workunit.client.1.smithi203.stdout:4/837: write d1a/d21/d60/daa/dc5/f10f [456877,96350] 0 2024-04-12T09:11:37.650 INFO:tasks.workunit.client.1.smithi203.stdout:6/676: sync 2024-04-12T09:11:37.651 INFO:tasks.workunit.client.1.smithi203.stdout:6/677: chown d1/d3/d4/c4f 1194831 1 2024-04-12T09:11:37.654 INFO:tasks.workunit.client.1.smithi203.stdout:5/897: unlink d0/c70 0 2024-04-12T09:11:37.655 INFO:tasks.workunit.client.1.smithi203.stdout:4/838: symlink d1a/d1d/l112 0 2024-04-12T09:11:37.660 INFO:tasks.workunit.client.1.smithi203.stdout:6/678: symlink d1/d3/d5b/d8c/d3e/da1/lcf 0 2024-04-12T09:11:37.662 INFO:tasks.workunit.client.1.smithi203.stdout:1/832: mkdir df/d2d/d6f/dfa 0 2024-04-12T09:11:37.664 INFO:tasks.workunit.client.1.smithi203.stdout:6/679: mknod d1/d3/d91/cd0 0 2024-04-12T09:11:37.668 INFO:tasks.workunit.client.1.smithi203.stdout:6/680: mknod d1/d3/d91/cd1 0 2024-04-12T09:11:37.669 INFO:tasks.workunit.client.1.smithi203.stdout:6/681: fsync d1/df/f6b 0 2024-04-12T09:11:37.670 INFO:tasks.workunit.client.1.smithi203.stdout:1/833: mkdir df/dfb 0 2024-04-12T09:11:37.673 INFO:tasks.workunit.client.1.smithi203.stdout:8/765: dwrite d4/d8/d1c/f31 [0,4194304] 0 2024-04-12T09:11:37.675 INFO:tasks.workunit.client.1.smithi203.stdout:6/682: read d1/d3/d26/d30/d4a/d6c/d45/d55/d77/f93 [9542,26792] 0 2024-04-12T09:11:37.678 INFO:tasks.workunit.client.1.smithi203.stdout:5/898: link d0/d6/d16/d9/d30/d89/cc6 d0/d6/d11/d18/d1a/c144 0 2024-04-12T09:11:37.679 INFO:tasks.workunit.client.1.smithi203.stdout:3/741: dwrite d2/d8/d14/d23/d35/d4c/d5c/d55/fbe [0,4194304] 0 2024-04-12T09:11:37.680 INFO:tasks.workunit.client.1.smithi203.stdout:5/899: fsync d0/d6/d16/d9/d30/fab 0 2024-04-12T09:11:37.682 INFO:tasks.workunit.client.1.smithi203.stdout:4/839: getdents d1a/d1d/d9c 0 2024-04-12T09:11:37.685 INFO:tasks.workunit.client.1.smithi203.stdout:1/834: unlink df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/f81 0 2024-04-12T09:11:37.686 INFO:tasks.workunit.client.1.smithi203.stdout:1/835: fdatasync df/f6e 0 2024-04-12T09:11:37.691 INFO:tasks.workunit.client.1.smithi203.stdout:8/766: mknod d4/d8/d74/db6/cf8 0 2024-04-12T09:11:37.692 INFO:tasks.workunit.client.1.smithi203.stdout:8/767: chown d4/d8/f42 252747 1 2024-04-12T09:11:37.692 INFO:tasks.workunit.client.1.smithi203.stdout:8/768: stat d4/d8/d81 0 2024-04-12T09:11:37.692 INFO:tasks.workunit.client.1.smithi203.stdout:6/683: chown d1/df/d87/d7a/c8a 12 1 2024-04-12T09:11:37.693 INFO:tasks.workunit.client.1.smithi203.stdout:6/684: readlink d1/d3/d26/d30/d4a/d6c/d45/l6a 0 2024-04-12T09:11:37.694 INFO:tasks.workunit.client.1.smithi203.stdout:6/685: stat d1/d3/d5b/d8c/d3e/da1/lcf 0 2024-04-12T09:11:37.699 INFO:tasks.workunit.client.1.smithi203.stdout:4/840: mkdir d1a/d21/d22/d2e/d8b/d113 0 2024-04-12T09:11:37.700 INFO:tasks.workunit.client.1.smithi203.stdout:1/836: readlink df/d2d/l86 0 2024-04-12T09:11:37.701 INFO:tasks.workunit.client.1.smithi203.stdout:3/742: mkdir d2/d8/def 0 2024-04-12T09:11:37.705 INFO:tasks.workunit.client.1.smithi203.stdout:8/769: creat d4/ddf/ff9 x:0 0 0 2024-04-12T09:11:37.706 INFO:tasks.workunit.client.1.smithi203.stdout:3/743: rmdir d2/d8/d14/d1b/d95/d92/ddb 39 2024-04-12T09:11:37.709 INFO:tasks.workunit.client.1.smithi203.stdout:1/837: mknod df/d59/cfc 0 2024-04-12T09:11:37.710 INFO:tasks.workunit.client.1.smithi203.stdout:8/770: mknod d4/d8/d81/d8e/cfa 0 2024-04-12T09:11:37.711 INFO:tasks.workunit.client.1.smithi203.stdout:3/744: creat d2/d8/d14/d23/d35/d91/d81/ff0 x:0 0 0 2024-04-12T09:11:37.712 INFO:tasks.workunit.client.1.smithi203.stdout:3/745: read - d2/d51/fa5 zero size 2024-04-12T09:11:37.714 INFO:tasks.workunit.client.1.smithi203.stdout:4/841: getdents d1a/d21/d60/d68/dbe 0 2024-04-12T09:11:37.717 INFO:tasks.workunit.client.1.smithi203.stdout:3/746: dwrite d2/d8/d14/fac [0,4194304] 0 2024-04-12T09:11:37.717 INFO:tasks.workunit.client.1.smithi203.stdout:6/686: write d1/d3/d26/d30/d4a/d6c/d45/f52 [1695590,104518] 0 2024-04-12T09:11:37.723 INFO:tasks.workunit.client.1.smithi203.stdout:1/838: write df/d2d/d6f/d75/d80/d54/f46 [327208,47624] 0 2024-04-12T09:11:37.724 INFO:tasks.workunit.client.1.smithi203.stdout:8/771: creat d4/ffb x:0 0 0 2024-04-12T09:11:37.725 INFO:tasks.workunit.client.1.smithi203.stdout:8/772: fdatasync d4/f4b 0 2024-04-12T09:11:37.725 INFO:tasks.workunit.client.1.smithi203.stdout:1/839: fdatasync df/d2d/d6f/d75/d80/d54/f3b 0 2024-04-12T09:11:37.726 INFO:tasks.workunit.client.1.smithi203.stdout:8/773: write d4/d8/d1c/f82 [1195320,60179] 0 2024-04-12T09:11:37.732 INFO:tasks.workunit.client.1.smithi203.stdout:4/842: write d1a/d20/d5f/f7a [382244,128707] 0 2024-04-12T09:11:37.732 INFO:tasks.workunit.client.1.smithi203.stdout:9/693: sync 2024-04-12T09:11:37.732 INFO:tasks.workunit.client.1.smithi203.stdout:0/870: sync 2024-04-12T09:11:37.732 INFO:tasks.workunit.client.1.smithi203.stdout:7/797: sync 2024-04-12T09:11:37.733 INFO:tasks.workunit.client.1.smithi203.stdout:1/840: creat df/d2d/d6f/d75/d80/d8c/ffd x:0 0 0 2024-04-12T09:11:37.735 INFO:tasks.workunit.client.1.smithi203.stdout:4/843: dread d1a/d21/da1/fa8 [0,4194304] 0 2024-04-12T09:11:37.736 INFO:tasks.workunit.client.1.smithi203.stdout:1/841: chown df/d2d/d6f/d75/d80/d54/d5d/d58/d94/deb/lf8 14496 1 2024-04-12T09:11:37.737 INFO:tasks.workunit.client.1.smithi203.stdout:0/871: symlink d0/d125/d94/d2f/d17/d19/de4/l127 0 2024-04-12T09:11:37.738 INFO:tasks.workunit.client.1.smithi203.stdout:0/872: chown d0/d125/d94/d65/ca7 2802480 1 2024-04-12T09:11:37.739 INFO:tasks.workunit.client.1.smithi203.stdout:3/747: write d2/f17 [3446652,55497] 0 2024-04-12T09:11:37.741 INFO:tasks.workunit.client.1.smithi203.stdout:6/687: truncate d1/d3/d26/f79 3239130 0 2024-04-12T09:11:37.744 INFO:tasks.workunit.client.1.smithi203.stdout:1/842: creat df/d2d/d6f/d75/d80/d54/ffe x:0 0 0 2024-04-12T09:11:37.745 INFO:tasks.workunit.client.1.smithi203.stdout:8/774: write d4/d8/d81/d84/d92/ddc/df2/fd0 [826106,121517] 0 2024-04-12T09:11:37.746 INFO:tasks.workunit.client.1.smithi203.stdout:8/775: chown d4/d8/d74/d78/fd2 868 1 2024-04-12T09:11:37.748 INFO:tasks.workunit.client.1.smithi203.stdout:0/873: write d0/d125/d94/d2f/d34/ff6 [1255098,68818] 0 2024-04-12T09:11:37.749 INFO:tasks.workunit.client.1.smithi203.stdout:3/748: unlink d2/d8/d14/d23/d35/fa1 0 2024-04-12T09:11:37.749 INFO:tasks.workunit.client.1.smithi203.stdout:6/688: dread d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/d9c/fa7 [0,4194304] 0 2024-04-12T09:11:37.750 INFO:tasks.workunit.client.1.smithi203.stdout:0/874: truncate d0/dd/d5b/fba 380205 0 2024-04-12T09:11:37.751 INFO:tasks.workunit.client.1.smithi203.stdout:0/875: write d0/d125/fb7 [215989,15756] 0 2024-04-12T09:11:37.751 INFO:tasks.workunit.client.1.smithi203.stdout:6/689: read d1/d3/f97 [404002,105111] 0 2024-04-12T09:11:37.752 INFO:tasks.workunit.client.1.smithi203.stdout:0/876: readlink d0/d48/d5e/dca/d101/l115 0 2024-04-12T09:11:37.753 INFO:tasks.workunit.client.1.smithi203.stdout:6/690: stat d1/d3/d26/d30/d4a/f7d 0 2024-04-12T09:11:37.760 INFO:tasks.workunit.client.1.smithi203.stdout:7/798: dwrite d0/d4/d1c/d5b/f65 [0,4194304] 0 2024-04-12T09:11:37.763 INFO:tasks.workunit.client.1.smithi203.stdout:8/776: dread d4/d8/d74/d78/f3a [0,4194304] 0 2024-04-12T09:11:37.764 INFO:tasks.workunit.client.1.smithi203.stdout:9/694: link d8/d12/d23/d38/d8a/cb0 d8/d3b/db7/cee 0 2024-04-12T09:11:37.768 INFO:tasks.workunit.client.1.smithi203.stdout:6/691: creat d1/df/d65/d96/fd2 x:0 0 0 2024-04-12T09:11:37.768 INFO:tasks.workunit.client.1.smithi203.stdout:6/692: readlink d1/l80 0 2024-04-12T09:11:37.769 INFO:tasks.workunit.client.1.smithi203.stdout:4/844: truncate d1a/d20/d5d/d2c/d72/fc8 644893 0 2024-04-12T09:11:37.772 INFO:tasks.workunit.client.1.smithi203.stdout:1/843: mkdir df/dfb/dff 0 2024-04-12T09:11:37.775 INFO:tasks.workunit.client.1.smithi203.stdout:5/900: sync 2024-04-12T09:11:37.775 INFO:tasks.workunit.client.1.smithi203.stdout:2/867: sync 2024-04-12T09:11:37.776 INFO:tasks.workunit.client.1.smithi203.stdout:3/749: fsync d2/d8/f85 0 2024-04-12T09:11:37.777 INFO:tasks.workunit.client.1.smithi203.stdout:3/750: chown d2/d51/d65/f77 0 1 2024-04-12T09:11:37.778 INFO:tasks.workunit.client.1.smithi203.stdout:3/751: dread - d2/d8/d14/d23/d35/d4c/fdf zero size 2024-04-12T09:11:37.780 INFO:tasks.workunit.client.1.smithi203.stdout:0/877: symlink d0/d48/d5e/d84/dd0/l128 0 2024-04-12T09:11:37.784 INFO:tasks.workunit.client.1.smithi203.stdout:9/695: dread d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/f82 [0,4194304] 0 2024-04-12T09:11:37.784 INFO:tasks.workunit.client.1.smithi203.stdout:4/845: rename d1a/d21/f98 to d1a/d20/d5f/f114 0 2024-04-12T09:11:37.786 INFO:tasks.workunit.client.1.smithi203.stdout:0/878: dwrite d0/d125/d94/d2f/d17/d19/f25 [12582912,4194304] 0 2024-04-12T09:11:37.787 INFO:tasks.workunit.client.1.smithi203.stdout:9/696: truncate d8/d12/d23/d27/fc8 4694731 0 2024-04-12T09:11:37.788 INFO:tasks.workunit.client.1.smithi203.stdout:7/799: write d0/d34/d7c/fe9 [1112262,20998] 0 2024-04-12T09:11:37.789 INFO:tasks.workunit.client.1.smithi203.stdout:4/846: read d1a/d21/d22/d2e/fd4 [617509,102173] 0 2024-04-12T09:11:37.794 INFO:tasks.workunit.client.1.smithi203.stdout:3/752: write d2/d8/fa2 [557378,120673] 0 2024-04-12T09:11:37.794 INFO:tasks.workunit.client.1.smithi203.stdout:6/693: getdents d1/df/d87/d7a 0 2024-04-12T09:11:37.802 INFO:tasks.workunit.client.1.smithi203.stdout:3/753: dread - d2/d8/d14/d1b/d95/fb1 zero size 2024-04-12T09:11:37.804 INFO:tasks.workunit.client.1.smithi203.stdout:0/879: dwrite d0/d125/d94/d2f/d17/dc9/ffa [0,4194304] 0 2024-04-12T09:11:37.806 INFO:tasks.workunit.client.1.smithi203.stdout:8/777: dwrite d4/d8/d1c/d5d/f73 [4194304,4194304] 0 2024-04-12T09:11:37.807 INFO:tasks.workunit.client.1.smithi203.stdout:1/844: write df/f1e [4308909,108173] 0 2024-04-12T09:11:37.810 INFO:tasks.workunit.client.1.smithi203.stdout:5/901: dwrite d0/d6/d11/d18/d2a/dc8/f110 [0,4194304] 0 2024-04-12T09:11:37.813 INFO:tasks.workunit.client.1.smithi203.stdout:9/697: dwrite d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/f4c [4194304,4194304] 0 2024-04-12T09:11:37.816 INFO:tasks.workunit.client.1.smithi203.stdout:6/694: mkdir d1/df/dd3 0 2024-04-12T09:11:37.816 INFO:tasks.workunit.client.1.smithi203.stdout:8/778: fdatasync d4/d8/d1c/f31 0 2024-04-12T09:11:37.817 INFO:tasks.workunit.client.1.smithi203.stdout:4/847: dwrite d1a/d21/d22/f109 [0,4194304] 0 2024-04-12T09:11:37.820 INFO:tasks.workunit.client.1.smithi203.stdout:5/902: dread - d0/d6/d11/d1e/d4c/d6a/f13c zero size 2024-04-12T09:11:37.823 INFO:tasks.workunit.client.1.smithi203.stdout:1/845: fdatasync df/d2d/f5f 0 2024-04-12T09:11:37.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:37 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:37.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:37 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:37.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:37 smithi203 ceph-mon[36428]: Reconfiguring grafana.smithi117 (dependencies changed)... 2024-04-12T09:11:37.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:37 smithi203 ceph-mon[36428]: Reconfiguring daemon grafana.smithi117 on smithi117 2024-04-12T09:11:37.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:37 smithi203 ceph-mon[36428]: pgmap v29: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 103 MiB/s rd, 294 MiB/s wr, 596 op/s 2024-04-12T09:11:37.827 INFO:tasks.workunit.client.1.smithi203.stdout:0/880: mknod d0/d125/d94/d2f/d17/d19/d6f/d78/dcd/c129 0 2024-04-12T09:11:37.830 INFO:tasks.workunit.client.1.smithi203.stdout:9/698: dwrite d8/d12/d23/d41/f78 [0,4194304] 0 2024-04-12T09:11:37.833 INFO:tasks.workunit.client.1.smithi203.stdout:8/779: dwrite d4/f97 [0,4194304] 0 2024-04-12T09:11:37.834 INFO:tasks.workunit.client.1.smithi203.stdout:6/695: unlink d1/d3/d5b/d8c/d3e/l7f 0 2024-04-12T09:11:37.835 INFO:tasks.workunit.client.1.smithi203.stdout:3/754: dwrite d2/f2b [0,4194304] 0 2024-04-12T09:11:37.841 INFO:tasks.workunit.client.1.smithi203.stdout:9/699: dwrite d8/d12/d23/f71 [0,4194304] 0 2024-04-12T09:11:37.843 INFO:tasks.workunit.client.1.smithi203.stdout:1/846: rename df/f83 to df/d2d/d6f/d75/d80/d2b/d91/f100 0 2024-04-12T09:11:37.845 INFO:tasks.workunit.client.1.smithi203.stdout:9/700: fsync d8/d12/d23/d41/f5e 0 2024-04-12T09:11:37.850 INFO:tasks.workunit.client.1.smithi203.stdout:1/847: dwrite df/f6e [0,4194304] 0 2024-04-12T09:11:37.857 INFO:tasks.workunit.client.1.smithi203.stdout:4/848: symlink d1a/d20/d5d/d2c/d72/d10a/l115 0 2024-04-12T09:11:37.862 INFO:tasks.workunit.client.1.smithi203.stdout:0/881: mknod d0/d48/c12a 0 2024-04-12T09:11:37.863 INFO:tasks.workunit.client.1.smithi203.stdout:0/882: chown d0/d125/d94/c41 0 1 2024-04-12T09:11:37.865 INFO:tasks.workunit.client.1.smithi203.stdout:7/800: truncate d0/d4/d53/f7e 608940 0 2024-04-12T09:11:37.867 INFO:tasks.workunit.client.1.smithi203.stdout:7/801: write d0/d15/f20 [2598210,31777] 0 2024-04-12T09:11:37.869 INFO:tasks.workunit.client.1.smithi203.stdout:3/755: creat d2/d51/dbc/ff1 x:0 0 0 2024-04-12T09:11:37.869 INFO:tasks.workunit.client.1.smithi203.stdout:0/883: dread d0/d125/d94/d2f/d17/dc9/ffa [0,4194304] 0 2024-04-12T09:11:37.870 INFO:tasks.workunit.client.1.smithi203.stdout:4/849: truncate d1a/d21/d22/f39 1617969 0 2024-04-12T09:11:37.873 INFO:tasks.workunit.client.1.smithi203.stdout:6/696: rename d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d3a/fc4 to d1/d3/d26/d30/d4a/d6c/d45/d55/fd4 0 2024-04-12T09:11:37.878 INFO:tasks.workunit.client.1.smithi203.stdout:0/884: write d0/dd/d40/f62 [2735181,98219] 0 2024-04-12T09:11:37.879 INFO:tasks.workunit.client.1.smithi203.stdout:4/850: truncate d1a/d21/f5c 2448863 0 2024-04-12T09:11:37.880 INFO:tasks.workunit.client.1.smithi203.stdout:1/848: rmdir df/d2d/d6f/d75/d80/d2b/d91 39 2024-04-12T09:11:37.881 INFO:tasks.workunit.client.1.smithi203.stdout:6/697: creat d1/d3/d26/dcb/fd5 x:0 0 0 2024-04-12T09:11:37.882 INFO:tasks.workunit.client.1.smithi203.stdout:6/698: fsync d1/d3/d26/d30/d4a/d6c/d45/d55/fa8 0 2024-04-12T09:11:37.883 INFO:tasks.workunit.client.1.smithi203.stdout:7/802: symlink d0/d4/d54/d75/l10c 0 2024-04-12T09:11:37.892 INFO:tasks.workunit.client.1.smithi203.stdout:8/780: dread d4/d8/f77 [0,4194304] 0 2024-04-12T09:11:37.892 INFO:tasks.workunit.client.1.smithi203.stdout:2/868: sync 2024-04-12T09:11:37.892 INFO:tasks.workunit.client.1.smithi203.stdout:6/699: dwrite d1/d3/d5b/d8c/d3e/da1/fc9 [0,4194304] 0 2024-04-12T09:11:37.894 INFO:tasks.workunit.client.1.smithi203.stdout:2/869: truncate d0/d3/d8e/fdd 392688 0 2024-04-12T09:11:37.895 INFO:tasks.workunit.client.1.smithi203.stdout:3/756: dread d2/d64/d8d/fae [0,4194304] 0 2024-04-12T09:11:37.896 INFO:tasks.workunit.client.1.smithi203.stdout:3/757: fdatasync d2/d8/d14/d23/d35/d4c/d5c/fdd 0 2024-04-12T09:11:37.898 INFO:tasks.workunit.client.1.smithi203.stdout:7/803: fsync d0/d4/d53/f7e 0 2024-04-12T09:11:37.900 INFO:tasks.workunit.client.1.smithi203.stdout:7/804: truncate d0/d4/d54/da0/dff/f46 4844773 0 2024-04-12T09:11:37.900 INFO:tasks.workunit.client.1.smithi203.stdout:3/758: read d2/d8/d14/d23/d35/d4c/d67/f9f [1791137,56544] 0 2024-04-12T09:11:37.901 INFO:tasks.workunit.client.1.smithi203.stdout:8/781: write d4/d8/d74/d78/f3a [3065181,35101] 0 2024-04-12T09:11:37.903 INFO:tasks.workunit.client.1.smithi203.stdout:4/851: dread f5 [4194304,4194304] 0 2024-04-12T09:11:37.904 INFO:tasks.workunit.client.1.smithi203.stdout:4/852: chown d1a/d2b/l4d 4389 1 2024-04-12T09:11:37.904 INFO:tasks.workunit.client.1.smithi203.stdout:3/759: truncate d2/d8/d14/d23/d35/d4c/fb6 1270699 0 2024-04-12T09:11:37.906 INFO:tasks.workunit.client.1.smithi203.stdout:2/870: mkdir d0/d14/d1e/d57/d95/d12f 0 2024-04-12T09:11:37.910 INFO:tasks.workunit.client.1.smithi203.stdout:7/805: fdatasync d0/d38/d79/fa7 0 2024-04-12T09:11:37.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:37 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:37.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:37 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:11:37.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:37 smithi117 ceph-mon[29277]: Reconfiguring grafana.smithi117 (dependencies changed)... 2024-04-12T09:11:37.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:37 smithi117 ceph-mon[29277]: Reconfiguring daemon grafana.smithi117 on smithi117 2024-04-12T09:11:37.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:37 smithi117 ceph-mon[29277]: pgmap v29: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 103 MiB/s rd, 294 MiB/s wr, 596 op/s 2024-04-12T09:11:37.911 INFO:tasks.workunit.client.1.smithi203.stdout:7/806: stat d0/d4/d54/d75/dc0/c107 0 2024-04-12T09:11:37.911 INFO:tasks.workunit.client.1.smithi203.stdout:6/700: fdatasync d1/d3/d26/f79 0 2024-04-12T09:11:37.912 INFO:tasks.workunit.client.1.smithi203.stdout:1/849: getdents df/dfb 0 2024-04-12T09:11:37.913 INFO:tasks.workunit.client.1.smithi203.stdout:8/782: mkdir d4/d8/d81/d84/dfc 0 2024-04-12T09:11:37.914 INFO:tasks.workunit.client.1.smithi203.stdout:8/783: chown d4/d8/d1c/d48/d5e/cb5 389 1 2024-04-12T09:11:37.915 INFO:tasks.workunit.client.1.smithi203.stdout:4/853: unlink d1a/d21/d22/f62 0 2024-04-12T09:11:37.917 INFO:tasks.workunit.client.1.smithi203.stdout:3/760: creat d2/d8/d14/d23/d35/d4c/d5c/ff2 x:0 0 0 2024-04-12T09:11:37.918 INFO:tasks.workunit.client.1.smithi203.stdout:2/871: symlink d0/d14/d1e/d2a/dcd/l130 0 2024-04-12T09:11:37.919 INFO:tasks.workunit.client.1.smithi203.stdout:0/885: dwrite d0/f2c [0,4194304] 0 2024-04-12T09:11:37.921 INFO:tasks.workunit.client.1.smithi203.stdout:7/807: stat d0/d15/d2d/df2/cc8 0 2024-04-12T09:11:37.924 INFO:tasks.workunit.client.1.smithi203.stdout:6/701: fdatasync d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/db5/fc5 0 2024-04-12T09:11:37.924 INFO:tasks.workunit.client.1.smithi203.stdout:1/850: creat df/d2d/d6f/d75/d80/d54/f101 x:0 0 0 2024-04-12T09:11:37.926 INFO:tasks.workunit.client.1.smithi203.stdout:6/702: stat d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/da0 0 2024-04-12T09:11:37.927 INFO:tasks.workunit.client.1.smithi203.stdout:3/761: mkdir d2/d64/df3 0 2024-04-12T09:11:37.929 INFO:tasks.workunit.client.1.smithi203.stdout:8/784: creat d4/d8/d1c/d5d/dc9/ffd x:0 0 0 2024-04-12T09:11:37.931 INFO:tasks.workunit.client.1.smithi203.stdout:4/854: creat d1a/d20/d5d/d10c/f116 x:0 0 0 2024-04-12T09:11:37.934 INFO:tasks.workunit.client.1.smithi203.stdout:2/872: link d0/d14/d1e/d2a/f5d d0/d3/d8e/df4/f131 0 2024-04-12T09:11:37.938 INFO:tasks.workunit.client.1.smithi203.stdout:7/808: dread d0/f7 [0,4194304] 0 2024-04-12T09:11:37.939 INFO:tasks.workunit.client.1.smithi203.stdout:6/703: mknod d1/d3/d26/d30/d4a/d6c/d45/d55/d77/cd6 0 2024-04-12T09:11:37.940 INFO:tasks.workunit.client.1.smithi203.stdout:3/762: mknod d2/d8/d14/d1b/d2f/cf4 0 2024-04-12T09:11:37.941 INFO:tasks.workunit.client.1.smithi203.stdout:3/763: write d2/d8/d14/f90 [1001528,15470] 0 2024-04-12T09:11:37.941 INFO:tasks.workunit.client.1.smithi203.stdout:1/851: link df/d2d/d6f/d75/d80/d8c/ld2 df/d2d/d6f/d75/d80/df3/l102 0 2024-04-12T09:11:37.942 INFO:tasks.workunit.client.1.smithi203.stdout:4/855: dwrite d1a/d34/f35 [0,4194304] 0 2024-04-12T09:11:37.945 INFO:tasks.workunit.client.1.smithi203.stdout:7/809: write d0/d15/d2d/f4b [3533984,11023] 0 2024-04-12T09:11:37.946 INFO:tasks.workunit.client.1.smithi203.stdout:7/810: dread - d0/d4/d54/d75/fab zero size 2024-04-12T09:11:37.950 INFO:tasks.workunit.client.1.smithi203.stdout:4/856: dread d1a/d21/d22/d2e/d8b/f99 [0,4194304] 0 2024-04-12T09:11:37.953 INFO:tasks.workunit.client.1.smithi203.stdout:1/852: mkdir df/d2d/d6f/d75/d80/d54/d103 0 2024-04-12T09:11:37.955 INFO:tasks.workunit.client.1.smithi203.stdout:3/764: symlink d2/d8/d14/d23/d35/d4c/d5c/dc3/lf5 0 2024-04-12T09:11:37.960 INFO:tasks.workunit.client.1.smithi203.stdout:6/704: rename d1/d3/d26/f61 to d1/df/d87/fd7 0 2024-04-12T09:11:37.961 INFO:tasks.workunit.client.1.smithi203.stdout:2/873: creat d0/d38/f132 x:0 0 0 2024-04-12T09:11:37.961 INFO:tasks.workunit.client.1.smithi203.stdout:3/765: dwrite d2/d51/fa5 [0,4194304] 0 2024-04-12T09:11:37.962 INFO:tasks.workunit.client.1.smithi203.stdout:6/705: write d1/d3/d26/dcb/fd5 [673831,99948] 0 2024-04-12T09:11:37.966 INFO:tasks.workunit.client.1.smithi203.stdout:5/903: sync 2024-04-12T09:11:37.967 INFO:tasks.workunit.client.1.smithi203.stdout:3/766: truncate d2/d8/d14/d23/d35/d4c/d5c/f56 1411285 0 2024-04-12T09:11:37.968 INFO:tasks.workunit.client.1.smithi203.stdout:8/785: getdents d4/ddf 0 2024-04-12T09:11:37.973 INFO:tasks.workunit.client.1.smithi203.stdout:7/811: rename d0/d4/f88 to d0/d4/d54/d75/dc0/f10d 0 2024-04-12T09:11:37.978 INFO:tasks.workunit.client.1.smithi203.stdout:8/786: write d4/d8/d74/d78/d53/d8f/fe1 [5094963,22322] 0 2024-04-12T09:11:37.979 INFO:tasks.workunit.client.1.smithi203.stdout:2/874: dwrite d0/d3/d8f/ff3 [0,4194304] 0 2024-04-12T09:11:37.981 INFO:tasks.workunit.client.1.smithi203.stdout:4/857: dread d1a/d2b/f80 [0,4194304] 0 2024-04-12T09:11:37.992 INFO:tasks.workunit.client.1.smithi203.stdout:9/701: sync 2024-04-12T09:11:37.994 INFO:tasks.workunit.client.1.smithi203.stdout:3/767: mkdir d2/d8/d14/d23/d35/d4c/d5c/d55/df6 0 2024-04-12T09:11:37.994 INFO:tasks.workunit.client.1.smithi203.stdout:7/812: read d0/d4/f69 [1433896,18677] 0 2024-04-12T09:11:37.996 INFO:tasks.workunit.client.1.smithi203.stdout:8/787: readlink d4/d8/d1c/d48/d5e/l70 0 2024-04-12T09:11:37.997 INFO:tasks.workunit.client.1.smithi203.stdout:5/904: truncate d0/d6/d16/d9/d80/df2/d104/d2d/fed 3914348 0 2024-04-12T09:11:37.999 INFO:tasks.workunit.client.1.smithi203.stdout:3/768: truncate d2/d8/d14/d23/d35/d4c/d5c/f9a 49802 0 2024-04-12T09:11:38.001 INFO:tasks.workunit.client.1.smithi203.stdout:4/858: creat d1a/d20/d5d/d2c/d72/f117 x:0 0 0 2024-04-12T09:11:38.007 INFO:tasks.workunit.client.1.smithi203.stdout:6/706: link d1/d3/d5b/f6d d1/d3/d26/d30/d4a/fd8 0 2024-04-12T09:11:38.007 INFO:tasks.workunit.client.1.smithi203.stdout:9/702: creat d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d40/fef x:0 0 0 2024-04-12T09:11:38.009 INFO:tasks.workunit.client.1.smithi203.stdout:7/813: dwrite d0/d4/d54/d75/f9a [0,4194304] 0 2024-04-12T09:11:38.012 INFO:tasks.workunit.client.1.smithi203.stdout:1/853: rename df/d2d/fd1 to df/d2d/d6f/d75/d80/d54/d5d/f104 0 2024-04-12T09:11:38.012 INFO:tasks.workunit.client.1.smithi203.stdout:7/814: fdatasync d0/d4/d54/da0/dff/d4c/f94 0 2024-04-12T09:11:38.013 INFO:tasks.workunit.client.1.smithi203.stdout:8/788: link d4/d8/f42 d4/d8/d1c/d5d/ffe 0 2024-04-12T09:11:38.015 INFO:tasks.workunit.client.1.smithi203.stdout:5/905: dwrite d0/d6/d11/d18/dcc/fdd [0,4194304] 0 2024-04-12T09:11:38.019 INFO:tasks.workunit.client.1.smithi203.stdout:9/703: mkdir d8/d12/d23/df0 0 2024-04-12T09:11:38.019 INFO:tasks.workunit.client.1.smithi203.stdout:6/707: creat d1/d3/d26/d36/fd9 x:0 0 0 2024-04-12T09:11:38.020 INFO:tasks.workunit.client.1.smithi203.stdout:9/704: chown d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d70/lbd 3195 1 2024-04-12T09:11:38.021 INFO:tasks.workunit.client.1.smithi203.stdout:9/705: chown d8/d12/d23/d38/d8a/d97/d9e/d74/dc7 2040085835 1 2024-04-12T09:11:38.022 INFO:tasks.workunit.client.1.smithi203.stdout:1/854: creat df/d2d/d6d/f105 x:0 0 0 2024-04-12T09:11:38.023 INFO:tasks.workunit.client.1.smithi203.stdout:2/875: dread d0/d14/d23/f8b [0,4194304] 0 2024-04-12T09:11:38.024 INFO:tasks.workunit.client.1.smithi203.stdout:2/876: write d0/d14/d1e/d57/d95/fb0 [4039079,29569] 0 2024-04-12T09:11:38.024 INFO:tasks.workunit.client.1.smithi203.stdout:1/855: write df/d59/db0/d9b/dd5/fd7 [225691,43359] 0 2024-04-12T09:11:38.026 INFO:tasks.workunit.client.1.smithi203.stdout:8/789: creat d4/d8/d1c/d5d/da7/fff x:0 0 0 2024-04-12T09:11:38.026 INFO:tasks.workunit.client.1.smithi203.stdout:2/877: write d0/d14/d1e/d2a/dcd/dfc/f5a [5974567,70395] 0 2024-04-12T09:11:38.028 INFO:tasks.workunit.client.1.smithi203.stdout:5/906: write d0/d6/d11/d18/d1a/f91 [284352,53418] 0 2024-04-12T09:11:38.029 INFO:tasks.workunit.client.1.smithi203.stdout:5/907: chown d0/d6/f93 34524200 1 2024-04-12T09:11:38.033 INFO:tasks.workunit.client.1.smithi203.stdout:2/878: creat d0/d14/d1e/d57/d95/f133 x:0 0 0 2024-04-12T09:11:38.034 INFO:tasks.workunit.client.1.smithi203.stdout:9/706: creat d8/d12/d23/d38/d8a/d97/de0/ff1 x:0 0 0 2024-04-12T09:11:38.036 INFO:tasks.workunit.client.1.smithi203.stdout:5/908: rmdir d0/d6/d11/d1e/d4c 39 2024-04-12T09:11:38.036 INFO:tasks.workunit.client.1.smithi203.stdout:9/707: dread - d8/d12/d23/d85/f46 zero size 2024-04-12T09:11:38.037 INFO:tasks.workunit.client.1.smithi203.stdout:1/856: dwrite df/d2d/f32 [0,4194304] 0 2024-04-12T09:11:38.039 INFO:tasks.workunit.client.1.smithi203.stdout:7/815: getdents d0/d38/d51 0 2024-04-12T09:11:38.046 INFO:tasks.workunit.client.1.smithi203.stdout:7/816: mknod d0/d4/d1c/d5b/dbf/c10e 0 2024-04-12T09:11:38.053 INFO:tasks.workunit.client.1.smithi203.stdout:5/909: creat d0/d6/d11/d1e/f145 x:0 0 0 2024-04-12T09:11:38.054 INFO:tasks.workunit.client.1.smithi203.stdout:2/879: link d0/d14/d1e/d2a/dcd/dfc/c58 d0/d67/d86/c134 0 2024-04-12T09:11:38.056 INFO:tasks.workunit.client.1.smithi203.stdout:1/857: rename df/l11 to df/d2d/d6f/d75/d80/d54/d5d/d58/l106 0 2024-04-12T09:11:38.059 INFO:tasks.workunit.client.1.smithi203.stdout:8/790: dread d4/f4b [0,4194304] 0 2024-04-12T09:11:38.060 INFO:tasks.workunit.client.1.smithi203.stdout:1/858: mkdir df/d2d/d6f/d75/d80/d54/d5d/d90/dc7/d107 0 2024-04-12T09:11:38.060 INFO:tasks.workunit.client.1.smithi203.stdout:1/859: fsync df/f99 0 2024-04-12T09:11:38.062 INFO:tasks.workunit.client.1.smithi203.stdout:5/910: link d0/f8e d0/d6/d16/d9/d30/d58/d74/d88/dbf/f146 0 2024-04-12T09:11:38.064 INFO:tasks.workunit.client.1.smithi203.stdout:2/880: rename d0/d14/d74/c10a to d0/d3/d8f/d10e/c135 0 2024-04-12T09:11:38.065 INFO:tasks.workunit.client.1.smithi203.stdout:8/791: mkdir d4/ddf/d100 0 2024-04-12T09:11:38.068 INFO:tasks.workunit.client.1.smithi203.stdout:1/860: truncate df/d2d/d6f/d75/d80/d2b/d91/db8/fbe 816675 0 2024-04-12T09:11:38.068 INFO:tasks.workunit.client.1.smithi203.stdout:5/911: unlink d0/d6/d16/d9/d30/d83/l120 0 2024-04-12T09:11:38.072 INFO:tasks.workunit.client.1.smithi203.stdout:2/881: mkdir d0/d3/d8f/d136 0 2024-04-12T09:11:38.073 INFO:tasks.workunit.client.1.smithi203.stdout:8/792: rename d4/cb3 to d4/d8/d1c/d5d/dc0/c101 0 2024-04-12T09:11:38.074 INFO:tasks.workunit.client.1.smithi203.stdout:5/912: dwrite d0/d6/d11/d18/d1a/f91 [0,4194304] 0 2024-04-12T09:11:38.082 INFO:tasks.workunit.client.1.smithi203.stdout:2/882: creat d0/d67/d86/dd9/dfd/f137 x:0 0 0 2024-04-12T09:11:38.082 INFO:tasks.workunit.client.1.smithi203.stdout:0/886: sync 2024-04-12T09:11:38.085 INFO:tasks.workunit.client.1.smithi203.stdout:8/793: creat d4/d8/d81/d84/d92/ddc/df2/f102 x:0 0 0 2024-04-12T09:11:38.086 INFO:tasks.workunit.client.1.smithi203.stdout:8/794: write d4/d8/d81/d84/d92/ddc/df2/dee/ff5 [952458,100504] 0 2024-04-12T09:11:38.087 INFO:tasks.workunit.client.1.smithi203.stdout:4/859: truncate d1a/d20/d5d/d2c/d72/fc2 1045563 0 2024-04-12T09:11:38.088 INFO:tasks.workunit.client.1.smithi203.stdout:4/860: write d1a/d1d/d69/dcf/ffa [5429953,15609] 0 2024-04-12T09:11:38.089 INFO:tasks.workunit.client.1.smithi203.stdout:0/887: mknod d0/d48/d5e/d84/c12b 0 2024-04-12T09:11:38.096 INFO:tasks.workunit.client.1.smithi203.stdout:6/708: mkdir d1/d3/d26/d30/d4a/d6c/d45/d55/d77/dda 0 2024-04-12T09:11:38.098 INFO:tasks.workunit.client.1.smithi203.stdout:9/708: dwrite d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/f5c [4194304,4194304] 0 2024-04-12T09:11:38.102 INFO:tasks.workunit.client.1.smithi203.stdout:7/817: truncate d0/f40 7522497 0 2024-04-12T09:11:38.105 INFO:tasks.workunit.client.1.smithi203.stdout:8/795: symlink d4/ddf/d100/l103 0 2024-04-12T09:11:38.110 INFO:tasks.workunit.client.1.smithi203.stdout:3/769: sync 2024-04-12T09:11:38.116 INFO:tasks.workunit.client.1.smithi203.stdout:1/861: write df/d2d/d6f/d75/d80/d54/d5d/d58/d94/f97 [188996,85340] 0 2024-04-12T09:11:38.117 INFO:tasks.workunit.client.1.smithi203.stdout:7/818: creat d0/d4/d54/dac/f10f x:0 0 0 2024-04-12T09:11:38.118 INFO:tasks.workunit.client.1.smithi203.stdout:6/709: dread d1/d3/f27 [0,4194304] 0 2024-04-12T09:11:38.120 INFO:tasks.workunit.client.1.smithi203.stdout:1/862: truncate df/d2d/d6f/d75/d80/d54/d5d/d58/fba 1240831 0 2024-04-12T09:11:38.120 INFO:tasks.workunit.client.1.smithi203.stdout:3/770: mkdir d2/d8/d14/d45/df7 0 2024-04-12T09:11:38.120 INFO:tasks.workunit.client.1.smithi203.stdout:1/863: write df/d2d/d6d/fe6 [207774,70158] 0 2024-04-12T09:11:38.124 INFO:tasks.workunit.client.1.smithi203.stdout:5/913: write d0/d6/d11/d18/f3b [3269315,103330] 0 2024-04-12T09:11:38.126 INFO:tasks.workunit.client.1.smithi203.stdout:5/914: write d0/d6/d11/d18/f40 [2493577,121786] 0 2024-04-12T09:11:38.130 INFO:tasks.workunit.client.1.smithi203.stdout:3/771: fsync d2/d8/d14/d1b/d95/d92/ddb/f79 0 2024-04-12T09:11:38.130 INFO:tasks.workunit.client.1.smithi203.stdout:1/864: fsync df/d2d/d6f/d75/d80/d54/d5d/f104 0 2024-04-12T09:11:38.133 INFO:tasks.workunit.client.1.smithi203.stdout:2/883: link d0/d14/d1e/d57/d95/lee d0/d54/d61/d78/d89/dd7/l138 0 2024-04-12T09:11:38.134 INFO:tasks.workunit.client.1.smithi203.stdout:1/865: chown df/d2d/d6f/d75/d80/d2b/fbc 97 1 2024-04-12T09:11:38.134 INFO:tasks.workunit.client.1.smithi203.stdout:4/861: truncate d1a/d1d/d69/f9a 1486423 0 2024-04-12T09:11:38.134 INFO:tasks.workunit.client.1.smithi203.stdout:3/772: fsync d2/d8/d14/d23/d35/d4c/d5c/d55/fdc 0 2024-04-12T09:11:38.134 INFO:tasks.workunit.client.1.smithi203.stdout:0/888: dwrite d0/d125/d94/d2f/d17/d19/f23 [4194304,4194304] 0 2024-04-12T09:11:38.135 INFO:tasks.workunit.client.1.smithi203.stdout:6/710: dread d1/d3/d26/d30/d4a/f7d [0,4194304] 0 2024-04-12T09:11:38.135 INFO:tasks.workunit.client.1.smithi203.stdout:2/884: dread - d0/d14/d23/d3d/f111 zero size 2024-04-12T09:11:38.137 INFO:tasks.workunit.client.1.smithi203.stdout:3/773: chown d2/d8/d14/d45/dcb/ce2 676 1 2024-04-12T09:11:38.142 INFO:tasks.workunit.client.1.smithi203.stdout:6/711: dwrite d1/d3/d26/d30/fab [0,4194304] 0 2024-04-12T09:11:38.147 INFO:tasks.workunit.client.1.smithi203.stdout:8/796: write d4/f5a [110677,83863] 0 2024-04-12T09:11:38.148 INFO:tasks.workunit.client.1.smithi203.stdout:8/797: fsync d4/d8/f50 0 2024-04-12T09:11:38.148 INFO:tasks.workunit.client.1.smithi203.stdout:4/862: symlink d1a/d21/d22/d2e/d78/l118 0 2024-04-12T09:11:38.153 INFO:tasks.workunit.client.1.smithi203.stdout:0/889: dwrite d0/d125/d94/d2f/f8f [0,4194304] 0 2024-04-12T09:11:38.161 INFO:tasks.workunit.client.1.smithi203.stdout:5/915: rename d0/d6/d16/d9/d80/df2/d104/d2d/fed to d0/d6/d11/d38/f147 0 2024-04-12T09:11:38.167 INFO:tasks.workunit.client.1.smithi203.stdout:1/866: mkdir df/d2d/d6f/d75/d80/d2b/d108 0 2024-04-12T09:11:38.168 INFO:tasks.workunit.client.1.smithi203.stdout:0/890: symlink d0/d48/d5e/dca/dd6/l12c 0 2024-04-12T09:11:38.168 INFO:tasks.workunit.client.1.smithi203.stdout:3/774: fsync d2/d8/d14/d1b/f48 0 2024-04-12T09:11:38.169 INFO:tasks.workunit.client.1.smithi203.stdout:0/891: stat d0/d125/f100 0 2024-04-12T09:11:38.170 INFO:tasks.workunit.client.1.smithi203.stdout:0/892: write d0/d125/d94/d2f/d34/ff6 [1051782,61940] 0 2024-04-12T09:11:38.176 INFO:tasks.workunit.client.1.smithi203.stdout:2/885: rename d0/d67/d86/df6/l10d to d0/d19/l139 0 2024-04-12T09:11:38.177 INFO:tasks.workunit.client.1.smithi203.stdout:5/916: rmdir d0 39 2024-04-12T09:11:38.192 INFO:tasks.workunit.client.1.smithi203.stdout:3/775: symlink d2/d8/d14/lf8 0 2024-04-12T09:11:38.195 INFO:tasks.workunit.client.1.smithi203.stdout:1/867: dwrite df/d2d/d6f/d75/d80/d54/d5d/d58/d94/fad [0,4194304] 0 2024-04-12T09:11:38.201 INFO:tasks.workunit.client.1.smithi203.stdout:0/893: dread d0/d125/d94/d2f/d17/fa [0,4194304] 0 2024-04-12T09:11:38.202 INFO:tasks.workunit.client.1.smithi203.stdout:1/868: dwrite df/d2d/d6f/d75/d80/d54/d5d/f4d [4194304,4194304] 0 2024-04-12T09:11:38.208 INFO:tasks.workunit.client.1.smithi203.stdout:9/709: sync 2024-04-12T09:11:38.210 INFO:tasks.workunit.client.1.smithi203.stdout:9/710: write d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/f9a [139676,29862] 0 2024-04-12T09:11:38.222 INFO:tasks.workunit.client.1.smithi203.stdout:1/869: creat df/d2d/d6f/d75/d80/d54/d5d/d67/f109 x:0 0 0 2024-04-12T09:11:38.223 INFO:tasks.workunit.client.1.smithi203.stdout:1/870: chown df/d2d/d6f/d75/d80/d54/d5d/d90/dc7/lca 940985 1 2024-04-12T09:11:38.224 INFO:tasks.workunit.client.1.smithi203.stdout:1/871: write df/d2d/d6f/d75/d80/d54/d5d/d58/fba [839314,21689] 0 2024-04-12T09:11:38.227 INFO:tasks.workunit.client.1.smithi203.stdout:6/712: rename d1/d3/d26/d30/d4a/d6c/d45/d55/d77/la4 to d1/df/d65/ldb 0 2024-04-12T09:11:38.228 INFO:tasks.workunit.client.1.smithi203.stdout:5/917: mknod d0/d6/d11/d1e/d4c/d48/de4/d13a/c148 0 2024-04-12T09:11:38.230 INFO:tasks.workunit.client.1.smithi203.stdout:0/894: symlink d0/dd/d5b/l12d 0 2024-04-12T09:11:38.234 INFO:tasks.workunit.client.1.smithi203.stdout:4/863: dread d1a/d1d/d69/f9a [0,4194304] 0 2024-04-12T09:11:38.234 INFO:tasks.workunit.client.1.smithi203.stdout:8/798: rename d4/c49 to d4/ddf/c104 0 2024-04-12T09:11:38.235 INFO:tasks.workunit.client.1.smithi203.stdout:4/864: read d1a/d21/f67 [1376020,47315] 0 2024-04-12T09:11:38.236 INFO:tasks.workunit.client.1.smithi203.stdout:9/711: write d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/f5a [368983,127640] 0 2024-04-12T09:11:38.236 INFO:tasks.workunit.client.1.smithi203.stdout:4/865: read d1a/d34/de4/ffc [308899,105989] 0 2024-04-12T09:11:38.237 INFO:tasks.workunit.client.1.smithi203.stdout:5/918: creat d0/d6/d11/d1e/d4c/d6a/f149 x:0 0 0 2024-04-12T09:11:38.239 INFO:tasks.workunit.client.1.smithi203.stdout:5/919: truncate d0/d6/d16/d9/fa4 5144673 0 2024-04-12T09:11:38.239 INFO:tasks.workunit.client.1.smithi203.stdout:5/920: write d0/dbd/fc7 [4154613,7603] 0 2024-04-12T09:11:38.245 INFO:tasks.workunit.client.1.smithi203.stdout:2/886: rename d0/dd3/f125 to d0/d14/d74/d96/d9a/f13a 0 2024-04-12T09:11:38.253 INFO:tasks.workunit.client.1.smithi203.stdout:9/712: creat d8/d12/d3e/d90/dd8/ff2 x:0 0 0 2024-04-12T09:11:38.254 INFO:tasks.workunit.client.1.smithi203.stdout:4/866: mkdir d1a/d20/d5f/d119 0 2024-04-12T09:11:38.258 INFO:tasks.workunit.client.1.smithi203.stdout:1/872: dwrite df/d2d/d6f/fc3 [0,4194304] 0 2024-04-12T09:11:38.259 INFO:tasks.workunit.client.1.smithi203.stdout:1/873: write df/d2d/d6f/d75/fa0 [34485,107439] 0 2024-04-12T09:11:38.262 INFO:tasks.workunit.client.1.smithi203.stdout:6/713: write d1/d3/d26/d30/d4a/d6c/d45/d55/fd4 [154201,121820] 0 2024-04-12T09:11:38.262 INFO:tasks.workunit.client.1.smithi203.stdout:6/714: chown d1/d3/l64 496164 1 2024-04-12T09:11:38.263 INFO:tasks.workunit.client.1.smithi203.stdout:6/715: fdatasync d1/d3/fad 0 2024-04-12T09:11:38.264 INFO:tasks.workunit.client.1.smithi203.stdout:8/799: getdents d4/d34 0 2024-04-12T09:11:38.265 INFO:tasks.workunit.client.1.smithi203.stdout:8/800: fsync d4/d8/d1c/f30 0 2024-04-12T09:11:38.267 INFO:tasks.workunit.client.1.smithi203.stdout:2/887: mkdir d0/d14/d1e/d57/d95/d13b 0 2024-04-12T09:11:38.267 INFO:tasks.workunit.client.1.smithi203.stdout:2/888: readlink d0/d14/le7 0 2024-04-12T09:11:38.268 INFO:tasks.workunit.client.1.smithi203.stdout:0/895: write d0/d125/d94/d2f/f51 [321448,57082] 0 2024-04-12T09:11:38.271 INFO:tasks.workunit.client.1.smithi203.stdout:4/867: creat d1a/d21/d22/d2e/f11a x:0 0 0 2024-04-12T09:11:38.274 INFO:tasks.workunit.client.1.smithi203.stdout:1/874: stat df/d2d/d6f/d75/d80/d8c/ld2 0 2024-04-12T09:11:38.275 INFO:tasks.workunit.client.1.smithi203.stdout:1/875: write df/d2d/d6d/fe6 [383369,16834] 0 2024-04-12T09:11:38.277 INFO:tasks.workunit.client.1.smithi203.stdout:6/716: creat d1/d3/d26/dcb/fdc x:0 0 0 2024-04-12T09:11:38.280 INFO:tasks.workunit.client.1.smithi203.stdout:8/801: fdatasync d4/d8/f77 0 2024-04-12T09:11:38.281 INFO:tasks.workunit.client.1.smithi203.stdout:2/889: symlink d0/dd3/l13c 0 2024-04-12T09:11:38.285 INFO:tasks.workunit.client.1.smithi203.stdout:9/713: unlink d8/d12/d23/d38/d8a/cb0 0 2024-04-12T09:11:38.287 INFO:tasks.workunit.client.1.smithi203.stdout:4/868: dread d1a/d21/f100 [0,4194304] 0 2024-04-12T09:11:38.288 INFO:tasks.workunit.client.1.smithi203.stdout:2/890: dwrite d0/fb2 [4194304,4194304] 0 2024-04-12T09:11:38.288 INFO:tasks.workunit.client.1.smithi203.stdout:5/921: creat d0/d6/d16/d11f/f14a x:0 0 0 2024-04-12T09:11:38.289 INFO:tasks.workunit.client.1.smithi203.stdout:1/876: symlink df/d2d/d6f/d75/d80/d54/d5d/d58/d94/l10a 0 2024-04-12T09:11:38.289 INFO:tasks.workunit.client.1.smithi203.stdout:5/922: chown d0/d6/d11/d18/d2a/l7e 209836 1 2024-04-12T09:11:38.290 INFO:tasks.workunit.client.1.smithi203.stdout:2/891: truncate d0/d14/d1e/d2a/f5d 4249205 0 2024-04-12T09:11:38.294 INFO:tasks.workunit.client.1.smithi203.stdout:8/802: write d4/d8/f7b [2760684,79640] 0 2024-04-12T09:11:38.295 INFO:tasks.workunit.client.1.smithi203.stdout:6/717: dread d1/df/d65/f86 [0,4194304] 0 2024-04-12T09:11:38.297 INFO:tasks.workunit.client.1.smithi203.stdout:4/869: creat d1a/d20/d5d/d2c/d72/f11b x:0 0 0 2024-04-12T09:11:38.299 INFO:tasks.workunit.client.1.smithi203.stdout:5/923: dwrite d0/d6/d16/d9/d80/df2/d104/d2d/fbc [0,4194304] 0 2024-04-12T09:11:38.301 INFO:tasks.workunit.client.1.smithi203.stdout:1/877: unlink df/d2d/d6f/d75/d80/d54/d5d/d58/fd9 0 2024-04-12T09:11:38.307 INFO:tasks.workunit.client.1.smithi203.stdout:8/803: rename d4/ddf/ff9 to d4/d8/d1c/d5d/da7/f105 0 2024-04-12T09:11:38.312 INFO:tasks.workunit.client.1.smithi203.stdout:9/714: dwrite d8/d12/d23/d85/f94 [0,4194304] 0 2024-04-12T09:11:38.313 INFO:tasks.workunit.client.1.smithi203.stdout:1/878: dwrite df/d2d/d6f/d75/d80/d2b/f42 [0,4194304] 0 2024-04-12T09:11:38.314 INFO:tasks.workunit.client.1.smithi203.stdout:9/715: fsync d8/d12/fad 0 2024-04-12T09:11:38.315 INFO:tasks.workunit.client.1.smithi203.stdout:6/718: dwrite d1/d3/d26/d30/d4a/d6c/d45/fb7 [0,4194304] 0 2024-04-12T09:11:38.317 INFO:tasks.workunit.client.1.smithi203.stdout:6/719: fsync d1/d3/d5b/d8c/f66 0 2024-04-12T09:11:38.317 INFO:tasks.workunit.client.1.smithi203.stdout:7/819: sync 2024-04-12T09:11:38.318 INFO:tasks.workunit.client.1.smithi203.stdout:6/720: stat d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d3a/f60 0 2024-04-12T09:11:38.329 INFO:tasks.workunit.client.1.smithi203.stdout:4/870: rename d1a/d20/f5e to d1a/d21/d22/d2e/d8d/d9b/dbc/dc7/f11c 0 2024-04-12T09:11:38.333 INFO:tasks.workunit.client.1.smithi203.stdout:8/804: creat d4/d8/d81/d84/d92/ddc/df2/f106 x:0 0 0 2024-04-12T09:11:38.334 INFO:tasks.workunit.client.1.smithi203.stdout:8/805: chown d4/d8/c4d 0 1 2024-04-12T09:11:38.335 INFO:tasks.workunit.client.1.smithi203.stdout:2/892: getdents d0/d14/d1e/d57/d95/dd6 0 2024-04-12T09:11:38.337 INFO:tasks.workunit.client.1.smithi203.stdout:1/879: fdatasync df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/fa8 0 2024-04-12T09:11:38.337 INFO:tasks.workunit.client.1.smithi203.stdout:9/716: read - d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/fb5 zero size 2024-04-12T09:11:38.338 INFO:tasks.workunit.client.1.smithi203.stdout:6/721: symlink d1/d3/d91/ldd 0 2024-04-12T09:11:38.339 INFO:tasks.workunit.client.1.smithi203.stdout:6/722: chown d1/df/d65/dbc/lbe 307 1 2024-04-12T09:11:38.340 INFO:tasks.workunit.client.1.smithi203.stdout:7/820: rename d0/d4/d1c/d5b/dbf/dc3/l102 to d0/d4/d54/dac/l110 0 2024-04-12T09:11:38.340 INFO:tasks.workunit.client.1.smithi203.stdout:7/821: stat d0/d4/d1c/d5b/f8e 0 2024-04-12T09:11:38.343 INFO:tasks.workunit.client.1.smithi203.stdout:4/871: symlink d1a/d21/d22/d2e/d8d/db8/l11d 0 2024-04-12T09:11:38.345 INFO:tasks.workunit.client.1.smithi203.stdout:5/924: write d0/d6/d16/d9/d80/df2/d104/f85 [210197,58500] 0 2024-04-12T09:11:38.347 INFO:tasks.workunit.client.1.smithi203.stdout:1/880: stat df/d2d/d6f/d8d/da7/fd8 0 2024-04-12T09:11:38.349 INFO:tasks.workunit.client.1.smithi203.stdout:4/872: dwrite d1a/d1d/d69/fc1 [0,4194304] 0 2024-04-12T09:11:38.349 INFO:tasks.workunit.client.1.smithi203.stdout:9/717: mkdir d8/d12/d23/d38/d8a/d97/df3 0 2024-04-12T09:11:38.353 INFO:tasks.workunit.client.1.smithi203.stdout:6/723: creat d1/df/dd3/fde x:0 0 0 2024-04-12T09:11:38.355 INFO:tasks.workunit.client.1.smithi203.stdout:6/724: read d1/d3/d26/d30/d4a/d6c/d45/d55/fd4 [659679,26969] 0 2024-04-12T09:11:38.356 INFO:tasks.workunit.client.1.smithi203.stdout:5/925: dwrite d0/d6/d16/d9/f24 [8388608,4194304] 0 2024-04-12T09:11:38.356 INFO:tasks.workunit.client.1.smithi203.stdout:4/873: creat d1a/d20/d5d/d2c/d72/f11e x:0 0 0 2024-04-12T09:11:38.358 INFO:tasks.workunit.client.1.smithi203.stdout:5/926: chown d0/d6/d16/d9/fa5 11848 1 2024-04-12T09:11:38.358 INFO:tasks.workunit.client.1.smithi203.stdout:4/874: fsync d1a/d21/d60/daa/dc5/f10f 0 2024-04-12T09:11:38.359 INFO:tasks.workunit.client.1.smithi203.stdout:5/927: dread - d0/d6/d16/d9/d30/d58/d74/d88/f126 zero size 2024-04-12T09:11:38.360 INFO:tasks.workunit.client.1.smithi203.stdout:5/928: chown d0/d6/d16/d44/dda/d140/lba 44593 1 2024-04-12T09:11:38.364 INFO:tasks.workunit.client.1.smithi203.stdout:1/881: mkdir df/dfb/dff/d10b 0 2024-04-12T09:11:38.365 INFO:tasks.workunit.client.1.smithi203.stdout:1/882: dread - df/d2d/d6f/d75/d80/d54/f101 zero size 2024-04-12T09:11:38.366 INFO:tasks.workunit.client.1.smithi203.stdout:1/883: readlink df/d2d/d6f/d75/d80/d2b/l63 0 2024-04-12T09:11:38.370 INFO:tasks.workunit.client.1.smithi203.stdout:6/725: truncate d1/df/d65/f86 1029823 0 2024-04-12T09:11:38.371 INFO:tasks.workunit.client.1.smithi203.stdout:6/726: write d1/d3/d5b/d8c/f66 [1186328,17372] 0 2024-04-12T09:11:38.371 INFO:tasks.workunit.client.1.smithi203.stdout:4/875: unlink d1a/d2b/f80 0 2024-04-12T09:11:38.372 INFO:tasks.workunit.client.1.smithi203.stdout:4/876: readlink d1a/d21/d60/daa/dc5/lf9 0 2024-04-12T09:11:38.375 INFO:tasks.workunit.client.1.smithi203.stdout:9/718: rename d8/d12/d3e/fa2 to d8/d12/d3e/ff4 0 2024-04-12T09:11:38.378 INFO:tasks.workunit.client.1.smithi203.stdout:7/822: link d0/d4/d54/dac/l110 d0/d4/d54/dac/dd4/l111 0 2024-04-12T09:11:38.378 INFO:tasks.workunit.client.1.smithi203.stdout:6/727: chown d1/df/d87/d7a/caa 1 1 2024-04-12T09:11:38.381 INFO:tasks.workunit.client.1.smithi203.stdout:4/877: creat d1a/d21/d22/d2e/d78/f11f x:0 0 0 2024-04-12T09:11:38.382 INFO:tasks.workunit.client.1.smithi203.stdout:1/884: dread df/d2d/d6f/daa/f77 [0,4194304] 0 2024-04-12T09:11:38.384 INFO:tasks.workunit.client.1.smithi203.stdout:6/728: creat d1/d3/d91/fdf x:0 0 0 2024-04-12T09:11:38.386 INFO:tasks.workunit.client.1.smithi203.stdout:6/729: write d1/d3/d26/d30/d4a/d6c/f44 [1164787,96765] 0 2024-04-12T09:11:38.387 INFO:tasks.workunit.client.1.smithi203.stdout:4/878: dwrite d1a/d34/de4/f10d [0,4194304] 0 2024-04-12T09:11:38.388 INFO:tasks.workunit.client.1.smithi203.stdout:9/719: dread d8/d12/d3e/f73 [0,4194304] 0 2024-04-12T09:11:38.389 INFO:tasks.workunit.client.1.smithi203.stdout:6/730: write d1/d3/d26/d30/d4a/d6c/d45/fb7 [2821824,66949] 0 2024-04-12T09:11:38.390 INFO:tasks.workunit.client.1.smithi203.stdout:1/885: unlink df/f6e 0 2024-04-12T09:11:38.392 INFO:tasks.workunit.client.1.smithi203.stdout:3/776: sync 2024-04-12T09:11:38.393 INFO:tasks.workunit.client.1.smithi203.stdout:5/929: truncate d0/d6/d11/d1e/d4c/d48/fc9 766479 0 2024-04-12T09:11:38.397 INFO:tasks.workunit.client.1.smithi203.stdout:4/879: dwrite d1a/d20/d5d/d2c/d72/f11b [0,4194304] 0 2024-04-12T09:11:38.398 INFO:tasks.workunit.client.1.smithi203.stdout:7/823: write d0/d4/d54/da0/dff/d4c/fa6 [1128241,20865] 0 2024-04-12T09:11:38.401 INFO:tasks.workunit.client.1.smithi203.stdout:9/720: truncate d8/d12/d3e/d90/f98 970656 0 2024-04-12T09:11:38.403 INFO:tasks.workunit.client.1.smithi203.stdout:1/886: readlink df/d2d/d6f/d75/d80/d54/d5d/d58/l106 0 2024-04-12T09:11:38.406 INFO:tasks.workunit.client.1.smithi203.stdout:6/731: rename d1/df/f6b to d1/d3/d5b/d8c/d3e/da1/db1/fe0 0 2024-04-12T09:11:38.414 INFO:tasks.workunit.client.1.smithi203.stdout:4/880: creat d1a/d21/d60/d68/db9/f120 x:0 0 0 2024-04-12T09:11:38.420 INFO:tasks.workunit.client.1.smithi203.stdout:7/824: mknod d0/d15/c112 0 2024-04-12T09:11:38.420 INFO:tasks.workunit.client.1.smithi203.stdout:3/777: dread d2/d8/d14/d1b/d95/d92/faa [0,4194304] 0 2024-04-12T09:11:38.422 INFO:tasks.workunit.client.1.smithi203.stdout:6/732: creat d1/d3/d26/d30/d4a/d6c/d45/d55/d77/dda/fe1 x:0 0 0 2024-04-12T09:11:38.423 INFO:tasks.workunit.client.1.smithi203.stdout:9/721: creat d8/d12/d23/d38/d8a/d97/d9e/d74/ff5 x:0 0 0 2024-04-12T09:11:38.424 INFO:tasks.workunit.client.1.smithi203.stdout:1/887: creat df/d2d/d6f/daa/f10c x:0 0 0 2024-04-12T09:11:38.424 INFO:tasks.workunit.client.1.smithi203.stdout:3/778: symlink d2/d8/d14/d23/d35/d4c/lf9 0 2024-04-12T09:11:38.425 INFO:tasks.workunit.client.1.smithi203.stdout:9/722: read f5 [3165439,99981] 0 2024-04-12T09:11:38.426 INFO:tasks.workunit.client.1.smithi203.stdout:1/888: fdatasync df/d2d/d6f/d75/f9e 0 2024-04-12T09:11:38.427 INFO:tasks.workunit.client.1.smithi203.stdout:5/930: dread d0/d6/d11/d18/d2a/ff [0,4194304] 0 2024-04-12T09:11:38.428 INFO:tasks.workunit.client.1.smithi203.stdout:1/889: write df/d2d/d6d/fe6 [121463,78044] 0 2024-04-12T09:11:38.431 INFO:tasks.workunit.client.1.smithi203.stdout:9/723: unlink d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/f9a 0 2024-04-12T09:11:38.432 INFO:tasks.workunit.client.1.smithi203.stdout:7/825: rename d0/d15/d2d/df2/c9f to d0/d4/d54/da0/dff/c113 0 2024-04-12T09:11:38.433 INFO:tasks.workunit.client.1.smithi203.stdout:4/881: dread d1a/d20/d5f/f114 [0,4194304] 0 2024-04-12T09:11:38.434 INFO:tasks.workunit.client.1.smithi203.stdout:3/779: dwrite d2/d8/d14/d1b/f48 [0,4194304] 0 2024-04-12T09:11:38.434 INFO:tasks.workunit.client.1.smithi203.stdout:5/931: fsync d0/d6/d11/d18/d2a/dc8/feb 0 2024-04-12T09:11:38.437 INFO:tasks.workunit.client.1.smithi203.stdout:7/826: dread - d0/d4/d54/d75/dc0/ff7 zero size 2024-04-12T09:11:38.437 INFO:tasks.workunit.client.1.smithi203.stdout:1/890: unlink df/d2d/d6f/d75/d80/d8c/ffd 0 2024-04-12T09:11:38.438 INFO:tasks.workunit.client.1.smithi203.stdout:6/733: dwrite d1/d3/d26/d30/d4a/d6c/d45/f49 [0,4194304] 0 2024-04-12T09:11:38.438 INFO:tasks.workunit.client.1.smithi203.stdout:5/932: chown d0/d6/d16/d44/dda/d140/lba 24 1 2024-04-12T09:11:38.440 INFO:tasks.workunit.client.1.smithi203.stdout:3/780: read d2/d8/d14/d23/d35/d91/f9b [3991632,58432] 0 2024-04-12T09:11:38.440 INFO:tasks.workunit.client.1.smithi203.stdout:4/882: symlink d1a/d21/d22/d2e/d78/l121 0 2024-04-12T09:11:38.442 INFO:tasks.workunit.client.1.smithi203.stdout:1/891: write df/d2d/d6f/d75/d80/d54/d5d/f9c [1885090,9380] 0 2024-04-12T09:11:38.443 INFO:tasks.workunit.client.1.smithi203.stdout:4/883: fsync d1a/d1d/d69/fc1 0 2024-04-12T09:11:38.444 INFO:tasks.workunit.client.1.smithi203.stdout:4/884: fsync d1a/d20/fa4 0 2024-04-12T09:11:38.446 INFO:tasks.workunit.client.1.smithi203.stdout:1/892: chown df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/le5 4862 1 2024-04-12T09:11:38.448 INFO:tasks.workunit.client.1.smithi203.stdout:1/893: truncate df/d2d/d6f/daa/f10c 292330 0 2024-04-12T09:11:38.449 INFO:tasks.workunit.client.1.smithi203.stdout:3/781: dwrite d2/d8/d14/d1b/d2f/f78 [0,4194304] 0 2024-04-12T09:11:38.449 INFO:tasks.workunit.client.1.smithi203.stdout:1/894: stat df/d2d/d6f/d75/cbf 0 2024-04-12T09:11:38.451 INFO:tasks.workunit.client.1.smithi203.stdout:5/933: creat d0/d5d/f14b x:0 0 0 2024-04-12T09:11:38.451 INFO:tasks.workunit.client.1.smithi203.stdout:9/724: write f4 [777167,55270] 0 2024-04-12T09:11:38.451 INFO:tasks.workunit.client.1.smithi203.stdout:7/827: creat d0/d4/d1c/d5b/dbf/de1/f114 x:0 0 0 2024-04-12T09:11:38.452 INFO:tasks.workunit.client.1.smithi203.stdout:5/934: chown d0/d9a 0 1 2024-04-12T09:11:38.453 INFO:tasks.workunit.client.1.smithi203.stdout:7/828: stat d0/d15/d2d/ca9 0 2024-04-12T09:11:38.453 INFO:tasks.workunit.client.1.smithi203.stdout:0/896: sync 2024-04-12T09:11:38.454 INFO:tasks.workunit.client.1.smithi203.stdout:6/734: write d1/d3/d26/d30/d4a/f7d [2246875,69296] 0 2024-04-12T09:11:38.456 INFO:tasks.workunit.client.1.smithi203.stdout:0/897: chown d0/d125/d94/d2f/d17/cdd 6480 1 2024-04-12T09:11:38.458 INFO:tasks.workunit.client.1.smithi203.stdout:6/735: truncate d1/d3/d26/dcb/fdc 1040353 0 2024-04-12T09:11:38.458 INFO:tasks.workunit.client.1.smithi203.stdout:1/895: fdatasync df/f1e 0 2024-04-12T09:11:38.460 INFO:tasks.workunit.client.1.smithi203.stdout:6/736: dread - d1/d3/d26/d30/d4a/d6c/d45/d55/d8e/fbf zero size 2024-04-12T09:11:38.462 INFO:tasks.workunit.client.1.smithi203.stdout:9/725: mkdir d8/d12/d23/d85/df6 0 2024-04-12T09:11:38.463 INFO:tasks.workunit.client.1.smithi203.stdout:4/885: mknod d1a/d20/d5f/d119/c122 0 2024-04-12T09:11:38.463 INFO:tasks.workunit.client.1.smithi203.stdout:0/898: dwrite d0/d125/d94/d2f/d17/d19/fb3 [0,4194304] 0 2024-04-12T09:11:38.466 INFO:tasks.workunit.client.1.smithi203.stdout:7/829: symlink d0/d4/d1c/d5b/dbf/dc5/l115 0 2024-04-12T09:11:38.466 INFO:tasks.workunit.client.1.smithi203.stdout:4/886: dread f5 [8388608,4194304] 0 2024-04-12T09:11:38.467 INFO:tasks.workunit.client.1.smithi203.stdout:0/899: read d0/d48/f104 [2491484,84547] 0 2024-04-12T09:11:38.468 INFO:tasks.workunit.client.1.smithi203.stdout:0/900: readlink d0/dd/le7 0 2024-04-12T09:11:38.469 INFO:tasks.workunit.client.1.smithi203.stdout:7/830: write d0/d4/d54/da0/d106/f81 [601674,80631] 0 2024-04-12T09:11:38.470 INFO:tasks.workunit.client.1.smithi203.stdout:1/896: mknod df/d2d/d6f/d75/d80/df3/c10d 0 2024-04-12T09:11:38.471 INFO:tasks.workunit.client.1.smithi203.stdout:7/831: chown d0/d4/d54/da0/dff/d4c/ld1 3873 1 2024-04-12T09:11:38.472 INFO:tasks.workunit.client.1.smithi203.stdout:6/737: mkdir d1/d3/d26/d9b/de2 0 2024-04-12T09:11:38.473 INFO:tasks.workunit.client.1.smithi203.stdout:9/726: readlink d8/l3f 0 2024-04-12T09:11:38.473 INFO:tasks.workunit.client.1.smithi203.stdout:3/782: write d2/d8/d14/d23/d35/d91/fad [2315710,35483] 0 2024-04-12T09:11:38.473 INFO:tasks.workunit.client.1.smithi203.stdout:6/738: read - d1/d3/d5b/d8c/fc0 zero size 2024-04-12T09:11:38.474 INFO:tasks.workunit.client.1.smithi203.stdout:6/739: dread - d1/df/d65/d96/fd2 zero size 2024-04-12T09:11:38.475 INFO:tasks.workunit.client.1.smithi203.stdout:6/740: fsync d1/d3/d4/f42 0 2024-04-12T09:11:38.475 INFO:tasks.workunit.client.1.smithi203.stdout:4/887: fsync d1a/d20/d5d/f84 0 2024-04-12T09:11:38.477 INFO:tasks.workunit.client.1.smithi203.stdout:6/741: truncate d1/df/d65/d96/fb8 73933 0 2024-04-12T09:11:38.483 INFO:tasks.workunit.client.1.smithi203.stdout:7/832: truncate d0/d15/d2d/df2/d108/f90 914105 0 2024-04-12T09:11:38.486 INFO:tasks.workunit.client.1.smithi203.stdout:3/783: rmdir d2/d8/d14/d23/d35/d4c 39 2024-04-12T09:11:38.487 INFO:tasks.workunit.client.1.smithi203.stdout:0/901: write d0/d125/d94/d2f/d17/fa [3434092,36098] 0 2024-04-12T09:11:38.487 INFO:tasks.workunit.client.1.smithi203.stdout:1/897: write df/d2d/fb6 [343468,125387] 0 2024-04-12T09:11:38.490 INFO:tasks.workunit.client.1.smithi203.stdout:4/888: symlink d1a/d21/d60/d68/dbe/l123 0 2024-04-12T09:11:38.490 INFO:tasks.workunit.client.1.smithi203.stdout:6/742: readlink d1/df/d65/l69 0 2024-04-12T09:11:38.491 INFO:tasks.workunit.client.1.smithi203.stdout:4/889: truncate d1a/d34/de4/f10d 4609801 0 2024-04-12T09:11:38.491 INFO:tasks.workunit.client.1.smithi203.stdout:7/833: creat d0/d4/d54/da0/dff/d4c/f116 x:0 0 0 2024-04-12T09:11:38.493 INFO:tasks.workunit.client.1.smithi203.stdout:9/727: creat d8/d12/d23/d85/df6/ff7 x:0 0 0 2024-04-12T09:11:38.493 INFO:tasks.workunit.client.1.smithi203.stdout:9/728: readlink d8/d12/d23/d38/d8a/lbf 0 2024-04-12T09:11:38.494 INFO:tasks.workunit.client.1.smithi203.stdout:0/902: creat d0/d125/d94/d2f/d34/db1/f12e x:0 0 0 2024-04-12T09:11:38.495 INFO:tasks.workunit.client.1.smithi203.stdout:1/898: creat df/d2d/d6f/d8d/da7/f10e x:0 0 0 2024-04-12T09:11:38.496 INFO:tasks.workunit.client.1.smithi203.stdout:1/899: write df/d2d/d6f/d75/d80/d54/d5d/d67/f109 [732223,84949] 0 2024-04-12T09:11:38.496 INFO:tasks.workunit.client.1.smithi203.stdout:3/784: mknod d2/d8/d14/d23/d35/d4c/d5c/cfa 0 2024-04-12T09:11:38.499 INFO:tasks.workunit.client.1.smithi203.stdout:3/785: write d2/d8/d14/d23/d35/d91/d81/ff0 [588124,113465] 0 2024-04-12T09:11:38.499 INFO:tasks.workunit.client.1.smithi203.stdout:6/743: dread d1/d3/d26/d30/d4a/d6c/d45/d55/fd4 [0,4194304] 0 2024-04-12T09:11:38.499 INFO:tasks.workunit.client.1.smithi203.stdout:4/890: rename d1a/d20/c48 to d1a/c124 0 2024-04-12T09:11:38.499 INFO:tasks.workunit.client.1.smithi203.stdout:7/834: mknod d0/d4/d54/da0/d106/c117 0 2024-04-12T09:11:38.501 INFO:tasks.workunit.client.1.smithi203.stdout:7/835: chown d0/d38/d79/cc6 598748 1 2024-04-12T09:11:38.501 INFO:tasks.workunit.client.1.smithi203.stdout:4/891: read d1a/d21/d22/d2e/f49 [4032020,1652] 0 2024-04-12T09:11:38.503 INFO:tasks.workunit.client.1.smithi203.stdout:3/786: symlink d2/d8/d14/d1b/d95/d92/ddb/lfb 0 2024-04-12T09:11:38.504 INFO:tasks.workunit.client.1.smithi203.stdout:4/892: truncate d1a/d21/d60/daa/dc5/f10f 1327303 0 2024-04-12T09:11:38.506 INFO:tasks.workunit.client.1.smithi203.stdout:6/744: mknod d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d3a/ce3 0 2024-04-12T09:11:38.507 INFO:tasks.workunit.client.1.smithi203.stdout:0/903: rmdir d0/d125/d94/d2f/d34/db1 39 2024-04-12T09:11:38.508 INFO:tasks.workunit.client.1.smithi203.stdout:1/900: creat df/d2d/d6f/d75/d80/f10f x:0 0 0 2024-04-12T09:11:38.511 INFO:tasks.workunit.client.1.smithi203.stdout:9/729: dread d8/d12/d23/d41/f5e [0,4194304] 0 2024-04-12T09:11:38.513 INFO:tasks.workunit.client.1.smithi203.stdout:7/836: unlink d0/d15/l2e 0 2024-04-12T09:11:38.514 INFO:tasks.workunit.client.1.smithi203.stdout:7/837: write d0/d4/d1c/d5b/dbf/dc5/fcc [3092041,126935] 0 2024-04-12T09:11:38.514 INFO:tasks.workunit.client.1.smithi203.stdout:7/838: fdatasync d0/d34/f87 0 2024-04-12T09:11:38.516 INFO:tasks.workunit.client.1.smithi203.stdout:7/839: write d0/d4/d54/da0/dff/d4c/fee [994121,8250] 0 2024-04-12T09:11:38.517 INFO:tasks.workunit.client.1.smithi203.stdout:0/904: creat d0/d48/d5e/f12f x:0 0 0 2024-04-12T09:11:38.520 INFO:tasks.workunit.client.1.smithi203.stdout:1/901: rename df/l3a to df/dfb/dff/l110 0 2024-04-12T09:11:38.521 INFO:tasks.workunit.client.1.smithi203.stdout:1/902: fdatasync df/f99 0 2024-04-12T09:11:38.521 INFO:tasks.workunit.client.1.smithi203.stdout:1/903: readlink df/lb5 0 2024-04-12T09:11:38.522 INFO:tasks.workunit.client.1.smithi203.stdout:3/787: dwrite d2/d8/d14/d23/d35/d4c/d5c/fed [0,4194304] 0 2024-04-12T09:11:38.523 INFO:tasks.workunit.client.1.smithi203.stdout:1/904: chown df/d2d/d6f/d75/d80/f21 4049 1 2024-04-12T09:11:38.526 INFO:tasks.workunit.client.1.smithi203.stdout:8/806: sync 2024-04-12T09:11:38.526 INFO:tasks.workunit.client.1.smithi203.stdout:2/893: sync 2024-04-12T09:11:38.528 INFO:tasks.workunit.client.1.smithi203.stdout:7/840: unlink d0/d4/d54/da0/dff/d4c/ld2 0 2024-04-12T09:11:38.529 INFO:tasks.workunit.client.1.smithi203.stdout:6/745: dwrite d1/d3/d26/d30/d4a/d6c/f40 [4194304,4194304] 0 2024-04-12T09:11:38.530 INFO:tasks.workunit.client.1.smithi203.stdout:6/746: chown d1/d3/d26/l32 0 1 2024-04-12T09:11:38.534 INFO:tasks.workunit.client.1.smithi203.stdout:6/747: write d1/d3/d26/d30/d4a/d6c/f5a [1444872,99544] 0 2024-04-12T09:11:38.536 INFO:tasks.workunit.client.1.smithi203.stdout:2/894: dwrite d0/d14/d1e/d2a/dcd/fdb [0,4194304] 0 2024-04-12T09:11:38.540 INFO:tasks.workunit.client.1.smithi203.stdout:8/807: mkdir d4/d8/d81/db4/d107 0 2024-04-12T09:11:38.543 INFO:tasks.workunit.client.1.smithi203.stdout:0/905: mkdir d0/dd/d5b/d90/dd3/d130 0 2024-04-12T09:11:38.543 INFO:tasks.workunit.client.1.smithi203.stdout:0/906: stat d0/dd/d5b/f93 0 2024-04-12T09:11:38.545 INFO:tasks.workunit.client.1.smithi203.stdout:4/893: getdents d1a/d21/d60/daa 0 2024-04-12T09:11:38.551 INFO:tasks.workunit.client.1.smithi203.stdout:1/905: symlink df/d2d/d6f/d75/d80/d54/d5d/d90/dc7/d107/l111 0 2024-04-12T09:11:38.551 INFO:tasks.workunit.client.1.smithi203.stdout:7/841: symlink d0/d4/d53/dde/l118 0 2024-04-12T09:11:38.553 INFO:tasks.workunit.client.1.smithi203.stdout:8/808: creat d4/d8/d1c/d5d/dc9/f108 x:0 0 0 2024-04-12T09:11:38.554 INFO:tasks.workunit.client.1.smithi203.stdout:9/730: getdents d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/dca/dd1 0 2024-04-12T09:11:38.556 INFO:tasks.workunit.client.1.smithi203.stdout:9/731: write d8/d12/d23/d85/de1/de6/fea [30129,1439] 0 2024-04-12T09:11:38.556 INFO:tasks.workunit.client.1.smithi203.stdout:2/895: mknod d0/d14/d23/c13d 0 2024-04-12T09:11:38.558 INFO:tasks.workunit.client.1.smithi203.stdout:3/788: dread d2/d8/d14/d1b/d2f/fc9 [0,4194304] 0 2024-04-12T09:11:38.559 INFO:tasks.workunit.client.1.smithi203.stdout:7/842: read - d0/d34/d7c/fcd zero size 2024-04-12T09:11:38.561 INFO:tasks.workunit.client.1.smithi203.stdout:0/907: creat d0/d125/d94/d2f/d34/dfe/f131 x:0 0 0 2024-04-12T09:11:38.561 INFO:tasks.workunit.client.1.smithi203.stdout:8/809: chown d4/d8/d74/d78/f25 0 1 2024-04-12T09:11:38.561 INFO:tasks.workunit.client.1.smithi203.stdout:0/908: truncate d0/dd/d5b/f117 825589 0 2024-04-12T09:11:38.564 INFO:tasks.workunit.client.1.smithi203.stdout:2/896: creat d0/d14/d1e/d2a/dcd/dfc/d9c/f13e x:0 0 0 2024-04-12T09:11:38.565 INFO:tasks.workunit.client.1.smithi203.stdout:9/732: rmdir d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d40/db8/ddf 39 2024-04-12T09:11:38.569 INFO:tasks.workunit.client.1.smithi203.stdout:1/906: dwrite df/d2d/d6f/d75/d80/d54/d5d/d67/f6b [0,4194304] 0 2024-04-12T09:11:38.570 INFO:tasks.workunit.client.1.smithi203.stdout:0/909: rmdir d0/dd/d5b/d9f 39 2024-04-12T09:11:38.575 INFO:tasks.workunit.client.1.smithi203.stdout:6/748: link d1/d3/d5b/f6d d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/db5/fe4 0 2024-04-12T09:11:38.575 INFO:tasks.workunit.client.1.smithi203.stdout:7/843: dread d0/d15/d89/fda [0,4194304] 0 2024-04-12T09:11:38.577 INFO:tasks.workunit.client.1.smithi203.stdout:3/789: write d2/d8/d14/d23/d35/d4c/d5c/f63 [4120882,7974] 0 2024-04-12T09:11:38.578 INFO:tasks.workunit.client.1.smithi203.stdout:3/790: write d2/f30 [1045686,131001] 0 2024-04-12T09:11:38.584 INFO:tasks.workunit.client.1.smithi203.stdout:9/733: rename d8/l1e to d8/d12/d3e/d90/d60/daf/lf8 0 2024-04-12T09:11:38.585 INFO:tasks.workunit.client.1.smithi203.stdout:7/844: mkdir d0/d4/d1c/d5b/dbf/dc3/d119 0 2024-04-12T09:11:38.586 INFO:tasks.workunit.client.1.smithi203.stdout:3/791: dwrite d2/d8/d14/d23/d35/d91/f7a [0,4194304] 0 2024-04-12T09:11:38.588 INFO:tasks.workunit.client.1.smithi203.stdout:6/749: dwrite d1/d3/d12/f1e [0,4194304] 0 2024-04-12T09:11:38.589 INFO:tasks.workunit.client.1.smithi203.stdout:9/734: chown d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/ld6 14966618 1 2024-04-12T09:11:38.590 INFO:tasks.workunit.client.1.smithi203.stdout:6/750: chown d1/d3/d26/d30/d4a/d6c/d45/d55 828 1 2024-04-12T09:11:38.594 INFO:tasks.workunit.client.1.smithi203.stdout:1/907: creat df/d2d/d6f/d75/d80/d2b/f112 x:0 0 0 2024-04-12T09:11:38.594 INFO:tasks.workunit.client.1.smithi203.stdout:0/910: dwrite d0/d125/d94/d2f/f42 [0,4194304] 0 2024-04-12T09:11:38.597 INFO:tasks.workunit.client.1.smithi203.stdout:6/751: creat d1/d3/d26/d5d/fe5 x:0 0 0 2024-04-12T09:11:38.599 INFO:tasks.workunit.client.1.smithi203.stdout:2/897: getdents d0/d14/d74 0 2024-04-12T09:11:38.601 INFO:tasks.workunit.client.1.smithi203.stdout:9/735: unlink d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/dca/dd1/lb6 0 2024-04-12T09:11:38.604 INFO:tasks.workunit.client.1.smithi203.stdout:1/908: chown df/f2a 630690992 1 2024-04-12T09:11:38.607 INFO:tasks.workunit.client.1.smithi203.stdout:9/736: creat d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/dca/dd1/ff9 x:0 0 0 2024-04-12T09:11:38.608 INFO:tasks.workunit.client.1.smithi203.stdout:0/911: dread d0/f4e [0,4194304] 0 2024-04-12T09:11:38.608 INFO:tasks.workunit.client.1.smithi203.stdout:3/792: rename d2/d8/d14/d23/d35/c6a to d2/d8/cfc 0 2024-04-12T09:11:38.610 INFO:tasks.workunit.client.1.smithi203.stdout:9/737: chown d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/f9f 377 1 2024-04-12T09:11:38.610 INFO:tasks.workunit.client.1.smithi203.stdout:2/898: link d0/d3/d8e/dcc/fe5 d0/d14/d1e/d2a/dce/d129/f13f 0 2024-04-12T09:11:38.610 INFO:tasks.workunit.client.1.smithi203.stdout:2/899: readlink d0/d3/d47/l10f 0 2024-04-12T09:11:38.610 INFO:tasks.workunit.client.1.smithi203.stdout:3/793: fsync d2/d8/d14/d23/d35/d4c/d5c/f38 0 2024-04-12T09:11:38.612 INFO:tasks.workunit.client.1.smithi203.stdout:3/794: stat d2/d51/d65 0 2024-04-12T09:11:38.612 INFO:tasks.workunit.client.1.smithi203.stdout:6/752: rename d1/d3/d26/d30/d4a/d6c/d45/d55/f7b to d1/df/d87/d7a/fe6 0 2024-04-12T09:11:38.613 INFO:tasks.workunit.client.1.smithi203.stdout:3/795: chown d2/d8/d14/d23/d35/d4c/d5c/d55/fdc 2115 1 2024-04-12T09:11:38.614 INFO:tasks.workunit.client.1.smithi203.stdout:2/900: mknod d0/d3/d8f/c140 0 2024-04-12T09:11:38.617 INFO:tasks.workunit.client.1.smithi203.stdout:0/912: dread d0/d48/dc1/fc2 [0,4194304] 0 2024-04-12T09:11:38.622 INFO:tasks.workunit.client.1.smithi203.stdout:5/935: sync 2024-04-12T09:11:38.638 INFO:tasks.workunit.client.1.smithi203.stdout:5/936: dread d0/d6/d16/d9/d86/f9f [0,4194304] 0 2024-04-12T09:11:38.685 INFO:tasks.workunit.client.1.smithi203.stdout:4/894: sync 2024-04-12T09:11:38.705 INFO:tasks.workunit.client.1.smithi203.stdout:8/810: sync 2024-04-12T09:11:38.705 INFO:tasks.workunit.client.1.smithi203.stdout:3/796: sync 2024-04-12T09:11:38.710 INFO:tasks.workunit.client.1.smithi203.stdout:9/738: fsync d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/f82 0 2024-04-12T09:11:38.718 INFO:tasks.workunit.client.1.smithi203.stdout:6/753: rmdir d1/d3/d5b/d8c/d3e/da1 39 2024-04-12T09:11:38.722 INFO:tasks.workunit.client.1.smithi203.stdout:2/901: fdatasync d0/d54/d61/d78/d89/fa2 0 2024-04-12T09:11:38.729 INFO:tasks.workunit.client.1.smithi203.stdout:9/739: dread d8/f58 [0,4194304] 0 2024-04-12T09:11:38.730 INFO:tasks.workunit.client.1.smithi203.stdout:0/913: truncate d0/d59/f91 48767 0 2024-04-12T09:11:38.730 INFO:tasks.workunit.client.1.smithi203.stdout:9/740: write d8/f34 [2341981,31774] 0 2024-04-12T09:11:38.733 INFO:tasks.workunit.client.1.smithi203.stdout:7/845: write d0/d34/d7c/ff5 [3468084,61710] 0 2024-04-12T09:11:38.738 INFO:tasks.workunit.client.1.smithi203.stdout:0/914: dwrite d0/dd/d5b/d90/f10a [0,4194304] 0 2024-04-12T09:11:38.739 INFO:tasks.workunit.client.1.smithi203.stdout:9/741: dwrite d8/d12/d3e/f84 [0,4194304] 0 2024-04-12T09:11:38.740 INFO:tasks.workunit.client.1.smithi203.stdout:4/895: mknod d1a/d20/d5d/d10c/c125 0 2024-04-12T09:11:38.757 INFO:tasks.workunit.client.1.smithi203.stdout:2/902: mkdir d0/d14/d8a/dca/d141 0 2024-04-12T09:11:38.764 INFO:tasks.workunit.client.1.smithi203.stdout:5/937: truncate d0/d6/d11/d1e/f78 425399 0 2024-04-12T09:11:38.768 INFO:tasks.workunit.client.1.smithi203.stdout:0/915: creat d0/d125/d94/d2f/d17/d19/d6f/dcb/f132 x:0 0 0 2024-04-12T09:11:38.772 INFO:tasks.workunit.client.1.smithi203.stdout:9/742: symlink d8/d12/d23/d85/lfa 0 2024-04-12T09:11:38.773 INFO:tasks.workunit.client.1.smithi203.stdout:9/743: stat d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/f6a 0 2024-04-12T09:11:38.774 INFO:tasks.workunit.client.1.smithi203.stdout:0/916: dread d0/d125/fb7 [0,4194304] 0 2024-04-12T09:11:38.778 INFO:tasks.workunit.client.1.smithi203.stdout:3/797: creat d2/d8/def/ffd x:0 0 0 2024-04-12T09:11:38.781 INFO:tasks.workunit.client.1.smithi203.stdout:6/754: symlink d1/d3/d5b/d8c/d3e/da1/le7 0 2024-04-12T09:11:38.793 INFO:tasks.workunit.client.1.smithi203.stdout:4/896: truncate d1a/d21/d22/f39 1172589 0 2024-04-12T09:11:38.793 INFO:tasks.workunit.client.1.smithi203.stdout:4/897: chown d1a/d20/d5d/d2c/d72/f117 197 1 2024-04-12T09:11:38.798 INFO:tasks.workunit.client.1.smithi203.stdout:7/846: rename d0/d15/d2d/df2/d108/dba/fe5 to d0/f11a 0 2024-04-12T09:11:38.798 INFO:tasks.workunit.client.1.smithi203.stdout:7/847: chown d0/d4/d54/da0/dff/f46 252 1 2024-04-12T09:11:38.803 INFO:tasks.workunit.client.1.smithi203.stdout:4/898: mknod d1a/d1d/d69/dcf/c126 0 2024-04-12T09:11:38.805 INFO:tasks.workunit.client.1.smithi203.stdout:6/755: mkdir d1/d3/d26/d9b/de2/de8 0 2024-04-12T09:11:38.810 INFO:tasks.workunit.client.1.smithi203.stdout:6/756: creat d1/d3/d5b/d8c/d3e/da1/fe9 x:0 0 0 2024-04-12T09:11:38.811 INFO:tasks.workunit.client.1.smithi203.stdout:6/757: chown d1/df/d65/d96 47 1 2024-04-12T09:11:38.811 INFO:tasks.workunit.client.1.smithi203.stdout:5/938: getdents d0/d6/d16/d9/d86 0 2024-04-12T09:11:38.812 INFO:tasks.workunit.client.1.smithi203.stdout:5/939: chown d0/d6/d11/dd3/d101 276 1 2024-04-12T09:11:38.813 INFO:tasks.workunit.client.1.smithi203.stdout:7/848: mknod d0/c11b 0 2024-04-12T09:11:38.814 INFO:tasks.workunit.client.1.smithi203.stdout:6/758: mknod d1/d3/d26/d30/cea 0 2024-04-12T09:11:38.819 INFO:tasks.workunit.client.1.smithi203.stdout:7/849: fdatasync d0/d4/d1c/f35 0 2024-04-12T09:11:38.823 INFO:tasks.workunit.client.1.smithi203.stdout:7/850: truncate d0/d15/d2d/fc2 153645 0 2024-04-12T09:11:38.825 INFO:tasks.workunit.client.1.smithi203.stdout:7/851: truncate d0/d34/d7c/fcd 762543 0 2024-04-12T09:11:38.826 INFO:tasks.workunit.client.1.smithi203.stdout:7/852: read d0/d4/d5d/f85 [26727,8181] 0 2024-04-12T09:11:38.827 INFO:tasks.workunit.client.1.smithi203.stdout:7/853: fdatasync d0/d4/d53/dde/fdf 0 2024-04-12T09:11:38.828 INFO:tasks.workunit.client.1.smithi203.stdout:7/854: read d0/d4/d5d/f85 [195444,6904] 0 2024-04-12T09:11:38.833 INFO:tasks.workunit.client.1.smithi203.stdout:7/855: dwrite d0/d4/d1c/d5b/dbf/dc5/fcc [4194304,4194304] 0 2024-04-12T09:11:38.837 INFO:tasks.workunit.client.1.smithi203.stdout:8/811: link d4/d8/d37/f98 d4/d8/d81/d84/f109 0 2024-04-12T09:11:38.840 INFO:tasks.workunit.client.1.smithi203.stdout:7/856: dwrite d0/d38/d51/f10a [0,4194304] 0 2024-04-12T09:11:38.845 INFO:tasks.workunit.client.1.smithi203.stdout:7/857: read d0/f40 [4535153,25751] 0 2024-04-12T09:11:38.846 INFO:tasks.workunit.client.1.smithi203.stdout:8/812: mknod d4/d8/d1c/c10a 0 2024-04-12T09:11:38.847 INFO:tasks.workunit.client.1.smithi203.stdout:7/858: chown d0/d4/d1c/f3a 850692 1 2024-04-12T09:11:38.855 INFO:tasks.workunit.client.1.smithi203.stdout:7/859: creat d0/d4/d54/da0/d106/df0/f11c x:0 0 0 2024-04-12T09:11:38.873 INFO:tasks.workunit.client.1.smithi203.stdout:7/860: dread d0/d15/f20 [0,4194304] 0 2024-04-12T09:11:38.875 INFO:tasks.workunit.client.1.smithi203.stdout:7/861: chown d0/c12 980 1 2024-04-12T09:11:38.876 INFO:tasks.workunit.client.1.smithi203.stdout:4/899: creat d1a/d21/d22/d2e/d8d/d9b/dbc/f127 x:0 0 0 2024-04-12T09:11:38.877 INFO:tasks.workunit.client.1.smithi203.stdout:4/900: chown d1a/d21/d60/daa/d103 20 1 2024-04-12T09:11:38.882 INFO:tasks.workunit.client.1.smithi203.stdout:4/901: dwrite d1a/d21/d60/daa/dc5/f10f [0,4194304] 0 2024-04-12T09:11:38.885 INFO:tasks.workunit.client.1.smithi203.stdout:4/902: mkdir d1a/d21/d22/d2e/d78/d128 0 2024-04-12T09:11:38.889 INFO:tasks.workunit.client.1.smithi203.stdout:4/903: mknod d1a/d21/d22/d2e/d8d/db8/c129 0 2024-04-12T09:11:38.890 INFO:tasks.workunit.client.1.smithi203.stdout:4/904: dread d1a/d1d/d69/f9a [0,4194304] 0 2024-04-12T09:11:38.891 INFO:tasks.workunit.client.1.smithi203.stdout:4/905: write d1a/d20/d5f/f66 [881852,35195] 0 2024-04-12T09:11:38.897 INFO:tasks.workunit.client.1.smithi203.stdout:4/906: dwrite d1a/d21/da1/fc0 [0,4194304] 0 2024-04-12T09:11:38.898 INFO:tasks.workunit.client.1.smithi203.stdout:4/907: chown d1a/d20/d5d/c3f 516523 1 2024-04-12T09:11:38.900 INFO:tasks.workunit.client.1.smithi203.stdout:4/908: read d1a/d21/d22/d2e/d8d/d9b/ddf/fee [211640,7395] 0 2024-04-12T09:11:38.925 INFO:tasks.workunit.client.1.smithi203.stdout:2/903: mkdir d0/d14/d142 0 2024-04-12T09:11:38.930 INFO:tasks.workunit.client.1.smithi203.stdout:2/904: creat d0/d14/d1e/d57/f143 x:0 0 0 2024-04-12T09:11:38.930 INFO:tasks.workunit.client.1.smithi203.stdout:3/798: write d2/d8/d14/f40 [142700,128588] 0 2024-04-12T09:11:38.931 INFO:tasks.workunit.client.1.smithi203.stdout:2/905: chown d0/d14/d1e/d57 5634923 1 2024-04-12T09:11:38.944 INFO:tasks.workunit.client.1.smithi203.stdout:2/906: dwrite d0/d3/f36 [4194304,4194304] 0 2024-04-12T09:11:38.946 INFO:tasks.workunit.client.1.smithi203.stdout:6/759: truncate d1/d3/d26/dcb/fd5 643970 0 2024-04-12T09:11:38.948 INFO:tasks.workunit.client.1.smithi203.stdout:2/907: unlink d0/d54/d61/d82/l8d 0 2024-04-12T09:11:38.949 INFO:tasks.workunit.client.1.smithi203.stdout:6/760: write d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d3a/f60 [648955,91510] 0 2024-04-12T09:11:38.949 INFO:tasks.workunit.client.1.smithi203.stdout:5/940: dwrite d0/d6/d11/d1e/fd9 [0,4194304] 0 2024-04-12T09:11:38.951 INFO:tasks.workunit.client.1.smithi203.stdout:6/761: write d1/d3/d12/f84 [2455719,128235] 0 2024-04-12T09:11:38.952 INFO:tasks.workunit.client.1.smithi203.stdout:2/908: mkdir d0/d3/d8e/dcc/d144 0 2024-04-12T09:11:38.959 INFO:tasks.workunit.client.1.smithi203.stdout:2/909: link d0/d14/d23/d3d/f111 d0/d14/d8a/dca/d141/f145 0 2024-04-12T09:11:38.960 INFO:tasks.workunit.client.1.smithi203.stdout:2/910: write d0/d14/d1e/d57/d95/fb0 [3576921,100706] 0 2024-04-12T09:11:38.964 INFO:tasks.workunit.client.1.smithi203.stdout:2/911: mknod d0/d14/d1e/d57/deb/c146 0 2024-04-12T09:11:38.964 INFO:tasks.workunit.client.1.smithi203.stdout:8/813: write d4/d34/f9a [155407,25709] 0 2024-04-12T09:11:38.969 INFO:tasks.workunit.client.1.smithi203.stdout:8/814: mkdir d4/d8/d37/d57/d7d/de6/d10b 0 2024-04-12T09:11:38.969 INFO:tasks.workunit.client.1.smithi203.stdout:9/744: mkdir d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/dfb 0 2024-04-12T09:11:38.970 INFO:tasks.workunit.client.1.smithi203.stdout:9/745: fdatasync d8/d12/d23/d27/fbc 0 2024-04-12T09:11:38.974 INFO:tasks.workunit.client.1.smithi203.stdout:8/815: dwrite d4/d8/d81/d84/d92/f80 [0,4194304] 0 2024-04-12T09:11:38.974 INFO:tasks.workunit.client.1.smithi203.stdout:9/746: creat d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/dca/ffc x:0 0 0 2024-04-12T09:11:38.975 INFO:tasks.workunit.client.1.smithi203.stdout:9/747: fsync d8/f8d 0 2024-04-12T09:11:38.975 INFO:tasks.workunit.client.1.smithi203.stdout:8/816: chown d4/d8/f24 237 1 2024-04-12T09:11:38.976 INFO:tasks.workunit.client.1.smithi203.stdout:8/817: dread - d4/d8/d1c/d5d/dc9/ffd zero size 2024-04-12T09:11:38.976 INFO:tasks.workunit.client.1.smithi203.stdout:0/917: unlink d0/dd/d5b/fba 0 2024-04-12T09:11:38.984 INFO:tasks.workunit.client.1.smithi203.stdout:7/862: mkdir d0/d4/d1c/d5b/dbf/d11d 0 2024-04-12T09:11:38.984 INFO:tasks.workunit.client.1.smithi203.stdout:9/748: link d8/d12/d23/d85/ca6 d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/dfb/cfd 0 2024-04-12T09:11:38.985 INFO:tasks.workunit.client.1.smithi203.stdout:9/749: fsync d8/d12/f16 0 2024-04-12T09:11:38.986 INFO:tasks.workunit.client.1.smithi203.stdout:1/909: creat df/d2d/d6f/d75/d80/d2b/f113 x:0 0 0 2024-04-12T09:11:38.989 INFO:tasks.workunit.client.1.smithi203.stdout:9/750: unlink d8/d12/f83 0 2024-04-12T09:11:38.991 INFO:tasks.workunit.client.1.smithi203.stdout:1/910: mkdir df/dfb/dff/d10b/d114 0 2024-04-12T09:11:38.994 INFO:tasks.workunit.client.1.smithi203.stdout:9/751: dwrite d8/d12/d23/f77 [0,4194304] 0 2024-04-12T09:11:38.995 INFO:tasks.workunit.client.1.smithi203.stdout:9/752: chown d8/d12/d3e/f84 0 1 2024-04-12T09:11:38.996 INFO:tasks.workunit.client.1.smithi203.stdout:1/911: getdents df/d2d/d6f/d75/d80/df3 0 2024-04-12T09:11:38.996 INFO:tasks.workunit.client.1.smithi203.stdout:9/753: chown d8/d12/d23/d38/f91 28 1 2024-04-12T09:11:38.999 INFO:tasks.workunit.client.1.smithi203.stdout:8/818: dread d4/d8/f77 [0,4194304] 0 2024-04-12T09:11:39.000 INFO:tasks.workunit.client.1.smithi203.stdout:8/819: dread - d4/d8/d1c/d5d/dc9/f108 zero size 2024-04-12T09:11:39.000 INFO:tasks.workunit.client.1.smithi203.stdout:1/912: rmdir df/d2d/d6f/d75/d80/d54/d5d/d58/dce 39 2024-04-12T09:11:39.002 INFO:tasks.workunit.client.1.smithi203.stdout:9/754: write d8/d12/d23/d38/d8a/d97/d9e/d74/fd0 [600201,101630] 0 2024-04-12T09:11:39.002 INFO:tasks.workunit.client.1.smithi203.stdout:1/913: read - df/d2d/d6f/d75/d80/d54/d5d/d90/fe9 zero size 2024-04-12T09:11:39.008 INFO:tasks.workunit.client.1.smithi203.stdout:9/755: dwrite d8/d12/d23/f3a [0,4194304] 0 2024-04-12T09:11:39.008 INFO:tasks.workunit.client.1.smithi203.stdout:0/918: creat d0/d125/f133 x:0 0 0 2024-04-12T09:11:39.010 INFO:tasks.workunit.client.1.smithi203.stdout:0/919: write d0/d48/f104 [1494818,22045] 0 2024-04-12T09:11:39.012 INFO:tasks.workunit.client.1.smithi203.stdout:4/909: write d1a/d21/d22/f39 [1333153,2082] 0 2024-04-12T09:11:39.017 INFO:tasks.workunit.client.1.smithi203.stdout:4/910: dread d1a/d34/de4/ffc [0,4194304] 0 2024-04-12T09:11:39.020 INFO:tasks.workunit.client.1.smithi203.stdout:8/820: getdents d4/d8/d81/d84 0 2024-04-12T09:11:39.023 INFO:tasks.workunit.client.1.smithi203.stdout:5/941: truncate d0/d6/d11/d18/d2a/dc8/fce 882949 0 2024-04-12T09:11:39.025 INFO:tasks.workunit.client.1.smithi203.stdout:9/756: link d8/d12/d3e/f84 d8/d12/d3e/d90/d60/ffe 0 2024-04-12T09:11:39.026 INFO:tasks.workunit.client.1.smithi203.stdout:4/911: creat d1a/d21/d60/d68/dbe/f12a x:0 0 0 2024-04-12T09:11:39.027 INFO:tasks.workunit.client.1.smithi203.stdout:0/920: mkdir d0/dd/d5b/d90/dd3/d130/d134 0 2024-04-12T09:11:39.028 INFO:tasks.workunit.client.1.smithi203.stdout:2/912: truncate d0/d3/f8 2359412 0 2024-04-12T09:11:39.030 INFO:tasks.workunit.client.1.smithi203.stdout:9/757: unlink d8/d12/d23/d38/c7c 0 2024-04-12T09:11:39.030 INFO:tasks.workunit.client.1.smithi203.stdout:8/821: dread d4/d8/d37/f98 [0,4194304] 0 2024-04-12T09:11:39.032 INFO:tasks.workunit.client.1.smithi203.stdout:4/912: unlink d1a/d21/d60/d68/dbe/ce2 0 2024-04-12T09:11:39.032 INFO:tasks.workunit.client.1.smithi203.stdout:5/942: dread d0/d6/d16/d9/d80/fd6 [0,4194304] 0 2024-04-12T09:11:39.037 INFO:tasks.workunit.client.1.smithi203.stdout:0/921: dwrite d0/d125/d94/d2f/d17/dc9/de2/f126 [0,4194304] 0 2024-04-12T09:11:39.039 INFO:tasks.workunit.client.1.smithi203.stdout:9/758: creat d8/d12/d23/d38/d8a/d97/df3/fff x:0 0 0 2024-04-12T09:11:39.040 INFO:tasks.workunit.client.1.smithi203.stdout:0/922: stat d0/d125/d94/l8e 0 2024-04-12T09:11:39.042 INFO:tasks.workunit.client.1.smithi203.stdout:8/822: dwrite d4/d34/f47 [0,4194304] 0 2024-04-12T09:11:39.046 INFO:tasks.workunit.client.1.smithi203.stdout:2/913: link d0/d14/d1e/d2a/dcd/dfc/ld8 d0/d3/d47/l147 0 2024-04-12T09:11:39.047 INFO:tasks.workunit.client.1.smithi203.stdout:5/943: dwrite d0/dbd/fc7 [4194304,4194304] 0 2024-04-12T09:11:39.053 INFO:tasks.workunit.client.1.smithi203.stdout:0/923: symlink d0/d125/d94/d2f/d17/d19/d6f/l135 0 2024-04-12T09:11:39.055 INFO:tasks.workunit.client.1.smithi203.stdout:2/914: write d0/d14/d1e/d2a/dcd/dfc/d9c/f13e [718508,74899] 0 2024-04-12T09:11:39.055 INFO:tasks.workunit.client.1.smithi203.stdout:7/863: dwrite d0/d34/d7c/fcd [0,4194304] 0 2024-04-12T09:11:39.058 INFO:tasks.workunit.client.1.smithi203.stdout:1/914: truncate df/d2d/d6f/d75/d80/f21 1182561 0 2024-04-12T09:11:39.058 INFO:tasks.workunit.client.1.smithi203.stdout:2/915: chown d0/d14/d1e/d57/da1/d110/f120 35428695 1 2024-04-12T09:11:39.059 INFO:tasks.workunit.client.1.smithi203.stdout:5/944: mknod d0/d6/d11/d1e/d4c/c14c 0 2024-04-12T09:11:39.062 INFO:tasks.workunit.client.1.smithi203.stdout:5/945: chown d0/d6/d11/d18/d2a/lc4 298720 1 2024-04-12T09:11:39.063 INFO:tasks.workunit.client.1.smithi203.stdout:4/913: dread d1a/d21/d22/f109 [0,4194304] 0 2024-04-12T09:11:39.068 INFO:tasks.workunit.client.1.smithi203.stdout:8/823: dread d4/d8/d81/d84/fa4 [0,4194304] 0 2024-04-12T09:11:39.070 INFO:tasks.workunit.client.1.smithi203.stdout:8/824: write d4/d8/d1c/d5d/dc9/f108 [387809,7530] 0 2024-04-12T09:11:39.071 INFO:tasks.workunit.client.1.smithi203.stdout:5/946: mknod d0/d6/d11/dd3/c14d 0 2024-04-12T09:11:39.076 INFO:tasks.workunit.client.1.smithi203.stdout:1/915: dread df/f2a [0,4194304] 0 2024-04-12T09:11:39.076 INFO:tasks.workunit.client.1.smithi203.stdout:4/914: getdents d1a/d21/d60/daa/d103 0 2024-04-12T09:11:39.078 INFO:tasks.workunit.client.1.smithi203.stdout:8/825: symlink d4/d8/d37/d57/l10c 0 2024-04-12T09:11:39.078 INFO:tasks.workunit.client.1.smithi203.stdout:1/916: read df/d2d/d6f/d75/d80/d2b/d91/f100 [539737,109978] 0 2024-04-12T09:11:39.079 INFO:tasks.workunit.client.1.smithi203.stdout:8/826: stat d4/d8/d81/d84/d92/ddc/df2 0 2024-04-12T09:11:39.080 INFO:tasks.workunit.client.1.smithi203.stdout:6/762: sync 2024-04-12T09:11:39.080 INFO:tasks.workunit.client.1.smithi203.stdout:3/799: sync 2024-04-12T09:11:39.085 INFO:tasks.workunit.client.1.smithi203.stdout:1/917: chown df/d2d/c3e 3 1 2024-04-12T09:11:39.085 INFO:tasks.workunit.client.1.smithi203.stdout:9/759: dwrite d8/d12/d23/f71 [0,4194304] 0 2024-04-12T09:11:39.087 INFO:tasks.workunit.client.1.smithi203.stdout:8/827: rename d4/d34 to d4/d8/d81/db4/dbb/d10d 0 2024-04-12T09:11:39.087 INFO:tasks.workunit.client.1.smithi203.stdout:8/828: write d4/d8/f50 [5378515,39916] 0 2024-04-12T09:11:39.088 INFO:tasks.workunit.client.1.smithi203.stdout:1/918: truncate df/d2d/d6f/d75/d80/d54/d5d/d58/d94/f97 1122253 0 2024-04-12T09:11:39.089 INFO:tasks.workunit.client.1.smithi203.stdout:8/829: fsync d4/d8/d1c/d5d/dc9/f108 0 2024-04-12T09:11:39.089 INFO:tasks.workunit.client.1.smithi203.stdout:5/947: creat d0/d6/d16/d11f/f14e x:0 0 0 2024-04-12T09:11:39.090 INFO:tasks.workunit.client.1.smithi203.stdout:0/924: write d0/d125/fb7 [1353559,81834] 0 2024-04-12T09:11:39.090 INFO:tasks.workunit.client.1.smithi203.stdout:1/919: dread - df/d2d/d6f/d75/d80/f10f zero size 2024-04-12T09:11:39.091 INFO:tasks.workunit.client.1.smithi203.stdout:1/920: write df/d2d/f68 [3009038,8748] 0 2024-04-12T09:11:39.093 INFO:tasks.workunit.client.1.smithi203.stdout:9/760: stat d8/d12/d23/d85/c1b 0 2024-04-12T09:11:39.093 INFO:tasks.workunit.client.1.smithi203.stdout:1/921: chown df/d2d/d6f/d75/d80/d54/d5d/d90/dc7/lca 73 1 2024-04-12T09:11:39.097 INFO:tasks.workunit.client.1.smithi203.stdout:4/915: link d1a/d21/d60/d68/db9/f120 d1a/d21/d22/f12b 0 2024-04-12T09:11:39.165 INFO:tasks.workunit.client.1.smithi203.stdout:5/948: mkdir d0/dbd/dd0/d14f 0 2024-04-12T09:11:39.165 INFO:tasks.workunit.client.1.smithi203.stdout:7/864: truncate d0/d4/d1c/d5b/f65 1002926 0 2024-04-12T09:11:39.167 INFO:tasks.workunit.client.1.smithi203.stdout:7/865: chown d0/d34/feb 71432266 1 2024-04-12T09:11:39.167 INFO:tasks.workunit.client.1.smithi203.stdout:0/925: write d0/d125/d94/d2f/d34/f52 [826129,7849] 0 2024-04-12T09:11:39.170 INFO:tasks.workunit.client.1.smithi203.stdout:1/922: creat df/d2d/d6f/d75/d80/d54/d103/f115 x:0 0 0 2024-04-12T09:11:39.171 INFO:tasks.workunit.client.1.smithi203.stdout:9/761: dread d8/f2a [0,4194304] 0 2024-04-12T09:11:39.173 INFO:tasks.workunit.client.1.smithi203.stdout:5/949: dread d0/dbd/fc7 [4194304,4194304] 0 2024-04-12T09:11:39.174 INFO:tasks.workunit.client.1.smithi203.stdout:6/763: dwrite d1/df/d87/fd7 [0,4194304] 0 2024-04-12T09:11:39.175 INFO:tasks.workunit.client.1.smithi203.stdout:9/762: dread - d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/fb5 zero size 2024-04-12T09:11:39.179 INFO:tasks.workunit.client.1.smithi203.stdout:9/763: write d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/f9f [3268450,35689] 0 2024-04-12T09:11:39.188 INFO:tasks.workunit.client.1.smithi203.stdout:5/950: dwrite d0/ffe [4194304,4194304] 0 2024-04-12T09:11:39.188 INFO:tasks.workunit.client.1.smithi203.stdout:7/866: dread d0/f7 [0,4194304] 0 2024-04-12T09:11:39.188 INFO:tasks.workunit.client.1.smithi203.stdout:0/926: rename d0/f3 to d0/d125/d94/d65/dbb/f136 0 2024-04-12T09:11:39.197 INFO:tasks.workunit.client.1.smithi203.stdout:2/916: sync 2024-04-12T09:11:39.198 INFO:tasks.workunit.client.1.smithi203.stdout:6/764: mknod d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/d9c/ceb 0 2024-04-12T09:11:39.199 INFO:tasks.workunit.client.1.smithi203.stdout:1/923: write df/d2d/d6f/d75/d80/f26 [2189125,48002] 0 2024-04-12T09:11:39.200 INFO:tasks.workunit.client.1.smithi203.stdout:6/765: chown d1/df/d87/d7a 19820 1 2024-04-12T09:11:39.201 INFO:tasks.workunit.client.1.smithi203.stdout:0/927: symlink d0/d125/d94/d2f/d17/d19/d6f/l137 0 2024-04-12T09:11:39.202 INFO:tasks.workunit.client.1.smithi203.stdout:4/916: getdents d1a/d21/d22/ddd 0 2024-04-12T09:11:39.207 INFO:tasks.workunit.client.1.smithi203.stdout:5/951: dread d0/d6/d16/d9/d80/df2/d104/d2d/fbc [0,4194304] 0 2024-04-12T09:11:39.245 INFO:tasks.workunit.client.1.smithi203.stdout:0/928: creat d0/d48/d5e/dca/dd6/f138 x:0 0 0 2024-04-12T09:11:39.246 INFO:tasks.workunit.client.1.smithi203.stdout:7/867: link d0/d4/d54/da0/d106/l6e d0/d4/d54/da0/d106/df0/l11e 0 2024-04-12T09:11:39.247 INFO:tasks.workunit.client.1.smithi203.stdout:1/924: symlink df/d2d/d6f/d75/d80/d54/d5d/d58/dce/l116 0 2024-04-12T09:11:39.249 INFO:tasks.workunit.client.1.smithi203.stdout:5/952: truncate d0/d6/d16/d9/d30/d58/d74/d88/dbf/f146 866522 0 2024-04-12T09:11:39.249 INFO:tasks.workunit.client.1.smithi203.stdout:1/925: truncate df/d2d/d6f/d75/d80/d54/f46 1188285 0 2024-04-12T09:11:39.250 INFO:tasks.workunit.client.1.smithi203.stdout:0/929: mkdir d0/d59/d139 0 2024-04-12T09:11:39.251 INFO:tasks.workunit.client.1.smithi203.stdout:0/930: chown d0/d125/d94/d2f/d34/lae 410735100 1 2024-04-12T09:11:39.251 INFO:tasks.workunit.client.1.smithi203.stdout:7/868: mknod d0/d4/d54/dac/c11f 0 2024-04-12T09:11:39.252 INFO:tasks.workunit.client.1.smithi203.stdout:0/931: chown d0/d125/d94/d65/dbb 449208670 1 2024-04-12T09:11:39.253 INFO:tasks.workunit.client.1.smithi203.stdout:9/764: rename d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d40/db8/ddf/fce to d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d40/db8/f100 0 2024-04-12T09:11:39.254 INFO:tasks.workunit.client.1.smithi203.stdout:4/917: dwrite d1a/d21/d22/d2e/d8d/d9b/dbc/f52 [0,4194304] 0 2024-04-12T09:11:39.257 INFO:tasks.workunit.client.1.smithi203.stdout:4/918: dread d1a/d1d/d69/f9a [0,4194304] 0 2024-04-12T09:11:39.257 INFO:tasks.workunit.client.1.smithi203.stdout:4/919: chown d1a/d20/d5d/l8c 3 1 2024-04-12T09:11:39.257 INFO:tasks.workunit.client.1.smithi203.stdout:2/917: truncate d0/d67/f75 3639595 0 2024-04-12T09:11:39.258 INFO:tasks.workunit.client.1.smithi203.stdout:4/920: readlink d1a/d21/d60/l70 0 2024-04-12T09:11:39.259 INFO:tasks.workunit.client.1.smithi203.stdout:4/921: write d1a/d20/fab [4637533,117901] 0 2024-04-12T09:11:39.259 INFO:tasks.workunit.client.1.smithi203.stdout:2/918: write d0/d14/d1e/d2a/dcd/dfc/f5a [3149073,110109] 0 2024-04-12T09:11:39.260 INFO:tasks.workunit.client.1.smithi203.stdout:4/922: chown d1a/d21/d22/d2e/d8b/l9e 12 1 2024-04-12T09:11:39.273 INFO:tasks.workunit.client.1.smithi203.stdout:5/953: mkdir d0/d6/d11/d1e/d4c/d48/d150 0 2024-04-12T09:11:39.274 INFO:tasks.workunit.client.1.smithi203.stdout:5/954: stat d0/d6/d11/d18/d2a/dc8/f110 0 2024-04-12T09:11:39.284 INFO:tasks.workunit.client.1.smithi203.stdout:2/919: mkdir d0/d67/d86/dd9/d148 0 2024-04-12T09:11:39.284 INFO:tasks.workunit.client.1.smithi203.stdout:2/920: readlink d0/d14/d74/l87 0 2024-04-12T09:11:39.287 INFO:tasks.workunit.client.1.smithi203.stdout:0/932: symlink d0/d125/d94/d2f/d34/l13a 0 2024-04-12T09:11:39.287 INFO:tasks.workunit.client.1.smithi203.stdout:3/800: sync 2024-04-12T09:11:39.288 INFO:tasks.workunit.client.1.smithi203.stdout:5/955: unlink d0/d6/d16/d9/d80/df2/d104/d2d/l90 0 2024-04-12T09:11:39.294 INFO:tasks.workunit.client.1.smithi203.stdout:7/869: write d0/d38/d79/fbd [13471,26093] 0 2024-04-12T09:11:39.301 INFO:tasks.workunit.client.1.smithi203.stdout:5/956: truncate d0/d6/d11/ffc 614712 0 2024-04-12T09:11:39.303 INFO:tasks.workunit.client.1.smithi203.stdout:9/765: creat d8/d12/d3e/d90/f101 x:0 0 0 2024-04-12T09:11:39.304 INFO:tasks.workunit.client.1.smithi203.stdout:1/926: getdents df/d2d/d6f/d75/d80/d8c 0 2024-04-12T09:11:39.305 INFO:tasks.workunit.client.1.smithi203.stdout:7/870: mkdir d0/d15/d2d/df2/d108/dba/d120 0 2024-04-12T09:11:39.307 INFO:tasks.workunit.client.1.smithi203.stdout:4/923: dwrite d1a/d34/f46 [4194304,4194304] 0 2024-04-12T09:11:39.311 INFO:tasks.workunit.client.1.smithi203.stdout:5/957: dread d0/d6/d16/d9/d30/d58/f99 [4194304,4194304] 0 2024-04-12T09:11:39.313 INFO:tasks.workunit.client.1.smithi203.stdout:9/766: dwrite d8/d12/d23/d41/f78 [0,4194304] 0 2024-04-12T09:11:39.314 INFO:tasks.workunit.client.1.smithi203.stdout:4/924: mknod d1a/d21/d60/d68/dbe/c12c 0 2024-04-12T09:11:39.315 INFO:tasks.workunit.client.1.smithi203.stdout:3/801: dread d2/f18 [0,4194304] 0 2024-04-12T09:11:39.318 INFO:tasks.workunit.client.1.smithi203.stdout:0/933: getdents d0/d48/d5e/dca 0 2024-04-12T09:11:39.319 INFO:tasks.workunit.client.1.smithi203.stdout:1/927: mknod df/d2d/d6f/d75/d80/d2b/c117 0 2024-04-12T09:11:39.319 INFO:tasks.workunit.client.1.smithi203.stdout:2/921: write d0/f18 [2140963,56044] 0 2024-04-12T09:11:39.320 INFO:tasks.workunit.client.1.smithi203.stdout:7/871: dwrite d0/d4/d54/dac/f10f [0,4194304] 0 2024-04-12T09:11:39.323 INFO:tasks.workunit.client.1.smithi203.stdout:1/928: truncate df/d2d/d6f/d75/d80/d2b/d91/ff5 208969 0 2024-04-12T09:11:39.323 INFO:tasks.workunit.client.1.smithi203.stdout:7/872: truncate d0/d4/d54/da0/dff/d4c/f116 973872 0 2024-04-12T09:11:39.326 INFO:tasks.workunit.client.1.smithi203.stdout:1/929: dread df/d2d/d6f/daa/f10c [0,4194304] 0 2024-04-12T09:11:39.328 INFO:tasks.workunit.client.1.smithi203.stdout:5/958: rename d0/d6/d16/d9/d30/d83 to d0/d6/d11/dd3/d151 0 2024-04-12T09:11:39.330 INFO:tasks.workunit.client.1.smithi203.stdout:8/830: sync 2024-04-12T09:11:39.330 INFO:tasks.workunit.client.1.smithi203.stdout:4/925: creat d1a/d21/d22/d2e/d8d/f12d x:0 0 0 2024-04-12T09:11:39.331 INFO:tasks.workunit.client.1.smithi203.stdout:8/831: dread - d4/d8/d1c/d48/d5e/fd1 zero size 2024-04-12T09:11:39.331 INFO:tasks.workunit.client.1.smithi203.stdout:4/926: dread - d1a/d21/d22/d2e/d8d/d9b/dbc/f127 zero size 2024-04-12T09:11:39.335 INFO:tasks.workunit.client.1.smithi203.stdout:2/922: fdatasync d0/d3/d47/fb4 0 2024-04-12T09:11:39.342 INFO:tasks.workunit.client.1.smithi203.stdout:4/927: rename fc to d1a/d21/da1/f12e 0 2024-04-12T09:11:39.342 INFO:tasks.workunit.client.1.smithi203.stdout:4/928: chown d1a/l54 0 1 2024-04-12T09:11:39.343 INFO:tasks.workunit.client.1.smithi203.stdout:0/934: fsync d0/d125/d94/d2f/d17/f60 0 2024-04-12T09:11:39.347 INFO:tasks.workunit.client.1.smithi203.stdout:2/923: fdatasync d0/d3/d47/fc8 0 2024-04-12T09:11:39.357 INFO:tasks.workunit.client.1.smithi203.stdout:3/802: truncate d2/d8/f33 3897762 0 2024-04-12T09:11:39.359 INFO:tasks.workunit.client.1.smithi203.stdout:5/959: creat d0/d6/d16/df8/d143/f152 x:0 0 0 2024-04-12T09:11:39.360 INFO:tasks.workunit.client.1.smithi203.stdout:8/832: unlink d4/d8/d74/d78/l9c 0 2024-04-12T09:11:39.363 INFO:tasks.workunit.client.1.smithi203.stdout:6/766: sync 2024-04-12T09:11:39.364 INFO:tasks.workunit.client.1.smithi203.stdout:9/767: link d8/d12/d3e/fb4 d8/d12/d23/d85/de1/de6/f102 0 2024-04-12T09:11:39.364 INFO:tasks.workunit.client.1.smithi203.stdout:6/767: write d1/d3/d5b/d8c/f66 [4356679,6759] 0 2024-04-12T09:11:39.365 INFO:tasks.workunit.client.1.smithi203.stdout:6/768: write d1/d3/f8f [677522,105873] 0 2024-04-12T09:11:39.365 INFO:tasks.workunit.client.1.smithi203.stdout:6/769: readlink d1/l2b 0 2024-04-12T09:11:39.367 INFO:tasks.workunit.client.1.smithi203.stdout:7/873: link d0/d4/d1c/d5b/cf9 d0/d15/d2d/df2/c121 0 2024-04-12T09:11:39.370 INFO:tasks.workunit.client.1.smithi203.stdout:1/930: rmdir df/d2d/d6f/dfa 0 2024-04-12T09:11:39.371 INFO:tasks.workunit.client.1.smithi203.stdout:3/803: truncate d2/d8/d14/d23/d35/d4c/d67/f9f 4634909 0 2024-04-12T09:11:39.371 INFO:tasks.workunit.client.1.smithi203.stdout:1/931: read - df/d2d/d6f/d75/d80/d2b/f112 zero size 2024-04-12T09:11:39.372 INFO:tasks.workunit.client.1.smithi203.stdout:3/804: stat d2/d8/d14/d23/d35/d4c/d5c/f38 0 2024-04-12T09:11:39.374 INFO:tasks.workunit.client.1.smithi203.stdout:5/960: rmdir d0/d9a 39 2024-04-12T09:11:39.375 INFO:tasks.workunit.client.1.smithi203.stdout:8/833: creat d4/d8/d1c/d5d/dea/f10e x:0 0 0 2024-04-12T09:11:39.377 INFO:tasks.workunit.client.1.smithi203.stdout:3/805: dread d2/d8/d14/d23/d35/d4c/d5c/f56 [0,4194304] 0 2024-04-12T09:11:39.378 INFO:tasks.workunit.client.1.smithi203.stdout:3/806: readlink d2/d8/d14/d23/d35/d4c/d67/d86/lda 0 2024-04-12T09:11:39.386 INFO:tasks.workunit.client.1.smithi203.stdout:8/834: dread d4/d8/d1c/d5d/ffe [8388608,4194304] 0 2024-04-12T09:11:39.391 INFO:tasks.workunit.client.1.smithi203.stdout:6/770: mkdir d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/da0/dec 0 2024-04-12T09:11:39.393 INFO:tasks.workunit.client.1.smithi203.stdout:5/961: creat d0/d6/d11/d1e/d4c/d48/de4/f153 x:0 0 0 2024-04-12T09:11:39.393 INFO:tasks.workunit.client.1.smithi203.stdout:5/962: chown d0/d6/d16/d44/dda/d140 16404305 1 2024-04-12T09:11:39.396 INFO:tasks.workunit.client.1.smithi203.stdout:4/929: truncate d1a/d20/d5d/d2c/d72/fa2 4998721 0 2024-04-12T09:11:39.397 INFO:tasks.workunit.client.1.smithi203.stdout:4/930: fsync d1a/d34/de4/f10d 0 2024-04-12T09:11:39.397 INFO:tasks.workunit.client.1.smithi203.stdout:4/931: chown d1a/d1d/d69/d76/dd6/ffd 5053 1 2024-04-12T09:11:39.398 INFO:tasks.workunit.client.1.smithi203.stdout:0/935: creat d0/dd/d5b/f13b x:0 0 0 2024-04-12T09:11:39.398 INFO:tasks.workunit.client.1.smithi203.stdout:2/924: truncate d0/d14/d1e/d57/da1/d110/f116 2944418 0 2024-04-12T09:11:39.399 INFO:tasks.workunit.client.1.smithi203.stdout:0/936: fsync d0/dd/f16 0 2024-04-12T09:11:39.412 INFO:tasks.workunit.client.1.smithi203.stdout:8/835: write d4/d8/d81/d84/d92/fae [3265550,76831] 0 2024-04-12T09:11:39.413 INFO:tasks.workunit.client.1.smithi203.stdout:3/807: mknod d2/d8/cfe 0 2024-04-12T09:11:39.414 INFO:tasks.workunit.client.1.smithi203.stdout:5/963: truncate d0/d6/d16/d44/f5c 4292729 0 2024-04-12T09:11:39.416 INFO:tasks.workunit.client.1.smithi203.stdout:3/808: truncate d2/d8/d14/d23/d35/d4c/d5c/f9a 1057215 0 2024-04-12T09:11:39.416 INFO:tasks.workunit.client.1.smithi203.stdout:7/874: truncate d0/d4/d54/d75/f9a 2812169 0 2024-04-12T09:11:39.416 INFO:tasks.workunit.client.1.smithi203.stdout:7/875: chown d0/d4/d5d/f86 35722316 1 2024-04-12T09:11:39.426 INFO:tasks.workunit.client.1.smithi203.stdout:8/836: mknod d4/d8/d81/d84/d92/ddc/c10f 0 2024-04-12T09:11:39.429 INFO:tasks.workunit.client.1.smithi203.stdout:3/809: creat d2/d51/fff x:0 0 0 2024-04-12T09:11:39.430 INFO:tasks.workunit.client.1.smithi203.stdout:3/810: write d2/d8/d14/d23/d35/d4c/d5c/f63 [2770797,55025] 0 2024-04-12T09:11:39.436 INFO:tasks.workunit.client.1.smithi203.stdout:2/925: creat d0/d3/d8e/dcc/d144/f149 x:0 0 0 2024-04-12T09:11:39.442 INFO:tasks.workunit.client.1.smithi203.stdout:9/768: rename d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/c33 to d8/d12/d23/d38/d8a/d97/d9e/c103 0 2024-04-12T09:11:39.452 INFO:tasks.workunit.client.1.smithi203.stdout:1/932: rename df/d2d/d6f/d75/d80/d54/d5d/d90/dc7/lca to df/d2d/d6f/d75/d80/d54/d5d/d58/d94/l118 0 2024-04-12T09:11:39.453 INFO:tasks.workunit.client.1.smithi203.stdout:6/771: link d1/d3/d26/d5d/cb2 d1/d3/d5b/d8c/d3e/ced 0 2024-04-12T09:11:39.454 INFO:tasks.workunit.client.1.smithi203.stdout:6/772: chown d1/d3/d26/d30/d4a/d6c/d45/lc8 210947 1 2024-04-12T09:11:39.455 INFO:tasks.workunit.client.1.smithi203.stdout:1/933: read df/d2d/d6f/d75/d80/d54/d5d/d58/f66 [378397,123636] 0 2024-04-12T09:11:39.456 INFO:tasks.workunit.client.1.smithi203.stdout:0/937: truncate d0/d48/d5e/d84/feb 2189968 0 2024-04-12T09:11:39.460 INFO:tasks.workunit.client.1.smithi203.stdout:2/926: dread d0/f32 [0,4194304] 0 2024-04-12T09:11:39.462 INFO:tasks.workunit.client.1.smithi203.stdout:2/927: write d0/d14/d23/d33/f83 [234921,24411] 0 2024-04-12T09:11:39.466 INFO:tasks.workunit.client.1.smithi203.stdout:8/837: link d4/d8/d37/d57/d7d/cac d4/d8/d1c/d5d/dea/c110 0 2024-04-12T09:11:39.468 INFO:tasks.workunit.client.1.smithi203.stdout:6/773: symlink d1/df/d87/d7a/lee 0 2024-04-12T09:11:39.469 INFO:tasks.workunit.client.1.smithi203.stdout:7/876: write d0/d4/f43 [1720012,36970] 0 2024-04-12T09:11:39.469 INFO:tasks.workunit.client.1.smithi203.stdout:7/877: readlink d0/d4/d1c/l76 0 2024-04-12T09:11:39.475 INFO:tasks.workunit.client.1.smithi203.stdout:1/934: mknod df/d2d/d6f/d75/d80/d54/d5d/d90/dc7/c119 0 2024-04-12T09:11:39.480 INFO:tasks.workunit.client.1.smithi203.stdout:8/838: mkdir d4/d8/d74/d111 0 2024-04-12T09:11:39.481 INFO:tasks.workunit.client.1.smithi203.stdout:6/774: mkdir d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/d9c/def 0 2024-04-12T09:11:39.484 INFO:tasks.workunit.client.1.smithi203.stdout:3/811: getdents d2/d51/dbc 0 2024-04-12T09:11:39.486 INFO:tasks.workunit.client.1.smithi203.stdout:1/935: chown df/d2d/d6f/lc0 13 1 2024-04-12T09:11:39.487 INFO:tasks.workunit.client.1.smithi203.stdout:8/839: dwrite d4/d8/d1c/d5d/f60 [0,4194304] 0 2024-04-12T09:11:39.488 INFO:tasks.workunit.client.1.smithi203.stdout:6/775: creat d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/d9c/ff0 x:0 0 0 2024-04-12T09:11:39.490 INFO:tasks.workunit.client.1.smithi203.stdout:2/928: dread d0/d54/d61/f79 [0,4194304] 0 2024-04-12T09:11:39.491 INFO:tasks.workunit.client.1.smithi203.stdout:4/932: rename d1a/d20/d5d/d2c/d72/fa2 to d1a/d20/d5d/f12f 0 2024-04-12T09:11:39.492 INFO:tasks.workunit.client.1.smithi203.stdout:4/933: write d1a/d21/d60/f89 [3095774,28021] 0 2024-04-12T09:11:39.494 INFO:tasks.workunit.client.1.smithi203.stdout:8/840: mkdir d4/d8/d74/d78/d112 0 2024-04-12T09:11:39.494 INFO:tasks.workunit.client.1.smithi203.stdout:4/934: write d1a/d21/d22/d2e/d78/f11f [933132,67044] 0 2024-04-12T09:11:39.495 INFO:tasks.workunit.client.1.smithi203.stdout:1/936: mknod df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/d88/c11a 0 2024-04-12T09:11:39.496 INFO:tasks.workunit.client.1.smithi203.stdout:7/878: write d0/d15/d2d/df2/d108/f90 [1191790,22237] 0 2024-04-12T09:11:39.498 INFO:tasks.workunit.client.1.smithi203.stdout:3/812: mkdir d2/d8/d14/d1b/d95/d92/d100 0 2024-04-12T09:11:39.498 INFO:tasks.workunit.client.1.smithi203.stdout:2/929: dwrite d0/d14/d1e/d2a/f90 [0,4194304] 0 2024-04-12T09:11:39.499 INFO:tasks.workunit.client.1.smithi203.stdout:7/879: stat d0/d4/d53/f7e 0 2024-04-12T09:11:39.511 INFO:tasks.workunit.client.1.smithi203.stdout:3/813: truncate d2/d8/d14/d23/d35/d4c/d67/d86/fb5 308996 0 2024-04-12T09:11:39.513 INFO:tasks.workunit.client.1.smithi203.stdout:8/841: mknod d4/d8/d37/d57/d7d/de6/d10b/c113 0 2024-04-12T09:11:39.513 INFO:tasks.workunit.client.1.smithi203.stdout:2/930: symlink d0/d14/d1e/d57/d95/d12f/l14a 0 2024-04-12T09:11:39.514 INFO:tasks.workunit.client.1.smithi203.stdout:8/842: truncate d4/d8/d81/db4/fe7 416729 0 2024-04-12T09:11:39.515 INFO:tasks.workunit.client.1.smithi203.stdout:5/964: rename d0/d6/d11/d1e/d4c/d48/de4/d13a/c148 to d0/d6/d16/c154 0 2024-04-12T09:11:39.515 INFO:tasks.workunit.client.1.smithi203.stdout:9/769: rename d8/d12/d3e/d90/dd8 to d8/d12/d3e/d90/dd8/d104 22 2024-04-12T09:11:39.515 INFO:tasks.workunit.client.1.smithi203.stdout:8/843: chown d4/d8/d1c/d48/d5e/fce 29566 1 2024-04-12T09:11:39.516 INFO:tasks.workunit.client.1.smithi203.stdout:9/770: readlink d8/d12/d23/ld4 0 2024-04-12T09:11:39.518 INFO:tasks.workunit.client.1.smithi203.stdout:2/931: creat d0/d67/d86/dd9/d103/f14b x:0 0 0 2024-04-12T09:11:39.523 INFO:tasks.workunit.client.1.smithi203.stdout:0/938: rename d0/d48/c12a to d0/d125/d94/d2f/d4c/d7a/c13c 0 2024-04-12T09:11:39.524 INFO:tasks.workunit.client.1.smithi203.stdout:9/771: rmdir d8/d12/d3e 39 2024-04-12T09:11:39.526 INFO:tasks.workunit.client.1.smithi203.stdout:9/772: dread d8/d12/fad [0,4194304] 0 2024-04-12T09:11:39.527 INFO:tasks.workunit.client.1.smithi203.stdout:1/937: write df/f2a [245723,28725] 0 2024-04-12T09:11:39.528 INFO:tasks.workunit.client.1.smithi203.stdout:9/773: dread - d8/d12/d23/d38/d8a/d97/df3/fff zero size 2024-04-12T09:11:39.528 INFO:tasks.workunit.client.1.smithi203.stdout:1/938: stat df/d59 0 2024-04-12T09:11:39.529 INFO:tasks.workunit.client.1.smithi203.stdout:9/774: read d8/fcf [75216,6819] 0 2024-04-12T09:11:39.531 INFO:tasks.workunit.client.1.smithi203.stdout:0/939: creat d0/dd/d5b/d90/f13d x:0 0 0 2024-04-12T09:11:39.531 INFO:tasks.workunit.client.1.smithi203.stdout:7/880: write d0/d15/d2d/f66 [1219518,34644] 0 2024-04-12T09:11:39.533 INFO:tasks.workunit.client.1.smithi203.stdout:7/881: chown d0/d34/d7c 4690935 1 2024-04-12T09:11:39.535 INFO:tasks.workunit.client.1.smithi203.stdout:1/939: symlink df/d2d/d6f/d75/d80/d54/l11b 0 2024-04-12T09:11:39.535 INFO:tasks.workunit.client.1.smithi203.stdout:9/775: chown d8/d12/d23/d38/d8a/d97/d9e/d74/f86 3729082 1 2024-04-12T09:11:39.536 INFO:tasks.workunit.client.1.smithi203.stdout:5/965: dread d0/d6/d11/d18/d1a/f3f [4194304,4194304] 0 2024-04-12T09:11:39.537 INFO:tasks.workunit.client.1.smithi203.stdout:1/940: chown df/l4e 3423747 1 2024-04-12T09:11:39.537 INFO:tasks.workunit.client.1.smithi203.stdout:6/776: dwrite d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/db5/fe4 [0,4194304] 0 2024-04-12T09:11:39.537 INFO:tasks.workunit.client.1.smithi203.stdout:8/844: rename d4/d8/d74/d78/d53/fe0 to d4/d8/d74/d78/d53/f114 0 2024-04-12T09:11:39.546 INFO:tasks.workunit.client.1.smithi203.stdout:3/814: dwrite d2/d8/d14/d23/d35/d4c/d67/f9f [4194304,4194304] 0 2024-04-12T09:11:39.546 INFO:tasks.workunit.client.1.smithi203.stdout:2/932: dread d0/d54/d61/fc4 [0,4194304] 0 2024-04-12T09:11:39.547 INFO:tasks.workunit.client.1.smithi203.stdout:3/815: chown d2/d8/d14/d1b/d2f/cbd 2217 1 2024-04-12T09:11:39.554 INFO:tasks.workunit.client.1.smithi203.stdout:3/816: dwrite d2/d8/d14/f40 [0,4194304] 0 2024-04-12T09:11:39.560 INFO:tasks.workunit.client.1.smithi203.stdout:6/777: mkdir d1/d3/d5b/d8c/d3e/da1/df1 0 2024-04-12T09:11:39.560 INFO:tasks.workunit.client.1.smithi203.stdout:9/776: dwrite d8/d12/d23/d38/f6c [0,4194304] 0 2024-04-12T09:11:39.561 INFO:tasks.workunit.client.1.smithi203.stdout:3/817: dwrite d2/f17 [0,4194304] 0 2024-04-12T09:11:39.563 INFO:tasks.workunit.client.1.smithi203.stdout:3/818: write d2/f2b [4397125,94305] 0 2024-04-12T09:11:39.564 INFO:tasks.workunit.client.1.smithi203.stdout:5/966: write d0/d6/d16/d9/d80/df2/d104/f25 [1450620,68791] 0 2024-04-12T09:11:39.564 INFO:tasks.workunit.client.1.smithi203.stdout:2/933: rmdir d0/d3/d8e/df4 39 2024-04-12T09:11:39.568 INFO:tasks.workunit.client.1.smithi203.stdout:8/845: mkdir d4/d8/d1c/d115 0 2024-04-12T09:11:39.576 INFO:tasks.workunit.client.1.smithi203.stdout:5/967: dwrite d0/d6/d16/d9/d30/d58/d74/d88/f126 [0,4194304] 0 2024-04-12T09:11:39.576 INFO:tasks.workunit.client.1.smithi203.stdout:6/778: creat d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/db5/ff2 x:0 0 0 2024-04-12T09:11:39.578 INFO:tasks.workunit.client.1.smithi203.stdout:5/968: truncate d0/d6/d11/d1e/d4c/f129 470266 0 2024-04-12T09:11:39.578 INFO:tasks.workunit.client.1.smithi203.stdout:7/882: rename d0/d4/c73 to d0/d15/c122 0 2024-04-12T09:11:39.581 INFO:tasks.workunit.client.1.smithi203.stdout:2/934: rmdir d0/d38 39 2024-04-12T09:11:39.582 INFO:tasks.workunit.client.1.smithi203.stdout:0/940: link d0/d48/d5e/c9c d0/d48/c13e 0 2024-04-12T09:11:39.585 INFO:tasks.workunit.client.1.smithi203.stdout:6/779: dwrite d1/d3/d26/d30/d4a/d6c/f5a [0,4194304] 0 2024-04-12T09:11:39.589 INFO:tasks.workunit.client.1.smithi203.stdout:8/846: rename d4/d8/d81/d84/d92/ddc to d4/d8/d74/d111/d116 0 2024-04-12T09:11:39.592 INFO:tasks.workunit.client.1.smithi203.stdout:8/847: truncate d4/d8/d37/d57/ff4 690839 0 2024-04-12T09:11:39.592 INFO:tasks.workunit.client.1.smithi203.stdout:4/935: sync 2024-04-12T09:11:39.592 INFO:tasks.workunit.client.1.smithi203.stdout:3/819: fsync d2/d8/d14/d1b/d2f/fc9 0 2024-04-12T09:11:39.593 INFO:tasks.workunit.client.1.smithi203.stdout:4/936: fsync d1a/fe5 0 2024-04-12T09:11:39.594 INFO:tasks.workunit.client.1.smithi203.stdout:7/883: mknod d0/d4/d54/d75/dc0/c123 0 2024-04-12T09:11:39.594 INFO:tasks.workunit.client.1.smithi203.stdout:8/848: write d4/d8/d81/db4/fe7 [728411,53427] 0 2024-04-12T09:11:39.599 INFO:tasks.workunit.client.1.smithi203.stdout:1/941: getdents df/d2d/d6f/d75/d80/d8c/ddb 0 2024-04-12T09:11:39.599 INFO:tasks.workunit.client.1.smithi203.stdout:8/849: truncate d4/d8/d74/db6/fca 612747 0 2024-04-12T09:11:39.599 INFO:tasks.workunit.client.1.smithi203.stdout:2/935: mknod d0/d67/d86/df6/c14c 0 2024-04-12T09:11:39.601 INFO:tasks.workunit.client.1.smithi203.stdout:0/941: dread - d0/d125/d94/fd1 zero size 2024-04-12T09:11:39.613 INFO:tasks.workunit.client.1.smithi203.stdout:3/820: creat d2/d8/def/f101 x:0 0 0 2024-04-12T09:11:39.613 INFO:tasks.workunit.client.1.smithi203.stdout:3/821: chown d2/d8/d14/lf8 94079 1 2024-04-12T09:11:39.614 INFO:tasks.workunit.client.1.smithi203.stdout:4/937: creat d1a/d20/d5f/f130 x:0 0 0 2024-04-12T09:11:39.615 INFO:tasks.workunit.client.1.smithi203.stdout:7/884: fsync d0/d4/d54/d75/dc0/fb3 0 2024-04-12T09:11:39.617 INFO:tasks.workunit.client.1.smithi203.stdout:8/850: unlink d4/d8/d1c/d5d/dc0/fcd 0 2024-04-12T09:11:39.618 INFO:tasks.workunit.client.1.smithi203.stdout:1/942: mknod df/d2d/d6f/d75/d80/d54/d5d/d58/d94/c11c 0 2024-04-12T09:11:39.619 INFO:tasks.workunit.client.1.smithi203.stdout:2/936: readlink d0/d14/d1e/d2a/dcd/dfc/ld8 0 2024-04-12T09:11:39.622 INFO:tasks.workunit.client.1.smithi203.stdout:5/969: dwrite d0/d6/d11/f6c [0,4194304] 0 2024-04-12T09:11:39.623 INFO:tasks.workunit.client.1.smithi203.stdout:0/942: rename d0/d48/f104 to d0/d125/d94/d2f/d17/d19/d6f/dcb/f13f 0 2024-04-12T09:11:39.623 INFO:tasks.workunit.client.1.smithi203.stdout:5/970: fdatasync d0/d6/d11/d38/f84 0 2024-04-12T09:11:39.624 INFO:tasks.workunit.client.1.smithi203.stdout:5/971: read d0/d6/d16/d9/d80/df2/d104/d2d/fbc [1814874,62600] 0 2024-04-12T09:11:39.625 INFO:tasks.workunit.client.1.smithi203.stdout:5/972: readlink d0/d6/d16/l4e 0 2024-04-12T09:11:39.625 INFO:tasks.workunit.client.1.smithi203.stdout:5/973: chown d0/d6/d16/d9/d122/d141 104 1 2024-04-12T09:11:39.627 INFO:tasks.workunit.client.1.smithi203.stdout:4/938: chown d1a/d20/d5d/d2c/d72/d10a 1772817 1 2024-04-12T09:11:39.632 INFO:tasks.workunit.client.1.smithi203.stdout:6/780: dwrite d1/df/f19 [0,4194304] 0 2024-04-12T09:11:39.635 INFO:tasks.workunit.client.1.smithi203.stdout:1/943: creat df/dfb/f11d x:0 0 0 2024-04-12T09:11:39.640 INFO:tasks.workunit.client.1.smithi203.stdout:9/777: link d8/d12/d23/c4e d8/d12/d23/d38/c105 0 2024-04-12T09:11:39.642 INFO:tasks.workunit.client.1.smithi203.stdout:2/937: rmdir d0/d54/d61/d82 39 2024-04-12T09:11:39.643 INFO:tasks.workunit.client.1.smithi203.stdout:2/938: fdatasync d0/d19/f9b 0 2024-04-12T09:11:39.644 INFO:tasks.workunit.client.1.smithi203.stdout:1/944: dread df/d2d/d6f/d75/fa0 [0,4194304] 0 2024-04-12T09:11:39.649 INFO:tasks.workunit.client.1.smithi203.stdout:0/943: rename d0/dd/d5b/f93 to d0/d59/d139/f140 0 2024-04-12T09:11:39.650 INFO:tasks.workunit.client.1.smithi203.stdout:5/974: rmdir d0/d6/d16/d9/d122 39 2024-04-12T09:11:39.656 INFO:tasks.workunit.client.1.smithi203.stdout:6/781: mknod d1/d3/d26/d30/d4a/d6c/d45/d55/cf3 0 2024-04-12T09:11:39.656 INFO:tasks.workunit.client.1.smithi203.stdout:6/782: chown d1/df/d65/d96/fb8 18808559 1 2024-04-12T09:11:39.657 INFO:tasks.workunit.client.1.smithi203.stdout:6/783: readlink d1/d3/d4/l75 0 2024-04-12T09:11:39.657 INFO:tasks.workunit.client.1.smithi203.stdout:6/784: stat d1/d3/d91/fc6 0 2024-04-12T09:11:39.659 INFO:tasks.workunit.client.1.smithi203.stdout:3/822: truncate d2/d8/fbf 2993156 0 2024-04-12T09:11:39.660 INFO:tasks.workunit.client.1.smithi203.stdout:6/785: dread d1/d3/f29 [0,4194304] 0 2024-04-12T09:11:39.660 INFO:tasks.workunit.client.1.smithi203.stdout:9/778: truncate d8/f2a 1166136 0 2024-04-12T09:11:39.666 INFO:tasks.workunit.client.1.smithi203.stdout:4/939: rename d1a/d21/d22/d2e/d78/d128 to d1a/d21/d22/d102/d131 0 2024-04-12T09:11:39.668 INFO:tasks.workunit.client.1.smithi203.stdout:6/786: dread d1/df/d87/fd7 [0,4194304] 0 2024-04-12T09:11:39.668 INFO:tasks.workunit.client.1.smithi203.stdout:2/939: dread d0/d67/d86/fb1 [0,4194304] 0 2024-04-12T09:11:39.668 INFO:tasks.workunit.client.1.smithi203.stdout:0/944: creat d0/d125/d94/d2f/d4c/d7a/f141 x:0 0 0 2024-04-12T09:11:39.669 INFO:tasks.workunit.client.1.smithi203.stdout:3/823: dwrite d2/d8/d14/d23/d35/d4c/d5c/f38 [0,4194304] 0 2024-04-12T09:11:39.670 INFO:tasks.workunit.client.1.smithi203.stdout:9/779: dwrite d8/d12/d23/f77 [4194304,4194304] 0 2024-04-12T09:11:39.673 INFO:tasks.workunit.client.1.smithi203.stdout:9/780: readlink d8/d12/d23/d85/l8f 0 2024-04-12T09:11:39.673 INFO:tasks.workunit.client.1.smithi203.stdout:8/851: creat d4/d8/f117 x:0 0 0 2024-04-12T09:11:39.676 INFO:tasks.workunit.client.1.smithi203.stdout:0/945: read d0/d125/d94/d2f/d17/fc [435688,100077] 0 2024-04-12T09:11:39.688 INFO:tasks.workunit.client.1.smithi203.stdout:5/975: fdatasync d0/d6/f46 0 2024-04-12T09:11:39.689 INFO:tasks.workunit.client.1.smithi203.stdout:2/940: rename d0/d19/c6b to d0/dd3/c14d 0 2024-04-12T09:11:39.693 INFO:tasks.workunit.client.1.smithi203.stdout:8/852: creat d4/d8/d1c/d48/d5e/de8/f118 x:0 0 0 2024-04-12T09:11:39.695 INFO:tasks.workunit.client.1.smithi203.stdout:0/946: rmdir d0/d59/d5d/d79 39 2024-04-12T09:11:39.697 INFO:tasks.workunit.client.1.smithi203.stdout:0/947: write d0/d125/d94/d2f/d17/dc9/de2/f126 [4202925,57847] 0 2024-04-12T09:11:39.698 INFO:tasks.workunit.client.1.smithi203.stdout:1/945: truncate df/d2d/d6f/d75/d80/d2b/fbc 2057475 0 2024-04-12T09:11:39.699 INFO:tasks.workunit.client.1.smithi203.stdout:4/940: write d1a/d21/d22/d2e/d8d/d9b/ddf/fee [1154655,94614] 0 2024-04-12T09:11:39.701 INFO:tasks.workunit.client.1.smithi203.stdout:3/824: symlink d2/d8/d14/d23/d35/l102 0 2024-04-12T09:11:39.705 INFO:tasks.workunit.client.1.smithi203.stdout:2/941: dread d0/d14/d1e/d57/da1/f10c [0,4194304] 0 2024-04-12T09:11:39.705 INFO:tasks.workunit.client.1.smithi203.stdout:6/787: mknod d1/d3/d26/d30/d4a/d6c/d45/d55/d90/cf4 0 2024-04-12T09:11:39.706 INFO:tasks.workunit.client.1.smithi203.stdout:4/941: dwrite d1a/d21/d22/d2e/f4b [0,4194304] 0 2024-04-12T09:11:39.716 INFO:tasks.workunit.client.1.smithi203.stdout:1/946: creat df/d2d/d6f/d75/d80/d54/d5d/d58/d94/f11e x:0 0 0 2024-04-12T09:11:39.716 INFO:tasks.workunit.client.1.smithi203.stdout:1/947: dread - df/d59/db0/d9b/fde zero size 2024-04-12T09:11:39.720 INFO:tasks.workunit.client.1.smithi203.stdout:3/825: dread d2/d51/d65/f77 [0,4194304] 0 2024-04-12T09:11:39.721 INFO:tasks.workunit.client.1.smithi203.stdout:2/942: unlink d0/d14/d1e/d2a/lba 0 2024-04-12T09:11:39.721 INFO:tasks.workunit.client.1.smithi203.stdout:2/943: readlink d0/d19/l40 0 2024-04-12T09:11:39.727 INFO:tasks.workunit.client.1.smithi203.stdout:9/781: rmdir d8/d12/d23/df0 0 2024-04-12T09:11:39.728 INFO:tasks.workunit.client.1.smithi203.stdout:5/976: truncate d0/d6/d11/d18/dcc/fdd 1368364 0 2024-04-12T09:11:39.732 INFO:tasks.workunit.client.1.smithi203.stdout:0/948: chown d0/dd/d5b/d9f/caa 3 1 2024-04-12T09:11:39.732 INFO:tasks.workunit.client.1.smithi203.stdout:6/788: dread d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/db5/fc5 [0,4194304] 0 2024-04-12T09:11:39.737 INFO:tasks.workunit.client.1.smithi203.stdout:3/826: truncate d2/d8/d14/d23/d35/d4c/d5c/f56 581411 0 2024-04-12T09:11:39.748 INFO:tasks.workunit.client.1.smithi203.stdout:0/949: unlink d0/d125/d94/d2f/d17/f9e 0 2024-04-12T09:11:39.749 INFO:tasks.workunit.client.1.smithi203.stdout:6/789: mknod d1/df/dd3/cf5 0 2024-04-12T09:11:39.754 INFO:tasks.workunit.client.1.smithi203.stdout:5/977: mknod d0/d6/d16/d9/d80/df2/d104/d13b/c155 0 2024-04-12T09:11:39.756 INFO:tasks.workunit.client.1.smithi203.stdout:7/885: sync 2024-04-12T09:11:39.756 INFO:tasks.workunit.client.1.smithi203.stdout:3/827: dread d2/d8/d14/d1b/d2f/fc9 [0,4194304] 0 2024-04-12T09:11:39.760 INFO:tasks.workunit.client.1.smithi203.stdout:2/944: dwrite d0/d14/d1e/d2a/dcd/dfc/d9c/fae [0,4194304] 0 2024-04-12T09:11:39.761 INFO:tasks.workunit.client.1.smithi203.stdout:4/942: dwrite d1a/d21/d22/d2e/d8d/d9b/dbc/dc7/f11c [0,4194304] 0 2024-04-12T09:11:39.762 INFO:tasks.workunit.client.1.smithi203.stdout:1/948: creat df/d2d/f11f x:0 0 0 2024-04-12T09:11:39.768 INFO:tasks.workunit.client.1.smithi203.stdout:5/978: mkdir d0/d6/d11/dd3/d151/d156 0 2024-04-12T09:11:39.770 INFO:tasks.workunit.client.1.smithi203.stdout:0/950: mknod d0/d48/c142 0 2024-04-12T09:11:39.775 INFO:tasks.workunit.client.1.smithi203.stdout:9/782: link d8/d12/d23/d27/c3c d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/c106 0 2024-04-12T09:11:39.776 INFO:tasks.workunit.client.1.smithi203.stdout:7/886: dread d0/d4/d54/d75/f9a [0,4194304] 0 2024-04-12T09:11:39.778 INFO:tasks.workunit.client.1.smithi203.stdout:3/828: mknod d2/d8/d14/d23/d35/d4c/d5c/d55/df6/c103 0 2024-04-12T09:11:39.778 INFO:tasks.workunit.client.1.smithi203.stdout:3/829: readlink d2/d8/d14/d1b/d2f/lbb 0 2024-04-12T09:11:39.779 INFO:tasks.workunit.client.1.smithi203.stdout:3/830: chown d2/d64/d8d 28635 1 2024-04-12T09:11:39.779 INFO:tasks.workunit.client.1.smithi203.stdout:3/831: fsync d2/d51/fc5 0 2024-04-12T09:11:39.784 INFO:tasks.workunit.client.1.smithi203.stdout:2/945: mkdir d0/d3/d8f/d136/d14e 0 2024-04-12T09:11:39.785 INFO:tasks.workunit.client.1.smithi203.stdout:2/946: stat d0/d3/d8e/dcc/fe5 0 2024-04-12T09:11:39.785 INFO:tasks.workunit.client.1.smithi203.stdout:2/947: stat d0/d14/f22 0 2024-04-12T09:11:39.792 INFO:tasks.workunit.client.1.smithi203.stdout:7/887: mknod d0/d4/d54/da0/d106/c124 0 2024-04-12T09:11:39.793 INFO:tasks.workunit.client.1.smithi203.stdout:5/979: truncate d0/d6/d11/d1e/f78 1135710 0 2024-04-12T09:11:39.793 INFO:tasks.workunit.client.1.smithi203.stdout:5/980: stat d0/d6/d16/d44/dda/d140/c5f 0 2024-04-12T09:11:39.799 INFO:tasks.workunit.client.1.smithi203.stdout:0/951: creat d0/d59/d5d/d79/f143 x:0 0 0 2024-04-12T09:11:39.799 INFO:tasks.workunit.client.1.smithi203.stdout:0/952: stat d0/dd/d5b/d9f/lbf 0 2024-04-12T09:11:39.799 INFO:tasks.workunit.client.1.smithi203.stdout:6/790: getdents d1/d3/d5b/d8c/d3e/da1 0 2024-04-12T09:11:39.799 INFO:tasks.workunit.client.1.smithi203.stdout:2/948: write d0/d14/d23/f8b [3808573,51730] 0 2024-04-12T09:11:39.799 INFO:tasks.workunit.client.1.smithi203.stdout:6/791: read d1/d3/d12/f1e [2580535,24156] 0 2024-04-12T09:11:39.800 INFO:tasks.workunit.client.1.smithi203.stdout:3/832: mkdir d2/d64/df3/d104 0 2024-04-12T09:11:39.803 INFO:tasks.workunit.client.1.smithi203.stdout:6/792: dwrite d1/d3/d26/d30/d4a/fd8 [0,4194304] 0 2024-04-12T09:11:39.804 INFO:tasks.workunit.client.1.smithi203.stdout:4/943: truncate d1a/d20/d5d/d2c/f51 332253 0 2024-04-12T09:11:39.806 INFO:tasks.workunit.client.1.smithi203.stdout:0/953: rename d0/d125/d94/d2f/d17/d19/d6f/d78/fb4 to d0/d59/f144 0 2024-04-12T09:11:39.813 INFO:tasks.workunit.client.1.smithi203.stdout:5/981: mknod d0/d6/d11/c157 0 2024-04-12T09:11:39.814 INFO:tasks.workunit.client.1.smithi203.stdout:3/833: stat d2/d8/d14/d23/d35/d4c/d5c/f56 0 2024-04-12T09:11:39.814 INFO:tasks.workunit.client.1.smithi203.stdout:9/783: dwrite d8/d12/d3e/f84 [0,4194304] 0 2024-04-12T09:11:39.815 INFO:tasks.workunit.client.1.smithi203.stdout:3/834: chown d2/d8/d14/d23/d35/d4c 28680 1 2024-04-12T09:11:39.817 INFO:tasks.workunit.client.1.smithi203.stdout:6/793: fsync d1/df/f51 0 2024-04-12T09:11:39.818 INFO:tasks.workunit.client.1.smithi203.stdout:3/835: truncate d2/d8/d14/d23/d35/d4c/d5c/dc3/fea 255616 0 2024-04-12T09:11:39.818 INFO:tasks.workunit.client.1.smithi203.stdout:2/949: dread d0/d14/d23/f8b [0,4194304] 0 2024-04-12T09:11:39.819 INFO:tasks.workunit.client.1.smithi203.stdout:3/836: readlink d2/d8/d14/d23/d35/d4c/d67/d86/l8e 0 2024-04-12T09:11:39.820 INFO:tasks.workunit.client.1.smithi203.stdout:3/837: chown d2/d8/d14/d1b/d95/fca 53738 1 2024-04-12T09:11:39.821 INFO:tasks.workunit.client.1.smithi203.stdout:4/944: creat d1a/d21/d22/d2e/d8d/db8/f132 x:0 0 0 2024-04-12T09:11:39.822 INFO:tasks.workunit.client.1.smithi203.stdout:0/954: dread - d0/d125/d94/d2f/d34/fa8 zero size 2024-04-12T09:11:39.823 INFO:tasks.workunit.client.1.smithi203.stdout:0/955: write d0/d125/d94/d2f/f8f [4233601,58068] 0 2024-04-12T09:11:39.824 INFO:tasks.workunit.client.1.smithi203.stdout:7/888: creat d0/d15/f125 x:0 0 0 2024-04-12T09:11:39.825 INFO:tasks.workunit.client.1.smithi203.stdout:5/982: rename d0/daf/f103 to d0/dbd/f158 0 2024-04-12T09:11:39.825 INFO:tasks.workunit.client.1.smithi203.stdout:8/853: sync 2024-04-12T09:11:39.829 INFO:tasks.workunit.client.1.smithi203.stdout:0/956: dread d0/d125/d94/d2f/d34/f52 [0,4194304] 0 2024-04-12T09:11:39.829 INFO:tasks.workunit.client.1.smithi203.stdout:4/945: mkdir d1a/d21/d22/ddd/d133 0 2024-04-12T09:11:39.836 INFO:tasks.workunit.client.1.smithi203.stdout:7/889: write d0/f11a [558068,63389] 0 2024-04-12T09:11:39.837 INFO:tasks.workunit.client.1.smithi203.stdout:7/890: read - d0/d4/d5d/f9e zero size 2024-04-12T09:11:39.837 INFO:tasks.workunit.client.1.smithi203.stdout:9/784: creat d8/d3b/dcd/f107 x:0 0 0 2024-04-12T09:11:39.838 INFO:tasks.workunit.client.1.smithi203.stdout:7/891: dread - d0/d4/d1c/f3a zero size 2024-04-12T09:11:39.839 INFO:tasks.workunit.client.1.smithi203.stdout:9/785: write d8/d12/d3e/ff4 [4425435,125454] 0 2024-04-12T09:11:39.839 INFO:tasks.workunit.client.1.smithi203.stdout:7/892: chown d0/d4/d1c/d5b/f8e 0 1 2024-04-12T09:11:39.840 INFO:tasks.workunit.client.1.smithi203.stdout:8/854: mknod d4/d8/d74/d111/d116/c119 0 2024-04-12T09:11:39.846 INFO:tasks.workunit.client.1.smithi203.stdout:3/838: creat d2/d64/d8d/de6/f105 x:0 0 0 2024-04-12T09:11:39.846 INFO:tasks.workunit.client.1.smithi203.stdout:6/794: truncate d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/db5/fc3 770021 0 2024-04-12T09:11:39.850 INFO:tasks.workunit.client.1.smithi203.stdout:0/957: creat d0/d125/d94/f145 x:0 0 0 2024-04-12T09:11:39.851 INFO:tasks.workunit.client.1.smithi203.stdout:4/946: mkdir d1a/d21/d60/daa/d134 0 2024-04-12T09:11:39.854 INFO:tasks.workunit.client.1.smithi203.stdout:2/950: dread d0/fc6 [0,4194304] 0 2024-04-12T09:11:39.855 INFO:tasks.workunit.client.1.smithi203.stdout:2/951: stat d0/d14/d1e/d2a/dce/lff 0 2024-04-12T09:11:39.862 INFO:tasks.workunit.client.1.smithi203.stdout:0/958: dread d0/d125/d94/d2f/d17/d19/fb3 [0,4194304] 0 2024-04-12T09:11:39.864 INFO:tasks.workunit.client.1.smithi203.stdout:8/855: rename d4/c3f to d4/d8/d1c/d48/c11a 0 2024-04-12T09:11:39.873 INFO:tasks.workunit.client.1.smithi203.stdout:2/952: mknod d0/d14/d1e/d2a/dcd/dfc/d9c/c14f 0 2024-04-12T09:11:39.874 INFO:tasks.workunit.client.1.smithi203.stdout:5/983: dwrite d0/d6/d16/d9/d30/d58/d74/d88/f97 [0,4194304] 0 2024-04-12T09:11:39.874 INFO:tasks.workunit.client.1.smithi203.stdout:9/786: mknod d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/da9/c108 0 2024-04-12T09:11:39.878 INFO:tasks.workunit.client.1.smithi203.stdout:0/959: rename d0/dd/d40/cdc to d0/d125/d94/d2f/d17/d19/c146 0 2024-04-12T09:11:39.881 INFO:tasks.workunit.client.1.smithi203.stdout:8/856: unlink d4/f66 0 2024-04-12T09:11:39.881 INFO:tasks.workunit.client.1.smithi203.stdout:0/960: write d0/d125/d94/d2f/d17/d19/d6f/dcb/f132 [943984,99110] 0 2024-04-12T09:11:39.882 INFO:tasks.workunit.client.1.smithi203.stdout:0/961: fsync d0/dd/d5b/d90/f10a 0 2024-04-12T09:11:39.882 INFO:tasks.workunit.client.1.smithi203.stdout:3/839: mknod d2/d8/d14/c106 0 2024-04-12T09:11:39.883 INFO:tasks.workunit.client.1.smithi203.stdout:0/962: write d0/d125/fb7 [1249873,51530] 0 2024-04-12T09:11:39.884 INFO:tasks.workunit.client.1.smithi203.stdout:0/963: chown d0/d125/d94/d2f/d17/d19/d6f/d78 90827 1 2024-04-12T09:11:39.885 INFO:tasks.workunit.client.1.smithi203.stdout:0/964: chown d0/d125/d94/d65/dbb/f136 96803428 1 2024-04-12T09:11:39.892 INFO:tasks.workunit.client.1.smithi203.stdout:2/953: rename d0/d14/d74/d96/d9a/fe1 to d0/d54/d61/d78/d89/f150 0 2024-04-12T09:11:39.895 INFO:tasks.workunit.client.1.smithi203.stdout:8/857: truncate d4/d8/d37/f9b 23198 0 2024-04-12T09:11:39.899 INFO:tasks.workunit.client.1.smithi203.stdout:6/795: write d1/d3/d26/f79 [4276398,75666] 0 2024-04-12T09:11:39.901 INFO:tasks.workunit.client.1.smithi203.stdout:0/965: unlink d0/d125/d94/d2f/d17/f60 0 2024-04-12T09:11:39.909 INFO:tasks.workunit.client.1.smithi203.stdout:2/954: write d0/d14/d23/f8b [4715825,4126] 0 2024-04-12T09:11:39.912 INFO:tasks.workunit.client.1.smithi203.stdout:8/858: mknod d4/ddf/d100/c11b 0 2024-04-12T09:11:39.914 INFO:tasks.workunit.client.1.smithi203.stdout:6/796: truncate d1/d3/d12/f1e 5422663 0 2024-04-12T09:11:39.917 INFO:tasks.workunit.client.1.smithi203.stdout:2/955: creat d0/d3/d8f/d10e/f151 x:0 0 0 2024-04-12T09:11:39.917 INFO:tasks.workunit.client.1.smithi203.stdout:8/859: symlink d4/d8/d1c/d5d/da7/l11c 0 2024-04-12T09:11:39.918 INFO:tasks.workunit.client.1.smithi203.stdout:6/797: rmdir d1/df/d87 39 2024-04-12T09:11:39.919 INFO:tasks.workunit.client.1.smithi203.stdout:5/984: getdents d0/d6/d11/dd3/d101 0 2024-04-12T09:11:39.920 INFO:tasks.workunit.client.1.smithi203.stdout:2/956: mknod d0/d3/d8f/d136/c152 0 2024-04-12T09:11:39.921 INFO:tasks.workunit.client.1.smithi203.stdout:8/860: truncate d4/d8/d37/d57/f9d 738380 0 2024-04-12T09:11:39.922 INFO:tasks.workunit.client.1.smithi203.stdout:0/966: dread d0/d125/d94/d2f/d17/f47 [0,4194304] 0 2024-04-12T09:11:39.923 INFO:tasks.workunit.client.1.smithi203.stdout:0/967: write d0/d48/d5e/d84/f8b [4018499,39143] 0 2024-04-12T09:11:39.923 INFO:tasks.workunit.client.1.smithi203.stdout:5/985: symlink d0/d6/d16/l159 0 2024-04-12T09:11:39.925 INFO:tasks.workunit.client.1.smithi203.stdout:8/861: mkdir d4/d8/d1c/d5d/dea/d11d 0 2024-04-12T09:11:39.932 INFO:tasks.workunit.client.1.smithi203.stdout:0/968: creat d0/d125/d94/d65/f147 x:0 0 0 2024-04-12T09:11:39.932 INFO:tasks.workunit.client.1.smithi203.stdout:0/969: readlink d0/d59/l111 0 2024-04-12T09:11:39.936 INFO:tasks.workunit.client.1.smithi203.stdout:8/862: chown d4/d8/d1c/d48/d5e/c8a 658449247 1 2024-04-12T09:11:39.937 INFO:tasks.workunit.client.1.smithi203.stdout:8/863: fsync d4/d8/d1c/fab 0 2024-04-12T09:11:39.938 INFO:tasks.workunit.client.1.smithi203.stdout:0/970: mkdir d0/d125/d94/d2f/d17/d19/d6f/d78/dcd/d148 0 2024-04-12T09:11:39.939 INFO:tasks.workunit.client.1.smithi203.stdout:3/840: dwrite d2/d64/f6f [0,4194304] 0 2024-04-12T09:11:39.940 INFO:tasks.workunit.client.1.smithi203.stdout:1/949: sync 2024-04-12T09:11:39.943 INFO:tasks.workunit.client.1.smithi203.stdout:0/971: creat d0/d125/d94/d2f/d17/d19/d6f/d78/f149 x:0 0 0 2024-04-12T09:11:39.944 INFO:tasks.workunit.client.1.smithi203.stdout:3/841: readlink d2/d8/d14/d1b/l74 0 2024-04-12T09:11:39.944 INFO:tasks.workunit.client.1.smithi203.stdout:9/787: truncate d8/d12/d23/f3a 3244646 0 2024-04-12T09:11:39.949 INFO:tasks.workunit.client.1.smithi203.stdout:0/972: mkdir d0/d125/d94/d14a 0 2024-04-12T09:11:39.950 INFO:tasks.workunit.client.1.smithi203.stdout:3/842: dread d2/d64/f6f [0,4194304] 0 2024-04-12T09:11:39.951 INFO:tasks.workunit.client.1.smithi203.stdout:9/788: dwrite d8/d12/fad [0,4194304] 0 2024-04-12T09:11:39.952 INFO:tasks.workunit.client.1.smithi203.stdout:3/843: read d2/d8/d14/d23/d35/d4c/d5c/f34 [4204559,97295] 0 2024-04-12T09:11:39.959 INFO:tasks.workunit.client.1.smithi203.stdout:9/789: dwrite d8/d12/d23/d41/f78 [0,4194304] 0 2024-04-12T09:11:39.962 INFO:tasks.workunit.client.1.smithi203.stdout:0/973: mkdir d0/d14b 0 2024-04-12T09:11:39.964 INFO:tasks.workunit.client.1.smithi203.stdout:3/844: creat d2/d8/d14/d23/d35/d4c/d67/d86/f107 x:0 0 0 2024-04-12T09:11:39.969 INFO:tasks.workunit.client.1.smithi203.stdout:9/790: unlink d8/d12/d23/d38/d8a/d97/d9e/ca4 0 2024-04-12T09:11:39.975 INFO:tasks.workunit.client.1.smithi203.stdout:1/950: dread df/d2d/d6f/d75/d80/d54/d5d/d67/f8b [0,4194304] 0 2024-04-12T09:11:39.976 INFO:tasks.workunit.client.1.smithi203.stdout:9/791: unlink d8/f6b 0 2024-04-12T09:11:39.977 INFO:tasks.workunit.client.1.smithi203.stdout:0/974: mkdir d0/d125/d94/d2f/d14c 0 2024-04-12T09:11:39.981 INFO:tasks.workunit.client.1.smithi203.stdout:3/845: mknod d2/c108 0 2024-04-12T09:11:39.990 INFO:tasks.workunit.client.1.smithi203.stdout:4/947: sync 2024-04-12T09:11:39.990 INFO:tasks.workunit.client.1.smithi203.stdout:7/893: sync 2024-04-12T09:11:39.992 INFO:tasks.workunit.client.1.smithi203.stdout:3/846: dwrite d2/d8/d14/d23/d35/d4c/d5c/dc3/fc4 [4194304,4194304] 0 2024-04-12T09:11:39.992 INFO:tasks.workunit.client.1.smithi203.stdout:2/957: write d0/d3/f17 [4082753,63359] 0 2024-04-12T09:11:39.995 INFO:tasks.workunit.client.1.smithi203.stdout:7/894: truncate d0/d34/d7c/fe9 1933401 0 2024-04-12T09:11:39.998 INFO:tasks.workunit.client.1.smithi203.stdout:1/951: symlink df/d2d/d6f/d75/d80/d54/d5d/d58/dc5/l120 0 2024-04-12T09:11:40.000 INFO:tasks.workunit.client.1.smithi203.stdout:6/798: dwrite d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/db5/fc3 [0,4194304] 0 2024-04-12T09:11:40.006 INFO:tasks.workunit.client.1.smithi203.stdout:0/975: rename d0/d125/d94/d2f/d17/d19/c30 to d0/d48/d5e/dca/c14d 0 2024-04-12T09:11:40.010 INFO:tasks.workunit.client.1.smithi203.stdout:4/948: mkdir d1a/d21/d60/daa/dc5/d135 0 2024-04-12T09:11:40.012 INFO:tasks.workunit.client.1.smithi203.stdout:2/958: readlink d0/l6e 0 2024-04-12T09:11:40.015 INFO:tasks.workunit.client.1.smithi203.stdout:3/847: creat d2/d8/d14/d23/d35/d4c/d67/f109 x:0 0 0 2024-04-12T09:11:40.018 INFO:tasks.workunit.client.1.smithi203.stdout:5/986: truncate d0/d6/d16/d9/d80/df2/d104/f85 983275 0 2024-04-12T09:11:40.027 INFO:tasks.workunit.client.1.smithi203.stdout:5/987: dwrite d0/d6/d16/df8/d143/f152 [0,4194304] 0 2024-04-12T09:11:40.031 INFO:tasks.workunit.client.1.smithi203.stdout:2/959: symlink d0/d54/d61/d78/d89/l153 0 2024-04-12T09:11:40.035 INFO:tasks.workunit.client.1.smithi203.stdout:3/848: mkdir d2/d64/d8d/de6/d10a 0 2024-04-12T09:11:40.035 INFO:tasks.workunit.client.1.smithi203.stdout:8/864: truncate d4/d8/fd 5250908 0 2024-04-12T09:11:40.036 INFO:tasks.workunit.client.1.smithi203.stdout:8/865: write d4/f4b [525646,128957] 0 2024-04-12T09:11:40.038 INFO:tasks.workunit.client.1.smithi203.stdout:8/866: chown d4/d8/d1c/d5d/f94 17 1 2024-04-12T09:11:40.038 INFO:tasks.workunit.client.1.smithi203.stdout:8/867: chown d4/d8/d37/d57 18254290 1 2024-04-12T09:11:40.044 INFO:tasks.workunit.client.1.smithi203.stdout:1/952: dread df/d2d/fc2 [0,4194304] 0 2024-04-12T09:11:40.046 INFO:tasks.workunit.client.1.smithi203.stdout:4/949: creat d1a/d21/d60/daa/d103/f136 x:0 0 0 2024-04-12T09:11:40.053 INFO:tasks.workunit.client.1.smithi203.stdout:5/988: symlink d0/d6/d16/d44/dda/d140/df4/l15a 0 2024-04-12T09:11:40.054 INFO:tasks.workunit.client.1.smithi203.stdout:6/799: dread d1/df/d87/f9e [0,4194304] 0 2024-04-12T09:11:40.058 INFO:tasks.workunit.client.1.smithi203.stdout:1/953: write df/d2d/fc2 [1538238,42076] 0 2024-04-12T09:11:40.062 INFO:tasks.workunit.client.1.smithi203.stdout:0/976: truncate d0/d125/d94/d2f/f33 767750 0 2024-04-12T09:11:40.064 INFO:tasks.workunit.client.1.smithi203.stdout:1/954: fdatasync df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/fa8 0 2024-04-12T09:11:40.065 INFO:tasks.workunit.client.1.smithi203.stdout:1/955: chown df/dfb 246644 1 2024-04-12T09:11:40.066 INFO:tasks.workunit.client.1.smithi203.stdout:4/950: fdatasync d1a/d20/d5f/f64 0 2024-04-12T09:11:40.069 INFO:tasks.workunit.client.1.smithi203.stdout:0/977: dread d0/d125/d94/d2f/dc6/ff4 [0,4194304] 0 2024-04-12T09:11:40.070 INFO:tasks.workunit.client.1.smithi203.stdout:3/849: creat d2/d8/d14/d23/d35/d91/f10b x:0 0 0 2024-04-12T09:11:40.070 INFO:tasks.workunit.client.1.smithi203.stdout:6/800: mknod d1/d3/d5b/d8c/d3e/cf6 0 2024-04-12T09:11:40.070 INFO:tasks.workunit.client.1.smithi203.stdout:9/792: write d8/d12/d3e/fb4 [427192,91335] 0 2024-04-12T09:11:40.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:39 smithi203 ceph-mon[36428]: pgmap v30: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 78 MiB/s rd, 197 MiB/s wr, 413 op/s 2024-04-12T09:11:40.073 INFO:tasks.workunit.client.1.smithi203.stdout:6/801: fsync d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/db5/fc3 0 2024-04-12T09:11:40.074 INFO:tasks.workunit.client.1.smithi203.stdout:4/951: mknod d1a/d21/d22/d2e/d8d/d9b/ddf/c137 0 2024-04-12T09:11:40.075 INFO:tasks.workunit.client.1.smithi203.stdout:4/952: chown d1a/d21/da1/lb4 0 1 2024-04-12T09:11:40.076 INFO:tasks.workunit.client.1.smithi203.stdout:3/850: dwrite d2/d8/d14/d1b/d95/fb1 [0,4194304] 0 2024-04-12T09:11:40.077 INFO:tasks.workunit.client.1.smithi203.stdout:4/953: read d1a/d21/d22/d2e/f4b [3863682,87754] 0 2024-04-12T09:11:40.079 INFO:tasks.workunit.client.1.smithi203.stdout:0/978: rename d0/d125/d94/d2f/d17/d19/d6f/d78 to d0/d48/d5e/dca/dd6/d14e 0 2024-04-12T09:11:40.079 INFO:tasks.workunit.client.1.smithi203.stdout:7/895: write d0/d4/d53/fa5 [113826,10646] 0 2024-04-12T09:11:40.082 INFO:tasks.workunit.client.1.smithi203.stdout:4/954: dread - d1a/d20/d5d/d10c/f116 zero size 2024-04-12T09:11:40.083 INFO:tasks.workunit.client.1.smithi203.stdout:7/896: chown d0/d4/f43 6916313 1 2024-04-12T09:11:40.084 INFO:tasks.workunit.client.1.smithi203.stdout:0/979: chown d0/d48/d5e/dca/ff2 170 1 2024-04-12T09:11:40.084 INFO:tasks.workunit.client.1.smithi203.stdout:6/802: dwrite d1/d3/d26/d30/d4a/fd8 [0,4194304] 0 2024-04-12T09:11:40.091 INFO:tasks.workunit.client.1.smithi203.stdout:0/980: unlink d0/d48/f69 0 2024-04-12T09:11:40.099 INFO:tasks.workunit.client.1.smithi203.stdout:1/956: getdents df/d2d/d6f/d75/d80/d54/d5d/d90/dc7 0 2024-04-12T09:11:40.102 INFO:tasks.workunit.client.1.smithi203.stdout:2/960: write d0/d14/d74/f7d [972407,24122] 0 2024-04-12T09:11:40.106 INFO:tasks.workunit.client.1.smithi203.stdout:1/957: dwrite df/d2d/d6f/d75/f9e [0,4194304] 0 2024-04-12T09:11:40.111 INFO:tasks.workunit.client.1.smithi203.stdout:5/989: truncate d0/f21 1995644 0 2024-04-12T09:11:40.112 INFO:tasks.workunit.client.1.smithi203.stdout:3/851: dread d2/d8/d14/f90 [0,4194304] 0 2024-04-12T09:11:40.118 INFO:tasks.workunit.client.1.smithi203.stdout:2/961: read d0/d54/d61/d78/f81 [154444,42632] 0 2024-04-12T09:11:40.120 INFO:tasks.workunit.client.1.smithi203.stdout:3/852: creat d2/d8/d14/d45/df7/f10c x:0 0 0 2024-04-12T09:11:40.125 INFO:tasks.workunit.client.1.smithi203.stdout:6/803: dread d1/d3/d26/d30/d4a/f6f [0,4194304] 0 2024-04-12T09:11:40.130 INFO:tasks.workunit.client.1.smithi203.stdout:9/793: dwrite d8/d12/d23/d38/d8a/d97/d9e/d74/f86 [0,4194304] 0 2024-04-12T09:11:40.130 INFO:tasks.workunit.client.1.smithi203.stdout:3/853: dwrite d2/d8/d14/d1b/d2f/fd5 [0,4194304] 0 2024-04-12T09:11:40.130 INFO:tasks.workunit.client.1.smithi203.stdout:6/804: symlink d1/d3/d12/lf7 0 2024-04-12T09:11:40.133 INFO:tasks.workunit.client.1.smithi203.stdout:7/897: write d0/d4/d1c/d5b/dbf/dc3/fd7 [382924,41272] 0 2024-04-12T09:11:40.138 INFO:tasks.workunit.client.1.smithi203.stdout:0/981: dwrite d0/f4 [0,4194304] 0 2024-04-12T09:11:40.140 INFO:tasks.workunit.client.1.smithi203.stdout:6/805: mkdir d1/df/d65/dbc/df8 0 2024-04-12T09:11:40.142 INFO:tasks.workunit.client.1.smithi203.stdout:6/806: stat d1/d3/d26/d36 0 2024-04-12T09:11:40.142 INFO:tasks.workunit.client.1.smithi203.stdout:5/990: dread d0/d6/d11/d38/f147 [0,4194304] 0 2024-04-12T09:11:40.144 INFO:tasks.workunit.client.1.smithi203.stdout:6/807: chown d1/d3/d26/d30/d4a/d6c/d45/l7e 106240 1 2024-04-12T09:11:40.146 INFO:tasks.workunit.client.1.smithi203.stdout:0/982: dwrite d0/d125/d94/d2f/d4c/d7a/f141 [0,4194304] 0 2024-04-12T09:11:40.147 INFO:tasks.workunit.client.1.smithi203.stdout:3/854: rename d2/d8/d14/d23/l3c to d2/d8/d14/d23/d35/d4c/l10d 0 2024-04-12T09:11:40.147 INFO:tasks.workunit.client.1.smithi203.stdout:0/983: dread - d0/dd/d5b/f13b zero size 2024-04-12T09:11:40.148 INFO:tasks.workunit.client.1.smithi203.stdout:1/958: write df/d2d/d6f/d75/d80/d54/d5d/d67/f8b [2740156,39869] 0 2024-04-12T09:11:40.149 INFO:tasks.workunit.client.1.smithi203.stdout:8/868: sync 2024-04-12T09:11:40.152 INFO:tasks.workunit.client.1.smithi203.stdout:7/898: creat d0/d4/d54/da0/f126 x:0 0 0 2024-04-12T09:11:40.153 INFO:tasks.workunit.client.1.smithi203.stdout:2/962: write d0/d3/f10 [176977,57585] 0 2024-04-12T09:11:40.158 INFO:tasks.workunit.client.1.smithi203.stdout:8/869: dwrite d4/d8/d1c/d5d/da7/fff [0,4194304] 0 2024-04-12T09:11:40.159 INFO:tasks.workunit.client.1.smithi203.stdout:0/984: stat d0/d59/d5d/d79/l103 0 2024-04-12T09:11:40.160 INFO:tasks.workunit.client.1.smithi203.stdout:8/870: chown d4/d8/d74/d111 3573594 1 2024-04-12T09:11:40.160 INFO:tasks.workunit.client.1.smithi203.stdout:5/991: read d0/d6/d16/d44/dda/d140/f82 [851221,109391] 0 2024-04-12T09:11:40.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:39 smithi117 ceph-mon[29277]: pgmap v30: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 78 MiB/s rd, 197 MiB/s wr, 413 op/s 2024-04-12T09:11:40.164 INFO:tasks.workunit.client.1.smithi203.stdout:9/794: rename d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/l68 to d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/dca/l109 0 2024-04-12T09:11:40.166 INFO:tasks.workunit.client.1.smithi203.stdout:9/795: dread - d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/dca/ffc zero size 2024-04-12T09:11:40.169 INFO:tasks.workunit.client.1.smithi203.stdout:2/963: mkdir d0/d14/d1e/d57/d154 0 2024-04-12T09:11:40.172 INFO:tasks.workunit.client.1.smithi203.stdout:0/985: symlink d0/d48/d5e/dca/d101/l14f 0 2024-04-12T09:11:40.173 INFO:tasks.workunit.client.1.smithi203.stdout:8/871: unlink d4/d8/d1c/d5d/fad 0 2024-04-12T09:11:40.175 INFO:tasks.workunit.client.1.smithi203.stdout:3/855: symlink d2/d8/d14/d1b/d95/d92/d100/l10e 0 2024-04-12T09:11:40.176 INFO:tasks.workunit.client.1.smithi203.stdout:1/959: mknod df/d2d/d6f/d75/d80/d2b/c121 0 2024-04-12T09:11:40.177 INFO:tasks.workunit.client.1.smithi203.stdout:8/872: dread - d4/d8/d1c/d48/d5e/de8/fe5 zero size 2024-04-12T09:11:40.177 INFO:tasks.workunit.client.1.smithi203.stdout:3/856: readlink d2/d8/d14/d1b/d95/d92/d100/l10e 0 2024-04-12T09:11:40.185 INFO:tasks.workunit.client.1.smithi203.stdout:0/986: rename d0/d125/lab to d0/d125/d94/d2f/d17/d19/d6f/dcb/l150 0 2024-04-12T09:11:40.189 INFO:tasks.workunit.client.1.smithi203.stdout:3/857: mkdir d2/d8/d14/d45/d10f 0 2024-04-12T09:11:40.190 INFO:tasks.workunit.client.1.smithi203.stdout:3/858: chown d2/d8/d14/d1b/l74 62 1 2024-04-12T09:11:40.191 INFO:tasks.workunit.client.1.smithi203.stdout:6/808: dread d1/d3/d5b/d8c/d3e/da1/db1/fe0 [0,4194304] 0 2024-04-12T09:11:40.192 INFO:tasks.workunit.client.1.smithi203.stdout:4/955: sync 2024-04-12T09:11:40.193 INFO:tasks.workunit.client.1.smithi203.stdout:9/796: dread d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/f5a [0,4194304] 0 2024-04-12T09:11:40.193 INFO:tasks.workunit.client.1.smithi203.stdout:6/809: truncate d1/d3/d5b/d8c/d3e/da1/fe9 636937 0 2024-04-12T09:11:40.193 INFO:tasks.workunit.client.1.smithi203.stdout:1/960: creat df/d2d/d6f/d75/d80/d2b/d91/db8/f122 x:0 0 0 2024-04-12T09:11:40.193 INFO:tasks.workunit.client.1.smithi203.stdout:6/810: readlink d1/l80 0 2024-04-12T09:11:40.198 INFO:tasks.workunit.client.1.smithi203.stdout:6/811: dwrite d1/d3/f8f [0,4194304] 0 2024-04-12T09:11:40.203 INFO:tasks.workunit.client.1.smithi203.stdout:8/873: rename d4/d8/d1c/d5d/dc0/feb to d4/d8/d74/d78/f11e 0 2024-04-12T09:11:40.205 INFO:tasks.workunit.client.1.smithi203.stdout:3/859: creat d2/d8/d14/d45/f110 x:0 0 0 2024-04-12T09:11:40.206 INFO:tasks.workunit.client.1.smithi203.stdout:4/956: readlink d1a/d20/d5d/l90 0 2024-04-12T09:11:40.207 INFO:tasks.workunit.client.1.smithi203.stdout:9/797: chown d8/d12/d23/d85/ca6 1446 1 2024-04-12T09:11:40.209 INFO:tasks.workunit.client.1.smithi203.stdout:5/992: write d0/d6/d11/d38/f147 [781951,88465] 0 2024-04-12T09:11:40.209 INFO:tasks.workunit.client.1.smithi203.stdout:7/899: link d0/c10 d0/d15/d2d/df2/d108/c127 0 2024-04-12T09:11:40.211 INFO:tasks.workunit.client.1.smithi203.stdout:1/961: unlink df/d2d/d6f/d75/d80/d54/f3b 0 2024-04-12T09:11:40.212 INFO:tasks.workunit.client.1.smithi203.stdout:5/993: write d0/d6/d16/d9/f63 [2369685,64583] 0 2024-04-12T09:11:40.213 INFO:tasks.workunit.client.1.smithi203.stdout:3/860: dwrite d2/d51/fc5 [0,4194304] 0 2024-04-12T09:11:40.262 INFO:tasks.workunit.client.1.smithi203.stdout:0/987: link d0/dd/d5b/d90/f13d d0/dd/d5b/d90/dd3/d130/f151 0 2024-04-12T09:11:40.263 INFO:tasks.workunit.client.1.smithi203.stdout:6/812: creat d1/d3/d12/ff9 x:0 0 0 2024-04-12T09:11:40.264 INFO:tasks.workunit.client.1.smithi203.stdout:4/957: creat d1a/d20/f138 x:0 0 0 2024-04-12T09:11:40.268 INFO:tasks.workunit.client.1.smithi203.stdout:2/964: link d0/d3/f36 d0/d14/d142/f155 0 2024-04-12T09:11:40.270 INFO:tasks.workunit.client.1.smithi203.stdout:5/994: creat d0/d6/d11/dd3/d101/f15b x:0 0 0 2024-04-12T09:11:40.271 INFO:tasks.workunit.client.1.smithi203.stdout:1/962: symlink df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/d88/l123 0 2024-04-12T09:11:40.272 INFO:tasks.workunit.client.1.smithi203.stdout:0/988: mkdir d0/dd/d5b/d90/dd3/d152 0 2024-04-12T09:11:40.273 INFO:tasks.workunit.client.1.smithi203.stdout:8/874: mknod d4/d8/d81/db4/d107/c11f 0 2024-04-12T09:11:40.274 INFO:tasks.workunit.client.1.smithi203.stdout:8/875: write d4/f97 [2447319,93049] 0 2024-04-12T09:11:40.276 INFO:tasks.workunit.client.1.smithi203.stdout:4/958: rename d1a/d21/d60/d68/lb7 to d1a/d21/d22/d2e/d8d/d9b/l139 0 2024-04-12T09:11:40.279 INFO:tasks.workunit.client.1.smithi203.stdout:2/965: rmdir d0/d14/d1e/d2a/dcd/dfc/d9c 39 2024-04-12T09:11:40.281 INFO:tasks.workunit.client.1.smithi203.stdout:5/995: mkdir d0/d6/d16/df8/d143/d15c 0 2024-04-12T09:11:40.282 INFO:tasks.workunit.client.1.smithi203.stdout:5/996: dread - d0/d6/d11/d1e/f145 zero size 2024-04-12T09:11:40.286 INFO:tasks.workunit.client.1.smithi203.stdout:9/798: creat d8/d12/d23/f10a x:0 0 0 2024-04-12T09:11:40.287 INFO:tasks.workunit.client.1.smithi203.stdout:9/799: read d8/d3b/fc9 [979877,73839] 0 2024-04-12T09:11:40.288 INFO:tasks.workunit.client.1.smithi203.stdout:4/959: rmdir d1a/d34/de4 39 2024-04-12T09:11:40.288 INFO:tasks.workunit.client.1.smithi203.stdout:4/960: stat d1a/d21/d60/daa/d103/f136 0 2024-04-12T09:11:40.298 INFO:tasks.workunit.client.1.smithi203.stdout:0/989: mkdir d0/dd/d5b/d90/dd3/d130/d134/d153 0 2024-04-12T09:11:40.298 INFO:tasks.workunit.client.1.smithi203.stdout:4/961: chown f14 14745 1 2024-04-12T09:11:40.299 INFO:tasks.workunit.client.1.smithi203.stdout:7/900: getdents d0/d4/d53 0 2024-04-12T09:11:40.300 INFO:tasks.workunit.client.1.smithi203.stdout:4/962: stat d1a/d21/d22/l96 0 2024-04-12T09:11:40.301 INFO:tasks.workunit.client.1.smithi203.stdout:2/966: mkdir d0/d14/d1e/d2a/dcd/dfc/d156 0 2024-04-12T09:11:40.301 INFO:tasks.workunit.client.1.smithi203.stdout:6/813: link d1/d3/d26/d5d/cb2 d1/d3/d26/d9b/de2/de8/cfa 0 2024-04-12T09:11:40.302 INFO:tasks.workunit.client.1.smithi203.stdout:0/990: readlink d0/d125/d94/d2f/l64 0 2024-04-12T09:11:40.304 INFO:tasks.workunit.client.1.smithi203.stdout:5/997: dwrite d0/d6/d11/d18/d1a/d23/fa9 [0,4194304] 0 2024-04-12T09:11:40.304 INFO:tasks.workunit.client.1.smithi203.stdout:6/814: fsync d1/d3/d5b/d8c/d3e/da1/fc9 0 2024-04-12T09:11:40.305 INFO:tasks.workunit.client.1.smithi203.stdout:4/963: chown d1a/d20/d5d/d2c/f51 19377861 1 2024-04-12T09:11:40.305 INFO:tasks.workunit.client.1.smithi203.stdout:7/901: dread d0/d15/f63 [0,4194304] 0 2024-04-12T09:11:40.306 INFO:tasks.workunit.client.1.smithi203.stdout:2/967: symlink d0/d14/d1e/d57/d95/d12f/l157 0 2024-04-12T09:11:40.308 INFO:tasks.workunit.client.1.smithi203.stdout:5/998: write d0/d6/d16/d9/d30/d58/d74/d88/dbf/f13d [821996,4885] 0 2024-04-12T09:11:40.310 INFO:tasks.workunit.client.1.smithi203.stdout:7/902: chown d0/d4/d1c/d5b/f65 75 1 2024-04-12T09:11:40.316 INFO:tasks.workunit.client.1.smithi203.stdout:4/964: fdatasync d1a/d21/d22/d2e/fd4 0 2024-04-12T09:11:40.316 INFO:tasks.workunit.client.1.smithi203.stdout:7/903: dwrite d0/d4/d54/d75/f9b [0,4194304] 0 2024-04-12T09:11:40.318 INFO:tasks.workunit.client.1.smithi203.stdout:6/815: rename d1/d3/d91/cd1 to d1/df/dd3/cfb 0 2024-04-12T09:11:40.319 INFO:tasks.workunit.client.1.smithi203.stdout:2/968: creat d0/d14/d1e/d57/d95/dd6/d100/f158 x:0 0 0 2024-04-12T09:11:40.319 INFO:tasks.workunit.client.1.smithi203.stdout:6/816: readlink d1/d3/d5b/d8c/d3e/l95 0 2024-04-12T09:11:40.320 INFO:tasks.workunit.client.1.smithi203.stdout:3/861: write d2/d8/f85 [494782,63835] 0 2024-04-12T09:11:40.320 INFO:tasks.workunit.client.1.smithi203.stdout:2/969: dread - d0/d54/d61/d78/d89/fa2 zero size 2024-04-12T09:11:40.321 INFO:tasks.workunit.client.1.smithi203.stdout:5/999: mkdir d0/d6/d11/dd3/d15d 0 2024-04-12T09:11:40.331 INFO:tasks.workunit.client.1.smithi203.stdout:2/970: mkdir d0/d3/d8f/d98/d159 0 2024-04-12T09:11:40.333 INFO:tasks.workunit.client.1.smithi203.stdout:4/965: creat d1a/d21/d22/d2e/d8b/d113/f13a x:0 0 0 2024-04-12T09:11:40.335 INFO:tasks.workunit.client.1.smithi203.stdout:1/963: dwrite df/f76 [0,4194304] 0 2024-04-12T09:11:40.342 INFO:tasks.workunit.client.1.smithi203.stdout:4/966: unlink d1a/d1d/d69/c73 0 2024-04-12T09:11:40.344 INFO:tasks.workunit.client.1.smithi203.stdout:3/862: creat d2/d8/d14/d1b/d2f/f111 x:0 0 0 2024-04-12T09:11:40.347 INFO:tasks.workunit.client.1.smithi203.stdout:1/964: mkdir df/dfb/d124 0 2024-04-12T09:11:40.350 INFO:tasks.workunit.client.1.smithi203.stdout:1/965: read df/d2d/d6f/d75/d80/d2b/d91/ff5 [178598,18857] 0 2024-04-12T09:11:40.351 INFO:tasks.workunit.client.1.smithi203.stdout:0/991: dwrite d0/d48/fd4 [4194304,4194304] 0 2024-04-12T09:11:40.353 INFO:tasks.workunit.client.1.smithi203.stdout:0/992: stat d0/d125/d94/d2f/d17/dc9/de2 0 2024-04-12T09:11:40.353 INFO:tasks.workunit.client.1.smithi203.stdout:6/817: rmdir d1/d3/d91 39 2024-04-12T09:11:40.356 INFO:tasks.workunit.client.1.smithi203.stdout:3/863: creat d2/d8/d14/d45/dcb/f112 x:0 0 0 2024-04-12T09:11:40.357 INFO:tasks.workunit.client.1.smithi203.stdout:3/864: chown d2/d8/d14/d23/d35/d4c/d5c/fdd 3166 1 2024-04-12T09:11:40.358 INFO:tasks.workunit.client.1.smithi203.stdout:8/876: sync 2024-04-12T09:11:40.358 INFO:tasks.workunit.client.1.smithi203.stdout:9/800: sync 2024-04-12T09:11:40.359 INFO:tasks.workunit.client.1.smithi203.stdout:8/877: chown d4/d8/d1c 4601294 1 2024-04-12T09:11:40.362 INFO:tasks.workunit.client.1.smithi203.stdout:7/904: dwrite d0/d15/d2d/f4d [4194304,4194304] 0 2024-04-12T09:11:40.374 INFO:tasks.workunit.client.1.smithi203.stdout:2/971: dwrite d0/f1a [4194304,4194304] 0 2024-04-12T09:11:40.376 INFO:tasks.workunit.client.1.smithi203.stdout:2/972: readlink d0/d54/d61/db7/lea 0 2024-04-12T09:11:40.377 INFO:tasks.workunit.client.1.smithi203.stdout:8/878: truncate d4/d8/f1d 4484561 0 2024-04-12T09:11:40.380 INFO:tasks.workunit.client.1.smithi203.stdout:1/966: write df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/d88/f9f [536906,62431] 0 2024-04-12T09:11:40.380 INFO:tasks.workunit.client.1.smithi203.stdout:4/967: dwrite f14 [0,4194304] 0 2024-04-12T09:11:40.381 INFO:tasks.workunit.client.1.smithi203.stdout:6/818: creat d1/d3/d5b/d8c/d3e/da1/df1/ffc x:0 0 0 2024-04-12T09:11:40.381 INFO:tasks.workunit.client.1.smithi203.stdout:3/865: dread d2/f83 [0,4194304] 0 2024-04-12T09:11:40.394 INFO:tasks.workunit.client.1.smithi203.stdout:8/879: symlink d4/d8/d1c/d48/d5e/de8/l120 0 2024-04-12T09:11:40.398 INFO:tasks.workunit.client.1.smithi203.stdout:4/968: truncate d1a/d21/d22/d2e/fd4 1718528 0 2024-04-12T09:11:40.404 INFO:tasks.workunit.client.1.smithi203.stdout:7/905: truncate d0/d4/d54/da0/dff/d4c/fa6 919457 0 2024-04-12T09:11:40.404 INFO:tasks.workunit.client.1.smithi203.stdout:7/906: chown d0/d4/f43 151668427 1 2024-04-12T09:11:40.406 INFO:tasks.workunit.client.1.smithi203.stdout:0/993: link d0/d125/d94/d2f/d17/cdd d0/dd/d5b/d90/dd3/d130/d134/c154 0 2024-04-12T09:11:40.408 INFO:tasks.workunit.client.1.smithi203.stdout:2/973: symlink d0/d14/d142/l15a 0 2024-04-12T09:11:40.410 INFO:tasks.workunit.client.1.smithi203.stdout:6/819: unlink d1/df/d87/d7a/fe6 0 2024-04-12T09:11:40.411 INFO:tasks.workunit.client.1.smithi203.stdout:1/967: symlink df/d2d/d6f/d75/d80/d54/d5d/d58/l125 0 2024-04-12T09:11:40.418 INFO:tasks.workunit.client.1.smithi203.stdout:7/907: rmdir d0/d4/d1c/d5b 39 2024-04-12T09:11:40.421 INFO:tasks.workunit.client.1.smithi203.stdout:4/969: write d1a/d21/da1/fc0 [4831162,41435] 0 2024-04-12T09:11:40.422 INFO:tasks.workunit.client.1.smithi203.stdout:8/880: symlink d4/d8/d37/d57/l121 0 2024-04-12T09:11:40.423 INFO:tasks.workunit.client.1.smithi203.stdout:4/970: truncate d1a/d1d/d69/d76/dd6/ffd 4777257 0 2024-04-12T09:11:40.423 INFO:tasks.workunit.client.1.smithi203.stdout:3/866: truncate d2/d8/d14/d1b/f48 5329887 0 2024-04-12T09:11:40.424 INFO:tasks.workunit.client.1.smithi203.stdout:2/974: truncate d0/d67/f6c 653570 0 2024-04-12T09:11:40.425 INFO:tasks.workunit.client.1.smithi203.stdout:6/820: creat d1/d3/d5b/d8c/ffd x:0 0 0 2024-04-12T09:11:40.430 INFO:tasks.workunit.client.1.smithi203.stdout:3/867: dwrite d2/d8/d14/d1b/d2f/f111 [0,4194304] 0 2024-04-12T09:11:40.431 INFO:tasks.workunit.client.1.smithi203.stdout:1/968: dread df/d2d/d6f/d75/d80/d2b/d91/f100 [0,4194304] 0 2024-04-12T09:11:40.432 INFO:tasks.workunit.client.1.smithi203.stdout:8/881: mkdir d4/d8/d1c/d5d/d122 0 2024-04-12T09:11:40.433 INFO:tasks.workunit.client.1.smithi203.stdout:1/969: stat df/d2d/d6f/d75/d80/df3/c10d 0 2024-04-12T09:11:40.437 INFO:tasks.workunit.client.1.smithi203.stdout:1/970: fsync df/d2d/d6f/d75/d80/d54/d5d/d67/f109 0 2024-04-12T09:11:40.439 INFO:tasks.workunit.client.1.smithi203.stdout:4/971: dwrite f5 [8388608,4194304] 0 2024-04-12T09:11:40.442 INFO:tasks.workunit.client.1.smithi203.stdout:2/975: creat d0/d14/d142/f15b x:0 0 0 2024-04-12T09:11:40.442 INFO:tasks.workunit.client.1.smithi203.stdout:9/801: sync 2024-04-12T09:11:40.446 INFO:tasks.workunit.client.1.smithi203.stdout:8/882: dwrite d4/d8/d74/d111/d116/df2/f102 [0,4194304] 0 2024-04-12T09:11:40.448 INFO:tasks.workunit.client.1.smithi203.stdout:4/972: unlink d1a/d21/d22/l95 0 2024-04-12T09:11:40.449 INFO:tasks.workunit.client.1.smithi203.stdout:3/868: dread d2/d64/f80 [0,4194304] 0 2024-04-12T09:11:40.451 INFO:tasks.workunit.client.1.smithi203.stdout:4/973: chown d1a/d20/c5b 3093 1 2024-04-12T09:11:40.452 INFO:tasks.workunit.client.1.smithi203.stdout:4/974: chown d1a/d20/d5d 0 1 2024-04-12T09:11:40.453 INFO:tasks.workunit.client.1.smithi203.stdout:0/994: dwrite d0/d125/d94/d2f/d34/db1/fa5 [0,4194304] 0 2024-04-12T09:11:40.453 INFO:tasks.workunit.client.1.smithi203.stdout:7/908: rename d0/d4/d1c/f35 to d0/d4/d1c/f128 0 2024-04-12T09:11:40.457 INFO:tasks.workunit.client.1.smithi203.stdout:6/821: creat d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/d9c/def/ffe x:0 0 0 2024-04-12T09:11:40.460 INFO:tasks.workunit.client.1.smithi203.stdout:2/976: mkdir d0/d3/d8f/d10e/d15c 0 2024-04-12T09:11:40.462 INFO:tasks.workunit.client.1.smithi203.stdout:2/977: truncate d0/d3/d47/f102 775181 0 2024-04-12T09:11:40.463 INFO:tasks.workunit.client.1.smithi203.stdout:2/978: write d0/d3/d8f/d10e/f151 [198159,21561] 0 2024-04-12T09:11:40.464 INFO:tasks.workunit.client.1.smithi203.stdout:1/971: mkdir df/d2d/d6f/d75/d80/d54/d5d/d126 0 2024-04-12T09:11:40.466 INFO:tasks.workunit.client.1.smithi203.stdout:8/883: creat d4/d8/d81/d8e/f123 x:0 0 0 2024-04-12T09:11:40.470 INFO:tasks.workunit.client.1.smithi203.stdout:7/909: dread d0/d38/d79/fbd [0,4194304] 0 2024-04-12T09:11:40.470 INFO:tasks.workunit.client.1.smithi203.stdout:2/979: dwrite d0/d3/d8f/d98/f99 [4194304,4194304] 0 2024-04-12T09:11:40.470 INFO:tasks.workunit.client.1.smithi203.stdout:3/869: symlink d2/d8/def/l113 0 2024-04-12T09:11:40.474 INFO:tasks.workunit.client.1.smithi203.stdout:4/975: mknod d1a/d1d/c13b 0 2024-04-12T09:11:40.477 INFO:tasks.workunit.client.1.smithi203.stdout:9/802: dwrite d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/f5a [0,4194304] 0 2024-04-12T09:11:40.479 INFO:tasks.workunit.client.1.smithi203.stdout:0/995: rmdir d0/d125/d94/d2f/d4c/d7a 39 2024-04-12T09:11:40.480 INFO:tasks.workunit.client.1.smithi203.stdout:9/803: chown d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/f6a 28445215 1 2024-04-12T09:11:40.481 INFO:tasks.workunit.client.1.smithi203.stdout:3/870: dwrite d2/d8/d14/d23/d35/d4c/d5c/ff2 [0,4194304] 0 2024-04-12T09:11:40.487 INFO:tasks.workunit.client.1.smithi203.stdout:9/804: dread d8/d12/d3e/f84 [0,4194304] 0 2024-04-12T09:11:40.488 INFO:tasks.workunit.client.1.smithi203.stdout:0/996: dwrite d0/d125/f116 [0,4194304] 0 2024-04-12T09:11:40.489 INFO:tasks.workunit.client.1.smithi203.stdout:1/972: mknod df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/c127 0 2024-04-12T09:11:40.492 INFO:tasks.workunit.client.1.smithi203.stdout:8/884: write d4/d8/d74/d78/f2e [1455941,28518] 0 2024-04-12T09:11:40.506 INFO:tasks.workunit.client.1.smithi203.stdout:3/871: creat d2/d8/d14/d23/d35/d4c/d67/d86/f114 x:0 0 0 2024-04-12T09:11:40.509 INFO:tasks.workunit.client.1.smithi203.stdout:9/805: mknod d8/d12/d23/d85/c10b 0 2024-04-12T09:11:40.512 INFO:tasks.workunit.client.1.smithi203.stdout:7/910: fsync d0/d4/fe 0 2024-04-12T09:11:40.514 INFO:tasks.workunit.client.1.smithi203.stdout:8/885: rename d4/ddf/d100/c11b to d4/d8/d1c/d5d/dea/d11d/c124 0 2024-04-12T09:11:40.516 INFO:tasks.workunit.client.1.smithi203.stdout:2/980: write d0/d14/d1e/d2a/f5d [4129413,73970] 0 2024-04-12T09:11:40.517 INFO:tasks.workunit.client.1.smithi203.stdout:2/981: readlink d0/d14/d23/l80 0 2024-04-12T09:11:40.522 INFO:tasks.workunit.client.1.smithi203.stdout:3/872: symlink d2/d51/d65/l115 0 2024-04-12T09:11:40.522 INFO:tasks.workunit.client.1.smithi203.stdout:6/822: truncate d1/d3/d26/f79 2211702 0 2024-04-12T09:11:40.524 INFO:tasks.workunit.client.1.smithi203.stdout:0/997: mkdir d0/d125/d94/d2f/d34/d155 0 2024-04-12T09:11:40.527 INFO:tasks.workunit.client.1.smithi203.stdout:9/806: creat d8/d3b/dcd/f10c x:0 0 0 2024-04-12T09:11:40.527 INFO:tasks.workunit.client.1.smithi203.stdout:3/873: dwrite d2/d8/d14/d1b/d2f/fd5 [0,4194304] 0 2024-04-12T09:11:40.532 INFO:tasks.workunit.client.1.smithi203.stdout:8/886: fsync d4/d8/f42 0 2024-04-12T09:11:40.532 INFO:tasks.workunit.client.1.smithi203.stdout:8/887: write d4/d8/d81/db4/fe7 [1412190,100779] 0 2024-04-12T09:11:40.536 INFO:tasks.workunit.client.1.smithi203.stdout:2/982: unlink d0/d67/d86/dd9/d103/f14b 0 2024-04-12T09:11:40.537 INFO:tasks.workunit.client.1.smithi203.stdout:4/976: rmdir d1a/d21/d60/d108 0 2024-04-12T09:11:40.541 INFO:tasks.workunit.client.1.smithi203.stdout:0/998: symlink d0/d48/d5e/l156 0 2024-04-12T09:11:40.542 INFO:tasks.workunit.client.1.smithi203.stdout:3/874: mkdir d2/d8/d14/d45/df7/d116 0 2024-04-12T09:11:40.543 INFO:tasks.workunit.client.1.smithi203.stdout:7/911: symlink d0/d4/d54/da0/d100/l129 0 2024-04-12T09:11:40.547 INFO:tasks.workunit.client.1.smithi203.stdout:2/983: creat d0/d14/d1e/d57/da1/f15d x:0 0 0 2024-04-12T09:11:40.549 INFO:tasks.workunit.client.1.smithi203.stdout:4/977: creat d1a/d21/d60/daa/f13c x:0 0 0 2024-04-12T09:11:40.549 INFO:tasks.workunit.client.1.smithi203.stdout:7/912: dwrite d0/d4/d54/d75/dc0/ff7 [0,4194304] 0 2024-04-12T09:11:40.550 INFO:tasks.workunit.client.1.smithi203.stdout:7/913: dread - d0/d4/d54/d75/dc0/fb3 zero size 2024-04-12T09:11:40.554 INFO:tasks.workunit.client.1.smithi203.stdout:3/875: dread - d2/d8/d14/d45/fcc zero size 2024-04-12T09:11:40.559 INFO:tasks.workunit.client.1.smithi203.stdout:6/823: creat d1/d3/d26/fff x:0 0 0 2024-04-12T09:11:40.561 INFO:tasks.workunit.client.1.smithi203.stdout:7/914: truncate d0/d38/d79/fa7 520194 0 2024-04-12T09:11:40.565 INFO:tasks.workunit.client.1.smithi203.stdout:4/978: dwrite d1a/d21/d22/f109 [0,4194304] 0 2024-04-12T09:11:40.567 INFO:tasks.workunit.client.1.smithi203.stdout:7/915: mknod d0/d34/d7c/c12a 0 2024-04-12T09:11:40.568 INFO:tasks.workunit.client.1.smithi203.stdout:3/876: mknod d2/d8/d14/d1b/d2f/c117 0 2024-04-12T09:11:40.570 INFO:tasks.workunit.client.1.smithi203.stdout:8/888: link d4/d8/d74/d78/f54 d4/d8/f125 0 2024-04-12T09:11:40.571 INFO:tasks.workunit.client.1.smithi203.stdout:6/824: dread d1/f37 [0,4194304] 0 2024-04-12T09:11:40.577 INFO:tasks.workunit.client.1.smithi203.stdout:3/877: rename d2/d51 to d2/d8/d14/d45/dcb/d118 0 2024-04-12T09:11:40.577 INFO:tasks.workunit.client.1.smithi203.stdout:6/825: dwrite d1/d3/d26/f9a [0,4194304] 0 2024-04-12T09:11:40.578 INFO:tasks.workunit.client.1.smithi203.stdout:9/807: truncate d8/d12/d23/f71 190897 0 2024-04-12T09:11:40.580 INFO:tasks.workunit.client.1.smithi203.stdout:8/889: mkdir d4/d8/d81/db4/dbb/d126 0 2024-04-12T09:11:40.581 INFO:tasks.workunit.client.1.smithi203.stdout:0/999: write d0/dd/d5b/d90/f13d [22287,96648] 0 2024-04-12T09:11:40.583 INFO:tasks.workunit.client.1.smithi203.stdout:6/826: dread d1/d3/d26/f9a [0,4194304] 0 2024-04-12T09:11:40.584 INFO:tasks.workunit.client.1.smithi203.stdout:6/827: chown d1/d3/d12/lf7 16 1 2024-04-12T09:11:40.585 INFO:tasks.workunit.client.1.smithi203.stdout:7/916: link d0/d38/d51/fa4 d0/d4/d54/da0/f12b 0 2024-04-12T09:11:40.590 INFO:tasks.workunit.client.1.smithi203.stdout:1/973: sync 2024-04-12T09:11:40.590 INFO:tasks.workunit.client.1.smithi203.stdout:9/808: mknod d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/c10d 0 2024-04-12T09:11:40.590 INFO:tasks.workunit.client.1.smithi203.stdout:6/828: dwrite d1/d3/d5b/d8c/d3e/da1/fc9 [0,4194304] 0 2024-04-12T09:11:40.593 INFO:tasks.workunit.client.1.smithi203.stdout:3/878: rename d2/d8/d14/d23/d35/d91/f10b to d2/d64/d8d/de6/f119 0 2024-04-12T09:11:40.599 INFO:tasks.workunit.client.1.smithi203.stdout:3/879: dwrite d2/d8/d14/d23/d35/d4c/fc2 [0,4194304] 0 2024-04-12T09:11:40.602 INFO:tasks.workunit.client.1.smithi203.stdout:8/890: read d4/d8/f24 [801716,112282] 0 2024-04-12T09:11:40.603 INFO:tasks.workunit.client.1.smithi203.stdout:4/979: dwrite d1a/d1d/faf [0,4194304] 0 2024-04-12T09:11:40.606 INFO:tasks.workunit.client.1.smithi203.stdout:8/891: truncate d4/d8/f117 127236 0 2024-04-12T09:11:40.616 INFO:tasks.workunit.client.1.smithi203.stdout:1/974: mkdir df/d2d/d6f/d75/d80/d54/d5d/d58/d94/d128 0 2024-04-12T09:11:40.621 INFO:tasks.workunit.client.1.smithi203.stdout:7/917: dread d0/d38/d51/f10a [0,4194304] 0 2024-04-12T09:11:40.622 INFO:tasks.workunit.client.1.smithi203.stdout:7/918: write d0/d4/d54/dac/f10f [27738,15416] 0 2024-04-12T09:11:40.624 INFO:tasks.workunit.client.1.smithi203.stdout:6/829: write d1/d3/d4/fae [319312,126767] 0 2024-04-12T09:11:40.626 INFO:tasks.workunit.client.1.smithi203.stdout:8/892: symlink d4/d8/d81/db4/dbb/d10d/l127 0 2024-04-12T09:11:40.628 INFO:tasks.workunit.client.1.smithi203.stdout:1/975: rmdir df/d2d/d6f/d75/d80/d54/d5d/d67 39 2024-04-12T09:11:40.629 INFO:tasks.workunit.client.1.smithi203.stdout:9/809: mkdir d8/d12/d23/d38/d8a/d97/d9e/d74/dc7/d10e 0 2024-04-12T09:11:40.629 INFO:tasks.workunit.client.1.smithi203.stdout:3/880: dwrite d2/d8/d14/d1b/d95/fca [0,4194304] 0 2024-04-12T09:11:40.630 INFO:tasks.workunit.client.1.smithi203.stdout:9/810: stat d8/d12/d23/fd7 0 2024-04-12T09:11:40.630 INFO:tasks.workunit.client.1.smithi203.stdout:3/881: write d2/d8/fa2 [2176462,34629] 0 2024-04-12T09:11:40.634 INFO:tasks.workunit.client.1.smithi203.stdout:1/976: dread df/d2d/fb6 [0,4194304] 0 2024-04-12T09:11:40.635 INFO:tasks.workunit.client.1.smithi203.stdout:1/977: dread - df/d2d/d6f/d75/d80/d54/ffe zero size 2024-04-12T09:11:40.635 INFO:tasks.workunit.client.1.smithi203.stdout:6/830: creat d1/df/d87/d7a/f100 x:0 0 0 2024-04-12T09:11:40.636 INFO:tasks.workunit.client.1.smithi203.stdout:1/978: write df/d2d/f68 [1948961,13802] 0 2024-04-12T09:11:40.639 INFO:tasks.workunit.client.1.smithi203.stdout:8/893: truncate d4/d8/d81/d84/f109 582431 0 2024-04-12T09:11:40.640 INFO:tasks.workunit.client.1.smithi203.stdout:8/894: truncate d4/d8/d1c/fab 4272784 0 2024-04-12T09:11:40.645 INFO:tasks.workunit.client.1.smithi203.stdout:6/831: truncate d1/d3/f27 589036 0 2024-04-12T09:11:40.646 INFO:tasks.workunit.client.1.smithi203.stdout:1/979: truncate df/f33 2131729 0 2024-04-12T09:11:40.649 INFO:tasks.workunit.client.1.smithi203.stdout:9/811: link d8/d12/f81 d8/d12/d23/d27/f10f 0 2024-04-12T09:11:40.652 INFO:tasks.workunit.client.1.smithi203.stdout:2/984: sync 2024-04-12T09:11:40.653 INFO:tasks.workunit.client.1.smithi203.stdout:7/919: write d0/d4/d54/da0/dff/f3f [1103958,36420] 0 2024-04-12T09:11:40.656 INFO:tasks.workunit.client.1.smithi203.stdout:1/980: mknod df/d2d/d6f/d75/d80/d54/d5d/d90/dc7/d107/c129 0 2024-04-12T09:11:40.659 INFO:tasks.workunit.client.1.smithi203.stdout:6/832: dread d1/d3/d26/d30/d4a/d6c/f44 [0,4194304] 0 2024-04-12T09:11:40.663 INFO:tasks.workunit.client.1.smithi203.stdout:6/833: dread d1/d3/d26/d30/d4a/fd8 [0,4194304] 0 2024-04-12T09:11:40.668 INFO:tasks.workunit.client.1.smithi203.stdout:9/812: link d8/d12/d23/d85/f1f d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d40/f110 0 2024-04-12T09:11:40.671 INFO:tasks.workunit.client.1.smithi203.stdout:3/882: rename d2/d8/d14/f2c to d2/d8/f11a 0 2024-04-12T09:11:40.673 INFO:tasks.workunit.client.1.smithi203.stdout:3/883: fsync d2/d8/d14/d45/dcb/d118/dbc/ff1 0 2024-04-12T09:11:40.676 INFO:tasks.workunit.client.1.smithi203.stdout:4/980: sync 2024-04-12T09:11:40.677 INFO:tasks.workunit.client.1.smithi203.stdout:3/884: dwrite d2/f2b [0,4194304] 0 2024-04-12T09:11:40.683 INFO:tasks.workunit.client.1.smithi203.stdout:2/985: dwrite d0/d38/fe9 [0,4194304] 0 2024-04-12T09:11:40.686 INFO:tasks.workunit.client.1.smithi203.stdout:6/834: mkdir d1/d3/d26/d9b/de2/de8/d101 0 2024-04-12T09:11:40.689 INFO:tasks.workunit.client.1.smithi203.stdout:4/981: creat d1a/d1d/d69/f13d x:0 0 0 2024-04-12T09:11:40.694 INFO:tasks.workunit.client.1.smithi203.stdout:2/986: creat d0/d14/d1e/d57/da1/f15e x:0 0 0 2024-04-12T09:11:40.694 INFO:tasks.workunit.client.1.smithi203.stdout:7/920: getdents d0/d4/d53/dde 0 2024-04-12T09:11:40.697 INFO:tasks.workunit.client.1.smithi203.stdout:1/981: link df/d2d/d6f/d75/d80/d8c/ld2 df/d2d/d6f/d75/d80/d54/d5d/d67/l12a 0 2024-04-12T09:11:40.698 INFO:tasks.workunit.client.1.smithi203.stdout:1/982: write df/d2d/d6f/d75/d80/f26 [937068,41164] 0 2024-04-12T09:11:40.700 INFO:tasks.workunit.client.1.smithi203.stdout:8/895: rename d4/d8/d81/db4 to d4/d8/d37/d57/d128 0 2024-04-12T09:11:40.700 INFO:tasks.workunit.client.1.smithi203.stdout:2/987: creat d0/d14/d142/f15f x:0 0 0 2024-04-12T09:11:40.701 INFO:tasks.workunit.client.1.smithi203.stdout:2/988: fsync d0/d14/d1e/d2a/f5d 0 2024-04-12T09:11:40.702 INFO:tasks.workunit.client.1.smithi203.stdout:6/835: unlink d1/d3/d26/d30/d4a/d6c/d45/d55/d77/c2e 0 2024-04-12T09:11:40.703 INFO:tasks.workunit.client.1.smithi203.stdout:9/813: creat d8/d3b/db7/f111 x:0 0 0 2024-04-12T09:11:40.704 INFO:tasks.workunit.client.1.smithi203.stdout:3/885: creat d2/d8/f11b x:0 0 0 2024-04-12T09:11:40.707 INFO:tasks.workunit.client.1.smithi203.stdout:8/896: read d4/d8/d1c/d5d/dc0/fd5 [257057,77350] 0 2024-04-12T09:11:40.712 INFO:tasks.workunit.client.1.smithi203.stdout:4/982: dread f5 [4194304,4194304] 0 2024-04-12T09:11:40.721 INFO:tasks.workunit.client.1.smithi203.stdout:8/897: stat d4/d8/d37/f98 0 2024-04-12T09:11:40.721 INFO:tasks.workunit.client.1.smithi203.stdout:8/898: write d4/d8/d1c/d5d/ffe [5655986,72034] 0 2024-04-12T09:11:40.722 INFO:tasks.workunit.client.1.smithi203.stdout:3/886: write d2/d8/d14/f40 [4723247,3528] 0 2024-04-12T09:11:40.723 INFO:tasks.workunit.client.1.smithi203.stdout:8/899: write d4/d8/d1c/f82 [2449266,56938] 0 2024-04-12T09:11:40.723 INFO:tasks.workunit.client.1.smithi203.stdout:2/989: mknod d0/d3/d8e/c160 0 2024-04-12T09:11:40.724 INFO:tasks.workunit.client.1.smithi203.stdout:1/983: write df/d2d/f32 [1781858,99390] 0 2024-04-12T09:11:40.725 INFO:tasks.workunit.client.1.smithi203.stdout:2/990: stat d0/d14/d1e 0 2024-04-12T09:11:40.726 INFO:tasks.workunit.client.1.smithi203.stdout:6/836: link d1/d3/d26/d30/d4a/d6c/d45/f52 d1/d3/d26/d30/d4a/d6c/d45/d55/d77/dda/f102 0 2024-04-12T09:11:40.729 INFO:tasks.workunit.client.1.smithi203.stdout:9/814: write d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d40/f110 [4388765,121144] 0 2024-04-12T09:11:40.730 INFO:tasks.workunit.client.1.smithi203.stdout:9/815: chown d8/d12/d23/c65 3633 1 2024-04-12T09:11:40.730 INFO:tasks.workunit.client.1.smithi203.stdout:1/984: dwrite df/d2d/f32 [0,4194304] 0 2024-04-12T09:11:40.732 INFO:tasks.workunit.client.1.smithi203.stdout:7/921: rmdir d0/d4/d1c/d5b/dbf/d11d 0 2024-04-12T09:11:40.732 INFO:tasks.workunit.client.1.smithi203.stdout:9/816: readlink d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/l67 0 2024-04-12T09:11:40.732 INFO:tasks.workunit.client.1.smithi203.stdout:3/887: fsync d2/d8/d14/f90 0 2024-04-12T09:11:40.734 INFO:tasks.workunit.client.1.smithi203.stdout:8/900: mkdir d4/ddf/d100/d129 0 2024-04-12T09:11:40.734 INFO:tasks.workunit.client.1.smithi203.stdout:9/817: write d8/d12/d23/d38/fd9 [399043,10904] 0 2024-04-12T09:11:40.736 INFO:tasks.workunit.client.1.smithi203.stdout:7/922: read d0/d4/d53/fa5 [3631921,9292] 0 2024-04-12T09:11:40.746 INFO:tasks.workunit.client.1.smithi203.stdout:9/818: chown d8/d12/d23/d38/d8a/d97/d9e/c9b 42816042 1 2024-04-12T09:11:40.747 INFO:tasks.workunit.client.1.smithi203.stdout:9/819: readlink d8/d12/d23/d41/l64 0 2024-04-12T09:11:40.750 INFO:tasks.workunit.client.1.smithi203.stdout:4/983: link d1a/d21/d22/d2e/d8d/db8/l11d d1a/d21/d60/daa/df0/l13e 0 2024-04-12T09:11:40.757 INFO:tasks.workunit.client.1.smithi203.stdout:9/820: read d8/f2a [871132,90776] 0 2024-04-12T09:11:40.758 INFO:tasks.workunit.client.1.smithi203.stdout:9/821: readlink d8/l3f 0 2024-04-12T09:11:40.761 INFO:tasks.workunit.client.1.smithi203.stdout:2/991: link d0/d3/f8 d0/d14/d23/d33/f161 0 2024-04-12T09:11:40.763 INFO:tasks.workunit.client.1.smithi203.stdout:8/901: dread d4/d8/d74/d78/d53/d8f/fe1 [0,4194304] 0 2024-04-12T09:11:40.765 INFO:tasks.workunit.client.1.smithi203.stdout:2/992: creat d0/d14/d8a/f162 x:0 0 0 2024-04-12T09:11:40.768 INFO:tasks.workunit.client.1.smithi203.stdout:7/923: write d0/d4/d54/da0/d106/f74 [4456472,61623] 0 2024-04-12T09:11:40.769 INFO:tasks.workunit.client.1.smithi203.stdout:9/822: dwrite d8/d12/d23/d85/de1/de6/f102 [0,4194304] 0 2024-04-12T09:11:40.778 INFO:tasks.workunit.client.1.smithi203.stdout:6/837: dwrite d1/d3/d5b/d8c/f23 [0,4194304] 0 2024-04-12T09:11:40.778 INFO:tasks.workunit.client.1.smithi203.stdout:4/984: dwrite d1a/d20/d5d/d2c/d72/f11e [0,4194304] 0 2024-04-12T09:11:40.778 INFO:tasks.workunit.client.1.smithi203.stdout:7/924: mknod d0/d38/d79/c12c 0 2024-04-12T09:11:40.781 INFO:tasks.workunit.client.1.smithi203.stdout:1/985: dwrite df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/fa8 [0,4194304] 0 2024-04-12T09:11:40.782 INFO:tasks.workunit.client.1.smithi203.stdout:3/888: dwrite d2/d8/f33 [0,4194304] 0 2024-04-12T09:11:40.785 INFO:tasks.workunit.client.1.smithi203.stdout:6/838: dread d1/d3/f29 [0,4194304] 0 2024-04-12T09:11:40.786 INFO:tasks.workunit.client.1.smithi203.stdout:8/902: rename d4/d8/d1c/d48/d5e/c8a to d4/d8/d1c/d5d/dea/d11d/c12a 0 2024-04-12T09:11:40.789 INFO:tasks.workunit.client.1.smithi203.stdout:9/823: dwrite d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/dca/ffc [0,4194304] 0 2024-04-12T09:11:40.791 INFO:tasks.workunit.client.1.smithi203.stdout:1/986: creat df/dfb/f12b x:0 0 0 2024-04-12T09:11:40.796 INFO:tasks.workunit.client.1.smithi203.stdout:2/993: rename d0/d38/c49 to d0/d38/c163 0 2024-04-12T09:11:40.801 INFO:tasks.workunit.client.1.smithi203.stdout:3/889: unlink d2/d8/f39 0 2024-04-12T09:11:40.804 INFO:tasks.workunit.client.1.smithi203.stdout:8/903: rename d4/d8/d1c/d5d/f60 to d4/ddf/d100/d129/f12b 0 2024-04-12T09:11:40.805 INFO:tasks.workunit.client.1.smithi203.stdout:8/904: chown d4/d8/d37/d57/d128/dbb 4846 1 2024-04-12T09:11:40.807 INFO:tasks.workunit.client.1.smithi203.stdout:9/824: mkdir d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/da9/d112 0 2024-04-12T09:11:40.813 INFO:tasks.workunit.client.1.smithi203.stdout:8/905: unlink d4/d8/d74/d78/f27 0 2024-04-12T09:11:40.813 INFO:tasks.workunit.client.1.smithi203.stdout:8/906: stat d4/d8/d1c/d5d/lc8 0 2024-04-12T09:11:40.814 INFO:tasks.workunit.client.1.smithi203.stdout:9/825: truncate d8/f28 473953 0 2024-04-12T09:11:40.815 INFO:tasks.workunit.client.1.smithi203.stdout:4/985: getdents d1a/d21/da1 0 2024-04-12T09:11:40.816 INFO:tasks.workunit.client.1.smithi203.stdout:7/925: getdents d0/d4/d1c 0 2024-04-12T09:11:40.817 INFO:tasks.workunit.client.1.smithi203.stdout:3/890: fdatasync d2/d8/d14/d1b/d95/d92/fec 0 2024-04-12T09:11:40.818 INFO:tasks.workunit.client.1.smithi203.stdout:6/839: link d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/db5/fe4 d1/d3/d26/dcb/f103 0 2024-04-12T09:11:40.819 INFO:tasks.workunit.client.1.smithi203.stdout:6/840: chown d1/d3/d26/d30/d4a/d6c/d45/d55/d77/cd6 47560 1 2024-04-12T09:11:40.819 INFO:tasks.workunit.client.1.smithi203.stdout:8/907: unlink d4/d8/d74/d78/d53/f72 0 2024-04-12T09:11:40.820 INFO:tasks.workunit.client.1.smithi203.stdout:4/986: creat d1a/d21/d60/d68/dbe/f13f x:0 0 0 2024-04-12T09:11:40.821 INFO:tasks.workunit.client.1.smithi203.stdout:9/826: rmdir d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d40 39 2024-04-12T09:11:40.822 INFO:tasks.workunit.client.1.smithi203.stdout:9/827: chown d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/dfb/cfd 61202390 1 2024-04-12T09:11:40.823 INFO:tasks.workunit.client.1.smithi203.stdout:9/828: readlink d8/d12/d23/l92 0 2024-04-12T09:11:40.824 INFO:tasks.workunit.client.1.smithi203.stdout:3/891: rename d2/d8/d14/d45/dcb/d118/l58 to d2/d8/d14/d45/dcb/d118/dbc/l11c 0 2024-04-12T09:11:40.825 INFO:tasks.workunit.client.1.smithi203.stdout:8/908: rmdir d4/d8/d37/d57/d7d 39 2024-04-12T09:11:40.827 INFO:tasks.workunit.client.1.smithi203.stdout:8/909: truncate d4/d8/d74/d78/f11e 960374 0 2024-04-12T09:11:40.827 INFO:tasks.workunit.client.1.smithi203.stdout:4/987: symlink d1a/d21/d60/daa/dc5/ddc/l140 0 2024-04-12T09:11:40.828 INFO:tasks.workunit.client.1.smithi203.stdout:7/926: creat d0/d15/d2d/dec/f12d x:0 0 0 2024-04-12T09:11:40.834 INFO:tasks.workunit.client.1.smithi203.stdout:4/988: rename d1a/d21/d22/d2e/d8d/db8/ldb to d1a/d21/d22/d2e/d8d/d9b/l141 0 2024-04-12T09:11:40.836 INFO:tasks.workunit.client.1.smithi203.stdout:4/989: creat d1a/d21/d22/d2e/d8d/f142 x:0 0 0 2024-04-12T09:11:40.837 INFO:tasks.workunit.client.1.smithi203.stdout:1/987: write df/f16 [344702,102612] 0 2024-04-12T09:11:40.837 INFO:tasks.workunit.client.1.smithi203.stdout:2/994: write d0/d14/d23/d3d/f111 [384047,41609] 0 2024-04-12T09:11:40.839 INFO:tasks.workunit.client.1.smithi203.stdout:8/910: dread d4/d8/d74/d78/f25 [0,4194304] 0 2024-04-12T09:11:40.840 INFO:tasks.workunit.client.1.smithi203.stdout:2/995: write d0/d67/d86/dd9/dfd/f112 [517900,25516] 0 2024-04-12T09:11:40.840 INFO:tasks.workunit.client.1.smithi203.stdout:8/911: readlink d4/d8/d81/d8e/l91 0 2024-04-12T09:11:40.843 INFO:tasks.workunit.client.1.smithi203.stdout:9/829: dread d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/feb [0,4194304] 0 2024-04-12T09:11:40.845 INFO:tasks.workunit.client.1.smithi203.stdout:8/912: rmdir d4/d8/d37 39 2024-04-12T09:11:40.845 INFO:tasks.workunit.client.1.smithi203.stdout:9/830: chown d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/f5c 290854845 1 2024-04-12T09:11:40.847 INFO:tasks.workunit.client.1.smithi203.stdout:2/996: dwrite d0/d14/d8a/dca/d141/f145 [0,4194304] 0 2024-04-12T09:11:40.849 INFO:tasks.workunit.client.1.smithi203.stdout:1/988: symlink df/d59/l12c 0 2024-04-12T09:11:40.851 INFO:tasks.workunit.client.1.smithi203.stdout:1/989: write df/d2d/d6d/f105 [687599,127178] 0 2024-04-12T09:11:40.853 INFO:tasks.workunit.client.1.smithi203.stdout:8/913: rmdir d4/d8/d1c/d5d/dea/d11d 39 2024-04-12T09:11:40.855 INFO:tasks.workunit.client.1.smithi203.stdout:1/990: write df/d2d/d6f/d75/d80/d54/d5d/d67/f8b [944157,112078] 0 2024-04-12T09:11:40.858 INFO:tasks.workunit.client.1.smithi203.stdout:2/997: read d0/d14/d1e/d2a/dcd/dfc/d9c/f13e [344404,94998] 0 2024-04-12T09:11:40.859 INFO:tasks.workunit.client.1.smithi203.stdout:6/841: dwrite d1/d3/d26/d30/d4a/d6c/d45/d55/f71 [0,4194304] 0 2024-04-12T09:11:40.860 INFO:tasks.workunit.client.1.smithi203.stdout:7/927: write d0/d4/ff1 [224363,90678] 0 2024-04-12T09:11:40.862 INFO:tasks.workunit.client.1.smithi203.stdout:6/842: dread - d1/df/dd3/fde zero size 2024-04-12T09:11:40.866 INFO:tasks.workunit.client.1.smithi203.stdout:8/914: write d4/d8/d74/d78/d53/d8f/fe1 [765633,1567] 0 2024-04-12T09:11:40.866 INFO:tasks.workunit.client.1.smithi203.stdout:4/990: dread d1a/d21/d22/d2e/f6f [0,4194304] 0 2024-04-12T09:11:40.867 INFO:tasks.workunit.client.1.smithi203.stdout:1/991: rmdir df/d2d/d6f/d75/d80/d54/d5d 39 2024-04-12T09:11:40.868 INFO:tasks.workunit.client.1.smithi203.stdout:3/892: dwrite d2/d8/d14/d23/d35/d91/f5b [0,4194304] 0 2024-04-12T09:11:40.869 INFO:tasks.workunit.client.1.smithi203.stdout:2/998: write d0/fc [342664,113906] 0 2024-04-12T09:11:40.870 INFO:tasks.workunit.client.1.smithi203.stdout:4/991: write d1a/d21/d60/fa6 [4762309,23397] 0 2024-04-12T09:11:40.871 INFO:tasks.workunit.client.1.smithi203.stdout:7/928: write d0/d4/d54/d75/f9a [2341186,128447] 0 2024-04-12T09:11:40.872 INFO:tasks.workunit.client.1.smithi203.stdout:3/893: fdatasync d2/d8/d14/f40 0 2024-04-12T09:11:40.875 INFO:tasks.workunit.client.1.smithi203.stdout:7/929: read - d0/d4/d54/da0/f126 zero size 2024-04-12T09:11:40.876 INFO:tasks.workunit.client.1.smithi203.stdout:6/843: mkdir d1/d3/d5b/d8c/d3e/da1/d104 0 2024-04-12T09:11:40.876 INFO:tasks.workunit.client.1.smithi203.stdout:1/992: truncate df/d2d/d6f/d75/d80/f10f 518783 0 2024-04-12T09:11:40.882 INFO:tasks.workunit.client.1.smithi203.stdout:2/999: mknod d0/d14/d23/d3d/c164 0 2024-04-12T09:11:40.882 INFO:tasks.workunit.client.1.smithi203.stdout:4/992: dwrite d1a/d20/fab [0,4194304] 0 2024-04-12T09:11:40.882 INFO:tasks.workunit.client.1.smithi203.stdout:9/831: dwrite d8/f58 [0,4194304] 0 2024-04-12T09:11:40.886 INFO:tasks.workunit.client.1.smithi203.stdout:8/915: creat d4/d8/d81/d84/dfc/f12c x:0 0 0 2024-04-12T09:11:40.886 INFO:tasks.workunit.client.1.smithi203.stdout:6/844: write d1/f37 [1127099,17180] 0 2024-04-12T09:11:40.890 INFO:tasks.workunit.client.1.smithi203.stdout:1/993: unlink df/d2d/d6f/d75/d80/d2b/l38 0 2024-04-12T09:11:40.893 INFO:tasks.workunit.client.1.smithi203.stdout:4/993: creat d1a/d21/d22/d2e/d8d/db8/f143 x:0 0 0 2024-04-12T09:11:40.899 INFO:tasks.workunit.client.1.smithi203.stdout:6/845: creat d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d3a/f105 x:0 0 0 2024-04-12T09:11:40.902 INFO:tasks.workunit.client.1.smithi203.stdout:4/994: unlink d1a/d2b/feb 0 2024-04-12T09:11:40.905 INFO:tasks.workunit.client.1.smithi203.stdout:6/846: rmdir d1/d3/d26/d30/d4a/d6c/d45/d55/d90 39 2024-04-12T09:11:40.906 INFO:tasks.workunit.client.1.smithi203.stdout:1/994: dwrite df/d2d/d6f/d75/d80/d54/d5d/d58/d7f/fa8 [4194304,4194304] 0 2024-04-12T09:11:40.910 INFO:tasks.workunit.client.1.smithi203.stdout:4/995: dread d1a/d1d/fb6 [0,4194304] 0 2024-04-12T09:11:40.910 INFO:tasks.workunit.client.1.smithi203.stdout:6/847: creat d1/df/dd3/f106 x:0 0 0 2024-04-12T09:11:40.911 INFO:tasks.workunit.client.1.smithi203.stdout:6/848: chown d1/df/d87 0 1 2024-04-12T09:11:40.911 INFO:tasks.workunit.client.1.smithi203.stdout:1/995: symlink df/dfb/l12d 0 2024-04-12T09:11:40.914 INFO:tasks.workunit.client.1.smithi203.stdout:1/996: fdatasync df/d2d/d6f/d75/d80/d54/d5d/d58/fba 0 2024-04-12T09:11:40.919 INFO:tasks.workunit.client.1.smithi203.stdout:4/996: truncate d1a/d21/d22/d2e/d8b/f99 722689 0 2024-04-12T09:11:40.920 INFO:tasks.workunit.client.1.smithi203.stdout:1/997: unlink ca 0 2024-04-12T09:11:40.923 INFO:tasks.workunit.client.1.smithi203.stdout:9/832: dread d8/d12/d23/d38/d8a/d97/d9e/d74/f86 [0,4194304] 0 2024-04-12T09:11:40.924 INFO:tasks.workunit.client.1.smithi203.stdout:9/833: write d8/fb [2481957,117819] 0 2024-04-12T09:11:40.925 INFO:tasks.workunit.client.1.smithi203.stdout:7/930: dwrite d0/d38/d79/fbd [0,4194304] 0 2024-04-12T09:11:40.930 INFO:tasks.workunit.client.1.smithi203.stdout:3/894: truncate d2/d8/d14/d1b/d95/fb1 1013559 0 2024-04-12T09:11:40.932 INFO:tasks.workunit.client.1.smithi203.stdout:6/849: dread d1/d3/d26/d30/d4a/f7d [0,4194304] 0 2024-04-12T09:11:40.932 INFO:tasks.workunit.client.1.smithi203.stdout:1/998: dread df/d2d/d6f/d75/d80/f74 [0,4194304] 0 2024-04-12T09:11:40.933 INFO:tasks.workunit.client.1.smithi203.stdout:7/931: truncate d0/d38/d51/f7d 110951 0 2024-04-12T09:11:40.934 INFO:tasks.workunit.client.1.smithi203.stdout:4/997: unlink d1a/d21/d22/d2e/d78/ca7 0 2024-04-12T09:11:40.936 INFO:tasks.workunit.client.1.smithi203.stdout:3/895: mkdir d2/d8/d14/d45/dcb/d118/dbc/d11d 0 2024-04-12T09:11:40.937 INFO:tasks.workunit.client.1.smithi203.stdout:6/850: creat d1/d3/d26/dcb/f107 x:0 0 0 2024-04-12T09:11:40.939 INFO:tasks.workunit.client.1.smithi203.stdout:9/834: dwrite d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d40/fef [0,4194304] 0 2024-04-12T09:11:40.939 INFO:tasks.workunit.client.1.smithi203.stdout:1/999: mkdir df/d2d/d6f/d75/d80/d54/d5d/d90/d12e 0 2024-04-12T09:11:40.941 INFO:tasks.workunit.client.1.smithi203.stdout:4/998: creat d1a/d21/d22/d2e/d8d/db8/f144 x:0 0 0 2024-04-12T09:11:40.944 INFO:tasks.workunit.client.1.smithi203.stdout:4/999: write d1a/d21/d22/ff5 [2915299,27997] 0 2024-04-12T09:11:40.955 INFO:tasks.workunit.client.1.smithi203.stdout:3/896: getdents d2/d8/d14/d45/dcb/d118/dbc/d11d 0 2024-04-12T09:11:40.955 INFO:tasks.workunit.client.1.smithi203.stdout:9/835: mknod d8/d12/d3e/d90/c113 0 2024-04-12T09:11:40.964 INFO:tasks.workunit.client.1.smithi203.stdout:3/897: dread d2/d8/d14/d45/dcb/d118/d65/fd2 [0,4194304] 0 2024-04-12T09:11:40.975 INFO:tasks.workunit.client.1.smithi203.stdout:3/898: mknod d2/d64/d8d/de6/d10a/c11e 0 2024-04-12T09:11:40.977 INFO:tasks.workunit.client.1.smithi203.stdout:3/899: mknod d2/d8/d14/d23/c11f 0 2024-04-12T09:11:40.978 INFO:tasks.workunit.client.1.smithi203.stdout:3/900: readlink d2/d8/d14/d45/l4e 0 2024-04-12T09:11:40.981 INFO:tasks.workunit.client.1.smithi203.stdout:9/836: dread d8/d12/d23/d38/d8a/d97/d9e/d74/fd0 [0,4194304] 0 2024-04-12T09:11:40.984 INFO:tasks.workunit.client.1.smithi203.stdout:9/837: symlink d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/dca/l114 0 2024-04-12T09:11:40.985 INFO:tasks.workunit.client.1.smithi203.stdout:3/901: dwrite d2/d8/d14/d23/d35/d91/f7a [0,4194304] 0 2024-04-12T09:11:40.987 INFO:tasks.workunit.client.1.smithi203.stdout:9/838: read d8/d12/d23/d85/f1d [3936543,114735] 0 2024-04-12T09:11:40.989 INFO:tasks.workunit.client.1.smithi203.stdout:3/902: mkdir d2/d64/d120 0 2024-04-12T09:11:40.993 INFO:tasks.workunit.client.1.smithi203.stdout:9/839: mknod d8/d12/d23/d41/c115 0 2024-04-12T09:11:40.994 INFO:tasks.workunit.client.1.smithi203.stdout:3/903: dwrite d2/d8/d14/d23/d35/d4c/fb6 [0,4194304] 0 2024-04-12T09:11:40.998 INFO:tasks.workunit.client.1.smithi203.stdout:3/904: symlink d2/d8/d14/d23/d35/d4c/d67/d86/l121 0 2024-04-12T09:11:40.999 INFO:tasks.workunit.client.1.smithi203.stdout:7/932: write d0/d4/d5d/f85 [334435,61489] 0 2024-04-12T09:11:40.999 INFO:tasks.workunit.client.1.smithi203.stdout:3/905: fsync d2/d8/d14/d1b/d95/d92/fe9 0 2024-04-12T09:11:41.000 INFO:tasks.workunit.client.1.smithi203.stdout:9/840: link d8/d3b/fc9 d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/f116 0 2024-04-12T09:11:41.001 INFO:tasks.workunit.client.1.smithi203.stdout:3/906: stat d2/d8/d14/d1b/d95/c9e 0 2024-04-12T09:11:41.004 INFO:tasks.workunit.client.1.smithi203.stdout:3/907: chown d2/d8/f11a 1567 1 2024-04-12T09:11:41.005 INFO:tasks.workunit.client.1.smithi203.stdout:9/841: unlink d8/d12/d23/f10a 0 2024-04-12T09:11:41.007 INFO:tasks.workunit.client.1.smithi203.stdout:6/851: write d1/d3/d26/d5d/f82 [345828,33847] 0 2024-04-12T09:11:41.010 INFO:tasks.workunit.client.1.smithi203.stdout:9/842: rename d8/d12/d3e/fbb to d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/dfb/f117 0 2024-04-12T09:11:41.010 INFO:tasks.workunit.client.1.smithi203.stdout:3/908: dwrite d2/d8/f85 [0,4194304] 0 2024-04-12T09:11:41.011 INFO:tasks.workunit.client.1.smithi203.stdout:9/843: readlink d8/d12/d23/d85/lda 0 2024-04-12T09:11:41.016 INFO:tasks.workunit.client.1.smithi203.stdout:8/916: sync 2024-04-12T09:11:41.022 INFO:tasks.workunit.client.1.smithi203.stdout:8/917: dwrite d4/d8/d1c/d5d/dc0/ff1 [0,4194304] 0 2024-04-12T09:11:41.025 INFO:tasks.workunit.client.1.smithi203.stdout:3/909: link d2/d8/d14/d23/d35/d4c/fc2 d2/d8/d14/d1b/f122 0 2024-04-12T09:11:41.026 INFO:tasks.workunit.client.1.smithi203.stdout:8/918: creat d4/d8/d81/d8e/f12d x:0 0 0 2024-04-12T09:11:41.027 INFO:tasks.workunit.client.1.smithi203.stdout:8/919: read - d4/d8/d1c/d48/d5e/de8/fe5 zero size 2024-04-12T09:11:41.031 INFO:tasks.workunit.client.1.smithi203.stdout:7/933: write d0/d4/d54/d75/dc0/fb3 [674544,127041] 0 2024-04-12T09:11:41.033 INFO:tasks.workunit.client.1.smithi203.stdout:9/844: dread d8/fb [0,4194304] 0 2024-04-12T09:11:41.033 INFO:tasks.workunit.client.1.smithi203.stdout:7/934: chown d0/d4/d54/dac/f10f 753 1 2024-04-12T09:11:41.081 INFO:tasks.workunit.client.1.smithi203.stdout:9/845: fdatasync d8/d12/f81 0 2024-04-12T09:11:41.081 INFO:tasks.workunit.client.1.smithi203.stdout:7/935: rename d0/d4/d1c/d5b/dbf/dc3/d119 to d0/d38/d12e 0 2024-04-12T09:11:41.084 INFO:tasks.workunit.client.1.smithi203.stdout:9/846: symlink d8/d12/d23/d85/df6/l118 0 2024-04-12T09:11:41.084 INFO:tasks.workunit.client.1.smithi203.stdout:7/936: write d0/d4/d54/da0/d106/f91 [86059,107847] 0 2024-04-12T09:11:41.087 INFO:tasks.workunit.client.1.smithi203.stdout:9/847: write d8/d12/d23/d38/d8a/d97/df3/fff [313751,110318] 0 2024-04-12T09:11:41.088 INFO:tasks.workunit.client.1.smithi203.stdout:8/920: dwrite d4/d8/d37/d57/f8d [0,4194304] 0 2024-04-12T09:11:41.092 INFO:tasks.workunit.client.1.smithi203.stdout:8/921: unlink d4/d8/d1c/f30 0 2024-04-12T09:11:41.095 INFO:tasks.workunit.client.1.smithi203.stdout:9/848: getdents d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/da9/d112 0 2024-04-12T09:11:41.106 INFO:tasks.workunit.client.1.smithi203.stdout:7/937: dread d0/d4/d1c/d5b/dbf/dc5/fcc [0,4194304] 0 2024-04-12T09:11:41.107 INFO:tasks.workunit.client.1.smithi203.stdout:7/938: fsync d0/d4/f43 0 2024-04-12T09:11:41.109 INFO:tasks.workunit.client.1.smithi203.stdout:9/849: dwrite d8/d12/d23/d38/f3d [0,4194304] 0 2024-04-12T09:11:41.113 INFO:tasks.workunit.client.1.smithi203.stdout:6/852: sync 2024-04-12T09:11:41.117 INFO:tasks.workunit.client.1.smithi203.stdout:6/853: symlink d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/db5/l108 0 2024-04-12T09:11:41.120 INFO:tasks.workunit.client.1.smithi203.stdout:7/939: rename d0/d4/d5d/f86 to d0/d4/d1c/d5b/f12f 0 2024-04-12T09:11:41.120 INFO:tasks.workunit.client.1.smithi203.stdout:7/940: stat d0/d4/d54/da0/dff/d4c/fa6 0 2024-04-12T09:11:41.122 INFO:tasks.workunit.client.1.smithi203.stdout:7/941: mkdir d0/d4/d1c/d5b/dbf/dc3/d130 0 2024-04-12T09:11:41.125 INFO:tasks.workunit.client.1.smithi203.stdout:7/942: fdatasync d0/d4/d54/da0/dff/d4c/fa6 0 2024-04-12T09:11:41.127 INFO:tasks.workunit.client.1.smithi203.stdout:9/850: dwrite d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d70/fab [0,4194304] 0 2024-04-12T09:11:41.128 INFO:tasks.workunit.client.1.smithi203.stdout:6/854: dwrite d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/db5/fc5 [4194304,4194304] 0 2024-04-12T09:11:41.128 INFO:tasks.workunit.client.1.smithi203.stdout:7/943: creat d0/d34/f131 x:0 0 0 2024-04-12T09:11:41.133 INFO:tasks.workunit.client.1.smithi203.stdout:9/851: creat d8/d12/d23/d38/d8a/d97/de0/f119 x:0 0 0 2024-04-12T09:11:41.136 INFO:tasks.workunit.client.1.smithi203.stdout:7/944: creat d0/d4/d1c/f132 x:0 0 0 2024-04-12T09:11:41.138 INFO:tasks.workunit.client.1.smithi203.stdout:7/945: chown d0/d4/d54/da0/d106/c6d 35424 1 2024-04-12T09:11:41.138 INFO:tasks.workunit.client.1.smithi203.stdout:6/855: symlink d1/d3/d26/dcb/l109 0 2024-04-12T09:11:41.138 INFO:tasks.workunit.client.1.smithi203.stdout:9/852: dread d8/d12/d23/d85/de1/de6/f102 [0,4194304] 0 2024-04-12T09:11:41.141 INFO:tasks.workunit.client.1.smithi203.stdout:6/856: mknod d1/d3/d26/d30/d4a/d6c/d45/d55/d8e/c10a 0 2024-04-12T09:11:41.143 INFO:tasks.workunit.client.1.smithi203.stdout:7/946: symlink d0/d4/d54/da0/dff/l133 0 2024-04-12T09:11:41.143 INFO:tasks.workunit.client.1.smithi203.stdout:7/947: fsync d0/d4/d54/d75/f9a 0 2024-04-12T09:11:41.144 INFO:tasks.workunit.client.1.smithi203.stdout:7/948: read d0/d15/f20 [4102222,52989] 0 2024-04-12T09:11:41.147 INFO:tasks.workunit.client.1.smithi203.stdout:6/857: truncate d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/d9c/fa7 667943 0 2024-04-12T09:11:41.152 INFO:tasks.workunit.client.1.smithi203.stdout:6/858: mkdir d1/df/d65/dbc/df8/d10b 0 2024-04-12T09:11:41.153 INFO:tasks.workunit.client.1.smithi203.stdout:6/859: read - d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/d9c/def/ffe zero size 2024-04-12T09:11:41.158 INFO:tasks.workunit.client.1.smithi203.stdout:9/853: truncate d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/dca/ffc 2855127 0 2024-04-12T09:11:41.159 INFO:tasks.workunit.client.1.smithi203.stdout:6/860: mkdir d1/d3/d26/d30/d4a/d6c/d45/d10c 0 2024-04-12T09:11:41.159 INFO:tasks.workunit.client.1.smithi203.stdout:9/854: chown d8/d12/d23/d38/d8a/d97/de0/f119 117 1 2024-04-12T09:11:41.161 INFO:tasks.workunit.client.1.smithi203.stdout:6/861: write d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/db5/fc5 [1283107,21521] 0 2024-04-12T09:11:41.164 INFO:tasks.workunit.client.1.smithi203.stdout:6/862: dread d1/df/f51 [0,4194304] 0 2024-04-12T09:11:41.166 INFO:tasks.workunit.client.1.smithi203.stdout:9/855: mknod d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d40/c11a 0 2024-04-12T09:11:41.169 INFO:tasks.workunit.client.1.smithi203.stdout:9/856: dread d8/d12/d23/d38/f3d [0,4194304] 0 2024-04-12T09:11:41.169 INFO:tasks.workunit.client.1.smithi203.stdout:6/863: rename d1/dcd to d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/d10d 0 2024-04-12T09:11:41.170 INFO:tasks.workunit.client.1.smithi203.stdout:6/864: rename d1/df to d1/df/d87/d7a/d10e 22 2024-04-12T09:11:41.177 INFO:tasks.workunit.client.1.smithi203.stdout:6/865: creat d1/d3/d5b/f10f x:0 0 0 2024-04-12T09:11:41.184 INFO:tasks.workunit.client.1.smithi203.stdout:6/866: mknod d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/c110 0 2024-04-12T09:11:41.188 INFO:tasks.workunit.client.1.smithi203.stdout:6/867: rename d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/da0 to d1/d3/d5b/d8c/d3e/da1/d104/d111 0 2024-04-12T09:11:41.189 INFO:tasks.workunit.client.1.smithi203.stdout:6/868: mkdir d1/d3/d26/d9b/de2/d112 0 2024-04-12T09:11:41.191 INFO:tasks.workunit.client.1.smithi203.stdout:6/869: creat d1/d3/d5b/f113 x:0 0 0 2024-04-12T09:11:41.192 INFO:tasks.workunit.client.1.smithi203.stdout:9/857: dwrite d8/d12/d23/d85/f46 [0,4194304] 0 2024-04-12T09:11:41.195 INFO:tasks.workunit.client.1.smithi203.stdout:6/870: truncate d1/d3/d91/fc6 538828 0 2024-04-12T09:11:41.195 INFO:tasks.workunit.client.1.smithi203.stdout:9/858: write d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/f61 [39499,130884] 0 2024-04-12T09:11:41.201 INFO:tasks.workunit.client.1.smithi203.stdout:6/871: dwrite d1/d3/d91/fc6 [0,4194304] 0 2024-04-12T09:11:41.211 INFO:tasks.workunit.client.1.smithi203.stdout:9/859: symlink d8/d12/d23/d38/l11b 0 2024-04-12T09:11:41.220 INFO:tasks.workunit.client.1.smithi203.stdout:3/910: sync 2024-04-12T09:11:41.244 INFO:tasks.workunit.client.1.smithi203.stdout:8/922: sync 2024-04-12T09:11:41.244 INFO:tasks.workunit.client.1.smithi203.stdout:7/949: sync 2024-04-12T09:11:41.248 INFO:tasks.workunit.client.1.smithi203.stdout:9/860: creat d8/d12/d3e/dc1/f11c x:0 0 0 2024-04-12T09:11:41.250 INFO:tasks.workunit.client.1.smithi203.stdout:7/950: rmdir d0/d4/d54/dac/dd4 39 2024-04-12T09:11:41.253 INFO:tasks.workunit.client.1.smithi203.stdout:3/911: mkdir d2/d8/d14/d45/d10f/d123 0 2024-04-12T09:11:41.254 INFO:tasks.workunit.client.1.smithi203.stdout:8/923: truncate d4/d8/d1c/d48/d5e/de8/f118 169744 0 2024-04-12T09:11:41.254 INFO:tasks.workunit.client.1.smithi203.stdout:6/872: getdents d1/d3/d26/d5d 0 2024-04-12T09:11:41.255 INFO:tasks.workunit.client.1.smithi203.stdout:7/951: mknod d0/d4/d53/c134 0 2024-04-12T09:11:41.260 INFO:tasks.workunit.client.1.smithi203.stdout:8/924: write d4/d8/d74/d78/d53/fe3 [4548791,48048] 0 2024-04-12T09:11:41.261 INFO:tasks.workunit.client.1.smithi203.stdout:7/952: dwrite d0/d15/d2d/df2/d108/f90 [0,4194304] 0 2024-04-12T09:11:41.262 INFO:tasks.workunit.client.1.smithi203.stdout:9/861: link d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/f116 d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/dca/dd1/f11d 0 2024-04-12T09:11:41.263 INFO:tasks.workunit.client.1.smithi203.stdout:6/873: fdatasync d1/d3/d12/f1e 0 2024-04-12T09:11:41.274 INFO:tasks.workunit.client.1.smithi203.stdout:8/925: rename d4/d8/d81/d84/dfc to d4/d8/d74/d111/d116/df2/d12e 0 2024-04-12T09:11:41.275 INFO:tasks.workunit.client.1.smithi203.stdout:8/926: fsync d4/d8/d1c/fab 0 2024-04-12T09:11:41.277 INFO:tasks.workunit.client.1.smithi203.stdout:9/862: symlink d8/d3b/db7/l11e 0 2024-04-12T09:11:41.280 INFO:tasks.workunit.client.1.smithi203.stdout:7/953: getdents d0/d4/d54/da0/d106 0 2024-04-12T09:11:41.284 INFO:tasks.workunit.client.1.smithi203.stdout:8/927: fdatasync d4/d8/d74/d78/f25 0 2024-04-12T09:11:41.285 INFO:tasks.workunit.client.1.smithi203.stdout:6/874: dread d1/d3/d26/d30/d4a/d6c/f92 [0,4194304] 0 2024-04-12T09:11:41.286 INFO:tasks.workunit.client.1.smithi203.stdout:6/875: truncate d1/df/d87/f9e 4364742 0 2024-04-12T09:11:41.288 INFO:tasks.workunit.client.1.smithi203.stdout:8/928: symlink d4/ddf/d100/l12f 0 2024-04-12T09:11:41.291 INFO:tasks.workunit.client.1.smithi203.stdout:8/929: readlink d4/d8/d1c/d5d/l88 0 2024-04-12T09:11:41.292 INFO:tasks.workunit.client.1.smithi203.stdout:9/863: link d8/d12/d23/l92 d8/d12/d23/d41/l11f 0 2024-04-12T09:11:41.292 INFO:tasks.workunit.client.1.smithi203.stdout:8/930: chown d4/d8/d81/d84/d92/fdd 460481 1 2024-04-12T09:11:41.293 INFO:tasks.workunit.client.1.smithi203.stdout:9/864: chown d8/d12/d3e/d90/d60/daf 9724 1 2024-04-12T09:11:41.293 INFO:tasks.workunit.client.1.smithi203.stdout:7/954: getdents d0/d15/d2d/df2/d108/dba 0 2024-04-12T09:11:41.294 INFO:tasks.workunit.client.1.smithi203.stdout:9/865: chown d8/d12/d3e/ff4 156 1 2024-04-12T09:11:41.295 INFO:tasks.workunit.client.1.smithi203.stdout:8/931: unlink d4/d8/d81/d8e/f123 0 2024-04-12T09:11:41.298 INFO:tasks.workunit.client.1.smithi203.stdout:9/866: unlink d8/d12/d23/d38/d8a/d97/d9e/d74/fd0 0 2024-04-12T09:11:41.300 INFO:tasks.workunit.client.1.smithi203.stdout:7/955: truncate d0/d15/d2d/fc2 1094823 0 2024-04-12T09:11:41.302 INFO:tasks.workunit.client.1.smithi203.stdout:8/932: rmdir d4/d8/d37/d57/d7d/de6/d10b 39 2024-04-12T09:11:41.305 INFO:tasks.workunit.client.1.smithi203.stdout:7/956: dwrite d0/d4/d54/d75/f9a [0,4194304] 0 2024-04-12T09:11:41.306 INFO:tasks.workunit.client.1.smithi203.stdout:7/957: readlink d0/d15/d2d/df2/ld9 0 2024-04-12T09:11:41.308 INFO:tasks.workunit.client.1.smithi203.stdout:8/933: symlink d4/d8/d1c/d5d/dc0/l130 0 2024-04-12T09:11:41.311 INFO:tasks.workunit.client.1.smithi203.stdout:7/958: unlink d0/d15/d2d/ld0 0 2024-04-12T09:11:41.312 INFO:tasks.workunit.client.1.smithi203.stdout:7/959: fdatasync d0/d4/d54/d75/dc0/ff7 0 2024-04-12T09:11:41.317 INFO:tasks.workunit.client.1.smithi203.stdout:3/912: dwrite d2/d8/f11a [0,4194304] 0 2024-04-12T09:11:41.318 INFO:tasks.workunit.client.1.smithi203.stdout:7/960: unlink d0/d4/d1c/d5b/lfe 0 2024-04-12T09:11:41.324 INFO:tasks.workunit.client.1.smithi203.stdout:7/961: dwrite d0/d4/d54/da0/d106/f81 [4194304,4194304] 0 2024-04-12T09:11:41.329 INFO:tasks.workunit.client.1.smithi203.stdout:7/962: dread d0/d4/d54/da0/dff/d4c/fa6 [0,4194304] 0 2024-04-12T09:11:41.333 INFO:tasks.workunit.client.1.smithi203.stdout:6/876: dwrite d1/d3/d26/d5d/f8b [0,4194304] 0 2024-04-12T09:11:41.338 INFO:tasks.workunit.client.1.smithi203.stdout:9/867: dwrite d8/fa [0,4194304] 0 2024-04-12T09:11:41.340 INFO:tasks.workunit.client.1.smithi203.stdout:7/963: dwrite d0/d4/d54/da0/d106/df0/f11c [0,4194304] 0 2024-04-12T09:11:41.344 INFO:tasks.workunit.client.1.smithi203.stdout:6/877: mkdir d1/d3/d5b/d8c/d114 0 2024-04-12T09:11:41.347 INFO:tasks.workunit.client.1.smithi203.stdout:9/868: dread d8/d12/d23/d38/fd9 [0,4194304] 0 2024-04-12T09:11:41.349 INFO:tasks.workunit.client.1.smithi203.stdout:7/964: rename d0/d15/l67 to d0/d15/d2d/df2/l135 0 2024-04-12T09:11:41.351 INFO:tasks.workunit.client.1.smithi203.stdout:9/869: mkdir d8/d3b/d120 0 2024-04-12T09:11:41.352 INFO:tasks.workunit.client.1.smithi203.stdout:3/913: dwrite d2/d8/d14/d23/d35/d91/d81/fcd [0,4194304] 0 2024-04-12T09:11:41.354 INFO:tasks.workunit.client.1.smithi203.stdout:9/870: fdatasync d8/fb 0 2024-04-12T09:11:41.355 INFO:tasks.workunit.client.1.smithi203.stdout:7/965: write d0/d4/d54/d75/dc0/f10d [645756,26626] 0 2024-04-12T09:11:41.357 INFO:tasks.workunit.client.1.smithi203.stdout:7/966: write d0/d4/ff1 [1042012,39408] 0 2024-04-12T09:11:41.358 INFO:tasks.workunit.client.1.smithi203.stdout:3/914: creat d2/d8/d14/d1b/d2f/dd4/f124 x:0 0 0 2024-04-12T09:11:41.360 INFO:tasks.workunit.client.1.smithi203.stdout:7/967: mknod d0/d38/d51/c136 0 2024-04-12T09:11:41.362 INFO:tasks.workunit.client.1.smithi203.stdout:3/915: mknod d2/d64/df3/d104/c125 0 2024-04-12T09:11:41.363 INFO:tasks.workunit.client.1.smithi203.stdout:9/871: getdents d8/d12/d23/d85/de1 0 2024-04-12T09:11:41.364 INFO:tasks.workunit.client.1.smithi203.stdout:9/872: chown d8/d12/l20 59060 1 2024-04-12T09:11:41.366 INFO:tasks.workunit.client.1.smithi203.stdout:9/873: truncate d8/f2a 4362879 0 2024-04-12T09:11:41.369 INFO:tasks.workunit.client.1.smithi203.stdout:9/874: mknod d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/da9/c121 0 2024-04-12T09:11:41.371 INFO:tasks.workunit.client.1.smithi203.stdout:9/875: rmdir d8/d12/d23/d85/de1/de6 39 2024-04-12T09:11:41.376 INFO:tasks.workunit.client.1.smithi203.stdout:9/876: mkdir d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/dca/dd1/d122 0 2024-04-12T09:11:41.378 INFO:tasks.workunit.client.1.smithi203.stdout:9/877: dread - d8/d12/d23/fd7 zero size 2024-04-12T09:11:41.382 INFO:tasks.workunit.client.1.smithi203.stdout:9/878: mknod d8/d12/d23/d38/d8a/d97/d9e/c123 0 2024-04-12T09:11:41.388 INFO:tasks.workunit.client.1.smithi203.stdout:3/916: truncate d2/d8/d14/d1b/f8b 1549314 0 2024-04-12T09:11:41.395 INFO:tasks.workunit.client.1.smithi203.stdout:3/917: mknod d2/d8/d14/d1b/d95/d92/c126 0 2024-04-12T09:11:41.400 INFO:tasks.workunit.client.1.smithi203.stdout:9/879: dwrite d8/d3b/fc9 [0,4194304] 0 2024-04-12T09:11:41.402 INFO:tasks.workunit.client.1.smithi203.stdout:9/880: write d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/dca/dd1/f11d [4946622,68858] 0 2024-04-12T09:11:41.403 INFO:tasks.workunit.client.1.smithi203.stdout:3/918: symlink d2/d8/d14/d1b/l127 0 2024-04-12T09:11:41.408 INFO:tasks.workunit.client.1.smithi203.stdout:9/881: rename d8/d3b/dcd/f10c to d8/d12/d23/d38/d8a/d97/f124 0 2024-04-12T09:11:41.409 INFO:tasks.workunit.client.1.smithi203.stdout:9/882: fsync d8/d12/d23/d38/f6c 0 2024-04-12T09:11:41.409 INFO:tasks.workunit.client.1.smithi203.stdout:9/883: stat d8/d12/d23/d38/d8a/d97/de0 0 2024-04-12T09:11:41.410 INFO:tasks.workunit.client.1.smithi203.stdout:9/884: write d8/d12/d3e/d90/f101 [618049,121723] 0 2024-04-12T09:11:41.414 INFO:tasks.workunit.client.1.smithi203.stdout:3/919: rename d2/d8/d14/f40 to d2/d8/d14/d1b/d95/d92/ddb/f128 0 2024-04-12T09:11:41.420 INFO:tasks.workunit.client.1.smithi203.stdout:3/920: dwrite d2/d8/d14/d23/d35/d91/d81/fcd [0,4194304] 0 2024-04-12T09:11:41.422 INFO:tasks.workunit.client.1.smithi203.stdout:3/921: rmdir d2/d8/d14/d23/d35/d4c/d5c 39 2024-04-12T09:11:41.424 INFO:tasks.workunit.client.1.smithi203.stdout:3/922: chown d2/d8/lf 0 1 2024-04-12T09:11:41.434 INFO:tasks.workunit.client.1.smithi203.stdout:8/934: sync 2024-04-12T09:11:41.435 INFO:tasks.workunit.client.1.smithi203.stdout:3/923: dread d2/d8/d14/d23/d35/d4c/d67/d86/fb5 [0,4194304] 0 2024-04-12T09:11:41.436 INFO:tasks.workunit.client.1.smithi203.stdout:3/924: fdatasync d2/d8/d14/d1b/d95/d92/ddb/f79 0 2024-04-12T09:11:41.436 INFO:tasks.workunit.client.1.smithi203.stdout:3/925: chown d2/d8/d14/d23/c4a 1644 1 2024-04-12T09:11:41.437 INFO:tasks.workunit.client.1.smithi203.stdout:3/926: chown d2/lb0 1300343 1 2024-04-12T09:11:41.439 INFO:tasks.workunit.client.1.smithi203.stdout:3/927: chown d2/d8/d14/d23/d35/d4c/d5c/cfa 761 1 2024-04-12T09:11:41.441 INFO:tasks.workunit.client.1.smithi203.stdout:8/935: dwrite d4/d8/d1c/d5d/da7/f105 [0,4194304] 0 2024-04-12T09:11:41.443 INFO:tasks.workunit.client.1.smithi203.stdout:3/928: fsync d2/d8/d14/d23/d35/d4c/d5c/f56 0 2024-04-12T09:11:41.444 INFO:tasks.workunit.client.1.smithi203.stdout:3/929: fdatasync d2/d8/f85 0 2024-04-12T09:11:41.456 INFO:tasks.workunit.client.1.smithi203.stdout:8/936: creat d4/d8/f131 x:0 0 0 2024-04-12T09:11:41.457 INFO:tasks.workunit.client.1.smithi203.stdout:3/930: creat d2/d8/f129 x:0 0 0 2024-04-12T09:11:41.459 INFO:tasks.workunit.client.1.smithi203.stdout:3/931: dread d2/d8/d14/d23/d35/f5a [0,4194304] 0 2024-04-12T09:11:41.468 INFO:tasks.workunit.client.1.smithi203.stdout:3/932: truncate d2/f83 1739690 0 2024-04-12T09:11:41.469 INFO:tasks.workunit.client.1.smithi203.stdout:8/937: dwrite d4/d8/d37/fb7 [0,4194304] 0 2024-04-12T09:11:41.470 INFO:tasks.workunit.client.1.smithi203.stdout:3/933: stat d2/d8/d14/d1b/d95/d92/ddb/f79 0 2024-04-12T09:11:41.470 INFO:tasks.workunit.client.1.smithi203.stdout:8/938: chown d4/d8/d74/db6/cf8 436114 1 2024-04-12T09:11:41.472 INFO:tasks.workunit.client.1.smithi203.stdout:8/939: chown d4/d8/d1c/d5d/dc0/ff1 3852420 1 2024-04-12T09:11:41.475 INFO:tasks.workunit.client.1.smithi203.stdout:3/934: creat d2/d8/d14/d45/df7/f12a x:0 0 0 2024-04-12T09:11:41.478 INFO:tasks.workunit.client.1.smithi203.stdout:8/940: mkdir d4/d8/d74/d111/d116/df2/dee/d132 0 2024-04-12T09:11:41.480 INFO:tasks.workunit.client.1.smithi203.stdout:3/935: dwrite d2/d8/def/f101 [0,4194304] 0 2024-04-12T09:11:41.482 INFO:tasks.workunit.client.1.smithi203.stdout:8/941: mkdir d4/d8/d74/d133 0 2024-04-12T09:11:41.484 INFO:tasks.workunit.client.1.smithi203.stdout:3/936: creat d2/d8/def/f12b x:0 0 0 2024-04-12T09:11:41.488 INFO:tasks.workunit.client.1.smithi203.stdout:6/878: sync 2024-04-12T09:11:41.490 INFO:tasks.workunit.client.1.smithi203.stdout:6/879: creat d1/d3/d26/d9b/de2/d112/f115 x:0 0 0 2024-04-12T09:11:41.493 INFO:tasks.workunit.client.1.smithi203.stdout:8/942: dread d4/f5a [0,4194304] 0 2024-04-12T09:11:41.496 INFO:tasks.workunit.client.1.smithi203.stdout:6/880: dwrite d1/d3/d26/d30/fab [0,4194304] 0 2024-04-12T09:11:41.497 INFO:tasks.workunit.client.1.smithi203.stdout:8/943: symlink d4/d8/d1c/l134 0 2024-04-12T09:11:41.502 INFO:tasks.workunit.client.1.smithi203.stdout:6/881: dwrite d1/d3/d26/d30/d4a/d6c/d45/f49 [4194304,4194304] 0 2024-04-12T09:11:41.504 INFO:tasks.workunit.client.1.smithi203.stdout:8/944: mkdir d4/d135 0 2024-04-12T09:11:41.511 INFO:tasks.workunit.client.1.smithi203.stdout:6/882: dread d1/d3/f27 [0,4194304] 0 2024-04-12T09:11:41.512 INFO:tasks.workunit.client.1.smithi203.stdout:6/883: readlink d1/d3/d26/d30/d4a/d6c/d45/d55/l8d 0 2024-04-12T09:11:41.513 INFO:tasks.workunit.client.1.smithi203.stdout:6/884: write d1/df/dd3/fde [434363,125187] 0 2024-04-12T09:11:41.514 INFO:tasks.workunit.client.1.smithi203.stdout:3/937: write d2/d64/d8d/fae [1186660,90765] 0 2024-04-12T09:11:41.515 INFO:tasks.workunit.client.1.smithi203.stdout:3/938: read d2/d8/def/f101 [702857,38048] 0 2024-04-12T09:11:41.519 INFO:tasks.workunit.client.1.smithi203.stdout:6/885: creat d1/d3/d5b/d8c/d3e/da1/d104/d111/f116 x:0 0 0 2024-04-12T09:11:41.521 INFO:tasks.workunit.client.1.smithi203.stdout:3/939: mknod d2/d8/d14/d45/dcb/d118/dbc/c12c 0 2024-04-12T09:11:41.524 INFO:tasks.workunit.client.1.smithi203.stdout:6/886: symlink d1/d3/d26/d30/d4a/d6c/d45/l117 0 2024-04-12T09:11:41.526 INFO:tasks.workunit.client.1.smithi203.stdout:6/887: mknod d1/d3/d12/c118 0 2024-04-12T09:11:41.527 INFO:tasks.workunit.client.1.smithi203.stdout:6/888: write d1/df/dd3/f106 [69718,45775] 0 2024-04-12T09:11:41.529 INFO:tasks.workunit.client.1.smithi203.stdout:8/945: dread d4/d8/d81/d84/d92/f80 [0,4194304] 0 2024-04-12T09:11:41.529 INFO:tasks.workunit.client.1.smithi203.stdout:6/889: unlink d1/c50 0 2024-04-12T09:11:41.534 INFO:tasks.workunit.client.1.smithi203.stdout:8/946: symlink d4/d8/d74/d111/d116/df2/dee/d132/l136 0 2024-04-12T09:11:41.535 INFO:tasks.workunit.client.1.smithi203.stdout:8/947: dread - d4/d8/d81/d84/d92/fd7 zero size 2024-04-12T09:11:41.536 INFO:tasks.workunit.client.1.smithi203.stdout:9/885: sync 2024-04-12T09:11:41.536 INFO:tasks.workunit.client.1.smithi203.stdout:7/968: sync 2024-04-12T09:11:41.538 INFO:tasks.workunit.client.1.smithi203.stdout:3/940: dwrite d2/d8/d14/d1b/d95/d92/fa4 [0,4194304] 0 2024-04-12T09:11:41.540 INFO:tasks.workunit.client.1.smithi203.stdout:9/886: symlink d8/d12/d23/d27/l125 0 2024-04-12T09:11:41.542 INFO:tasks.workunit.client.1.smithi203.stdout:9/887: chown d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/f43 36 1 2024-04-12T09:11:41.542 INFO:tasks.workunit.client.1.smithi203.stdout:9/888: stat d8/d12/d23/d85/de1 0 2024-04-12T09:11:41.545 INFO:tasks.workunit.client.1.smithi203.stdout:7/969: rename d0/d4/d1c/d5b/f65 to d0/d15/d2d/df2/f137 0 2024-04-12T09:11:41.546 INFO:tasks.workunit.client.1.smithi203.stdout:9/889: truncate d8/d12/d23/d38/d8a/d97/de0/ff1 593753 0 2024-04-12T09:11:41.546 INFO:tasks.workunit.client.1.smithi203.stdout:8/948: link d4/ffb d4/d8/d1c/d5d/d122/f137 0 2024-04-12T09:11:41.554 INFO:tasks.workunit.client.1.smithi203.stdout:6/890: dread d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d3a/f60 [0,4194304] 0 2024-04-12T09:11:41.559 INFO:tasks.workunit.client.1.smithi203.stdout:7/970: truncate d0/d4/d1c/d5b/f12f 134023 0 2024-04-12T09:11:41.560 INFO:tasks.workunit.client.1.smithi203.stdout:6/891: dwrite d1/d3/d4/f88 [0,4194304] 0 2024-04-12T09:11:41.561 INFO:tasks.workunit.client.1.smithi203.stdout:9/890: symlink d8/d12/d23/d38/d8a/d97/d9e/d74/dc7/l126 0 2024-04-12T09:11:41.562 INFO:tasks.workunit.client.1.smithi203.stdout:9/891: dread - d8/d12/d23/d38/d8a/d97/f124 zero size 2024-04-12T09:11:41.565 INFO:tasks.workunit.client.1.smithi203.stdout:7/971: rename d0/d4/f69 to d0/d4/d53/dde/f138 0 2024-04-12T09:11:41.567 INFO:tasks.workunit.client.1.smithi203.stdout:9/892: dread d8/d12/d3e/f73 [0,4194304] 0 2024-04-12T09:11:41.568 INFO:tasks.workunit.client.1.smithi203.stdout:6/892: creat d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/d9c/def/f119 x:0 0 0 2024-04-12T09:11:41.572 INFO:tasks.workunit.client.1.smithi203.stdout:6/893: chown d1/d3/d26/d30/d4a/d6c/d45/d55/d90/cf4 915 1 2024-04-12T09:11:41.575 INFO:tasks.workunit.client.1.smithi203.stdout:8/949: link d4/d8/c26 d4/c138 0 2024-04-12T09:11:41.576 INFO:tasks.workunit.client.1.smithi203.stdout:7/972: creat d0/d15/d2d/f139 x:0 0 0 2024-04-12T09:11:41.580 INFO:tasks.workunit.client.1.smithi203.stdout:6/894: creat d1/d3/d5b/d8c/d114/f11a x:0 0 0 2024-04-12T09:11:41.582 INFO:tasks.workunit.client.1.smithi203.stdout:8/950: creat d4/d8/d1c/d5d/dea/dec/f139 x:0 0 0 2024-04-12T09:11:41.583 INFO:tasks.workunit.client.1.smithi203.stdout:7/973: mknod d0/c13a 0 2024-04-12T09:11:41.584 INFO:tasks.workunit.client.1.smithi203.stdout:6/895: rmdir d1/d3/d26/d30/d4a/d6c/d45/d55/d8e 39 2024-04-12T09:11:41.584 INFO:tasks.workunit.client.1.smithi203.stdout:6/896: fdatasync d1/df/dd3/f106 0 2024-04-12T09:11:41.586 INFO:tasks.workunit.client.1.smithi203.stdout:8/951: mkdir d4/d8/d1c/d5d/da7/d13a 0 2024-04-12T09:11:41.589 INFO:tasks.workunit.client.1.smithi203.stdout:6/897: creat d1/d3/d5b/f11b x:0 0 0 2024-04-12T09:11:41.589 INFO:tasks.workunit.client.1.smithi203.stdout:6/898: fdatasync d1/d3/f8f 0 2024-04-12T09:11:41.593 INFO:tasks.workunit.client.1.smithi203.stdout:6/899: creat d1/d3/d5b/d8c/d3e/da1/df1/f11c x:0 0 0 2024-04-12T09:11:41.593 INFO:tasks.workunit.client.1.smithi203.stdout:8/952: dread d4/d8/d37/d57/d128/fe7 [0,4194304] 0 2024-04-12T09:11:41.595 INFO:tasks.workunit.client.1.smithi203.stdout:9/893: dwrite d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/f6a [0,4194304] 0 2024-04-12T09:11:41.610 INFO:tasks.workunit.client.1.smithi203.stdout:9/894: creat d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/f127 x:0 0 0 2024-04-12T09:11:41.611 INFO:tasks.workunit.client.1.smithi203.stdout:6/900: getdents d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/d9c 0 2024-04-12T09:11:41.612 INFO:tasks.workunit.client.1.smithi203.stdout:6/901: truncate d1/d3/d26/dcb/f107 987228 0 2024-04-12T09:11:41.614 INFO:tasks.workunit.client.1.smithi203.stdout:6/902: chown d1/d3/d26/d30/d4a/d6c/d45/fb7 409377073 1 2024-04-12T09:11:41.616 INFO:tasks.workunit.client.1.smithi203.stdout:9/895: dwrite d8/d12/d23/d41/fe5 [0,4194304] 0 2024-04-12T09:11:41.617 INFO:tasks.workunit.client.1.smithi203.stdout:6/903: mkdir d1/d3/d91/d11d 0 2024-04-12T09:11:41.621 INFO:tasks.workunit.client.1.smithi203.stdout:9/896: truncate d8/d12/f16 3766285 0 2024-04-12T09:11:41.622 INFO:tasks.workunit.client.1.smithi203.stdout:8/953: dread d4/d8/d74/d78/f6d [0,4194304] 0 2024-04-12T09:11:41.628 INFO:tasks.workunit.client.1.smithi203.stdout:8/954: unlink d4/d8/d74/d111/d116/df2/fd0 0 2024-04-12T09:11:41.628 INFO:tasks.workunit.client.1.smithi203.stdout:9/897: dwrite d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/f5a [0,4194304] 0 2024-04-12T09:11:41.629 INFO:tasks.workunit.client.1.smithi203.stdout:8/955: chown d4/d8/d1c/d5d/dc9/f108 67913 1 2024-04-12T09:11:41.632 INFO:tasks.workunit.client.1.smithi203.stdout:9/898: creat d8/d12/d23/d38/d8a/d97/f128 x:0 0 0 2024-04-12T09:11:41.633 INFO:tasks.workunit.client.1.smithi203.stdout:6/904: truncate d1/d3/d26/d5d/f82 364172 0 2024-04-12T09:11:41.636 INFO:tasks.workunit.client.1.smithi203.stdout:8/956: dwrite d4/d8/f117 [0,4194304] 0 2024-04-12T09:11:41.641 INFO:tasks.workunit.client.1.smithi203.stdout:9/899: mknod d8/d12/c129 0 2024-04-12T09:11:41.644 INFO:tasks.workunit.client.1.smithi203.stdout:3/941: sync 2024-04-12T09:11:41.644 INFO:tasks.workunit.client.1.smithi203.stdout:8/957: rmdir d4/d8/d1c/d5d/dea/d11d 39 2024-04-12T09:11:41.648 INFO:tasks.workunit.client.1.smithi203.stdout:9/900: creat d8/d12/d23/db3/f12a x:0 0 0 2024-04-12T09:11:41.649 INFO:tasks.workunit.client.1.smithi203.stdout:9/901: read - d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/f127 zero size 2024-04-12T09:11:41.650 INFO:tasks.workunit.client.1.smithi203.stdout:6/905: getdents d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/d9c 0 2024-04-12T09:11:41.651 INFO:tasks.workunit.client.1.smithi203.stdout:3/942: write d2/d8/d14/d1b/d95/d92/ddb/f128 [4458153,17481] 0 2024-04-12T09:11:41.653 INFO:tasks.workunit.client.1.smithi203.stdout:3/943: write d2/d8/d14/d1b/d95/d92/fe9 [819670,92992] 0 2024-04-12T09:11:41.654 INFO:tasks.workunit.client.1.smithi203.stdout:8/958: symlink d4/d8/d74/d78/l13b 0 2024-04-12T09:11:41.658 INFO:tasks.workunit.client.1.smithi203.stdout:6/906: dwrite d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/db5/ff2 [0,4194304] 0 2024-04-12T09:11:41.659 INFO:tasks.workunit.client.1.smithi203.stdout:9/902: readlink d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/l99 0 2024-04-12T09:11:41.660 INFO:tasks.workunit.client.1.smithi203.stdout:3/944: dread d2/d8/f11a [0,4194304] 0 2024-04-12T09:11:41.661 INFO:tasks.workunit.client.1.smithi203.stdout:7/974: sync 2024-04-12T09:11:41.666 INFO:tasks.workunit.client.1.smithi203.stdout:3/945: dread d2/d8/d14/d23/d35/d91/d81/fcd [0,4194304] 0 2024-04-12T09:11:41.677 INFO:tasks.workunit.client.1.smithi203.stdout:3/946: dwrite d2/d8/d14/d45/dcb/d118/d65/fd2 [0,4194304] 0 2024-04-12T09:11:41.677 INFO:tasks.workunit.client.1.smithi203.stdout:9/903: creat d8/d12/d23/d38/d8a/d97/d9e/f12b x:0 0 0 2024-04-12T09:11:41.678 INFO:tasks.workunit.client.1.smithi203.stdout:6/907: getdents d1/d3/d91 0 2024-04-12T09:11:41.680 INFO:tasks.workunit.client.1.smithi203.stdout:3/947: truncate d2/d8/d14/d23/d35/d4c/d5c/dc3/fd3 414482 0 2024-04-12T09:11:41.681 INFO:tasks.workunit.client.1.smithi203.stdout:6/908: creat d1/df/d65/d96/f11e x:0 0 0 2024-04-12T09:11:41.685 INFO:tasks.workunit.client.1.smithi203.stdout:3/948: rmdir d2/d8/d14/d23 39 2024-04-12T09:11:41.686 INFO:tasks.workunit.client.1.smithi203.stdout:9/904: write d8/d12/d23/f26 [2823792,105520] 0 2024-04-12T09:11:41.687 INFO:tasks.workunit.client.1.smithi203.stdout:6/909: mknod d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/d10d/c11f 0 2024-04-12T09:11:41.692 INFO:tasks.workunit.client.1.smithi203.stdout:9/905: mknod d8/d3b/db7/c12c 0 2024-04-12T09:11:41.694 INFO:tasks.workunit.client.1.smithi203.stdout:9/906: chown d8/d3b/db7/l11e 2096790 1 2024-04-12T09:11:41.694 INFO:tasks.workunit.client.1.smithi203.stdout:7/975: dwrite d0/d4/d54/da0/dff/f4e [4194304,4194304] 0 2024-04-12T09:11:41.698 INFO:tasks.workunit.client.1.smithi203.stdout:3/949: dwrite d2/d8/d14/d23/d35/d4c/d5c/fd7 [0,4194304] 0 2024-04-12T09:11:41.699 INFO:tasks.workunit.client.1.smithi203.stdout:7/976: chown d0/d4/d1c/d5b/dbf/dc5/l115 1 1 2024-04-12T09:11:41.700 INFO:tasks.workunit.client.1.smithi203.stdout:9/907: symlink d8/d12/d3e/d90/l12d 0 2024-04-12T09:11:41.702 INFO:tasks.workunit.client.1.smithi203.stdout:6/910: dwrite d1/d3/d26/d30/d4a/d6c/d45/d55/fd4 [0,4194304] 0 2024-04-12T09:11:41.708 INFO:tasks.workunit.client.1.smithi203.stdout:3/950: rename d2/d8/d14/d1b/d95/d92/d100/l10e to d2/d64/df3/d104/l12d 0 2024-04-12T09:11:41.711 INFO:tasks.workunit.client.1.smithi203.stdout:9/908: creat d8/d12/d23/d38/d8a/d97/d9e/d74/dc7/f12e x:0 0 0 2024-04-12T09:11:41.711 INFO:tasks.workunit.client.1.smithi203.stdout:3/951: truncate d2/d8/d14/d23/d35/d4c/d5c/dc3/fd3 976869 0 2024-04-12T09:11:41.713 INFO:tasks.workunit.client.1.smithi203.stdout:8/959: sync 2024-04-12T09:11:41.714 INFO:tasks.workunit.client.1.smithi203.stdout:3/952: stat d2/d8/d14/d23/d35/d4c/d5c/dc3/lf5 0 2024-04-12T09:11:41.715 INFO:tasks.workunit.client.1.smithi203.stdout:6/911: rmdir d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/db5 39 2024-04-12T09:11:41.716 INFO:tasks.workunit.client.1.smithi203.stdout:7/977: creat d0/d4/d1c/d5b/f13b x:0 0 0 2024-04-12T09:11:41.719 INFO:tasks.workunit.client.1.smithi203.stdout:7/978: stat d0/d4/d53/dde/f138 0 2024-04-12T09:11:41.719 INFO:tasks.workunit.client.1.smithi203.stdout:8/960: creat d4/d8/d1c/d5d/dea/f13c x:0 0 0 2024-04-12T09:11:41.720 INFO:tasks.workunit.client.1.smithi203.stdout:6/912: mkdir d1/df/d65/d96/d120 0 2024-04-12T09:11:41.721 INFO:tasks.workunit.client.1.smithi203.stdout:9/909: dwrite d8/d12/d23/f26 [0,4194304] 0 2024-04-12T09:11:41.721 INFO:tasks.workunit.client.1.smithi203.stdout:6/913: stat d1/d3/d12/f1e 0 2024-04-12T09:11:41.724 INFO:tasks.workunit.client.1.smithi203.stdout:7/979: rename d0/lf8 to d0/d4/l13c 0 2024-04-12T09:11:41.725 INFO:tasks.workunit.client.1.smithi203.stdout:9/910: mkdir d8/d12/d23/d38/d8a/d97/df3/d12f 0 2024-04-12T09:11:41.726 INFO:tasks.workunit.client.1.smithi203.stdout:6/914: mknod d1/d3/d26/c121 0 2024-04-12T09:11:41.729 INFO:tasks.workunit.client.1.smithi203.stdout:8/961: dwrite d4/d8/d1c/d48/d5e/de8/f118 [0,4194304] 0 2024-04-12T09:11:41.730 INFO:tasks.workunit.client.1.smithi203.stdout:6/915: mknod d1/d3/d26/dcb/c122 0 2024-04-12T09:11:41.733 INFO:tasks.workunit.client.1.smithi203.stdout:8/962: unlink d4/d8/d81/d84/d92/fdd 0 2024-04-12T09:11:41.736 INFO:tasks.workunit.client.1.smithi203.stdout:8/963: read d4/d8/d1c/d5d/f69 [1862585,9858] 0 2024-04-12T09:11:41.737 INFO:tasks.workunit.client.1.smithi203.stdout:9/911: link d8/d12/d3e/ff4 d8/d3b/d120/f130 0 2024-04-12T09:11:41.737 INFO:tasks.workunit.client.1.smithi203.stdout:8/964: fsync d4/d8/d37/d57/f8d 0 2024-04-12T09:11:41.741 INFO:tasks.workunit.client.1.smithi203.stdout:3/953: write d2/fa [3076025,97738] 0 2024-04-12T09:11:41.742 INFO:tasks.workunit.client.1.smithi203.stdout:9/912: dwrite f4 [0,4194304] 0 2024-04-12T09:11:41.744 INFO:tasks.workunit.client.1.smithi203.stdout:9/913: readlink d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d70/lbd 0 2024-04-12T09:11:41.746 INFO:tasks.workunit.client.1.smithi203.stdout:8/965: fsync d4/d8/d74/d78/d53/f68 0 2024-04-12T09:11:41.750 INFO:tasks.workunit.client.1.smithi203.stdout:3/954: symlink d2/d8/d14/d45/dcb/d118/dbc/l12e 0 2024-04-12T09:11:41.758 INFO:tasks.workunit.client.1.smithi203.stdout:6/916: rename d1/d3/d26/d30/d4a/d6c/d45/d55/d77/dda to d1/d3/d26/d30/d4a/d6c/d45/d55/d123 0 2024-04-12T09:11:41.760 INFO:tasks.workunit.client.1.smithi203.stdout:7/980: dwrite d0/d4/d5d/f9e [0,4194304] 0 2024-04-12T09:11:41.762 INFO:tasks.workunit.client.1.smithi203.stdout:7/981: write d0/d4/d54/d75/f9b [2770659,56999] 0 2024-04-12T09:11:41.770 INFO:tasks.workunit.client.1.smithi203.stdout:9/914: write d8/d12/d3e/f84 [193031,107670] 0 2024-04-12T09:11:41.772 INFO:tasks.workunit.client.1.smithi203.stdout:3/955: mkdir d2/d8/d14/d1b/d2f/d12f 0 2024-04-12T09:11:41.781 INFO:tasks.workunit.client.1.smithi203.stdout:3/956: dwrite d2/d8/d14/d23/d35/d4c/d5c/d55/fdc [0,4194304] 0 2024-04-12T09:11:41.782 INFO:tasks.workunit.client.1.smithi203.stdout:8/966: dwrite d4/d8/d74/d111/d116/df2/fd4 [0,4194304] 0 2024-04-12T09:11:41.784 INFO:tasks.workunit.client.1.smithi203.stdout:6/917: creat d1/f124 x:0 0 0 2024-04-12T09:11:41.785 INFO:tasks.workunit.client.1.smithi203.stdout:7/982: dread d0/d4/f11 [0,4194304] 0 2024-04-12T09:11:41.787 INFO:tasks.workunit.client.1.smithi203.stdout:7/983: chown d0/d15/d2d/f66 1977101212 1 2024-04-12T09:11:41.788 INFO:tasks.workunit.client.1.smithi203.stdout:6/918: chown d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/d10d/c11f 230691146 1 2024-04-12T09:11:41.790 INFO:tasks.workunit.client.1.smithi203.stdout:6/919: read d1/d3/d12/f5e [1561794,111696] 0 2024-04-12T09:11:41.791 INFO:tasks.workunit.client.1.smithi203.stdout:8/967: dwrite d4/d8/f42 [4194304,4194304] 0 2024-04-12T09:11:41.792 INFO:tasks.workunit.client.1.smithi203.stdout:9/915: link d8/f58 d8/d12/d23/d27/f131 0 2024-04-12T09:11:41.794 INFO:tasks.workunit.client.1.smithi203.stdout:7/984: dread d0/d15/d2d/df2/d108/f90 [0,4194304] 0 2024-04-12T09:11:41.796 INFO:tasks.workunit.client.1.smithi203.stdout:8/968: dread d4/d8/d37/f93 [0,4194304] 0 2024-04-12T09:11:41.799 INFO:tasks.workunit.client.1.smithi203.stdout:3/957: mkdir d2/d8/d14/d23/d35/d91/d130 0 2024-04-12T09:11:41.801 INFO:tasks.workunit.client.1.smithi203.stdout:7/985: creat d0/d34/f13d x:0 0 0 2024-04-12T09:11:41.820 INFO:tasks.workunit.client.1.smithi203.stdout:3/958: truncate d2/d8/d14/d23/d35/d4c/d5c/d55/f66 743073 0 2024-04-12T09:11:41.824 INFO:tasks.workunit.client.1.smithi203.stdout:6/920: getdents d1/df/dd3 0 2024-04-12T09:11:41.825 INFO:tasks.workunit.client.1.smithi203.stdout:6/921: chown d1/d3/d26/d5d/f8b 1357817 1 2024-04-12T09:11:41.830 INFO:tasks.workunit.client.1.smithi203.stdout:3/959: symlink d2/d8/d14/d23/d35/d4c/d5c/d55/l131 0 2024-04-12T09:11:41.831 INFO:tasks.workunit.client.1.smithi203.stdout:8/969: rename d4/d8/d74/db6/lda to d4/d8/d37/d57/d128/dbb/d126/l13d 0 2024-04-12T09:11:41.832 INFO:tasks.workunit.client.1.smithi203.stdout:6/922: stat d1/d3/d26/f79 0 2024-04-12T09:11:41.835 INFO:tasks.workunit.client.1.smithi203.stdout:3/960: dwrite d2/f30 [0,4194304] 0 2024-04-12T09:11:41.840 INFO:tasks.workunit.client.1.smithi203.stdout:7/986: dread d0/d38/d79/fbd [0,4194304] 0 2024-04-12T09:11:41.841 INFO:tasks.workunit.client.1.smithi203.stdout:3/961: unlink d2/d8/d14/d23/d35/d4c/d67/d86/fe8 0 2024-04-12T09:11:41.846 INFO:tasks.workunit.client.1.smithi203.stdout:7/987: creat d0/d15/d2d/df2/d108/dba/d120/f13e x:0 0 0 2024-04-12T09:11:41.847 INFO:tasks.workunit.client.1.smithi203.stdout:3/962: dwrite d2/d8/f11b [0,4194304] 0 2024-04-12T09:11:41.847 INFO:tasks.workunit.client.1.smithi203.stdout:7/988: fsync d0/d34/d7c/fe9 0 2024-04-12T09:11:41.848 INFO:tasks.workunit.client.1.smithi203.stdout:3/963: dread - d2/d8/def/ffd zero size 2024-04-12T09:11:41.850 INFO:tasks.workunit.client.1.smithi203.stdout:8/970: truncate d4/d8/d37/fb7 2194949 0 2024-04-12T09:11:41.852 INFO:tasks.workunit.client.1.smithi203.stdout:6/923: truncate d1/d3/d26/d5d/f8b 2871996 0 2024-04-12T09:11:41.852 INFO:tasks.workunit.client.1.smithi203.stdout:3/964: truncate d2/d8/d14/d23/d35/d91/d81/fd8 82019 0 2024-04-12T09:11:41.852 INFO:tasks.workunit.client.1.smithi203.stdout:7/989: dread d0/d4/d54/f77 [0,4194304] 0 2024-04-12T09:11:41.853 INFO:tasks.workunit.client.1.smithi203.stdout:3/965: chown d2/d8/d14/d23/d35/d91/f9b 292138116 1 2024-04-12T09:11:41.855 INFO:tasks.workunit.client.1.smithi203.stdout:3/966: write d2/d8/d14/d1b/d2f/f111 [1930257,130525] 0 2024-04-12T09:11:41.856 INFO:tasks.workunit.client.1.smithi203.stdout:3/967: chown d2/d8/d14/d23/d35/d91/f5b 52740008 1 2024-04-12T09:11:41.858 INFO:tasks.workunit.client.1.smithi203.stdout:7/990: truncate d0/fe2 420128 0 2024-04-12T09:11:41.861 INFO:tasks.workunit.client.1.smithi203.stdout:8/971: rename d4/ddf/c104 to d4/d8/d1c/d5d/dc9/c13e 0 2024-04-12T09:11:41.861 INFO:tasks.workunit.client.1.smithi203.stdout:6/924: mkdir d1/d3/d91/d11d/d125 0 2024-04-12T09:11:41.869 INFO:tasks.workunit.client.1.smithi203.stdout:3/968: rename d2/l75 to d2/d64/df3/l132 0 2024-04-12T09:11:41.871 INFO:tasks.workunit.client.1.smithi203.stdout:9/916: sync 2024-04-12T09:11:41.877 INFO:tasks.workunit.client.1.smithi203.stdout:9/917: dwrite d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/fe9 [8388608,4194304] 0 2024-04-12T09:11:41.877 INFO:tasks.workunit.client.1.smithi203.stdout:3/969: mkdir d2/d64/d8d/d133 0 2024-04-12T09:11:41.878 INFO:tasks.workunit.client.1.smithi203.stdout:6/925: mkdir d1/d3/d26/d30/d4a/d126 0 2024-04-12T09:11:41.878 INFO:tasks.workunit.client.1.smithi203.stdout:9/918: chown d8/d12/d3e/f84 1 1 2024-04-12T09:11:41.886 INFO:tasks.workunit.client.1.smithi203.stdout:7/991: write d0/d38/f5a [494068,19455] 0 2024-04-12T09:11:41.888 INFO:tasks.workunit.client.1.smithi203.stdout:7/992: truncate d0/d4/d54/da0/d106/df0/f11c 4664291 0 2024-04-12T09:11:41.889 INFO:tasks.workunit.client.1.smithi203.stdout:3/970: rmdir d2/d8/d14/d45 39 2024-04-12T09:11:41.889 INFO:tasks.workunit.client.1.smithi203.stdout:7/993: readlink d0/d4/d54/d75/dc0/lfc 0 2024-04-12T09:11:41.889 INFO:tasks.workunit.client.1.smithi203.stdout:3/971: fdatasync d2/d64/d8d/fb9 0 2024-04-12T09:11:41.890 INFO:tasks.workunit.client.1.smithi203.stdout:6/926: creat d1/d3/d5b/f127 x:0 0 0 2024-04-12T09:11:41.892 INFO:tasks.workunit.client.1.smithi203.stdout:9/919: mknod d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/da9/c132 0 2024-04-12T09:11:41.893 INFO:tasks.workunit.client.1.smithi203.stdout:3/972: chown d2/f83 386 1 2024-04-12T09:11:41.896 INFO:tasks.workunit.client.1.smithi203.stdout:7/994: rename d0/d4/d1c/d5b/dbf/de1/fe7 to d0/d15/d89/df4/f13f 0 2024-04-12T09:11:41.899 INFO:tasks.workunit.client.1.smithi203.stdout:9/920: readlink d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/l53 0 2024-04-12T09:11:41.903 INFO:tasks.workunit.client.1.smithi203.stdout:3/973: mknod d2/d8/d14/d1b/d95/c134 0 2024-04-12T09:11:41.904 INFO:tasks.workunit.client.1.smithi203.stdout:3/974: write d2/d8/d14/f90 [1142525,92608] 0 2024-04-12T09:11:41.905 INFO:tasks.workunit.client.1.smithi203.stdout:7/995: link d0/d4/d1c/d5b/dbf/de1/f114 d0/d4/d1c/d5b/dbf/dc3/d130/f140 0 2024-04-12T09:11:41.907 INFO:tasks.workunit.client.1.smithi203.stdout:8/972: truncate d4/d8/d37/d57/ff4 524874 0 2024-04-12T09:11:41.908 INFO:tasks.workunit.client.1.smithi203.stdout:3/975: creat d2/d64/df3/f135 x:0 0 0 2024-04-12T09:11:41.909 INFO:tasks.workunit.client.1.smithi203.stdout:7/996: rename d0/d4/l109 to d0/d4/d5d/l141 0 2024-04-12T09:11:41.910 INFO:tasks.workunit.client.1.smithi203.stdout:8/973: dread d4/d8/d1c/d5d/dc9/f108 [0,4194304] 0 2024-04-12T09:11:41.914 INFO:tasks.workunit.client.1.smithi203.stdout:8/974: creat d4/d8/d37/d57/d7d/de6/f13f x:0 0 0 2024-04-12T09:11:41.915 INFO:tasks.workunit.client.1.smithi203.stdout:8/975: truncate d4/d8/d1c/d5d/dc9/f108 513767 0 2024-04-12T09:11:41.924 INFO:tasks.workunit.client.1.smithi203.stdout:9/921: write d8/d12/d3e/fdd [913116,11105] 0 2024-04-12T09:11:41.928 INFO:tasks.workunit.client.1.smithi203.stdout:8/976: dread d4/d8/d1c/d5d/f69 [0,4194304] 0 2024-04-12T09:11:41.929 INFO:tasks.workunit.client.1.smithi203.stdout:6/927: dwrite d1/d3/d26/dcb/f103 [4194304,4194304] 0 2024-04-12T09:11:41.932 INFO:tasks.workunit.client.1.smithi203.stdout:9/922: mkdir d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d40/db8/ddf/d133 0 2024-04-12T09:11:41.932 INFO:tasks.workunit.client.1.smithi203.stdout:8/977: mknod d4/ddf/c140 0 2024-04-12T09:11:41.932 INFO:tasks.workunit.client.1.smithi203.stdout:3/976: write d2/d8/d14/d1b/d2f/f32 [4093294,55609] 0 2024-04-12T09:11:41.941 INFO:tasks.workunit.client.1.smithi203.stdout:6/928: dwrite d1/d3/d26/dcb/f103 [4194304,4194304] 0 2024-04-12T09:11:41.943 INFO:tasks.workunit.client.1.smithi203.stdout:9/923: unlink d8/fa 0 2024-04-12T09:11:41.953 INFO:tasks.workunit.client.1.smithi203.stdout:8/978: symlink d4/d8/d37/d57/l141 0 2024-04-12T09:11:41.954 INFO:tasks.workunit.client.1.smithi203.stdout:9/924: creat d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/f134 x:0 0 0 2024-04-12T09:11:41.959 INFO:tasks.workunit.client.1.smithi203.stdout:6/929: link d1/d3/d12/f5e d1/d3/d4/f128 0 2024-04-12T09:11:41.959 INFO:tasks.workunit.client.1.smithi203.stdout:3/977: getdents d2/d64/d8d/de6/d10a 0 2024-04-12T09:11:41.960 INFO:tasks.workunit.client.1.smithi203.stdout:3/978: chown d2/f83 3 1 2024-04-12T09:11:41.973 INFO:tasks.workunit.client.1.smithi203.stdout:3/979: rename d2/d8/d14/d45/df7 to d2/d64/d120/d136 0 2024-04-12T09:11:41.981 INFO:tasks.workunit.client.1.smithi203.stdout:3/980: dwrite d2/f30 [0,4194304] 0 2024-04-12T09:11:41.982 INFO:tasks.workunit.client.1.smithi203.stdout:3/981: readlink d2/d8/d14/d23/d35/d4c/d67/d86/l8e 0 2024-04-12T09:11:41.983 INFO:tasks.workunit.client.1.smithi203.stdout:9/925: unlink d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/fe9 0 2024-04-12T09:11:41.984 INFO:tasks.workunit.client.1.smithi203.stdout:8/979: truncate d4/d8/d74/d111/d116/df2/f102 3335823 0 2024-04-12T09:11:41.986 INFO:tasks.workunit.client.1.smithi203.stdout:6/930: write d1/d3/d12/f5e [1834140,90982] 0 2024-04-12T09:11:41.989 INFO:tasks.workunit.client.1.smithi203.stdout:8/980: mkdir d4/d8/d37/d57/d128/d142 0 2024-04-12T09:11:41.996 INFO:tasks.workunit.client.1.smithi203.stdout:8/981: creat d4/d8/d74/f143 x:0 0 0 2024-04-12T09:11:42.001 INFO:tasks.workunit.client.1.smithi203.stdout:3/982: dwrite d2/d8/d14/d45/fa9 [0,4194304] 0 2024-04-12T09:11:42.004 INFO:tasks.workunit.client.1.smithi203.stdout:6/931: dwrite d1/d3/d26/d30/d4a/f6f [0,4194304] 0 2024-04-12T09:11:42.004 INFO:tasks.workunit.client.1.smithi203.stdout:3/983: write d2/d8/d14/d23/d35/d4c/d67/d86/f114 [581803,76480] 0 2024-04-12T09:11:42.010 INFO:tasks.workunit.client.1.smithi203.stdout:6/932: stat d1/d3/d26/d30/d4a/d6c/d45/d55/d90 0 2024-04-12T09:11:42.011 INFO:tasks.workunit.client.1.smithi203.stdout:3/984: mkdir d2/d64/d120/d136/d137 0 2024-04-12T09:11:42.014 INFO:tasks.workunit.client.1.smithi203.stdout:8/982: dwrite d4/d8/d37/d57/f9f [0,4194304] 0 2024-04-12T09:11:42.018 INFO:tasks.workunit.client.1.smithi203.stdout:8/983: creat d4/d8/d37/d57/d128/f144 x:0 0 0 2024-04-12T09:11:42.019 INFO:tasks.workunit.client.1.smithi203.stdout:3/985: creat d2/d64/d120/d136/d137/f138 x:0 0 0 2024-04-12T09:11:42.023 INFO:tasks.workunit.client.1.smithi203.stdout:8/984: creat d4/d8/d81/d84/d92/f145 x:0 0 0 2024-04-12T09:11:42.024 INFO:tasks.workunit.client.1.smithi203.stdout:8/985: write d4/d8/d1c/d5d/f73 [1065991,12290] 0 2024-04-12T09:11:42.029 INFO:tasks.workunit.client.1.smithi203.stdout:8/986: creat d4/d8/d37/d57/d128/d107/f146 x:0 0 0 2024-04-12T09:11:42.030 INFO:tasks.workunit.client.1.smithi203.stdout:3/986: truncate d2/d8/d14/d23/d35/d4c/d5c/d55/f66 1123517 0 2024-04-12T09:11:42.033 INFO:tasks.workunit.client.1.smithi203.stdout:8/987: mkdir d4/d8/d1c/d5d/dea/dec/d147 0 2024-04-12T09:11:42.035 INFO:tasks.workunit.client.1.smithi203.stdout:6/933: dwrite d1/d3/d26/d30/d4a/d6c/d45/d55/d77/f93 [0,4194304] 0 2024-04-12T09:11:42.037 INFO:tasks.workunit.client.1.smithi203.stdout:3/987: creat d2/d8/d14/f139 x:0 0 0 2024-04-12T09:11:42.037 INFO:tasks.workunit.client.1.smithi203.stdout:6/934: truncate d1/df/dd3/fde 1001867 0 2024-04-12T09:11:42.040 INFO:tasks.workunit.client.1.smithi203.stdout:6/935: mknod d1/d3/d26/d9b/c129 0 2024-04-12T09:11:42.045 INFO:tasks.workunit.client.1.smithi203.stdout:6/936: unlink d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/c94 0 2024-04-12T09:11:42.048 INFO:tasks.workunit.client.1.smithi203.stdout:8/988: link d4/d8/d74/d78/f3a d4/d8/d1c/d5d/dea/d11d/f148 0 2024-04-12T09:11:42.053 INFO:tasks.workunit.client.1.smithi203.stdout:8/989: write d4/d8/d1c/f31 [1725513,63947] 0 2024-04-12T09:11:42.057 INFO:tasks.workunit.client.1.smithi203.stdout:3/988: rename d2/d8/d14/d1b/d95/c134 to d2/d8/c13a 0 2024-04-12T09:11:42.065 INFO:tasks.workunit.client.1.smithi203.stdout:3/989: truncate d2/d8/d14/d45/dcb/d118/d65/f77 1046446 0 2024-04-12T09:11:42.065 INFO:tasks.workunit.client.1.smithi203.stdout:3/990: fsync d2/d8/d14/d45/dcb/d118/d65/fc1 0 2024-04-12T09:11:42.071 INFO:tasks.workunit.client.1.smithi203.stdout:3/991: symlink d2/d8/d14/d45/d10f/l13b 0 2024-04-12T09:11:42.071 INFO:tasks.workunit.client.1.smithi203.stdout:7/997: sync 2024-04-12T09:11:42.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:41 smithi203 ceph-mon[36428]: pgmap v31: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 82 MiB/s rd, 210 MiB/s wr, 432 op/s 2024-04-12T09:11:42.073 INFO:tasks.workunit.client.1.smithi203.stdout:6/937: write d1/d3/d26/d5d/f82 [196634,124210] 0 2024-04-12T09:11:42.074 INFO:tasks.workunit.client.1.smithi203.stdout:3/992: rmdir d2/d8/d14/d23/d35/d4c/d5c/d55 39 2024-04-12T09:11:42.074 INFO:tasks.workunit.client.1.smithi203.stdout:6/938: write d1/f37 [4405486,118728] 0 2024-04-12T09:11:42.079 INFO:tasks.workunit.client.1.smithi203.stdout:3/993: symlink d2/d8/d14/d1b/d2f/dd4/l13c 0 2024-04-12T09:11:42.079 INFO:tasks.workunit.client.1.smithi203.stdout:6/939: mknod d1/df/dd3/c12a 0 2024-04-12T09:11:42.082 INFO:tasks.workunit.client.1.smithi203.stdout:6/940: fsync d1/d3/d26/d9b/de2/d112/f115 0 2024-04-12T09:11:42.082 INFO:tasks.workunit.client.1.smithi203.stdout:8/990: dwrite d4/d8/d1c/f82 [0,4194304] 0 2024-04-12T09:11:42.083 INFO:tasks.workunit.client.1.smithi203.stdout:3/994: dread d2/d8/d14/d23/d35/d91/d81/fd8 [0,4194304] 0 2024-04-12T09:11:42.086 INFO:tasks.workunit.client.1.smithi203.stdout:8/991: mknod d4/d8/d74/d78/c149 0 2024-04-12T09:11:42.087 INFO:tasks.workunit.client.1.smithi203.stdout:7/998: dwrite d0/d34/feb [0,4194304] 0 2024-04-12T09:11:42.089 INFO:tasks.workunit.client.1.smithi203.stdout:6/941: creat d1/d3/d5b/d8c/d3e/da1/d104/f12b x:0 0 0 2024-04-12T09:11:42.098 INFO:tasks.workunit.client.1.smithi203.stdout:8/992: link d4/d8/d81/f8b d4/d8/d37/d57/d128/d142/f14a 0 2024-04-12T09:11:42.099 INFO:tasks.workunit.client.1.smithi203.stdout:6/942: mknod d1/df/d65/d96/d120/c12c 0 2024-04-12T09:11:42.113 INFO:tasks.workunit.client.1.smithi203.stdout:6/943: dread d1/d3/d26/d30/d4a/d6c/f40 [0,4194304] 0 2024-04-12T09:11:42.189 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:41 smithi117 ceph-mon[29277]: pgmap v31: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 82 MiB/s rd, 210 MiB/s wr, 432 op/s 2024-04-12T09:11:42.192 INFO:tasks.workunit.client.1.smithi203.stdout:6/944: mkdir d1/df/d87/d7a/d12d 0 2024-04-12T09:11:42.192 INFO:tasks.workunit.client.1.smithi203.stdout:6/945: fsync d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/d9c/ff0 0 2024-04-12T09:11:42.192 INFO:tasks.workunit.client.1.smithi203.stdout:6/946: write d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/db5/fe4 [4594412,69647] 0 2024-04-12T09:11:42.192 INFO:tasks.workunit.client.1.smithi203.stdout:7/999: dwrite d0/d4/d1c/faa [0,4194304] 0 2024-04-12T09:11:42.192 INFO:tasks.workunit.client.1.smithi203.stdout:6/947: write d1/d3/f2d [5784119,29159] 0 2024-04-12T09:11:42.192 INFO:tasks.workunit.client.1.smithi203.stdout:8/993: dwrite d4/d8/d1c/d5d/f94 [0,4194304] 0 2024-04-12T09:11:42.193 INFO:tasks.workunit.client.1.smithi203.stdout:6/948: chown d1/d3/d26/d30/d4a/f7d 109268 1 2024-04-12T09:11:42.193 INFO:tasks.workunit.client.1.smithi203.stdout:6/949: rmdir d1/df/d65/dbc/df8/d10b 0 2024-04-12T09:11:42.193 INFO:tasks.workunit.client.1.smithi203.stdout:6/950: chown d1/d3/d5b 7043619 1 2024-04-12T09:11:42.193 INFO:tasks.workunit.client.1.smithi203.stdout:6/951: truncate d1/d3/d26/d30/d4a/d6c/d45/d55/f71 4714000 0 2024-04-12T09:11:42.193 INFO:tasks.workunit.client.1.smithi203.stdout:8/994: write d4/d8/d1c/d5d/d122/f137 [270323,83341] 0 2024-04-12T09:11:42.193 INFO:tasks.workunit.client.1.smithi203.stdout:6/952: mknod d1/c12e 0 2024-04-12T09:11:42.193 INFO:tasks.workunit.client.1.smithi203.stdout:8/995: rmdir d4/d8/d74/d78/d53/d8f 39 2024-04-12T09:11:42.193 INFO:tasks.workunit.client.1.smithi203.stdout:6/953: mkdir d1/d3/d26/d30/d4a/d6c/d45/d10c/d12f 0 2024-04-12T09:11:42.193 INFO:tasks.workunit.client.1.smithi203.stdout:8/996: mkdir d4/d135/d14b 0 2024-04-12T09:11:42.193 INFO:tasks.workunit.client.1.smithi203.stdout:6/954: rmdir d1/d3/d91/d11d 39 2024-04-12T09:11:42.193 INFO:tasks.workunit.client.1.smithi203.stdout:6/955: truncate d1/f124 116265 0 2024-04-12T09:11:42.193 INFO:tasks.workunit.client.1.smithi203.stdout:9/926: sync 2024-04-12T09:11:42.193 INFO:tasks.workunit.client.1.smithi203.stdout:6/956: dwrite d1/d3/d5b/d8c/fc0 [0,4194304] 0 2024-04-12T09:11:42.193 INFO:tasks.workunit.client.1.smithi203.stdout:8/997: write d4/d8/d74/d78/f43 [129767,68734] 0 2024-04-12T09:11:42.193 INFO:tasks.workunit.client.1.smithi203.stdout:6/957: mkdir d1/d3/d26/d5d/d130 0 2024-04-12T09:11:42.194 INFO:tasks.workunit.client.1.smithi203.stdout:9/927: truncate d8/d12/d23/d85/f46 2675862 0 2024-04-12T09:11:42.194 INFO:tasks.workunit.client.1.smithi203.stdout:6/958: mkdir d1/d3/d26/d30/d4a/d126/d131 0 2024-04-12T09:11:42.194 INFO:tasks.workunit.client.1.smithi203.stdout:6/959: dread d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/db5/ff2 [0,4194304] 0 2024-04-12T09:11:42.194 INFO:tasks.workunit.client.1.smithi203.stdout:8/998: dwrite d4/d8/d1c/d5d/dc0/fd5 [0,4194304] 0 2024-04-12T09:11:42.194 INFO:tasks.workunit.client.1.smithi203.stdout:9/928: write d8/f2a [4283418,42229] 0 2024-04-12T09:11:42.194 INFO:tasks.workunit.client.1.smithi203.stdout:8/999: rmdir d4/d8/d37/d57 39 2024-04-12T09:11:42.194 INFO:tasks.workunit.client.1.smithi203.stdout:6/960: dwrite d1/d3/f39 [0,4194304] 0 2024-04-12T09:11:42.195 INFO:tasks.workunit.client.1.smithi203.stdout:6/961: dwrite d1/df/dd3/fde [0,4194304] 0 2024-04-12T09:11:42.195 INFO:tasks.workunit.client.1.smithi203.stdout:6/962: chown d1/d3/d26/d9b 954717 1 2024-04-12T09:11:42.195 INFO:tasks.workunit.client.1.smithi203.stdout:6/963: stat d1/d3/d4/f128 0 2024-04-12T09:11:42.201 INFO:tasks.workunit.client.1.smithi203.stdout:6/964: creat d1/d3/d26/d30/d4a/f132 x:0 0 0 2024-04-12T09:11:42.202 INFO:tasks.workunit.client.1.smithi203.stdout:6/965: fdatasync d1/d3/f8f 0 2024-04-12T09:11:42.217 INFO:tasks.workunit.client.1.smithi203.stdout:9/929: dread d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d40/db8/f100 [0,4194304] 0 2024-04-12T09:11:42.223 INFO:tasks.workunit.client.1.smithi203.stdout:6/966: dread d1/d3/d26/d30/d4a/d6c/f44 [0,4194304] 0 2024-04-12T09:11:42.224 INFO:tasks.workunit.client.1.smithi203.stdout:3/995: sync 2024-04-12T09:11:42.262 INFO:tasks.workunit.client.1.smithi203.stdout:3/996: creat d2/d8/d14/d23/d35/d4c/d67/d86/f13d x:0 0 0 2024-04-12T09:11:42.262 INFO:tasks.workunit.client.1.smithi203.stdout:9/930: mknod d8/d12/d23/d85/de1/c135 0 2024-04-12T09:11:42.291 INFO:tasks.workunit.client.1.smithi203.stdout:6/967: sync 2024-04-12T09:11:42.293 INFO:tasks.workunit.client.1.smithi203.stdout:3/997: rmdir d2/d8/d14/d23/d35/d4c/d67/d86 39 2024-04-12T09:11:42.294 INFO:tasks.workunit.client.1.smithi203.stdout:6/968: rmdir d1/d3/d5b/d8c/d3e/da1 39 2024-04-12T09:11:42.294 INFO:tasks.workunit.client.1.smithi203.stdout:3/998: write d2/d8/d14/d23/d35/d91/fad [2146744,120030] 0 2024-04-12T09:11:42.294 INFO:tasks.workunit.client.1.smithi203.stdout:9/931: write d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/fb5 [748739,79711] 0 2024-04-12T09:11:42.299 INFO:tasks.workunit.client.1.smithi203.stdout:9/932: creat d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/f136 x:0 0 0 2024-04-12T09:11:42.301 INFO:tasks.workunit.client.1.smithi203.stdout:9/933: truncate d8/d12/d23/d38/d8a/d97/d9e/d74/ff5 1010796 0 2024-04-12T09:11:42.303 INFO:tasks.workunit.client.1.smithi203.stdout:3/999: link d2/d8/d14/d23/d35/d4c/d5c/fd7 d2/d64/d120/f13e 0 2024-04-12T09:11:42.305 INFO:tasks.workunit.client.1.smithi203.stdout:9/934: unlink d8/d12/d23/d85/lda 0 2024-04-12T09:11:42.309 INFO:tasks.workunit.client.1.smithi203.stdout:9/935: rename d8/d12/d23/d41/f5e to d8/d12/d23/d38/d8a/d97/d9e/d74/dc7/d10e/f137 0 2024-04-12T09:11:42.310 INFO:tasks.workunit.client.1.smithi203.stdout:6/969: truncate d1/d3/d26/d30/d4a/d6c/d45/f49 2325786 0 2024-04-12T09:11:42.313 INFO:tasks.workunit.client.1.smithi203.stdout:6/970: symlink d1/d3/d5b/l133 0 2024-04-12T09:11:42.316 INFO:tasks.workunit.client.1.smithi203.stdout:6/971: creat d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/d9c/def/f134 x:0 0 0 2024-04-12T09:11:42.318 INFO:tasks.workunit.client.1.smithi203.stdout:6/972: mkdir d1/d3/d26/d36/d135 0 2024-04-12T09:11:42.322 INFO:tasks.workunit.client.1.smithi203.stdout:9/936: write d8/d12/d3e/d90/f98 [177542,112590] 0 2024-04-12T09:11:42.323 INFO:tasks.workunit.client.1.smithi203.stdout:6/973: creat d1/df/f136 x:0 0 0 2024-04-12T09:11:42.323 INFO:tasks.workunit.client.1.smithi203.stdout:9/937: write d8/f8d [1010230,102885] 0 2024-04-12T09:11:42.328 INFO:tasks.workunit.client.1.smithi203.stdout:6/974: truncate d1/d3/d26/d30/f7c 875991 0 2024-04-12T09:11:42.330 INFO:tasks.workunit.client.1.smithi203.stdout:6/975: read - d1/d3/d26/d30/d4a/d6c/d45/d55/d8e/fbf zero size 2024-04-12T09:11:42.337 INFO:tasks.workunit.client.1.smithi203.stdout:6/976: dwrite d1/d3/d26/d30/d4a/f7d [4194304,4194304] 0 2024-04-12T09:11:42.339 INFO:tasks.workunit.client.1.smithi203.stdout:9/938: dread d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/f61 [0,4194304] 0 2024-04-12T09:11:42.346 INFO:tasks.workunit.client.1.smithi203.stdout:9/939: dwrite d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/f116 [4194304,4194304] 0 2024-04-12T09:11:42.346 INFO:tasks.workunit.client.1.smithi203.stdout:6/977: creat d1/d3/d91/d11d/f137 x:0 0 0 2024-04-12T09:11:42.350 INFO:tasks.workunit.client.1.smithi203.stdout:6/978: creat d1/d3/d5b/d8c/f138 x:0 0 0 2024-04-12T09:11:42.352 INFO:tasks.workunit.client.1.smithi203.stdout:9/940: mknod d8/d12/d3e/d90/c138 0 2024-04-12T09:11:42.357 INFO:tasks.workunit.client.1.smithi203.stdout:6/979: creat d1/d3/d5b/d8c/d3e/f139 x:0 0 0 2024-04-12T09:11:42.358 INFO:tasks.workunit.client.1.smithi203.stdout:9/941: creat d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/da9/d112/f139 x:0 0 0 2024-04-12T09:11:42.358 INFO:tasks.workunit.client.1.smithi203.stdout:6/980: stat d1/d3/f8f 0 2024-04-12T09:11:42.359 INFO:tasks.workunit.client.1.smithi203.stdout:9/942: dread - d8/d12/d23/d85/df6/ff7 zero size 2024-04-12T09:11:42.365 INFO:tasks.workunit.client.1.smithi203.stdout:6/981: getdents d1/df/d65/dbc/df8 0 2024-04-12T09:11:42.371 INFO:tasks.workunit.client.1.smithi203.stdout:6/982: dwrite d1/d3/d12/ff9 [0,4194304] 0 2024-04-12T09:11:42.373 INFO:tasks.workunit.client.1.smithi203.stdout:6/983: truncate d1/d3/d26/d30/d4a/d6c/d45/d55/d123/fe1 671647 0 2024-04-12T09:11:42.379 INFO:tasks.workunit.client.1.smithi203.stdout:6/984: dwrite d1/d3/d26/dcb/fdc [0,4194304] 0 2024-04-12T09:11:42.384 INFO:tasks.workunit.client.1.smithi203.stdout:6/985: symlink d1/d3/d26/d5d/l13a 0 2024-04-12T09:11:42.389 INFO:tasks.workunit.client.1.smithi203.stdout:9/943: getdents d8/d12/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/da9/d112 0 2024-04-12T09:11:42.401 INFO:tasks.workunit.client.1.smithi203.stdout:9/944: rename d8/d12 to d8/d3b/d120/d13a 0 2024-04-12T09:11:42.405 INFO:tasks.workunit.client.1.smithi203.stdout:6/986: getdents d1/d3/d26/d30/d4a/d6c/d45/d55 0 2024-04-12T09:11:42.406 INFO:tasks.workunit.client.1.smithi203.stdout:9/945: dwrite d8/d3b/db7/f111 [0,4194304] 0 2024-04-12T09:11:42.407 INFO:tasks.workunit.client.1.smithi203.stdout:6/987: fsync d1/d3/d5b/d8c/f66 0 2024-04-12T09:11:42.408 INFO:tasks.workunit.client.1.smithi203.stdout:9/946: write d8/d3b/d120/d13a/d23/d85/f1f [5533461,127729] 0 2024-04-12T09:11:42.420 INFO:tasks.workunit.client.1.smithi203.stdout:6/988: dread d1/d3/d26/f79 [0,4194304] 0 2024-04-12T09:11:42.423 INFO:tasks.workunit.client.1.smithi203.stdout:9/947: write d8/d3b/d120/d13a/d23/d85/f1d [4864527,101178] 0 2024-04-12T09:11:42.424 INFO:tasks.workunit.client.1.smithi203.stdout:6/989: creat d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/d9c/f13b x:0 0 0 2024-04-12T09:11:42.427 INFO:tasks.workunit.client.1.smithi203.stdout:9/948: creat d8/d3b/d120/d13a/d23/d41/f13b x:0 0 0 2024-04-12T09:11:42.433 INFO:tasks.workunit.client.1.smithi203.stdout:9/949: dwrite d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/d8e/f43 [0,4194304] 0 2024-04-12T09:11:42.434 INFO:tasks.workunit.client.1.smithi203.stdout:9/950: fsync d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/f127 0 2024-04-12T09:11:42.436 INFO:tasks.workunit.client.1.smithi203.stdout:6/990: rmdir d1/d3/d26/d30/d4a/d6c/d45/d55/d77/d43/d9c 39 2024-04-12T09:11:42.438 INFO:tasks.workunit.client.1.smithi203.stdout:9/951: dread d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/d8e/d2c/fb5 [0,4194304] 0 2024-04-12T09:11:42.456 INFO:tasks.workunit.client.1.smithi203.stdout:6/991: truncate d1/d3/d26/d30/d4a/d6c/d45/d55/f71 61519 0 2024-04-12T09:11:42.457 INFO:tasks.workunit.client.1.smithi203.stdout:6/992: dread - d1/d3/d5b/d8c/ffd zero size 2024-04-12T09:11:42.459 INFO:tasks.workunit.client.1.smithi203.stdout:6/993: creat d1/d3/d12/f13c x:0 0 0 2024-04-12T09:11:42.467 INFO:tasks.workunit.client.1.smithi203.stdout:6/994: dwrite d1/d3/d5b/d8c/d3e/da1/fe9 [0,4194304] 0 2024-04-12T09:11:42.475 INFO:tasks.workunit.client.1.smithi203.stdout:6/995: dwrite d1/df/d65/d96/f11e [0,4194304] 0 2024-04-12T09:11:42.477 INFO:tasks.workunit.client.1.smithi203.stdout:6/996: write d1/d3/d4/f128 [2830804,8199] 0 2024-04-12T09:11:42.483 INFO:tasks.workunit.client.1.smithi203.stdout:6/997: unlink d1/d3/d26/d30/d4a/d6c/d45/d55/d8e/fbf 0 2024-04-12T09:11:42.551 INFO:tasks.workunit.client.1.smithi203.stdout:9/952: sync 2024-04-12T09:11:42.566 INFO:tasks.workunit.client.1.smithi203.stdout:9/953: dread d8/d3b/d120/d13a/d23/d85/f94 [0,4194304] 0 2024-04-12T09:11:42.567 INFO:tasks.workunit.client.1.smithi203.stdout:9/954: fsync d8/d3b/d120/d13a/d23/d38/d8a/d97/de0/f119 0 2024-04-12T09:11:42.574 INFO:tasks.workunit.client.1.smithi203.stdout:6/998: sync 2024-04-12T09:11:42.576 INFO:tasks.workunit.client.1.smithi203.stdout:6/999: mknod d1/d3/d12/c13d 0 2024-04-12T09:11:42.578 INFO:tasks.workunit.client.1.smithi203.stdout:9/955: dread d8/d3b/d120/d13a/d23/d27/fc8 [0,4194304] 0 2024-04-12T09:11:42.580 INFO:tasks.workunit.client.1.smithi203.stdout:9/956: mkdir d8/d3b/d120/d13a/d23/db3/d13c 0 2024-04-12T09:11:42.586 INFO:tasks.workunit.client.1.smithi203.stdout:9/957: dread d8/fb [0,4194304] 0 2024-04-12T09:11:42.587 INFO:tasks.workunit.client.1.smithi203.stdout:9/958: chown d8/d3b/d120/d13a/d3e/d90/f98 5 1 2024-04-12T09:11:42.592 INFO:tasks.workunit.client.1.smithi203.stdout:9/959: rename d8/d3b/d120/d13a/d3e/d90/d60/daf to d8/d3b/d120/d13a/d23/d85/de1/de6/d13d 0 2024-04-12T09:11:42.616 INFO:tasks.workunit.client.1.smithi203.stdout:9/960: dwrite d8/d3b/d120/d13a/d3e/ff4 [4194304,4194304] 0 2024-04-12T09:11:42.624 INFO:tasks.workunit.client.1.smithi203.stdout:9/961: dwrite d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/d8e/d2c/f9f [4194304,4194304] 0 2024-04-12T09:11:42.625 INFO:tasks.workunit.client.1.smithi203.stdout:9/962: write d8/f34 [1108894,50064] 0 2024-04-12T09:11:42.629 INFO:tasks.workunit.client.1.smithi203.stdout:9/963: symlink d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/da9/d112/l13e 0 2024-04-12T09:11:42.631 INFO:tasks.workunit.client.1.smithi203.stdout:9/964: write d8/d3b/d120/d13a/d23/d85/df6/ff7 [154621,124933] 0 2024-04-12T09:11:42.636 INFO:tasks.workunit.client.1.smithi203.stdout:9/965: unlink d8/d3b/d120/d13a/d23/db3/lc5 0 2024-04-12T09:11:42.637 INFO:tasks.workunit.client.1.smithi203.stdout:9/966: stat d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/d8e/dfb/cfd 0 2024-04-12T09:11:42.639 INFO:tasks.workunit.client.1.smithi203.stdout:9/967: mkdir d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/dc7/d13f 0 2024-04-12T09:11:42.642 INFO:tasks.workunit.client.1.smithi203.stdout:9/968: symlink d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/d8e/l140 0 2024-04-12T09:11:42.643 INFO:tasks.workunit.client.1.smithi203.stdout:9/969: creat d8/d3b/d120/d13a/d23/d85/df6/f141 x:0 0 0 2024-04-12T09:11:42.647 INFO:tasks.workunit.client.1.smithi203.stdout:9/970: dread d8/d3b/d120/d13a/d23/d38/fd9 [0,4194304] 0 2024-04-12T09:11:42.650 INFO:tasks.workunit.client.1.smithi203.stdout:9/971: unlink d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/ld6 0 2024-04-12T09:11:42.656 INFO:tasks.workunit.client.1.smithi203.stdout:9/972: link d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/d8e/l140 d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/l142 0 2024-04-12T09:11:42.657 INFO:tasks.workunit.client.1.smithi203.stdout:9/973: rename d8/d3b/d120/d13a to d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d40/d143 22 2024-04-12T09:11:42.669 INFO:tasks.workunit.client.1.smithi203.stdout:9/974: getdents d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d 0 2024-04-12T09:11:42.670 INFO:tasks.workunit.client.1.smithi203.stdout:9/975: fdatasync d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/d8e/f136 0 2024-04-12T09:11:42.675 INFO:tasks.workunit.client.1.smithi203.stdout:9/976: write d8/d3b/d120/d13a/d23/d85/de1/de6/f102 [3790802,51579] 0 2024-04-12T09:11:42.678 INFO:tasks.workunit.client.1.smithi203.stdout:9/977: mkdir d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/da9/d144 0 2024-04-12T09:11:42.684 INFO:tasks.workunit.client.1.smithi203.stdout:9/978: dwrite d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/d8e/d2c/f4c [8388608,4194304] 0 2024-04-12T09:11:42.689 INFO:tasks.workunit.client.1.smithi203.stdout:9/979: rename d8/d3b/d120/d13a/d3e/d90/d60/l8c to d8/d3b/d120/l145 0 2024-04-12T09:11:42.690 INFO:tasks.workunit.client.1.smithi203.stdout:9/980: read - d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/f127 zero size 2024-04-12T09:11:42.696 INFO:tasks.workunit.client.1.smithi203.stdout:9/981: mkdir d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d146 0 2024-04-12T09:11:42.697 INFO:tasks.workunit.client.1.smithi203.stdout:9/982: chown d8/d3b/d120/d13a/d23/d38/d8a/d97/de0 5428 1 2024-04-12T09:11:42.704 INFO:tasks.workunit.client.1.smithi203.stdout:9/983: link d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/d8e/f134 d8/d3b/d120/d13a/d23/d38/d8a/d97/f147 0 2024-04-12T09:11:42.709 INFO:tasks.workunit.client.1.smithi203.stdout:9/984: dread d8/d3b/d120/f130 [0,4194304] 0 2024-04-12T09:11:42.710 INFO:tasks.workunit.client.1.smithi203.stdout:9/985: chown d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/l99 5859418 1 2024-04-12T09:11:42.716 INFO:tasks.workunit.client.1.smithi203.stdout:9/986: dwrite d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/ff5 [0,4194304] 0 2024-04-12T09:11:42.723 INFO:tasks.workunit.client.1.smithi203.stdout:9/987: dwrite d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/ff5 [0,4194304] 0 2024-04-12T09:11:42.725 INFO:tasks.workunit.client.1.smithi203.stdout:9/988: chown d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/dc7 122 1 2024-04-12T09:11:42.727 INFO:tasks.workunit.client.1.smithi203.stdout:9/989: fsync d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/d8e/d2c/dca/dd1/ff9 0 2024-04-12T09:11:42.729 INFO:tasks.workunit.client.1.smithi203.stdout:9/990: stat d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/d8e 0 2024-04-12T09:11:42.735 INFO:tasks.workunit.client.1.smithi203.stdout:9/991: rename d8/d3b/d120/d13a/d23/d27/fbc to d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/da9/d112/f148 0 2024-04-12T09:11:42.739 INFO:tasks.workunit.client.1.smithi203.stdout:9/992: rmdir d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/dc7/d10e 39 2024-04-12T09:11:42.743 INFO:tasks.workunit.client.1.smithi203.stdout:9/993: symlink d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/dc7/d13f/l149 0 2024-04-12T09:11:42.744 INFO:tasks.workunit.client.1.smithi203.stdout:9/994: chown d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/d8e/c10d 24557 1 2024-04-12T09:11:42.758 INFO:tasks.workunit.client.1.smithi203.stdout:9/995: dread d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/f86 [0,4194304] 0 2024-04-12T09:11:42.760 INFO:tasks.workunit.client.1.smithi203.stdout:9/996: dread - d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/d8e/d2c/d5d/da9/d112/f139 zero size 2024-04-12T09:11:42.771 INFO:tasks.workunit.client.1.smithi203.stdout:9/997: dread d8/d3b/d120/d13a/d23/d38/d8a/d97/d9e/d74/d8e/d2c/f9f [0,4194304] 0 2024-04-12T09:11:42.774 INFO:tasks.workunit.client.1.smithi203.stdout:9/998: stat d8/l69 0 2024-04-12T09:11:42.780 INFO:tasks.workunit.client.1.smithi203.stdout:9/999: dwrite d8/d3b/d120/d13a/d23/d85/de1/de6/f102 [4194304,4194304] 0 2024-04-12T09:11:42.784 INFO:tasks.workunit.client.1.smithi203.stderr:+ rm -rf -- ./tmp.p7ILWHDxgp 2024-04-12T09:11:44.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:43 smithi203 ceph-mon[36428]: pgmap v32: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 112 MiB/s rd, 273 MiB/s wr, 609 op/s 2024-04-12T09:11:44.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:43 smithi117 ceph-mon[29277]: pgmap v32: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 112 MiB/s rd, 273 MiB/s wr, 609 op/s 2024-04-12T09:11:45.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:44 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:11:45.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:44 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:11:46.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:45 smithi117 ceph-mon[29277]: pgmap v33: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 78 MiB/s rd, 167 MiB/s wr, 403 op/s 2024-04-12T09:11:46.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:45 smithi203 ceph-mon[36428]: pgmap v33: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 78 MiB/s rd, 167 MiB/s wr, 403 op/s 2024-04-12T09:11:48.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:47 smithi117 ceph-mon[29277]: pgmap v34: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 87 MiB/s rd, 198 MiB/s wr, 508 op/s 2024-04-12T09:11:48.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:47 smithi203 ceph-mon[36428]: pgmap v34: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 87 MiB/s rd, 198 MiB/s wr, 508 op/s 2024-04-12T09:11:50.121 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:49 smithi117 ceph-mon[29277]: pgmap v35: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 43 MiB/s rd, 106 MiB/s wr, 300 op/s 2024-04-12T09:11:50.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:49 smithi203 ceph-mon[36428]: pgmap v35: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 43 MiB/s rd, 106 MiB/s wr, 300 op/s 2024-04-12T09:11:52.080 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:51 smithi117 ceph-mon[29277]: pgmap v36: 65 pgs: 65 active+clean; 3.3 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 43 MiB/s rd, 107 MiB/s wr, 315 op/s 2024-04-12T09:11:52.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:51 smithi203 ceph-mon[36428]: pgmap v36: 65 pgs: 65 active+clean; 3.3 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 43 MiB/s rd, 107 MiB/s wr, 315 op/s 2024-04-12T09:11:54.111 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:53 smithi117 ceph-mon[29277]: pgmap v37: 65 pgs: 65 active+clean; 2.6 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 39 MiB/s rd, 94 MiB/s wr, 355 op/s 2024-04-12T09:11:54.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.110+0000 7f66ea984700 1 -- 172.21.15.117:0/2469739771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66e4066240 msgr2=0x7f66e40ffa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:54.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.110+0000 7f66ea984700 1 --2- 172.21.15.117:0/2469739771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66e4066240 0x7f66e40ffa60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f66d4004940 tx=0x7f66d4009e30 comp rx=0 tx=0).stop 2024-04-12T09:11:54.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.110+0000 7f66ea984700 1 -- 172.21.15.117:0/2469739771 shutdown_connections 2024-04-12T09:11:54.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.110+0000 7f66ea984700 1 --2- 172.21.15.117:0/2469739771 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f66e40fffa0 0x7f66e4102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:54.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.110+0000 7f66ea984700 1 --2- 172.21.15.117:0/2469739771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66e4066240 0x7f66e40ffa60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:54.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.110+0000 7f66ea984700 1 -- 172.21.15.117:0/2469739771 >> 172.21.15.117:0/2469739771 conn(0x7f66e40f7430 msgr2=0x7f66e40f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:11:54.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.110+0000 7f66ea984700 1 -- 172.21.15.117:0/2469739771 shutdown_connections 2024-04-12T09:11:54.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.110+0000 7f66ea984700 1 -- 172.21.15.117:0/2469739771 wait complete. 2024-04-12T09:11:54.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.110+0000 7f66ea984700 1 Processor -- start 2024-04-12T09:11:54.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.111+0000 7f66ea984700 1 -- start start 2024-04-12T09:11:54.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.111+0000 7f66ea984700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f66e4066240 0x7f66e40fd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:54.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.111+0000 7f66ea984700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66e40fffa0 0x7f66e40fb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:54.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.111+0000 7f66ea984700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e40fbf30 con 0x7f66e40fffa0 2024-04-12T09:11:54.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.111+0000 7f66ea984700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e40fc070 con 0x7f66e4066240 2024-04-12T09:11:54.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.111+0000 7f66e37fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66e40fffa0 0x7f66e40fb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:54.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.111+0000 7f66e37fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66e40fffa0 0x7f66e40fb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51344/0 (socket says 172.21.15.117:51344) 2024-04-12T09:11:54.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.111+0000 7f66e3fff700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f66e4066240 0x7f66e40fd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:54.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.111+0000 7f66e37fe700 1 -- 172.21.15.117:0/2298371758 learned_addr learned my addr 172.21.15.117:0/2298371758 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:11:54.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.111+0000 7f66e37fe700 1 -- 172.21.15.117:0/2298371758 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f66e4066240 msgr2=0x7f66e40fd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:54.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.111+0000 7f66e37fe700 1 --2- 172.21.15.117:0/2298371758 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f66e4066240 0x7f66e40fd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:54.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.111+0000 7f66e37fe700 1 -- 172.21.15.117:0/2298371758 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d4005040 con 0x7f66e40fffa0 2024-04-12T09:11:54.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.111+0000 7f66e37fe700 1 --2- 172.21.15.117:0/2298371758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66e40fffa0 0x7f66e40fb960 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f66d800b790 tx=0x7f66d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:11:54.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.112+0000 7f66e0ff9700 1 -- 172.21.15.117:0/2298371758 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66d800f6f0 con 0x7f66e40fffa0 2024-04-12T09:11:54.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.112+0000 7f66e0ff9700 1 -- 172.21.15.117:0/2298371758 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f66d800fd20 con 0x7f66e40fffa0 2024-04-12T09:11:54.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.112+0000 7f66e0ff9700 1 -- 172.21.15.117:0/2298371758 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66d80103a0 con 0x7f66e40fffa0 2024-04-12T09:11:54.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.112+0000 7f66ea984700 1 -- 172.21.15.117:0/2298371758 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e40fc350 con 0x7f66e40fffa0 2024-04-12T09:11:54.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.112+0000 7f66ea984700 1 -- 172.21.15.117:0/2298371758 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e4115b10 con 0x7f66e40fffa0 2024-04-12T09:11:54.115 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.113+0000 7f66ea984700 1 -- 172.21.15.117:0/2298371758 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e405f5f0 con 0x7f66e40fffa0 2024-04-12T09:11:54.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.113+0000 7f66e0ff9700 1 -- 172.21.15.117:0/2298371758 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 25) v1 ==== 89201+0+0 (secure 0 0 0) 0x7f66d8011400 con 0x7f66e40fffa0 2024-04-12T09:11:54.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.113+0000 7f66e0ff9700 1 --2- 172.21.15.117:0/2298371758 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f66cc06b540 0x7f66cc06d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:54.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.114+0000 7f66e0ff9700 1 -- 172.21.15.117:0/2298371758 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f66d8089e10 con 0x7f66e40fffa0 2024-04-12T09:11:54.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.114+0000 7f66e3fff700 1 --2- 172.21.15.117:0/2298371758 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f66cc06b540 0x7f66cc06d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:54.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.114+0000 7f66e3fff700 1 --2- 172.21.15.117:0/2298371758 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f66cc06b540 0x7f66cc06d9f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f66e40fd180 tx=0x7f66d4009e30 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:11:54.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.118+0000 7f66e0ff9700 1 -- 172.21.15.117:0/2298371758 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f66d8053cc0 con 0x7f66e40fffa0 2024-04-12T09:11:54.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:53 smithi203 ceph-mon[36428]: pgmap v37: 65 pgs: 65 active+clean; 2.6 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 39 MiB/s rd, 94 MiB/s wr, 355 op/s 2024-04-12T09:11:54.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.455+0000 7f66ea984700 1 -- 172.21.15.117:0/2298371758 --> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f66e40f8f70 con 0x7f66cc06b540 2024-04-12T09:11:54.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.456+0000 7f66e0ff9700 1 -- 172.21.15.117:0/2298371758 <== mgr.24371 v2:172.21.15.203:6828/2773660052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f66e40f8f70 con 0x7f66cc06b540 2024-04-12T09:11:54.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.458+0000 7f66ea984700 1 -- 172.21.15.117:0/2298371758 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f66cc06b540 msgr2=0x7f66cc06d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:54.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.458+0000 7f66ea984700 1 --2- 172.21.15.117:0/2298371758 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f66cc06b540 0x7f66cc06d9f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f66e40fd180 tx=0x7f66d4009e30 comp rx=0 tx=0).stop 2024-04-12T09:11:54.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.458+0000 7f66ea984700 1 -- 172.21.15.117:0/2298371758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66e40fffa0 msgr2=0x7f66e40fb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:54.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.458+0000 7f66ea984700 1 --2- 172.21.15.117:0/2298371758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66e40fffa0 0x7f66e40fb960 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f66d800b790 tx=0x7f66d8009250 comp rx=0 tx=0).stop 2024-04-12T09:11:54.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.458+0000 7f66ea984700 1 -- 172.21.15.117:0/2298371758 shutdown_connections 2024-04-12T09:11:54.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.458+0000 7f66ea984700 1 --2- 172.21.15.117:0/2298371758 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f66e4066240 0x7f66e40fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:54.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.458+0000 7f66ea984700 1 --2- 172.21.15.117:0/2298371758 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f66cc06b540 0x7f66cc06d9f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:54.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.458+0000 7f66ea984700 1 --2- 172.21.15.117:0/2298371758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66e40fffa0 0x7f66e40fb960 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:54.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.458+0000 7f66ea984700 1 -- 172.21.15.117:0/2298371758 >> 172.21.15.117:0/2298371758 conn(0x7f66e40f7430 msgr2=0x7f66e40f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:11:54.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.459+0000 7f66ea984700 1 -- 172.21.15.117:0/2298371758 shutdown_connections 2024-04-12T09:11:54.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.459+0000 7f66ea984700 1 -- 172.21.15.117:0/2298371758 wait complete. 2024-04-12T09:11:54.469 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:11:54.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.580+0000 7f6228eae700 1 -- 172.21.15.117:0/2155061426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62240fbcd0 msgr2=0x7f62240fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:54.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.580+0000 7f6228eae700 1 --2- 172.21.15.117:0/2155061426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62240fbcd0 0x7f62240fc0e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6214004940 tx=0x7f6214009e30 comp rx=0 tx=0).stop 2024-04-12T09:11:54.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.581+0000 7f6228eae700 1 -- 172.21.15.117:0/2155061426 shutdown_connections 2024-04-12T09:11:54.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.581+0000 7f6228eae700 1 --2- 172.21.15.117:0/2155061426 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62240fcf80 0x7f62240fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:54.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.581+0000 7f6228eae700 1 --2- 172.21.15.117:0/2155061426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62240fbcd0 0x7f62240fc0e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:54.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.581+0000 7f6228eae700 1 -- 172.21.15.117:0/2155061426 >> 172.21.15.117:0/2155061426 conn(0x7f62240f7430 msgr2=0x7f62240f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:11:54.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.581+0000 7f6228eae700 1 -- 172.21.15.117:0/2155061426 shutdown_connections 2024-04-12T09:11:54.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.581+0000 7f6228eae700 1 -- 172.21.15.117:0/2155061426 wait complete. 2024-04-12T09:11:54.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.581+0000 7f6228eae700 1 Processor -- start 2024-04-12T09:11:54.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.581+0000 7f6228eae700 1 -- start start 2024-04-12T09:11:54.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.582+0000 7f6228eae700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62240fbcd0 0x7f622410da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:54.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.582+0000 7f6228eae700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62240fcf80 0x7f622410df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:54.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.582+0000 7f6228eae700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622410e610 con 0x7f62240fbcd0 2024-04-12T09:11:54.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.582+0000 7f6228eae700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622410edb0 con 0x7f62240fcf80 2024-04-12T09:11:54.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.582+0000 7f622259c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62240fbcd0 0x7f622410da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:54.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.582+0000 7f622259c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62240fbcd0 0x7f622410da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51364/0 (socket says 172.21.15.117:51364) 2024-04-12T09:11:54.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.582+0000 7f622259c700 1 -- 172.21.15.117:0/1356365959 learned_addr learned my addr 172.21.15.117:0/1356365959 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:11:54.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.582+0000 7f6221d9b700 1 --2- 172.21.15.117:0/1356365959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62240fcf80 0x7f622410df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:54.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.582+0000 7f622259c700 1 -- 172.21.15.117:0/1356365959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62240fcf80 msgr2=0x7f622410df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:54.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.582+0000 7f622259c700 1 --2- 172.21.15.117:0/1356365959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62240fcf80 0x7f622410df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:54.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.582+0000 7f622259c700 1 -- 172.21.15.117:0/1356365959 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6214005040 con 0x7f62240fbcd0 2024-04-12T09:11:54.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.582+0000 7f622259c700 1 --2- 172.21.15.117:0/1356365959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62240fbcd0 0x7f622410da40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f621400b3b0 tx=0x7f6214009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:11:54.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.582+0000 7f6212ffd700 1 -- 172.21.15.117:0/1356365959 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f621400e040 con 0x7f62240fbcd0 2024-04-12T09:11:54.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.582+0000 7f6212ffd700 1 -- 172.21.15.117:0/1356365959 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6214004290 con 0x7f62240fbcd0 2024-04-12T09:11:54.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.583+0000 7f6212ffd700 1 -- 172.21.15.117:0/1356365959 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f621401c630 con 0x7f62240fbcd0 2024-04-12T09:11:54.587 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.583+0000 7f6228eae700 1 -- 172.21.15.117:0/1356365959 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f622410f030 con 0x7f62240fbcd0 2024-04-12T09:11:54.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.583+0000 7f6228eae700 1 -- 172.21.15.117:0/1356365959 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f622410f570 con 0x7f62240fbcd0 2024-04-12T09:11:54.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.584+0000 7f6228eae700 1 -- 172.21.15.117:0/1356365959 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6224101b10 con 0x7f62240fbcd0 2024-04-12T09:11:54.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.585+0000 7f6212ffd700 1 -- 172.21.15.117:0/1356365959 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 25) v1 ==== 89201+0+0 (secure 0 0 0) 0x7f621400bbf0 con 0x7f62240fbcd0 2024-04-12T09:11:54.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.585+0000 7f6212ffd700 1 --2- 172.21.15.117:0/1356365959 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f620c06b330 0x7f620c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:54.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.585+0000 7f6212ffd700 1 -- 172.21.15.117:0/1356365959 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f621408ae40 con 0x7f62240fbcd0 2024-04-12T09:11:54.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.585+0000 7f6221d9b700 1 --2- 172.21.15.117:0/1356365959 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f620c06b330 0x7f620c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:54.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.586+0000 7f6221d9b700 1 --2- 172.21.15.117:0/1356365959 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f620c06b330 0x7f620c06d7e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6218006fd0 tx=0x7f6218008040 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:11:54.591 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.591+0000 7f6212ffd700 1 -- 172.21.15.117:0/1356365959 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f62140587d0 con 0x7f62240fbcd0 2024-04-12T09:11:54.806 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-12T09:11:54.807 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-12T09:11:54.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.947+0000 7f6228eae700 1 -- 172.21.15.117:0/1356365959 --> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f62241048b0 con 0x7f620c06b330 2024-04-12T09:11:54.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.948+0000 7f6212ffd700 1 -- 172.21.15.117:0/1356365959 <== mgr.24371 v2:172.21.15.203:6828/2773660052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f62241048b0 con 0x7f620c06b330 2024-04-12T09:11:54.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.951+0000 7f6228eae700 1 -- 172.21.15.117:0/1356365959 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f620c06b330 msgr2=0x7f620c06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:54.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.951+0000 7f6228eae700 1 --2- 172.21.15.117:0/1356365959 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f620c06b330 0x7f620c06d7e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6218006fd0 tx=0x7f6218008040 comp rx=0 tx=0).stop 2024-04-12T09:11:54.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.951+0000 7f6228eae700 1 -- 172.21.15.117:0/1356365959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62240fbcd0 msgr2=0x7f622410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:54.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.951+0000 7f6228eae700 1 --2- 172.21.15.117:0/1356365959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62240fbcd0 0x7f622410da40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f621400b3b0 tx=0x7f6214009e30 comp rx=0 tx=0).stop 2024-04-12T09:11:54.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.951+0000 7f6228eae700 1 -- 172.21.15.117:0/1356365959 shutdown_connections 2024-04-12T09:11:54.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.951+0000 7f6228eae700 1 --2- 172.21.15.117:0/1356365959 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f620c06b330 0x7f620c06d7e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:54.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.951+0000 7f6228eae700 1 --2- 172.21.15.117:0/1356365959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62240fbcd0 0x7f622410da40 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:54.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.951+0000 7f6228eae700 1 --2- 172.21.15.117:0/1356365959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62240fcf80 0x7f622410df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:54.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.951+0000 7f6228eae700 1 -- 172.21.15.117:0/1356365959 >> 172.21.15.117:0/1356365959 conn(0x7f62240f7430 msgr2=0x7f6224065b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:11:54.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.951+0000 7f6228eae700 1 -- 172.21.15.117:0/1356365959 shutdown_connections 2024-04-12T09:11:54.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:54.951+0000 7f6228eae700 1 -- 172.21.15.117:0/1356365959 wait complete. 2024-04-12T09:11:55.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.098+0000 7f9c31603700 1 -- 172.21.15.117:0/214162892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c2c0fe310 msgr2=0x7f9c2c0fe720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:55.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.098+0000 7f9c31603700 1 --2- 172.21.15.117:0/214162892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c2c0fe310 0x7f9c2c0fe720 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c004940 tx=0x7f9c1c009e30 comp rx=0 tx=0).stop 2024-04-12T09:11:55.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.098+0000 7f9c31603700 1 -- 172.21.15.117:0/214162892 shutdown_connections 2024-04-12T09:11:55.103 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.098+0000 7f9c31603700 1 --2- 172.21.15.117:0/214162892 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c2c0fec60 0x7f9c2c0fada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:55.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.098+0000 7f9c31603700 1 --2- 172.21.15.117:0/214162892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c2c0fe310 0x7f9c2c0fe720 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:55.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.098+0000 7f9c31603700 1 -- 172.21.15.117:0/214162892 >> 172.21.15.117:0/214162892 conn(0x7f9c2c0f6a10 msgr2=0x7f9c2c0f8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:11:55.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.098+0000 7f9c31603700 1 -- 172.21.15.117:0/214162892 shutdown_connections 2024-04-12T09:11:55.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.098+0000 7f9c31603700 1 -- 172.21.15.117:0/214162892 wait complete. 2024-04-12T09:11:55.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.099+0000 7f9c31603700 1 Processor -- start 2024-04-12T09:11:55.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.099+0000 7f9c31603700 1 -- start start 2024-04-12T09:11:55.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.099+0000 7f9c31603700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c2c0fe310 0x7f9c2c0fdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:55.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.100+0000 7f9c31603700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c2c0fec60 0x7f9c2c0fbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:55.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.100+0000 7f9c31603700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c0fc580 con 0x7f9c2c0fec60 2024-04-12T09:11:55.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.100+0000 7f9c31603700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c0fc6f0 con 0x7f9c2c0fe310 2024-04-12T09:11:55.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.100+0000 7f9c2a7fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c2c0fec60 0x7f9c2c0fbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:55.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.100+0000 7f9c2affd700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c2c0fe310 0x7f9c2c0fdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:55.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.100+0000 7f9c2a7fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c2c0fec60 0x7f9c2c0fbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51380/0 (socket says 172.21.15.117:51380) 2024-04-12T09:11:55.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.100+0000 7f9c2a7fc700 1 -- 172.21.15.117:0/405897855 learned_addr learned my addr 172.21.15.117:0/405897855 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:11:55.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.100+0000 7f9c2affd700 1 -- 172.21.15.117:0/405897855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c2c0fec60 msgr2=0x7f9c2c0fbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:55.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.100+0000 7f9c2affd700 1 --2- 172.21.15.117:0/405897855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c2c0fec60 0x7f9c2c0fbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:55.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.100+0000 7f9c2affd700 1 -- 172.21.15.117:0/405897855 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1c005040 con 0x7f9c2c0fe310 2024-04-12T09:11:55.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.100+0000 7f9c2affd700 1 --2- 172.21.15.117:0/405897855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c2c0fe310 0x7f9c2c0fdb00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c000c00 tx=0x7f9c1c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:11:55.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.101+0000 7f9c137fe700 1 -- 172.21.15.117:0/405897855 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c1c00e030 con 0x7f9c2c0fe310 2024-04-12T09:11:55.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.101+0000 7f9c137fe700 1 -- 172.21.15.117:0/405897855 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9c1c013de0 con 0x7f9c2c0fe310 2024-04-12T09:11:55.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.101+0000 7f9c31603700 1 -- 172.21.15.117:0/405897855 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c2c0fc970 con 0x7f9c2c0fe310 2024-04-12T09:11:55.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.101+0000 7f9c137fe700 1 -- 172.21.15.117:0/405897855 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c1c01ce50 con 0x7f9c2c0fe310 2024-04-12T09:11:55.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.101+0000 7f9c31603700 1 -- 172.21.15.117:0/405897855 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c2c1157e0 con 0x7f9c2c0fe310 2024-04-12T09:11:55.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.102+0000 7f9c31603700 1 -- 172.21.15.117:0/405897855 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c2c05f5f0 con 0x7f9c2c0fe310 2024-04-12T09:11:55.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.103+0000 7f9c137fe700 1 -- 172.21.15.117:0/405897855 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) v1 ==== 89201+0+0 (secure 0 0 0) 0x7f9c1c00b4a0 con 0x7f9c2c0fe310 2024-04-12T09:11:55.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.103+0000 7f9c137fe700 1 --2- 172.21.15.117:0/405897855 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f9c1406b4e0 0x7f9c1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:55.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.103+0000 7f9c137fe700 1 -- 172.21.15.117:0/405897855 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f9c1c08ba10 con 0x7f9c2c0fe310 2024-04-12T09:11:55.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.103+0000 7f9c2a7fc700 1 --2- 172.21.15.117:0/405897855 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f9c1406b4e0 0x7f9c1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:55.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.104+0000 7f9c2a7fc700 1 --2- 172.21.15.117:0/405897855 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f9c1406b4e0 0x7f9c1406d990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9c200041d0 tx=0x7f9c2000b040 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:11:55.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.108+0000 7f9c137fe700 1 -- 172.21.15.117:0/405897855 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f9c1c055850 con 0x7f9c2c0fe310 2024-04-12T09:11:55.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.436+0000 7f9c31603700 1 -- 172.21.15.117:0/405897855 --> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c2c102360 con 0x7f9c1406b4e0 2024-04-12T09:11:55.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.446+0000 7f9c137fe700 1 -- 172.21.15.117:0/405897855 <== mgr.24371 v2:172.21.15.203:6828/2773660052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f9c2c102360 con 0x7f9c1406b4e0 2024-04-12T09:11:55.447 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:11:55.447 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 starting - - - - 2024-04-12T09:11:55.447 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (9m) 37s ago 9m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad 1e9f2c6a4491 2024-04-12T09:11:55.447 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (8m) 61s ago 8m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad e42da3f6e517 2024-04-12T09:11:55.447 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 running (7m) 37s ago 8m 82.2M - 9.4.7 954c08fa6188 80596fd1f615 2024-04-12T09:11:55.447 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (3m) 37s ago 3m 157M - 17.2.7-827-gd3b5060a 21de9b7369ad de062e2c10e7 2024-04-12T09:11:55.447 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 running (3m) 37s ago 3m 11.8M - 17.2.7-827-gd3b5060a 21de9b7369ad 1e82c6241a18 2024-04-12T09:11:55.447 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (3m) 61s ago 3m 14.6M - 17.2.7-827-gd3b5060a 21de9b7369ad b05228e997f7 2024-04-12T09:11:55.448 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (3m) 61s ago 3m 15.0M - 17.2.7-827-gd3b5060a 21de9b7369ad 6d7f82c072c7 2024-04-12T09:11:55.448 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:9283 running (10m) 37s ago 10m 335M - 17.2.7-827-gd3b5060a 21de9b7369ad cd0beaa7ece1 2024-04-12T09:11:55.448 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283 running (86s) 61s ago 8m 489M - 19.0.0-2053-gb277feb2 668895944f0e bce98e99ffe8 2024-04-12T09:11:55.448 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (10m) 37s ago 10m 47.5M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad f9d5f7ac5270 2024-04-12T09:11:55.448 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (8m) 61s ago 8m 38.6M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad 17c0db49bb16 2024-04-12T09:11:55.448 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 starting - - - - 2024-04-12T09:11:55.448 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (8m) 61s ago 8m 16.2M - 1.5.0 0da6a335fe13 be0daeda3393 2024-04-12T09:11:55.448 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (7m) 37s ago 7m 110M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 77040a2498f3 2024-04-12T09:11:55.448 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (6m) 37s ago 6m 119M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 8f9dbf0274ed 2024-04-12T09:11:55.448 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (6m) 37s ago 6m 102M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 339c5a80d1dd 2024-04-12T09:11:55.448 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (5m) 61s ago 5m 120M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad fb87d616bae3 2024-04-12T09:11:55.448 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (5m) 61s ago 5m 116M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad c873826a2dea 2024-04-12T09:11:55.448 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (5m) 61s ago 5m 108M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad 69cb7c22f002 2024-04-12T09:11:55.448 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 running (7m) 37s ago 8m 55.2M - 2.43.0 a07b618ecd1d 2799a65eed76 2024-04-12T09:11:55.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.449+0000 7f9c31603700 1 -- 172.21.15.117:0/405897855 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f9c1406b4e0 msgr2=0x7f9c1406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:55.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.449+0000 7f9c31603700 1 --2- 172.21.15.117:0/405897855 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f9c1406b4e0 0x7f9c1406d990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9c200041d0 tx=0x7f9c2000b040 comp rx=0 tx=0).stop 2024-04-12T09:11:55.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.449+0000 7f9c31603700 1 -- 172.21.15.117:0/405897855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c2c0fe310 msgr2=0x7f9c2c0fdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:55.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.449+0000 7f9c31603700 1 --2- 172.21.15.117:0/405897855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c2c0fe310 0x7f9c2c0fdb00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c000c00 tx=0x7f9c1c009e30 comp rx=0 tx=0).stop 2024-04-12T09:11:55.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.449+0000 7f9c31603700 1 -- 172.21.15.117:0/405897855 shutdown_connections 2024-04-12T09:11:55.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.449+0000 7f9c31603700 1 --2- 172.21.15.117:0/405897855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c2c0fe310 0x7f9c2c0fdb00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:55.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.449+0000 7f9c31603700 1 --2- 172.21.15.117:0/405897855 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f9c1406b4e0 0x7f9c1406d990 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:55.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.449+0000 7f9c31603700 1 --2- 172.21.15.117:0/405897855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c2c0fec60 0x7f9c2c0fbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:55.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.449+0000 7f9c31603700 1 -- 172.21.15.117:0/405897855 >> 172.21.15.117:0/405897855 conn(0x7f9c2c0f6a10 msgr2=0x7f9c2c0f8060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:11:55.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.450+0000 7f9c31603700 1 -- 172.21.15.117:0/405897855 shutdown_connections 2024-04-12T09:11:55.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.450+0000 7f9c31603700 1 -- 172.21.15.117:0/405897855 wait complete. 2024-04-12T09:11:55.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.560+0000 7f2ec433c700 1 -- 172.21.15.117:0/502336375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ebc0fcf80 msgr2=0x7f2ebc0fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:55.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.560+0000 7f2ec433c700 1 --2- 172.21.15.117:0/502336375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ebc0fcf80 0x7f2ebc0fd3f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2eac004940 tx=0x7f2eac009e30 comp rx=0 tx=0).stop 2024-04-12T09:11:55.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.560+0000 7f2ec433c700 1 -- 172.21.15.117:0/502336375 shutdown_connections 2024-04-12T09:11:55.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.560+0000 7f2ec433c700 1 --2- 172.21.15.117:0/502336375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ebc0fcf80 0x7f2ebc0fd3f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:55.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.560+0000 7f2ec433c700 1 --2- 172.21.15.117:0/502336375 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ebc0fbcd0 0x7f2ebc0fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:55.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.560+0000 7f2ec433c700 1 -- 172.21.15.117:0/502336375 >> 172.21.15.117:0/502336375 conn(0x7f2ebc0f7430 msgr2=0x7f2ebc0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:11:55.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.560+0000 7f2ec433c700 1 -- 172.21.15.117:0/502336375 shutdown_connections 2024-04-12T09:11:55.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.560+0000 7f2ec433c700 1 -- 172.21.15.117:0/502336375 wait complete. 2024-04-12T09:11:55.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.561+0000 7f2ec433c700 1 Processor -- start 2024-04-12T09:11:55.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.561+0000 7f2ec433c700 1 -- start start 2024-04-12T09:11:55.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.561+0000 7f2ec433c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ebc0fbcd0 0x7f2ebc0ffd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:55.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.561+0000 7f2ec433c700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ebc0fcf80 0x7f2ebc0fe2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:55.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.561+0000 7f2ec433c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc0fe800 con 0x7f2ebc0fbcd0 2024-04-12T09:11:55.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.561+0000 7f2ec433c700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc0fe940 con 0x7f2ebc0fcf80 2024-04-12T09:11:55.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.561+0000 7f2ec20d8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ebc0fbcd0 0x7f2ebc0ffd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:55.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.561+0000 7f2ec20d8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ebc0fbcd0 0x7f2ebc0ffd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51396/0 (socket says 172.21.15.117:51396) 2024-04-12T09:11:55.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.561+0000 7f2ec20d8700 1 -- 172.21.15.117:0/1560264369 learned_addr learned my addr 172.21.15.117:0/1560264369 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:11:55.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.561+0000 7f2ec18d7700 1 --2- 172.21.15.117:0/1560264369 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ebc0fcf80 0x7f2ebc0fe2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:55.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.561+0000 7f2ec20d8700 1 -- 172.21.15.117:0/1560264369 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ebc0fcf80 msgr2=0x7f2ebc0fe2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:55.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.561+0000 7f2ec20d8700 1 --2- 172.21.15.117:0/1560264369 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ebc0fcf80 0x7f2ebc0fe2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:55.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.561+0000 7f2ec20d8700 1 -- 172.21.15.117:0/1560264369 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac005040 con 0x7f2ebc0fbcd0 2024-04-12T09:11:55.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.562+0000 7f2ec20d8700 1 --2- 172.21.15.117:0/1560264369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ebc0fbcd0 0x7f2ebc0ffd50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8002a50 tx=0x7f2eb80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:11:55.564 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.562+0000 7f2eb2ffd700 1 -- 172.21.15.117:0/1560264369 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2eb8007cc0 con 0x7f2ebc0fbcd0 2024-04-12T09:11:55.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.562+0000 7f2ec433c700 1 -- 172.21.15.117:0/1560264369 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ebc0fec20 con 0x7f2ebc0fbcd0 2024-04-12T09:11:55.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.562+0000 7f2eb2ffd700 1 -- 172.21.15.117:0/1560264369 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2eb800f040 con 0x7f2ebc0fbcd0 2024-04-12T09:11:55.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.562+0000 7f2eb2ffd700 1 -- 172.21.15.117:0/1560264369 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2eb800da30 con 0x7f2ebc0fbcd0 2024-04-12T09:11:55.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.562+0000 7f2ec433c700 1 -- 172.21.15.117:0/1560264369 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ebc115ad0 con 0x7f2ebc0fbcd0 2024-04-12T09:11:55.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.563+0000 7f2ec433c700 1 -- 172.21.15.117:0/1560264369 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ebc101b10 con 0x7f2ebc0fbcd0 2024-04-12T09:11:55.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.564+0000 7f2eb2ffd700 1 -- 172.21.15.117:0/1560264369 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 25) v1 ==== 89201+0+0 (secure 0 0 0) 0x7f2eb800db90 con 0x7f2ebc0fbcd0 2024-04-12T09:11:55.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.564+0000 7f2eb2ffd700 1 --2- 172.21.15.117:0/1560264369 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f2ea806b540 0x7f2ea806d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:55.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.564+0000 7f2eb2ffd700 1 -- 172.21.15.117:0/1560264369 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f2eb8089ef0 con 0x7f2ebc0fbcd0 2024-04-12T09:11:55.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.564+0000 7f2ec18d7700 1 --2- 172.21.15.117:0/1560264369 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f2ea806b540 0x7f2ea806d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:55.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.565+0000 7f2ec18d7700 1 --2- 172.21.15.117:0/1560264369 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f2ea806b540 0x7f2ea806d9f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2eac00b970 tx=0x7f2eac009e30 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:11:55.570 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.569+0000 7f2eb2ffd700 1 -- 172.21.15.117:0/1560264369 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f2eb8053c10 con 0x7f2ebc0fbcd0 2024-04-12T09:11:55.936 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.936+0000 7f2ec433c700 1 -- 172.21.15.117:0/1560264369 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2ebc1048c0 con 0x7f2ebc0fbcd0 2024-04-12T09:11:55.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.936+0000 7f2eb2ffd700 1 -- 172.21.15.117:0/1560264369 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f2eb80572d0 con 0x7f2ebc0fbcd0 2024-04-12T09:11:55.937 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:11:55.937 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": { 2024-04-12T09:11:55.937 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 2 2024-04-12T09:11:55.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:11:55.937 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": { 2024-04-12T09:11:55.938 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 1, 2024-04-12T09:11:55.938 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 1 2024-04-12T09:11:55.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:11:55.938 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": { 2024-04-12T09:11:55.938 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 6 2024-04-12T09:11:55.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:11:55.938 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-04-12T09:11:55.938 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 4 2024-04-12T09:11:55.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:11:55.938 INFO:teuthology.orchestra.run.smithi117.stdout: "overall": { 2024-04-12T09:11:55.938 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 13, 2024-04-12T09:11:55.938 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 1 2024-04-12T09:11:55.938 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:11:55.938 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:11:55.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.939+0000 7f2ec433c700 1 -- 172.21.15.117:0/1560264369 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f2ea806b540 msgr2=0x7f2ea806d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:55.940 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.939+0000 7f2ec433c700 1 --2- 172.21.15.117:0/1560264369 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f2ea806b540 0x7f2ea806d9f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2eac00b970 tx=0x7f2eac009e30 comp rx=0 tx=0).stop 2024-04-12T09:11:55.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.939+0000 7f2ec433c700 1 -- 172.21.15.117:0/1560264369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ebc0fbcd0 msgr2=0x7f2ebc0ffd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:55.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.939+0000 7f2ec433c700 1 --2- 172.21.15.117:0/1560264369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ebc0fbcd0 0x7f2ebc0ffd50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8002a50 tx=0x7f2eb80046b0 comp rx=0 tx=0).stop 2024-04-12T09:11:55.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.939+0000 7f2ec433c700 1 -- 172.21.15.117:0/1560264369 shutdown_connections 2024-04-12T09:11:55.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.939+0000 7f2ec433c700 1 --2- 172.21.15.117:0/1560264369 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f2ea806b540 0x7f2ea806d9f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:55.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.939+0000 7f2ec433c700 1 --2- 172.21.15.117:0/1560264369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ebc0fbcd0 0x7f2ebc0ffd50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:55.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.939+0000 7f2ec433c700 1 --2- 172.21.15.117:0/1560264369 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ebc0fcf80 0x7f2ebc0fe2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:55.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.939+0000 7f2ec433c700 1 -- 172.21.15.117:0/1560264369 >> 172.21.15.117:0/1560264369 conn(0x7f2ebc0f7430 msgr2=0x7f2ebc065b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:11:55.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.940+0000 7f2ec433c700 1 -- 172.21.15.117:0/1560264369 shutdown_connections 2024-04-12T09:11:55.941 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:55.940+0000 7f2ec433c700 1 -- 172.21.15.117:0/1560264369 wait complete. 2024-04-12T09:11:56.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.071+0000 7f6eae5a2700 1 -- 172.21.15.117:0/1415858971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ea80fcf80 msgr2=0x7f6ea80fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:56.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.071+0000 7f6eae5a2700 1 --2- 172.21.15.117:0/1415858971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ea80fcf80 0x7f6ea80fd3f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c004940 tx=0x7f6e9c009e30 comp rx=0 tx=0).stop 2024-04-12T09:11:56.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.071+0000 7f6eae5a2700 1 -- 172.21.15.117:0/1415858971 shutdown_connections 2024-04-12T09:11:56.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.071+0000 7f6eae5a2700 1 --2- 172.21.15.117:0/1415858971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ea80fcf80 0x7f6ea80fd3f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:56.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.071+0000 7f6eae5a2700 1 --2- 172.21.15.117:0/1415858971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ea80fbcd0 0x7f6ea80fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:56.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.071+0000 7f6eae5a2700 1 -- 172.21.15.117:0/1415858971 >> 172.21.15.117:0/1415858971 conn(0x7f6ea80f7430 msgr2=0x7f6ea80f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:11:56.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.072+0000 7f6eae5a2700 1 -- 172.21.15.117:0/1415858971 shutdown_connections 2024-04-12T09:11:56.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.072+0000 7f6eae5a2700 1 -- 172.21.15.117:0/1415858971 wait complete. 2024-04-12T09:11:56.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.072+0000 7f6eae5a2700 1 Processor -- start 2024-04-12T09:11:56.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.072+0000 7f6eae5a2700 1 -- start start 2024-04-12T09:11:56.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.073+0000 7f6eae5a2700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ea80fbcd0 0x7f6ea810d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:56.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.073+0000 7f6eae5a2700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ea80fcf80 0x7f6ea810df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:56.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.073+0000 7f6eae5a2700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea810e520 con 0x7f6ea80fcf80 2024-04-12T09:11:56.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.073+0000 7f6eae5a2700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea810ed20 con 0x7f6ea80fbcd0 2024-04-12T09:11:56.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.073+0000 7f6ea7fff700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ea80fbcd0 0x7f6ea810d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:56.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.073+0000 7f6ea77fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ea80fcf80 0x7f6ea810df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:56.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.073+0000 7f6ea7fff700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ea80fbcd0 0x7f6ea810d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.117:43016/0 (socket says 172.21.15.117:43016) 2024-04-12T09:11:56.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.073+0000 7f6ea7fff700 1 -- 172.21.15.117:0/1355284177 learned_addr learned my addr 172.21.15.117:0/1355284177 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:11:56.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.073+0000 7f6ea7fff700 1 -- 172.21.15.117:0/1355284177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ea80fcf80 msgr2=0x7f6ea810df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:56.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.073+0000 7f6ea7fff700 1 --2- 172.21.15.117:0/1355284177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ea80fcf80 0x7f6ea810df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:56.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.073+0000 7f6ea7fff700 1 -- 172.21.15.117:0/1355284177 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c005040 con 0x7f6ea80fbcd0 2024-04-12T09:11:56.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.073+0000 7f6ea77fe700 1 --2- 172.21.15.117:0/1355284177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ea80fcf80 0x7f6ea810df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T09:11:56.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.073+0000 7f6ea7fff700 1 --2- 172.21.15.117:0/1355284177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ea80fbcd0 0x7f6ea810d9e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6e98002a80 tx=0x7f6e980046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:11:56.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.074+0000 7f6ea4ff9700 1 -- 172.21.15.117:0/1355284177 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e98007cc0 con 0x7f6ea80fbcd0 2024-04-12T09:11:56.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.074+0000 7f6ea4ff9700 1 -- 172.21.15.117:0/1355284177 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e9800f040 con 0x7f6ea80fbcd0 2024-04-12T09:11:56.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.074+0000 7f6eae5a2700 1 -- 172.21.15.117:0/1355284177 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea810f000 con 0x7f6ea80fbcd0 2024-04-12T09:11:56.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.074+0000 7f6ea4ff9700 1 -- 172.21.15.117:0/1355284177 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e9800dac0 con 0x7f6ea80fbcd0 2024-04-12T09:11:56.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.074+0000 7f6eae5a2700 1 -- 172.21.15.117:0/1355284177 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea810f540 con 0x7f6ea80fbcd0 2024-04-12T09:11:56.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.075+0000 7f6eae5a2700 1 -- 172.21.15.117:0/1355284177 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea8101b10 con 0x7f6ea80fbcd0 2024-04-12T09:11:56.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.076+0000 7f6ea4ff9700 1 -- 172.21.15.117:0/1355284177 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) v1 ==== 89201+0+0 (secure 0 0 0) 0x7f6e9800dc20 con 0x7f6ea80fbcd0 2024-04-12T09:11:56.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.076+0000 7f6ea4ff9700 1 --2- 172.21.15.117:0/1355284177 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f6e9006b540 0x7f6e9006d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:11:56.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.076+0000 7f6ea4ff9700 1 -- 172.21.15.117:0/1355284177 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f6e98089de0 con 0x7f6ea80fbcd0 2024-04-12T09:11:56.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.076+0000 7f6ea77fe700 1 --2- 172.21.15.117:0/1355284177 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f6e9006b540 0x7f6e9006d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:11:56.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.077+0000 7f6ea77fe700 1 --2- 172.21.15.117:0/1355284177 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f6e9006b540 0x7f6e9006d9f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c00b3b0 tx=0x7f6e9c009e30 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:11:56.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.081+0000 7f6ea4ff9700 1 -- 172.21.15.117:0/1355284177 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f6e98057630 con 0x7f6ea80fbcd0 2024-04-12T09:11:56.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:55 smithi117 ceph-mon[29277]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:11:56.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:55 smithi117 ceph-mon[29277]: pgmap v38: 65 pgs: 65 active+clean; 2.6 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 9.6 MiB/s rd, 31 MiB/s wr, 177 op/s 2024-04-12T09:11:56.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:55 smithi117 ceph-mon[29277]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:11:56.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:55 smithi203 ceph-mon[36428]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:11:56.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:55 smithi203 ceph-mon[36428]: pgmap v38: 65 pgs: 65 active+clean; 2.6 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 9.6 MiB/s rd, 31 MiB/s wr, 177 op/s 2024-04-12T09:11:56.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:55 smithi203 ceph-mon[36428]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:11:56.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.411+0000 7f6eae5a2700 1 -- 172.21.15.117:0/1355284177 --> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ea810f760 con 0x7f6e9006b540 2024-04-12T09:11:56.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.412+0000 7f6ea4ff9700 1 -- 172.21.15.117:0/1355284177 <== mgr.24371 v2:172.21.15.203:6828/2773660052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f6ea810f760 con 0x7f6e9006b540 2024-04-12T09:11:56.413 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:11:56.413 INFO:teuthology.orchestra.run.smithi117.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec", 2024-04-12T09:11:56.413 INFO:teuthology.orchestra.run.smithi117.stdout: "in_progress": true, 2024-04-12T09:11:56.413 INFO:teuthology.orchestra.run.smithi117.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-12T09:11:56.413 INFO:teuthology.orchestra.run.smithi117.stdout: "services_complete": [], 2024-04-12T09:11:56.413 INFO:teuthology.orchestra.run.smithi117.stdout: "progress": "1/2 daemons upgraded", 2024-04-12T09:11:56.413 INFO:teuthology.orchestra.run.smithi117.stdout: "message": "", 2024-04-12T09:11:56.413 INFO:teuthology.orchestra.run.smithi117.stdout: "is_paused": false 2024-04-12T09:11:56.413 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:11:56.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.414+0000 7f6eae5a2700 1 -- 172.21.15.117:0/1355284177 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f6e9006b540 msgr2=0x7f6e9006d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:56.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.414+0000 7f6eae5a2700 1 --2- 172.21.15.117:0/1355284177 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f6e9006b540 0x7f6e9006d9f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c00b3b0 tx=0x7f6e9c009e30 comp rx=0 tx=0).stop 2024-04-12T09:11:56.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.414+0000 7f6eae5a2700 1 -- 172.21.15.117:0/1355284177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ea80fbcd0 msgr2=0x7f6ea810d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:11:56.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.414+0000 7f6eae5a2700 1 --2- 172.21.15.117:0/1355284177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ea80fbcd0 0x7f6ea810d9e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6e98002a80 tx=0x7f6e980046b0 comp rx=0 tx=0).stop 2024-04-12T09:11:56.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.414+0000 7f6eae5a2700 1 -- 172.21.15.117:0/1355284177 shutdown_connections 2024-04-12T09:11:56.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.414+0000 7f6eae5a2700 1 --2- 172.21.15.117:0/1355284177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ea80fbcd0 0x7f6ea810d9e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:56.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.414+0000 7f6eae5a2700 1 --2- 172.21.15.117:0/1355284177 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f6e9006b540 0x7f6e9006d9f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:56.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.414+0000 7f6eae5a2700 1 --2- 172.21.15.117:0/1355284177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ea80fcf80 0x7f6ea810df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:11:56.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.414+0000 7f6eae5a2700 1 -- 172.21.15.117:0/1355284177 >> 172.21.15.117:0/1355284177 conn(0x7f6ea80f7430 msgr2=0x7f6ea8065ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:11:56.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.414+0000 7f6eae5a2700 1 -- 172.21.15.117:0/1355284177 shutdown_connections 2024-04-12T09:11:56.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:11:56.415+0000 7f6eae5a2700 1 -- 172.21.15.117:0/1355284177 wait complete. 2024-04-12T09:11:57.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:56 smithi117 ceph-mon[29277]: from='client.24441 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:11:57.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:56 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/1560264369' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:11:57.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:56 smithi203 ceph-mon[36428]: from='client.24441 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:11:57.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:56 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/1560264369' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:11:58.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:57 smithi117 ceph-mon[29277]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:11:58.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:57 smithi117 ceph-mon[29277]: pgmap v39: 65 pgs: 65 active+clean; 1.5 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 9.6 MiB/s rd, 32 MiB/s wr, 249 op/s 2024-04-12T09:11:58.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:57 smithi203 ceph-mon[36428]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:11:58.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:57 smithi203 ceph-mon[36428]: pgmap v39: 65 pgs: 65 active+clean; 1.5 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 9.6 MiB/s rd, 32 MiB/s wr, 249 op/s 2024-04-12T09:12:00.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:59 smithi117 ceph-mon[29277]: pgmap v40: 65 pgs: 65 active+clean; 1.5 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 22 KiB/s rd, 1.1 MiB/s wr, 144 op/s 2024-04-12T09:12:00.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:11:59 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:12:00.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:59 smithi203 ceph-mon[36428]: pgmap v40: 65 pgs: 65 active+clean; 1.5 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 22 KiB/s rd, 1.1 MiB/s wr, 144 op/s 2024-04-12T09:12:00.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:11:59 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:12:01.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:01 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:01.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:01 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:01.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:01 smithi203 ceph-mon[36428]: Reconfiguring prometheus.smithi117 (dependencies changed)... 2024-04-12T09:12:01.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:01 smithi203 ceph-mon[36428]: pgmap v41: 65 pgs: 65 active+clean; 1.4 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 22 KiB/s rd, 1.3 MiB/s wr, 168 op/s 2024-04-12T09:12:01.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:01 smithi203 ceph-mon[36428]: Reconfiguring daemon prometheus.smithi117 on smithi117 2024-04-12T09:12:01.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:01 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:01.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:01 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:01.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:01 smithi117 ceph-mon[29277]: Reconfiguring prometheus.smithi117 (dependencies changed)... 2024-04-12T09:12:01.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:01 smithi117 ceph-mon[29277]: pgmap v41: 65 pgs: 65 active+clean; 1.4 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 22 KiB/s rd, 1.3 MiB/s wr, 168 op/s 2024-04-12T09:12:01.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:01 smithi117 ceph-mon[29277]: Reconfiguring daemon prometheus.smithi117 on smithi117 2024-04-12T09:12:03.614 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-12T09:12:03.614 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-04-12T09:12:04.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:03 smithi203 ceph-mon[36428]: pgmap v42: 65 pgs: 65 active+clean; 738 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 33 KiB/s rd, 1.4 MiB/s wr, 210 op/s 2024-04-12T09:12:04.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:03 smithi117 ceph-mon[29277]: pgmap v42: 65 pgs: 65 active+clean; 738 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 33 KiB/s rd, 1.4 MiB/s wr, 210 op/s 2024-04-12T09:12:06.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:05 smithi203 ceph-mon[36428]: pgmap v43: 65 pgs: 65 active+clean; 738 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 23 KiB/s rd, 992 KiB/s wr, 151 op/s 2024-04-12T09:12:06.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:05 smithi117 ceph-mon[29277]: pgmap v43: 65 pgs: 65 active+clean; 738 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 23 KiB/s rd, 992 KiB/s wr, 151 op/s 2024-04-12T09:12:08.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:07 smithi203 ceph-mon[36428]: pgmap v44: 65 pgs: 65 active+clean; 330 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 34 KiB/s rd, 1.5 MiB/s wr, 256 op/s 2024-04-12T09:12:08.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:07 smithi117 ceph-mon[29277]: pgmap v44: 65 pgs: 65 active+clean; 330 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 34 KiB/s rd, 1.5 MiB/s wr, 256 op/s 2024-04-12T09:12:10.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:09 smithi117 ceph-mon[29277]: pgmap v45: 65 pgs: 65 active+clean; 330 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 22 KiB/s rd, 982 KiB/s wr, 185 op/s 2024-04-12T09:12:10.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:09 smithi203 ceph-mon[36428]: pgmap v45: 65 pgs: 65 active+clean; 330 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 22 KiB/s rd, 982 KiB/s wr, 185 op/s 2024-04-12T09:12:12.081 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:11 smithi117 ceph-mon[29277]: pgmap v46: 65 pgs: 65 active+clean; 311 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 22 KiB/s rd, 1.2 MiB/s wr, 214 op/s 2024-04-12T09:12:12.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:11 smithi203 ceph-mon[36428]: pgmap v46: 65 pgs: 65 active+clean; 311 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 22 KiB/s rd, 1.2 MiB/s wr, 214 op/s 2024-04-12T09:12:14.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:13 smithi117 ceph-mon[29277]: pgmap v47: 65 pgs: 65 active+clean; 282 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.2 MiB/s wr, 288 op/s 2024-04-12T09:12:14.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:13 smithi203 ceph-mon[36428]: pgmap v47: 65 pgs: 65 active+clean; 282 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.2 MiB/s wr, 288 op/s 2024-04-12T09:12:15.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:14 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:12:15.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:14 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:12:16.103 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:15 smithi117 ceph-mon[29277]: pgmap v48: 65 pgs: 65 active+clean; 282 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.1 MiB/s wr, 232 op/s 2024-04-12T09:12:16.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:15 smithi203 ceph-mon[36428]: pgmap v48: 65 pgs: 65 active+clean; 282 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.1 MiB/s wr, 232 op/s 2024-04-12T09:12:18.119 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:17 smithi117 ceph-mon[29277]: pgmap v49: 65 pgs: 65 active+clean; 285 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.6 MiB/s wr, 430 op/s 2024-04-12T09:12:18.119 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:17 smithi117 ceph-mon[29277]: mgrmap e26: smithi203.apfqpo(active, since 92s), standbys: smithi117.oyaxql 2024-04-12T09:12:18.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:17 smithi203 ceph-mon[36428]: pgmap v49: 65 pgs: 65 active+clean; 285 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.6 MiB/s wr, 430 op/s 2024-04-12T09:12:18.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:17 smithi203 ceph-mon[36428]: mgrmap e26: smithi203.apfqpo(active, since 92s), standbys: smithi117.oyaxql 2024-04-12T09:12:19.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:19 smithi117 ceph-mon[29277]: pgmap v50: 65 pgs: 65 active+clean; 285 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.1 MiB/s wr, 325 op/s 2024-04-12T09:12:20.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:19 smithi203 ceph-mon[36428]: pgmap v50: 65 pgs: 65 active+clean; 285 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.1 MiB/s wr, 325 op/s 2024-04-12T09:12:21.234 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:21 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:21.234 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:21 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:21.234 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:21 smithi203 ceph-mon[36428]: Reconfiguring node-exporter.smithi203 (dependencies changed)... 2024-04-12T09:12:21.234 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:21 smithi203 ceph-mon[36428]: Reconfiguring daemon node-exporter.smithi203 on smithi203 2024-04-12T09:12:21.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:21 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:21.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:21 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:21.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:21 smithi117 ceph-mon[29277]: Reconfiguring node-exporter.smithi203 (dependencies changed)... 2024-04-12T09:12:21.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:21 smithi117 ceph-mon[29277]: Reconfiguring daemon node-exporter.smithi203 on smithi203 2024-04-12T09:12:22.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:22 smithi203 ceph-mon[36428]: pgmap v51: 65 pgs: 65 active+clean; 287 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 373 op/s 2024-04-12T09:12:22.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:22 smithi117 ceph-mon[29277]: pgmap v51: 65 pgs: 65 active+clean; 287 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 373 op/s 2024-04-12T09:12:23.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:23 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:23.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:23 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:23.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:23 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-12T09:12:23.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:23 smithi117 ceph-mon[29277]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-12T09:12:23.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:23 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-12T09:12:23.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:23 smithi117 ceph-mon[29277]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-12T09:12:23.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:23 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T09:12:23.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:23 smithi117 ceph-mon[29277]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T09:12:23.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:23 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:12:23.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:23 smithi117 ceph-mon[29277]: Upgrade: Need to upgrade myself (mgr.smithi203.apfqpo) 2024-04-12T09:12:23.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:23 smithi117 ceph-mon[29277]: Upgrade: Need to upgrade myself (mgr.smithi203.apfqpo) 2024-04-12T09:12:23.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:23 smithi117 ceph-mon[29277]: pgmap v52: 65 pgs: 65 active+clean; 283 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 1.5 MiB/s wr, 456 op/s 2024-04-12T09:12:23.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:23 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:23.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:23 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:23.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:23 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-12T09:12:23.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:23 smithi203 ceph-mon[36428]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-12T09:12:23.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:23 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-12T09:12:23.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:23 smithi203 ceph-mon[36428]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-12T09:12:23.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:23 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T09:12:23.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:23 smithi203 ceph-mon[36428]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T09:12:23.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:23 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:12:23.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:23 smithi203 ceph-mon[36428]: Upgrade: Need to upgrade myself (mgr.smithi203.apfqpo) 2024-04-12T09:12:23.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:23 smithi203 ceph-mon[36428]: Upgrade: Need to upgrade myself (mgr.smithi203.apfqpo) 2024-04-12T09:12:23.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:23 smithi203 ceph-mon[36428]: pgmap v52: 65 pgs: 65 active+clean; 283 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 1.5 MiB/s wr, 456 op/s 2024-04-12T09:12:26.150 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:25 smithi117 ceph-mon[29277]: pgmap v53: 65 pgs: 65 active+clean; 283 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.2 MiB/s wr, 357 op/s 2024-04-12T09:12:26.151 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:25 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:26.151 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:25 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi117.oyaxql", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T09:12:26.151 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:25 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi117.oyaxql", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T09:12:26.151 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:25 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T09:12:26.151 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:25 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:12:26.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:25 smithi203 ceph-mon[36428]: pgmap v53: 65 pgs: 65 active+clean; 283 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.2 MiB/s wr, 357 op/s 2024-04-12T09:12:26.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:25 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:26.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:25 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi117.oyaxql", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T09:12:26.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:25 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi117.oyaxql", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T09:12:26.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:25 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T09:12:26.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:25 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:12:26.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.549+0000 7fab081f6700 1 -- 172.21.15.117:0/1578575802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab000fc310 msgr2=0x7fab000fc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:26.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.549+0000 7fab081f6700 1 --2- 172.21.15.117:0/1578575802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab000fc310 0x7fab000fc720 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7faafc004940 tx=0x7faafc009e30 comp rx=0 tx=0).stop 2024-04-12T09:12:26.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.549+0000 7fab081f6700 1 -- 172.21.15.117:0/1578575802 shutdown_connections 2024-04-12T09:12:26.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.549+0000 7fab081f6700 1 --2- 172.21.15.117:0/1578575802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab000fcc60 0x7fab000fd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:26.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.549+0000 7fab081f6700 1 --2- 172.21.15.117:0/1578575802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab000fc310 0x7fab000fc720 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:26.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.549+0000 7fab081f6700 1 -- 172.21.15.117:0/1578575802 >> 172.21.15.117:0/1578575802 conn(0x7fab000f6bc0 msgr2=0x7fab000f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:12:26.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.549+0000 7fab081f6700 1 -- 172.21.15.117:0/1578575802 shutdown_connections 2024-04-12T09:12:26.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.549+0000 7fab081f6700 1 -- 172.21.15.117:0/1578575802 wait complete. 2024-04-12T09:12:26.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.550+0000 7fab081f6700 1 Processor -- start 2024-04-12T09:12:26.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.550+0000 7fab081f6700 1 -- start start 2024-04-12T09:12:26.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.550+0000 7fab081f6700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab000fc310 0x7fab000fba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:12:26.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.550+0000 7fab081f6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab000fcc60 0x7fab00112710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:12:26.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.550+0000 7fab081f6700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab00112c50 con 0x7fab000fcc60 2024-04-12T09:12:26.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.550+0000 7fab081f6700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab00112d90 con 0x7fab000fc310 2024-04-12T09:12:26.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.550+0000 7fab05791700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab000fcc60 0x7fab00112710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:12:26.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.550+0000 7fab05791700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab000fcc60 0x7fab00112710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45084/0 (socket says 172.21.15.117:45084) 2024-04-12T09:12:26.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.550+0000 7fab05791700 1 -- 172.21.15.117:0/2459756007 learned_addr learned my addr 172.21.15.117:0/2459756007 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:12:26.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.550+0000 7fab05f92700 1 --2- 172.21.15.117:0/2459756007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab000fc310 0x7fab000fba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:12:26.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.551+0000 7fab05f92700 1 -- 172.21.15.117:0/2459756007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab000fcc60 msgr2=0x7fab00112710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:26.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.551+0000 7fab05f92700 1 --2- 172.21.15.117:0/2459756007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab000fcc60 0x7fab00112710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:26.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.551+0000 7fab05f92700 1 -- 172.21.15.117:0/2459756007 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc005040 con 0x7fab000fc310 2024-04-12T09:12:26.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.551+0000 7fab05f92700 1 --2- 172.21.15.117:0/2459756007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab000fc310 0x7fab000fba30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faafc00b970 tx=0x7faafc009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:12:26.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.551+0000 7faaf67fc700 1 -- 172.21.15.117:0/2459756007 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faafc00e040 con 0x7fab000fc310 2024-04-12T09:12:26.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.551+0000 7faaf67fc700 1 -- 172.21.15.117:0/2459756007 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faafc00bc20 con 0x7fab000fc310 2024-04-12T09:12:26.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.551+0000 7fab081f6700 1 -- 172.21.15.117:0/2459756007 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab0010c4e0 con 0x7fab000fc310 2024-04-12T09:12:26.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.551+0000 7faaf67fc700 1 -- 172.21.15.117:0/2459756007 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faafc013660 con 0x7fab000fc310 2024-04-12T09:12:26.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.551+0000 7fab081f6700 1 -- 172.21.15.117:0/2459756007 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab0010ca40 con 0x7fab000fc310 2024-04-12T09:12:26.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.552+0000 7fab081f6700 1 -- 172.21.15.117:0/2459756007 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab0004c710 con 0x7fab000fc310 2024-04-12T09:12:26.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.553+0000 7faaf67fc700 1 -- 172.21.15.117:0/2459756007 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 26) v1 ==== 89099+0+0 (secure 0 0 0) 0x7faafc01a570 con 0x7fab000fc310 2024-04-12T09:12:26.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.553+0000 7faaf67fc700 1 --2- 172.21.15.117:0/2459756007 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7faaec06b420 0x7faaec06d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:12:26.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.553+0000 7faaf67fc700 1 -- 172.21.15.117:0/2459756007 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7faafc08ecb0 con 0x7fab000fc310 2024-04-12T09:12:26.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.553+0000 7fab05791700 1 --2- 172.21.15.117:0/2459756007 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7faaec06b420 0x7faaec06d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:12:26.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.554+0000 7fab05791700 1 --2- 172.21.15.117:0/2459756007 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7faaec06b420 0x7faaec06d8d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faaf00041d0 tx=0x7faaf000b040 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:12:26.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.558+0000 7faaf67fc700 1 -- 172.21.15.117:0/2459756007 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7faafc05c840 con 0x7fab000fc310 2024-04-12T09:12:26.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.941+0000 7fab081f6700 1 -- 172.21.15.117:0/2459756007 --> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fab00101410 con 0x7faaec06b420 2024-04-12T09:12:26.943 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.942+0000 7faaf67fc700 1 -- 172.21.15.117:0/2459756007 <== mgr.24371 v2:172.21.15.203:6828/2773660052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fab00101410 con 0x7faaec06b420 2024-04-12T09:12:26.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.945+0000 7fab081f6700 1 -- 172.21.15.117:0/2459756007 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7faaec06b420 msgr2=0x7faaec06d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:26.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.945+0000 7fab081f6700 1 --2- 172.21.15.117:0/2459756007 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7faaec06b420 0x7faaec06d8d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faaf00041d0 tx=0x7faaf000b040 comp rx=0 tx=0).stop 2024-04-12T09:12:26.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.945+0000 7fab081f6700 1 -- 172.21.15.117:0/2459756007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab000fc310 msgr2=0x7fab000fba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:26.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.945+0000 7fab081f6700 1 --2- 172.21.15.117:0/2459756007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab000fc310 0x7fab000fba30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faafc00b970 tx=0x7faafc009e30 comp rx=0 tx=0).stop 2024-04-12T09:12:26.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.945+0000 7fab081f6700 1 -- 172.21.15.117:0/2459756007 shutdown_connections 2024-04-12T09:12:26.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.945+0000 7fab081f6700 1 --2- 172.21.15.117:0/2459756007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab000fc310 0x7fab000fba30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:26.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.945+0000 7fab081f6700 1 --2- 172.21.15.117:0/2459756007 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7faaec06b420 0x7faaec06d8d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:26.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.945+0000 7fab081f6700 1 --2- 172.21.15.117:0/2459756007 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab000fcc60 0x7fab00112710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:26.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.945+0000 7fab081f6700 1 -- 172.21.15.117:0/2459756007 >> 172.21.15.117:0/2459756007 conn(0x7fab000f6bc0 msgr2=0x7fab000f8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:12:26.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.945+0000 7fab081f6700 1 -- 172.21.15.117:0/2459756007 shutdown_connections 2024-04-12T09:12:26.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:26.945+0000 7fab081f6700 1 -- 172.21.15.117:0/2459756007 wait complete. 2024-04-12T09:12:26.959 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:12:27.071 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.070+0000 7f9757fff700 1 -- 172.21.15.117:0/741735864 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f975c00bcb0 con 0x7f97600662e0 2024-04-12T09:12:27.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.071+0000 7f9767653700 1 -- 172.21.15.117:0/741735864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97600662e0 msgr2=0x7f97600ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:27.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.071+0000 7f9767653700 1 --2- 172.21.15.117:0/741735864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97600662e0 0x7f97600ff9c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f975c004940 tx=0x7f975c009e30 comp rx=0 tx=0).stop 2024-04-12T09:12:27.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.071+0000 7f9767653700 1 -- 172.21.15.117:0/741735864 shutdown_connections 2024-04-12T09:12:27.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.071+0000 7f9767653700 1 --2- 172.21.15.117:0/741735864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97600fff00 0x7f9760102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:27.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.071+0000 7f9767653700 1 --2- 172.21.15.117:0/741735864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97600662e0 0x7f97600ff9c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:27.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.071+0000 7f9767653700 1 -- 172.21.15.117:0/741735864 >> 172.21.15.117:0/741735864 conn(0x7f97600f7430 msgr2=0x7f97600f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:12:27.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.071+0000 7f9767653700 1 -- 172.21.15.117:0/741735864 shutdown_connections 2024-04-12T09:12:27.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.071+0000 7f9767653700 1 -- 172.21.15.117:0/741735864 wait complete. 2024-04-12T09:12:27.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.072+0000 7f9767653700 1 Processor -- start 2024-04-12T09:12:27.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.072+0000 7f9767653700 1 -- start start 2024-04-12T09:12:27.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.072+0000 7f9767653700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97600662e0 0x7f976010fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:12:27.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.072+0000 7f9767653700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97600fff00 0x7f97601101f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:12:27.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.072+0000 7f9767653700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97601107f0 con 0x7f97600662e0 2024-04-12T09:12:27.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.072+0000 7f9767653700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9760110ff0 con 0x7f97600fff00 2024-04-12T09:12:27.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.072+0000 7f97653ef700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97600662e0 0x7f976010fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:12:27.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.072+0000 7f97653ef700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97600662e0 0x7f976010fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45104/0 (socket says 172.21.15.117:45104) 2024-04-12T09:12:27.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.072+0000 7f97653ef700 1 -- 172.21.15.117:0/4177452979 learned_addr learned my addr 172.21.15.117:0/4177452979 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:12:27.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.072+0000 7f9764bee700 1 --2- 172.21.15.117:0/4177452979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97600fff00 0x7f97601101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:12:27.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.072+0000 7f97653ef700 1 -- 172.21.15.117:0/4177452979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97600fff00 msgr2=0x7f97601101f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:27.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.073+0000 7f97653ef700 1 --2- 172.21.15.117:0/4177452979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97600fff00 0x7f97601101f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:27.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.073+0000 7f97653ef700 1 -- 172.21.15.117:0/4177452979 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c005040 con 0x7f97600662e0 2024-04-12T09:12:27.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.073+0000 7f97653ef700 1 --2- 172.21.15.117:0/4177452979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97600662e0 0x7f976010fcb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f975c000c00 tx=0x7f975c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:12:27.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.073+0000 7f9755ffb700 1 -- 172.21.15.117:0/4177452979 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f975c00e040 con 0x7f97600662e0 2024-04-12T09:12:27.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.073+0000 7f9755ffb700 1 -- 172.21.15.117:0/4177452979 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f975c00bcc0 con 0x7f97600662e0 2024-04-12T09:12:27.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.073+0000 7f9767653700 1 -- 172.21.15.117:0/4177452979 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9760111270 con 0x7f97600662e0 2024-04-12T09:12:27.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.073+0000 7f9755ffb700 1 -- 172.21.15.117:0/4177452979 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f975c01c630 con 0x7f97600662e0 2024-04-12T09:12:27.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.073+0000 7f9767653700 1 -- 172.21.15.117:0/4177452979 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97601117b0 con 0x7f97600662e0 2024-04-12T09:12:27.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.074+0000 7f9767653700 1 -- 172.21.15.117:0/4177452979 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f976005f5f0 con 0x7f97600662e0 2024-04-12T09:12:27.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.075+0000 7f9755ffb700 1 -- 172.21.15.117:0/4177452979 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 26) v1 ==== 89099+0+0 (secure 0 0 0) 0x7f975c013980 con 0x7f97600662e0 2024-04-12T09:12:27.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.075+0000 7f9755ffb700 1 --2- 172.21.15.117:0/4177452979 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f974c06b420 0x7f974c06d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:12:27.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.075+0000 7f9755ffb700 1 -- 172.21.15.117:0/4177452979 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f975c08b290 con 0x7f97600662e0 2024-04-12T09:12:27.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.076+0000 7f9764bee700 1 --2- 172.21.15.117:0/4177452979 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f974c06b420 0x7f974c06d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:12:27.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.076+0000 7f9764bee700 1 --2- 172.21.15.117:0/4177452979 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f974c06b420 0x7f974c06d8d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9750007fd0 tx=0x7f9750009040 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:12:27.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.081+0000 7f9755ffb700 1 -- 172.21.15.117:0/4177452979 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f975c058e30 con 0x7f97600662e0 2024-04-12T09:12:27.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:26 smithi117 ceph-mon[29277]: Upgrade: Updating mgr.smithi117.oyaxql 2024-04-12T09:12:27.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:26 smithi117 ceph-mon[29277]: Deploying daemon mgr.smithi117.oyaxql on smithi117 2024-04-12T09:12:27.178 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:26 smithi203 ceph-mon[36428]: Upgrade: Updating mgr.smithi117.oyaxql 2024-04-12T09:12:27.178 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:26 smithi203 ceph-mon[36428]: Deploying daemon mgr.smithi117.oyaxql on smithi117 2024-04-12T09:12:27.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.340+0000 7f9767653700 1 -- 172.21.15.117:0/4177452979 --> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9760111a90 con 0x7f974c06b420 2024-04-12T09:12:27.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.341+0000 7f9755ffb700 1 -- 172.21.15.117:0/4177452979 <== mgr.24371 v2:172.21.15.203:6828/2773660052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f9760111a90 con 0x7f974c06b420 2024-04-12T09:12:27.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.343+0000 7f9767653700 1 -- 172.21.15.117:0/4177452979 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f974c06b420 msgr2=0x7f974c06d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:27.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.343+0000 7f9767653700 1 --2- 172.21.15.117:0/4177452979 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f974c06b420 0x7f974c06d8d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9750007fd0 tx=0x7f9750009040 comp rx=0 tx=0).stop 2024-04-12T09:12:27.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.343+0000 7f9767653700 1 -- 172.21.15.117:0/4177452979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97600662e0 msgr2=0x7f976010fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:27.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.343+0000 7f9767653700 1 --2- 172.21.15.117:0/4177452979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97600662e0 0x7f976010fcb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f975c000c00 tx=0x7f975c009e30 comp rx=0 tx=0).stop 2024-04-12T09:12:27.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.343+0000 7f9767653700 1 -- 172.21.15.117:0/4177452979 shutdown_connections 2024-04-12T09:12:27.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.343+0000 7f9767653700 1 --2- 172.21.15.117:0/4177452979 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f974c06b420 0x7f974c06d8d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:27.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.343+0000 7f9767653700 1 --2- 172.21.15.117:0/4177452979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97600662e0 0x7f976010fcb0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:27.345 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.343+0000 7f9767653700 1 --2- 172.21.15.117:0/4177452979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97600fff00 0x7f97601101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:27.345 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.343+0000 7f9767653700 1 -- 172.21.15.117:0/4177452979 >> 172.21.15.117:0/4177452979 conn(0x7f97600f7430 msgr2=0x7f97600fba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:12:27.345 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.343+0000 7f9767653700 1 -- 172.21.15.117:0/4177452979 shutdown_connections 2024-04-12T09:12:27.345 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.343+0000 7f9767653700 1 -- 172.21.15.117:0/4177452979 wait complete. 2024-04-12T09:12:27.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.473+0000 7f11ac415700 1 -- 172.21.15.117:0/3793334688 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11a40fbd00 msgr2=0x7f11a40fc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:27.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.473+0000 7f11ac415700 1 --2- 172.21.15.117:0/3793334688 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11a40fbd00 0x7f11a40fc110 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f11a0004940 tx=0x7f11a0009e30 comp rx=0 tx=0).stop 2024-04-12T09:12:27.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.473+0000 7f11ac415700 1 -- 172.21.15.117:0/3793334688 shutdown_connections 2024-04-12T09:12:27.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.473+0000 7f11ac415700 1 --2- 172.21.15.117:0/3793334688 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11a40fcfb0 0x7f11a40fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:27.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.473+0000 7f11ac415700 1 --2- 172.21.15.117:0/3793334688 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11a40fbd00 0x7f11a40fc110 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:27.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.473+0000 7f11ac415700 1 -- 172.21.15.117:0/3793334688 >> 172.21.15.117:0/3793334688 conn(0x7f11a40f7440 msgr2=0x7f11a40f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:12:27.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.473+0000 7f11ac415700 1 -- 172.21.15.117:0/3793334688 shutdown_connections 2024-04-12T09:12:27.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.473+0000 7f11ac415700 1 -- 172.21.15.117:0/3793334688 wait complete. 2024-04-12T09:12:27.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.473+0000 7f11ac415700 1 Processor -- start 2024-04-12T09:12:27.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.474+0000 7f11ac415700 1 -- start start 2024-04-12T09:12:27.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.474+0000 7f11ac415700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11a40fbd00 0x7f11a410d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:12:27.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.474+0000 7f11ac415700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11a40fcfb0 0x7f11a410de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:12:27.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.474+0000 7f11ac415700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a410e460 con 0x7f11a40fcfb0 2024-04-12T09:12:27.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.474+0000 7f11ac415700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a410e5d0 con 0x7f11a40fbd00 2024-04-12T09:12:27.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.474+0000 7f11a99b0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11a40fcfb0 0x7f11a410de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:12:27.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.474+0000 7f11a99b0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11a40fcfb0 0x7f11a410de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45136/0 (socket says 172.21.15.117:45136) 2024-04-12T09:12:27.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.474+0000 7f11a99b0700 1 -- 172.21.15.117:0/161046816 learned_addr learned my addr 172.21.15.117:0/161046816 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:12:27.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.474+0000 7f11aa1b1700 1 --2- 172.21.15.117:0/161046816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11a40fbd00 0x7f11a410d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:12:27.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.474+0000 7f11a99b0700 1 -- 172.21.15.117:0/161046816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11a40fbd00 msgr2=0x7f11a410d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:27.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.474+0000 7f11a99b0700 1 --2- 172.21.15.117:0/161046816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11a40fbd00 0x7f11a410d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:27.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.474+0000 7f11a99b0700 1 -- 172.21.15.117:0/161046816 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a0005040 con 0x7f11a40fcfb0 2024-04-12T09:12:27.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.474+0000 7f11aa1b1700 1 --2- 172.21.15.117:0/161046816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11a40fbd00 0x7f11a410d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T09:12:27.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.475+0000 7f11a99b0700 1 --2- 172.21.15.117:0/161046816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11a40fcfb0 0x7f11a410de60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1194002a50 tx=0x7f11940046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:12:27.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.475+0000 7f119affd700 1 -- 172.21.15.117:0/161046816 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1194007cc0 con 0x7f11a40fcfb0 2024-04-12T09:12:27.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.475+0000 7f11ac415700 1 -- 172.21.15.117:0/161046816 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a4113030 con 0x7f11a40fcfb0 2024-04-12T09:12:27.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.475+0000 7f119affd700 1 -- 172.21.15.117:0/161046816 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f119400f040 con 0x7f11a40fcfb0 2024-04-12T09:12:27.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.475+0000 7f119affd700 1 -- 172.21.15.117:0/161046816 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1194009640 con 0x7f11a40fcfb0 2024-04-12T09:12:27.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.475+0000 7f11ac415700 1 -- 172.21.15.117:0/161046816 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a41135c0 con 0x7f11a40fcfb0 2024-04-12T09:12:27.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.476+0000 7f11ac415700 1 -- 172.21.15.117:0/161046816 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a404c710 con 0x7f11a40fcfb0 2024-04-12T09:12:27.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.476+0000 7f119affd700 1 -- 172.21.15.117:0/161046816 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 26) v1 ==== 89099+0+0 (secure 0 0 0) 0x7f11940097a0 con 0x7f11a40fcfb0 2024-04-12T09:12:27.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.477+0000 7f119affd700 1 --2- 172.21.15.117:0/161046816 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f119006b470 0x7f119006d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:12:27.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.477+0000 7f119affd700 1 -- 172.21.15.117:0/161046816 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f1194089d40 con 0x7f11a40fcfb0 2024-04-12T09:12:27.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.477+0000 7f11aa1b1700 1 --2- 172.21.15.117:0/161046816 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f119006b470 0x7f119006d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:12:27.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.477+0000 7f11aa1b1700 1 --2- 172.21.15.117:0/161046816 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f119006b470 0x7f119006d920 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f11a000b3b0 tx=0x7f11a0009e30 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:12:27.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.482+0000 7f119affd700 1 -- 172.21.15.117:0/161046816 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f1194057730 con 0x7f11a40fcfb0 2024-04-12T09:12:27.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.785+0000 7f11ac415700 1 -- 172.21.15.117:0/161046816 --> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f11a41012a0 con 0x7f119006b470 2024-04-12T09:12:27.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.795+0000 7f119affd700 1 -- 172.21.15.117:0/161046816 <== mgr.24371 v2:172.21.15.203:6828/2773660052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f11a41012a0 con 0x7f119006b470 2024-04-12T09:12:27.796 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:12:27.796 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 starting - - - - 2024-04-12T09:12:27.796 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (9m) 70s ago 9m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad 1e9f2c6a4491 2024-04-12T09:12:27.796 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (8m) 93s ago 8m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad e42da3f6e517 2024-04-12T09:12:27.796 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 starting - - - - 2024-04-12T09:12:27.797 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (4m) 70s ago 4m 157M - 17.2.7-827-gd3b5060a 21de9b7369ad de062e2c10e7 2024-04-12T09:12:27.797 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 running (4m) 70s ago 4m 11.8M - 17.2.7-827-gd3b5060a 21de9b7369ad 1e82c6241a18 2024-04-12T09:12:27.797 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (4m) 93s ago 4m 14.6M - 17.2.7-827-gd3b5060a 21de9b7369ad b05228e997f7 2024-04-12T09:12:27.797 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (4m) 93s ago 4m 15.0M - 17.2.7-827-gd3b5060a 21de9b7369ad 6d7f82c072c7 2024-04-12T09:12:27.797 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:9283 running (10m) 70s ago 10m 335M - 17.2.7-827-gd3b5060a 21de9b7369ad cd0beaa7ece1 2024-04-12T09:12:27.797 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283 running (118s) 93s ago 8m 489M - 19.0.0-2053-gb277feb2 668895944f0e bce98e99ffe8 2024-04-12T09:12:27.797 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (10m) 70s ago 11m 47.5M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad f9d5f7ac5270 2024-04-12T09:12:27.797 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (8m) 93s ago 8m 38.6M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad 17c0db49bb16 2024-04-12T09:12:27.797 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 starting - - - - 2024-04-12T09:12:27.797 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 starting - - - - 2024-04-12T09:12:27.797 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (7m) 70s ago 7m 110M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 77040a2498f3 2024-04-12T09:12:27.797 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (7m) 70s ago 7m 119M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 8f9dbf0274ed 2024-04-12T09:12:27.797 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (6m) 70s ago 6m 102M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 339c5a80d1dd 2024-04-12T09:12:27.797 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (6m) 93s ago 6m 120M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad fb87d616bae3 2024-04-12T09:12:27.797 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (6m) 93s ago 6m 116M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad c873826a2dea 2024-04-12T09:12:27.798 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (5m) 93s ago 5m 108M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad 69cb7c22f002 2024-04-12T09:12:27.798 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 starting - - - - 2024-04-12T09:12:27.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.797+0000 7f11ac415700 1 -- 172.21.15.117:0/161046816 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f119006b470 msgr2=0x7f119006d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:27.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.797+0000 7f11ac415700 1 --2- 172.21.15.117:0/161046816 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f119006b470 0x7f119006d920 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f11a000b3b0 tx=0x7f11a0009e30 comp rx=0 tx=0).stop 2024-04-12T09:12:27.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.797+0000 7f11ac415700 1 -- 172.21.15.117:0/161046816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11a40fcfb0 msgr2=0x7f11a410de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:27.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.797+0000 7f11ac415700 1 --2- 172.21.15.117:0/161046816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11a40fcfb0 0x7f11a410de60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1194002a50 tx=0x7f11940046b0 comp rx=0 tx=0).stop 2024-04-12T09:12:27.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.797+0000 7f11ac415700 1 -- 172.21.15.117:0/161046816 shutdown_connections 2024-04-12T09:12:27.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.797+0000 7f11ac415700 1 --2- 172.21.15.117:0/161046816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11a40fbd00 0x7f11a410d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:27.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.797+0000 7f11ac415700 1 --2- 172.21.15.117:0/161046816 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f119006b470 0x7f119006d920 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:27.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.797+0000 7f11ac415700 1 --2- 172.21.15.117:0/161046816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11a40fcfb0 0x7f11a410de60 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:27.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.797+0000 7f11ac415700 1 -- 172.21.15.117:0/161046816 >> 172.21.15.117:0/161046816 conn(0x7f11a40f7440 msgr2=0x7f11a40f8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:12:27.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.797+0000 7f11ac415700 1 -- 172.21.15.117:0/161046816 shutdown_connections 2024-04-12T09:12:27.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.797+0000 7f11ac415700 1 -- 172.21.15.117:0/161046816 wait complete. 2024-04-12T09:12:27.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.965+0000 7fa6d0ef3700 1 -- 172.21.15.117:0/3025413351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6cc0fcf80 msgr2=0x7fa6cc0fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:27.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.965+0000 7fa6d0ef3700 1 --2- 172.21.15.117:0/3025413351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6cc0fcf80 0x7fa6cc0fd3f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0004880 tx=0x7fa6c0009e30 comp rx=0 tx=0).stop 2024-04-12T09:12:27.967 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:27 smithi117 ceph-mon[29277]: pgmap v54: 65 pgs: 65 active+clean; 280 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 1.9 MiB/s wr, 524 op/s 2024-04-12T09:12:27.967 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:27 smithi117 ceph-mon[29277]: from='client.24453 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:12:27.967 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:27 smithi117 ceph-mon[29277]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:12:27.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.966+0000 7fa6d0ef3700 1 -- 172.21.15.117:0/3025413351 shutdown_connections 2024-04-12T09:12:27.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.966+0000 7fa6d0ef3700 1 --2- 172.21.15.117:0/3025413351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6cc0fcf80 0x7fa6cc0fd3f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:27.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.966+0000 7fa6d0ef3700 1 --2- 172.21.15.117:0/3025413351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6cc0fbcd0 0x7fa6cc0fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:27.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.966+0000 7fa6d0ef3700 1 -- 172.21.15.117:0/3025413351 >> 172.21.15.117:0/3025413351 conn(0x7fa6cc0f7430 msgr2=0x7fa6cc0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:12:27.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.967+0000 7fa6d0ef3700 1 -- 172.21.15.117:0/3025413351 shutdown_connections 2024-04-12T09:12:27.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.967+0000 7fa6d0ef3700 1 -- 172.21.15.117:0/3025413351 wait complete. 2024-04-12T09:12:27.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.968+0000 7fa6d0ef3700 1 Processor -- start 2024-04-12T09:12:27.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.968+0000 7fa6d0ef3700 1 -- start start 2024-04-12T09:12:27.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.968+0000 7fa6d0ef3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6cc0fbcd0 0x7fa6cc113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:12:27.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.968+0000 7fa6d0ef3700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6cc0fcf80 0x7fa6cc114530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:12:27.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.968+0000 7fa6d0ef3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc114b30 con 0x7fa6cc0fbcd0 2024-04-12T09:12:27.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.968+0000 7fa6d0ef3700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc115380 con 0x7fa6cc0fcf80 2024-04-12T09:12:27.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.968+0000 7fa6ca59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6cc0fbcd0 0x7fa6cc113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:12:27.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.969+0000 7fa6ca59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6cc0fbcd0 0x7fa6cc113ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45150/0 (socket says 172.21.15.117:45150) 2024-04-12T09:12:27.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.969+0000 7fa6ca59c700 1 -- 172.21.15.117:0/3966066343 learned_addr learned my addr 172.21.15.117:0/3966066343 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:12:27.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.969+0000 7fa6c9d9b700 1 --2- 172.21.15.117:0/3966066343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6cc0fcf80 0x7fa6cc114530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:12:27.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.969+0000 7fa6ca59c700 1 -- 172.21.15.117:0/3966066343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6cc0fcf80 msgr2=0x7fa6cc114530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:27.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.969+0000 7fa6ca59c700 1 --2- 172.21.15.117:0/3966066343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6cc0fcf80 0x7fa6cc114530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:27.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.969+0000 7fa6ca59c700 1 -- 172.21.15.117:0/3966066343 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c0005040 con 0x7fa6cc0fbcd0 2024-04-12T09:12:27.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.970+0000 7fa6ca59c700 1 --2- 172.21.15.117:0/3966066343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6cc0fbcd0 0x7fa6cc113ff0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc002a50 tx=0x7fa6bc004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:12:27.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.970+0000 7fa6baffd700 1 -- 172.21.15.117:0/3966066343 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6bc007cc0 con 0x7fa6cc0fbcd0 2024-04-12T09:12:27.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.970+0000 7fa6baffd700 1 -- 172.21.15.117:0/3966066343 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa6bc00f040 con 0x7fa6cc0fbcd0 2024-04-12T09:12:27.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.970+0000 7fa6d0ef3700 1 -- 172.21.15.117:0/3966066343 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6cc115660 con 0x7fa6cc0fbcd0 2024-04-12T09:12:27.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.970+0000 7fa6d0ef3700 1 -- 172.21.15.117:0/3966066343 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6cc115ba0 con 0x7fa6cc0fbcd0 2024-04-12T09:12:27.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.970+0000 7fa6baffd700 1 -- 172.21.15.117:0/3966066343 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6bc00da60 con 0x7fa6cc0fbcd0 2024-04-12T09:12:27.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.972+0000 7fa6d0ef3700 1 -- 172.21.15.117:0/3966066343 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6cc102a50 con 0x7fa6cc0fbcd0 2024-04-12T09:12:27.973 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.972+0000 7fa6baffd700 1 -- 172.21.15.117:0/3966066343 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 26) v1 ==== 89099+0+0 (secure 0 0 0) 0x7fa6bc00dbc0 con 0x7fa6cc0fbcd0 2024-04-12T09:12:27.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.973+0000 7fa6baffd700 1 --2- 172.21.15.117:0/3966066343 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fa6b406b480 0x7fa6b406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:12:27.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.973+0000 7fa6baffd700 1 -- 172.21.15.117:0/3966066343 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa6bc089500 con 0x7fa6cc0fbcd0 2024-04-12T09:12:27.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.974+0000 7fa6c9d9b700 1 --2- 172.21.15.117:0/3966066343 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fa6b406b480 0x7fa6b406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:12:27.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.974+0000 7fa6c9d9b700 1 --2- 172.21.15.117:0/3966066343 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fa6b406b480 0x7fa6b406d930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0013920 tx=0x7fa6c0009e30 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:12:27.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:27.983+0000 7fa6baffd700 1 -- 172.21.15.117:0/3966066343 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7fa6bc04eb80 con 0x7fa6cc0fbcd0 2024-04-12T09:12:28.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:27 smithi203 ceph-mon[36428]: pgmap v54: 65 pgs: 65 active+clean; 280 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 1.9 MiB/s wr, 524 op/s 2024-04-12T09:12:28.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:27 smithi203 ceph-mon[36428]: from='client.24453 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:12:28.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:27 smithi203 ceph-mon[36428]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:12:28.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.363+0000 7fa6d0ef3700 1 -- 172.21.15.117:0/3966066343 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa6cc107c50 con 0x7fa6cc0fbcd0 2024-04-12T09:12:28.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.363+0000 7fa6baffd700 1 -- 172.21.15.117:0/3966066343 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7fa6bc056f70 con 0x7fa6cc0fbcd0 2024-04-12T09:12:28.364 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:12:28.365 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": { 2024-04-12T09:12:28.365 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 2 2024-04-12T09:12:28.365 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:12:28.365 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": { 2024-04-12T09:12:28.365 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 1, 2024-04-12T09:12:28.365 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 1 2024-04-12T09:12:28.365 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:12:28.365 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": { 2024-04-12T09:12:28.365 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 6 2024-04-12T09:12:28.365 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:12:28.365 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-04-12T09:12:28.365 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 4 2024-04-12T09:12:28.365 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:12:28.365 INFO:teuthology.orchestra.run.smithi117.stdout: "overall": { 2024-04-12T09:12:28.366 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 13, 2024-04-12T09:12:28.366 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 1 2024-04-12T09:12:28.366 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:12:28.366 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:12:28.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.366+0000 7fa6d0ef3700 1 -- 172.21.15.117:0/3966066343 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fa6b406b480 msgr2=0x7fa6b406d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:28.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.366+0000 7fa6d0ef3700 1 --2- 172.21.15.117:0/3966066343 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fa6b406b480 0x7fa6b406d930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0013920 tx=0x7fa6c0009e30 comp rx=0 tx=0).stop 2024-04-12T09:12:28.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.366+0000 7fa6d0ef3700 1 -- 172.21.15.117:0/3966066343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6cc0fbcd0 msgr2=0x7fa6cc113ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:28.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.366+0000 7fa6d0ef3700 1 --2- 172.21.15.117:0/3966066343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6cc0fbcd0 0x7fa6cc113ff0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc002a50 tx=0x7fa6bc004630 comp rx=0 tx=0).stop 2024-04-12T09:12:28.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.366+0000 7fa6d0ef3700 1 -- 172.21.15.117:0/3966066343 shutdown_connections 2024-04-12T09:12:28.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.366+0000 7fa6d0ef3700 1 --2- 172.21.15.117:0/3966066343 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7fa6b406b480 0x7fa6b406d930 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:28.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.366+0000 7fa6d0ef3700 1 --2- 172.21.15.117:0/3966066343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6cc0fbcd0 0x7fa6cc113ff0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:28.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.366+0000 7fa6d0ef3700 1 --2- 172.21.15.117:0/3966066343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6cc0fcf80 0x7fa6cc114530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:28.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.366+0000 7fa6d0ef3700 1 -- 172.21.15.117:0/3966066343 >> 172.21.15.117:0/3966066343 conn(0x7fa6cc0f7430 msgr2=0x7fa6cc0f8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:12:28.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.366+0000 7fa6d0ef3700 1 -- 172.21.15.117:0/3966066343 shutdown_connections 2024-04-12T09:12:28.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.366+0000 7fa6d0ef3700 1 -- 172.21.15.117:0/3966066343 wait complete. 2024-04-12T09:12:28.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.483+0000 7f6018e95700 1 -- 172.21.15.117:0/1686284657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60140fcf80 msgr2=0x7f60140fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:28.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.483+0000 7f6018e95700 1 --2- 172.21.15.117:0/1686284657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60140fcf80 0x7f60140fd3f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6008004940 tx=0x7f6008009e30 comp rx=0 tx=0).stop 2024-04-12T09:12:28.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.483+0000 7f6018e95700 1 -- 172.21.15.117:0/1686284657 shutdown_connections 2024-04-12T09:12:28.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.483+0000 7f6018e95700 1 --2- 172.21.15.117:0/1686284657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60140fcf80 0x7f60140fd3f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:28.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.483+0000 7f6018e95700 1 --2- 172.21.15.117:0/1686284657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60140fbcd0 0x7f60140fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:28.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.483+0000 7f6018e95700 1 -- 172.21.15.117:0/1686284657 >> 172.21.15.117:0/1686284657 conn(0x7f60140f7430 msgr2=0x7f60140f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:12:28.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.483+0000 7f6018e95700 1 -- 172.21.15.117:0/1686284657 shutdown_connections 2024-04-12T09:12:28.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.483+0000 7f6018e95700 1 -- 172.21.15.117:0/1686284657 wait complete. 2024-04-12T09:12:28.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.484+0000 7f6018e95700 1 Processor -- start 2024-04-12T09:12:28.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.484+0000 7f6018e95700 1 -- start start 2024-04-12T09:12:28.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.484+0000 7f6018e95700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60140fbcd0 0x7f601410d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:12:28.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.484+0000 7f6018e95700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60140fcf80 0x7f601410df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:12:28.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.484+0000 7f6018e95700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601410e500 con 0x7f60140fcf80 2024-04-12T09:12:28.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.484+0000 7f6018e95700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601410ed00 con 0x7f60140fbcd0 2024-04-12T09:12:28.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.484+0000 7f6011d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60140fcf80 0x7f601410df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:12:28.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.484+0000 7f6011d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60140fcf80 0x7f601410df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45174/0 (socket says 172.21.15.117:45174) 2024-04-12T09:12:28.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.484+0000 7f6011d9b700 1 -- 172.21.15.117:0/495953329 learned_addr learned my addr 172.21.15.117:0/495953329 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:12:28.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.484+0000 7f601259c700 1 --2- 172.21.15.117:0/495953329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60140fbcd0 0x7f601410d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:12:28.486 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.485+0000 7f6011d9b700 1 -- 172.21.15.117:0/495953329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60140fbcd0 msgr2=0x7f601410d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:28.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.485+0000 7f6011d9b700 1 --2- 172.21.15.117:0/495953329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60140fbcd0 0x7f601410d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:28.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.485+0000 7f6011d9b700 1 -- 172.21.15.117:0/495953329 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6008005040 con 0x7f60140fcf80 2024-04-12T09:12:28.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.485+0000 7f6011d9b700 1 --2- 172.21.15.117:0/495953329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60140fcf80 0x7f601410df00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6008009150 tx=0x7f6008009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:12:28.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.485+0000 7f6002ffd700 1 -- 172.21.15.117:0/495953329 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f600800e040 con 0x7f60140fcf80 2024-04-12T09:12:28.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.485+0000 7f6002ffd700 1 -- 172.21.15.117:0/495953329 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6008004290 con 0x7f60140fcf80 2024-04-12T09:12:28.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.485+0000 7f6018e95700 1 -- 172.21.15.117:0/495953329 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f601410ef80 con 0x7f60140fcf80 2024-04-12T09:12:28.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.485+0000 7f6002ffd700 1 -- 172.21.15.117:0/495953329 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f600801c630 con 0x7f60140fcf80 2024-04-12T09:12:28.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.485+0000 7f6018e95700 1 -- 172.21.15.117:0/495953329 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601410f4c0 con 0x7f60140fcf80 2024-04-12T09:12:28.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.486+0000 7f6018e95700 1 -- 172.21.15.117:0/495953329 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6014101b10 con 0x7f60140fcf80 2024-04-12T09:12:28.488 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.487+0000 7f6002ffd700 1 -- 172.21.15.117:0/495953329 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 26) v1 ==== 89099+0+0 (secure 0 0 0) 0x7f600800bbf0 con 0x7f60140fcf80 2024-04-12T09:12:28.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.488+0000 7f6002ffd700 1 --2- 172.21.15.117:0/495953329 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f5ffc06b420 0x7f5ffc06d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:12:28.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.488+0000 7f6002ffd700 1 -- 172.21.15.117:0/495953329 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f600808a940 con 0x7f60140fcf80 2024-04-12T09:12:28.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.488+0000 7f601259c700 1 --2- 172.21.15.117:0/495953329 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f5ffc06b420 0x7f5ffc06d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:12:28.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.488+0000 7f601259c700 1 --2- 172.21.15.117:0/495953329 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f5ffc06b420 0x7f5ffc06d8d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6004009fd0 tx=0x7f600400b040 comp rx=0 tx=0).ready entity=mgr.24371 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:12:28.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.493+0000 7f6002ffd700 1 -- 172.21.15.117:0/495953329 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f6008058610 con 0x7f60140fcf80 2024-04-12T09:12:28.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.811+0000 7f6018e95700 1 -- 172.21.15.117:0/495953329 --> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f60141048d0 con 0x7f5ffc06b420 2024-04-12T09:12:28.816 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:12:28.816 INFO:teuthology.orchestra.run.smithi117.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec", 2024-04-12T09:12:28.816 INFO:teuthology.orchestra.run.smithi117.stdout: "in_progress": true, 2024-04-12T09:12:28.817 INFO:teuthology.orchestra.run.smithi117.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-12T09:12:28.817 INFO:teuthology.orchestra.run.smithi117.stdout: "services_complete": [], 2024-04-12T09:12:28.817 INFO:teuthology.orchestra.run.smithi117.stdout: "progress": "1/2 daemons upgraded", 2024-04-12T09:12:28.817 INFO:teuthology.orchestra.run.smithi117.stdout: "message": "Currently upgrading mgr daemons", 2024-04-12T09:12:28.817 INFO:teuthology.orchestra.run.smithi117.stdout: "is_paused": false 2024-04-12T09:12:28.817 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:12:28.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.813+0000 7f6002ffd700 1 -- 172.21.15.117:0/495953329 <== mgr.24371 v2:172.21.15.203:6828/2773660052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f60141048d0 con 0x7f5ffc06b420 2024-04-12T09:12:28.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.816+0000 7f6018e95700 1 -- 172.21.15.117:0/495953329 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f5ffc06b420 msgr2=0x7f5ffc06d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:28.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.816+0000 7f6018e95700 1 --2- 172.21.15.117:0/495953329 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f5ffc06b420 0x7f5ffc06d8d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6004009fd0 tx=0x7f600400b040 comp rx=0 tx=0).stop 2024-04-12T09:12:28.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.816+0000 7f6018e95700 1 -- 172.21.15.117:0/495953329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60140fcf80 msgr2=0x7f601410df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:28.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.816+0000 7f6018e95700 1 --2- 172.21.15.117:0/495953329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60140fcf80 0x7f601410df00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6008009150 tx=0x7f6008009e30 comp rx=0 tx=0).stop 2024-04-12T09:12:28.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.816+0000 7f6018e95700 1 -- 172.21.15.117:0/495953329 shutdown_connections 2024-04-12T09:12:28.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.816+0000 7f6018e95700 1 --2- 172.21.15.117:0/495953329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60140fbcd0 0x7f601410d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:28.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.816+0000 7f6018e95700 1 --2- 172.21.15.117:0/495953329 >> [v2:172.21.15.203:6828/2773660052,v1:172.21.15.203:6829/2773660052] conn(0x7f5ffc06b420 0x7f5ffc06d8d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:28.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.816+0000 7f6018e95700 1 --2- 172.21.15.117:0/495953329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60140fcf80 0x7f601410df00 secure :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6008009150 tx=0x7f6008009e30 comp rx=0 tx=0).stop 2024-04-12T09:12:28.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.816+0000 7f6018e95700 1 -- 172.21.15.117:0/495953329 >> 172.21.15.117:0/495953329 conn(0x7f60140f7430 msgr2=0x7f6014065b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:12:28.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.819+0000 7f6018e95700 1 -- 172.21.15.117:0/495953329 shutdown_connections 2024-04-12T09:12:28.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:28.819+0000 7f6018e95700 1 -- 172.21.15.117:0/495953329 wait complete. 2024-04-12T09:12:28.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:28 smithi117 ceph-mon[29277]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:12:28.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:28 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/3966066343' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:12:29.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:28 smithi203 ceph-mon[36428]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:12:29.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:28 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/3966066343' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:12:30.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:29 smithi117 ceph-mon[29277]: pgmap v55: 65 pgs: 65 active+clean; 280 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.3 MiB/s wr, 327 op/s 2024-04-12T09:12:30.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:29 smithi117 ceph-mon[29277]: from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:12:30.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:29 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:12:30.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:29 smithi203 ceph-mon[36428]: pgmap v55: 65 pgs: 65 active+clean; 280 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.3 MiB/s wr, 327 op/s 2024-04-12T09:12:30.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:29 smithi203 ceph-mon[36428]: from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:12:30.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:29 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:12:32.127 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:31 smithi203 ceph-mon[36428]: pgmap v56: 65 pgs: 65 active+clean; 279 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.3 MiB/s wr, 399 op/s 2024-04-12T09:12:32.127 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:31 smithi117 ceph-mon[29277]: pgmap v56: 65 pgs: 65 active+clean; 279 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.3 MiB/s wr, 399 op/s 2024-04-12T09:12:34.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:33 smithi117 ceph-mon[29277]: pgmap v57: 65 pgs: 65 active+clean; 280 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 1.6 MiB/s wr, 549 op/s 2024-04-12T09:12:34.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:33 smithi203 ceph-mon[36428]: pgmap v57: 65 pgs: 65 active+clean; 280 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 1.6 MiB/s wr, 549 op/s 2024-04-12T09:12:36.055 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:35 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:36.055 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:35 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:36.055 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:35 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:12:36.055 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:35 smithi203 ceph-mon[36428]: pgmap v58: 65 pgs: 65 active+clean; 280 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.3 MiB/s wr, 437 op/s 2024-04-12T09:12:36.055 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:35 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:36.055 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:35 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:36.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:35 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:36.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:35 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:36.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:35 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:12:36.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:35 smithi117 ceph-mon[29277]: pgmap v58: 65 pgs: 65 active+clean; 280 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.3 MiB/s wr, 437 op/s 2024-04-12T09:12:36.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:35 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:36.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:35 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:37.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:37 smithi117 ceph-mon[29277]: pgmap v59: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.8 MiB/s wr, 654 op/s 2024-04-12T09:12:38.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:37 smithi203 ceph-mon[36428]: pgmap v59: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.8 MiB/s wr, 654 op/s 2024-04-12T09:12:39.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:39 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:39.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:39 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:39.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:39 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:39.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:39 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:40.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:40 smithi203 ceph-mon[36428]: pgmap v60: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.1 MiB/s wr, 487 op/s 2024-04-12T09:12:40.608 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:40 smithi117 ceph-mon[29277]: pgmap v60: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.1 MiB/s wr, 487 op/s 2024-04-12T09:12:42.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:42 smithi203 ceph-mon[36428]: pgmap v61: 65 pgs: 65 active+clean; 264 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.1 MiB/s wr, 525 op/s 2024-04-12T09:12:42.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:42 smithi117 ceph-mon[29277]: pgmap v61: 65 pgs: 65 active+clean; 264 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.1 MiB/s wr, 525 op/s 2024-04-12T09:12:44.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:44 smithi203 ceph-mon[36428]: pgmap v62: 65 pgs: 65 active+clean; 258 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.6 MiB/s wr, 578 op/s 2024-04-12T09:12:44.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:44 smithi203 ceph-mon[36428]: Standby manager daemon smithi117.oyaxql restarted 2024-04-12T09:12:44.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:44 smithi203 ceph-mon[36428]: Standby manager daemon smithi117.oyaxql started 2024-04-12T09:12:44.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:44 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.oyaxql/crt"}]: dispatch 2024-04-12T09:12:44.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:44 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T09:12:44.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:44 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.oyaxql/key"}]: dispatch 2024-04-12T09:12:44.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:44 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T09:12:44.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:44 smithi117 ceph-mon[29277]: pgmap v62: 65 pgs: 65 active+clean; 258 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.6 MiB/s wr, 578 op/s 2024-04-12T09:12:44.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:44 smithi117 ceph-mon[29277]: Standby manager daemon smithi117.oyaxql restarted 2024-04-12T09:12:44.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:44 smithi117 ceph-mon[29277]: Standby manager daemon smithi117.oyaxql started 2024-04-12T09:12:44.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:44 smithi117 ceph-mon[29277]: from='mgr.? 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.oyaxql/crt"}]: dispatch 2024-04-12T09:12:44.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:44 smithi117 ceph-mon[29277]: from='mgr.? 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T09:12:44.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:44 smithi117 ceph-mon[29277]: from='mgr.? 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.oyaxql/key"}]: dispatch 2024-04-12T09:12:44.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:44 smithi117 ceph-mon[29277]: from='mgr.? 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T09:12:45.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:45 smithi203 ceph-mon[36428]: mgrmap e27: smithi203.apfqpo(active, since 119s), standbys: smithi117.oyaxql 2024-04-12T09:12:45.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:45 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:12:45.638 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:45 smithi117 ceph-mon[29277]: mgrmap e27: smithi203.apfqpo(active, since 119s), standbys: smithi117.oyaxql 2024-04-12T09:12:45.638 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:45 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:12:46.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:46 smithi203 ceph-mon[36428]: pgmap v63: 65 pgs: 65 active+clean; 258 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.1 MiB/s wr, 380 op/s 2024-04-12T09:12:46.627 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:46 smithi117 ceph-mon[29277]: pgmap v63: 65 pgs: 65 active+clean; 258 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.1 MiB/s wr, 380 op/s 2024-04-12T09:12:48.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:47 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:48.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:47 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:47 smithi203 ceph-mon[36428]: pgmap v64: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.6 MiB/s wr, 673 op/s 2024-04-12T09:12:48.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:47 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:48.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:47 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:48.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:47 smithi117 ceph-mon[29277]: pgmap v64: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.6 MiB/s wr, 673 op/s 2024-04-12T09:12:49.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:49 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:49.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:49 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:49.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:49 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:49.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:49 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:50.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:50 smithi117 ceph-mon[29277]: pgmap v65: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.1 MiB/s wr, 456 op/s 2024-04-12T09:12:50.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:50 smithi203 ceph-mon[36428]: pgmap v65: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.1 MiB/s wr, 456 op/s 2024-04-12T09:12:52.513 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:52 smithi117 ceph-mon[29277]: pgmap v66: 65 pgs: 65 active+clean; 260 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.3 MiB/s wr, 500 op/s 2024-04-12T09:12:52.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:52 smithi203 ceph-mon[36428]: pgmap v66: 65 pgs: 65 active+clean; 260 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.3 MiB/s wr, 500 op/s 2024-04-12T09:12:54.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:54 smithi117 ceph-mon[29277]: pgmap v67: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 1.6 MiB/s wr, 569 op/s 2024-04-12T09:12:54.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:54 smithi203 ceph-mon[36428]: pgmap v67: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 1.6 MiB/s wr, 569 op/s 2024-04-12T09:12:55.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:55.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:55.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:12:55.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:12:55.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:55.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:12:55.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mgr fail", "who": "smithi203.apfqpo"}]: dispatch 2024-04-12T09:12:55.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mgr fail", "who": "smithi203.apfqpo"}]: dispatch 2024-04-12T09:12:55.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: osdmap e48: 6 total, 6 up, 6 in 2024-04-12T09:12:55.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' cmd='[{"prefix": "mgr fail", "who": "smithi203.apfqpo"}]': finished 2024-04-12T09:12:55.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: mgrmap e28: smithi117.oyaxql(active, starting, since 0.00703196s) 2024-04-12T09:12:55.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-04-12T09:12:55.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:12:55.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.eslmxh"}]: dispatch 2024-04-12T09:12:55.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.wddsgt"}]: dispatch 2024-04-12T09:12:55.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.fbeixl"}]: dispatch 2024-04-12T09:12:55.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.bszhxz"}]: dispatch 2024-04-12T09:12:55.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr metadata", "who": "smithi117.oyaxql", "id": "smithi117.oyaxql"}]: dispatch 2024-04-12T09:12:55.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T09:12:55.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T09:12:55.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T09:12:55.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T09:12:55.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T09:12:55.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T09:12:55.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-12T09:12:55.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-12T09:12:55.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-12T09:12:55.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: Manager daemon smithi117.oyaxql is now available 2024-04-12T09:12:55.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:12:55.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:12:55.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.oyaxql/mirror_snapshot_schedule"}]: dispatch 2024-04-12T09:12:55.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.oyaxql/trash_purge_schedule"}]: dispatch 2024-04-12T09:12:55.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:55 smithi203 ceph-mon[36428]: [12/Apr/2024:09:12:55] ENGINE Bus STARTING 2024-04-12T09:12:56.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:56.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:56.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:12:56.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:12:56.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' 2024-04-12T09:12:56.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:12:56.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.24371 172.21.15.203:0/1118615357' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mgr fail", "who": "smithi203.apfqpo"}]: dispatch 2024-04-12T09:12:56.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "mgr fail", "who": "smithi203.apfqpo"}]: dispatch 2024-04-12T09:12:56.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: osdmap e48: 6 total, 6 up, 6 in 2024-04-12T09:12:56.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.24371 ' entity='mgr.smithi203.apfqpo' cmd='[{"prefix": "mgr fail", "who": "smithi203.apfqpo"}]': finished 2024-04-12T09:12:56.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: mgrmap e28: smithi117.oyaxql(active, starting, since 0.00703196s) 2024-04-12T09:12:56.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-04-12T09:12:56.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:12:56.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.eslmxh"}]: dispatch 2024-04-12T09:12:56.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.wddsgt"}]: dispatch 2024-04-12T09:12:56.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.fbeixl"}]: dispatch 2024-04-12T09:12:56.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.bszhxz"}]: dispatch 2024-04-12T09:12:56.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr metadata", "who": "smithi117.oyaxql", "id": "smithi117.oyaxql"}]: dispatch 2024-04-12T09:12:56.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T09:12:56.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T09:12:56.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T09:12:56.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T09:12:56.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T09:12:56.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T09:12:56.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-12T09:12:56.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-12T09:12:56.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-12T09:12:56.163 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: Manager daemon smithi117.oyaxql is now available 2024-04-12T09:12:56.163 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:12:56.163 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:12:56.163 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.oyaxql/mirror_snapshot_schedule"}]: dispatch 2024-04-12T09:12:56.163 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.oyaxql/trash_purge_schedule"}]: dispatch 2024-04-12T09:12:56.163 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:55 smithi117 ceph-mon[29277]: [12/Apr/2024:09:12:55] ENGINE Bus STARTING 2024-04-12T09:12:56.805 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:56 smithi203 ceph-mon[36428]: [12/Apr/2024:09:12:55] ENGINE Serving on https://172.21.15.117:7150 2024-04-12T09:12:56.805 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:56 smithi203 ceph-mon[36428]: [12/Apr/2024:09:12:55] ENGINE Serving on http://172.21.15.117:8765 2024-04-12T09:12:56.806 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:56 smithi203 ceph-mon[36428]: [12/Apr/2024:09:12:55] ENGINE Bus STARTED 2024-04-12T09:12:56.806 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:56 smithi203 ceph-mon[36428]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-12T09:12:56.806 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:56 smithi203 ceph-mon[36428]: mgrmap e29: smithi117.oyaxql(active, since 1.00843s) 2024-04-12T09:12:56.806 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:56 smithi203 ceph-mon[36428]: pgmap v3: 65 pgs: 65 active+clean; 240 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:12:56.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:56 smithi117 ceph-mon[29277]: [12/Apr/2024:09:12:55] ENGINE Serving on https://172.21.15.117:7150 2024-04-12T09:12:56.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:56 smithi117 ceph-mon[29277]: [12/Apr/2024:09:12:55] ENGINE Serving on http://172.21.15.117:8765 2024-04-12T09:12:56.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:56 smithi117 ceph-mon[29277]: [12/Apr/2024:09:12:55] ENGINE Bus STARTED 2024-04-12T09:12:56.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:56 smithi117 ceph-mon[29277]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-12T09:12:56.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:56 smithi117 ceph-mon[29277]: mgrmap e29: smithi117.oyaxql(active, since 1.00843s) 2024-04-12T09:12:56.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:56 smithi117 ceph-mon[29277]: pgmap v3: 65 pgs: 65 active+clean; 240 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:12:57.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:57 smithi117 ceph-mon[29277]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-04-12T09:12:57.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:57 smithi117 ceph-mon[29277]: Cluster is now healthy 2024-04-12T09:12:57.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:57 smithi117 ceph-mon[29277]: pgmap v4: 65 pgs: 65 active+clean; 240 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:12:58.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:57 smithi203 ceph-mon[36428]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-04-12T09:12:58.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:57 smithi203 ceph-mon[36428]: Cluster is now healthy 2024-04-12T09:12:58.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:57 smithi203 ceph-mon[36428]: pgmap v4: 65 pgs: 65 active+clean; 240 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:12:58.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.946+0000 7ff2dff5d700 1 -- 172.21.15.117:0/1381514652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2d80fb1e0 msgr2=0x7ff2d80fb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:58.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.946+0000 7ff2dff5d700 1 --2- 172.21.15.117:0/1381514652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2d80fb1e0 0x7ff2d80fb610 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4004940 tx=0x7ff2d4009e30 comp rx=0 tx=0).stop 2024-04-12T09:12:58.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.946+0000 7ff2dff5d700 1 -- 172.21.15.117:0/1381514652 shutdown_connections 2024-04-12T09:12:58.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.946+0000 7ff2dff5d700 1 --2- 172.21.15.117:0/1381514652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2d80fbb50 0x7ff2d8102360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:58.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.946+0000 7ff2dff5d700 1 --2- 172.21.15.117:0/1381514652 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2d80fb1e0 0x7ff2d80fb610 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:58.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.946+0000 7ff2dff5d700 1 -- 172.21.15.117:0/1381514652 >> 172.21.15.117:0/1381514652 conn(0x7ff2d80f6ba0 msgr2=0x7ff2d80f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:12:58.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.946+0000 7ff2dff5d700 1 -- 172.21.15.117:0/1381514652 shutdown_connections 2024-04-12T09:12:58.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.946+0000 7ff2dff5d700 1 -- 172.21.15.117:0/1381514652 wait complete. 2024-04-12T09:12:58.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.947+0000 7ff2dff5d700 1 Processor -- start 2024-04-12T09:12:58.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.947+0000 7ff2dff5d700 1 -- start start 2024-04-12T09:12:58.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.947+0000 7ff2dff5d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2d80fb1e0 0x7ff2d80fdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:12:58.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.947+0000 7ff2dff5d700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2d80fbb50 0x7ff2d80fc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:12:58.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.947+0000 7ff2dff5d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d8111670 con 0x7ff2d80fb1e0 2024-04-12T09:12:58.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.947+0000 7ff2dff5d700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d81117e0 con 0x7ff2d80fbb50 2024-04-12T09:12:58.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.947+0000 7ff2ddcf9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2d80fb1e0 0x7ff2d80fdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:12:58.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.947+0000 7ff2ddcf9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2d80fb1e0 0x7ff2d80fdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50074/0 (socket says 172.21.15.117:50074) 2024-04-12T09:12:58.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.947+0000 7ff2ddcf9700 1 -- 172.21.15.117:0/2117448704 learned_addr learned my addr 172.21.15.117:0/2117448704 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:12:58.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.947+0000 7ff2dd4f8700 1 --2- 172.21.15.117:0/2117448704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2d80fbb50 0x7ff2d80fc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:12:58.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.948+0000 7ff2ddcf9700 1 -- 172.21.15.117:0/2117448704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2d80fbb50 msgr2=0x7ff2d80fc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:58.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.948+0000 7ff2ddcf9700 1 --2- 172.21.15.117:0/2117448704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2d80fbb50 0x7ff2d80fc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:58.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.948+0000 7ff2ddcf9700 1 -- 172.21.15.117:0/2117448704 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d4005040 con 0x7ff2d80fb1e0 2024-04-12T09:12:58.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.948+0000 7ff2ddcf9700 1 --2- 172.21.15.117:0/2117448704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2d80fb1e0 0x7ff2d80fdcf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4000c00 tx=0x7ff2d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:12:58.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.948+0000 7ff2ce7fc700 1 -- 172.21.15.117:0/2117448704 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2d400e070 con 0x7ff2d80fb1e0 2024-04-12T09:12:58.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.948+0000 7ff2ce7fc700 1 -- 172.21.15.117:0/2117448704 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff2d4009430 con 0x7ff2d80fb1e0 2024-04-12T09:12:58.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.948+0000 7ff2dff5d700 1 -- 172.21.15.117:0/2117448704 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d80fc7c0 con 0x7ff2d80fb1e0 2024-04-12T09:12:58.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.948+0000 7ff2ce7fc700 1 -- 172.21.15.117:0/2117448704 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2d400b410 con 0x7ff2d80fb1e0 2024-04-12T09:12:58.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.948+0000 7ff2dff5d700 1 -- 172.21.15.117:0/2117448704 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d80fcc50 con 0x7ff2d80fb1e0 2024-04-12T09:12:58.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.950+0000 7ff2dff5d700 1 -- 172.21.15.117:0/2117448704 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d805f5f0 con 0x7ff2d80fb1e0 2024-04-12T09:12:58.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.950+0000 7ff2ce7fc700 1 -- 172.21.15.117:0/2117448704 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 30) v1 ==== 46117+0+0 (secure 0 0 0) 0x7ff2d400b570 con 0x7ff2d80fb1e0 2024-04-12T09:12:58.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.950+0000 7ff2ce7fc700 1 --2- 172.21.15.117:0/2117448704 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7ff2c4038cc0 0x7ff2c403b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:12:58.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.950+0000 7ff2ce7fc700 1 -- 172.21.15.117:0/2117448704 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7ff2d404dfe0 con 0x7ff2d80fb1e0 2024-04-12T09:12:58.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.950+0000 7ff2dd4f8700 1 --2- 172.21.15.117:0/2117448704 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7ff2c4038cc0 0x7ff2c403b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:12:58.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.951+0000 7ff2dd4f8700 1 --2- 172.21.15.117:0/2117448704 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7ff2c4038cc0 0x7ff2c403b170 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8004fd0 tx=0x7ff2c800b040 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:12:58.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:58.955+0000 7ff2ce7fc700 1 -- 172.21.15.117:0/2117448704 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7ff2d4081b80 con 0x7ff2d80fb1e0 2024-04-12T09:12:59.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:12:58 smithi203 ceph-mon[36428]: mgrmap e30: smithi117.oyaxql(active, since 3s) 2024-04-12T09:12:59.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:12:58 smithi117 ceph-mon[29277]: mgrmap e30: smithi117.oyaxql(active, since 3s) 2024-04-12T09:12:59.229 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.228+0000 7ff2dff5d700 1 -- 172.21.15.117:0/2117448704 --> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2d8105a60 con 0x7ff2c4038cc0 2024-04-12T09:12:59.230 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.230+0000 7ff2ce7fc700 1 -- 172.21.15.117:0/2117448704 <== mgr.14694 v2:172.21.15.117:6800/1056729457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7ff2c800f040 con 0x7ff2c4038cc0 2024-04-12T09:12:59.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.232+0000 7ff2dff5d700 1 -- 172.21.15.117:0/2117448704 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7ff2c4038cc0 msgr2=0x7ff2c403b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:59.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.232+0000 7ff2dff5d700 1 --2- 172.21.15.117:0/2117448704 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7ff2c4038cc0 0x7ff2c403b170 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8004fd0 tx=0x7ff2c800b040 comp rx=0 tx=0).stop 2024-04-12T09:12:59.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.232+0000 7ff2dff5d700 1 -- 172.21.15.117:0/2117448704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2d80fb1e0 msgr2=0x7ff2d80fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:59.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.232+0000 7ff2dff5d700 1 --2- 172.21.15.117:0/2117448704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2d80fb1e0 0x7ff2d80fdcf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4000c00 tx=0x7ff2d4009e30 comp rx=0 tx=0).stop 2024-04-12T09:12:59.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.232+0000 7ff2dff5d700 1 -- 172.21.15.117:0/2117448704 shutdown_connections 2024-04-12T09:12:59.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.232+0000 7ff2dff5d700 1 --2- 172.21.15.117:0/2117448704 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7ff2c4038cc0 0x7ff2c403b170 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:59.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.232+0000 7ff2dff5d700 1 --2- 172.21.15.117:0/2117448704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2d80fb1e0 0x7ff2d80fdcf0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:59.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.232+0000 7ff2dff5d700 1 --2- 172.21.15.117:0/2117448704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2d80fbb50 0x7ff2d80fc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:59.235 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.232+0000 7ff2dff5d700 1 -- 172.21.15.117:0/2117448704 >> 172.21.15.117:0/2117448704 conn(0x7ff2d80f6ba0 msgr2=0x7ff2d81003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:12:59.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.232+0000 7ff2dff5d700 1 -- 172.21.15.117:0/2117448704 shutdown_connections 2024-04-12T09:12:59.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.232+0000 7ff2dff5d700 1 -- 172.21.15.117:0/2117448704 wait complete. 2024-04-12T09:12:59.243 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:12:59.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.391+0000 7f8a9168b700 1 -- 172.21.15.117:0/2535046802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a8c06e7e0 msgr2=0x7f8a8c06ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:59.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.391+0000 7f8a9168b700 1 --2- 172.21.15.117:0/2535046802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a8c06e7e0 0x7f8a8c06ec50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8a80004940 tx=0x7f8a80009e30 comp rx=0 tx=0).stop 2024-04-12T09:12:59.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.391+0000 7f8a9168b700 1 -- 172.21.15.117:0/2535046802 shutdown_connections 2024-04-12T09:12:59.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.391+0000 7f8a9168b700 1 --2- 172.21.15.117:0/2535046802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a8c06e7e0 0x7f8a8c06ec50 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:59.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.391+0000 7f8a9168b700 1 --2- 172.21.15.117:0/2535046802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a8c06fc00 0x7f8a8c06e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:59.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.391+0000 7f8a9168b700 1 -- 172.21.15.117:0/2535046802 >> 172.21.15.117:0/2535046802 conn(0x7f8a8c069c10 msgr2=0x7f8a8c06c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:12:59.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.392+0000 7f8a9168b700 1 -- 172.21.15.117:0/2535046802 shutdown_connections 2024-04-12T09:12:59.393 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.392+0000 7f8a9168b700 1 -- 172.21.15.117:0/2535046802 wait complete. 2024-04-12T09:12:59.394 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.392+0000 7f8a9168b700 1 Processor -- start 2024-04-12T09:12:59.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.392+0000 7f8a9168b700 1 -- start start 2024-04-12T09:12:59.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.393+0000 7f8a9168b700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a8c06e7e0 0x7f8a8c11c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:12:59.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.393+0000 7f8a9168b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a8c06fc00 0x7f8a8c11cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:12:59.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.393+0000 7f8a9168b700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c11d280 con 0x7f8a8c06fc00 2024-04-12T09:12:59.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.393+0000 7f8a9168b700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c11da70 con 0x7f8a8c06e7e0 2024-04-12T09:12:59.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.393+0000 7f8a8b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a8c06fc00 0x7f8a8c11cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:12:59.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.393+0000 7f8a8b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a8c06fc00 0x7f8a8c11cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:50102/0 (socket says 172.21.15.117:50102) 2024-04-12T09:12:59.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.393+0000 7f8a8bfff700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a8c06e7e0 0x7f8a8c11c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:12:59.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.393+0000 7f8a8bfff700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a8c06e7e0 0x7f8a8c11c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.117:56694/0 (socket says 172.21.15.117:56694) 2024-04-12T09:12:59.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.393+0000 7f8a8bfff700 1 -- 172.21.15.117:0/3397914668 learned_addr learned my addr 172.21.15.117:0/3397914668 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:12:59.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.393+0000 7f8a8bfff700 1 -- 172.21.15.117:0/3397914668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a8c06fc00 msgr2=0x7f8a8c11cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:59.395 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.393+0000 7f8a8bfff700 1 --2- 172.21.15.117:0/3397914668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a8c06fc00 0x7f8a8c11cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:59.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.393+0000 7f8a8bfff700 1 -- 172.21.15.117:0/3397914668 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a80005040 con 0x7f8a8c06e7e0 2024-04-12T09:12:59.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.394+0000 7f8a8b7fe700 1 --2- 172.21.15.117:0/3397914668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a8c06fc00 0x7f8a8c11cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T09:12:59.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.394+0000 7f8a8bfff700 1 --2- 172.21.15.117:0/3397914668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a8c06e7e0 0x7f8a8c11c6b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00b760 tx=0x7f8a7c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:12:59.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.394+0000 7f8a88ff9700 1 -- 172.21.15.117:0/3397914668 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a7c00f6f0 con 0x7f8a8c06e7e0 2024-04-12T09:12:59.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.394+0000 7f8a88ff9700 1 -- 172.21.15.117:0/3397914668 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a7c00fd20 con 0x7f8a8c06e7e0 2024-04-12T09:12:59.396 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.394+0000 7f8a9168b700 1 -- 172.21.15.117:0/3397914668 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a8c11dd50 con 0x7f8a8c06e7e0 2024-04-12T09:12:59.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.395+0000 7f8a88ff9700 1 -- 172.21.15.117:0/3397914668 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a7c011d70 con 0x7f8a8c06e7e0 2024-04-12T09:12:59.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.395+0000 7f8a9168b700 1 -- 172.21.15.117:0/3397914668 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a8c11e310 con 0x7f8a8c06e7e0 2024-04-12T09:12:59.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.395+0000 7f8a88ff9700 1 -- 172.21.15.117:0/3397914668 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 30) v1 ==== 46117+0+0 (secure 0 0 0) 0x7f8a7c011590 con 0x7f8a8c06e7e0 2024-04-12T09:12:59.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.395+0000 7f8a88ff9700 1 --2- 172.21.15.117:0/3397914668 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f8a74038cd0 0x7f8a7403b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:12:59.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.395+0000 7f8a9168b700 1 -- 172.21.15.117:0/3397914668 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a8c06d820 con 0x7f8a8c06e7e0 2024-04-12T09:12:59.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.395+0000 7f8a88ff9700 1 -- 172.21.15.117:0/3397914668 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f8a7c04c480 con 0x7f8a8c06e7e0 2024-04-12T09:12:59.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.396+0000 7f8a8b7fe700 1 --2- 172.21.15.117:0/3397914668 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f8a74038cd0 0x7f8a7403b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:12:59.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.396+0000 7f8a8b7fe700 1 --2- 172.21.15.117:0/3397914668 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f8a74038cd0 0x7f8a7403b180 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8a80000c00 tx=0x7f8a80009e30 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:12:59.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.401+0000 7f8a88ff9700 1 -- 172.21.15.117:0/3397914668 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f8a7c03d020 con 0x7f8a8c06e7e0 2024-04-12T09:12:59.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.729+0000 7f8a9168b700 1 -- 172.21.15.117:0/3397914668 --> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a8c11e650 con 0x7f8a74038cd0 2024-04-12T09:12:59.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.730+0000 7f8a88ff9700 1 -- 172.21.15.117:0/3397914668 <== mgr.14694 v2:172.21.15.117:6800/1056729457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f8a8c11e650 con 0x7f8a74038cd0 2024-04-12T09:12:59.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.732+0000 7f8a9168b700 1 -- 172.21.15.117:0/3397914668 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f8a74038cd0 msgr2=0x7f8a7403b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:59.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.732+0000 7f8a9168b700 1 --2- 172.21.15.117:0/3397914668 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f8a74038cd0 0x7f8a7403b180 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8a80000c00 tx=0x7f8a80009e30 comp rx=0 tx=0).stop 2024-04-12T09:12:59.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.732+0000 7f8a9168b700 1 -- 172.21.15.117:0/3397914668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a8c06e7e0 msgr2=0x7f8a8c11c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:59.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.732+0000 7f8a9168b700 1 --2- 172.21.15.117:0/3397914668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a8c06e7e0 0x7f8a8c11c6b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00b760 tx=0x7f8a7c0091a0 comp rx=0 tx=0).stop 2024-04-12T09:12:59.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.732+0000 7f8a9168b700 1 -- 172.21.15.117:0/3397914668 shutdown_connections 2024-04-12T09:12:59.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.732+0000 7f8a9168b700 1 --2- 172.21.15.117:0/3397914668 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f8a74038cd0 0x7f8a7403b180 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:59.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.732+0000 7f8a9168b700 1 --2- 172.21.15.117:0/3397914668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a8c06e7e0 0x7f8a8c11c6b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:59.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.732+0000 7f8a9168b700 1 --2- 172.21.15.117:0/3397914668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a8c06fc00 0x7f8a8c11cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:59.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.732+0000 7f8a9168b700 1 -- 172.21.15.117:0/3397914668 >> 172.21.15.117:0/3397914668 conn(0x7f8a8c069c10 msgr2=0x7f8a8c06b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:12:59.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.733+0000 7f8a9168b700 1 -- 172.21.15.117:0/3397914668 shutdown_connections 2024-04-12T09:12:59.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.733+0000 7f8a9168b700 1 -- 172.21.15.117:0/3397914668 wait complete. 2024-04-12T09:12:59.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.856+0000 7f900cb5d700 1 -- 172.21.15.117:0/146296836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90080fb480 msgr2=0x7f90080fb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:59.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.856+0000 7f900cb5d700 1 --2- 172.21.15.117:0/146296836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90080fb480 0x7f90080fb890 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8004a50 tx=0x7f8ff800af40 comp rx=0 tx=0).stop 2024-04-12T09:12:59.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.856+0000 7f900cb5d700 1 -- 172.21.15.117:0/146296836 shutdown_connections 2024-04-12T09:12:59.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.856+0000 7f900cb5d700 1 --2- 172.21.15.117:0/146296836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90080fc730 0x7f90080fcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:59.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.856+0000 7f900cb5d700 1 --2- 172.21.15.117:0/146296836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90080fb480 0x7f90080fb890 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:59.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.856+0000 7f900cb5d700 1 -- 172.21.15.117:0/146296836 >> 172.21.15.117:0/146296836 conn(0x7f90080f6be0 msgr2=0x7f90080f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:12:59.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.857+0000 7f900cb5d700 1 -- 172.21.15.117:0/146296836 shutdown_connections 2024-04-12T09:12:59.858 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.857+0000 7f900cb5d700 1 -- 172.21.15.117:0/146296836 wait complete. 2024-04-12T09:12:59.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.857+0000 7f900cb5d700 1 Processor -- start 2024-04-12T09:12:59.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.857+0000 7f900cb5d700 1 -- start start 2024-04-12T09:12:59.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.857+0000 7f900cb5d700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90080fb480 0x7f900810b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:12:59.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.857+0000 7f900cb5d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90080fc730 0x7f900810bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:12:59.860 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.857+0000 7f900cb5d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900810c1c0 con 0x7f90080fc730 2024-04-12T09:12:59.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.858+0000 7f900cb5d700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900810c330 con 0x7f90080fb480 2024-04-12T09:12:59.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.858+0000 7f900659c700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90080fb480 0x7f900810b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:12:59.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.858+0000 7f900659c700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90080fb480 0x7f900810b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.117:59876/0 (socket says 172.21.15.117:59876) 2024-04-12T09:12:59.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.858+0000 7f900659c700 1 -- 172.21.15.117:0/2938320279 learned_addr learned my addr 172.21.15.117:0/2938320279 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:12:59.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.858+0000 7f9005d9b700 1 --2- 172.21.15.117:0/2938320279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90080fc730 0x7f900810bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:12:59.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.858+0000 7f9005d9b700 1 -- 172.21.15.117:0/2938320279 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90080fb480 msgr2=0x7f900810b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:12:59.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.858+0000 7f9005d9b700 1 --2- 172.21.15.117:0/2938320279 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90080fb480 0x7f900810b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:12:59.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.858+0000 7f9005d9b700 1 -- 172.21.15.117:0/2938320279 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff8005040 con 0x7f90080fc730 2024-04-12T09:12:59.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.858+0000 7f900659c700 1 --2- 172.21.15.117:0/2938320279 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90080fb480 0x7f900810b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T09:12:59.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.858+0000 7f9005d9b700 1 --2- 172.21.15.117:0/2938320279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90080fc730 0x7f900810bbc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc002a50 tx=0x7f8ffc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:12:59.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.859+0000 7f8ff6ffd700 1 -- 172.21.15.117:0/2938320279 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ffc007cc0 con 0x7f90080fc730 2024-04-12T09:12:59.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.859+0000 7f8ff6ffd700 1 -- 172.21.15.117:0/2938320279 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ffc00f040 con 0x7f90080fc730 2024-04-12T09:12:59.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.859+0000 7f8ff6ffd700 1 -- 172.21.15.117:0/2938320279 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ffc0094b0 con 0x7f90080fc730 2024-04-12T09:12:59.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.859+0000 7f900cb5d700 1 -- 172.21.15.117:0/2938320279 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9008110d90 con 0x7f90080fc730 2024-04-12T09:12:59.862 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.859+0000 7f900cb5d700 1 -- 172.21.15.117:0/2938320279 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9008113530 con 0x7f90080fc730 2024-04-12T09:12:59.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.860+0000 7f8ff6ffd700 1 -- 172.21.15.117:0/2938320279 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 30) v1 ==== 46117+0+0 (secure 0 0 0) 0x7f8ffc009720 con 0x7f90080fc730 2024-04-12T09:12:59.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.860+0000 7f900cb5d700 1 -- 172.21.15.117:0/2938320279 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f900804c710 con 0x7f90080fc730 2024-04-12T09:12:59.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.860+0000 7f8ff6ffd700 1 --2- 172.21.15.117:0/2938320279 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f8ff0038cd0 0x7f8ff003b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:12:59.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.860+0000 7f8ff6ffd700 1 -- 172.21.15.117:0/2938320279 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f8ffc04c760 con 0x7f90080fc730 2024-04-12T09:12:59.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.860+0000 7f900659c700 1 --2- 172.21.15.117:0/2938320279 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f8ff0038cd0 0x7f8ff003b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:12:59.863 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.861+0000 7f900659c700 1 --2- 172.21.15.117:0/2938320279 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f8ff0038cd0 0x7f8ff003b180 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8ff800a040 tx=0x7f8ff800af40 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:12:59.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:12:59.865+0000 7f8ff6ffd700 1 -- 172.21.15.117:0/2938320279 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f8ffc01ce40 con 0x7f90080fc730 2024-04-12T09:13:00.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.130+0000 7f900cb5d700 1 -- 172.21.15.117:0/2938320279 --> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f90081009d0 con 0x7f8ff0038cd0 2024-04-12T09:13:00.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.142+0000 7f8ff6ffd700 1 -- 172.21.15.117:0/2938320279 <== mgr.14694 v2:172.21.15.117:6800/1056729457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f90081009d0 con 0x7f8ff0038cd0 2024-04-12T09:13:00.143 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:13:00.143 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 running (84s) 13s ago 10m 25.6M - 0.25.0 c8568f914cd2 34d1f5b82e31 2024-04-12T09:13:00.143 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (10m) 13s ago 10m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad 1e9f2c6a4491 2024-04-12T09:13:00.143 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (9m) 1s ago 9m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad e42da3f6e517 2024-04-12T09:13:00.144 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 unknown 13s ago 9m - - 2024-04-12T09:13:00.144 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (4m) 13s ago 4m 206M - 17.2.7-827-gd3b5060a 21de9b7369ad de062e2c10e7 2024-04-12T09:13:00.144 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 running (4m) 13s ago 4m 12.3M - 17.2.7-827-gd3b5060a 21de9b7369ad 1e82c6241a18 2024-04-12T09:13:00.144 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (4m) 1s ago 4m 15.2M - 17.2.7-827-gd3b5060a 21de9b7369ad b05228e997f7 2024-04-12T09:13:00.144 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (4m) 1s ago 4m 15.8M - 17.2.7-827-gd3b5060a 21de9b7369ad 6d7f82c072c7 2024-04-12T09:13:00.144 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:8443,9283,8765 running (26s) 13s ago 11m 91.8M - 19.0.0-2053-gb277feb2 668895944f0e fee613d05ab7 2024-04-12T09:13:00.144 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283 running (2m) 1s ago 9m 67.4M - 19.0.0-2053-gb277feb2 668895944f0e bce98e99ffe8 2024-04-12T09:13:00.144 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (11m) 13s ago 11m 50.2M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad f9d5f7ac5270 2024-04-12T09:13:00.144 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (9m) 1s ago 9m 38.2M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad 17c0db49bb16 2024-04-12T09:13:00.144 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 running (94s) 13s ago 10m 15.8M - 1.5.0 0da6a335fe13 8d7fb10ea797 2024-04-12T09:13:00.144 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (38s) 1s ago 9m 15.0M - 1.5.0 0da6a335fe13 1eb060aff798 2024-04-12T09:13:00.144 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (8m) 13s ago 8m 209M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 77040a2498f3 2024-04-12T09:13:00.145 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (7m) 13s ago 7m 217M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 8f9dbf0274ed 2024-04-12T09:13:00.145 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (7m) 13s ago 7m 183M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 339c5a80d1dd 2024-04-12T09:13:00.145 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (7m) 1s ago 7m 263M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad fb87d616bae3 2024-04-12T09:13:00.145 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (6m) 1s ago 6m 240M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad c873826a2dea 2024-04-12T09:13:00.145 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (6m) 1s ago 6m 214M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad 69cb7c22f002 2024-04-12T09:13:00.145 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 running (40s) 13s ago 9m 42.6M - 2.43.0 a07b618ecd1d 9e4dd2381ac1 2024-04-12T09:13:00.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.145+0000 7f900cb5d700 1 -- 172.21.15.117:0/2938320279 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f8ff0038cd0 msgr2=0x7f8ff003b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:00.146 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.145+0000 7f900cb5d700 1 --2- 172.21.15.117:0/2938320279 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f8ff0038cd0 0x7f8ff003b180 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8ff800a040 tx=0x7f8ff800af40 comp rx=0 tx=0).stop 2024-04-12T09:13:00.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.145+0000 7f900cb5d700 1 -- 172.21.15.117:0/2938320279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90080fc730 msgr2=0x7f900810bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:00.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.145+0000 7f900cb5d700 1 --2- 172.21.15.117:0/2938320279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90080fc730 0x7f900810bbc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc002a50 tx=0x7f8ffc004600 comp rx=0 tx=0).stop 2024-04-12T09:13:00.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.145+0000 7f900cb5d700 1 -- 172.21.15.117:0/2938320279 shutdown_connections 2024-04-12T09:13:00.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.145+0000 7f900cb5d700 1 --2- 172.21.15.117:0/2938320279 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f8ff0038cd0 0x7f8ff003b180 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:00.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.145+0000 7f900cb5d700 1 --2- 172.21.15.117:0/2938320279 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90080fb480 0x7f900810b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:00.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.145+0000 7f900cb5d700 1 --2- 172.21.15.117:0/2938320279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90080fc730 0x7f900810bbc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:00.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.145+0000 7f900cb5d700 1 -- 172.21.15.117:0/2938320279 >> 172.21.15.117:0/2938320279 conn(0x7f90080f6be0 msgr2=0x7f90080f81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:13:00.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.145+0000 7f900cb5d700 1 -- 172.21.15.117:0/2938320279 shutdown_connections 2024-04-12T09:13:00.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.145+0000 7f900cb5d700 1 -- 172.21.15.117:0/2938320279 wait complete. 2024-04-12T09:13:00.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.278+0000 7f319edc3700 1 -- 172.21.15.117:0/2554149059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3198103420 msgr2=0x7f3198103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:00.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.278+0000 7f319edc3700 1 --2- 172.21.15.117:0/2554149059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3198103420 0x7f3198103830 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f318c004940 tx=0x7f318c009e30 comp rx=0 tx=0).stop 2024-04-12T09:13:00.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.279+0000 7f319edc3700 1 -- 172.21.15.117:0/2554149059 shutdown_connections 2024-04-12T09:13:00.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.279+0000 7f319edc3700 1 --2- 172.21.15.117:0/2554149059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31981046d0 0x7f3198104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:00.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.279+0000 7f319edc3700 1 --2- 172.21.15.117:0/2554149059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3198103420 0x7f3198103830 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:00.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.279+0000 7f319edc3700 1 -- 172.21.15.117:0/2554149059 >> 172.21.15.117:0/2554149059 conn(0x7f31980725a0 msgr2=0x7f31980749d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:13:00.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.279+0000 7f319edc3700 1 -- 172.21.15.117:0/2554149059 shutdown_connections 2024-04-12T09:13:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.279+0000 7f319edc3700 1 -- 172.21.15.117:0/2554149059 wait complete. 2024-04-12T09:13:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.280+0000 7f319edc3700 1 Processor -- start 2024-04-12T09:13:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.280+0000 7f319edc3700 1 -- start start 2024-04-12T09:13:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.280+0000 7f319edc3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3198103420 0x7f319811ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:13:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.280+0000 7f319edc3700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31981046d0 0x7f3198121460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:13:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.280+0000 7f319edc3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31981219a0 con 0x7f3198103420 2024-04-12T09:13:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.280+0000 7f319edc3700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3198121b10 con 0x7f31981046d0 2024-04-12T09:13:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.281+0000 7f319cb5f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3198103420 0x7f319811ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:13:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.281+0000 7f319cb5f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3198103420 0x7f319811ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35634/0 (socket says 172.21.15.117:35634) 2024-04-12T09:13:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.281+0000 7f319cb5f700 1 -- 172.21.15.117:0/271021033 learned_addr learned my addr 172.21.15.117:0/271021033 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:13:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.281+0000 7f3197fff700 1 --2- 172.21.15.117:0/271021033 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31981046d0 0x7f3198121460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:13:00.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.281+0000 7f319cb5f700 1 -- 172.21.15.117:0/271021033 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31981046d0 msgr2=0x7f3198121460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:00.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.281+0000 7f319cb5f700 1 --2- 172.21.15.117:0/271021033 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31981046d0 0x7f3198121460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:00.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.281+0000 7f319cb5f700 1 -- 172.21.15.117:0/271021033 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318c005040 con 0x7f3198103420 2024-04-12T09:13:00.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.282+0000 7f319cb5f700 1 --2- 172.21.15.117:0/271021033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3198103420 0x7f319811ef10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f318c000c00 tx=0x7f318c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:13:00.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.282+0000 7f31957fa700 1 -- 172.21.15.117:0/271021033 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f318c021070 con 0x7f3198103420 2024-04-12T09:13:00.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.282+0000 7f31957fa700 1 -- 172.21.15.117:0/271021033 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f318c01c400 con 0x7f3198103420 2024-04-12T09:13:00.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.282+0000 7f31957fa700 1 -- 172.21.15.117:0/271021033 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f318c00e070 con 0x7f3198103420 2024-04-12T09:13:00.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.283+0000 7f319edc3700 1 -- 172.21.15.117:0/271021033 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3198121d90 con 0x7f3198103420 2024-04-12T09:13:00.284 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.283+0000 7f319edc3700 1 -- 172.21.15.117:0/271021033 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3198122210 con 0x7f3198103420 2024-04-12T09:13:00.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.284+0000 7f31957fa700 1 -- 172.21.15.117:0/271021033 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 30) v1 ==== 46117+0+0 (secure 0 0 0) 0x7f318c01ca50 con 0x7f3198103420 2024-04-12T09:13:00.285 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.284+0000 7f319edc3700 1 -- 172.21.15.117:0/271021033 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f319804c710 con 0x7f3198103420 2024-04-12T09:13:00.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.285+0000 7f31957fa700 1 --2- 172.21.15.117:0/271021033 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f3188038d20 0x7f318803b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:13:00.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.285+0000 7f31957fa700 1 -- 172.21.15.117:0/271021033 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f318c04dca0 con 0x7f3198103420 2024-04-12T09:13:00.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.287+0000 7f3197fff700 1 --2- 172.21.15.117:0/271021033 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f3188038d20 0x7f318803b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:13:00.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.288+0000 7f3197fff700 1 --2- 172.21.15.117:0/271021033 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f3188038d20 0x7f318803b1d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f319807ea60 tx=0x7f318400b040 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:13:00.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.292+0000 7f31957fa700 1 -- 172.21.15.117:0/271021033 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f318c011c10 con 0x7f3198103420 2024-04-12T09:13:00.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:00 smithi117 ceph-mon[29277]: pgmap v5: 65 pgs: 65 active+clean; 240 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:00.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:00 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:00.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:00 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:00.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:00 smithi117 ceph-mon[29277]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:13:00.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:00 smithi203 ceph-mon[36428]: pgmap v5: 65 pgs: 65 active+clean; 240 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:00.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:00 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:00.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:00 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:00.545 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:00 smithi203 ceph-mon[36428]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:13:00.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.664+0000 7f319edc3700 1 -- 172.21.15.117:0/271021033 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f31981224f0 con 0x7f3198103420 2024-04-12T09:13:00.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.664+0000 7f31957fa700 1 -- 172.21.15.117:0/271021033 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f318c011830 con 0x7f3198103420 2024-04-12T09:13:00.665 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:13:00.665 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": { 2024-04-12T09:13:00.665 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 2 2024-04-12T09:13:00.665 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:13:00.665 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": { 2024-04-12T09:13:00.665 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 1 2024-04-12T09:13:00.665 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:13:00.666 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": { 2024-04-12T09:13:00.666 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 6 2024-04-12T09:13:00.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:13:00.666 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-04-12T09:13:00.666 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 4 2024-04-12T09:13:00.666 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:13:00.666 INFO:teuthology.orchestra.run.smithi117.stdout: "overall": { 2024-04-12T09:13:00.666 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 12, 2024-04-12T09:13:00.666 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 1 2024-04-12T09:13:00.666 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:13:00.666 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:13:00.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.667+0000 7f319edc3700 1 -- 172.21.15.117:0/271021033 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f3188038d20 msgr2=0x7f318803b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:00.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.667+0000 7f319edc3700 1 --2- 172.21.15.117:0/271021033 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f3188038d20 0x7f318803b1d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f319807ea60 tx=0x7f318400b040 comp rx=0 tx=0).stop 2024-04-12T09:13:00.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.667+0000 7f319edc3700 1 -- 172.21.15.117:0/271021033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3198103420 msgr2=0x7f319811ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:00.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.667+0000 7f319edc3700 1 --2- 172.21.15.117:0/271021033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3198103420 0x7f319811ef10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f318c000c00 tx=0x7f318c009e30 comp rx=0 tx=0).stop 2024-04-12T09:13:00.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.667+0000 7f319edc3700 1 -- 172.21.15.117:0/271021033 shutdown_connections 2024-04-12T09:13:00.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.667+0000 7f319edc3700 1 --2- 172.21.15.117:0/271021033 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f3188038d20 0x7f318803b1d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:00.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.667+0000 7f319edc3700 1 --2- 172.21.15.117:0/271021033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3198103420 0x7f319811ef10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:00.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.667+0000 7f319edc3700 1 --2- 172.21.15.117:0/271021033 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31981046d0 0x7f3198121460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:00.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.667+0000 7f319edc3700 1 -- 172.21.15.117:0/271021033 >> 172.21.15.117:0/271021033 conn(0x7f31980725a0 msgr2=0x7f3198073c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:13:00.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.667+0000 7f319edc3700 1 -- 172.21.15.117:0/271021033 shutdown_connections 2024-04-12T09:13:00.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.667+0000 7f319edc3700 1 -- 172.21.15.117:0/271021033 wait complete. 2024-04-12T09:13:00.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.814+0000 7f3289ffb700 1 -- 172.21.15.117:0/190078611 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f327c013bf0 con 0x7f328c066220 2024-04-12T09:13:00.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.814+0000 7f3291533700 1 -- 172.21.15.117:0/190078611 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f328c066220 msgr2=0x7f328c0ffa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:00.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.814+0000 7f3291533700 1 --2- 172.21.15.117:0/190078611 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f328c066220 0x7f328c0ffa80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f327c004880 tx=0x7f327c009e30 comp rx=0 tx=0).stop 2024-04-12T09:13:00.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.815+0000 7f3291533700 1 -- 172.21.15.117:0/190078611 shutdown_connections 2024-04-12T09:13:00.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.815+0000 7f3291533700 1 --2- 172.21.15.117:0/190078611 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f328c0fffc0 0x7f328c1023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:00.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.815+0000 7f3291533700 1 --2- 172.21.15.117:0/190078611 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f328c066220 0x7f328c0ffa80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:00.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.815+0000 7f3291533700 1 -- 172.21.15.117:0/190078611 >> 172.21.15.117:0/190078611 conn(0x7f328c0f7430 msgr2=0x7f328c0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:13:00.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.815+0000 7f3291533700 1 -- 172.21.15.117:0/190078611 shutdown_connections 2024-04-12T09:13:00.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.815+0000 7f3291533700 1 -- 172.21.15.117:0/190078611 wait complete. 2024-04-12T09:13:00.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.816+0000 7f3291533700 1 Processor -- start 2024-04-12T09:13:00.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.816+0000 7f3291533700 1 -- start start 2024-04-12T09:13:00.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.816+0000 7f3291533700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f328c066220 0x7f328c0fd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:13:00.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.816+0000 7f3291533700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f328c0fffc0 0x7f328c0fb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:13:00.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.816+0000 7f3291533700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328c111710 con 0x7f328c0fffc0 2024-04-12T09:13:00.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.816+0000 7f3291533700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328c111880 con 0x7f328c066220 2024-04-12T09:13:00.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.817+0000 7f328a7fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f328c0fffc0 0x7f328c0fb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:13:00.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.817+0000 7f328a7fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f328c0fffc0 0x7f328c0fb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35642/0 (socket says 172.21.15.117:35642) 2024-04-12T09:13:00.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.817+0000 7f328a7fc700 1 -- 172.21.15.117:0/754698917 learned_addr learned my addr 172.21.15.117:0/754698917 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:13:00.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.817+0000 7f328a7fc700 1 -- 172.21.15.117:0/754698917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f328c066220 msgr2=0x7f328c0fd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:00.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.817+0000 7f328a7fc700 1 --2- 172.21.15.117:0/754698917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f328c066220 0x7f328c0fd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:00.818 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.817+0000 7f328a7fc700 1 -- 172.21.15.117:0/754698917 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c005040 con 0x7f328c0fffc0 2024-04-12T09:13:00.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.817+0000 7f328a7fc700 1 --2- 172.21.15.117:0/754698917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f328c0fffc0 0x7f328c0fb980 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f328000eb40 tx=0x7f328000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:13:00.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.818+0000 7f32737fe700 1 -- 172.21.15.117:0/754698917 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3280007cc0 con 0x7f328c0fffc0 2024-04-12T09:13:00.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.818+0000 7f32737fe700 1 -- 172.21.15.117:0/754698917 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f328000f040 con 0x7f328c0fffc0 2024-04-12T09:13:00.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.818+0000 7f3291533700 1 -- 172.21.15.117:0/754698917 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328c111b00 con 0x7f328c0fffc0 2024-04-12T09:13:00.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.818+0000 7f32737fe700 1 -- 172.21.15.117:0/754698917 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3280009580 con 0x7f328c0fffc0 2024-04-12T09:13:00.819 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.818+0000 7f3291533700 1 -- 172.21.15.117:0/754698917 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328c1120c0 con 0x7f328c0fffc0 2024-04-12T09:13:00.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.819+0000 7f32737fe700 1 -- 172.21.15.117:0/754698917 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 30) v1 ==== 46117+0+0 (secure 0 0 0) 0x7f32800097f0 con 0x7f328c0fffc0 2024-04-12T09:13:00.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.819+0000 7f3291533700 1 -- 172.21.15.117:0/754698917 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f328c05f5f0 con 0x7f328c0fffc0 2024-04-12T09:13:00.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.819+0000 7f32737fe700 1 --2- 172.21.15.117:0/754698917 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f3274038d20 0x7f327403b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:13:00.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.820+0000 7f32737fe700 1 -- 172.21.15.117:0/754698917 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f328004c510 con 0x7f328c0fffc0 2024-04-12T09:13:00.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.820+0000 7f328affd700 1 --2- 172.21.15.117:0/754698917 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f3274038d20 0x7f327403b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:13:00.822 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.820+0000 7f328affd700 1 --2- 172.21.15.117:0/754698917 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f3274038d20 0x7f327403b1d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f327c000c00 tx=0x7f327c009e30 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:13:00.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:00.827+0000 7f32737fe700 1 -- 172.21.15.117:0/754698917 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f3280012db0 con 0x7f328c0fffc0 2024-04-12T09:13:01.147 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:01.147+0000 7f3291533700 1 -- 172.21.15.117:0/754698917 --> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f328c0f8f70 con 0x7f3274038d20 2024-04-12T09:13:01.148 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:01.148+0000 7f32737fe700 1 -- 172.21.15.117:0/754698917 <== mgr.14694 v2:172.21.15.117:6800/1056729457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f328c0f8f70 con 0x7f3274038d20 2024-04-12T09:13:01.149 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:13:01.149 INFO:teuthology.orchestra.run.smithi117.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec", 2024-04-12T09:13:01.149 INFO:teuthology.orchestra.run.smithi117.stdout: "in_progress": true, 2024-04-12T09:13:01.149 INFO:teuthology.orchestra.run.smithi117.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-12T09:13:01.149 INFO:teuthology.orchestra.run.smithi117.stdout: "services_complete": [ 2024-04-12T09:13:01.149 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr" 2024-04-12T09:13:01.149 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2024-04-12T09:13:01.149 INFO:teuthology.orchestra.run.smithi117.stdout: "progress": "2/2 daemons upgraded", 2024-04-12T09:13:01.149 INFO:teuthology.orchestra.run.smithi117.stdout: "message": "", 2024-04-12T09:13:01.149 INFO:teuthology.orchestra.run.smithi117.stdout: "is_paused": false 2024-04-12T09:13:01.149 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:13:01.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:01.150+0000 7f3291533700 1 -- 172.21.15.117:0/754698917 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f3274038d20 msgr2=0x7f327403b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:01.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:01.150+0000 7f3291533700 1 --2- 172.21.15.117:0/754698917 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f3274038d20 0x7f327403b1d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f327c000c00 tx=0x7f327c009e30 comp rx=0 tx=0).stop 2024-04-12T09:13:01.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:01.150+0000 7f3291533700 1 -- 172.21.15.117:0/754698917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f328c0fffc0 msgr2=0x7f328c0fb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:01.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:01.150+0000 7f3291533700 1 --2- 172.21.15.117:0/754698917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f328c0fffc0 0x7f328c0fb980 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f328000eb40 tx=0x7f328000b040 comp rx=0 tx=0).stop 2024-04-12T09:13:01.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:01.150+0000 7f3291533700 1 -- 172.21.15.117:0/754698917 shutdown_connections 2024-04-12T09:13:01.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:01.150+0000 7f3291533700 1 --2- 172.21.15.117:0/754698917 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f3274038d20 0x7f327403b1d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:01.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:01.150+0000 7f3291533700 1 --2- 172.21.15.117:0/754698917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f328c066220 0x7f328c0fd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:01.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:01.150+0000 7f3291533700 1 --2- 172.21.15.117:0/754698917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f328c0fffc0 0x7f328c0fb980 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:01.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:01.150+0000 7f3291533700 1 -- 172.21.15.117:0/754698917 >> 172.21.15.117:0/754698917 conn(0x7f328c0f7430 msgr2=0x7f328c0f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:13:01.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:01.151+0000 7f3291533700 1 -- 172.21.15.117:0/754698917 shutdown_connections 2024-04-12T09:13:01.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:01.151+0000 7f3291533700 1 -- 172.21.15.117:0/754698917 wait complete. 2024-04-12T09:13:01.697 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:01 smithi203 ceph-mon[36428]: from='client.24501 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:13:01.697 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:01 smithi203 ceph-mon[36428]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:13:01.697 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:01 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:01.697 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:01 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:01.697 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:01 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/271021033' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:01.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:01 smithi117 ceph-mon[29277]: from='client.24501 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:13:01.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:01 smithi117 ceph-mon[29277]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:13:01.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:01 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:01.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:01 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:01.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:01 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/271021033' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:02.583 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:02 smithi117 ceph-mon[29277]: pgmap v6: 65 pgs: 65 active+clean; 242 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 851 KiB/s wr, 127 op/s 2024-04-12T09:13:02.583 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:02 smithi117 ceph-mon[29277]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:13:02.694 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:02 smithi203 ceph-mon[36428]: pgmap v6: 65 pgs: 65 active+clean; 242 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 851 KiB/s wr, 127 op/s 2024-04-12T09:13:02.694 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:02 smithi203 ceph-mon[36428]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:13:03.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:03 smithi117 ceph-mon[29277]: Standby manager daemon smithi203.apfqpo started 2024-04-12T09:13:03.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:03 smithi117 ceph-mon[29277]: from='mgr.? 172.21.15.203:0/1681533951' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.apfqpo/crt"}]: dispatch 2024-04-12T09:13:03.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:03 smithi117 ceph-mon[29277]: from='mgr.? 172.21.15.203:0/1681533951' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T09:13:03.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:03 smithi117 ceph-mon[29277]: from='mgr.? 172.21.15.203:0/1681533951' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.apfqpo/key"}]: dispatch 2024-04-12T09:13:03.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:03 smithi117 ceph-mon[29277]: from='mgr.? 172.21.15.203:0/1681533951' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T09:13:03.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:03 smithi203 ceph-mon[36428]: Standby manager daemon smithi203.apfqpo started 2024-04-12T09:13:03.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:03 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.203:0/1681533951' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.apfqpo/crt"}]: dispatch 2024-04-12T09:13:03.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:03 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.203:0/1681533951' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T09:13:03.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:03 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.203:0/1681533951' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.apfqpo/key"}]: dispatch 2024-04-12T09:13:03.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:03 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.203:0/1681533951' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T09:13:04.612 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:04 smithi117 ceph-mon[29277]: pgmap v7: 65 pgs: 65 active+clean; 237 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 789 KiB/s wr, 228 op/s 2024-04-12T09:13:04.612 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:04 smithi117 ceph-mon[29277]: mgrmap e31: smithi117.oyaxql(active, since 8s), standbys: smithi203.apfqpo 2024-04-12T09:13:04.612 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:04 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr metadata", "who": "smithi203.apfqpo", "id": "smithi203.apfqpo"}]: dispatch 2024-04-12T09:13:04.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:04 smithi203 ceph-mon[36428]: pgmap v7: 65 pgs: 65 active+clean; 237 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 789 KiB/s wr, 228 op/s 2024-04-12T09:13:04.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:04 smithi203 ceph-mon[36428]: mgrmap e31: smithi117.oyaxql(active, since 8s), standbys: smithi203.apfqpo 2024-04-12T09:13:04.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:04 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr metadata", "who": "smithi203.apfqpo", "id": "smithi203.apfqpo"}]: dispatch 2024-04-12T09:13:06.582 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:06 smithi117 ceph-mon[29277]: pgmap v8: 65 pgs: 65 active+clean; 237 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 613 KiB/s wr, 177 op/s 2024-04-12T09:13:06.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:06 smithi203 ceph-mon[36428]: pgmap v8: 65 pgs: 65 active+clean; 237 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 613 KiB/s wr, 177 op/s 2024-04-12T09:13:07.217 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-12T09:13:07.218 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-12T09:13:07.606 DEBUG:teuthology.parallel:result is None 2024-04-12T09:13:08.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:08 smithi117 ceph-mon[29277]: pgmap v9: 65 pgs: 65 active+clean; 229 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 1.1 MiB/s wr, 300 op/s 2024-04-12T09:13:08.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:08 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:08.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:08 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:08.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:08 smithi203 ceph-mon[36428]: pgmap v9: 65 pgs: 65 active+clean; 229 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 1.1 MiB/s wr, 300 op/s 2024-04-12T09:13:08.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:08 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:08.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:08 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:09.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:09 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:09.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:09 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:09.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:09 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:09.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:09 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:10.810 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:10 smithi117 ceph-mon[29277]: pgmap v10: 65 pgs: 65 active+clean; 229 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 1000 KiB/s wr, 274 op/s 2024-04-12T09:13:10.810 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:10 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:13:10.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:10 smithi203 ceph-mon[36428]: pgmap v10: 65 pgs: 65 active+clean; 229 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 1000 KiB/s wr, 274 op/s 2024-04-12T09:13:10.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:10 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:13:12.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:12 smithi117 ceph-mon[29277]: pgmap v11: 65 pgs: 65 active+clean; 223 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 1.0 MiB/s wr, 315 op/s 2024-04-12T09:13:12.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:12 smithi203 ceph-mon[36428]: pgmap v11: 65 pgs: 65 active+clean; 223 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 1.0 MiB/s wr, 315 op/s 2024-04-12T09:13:12.901 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-04-12T09:13:12.902 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-04-12T09:13:13.211 DEBUG:teuthology.parallel:result is None 2024-04-12T09:13:13.211 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-12T09:13:13.254 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-12T09:13:13.255 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-04-12T09:13:13.319 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-04-12T09:13:13.319 DEBUG:teuthology.parallel:result is None 2024-04-12T09:13:14.094 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:13 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:14.094 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:13 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:14.095 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:13 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:13:14.095 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:13 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:13:14.095 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:13 smithi203 ceph-mon[36428]: Updating smithi117:/etc/ceph/ceph.conf 2024-04-12T09:13:14.095 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:13 smithi203 ceph-mon[36428]: Updating smithi203:/etc/ceph/ceph.conf 2024-04-12T09:13:14.095 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:13 smithi203 ceph-mon[36428]: pgmap v12: 65 pgs: 65 active+clean; 220 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 1.1 MiB/s wr, 374 op/s 2024-04-12T09:13:14.095 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:13 smithi203 ceph-mon[36428]: Updating smithi117:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T09:13:14.095 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:13 smithi203 ceph-mon[36428]: Updating smithi203:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T09:13:14.095 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:13 smithi203 ceph-mon[36428]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2024-04-12T09:13:14.095 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:13 smithi203 ceph-mon[36428]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-04-12T09:13:14.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:13 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:14.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:13 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:14.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:13 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:13:14.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:13 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:13:14.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:13 smithi117 ceph-mon[29277]: Updating smithi117:/etc/ceph/ceph.conf 2024-04-12T09:13:14.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:13 smithi117 ceph-mon[29277]: Updating smithi203:/etc/ceph/ceph.conf 2024-04-12T09:13:14.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:13 smithi117 ceph-mon[29277]: pgmap v12: 65 pgs: 65 active+clean; 220 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 1.1 MiB/s wr, 374 op/s 2024-04-12T09:13:14.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:13 smithi117 ceph-mon[29277]: Updating smithi117:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T09:13:14.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:13 smithi117 ceph-mon[29277]: Updating smithi203:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T09:13:14.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:13 smithi117 ceph-mon[29277]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2024-04-12T09:13:14.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:13 smithi117 ceph-mon[29277]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-04-12T09:13:15.148 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:14 smithi117 ceph-mon[29277]: Updating smithi117:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T09:13:15.149 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:14 smithi117 ceph-mon[29277]: Updating smithi203:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T09:13:15.149 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:14 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:15.149 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:14 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:15.149 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:14 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:15.149 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:14 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:15.149 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:14 smithi117 ceph-mon[29277]: pgmap v13: 65 pgs: 65 active+clean; 220 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.1 MiB/s wr, 321 op/s 2024-04-12T09:13:15.149 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:14 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:15.149 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:14 smithi117 ceph-mon[29277]: Reconfiguring prometheus.smithi117 (dependencies changed)... 2024-04-12T09:13:15.149 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:14 smithi117 ceph-mon[29277]: Reconfiguring daemon prometheus.smithi117 on smithi117 2024-04-12T09:13:15.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:14 smithi203 ceph-mon[36428]: Updating smithi117:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T09:13:15.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:14 smithi203 ceph-mon[36428]: Updating smithi203:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T09:13:15.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:14 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:15.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:14 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:15.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:14 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:15.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:14 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:15.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:14 smithi203 ceph-mon[36428]: pgmap v13: 65 pgs: 65 active+clean; 220 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.1 MiB/s wr, 321 op/s 2024-04-12T09:13:15.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:14 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:15.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:14 smithi203 ceph-mon[36428]: Reconfiguring prometheus.smithi117 (dependencies changed)... 2024-04-12T09:13:15.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:14 smithi203 ceph-mon[36428]: Reconfiguring daemon prometheus.smithi117 on smithi117 2024-04-12T09:13:16.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:15 smithi117 ceph-mon[29277]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-12T09:13:16.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:15 smithi203 ceph-mon[36428]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-12T09:13:16.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:16 smithi117 ceph-mon[29277]: pgmap v14: 65 pgs: 65 active+clean; 220 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 1.3 MiB/s wr, 362 op/s 2024-04-12T09:13:17.178 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:16 smithi203 ceph-mon[36428]: pgmap v14: 65 pgs: 65 active+clean; 220 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 1.3 MiB/s wr, 362 op/s 2024-04-12T09:13:19.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:18 smithi117 ceph-mon[29277]: pgmap v15: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 766 KiB/s wr, 277 op/s 2024-04-12T09:13:19.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:18 smithi203 ceph-mon[36428]: pgmap v15: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 766 KiB/s wr, 277 op/s 2024-04-12T09:13:21.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:21 smithi203 ceph-mon[36428]: pgmap v16: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 766 KiB/s wr, 277 op/s 2024-04-12T09:13:21.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:21 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:21.576 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:21 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:21.576 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:21 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T09:13:21.576 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:21 smithi203 ceph-mon[36428]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T09:13:21.576 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:21 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:13:21.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:21 smithi117 ceph-mon[29277]: pgmap v16: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 766 KiB/s wr, 277 op/s 2024-04-12T09:13:21.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:21 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:21.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:21 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:21.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:21 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T09:13:21.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:21 smithi117 ceph-mon[29277]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T09:13:21.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:21 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:13:22.743 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:22 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi203.apfqpo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T09:13:22.743 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:22 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T09:13:22.743 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:22 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:13:22.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:22 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi203.apfqpo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T09:13:22.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:22 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T09:13:22.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:22 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:13:23.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:23 smithi203 ceph-mon[36428]: pgmap v17: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 747 KiB/s wr, 233 op/s 2024-04-12T09:13:23.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:23 smithi203 ceph-mon[36428]: Upgrade: Updating mgr.smithi203.apfqpo 2024-04-12T09:13:23.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:23 smithi203 ceph-mon[36428]: Deploying daemon mgr.smithi203.apfqpo on smithi203 2024-04-12T09:13:23.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:23 smithi117 ceph-mon[29277]: pgmap v17: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 747 KiB/s wr, 233 op/s 2024-04-12T09:13:23.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:23 smithi117 ceph-mon[29277]: Upgrade: Updating mgr.smithi203.apfqpo 2024-04-12T09:13:23.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:23 smithi117 ceph-mon[29277]: Deploying daemon mgr.smithi203.apfqpo on smithi203 2024-04-12T09:13:25.784 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:25 smithi203 ceph-mon[36428]: pgmap v18: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 266 KiB/s wr, 111 op/s 2024-04-12T09:13:25.785 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:25 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:25.785 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:25 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:13:25.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:25 smithi117 ceph-mon[29277]: pgmap v18: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 266 KiB/s wr, 111 op/s 2024-04-12T09:13:25.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:25 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:25.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:25 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:13:27.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:27 smithi117 ceph-mon[29277]: pgmap v19: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 244 KiB/s wr, 102 op/s 2024-04-12T09:13:27.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:27 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:27.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:27 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:27.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:27 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:13:27.313 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:27 smithi203 ceph-mon[36428]: pgmap v19: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 244 KiB/s wr, 102 op/s 2024-04-12T09:13:27.313 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:27 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:27.313 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:27 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:27.313 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:27 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:13:29.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:29 smithi203 ceph-mon[36428]: pgmap v20: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 25 KiB/s wr, 64 op/s 2024-04-12T09:13:29.382 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:29 smithi117 ceph-mon[29277]: pgmap v20: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 25 KiB/s wr, 64 op/s 2024-04-12T09:13:30.993 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:30 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:30.993 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:30 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:30.993 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:30 smithi117 ceph-mon[29277]: pgmap v21: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 24 KiB/s wr, 0 op/s 2024-04-12T09:13:31.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:30 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:31.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:30 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:31.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:30 smithi203 ceph-mon[36428]: pgmap v21: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 24 KiB/s wr, 0 op/s 2024-04-12T09:13:31.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.259+0000 7f8844dd6700 1 -- 172.21.15.117:0/2673590646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88400fe400 msgr2=0x7f88400fe810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:31.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.259+0000 7f8844dd6700 1 --2- 172.21.15.117:0/2673590646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88400fe400 0x7f88400fe810 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8830004940 tx=0x7f8830009e30 comp rx=0 tx=0).stop 2024-04-12T09:13:31.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.259+0000 7f8844dd6700 1 -- 172.21.15.117:0/2673590646 shutdown_connections 2024-04-12T09:13:31.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.259+0000 7f8844dd6700 1 --2- 172.21.15.117:0/2673590646 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88400fed50 0x7f88400fae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:31.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.259+0000 7f8844dd6700 1 --2- 172.21.15.117:0/2673590646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88400fe400 0x7f88400fe810 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:31.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.259+0000 7f8844dd6700 1 -- 172.21.15.117:0/2673590646 >> 172.21.15.117:0/2673590646 conn(0x7f88400f6ba0 msgr2=0x7f88400f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:13:31.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.259+0000 7f8844dd6700 1 -- 172.21.15.117:0/2673590646 shutdown_connections 2024-04-12T09:13:31.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.259+0000 7f8844dd6700 1 -- 172.21.15.117:0/2673590646 wait complete. 2024-04-12T09:13:31.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.259+0000 7f8844dd6700 1 Processor -- start 2024-04-12T09:13:31.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.259+0000 7f8844dd6700 1 -- start start 2024-04-12T09:13:31.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.260+0000 7f8844dd6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88400fe400 0x7f88400fdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:13:31.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.260+0000 7f8844dd6700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88400fed50 0x7f88400fc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:13:31.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.260+0000 7f8844dd6700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88400fc670 con 0x7f88400fe400 2024-04-12T09:13:31.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.260+0000 7f8844dd6700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88400fc7e0 con 0x7f88400fed50 2024-04-12T09:13:31.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.260+0000 7f883e59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88400fe400 0x7f88400fdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:13:31.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.260+0000 7f883e59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88400fe400 0x7f88400fdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:46492/0 (socket says 172.21.15.117:46492) 2024-04-12T09:13:31.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.260+0000 7f883e59c700 1 -- 172.21.15.117:0/331522494 learned_addr learned my addr 172.21.15.117:0/331522494 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:13:31.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.260+0000 7f883dd9b700 1 --2- 172.21.15.117:0/331522494 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88400fed50 0x7f88400fc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:13:31.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.260+0000 7f883dd9b700 1 -- 172.21.15.117:0/331522494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88400fe400 msgr2=0x7f88400fdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:31.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.260+0000 7f883dd9b700 1 --2- 172.21.15.117:0/331522494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88400fe400 0x7f88400fdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:31.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.260+0000 7f883dd9b700 1 -- 172.21.15.117:0/331522494 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8830005040 con 0x7f88400fed50 2024-04-12T09:13:31.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.260+0000 7f883e59c700 1 --2- 172.21.15.117:0/331522494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88400fe400 0x7f88400fdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T09:13:31.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.260+0000 7f883dd9b700 1 --2- 172.21.15.117:0/331522494 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88400fed50 0x7f88400fc0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8834009fd0 tx=0x7f883400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:13:31.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.260+0000 7f882effd700 1 -- 172.21.15.117:0/331522494 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8834004e90 con 0x7f88400fed50 2024-04-12T09:13:31.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.261+0000 7f882effd700 1 -- 172.21.15.117:0/331522494 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f883400f040 con 0x7f88400fed50 2024-04-12T09:13:31.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.261+0000 7f882effd700 1 -- 172.21.15.117:0/331522494 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f883400ca50 con 0x7f88400fed50 2024-04-12T09:13:31.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.261+0000 7f8844dd6700 1 -- 172.21.15.117:0/331522494 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88400fca60 con 0x7f88400fed50 2024-04-12T09:13:31.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.261+0000 7f8844dd6700 1 -- 172.21.15.117:0/331522494 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88401159b0 con 0x7f88400fed50 2024-04-12T09:13:31.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.262+0000 7f8844dd6700 1 -- 172.21.15.117:0/331522494 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884005f5f0 con 0x7f88400fed50 2024-04-12T09:13:31.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.262+0000 7f882effd700 1 -- 172.21.15.117:0/331522494 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 31) v1 ==== 91677+0+0 (secure 0 0 0) 0x7f8834007cc0 con 0x7f88400fed50 2024-04-12T09:13:31.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.263+0000 7f882effd700 1 --2- 172.21.15.117:0/331522494 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f882806d6c0 0x7f882806fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:13:31.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.263+0000 7f882effd700 1 -- 172.21.15.117:0/331522494 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f883408c7c0 con 0x7f88400fed50 2024-04-12T09:13:31.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.263+0000 7f883e59c700 1 --2- 172.21.15.117:0/331522494 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f882806d6c0 0x7f882806fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:13:31.265 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.263+0000 7f883e59c700 1 --2- 172.21.15.117:0/331522494 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f882806d6c0 0x7f882806fb70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8830009b30 tx=0x7f8830009e30 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:13:31.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.267+0000 7f882effd700 1 -- 172.21.15.117:0/331522494 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f88340564a0 con 0x7f88400fed50 2024-04-12T09:13:31.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.502+0000 7f8844dd6700 1 -- 172.21.15.117:0/331522494 --> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8840102450 con 0x7f882806d6c0 2024-04-12T09:13:31.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.504+0000 7f882effd700 1 -- 172.21.15.117:0/331522494 <== mgr.14694 v2:172.21.15.117:6800/1056729457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f8840102450 con 0x7f882806d6c0 2024-04-12T09:13:31.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.505+0000 7f8844dd6700 1 -- 172.21.15.117:0/331522494 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f882806d6c0 msgr2=0x7f882806fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:31.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.505+0000 7f8844dd6700 1 --2- 172.21.15.117:0/331522494 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f882806d6c0 0x7f882806fb70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8830009b30 tx=0x7f8830009e30 comp rx=0 tx=0).stop 2024-04-12T09:13:31.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.506+0000 7f8844dd6700 1 -- 172.21.15.117:0/331522494 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88400fed50 msgr2=0x7f88400fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:31.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.506+0000 7f8844dd6700 1 --2- 172.21.15.117:0/331522494 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88400fed50 0x7f88400fc0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8834009fd0 tx=0x7f883400b040 comp rx=0 tx=0).stop 2024-04-12T09:13:31.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.506+0000 7f8844dd6700 1 -- 172.21.15.117:0/331522494 shutdown_connections 2024-04-12T09:13:31.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.506+0000 7f8844dd6700 1 --2- 172.21.15.117:0/331522494 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f882806d6c0 0x7f882806fb70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:31.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.506+0000 7f8844dd6700 1 --2- 172.21.15.117:0/331522494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88400fe400 0x7f88400fdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:31.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.506+0000 7f8844dd6700 1 --2- 172.21.15.117:0/331522494 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88400fed50 0x7f88400fc0c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:31.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.506+0000 7f8844dd6700 1 -- 172.21.15.117:0/331522494 >> 172.21.15.117:0/331522494 conn(0x7f88400f6ba0 msgr2=0x7f88400f81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:13:31.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.506+0000 7f8844dd6700 1 -- 172.21.15.117:0/331522494 shutdown_connections 2024-04-12T09:13:31.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.506+0000 7f8844dd6700 1 -- 172.21.15.117:0/331522494 wait complete. 2024-04-12T09:13:31.517 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:13:31.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.610+0000 7f4f386fe700 1 -- 172.21.15.117:0/851315758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f300fcf70 msgr2=0x7f4f300fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:31.612 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.610+0000 7f4f386fe700 1 --2- 172.21.15.117:0/851315758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f300fcf70 0x7f4f300fd3e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4f20004940 tx=0x7f4f20009e30 comp rx=0 tx=0).stop 2024-04-12T09:13:31.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.610+0000 7f4f386fe700 1 -- 172.21.15.117:0/851315758 shutdown_connections 2024-04-12T09:13:31.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.610+0000 7f4f386fe700 1 --2- 172.21.15.117:0/851315758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f300fcf70 0x7f4f300fd3e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:31.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.610+0000 7f4f386fe700 1 --2- 172.21.15.117:0/851315758 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f300fbe00 0x7f4f300fc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:31.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.610+0000 7f4f386fe700 1 -- 172.21.15.117:0/851315758 >> 172.21.15.117:0/851315758 conn(0x7f4f300f74e0 msgr2=0x7f4f300f98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:13:31.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.610+0000 7f4f386fe700 1 -- 172.21.15.117:0/851315758 shutdown_connections 2024-04-12T09:13:31.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.610+0000 7f4f386fe700 1 -- 172.21.15.117:0/851315758 wait complete. 2024-04-12T09:13:31.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.610+0000 7f4f386fe700 1 Processor -- start 2024-04-12T09:13:31.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.610+0000 7f4f386fe700 1 -- start start 2024-04-12T09:13:31.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.611+0000 7f4f386fe700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f300fbe00 0x7f4f3010c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:13:31.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.611+0000 7f4f386fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f300fcf70 0x7f4f3010ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:13:31.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.611+0000 7f4f386fe700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3010d460 con 0x7f4f300fcf70 2024-04-12T09:13:31.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.611+0000 7f4f386fe700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3010dcb0 con 0x7f4f300fbe00 2024-04-12T09:13:31.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.611+0000 7f4f35c99700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f300fcf70 0x7f4f3010ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:13:31.613 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.611+0000 7f4f35c99700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f300fcf70 0x7f4f3010ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:46508/0 (socket says 172.21.15.117:46508) 2024-04-12T09:13:31.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.611+0000 7f4f35c99700 1 -- 172.21.15.117:0/171083596 learned_addr learned my addr 172.21.15.117:0/171083596 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:13:31.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.611+0000 7f4f3649a700 1 --2- 172.21.15.117:0/171083596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f300fbe00 0x7f4f3010c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:13:31.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.611+0000 7f4f35c99700 1 -- 172.21.15.117:0/171083596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f300fbe00 msgr2=0x7f4f3010c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:31.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.611+0000 7f4f35c99700 1 --2- 172.21.15.117:0/171083596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f300fbe00 0x7f4f3010c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:31.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.611+0000 7f4f35c99700 1 -- 172.21.15.117:0/171083596 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f20005040 con 0x7f4f300fcf70 2024-04-12T09:13:31.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.611+0000 7f4f35c99700 1 --2- 172.21.15.117:0/171083596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f300fcf70 0x7f4f3010ce60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000b3b0 tx=0x7f4f20009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:13:31.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.611+0000 7f4f26ffd700 1 -- 172.21.15.117:0/171083596 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f2000e040 con 0x7f4f300fcf70 2024-04-12T09:13:31.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.611+0000 7f4f386fe700 1 -- 172.21.15.117:0/171083596 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3010df30 con 0x7f4f300fcf70 2024-04-12T09:13:31.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.611+0000 7f4f26ffd700 1 -- 172.21.15.117:0/171083596 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f2000bbf0 con 0x7f4f300fcf70 2024-04-12T09:13:31.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.611+0000 7f4f26ffd700 1 -- 172.21.15.117:0/171083596 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f2001c630 con 0x7f4f300fcf70 2024-04-12T09:13:31.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.611+0000 7f4f386fe700 1 -- 172.21.15.117:0/171083596 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3010e470 con 0x7f4f300fcf70 2024-04-12T09:13:31.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.612+0000 7f4f386fe700 1 -- 172.21.15.117:0/171083596 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3005f5f0 con 0x7f4f300fcf70 2024-04-12T09:13:31.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.613+0000 7f4f26ffd700 1 -- 172.21.15.117:0/171083596 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 31) v1 ==== 91677+0+0 (secure 0 0 0) 0x7f4f2000bd60 con 0x7f4f300fcf70 2024-04-12T09:13:31.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.614+0000 7f4f26ffd700 1 --2- 172.21.15.117:0/171083596 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f4f1c06f8d0 0x7f4f1c071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:13:31.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.614+0000 7f4f26ffd700 1 -- 172.21.15.117:0/171083596 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f4f2008da20 con 0x7f4f300fcf70 2024-04-12T09:13:31.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.614+0000 7f4f3649a700 1 --2- 172.21.15.117:0/171083596 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f4f1c06f8d0 0x7f4f1c071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:13:31.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.614+0000 7f4f3649a700 1 --2- 172.21.15.117:0/171083596 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f4f1c06f8d0 0x7f4f1c071d80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c004f40 tx=0x7f4f2c00b040 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:13:31.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.618+0000 7f4f26ffd700 1 -- 172.21.15.117:0/171083596 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f4f2005b1e0 con 0x7f4f300fcf70 2024-04-12T09:13:31.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.852+0000 7f4f386fe700 1 -- 172.21.15.117:0/171083596 --> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f3010e7d0 con 0x7f4f1c06f8d0 2024-04-12T09:13:31.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.854+0000 7f4f26ffd700 1 -- 172.21.15.117:0/171083596 <== mgr.14694 v2:172.21.15.117:6800/1056729457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f4f3010e7d0 con 0x7f4f1c06f8d0 2024-04-12T09:13:31.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.856+0000 7f4f386fe700 1 -- 172.21.15.117:0/171083596 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f4f1c06f8d0 msgr2=0x7f4f1c071d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:31.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.856+0000 7f4f386fe700 1 --2- 172.21.15.117:0/171083596 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f4f1c06f8d0 0x7f4f1c071d80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c004f40 tx=0x7f4f2c00b040 comp rx=0 tx=0).stop 2024-04-12T09:13:31.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.856+0000 7f4f386fe700 1 -- 172.21.15.117:0/171083596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f300fcf70 msgr2=0x7f4f3010ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:31.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.856+0000 7f4f386fe700 1 --2- 172.21.15.117:0/171083596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f300fcf70 0x7f4f3010ce60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000b3b0 tx=0x7f4f20009e30 comp rx=0 tx=0).stop 2024-04-12T09:13:31.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.856+0000 7f4f386fe700 1 -- 172.21.15.117:0/171083596 shutdown_connections 2024-04-12T09:13:31.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.856+0000 7f4f386fe700 1 --2- 172.21.15.117:0/171083596 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f4f1c06f8d0 0x7f4f1c071d80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:31.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.856+0000 7f4f386fe700 1 --2- 172.21.15.117:0/171083596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f300fbe00 0x7f4f3010c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:31.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.856+0000 7f4f386fe700 1 --2- 172.21.15.117:0/171083596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4f300fcf70 0x7f4f3010ce60 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:31.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.856+0000 7f4f386fe700 1 -- 172.21.15.117:0/171083596 >> 172.21.15.117:0/171083596 conn(0x7f4f300f74e0 msgr2=0x7f4f300f8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:13:31.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.856+0000 7f4f386fe700 1 -- 172.21.15.117:0/171083596 shutdown_connections 2024-04-12T09:13:31.857 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.856+0000 7f4f386fe700 1 -- 172.21.15.117:0/171083596 wait complete. 2024-04-12T09:13:31.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.959+0000 7f5841ba5700 1 -- 172.21.15.117:0/2306692976 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c0fbcd0 msgr2=0x7f583c0fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:31.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.959+0000 7f5841ba5700 1 --2- 172.21.15.117:0/2306692976 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c0fbcd0 0x7f583c0fc0e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f582c004940 tx=0x7f582c009e30 comp rx=0 tx=0).stop 2024-04-12T09:13:31.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.959+0000 7f5841ba5700 1 -- 172.21.15.117:0/2306692976 shutdown_connections 2024-04-12T09:13:31.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.959+0000 7f5841ba5700 1 --2- 172.21.15.117:0/2306692976 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f583c0fcf80 0x7f583c0fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:31.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.959+0000 7f5841ba5700 1 --2- 172.21.15.117:0/2306692976 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c0fbcd0 0x7f583c0fc0e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:31.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.959+0000 7f5841ba5700 1 -- 172.21.15.117:0/2306692976 >> 172.21.15.117:0/2306692976 conn(0x7f583c0f7430 msgr2=0x7f583c0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:13:31.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.959+0000 7f5841ba5700 1 -- 172.21.15.117:0/2306692976 shutdown_connections 2024-04-12T09:13:31.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.959+0000 7f5841ba5700 1 -- 172.21.15.117:0/2306692976 wait complete. 2024-04-12T09:13:31.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.959+0000 7f5841ba5700 1 Processor -- start 2024-04-12T09:13:31.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.959+0000 7f5841ba5700 1 -- start start 2024-04-12T09:13:31.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.960+0000 7f5841ba5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c0fbcd0 0x7f583c10d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:13:31.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.960+0000 7f5841ba5700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f583c0fcf80 0x7f583c10ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:13:31.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.960+0000 7f5841ba5700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c10e4d0 con 0x7f583c0fbcd0 2024-04-12T09:13:31.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.960+0000 7f5841ba5700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c10e640 con 0x7f583c0fcf80 2024-04-12T09:13:31.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.960+0000 7f583b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c0fbcd0 0x7f583c10d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:13:31.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.960+0000 7f583b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c0fbcd0 0x7f583c10d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:46522/0 (socket says 172.21.15.117:46522) 2024-04-12T09:13:31.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.960+0000 7f583b7fe700 1 -- 172.21.15.117:0/1400598501 learned_addr learned my addr 172.21.15.117:0/1400598501 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:13:31.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.960+0000 7f583affd700 1 --2- 172.21.15.117:0/1400598501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f583c0fcf80 0x7f583c10ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:13:31.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.960+0000 7f583b7fe700 1 -- 172.21.15.117:0/1400598501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f583c0fcf80 msgr2=0x7f583c10ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:31.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.960+0000 7f583b7fe700 1 --2- 172.21.15.117:0/1400598501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f583c0fcf80 0x7f583c10ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:31.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.960+0000 7f583b7fe700 1 -- 172.21.15.117:0/1400598501 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c005040 con 0x7f583c0fbcd0 2024-04-12T09:13:31.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.960+0000 7f583b7fe700 1 --2- 172.21.15.117:0/1400598501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c0fbcd0 0x7f583c10d990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f582c00b3b0 tx=0x7f582c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:13:31.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.960+0000 7f5823fff700 1 -- 172.21.15.117:0/1400598501 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f582c00e040 con 0x7f583c0fbcd0 2024-04-12T09:13:31.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.960+0000 7f5841ba5700 1 -- 172.21.15.117:0/1400598501 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583c112ff0 con 0x7f583c0fbcd0 2024-04-12T09:13:31.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.960+0000 7f5823fff700 1 -- 172.21.15.117:0/1400598501 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f582c00bbf0 con 0x7f583c0fbcd0 2024-04-12T09:13:31.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.960+0000 7f5823fff700 1 -- 172.21.15.117:0/1400598501 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f582c01c630 con 0x7f583c0fbcd0 2024-04-12T09:13:31.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.960+0000 7f5841ba5700 1 -- 172.21.15.117:0/1400598501 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583c113520 con 0x7f583c0fbcd0 2024-04-12T09:13:31.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.961+0000 7f5841ba5700 1 -- 172.21.15.117:0/1400598501 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583c101b10 con 0x7f583c0fbcd0 2024-04-12T09:13:31.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.962+0000 7f5823fff700 1 -- 172.21.15.117:0/1400598501 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 31) v1 ==== 91677+0+0 (secure 0 0 0) 0x7f582c00bd60 con 0x7f583c0fbcd0 2024-04-12T09:13:31.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.962+0000 7f5823fff700 1 --2- 172.21.15.117:0/1400598501 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f582406d6d0 0x7f582406fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:13:31.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.962+0000 7f5823fff700 1 -- 172.21.15.117:0/1400598501 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f582c08da10 con 0x7f583c0fbcd0 2024-04-12T09:13:31.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.962+0000 7f583affd700 1 --2- 172.21.15.117:0/1400598501 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f582406d6d0 0x7f582406fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:13:31.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.963+0000 7f583affd700 1 --2- 172.21.15.117:0/1400598501 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f582406d6d0 0x7f582406fb80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5830004f40 tx=0x7f583000b040 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:13:31.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:31.967+0000 7f5823fff700 1 -- 172.21.15.117:0/1400598501 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f582c05b1d0 con 0x7f583c0fbcd0 2024-04-12T09:13:32.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:31 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:32.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:31 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:32.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:31 smithi117 ceph-mon[29277]: from='client.24519 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:13:32.175 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.174+0000 7f5841ba5700 1 -- 172.21.15.117:0/1400598501 --> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f583c02b420 con 0x7f582406d6d0 2024-04-12T09:13:32.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.184+0000 7f5823fff700 1 -- 172.21.15.117:0/1400598501 <== mgr.14694 v2:172.21.15.117:6800/1056729457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f583c02b420 con 0x7f582406d6d0 2024-04-12T09:13:32.185 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:13:32.185 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 running (116s) 25s ago 10m 25.6M - 0.25.0 c8568f914cd2 34d1f5b82e31 2024-04-12T09:13:32.185 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (10m) 25s ago 10m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad 1e9f2c6a4491 2024-04-12T09:13:32.185 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (9m) 2s ago 9m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad e42da3f6e517 2024-04-12T09:13:32.185 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 unknown 25s ago 10m - - 2024-04-12T09:13:32.185 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (5m) 25s ago 5m 187M - 17.2.7-827-gd3b5060a 21de9b7369ad de062e2c10e7 2024-04-12T09:13:32.185 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 running (5m) 25s ago 5m 12.5M - 17.2.7-827-gd3b5060a 21de9b7369ad 1e82c6241a18 2024-04-12T09:13:32.185 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (5m) 2s ago 5m 15.4M - 17.2.7-827-gd3b5060a 21de9b7369ad b05228e997f7 2024-04-12T09:13:32.185 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (5m) 2s ago 5m 16.0M - 17.2.7-827-gd3b5060a 21de9b7369ad 6d7f82c072c7 2024-04-12T09:13:32.185 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:8443,9283,8765 running (58s) 25s ago 12m 479M - 19.0.0-2053-gb277feb2 668895944f0e fee613d05ab7 2024-04-12T09:13:32.185 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283,8765 running (6s) 2s ago 9m 64.7M - 19.0.0-2053-gb277feb2 668895944f0e c793944c3e16 2024-04-12T09:13:32.186 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (12m) 25s ago 12m 52.4M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad f9d5f7ac5270 2024-04-12T09:13:32.186 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (9m) 2s ago 9m 40.7M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad 17c0db49bb16 2024-04-12T09:13:32.186 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 running (2m) 25s ago 10m 16.3M - 1.5.0 0da6a335fe13 8d7fb10ea797 2024-04-12T09:13:32.186 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (70s) 2s ago 9m 15.1M - 1.5.0 0da6a335fe13 1eb060aff798 2024-04-12T09:13:32.186 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (8m) 25s ago 8m 218M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 77040a2498f3 2024-04-12T09:13:32.186 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (8m) 25s ago 8m 226M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 8f9dbf0274ed 2024-04-12T09:13:32.186 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (7m) 25s ago 7m 188M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 339c5a80d1dd 2024-04-12T09:13:32.186 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (7m) 2s ago 7m 272M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad fb87d616bae3 2024-04-12T09:13:32.186 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (7m) 2s ago 7m 245M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad c873826a2dea 2024-04-12T09:13:32.186 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (6m) 2s ago 6m 218M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad 69cb7c22f002 2024-04-12T09:13:32.186 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 starting - - - - 2024-04-12T09:13:32.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.186+0000 7f5841ba5700 1 -- 172.21.15.117:0/1400598501 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f582406d6d0 msgr2=0x7f582406fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:32.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.186+0000 7f5841ba5700 1 --2- 172.21.15.117:0/1400598501 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f582406d6d0 0x7f582406fb80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5830004f40 tx=0x7f583000b040 comp rx=0 tx=0).stop 2024-04-12T09:13:32.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.186+0000 7f5841ba5700 1 -- 172.21.15.117:0/1400598501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c0fbcd0 msgr2=0x7f583c10d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:32.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.186+0000 7f5841ba5700 1 --2- 172.21.15.117:0/1400598501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c0fbcd0 0x7f583c10d990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f582c00b3b0 tx=0x7f582c009e30 comp rx=0 tx=0).stop 2024-04-12T09:13:32.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.186+0000 7f5841ba5700 1 -- 172.21.15.117:0/1400598501 shutdown_connections 2024-04-12T09:13:32.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.187+0000 7f5841ba5700 1 --2- 172.21.15.117:0/1400598501 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f582406d6d0 0x7f582406fb80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:32.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.187+0000 7f5841ba5700 1 --2- 172.21.15.117:0/1400598501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c0fbcd0 0x7f583c10d990 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:32.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.187+0000 7f5841ba5700 1 --2- 172.21.15.117:0/1400598501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f583c0fcf80 0x7f583c10ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:32.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.187+0000 7f5841ba5700 1 -- 172.21.15.117:0/1400598501 >> 172.21.15.117:0/1400598501 conn(0x7f583c0f7430 msgr2=0x7f583c0f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:13:32.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.187+0000 7f5841ba5700 1 -- 172.21.15.117:0/1400598501 shutdown_connections 2024-04-12T09:13:32.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.187+0000 7f5841ba5700 1 -- 172.21.15.117:0/1400598501 wait complete. 2024-04-12T09:13:32.191 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:31 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:32.191 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:31 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:32.191 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:31 smithi203 ceph-mon[36428]: from='client.24519 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:13:32.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.290+0000 7f6a9c0ad700 1 -- 172.21.15.117:0/3470827738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a940fbcd0 msgr2=0x7f6a940fc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:32.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.290+0000 7f6a9c0ad700 1 --2- 172.21.15.117:0/3470827738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a940fbcd0 0x7f6a940fc0e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6a84004940 tx=0x7f6a84009e30 comp rx=0 tx=0).stop 2024-04-12T09:13:32.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.290+0000 7f6a9c0ad700 1 -- 172.21.15.117:0/3470827738 shutdown_connections 2024-04-12T09:13:32.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.290+0000 7f6a9c0ad700 1 --2- 172.21.15.117:0/3470827738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a940fcf80 0x7f6a940fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:32.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.290+0000 7f6a9c0ad700 1 --2- 172.21.15.117:0/3470827738 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a940fbcd0 0x7f6a940fc0e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:32.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.290+0000 7f6a9c0ad700 1 -- 172.21.15.117:0/3470827738 >> 172.21.15.117:0/3470827738 conn(0x7f6a940f7430 msgr2=0x7f6a940f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:13:32.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.290+0000 7f6a9c0ad700 1 -- 172.21.15.117:0/3470827738 shutdown_connections 2024-04-12T09:13:32.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.290+0000 7f6a9c0ad700 1 -- 172.21.15.117:0/3470827738 wait complete. 2024-04-12T09:13:32.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.290+0000 7f6a9c0ad700 1 Processor -- start 2024-04-12T09:13:32.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.291+0000 7f6a9c0ad700 1 -- start start 2024-04-12T09:13:32.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.291+0000 7f6a9c0ad700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a940fbcd0 0x7f6a9410c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:13:32.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.291+0000 7f6a9c0ad700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a940fcf80 0x7f6a9410ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:13:32.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.291+0000 7f6a9c0ad700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9410d440 con 0x7f6a940fbcd0 2024-04-12T09:13:32.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.291+0000 7f6a9c0ad700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9410dc90 con 0x7f6a940fcf80 2024-04-12T09:13:32.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.291+0000 7f6a99e49700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a940fbcd0 0x7f6a9410c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:13:32.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.291+0000 7f6a99e49700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a940fbcd0 0x7f6a9410c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:46536/0 (socket says 172.21.15.117:46536) 2024-04-12T09:13:32.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.291+0000 7f6a99e49700 1 -- 172.21.15.117:0/1588427429 learned_addr learned my addr 172.21.15.117:0/1588427429 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:13:32.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.291+0000 7f6a99648700 1 --2- 172.21.15.117:0/1588427429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a940fcf80 0x7f6a9410ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:13:32.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.291+0000 7f6a99e49700 1 -- 172.21.15.117:0/1588427429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a940fcf80 msgr2=0x7f6a9410ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:32.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.291+0000 7f6a99e49700 1 --2- 172.21.15.117:0/1588427429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a940fcf80 0x7f6a9410ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:32.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.291+0000 7f6a99e49700 1 -- 172.21.15.117:0/1588427429 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a84005040 con 0x7f6a940fbcd0 2024-04-12T09:13:32.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.291+0000 7f6a99e49700 1 --2- 172.21.15.117:0/1588427429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a940fbcd0 0x7f6a9410c900 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6a84009fd0 tx=0x7f6a84009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:13:32.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.291+0000 7f6a8a7fc700 1 -- 172.21.15.117:0/1588427429 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a8400e040 con 0x7f6a940fbcd0 2024-04-12T09:13:32.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.292+0000 7f6a9c0ad700 1 -- 172.21.15.117:0/1588427429 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9410df10 con 0x7f6a940fbcd0 2024-04-12T09:13:32.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.292+0000 7f6a8a7fc700 1 -- 172.21.15.117:0/1588427429 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6a8400be00 con 0x7f6a940fbcd0 2024-04-12T09:13:32.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.292+0000 7f6a8a7fc700 1 -- 172.21.15.117:0/1588427429 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a840137f0 con 0x7f6a940fbcd0 2024-04-12T09:13:32.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.292+0000 7f6a9c0ad700 1 -- 172.21.15.117:0/1588427429 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9410e450 con 0x7f6a940fbcd0 2024-04-12T09:13:32.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.293+0000 7f6a9c0ad700 1 -- 172.21.15.117:0/1588427429 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a9405f5f0 con 0x7f6a940fbcd0 2024-04-12T09:13:32.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.293+0000 7f6a8a7fc700 1 -- 172.21.15.117:0/1588427429 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 31) v1 ==== 91677+0+0 (secure 0 0 0) 0x7f6a84013a60 con 0x7f6a940fbcd0 2024-04-12T09:13:32.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.293+0000 7f6a8a7fc700 1 --2- 172.21.15.117:0/1588427429 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f6a8006d6c0 0x7f6a8006fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:13:32.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.294+0000 7f6a8a7fc700 1 -- 172.21.15.117:0/1588427429 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f6a84090740 con 0x7f6a940fbcd0 2024-04-12T09:13:32.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.294+0000 7f6a99648700 1 --2- 172.21.15.117:0/1588427429 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f6a8006d6c0 0x7f6a8006fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:13:32.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.294+0000 7f6a99648700 1 --2- 172.21.15.117:0/1588427429 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f6a8006d6c0 0x7f6a8006fb70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6a90004f40 tx=0x7f6a9000b040 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:13:32.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.300+0000 7f6a8a7fc700 1 -- 172.21.15.117:0/1588427429 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f6a8405df30 con 0x7f6a940fbcd0 2024-04-12T09:13:32.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.638+0000 7f6a9c0ad700 1 -- 172.21.15.117:0/1588427429 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6a9410e840 con 0x7f6a940fbcd0 2024-04-12T09:13:32.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.638+0000 7f6a8a7fc700 1 -- 172.21.15.117:0/1588427429 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f6a8405dac0 con 0x7f6a940fbcd0 2024-04-12T09:13:32.640 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:13:32.640 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": { 2024-04-12T09:13:32.640 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 2 2024-04-12T09:13:32.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:13:32.640 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": { 2024-04-12T09:13:32.640 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:13:32.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:13:32.640 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": { 2024-04-12T09:13:32.640 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 6 2024-04-12T09:13:32.640 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:13:32.641 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-04-12T09:13:32.641 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 4 2024-04-12T09:13:32.641 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:13:32.641 INFO:teuthology.orchestra.run.smithi117.stdout: "overall": { 2024-04-12T09:13:32.641 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 12, 2024-04-12T09:13:32.641 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:13:32.641 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:13:32.641 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:13:32.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.640+0000 7f6a9c0ad700 1 -- 172.21.15.117:0/1588427429 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f6a8006d6c0 msgr2=0x7f6a8006fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:32.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.640+0000 7f6a9c0ad700 1 --2- 172.21.15.117:0/1588427429 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f6a8006d6c0 0x7f6a8006fb70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6a90004f40 tx=0x7f6a9000b040 comp rx=0 tx=0).stop 2024-04-12T09:13:32.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.640+0000 7f6a9c0ad700 1 -- 172.21.15.117:0/1588427429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a940fbcd0 msgr2=0x7f6a9410c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:32.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.640+0000 7f6a9c0ad700 1 --2- 172.21.15.117:0/1588427429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a940fbcd0 0x7f6a9410c900 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6a84009fd0 tx=0x7f6a84009e30 comp rx=0 tx=0).stop 2024-04-12T09:13:32.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.641+0000 7f6a9c0ad700 1 -- 172.21.15.117:0/1588427429 shutdown_connections 2024-04-12T09:13:32.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.641+0000 7f6a9c0ad700 1 --2- 172.21.15.117:0/1588427429 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f6a8006d6c0 0x7f6a8006fb70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:32.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.641+0000 7f6a9c0ad700 1 --2- 172.21.15.117:0/1588427429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a940fbcd0 0x7f6a9410c900 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:32.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.641+0000 7f6a9c0ad700 1 --2- 172.21.15.117:0/1588427429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a940fcf80 0x7f6a9410ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:32.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.641+0000 7f6a9c0ad700 1 -- 172.21.15.117:0/1588427429 >> 172.21.15.117:0/1588427429 conn(0x7f6a940f7430 msgr2=0x7f6a940f8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:13:32.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.641+0000 7f6a9c0ad700 1 -- 172.21.15.117:0/1588427429 shutdown_connections 2024-04-12T09:13:32.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.641+0000 7f6a9c0ad700 1 -- 172.21.15.117:0/1588427429 wait complete. 2024-04-12T09:13:32.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.743+0000 7f19dfa48700 1 -- 172.21.15.117:0/2151350486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19d80fed90 msgr2=0x7f19d80faed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:32.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.743+0000 7f19dfa48700 1 --2- 172.21.15.117:0/2151350486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19d80fed90 0x7f19d80faed0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f19c8004940 tx=0x7f19c8009e30 comp rx=0 tx=0).stop 2024-04-12T09:13:32.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.743+0000 7f19dfa48700 1 -- 172.21.15.117:0/2151350486 shutdown_connections 2024-04-12T09:13:32.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.743+0000 7f19dfa48700 1 --2- 172.21.15.117:0/2151350486 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19d80fed90 0x7f19d80faed0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:32.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.743+0000 7f19dfa48700 1 --2- 172.21.15.117:0/2151350486 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19d80fe440 0x7f19d80fe850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:32.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.743+0000 7f19dfa48700 1 -- 172.21.15.117:0/2151350486 >> 172.21.15.117:0/2151350486 conn(0x7f19d80f6be0 msgr2=0x7f19d80f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:13:32.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.743+0000 7f19dfa48700 1 -- 172.21.15.117:0/2151350486 shutdown_connections 2024-04-12T09:13:32.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.743+0000 7f19dfa48700 1 -- 172.21.15.117:0/2151350486 wait complete. 2024-04-12T09:13:32.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.743+0000 7f19dfa48700 1 Processor -- start 2024-04-12T09:13:32.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.743+0000 7f19dfa48700 1 -- start start 2024-04-12T09:13:32.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.743+0000 7f19dfa48700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19d80fe440 0x7f19d810faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:13:32.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.743+0000 7f19dfa48700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19d80fed90 0x7f19d810ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:13:32.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.743+0000 7f19dfa48700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d81105e0 con 0x7f19d80fed90 2024-04-12T09:13:32.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.743+0000 7f19dfa48700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d8110750 con 0x7f19d80fe440 2024-04-12T09:13:32.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.744+0000 7f19dcfe3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19d80fed90 0x7f19d810ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:13:32.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.744+0000 7f19dcfe3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19d80fed90 0x7f19d810ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:46556/0 (socket says 172.21.15.117:46556) 2024-04-12T09:13:32.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.744+0000 7f19dcfe3700 1 -- 172.21.15.117:0/1850390792 learned_addr learned my addr 172.21.15.117:0/1850390792 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:13:32.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.744+0000 7f19dd7e4700 1 --2- 172.21.15.117:0/1850390792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19d80fe440 0x7f19d810faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:13:32.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.744+0000 7f19dcfe3700 1 -- 172.21.15.117:0/1850390792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19d80fe440 msgr2=0x7f19d810faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:32.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.744+0000 7f19dcfe3700 1 --2- 172.21.15.117:0/1850390792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19d80fe440 0x7f19d810faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:32.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.744+0000 7f19dcfe3700 1 -- 172.21.15.117:0/1850390792 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c8005040 con 0x7f19d80fed90 2024-04-12T09:13:32.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.744+0000 7f19dcfe3700 1 --2- 172.21.15.117:0/1850390792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19d80fed90 0x7f19d810ffe0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009150 tx=0x7f19c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:13:32.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.744+0000 7f19cdffb700 1 -- 172.21.15.117:0/1850390792 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c800e040 con 0x7f19d80fed90 2024-04-12T09:13:32.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.744+0000 7f19cdffb700 1 -- 172.21.15.117:0/1850390792 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f19c8004290 con 0x7f19d80fed90 2024-04-12T09:13:32.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.744+0000 7f19dfa48700 1 -- 172.21.15.117:0/1850390792 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d8115150 con 0x7f19d80fed90 2024-04-12T09:13:32.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.744+0000 7f19cdffb700 1 -- 172.21.15.117:0/1850390792 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c801c630 con 0x7f19d80fed90 2024-04-12T09:13:32.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.744+0000 7f19dfa48700 1 -- 172.21.15.117:0/1850390792 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d8115710 con 0x7f19d80fed90 2024-04-12T09:13:32.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.745+0000 7f19dfa48700 1 -- 172.21.15.117:0/1850390792 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d804c710 con 0x7f19d80fed90 2024-04-12T09:13:32.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.746+0000 7f19cdffb700 1 -- 172.21.15.117:0/1850390792 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 31) v1 ==== 91677+0+0 (secure 0 0 0) 0x7f19c800bbf0 con 0x7f19d80fed90 2024-04-12T09:13:32.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.746+0000 7f19cdffb700 1 --2- 172.21.15.117:0/1850390792 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f19c406d6d0 0x7f19c406fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:13:32.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.746+0000 7f19cdffb700 1 -- 172.21.15.117:0/1850390792 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f19c808d9f0 con 0x7f19d80fed90 2024-04-12T09:13:32.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.746+0000 7f19dd7e4700 1 --2- 172.21.15.117:0/1850390792 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f19c406d6d0 0x7f19c406fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:13:32.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.747+0000 7f19dd7e4700 1 --2- 172.21.15.117:0/1850390792 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f19c406d6d0 0x7f19c406fb80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f19d4009fd0 tx=0x7f19d400b040 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:13:32.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.751+0000 7f19cdffb700 1 -- 172.21.15.117:0/1850390792 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f19c808fe60 con 0x7f19d80fed90 2024-04-12T09:13:32.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.963+0000 7f19dfa48700 1 -- 172.21.15.117:0/1850390792 --> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f19d8102490 con 0x7f19c406d6d0 2024-04-12T09:13:32.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.965+0000 7f19cdffb700 1 -- 172.21.15.117:0/1850390792 <== mgr.14694 v2:172.21.15.117:6800/1056729457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f19d8102490 con 0x7f19c406d6d0 2024-04-12T09:13:32.965 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:13:32.965 INFO:teuthology.orchestra.run.smithi117.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec", 2024-04-12T09:13:32.965 INFO:teuthology.orchestra.run.smithi117.stdout: "in_progress": true, 2024-04-12T09:13:32.966 INFO:teuthology.orchestra.run.smithi117.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-12T09:13:32.966 INFO:teuthology.orchestra.run.smithi117.stdout: "services_complete": [ 2024-04-12T09:13:32.966 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr" 2024-04-12T09:13:32.966 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2024-04-12T09:13:32.966 INFO:teuthology.orchestra.run.smithi117.stdout: "progress": "2/2 daemons upgraded", 2024-04-12T09:13:32.966 INFO:teuthology.orchestra.run.smithi117.stdout: "message": "Currently upgrading mgr daemons", 2024-04-12T09:13:32.966 INFO:teuthology.orchestra.run.smithi117.stdout: "is_paused": false 2024-04-12T09:13:32.966 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:13:32.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.967+0000 7f19dfa48700 1 -- 172.21.15.117:0/1850390792 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f19c406d6d0 msgr2=0x7f19c406fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:32.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.967+0000 7f19dfa48700 1 --2- 172.21.15.117:0/1850390792 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f19c406d6d0 0x7f19c406fb80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f19d4009fd0 tx=0x7f19d400b040 comp rx=0 tx=0).stop 2024-04-12T09:13:32.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.967+0000 7f19dfa48700 1 -- 172.21.15.117:0/1850390792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19d80fed90 msgr2=0x7f19d810ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:13:32.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.967+0000 7f19dfa48700 1 --2- 172.21.15.117:0/1850390792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19d80fed90 0x7f19d810ffe0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009150 tx=0x7f19c8009e30 comp rx=0 tx=0).stop 2024-04-12T09:13:32.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.967+0000 7f19dfa48700 1 -- 172.21.15.117:0/1850390792 shutdown_connections 2024-04-12T09:13:32.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.967+0000 7f19dfa48700 1 --2- 172.21.15.117:0/1850390792 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f19c406d6d0 0x7f19c406fb80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:32.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.967+0000 7f19dfa48700 1 --2- 172.21.15.117:0/1850390792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19d80fe440 0x7f19d810faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:32.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.967+0000 7f19dfa48700 1 --2- 172.21.15.117:0/1850390792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19d80fed90 0x7f19d810ffe0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:13:32.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.967+0000 7f19dfa48700 1 -- 172.21.15.117:0/1850390792 >> 172.21.15.117:0/1850390792 conn(0x7f19d80f6be0 msgr2=0x7f19d80f81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:13:32.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.967+0000 7f19dfa48700 1 -- 172.21.15.117:0/1850390792 shutdown_connections 2024-04-12T09:13:32.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:13:32.967+0000 7f19dfa48700 1 -- 172.21.15.117:0/1850390792 wait complete. 2024-04-12T09:13:33.783 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:33 smithi203 ceph-mon[36428]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:13:33.783 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:33 smithi203 ceph-mon[36428]: pgmap v22: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 24 KiB/s wr, 0 op/s 2024-04-12T09:13:33.784 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:33 smithi203 ceph-mon[36428]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:13:33.784 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:33 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:33.784 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:33 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:33.784 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:33 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/1588427429' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:33.784 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:33 smithi203 ceph-mon[36428]: Standby manager daemon smithi203.apfqpo restarted 2024-04-12T09:13:33.784 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:33 smithi203 ceph-mon[36428]: Standby manager daemon smithi203.apfqpo started 2024-04-12T09:13:33.784 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:33 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.203:0/2948830698' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.apfqpo/crt"}]: dispatch 2024-04-12T09:13:33.784 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:33 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.203:0/2948830698' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T09:13:33.784 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:33 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.203:0/2948830698' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.apfqpo/key"}]: dispatch 2024-04-12T09:13:33.784 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:33 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.203:0/2948830698' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T09:13:33.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:33 smithi117 ceph-mon[29277]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:13:33.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:33 smithi117 ceph-mon[29277]: pgmap v22: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 24 KiB/s wr, 0 op/s 2024-04-12T09:13:33.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:33 smithi117 ceph-mon[29277]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:13:33.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:33 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:33.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:33 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:33.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:33 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/1588427429' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:33.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:33 smithi117 ceph-mon[29277]: Standby manager daemon smithi203.apfqpo restarted 2024-04-12T09:13:33.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:33 smithi117 ceph-mon[29277]: Standby manager daemon smithi203.apfqpo started 2024-04-12T09:13:33.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:33 smithi117 ceph-mon[29277]: from='mgr.? 172.21.15.203:0/2948830698' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.apfqpo/crt"}]: dispatch 2024-04-12T09:13:33.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:33 smithi117 ceph-mon[29277]: from='mgr.? 172.21.15.203:0/2948830698' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T09:13:33.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:33 smithi117 ceph-mon[29277]: from='mgr.? 172.21.15.203:0/2948830698' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.apfqpo/key"}]: dispatch 2024-04-12T09:13:33.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:33 smithi117 ceph-mon[29277]: from='mgr.? 172.21.15.203:0/2948830698' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T09:13:34.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:34 smithi203 ceph-mon[36428]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:13:34.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:34 smithi203 ceph-mon[36428]: mgrmap e32: smithi117.oyaxql(active, since 38s), standbys: smithi203.apfqpo 2024-04-12T09:13:34.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:34 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:34.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:34 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:34.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:34 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:13:34.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:34 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:13:34.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:34 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:34.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:34 smithi117 ceph-mon[29277]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:13:34.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:34 smithi117 ceph-mon[29277]: mgrmap e32: smithi117.oyaxql(active, since 38s), standbys: smithi203.apfqpo 2024-04-12T09:13:34.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:34 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:34.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:34 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:34.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:34 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:13:34.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:34 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:13:34.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:34 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:35.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:35 smithi203 ceph-mon[36428]: pgmap v23: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:35.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:35 smithi203 ceph-mon[36428]: pgmap v24: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:35.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:35 smithi203 ceph-mon[36428]: pgmap v25: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:35.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:35 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:13:35.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:35 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:35.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:35 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:35.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:35 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi117.oyaxql"}]: dispatch 2024-04-12T09:13:35.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:35 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi117.oyaxql"}]': finished 2024-04-12T09:13:35.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:35 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi203.apfqpo"}]: dispatch 2024-04-12T09:13:35.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:35 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi203.apfqpo"}]': finished 2024-04-12T09:13:35.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:35 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:35.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:35 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:35.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:35 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:35.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:35 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:35.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:35 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:35.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:35 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:35.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:35 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:35.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:35 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:35.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:35 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:35.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:35 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:35.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:35 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:35.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:35 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:35.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:35 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:35.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:35 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:35.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:35 smithi117 ceph-mon[29277]: pgmap v23: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:35.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:35 smithi117 ceph-mon[29277]: pgmap v24: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:35.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:35 smithi117 ceph-mon[29277]: pgmap v25: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:35.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:35 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:13:35.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:35 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:35.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:35 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:35.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:35 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi117.oyaxql"}]: dispatch 2024-04-12T09:13:35.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:35 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi117.oyaxql"}]': finished 2024-04-12T09:13:35.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:35 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi203.apfqpo"}]: dispatch 2024-04-12T09:13:35.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:35 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi203.apfqpo"}]': finished 2024-04-12T09:13:35.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:35 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:35.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:35 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:35.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:35 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:35.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:35 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:35.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:35 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:35.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:35 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:35.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:35 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:35.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:35 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:35.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:35 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:35.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:35 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:35.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:35 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:35.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:35 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:35.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:35 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:35.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:35 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:36.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:36 smithi203 ceph-mon[36428]: Upgrade: Setting container_image for all mgr 2024-04-12T09:13:36.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:36 smithi203 ceph-mon[36428]: Upgrade: Setting container_image for all rgw 2024-04-12T09:13:36.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:36 smithi203 ceph-mon[36428]: Upgrade: Setting container_image for all rbd-mirror 2024-04-12T09:13:36.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:36 smithi203 ceph-mon[36428]: Upgrade: Setting container_image for all cephfs-mirror 2024-04-12T09:13:36.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:36 smithi203 ceph-mon[36428]: Upgrade: Setting container_image for all ceph-exporter 2024-04-12T09:13:36.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:36 smithi203 ceph-mon[36428]: Upgrade: Setting container_image for all iscsi 2024-04-12T09:13:36.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:36 smithi203 ceph-mon[36428]: Upgrade: Setting container_image for all nfs 2024-04-12T09:13:36.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:36 smithi203 ceph-mon[36428]: Upgrade: Setting container_image for all nvmeof 2024-04-12T09:13:36.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:36 smithi117 ceph-mon[29277]: Upgrade: Setting container_image for all mgr 2024-04-12T09:13:36.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:36 smithi117 ceph-mon[29277]: Upgrade: Setting container_image for all rgw 2024-04-12T09:13:36.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:36 smithi117 ceph-mon[29277]: Upgrade: Setting container_image for all rbd-mirror 2024-04-12T09:13:36.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:36 smithi117 ceph-mon[29277]: Upgrade: Setting container_image for all cephfs-mirror 2024-04-12T09:13:36.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:36 smithi117 ceph-mon[29277]: Upgrade: Setting container_image for all ceph-exporter 2024-04-12T09:13:36.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:36 smithi117 ceph-mon[29277]: Upgrade: Setting container_image for all iscsi 2024-04-12T09:13:36.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:36 smithi117 ceph-mon[29277]: Upgrade: Setting container_image for all nfs 2024-04-12T09:13:36.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:36 smithi117 ceph-mon[29277]: Upgrade: Setting container_image for all nvmeof 2024-04-12T09:13:37.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:37 smithi203 ceph-mon[36428]: pgmap v26: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:37.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:37 smithi117 ceph-mon[29277]: pgmap v26: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:39.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:39 smithi117 ceph-mon[29277]: Upgrade: Updating node-exporter.smithi117 (1/2) 2024-04-12T09:13:39.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:39 smithi117 ceph-mon[29277]: Deploying daemon node-exporter.smithi117 on smithi117 2024-04-12T09:13:39.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:39 smithi117 ceph-mon[29277]: pgmap v27: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:39.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:39 smithi203 ceph-mon[36428]: Upgrade: Updating node-exporter.smithi117 (1/2) 2024-04-12T09:13:39.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:39 smithi203 ceph-mon[36428]: Deploying daemon node-exporter.smithi117 on smithi117 2024-04-12T09:13:39.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:39 smithi203 ceph-mon[36428]: pgmap v27: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:40.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:40 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:13:40.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:40 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:13:41.727 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:41 smithi203 ceph-mon[36428]: pgmap v28: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:41.727 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:41 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:41.728 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:41 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:41.883 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:41 smithi117 ceph-mon[29277]: pgmap v28: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:41.884 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:41 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:41.884 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:41 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:43.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:43 smithi203 ceph-mon[36428]: Upgrade: Updating node-exporter.smithi203 (2/2) 2024-04-12T09:13:43.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:43 smithi203 ceph-mon[36428]: Deploying daemon node-exporter.smithi203 on smithi203 2024-04-12T09:13:43.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:43 smithi203 ceph-mon[36428]: pgmap v29: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:43.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:43 smithi117 ceph-mon[29277]: Upgrade: Updating node-exporter.smithi203 (2/2) 2024-04-12T09:13:43.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:43 smithi117 ceph-mon[29277]: Deploying daemon node-exporter.smithi203 on smithi203 2024-04-12T09:13:43.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:43 smithi117 ceph-mon[29277]: pgmap v29: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:45.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:45 smithi203 ceph-mon[36428]: pgmap v30: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:45.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:45 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:45.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:45 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:45.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:45 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:13:45.854 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:45 smithi117 ceph-mon[29277]: pgmap v30: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:45.854 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:45 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:45.854 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:45 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:45.854 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:45 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:13:46.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:46 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:46.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:46 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:46.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:46 smithi203 ceph-mon[36428]: pgmap v31: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:46.847 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:46 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:46.847 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:46 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:46.847 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:46 smithi117 ceph-mon[29277]: pgmap v31: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:49.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:49 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:49.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:49 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:49.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:49 smithi117 ceph-mon[29277]: pgmap v32: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:49.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:49 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:49.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:49 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:49.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:49 smithi203 ceph-mon[36428]: pgmap v32: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:50.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:50 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:50.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:50 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:50.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:50 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:50.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:50 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:50.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:50 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:50.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:50 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:50.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:50 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:50.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:50 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:51.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:51 smithi203 ceph-mon[36428]: pgmap v33: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:51.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:51 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:51.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:51 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:51.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:51 smithi117 ceph-mon[29277]: pgmap v33: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:51.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:51 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:51.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:51 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:53.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:53 smithi203 ceph-mon[36428]: pgmap v34: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:53.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:53 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:53.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:53 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:53.858 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:53 smithi117 ceph-mon[29277]: pgmap v34: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:53.858 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:53 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:53.858 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:53 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:55.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:55.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:55.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:13:55.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:13:55.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:55 smithi117 ceph-mon[29277]: pgmap v35: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:55.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:55 smithi117 ceph-mon[29277]: pgmap v36: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:55.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:55.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:13:55.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:55.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:55.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:55.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:55.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:55.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:55.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:55.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:55.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:55.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:13:55.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:55.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:55.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:13:55.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:13:55.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:55 smithi203 ceph-mon[36428]: pgmap v35: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:55.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:55 smithi203 ceph-mon[36428]: pgmap v36: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:55.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:13:55.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:13:55.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:55.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:55.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:55.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:55.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:55.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:55.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:55.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:55.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:13:55.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:13:57.700 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:57 smithi117 ceph-mon[29277]: pgmap v37: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:57.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:57 smithi203 ceph-mon[36428]: pgmap v37: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:58.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:58 smithi203 ceph-mon[36428]: Upgrade: Updating prometheus.smithi117 2024-04-12T09:13:58.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:58 smithi203 ceph-mon[36428]: Deploying daemon prometheus.smithi117 on smithi117 2024-04-12T09:13:58.891 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:58 smithi117 ceph-mon[29277]: Upgrade: Updating prometheus.smithi117 2024-04-12T09:13:58.891 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:58 smithi117 ceph-mon[29277]: Deploying daemon prometheus.smithi117 on smithi117 2024-04-12T09:13:59.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:13:59 smithi203 ceph-mon[36428]: pgmap v38: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:13:59.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:13:59 smithi117 ceph-mon[29277]: pgmap v38: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:01.771 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:01 smithi117 ceph-mon[29277]: pgmap v39: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:01.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:01 smithi203 ceph-mon[36428]: pgmap v39: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:03.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.079+0000 7f0496564700 1 -- 172.21.15.117:0/2875408006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04900fff00 msgr2=0x7f0490102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:03.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.079+0000 7f0496564700 1 --2- 172.21.15.117:0/2875408006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04900fff00 0x7f0490102320 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0484004940 tx=0x7f0484009e30 comp rx=0 tx=0).stop 2024-04-12T09:14:03.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.079+0000 7f0496564700 1 -- 172.21.15.117:0/2875408006 shutdown_connections 2024-04-12T09:14:03.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.079+0000 7f0496564700 1 --2- 172.21.15.117:0/2875408006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04900fff00 0x7f0490102320 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:03.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.079+0000 7f0496564700 1 --2- 172.21.15.117:0/2875408006 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0490066ef0 0x7f04900ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:03.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.079+0000 7f0496564700 1 -- 172.21.15.117:0/2875408006 >> 172.21.15.117:0/2875408006 conn(0x7f04900f7430 msgr2=0x7f04900f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:14:03.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.079+0000 7f0496564700 1 -- 172.21.15.117:0/2875408006 shutdown_connections 2024-04-12T09:14:03.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.079+0000 7f0496564700 1 -- 172.21.15.117:0/2875408006 wait complete. 2024-04-12T09:14:03.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.079+0000 7f0496564700 1 Processor -- start 2024-04-12T09:14:03.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.080+0000 7f0496564700 1 -- start start 2024-04-12T09:14:03.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.080+0000 7f0496564700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0490066ef0 0x7f049010d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:03.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.080+0000 7f0496564700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04900fff00 0x7f049010dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:03.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.080+0000 7f0496564700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049010e550 con 0x7f04900fff00 2024-04-12T09:14:03.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.080+0000 7f0496564700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0490112ea0 con 0x7f0490066ef0 2024-04-12T09:14:03.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.080+0000 7f048f7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04900fff00 0x7f049010dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:03.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.080+0000 7f048f7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04900fff00 0x7f049010dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:41268/0 (socket says 172.21.15.117:41268) 2024-04-12T09:14:03.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.080+0000 7f048f7fe700 1 -- 172.21.15.117:0/654117920 learned_addr learned my addr 172.21.15.117:0/654117920 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:14:03.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.080+0000 7f048ffff700 1 --2- 172.21.15.117:0/654117920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0490066ef0 0x7f049010d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:03.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.080+0000 7f048f7fe700 1 -- 172.21.15.117:0/654117920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0490066ef0 msgr2=0x7f049010d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:03.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.080+0000 7f048f7fe700 1 --2- 172.21.15.117:0/654117920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0490066ef0 0x7f049010d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:03.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.080+0000 7f048f7fe700 1 -- 172.21.15.117:0/654117920 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0484005040 con 0x7f04900fff00 2024-04-12T09:14:03.083 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.080+0000 7f048ffff700 1 --2- 172.21.15.117:0/654117920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0490066ef0 0x7f049010d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T09:14:03.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.080+0000 7f048f7fe700 1 --2- 172.21.15.117:0/654117920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04900fff00 0x7f049010dec0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f048400b3b0 tx=0x7f0484009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:14:03.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.081+0000 7f048cff9700 1 -- 172.21.15.117:0/654117920 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f048400e040 con 0x7f04900fff00 2024-04-12T09:14:03.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.081+0000 7f048cff9700 1 -- 172.21.15.117:0/654117920 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f048400bcc0 con 0x7f04900fff00 2024-04-12T09:14:03.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.081+0000 7f048cff9700 1 -- 172.21.15.117:0/654117920 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f048401c630 con 0x7f04900fff00 2024-04-12T09:14:03.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.081+0000 7f0496564700 1 -- 172.21.15.117:0/654117920 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04901130a0 con 0x7f04900fff00 2024-04-12T09:14:03.084 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.081+0000 7f0496564700 1 -- 172.21.15.117:0/654117920 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0490113610 con 0x7f04900fff00 2024-04-12T09:14:03.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.082+0000 7f0496564700 1 -- 172.21.15.117:0/654117920 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f049004c710 con 0x7f04900fff00 2024-04-12T09:14:03.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.082+0000 7f048cff9700 1 -- 172.21.15.117:0/654117920 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 32) v1 ==== 91677+0+0 (secure 0 0 0) 0x7f0484013420 con 0x7f04900fff00 2024-04-12T09:14:03.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.083+0000 7f048cff9700 1 --2- 172.21.15.117:0/654117920 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f047806d6d0 0x7f047806fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:03.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.083+0000 7f048cff9700 1 -- 172.21.15.117:0/654117920 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f048408da20 con 0x7f04900fff00 2024-04-12T09:14:03.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.083+0000 7f048ffff700 1 --2- 172.21.15.117:0/654117920 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f047806d6d0 0x7f047806fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:03.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.083+0000 7f048ffff700 1 --2- 172.21.15.117:0/654117920 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f047806d6d0 0x7f047806fb80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0480006fd0 tx=0x7f0480008040 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:14:03.088 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.088+0000 7f048cff9700 1 -- 172.21.15.117:0/654117920 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f048405b1e0 con 0x7f04900fff00 2024-04-12T09:14:03.310 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.309+0000 7f0496564700 1 -- 172.21.15.117:0/654117920 --> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f04900f8f70 con 0x7f047806d6d0 2024-04-12T09:14:03.311 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.310+0000 7f048cff9700 1 -- 172.21.15.117:0/654117920 <== mgr.14694 v2:172.21.15.117:6800/1056729457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f04900f8f70 con 0x7f047806d6d0 2024-04-12T09:14:03.313 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.312+0000 7f0496564700 1 -- 172.21.15.117:0/654117920 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f047806d6d0 msgr2=0x7f047806fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:03.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.312+0000 7f0496564700 1 --2- 172.21.15.117:0/654117920 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f047806d6d0 0x7f047806fb80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0480006fd0 tx=0x7f0480008040 comp rx=0 tx=0).stop 2024-04-12T09:14:03.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.312+0000 7f0496564700 1 -- 172.21.15.117:0/654117920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04900fff00 msgr2=0x7f049010dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:03.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.312+0000 7f0496564700 1 --2- 172.21.15.117:0/654117920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04900fff00 0x7f049010dec0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f048400b3b0 tx=0x7f0484009e30 comp rx=0 tx=0).stop 2024-04-12T09:14:03.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.313+0000 7f0496564700 1 -- 172.21.15.117:0/654117920 shutdown_connections 2024-04-12T09:14:03.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.313+0000 7f0496564700 1 --2- 172.21.15.117:0/654117920 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f047806d6d0 0x7f047806fb80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:03.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.313+0000 7f0496564700 1 --2- 172.21.15.117:0/654117920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0490066ef0 0x7f049010d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:03.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.313+0000 7f0496564700 1 --2- 172.21.15.117:0/654117920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04900fff00 0x7f049010dec0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:03.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.313+0000 7f0496564700 1 -- 172.21.15.117:0/654117920 >> 172.21.15.117:0/654117920 conn(0x7f04900f7430 msgr2=0x7f04900f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:14:03.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.313+0000 7f0496564700 1 -- 172.21.15.117:0/654117920 shutdown_connections 2024-04-12T09:14:03.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.313+0000 7f0496564700 1 -- 172.21.15.117:0/654117920 wait complete. 2024-04-12T09:14:03.324 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:14:03.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.418+0000 7f03f8d3a700 1 -- 172.21.15.117:0/3340250956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03f40fed50 msgr2=0x7f03f40fae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:03.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.418+0000 7f03f8d3a700 1 --2- 172.21.15.117:0/3340250956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03f40fed50 0x7f03f40fae90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f03e8004940 tx=0x7f03e8009e30 comp rx=0 tx=0).stop 2024-04-12T09:14:03.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.418+0000 7f03f8d3a700 1 -- 172.21.15.117:0/3340250956 shutdown_connections 2024-04-12T09:14:03.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.418+0000 7f03f8d3a700 1 --2- 172.21.15.117:0/3340250956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03f40fed50 0x7f03f40fae90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:03.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.418+0000 7f03f8d3a700 1 --2- 172.21.15.117:0/3340250956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f03f40fe400 0x7f03f40fe810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:03.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.418+0000 7f03f8d3a700 1 -- 172.21.15.117:0/3340250956 >> 172.21.15.117:0/3340250956 conn(0x7f03f40f6ba0 msgr2=0x7f03f40f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:14:03.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.418+0000 7f03f8d3a700 1 -- 172.21.15.117:0/3340250956 shutdown_connections 2024-04-12T09:14:03.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.418+0000 7f03f8d3a700 1 -- 172.21.15.117:0/3340250956 wait complete. 2024-04-12T09:14:03.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.419+0000 7f03f8d3a700 1 Processor -- start 2024-04-12T09:14:03.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.419+0000 7f03f8d3a700 1 -- start start 2024-04-12T09:14:03.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.419+0000 7f03f8d3a700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f03f40fe400 0x7f03f40fdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:03.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.419+0000 7f03f8d3a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03f40fed50 0x7f03f40fc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:03.421 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.419+0000 7f03f8d3a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f4111650 con 0x7f03f40fed50 2024-04-12T09:14:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.419+0000 7f03f8d3a700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f41117c0 con 0x7f03f40fe400 2024-04-12T09:14:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.419+0000 7f03f1d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03f40fed50 0x7f03f40fc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.420+0000 7f03f1d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03f40fed50 0x7f03f40fc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:41284/0 (socket says 172.21.15.117:41284) 2024-04-12T09:14:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.420+0000 7f03f1d9b700 1 -- 172.21.15.117:0/2203195247 learned_addr learned my addr 172.21.15.117:0/2203195247 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:14:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.420+0000 7f03f259c700 1 --2- 172.21.15.117:0/2203195247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f03f40fe400 0x7f03f40fdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.420+0000 7f03f1d9b700 1 -- 172.21.15.117:0/2203195247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f03f40fe400 msgr2=0x7f03f40fdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.420+0000 7f03f1d9b700 1 --2- 172.21.15.117:0/2203195247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f03f40fe400 0x7f03f40fdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.420+0000 7f03f1d9b700 1 -- 172.21.15.117:0/2203195247 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e8005040 con 0x7f03f40fed50 2024-04-12T09:14:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.420+0000 7f03f1d9b700 1 --2- 172.21.15.117:0/2203195247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03f40fed50 0x7f03f40fc0c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f03e800b3b0 tx=0x7f03e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:14:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.420+0000 7f03e2ffd700 1 -- 172.21.15.117:0/2203195247 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03e800e040 con 0x7f03f40fed50 2024-04-12T09:14:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.420+0000 7f03f8d3a700 1 -- 172.21.15.117:0/2203195247 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f40fc6c0 con 0x7f03f40fed50 2024-04-12T09:14:03.422 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.420+0000 7f03e2ffd700 1 -- 172.21.15.117:0/2203195247 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f03e800bbf0 con 0x7f03f40fed50 2024-04-12T09:14:03.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.421+0000 7f03e2ffd700 1 -- 172.21.15.117:0/2203195247 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03e801c630 con 0x7f03f40fed50 2024-04-12T09:14:03.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.421+0000 7f03f8d3a700 1 -- 172.21.15.117:0/2203195247 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f40fcc30 con 0x7f03f40fed50 2024-04-12T09:14:03.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.422+0000 7f03e2ffd700 1 -- 172.21.15.117:0/2203195247 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 32) v1 ==== 91677+0+0 (secure 0 0 0) 0x7f03e8013420 con 0x7f03f40fed50 2024-04-12T09:14:03.423 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.422+0000 7f03f8d3a700 1 -- 172.21.15.117:0/2203195247 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f405f5f0 con 0x7f03f40fed50 2024-04-12T09:14:03.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.422+0000 7f03e2ffd700 1 --2- 172.21.15.117:0/2203195247 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f03dc06d4c0 0x7f03dc06f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:03.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.422+0000 7f03e2ffd700 1 -- 172.21.15.117:0/2203195247 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f03e808d780 con 0x7f03f40fed50 2024-04-12T09:14:03.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.422+0000 7f03f259c700 1 --2- 172.21.15.117:0/2203195247 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f03dc06d4c0 0x7f03dc06f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:03.424 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.423+0000 7f03f259c700 1 --2- 172.21.15.117:0/2203195247 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f03dc06d4c0 0x7f03dc06f970 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f03f40fd980 tx=0x7f03e400b040 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:14:03.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.427+0000 7f03e2ffd700 1 -- 172.21.15.117:0/2203195247 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f03e8057380 con 0x7f03f40fed50 2024-04-12T09:14:03.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:03 smithi117 ceph-mon[29277]: pgmap v40: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:03.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:03 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:03.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:03 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:03.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:03 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:14:03.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.688+0000 7f03f8d3a700 1 -- 172.21.15.117:0/2203195247 --> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f03f4105940 con 0x7f03dc06d4c0 2024-04-12T09:14:03.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.690+0000 7f03e2ffd700 1 -- 172.21.15.117:0/2203195247 <== mgr.14694 v2:172.21.15.117:6800/1056729457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f03f4105940 con 0x7f03dc06d4c0 2024-04-12T09:14:03.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.692+0000 7f03f8d3a700 1 -- 172.21.15.117:0/2203195247 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f03dc06d4c0 msgr2=0x7f03dc06f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:03.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.692+0000 7f03f8d3a700 1 --2- 172.21.15.117:0/2203195247 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f03dc06d4c0 0x7f03dc06f970 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f03f40fd980 tx=0x7f03e400b040 comp rx=0 tx=0).stop 2024-04-12T09:14:03.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.692+0000 7f03f8d3a700 1 -- 172.21.15.117:0/2203195247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03f40fed50 msgr2=0x7f03f40fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:03.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.692+0000 7f03f8d3a700 1 --2- 172.21.15.117:0/2203195247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03f40fed50 0x7f03f40fc0c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f03e800b3b0 tx=0x7f03e8009e30 comp rx=0 tx=0).stop 2024-04-12T09:14:03.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.693+0000 7f03f8d3a700 1 -- 172.21.15.117:0/2203195247 shutdown_connections 2024-04-12T09:14:03.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.693+0000 7f03f8d3a700 1 --2- 172.21.15.117:0/2203195247 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f03dc06d4c0 0x7f03dc06f970 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:03.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.693+0000 7f03f8d3a700 1 --2- 172.21.15.117:0/2203195247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f03f40fe400 0x7f03f40fdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:03.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.693+0000 7f03f8d3a700 1 --2- 172.21.15.117:0/2203195247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f03f40fed50 0x7f03f40fc0c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:03.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.693+0000 7f03f8d3a700 1 -- 172.21.15.117:0/2203195247 >> 172.21.15.117:0/2203195247 conn(0x7f03f40f6ba0 msgr2=0x7f03f40f8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:14:03.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.693+0000 7f03f8d3a700 1 -- 172.21.15.117:0/2203195247 shutdown_connections 2024-04-12T09:14:03.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.693+0000 7f03f8d3a700 1 -- 172.21.15.117:0/2203195247 wait complete. 2024-04-12T09:14:03.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.794+0000 7f72edabb700 1 -- 172.21.15.117:0/2510069029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e80fce80 msgr2=0x7f72e80fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:03.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.794+0000 7f72edabb700 1 --2- 172.21.15.117:0/2510069029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e80fce80 0x7f72e80fd290 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f72e0009ce0 tx=0x7f72e0004d10 comp rx=0 tx=0).stop 2024-04-12T09:14:03.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.794+0000 7f72edabb700 1 -- 172.21.15.117:0/2510069029 shutdown_connections 2024-04-12T09:14:03.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.794+0000 7f72edabb700 1 --2- 172.21.15.117:0/2510069029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72e80fdff0 0x7f72e80fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:03.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.794+0000 7f72edabb700 1 --2- 172.21.15.117:0/2510069029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e80fce80 0x7f72e80fd290 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:03.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.794+0000 7f72edabb700 1 -- 172.21.15.117:0/2510069029 >> 172.21.15.117:0/2510069029 conn(0x7f72e80f8560 msgr2=0x7f72e80fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:14:03.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.794+0000 7f72edabb700 1 -- 172.21.15.117:0/2510069029 shutdown_connections 2024-04-12T09:14:03.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.794+0000 7f72edabb700 1 -- 172.21.15.117:0/2510069029 wait complete. 2024-04-12T09:14:03.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.794+0000 7f72edabb700 1 Processor -- start 2024-04-12T09:14:03.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.794+0000 7f72edabb700 1 -- start start 2024-04-12T09:14:03.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.795+0000 7f72edabb700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72e80fce80 0x7f72e810dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:03.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.795+0000 7f72edabb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e80fdff0 0x7f72e810e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:03.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.795+0000 7f72edabb700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e810e760 con 0x7f72e80fdff0 2024-04-12T09:14:03.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.795+0000 7f72edabb700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e810efb0 con 0x7f72e80fce80 2024-04-12T09:14:03.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.795+0000 7f72e6ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e80fdff0 0x7f72e810e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:03.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.795+0000 7f72e6ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e80fdff0 0x7f72e810e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:41306/0 (socket says 172.21.15.117:41306) 2024-04-12T09:14:03.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.795+0000 7f72e6ffd700 1 -- 172.21.15.117:0/2314258649 learned_addr learned my addr 172.21.15.117:0/2314258649 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:14:03.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.795+0000 7f72e77fe700 1 --2- 172.21.15.117:0/2314258649 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72e80fce80 0x7f72e810dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:03.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.795+0000 7f72e6ffd700 1 -- 172.21.15.117:0/2314258649 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72e80fce80 msgr2=0x7f72e810dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:03.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.795+0000 7f72e6ffd700 1 --2- 172.21.15.117:0/2314258649 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72e80fce80 0x7f72e810dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:03.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.795+0000 7f72e6ffd700 1 -- 172.21.15.117:0/2314258649 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e0009940 con 0x7f72e80fdff0 2024-04-12T09:14:03.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.795+0000 7f72e6ffd700 1 --2- 172.21.15.117:0/2314258649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e80fdff0 0x7f72e810e160 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f72d0002a50 tx=0x7f72d00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:14:03.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.795+0000 7f72dffff700 1 -- 172.21.15.117:0/2314258649 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72d0007cc0 con 0x7f72e80fdff0 2024-04-12T09:14:03.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.795+0000 7f72edabb700 1 -- 172.21.15.117:0/2314258649 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e810f290 con 0x7f72e80fdff0 2024-04-12T09:14:03.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.795+0000 7f72dffff700 1 -- 172.21.15.117:0/2314258649 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f72d000f040 con 0x7f72e80fdff0 2024-04-12T09:14:03.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.795+0000 7f72dffff700 1 -- 172.21.15.117:0/2314258649 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72d000da30 con 0x7f72e80fdff0 2024-04-12T09:14:03.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.795+0000 7f72edabb700 1 -- 172.21.15.117:0/2314258649 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e810f7d0 con 0x7f72e80fdff0 2024-04-12T09:14:03.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.796+0000 7f72edabb700 1 -- 172.21.15.117:0/2314258649 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e805f5f0 con 0x7f72e80fdff0 2024-04-12T09:14:03.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.797+0000 7f72dffff700 1 -- 172.21.15.117:0/2314258649 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 32) v1 ==== 91677+0+0 (secure 0 0 0) 0x7f72d000db90 con 0x7f72e80fdff0 2024-04-12T09:14:03.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.797+0000 7f72dffff700 1 --2- 172.21.15.117:0/2314258649 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f72d406d6c0 0x7f72d406fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:03.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.797+0000 7f72dffff700 1 -- 172.21.15.117:0/2314258649 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f72d008cbc0 con 0x7f72e80fdff0 2024-04-12T09:14:03.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.797+0000 7f72e77fe700 1 --2- 172.21.15.117:0/2314258649 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f72d406d6c0 0x7f72d406fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:03.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.798+0000 7f72e77fe700 1 --2- 172.21.15.117:0/2314258649 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f72d406d6c0 0x7f72d406fb70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f72e0015040 tx=0x7f72e0004d10 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:14:03.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:03.802+0000 7f72dffff700 1 -- 172.21.15.117:0/2314258649 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f72d005a300 con 0x7f72e80fdff0 2024-04-12T09:14:03.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:03 smithi203 ceph-mon[36428]: pgmap v40: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:03.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:03 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:03.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:03 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:03.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:03 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:14:04.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.012+0000 7f72edabb700 1 -- 172.21.15.117:0/2314258649 --> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f72e810fb70 con 0x7f72d406d6c0 2024-04-12T09:14:04.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.024+0000 7f72dffff700 1 -- 172.21.15.117:0/2314258649 <== mgr.14694 v2:172.21.15.117:6800/1056729457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f72e810fb70 con 0x7f72d406d6c0 2024-04-12T09:14:04.025 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:14:04.025 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 running (2m) 14s ago 11m 27.7M - 0.25.0 c8568f914cd2 34d1f5b82e31 2024-04-12T09:14:04.025 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (11m) 14s ago 11m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad 1e9f2c6a4491 2024-04-12T09:14:04.025 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (10m) 15s ago 10m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad e42da3f6e517 2024-04-12T09:14:04.025 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 unknown 14s ago 10m - - 2024-04-12T09:14:04.025 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (5m) 14s ago 5m 141M - 17.2.7-827-gd3b5060a 21de9b7369ad de062e2c10e7 2024-04-12T09:14:04.025 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 running (5m) 14s ago 5m 12.8M - 17.2.7-827-gd3b5060a 21de9b7369ad 1e82c6241a18 2024-04-12T09:14:04.025 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (5m) 15s ago 5m 15.5M - 17.2.7-827-gd3b5060a 21de9b7369ad b05228e997f7 2024-04-12T09:14:04.025 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (5m) 15s ago 5m 16.1M - 17.2.7-827-gd3b5060a 21de9b7369ad 6d7f82c072c7 2024-04-12T09:14:04.025 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:8443,9283,8765 running (89s) 14s ago 12m 501M - 19.0.0-2053-gb277feb2 668895944f0e fee613d05ab7 2024-04-12T09:14:04.025 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283,8765 running (38s) 15s ago 10m 448M - 19.0.0-2053-gb277feb2 668895944f0e c793944c3e16 2024-04-12T09:14:04.025 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (12m) 14s ago 12m 52.9M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad f9d5f7ac5270 2024-04-12T09:14:04.026 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (10m) 15s ago 10m 42.4M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad 17c0db49bb16 2024-04-12T09:14:04.026 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 running (23s) 14s ago 11m 5435k - 1.5.0 0da6a335fe13 c692bed9f6c7 2024-04-12T09:14:04.026 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (19s) 15s ago 10m 3351k - 1.5.0 0da6a335fe13 f3b5a470f545 2024-04-12T09:14:04.026 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (9m) 14s ago 9m 224M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 77040a2498f3 2024-04-12T09:14:04.026 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (8m) 14s ago 8m 234M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 8f9dbf0274ed 2024-04-12T09:14:04.026 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (8m) 14s ago 8m 199M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 339c5a80d1dd 2024-04-12T09:14:04.026 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (8m) 15s ago 8m 272M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad fb87d616bae3 2024-04-12T09:14:04.026 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (7m) 15s ago 7m 245M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad c873826a2dea 2024-04-12T09:14:04.026 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (7m) 15s ago 7m 219M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad 69cb7c22f002 2024-04-12T09:14:04.026 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 starting - - - - 2024-04-12T09:14:04.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.026+0000 7f72edabb700 1 -- 172.21.15.117:0/2314258649 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f72d406d6c0 msgr2=0x7f72d406fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:04.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.026+0000 7f72edabb700 1 --2- 172.21.15.117:0/2314258649 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f72d406d6c0 0x7f72d406fb70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f72e0015040 tx=0x7f72e0004d10 comp rx=0 tx=0).stop 2024-04-12T09:14:04.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.026+0000 7f72edabb700 1 -- 172.21.15.117:0/2314258649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e80fdff0 msgr2=0x7f72e810e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:04.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.026+0000 7f72edabb700 1 --2- 172.21.15.117:0/2314258649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e80fdff0 0x7f72e810e160 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f72d0002a50 tx=0x7f72d00046b0 comp rx=0 tx=0).stop 2024-04-12T09:14:04.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.026+0000 7f72edabb700 1 -- 172.21.15.117:0/2314258649 shutdown_connections 2024-04-12T09:14:04.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.026+0000 7f72edabb700 1 --2- 172.21.15.117:0/2314258649 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f72d406d6c0 0x7f72d406fb70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:04.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.026+0000 7f72edabb700 1 --2- 172.21.15.117:0/2314258649 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72e80fce80 0x7f72e810dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:04.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.026+0000 7f72edabb700 1 --2- 172.21.15.117:0/2314258649 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72e80fdff0 0x7f72e810e160 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:04.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.026+0000 7f72edabb700 1 -- 172.21.15.117:0/2314258649 >> 172.21.15.117:0/2314258649 conn(0x7f72e80f8560 msgr2=0x7f72e80f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:14:04.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.026+0000 7f72edabb700 1 -- 172.21.15.117:0/2314258649 shutdown_connections 2024-04-12T09:14:04.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.026+0000 7f72edabb700 1 -- 172.21.15.117:0/2314258649 wait complete. 2024-04-12T09:14:04.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.127+0000 7f247ff3f700 1 -- 172.21.15.117:0/2773100461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2478066f70 msgr2=0x7f24780ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:04.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.127+0000 7f247ff3f700 1 --2- 172.21.15.117:0/2773100461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2478066f70 0x7f24780ff9c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2474004940 tx=0x7f2474009e30 comp rx=0 tx=0).stop 2024-04-12T09:14:04.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.127+0000 7f247ff3f700 1 -- 172.21.15.117:0/2773100461 shutdown_connections 2024-04-12T09:14:04.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.127+0000 7f247ff3f700 1 --2- 172.21.15.117:0/2773100461 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24780fff00 0x7f2478102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:04.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.127+0000 7f247ff3f700 1 --2- 172.21.15.117:0/2773100461 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2478066f70 0x7f24780ff9c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:04.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.127+0000 7f247ff3f700 1 -- 172.21.15.117:0/2773100461 >> 172.21.15.117:0/2773100461 conn(0x7f24780f7430 msgr2=0x7f24780f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:14:04.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.128+0000 7f247ff3f700 1 -- 172.21.15.117:0/2773100461 shutdown_connections 2024-04-12T09:14:04.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.128+0000 7f247ff3f700 1 -- 172.21.15.117:0/2773100461 wait complete. 2024-04-12T09:14:04.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.128+0000 7f247ff3f700 1 Processor -- start 2024-04-12T09:14:04.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.128+0000 7f247ff3f700 1 -- start start 2024-04-12T09:14:04.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.128+0000 7f247ff3f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2478066f70 0x7f247810d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:04.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.128+0000 7f247ff3f700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24780fff00 0x7f247810dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:04.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.128+0000 7f247ff3f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247810e4a0 con 0x7f2478066f70 2024-04-12T09:14:04.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.128+0000 7f247ff3f700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247810e610 con 0x7f24780fff00 2024-04-12T09:14:04.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.128+0000 7f247dcdb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2478066f70 0x7f247810d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:04.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.128+0000 7f247dcdb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2478066f70 0x7f247810d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:41332/0 (socket says 172.21.15.117:41332) 2024-04-12T09:14:04.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.128+0000 7f247dcdb700 1 -- 172.21.15.117:0/2198728877 learned_addr learned my addr 172.21.15.117:0/2198728877 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:14:04.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.129+0000 7f247d4da700 1 --2- 172.21.15.117:0/2198728877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24780fff00 0x7f247810dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:04.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.129+0000 7f247dcdb700 1 -- 172.21.15.117:0/2198728877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24780fff00 msgr2=0x7f247810dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:04.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.129+0000 7f247dcdb700 1 --2- 172.21.15.117:0/2198728877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24780fff00 0x7f247810dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:04.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.129+0000 7f247dcdb700 1 -- 172.21.15.117:0/2198728877 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2474005040 con 0x7f2478066f70 2024-04-12T09:14:04.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.129+0000 7f247dcdb700 1 --2- 172.21.15.117:0/2198728877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2478066f70 0x7f247810d960 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f247400b3b0 tx=0x7f2474009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:14:04.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.129+0000 7f246e7fc700 1 -- 172.21.15.117:0/2198728877 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f247400e040 con 0x7f2478066f70 2024-04-12T09:14:04.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.129+0000 7f247ff3f700 1 -- 172.21.15.117:0/2198728877 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2478113010 con 0x7f2478066f70 2024-04-12T09:14:04.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.129+0000 7f246e7fc700 1 -- 172.21.15.117:0/2198728877 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f247400bbf0 con 0x7f2478066f70 2024-04-12T09:14:04.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.130+0000 7f246e7fc700 1 -- 172.21.15.117:0/2198728877 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f247401c630 con 0x7f2478066f70 2024-04-12T09:14:04.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.130+0000 7f247ff3f700 1 -- 172.21.15.117:0/2198728877 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24781135d0 con 0x7f2478066f70 2024-04-12T09:14:04.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.131+0000 7f247ff3f700 1 -- 172.21.15.117:0/2198728877 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f247804c710 con 0x7f2478066f70 2024-04-12T09:14:04.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.131+0000 7f246e7fc700 1 -- 172.21.15.117:0/2198728877 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 32) v1 ==== 91677+0+0 (secure 0 0 0) 0x7f247400bd60 con 0x7f2478066f70 2024-04-12T09:14:04.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.131+0000 7f246e7fc700 1 --2- 172.21.15.117:0/2198728877 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f246406d6d0 0x7f246406fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:04.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.132+0000 7f246e7fc700 1 -- 172.21.15.117:0/2198728877 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f247408d9c0 con 0x7f2478066f70 2024-04-12T09:14:04.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.132+0000 7f247d4da700 1 --2- 172.21.15.117:0/2198728877 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f246406d6d0 0x7f246406fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:04.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.132+0000 7f247d4da700 1 --2- 172.21.15.117:0/2198728877 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f246406d6d0 0x7f246406fb80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2468004f40 tx=0x7f246800b040 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:14:04.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.139+0000 7f246e7fc700 1 -- 172.21.15.117:0/2198728877 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f247405b180 con 0x7f2478066f70 2024-04-12T09:14:04.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.425+0000 7f247ff3f700 1 -- 172.21.15.117:0/2198728877 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2478113960 con 0x7f2478066f70 2024-04-12T09:14:04.427 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.426+0000 7f246e7fc700 1 -- 172.21.15.117:0/2198728877 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f247405ad10 con 0x7f2478066f70 2024-04-12T09:14:04.427 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:14:04.427 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": { 2024-04-12T09:14:04.427 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 2 2024-04-12T09:14:04.427 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:14:04.427 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": { 2024-04-12T09:14:04.427 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:14:04.427 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:14:04.428 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": { 2024-04-12T09:14:04.428 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 6 2024-04-12T09:14:04.428 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:14:04.428 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-04-12T09:14:04.428 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 4 2024-04-12T09:14:04.428 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:14:04.428 INFO:teuthology.orchestra.run.smithi117.stdout: "overall": { 2024-04-12T09:14:04.428 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 12, 2024-04-12T09:14:04.428 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:14:04.428 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:14:04.428 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:14:04.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.428+0000 7f247ff3f700 1 -- 172.21.15.117:0/2198728877 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f246406d6d0 msgr2=0x7f246406fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:04.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.428+0000 7f247ff3f700 1 --2- 172.21.15.117:0/2198728877 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f246406d6d0 0x7f246406fb80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2468004f40 tx=0x7f246800b040 comp rx=0 tx=0).stop 2024-04-12T09:14:04.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.428+0000 7f247ff3f700 1 -- 172.21.15.117:0/2198728877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2478066f70 msgr2=0x7f247810d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:04.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.428+0000 7f247ff3f700 1 --2- 172.21.15.117:0/2198728877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2478066f70 0x7f247810d960 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f247400b3b0 tx=0x7f2474009e30 comp rx=0 tx=0).stop 2024-04-12T09:14:04.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.428+0000 7f247ff3f700 1 -- 172.21.15.117:0/2198728877 shutdown_connections 2024-04-12T09:14:04.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.428+0000 7f247ff3f700 1 --2- 172.21.15.117:0/2198728877 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f246406d6d0 0x7f246406fb80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:04.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.428+0000 7f247ff3f700 1 --2- 172.21.15.117:0/2198728877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2478066f70 0x7f247810d960 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:04.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.428+0000 7f247ff3f700 1 --2- 172.21.15.117:0/2198728877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24780fff00 0x7f247810dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:04.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.428+0000 7f247ff3f700 1 -- 172.21.15.117:0/2198728877 >> 172.21.15.117:0/2198728877 conn(0x7f24780f7430 msgr2=0x7f24780f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:14:04.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.428+0000 7f247ff3f700 1 -- 172.21.15.117:0/2198728877 shutdown_connections 2024-04-12T09:14:04.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.429+0000 7f247ff3f700 1 -- 172.21.15.117:0/2198728877 wait complete. 2024-04-12T09:14:04.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.544+0000 7feb490f0700 1 -- 172.21.15.117:0/196231459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb440fdfe0 msgr2=0x7feb440fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:04.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.544+0000 7feb490f0700 1 --2- 172.21.15.117:0/196231459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb440fdfe0 0x7feb440fe450 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7feb38004940 tx=0x7feb38009e30 comp rx=0 tx=0).stop 2024-04-12T09:14:04.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.544+0000 7feb490f0700 1 -- 172.21.15.117:0/196231459 shutdown_connections 2024-04-12T09:14:04.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.544+0000 7feb490f0700 1 --2- 172.21.15.117:0/196231459 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb440fdfe0 0x7feb440fe450 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:04.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.544+0000 7feb490f0700 1 --2- 172.21.15.117:0/196231459 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb440fce70 0x7feb440fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:04.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.544+0000 7feb490f0700 1 -- 172.21.15.117:0/196231459 >> 172.21.15.117:0/196231459 conn(0x7feb440f8550 msgr2=0x7feb440fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:14:04.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.544+0000 7feb490f0700 1 -- 172.21.15.117:0/196231459 shutdown_connections 2024-04-12T09:14:04.547 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.544+0000 7feb490f0700 1 -- 172.21.15.117:0/196231459 wait complete. 2024-04-12T09:14:04.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.545+0000 7feb490f0700 1 Processor -- start 2024-04-12T09:14:04.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.545+0000 7feb490f0700 1 -- start start 2024-04-12T09:14:04.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.545+0000 7feb490f0700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb440fce70 0x7feb4410d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:04.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.545+0000 7feb490f0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb440fdfe0 0x7feb4410de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:04.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.545+0000 7feb490f0700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4410e460 con 0x7feb440fdfe0 2024-04-12T09:14:04.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.545+0000 7feb490f0700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4410e5d0 con 0x7feb440fce70 2024-04-12T09:14:04.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.545+0000 7feb4259c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb440fdfe0 0x7feb4410de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:04.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.545+0000 7feb4259c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb440fdfe0 0x7feb4410de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:41350/0 (socket says 172.21.15.117:41350) 2024-04-12T09:14:04.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.545+0000 7feb4259c700 1 -- 172.21.15.117:0/2200032242 learned_addr learned my addr 172.21.15.117:0/2200032242 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:14:04.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.545+0000 7feb42d9d700 1 --2- 172.21.15.117:0/2200032242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb440fce70 0x7feb4410d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:04.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.546+0000 7feb4259c700 1 -- 172.21.15.117:0/2200032242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb440fce70 msgr2=0x7feb4410d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:04.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.546+0000 7feb4259c700 1 --2- 172.21.15.117:0/2200032242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb440fce70 0x7feb4410d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:04.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.546+0000 7feb4259c700 1 -- 172.21.15.117:0/2200032242 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb38005040 con 0x7feb440fdfe0 2024-04-12T09:14:04.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.546+0000 7feb4259c700 1 --2- 172.21.15.117:0/2200032242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb440fdfe0 0x7feb4410de60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7feb3800b3b0 tx=0x7feb38009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:14:04.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.546+0000 7feb2b7fe700 1 -- 172.21.15.117:0/2200032242 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb3800e040 con 0x7feb440fdfe0 2024-04-12T09:14:04.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.546+0000 7feb490f0700 1 -- 172.21.15.117:0/2200032242 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb44112fd0 con 0x7feb440fdfe0 2024-04-12T09:14:04.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.546+0000 7feb2b7fe700 1 -- 172.21.15.117:0/2200032242 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb3800bbf0 con 0x7feb440fdfe0 2024-04-12T09:14:04.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.546+0000 7feb2b7fe700 1 -- 172.21.15.117:0/2200032242 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb3801c630 con 0x7feb440fdfe0 2024-04-12T09:14:04.549 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.546+0000 7feb490f0700 1 -- 172.21.15.117:0/2200032242 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb44113560 con 0x7feb440fdfe0 2024-04-12T09:14:04.550 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.547+0000 7feb490f0700 1 -- 172.21.15.117:0/2200032242 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb4404c710 con 0x7feb440fdfe0 2024-04-12T09:14:04.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.547+0000 7feb2b7fe700 1 -- 172.21.15.117:0/2200032242 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 32) v1 ==== 91677+0+0 (secure 0 0 0) 0x7feb3800bd60 con 0x7feb440fdfe0 2024-04-12T09:14:04.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.548+0000 7feb2b7fe700 1 --2- 172.21.15.117:0/2200032242 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7feb2c06d6d0 0x7feb2c06fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:04.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.548+0000 7feb2b7fe700 1 -- 172.21.15.117:0/2200032242 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7feb3808d9f0 con 0x7feb440fdfe0 2024-04-12T09:14:04.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.548+0000 7feb42d9d700 1 --2- 172.21.15.117:0/2200032242 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7feb2c06d6d0 0x7feb2c06fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:04.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.548+0000 7feb42d9d700 1 --2- 172.21.15.117:0/2200032242 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7feb2c06d6d0 0x7feb2c06fb80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feb34004f40 tx=0x7feb3400b040 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:14:04.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.552+0000 7feb2b7fe700 1 -- 172.21.15.117:0/2200032242 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7feb3808fe60 con 0x7feb440fdfe0 2024-04-12T09:14:04.762 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:04 smithi117 ceph-mon[29277]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:14:04.762 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:04 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/2198728877' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:04.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.773+0000 7feb490f0700 1 -- 172.21.15.117:0/2200032242 --> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feb441023a0 con 0x7feb2c06d6d0 2024-04-12T09:14:04.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.774+0000 7feb2b7fe700 1 -- 172.21.15.117:0/2200032242 <== mgr.14694 v2:172.21.15.117:6800/1056729457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7feb441023a0 con 0x7feb2c06d6d0 2024-04-12T09:14:04.774 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:14:04.775 INFO:teuthology.orchestra.run.smithi117.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec", 2024-04-12T09:14:04.775 INFO:teuthology.orchestra.run.smithi117.stdout: "in_progress": true, 2024-04-12T09:14:04.775 INFO:teuthology.orchestra.run.smithi117.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-12T09:14:04.775 INFO:teuthology.orchestra.run.smithi117.stdout: "services_complete": [ 2024-04-12T09:14:04.775 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr" 2024-04-12T09:14:04.775 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2024-04-12T09:14:04.775 INFO:teuthology.orchestra.run.smithi117.stdout: "progress": "2/2 daemons upgraded", 2024-04-12T09:14:04.775 INFO:teuthology.orchestra.run.smithi117.stdout: "message": "Currently upgrading prometheus daemons", 2024-04-12T09:14:04.775 INFO:teuthology.orchestra.run.smithi117.stdout: "is_paused": false 2024-04-12T09:14:04.775 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:14:04.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.776+0000 7feb490f0700 1 -- 172.21.15.117:0/2200032242 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7feb2c06d6d0 msgr2=0x7feb2c06fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:04.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.776+0000 7feb490f0700 1 --2- 172.21.15.117:0/2200032242 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7feb2c06d6d0 0x7feb2c06fb80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feb34004f40 tx=0x7feb3400b040 comp rx=0 tx=0).stop 2024-04-12T09:14:04.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.776+0000 7feb490f0700 1 -- 172.21.15.117:0/2200032242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb440fdfe0 msgr2=0x7feb4410de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:04.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.776+0000 7feb490f0700 1 --2- 172.21.15.117:0/2200032242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb440fdfe0 0x7feb4410de60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7feb3800b3b0 tx=0x7feb38009e30 comp rx=0 tx=0).stop 2024-04-12T09:14:04.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.776+0000 7feb490f0700 1 -- 172.21.15.117:0/2200032242 shutdown_connections 2024-04-12T09:14:04.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.776+0000 7feb490f0700 1 --2- 172.21.15.117:0/2200032242 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7feb2c06d6d0 0x7feb2c06fb80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:04.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.776+0000 7feb490f0700 1 --2- 172.21.15.117:0/2200032242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb440fce70 0x7feb4410d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:04.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.776+0000 7feb490f0700 1 --2- 172.21.15.117:0/2200032242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb440fdfe0 0x7feb4410de60 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:04.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.776+0000 7feb490f0700 1 -- 172.21.15.117:0/2200032242 >> 172.21.15.117:0/2200032242 conn(0x7feb440f8550 msgr2=0x7feb440f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:14:04.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.776+0000 7feb490f0700 1 -- 172.21.15.117:0/2200032242 shutdown_connections 2024-04-12T09:14:04.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:04.776+0000 7feb490f0700 1 -- 172.21.15.117:0/2200032242 wait complete. 2024-04-12T09:14:04.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:04 smithi203 ceph-mon[36428]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:14:04.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:04 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/2198728877' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:05.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:05 smithi203 ceph-mon[36428]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:14:05.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:05 smithi203 ceph-mon[36428]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:14:05.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:05 smithi203 ceph-mon[36428]: pgmap v41: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:05.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:05 smithi117 ceph-mon[29277]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:14:05.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:05 smithi117 ceph-mon[29277]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:14:05.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:05 smithi117 ceph-mon[29277]: pgmap v41: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:06.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:06 smithi203 ceph-mon[36428]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:14:06.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:06 smithi117 ceph-mon[29277]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:14:07.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:07 smithi203 ceph-mon[36428]: pgmap v42: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:07.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:07 smithi117 ceph-mon[29277]: pgmap v42: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:09.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:09 smithi117 ceph-mon[29277]: pgmap v43: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:09.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:09 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:09.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:09 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:09.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:09 smithi203 ceph-mon[36428]: pgmap v43: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:09.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:09 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:09.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:09 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:11.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:10 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:11.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:10 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:11.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:10 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:14:11.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:10 smithi203 ceph-mon[36428]: pgmap v44: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:11.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:10 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:11.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:10 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:11.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:10 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:14:11.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:10 smithi117 ceph-mon[29277]: pgmap v44: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:13.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:13 smithi203 ceph-mon[36428]: pgmap v45: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:13.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:13 smithi117 ceph-mon[29277]: pgmap v45: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:14.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:14 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:14.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:14 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:14.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:14 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:14:14.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:14 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:14:14.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:14 smithi203 ceph-mon[36428]: pgmap v46: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:14.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:14 smithi203 ceph-mon[36428]: pgmap v47: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:14.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:14 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:14.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:14 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T09:14:14.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:14 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:14:14.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:14 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:14.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:14 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:14.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:14 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:14.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:14 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:14.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:14 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:14.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:14 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:14.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:14 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:14.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:14 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:14.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:14 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:14.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:14 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:14.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:14 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:14.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:14 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:14.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:14 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:14:14.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:14 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:14:14.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:14 smithi117 ceph-mon[29277]: pgmap v46: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:14.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:14 smithi117 ceph-mon[29277]: pgmap v47: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:14.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:14 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:14.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:14 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T09:14:14.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:14 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:14:14.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:14 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:14.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:14 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:14.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:14 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:14.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:14 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:14.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:14 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:14.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:14 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:14.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:14 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:14.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:14 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:14.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:14 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:14.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:14 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:15.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:15 smithi203 ceph-mon[36428]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T09:14:15.829 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:15 smithi117 ceph-mon[29277]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-12T09:14:16.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:16 smithi203 ceph-mon[36428]: Upgrade: Updating alertmanager.smithi117 2024-04-12T09:14:16.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:16 smithi203 ceph-mon[36428]: Deploying daemon alertmanager.smithi117 on smithi117 2024-04-12T09:14:16.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:16 smithi203 ceph-mon[36428]: pgmap v48: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:16.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:16 smithi117 ceph-mon[29277]: Upgrade: Updating alertmanager.smithi117 2024-04-12T09:14:16.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:16 smithi117 ceph-mon[29277]: Deploying daemon alertmanager.smithi117 on smithi117 2024-04-12T09:14:16.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:16 smithi117 ceph-mon[29277]: pgmap v48: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:18.659 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:18 smithi117 ceph-mon[29277]: pgmap v49: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:18.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:18 smithi203 ceph-mon[36428]: pgmap v49: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:20.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:20 smithi203 ceph-mon[36428]: pgmap v50: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:20.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:20 smithi117 ceph-mon[29277]: pgmap v50: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:22.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:22 smithi203 ceph-mon[36428]: pgmap v51: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:22.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:22 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:22.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:22 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:22.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:22 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:14:22.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:22 smithi117 ceph-mon[29277]: pgmap v51: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:22.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:22 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:22.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:22 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:22.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:22 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:14:24.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:24 smithi203 ceph-mon[36428]: pgmap v52: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:24.903 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:24 smithi117 ceph-mon[29277]: pgmap v52: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:25.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:25 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:14:25.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:25 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:14:26.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:26 smithi203 ceph-mon[36428]: pgmap v53: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:26.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:26 smithi203 ceph-mon[36428]: mgrmap e33: smithi117.oyaxql(active, since 90s), standbys: smithi203.apfqpo 2024-04-12T09:14:26.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:26 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:26.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:26 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:26.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:26 smithi117 ceph-mon[29277]: pgmap v53: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:26.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:26 smithi117 ceph-mon[29277]: mgrmap e33: smithi117.oyaxql(active, since 90s), standbys: smithi203.apfqpo 2024-04-12T09:14:26.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:26 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:26.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:26 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:28.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:28 smithi117 ceph-mon[29277]: pgmap v54: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-12T09:14:28.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:28 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:28.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:28 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:29.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:28 smithi203 ceph-mon[36428]: pgmap v54: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-12T09:14:29.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:28 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:29.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:28 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:30.816 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:30 smithi117 ceph-mon[29277]: pgmap v55: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-12T09:14:31.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:30 smithi203 ceph-mon[36428]: pgmap v55: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-12T09:14:32.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:32 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:32.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:32 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:32.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:32 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:14:32.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:32 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:14:32.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:32 smithi203 ceph-mon[36428]: pgmap v56: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 263 B/s wr, 0 op/s 2024-04-12T09:14:32.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:32 smithi203 ceph-mon[36428]: pgmap v57: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 317 B/s wr, 0 op/s 2024-04-12T09:14:32.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:32 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:32.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:32 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-12T09:14:32.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:32 smithi203 ceph-mon[36428]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-12T09:14:32.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:32 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:14:32.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:32 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:32.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:32 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:32.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:32 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:32.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:32 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:32.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:32 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:32.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:32 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:32.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:32 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:32.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:32 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:32.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:32 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:32.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:32 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:32.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:32 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:32.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:32 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:32.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:32 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:32.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:32 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:14:32.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:32 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:14:32.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:32 smithi117 ceph-mon[29277]: pgmap v56: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 263 B/s wr, 0 op/s 2024-04-12T09:14:32.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:32 smithi117 ceph-mon[29277]: pgmap v57: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 317 B/s wr, 0 op/s 2024-04-12T09:14:32.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:32 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:32.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:32 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-12T09:14:32.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:32 smithi117 ceph-mon[29277]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-12T09:14:32.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:32 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:14:32.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:32 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:32.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:32 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:32.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:32 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:32.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:32 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:32.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:32 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:32.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:32 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:32.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:32 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:32.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:32 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:32.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:32 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:32.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:32 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:32.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:32 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:34.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:34 smithi203 ceph-mon[36428]: Upgrade: Updating grafana.smithi117 2024-04-12T09:14:34.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:34 smithi203 ceph-mon[36428]: Deploying daemon grafana.smithi117 on smithi117 2024-04-12T09:14:34.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:34 smithi203 ceph-mon[36428]: pgmap v58: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 317 B/s wr, 0 op/s 2024-04-12T09:14:34.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:34 smithi117 ceph-mon[29277]: Upgrade: Updating grafana.smithi117 2024-04-12T09:14:34.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:34 smithi117 ceph-mon[29277]: Deploying daemon grafana.smithi117 on smithi117 2024-04-12T09:14:34.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:34 smithi117 ceph-mon[29277]: pgmap v58: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 317 B/s wr, 0 op/s 2024-04-12T09:14:34.887 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.883+0000 7f3896f89700 1 -- 172.21.15.117:0/2201494702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38900fdfe0 msgr2=0x7f38900fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:34.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.883+0000 7f3896f89700 1 --2- 172.21.15.117:0/2201494702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38900fdfe0 0x7f38900fe450 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f387c004940 tx=0x7f387c009e30 comp rx=0 tx=0).stop 2024-04-12T09:14:34.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.883+0000 7f3896f89700 1 -- 172.21.15.117:0/2201494702 shutdown_connections 2024-04-12T09:14:34.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.883+0000 7f3896f89700 1 --2- 172.21.15.117:0/2201494702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38900fdfe0 0x7f38900fe450 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:34.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.883+0000 7f3896f89700 1 --2- 172.21.15.117:0/2201494702 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38900fce70 0x7f38900fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:34.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.884+0000 7f3896f89700 1 -- 172.21.15.117:0/2201494702 >> 172.21.15.117:0/2201494702 conn(0x7f38900f8550 msgr2=0x7f38900fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:14:34.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.884+0000 7f3896f89700 1 -- 172.21.15.117:0/2201494702 shutdown_connections 2024-04-12T09:14:34.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.884+0000 7f3896f89700 1 -- 172.21.15.117:0/2201494702 wait complete. 2024-04-12T09:14:34.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.884+0000 7f3896f89700 1 Processor -- start 2024-04-12T09:14:34.888 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.884+0000 7f3896f89700 1 -- start start 2024-04-12T09:14:34.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.884+0000 7f3896f89700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38900fce70 0x7f389010d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:34.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.884+0000 7f3896f89700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38900fdfe0 0x7f389010de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:34.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.884+0000 7f3896f89700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389010e4e0 con 0x7f38900fce70 2024-04-12T09:14:34.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.884+0000 7f3896f89700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3890112e80 con 0x7f38900fdfe0 2024-04-12T09:14:34.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.884+0000 7f3894d25700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38900fce70 0x7f389010d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:34.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.885+0000 7f3894d25700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38900fce70 0x7f389010d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51142/0 (socket says 172.21.15.117:51142) 2024-04-12T09:14:34.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.885+0000 7f3894d25700 1 -- 172.21.15.117:0/3213778551 learned_addr learned my addr 172.21.15.117:0/3213778551 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:14:34.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.885+0000 7f388ffff700 1 --2- 172.21.15.117:0/3213778551 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38900fdfe0 0x7f389010de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:34.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.885+0000 7f3894d25700 1 -- 172.21.15.117:0/3213778551 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38900fdfe0 msgr2=0x7f389010de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:34.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.885+0000 7f3894d25700 1 --2- 172.21.15.117:0/3213778551 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38900fdfe0 0x7f389010de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:34.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.885+0000 7f3894d25700 1 -- 172.21.15.117:0/3213778551 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387c005040 con 0x7f38900fce70 2024-04-12T09:14:34.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.885+0000 7f3894d25700 1 --2- 172.21.15.117:0/3213778551 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38900fce70 0x7f389010d910 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f388400b790 tx=0x7f3884009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:14:34.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.885+0000 7f388d7fa700 1 -- 172.21.15.117:0/3213778551 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f388400f770 con 0x7f38900fce70 2024-04-12T09:14:34.889 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.885+0000 7f3896f89700 1 -- 172.21.15.117:0/3213778551 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38901130e0 con 0x7f38900fce70 2024-04-12T09:14:34.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.885+0000 7f388d7fa700 1 -- 172.21.15.117:0/3213778551 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f388400fda0 con 0x7f38900fce70 2024-04-12T09:14:34.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.885+0000 7f388d7fa700 1 -- 172.21.15.117:0/3213778551 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f388400d310 con 0x7f38900fce70 2024-04-12T09:14:34.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.885+0000 7f3896f89700 1 -- 172.21.15.117:0/3213778551 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3890113650 con 0x7f38900fce70 2024-04-12T09:14:34.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.886+0000 7f3896f89700 1 -- 172.21.15.117:0/3213778551 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f389004c710 con 0x7f38900fce70 2024-04-12T09:14:34.890 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.887+0000 7f388d7fa700 1 -- 172.21.15.117:0/3213778551 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 33) v1 ==== 91575+0+0 (secure 0 0 0) 0x7f3884010420 con 0x7f38900fce70 2024-04-12T09:14:34.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.887+0000 7f388d7fa700 1 --2- 172.21.15.117:0/3213778551 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f388006d5a0 0x7f388006fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:34.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.887+0000 7f388ffff700 1 --2- 172.21.15.117:0/3213778551 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f388006d5a0 0x7f388006fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:34.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.887+0000 7f388d7fa700 1 -- 172.21.15.117:0/3213778551 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f388408cc10 con 0x7f38900fce70 2024-04-12T09:14:34.891 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.888+0000 7f388ffff700 1 --2- 172.21.15.117:0/3213778551 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f388006d5a0 0x7f388006fa50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f387c00b3b0 tx=0x7f387c009e30 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:14:34.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:34.892+0000 7f388d7fa700 1 -- 172.21.15.117:0/3213778551 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f388405a5f0 con 0x7f38900fce70 2024-04-12T09:14:35.108 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.106+0000 7f3896f89700 1 -- 172.21.15.117:0/3213778551 --> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3890102280 con 0x7f388006d5a0 2024-04-12T09:14:35.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.107+0000 7f388d7fa700 1 -- 172.21.15.117:0/3213778551 <== mgr.14694 v2:172.21.15.117:6800/1056729457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f3890102280 con 0x7f388006d5a0 2024-04-12T09:14:35.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.109+0000 7f3896f89700 1 -- 172.21.15.117:0/3213778551 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f388006d5a0 msgr2=0x7f388006fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:35.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.109+0000 7f3896f89700 1 --2- 172.21.15.117:0/3213778551 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f388006d5a0 0x7f388006fa50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f387c00b3b0 tx=0x7f387c009e30 comp rx=0 tx=0).stop 2024-04-12T09:14:35.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.109+0000 7f3896f89700 1 -- 172.21.15.117:0/3213778551 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38900fce70 msgr2=0x7f389010d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:35.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.109+0000 7f3896f89700 1 --2- 172.21.15.117:0/3213778551 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38900fce70 0x7f389010d910 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f388400b790 tx=0x7f3884009250 comp rx=0 tx=0).stop 2024-04-12T09:14:35.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.109+0000 7f3896f89700 1 -- 172.21.15.117:0/3213778551 shutdown_connections 2024-04-12T09:14:35.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.109+0000 7f3896f89700 1 --2- 172.21.15.117:0/3213778551 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f388006d5a0 0x7f388006fa50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:35.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.109+0000 7f3896f89700 1 --2- 172.21.15.117:0/3213778551 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38900fce70 0x7f389010d910 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:35.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.109+0000 7f3896f89700 1 --2- 172.21.15.117:0/3213778551 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38900fdfe0 0x7f389010de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:35.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.109+0000 7f3896f89700 1 -- 172.21.15.117:0/3213778551 >> 172.21.15.117:0/3213778551 conn(0x7f38900f8550 msgr2=0x7f38900f9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:14:35.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.109+0000 7f3896f89700 1 -- 172.21.15.117:0/3213778551 shutdown_connections 2024-04-12T09:14:35.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.109+0000 7f3896f89700 1 -- 172.21.15.117:0/3213778551 wait complete. 2024-04-12T09:14:35.121 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:14:35.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.215+0000 7fc033abc700 1 -- 172.21.15.117:0/3702451725 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc02c0fcf80 msgr2=0x7fc02c0fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:35.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.215+0000 7fc033abc700 1 --2- 172.21.15.117:0/3702451725 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc02c0fcf80 0x7fc02c0fd3f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc01c004940 tx=0x7fc01c009e30 comp rx=0 tx=0).stop 2024-04-12T09:14:35.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.215+0000 7fc033abc700 1 -- 172.21.15.117:0/3702451725 shutdown_connections 2024-04-12T09:14:35.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.215+0000 7fc033abc700 1 --2- 172.21.15.117:0/3702451725 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc02c0fcf80 0x7fc02c0fd3f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:35.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.215+0000 7fc033abc700 1 --2- 172.21.15.117:0/3702451725 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc02c0fbcd0 0x7fc02c0fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:35.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.215+0000 7fc033abc700 1 -- 172.21.15.117:0/3702451725 >> 172.21.15.117:0/3702451725 conn(0x7fc02c0f7430 msgr2=0x7fc02c0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:14:35.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.215+0000 7fc033abc700 1 -- 172.21.15.117:0/3702451725 shutdown_connections 2024-04-12T09:14:35.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.215+0000 7fc033abc700 1 -- 172.21.15.117:0/3702451725 wait complete. 2024-04-12T09:14:35.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.216+0000 7fc033abc700 1 Processor -- start 2024-04-12T09:14:35.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.216+0000 7fc033abc700 1 -- start start 2024-04-12T09:14:35.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.216+0000 7fc033abc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc02c0fbcd0 0x7fc02c10d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:35.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.216+0000 7fc033abc700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc02c0fcf80 0x7fc02c10df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:35.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.216+0000 7fc033abc700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c10e520 con 0x7fc02c0fbcd0 2024-04-12T09:14:35.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.216+0000 7fc033abc700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c10ed20 con 0x7fc02c0fcf80 2024-04-12T09:14:35.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.216+0000 7fc031858700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc02c0fbcd0 0x7fc02c10d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:35.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.216+0000 7fc031858700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc02c0fbcd0 0x7fc02c10d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51156/0 (socket says 172.21.15.117:51156) 2024-04-12T09:14:35.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.216+0000 7fc031858700 1 -- 172.21.15.117:0/1197781069 learned_addr learned my addr 172.21.15.117:0/1197781069 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:14:35.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.217+0000 7fc031858700 1 -- 172.21.15.117:0/1197781069 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc02c0fcf80 msgr2=0x7fc02c10df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:35.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.217+0000 7fc031858700 1 --2- 172.21.15.117:0/1197781069 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc02c0fcf80 0x7fc02c10df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:35.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.217+0000 7fc031858700 1 -- 172.21.15.117:0/1197781069 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c005040 con 0x7fc02c0fbcd0 2024-04-12T09:14:35.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.217+0000 7fc031858700 1 --2- 172.21.15.117:0/1197781069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc02c0fbcd0 0x7fc02c10d9e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc028002a80 tx=0x7fc0280046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:14:35.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.217+0000 7fc0227fc700 1 -- 172.21.15.117:0/1197781069 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc028007cc0 con 0x7fc02c0fbcd0 2024-04-12T09:14:35.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.217+0000 7fc033abc700 1 -- 172.21.15.117:0/1197781069 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc02c10f000 con 0x7fc02c0fbcd0 2024-04-12T09:14:35.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.217+0000 7fc0227fc700 1 -- 172.21.15.117:0/1197781069 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc02800f040 con 0x7fc02c0fbcd0 2024-04-12T09:14:35.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.218+0000 7fc0227fc700 1 -- 172.21.15.117:0/1197781069 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0280096f0 con 0x7fc02c0fbcd0 2024-04-12T09:14:35.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.218+0000 7fc033abc700 1 -- 172.21.15.117:0/1197781069 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc02c10f540 con 0x7fc02c0fbcd0 2024-04-12T09:14:35.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.219+0000 7fc0227fc700 1 -- 172.21.15.117:0/1197781069 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 33) v1 ==== 91575+0+0 (secure 0 0 0) 0x7fc02801c400 con 0x7fc02c0fbcd0 2024-04-12T09:14:35.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.219+0000 7fc033abc700 1 -- 172.21.15.117:0/1197781069 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc02c101b10 con 0x7fc02c0fbcd0 2024-04-12T09:14:35.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.219+0000 7fc0227fc700 1 --2- 172.21.15.117:0/1197781069 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fc01806d5a0 0x7fc01806fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:35.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.220+0000 7fc0227fc700 1 -- 172.21.15.117:0/1197781069 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fc02808c2c0 con 0x7fc02c0fbcd0 2024-04-12T09:14:35.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.220+0000 7fc031057700 1 --2- 172.21.15.117:0/1197781069 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fc01806d5a0 0x7fc01806fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:35.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.220+0000 7fc031057700 1 --2- 172.21.15.117:0/1197781069 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fc01806d5a0 0x7fc01806fa50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc01c004f90 tx=0x7fc01c009e30 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:14:35.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.224+0000 7fc0227fc700 1 -- 172.21.15.117:0/1197781069 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7fc028059ca0 con 0x7fc02c0fbcd0 2024-04-12T09:14:35.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.449+0000 7fc033abc700 1 -- 172.21.15.117:0/1197781069 --> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc02c10f7b0 con 0x7fc01806d5a0 2024-04-12T09:14:35.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.450+0000 7fc0227fc700 1 -- 172.21.15.117:0/1197781069 <== mgr.14694 v2:172.21.15.117:6800/1056729457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7fc02c10f7b0 con 0x7fc01806d5a0 2024-04-12T09:14:35.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.452+0000 7fc033abc700 1 -- 172.21.15.117:0/1197781069 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fc01806d5a0 msgr2=0x7fc01806fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:35.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.452+0000 7fc033abc700 1 --2- 172.21.15.117:0/1197781069 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fc01806d5a0 0x7fc01806fa50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc01c004f90 tx=0x7fc01c009e30 comp rx=0 tx=0).stop 2024-04-12T09:14:35.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.452+0000 7fc033abc700 1 -- 172.21.15.117:0/1197781069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc02c0fbcd0 msgr2=0x7fc02c10d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:35.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.452+0000 7fc033abc700 1 --2- 172.21.15.117:0/1197781069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc02c0fbcd0 0x7fc02c10d9e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc028002a80 tx=0x7fc0280046b0 comp rx=0 tx=0).stop 2024-04-12T09:14:35.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.452+0000 7fc033abc700 1 -- 172.21.15.117:0/1197781069 shutdown_connections 2024-04-12T09:14:35.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.452+0000 7fc033abc700 1 --2- 172.21.15.117:0/1197781069 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fc01806d5a0 0x7fc01806fa50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:35.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.452+0000 7fc033abc700 1 --2- 172.21.15.117:0/1197781069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc02c0fbcd0 0x7fc02c10d9e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:35.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.452+0000 7fc033abc700 1 --2- 172.21.15.117:0/1197781069 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc02c0fcf80 0x7fc02c10df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:35.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.452+0000 7fc033abc700 1 -- 172.21.15.117:0/1197781069 >> 172.21.15.117:0/1197781069 conn(0x7fc02c0f7430 msgr2=0x7fc02c065ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:14:35.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.452+0000 7fc033abc700 1 -- 172.21.15.117:0/1197781069 shutdown_connections 2024-04-12T09:14:35.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.452+0000 7fc033abc700 1 -- 172.21.15.117:0/1197781069 wait complete. 2024-04-12T09:14:35.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.560+0000 7f0eca11a700 1 -- 172.21.15.117:0/3073833999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ec40662e0 msgr2=0x7f0ec40ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:35.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.560+0000 7f0eca11a700 1 --2- 172.21.15.117:0/3073833999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ec40662e0 0x7f0ec40ff9c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4004940 tx=0x7f0eb4009e30 comp rx=0 tx=0).stop 2024-04-12T09:14:35.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.560+0000 7f0eca11a700 1 -- 172.21.15.117:0/3073833999 shutdown_connections 2024-04-12T09:14:35.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.560+0000 7f0eca11a700 1 --2- 172.21.15.117:0/3073833999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ec40fff00 0x7f0ec4102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:35.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.560+0000 7f0eca11a700 1 --2- 172.21.15.117:0/3073833999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ec40662e0 0x7f0ec40ff9c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:35.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.560+0000 7f0eca11a700 1 -- 172.21.15.117:0/3073833999 >> 172.21.15.117:0/3073833999 conn(0x7f0ec40f7430 msgr2=0x7f0ec40f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:14:35.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.560+0000 7f0eca11a700 1 -- 172.21.15.117:0/3073833999 shutdown_connections 2024-04-12T09:14:35.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.560+0000 7f0eca11a700 1 -- 172.21.15.117:0/3073833999 wait complete. 2024-04-12T09:14:35.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.560+0000 7f0eca11a700 1 Processor -- start 2024-04-12T09:14:35.563 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.560+0000 7f0eca11a700 1 -- start start 2024-04-12T09:14:35.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.561+0000 7f0eca11a700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ec40662e0 0x7f0ec410dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:35.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.561+0000 7f0eca11a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ec40fff00 0x7f0ec410e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:35.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.561+0000 7f0eca11a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec410e6a0 con 0x7f0ec40fff00 2024-04-12T09:14:35.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.561+0000 7f0eca11a700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec410edf0 con 0x7f0ec40662e0 2024-04-12T09:14:35.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.561+0000 7f0ec2ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ec40fff00 0x7f0ec410e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:35.565 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.561+0000 7f0ec2ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ec40fff00 0x7f0ec410e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51178/0 (socket says 172.21.15.117:51178) 2024-04-12T09:14:35.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.561+0000 7f0ec2ffd700 1 -- 172.21.15.117:0/1358045521 learned_addr learned my addr 172.21.15.117:0/1358045521 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:14:35.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.561+0000 7f0ec37fe700 1 --2- 172.21.15.117:0/1358045521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ec40662e0 0x7f0ec410dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:35.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.561+0000 7f0ec2ffd700 1 -- 172.21.15.117:0/1358045521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ec40662e0 msgr2=0x7f0ec410dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:35.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.561+0000 7f0ec2ffd700 1 --2- 172.21.15.117:0/1358045521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ec40662e0 0x7f0ec410dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:35.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.561+0000 7f0ec2ffd700 1 -- 172.21.15.117:0/1358045521 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb4005040 con 0x7f0ec40fff00 2024-04-12T09:14:35.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.561+0000 7f0ec2ffd700 1 --2- 172.21.15.117:0/1358045521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ec40fff00 0x7f0ec410e010 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0eb800b790 tx=0x7f0eb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:14:35.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.561+0000 7f0eabfff700 1 -- 172.21.15.117:0/1358045521 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0eb800f770 con 0x7f0ec40fff00 2024-04-12T09:14:35.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.561+0000 7f0eca11a700 1 -- 172.21.15.117:0/1358045521 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec410f0d0 con 0x7f0ec40fff00 2024-04-12T09:14:35.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.561+0000 7f0eabfff700 1 -- 172.21.15.117:0/1358045521 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0eb800fda0 con 0x7f0ec40fff00 2024-04-12T09:14:35.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.562+0000 7f0eabfff700 1 -- 172.21.15.117:0/1358045521 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0eb800d310 con 0x7f0ec40fff00 2024-04-12T09:14:35.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.562+0000 7f0eca11a700 1 -- 172.21.15.117:0/1358045521 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec410f690 con 0x7f0ec40fff00 2024-04-12T09:14:35.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.563+0000 7f0eca11a700 1 -- 172.21.15.117:0/1358045521 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec405f5f0 con 0x7f0ec40fff00 2024-04-12T09:14:35.566 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.563+0000 7f0eabfff700 1 -- 172.21.15.117:0/1358045521 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 33) v1 ==== 91575+0+0 (secure 0 0 0) 0x7f0eb8010420 con 0x7f0ec40fff00 2024-04-12T09:14:35.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.563+0000 7f0eabfff700 1 --2- 172.21.15.117:0/1358045521 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f0eac06d5b0 0x7f0eac06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:35.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.563+0000 7f0eabfff700 1 -- 172.21.15.117:0/1358045521 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f0eb808cc00 con 0x7f0ec40fff00 2024-04-12T09:14:35.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.563+0000 7f0ec37fe700 1 --2- 172.21.15.117:0/1358045521 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f0eac06d5b0 0x7f0eac06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:35.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.564+0000 7f0ec37fe700 1 --2- 172.21.15.117:0/1358045521 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f0eac06d5b0 0x7f0eac06fa60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009fd0 tx=0x7f0eb4009e30 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:14:35.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.568+0000 7f0eabfff700 1 -- 172.21.15.117:0/1358045521 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f0eb8092020 con 0x7f0ec40fff00 2024-04-12T09:14:35.778 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.776+0000 7f0eca11a700 1 -- 172.21.15.117:0/1358045521 --> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ec410f960 con 0x7f0eac06d5b0 2024-04-12T09:14:35.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.786+0000 7f0eabfff700 1 -- 172.21.15.117:0/1358045521 <== mgr.14694 v2:172.21.15.117:6800/1056729457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f0ec410f960 con 0x7f0eac06d5b0 2024-04-12T09:14:35.788 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:14:35.788 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 running (14s) 9s ago 11m 16.7M - 0.25.0 c8568f914cd2 204687f21ed7 2024-04-12T09:14:35.788 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (11m) 9s ago 11m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad 1e9f2c6a4491 2024-04-12T09:14:35.788 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (10m) 47s ago 10m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad e42da3f6e517 2024-04-12T09:14:35.788 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 unknown 9s ago 11m - - 2024-04-12T09:14:35.788 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (6m) 9s ago 6m 141M - 17.2.7-827-gd3b5060a 21de9b7369ad de062e2c10e7 2024-04-12T09:14:35.789 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 running (6m) 9s ago 6m 13.0M - 17.2.7-827-gd3b5060a 21de9b7369ad 1e82c6241a18 2024-04-12T09:14:35.789 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (6m) 47s ago 6m 15.5M - 17.2.7-827-gd3b5060a 21de9b7369ad b05228e997f7 2024-04-12T09:14:35.789 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (6m) 47s ago 6m 16.1M - 17.2.7-827-gd3b5060a 21de9b7369ad 6d7f82c072c7 2024-04-12T09:14:35.789 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:8443,9283,8765 running (2m) 9s ago 13m 504M - 19.0.0-2053-gb277feb2 668895944f0e fee613d05ab7 2024-04-12T09:14:35.789 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283,8765 running (70s) 47s ago 10m 448M - 19.0.0-2053-gb277feb2 668895944f0e c793944c3e16 2024-04-12T09:14:35.789 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (13m) 9s ago 13m 51.5M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad f9d5f7ac5270 2024-04-12T09:14:35.789 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (10m) 47s ago 10m 42.4M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad 17c0db49bb16 2024-04-12T09:14:35.789 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 running (55s) 9s ago 11m 16.1M - 1.5.0 0da6a335fe13 c692bed9f6c7 2024-04-12T09:14:35.789 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (51s) 47s ago 10m 3351k - 1.5.0 0da6a335fe13 f3b5a470f545 2024-04-12T09:14:35.789 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (9m) 9s ago 9m 223M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 77040a2498f3 2024-04-12T09:14:35.789 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (9m) 9s ago 9m 234M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 8f9dbf0274ed 2024-04-12T09:14:35.789 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (9m) 9s ago 9m 200M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 339c5a80d1dd 2024-04-12T09:14:35.789 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (8m) 47s ago 8m 272M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad fb87d616bae3 2024-04-12T09:14:35.789 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (8m) 47s ago 8m 245M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad c873826a2dea 2024-04-12T09:14:35.789 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (7m) 47s ago 7m 219M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad 69cb7c22f002 2024-04-12T09:14:35.790 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 running (33s) 9s ago 11m 44.9M - 2.43.0 a07b618ecd1d 43ce588d82cc 2024-04-12T09:14:35.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.788+0000 7f0eca11a700 1 -- 172.21.15.117:0/1358045521 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f0eac06d5b0 msgr2=0x7f0eac06fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:35.790 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.788+0000 7f0eca11a700 1 --2- 172.21.15.117:0/1358045521 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f0eac06d5b0 0x7f0eac06fa60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009fd0 tx=0x7f0eb4009e30 comp rx=0 tx=0).stop 2024-04-12T09:14:35.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.788+0000 7f0eca11a700 1 -- 172.21.15.117:0/1358045521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ec40fff00 msgr2=0x7f0ec410e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:35.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.788+0000 7f0eca11a700 1 --2- 172.21.15.117:0/1358045521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ec40fff00 0x7f0ec410e010 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0eb800b790 tx=0x7f0eb8009250 comp rx=0 tx=0).stop 2024-04-12T09:14:35.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.788+0000 7f0eca11a700 1 -- 172.21.15.117:0/1358045521 shutdown_connections 2024-04-12T09:14:35.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.788+0000 7f0eca11a700 1 --2- 172.21.15.117:0/1358045521 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f0eac06d5b0 0x7f0eac06fa60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:35.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.788+0000 7f0eca11a700 1 --2- 172.21.15.117:0/1358045521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ec40662e0 0x7f0ec410dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:35.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.788+0000 7f0eca11a700 1 --2- 172.21.15.117:0/1358045521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ec40fff00 0x7f0ec410e010 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:35.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.788+0000 7f0eca11a700 1 -- 172.21.15.117:0/1358045521 >> 172.21.15.117:0/1358045521 conn(0x7f0ec40f7430 msgr2=0x7f0ec40f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:14:35.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.789+0000 7f0eca11a700 1 -- 172.21.15.117:0/1358045521 shutdown_connections 2024-04-12T09:14:35.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.789+0000 7f0eca11a700 1 -- 172.21.15.117:0/1358045521 wait complete. 2024-04-12T09:14:35.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.889+0000 7f9530910700 1 -- 172.21.15.117:0/1828770906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952c0fff00 msgr2=0x7f952c102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:35.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.889+0000 7f9530910700 1 --2- 172.21.15.117:0/1828770906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952c0fff00 0x7f952c102320 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9520004940 tx=0x7f9520009e30 comp rx=0 tx=0).stop 2024-04-12T09:14:35.892 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.889+0000 7f9530910700 1 -- 172.21.15.117:0/1828770906 shutdown_connections 2024-04-12T09:14:35.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.889+0000 7f9530910700 1 --2- 172.21.15.117:0/1828770906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952c0fff00 0x7f952c102320 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:35.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.889+0000 7f9530910700 1 --2- 172.21.15.117:0/1828770906 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f952c0662e0 0x7f952c0ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:35.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.889+0000 7f9530910700 1 -- 172.21.15.117:0/1828770906 >> 172.21.15.117:0/1828770906 conn(0x7f952c0f7430 msgr2=0x7f952c0f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:14:35.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.889+0000 7f9530910700 1 -- 172.21.15.117:0/1828770906 shutdown_connections 2024-04-12T09:14:35.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.889+0000 7f9530910700 1 -- 172.21.15.117:0/1828770906 wait complete. 2024-04-12T09:14:35.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.889+0000 7f9530910700 1 Processor -- start 2024-04-12T09:14:35.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.889+0000 7f9530910700 1 -- start start 2024-04-12T09:14:35.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.890+0000 7f9530910700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f952c0662e0 0x7f952c10da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:35.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.890+0000 7f9530910700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952c0fff00 0x7f952c10dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:35.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.890+0000 7f9530910700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c10e5a0 con 0x7f952c0fff00 2024-04-12T09:14:35.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.890+0000 7f9530910700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c10edf0 con 0x7f952c0662e0 2024-04-12T09:14:35.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.890+0000 7f9529d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952c0fff00 0x7f952c10dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:35.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.890+0000 7f9529d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952c0fff00 0x7f952c10dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51196/0 (socket says 172.21.15.117:51196) 2024-04-12T09:14:35.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.890+0000 7f9529d9b700 1 -- 172.21.15.117:0/1774172906 learned_addr learned my addr 172.21.15.117:0/1774172906 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:14:35.893 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.890+0000 7f952a59c700 1 --2- 172.21.15.117:0/1774172906 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f952c0662e0 0x7f952c10da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:35.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.890+0000 7f9529d9b700 1 -- 172.21.15.117:0/1774172906 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f952c0662e0 msgr2=0x7f952c10da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:35.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.890+0000 7f9529d9b700 1 --2- 172.21.15.117:0/1774172906 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f952c0662e0 0x7f952c10da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:35.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.890+0000 7f9529d9b700 1 -- 172.21.15.117:0/1774172906 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9520005040 con 0x7f952c0fff00 2024-04-12T09:14:35.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.890+0000 7f952a59c700 1 --2- 172.21.15.117:0/1774172906 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f952c0662e0 0x7f952c10da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T09:14:35.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.890+0000 7f9529d9b700 1 --2- 172.21.15.117:0/1774172906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952c0fff00 0x7f952c10dfa0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f952000b3b0 tx=0x7f9520009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:14:35.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.890+0000 7f951affd700 1 -- 172.21.15.117:0/1774172906 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f952000e040 con 0x7f952c0fff00 2024-04-12T09:14:35.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.890+0000 7f951affd700 1 -- 172.21.15.117:0/1774172906 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f952000bcc0 con 0x7f952c0fff00 2024-04-12T09:14:35.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.890+0000 7f9530910700 1 -- 172.21.15.117:0/1774172906 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952c10f070 con 0x7f952c0fff00 2024-04-12T09:14:35.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.890+0000 7f951affd700 1 -- 172.21.15.117:0/1774172906 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f952001c630 con 0x7f952c0fff00 2024-04-12T09:14:35.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.890+0000 7f9530910700 1 -- 172.21.15.117:0/1774172906 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952c10f5b0 con 0x7f952c0fff00 2024-04-12T09:14:35.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.891+0000 7f9530910700 1 -- 172.21.15.117:0/1774172906 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952c05f5f0 con 0x7f952c0fff00 2024-04-12T09:14:35.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.892+0000 7f951affd700 1 -- 172.21.15.117:0/1774172906 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 33) v1 ==== 91575+0+0 (secure 0 0 0) 0x7f9520013980 con 0x7f952c0fff00 2024-04-12T09:14:35.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.892+0000 7f951affd700 1 --2- 172.21.15.117:0/1774172906 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f951406d5a0 0x7f951406fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:35.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.892+0000 7f951affd700 1 -- 172.21.15.117:0/1774172906 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f952008d820 con 0x7f952c0fff00 2024-04-12T09:14:35.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.892+0000 7f952a59c700 1 --2- 172.21.15.117:0/1774172906 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f951406d5a0 0x7f951406fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:35.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.893+0000 7f952a59c700 1 --2- 172.21.15.117:0/1774172906 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f951406d5a0 0x7f951406fa50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f952c066020 tx=0x7f951c00b040 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:14:35.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:35.897+0000 7f951affd700 1 -- 172.21.15.117:0/1774172906 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f952005b200 con 0x7f952c0fff00 2024-04-12T09:14:36.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.183+0000 7f9530910700 1 -- 172.21.15.117:0/1774172906 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f952c1058d0 con 0x7f952c0fff00 2024-04-12T09:14:36.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.183+0000 7f951affd700 1 -- 172.21.15.117:0/1774172906 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f952005ad90 con 0x7f952c0fff00 2024-04-12T09:14:36.185 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:14:36.185 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": { 2024-04-12T09:14:36.185 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 2 2024-04-12T09:14:36.185 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:14:36.186 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": { 2024-04-12T09:14:36.186 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:14:36.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:14:36.186 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": { 2024-04-12T09:14:36.186 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 6 2024-04-12T09:14:36.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:14:36.186 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-04-12T09:14:36.186 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 4 2024-04-12T09:14:36.186 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:14:36.186 INFO:teuthology.orchestra.run.smithi117.stdout: "overall": { 2024-04-12T09:14:36.186 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 12, 2024-04-12T09:14:36.186 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:14:36.186 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:14:36.186 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:14:36.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.185+0000 7f9530910700 1 -- 172.21.15.117:0/1774172906 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f951406d5a0 msgr2=0x7f951406fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:36.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.185+0000 7f9530910700 1 --2- 172.21.15.117:0/1774172906 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f951406d5a0 0x7f951406fa50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f952c066020 tx=0x7f951c00b040 comp rx=0 tx=0).stop 2024-04-12T09:14:36.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.185+0000 7f9530910700 1 -- 172.21.15.117:0/1774172906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952c0fff00 msgr2=0x7f952c10dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:36.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.185+0000 7f9530910700 1 --2- 172.21.15.117:0/1774172906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952c0fff00 0x7f952c10dfa0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f952000b3b0 tx=0x7f9520009e30 comp rx=0 tx=0).stop 2024-04-12T09:14:36.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.185+0000 7f9530910700 1 -- 172.21.15.117:0/1774172906 shutdown_connections 2024-04-12T09:14:36.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.185+0000 7f9530910700 1 --2- 172.21.15.117:0/1774172906 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f951406d5a0 0x7f951406fa50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:36.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.185+0000 7f9530910700 1 --2- 172.21.15.117:0/1774172906 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f952c0662e0 0x7f952c10da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:36.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.185+0000 7f9530910700 1 --2- 172.21.15.117:0/1774172906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f952c0fff00 0x7f952c10dfa0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:36.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.185+0000 7f9530910700 1 -- 172.21.15.117:0/1774172906 >> 172.21.15.117:0/1774172906 conn(0x7f952c0f7430 msgr2=0x7f952c0f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:14:36.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.186+0000 7f9530910700 1 -- 172.21.15.117:0/1774172906 shutdown_connections 2024-04-12T09:14:36.188 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.186+0000 7f9530910700 1 -- 172.21.15.117:0/1774172906 wait complete. 2024-04-12T09:14:36.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.288+0000 7f5250dbf700 1 -- 172.21.15.117:0/174917703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f524c0fbd00 msgr2=0x7f524c0fc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:36.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.288+0000 7f5250dbf700 1 --2- 172.21.15.117:0/174917703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f524c0fbd00 0x7f524c0fc110 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f523c004940 tx=0x7f523c009e30 comp rx=0 tx=0).stop 2024-04-12T09:14:36.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.288+0000 7f5250dbf700 1 -- 172.21.15.117:0/174917703 shutdown_connections 2024-04-12T09:14:36.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.288+0000 7f5250dbf700 1 --2- 172.21.15.117:0/174917703 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f524c0fcfb0 0x7f524c0fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:36.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.288+0000 7f5250dbf700 1 --2- 172.21.15.117:0/174917703 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f524c0fbd00 0x7f524c0fc110 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:36.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.288+0000 7f5250dbf700 1 -- 172.21.15.117:0/174917703 >> 172.21.15.117:0/174917703 conn(0x7f524c0f7480 msgr2=0x7f524c0f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:14:36.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.288+0000 7f5250dbf700 1 -- 172.21.15.117:0/174917703 shutdown_connections 2024-04-12T09:14:36.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.288+0000 7f5250dbf700 1 -- 172.21.15.117:0/174917703 wait complete. 2024-04-12T09:14:36.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.289+0000 7f5250dbf700 1 Processor -- start 2024-04-12T09:14:36.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.289+0000 7f5250dbf700 1 -- start start 2024-04-12T09:14:36.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.289+0000 7f5250dbf700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f524c0fbd00 0x7f524c10d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:36.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.289+0000 7f5250dbf700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f524c0fcfb0 0x7f524c10dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:36.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.289+0000 7f5250dbf700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c10e530 con 0x7f524c0fbd00 2024-04-12T09:14:36.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.289+0000 7f5250dbf700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c112e80 con 0x7f524c0fcfb0 2024-04-12T09:14:36.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.289+0000 7f524a59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f524c0fbd00 0x7f524c10d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:36.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.289+0000 7f524a59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f524c0fbd00 0x7f524c10d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:51226/0 (socket says 172.21.15.117:51226) 2024-04-12T09:14:36.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.289+0000 7f524a59c700 1 -- 172.21.15.117:0/3290980540 learned_addr learned my addr 172.21.15.117:0/3290980540 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:14:36.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.289+0000 7f524a59c700 1 -- 172.21.15.117:0/3290980540 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f524c0fcfb0 msgr2=0x7f524c10dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:36.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.289+0000 7f524a59c700 1 --2- 172.21.15.117:0/3290980540 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f524c0fcfb0 0x7f524c10dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:36.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.289+0000 7f524a59c700 1 -- 172.21.15.117:0/3290980540 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c005040 con 0x7f524c0fbd00 2024-04-12T09:14:36.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.289+0000 7f524a59c700 1 --2- 172.21.15.117:0/3290980540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f524c0fbd00 0x7f524c10d960 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f523c00b3b0 tx=0x7f523c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:14:36.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.289+0000 7f523affd700 1 -- 172.21.15.117:0/3290980540 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f523c00e040 con 0x7f524c0fbd00 2024-04-12T09:14:36.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.290+0000 7f523affd700 1 -- 172.21.15.117:0/3290980540 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f523c00bcc0 con 0x7f524c0fbd00 2024-04-12T09:14:36.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.290+0000 7f523affd700 1 -- 172.21.15.117:0/3290980540 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f523c01c630 con 0x7f524c0fbd00 2024-04-12T09:14:36.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.290+0000 7f5250dbf700 1 -- 172.21.15.117:0/3290980540 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524c113080 con 0x7f524c0fbd00 2024-04-12T09:14:36.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.290+0000 7f5250dbf700 1 -- 172.21.15.117:0/3290980540 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524c1135f0 con 0x7f524c0fbd00 2024-04-12T09:14:36.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.290+0000 7f5250dbf700 1 -- 172.21.15.117:0/3290980540 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f524c101b40 con 0x7f524c0fbd00 2024-04-12T09:14:36.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.291+0000 7f523affd700 1 -- 172.21.15.117:0/3290980540 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 33) v1 ==== 91575+0+0 (secure 0 0 0) 0x7f523c013980 con 0x7f524c0fbd00 2024-04-12T09:14:36.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.291+0000 7f523affd700 1 --2- 172.21.15.117:0/3290980540 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f523406d5a0 0x7f523406fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:14:36.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.291+0000 7f523affd700 1 -- 172.21.15.117:0/3290980540 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f523c08d820 con 0x7f524c0fbd00 2024-04-12T09:14:36.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.292+0000 7f5249d9b700 1 --2- 172.21.15.117:0/3290980540 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f523406d5a0 0x7f523406fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:14:36.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.292+0000 7f5249d9b700 1 --2- 172.21.15.117:0/3290980540 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f523406d5a0 0x7f523406fa50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5240006fd0 tx=0x7f5240006db0 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:14:36.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.296+0000 7f523affd700 1 -- 172.21.15.117:0/3290980540 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f523c05b200 con 0x7f524c0fbd00 2024-04-12T09:14:36.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:36 smithi117 ceph-mon[29277]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:14:36.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:36 smithi117 ceph-mon[29277]: pgmap v59: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 317 B/s wr, 0 op/s 2024-04-12T09:14:36.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:36 smithi117 ceph-mon[29277]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:14:36.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:36 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/1774172906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:36.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.511+0000 7f5250dbf700 1 -- 172.21.15.117:0/3290980540 --> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f524c02b4d0 con 0x7f523406d5a0 2024-04-12T09:14:36.514 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.512+0000 7f523affd700 1 -- 172.21.15.117:0/3290980540 <== mgr.14694 v2:172.21.15.117:6800/1056729457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f524c02b4d0 con 0x7f523406d5a0 2024-04-12T09:14:36.514 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:14:36.514 INFO:teuthology.orchestra.run.smithi117.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec", 2024-04-12T09:14:36.514 INFO:teuthology.orchestra.run.smithi117.stdout: "in_progress": true, 2024-04-12T09:14:36.514 INFO:teuthology.orchestra.run.smithi117.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-04-12T09:14:36.514 INFO:teuthology.orchestra.run.smithi117.stdout: "services_complete": [ 2024-04-12T09:14:36.514 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr" 2024-04-12T09:14:36.514 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2024-04-12T09:14:36.515 INFO:teuthology.orchestra.run.smithi117.stdout: "progress": "2/2 daemons upgraded", 2024-04-12T09:14:36.515 INFO:teuthology.orchestra.run.smithi117.stdout: "message": "Currently upgrading grafana daemons", 2024-04-12T09:14:36.515 INFO:teuthology.orchestra.run.smithi117.stdout: "is_paused": false 2024-04-12T09:14:36.515 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:14:36.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.514+0000 7f5250dbf700 1 -- 172.21.15.117:0/3290980540 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f523406d5a0 msgr2=0x7f523406fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:36.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.514+0000 7f5250dbf700 1 --2- 172.21.15.117:0/3290980540 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f523406d5a0 0x7f523406fa50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5240006fd0 tx=0x7f5240006db0 comp rx=0 tx=0).stop 2024-04-12T09:14:36.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.514+0000 7f5250dbf700 1 -- 172.21.15.117:0/3290980540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f524c0fbd00 msgr2=0x7f524c10d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:14:36.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.514+0000 7f5250dbf700 1 --2- 172.21.15.117:0/3290980540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f524c0fbd00 0x7f524c10d960 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f523c00b3b0 tx=0x7f523c009e30 comp rx=0 tx=0).stop 2024-04-12T09:14:36.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.514+0000 7f5250dbf700 1 -- 172.21.15.117:0/3290980540 shutdown_connections 2024-04-12T09:14:36.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.514+0000 7f5250dbf700 1 --2- 172.21.15.117:0/3290980540 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f523406d5a0 0x7f523406fa50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:36.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.514+0000 7f5250dbf700 1 --2- 172.21.15.117:0/3290980540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f524c0fbd00 0x7f524c10d960 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:36.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.514+0000 7f5250dbf700 1 --2- 172.21.15.117:0/3290980540 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f524c0fcfb0 0x7f524c10dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:14:36.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.514+0000 7f5250dbf700 1 -- 172.21.15.117:0/3290980540 >> 172.21.15.117:0/3290980540 conn(0x7f524c0f7480 msgr2=0x7f524c066720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:14:36.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.515+0000 7f5250dbf700 1 -- 172.21.15.117:0/3290980540 shutdown_connections 2024-04-12T09:14:36.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:14:36.515+0000 7f5250dbf700 1 -- 172.21.15.117:0/3290980540 wait complete. 2024-04-12T09:14:36.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:36 smithi203 ceph-mon[36428]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:14:36.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:36 smithi203 ceph-mon[36428]: pgmap v59: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 317 B/s wr, 0 op/s 2024-04-12T09:14:36.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:36 smithi203 ceph-mon[36428]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:14:36.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:36 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/1774172906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:37.553 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:37 smithi117 ceph-mon[29277]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:14:37.553 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:37 smithi117 ceph-mon[29277]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:14:37.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:37 smithi203 ceph-mon[36428]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:14:37.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:37 smithi203 ceph-mon[36428]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:14:38.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:38 smithi203 ceph-mon[36428]: pgmap v60: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:38.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:38 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:38.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:38 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:38.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:38 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:14:38.608 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:38 smithi117 ceph-mon[29277]: pgmap v60: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:38.608 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:38 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:38.608 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:38 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:38.609 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:38 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:14:40.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:40 smithi203 ceph-mon[36428]: pgmap v61: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:40.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:40 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:14:40.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:40 smithi117 ceph-mon[29277]: pgmap v61: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:40.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:40 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:14:42.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:42 smithi203 ceph-mon[36428]: pgmap v62: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:42.607 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:42 smithi117 ceph-mon[29277]: pgmap v62: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:44.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:44 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:44.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:44 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:44.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:44 smithi117 ceph-mon[29277]: pgmap v63: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:44.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:44 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:44.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:44 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:44.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:44 smithi203 ceph-mon[36428]: pgmap v63: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:45.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:45 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:45.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:45 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:45.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:45 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:45.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:45 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:46.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:46 smithi117 ceph-mon[29277]: pgmap v64: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:46.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:46 smithi203 ceph-mon[36428]: pgmap v64: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:48.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: pgmap v65: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:48.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:48.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:48.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:14:48.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:14:48.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:48.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-12T09:14:48.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:14:48.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.575 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.576 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.576 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:48.576 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-12T09:14:48.576 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-12T09:14:48.576 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:14:48.576 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-12T09:14:48.576 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-12T09:14:48.576 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-12T09:14:48.576 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-12T09:14:48.576 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-12T09:14:48.576 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-12T09:14:48.576 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-12T09:14:48.576 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-12T09:14:48.576 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:14:48.577 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-12T09:14:48.577 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-12T09:14:48.577 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-12T09:14:48.577 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-12T09:14:48.577 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-12T09:14:48.577 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-12T09:14:48.577 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-12T09:14:48.577 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-12T09:14:48.577 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:14:48.577 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:14:48.577 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:14:48.578 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:14:48.578 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:14:48.578 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:14:48.578 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-12T09:14:48.578 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-12T09:14:48.578 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:14:48.578 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:14:48.578 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:14:48.578 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:48.578 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:14:48.578 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:14:48.578 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:14:48.578 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:48 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:48.659 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: pgmap v65: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:48.659 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:48.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:48.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:14:48.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:14:48.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:48.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-12T09:14:48.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:14:48.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:14:48.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:48.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-12T09:14:48.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-12T09:14:48.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:14:48.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-12T09:14:48.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-12T09:14:48.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-12T09:14:48.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-12T09:14:48.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-12T09:14:48.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-12T09:14:48.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-12T09:14:48.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-12T09:14:48.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:14:48.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-12T09:14:48.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-12T09:14:48.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-12T09:14:48.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-12T09:14:48.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-12T09:14:48.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-12T09:14:48.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-12T09:14:48.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-12T09:14:48.662 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:14:48.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:14:48.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:14:48.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:14:48.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:14:48.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:14:48.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-12T09:14:48.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-12T09:14:48.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:14:48.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:14:48.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:14:48.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:48.664 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:14:48.664 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:14:48.664 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:14:48.664 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:48 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:49.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:49 smithi117 ceph-mon[29277]: pgmap v66: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:49.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:49 smithi117 ceph-mon[29277]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-12T09:14:49.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:49 smithi117 ceph-mon[29277]: Upgrade: Finalizing container_image settings 2024-04-12T09:14:49.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:49 smithi117 ceph-mon[29277]: Upgrade: Complete! 2024-04-12T09:14:49.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:49 smithi117 ceph-mon[29277]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-04-12T09:14:49.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:49 smithi117 ceph-mon[29277]: Cluster is now healthy 2024-04-12T09:14:49.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:49 smithi203 ceph-mon[36428]: pgmap v66: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:49.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:49 smithi203 ceph-mon[36428]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-12T09:14:49.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:49 smithi203 ceph-mon[36428]: Upgrade: Finalizing container_image settings 2024-04-12T09:14:49.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:49 smithi203 ceph-mon[36428]: Upgrade: Complete! 2024-04-12T09:14:49.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:49 smithi203 ceph-mon[36428]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-04-12T09:14:49.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:49 smithi203 ceph-mon[36428]: Cluster is now healthy 2024-04-12T09:14:51.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:50 smithi203 ceph-mon[36428]: pgmap v67: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:51.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:50 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:51.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:50 smithi117 ceph-mon[29277]: pgmap v67: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:51.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:50 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:53.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:52 smithi203 ceph-mon[36428]: pgmap v68: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:53.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:52 smithi117 ceph-mon[29277]: pgmap v68: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:55.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:54 smithi203 ceph-mon[36428]: pgmap v69: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:55.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:54 smithi117 ceph-mon[29277]: pgmap v69: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:56.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:56.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:55 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:14:56.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:14:56.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:55 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:14:57.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:56 smithi203 ceph-mon[36428]: pgmap v70: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:57.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:56 smithi117 ceph-mon[29277]: pgmap v70: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:59.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:14:58 smithi203 ceph-mon[36428]: pgmap v71: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:14:59.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:14:58 smithi117 ceph-mon[29277]: pgmap v71: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:01.213 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:00 smithi117 ceph-mon[29277]: pgmap v72: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:01.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:00 smithi203 ceph-mon[36428]: pgmap v72: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:03.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:02 smithi203 ceph-mon[36428]: pgmap v73: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:03.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:02 smithi117 ceph-mon[29277]: pgmap v73: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:05.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:04 smithi203 ceph-mon[36428]: pgmap v74: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:05.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:04 smithi117 ceph-mon[29277]: pgmap v74: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:06.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.630+0000 7f48ebba8700 1 -- 172.21.15.117:0/982150724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48e40fffa0 msgr2=0x7f48e4102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:06.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.630+0000 7f48ebba8700 1 --2- 172.21.15.117:0/982150724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48e40fffa0 0x7f48e4102380 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f48d4004940 tx=0x7f48d4009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:06.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.630+0000 7f48ebba8700 1 -- 172.21.15.117:0/982150724 shutdown_connections 2024-04-12T09:15:06.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.630+0000 7f48ebba8700 1 --2- 172.21.15.117:0/982150724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48e40fffa0 0x7f48e4102380 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:06.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.630+0000 7f48ebba8700 1 --2- 172.21.15.117:0/982150724 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48e4066eb0 0x7f48e40ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:06.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.630+0000 7f48ebba8700 1 -- 172.21.15.117:0/982150724 >> 172.21.15.117:0/982150724 conn(0x7f48e40f7450 msgr2=0x7f48e40f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:06.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.630+0000 7f48ebba8700 1 -- 172.21.15.117:0/982150724 shutdown_connections 2024-04-12T09:15:06.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.630+0000 7f48ebba8700 1 -- 172.21.15.117:0/982150724 wait complete. 2024-04-12T09:15:06.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.631+0000 7f48ebba8700 1 Processor -- start 2024-04-12T09:15:06.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.631+0000 7f48ebba8700 1 -- start start 2024-04-12T09:15:06.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.631+0000 7f48ebba8700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48e4066eb0 0x7f48e410d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:06.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.631+0000 7f48ebba8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48e40fffa0 0x7f48e410deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:06.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.631+0000 7f48ebba8700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e410e540 con 0x7f48e40fffa0 2024-04-12T09:15:06.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.631+0000 7f48ebba8700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e4112ee0 con 0x7f48e4066eb0 2024-04-12T09:15:06.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.631+0000 7f48e9143700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48e40fffa0 0x7f48e410deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:06.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.631+0000 7f48e9143700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48e40fffa0 0x7f48e410deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:49968/0 (socket says 172.21.15.117:49968) 2024-04-12T09:15:06.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.631+0000 7f48e9143700 1 -- 172.21.15.117:0/1066225283 learned_addr learned my addr 172.21.15.117:0/1066225283 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:15:06.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.631+0000 7f48e9944700 1 --2- 172.21.15.117:0/1066225283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48e4066eb0 0x7f48e410d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:06.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.631+0000 7f48e9143700 1 -- 172.21.15.117:0/1066225283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48e4066eb0 msgr2=0x7f48e410d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:06.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.631+0000 7f48e9143700 1 --2- 172.21.15.117:0/1066225283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48e4066eb0 0x7f48e410d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:06.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.631+0000 7f48e9143700 1 -- 172.21.15.117:0/1066225283 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d4005040 con 0x7f48e40fffa0 2024-04-12T09:15:06.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.631+0000 7f48e9944700 1 --2- 172.21.15.117:0/1066225283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48e4066eb0 0x7f48e410d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T09:15:06.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.631+0000 7f48e9143700 1 --2- 172.21.15.117:0/1066225283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48e40fffa0 0x7f48e410deb0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f48d400b3b0 tx=0x7f48d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:06.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.632+0000 7f48da7fc700 1 -- 172.21.15.117:0/1066225283 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48d400e040 con 0x7f48e40fffa0 2024-04-12T09:15:06.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.632+0000 7f48ebba8700 1 -- 172.21.15.117:0/1066225283 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e41130e0 con 0x7f48e40fffa0 2024-04-12T09:15:06.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.632+0000 7f48da7fc700 1 -- 172.21.15.117:0/1066225283 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f48d400bcc0 con 0x7f48e40fffa0 2024-04-12T09:15:06.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.632+0000 7f48da7fc700 1 -- 172.21.15.117:0/1066225283 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48d401c630 con 0x7f48e40fffa0 2024-04-12T09:15:06.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.632+0000 7f48ebba8700 1 -- 172.21.15.117:0/1066225283 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e4113650 con 0x7f48e40fffa0 2024-04-12T09:15:06.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.633+0000 7f48ebba8700 1 -- 172.21.15.117:0/1066225283 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e404c710 con 0x7f48e40fffa0 2024-04-12T09:15:06.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.633+0000 7f48da7fc700 1 -- 172.21.15.117:0/1066225283 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 33) v1 ==== 91575+0+0 (secure 0 0 0) 0x7f48d40139f0 con 0x7f48e40fffa0 2024-04-12T09:15:06.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.634+0000 7f48da7fc700 1 --2- 172.21.15.117:0/1066225283 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f48d006d5a0 0x7f48d006fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:06.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.634+0000 7f48da7fc700 1 -- 172.21.15.117:0/1066225283 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f48d408d940 con 0x7f48e40fffa0 2024-04-12T09:15:06.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.634+0000 7f48e9944700 1 --2- 172.21.15.117:0/1066225283 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f48d006d5a0 0x7f48d006fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:06.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.634+0000 7f48e9944700 1 --2- 172.21.15.117:0/1066225283 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f48d006d5a0 0x7f48d006fa50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f48e0006fd0 tx=0x7f48e0008040 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:06.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.638+0000 7f48da7fc700 1 -- 172.21.15.117:0/1066225283 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f48d405b2a0 con 0x7f48e40fffa0 2024-04-12T09:15:06.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.850+0000 7f48ebba8700 1 -- 172.21.15.117:0/1066225283 --> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f48e40f8f40 con 0x7f48d006d5a0 2024-04-12T09:15:06.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.851+0000 7f48da7fc700 1 -- 172.21.15.117:0/1066225283 <== mgr.14694 v2:172.21.15.117:6800/1056729457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f48e40f8f40 con 0x7f48d006d5a0 2024-04-12T09:15:06.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.853+0000 7f48ebba8700 1 -- 172.21.15.117:0/1066225283 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f48d006d5a0 msgr2=0x7f48d006fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:06.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.853+0000 7f48ebba8700 1 --2- 172.21.15.117:0/1066225283 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f48d006d5a0 0x7f48d006fa50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f48e0006fd0 tx=0x7f48e0008040 comp rx=0 tx=0).stop 2024-04-12T09:15:06.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.853+0000 7f48ebba8700 1 -- 172.21.15.117:0/1066225283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48e40fffa0 msgr2=0x7f48e410deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:06.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.853+0000 7f48ebba8700 1 --2- 172.21.15.117:0/1066225283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48e40fffa0 0x7f48e410deb0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f48d400b3b0 tx=0x7f48d4009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:06.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.853+0000 7f48ebba8700 1 -- 172.21.15.117:0/1066225283 shutdown_connections 2024-04-12T09:15:06.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.853+0000 7f48ebba8700 1 --2- 172.21.15.117:0/1066225283 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f48d006d5a0 0x7f48d006fa50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:06.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.853+0000 7f48ebba8700 1 --2- 172.21.15.117:0/1066225283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f48e4066eb0 0x7f48e410d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:06.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.853+0000 7f48ebba8700 1 --2- 172.21.15.117:0/1066225283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48e40fffa0 0x7f48e410deb0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:06.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.853+0000 7f48ebba8700 1 -- 172.21.15.117:0/1066225283 >> 172.21.15.117:0/1066225283 conn(0x7f48e40f7450 msgr2=0x7f48e40f7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:06.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.853+0000 7f48ebba8700 1 -- 172.21.15.117:0/1066225283 shutdown_connections 2024-04-12T09:15:06.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:06.853+0000 7f48ebba8700 1 -- 172.21.15.117:0/1066225283 wait complete. 2024-04-12T09:15:07.227 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:06 smithi117 ceph-mon[29277]: pgmap v75: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:07.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:06 smithi203 ceph-mon[36428]: pgmap v75: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:07.576 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-04-12T09:15:07.874 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:15:08.245 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:07 smithi117 ceph-mon[29277]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:15:08.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:07 smithi203 ceph-mon[36428]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:15:09.291 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:08 smithi117 ceph-mon[29277]: pgmap v76: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:09.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:08 smithi203 ceph-mon[36428]: pgmap v76: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:09.663 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.662+0000 7f4dd881a700 1 -- 172.21.15.117:0/2085643421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dd4102710 msgr2=0x7f4dd40fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:09.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.662+0000 7f4dd881a700 1 --2- 172.21.15.117:0/2085643421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dd4102710 0x7f4dd40fbd80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8004940 tx=0x7f4dc8009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:09.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.662+0000 7f4dd881a700 1 -- 172.21.15.117:0/2085643421 shutdown_connections 2024-04-12T09:15:09.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.662+0000 7f4dd881a700 1 --2- 172.21.15.117:0/2085643421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dd4102710 0x7f4dd40fbd80 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:09.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.662+0000 7f4dd881a700 1 --2- 172.21.15.117:0/2085643421 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4dd4101d70 0x7f4dd4102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:09.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.662+0000 7f4dd881a700 1 -- 172.21.15.117:0/2085643421 >> 172.21.15.117:0/2085643421 conn(0x7f4dd4072bc0 msgr2=0x7f4dd4072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:09.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.662+0000 7f4dd881a700 1 -- 172.21.15.117:0/2085643421 shutdown_connections 2024-04-12T09:15:09.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.662+0000 7f4dd881a700 1 -- 172.21.15.117:0/2085643421 wait complete. 2024-04-12T09:15:09.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.663+0000 7f4dd881a700 1 Processor -- start 2024-04-12T09:15:09.664 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.663+0000 7f4dd881a700 1 -- start start 2024-04-12T09:15:09.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.663+0000 7f4dd881a700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4dd4101d70 0x7f4dd4112aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:09.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.663+0000 7f4dd881a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dd4102710 0x7f4dd4112fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:09.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.663+0000 7f4dd881a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd4113630 con 0x7f4dd4102710 2024-04-12T09:15:09.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.663+0000 7f4dd881a700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd410ca20 con 0x7f4dd4101d70 2024-04-12T09:15:09.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.663+0000 7f4dd1d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dd4102710 0x7f4dd4112fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:09.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.663+0000 7f4dd1d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dd4102710 0x7f4dd4112fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38750/0 (socket says 172.21.15.117:38750) 2024-04-12T09:15:09.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.664+0000 7f4dd1d9b700 1 -- 172.21.15.117:0/1234855502 learned_addr learned my addr 172.21.15.117:0/1234855502 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:15:09.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.664+0000 7f4dd259c700 1 --2- 172.21.15.117:0/1234855502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4dd4101d70 0x7f4dd4112aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:09.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.664+0000 7f4dd1d9b700 1 -- 172.21.15.117:0/1234855502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4dd4101d70 msgr2=0x7f4dd4112aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:09.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.664+0000 7f4dd1d9b700 1 --2- 172.21.15.117:0/1234855502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4dd4101d70 0x7f4dd4112aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:09.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.664+0000 7f4dd1d9b700 1 -- 172.21.15.117:0/1234855502 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc8005040 con 0x7f4dd4102710 2024-04-12T09:15:09.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.664+0000 7f4dd1d9b700 1 --2- 172.21.15.117:0/1234855502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dd4102710 0x7f4dd4112fe0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8009100 tx=0x7f4dc8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:09.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.664+0000 7f4dc2ffd700 1 -- 172.21.15.117:0/1234855502 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dc800e040 con 0x7f4dd4102710 2024-04-12T09:15:09.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.664+0000 7f4dd881a700 1 -- 172.21.15.117:0/1234855502 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd410cca0 con 0x7f4dd4102710 2024-04-12T09:15:09.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.664+0000 7f4dc2ffd700 1 -- 172.21.15.117:0/1234855502 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4dc8009af0 con 0x7f4dd4102710 2024-04-12T09:15:09.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.664+0000 7f4dc2ffd700 1 -- 172.21.15.117:0/1234855502 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dc801c3f0 con 0x7f4dd4102710 2024-04-12T09:15:09.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.664+0000 7f4dd881a700 1 -- 172.21.15.117:0/1234855502 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd410d260 con 0x7f4dd4102710 2024-04-12T09:15:09.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.665+0000 7f4dd881a700 1 -- 172.21.15.117:0/1234855502 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd40fd4c0 con 0x7f4dd4102710 2024-04-12T09:15:09.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.666+0000 7f4dc2ffd700 1 -- 172.21.15.117:0/1234855502 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 33) v1 ==== 91575+0+0 (secure 0 0 0) 0x7f4dc800baf0 con 0x7f4dd4102710 2024-04-12T09:15:09.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.666+0000 7f4dc2ffd700 1 --2- 172.21.15.117:0/1234855502 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f4dbc06f7b0 0x7f4dbc071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:09.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.666+0000 7f4dc2ffd700 1 -- 172.21.15.117:0/1234855502 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f4dc808dd30 con 0x7f4dd4102710 2024-04-12T09:15:09.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.666+0000 7f4dd259c700 1 --2- 172.21.15.117:0/1234855502 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f4dbc06f7b0 0x7f4dbc071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:09.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.667+0000 7f4dd259c700 1 --2- 172.21.15.117:0/1234855502 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f4dbc06f7b0 0x7f4dbc071c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4004eb0 tx=0x7f4dc400b040 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:09.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.671+0000 7f4dc2ffd700 1 -- 172.21.15.117:0/1234855502 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f4dc805b7b0 con 0x7f4dd4102710 2024-04-12T09:15:09.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.946+0000 7f4dd881a700 1 -- 172.21.15.117:0/1234855502 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4dd4108e50 con 0x7f4dd4102710 2024-04-12T09:15:09.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.946+0000 7f4dc2ffd700 1 -- 172.21.15.117:0/1234855502 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f4dc805b340 con 0x7f4dd4102710 2024-04-12T09:15:09.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.948+0000 7f4dd881a700 1 -- 172.21.15.117:0/1234855502 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f4dbc06f7b0 msgr2=0x7f4dbc071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:09.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.948+0000 7f4dd881a700 1 --2- 172.21.15.117:0/1234855502 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f4dbc06f7b0 0x7f4dbc071c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4004eb0 tx=0x7f4dc400b040 comp rx=0 tx=0).stop 2024-04-12T09:15:09.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.948+0000 7f4dd881a700 1 -- 172.21.15.117:0/1234855502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dd4102710 msgr2=0x7f4dd4112fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:09.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.948+0000 7f4dd881a700 1 --2- 172.21.15.117:0/1234855502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dd4102710 0x7f4dd4112fe0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8009100 tx=0x7f4dc8009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:09.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.948+0000 7f4dd881a700 1 -- 172.21.15.117:0/1234855502 shutdown_connections 2024-04-12T09:15:09.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.948+0000 7f4dd881a700 1 --2- 172.21.15.117:0/1234855502 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f4dbc06f7b0 0x7f4dbc071c60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:09.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.948+0000 7f4dd881a700 1 --2- 172.21.15.117:0/1234855502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4dd4101d70 0x7f4dd4112aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:09.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.948+0000 7f4dd881a700 1 --2- 172.21.15.117:0/1234855502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dd4102710 0x7f4dd4112fe0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:09.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.948+0000 7f4dd881a700 1 -- 172.21.15.117:0/1234855502 >> 172.21.15.117:0/1234855502 conn(0x7f4dd4072bc0 msgr2=0x7f4dd40fb080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:09.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.948+0000 7f4dd881a700 1 -- 172.21.15.117:0/1234855502 shutdown_connections 2024-04-12T09:15:09.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:09.948+0000 7f4dd881a700 1 -- 172.21.15.117:0/1234855502 wait complete. 2024-04-12T09:15:09.959 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:15:10.317 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:09 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/1234855502' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:15:10.317 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:09 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:15:10.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:09 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/1234855502' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:15:10.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:09 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:15:10.651 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-04-12T09:15:10.910 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:15:11.254 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:10 smithi117 ceph-mon[29277]: pgmap v77: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:11.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:10 smithi203 ceph-mon[36428]: pgmap v77: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:12.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.507+0000 7f9780336700 1 -- 172.21.15.117:0/2301406919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9778102e00 msgr2=0x7f97781031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:12.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.507+0000 7f9780336700 1 --2- 172.21.15.117:0/2301406919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9778102e00 0x7f97781031d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9774004940 tx=0x7f9774009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:12.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.507+0000 7f9780336700 1 -- 172.21.15.117:0/2301406919 shutdown_connections 2024-04-12T09:15:12.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.507+0000 7f9780336700 1 --2- 172.21.15.117:0/2301406919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97781037a0 0x7f97780fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:12.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.507+0000 7f9780336700 1 --2- 172.21.15.117:0/2301406919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9778102e00 0x7f97781031d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:12.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.507+0000 7f9780336700 1 -- 172.21.15.117:0/2301406919 >> 172.21.15.117:0/2301406919 conn(0x7f97780f89b0 msgr2=0x7f97780fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:12.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.507+0000 7f9780336700 1 -- 172.21.15.117:0/2301406919 shutdown_connections 2024-04-12T09:15:12.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.507+0000 7f9780336700 1 -- 172.21.15.117:0/2301406919 wait complete. 2024-04-12T09:15:12.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.508+0000 7f9780336700 1 Processor -- start 2024-04-12T09:15:12.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.508+0000 7f9780336700 1 -- start start 2024-04-12T09:15:12.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.508+0000 7f9780336700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9778102e00 0x7f9778113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:12.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.508+0000 7f9780336700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97781037a0 0x7f97781140e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:12.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.508+0000 7f9780336700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9778114730 con 0x7f9778102e00 2024-04-12T09:15:12.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.508+0000 7f9780336700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977810db70 con 0x7f97781037a0 2024-04-12T09:15:12.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.508+0000 7f977e0d2700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9778102e00 0x7f9778113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:12.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.508+0000 7f977e0d2700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9778102e00 0x7f9778113ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38764/0 (socket says 172.21.15.117:38764) 2024-04-12T09:15:12.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.508+0000 7f977e0d2700 1 -- 172.21.15.117:0/4197040380 learned_addr learned my addr 172.21.15.117:0/4197040380 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:15:12.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.508+0000 7f977e0d2700 1 -- 172.21.15.117:0/4197040380 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97781037a0 msgr2=0x7f97781140e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:12.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.508+0000 7f977e0d2700 1 --2- 172.21.15.117:0/4197040380 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97781037a0 0x7f97781140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:12.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.508+0000 7f977e0d2700 1 -- 172.21.15.117:0/4197040380 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9774005040 con 0x7f9778102e00 2024-04-12T09:15:12.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.508+0000 7f977e0d2700 1 --2- 172.21.15.117:0/4197040380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9778102e00 0x7f9778113ba0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f977400b3b0 tx=0x7f9774009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:12.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.508+0000 7f976effd700 1 -- 172.21.15.117:0/4197040380 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f977400e040 con 0x7f9778102e00 2024-04-12T09:15:12.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.509+0000 7f9780336700 1 -- 172.21.15.117:0/4197040380 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977810ddf0 con 0x7f9778102e00 2024-04-12T09:15:12.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.509+0000 7f976effd700 1 -- 172.21.15.117:0/4197040380 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f977400bbc0 con 0x7f9778102e00 2024-04-12T09:15:12.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.509+0000 7f976effd700 1 -- 172.21.15.117:0/4197040380 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f977401c3f0 con 0x7f9778102e00 2024-04-12T09:15:12.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.509+0000 7f9780336700 1 -- 172.21.15.117:0/4197040380 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977810e3b0 con 0x7f9778102e00 2024-04-12T09:15:12.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.509+0000 7f9780336700 1 -- 172.21.15.117:0/4197040380 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9778100110 con 0x7f9778102e00 2024-04-12T09:15:12.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.510+0000 7f976effd700 1 -- 172.21.15.117:0/4197040380 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 33) v1 ==== 91575+0+0 (secure 0 0 0) 0x7f977400bd30 con 0x7f9778102e00 2024-04-12T09:15:12.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.510+0000 7f976effd700 1 --2- 172.21.15.117:0/4197040380 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f976406d5a0 0x7f976406fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:12.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.510+0000 7f976effd700 1 -- 172.21.15.117:0/4197040380 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f977408de50 con 0x7f9778102e00 2024-04-12T09:15:12.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.510+0000 7f977d8d1700 1 --2- 172.21.15.117:0/4197040380 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f976406d5a0 0x7f976406fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:12.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.511+0000 7f977d8d1700 1 --2- 172.21.15.117:0/4197040380 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f976406d5a0 0x7f976406fa50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f977810ece0 tx=0x7f9768007d40 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:12.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.515+0000 7f976effd700 1 -- 172.21.15.117:0/4197040380 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f977405b7b0 con 0x7f9778102e00 2024-04-12T09:15:12.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.787+0000 7f9780336700 1 -- 172.21.15.117:0/4197040380 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f977810f220 con 0x7f9778102e00 2024-04-12T09:15:12.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.788+0000 7f976effd700 1 -- 172.21.15.117:0/4197040380 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f977405b340 con 0x7f9778102e00 2024-04-12T09:15:12.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.790+0000 7f9780336700 1 -- 172.21.15.117:0/4197040380 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f976406d5a0 msgr2=0x7f976406fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:12.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.790+0000 7f9780336700 1 --2- 172.21.15.117:0/4197040380 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f976406d5a0 0x7f976406fa50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f977810ece0 tx=0x7f9768007d40 comp rx=0 tx=0).stop 2024-04-12T09:15:12.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.790+0000 7f9780336700 1 -- 172.21.15.117:0/4197040380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9778102e00 msgr2=0x7f9778113ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:12.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.790+0000 7f9780336700 1 --2- 172.21.15.117:0/4197040380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9778102e00 0x7f9778113ba0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f977400b3b0 tx=0x7f9774009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:12.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.790+0000 7f9780336700 1 -- 172.21.15.117:0/4197040380 shutdown_connections 2024-04-12T09:15:12.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.790+0000 7f9780336700 1 --2- 172.21.15.117:0/4197040380 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f976406d5a0 0x7f976406fa50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:12.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.790+0000 7f9780336700 1 --2- 172.21.15.117:0/4197040380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9778102e00 0x7f9778113ba0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:12.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.790+0000 7f9780336700 1 --2- 172.21.15.117:0/4197040380 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97781037a0 0x7f97781140e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:12.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.790+0000 7f9780336700 1 -- 172.21.15.117:0/4197040380 >> 172.21.15.117:0/4197040380 conn(0x7f97780f89b0 msgr2=0x7f97781073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:12.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.790+0000 7f9780336700 1 -- 172.21.15.117:0/4197040380 shutdown_connections 2024-04-12T09:15:12.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:12.790+0000 7f9780336700 1 -- 172.21.15.117:0/4197040380 wait complete. 2024-04-12T09:15:12.800 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)" 2024-04-12T09:15:13.163 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:12 smithi117 ceph-mon[29277]: pgmap v78: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:13.163 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:12 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/4197040380' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:15:13.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:12 smithi203 ceph-mon[36428]: pgmap v78: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:13.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:12 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/4197040380' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:15:13.458 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-04-12T09:15:13.719 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:15:15.116 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:14 smithi117 ceph-mon[29277]: pgmap v79: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:15.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:14 smithi203 ceph-mon[36428]: pgmap v79: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:15.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.329+0000 7fedd583a700 1 -- 172.21.15.117:0/731153644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedd00fde80 msgr2=0x7fedd00fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:15.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.329+0000 7fedd583a700 1 --2- 172.21.15.117:0/731153644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedd00fde80 0x7fedd00fe250 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fedc0004940 tx=0x7fedc0009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:15.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.329+0000 7fedd583a700 1 -- 172.21.15.117:0/731153644 shutdown_connections 2024-04-12T09:15:15.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.329+0000 7fedd583a700 1 --2- 172.21.15.117:0/731153644 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedd00fe820 0x7fedd0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:15.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.329+0000 7fedd583a700 1 --2- 172.21.15.117:0/731153644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedd00fde80 0x7fedd00fe250 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:15.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.329+0000 7fedd583a700 1 -- 172.21.15.117:0/731153644 >> 172.21.15.117:0/731153644 conn(0x7fedd00f7870 msgr2=0x7fedd00f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:15.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.329+0000 7fedd583a700 1 -- 172.21.15.117:0/731153644 shutdown_connections 2024-04-12T09:15:15.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.329+0000 7fedd583a700 1 -- 172.21.15.117:0/731153644 wait complete. 2024-04-12T09:15:15.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.329+0000 7fedd583a700 1 Processor -- start 2024-04-12T09:15:15.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.330+0000 7fedd583a700 1 -- start start 2024-04-12T09:15:15.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.330+0000 7fedd583a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedd00fde80 0x7fedd0115b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:15.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.330+0000 7fedd583a700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedd00fe820 0x7fedd0116040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:15.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.330+0000 7fedd583a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd0116690 con 0x7fedd00fde80 2024-04-12T09:15:15.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.330+0000 7fedd583a700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd010fc70 con 0x7fedd00fe820 2024-04-12T09:15:15.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.330+0000 7fedceffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedd00fde80 0x7fedd0115b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:15.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.330+0000 7fedceffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedd00fde80 0x7fedd0115b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38788/0 (socket says 172.21.15.117:38788) 2024-04-12T09:15:15.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.330+0000 7fedceffd700 1 -- 172.21.15.117:0/509988667 learned_addr learned my addr 172.21.15.117:0/509988667 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:15:15.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.330+0000 7fedc67fc700 1 --2- 172.21.15.117:0/509988667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedd00fe820 0x7fedd0116040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:15.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.330+0000 7fedceffd700 1 -- 172.21.15.117:0/509988667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedd00fe820 msgr2=0x7fedd0116040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:15.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.330+0000 7fedceffd700 1 --2- 172.21.15.117:0/509988667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedd00fe820 0x7fedd0116040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:15.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.330+0000 7fedceffd700 1 -- 172.21.15.117:0/509988667 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc0005040 con 0x7fedd00fde80 2024-04-12T09:15:15.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.330+0000 7fedc67fc700 1 --2- 172.21.15.117:0/509988667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedd00fe820 0x7fedd0116040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T09:15:15.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.330+0000 7fedceffd700 1 --2- 172.21.15.117:0/509988667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedd00fde80 0x7fedd0115b00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009380 tx=0x7fedc0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:15.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.331+0000 7fedc7fff700 1 -- 172.21.15.117:0/509988667 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedc000e040 con 0x7fedd00fde80 2024-04-12T09:15:15.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.331+0000 7fedc7fff700 1 -- 172.21.15.117:0/509988667 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fedc0009af0 con 0x7fedd00fde80 2024-04-12T09:15:15.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.331+0000 7fedc7fff700 1 -- 172.21.15.117:0/509988667 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedc001c630 con 0x7fedd00fde80 2024-04-12T09:15:15.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.331+0000 7fedd583a700 1 -- 172.21.15.117:0/509988667 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd010ff50 con 0x7fedd00fde80 2024-04-12T09:15:15.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.331+0000 7fedd583a700 1 -- 172.21.15.117:0/509988667 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd0110490 con 0x7fedd00fde80 2024-04-12T09:15:15.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.332+0000 7fedd583a700 1 -- 172.21.15.117:0/509988667 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd0066b10 con 0x7fedd00fde80 2024-04-12T09:15:15.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.332+0000 7fedc7fff700 1 -- 172.21.15.117:0/509988667 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 33) v1 ==== 91575+0+0 (secure 0 0 0) 0x7fedc000bbc0 con 0x7fedd00fde80 2024-04-12T09:15:15.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.333+0000 7fedc7fff700 1 --2- 172.21.15.117:0/509988667 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fedbc06d5a0 0x7fedbc06fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:15.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.333+0000 7fedc67fc700 1 --2- 172.21.15.117:0/509988667 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fedbc06d5a0 0x7fedbc06fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:15.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.333+0000 7fedc7fff700 1 -- 172.21.15.117:0/509988667 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fedc008dde0 con 0x7fedd00fde80 2024-04-12T09:15:15.335 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.333+0000 7fedc67fc700 1 --2- 172.21.15.117:0/509988667 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fedbc06d5a0 0x7fedbc06fa50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fedb8009fd0 tx=0x7fedb800b040 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:15.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.337+0000 7fedc7fff700 1 -- 172.21.15.117:0/509988667 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7fedc005b860 con 0x7fedd00fde80 2024-04-12T09:15:15.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.615+0000 7fedd583a700 1 -- 172.21.15.117:0/509988667 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fedd0111150 con 0x7fedd00fde80 2024-04-12T09:15:15.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.615+0000 7fedc7fff700 1 -- 172.21.15.117:0/509988667 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fedc005b3f0 con 0x7fedd00fde80 2024-04-12T09:15:15.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.617+0000 7fedd583a700 1 -- 172.21.15.117:0/509988667 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fedbc06d5a0 msgr2=0x7fedbc06fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:15.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.617+0000 7fedd583a700 1 --2- 172.21.15.117:0/509988667 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fedbc06d5a0 0x7fedbc06fa50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fedb8009fd0 tx=0x7fedb800b040 comp rx=0 tx=0).stop 2024-04-12T09:15:15.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.617+0000 7fedd583a700 1 -- 172.21.15.117:0/509988667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedd00fde80 msgr2=0x7fedd0115b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:15.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.617+0000 7fedd583a700 1 --2- 172.21.15.117:0/509988667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedd00fde80 0x7fedd0115b00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009380 tx=0x7fedc0009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:15.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.617+0000 7fedd583a700 1 -- 172.21.15.117:0/509988667 shutdown_connections 2024-04-12T09:15:15.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.617+0000 7fedd583a700 1 --2- 172.21.15.117:0/509988667 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fedbc06d5a0 0x7fedbc06fa50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:15.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.617+0000 7fedd583a700 1 --2- 172.21.15.117:0/509988667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedd00fde80 0x7fedd0115b00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:15.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.617+0000 7fedd583a700 1 --2- 172.21.15.117:0/509988667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedd00fe820 0x7fedd0116040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:15.622 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.617+0000 7fedd583a700 1 -- 172.21.15.117:0/509988667 >> 172.21.15.117:0/509988667 conn(0x7fedd00f7870 msgr2=0x7fedd00f8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:15.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.617+0000 7fedd583a700 1 -- 172.21.15.117:0/509988667 shutdown_connections 2024-04-12T09:15:15.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:15.618+0000 7fedd583a700 1 -- 172.21.15.117:0/509988667 wait complete. 2024-04-12T09:15:15.628 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:15:16.220 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:15 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/509988667' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:15:16.243 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-04-12T09:15:16.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:15 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/509988667' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:15:16.497 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:15:17.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:17 smithi203 ceph-mon[36428]: pgmap v80: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:17.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:16 smithi117 ceph-mon[29277]: pgmap v80: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:18.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.124+0000 7f79414b2700 1 -- 172.21.15.117:0/3876099511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f793c1037b0 msgr2=0x7f793c0fce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:18.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.124+0000 7f79414b2700 1 --2- 172.21.15.117:0/3876099511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f793c1037b0 0x7f793c0fce20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7924004940 tx=0x7f7924009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:18.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.124+0000 7f79414b2700 1 -- 172.21.15.117:0/3876099511 shutdown_connections 2024-04-12T09:15:18.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.124+0000 7f79414b2700 1 --2- 172.21.15.117:0/3876099511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f793c1037b0 0x7f793c0fce20 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:18.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.124+0000 7f79414b2700 1 --2- 172.21.15.117:0/3876099511 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f793c102e10 0x7f793c1031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:18.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.124+0000 7f79414b2700 1 -- 172.21.15.117:0/3876099511 >> 172.21.15.117:0/3876099511 conn(0x7f793c0f89a0 msgr2=0x7f793c0fadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:18.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.124+0000 7f79414b2700 1 -- 172.21.15.117:0/3876099511 shutdown_connections 2024-04-12T09:15:18.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.124+0000 7f79414b2700 1 -- 172.21.15.117:0/3876099511 wait complete. 2024-04-12T09:15:18.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.124+0000 7f79414b2700 1 Processor -- start 2024-04-12T09:15:18.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.125+0000 7f79414b2700 1 -- start start 2024-04-12T09:15:18.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.125+0000 7f79414b2700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f793c102e10 0x7f793c113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:18.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.125+0000 7f79414b2700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f793c1037b0 0x7f793c1140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:18.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.125+0000 7f79414b2700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793c114710 con 0x7f793c1037b0 2024-04-12T09:15:18.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.125+0000 7f79414b2700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793c10db20 con 0x7f793c102e10 2024-04-12T09:15:18.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.125+0000 7f79327fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f793c1037b0 0x7f793c1140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:18.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.125+0000 7f79327fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f793c1037b0 0x7f793c1140c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38806/0 (socket says 172.21.15.117:38806) 2024-04-12T09:15:18.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.125+0000 7f79327fc700 1 -- 172.21.15.117:0/1722071163 learned_addr learned my addr 172.21.15.117:0/1722071163 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:15:18.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.125+0000 7f793affd700 1 --2- 172.21.15.117:0/1722071163 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f793c102e10 0x7f793c113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:18.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.125+0000 7f79327fc700 1 -- 172.21.15.117:0/1722071163 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f793c102e10 msgr2=0x7f793c113b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:18.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.125+0000 7f79327fc700 1 --2- 172.21.15.117:0/1722071163 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f793c102e10 0x7f793c113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:18.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.125+0000 7f79327fc700 1 -- 172.21.15.117:0/1722071163 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7924005040 con 0x7f793c1037b0 2024-04-12T09:15:18.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.126+0000 7f79327fc700 1 --2- 172.21.15.117:0/1722071163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f793c1037b0 0x7f793c1140c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7924009100 tx=0x7f7924009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:18.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.126+0000 7f7933fff700 1 -- 172.21.15.117:0/1722071163 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f792400e040 con 0x7f793c1037b0 2024-04-12T09:15:18.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.126+0000 7f79414b2700 1 -- 172.21.15.117:0/1722071163 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f793c10dda0 con 0x7f793c1037b0 2024-04-12T09:15:18.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.126+0000 7f7933fff700 1 -- 172.21.15.117:0/1722071163 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7924013420 con 0x7f793c1037b0 2024-04-12T09:15:18.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.126+0000 7f7933fff700 1 -- 172.21.15.117:0/1722071163 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f792401c610 con 0x7f793c1037b0 2024-04-12T09:15:18.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.126+0000 7f79414b2700 1 -- 172.21.15.117:0/1722071163 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f793c10e360 con 0x7f793c1037b0 2024-04-12T09:15:18.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.127+0000 7f79414b2700 1 -- 172.21.15.117:0/1722071163 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f793c1052e0 con 0x7f793c1037b0 2024-04-12T09:15:18.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.127+0000 7f7933fff700 1 -- 172.21.15.117:0/1722071163 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 33) v1 ==== 91575+0+0 (secure 0 0 0) 0x7f7924013590 con 0x7f793c1037b0 2024-04-12T09:15:18.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.128+0000 7f7933fff700 1 --2- 172.21.15.117:0/1722071163 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f792806d5a0 0x7f792806fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:18.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.128+0000 7f7933fff700 1 -- 172.21.15.117:0/1722071163 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f792408de70 con 0x7f793c1037b0 2024-04-12T09:15:18.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.128+0000 7f793affd700 1 --2- 172.21.15.117:0/1722071163 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f792806d5a0 0x7f792806fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:18.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.128+0000 7f793affd700 1 --2- 172.21.15.117:0/1722071163 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f792806d5a0 0x7f792806fa50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f792c004cc0 tx=0x7f792c00b040 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:18.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.132+0000 7f7933fff700 1 -- 172.21.15.117:0/1722071163 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f7924057d20 con 0x7f793c1037b0 2024-04-12T09:15:18.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:18.346+0000 7f79414b2700 1 -- 172.21.15.117:0/1722071163 --> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:b277feb2c7beb4597d8ecc39d58d5c36b81f613a", "target": ["mon-mgr", ""]}) v1 -- 0x7f793c05f690 con 0x7f792806d5a0 2024-04-12T09:15:19.285 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:19 smithi117 ceph-mon[29277]: pgmap v81: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:19.285 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:19 smithi117 ceph-mon[29277]: from='client.14822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:b277feb2c7beb4597d8ecc39d58d5c36b81f613a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:15:19.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:19 smithi203 ceph-mon[36428]: pgmap v81: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:19.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:19 smithi203 ceph-mon[36428]: from='client.14822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:b277feb2c7beb4597d8ecc39d58d5c36b81f613a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:15:20.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:20.517+0000 7f7933fff700 1 -- 172.21.15.117:0/1722071163 <== mgr.14694 v2:172.21.15.117:6800/1056729457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5092 (secure 0 0 0) 0x7f793c05f690 con 0x7f792806d5a0 2024-04-12T09:15:20.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:20.519+0000 7f79414b2700 1 -- 172.21.15.117:0/1722071163 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f792806d5a0 msgr2=0x7f792806fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:20.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:20.519+0000 7f79414b2700 1 --2- 172.21.15.117:0/1722071163 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f792806d5a0 0x7f792806fa50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f792c004cc0 tx=0x7f792c00b040 comp rx=0 tx=0).stop 2024-04-12T09:15:20.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:20.519+0000 7f79414b2700 1 -- 172.21.15.117:0/1722071163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f793c1037b0 msgr2=0x7f793c1140c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:20.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:20.519+0000 7f79414b2700 1 --2- 172.21.15.117:0/1722071163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f793c1037b0 0x7f793c1140c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7924009100 tx=0x7f7924009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:20.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:20.519+0000 7f79414b2700 1 -- 172.21.15.117:0/1722071163 shutdown_connections 2024-04-12T09:15:20.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:20.519+0000 7f79414b2700 1 --2- 172.21.15.117:0/1722071163 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f792806d5a0 0x7f792806fa50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:20.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:20.519+0000 7f79414b2700 1 --2- 172.21.15.117:0/1722071163 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f793c102e10 0x7f793c113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:20.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:20.519+0000 7f79414b2700 1 --2- 172.21.15.117:0/1722071163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f793c1037b0 0x7f793c1140c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:20.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:20.519+0000 7f79414b2700 1 -- 172.21.15.117:0/1722071163 >> 172.21.15.117:0/1722071163 conn(0x7f793c0f89a0 msgr2=0x7f793c102220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:20.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:20.519+0000 7f79414b2700 1 -- 172.21.15.117:0/1722071163 shutdown_connections 2024-04-12T09:15:20.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:20.519+0000 7f79414b2700 1 -- 172.21.15.117:0/1722071163 wait complete. 2024-04-12T09:15:20.530 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:15:21.134 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'ceph orch ps' 2024-04-12T09:15:21.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:21 smithi203 ceph-mon[36428]: pgmap v82: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:21.391 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:15:21.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:21 smithi117 ceph-mon[29277]: pgmap v82: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:22.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.961+0000 7f9968dfe700 1 -- 172.21.15.117:0/519256876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9964101d70 msgr2=0x7f9964102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:22.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.961+0000 7f9968dfe700 1 --2- 172.21.15.117:0/519256876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9964101d70 0x7f9964102140 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9958004940 tx=0x7f9958009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:22.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.961+0000 7f9968dfe700 1 -- 172.21.15.117:0/519256876 shutdown_connections 2024-04-12T09:15:22.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.961+0000 7f9968dfe700 1 --2- 172.21.15.117:0/519256876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9964102710 0x7f99640fbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:22.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.961+0000 7f9968dfe700 1 --2- 172.21.15.117:0/519256876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9964101d70 0x7f9964102140 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:22.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.961+0000 7f9968dfe700 1 -- 172.21.15.117:0/519256876 >> 172.21.15.117:0/519256876 conn(0x7f9964072bc0 msgr2=0x7f9964072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:22.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.961+0000 7f9968dfe700 1 -- 172.21.15.117:0/519256876 shutdown_connections 2024-04-12T09:15:22.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.961+0000 7f9968dfe700 1 -- 172.21.15.117:0/519256876 wait complete. 2024-04-12T09:15:22.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.962+0000 7f9968dfe700 1 Processor -- start 2024-04-12T09:15:22.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.962+0000 7f9968dfe700 1 -- start start 2024-04-12T09:15:22.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.962+0000 7f9968dfe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9964101d70 0x7f9964115d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:22.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.962+0000 7f9968dfe700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9964102710 0x7f99641162b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:22.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.962+0000 7f9968dfe700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9964116990 con 0x7f9964101d70 2024-04-12T09:15:22.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.962+0000 7f9968dfe700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996410fcd0 con 0x7f9964102710 2024-04-12T09:15:22.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.962+0000 7f996259c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9964101d70 0x7f9964115d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:22.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.962+0000 7f996259c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9964101d70 0x7f9964115d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57208/0 (socket says 172.21.15.117:57208) 2024-04-12T09:15:22.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.962+0000 7f996259c700 1 -- 172.21.15.117:0/1247163524 learned_addr learned my addr 172.21.15.117:0/1247163524 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:15:22.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.962+0000 7f996259c700 1 -- 172.21.15.117:0/1247163524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9964102710 msgr2=0x7f99641162b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:22.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.962+0000 7f996259c700 1 --2- 172.21.15.117:0/1247163524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9964102710 0x7f99641162b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:22.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.962+0000 7f996259c700 1 -- 172.21.15.117:0/1247163524 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9958005040 con 0x7f9964101d70 2024-04-12T09:15:22.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.962+0000 7f996259c700 1 --2- 172.21.15.117:0/1247163524 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9964101d70 0x7f9964115d70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f995800b3b0 tx=0x7f9958009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:22.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.962+0000 7f9952ffd700 1 -- 172.21.15.117:0/1247163524 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f995800e040 con 0x7f9964101d70 2024-04-12T09:15:22.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.963+0000 7f9952ffd700 1 -- 172.21.15.117:0/1247163524 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f995800bbc0 con 0x7f9964101d70 2024-04-12T09:15:22.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.963+0000 7f9968dfe700 1 -- 172.21.15.117:0/1247163524 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f996410fef0 con 0x7f9964101d70 2024-04-12T09:15:22.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.963+0000 7f9952ffd700 1 -- 172.21.15.117:0/1247163524 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f995801c3f0 con 0x7f9964101d70 2024-04-12T09:15:22.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.963+0000 7f9968dfe700 1 -- 172.21.15.117:0/1247163524 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99641104b0 con 0x7f9964101d70 2024-04-12T09:15:22.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.963+0000 7f9968dfe700 1 -- 172.21.15.117:0/1247163524 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99640fd4c0 con 0x7f9964101d70 2024-04-12T09:15:22.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.964+0000 7f9952ffd700 1 -- 172.21.15.117:0/1247163524 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 33) v1 ==== 91575+0+0 (secure 0 0 0) 0x7f995800bd30 con 0x7f9964101d70 2024-04-12T09:15:22.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.964+0000 7f9952ffd700 1 --2- 172.21.15.117:0/1247163524 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f994c06d5a0 0x7f994c06fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:22.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.965+0000 7f9952ffd700 1 -- 172.21.15.117:0/1247163524 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f995808de60 con 0x7f9964101d70 2024-04-12T09:15:22.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.965+0000 7f9961d9b700 1 --2- 172.21.15.117:0/1247163524 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f994c06d5a0 0x7f994c06fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:22.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.965+0000 7f9961d9b700 1 --2- 172.21.15.117:0/1247163524 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f994c06d5a0 0x7f994c06fa50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9954006fd0 tx=0x7f9954006db0 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:22.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:22.969+0000 7f9952ffd700 1 -- 172.21.15.117:0/1247163524 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f995805b7c0 con 0x7f9964101d70 2024-04-12T09:15:23.174 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:23.173+0000 7f9968dfe700 1 -- 172.21.15.117:0/1247163524 --> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9964108f80 con 0x7f994c06d5a0 2024-04-12T09:15:23.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:23.183+0000 7f9952ffd700 1 -- 172.21.15.117:0/1247163524 <== mgr.14694 v2:172.21.15.117:6800/1056729457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f9954009dd0 con 0x7f994c06d5a0 2024-04-12T09:15:23.184 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:15:23.184 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 running (62s) 40s ago 12m 16.7M - 0.25.0 c8568f914cd2 204687f21ed7 2024-04-12T09:15:23.184 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (12m) 40s ago 12m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad 1e9f2c6a4491 2024-04-12T09:15:23.184 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (11m) 94s ago 11m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad e42da3f6e517 2024-04-12T09:15:23.184 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 running (46s) 40s ago 12m 52.2M - 9.4.12 2bacad6d85d8 a7b102216886 2024-04-12T09:15:23.184 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (7m) 40s ago 6m 141M - 17.2.7-827-gd3b5060a 21de9b7369ad de062e2c10e7 2024-04-12T09:15:23.184 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 running (7m) 40s ago 7m 13.0M - 17.2.7-827-gd3b5060a 21de9b7369ad 1e82c6241a18 2024-04-12T09:15:23.185 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (6m) 94s ago 6m 15.5M - 17.2.7-827-gd3b5060a 21de9b7369ad b05228e997f7 2024-04-12T09:15:23.185 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (7m) 94s ago 7m 16.1M - 17.2.7-827-gd3b5060a 21de9b7369ad 6d7f82c072c7 2024-04-12T09:15:23.185 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:8443,9283,8765 running (2m) 40s ago 13m 511M - 19.0.0-2053-gb277feb2 668895944f0e fee613d05ab7 2024-04-12T09:15:23.185 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283,8765 running (117s) 94s ago 11m 448M - 19.0.0-2053-gb277feb2 668895944f0e c793944c3e16 2024-04-12T09:15:23.185 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (13m) 40s ago 13m 53.1M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad f9d5f7ac5270 2024-04-12T09:15:23.185 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (11m) 94s ago 11m 42.4M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad 17c0db49bb16 2024-04-12T09:15:23.185 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 running (102s) 40s ago 12m 16.1M - 1.5.0 0da6a335fe13 c692bed9f6c7 2024-04-12T09:15:23.185 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (98s) 94s ago 11m 3351k - 1.5.0 0da6a335fe13 f3b5a470f545 2024-04-12T09:15:23.185 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (10m) 40s ago 10m 223M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 77040a2498f3 2024-04-12T09:15:23.185 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (10m) 40s ago 10m 234M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 8f9dbf0274ed 2024-04-12T09:15:23.185 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (9m) 40s ago 9m 200M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 339c5a80d1dd 2024-04-12T09:15:23.185 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (9m) 94s ago 9m 272M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad fb87d616bae3 2024-04-12T09:15:23.185 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (9m) 94s ago 9m 245M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad c873826a2dea 2024-04-12T09:15:23.185 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (8m) 94s ago 8m 219M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad 69cb7c22f002 2024-04-12T09:15:23.186 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 running (80s) 40s ago 11m 45.1M - 2.43.0 a07b618ecd1d 43ce588d82cc 2024-04-12T09:15:23.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:23.185+0000 7f9968dfe700 1 -- 172.21.15.117:0/1247163524 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f994c06d5a0 msgr2=0x7f994c06fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:23.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:23.185+0000 7f9968dfe700 1 --2- 172.21.15.117:0/1247163524 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f994c06d5a0 0x7f994c06fa50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9954006fd0 tx=0x7f9954006db0 comp rx=0 tx=0).stop 2024-04-12T09:15:23.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:23.185+0000 7f9968dfe700 1 -- 172.21.15.117:0/1247163524 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9964101d70 msgr2=0x7f9964115d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:23.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:23.185+0000 7f9968dfe700 1 --2- 172.21.15.117:0/1247163524 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9964101d70 0x7f9964115d70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f995800b3b0 tx=0x7f9958009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:23.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:23.185+0000 7f9968dfe700 1 -- 172.21.15.117:0/1247163524 shutdown_connections 2024-04-12T09:15:23.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:23.185+0000 7f9968dfe700 1 --2- 172.21.15.117:0/1247163524 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f994c06d5a0 0x7f994c06fa50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:23.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:23.185+0000 7f9968dfe700 1 --2- 172.21.15.117:0/1247163524 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9964101d70 0x7f9964115d70 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:23.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:23.185+0000 7f9968dfe700 1 --2- 172.21.15.117:0/1247163524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9964102710 0x7f99641162b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:23.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:23.185+0000 7f9968dfe700 1 -- 172.21.15.117:0/1247163524 >> 172.21.15.117:0/1247163524 conn(0x7f9964072bc0 msgr2=0x7f9964065910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:23.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:23.185+0000 7f9968dfe700 1 -- 172.21.15.117:0/1247163524 shutdown_connections 2024-04-12T09:15:23.187 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:23.185+0000 7f9968dfe700 1 -- 172.21.15.117:0/1247163524 wait complete. 2024-04-12T09:15:23.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:23 smithi203 ceph-mon[36428]: pgmap v83: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:23.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:23 smithi117 ceph-mon[29277]: pgmap v83: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:23.856 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-12T09:15:23.857 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi117.front.sepia.ceph.com 2024-04-12T09:15:23.857 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-04-12T09:15:24.115 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:15:24.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:24 smithi117 ceph-mon[29277]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:15:24.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:24 smithi203 ceph-mon[36428]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:15:25.188 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:25 smithi117 ceph-mon[29277]: pgmap v84: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:25.188 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:25 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:15:25.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:25 smithi203 ceph-mon[36428]: pgmap v84: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:25.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:25 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:15:25.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.692+0000 7f3478050700 1 -- 172.21.15.117:0/3241061717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3470101ce0 msgr2=0x7f34701020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:25.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.692+0000 7f3478050700 1 --2- 172.21.15.117:0/3241061717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3470101ce0 0x7f34701020b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f346c004940 tx=0x7f346c009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:25.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.692+0000 7f3478050700 1 -- 172.21.15.117:0/3241061717 shutdown_connections 2024-04-12T09:15:25.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.692+0000 7f3478050700 1 --2- 172.21.15.117:0/3241061717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3470102680 0x7f34700fbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:25.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.692+0000 7f3478050700 1 --2- 172.21.15.117:0/3241061717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3470101ce0 0x7f34701020b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:25.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.692+0000 7f3478050700 1 -- 172.21.15.117:0/3241061717 >> 172.21.15.117:0/3241061717 conn(0x7f34700f7870 msgr2=0x7f34700f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:25.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.692+0000 7f3478050700 1 -- 172.21.15.117:0/3241061717 shutdown_connections 2024-04-12T09:15:25.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.692+0000 7f3478050700 1 -- 172.21.15.117:0/3241061717 wait complete. 2024-04-12T09:15:25.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.693+0000 7f3478050700 1 Processor -- start 2024-04-12T09:15:25.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.693+0000 7f3478050700 1 -- start start 2024-04-12T09:15:25.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.693+0000 7f3478050700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3470101ce0 0x7f34701138d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:25.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.693+0000 7f3478050700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3470102680 0x7f3470113e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:25.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.693+0000 7f3478050700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3470114460 con 0x7f3470102680 2024-04-12T09:15:25.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.693+0000 7f3478050700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347010da60 con 0x7f3470101ce0 2024-04-12T09:15:25.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.693+0000 7f34755eb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3470102680 0x7f3470113e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:25.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.693+0000 7f34755eb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3470102680 0x7f3470113e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57232/0 (socket says 172.21.15.117:57232) 2024-04-12T09:15:25.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.693+0000 7f34755eb700 1 -- 172.21.15.117:0/2540252695 learned_addr learned my addr 172.21.15.117:0/2540252695 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:15:25.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.693+0000 7f3475dec700 1 --2- 172.21.15.117:0/2540252695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3470101ce0 0x7f34701138d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:25.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.693+0000 7f34755eb700 1 -- 172.21.15.117:0/2540252695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3470101ce0 msgr2=0x7f34701138d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:25.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.693+0000 7f34755eb700 1 --2- 172.21.15.117:0/2540252695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3470101ce0 0x7f34701138d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:25.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.693+0000 7f34755eb700 1 -- 172.21.15.117:0/2540252695 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c005040 con 0x7f3470102680 2024-04-12T09:15:25.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.694+0000 7f34755eb700 1 --2- 172.21.15.117:0/2540252695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3470102680 0x7f3470113e10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f346000eb40 tx=0x7f346000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:25.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.694+0000 7f34667fc700 1 -- 172.21.15.117:0/2540252695 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3460007cc0 con 0x7f3470102680 2024-04-12T09:15:25.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.694+0000 7f3478050700 1 -- 172.21.15.117:0/2540252695 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f347010dce0 con 0x7f3470102680 2024-04-12T09:15:25.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.694+0000 7f34667fc700 1 -- 172.21.15.117:0/2540252695 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f346000f040 con 0x7f3470102680 2024-04-12T09:15:25.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.694+0000 7f3478050700 1 -- 172.21.15.117:0/2540252695 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f347010e220 con 0x7f3470102680 2024-04-12T09:15:25.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.694+0000 7f34667fc700 1 -- 172.21.15.117:0/2540252695 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f346000c970 con 0x7f3470102680 2024-04-12T09:15:25.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.695+0000 7f3478050700 1 -- 172.21.15.117:0/2540252695 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34700fd430 con 0x7f3470102680 2024-04-12T09:15:25.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.695+0000 7f34667fc700 1 -- 172.21.15.117:0/2540252695 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 33) v1 ==== 91575+0+0 (secure 0 0 0) 0x7f346000cad0 con 0x7f3470102680 2024-04-12T09:15:25.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.696+0000 7f34667fc700 1 --2- 172.21.15.117:0/2540252695 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f345c06d5a0 0x7f345c06fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:25.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.696+0000 7f34667fc700 1 -- 172.21.15.117:0/2540252695 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f346008c570 con 0x7f3470102680 2024-04-12T09:15:25.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.696+0000 7f3475dec700 1 --2- 172.21.15.117:0/2540252695 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f345c06d5a0 0x7f345c06fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:25.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.696+0000 7f3475dec700 1 --2- 172.21.15.117:0/2540252695 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f345c06d5a0 0x7f345c06fa50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f346c009b30 tx=0x7f346c009e30 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:25.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.700+0000 7f34667fc700 1 -- 172.21.15.117:0/2540252695 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f3460059f80 con 0x7f3470102680 2024-04-12T09:15:25.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.895+0000 7f3478050700 1 -- 172.21.15.117:0/2540252695 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f3470109ed0 con 0x7f3470102680 2024-04-12T09:15:25.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.900+0000 7f34667fc700 1 -- 172.21.15.117:0/2540252695 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v46)=0 v46) v1 ==== 125+0+0 (secure 0 0 0) 0x7f3460059b10 con 0x7f3470102680 2024-04-12T09:15:25.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.902+0000 7f3478050700 1 -- 172.21.15.117:0/2540252695 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f345c06d5a0 msgr2=0x7f345c06fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:25.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.902+0000 7f3478050700 1 --2- 172.21.15.117:0/2540252695 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f345c06d5a0 0x7f345c06fa50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f346c009b30 tx=0x7f346c009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:25.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.902+0000 7f3478050700 1 -- 172.21.15.117:0/2540252695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3470102680 msgr2=0x7f3470113e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:25.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.902+0000 7f3478050700 1 --2- 172.21.15.117:0/2540252695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3470102680 0x7f3470113e10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f346000eb40 tx=0x7f346000b040 comp rx=0 tx=0).stop 2024-04-12T09:15:25.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.902+0000 7f3478050700 1 -- 172.21.15.117:0/2540252695 shutdown_connections 2024-04-12T09:15:25.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.902+0000 7f3478050700 1 --2- 172.21.15.117:0/2540252695 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f345c06d5a0 0x7f345c06fa50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:25.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.902+0000 7f3478050700 1 --2- 172.21.15.117:0/2540252695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3470101ce0 0x7f34701138d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:25.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.902+0000 7f3478050700 1 --2- 172.21.15.117:0/2540252695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3470102680 0x7f3470113e10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:25.904 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.902+0000 7f3478050700 1 -- 172.21.15.117:0/2540252695 >> 172.21.15.117:0/2540252695 conn(0x7f34700f7870 msgr2=0x7f34700f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:25.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.902+0000 7f3478050700 1 -- 172.21.15.117:0/2540252695 shutdown_connections 2024-04-12T09:15:25.905 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:25.902+0000 7f3478050700 1 -- 172.21.15.117:0/2540252695 wait complete. 2024-04-12T09:15:26.519 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-12T09:15:26.520 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi117.front.sepia.ceph.com 2024-04-12T09:15:26.520 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-04-12T09:15:26.781 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:15:27.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:26 smithi117 ceph-mon[29277]: pgmap v85: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:27.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:26 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/2540252695' entity='client.admin' 2024-04-12T09:15:27.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:26 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:15:27.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:26 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:15:27.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:26 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:15:27.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:26 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:15:27.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:26 smithi203 ceph-mon[36428]: pgmap v85: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:27.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:26 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/2540252695' entity='client.admin' 2024-04-12T09:15:27.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:26 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:15:27.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:26 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:15:27.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:26 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:15:27.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:26 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:15:28.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.357+0000 7f9fe1440700 1 -- 172.21.15.117:0/3931103197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fdc101d70 msgr2=0x7f9fdc102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:28.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.357+0000 7f9fe1440700 1 --2- 172.21.15.117:0/3931103197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fdc101d70 0x7f9fdc102140 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc004940 tx=0x7f9fcc009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:28.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.357+0000 7f9fe1440700 1 -- 172.21.15.117:0/3931103197 shutdown_connections 2024-04-12T09:15:28.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.357+0000 7f9fe1440700 1 --2- 172.21.15.117:0/3931103197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9fdc102710 0x7f9fdc0fbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:28.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.357+0000 7f9fe1440700 1 --2- 172.21.15.117:0/3931103197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fdc101d70 0x7f9fdc102140 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:28.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.357+0000 7f9fe1440700 1 -- 172.21.15.117:0/3931103197 >> 172.21.15.117:0/3931103197 conn(0x7f9fdc072bc0 msgr2=0x7f9fdc072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:28.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.357+0000 7f9fe1440700 1 -- 172.21.15.117:0/3931103197 shutdown_connections 2024-04-12T09:15:28.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.357+0000 7f9fe1440700 1 -- 172.21.15.117:0/3931103197 wait complete. 2024-04-12T09:15:28.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.358+0000 7f9fe1440700 1 Processor -- start 2024-04-12T09:15:28.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.358+0000 7f9fe1440700 1 -- start start 2024-04-12T09:15:28.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.358+0000 7f9fe1440700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9fdc101d70 0x7f9fdc10eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:28.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.358+0000 7f9fe1440700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fdc102710 0x7f9fdc10f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:28.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.358+0000 7f9fe1440700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc10f770 con 0x7f9fdc102710 2024-04-12T09:15:28.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.358+0000 7f9fe1440700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc10f8b0 con 0x7f9fdc101d70 2024-04-12T09:15:28.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.358+0000 7f9fd3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fdc102710 0x7f9fdc10f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:28.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.358+0000 7f9fd3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fdc102710 0x7f9fdc10f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57242/0 (socket says 172.21.15.117:57242) 2024-04-12T09:15:28.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.358+0000 7f9fd3fff700 1 -- 172.21.15.117:0/3712331130 learned_addr learned my addr 172.21.15.117:0/3712331130 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:15:28.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.358+0000 7f9fdaffd700 1 --2- 172.21.15.117:0/3712331130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9fdc101d70 0x7f9fdc10eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:28.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.358+0000 7f9fd3fff700 1 -- 172.21.15.117:0/3712331130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9fdc101d70 msgr2=0x7f9fdc10eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:28.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.358+0000 7f9fd3fff700 1 --2- 172.21.15.117:0/3712331130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9fdc101d70 0x7f9fdc10eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:28.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.358+0000 7f9fd3fff700 1 -- 172.21.15.117:0/3712331130 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc005040 con 0x7f9fdc102710 2024-04-12T09:15:28.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.358+0000 7f9fdaffd700 1 --2- 172.21.15.117:0/3712331130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9fdc101d70 0x7f9fdc10eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T09:15:28.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.359+0000 7f9fd3fff700 1 --2- 172.21.15.117:0/3712331130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fdc102710 0x7f9fdc10f090 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400b790 tx=0x7f9fc4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:28.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.359+0000 7f9fd37fe700 1 -- 172.21.15.117:0/3712331130 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fc400f6f0 con 0x7f9fdc102710 2024-04-12T09:15:28.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.359+0000 7f9fd37fe700 1 -- 172.21.15.117:0/3712331130 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9fc400fd20 con 0x7f9fdc102710 2024-04-12T09:15:28.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.359+0000 7f9fe1440700 1 -- 172.21.15.117:0/3712331130 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fdc117c20 con 0x7f9fdc102710 2024-04-12T09:15:28.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.359+0000 7f9fd37fe700 1 -- 172.21.15.117:0/3712331130 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fc40103a0 con 0x7f9fdc102710 2024-04-12T09:15:28.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.359+0000 7f9fe1440700 1 -- 172.21.15.117:0/3712331130 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fdc118130 con 0x7f9fdc102710 2024-04-12T09:15:28.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.360+0000 7f9fe1440700 1 -- 172.21.15.117:0/3712331130 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fdc0ff080 con 0x7f9fdc102710 2024-04-12T09:15:28.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.360+0000 7f9fd37fe700 1 -- 172.21.15.117:0/3712331130 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 33) v1 ==== 91575+0+0 (secure 0 0 0) 0x7f9fc4011400 con 0x7f9fdc102710 2024-04-12T09:15:28.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.361+0000 7f9fd37fe700 1 --2- 172.21.15.117:0/3712331130 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f9fc806d5a0 0x7f9fc806fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:28.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.361+0000 7f9fd37fe700 1 -- 172.21.15.117:0/3712331130 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f9fc408ca20 con 0x7f9fdc102710 2024-04-12T09:15:28.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.361+0000 7f9fdaffd700 1 --2- 172.21.15.117:0/3712331130 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f9fc806d5a0 0x7f9fc806fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:28.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.361+0000 7f9fdaffd700 1 --2- 172.21.15.117:0/3712331130 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f9fc806d5a0 0x7f9fc806fa50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc004560 tx=0x7f9fcc009e30 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:28.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.365+0000 7f9fd37fe700 1 -- 172.21.15.117:0/3712331130 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f9fc4056850 con 0x7f9fdc102710 2024-04-12T09:15:28.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.557+0000 7f9fe1440700 1 -- 172.21.15.117:0/3712331130 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f9fdc0fd4c0 con 0x7f9fdc102710 2024-04-12T09:15:28.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.558+0000 7f9fd37fe700 1 -- 172.21.15.117:0/3712331130 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v46)=0 v46) v1 ==== 155+0+0 (secure 0 0 0) 0x7f9fc4059f10 con 0x7f9fdc102710 2024-04-12T09:15:28.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.560+0000 7f9fe1440700 1 -- 172.21.15.117:0/3712331130 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f9fc806d5a0 msgr2=0x7f9fc806fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:28.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.560+0000 7f9fe1440700 1 --2- 172.21.15.117:0/3712331130 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f9fc806d5a0 0x7f9fc806fa50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc004560 tx=0x7f9fcc009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:28.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.560+0000 7f9fe1440700 1 -- 172.21.15.117:0/3712331130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fdc102710 msgr2=0x7f9fdc10f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:28.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.560+0000 7f9fe1440700 1 --2- 172.21.15.117:0/3712331130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fdc102710 0x7f9fdc10f090 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400b790 tx=0x7f9fc4009220 comp rx=0 tx=0).stop 2024-04-12T09:15:28.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.560+0000 7f9fe1440700 1 -- 172.21.15.117:0/3712331130 shutdown_connections 2024-04-12T09:15:28.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.560+0000 7f9fe1440700 1 --2- 172.21.15.117:0/3712331130 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f9fc806d5a0 0x7f9fc806fa50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:28.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.560+0000 7f9fe1440700 1 --2- 172.21.15.117:0/3712331130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9fdc101d70 0x7f9fdc10eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:28.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.560+0000 7f9fe1440700 1 --2- 172.21.15.117:0/3712331130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fdc102710 0x7f9fdc10f090 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:28.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.560+0000 7f9fe1440700 1 -- 172.21.15.117:0/3712331130 >> 172.21.15.117:0/3712331130 conn(0x7f9fdc072bc0 msgr2=0x7f9fdc0faf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:28.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.560+0000 7f9fe1440700 1 -- 172.21.15.117:0/3712331130 shutdown_connections 2024-04-12T09:15:28.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:28.560+0000 7f9fe1440700 1 -- 172.21.15.117:0/3712331130 wait complete. 2024-04-12T09:15:29.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:28 smithi117 ceph-mon[29277]: pgmap v86: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:29.243 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-04-12T09:15:29.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:28 smithi203 ceph-mon[36428]: pgmap v86: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:29.502 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:15:31.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.071+0000 7fa9f49f3700 1 -- 172.21.15.117:0/2371863020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9f0101d20 msgr2=0x7fa9f01020f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:31.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.071+0000 7fa9f49f3700 1 --2- 172.21.15.117:0/2371863020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9f0101d20 0x7fa9f01020f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0004940 tx=0x7fa9e0009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:31.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.071+0000 7fa9f49f3700 1 -- 172.21.15.117:0/2371863020 shutdown_connections 2024-04-12T09:15:31.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.071+0000 7fa9f49f3700 1 --2- 172.21.15.117:0/2371863020 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9f01026c0 0x7fa9f00fbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:31.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.071+0000 7fa9f49f3700 1 --2- 172.21.15.117:0/2371863020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9f0101d20 0x7fa9f01020f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:31.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.071+0000 7fa9f49f3700 1 -- 172.21.15.117:0/2371863020 >> 172.21.15.117:0/2371863020 conn(0x7fa9f00f7870 msgr2=0x7fa9f00f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:31.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.071+0000 7fa9f49f3700 1 -- 172.21.15.117:0/2371863020 shutdown_connections 2024-04-12T09:15:31.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.071+0000 7fa9f49f3700 1 -- 172.21.15.117:0/2371863020 wait complete. 2024-04-12T09:15:31.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.072+0000 7fa9f49f3700 1 Processor -- start 2024-04-12T09:15:31.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.072+0000 7fa9f49f3700 1 -- start start 2024-04-12T09:15:31.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.072+0000 7fa9f49f3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9f0101d20 0x7fa9f0115bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:31.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.072+0000 7fa9f49f3700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9f01026c0 0x7fa9f0116100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:31.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.072+0000 7fa9f49f3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f0116750 con 0x7fa9f0101d20 2024-04-12T09:15:31.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.072+0000 7fa9f49f3700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f010fd30 con 0x7fa9f01026c0 2024-04-12T09:15:31.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.072+0000 7fa9ee59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9f0101d20 0x7fa9f0115bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:31.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.072+0000 7fa9ee59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9f0101d20 0x7fa9f0115bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39118/0 (socket says 172.21.15.117:39118) 2024-04-12T09:15:31.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.072+0000 7fa9ee59c700 1 -- 172.21.15.117:0/1490302365 learned_addr learned my addr 172.21.15.117:0/1490302365 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:15:31.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.072+0000 7fa9e5d9b700 1 --2- 172.21.15.117:0/1490302365 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9f01026c0 0x7fa9f0116100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:31.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.072+0000 7fa9ee59c700 1 -- 172.21.15.117:0/1490302365 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9f01026c0 msgr2=0x7fa9f0116100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:31.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.072+0000 7fa9ee59c700 1 --2- 172.21.15.117:0/1490302365 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9f01026c0 0x7fa9f0116100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:31.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.072+0000 7fa9ee59c700 1 -- 172.21.15.117:0/1490302365 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e0005040 con 0x7fa9f0101d20 2024-04-12T09:15:31.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.072+0000 7fa9ee59c700 1 --2- 172.21.15.117:0/1490302365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9f0101d20 0x7fa9f0115bc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000b3b0 tx=0x7fa9e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:31.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.072+0000 7fa9e77fe700 1 -- 172.21.15.117:0/1490302365 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9e000e040 con 0x7fa9f0101d20 2024-04-12T09:15:31.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.073+0000 7fa9f49f3700 1 -- 172.21.15.117:0/1490302365 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f010ffb0 con 0x7fa9f0101d20 2024-04-12T09:15:31.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.073+0000 7fa9e77fe700 1 -- 172.21.15.117:0/1490302365 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa9e000bbc0 con 0x7fa9f0101d20 2024-04-12T09:15:31.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.073+0000 7fa9e77fe700 1 -- 172.21.15.117:0/1490302365 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9e001c3f0 con 0x7fa9f0101d20 2024-04-12T09:15:31.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.073+0000 7fa9f49f3700 1 -- 172.21.15.117:0/1490302365 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f0110570 con 0x7fa9f0101d20 2024-04-12T09:15:31.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.074+0000 7fa9f49f3700 1 -- 172.21.15.117:0/1490302365 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f00fd470 con 0x7fa9f0101d20 2024-04-12T09:15:31.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.074+0000 7fa9e77fe700 1 -- 172.21.15.117:0/1490302365 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 33) v1 ==== 91575+0+0 (secure 0 0 0) 0x7fa9e000bd30 con 0x7fa9f0101d20 2024-04-12T09:15:31.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.074+0000 7fa9e77fe700 1 --2- 172.21.15.117:0/1490302365 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fa9dc06d5a0 0x7fa9dc06fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:31.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.075+0000 7fa9e77fe700 1 -- 172.21.15.117:0/1490302365 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fa9e008de60 con 0x7fa9f0101d20 2024-04-12T09:15:31.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.075+0000 7fa9e5d9b700 1 --2- 172.21.15.117:0/1490302365 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fa9dc06d5a0 0x7fa9dc06fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:31.077 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.075+0000 7fa9e5d9b700 1 --2- 172.21.15.117:0/1490302365 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fa9dc06d5a0 0x7fa9dc06fa50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0111460 tx=0x7fa9d8009040 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:31.081 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.079+0000 7fa9e77fe700 1 -- 172.21.15.117:0/1490302365 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7fa9e005b7c0 con 0x7fa9f0101d20 2024-04-12T09:15:31.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:30 smithi117 ceph-mon[29277]: pgmap v87: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:31.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.278+0000 7fa9f49f3700 1 -- 172.21.15.117:0/1490302365 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fa9f004c710 con 0x7fa9f0101d20 2024-04-12T09:15:31.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.278+0000 7fa9e77fe700 1 -- 172.21.15.117:0/1490302365 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v46)=0 v46) v1 ==== 163+0+0 (secure 0 0 0) 0x7fa9e005b350 con 0x7fa9f0101d20 2024-04-12T09:15:31.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.281+0000 7fa9f49f3700 1 -- 172.21.15.117:0/1490302365 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fa9dc06d5a0 msgr2=0x7fa9dc06fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:31.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.281+0000 7fa9f49f3700 1 --2- 172.21.15.117:0/1490302365 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fa9dc06d5a0 0x7fa9dc06fa50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0111460 tx=0x7fa9d8009040 comp rx=0 tx=0).stop 2024-04-12T09:15:31.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.281+0000 7fa9f49f3700 1 -- 172.21.15.117:0/1490302365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9f0101d20 msgr2=0x7fa9f0115bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:31.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.281+0000 7fa9f49f3700 1 --2- 172.21.15.117:0/1490302365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9f0101d20 0x7fa9f0115bc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000b3b0 tx=0x7fa9e0009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:31.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.281+0000 7fa9f49f3700 1 -- 172.21.15.117:0/1490302365 shutdown_connections 2024-04-12T09:15:31.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.281+0000 7fa9f49f3700 1 --2- 172.21.15.117:0/1490302365 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fa9dc06d5a0 0x7fa9dc06fa50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:31.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.281+0000 7fa9f49f3700 1 --2- 172.21.15.117:0/1490302365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa9f0101d20 0x7fa9f0115bc0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:31.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.281+0000 7fa9f49f3700 1 --2- 172.21.15.117:0/1490302365 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9f01026c0 0x7fa9f0116100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:31.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.281+0000 7fa9f49f3700 1 -- 172.21.15.117:0/1490302365 >> 172.21.15.117:0/1490302365 conn(0x7fa9f00f7870 msgr2=0x7fa9f00f8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:31.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.281+0000 7fa9f49f3700 1 -- 172.21.15.117:0/1490302365 shutdown_connections 2024-04-12T09:15:31.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:31.281+0000 7fa9f49f3700 1 -- 172.21.15.117:0/1490302365 wait complete. 2024-04-12T09:15:31.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:30 smithi203 ceph-mon[36428]: pgmap v87: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:31.891 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'ceph config set global log_to_journald false --force' 2024-04-12T09:15:32.161 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:15:33.322 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:32 smithi117 ceph-mon[29277]: pgmap v88: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:33.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:32 smithi203 ceph-mon[36428]: pgmap v88: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:33.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.811+0000 7fe591ecd700 1 -- 172.21.15.117:0/1283898684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe58c102e00 msgr2=0x7fe58c1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:33.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.811+0000 7fe591ecd700 1 --2- 172.21.15.117:0/1283898684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe58c102e00 0x7fe58c1031d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe57c004940 tx=0x7fe57c009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:33.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.811+0000 7fe591ecd700 1 -- 172.21.15.117:0/1283898684 shutdown_connections 2024-04-12T09:15:33.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.811+0000 7fe591ecd700 1 --2- 172.21.15.117:0/1283898684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe58c1037a0 0x7fe58c0fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:33.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.811+0000 7fe591ecd700 1 --2- 172.21.15.117:0/1283898684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe58c102e00 0x7fe58c1031d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:33.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.811+0000 7fe591ecd700 1 -- 172.21.15.117:0/1283898684 >> 172.21.15.117:0/1283898684 conn(0x7fe58c0f89b0 msgr2=0x7fe58c0fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:33.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.812+0000 7fe591ecd700 1 -- 172.21.15.117:0/1283898684 shutdown_connections 2024-04-12T09:15:33.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.812+0000 7fe591ecd700 1 -- 172.21.15.117:0/1283898684 wait complete. 2024-04-12T09:15:33.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.812+0000 7fe591ecd700 1 Processor -- start 2024-04-12T09:15:33.814 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.812+0000 7fe591ecd700 1 -- start start 2024-04-12T09:15:33.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.812+0000 7fe591ecd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe58c102e00 0x7fe58c113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:33.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.812+0000 7fe591ecd700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe58c1037a0 0x7fe58c113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:33.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.812+0000 7fe591ecd700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c1145a0 con 0x7fe58c102e00 2024-04-12T09:15:33.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.812+0000 7fe591ecd700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c10db10 con 0x7fe58c1037a0 2024-04-12T09:15:33.815 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.813+0000 7fe58b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe58c102e00 0x7fe58c113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:33.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.813+0000 7fe58b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe58c102e00 0x7fe58c113980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39136/0 (socket says 172.21.15.117:39136) 2024-04-12T09:15:33.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.813+0000 7fe58b7fe700 1 -- 172.21.15.117:0/24851856 learned_addr learned my addr 172.21.15.117:0/24851856 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:15:33.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.813+0000 7fe58affd700 1 --2- 172.21.15.117:0/24851856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe58c1037a0 0x7fe58c113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:33.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.813+0000 7fe58b7fe700 1 -- 172.21.15.117:0/24851856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe58c1037a0 msgr2=0x7fe58c113ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:33.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.813+0000 7fe58b7fe700 1 --2- 172.21.15.117:0/24851856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe58c1037a0 0x7fe58c113ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:33.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.813+0000 7fe58b7fe700 1 -- 172.21.15.117:0/24851856 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c005040 con 0x7fe58c102e00 2024-04-12T09:15:33.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.813+0000 7fe58b7fe700 1 --2- 172.21.15.117:0/24851856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe58c102e00 0x7fe58c113980 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00b8b0 tx=0x7fe57c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:33.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.813+0000 7fe573fff700 1 -- 172.21.15.117:0/24851856 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe57c00e040 con 0x7fe58c102e00 2024-04-12T09:15:33.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.813+0000 7fe591ecd700 1 -- 172.21.15.117:0/24851856 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe58c10dd90 con 0x7fe58c102e00 2024-04-12T09:15:33.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.813+0000 7fe591ecd700 1 -- 172.21.15.117:0/24851856 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58c10e350 con 0x7fe58c102e00 2024-04-12T09:15:33.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.813+0000 7fe573fff700 1 -- 172.21.15.117:0/24851856 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe57c004290 con 0x7fe58c102e00 2024-04-12T09:15:33.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.813+0000 7fe573fff700 1 -- 172.21.15.117:0/24851856 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe57c025400 con 0x7fe58c102e00 2024-04-12T09:15:33.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.814+0000 7fe591ecd700 1 -- 172.21.15.117:0/24851856 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5780052b0 con 0x7fe58c102e00 2024-04-12T09:15:33.816 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.815+0000 7fe573fff700 1 -- 172.21.15.117:0/24851856 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 33) v1 ==== 91575+0+0 (secure 0 0 0) 0x7fe57c00baf0 con 0x7fe58c102e00 2024-04-12T09:15:33.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.815+0000 7fe573fff700 1 --2- 172.21.15.117:0/24851856 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fe57406d5a0 0x7fe57406fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:33.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.815+0000 7fe573fff700 1 -- 172.21.15.117:0/24851856 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fe57c08de50 con 0x7fe58c102e00 2024-04-12T09:15:33.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.815+0000 7fe58affd700 1 --2- 172.21.15.117:0/24851856 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fe57406d5a0 0x7fe57406fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:33.817 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.816+0000 7fe58affd700 1 --2- 172.21.15.117:0/24851856 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fe57406d5a0 0x7fe57406fa50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe580006fd0 tx=0x7fe580008040 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:33.820 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:33.819+0000 7fe573fff700 1 -- 172.21.15.117:0/24851856 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7fe57c05b830 con 0x7fe58c102e00 2024-04-12T09:15:34.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:34.016+0000 7fe591ecd700 1 -- 172.21.15.117:0/24851856 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fe578005ae0 con 0x7fe58c102e00 2024-04-12T09:15:34.017 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:34.016+0000 7fe573fff700 1 -- 172.21.15.117:0/24851856 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v46)=0 v46) v1 ==== 135+0+0 (secure 0 0 0) 0x7fe57c05b3c0 con 0x7fe58c102e00 2024-04-12T09:15:34.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:34.018+0000 7fe591ecd700 1 -- 172.21.15.117:0/24851856 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fe57406d5a0 msgr2=0x7fe57406fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:34.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:34.018+0000 7fe591ecd700 1 --2- 172.21.15.117:0/24851856 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fe57406d5a0 0x7fe57406fa50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe580006fd0 tx=0x7fe580008040 comp rx=0 tx=0).stop 2024-04-12T09:15:34.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:34.018+0000 7fe591ecd700 1 -- 172.21.15.117:0/24851856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe58c102e00 msgr2=0x7fe58c113980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:34.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:34.018+0000 7fe591ecd700 1 --2- 172.21.15.117:0/24851856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe58c102e00 0x7fe58c113980 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00b8b0 tx=0x7fe57c009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:34.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:34.018+0000 7fe591ecd700 1 -- 172.21.15.117:0/24851856 shutdown_connections 2024-04-12T09:15:34.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:34.018+0000 7fe591ecd700 1 --2- 172.21.15.117:0/24851856 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fe57406d5a0 0x7fe57406fa50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:34.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:34.018+0000 7fe591ecd700 1 --2- 172.21.15.117:0/24851856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe58c102e00 0x7fe58c113980 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:34.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:34.018+0000 7fe591ecd700 1 --2- 172.21.15.117:0/24851856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe58c1037a0 0x7fe58c113ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:34.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:34.018+0000 7fe591ecd700 1 -- 172.21.15.117:0/24851856 >> 172.21.15.117:0/24851856 conn(0x7fe58c0f89b0 msgr2=0x7fe58c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:34.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:34.018+0000 7fe591ecd700 1 -- 172.21.15.117:0/24851856 shutdown_connections 2024-04-12T09:15:34.020 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:34.018+0000 7fe591ecd700 1 -- 172.21.15.117:0/24851856 wait complete. 2024-04-12T09:15:34.665 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-04-12T09:15:34.923 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:15:35.172 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:34 smithi117 ceph-mon[29277]: pgmap v89: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:35.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:34 smithi203 ceph-mon[36428]: pgmap v89: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:36.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.516+0000 7f16f47ec700 1 -- 172.21.15.117:0/2470205836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16ec102e00 msgr2=0x7f16ec1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:36.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.516+0000 7f16f47ec700 1 --2- 172.21.15.117:0/2470205836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16ec102e00 0x7f16ec1031d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f16dc004940 tx=0x7f16dc009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:36.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.516+0000 7f16f47ec700 1 -- 172.21.15.117:0/2470205836 shutdown_connections 2024-04-12T09:15:36.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.516+0000 7f16f47ec700 1 --2- 172.21.15.117:0/2470205836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16ec1037a0 0x7f16ec0fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:36.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.516+0000 7f16f47ec700 1 --2- 172.21.15.117:0/2470205836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16ec102e00 0x7f16ec1031d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:36.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.516+0000 7f16f47ec700 1 -- 172.21.15.117:0/2470205836 >> 172.21.15.117:0/2470205836 conn(0x7f16ec0f89b0 msgr2=0x7f16ec0fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:36.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.516+0000 7f16f47ec700 1 -- 172.21.15.117:0/2470205836 shutdown_connections 2024-04-12T09:15:36.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.516+0000 7f16f47ec700 1 -- 172.21.15.117:0/2470205836 wait complete. 2024-04-12T09:15:36.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.517+0000 7f16f47ec700 1 Processor -- start 2024-04-12T09:15:36.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.517+0000 7f16f47ec700 1 -- start start 2024-04-12T09:15:36.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.517+0000 7f16f47ec700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16ec102e00 0x7f16ec0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:36.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.517+0000 7f16f47ec700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16ec1037a0 0x7f16ec070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:36.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.517+0000 7f16f47ec700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec0722a0 con 0x7f16ec102e00 2024-04-12T09:15:36.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.517+0000 7f16f47ec700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec070d40 con 0x7f16ec1037a0 2024-04-12T09:15:36.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.517+0000 7f16f2588700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16ec102e00 0x7f16ec0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:36.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.517+0000 7f16f2588700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16ec102e00 0x7f16ec0702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39154/0 (socket says 172.21.15.117:39154) 2024-04-12T09:15:36.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.517+0000 7f16f2588700 1 -- 172.21.15.117:0/140014807 learned_addr learned my addr 172.21.15.117:0/140014807 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:15:36.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.517+0000 7f16f1d87700 1 --2- 172.21.15.117:0/140014807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16ec1037a0 0x7f16ec070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:36.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.518+0000 7f16f2588700 1 -- 172.21.15.117:0/140014807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16ec1037a0 msgr2=0x7f16ec070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:36.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.518+0000 7f16f2588700 1 --2- 172.21.15.117:0/140014807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16ec1037a0 0x7f16ec070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:36.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.518+0000 7f16f2588700 1 -- 172.21.15.117:0/140014807 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc005040 con 0x7f16ec102e00 2024-04-12T09:15:36.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.518+0000 7f16f2588700 1 --2- 172.21.15.117:0/140014807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16ec102e00 0x7f16ec0702c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f16dc00b3b0 tx=0x7f16dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:36.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.518+0000 7f16e2ffd700 1 -- 172.21.15.117:0/140014807 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16dc00e040 con 0x7f16ec102e00 2024-04-12T09:15:36.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.518+0000 7f16e2ffd700 1 -- 172.21.15.117:0/140014807 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f16dc00bbc0 con 0x7f16ec102e00 2024-04-12T09:15:36.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.518+0000 7f16f47ec700 1 -- 172.21.15.117:0/140014807 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ec070fc0 con 0x7f16ec102e00 2024-04-12T09:15:36.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.518+0000 7f16e2ffd700 1 -- 172.21.15.117:0/140014807 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16dc01c3f0 con 0x7f16ec102e00 2024-04-12T09:15:36.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.518+0000 7f16f47ec700 1 -- 172.21.15.117:0/140014807 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ec11a150 con 0x7f16ec102e00 2024-04-12T09:15:36.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.519+0000 7f16f47ec700 1 -- 172.21.15.117:0/140014807 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16ec0fe550 con 0x7f16ec102e00 2024-04-12T09:15:36.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.519+0000 7f16e2ffd700 1 -- 172.21.15.117:0/140014807 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 33) v1 ==== 91575+0+0 (secure 0 0 0) 0x7f16dc00bd30 con 0x7f16ec102e00 2024-04-12T09:15:36.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.520+0000 7f16e2ffd700 1 --2- 172.21.15.117:0/140014807 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f16d806d5a0 0x7f16d806fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:36.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.520+0000 7f16e2ffd700 1 -- 172.21.15.117:0/140014807 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f16dc08de80 con 0x7f16ec102e00 2024-04-12T09:15:36.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.520+0000 7f16f1d87700 1 --2- 172.21.15.117:0/140014807 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f16d806d5a0 0x7f16d806fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:36.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.520+0000 7f16f1d87700 1 --2- 172.21.15.117:0/140014807 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f16d806d5a0 0x7f16d806fa50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f16e8006fd0 tx=0x7f16e8008040 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:36.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.524+0000 7f16e2ffd700 1 -- 172.21.15.117:0/140014807 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f16dc057c50 con 0x7f16ec102e00 2024-04-12T09:15:36.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.737+0000 7f16f47ec700 1 -- 172.21.15.117:0/140014807 --> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b277feb2c7beb4597d8ecc39d58d5c36b81f613a", "target": ["mon-mgr", ""]}) v1 -- 0x7f16ec0f9fd0 con 0x7f16d806d5a0 2024-04-12T09:15:36.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.743+0000 7f16e2ffd700 1 -- 172.21.15.117:0/140014807 <== mgr.14694 v2:172.21.15.117:6800/1056729457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f16ec0f9fd0 con 0x7f16d806d5a0 2024-04-12T09:15:36.744 INFO:teuthology.orchestra.run.smithi117.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:b277feb2c7beb4597d8ecc39d58d5c36b81f613a 2024-04-12T09:15:36.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.745+0000 7f16f47ec700 1 -- 172.21.15.117:0/140014807 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f16d806d5a0 msgr2=0x7f16d806fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:36.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.745+0000 7f16f47ec700 1 --2- 172.21.15.117:0/140014807 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f16d806d5a0 0x7f16d806fa50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f16e8006fd0 tx=0x7f16e8008040 comp rx=0 tx=0).stop 2024-04-12T09:15:36.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.745+0000 7f16f47ec700 1 -- 172.21.15.117:0/140014807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16ec102e00 msgr2=0x7f16ec0702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:36.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.745+0000 7f16f47ec700 1 --2- 172.21.15.117:0/140014807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16ec102e00 0x7f16ec0702c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f16dc00b3b0 tx=0x7f16dc009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:36.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.745+0000 7f16f47ec700 1 -- 172.21.15.117:0/140014807 shutdown_connections 2024-04-12T09:15:36.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.745+0000 7f16f47ec700 1 --2- 172.21.15.117:0/140014807 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f16d806d5a0 0x7f16d806fa50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:36.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.745+0000 7f16f47ec700 1 --2- 172.21.15.117:0/140014807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16ec102e00 0x7f16ec0702c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:36.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.745+0000 7f16f47ec700 1 --2- 172.21.15.117:0/140014807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16ec1037a0 0x7f16ec070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:36.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.745+0000 7f16f47ec700 1 -- 172.21.15.117:0/140014807 >> 172.21.15.117:0/140014807 conn(0x7f16ec0f89b0 msgr2=0x7f16ec0f98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:36.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.745+0000 7f16f47ec700 1 -- 172.21.15.117:0/140014807 shutdown_connections 2024-04-12T09:15:36.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:36.745+0000 7f16f47ec700 1 -- 172.21.15.117:0/140014807 wait complete. 2024-04-12T09:15:37.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:36 smithi117 ceph-mon[29277]: pgmap v90: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:37.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:36 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:15:37.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:36 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:15:37.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:36 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:15:37.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:36 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:15:37.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:36 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:15:37.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:36 smithi203 ceph-mon[36428]: pgmap v90: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:37.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:36 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:15:37.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:36 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:15:37.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:36 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:15:37.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:36 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:15:37.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:36 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:15:37.417 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-12T09:15:37.418 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi117.front.sepia.ceph.com 2024-04-12T09:15:37.418 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-04-12T09:15:37.685 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:15:38.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:37 smithi117 ceph-mon[29277]: from='client.14846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b277feb2c7beb4597d8ecc39d58d5c36b81f613a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:15:38.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:37 smithi117 ceph-mon[29277]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:b277feb2c7beb4597d8ecc39d58d5c36b81f613a 2024-04-12T09:15:38.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:37 smithi117 ceph-mon[29277]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b277feb2c7beb4597d8ecc39d58d5c36b81f613a 2024-04-12T09:15:38.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:37 smithi203 ceph-mon[36428]: from='client.14846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b277feb2c7beb4597d8ecc39d58d5c36b81f613a", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:15:38.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:37 smithi203 ceph-mon[36428]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:b277feb2c7beb4597d8ecc39d58d5c36b81f613a 2024-04-12T09:15:38.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:37 smithi203 ceph-mon[36428]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b277feb2c7beb4597d8ecc39d58d5c36b81f613a 2024-04-12T09:15:39.300 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:38 smithi117 ceph-mon[29277]: pgmap v91: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:39.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:38 smithi203 ceph-mon[36428]: pgmap v91: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:39.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.943+0000 7f476fac4700 1 -- 172.21.15.117:0/1835524245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4768102e00 msgr2=0x7f47681031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:39.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.943+0000 7f476fac4700 1 --2- 172.21.15.117:0/1835524245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4768102e00 0x7f47681031d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4758004940 tx=0x7f4758009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:39.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.943+0000 7f476fac4700 1 -- 172.21.15.117:0/1835524245 shutdown_connections 2024-04-12T09:15:39.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.943+0000 7f476fac4700 1 --2- 172.21.15.117:0/1835524245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47681037a0 0x7f47680fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:39.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.943+0000 7f476fac4700 1 --2- 172.21.15.117:0/1835524245 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4768102e00 0x7f47681031d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:39.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.943+0000 7f476fac4700 1 -- 172.21.15.117:0/1835524245 >> 172.21.15.117:0/1835524245 conn(0x7f47680f89b0 msgr2=0x7f47680fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:39.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.944+0000 7f476fac4700 1 -- 172.21.15.117:0/1835524245 shutdown_connections 2024-04-12T09:15:39.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.944+0000 7f476fac4700 1 -- 172.21.15.117:0/1835524245 wait complete. 2024-04-12T09:15:39.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.944+0000 7f476fac4700 1 Processor -- start 2024-04-12T09:15:39.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.944+0000 7f476fac4700 1 -- start start 2024-04-12T09:15:39.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.944+0000 7f476fac4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4768102e00 0x7f47681138d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:39.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.944+0000 7f476fac4700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47681037a0 0x7f4768113e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:39.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.944+0000 7f476fac4700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4768114460 con 0x7f4768102e00 2024-04-12T09:15:39.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.944+0000 7f476fac4700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476810dab0 con 0x7f47681037a0 2024-04-12T09:15:39.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.944+0000 7f476d860700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4768102e00 0x7f47681138d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:39.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.944+0000 7f476d860700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4768102e00 0x7f47681138d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33332/0 (socket says 172.21.15.117:33332) 2024-04-12T09:15:39.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.944+0000 7f476d860700 1 -- 172.21.15.117:0/2589737021 learned_addr learned my addr 172.21.15.117:0/2589737021 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:15:39.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.945+0000 7f476d05f700 1 --2- 172.21.15.117:0/2589737021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47681037a0 0x7f4768113e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:39.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.945+0000 7f476d860700 1 -- 172.21.15.117:0/2589737021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47681037a0 msgr2=0x7f4768113e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:39.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.945+0000 7f476d860700 1 --2- 172.21.15.117:0/2589737021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47681037a0 0x7f4768113e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:39.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.945+0000 7f476d860700 1 -- 172.21.15.117:0/2589737021 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4758005040 con 0x7f4768102e00 2024-04-12T09:15:39.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.945+0000 7f476d860700 1 --2- 172.21.15.117:0/2589737021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4768102e00 0x7f47681138d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f475800b3b0 tx=0x7f4758009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:39.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.945+0000 7f475e7fc700 1 -- 172.21.15.117:0/2589737021 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f475800e040 con 0x7f4768102e00 2024-04-12T09:15:39.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.945+0000 7f476fac4700 1 -- 172.21.15.117:0/2589737021 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f476810dd30 con 0x7f4768102e00 2024-04-12T09:15:39.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.945+0000 7f475e7fc700 1 -- 172.21.15.117:0/2589737021 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4758013420 con 0x7f4768102e00 2024-04-12T09:15:39.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.945+0000 7f475e7fc700 1 -- 172.21.15.117:0/2589737021 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f475801c630 con 0x7f4768102e00 2024-04-12T09:15:39.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.945+0000 7f476fac4700 1 -- 172.21.15.117:0/2589737021 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f476810e2f0 con 0x7f4768102e00 2024-04-12T09:15:39.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.946+0000 7f476fac4700 1 -- 172.21.15.117:0/2589737021 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4768100110 con 0x7f4768102e00 2024-04-12T09:15:39.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.947+0000 7f475e7fc700 1 -- 172.21.15.117:0/2589737021 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 33) v1 ==== 91575+0+0 (secure 0 0 0) 0x7f4758013590 con 0x7f4768102e00 2024-04-12T09:15:39.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.947+0000 7f475e7fc700 1 --2- 172.21.15.117:0/2589737021 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f475406d5a0 0x7f475406fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:39.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.947+0000 7f475e7fc700 1 -- 172.21.15.117:0/2589737021 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f475808dd90 con 0x7f4768102e00 2024-04-12T09:15:39.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.947+0000 7f476d05f700 1 --2- 172.21.15.117:0/2589737021 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f475406d5a0 0x7f475406fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:39.950 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.948+0000 7f476d05f700 1 --2- 172.21.15.117:0/2589737021 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f475406d5a0 0x7f475406fa50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f476810ec20 tx=0x7f476400b040 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:39.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:39.952+0000 7f475e7fc700 1 -- 172.21.15.117:0/2589737021 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f475805b770 con 0x7f4768102e00 2024-04-12T09:15:40.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.179+0000 7f476fac4700 1 -- 172.21.15.117:0/2589737021 --> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f476810ef90 con 0x7f475406d5a0 2024-04-12T09:15:40.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.180+0000 7f475e7fc700 1 -- 172.21.15.117:0/2589737021 <== mgr.14694 v2:172.21.15.117:6800/1056729457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f476810ef90 con 0x7f475406d5a0 2024-04-12T09:15:40.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.182+0000 7f476fac4700 1 -- 172.21.15.117:0/2589737021 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f475406d5a0 msgr2=0x7f475406fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:40.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.182+0000 7f476fac4700 1 --2- 172.21.15.117:0/2589737021 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f475406d5a0 0x7f475406fa50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f476810ec20 tx=0x7f476400b040 comp rx=0 tx=0).stop 2024-04-12T09:15:40.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.182+0000 7f476fac4700 1 -- 172.21.15.117:0/2589737021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4768102e00 msgr2=0x7f47681138d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:40.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.182+0000 7f476fac4700 1 --2- 172.21.15.117:0/2589737021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4768102e00 0x7f47681138d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f475800b3b0 tx=0x7f4758009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:40.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.182+0000 7f476fac4700 1 -- 172.21.15.117:0/2589737021 shutdown_connections 2024-04-12T09:15:40.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.183+0000 7f476fac4700 1 --2- 172.21.15.117:0/2589737021 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f475406d5a0 0x7f475406fa50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:40.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.183+0000 7f476fac4700 1 --2- 172.21.15.117:0/2589737021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4768102e00 0x7f47681138d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:40.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.183+0000 7f476fac4700 1 --2- 172.21.15.117:0/2589737021 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47681037a0 0x7f4768113e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:40.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.183+0000 7f476fac4700 1 -- 172.21.15.117:0/2589737021 >> 172.21.15.117:0/2589737021 conn(0x7f47680f89b0 msgr2=0x7f47680fa710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:40.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.183+0000 7f476fac4700 1 -- 172.21.15.117:0/2589737021 shutdown_connections 2024-04-12T09:15:40.184 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.183+0000 7f476fac4700 1 -- 172.21.15.117:0/2589737021 wait complete. 2024-04-12T09:15:40.193 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:15:40.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.289+0000 7f7f0e1a7700 1 -- 172.21.15.117:0/1340487550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f080fc590 msgr2=0x7f7f081092f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:40.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.289+0000 7f7f0e1a7700 1 --2- 172.21.15.117:0/1340487550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f080fc590 0x7f7f081092f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7efc004940 tx=0x7f7efc009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:40.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.289+0000 7f7f0e1a7700 1 -- 172.21.15.117:0/1340487550 shutdown_connections 2024-04-12T09:15:40.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.289+0000 7f7f0e1a7700 1 --2- 172.21.15.117:0/1340487550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f080fc590 0x7f7f081092f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:40.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.289+0000 7f7f0e1a7700 1 --2- 172.21.15.117:0/1340487550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f080fbc80 0x7f7f080fc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:40.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.289+0000 7f7f0e1a7700 1 -- 172.21.15.117:0/1340487550 >> 172.21.15.117:0/1340487550 conn(0x7f7f08072bc0 msgr2=0x7f7f08072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:40.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.289+0000 7f7f0e1a7700 1 -- 172.21.15.117:0/1340487550 shutdown_connections 2024-04-12T09:15:40.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.289+0000 7f7f0e1a7700 1 -- 172.21.15.117:0/1340487550 wait complete. 2024-04-12T09:15:40.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.289+0000 7f7f0e1a7700 1 Processor -- start 2024-04-12T09:15:40.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.290+0000 7f7f0e1a7700 1 -- start start 2024-04-12T09:15:40.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.290+0000 7f7f0e1a7700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f080fbc80 0x7f7f08115d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:40.292 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.290+0000 7f7f0e1a7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f080fc590 0x7f7f08116270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:40.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.290+0000 7f7f0e1a7700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f08116950 con 0x7f7f080fc590 2024-04-12T09:15:40.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.290+0000 7f7f0e1a7700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0810fc90 con 0x7f7f080fbc80 2024-04-12T09:15:40.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.290+0000 7f7f06ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f080fc590 0x7f7f08116270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:40.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.290+0000 7f7f06ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f080fc590 0x7f7f08116270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33344/0 (socket says 172.21.15.117:33344) 2024-04-12T09:15:40.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.290+0000 7f7f06ffd700 1 -- 172.21.15.117:0/1154715286 learned_addr learned my addr 172.21.15.117:0/1154715286 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:15:40.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.290+0000 7f7f06ffd700 1 -- 172.21.15.117:0/1154715286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f080fbc80 msgr2=0x7f7f08115d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:40.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.290+0000 7f7f077fe700 1 --2- 172.21.15.117:0/1154715286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f080fbc80 0x7f7f08115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:40.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.290+0000 7f7f06ffd700 1 --2- 172.21.15.117:0/1154715286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f080fbc80 0x7f7f08115d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:40.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.290+0000 7f7f06ffd700 1 -- 172.21.15.117:0/1154715286 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc005040 con 0x7f7f080fc590 2024-04-12T09:15:40.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.290+0000 7f7f077fe700 1 --2- 172.21.15.117:0/1154715286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f080fbc80 0x7f7f08115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T09:15:40.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.290+0000 7f7f06ffd700 1 --2- 172.21.15.117:0/1154715286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f080fc590 0x7f7f08116270 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00b3b0 tx=0x7f7efc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:40.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.290+0000 7f7eeffff700 1 -- 172.21.15.117:0/1154715286 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7efc00e040 con 0x7f7f080fc590 2024-04-12T09:15:40.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.291+0000 7f7eeffff700 1 -- 172.21.15.117:0/1154715286 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7efc00bbc0 con 0x7f7f080fc590 2024-04-12T09:15:40.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.291+0000 7f7f0e1a7700 1 -- 172.21.15.117:0/1154715286 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0810feb0 con 0x7f7f080fc590 2024-04-12T09:15:40.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.291+0000 7f7eeffff700 1 -- 172.21.15.117:0/1154715286 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7efc01c3f0 con 0x7f7f080fc590 2024-04-12T09:15:40.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.291+0000 7f7f0e1a7700 1 -- 172.21.15.117:0/1154715286 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f08110470 con 0x7f7f080fc590 2024-04-12T09:15:40.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.291+0000 7f7f0e1a7700 1 -- 172.21.15.117:0/1154715286 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f08103bc0 con 0x7f7f080fc590 2024-04-12T09:15:40.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.292+0000 7f7eeffff700 1 -- 172.21.15.117:0/1154715286 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 33) v1 ==== 91575+0+0 (secure 0 0 0) 0x7f7efc00bd30 con 0x7f7f080fc590 2024-04-12T09:15:40.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.292+0000 7f7eeffff700 1 --2- 172.21.15.117:0/1154715286 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f7ef006d5a0 0x7f7ef006fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:40.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.292+0000 7f7eeffff700 1 -- 172.21.15.117:0/1154715286 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f7efc08dd60 con 0x7f7f080fc590 2024-04-12T09:15:40.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.293+0000 7f7f077fe700 1 --2- 172.21.15.117:0/1154715286 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f7ef006d5a0 0x7f7ef006fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:40.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.293+0000 7f7f077fe700 1 --2- 172.21.15.117:0/1154715286 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f7ef006d5a0 0x7f7ef006fa50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8006fd0 tx=0x7f7ef8008040 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:40.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.297+0000 7f7eeffff700 1 -- 172.21.15.117:0/1154715286 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f7efc05b740 con 0x7f7f080fc590 2024-04-12T09:15:40.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.515+0000 7f7f0e1a7700 1 -- 172.21.15.117:0/1154715286 --> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f08111420 con 0x7f7ef006d5a0 2024-04-12T09:15:40.517 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.516+0000 7f7eeffff700 1 -- 172.21.15.117:0/1154715286 <== mgr.14694 v2:172.21.15.117:6800/1056729457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f7f08111420 con 0x7f7ef006d5a0 2024-04-12T09:15:40.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.518+0000 7f7f0e1a7700 1 -- 172.21.15.117:0/1154715286 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f7ef006d5a0 msgr2=0x7f7ef006fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:40.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.518+0000 7f7f0e1a7700 1 --2- 172.21.15.117:0/1154715286 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f7ef006d5a0 0x7f7ef006fa50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8006fd0 tx=0x7f7ef8008040 comp rx=0 tx=0).stop 2024-04-12T09:15:40.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.518+0000 7f7f0e1a7700 1 -- 172.21.15.117:0/1154715286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f080fc590 msgr2=0x7f7f08116270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:40.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.518+0000 7f7f0e1a7700 1 --2- 172.21.15.117:0/1154715286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f080fc590 0x7f7f08116270 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00b3b0 tx=0x7f7efc009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:40.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.518+0000 7f7f0e1a7700 1 -- 172.21.15.117:0/1154715286 shutdown_connections 2024-04-12T09:15:40.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.518+0000 7f7f0e1a7700 1 --2- 172.21.15.117:0/1154715286 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f7ef006d5a0 0x7f7ef006fa50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:40.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.518+0000 7f7f0e1a7700 1 --2- 172.21.15.117:0/1154715286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f080fbc80 0x7f7f08115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:40.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.518+0000 7f7f0e1a7700 1 --2- 172.21.15.117:0/1154715286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f080fc590 0x7f7f08116270 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:40.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.518+0000 7f7f0e1a7700 1 -- 172.21.15.117:0/1154715286 >> 172.21.15.117:0/1154715286 conn(0x7f7f08072bc0 msgr2=0x7f7f080fa420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:40.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.518+0000 7f7f0e1a7700 1 -- 172.21.15.117:0/1154715286 shutdown_connections 2024-04-12T09:15:40.520 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.518+0000 7f7f0e1a7700 1 -- 172.21.15.117:0/1154715286 wait complete. 2024-04-12T09:15:40.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.620+0000 7f2024c38700 1 -- 172.21.15.117:0/2735533498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20201026d0 msgr2=0x7f20200fbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:40.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.620+0000 7f2024c38700 1 --2- 172.21.15.117:0/2735533498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20201026d0 0x7f20200fbd40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2014004940 tx=0x7f2014009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:40.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.621+0000 7f2024c38700 1 -- 172.21.15.117:0/2735533498 shutdown_connections 2024-04-12T09:15:40.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.621+0000 7f2024c38700 1 --2- 172.21.15.117:0/2735533498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20201026d0 0x7f20200fbd40 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:40.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.621+0000 7f2024c38700 1 --2- 172.21.15.117:0/2735533498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2020101d30 0x7f2020102100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:40.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.621+0000 7f2024c38700 1 -- 172.21.15.117:0/2735533498 >> 172.21.15.117:0/2735533498 conn(0x7f20200f78c0 msgr2=0x7f20200f9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.621+0000 7f2024c38700 1 -- 172.21.15.117:0/2735533498 shutdown_connections 2024-04-12T09:15:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.621+0000 7f2024c38700 1 -- 172.21.15.117:0/2735533498 wait complete. 2024-04-12T09:15:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.621+0000 7f2024c38700 1 Processor -- start 2024-04-12T09:15:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.621+0000 7f2024c38700 1 -- start start 2024-04-12T09:15:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.621+0000 7f2024c38700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2020101d30 0x7f2020113900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.621+0000 7f2024c38700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20201026d0 0x7f2020113e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.621+0000 7f2024c38700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2020114490 con 0x7f2020101d30 2024-04-12T09:15:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.621+0000 7f2024c38700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202010da90 con 0x7f20201026d0 2024-04-12T09:15:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.622+0000 7f201e59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2020101d30 0x7f2020113900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.622+0000 7f201e59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2020101d30 0x7f2020113900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33366/0 (socket says 172.21.15.117:33366) 2024-04-12T09:15:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.622+0000 7f201e59c700 1 -- 172.21.15.117:0/1235969312 learned_addr learned my addr 172.21.15.117:0/1235969312 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:15:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.622+0000 7f201dd9b700 1 --2- 172.21.15.117:0/1235969312 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20201026d0 0x7f2020113e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.622+0000 7f201e59c700 1 -- 172.21.15.117:0/1235969312 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20201026d0 msgr2=0x7f2020113e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.622+0000 7f201e59c700 1 --2- 172.21.15.117:0/1235969312 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20201026d0 0x7f2020113e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.622+0000 7f201e59c700 1 -- 172.21.15.117:0/1235969312 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2014005040 con 0x7f2020101d30 2024-04-12T09:15:40.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.622+0000 7f201e59c700 1 --2- 172.21.15.117:0/1235969312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2020101d30 0x7f2020113900 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f201000eb40 tx=0x7f201000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:40.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.622+0000 7f200effd700 1 -- 172.21.15.117:0/1235969312 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2010007cc0 con 0x7f2020101d30 2024-04-12T09:15:40.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.622+0000 7f200effd700 1 -- 172.21.15.117:0/1235969312 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f201000f040 con 0x7f2020101d30 2024-04-12T09:15:40.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.622+0000 7f2024c38700 1 -- 172.21.15.117:0/1235969312 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202010dd10 con 0x7f2020101d30 2024-04-12T09:15:40.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.622+0000 7f200effd700 1 -- 172.21.15.117:0/1235969312 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f201000ca10 con 0x7f2020101d30 2024-04-12T09:15:40.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.622+0000 7f2024c38700 1 -- 172.21.15.117:0/1235969312 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202010e220 con 0x7f2020101d30 2024-04-12T09:15:40.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.623+0000 7f2024c38700 1 -- 172.21.15.117:0/1235969312 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20200fd480 con 0x7f2020101d30 2024-04-12T09:15:40.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.624+0000 7f200effd700 1 -- 172.21.15.117:0/1235969312 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 33) v1 ==== 91575+0+0 (secure 0 0 0) 0x7f201000cc80 con 0x7f2020101d30 2024-04-12T09:15:40.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.624+0000 7f200effd700 1 --2- 172.21.15.117:0/1235969312 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f200806d5a0 0x7f200806fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:40.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.625+0000 7f201dd9b700 1 --2- 172.21.15.117:0/1235969312 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f200806d5a0 0x7f200806fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:40.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.625+0000 7f200effd700 1 -- 172.21.15.117:0/1235969312 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f201008c770 con 0x7f2020101d30 2024-04-12T09:15:40.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.625+0000 7f201dd9b700 1 --2- 172.21.15.117:0/1235969312 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f200806d5a0 0x7f200806fa50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2014004890 tx=0x7f2014009e30 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:40.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.629+0000 7f200effd700 1 -- 172.21.15.117:0/1235969312 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f201005a180 con 0x7f2020101d30 2024-04-12T09:15:40.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.834+0000 7f2024c38700 1 -- 172.21.15.117:0/1235969312 --> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2020108e10 con 0x7f200806d5a0 2024-04-12T09:15:40.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.844+0000 7f200effd700 1 -- 172.21.15.117:0/1235969312 <== mgr.14694 v2:172.21.15.117:6800/1056729457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f2020108e10 con 0x7f200806d5a0 2024-04-12T09:15:40.845 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:15:40.845 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 running (79s) 57s ago 12m 16.7M - 0.25.0 c8568f914cd2 204687f21ed7 2024-04-12T09:15:40.845 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (13m) 57s ago 13m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad 1e9f2c6a4491 2024-04-12T09:15:40.845 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (11m) 112s ago 11m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad e42da3f6e517 2024-04-12T09:15:40.845 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 running (63s) 57s ago 12m 52.2M - 9.4.12 2bacad6d85d8 a7b102216886 2024-04-12T09:15:40.845 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (7m) 57s ago 7m 141M - 17.2.7-827-gd3b5060a 21de9b7369ad de062e2c10e7 2024-04-12T09:15:40.845 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 running (7m) 57s ago 7m 13.0M - 17.2.7-827-gd3b5060a 21de9b7369ad 1e82c6241a18 2024-04-12T09:15:40.846 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (7m) 112s ago 7m 15.5M - 17.2.7-827-gd3b5060a 21de9b7369ad b05228e997f7 2024-04-12T09:15:40.846 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (7m) 112s ago 7m 16.1M - 17.2.7-827-gd3b5060a 21de9b7369ad 6d7f82c072c7 2024-04-12T09:15:40.846 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:8443,9283,8765 running (3m) 57s ago 14m 511M - 19.0.0-2053-gb277feb2 668895944f0e fee613d05ab7 2024-04-12T09:15:40.846 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283,8765 running (2m) 112s ago 11m 448M - 19.0.0-2053-gb277feb2 668895944f0e c793944c3e16 2024-04-12T09:15:40.846 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (14m) 57s ago 14m 53.1M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad f9d5f7ac5270 2024-04-12T09:15:40.846 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (11m) 112s ago 11m 42.4M 2048M 17.2.7-827-gd3b5060a 21de9b7369ad 17c0db49bb16 2024-04-12T09:15:40.846 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 running (2m) 57s ago 12m 16.1M - 1.5.0 0da6a335fe13 c692bed9f6c7 2024-04-12T09:15:40.846 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (116s) 112s ago 11m 3351k - 1.5.0 0da6a335fe13 f3b5a470f545 2024-04-12T09:15:40.846 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (11m) 57s ago 11m 223M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 77040a2498f3 2024-04-12T09:15:40.846 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (10m) 57s ago 10m 234M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 8f9dbf0274ed 2024-04-12T09:15:40.846 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (10m) 57s ago 10m 200M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 339c5a80d1dd 2024-04-12T09:15:40.846 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (9m) 112s ago 9m 272M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad fb87d616bae3 2024-04-12T09:15:40.846 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (9m) 112s ago 9m 245M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad c873826a2dea 2024-04-12T09:15:40.846 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (8m) 112s ago 8m 219M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad 69cb7c22f002 2024-04-12T09:15:40.847 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 running (98s) 57s ago 12m 45.1M - 2.43.0 a07b618ecd1d 43ce588d82cc 2024-04-12T09:15:40.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.846+0000 7f2024c38700 1 -- 172.21.15.117:0/1235969312 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f200806d5a0 msgr2=0x7f200806fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:40.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.846+0000 7f2024c38700 1 --2- 172.21.15.117:0/1235969312 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f200806d5a0 0x7f200806fa50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2014004890 tx=0x7f2014009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:40.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.846+0000 7f2024c38700 1 -- 172.21.15.117:0/1235969312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2020101d30 msgr2=0x7f2020113900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:40.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.846+0000 7f2024c38700 1 --2- 172.21.15.117:0/1235969312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2020101d30 0x7f2020113900 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f201000eb40 tx=0x7f201000b040 comp rx=0 tx=0).stop 2024-04-12T09:15:40.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.846+0000 7f2024c38700 1 -- 172.21.15.117:0/1235969312 shutdown_connections 2024-04-12T09:15:40.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.846+0000 7f2024c38700 1 --2- 172.21.15.117:0/1235969312 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f200806d5a0 0x7f200806fa50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:40.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.846+0000 7f2024c38700 1 --2- 172.21.15.117:0/1235969312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2020101d30 0x7f2020113900 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:40.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.846+0000 7f2024c38700 1 --2- 172.21.15.117:0/1235969312 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20201026d0 0x7f2020113e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:40.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.846+0000 7f2024c38700 1 -- 172.21.15.117:0/1235969312 >> 172.21.15.117:0/1235969312 conn(0x7f20200f78c0 msgr2=0x7f20200f8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:40.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.846+0000 7f2024c38700 1 -- 172.21.15.117:0/1235969312 shutdown_connections 2024-04-12T09:15:40.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.846+0000 7f2024c38700 1 -- 172.21.15.117:0/1235969312 wait complete. 2024-04-12T09:15:40.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.951+0000 7f7511c17700 1 -- 172.21.15.117:0/1634833561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f750c1026c0 msgr2=0x7f750c0fbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:40.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.951+0000 7f7511c17700 1 --2- 172.21.15.117:0/1634833561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f750c1026c0 0x7f750c0fbd30 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7500004940 tx=0x7f7500009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.951+0000 7f7511c17700 1 -- 172.21.15.117:0/1634833561 shutdown_connections 2024-04-12T09:15:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.951+0000 7f7511c17700 1 --2- 172.21.15.117:0/1634833561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f750c1026c0 0x7f750c0fbd30 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.951+0000 7f7511c17700 1 --2- 172.21.15.117:0/1634833561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f750c101d20 0x7f750c1020f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.951+0000 7f7511c17700 1 -- 172.21.15.117:0/1634833561 >> 172.21.15.117:0/1634833561 conn(0x7f750c0f7870 msgr2=0x7f750c0f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.951+0000 7f7511c17700 1 -- 172.21.15.117:0/1634833561 shutdown_connections 2024-04-12T09:15:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.951+0000 7f7511c17700 1 -- 172.21.15.117:0/1634833561 wait complete. 2024-04-12T09:15:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.952+0000 7f7511c17700 1 Processor -- start 2024-04-12T09:15:40.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.952+0000 7f7511c17700 1 -- start start 2024-04-12T09:15:40.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.952+0000 7f7511c17700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f750c101d20 0x7f750c113940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:40.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.952+0000 7f7511c17700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f750c1026c0 0x7f750c113e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:40.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.952+0000 7f7511c17700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c114560 con 0x7f750c1026c0 2024-04-12T09:15:40.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.952+0000 7f7511c17700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c10dad0 con 0x7f750c101d20 2024-04-12T09:15:40.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.952+0000 7f750affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f750c1026c0 0x7f750c113e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:40.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.952+0000 7f750affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f750c1026c0 0x7f750c113e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33376/0 (socket says 172.21.15.117:33376) 2024-04-12T09:15:40.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.952+0000 7f750affd700 1 -- 172.21.15.117:0/655887157 learned_addr learned my addr 172.21.15.117:0/655887157 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:15:40.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.953+0000 7f750b7fe700 1 --2- 172.21.15.117:0/655887157 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f750c101d20 0x7f750c113940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:40.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.953+0000 7f750affd700 1 -- 172.21.15.117:0/655887157 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f750c101d20 msgr2=0x7f750c113940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.953+0000 7f750affd700 1 --2- 172.21.15.117:0/655887157 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f750c101d20 0x7f750c113940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.953+0000 7f750affd700 1 -- 172.21.15.117:0/655887157 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7500005040 con 0x7f750c1026c0 2024-04-12T09:15:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.953+0000 7f750b7fe700 1 --2- 172.21.15.117:0/655887157 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f750c101d20 0x7f750c113940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T09:15:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.953+0000 7f750affd700 1 --2- 172.21.15.117:0/655887157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f750c1026c0 0x7f750c113e80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7500009180 tx=0x7f7500009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.953+0000 7f74f3fff700 1 -- 172.21.15.117:0/655887157 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f750000e040 con 0x7f750c1026c0 2024-04-12T09:15:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.953+0000 7f7511c17700 1 -- 172.21.15.117:0/655887157 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f750c10dd50 con 0x7f750c1026c0 2024-04-12T09:15:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.953+0000 7f74f3fff700 1 -- 172.21.15.117:0/655887157 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f750000bbc0 con 0x7f750c1026c0 2024-04-12T09:15:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.953+0000 7f74f3fff700 1 -- 172.21.15.117:0/655887157 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f750001c3f0 con 0x7f750c1026c0 2024-04-12T09:15:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.953+0000 7f7511c17700 1 -- 172.21.15.117:0/655887157 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f750c10e310 con 0x7f750c1026c0 2024-04-12T09:15:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.954+0000 7f7511c17700 1 -- 172.21.15.117:0/655887157 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f750c0fd470 con 0x7f750c1026c0 2024-04-12T09:15:40.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.955+0000 7f74f3fff700 1 -- 172.21.15.117:0/655887157 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 33) v1 ==== 91575+0+0 (secure 0 0 0) 0x7f750000bd30 con 0x7f750c1026c0 2024-04-12T09:15:40.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.955+0000 7f74f3fff700 1 --2- 172.21.15.117:0/655887157 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f74f406d5a0 0x7f74f406fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:40.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.955+0000 7f74f3fff700 1 -- 172.21.15.117:0/655887157 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f750008dee0 con 0x7f750c1026c0 2024-04-12T09:15:40.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.955+0000 7f750b7fe700 1 --2- 172.21.15.117:0/655887157 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f74f406d5a0 0x7f74f406fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:40.957 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.955+0000 7f750b7fe700 1 --2- 172.21.15.117:0/655887157 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f74f406d5a0 0x7f74f406fa50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f74fc009b10 tx=0x7f74fc008040 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:40.960 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:40.960+0000 7f74f3fff700 1 -- 172.21.15.117:0/655887157 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f750005b8c0 con 0x7f750c1026c0 2024-04-12T09:15:41.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:40 smithi117 ceph-mon[29277]: pgmap v92: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:41.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:40 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:15:41.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:40 smithi117 ceph-mon[29277]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:15:41.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:40 smithi117 ceph-mon[29277]: from='client.14854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:15:41.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.258+0000 7f7511c17700 1 -- 172.21.15.117:0/655887157 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f750c108e70 con 0x7f750c1026c0 2024-04-12T09:15:41.259 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.258+0000 7f74f3fff700 1 -- 172.21.15.117:0/655887157 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f750005b450 con 0x7f750c1026c0 2024-04-12T09:15:41.259 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:15:41.259 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": { 2024-04-12T09:15:41.259 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 2 2024-04-12T09:15:41.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:15:41.259 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": { 2024-04-12T09:15:41.259 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:15:41.259 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:15:41.260 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": { 2024-04-12T09:15:41.260 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 6 2024-04-12T09:15:41.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:15:41.260 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-04-12T09:15:41.260 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 4 2024-04-12T09:15:41.260 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:15:41.260 INFO:teuthology.orchestra.run.smithi117.stdout: "overall": { 2024-04-12T09:15:41.260 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 12, 2024-04-12T09:15:41.260 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:15:41.260 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:15:41.260 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:15:41.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.260+0000 7f7511c17700 1 -- 172.21.15.117:0/655887157 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f74f406d5a0 msgr2=0x7f74f406fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:41.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.260+0000 7f7511c17700 1 --2- 172.21.15.117:0/655887157 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f74f406d5a0 0x7f74f406fa50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f74fc009b10 tx=0x7f74fc008040 comp rx=0 tx=0).stop 2024-04-12T09:15:41.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.260+0000 7f7511c17700 1 -- 172.21.15.117:0/655887157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f750c1026c0 msgr2=0x7f750c113e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:41.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.260+0000 7f7511c17700 1 --2- 172.21.15.117:0/655887157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f750c1026c0 0x7f750c113e80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7500009180 tx=0x7f7500009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:41.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.261+0000 7f7511c17700 1 -- 172.21.15.117:0/655887157 shutdown_connections 2024-04-12T09:15:41.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.261+0000 7f7511c17700 1 --2- 172.21.15.117:0/655887157 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f74f406d5a0 0x7f74f406fa50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:41.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.261+0000 7f7511c17700 1 --2- 172.21.15.117:0/655887157 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f750c101d20 0x7f750c113940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:41.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.261+0000 7f7511c17700 1 --2- 172.21.15.117:0/655887157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f750c1026c0 0x7f750c113e80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:41.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.261+0000 7f7511c17700 1 -- 172.21.15.117:0/655887157 >> 172.21.15.117:0/655887157 conn(0x7f750c0f7870 msgr2=0x7f750c0f8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:41.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.261+0000 7f7511c17700 1 -- 172.21.15.117:0/655887157 shutdown_connections 2024-04-12T09:15:41.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.261+0000 7f7511c17700 1 -- 172.21.15.117:0/655887157 wait complete. 2024-04-12T09:15:41.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:40 smithi203 ceph-mon[36428]: pgmap v92: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:41.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:40 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:15:41.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:40 smithi203 ceph-mon[36428]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:15:41.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:40 smithi203 ceph-mon[36428]: from='client.14854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:15:41.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.364+0000 7f80547be700 1 -- 172.21.15.117:0/2809960780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f804c102710 msgr2=0x7f804c0fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:41.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.364+0000 7f80547be700 1 --2- 172.21.15.117:0/2809960780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f804c102710 0x7f804c0fbd80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f803c004940 tx=0x7f803c009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:41.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.365+0000 7f80547be700 1 -- 172.21.15.117:0/2809960780 shutdown_connections 2024-04-12T09:15:41.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.365+0000 7f80547be700 1 --2- 172.21.15.117:0/2809960780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f804c102710 0x7f804c0fbd80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:41.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.365+0000 7f80547be700 1 --2- 172.21.15.117:0/2809960780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f804c101d70 0x7f804c102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:41.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.365+0000 7f80547be700 1 -- 172.21.15.117:0/2809960780 >> 172.21.15.117:0/2809960780 conn(0x7f804c072bc0 msgr2=0x7f804c072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:41.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.365+0000 7f80547be700 1 -- 172.21.15.117:0/2809960780 shutdown_connections 2024-04-12T09:15:41.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.365+0000 7f80547be700 1 -- 172.21.15.117:0/2809960780 wait complete. 2024-04-12T09:15:41.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.365+0000 7f80547be700 1 Processor -- start 2024-04-12T09:15:41.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.365+0000 7f80547be700 1 -- start start 2024-04-12T09:15:41.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.366+0000 7f80547be700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f804c101d70 0x7f804c10ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:41.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.366+0000 7f80547be700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f804c102710 0x7f804c10f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:41.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.366+0000 7f80547be700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c10f760 con 0x7f804c102710 2024-04-12T09:15:41.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.366+0000 7f80547be700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c10f8a0 con 0x7f804c101d70 2024-04-12T09:15:41.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.366+0000 7f8051d59700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f804c102710 0x7f804c10f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:41.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.366+0000 7f8051d59700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f804c102710 0x7f804c10f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33400/0 (socket says 172.21.15.117:33400) 2024-04-12T09:15:41.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.366+0000 7f8051d59700 1 -- 172.21.15.117:0/987934849 learned_addr learned my addr 172.21.15.117:0/987934849 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:15:41.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.366+0000 7f805255a700 1 --2- 172.21.15.117:0/987934849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f804c101d70 0x7f804c10ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:41.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.366+0000 7f8051d59700 1 -- 172.21.15.117:0/987934849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f804c101d70 msgr2=0x7f804c10ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:41.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.366+0000 7f8051d59700 1 --2- 172.21.15.117:0/987934849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f804c101d70 0x7f804c10ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:41.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.366+0000 7f8051d59700 1 -- 172.21.15.117:0/987934849 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c005040 con 0x7f804c102710 2024-04-12T09:15:41.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.366+0000 7f8051d59700 1 --2- 172.21.15.117:0/987934849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f804c102710 0x7f804c10f220 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f803c009180 tx=0x7f803c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:41.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.366+0000 7f8042ffd700 1 -- 172.21.15.117:0/987934849 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f803c00e040 con 0x7f804c102710 2024-04-12T09:15:41.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.366+0000 7f80547be700 1 -- 172.21.15.117:0/987934849 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804c117b90 con 0x7f804c102710 2024-04-12T09:15:41.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.366+0000 7f8042ffd700 1 -- 172.21.15.117:0/987934849 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f803c013420 con 0x7f804c102710 2024-04-12T09:15:41.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.366+0000 7f8042ffd700 1 -- 172.21.15.117:0/987934849 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f803c01c610 con 0x7f804c102710 2024-04-12T09:15:41.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.367+0000 7f80547be700 1 -- 172.21.15.117:0/987934849 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f804c118120 con 0x7f804c102710 2024-04-12T09:15:41.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.368+0000 7f80547be700 1 -- 172.21.15.117:0/987934849 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f804c104240 con 0x7f804c102710 2024-04-12T09:15:41.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.368+0000 7f8042ffd700 1 -- 172.21.15.117:0/987934849 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 33) v1 ==== 91575+0+0 (secure 0 0 0) 0x7f803c013a00 con 0x7f804c102710 2024-04-12T09:15:41.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.368+0000 7f8042ffd700 1 --2- 172.21.15.117:0/987934849 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f803806d5a0 0x7f803806fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:41.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.368+0000 7f8042ffd700 1 -- 172.21.15.117:0/987934849 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f803c08dca0 con 0x7f804c102710 2024-04-12T09:15:41.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.368+0000 7f805255a700 1 --2- 172.21.15.117:0/987934849 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f803806d5a0 0x7f803806fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:41.371 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.369+0000 7f805255a700 1 --2- 172.21.15.117:0/987934849 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f803806d5a0 0x7f803806fa50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8048004f40 tx=0x7f804800b040 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:41.373 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.373+0000 7f8042ffd700 1 -- 172.21.15.117:0/987934849 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f803c092070 con 0x7f804c102710 2024-04-12T09:15:41.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.627+0000 7f80547be700 1 -- 172.21.15.117:0/987934849 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f804c108e50 con 0x7f804c102710 2024-04-12T09:15:41.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.627+0000 7f8042ffd700 1 -- 172.21.15.117:0/987934849 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1814 (secure 0 0 0) 0x7f803c057c00 con 0x7f804c102710 2024-04-12T09:15:41.628 INFO:teuthology.orchestra.run.smithi117.stdout:e14 2024-04-12T09:15:41.628 INFO:teuthology.orchestra.run.smithi117.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T09:15:41.628 INFO:teuthology.orchestra.run.smithi117.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:15:41.628 INFO:teuthology.orchestra.run.smithi117.stdout:legacy client fscid: 1 2024-04-12T09:15:41.628 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:15:41.629 INFO:teuthology.orchestra.run.smithi117.stdout:Filesystem 'cephfs' (1) 2024-04-12T09:15:41.629 INFO:teuthology.orchestra.run.smithi117.stdout:fs_name cephfs 2024-04-12T09:15:41.629 INFO:teuthology.orchestra.run.smithi117.stdout:epoch 14 2024-04-12T09:15:41.629 INFO:teuthology.orchestra.run.smithi117.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T09:15:41.629 INFO:teuthology.orchestra.run.smithi117.stdout:created 2024-04-12T09:08:12.488144+0000 2024-04-12T09:15:41.629 INFO:teuthology.orchestra.run.smithi117.stdout:modified 2024-04-12T09:08:30.563184+0000 2024-04-12T09:15:41.629 INFO:teuthology.orchestra.run.smithi117.stdout:tableserver 0 2024-04-12T09:15:41.629 INFO:teuthology.orchestra.run.smithi117.stdout:root 0 2024-04-12T09:15:41.629 INFO:teuthology.orchestra.run.smithi117.stdout:session_timeout 60 2024-04-12T09:15:41.629 INFO:teuthology.orchestra.run.smithi117.stdout:session_autoclose 300 2024-04-12T09:15:41.629 INFO:teuthology.orchestra.run.smithi117.stdout:max_file_size 1099511627776 2024-04-12T09:15:41.629 INFO:teuthology.orchestra.run.smithi117.stdout:required_client_features {} 2024-04-12T09:15:41.629 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure 0 2024-04-12T09:15:41.629 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure_osd_epoch 46 2024-04-12T09:15:41.630 INFO:teuthology.orchestra.run.smithi117.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:15:41.630 INFO:teuthology.orchestra.run.smithi117.stdout:max_mds 1 2024-04-12T09:15:41.630 INFO:teuthology.orchestra.run.smithi117.stdout:in 0 2024-04-12T09:15:41.630 INFO:teuthology.orchestra.run.smithi117.stdout:up {0=14474} 2024-04-12T09:15:41.630 INFO:teuthology.orchestra.run.smithi117.stdout:failed 2024-04-12T09:15:41.630 INFO:teuthology.orchestra.run.smithi117.stdout:damaged 2024-04-12T09:15:41.630 INFO:teuthology.orchestra.run.smithi117.stdout:stopped 2024-04-12T09:15:41.630 INFO:teuthology.orchestra.run.smithi117.stdout:data_pools [3] 2024-04-12T09:15:41.630 INFO:teuthology.orchestra.run.smithi117.stdout:metadata_pool 2 2024-04-12T09:15:41.630 INFO:teuthology.orchestra.run.smithi117.stdout:inline_data disabled 2024-04-12T09:15:41.630 INFO:teuthology.orchestra.run.smithi117.stdout:balancer 2024-04-12T09:15:41.630 INFO:teuthology.orchestra.run.smithi117.stdout:standby_count_wanted 1 2024-04-12T09:15:41.630 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.eslmxh{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.117:6828/2248590199,v1:172.21.15.117:6829/2248590199] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:15:41.631 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:15:41.631 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:15:41.631 INFO:teuthology.orchestra.run.smithi117.stdout:Standby daemons: 2024-04-12T09:15:41.631 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:15:41.631 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.wddsgt{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/4010127141,v1:172.21.15.117:6827/4010127141] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:15:41.631 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.fbeixl{-1:24265} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.203:6824/840607003,v1:172.21.15.203:6825/840607003] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:15:41.631 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.bszhxz{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/2731911290,v1:172.21.15.203:6827/2731911290] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:15:41.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.629+0000 7f80547be700 1 -- 172.21.15.117:0/987934849 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f803806d5a0 msgr2=0x7f803806fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:41.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.629+0000 7f80547be700 1 --2- 172.21.15.117:0/987934849 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f803806d5a0 0x7f803806fa50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8048004f40 tx=0x7f804800b040 comp rx=0 tx=0).stop 2024-04-12T09:15:41.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.629+0000 7f80547be700 1 -- 172.21.15.117:0/987934849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f804c102710 msgr2=0x7f804c10f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:41.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.629+0000 7f80547be700 1 --2- 172.21.15.117:0/987934849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f804c102710 0x7f804c10f220 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f803c009180 tx=0x7f803c009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:41.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.629+0000 7f80547be700 1 -- 172.21.15.117:0/987934849 shutdown_connections 2024-04-12T09:15:41.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.629+0000 7f80547be700 1 --2- 172.21.15.117:0/987934849 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f803806d5a0 0x7f803806fa50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:41.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.629+0000 7f80547be700 1 --2- 172.21.15.117:0/987934849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f804c101d70 0x7f804c10ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:41.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.629+0000 7f80547be700 1 --2- 172.21.15.117:0/987934849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f804c102710 0x7f804c10f220 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:41.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.629+0000 7f80547be700 1 -- 172.21.15.117:0/987934849 >> 172.21.15.117:0/987934849 conn(0x7f804c072bc0 msgr2=0x7f804c0fb080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:41.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.630+0000 7f80547be700 1 -- 172.21.15.117:0/987934849 shutdown_connections 2024-04-12T09:15:41.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.630+0000 7f80547be700 1 -- 172.21.15.117:0/987934849 wait complete. 2024-04-12T09:15:41.632 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 14 2024-04-12T09:15:41.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.732+0000 7f1b51220700 1 -- 172.21.15.117:0/3878344650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b4c101d20 msgr2=0x7f1b4c1020f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:41.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.732+0000 7f1b51220700 1 --2- 172.21.15.117:0/3878344650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b4c101d20 0x7f1b4c1020f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c004940 tx=0x7f1b3c009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:41.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.732+0000 7f1b51220700 1 -- 172.21.15.117:0/3878344650 shutdown_connections 2024-04-12T09:15:41.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.732+0000 7f1b51220700 1 --2- 172.21.15.117:0/3878344650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b4c1026c0 0x7f1b4c0fbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:41.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.732+0000 7f1b51220700 1 --2- 172.21.15.117:0/3878344650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b4c101d20 0x7f1b4c1020f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:41.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.732+0000 7f1b51220700 1 -- 172.21.15.117:0/3878344650 >> 172.21.15.117:0/3878344650 conn(0x7f1b4c0f7870 msgr2=0x7f1b4c0f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:41.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.732+0000 7f1b51220700 1 -- 172.21.15.117:0/3878344650 shutdown_connections 2024-04-12T09:15:41.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.732+0000 7f1b51220700 1 -- 172.21.15.117:0/3878344650 wait complete. 2024-04-12T09:15:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.733+0000 7f1b51220700 1 Processor -- start 2024-04-12T09:15:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.733+0000 7f1b51220700 1 -- start start 2024-04-12T09:15:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.733+0000 7f1b51220700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b4c101d20 0x7f1b4c1139f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.733+0000 7f1b51220700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b4c1026c0 0x7f1b4c113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.733+0000 7f1b51220700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c114580 con 0x7f1b4c1026c0 2024-04-12T09:15:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.733+0000 7f1b51220700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c10db80 con 0x7f1b4c101d20 2024-04-12T09:15:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.733+0000 7f1b4a59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b4c1026c0 0x7f1b4c113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.733+0000 7f1b4a59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b4c1026c0 0x7f1b4c113f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33404/0 (socket says 172.21.15.117:33404) 2024-04-12T09:15:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.733+0000 7f1b4a59c700 1 -- 172.21.15.117:0/1673683281 learned_addr learned my addr 172.21.15.117:0/1673683281 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:15:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.733+0000 7f1b4ad9d700 1 --2- 172.21.15.117:0/1673683281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b4c101d20 0x7f1b4c1139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.734+0000 7f1b4a59c700 1 -- 172.21.15.117:0/1673683281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b4c101d20 msgr2=0x7f1b4c1139f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.734+0000 7f1b4a59c700 1 --2- 172.21.15.117:0/1673683281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b4c101d20 0x7f1b4c1139f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:41.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.734+0000 7f1b4a59c700 1 -- 172.21.15.117:0/1673683281 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c005040 con 0x7f1b4c1026c0 2024-04-12T09:15:41.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.734+0000 7f1b4a59c700 1 --2- 172.21.15.117:0/1673683281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b4c1026c0 0x7f1b4c113f30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1b4000c800 tx=0x7f1b40004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:41.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.734+0000 7f1b337fe700 1 -- 172.21.15.117:0/1673683281 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b400106f0 con 0x7f1b4c1026c0 2024-04-12T09:15:41.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.734+0000 7f1b51220700 1 -- 172.21.15.117:0/1673683281 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b4c10de60 con 0x7f1b4c1026c0 2024-04-12T09:15:41.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.734+0000 7f1b337fe700 1 -- 172.21.15.117:0/1673683281 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1b40010d20 con 0x7f1b4c1026c0 2024-04-12T09:15:41.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.734+0000 7f1b337fe700 1 -- 172.21.15.117:0/1673683281 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b400113a0 con 0x7f1b4c1026c0 2024-04-12T09:15:41.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.734+0000 7f1b51220700 1 -- 172.21.15.117:0/1673683281 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4c10e420 con 0x7f1b4c1026c0 2024-04-12T09:15:41.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.735+0000 7f1b51220700 1 -- 172.21.15.117:0/1673683281 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4c0fd470 con 0x7f1b4c1026c0 2024-04-12T09:15:41.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.735+0000 7f1b337fe700 1 -- 172.21.15.117:0/1673683281 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 33) v1 ==== 91575+0+0 (secure 0 0 0) 0x7f1b40012400 con 0x7f1b4c1026c0 2024-04-12T09:15:41.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.736+0000 7f1b337fe700 1 --2- 172.21.15.117:0/1673683281 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f1b3406d5a0 0x7f1b3406fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:41.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.736+0000 7f1b337fe700 1 -- 172.21.15.117:0/1673683281 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f1b4008ca00 con 0x7f1b4c1026c0 2024-04-12T09:15:41.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.736+0000 7f1b4ad9d700 1 --2- 172.21.15.117:0/1673683281 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f1b3406d5a0 0x7f1b3406fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:41.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.736+0000 7f1b4ad9d700 1 --2- 172.21.15.117:0/1673683281 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f1b3406d5a0 0x7f1b3406fa50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c004f90 tx=0x7f1b3c009e30 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:41.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.740+0000 7f1b337fe700 1 -- 172.21.15.117:0/1673683281 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7f1b4005a480 con 0x7f1b4c1026c0 2024-04-12T09:15:41.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.975+0000 7f1b51220700 1 -- 172.21.15.117:0/1673683281 --> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b4c108e20 con 0x7f1b3406d5a0 2024-04-12T09:15:41.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.977+0000 7f1b337fe700 1 -- 172.21.15.117:0/1673683281 <== mgr.14694 v2:172.21.15.117:6800/1056729457 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f1b4c108e20 con 0x7f1b3406d5a0 2024-04-12T09:15:41.978 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:15:41.978 INFO:teuthology.orchestra.run.smithi117.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec", 2024-04-12T09:15:41.978 INFO:teuthology.orchestra.run.smithi117.stdout: "in_progress": true, 2024-04-12T09:15:41.978 INFO:teuthology.orchestra.run.smithi117.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T09:15:41.978 INFO:teuthology.orchestra.run.smithi117.stdout: "services_complete": [ 2024-04-12T09:15:41.978 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr" 2024-04-12T09:15:41.978 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2024-04-12T09:15:41.978 INFO:teuthology.orchestra.run.smithi117.stdout: "progress": "2/21 daemons upgraded", 2024-04-12T09:15:41.978 INFO:teuthology.orchestra.run.smithi117.stdout: "message": "Currently upgrading mon daemons", 2024-04-12T09:15:41.978 INFO:teuthology.orchestra.run.smithi117.stdout: "is_paused": false 2024-04-12T09:15:41.978 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:15:41.979 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.979+0000 7f1b51220700 1 -- 172.21.15.117:0/1673683281 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f1b3406d5a0 msgr2=0x7f1b3406fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:41.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.979+0000 7f1b51220700 1 --2- 172.21.15.117:0/1673683281 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f1b3406d5a0 0x7f1b3406fa50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c004f90 tx=0x7f1b3c009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:41.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.979+0000 7f1b51220700 1 -- 172.21.15.117:0/1673683281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b4c1026c0 msgr2=0x7f1b4c113f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:41.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.979+0000 7f1b51220700 1 --2- 172.21.15.117:0/1673683281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b4c1026c0 0x7f1b4c113f30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1b4000c800 tx=0x7f1b40004470 comp rx=0 tx=0).stop 2024-04-12T09:15:41.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.979+0000 7f1b51220700 1 -- 172.21.15.117:0/1673683281 shutdown_connections 2024-04-12T09:15:41.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.979+0000 7f1b51220700 1 --2- 172.21.15.117:0/1673683281 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7f1b3406d5a0 0x7f1b3406fa50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:41.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.979+0000 7f1b51220700 1 --2- 172.21.15.117:0/1673683281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b4c101d20 0x7f1b4c1139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:41.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.979+0000 7f1b51220700 1 --2- 172.21.15.117:0/1673683281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b4c1026c0 0x7f1b4c113f30 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:41.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.979+0000 7f1b51220700 1 -- 172.21.15.117:0/1673683281 >> 172.21.15.117:0/1673683281 conn(0x7f1b4c0f7870 msgr2=0x7f1b4c0f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:41.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.979+0000 7f1b51220700 1 -- 172.21.15.117:0/1673683281 shutdown_connections 2024-04-12T09:15:41.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:41.979+0000 7f1b51220700 1 -- 172.21.15.117:0/1673683281 wait complete. 2024-04-12T09:15:42.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.081+0000 7fdf5bfe8700 1 -- 172.21.15.117:0/2278736080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf54102710 msgr2=0x7fdf540fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:42.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.081+0000 7fdf5bfe8700 1 --2- 172.21.15.117:0/2278736080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf54102710 0x7fdf540fbd80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdf44004940 tx=0x7fdf44009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:42.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.081+0000 7fdf5bfe8700 1 -- 172.21.15.117:0/2278736080 shutdown_connections 2024-04-12T09:15:42.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.081+0000 7fdf5bfe8700 1 --2- 172.21.15.117:0/2278736080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf54102710 0x7fdf540fbd80 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:42.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.081+0000 7fdf5bfe8700 1 --2- 172.21.15.117:0/2278736080 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf54101d70 0x7fdf54102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:42.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.081+0000 7fdf5bfe8700 1 -- 172.21.15.117:0/2278736080 >> 172.21.15.117:0/2278736080 conn(0x7fdf54072bc0 msgr2=0x7fdf54072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:42.082 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.081+0000 7fdf5bfe8700 1 -- 172.21.15.117:0/2278736080 shutdown_connections 2024-04-12T09:15:42.082 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:41 smithi117 ceph-mon[29277]: from='client.14858 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:15:42.082 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:41 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:15:42.083 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:41 smithi117 ceph-mon[29277]: Upgrade: Target is version 19.0.0-2053-gb277feb2 (squid) 2024-04-12T09:15:42.083 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:41 smithi117 ceph-mon[29277]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, digests ['quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec'] 2024-04-12T09:15:42.083 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:41 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:15:42.083 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:41 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:15:42.083 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:41 smithi117 ceph-mon[29277]: Upgrade: Setting container_image for all mgr 2024-04-12T09:15:42.083 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:41 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:15:42.083 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:41 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-12T09:15:42.083 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:41 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/655887157' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:15:42.083 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:41 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/987934849' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:15:42.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.081+0000 7fdf5bfe8700 1 -- 172.21.15.117:0/2278736080 wait complete. 2024-04-12T09:15:42.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.081+0000 7fdf5bfe8700 1 Processor -- start 2024-04-12T09:15:42.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.081+0000 7fdf5bfe8700 1 -- start start 2024-04-12T09:15:42.085 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.082+0000 7fdf5bfe8700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf54101d70 0x7fdf5410c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:42.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.082+0000 7fdf5bfe8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf54102710 0x7fdf5410ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:42.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.082+0000 7fdf5bfe8700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5410d430 con 0x7fdf54102710 2024-04-12T09:15:42.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.082+0000 7fdf5bfe8700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5410d5a0 con 0x7fdf54101d70 2024-04-12T09:15:42.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.082+0000 7fdf59583700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf54102710 0x7fdf5410ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:42.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.082+0000 7fdf59583700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf54102710 0x7fdf5410ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:33416/0 (socket says 172.21.15.117:33416) 2024-04-12T09:15:42.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.082+0000 7fdf59583700 1 -- 172.21.15.117:0/1367109047 learned_addr learned my addr 172.21.15.117:0/1367109047 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:15:42.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.082+0000 7fdf59d84700 1 --2- 172.21.15.117:0/1367109047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf54101d70 0x7fdf5410c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:42.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.082+0000 7fdf59583700 1 -- 172.21.15.117:0/1367109047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf54101d70 msgr2=0x7fdf5410c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:42.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.082+0000 7fdf59583700 1 --2- 172.21.15.117:0/1367109047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf54101d70 0x7fdf5410c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:42.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.082+0000 7fdf59583700 1 -- 172.21.15.117:0/1367109047 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf44005040 con 0x7fdf54102710 2024-04-12T09:15:42.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.082+0000 7fdf59d84700 1 --2- 172.21.15.117:0/1367109047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf54101d70 0x7fdf5410c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T09:15:42.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.082+0000 7fdf59583700 1 --2- 172.21.15.117:0/1367109047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf54102710 0x7fdf5410ce60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009100 tx=0x7fdf44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:42.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.082+0000 7fdf4a7fc700 1 -- 172.21.15.117:0/1367109047 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf4400e040 con 0x7fdf54102710 2024-04-12T09:15:42.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.082+0000 7fdf4a7fc700 1 -- 172.21.15.117:0/1367109047 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdf44013420 con 0x7fdf54102710 2024-04-12T09:15:42.086 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.082+0000 7fdf5bfe8700 1 -- 172.21.15.117:0/1367109047 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf54119f90 con 0x7fdf54102710 2024-04-12T09:15:42.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.082+0000 7fdf4a7fc700 1 -- 172.21.15.117:0/1367109047 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf4401c610 con 0x7fdf54102710 2024-04-12T09:15:42.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.083+0000 7fdf5bfe8700 1 -- 172.21.15.117:0/1367109047 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5411a360 con 0x7fdf54102710 2024-04-12T09:15:42.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.084+0000 7fdf5bfe8700 1 -- 172.21.15.117:0/1367109047 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf540ff080 con 0x7fdf54102710 2024-04-12T09:15:42.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.084+0000 7fdf4a7fc700 1 -- 172.21.15.117:0/1367109047 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 33) v1 ==== 91575+0+0 (secure 0 0 0) 0x7fdf44013590 con 0x7fdf54102710 2024-04-12T09:15:42.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.084+0000 7fdf4a7fc700 1 --2- 172.21.15.117:0/1367109047 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fdf4006d5a0 0x7fdf4006fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:15:42.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.084+0000 7fdf4a7fc700 1 -- 172.21.15.117:0/1367109047 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fdf4408ddc0 con 0x7fdf54102710 2024-04-12T09:15:42.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.084+0000 7fdf59d84700 1 --2- 172.21.15.117:0/1367109047 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fdf4006d5a0 0x7fdf4006fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:15:42.087 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.085+0000 7fdf59d84700 1 --2- 172.21.15.117:0/1367109047 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fdf4006d5a0 0x7fdf4006fa50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c006fd0 tx=0x7fdf4c008040 comp rx=0 tx=0).ready entity=mgr.14694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:15:42.089 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.089+0000 7fdf4a7fc700 1 -- 172.21.15.117:0/1367109047 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183140 (secure 0 0 0) 0x7fdf4405b7a0 con 0x7fdf54102710 2024-04-12T09:15:42.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:41 smithi203 ceph-mon[36428]: from='client.14858 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:15:42.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:41 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:15:42.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:41 smithi203 ceph-mon[36428]: Upgrade: Target is version 19.0.0-2053-gb277feb2 (squid) 2024-04-12T09:15:42.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:41 smithi203 ceph-mon[36428]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, digests ['quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec'] 2024-04-12T09:15:42.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:41 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:15:42.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:41 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:15:42.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:41 smithi203 ceph-mon[36428]: Upgrade: Setting container_image for all mgr 2024-04-12T09:15:42.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:41 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:15:42.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:41 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-12T09:15:42.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:41 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/655887157' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:15:42.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:41 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/987934849' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:15:42.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.366+0000 7fdf5bfe8700 1 -- 172.21.15.117:0/1367109047 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdf54065de0 con 0x7fdf54102710 2024-04-12T09:15:42.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.366+0000 7fdf4a7fc700 1 -- 172.21.15.117:0/1367109047 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fdf4405b330 con 0x7fdf54102710 2024-04-12T09:15:42.367 INFO:teuthology.orchestra.run.smithi117.stdout:HEALTH_OK 2024-04-12T09:15:42.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.368+0000 7fdf5bfe8700 1 -- 172.21.15.117:0/1367109047 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fdf4006d5a0 msgr2=0x7fdf4006fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:42.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.368+0000 7fdf5bfe8700 1 --2- 172.21.15.117:0/1367109047 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fdf4006d5a0 0x7fdf4006fa50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c006fd0 tx=0x7fdf4c008040 comp rx=0 tx=0).stop 2024-04-12T09:15:42.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.368+0000 7fdf5bfe8700 1 -- 172.21.15.117:0/1367109047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf54102710 msgr2=0x7fdf5410ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:15:42.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.368+0000 7fdf5bfe8700 1 --2- 172.21.15.117:0/1367109047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf54102710 0x7fdf5410ce60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009100 tx=0x7fdf44009e30 comp rx=0 tx=0).stop 2024-04-12T09:15:42.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.368+0000 7fdf5bfe8700 1 -- 172.21.15.117:0/1367109047 shutdown_connections 2024-04-12T09:15:42.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.368+0000 7fdf5bfe8700 1 --2- 172.21.15.117:0/1367109047 >> [v2:172.21.15.117:6800/1056729457,v1:172.21.15.117:6801/1056729457] conn(0x7fdf4006d5a0 0x7fdf4006fa50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:42.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.368+0000 7fdf5bfe8700 1 --2- 172.21.15.117:0/1367109047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf54101d70 0x7fdf5410c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:42.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.368+0000 7fdf5bfe8700 1 --2- 172.21.15.117:0/1367109047 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf54102710 0x7fdf5410ce60 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:15:42.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.368+0000 7fdf5bfe8700 1 -- 172.21.15.117:0/1367109047 >> 172.21.15.117:0/1367109047 conn(0x7fdf54072bc0 msgr2=0x7fdf540faf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:15:42.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.368+0000 7fdf5bfe8700 1 -- 172.21.15.117:0/1367109047 shutdown_connections 2024-04-12T09:15:42.370 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:15:42.368+0000 7fdf5bfe8700 1 -- 172.21.15.117:0/1367109047 wait complete. 2024-04-12T09:15:43.281 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:42 smithi117 ceph-mon[29277]: pgmap v93: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:43.281 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:42 smithi117 ceph-mon[29277]: from='client.14870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:15:43.281 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:42 smithi117 ceph-mon[29277]: from='client.? 172.21.15.117:0/1367109047' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:15:43.281 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:42 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:15:43.281 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:42 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T09:15:43.281 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:42 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-12T09:15:43.281 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:42 smithi117 ceph-mon[29277]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:15:43.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:42 smithi203 ceph-mon[36428]: pgmap v93: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:43.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:42 smithi203 ceph-mon[36428]: from='client.14870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:15:43.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:42 smithi203 ceph-mon[36428]: from='client.? 172.21.15.117:0/1367109047' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:15:43.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:42 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' 2024-04-12T09:15:43.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:42 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T09:15:43.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:42 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-12T09:15:43.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:42 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:15:44.130 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:43 smithi117 ceph-mon[29277]: Upgrade: Updating mon.smithi117 2024-04-12T09:15:44.131 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:43 smithi117 ceph-mon[29277]: Deploying daemon mon.smithi117 on smithi117 2024-04-12T09:15:44.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:43 smithi203 ceph-mon[36428]: Upgrade: Updating mon.smithi117 2024-04-12T09:15:44.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:43 smithi203 ceph-mon[36428]: Deploying daemon mon.smithi117 on smithi117 2024-04-12T09:15:44.684 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:44 smithi117 systemd[1]: Stopping Ceph mon.smithi117 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:15:44.684 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:44 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117[29273]: 2024-04-12T09:15:44.675+0000 7ff137485700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi117 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T09:15:44.684 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:44 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117[29273]: 2024-04-12T09:15:44.675+0000 7ff137485700 -1 mon.smithi117@0(leader) e2 *** Got Signal Terminated *** 2024-04-12T09:15:45.127 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:44 smithi117 podman[113398]: 2024-04-12 09:15:44.839488563 +0000 UTC m=+0.266821404 container died f9d5f7ac5270f6e964257b43e08d38b79d97a83858cc6ccfb8e9c197a3579c48 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=quincy-d3b5060, io.buildah.version=1.33.5) 2024-04-12T09:15:45.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:45 smithi117 podman[113398]: 2024-04-12 09:15:45.234484381 +0000 UTC m=+0.661817264 container cleanup f9d5f7ac5270f6e964257b43e08d38b79d97a83858cc6ccfb8e9c197a3579c48 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=quincy-d3b5060, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-12T09:15:45.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:45 smithi117 bash[113398]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117 2024-04-12T09:15:45.856 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:45 smithi117 podman[113423]: 2024-04-12 09:15:45.494166186 +0000 UTC m=+0.650957632 container remove f9d5f7ac5270f6e964257b43e08d38b79d97a83858cc6ccfb8e9c197a3579c48 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=quincy-d3b5060, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS) 2024-04-12T09:15:45.856 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:45 smithi117 systemd[1]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968@mon.smithi117.service: Deactivated successfully. 2024-04-12T09:15:45.856 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:45 smithi117 systemd[1]: Stopped Ceph mon.smithi117 for 12161984-f8ab-11ee-bc8c-c7b262605968. 2024-04-12T09:15:45.856 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:45 smithi117 systemd[1]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968@mon.smithi117.service: Consumed 12.904s CPU time. 2024-04-12T09:15:46.159 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:45 smithi117 systemd[1]: Starting Ceph mon.smithi117 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:15:46.159 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 podman[113552]: 2024-04-12 09:15:45.972261974 +0000 UTC m=+0.017805146 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:15:46.159 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 podman[113552]: 2024-04-12 09:15:46.070619812 +0000 UTC m=+0.116162985 container create 6823aaff30ce3c92ac69dc3427dc1e67e6827d3e2387b5d421fb18fb990e14e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-b277feb, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409) 2024-04-12T09:15:46.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 podman[113552]: 2024-04-12 09:15:46.256591041 +0000 UTC m=+0.302134222 container init 6823aaff30ce3c92ac69dc3427dc1e67e6827d3e2387b5d421fb18fb990e14e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b277feb, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-12T09:15:46.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 podman[113552]: 2024-04-12 09:15:46.260205621 +0000 UTC m=+0.305748797 container start 6823aaff30ce3c92ac69dc3427dc1e67e6827d3e2387b5d421fb18fb990e14e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b277feb, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-12T09:15:46.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: set uid:gid to 167:167 (ceph:ceph) 2024-04-12T09:15:46.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev), process ceph-mon, pid 2 2024-04-12T09:15:46.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: pidfile_write: ignore empty --pid-file 2024-04-12T09:15:46.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: load: jerasure load: lrc 2024-04-12T09:15:46.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: RocksDB version: 7.9.2 2024-04-12T09:15:46.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Git sha 0 2024-04-12T09:15:46.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Compile date 2024-04-09 21:18:54 2024-04-12T09:15:46.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: DB SUMMARY 2024-04-12T09:15:46.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: DB Session ID: CU848JPVIYXBBVKWMOUS 2024-04-12T09:15:46.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: CURRENT file: CURRENT 2024-04-12T09:15:46.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: IDENTITY file: IDENTITY 2024-04-12T09:15:46.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1158 Bytes 2024-04-12T09:15:46.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi117/store.db dir, Total Num: 1, files: 000033.sst 2024-04-12T09:15:46.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi117/store.db: 000031.log size: 2098150 ; 2024-04-12T09:15:46.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.error_if_exists: 0 2024-04-12T09:15:46.413 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.create_if_missing: 0 2024-04-12T09:15:46.413 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.paranoid_checks: 1 2024-04-12T09:15:46.413 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-12T09:15:46.413 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-12T09:15:46.413 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-12T09:15:46.413 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.env: 0x55f397b18c60 2024-04-12T09:15:46.413 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.fs: PosixFileSystem 2024-04-12T09:15:46.413 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.info_log: 0x55f398a319a0 2024-04-12T09:15:46.413 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_file_opening_threads: 16 2024-04-12T09:15:46.413 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.statistics: (nil) 2024-04-12T09:15:46.413 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.use_fsync: 0 2024-04-12T09:15:46.413 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_log_file_size: 0 2024-04-12T09:15:46.413 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-12T09:15:46.413 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-12T09:15:46.413 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.keep_log_file_num: 1000 2024-04-12T09:15:46.414 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.recycle_log_file_num: 0 2024-04-12T09:15:46.414 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.allow_fallocate: 1 2024-04-12T09:15:46.414 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.allow_mmap_reads: 0 2024-04-12T09:15:46.414 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.allow_mmap_writes: 0 2024-04-12T09:15:46.414 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.use_direct_reads: 0 2024-04-12T09:15:46.414 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-12T09:15:46.414 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.create_missing_column_families: 0 2024-04-12T09:15:46.414 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.db_log_dir: 2024-04-12T09:15:46.414 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.wal_dir: 2024-04-12T09:15:46.414 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-12T09:15:46.414 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-12T09:15:46.414 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-12T09:15:46.414 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-12T09:15:46.414 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-12T09:15:46.415 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-12T09:15:46.415 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.advise_random_on_open: 1 2024-04-12T09:15:46.415 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.db_write_buffer_size: 0 2024-04-12T09:15:46.415 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.write_buffer_manager: 0x55f398a041e0 2024-04-12T09:15:46.415 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-12T09:15:46.415 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-12T09:15:46.415 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-12T09:15:46.415 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.rate_limiter: (nil) 2024-04-12T09:15:46.415 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-12T09:15:46.415 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.wal_recovery_mode: 2 2024-04-12T09:15:46.415 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.enable_thread_tracking: 0 2024-04-12T09:15:46.415 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.enable_pipelined_write: 0 2024-04-12T09:15:46.415 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.unordered_write: 0 2024-04-12T09:15:46.415 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-12T09:15:46.415 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-12T09:15:46.416 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-12T09:15:46.416 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-12T09:15:46.416 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.row_cache: None 2024-04-12T09:15:46.416 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.wal_filter: None 2024-04-12T09:15:46.417 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-12T09:15:46.417 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.allow_ingest_behind: 0 2024-04-12T09:15:46.417 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.two_write_queues: 0 2024-04-12T09:15:46.417 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.manual_wal_flush: 0 2024-04-12T09:15:46.417 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.wal_compression: 0 2024-04-12T09:15:46.418 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.atomic_flush: 0 2024-04-12T09:15:46.418 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-12T09:15:46.418 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-12T09:15:46.418 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-12T09:15:46.418 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.log_readahead_size: 0 2024-04-12T09:15:46.418 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-12T09:15:46.418 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.best_efforts_recovery: 0 2024-04-12T09:15:46.418 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-12T09:15:46.418 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-12T09:15:46.418 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.allow_data_in_errors: 0 2024-04-12T09:15:46.418 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.db_host_id: __hostname__ 2024-04-12T09:15:46.418 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-12T09:15:46.418 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_background_jobs: 2 2024-04-12T09:15:46.418 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_background_compactions: -1 2024-04-12T09:15:46.419 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_subcompactions: 1 2024-04-12T09:15:46.419 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-12T09:15:46.419 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-12T09:15:46.419 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-12T09:15:46.419 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_total_wal_size: 0 2024-04-12T09:15:46.419 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-12T09:15:46.419 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-12T09:15:46.419 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-12T09:15:46.419 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-12T09:15:46.419 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_open_files: -1 2024-04-12T09:15:46.419 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.bytes_per_sync: 0 2024-04-12T09:15:46.419 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-12T09:15:46.419 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-12T09:15:46.420 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.compaction_readahead_size: 0 2024-04-12T09:15:46.420 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_background_flushes: -1 2024-04-12T09:15:46.420 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Compression algorithms supported: 2024-04-12T09:15:46.420 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-12T09:15:46.420 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: kZSTD supported: 0 2024-04-12T09:15:46.420 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: kXpressCompression supported: 0 2024-04-12T09:15:46.420 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: kLZ4HCCompression supported: 1 2024-04-12T09:15:46.420 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: kZlibCompression supported: 1 2024-04-12T09:15:46.420 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: kSnappyCompression supported: 1 2024-04-12T09:15:46.420 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: kLZ4Compression supported: 1 2024-04-12T09:15:46.420 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: kBZip2Compression supported: 0 2024-04-12T09:15:46.420 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-12T09:15:46.420 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-12T09:15:46.420 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi117/store.db/MANIFEST-000015 2024-04-12T09:15:46.421 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-12T09:15:46.421 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-12T09:15:46.421 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.merge_operator: 2024-04-12T09:15:46.421 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.compaction_filter: None 2024-04-12T09:15:46.421 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.compaction_filter_factory: None 2024-04-12T09:15:46.421 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.sst_partitioner_factory: None 2024-04-12T09:15:46.421 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-12T09:15:46.421 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-12T09:15:46.421 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f398a31aa0) 2024-04-12T09:15:46.421 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: cache_index_and_filter_blocks: 1 2024-04-12T09:15:46.421 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-12T09:15:46.421 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-12T09:15:46.421 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: pin_top_level_index_and_filter: 1 2024-04-12T09:15:46.421 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: index_type: 0 2024-04-12T09:15:46.421 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: data_block_index_type: 0 2024-04-12T09:15:46.422 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: index_shortening: 1 2024-04-12T09:15:46.422 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-12T09:15:46.422 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: checksum: 4 2024-04-12T09:15:46.422 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: no_block_cache: 0 2024-04-12T09:15:46.422 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: block_cache: 0x55f398a35090 2024-04-12T09:15:46.422 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: block_cache_name: BinnedLRUCache 2024-04-12T09:15:46.422 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: block_cache_options: 2024-04-12T09:15:46.422 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: capacity : 536870912 2024-04-12T09:15:46.422 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: num_shard_bits : 4 2024-04-12T09:15:46.422 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: strict_capacity_limit : 0 2024-04-12T09:15:46.422 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: high_pri_pool_ratio: 0.000 2024-04-12T09:15:46.422 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: block_cache_compressed: (nil) 2024-04-12T09:15:46.422 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: persistent_cache: (nil) 2024-04-12T09:15:46.422 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: block_size: 4096 2024-04-12T09:15:46.423 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: block_size_deviation: 10 2024-04-12T09:15:46.423 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: block_restart_interval: 16 2024-04-12T09:15:46.423 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: index_block_restart_interval: 1 2024-04-12T09:15:46.423 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: metadata_block_size: 4096 2024-04-12T09:15:46.423 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: partition_filters: 0 2024-04-12T09:15:46.423 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: use_delta_encoding: 1 2024-04-12T09:15:46.423 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: filter_policy: bloomfilter 2024-04-12T09:15:46.423 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: whole_key_filtering: 1 2024-04-12T09:15:46.423 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: verify_compression: 0 2024-04-12T09:15:46.423 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: read_amp_bytes_per_bit: 0 2024-04-12T09:15:46.423 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: format_version: 5 2024-04-12T09:15:46.423 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: enable_index_compression: 1 2024-04-12T09:15:46.423 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: block_align: 0 2024-04-12T09:15:46.423 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: max_auto_readahead_size: 262144 2024-04-12T09:15:46.423 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: prepopulate_block_cache: 0 2024-04-12T09:15:46.424 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: initial_auto_readahead_size: 8192 2024-04-12T09:15:46.424 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: num_file_reads_for_auto_readahead: 2 2024-04-12T09:15:46.424 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.write_buffer_size: 33554432 2024-04-12T09:15:46.424 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_write_buffer_number: 2 2024-04-12T09:15:46.424 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.compression: NoCompression 2024-04-12T09:15:46.424 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.bottommost_compression: Disabled 2024-04-12T09:15:46.424 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.prefix_extractor: nullptr 2024-04-12T09:15:46.424 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-12T09:15:46.424 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.num_levels: 7 2024-04-12T09:15:46.424 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-12T09:15:46.424 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-12T09:15:46.424 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-12T09:15:46.424 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-12T09:15:46.424 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-12T09:15:46.424 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-12T09:15:46.425 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-12T09:15:46.425 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-12T09:15:46.425 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-12T09:15:46.425 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-12T09:15:46.425 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-12T09:15:46.425 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-12T09:15:46.425 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-12T09:15:46.425 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.compression_opts.level: 32767 2024-04-12T09:15:46.425 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.compression_opts.strategy: 0 2024-04-12T09:15:46.425 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-12T09:15:46.425 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-12T09:15:46.425 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-12T09:15:46.425 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-12T09:15:46.425 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.compression_opts.enabled: false 2024-04-12T09:15:46.425 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-12T09:15:46.426 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-12T09:15:46.426 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-12T09:15:46.426 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-12T09:15:46.426 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.target_file_size_base: 67108864 2024-04-12T09:15:46.426 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-12T09:15:46.426 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-12T09:15:46.426 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-12T09:15:46.426 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-12T09:15:46.426 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-12T09:15:46.426 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-12T09:15:46.426 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-12T09:15:46.426 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-12T09:15:46.426 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-12T09:15:46.427 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-12T09:15:46.427 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-12T09:15:46.427 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-12T09:15:46.427 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-12T09:15:46.427 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-12T09:15:46.427 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.arena_block_size: 1048576 2024-04-12T09:15:46.427 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-12T09:15:46.427 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-12T09:15:46.427 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.disable_auto_compactions: 0 2024-04-12T09:15:46.427 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-12T09:15:46.427 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-12T09:15:46.427 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-12T09:15:46.427 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-12T09:15:46.427 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-12T09:15:46.428 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-12T09:15:46.428 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-12T09:15:46.428 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-12T09:15:46.428 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-12T09:15:46.428 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-12T09:15:46.428 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.table_properties_collectors: 2024-04-12T09:15:46.428 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.inplace_update_support: 0 2024-04-12T09:15:46.428 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-12T09:15:46.428 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-12T09:15:46.428 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-12T09:15:46.428 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-12T09:15:46.428 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.bloom_locality: 0 2024-04-12T09:15:46.428 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.max_successive_merges: 0 2024-04-12T09:15:46.428 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-12T09:15:46.428 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.paranoid_file_checks: 0 2024-04-12T09:15:46.429 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.force_consistency_checks: 1 2024-04-12T09:15:46.429 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.report_bg_io_stats: 0 2024-04-12T09:15:46.429 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.ttl: 2592000 2024-04-12T09:15:46.429 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-12T09:15:46.429 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-12T09:15:46.429 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-12T09:15:46.429 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.enable_blob_files: false 2024-04-12T09:15:46.429 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.min_blob_size: 0 2024-04-12T09:15:46.429 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.blob_file_size: 268435456 2024-04-12T09:15:46.429 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-12T09:15:46.429 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-12T09:15:46.429 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-12T09:15:46.429 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-12T09:15:46.430 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-12T09:15:46.430 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.blob_file_starting_level: 0 2024-04-12T09:15:46.430 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-12T09:15:46.430 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2024-04-12T09:15:46.430 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-12T09:15:46.430 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi117/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 11995, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-12T09:15:46.430 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2024-04-12T09:15:46.430 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4ca7ff06-9e66-4245-af89-b174f237aad3 2024-04-12T09:15:46.430 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712913346289363, "job": 1, "event": "recovery_started", "wal_files": [31]} 2024-04-12T09:15:46.430 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2024-04-12T09:15:46.430 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712913346295862, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 1851421, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 11989, "largest_seqno": 13610, "table_properties": {"data_size": 1843935, "index_size": 4614, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1861, "raw_key_size": 17084, "raw_average_key_size": 23, "raw_value_size": 1828555, "raw_average_value_size": 2522, "num_data_blocks": 210, "num_entries": 725, "num_filter_entries": 725, "num_deletions": 7, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1712913346, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4ca7ff06-9e66-4245-af89-b174f237aad3", "db_session_id": "CU848JPVIYXBBVKWMOUS", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2024-04-12T09:15:46.430 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712913346295946, "job": 1, "event": "recovery_finished"} 2024-04-12T09:15:46.430 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2024-04-12T09:15:46.430 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-12T09:15:46.431 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi117/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-12T09:15:46.431 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f398b26000 2024-04-12T09:15:46.431 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: DB pointer 0x55f398b10000 2024-04-12T09:15:46.431 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-12T09:15:46.431 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-12T09:15:46.431 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: ** DB Stats ** 2024-04-12T09:15:46.431 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-12T09:15:46.431 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-12T09:15:46.431 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-12T09:15:46.431 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-12T09:15:46.431 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-12T09:15:46.431 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-12T09:15:46.431 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-12T09:15:46.432 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-04-12T09:15:46.432 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: ** Compaction Stats [default] ** 2024-04-12T09:15:46.432 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-12T09:15:46.432 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-12T09:15:46.432 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: L0 1/0 1.77 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 568.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-04-12T09:15:46.432 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: L6 1/0 6.75 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-12T09:15:46.432 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Sum 2/0 8.52 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 568.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-04-12T09:15:46.432 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 568.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-04-12T09:15:46.432 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-04-12T09:15:46.432 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: ** Compaction Stats [default] ** 2024-04-12T09:15:46.432 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-12T09:15:46.432 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-12T09:15:46.432 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 568.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-04-12T09:15:46.432 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-04-12T09:15:46.433 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-12T09:15:46.433 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-04-12T09:15:46.433 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-12T09:15:46.433 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-04-12T09:15:46.433 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-12T09:15:46.433 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-12T09:15:46.433 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-12T09:15:46.433 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-12T09:15:46.433 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Cumulative compaction: 0.00 GB write, 160.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-12T09:15:46.433 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Interval compaction: 0.00 GB write, 160.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-12T09:15:46.433 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-12T09:15:46.433 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Block cache BinnedLRUCache@0x55f398a35090#2 capacity: 512.00 MB usage: 7.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-04-12T09:15:46.433 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.03 KB,0.00038743%) IndexBlock(1,5.08 KB,0.000968575%) Misc(1,0.00 KB,0%) 2024-04-12T09:15:46.434 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-04-12T09:15:46.434 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-12T09:15:46.434 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: starting mon.smithi117 rank 0 at public addrs [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] at bind addrs [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi117 fsid 12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:15:46.434 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: mon.smithi117@-1(???) e2 preinit fsid 12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:15:46.434 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: mon.smithi117@-1(???).mds e14 new map 2024-04-12T09:15:46.434 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: mon.smithi117@-1(???).mds e14 print_map 2024-04-12T09:15:46.434 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: e14 2024-04-12T09:15:46.434 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T09:15:46.434 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:15:46.434 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: legacy client fscid: 1 2024-04-12T09:15:46.434 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-04-12T09:15:46.434 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Filesystem 'cephfs' (1) 2024-04-12T09:15:46.435 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: fs_name cephfs 2024-04-12T09:15:46.435 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: epoch 14 2024-04-12T09:15:46.435 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T09:15:46.435 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: created 2024-04-12T09:08:12.488144+0000 2024-04-12T09:15:46.435 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: modified 2024-04-12T09:08:30.563184+0000 2024-04-12T09:15:46.435 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: tableserver 0 2024-04-12T09:15:46.435 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: root 0 2024-04-12T09:15:46.435 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: session_timeout 60 2024-04-12T09:15:46.435 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: session_autoclose 300 2024-04-12T09:15:46.435 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: max_file_size 1099511627776 2024-04-12T09:15:46.435 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: max_xattr_size 65536 2024-04-12T09:15:46.435 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: required_client_features {} 2024-04-12T09:15:46.435 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: last_failure 0 2024-04-12T09:15:46.435 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: last_failure_osd_epoch 46 2024-04-12T09:15:46.435 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:15:46.435 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: max_mds 1 2024-04-12T09:15:46.436 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: in 0 2024-04-12T09:15:46.436 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: up {0=14474} 2024-04-12T09:15:46.436 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: failed 2024-04-12T09:15:46.436 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: damaged 2024-04-12T09:15:46.436 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: stopped 2024-04-12T09:15:46.436 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: data_pools [3] 2024-04-12T09:15:46.436 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: metadata_pool 2 2024-04-12T09:15:46.436 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: inline_data disabled 2024-04-12T09:15:46.436 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: balancer 2024-04-12T09:15:46.436 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: bal_rank_mask -1 2024-04-12T09:15:46.436 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: standby_count_wanted 1 2024-04-12T09:15:46.436 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: qdb_cluster leader: 0 members: 2024-04-12T09:15:46.436 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: [mds.cephfs.smithi117.eslmxh{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.117:6828/2248590199,v1:172.21.15.117:6829/2248590199] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:15:46.436 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-04-12T09:15:46.437 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-04-12T09:15:46.437 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Standby daemons: 2024-04-12T09:15:46.437 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-04-12T09:15:46.437 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: [mds.cephfs.smithi117.wddsgt{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/4010127141,v1:172.21.15.117:6827/4010127141] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:15:46.437 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: [mds.cephfs.smithi203.fbeixl{-1:24265} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.203:6824/840607003,v1:172.21.15.203:6825/840607003] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:15:46.437 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: [mds.cephfs.smithi203.bszhxz{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/2731911290,v1:172.21.15.203:6827/2731911290] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:15:46.437 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: mon.smithi117@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-12T09:15:46.437 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: mon.smithi117@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-12T09:15:46.437 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: mon.smithi117@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-12T09:15:46.437 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: mon.smithi117@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-12T09:15:46.437 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 ceph-mon[113571]: mon.smithi117@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-04-12T09:15:46.437 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 bash[113552]: 6823aaff30ce3c92ac69dc3427dc1e67e6827d3e2387b5d421fb18fb990e14e1 2024-04-12T09:15:46.437 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:46 smithi117 systemd[1]: Started Ceph mon.smithi117 for 12161984-f8ab-11ee-bc8c-c7b262605968. 2024-04-12T09:15:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:47 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-04-12T09:15:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:47 smithi203 ceph-mon[36428]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:15:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:47 smithi203 ceph-mon[36428]: pgmap v95: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:47 smithi203 ceph-mon[36428]: mon.smithi117 calling monitor election 2024-04-12T09:15:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:47 smithi203 ceph-mon[36428]: mon.smithi117 is new leader, mons smithi117,smithi203 in quorum (ranks 0,1) 2024-04-12T09:15:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:47 smithi203 ceph-mon[36428]: monmap epoch 2 2024-04-12T09:15:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:47 smithi203 ceph-mon[36428]: fsid 12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:15:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:47 smithi203 ceph-mon[36428]: last_changed 2024-04-12T09:03:54.876613+0000 2024-04-12T09:15:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:47 smithi203 ceph-mon[36428]: created 2024-04-12T09:01:20.152816+0000 2024-04-12T09:15:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:47 smithi203 ceph-mon[36428]: min_mon_release 17 (quincy) 2024-04-12T09:15:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:47 smithi203 ceph-mon[36428]: election_strategy: 1 2024-04-12T09:15:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:47 smithi203 ceph-mon[36428]: 0: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.smithi117 2024-04-12T09:15:48.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:47 smithi203 ceph-mon[36428]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.smithi203 2024-04-12T09:15:48.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:47 smithi203 ceph-mon[36428]: fsmap cephfs:1 {0=cephfs.smithi117.eslmxh=up:active} 3 up:standby 2024-04-12T09:15:48.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:47 smithi203 ceph-mon[36428]: osdmap e48: 6 total, 6 up, 6 in 2024-04-12T09:15:48.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:47 smithi203 ceph-mon[36428]: mgrmap e33: smithi117.oyaxql(active, since 2m), standbys: smithi203.apfqpo 2024-04-12T09:15:48.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:47 smithi203 ceph-mon[36428]: overall HEALTH_OK 2024-04-12T09:15:48.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:47 smithi203 ceph-mon[36428]: from='mgr.14694 ' entity='' 2024-04-12T09:15:48.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:47 smithi203 ceph-mon[36428]: mgrmap e34: smithi117.oyaxql(active, since 2m), standbys: smithi203.apfqpo 2024-04-12T09:15:48.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:47 smithi117 ceph-mon[113571]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-04-12T09:15:48.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:47 smithi117 ceph-mon[113571]: from='mgr.14694 172.21.15.117:0/3971770773' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:15:48.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:47 smithi117 ceph-mon[113571]: pgmap v95: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:48.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:47 smithi117 ceph-mon[113571]: mon.smithi117 calling monitor election 2024-04-12T09:15:48.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:47 smithi117 ceph-mon[113571]: mon.smithi117 is new leader, mons smithi117,smithi203 in quorum (ranks 0,1) 2024-04-12T09:15:48.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:47 smithi117 ceph-mon[113571]: monmap epoch 2 2024-04-12T09:15:48.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:47 smithi117 ceph-mon[113571]: fsid 12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:15:48.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:47 smithi117 ceph-mon[113571]: last_changed 2024-04-12T09:03:54.876613+0000 2024-04-12T09:15:48.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:47 smithi117 ceph-mon[113571]: created 2024-04-12T09:01:20.152816+0000 2024-04-12T09:15:48.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:47 smithi117 ceph-mon[113571]: min_mon_release 17 (quincy) 2024-04-12T09:15:48.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:47 smithi117 ceph-mon[113571]: election_strategy: 1 2024-04-12T09:15:48.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:47 smithi117 ceph-mon[113571]: 0: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.smithi117 2024-04-12T09:15:48.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:47 smithi117 ceph-mon[113571]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.smithi203 2024-04-12T09:15:48.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:47 smithi117 ceph-mon[113571]: fsmap cephfs:1 {0=cephfs.smithi117.eslmxh=up:active} 3 up:standby 2024-04-12T09:15:48.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:47 smithi117 ceph-mon[113571]: osdmap e48: 6 total, 6 up, 6 in 2024-04-12T09:15:48.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:47 smithi117 ceph-mon[113571]: mgrmap e33: smithi117.oyaxql(active, since 2m), standbys: smithi203.apfqpo 2024-04-12T09:15:48.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:47 smithi117 ceph-mon[113571]: overall HEALTH_OK 2024-04-12T09:15:48.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:47 smithi117 ceph-mon[113571]: from='mgr.14694 ' entity='' 2024-04-12T09:15:48.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:47 smithi117 ceph-mon[113571]: mgrmap e34: smithi117.oyaxql(active, since 2m), standbys: smithi203.apfqpo 2024-04-12T09:15:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:54 smithi117 ceph-mon[113571]: Active manager daemon smithi117.oyaxql restarted 2024-04-12T09:15:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:54 smithi117 ceph-mon[113571]: Activating manager daemon smithi117.oyaxql 2024-04-12T09:15:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:54 smithi117 ceph-mon[113571]: osdmap e49: 6 total, 6 up, 6 in 2024-04-12T09:15:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:54 smithi117 ceph-mon[113571]: mgrmap e35: smithi117.oyaxql(active, starting, since 0.00797954s), standbys: smithi203.apfqpo 2024-04-12T09:15:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-04-12T09:15:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:15:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.eslmxh"}]: dispatch 2024-04-12T09:15:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.wddsgt"}]: dispatch 2024-04-12T09:15:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.fbeixl"}]: dispatch 2024-04-12T09:15:54.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.bszhxz"}]: dispatch 2024-04-12T09:15:54.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr metadata", "who": "smithi117.oyaxql", "id": "smithi117.oyaxql"}]: dispatch 2024-04-12T09:15:54.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr metadata", "who": "smithi203.apfqpo", "id": "smithi203.apfqpo"}]: dispatch 2024-04-12T09:15:54.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T09:15:54.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T09:15:54.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T09:15:54.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T09:15:54.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T09:15:54.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T09:15:54.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-12T09:15:54.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-12T09:15:54.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-12T09:15:54.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:54 smithi117 ceph-mon[113571]: Manager daemon smithi117.oyaxql is now available 2024-04-12T09:15:54.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:15:55.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:54 smithi203 ceph-mon[36428]: Active manager daemon smithi117.oyaxql restarted 2024-04-12T09:15:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:54 smithi203 ceph-mon[36428]: Activating manager daemon smithi117.oyaxql 2024-04-12T09:15:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:54 smithi203 ceph-mon[36428]: osdmap e49: 6 total, 6 up, 6 in 2024-04-12T09:15:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:54 smithi203 ceph-mon[36428]: mgrmap e35: smithi117.oyaxql(active, starting, since 0.00797954s), standbys: smithi203.apfqpo 2024-04-12T09:15:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:54 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-04-12T09:15:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:54 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:15:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:54 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.eslmxh"}]: dispatch 2024-04-12T09:15:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:54 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.wddsgt"}]: dispatch 2024-04-12T09:15:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:54 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.fbeixl"}]: dispatch 2024-04-12T09:15:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:54 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.bszhxz"}]: dispatch 2024-04-12T09:15:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:54 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr metadata", "who": "smithi117.oyaxql", "id": "smithi117.oyaxql"}]: dispatch 2024-04-12T09:15:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:54 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr metadata", "who": "smithi203.apfqpo", "id": "smithi203.apfqpo"}]: dispatch 2024-04-12T09:15:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:54 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T09:15:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:54 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T09:15:55.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:54 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T09:15:55.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:54 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T09:15:55.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:54 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T09:15:55.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:54 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T09:15:55.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:54 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-12T09:15:55.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:54 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-12T09:15:55.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:54 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-12T09:15:55.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:54 smithi203 ceph-mon[36428]: Manager daemon smithi117.oyaxql is now available 2024-04-12T09:15:55.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:54 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:15:55.808 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:55 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:15:55.809 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:55 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.oyaxql/mirror_snapshot_schedule"}]: dispatch 2024-04-12T09:15:55.809 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:55 smithi117 ceph-mon[113571]: Standby manager daemon smithi203.apfqpo restarted 2024-04-12T09:15:55.809 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:55 smithi117 ceph-mon[113571]: Standby manager daemon smithi203.apfqpo started 2024-04-12T09:15:55.809 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:55 smithi117 ceph-mon[113571]: from='mgr.? 172.21.15.203:0/4070236846' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.apfqpo/crt"}]: dispatch 2024-04-12T09:15:55.809 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:55 smithi117 ceph-mon[113571]: from='mgr.? 172.21.15.203:0/4070236846' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T09:15:55.809 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:55 smithi117 ceph-mon[113571]: from='mgr.? 172.21.15.203:0/4070236846' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.apfqpo/key"}]: dispatch 2024-04-12T09:15:55.809 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:55 smithi117 ceph-mon[113571]: from='mgr.? 172.21.15.203:0/4070236846' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T09:15:55.809 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:55 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.oyaxql/trash_purge_schedule"}]: dispatch 2024-04-12T09:15:55.809 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:55 smithi117 ceph-mon[113571]: mgrmap e36: smithi117.oyaxql(active, since 1.00889s), standbys: smithi203.apfqpo 2024-04-12T09:15:56.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:55 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:15:56.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:55 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.oyaxql/mirror_snapshot_schedule"}]: dispatch 2024-04-12T09:15:56.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:55 smithi203 ceph-mon[36428]: Standby manager daemon smithi203.apfqpo restarted 2024-04-12T09:15:56.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:55 smithi203 ceph-mon[36428]: Standby manager daemon smithi203.apfqpo started 2024-04-12T09:15:56.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:55 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.203:0/4070236846' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.apfqpo/crt"}]: dispatch 2024-04-12T09:15:56.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:55 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.203:0/4070236846' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-12T09:15:56.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:55 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.203:0/4070236846' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi203.apfqpo/key"}]: dispatch 2024-04-12T09:15:56.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:55 smithi203 ceph-mon[36428]: from='mgr.? 172.21.15.203:0/4070236846' entity='mgr.smithi203.apfqpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-12T09:15:56.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:55 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.oyaxql/trash_purge_schedule"}]: dispatch 2024-04-12T09:15:56.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:55 smithi203 ceph-mon[36428]: mgrmap e36: smithi117.oyaxql(active, since 1.00889s), standbys: smithi203.apfqpo 2024-04-12T09:15:56.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:56 smithi117 ceph-mon[113571]: pgmap v3: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:56.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:56 smithi203 ceph-mon[36428]: pgmap v3: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:57.871 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:57 smithi117 ceph-mon[113571]: [12/Apr/2024:09:15:56] ENGINE Bus STARTING 2024-04-12T09:15:57.871 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:57 smithi117 ceph-mon[113571]: [12/Apr/2024:09:15:56] ENGINE Serving on https://172.21.15.117:7150 2024-04-12T09:15:57.871 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:57 smithi117 ceph-mon[113571]: [12/Apr/2024:09:15:56] ENGINE Serving on http://172.21.15.117:8765 2024-04-12T09:15:57.871 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:57 smithi117 ceph-mon[113571]: [12/Apr/2024:09:15:56] ENGINE Bus STARTED 2024-04-12T09:15:57.871 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:57 smithi117 ceph-mon[113571]: pgmap v4: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:57.871 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:57 smithi117 ceph-mon[113571]: mgrmap e37: smithi117.oyaxql(active, since 2s), standbys: smithi203.apfqpo 2024-04-12T09:15:58.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:57 smithi203 ceph-mon[36428]: [12/Apr/2024:09:15:56] ENGINE Bus STARTING 2024-04-12T09:15:58.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:57 smithi203 ceph-mon[36428]: [12/Apr/2024:09:15:56] ENGINE Serving on https://172.21.15.117:7150 2024-04-12T09:15:58.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:57 smithi203 ceph-mon[36428]: [12/Apr/2024:09:15:56] ENGINE Serving on http://172.21.15.117:8765 2024-04-12T09:15:58.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:57 smithi203 ceph-mon[36428]: [12/Apr/2024:09:15:56] ENGINE Bus STARTED 2024-04-12T09:15:58.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:57 smithi203 ceph-mon[36428]: pgmap v4: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:15:58.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:57 smithi203 ceph-mon[36428]: mgrmap e37: smithi117.oyaxql(active, since 2s), standbys: smithi203.apfqpo 2024-04-12T09:15:59.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:58 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:15:59.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:58 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:15:59.111 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:58 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:15:59.112 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:58 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:00.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:59 smithi203 ceph-mon[36428]: pgmap v5: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:00.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:59 smithi203 ceph-mon[36428]: mgrmap e38: smithi117.oyaxql(active, since 4s), standbys: smithi203.apfqpo 2024-04-12T09:16:00.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:59 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:00.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:15:59 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:00.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:59 smithi117 ceph-mon[113571]: pgmap v5: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:00.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:59 smithi117 ceph-mon[113571]: mgrmap e38: smithi117.oyaxql(active, since 4s), standbys: smithi203.apfqpo 2024-04-12T09:16:00.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:59 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:00.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:15:59 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:00.991 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:00 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:00.991 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:00 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:00.991 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:00 smithi203 ceph-mon[36428]: pgmap v6: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 0 B/s wr, 23 op/s 2024-04-12T09:16:01.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:00 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:01.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:00 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:01.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:00 smithi117 ceph-mon[113571]: pgmap v6: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 0 B/s wr, 23 op/s 2024-04-12T09:16:02.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:01 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:02.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:01 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:02.196 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:01 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:02.196 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:01 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:03.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:03 smithi203 ceph-mon[36428]: Detected new or changed devices on smithi203 2024-04-12T09:16:03.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:03 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:03.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:03 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:03.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:03 smithi203 ceph-mon[36428]: pgmap v7: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-12T09:16:03.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:03 smithi117 ceph-mon[113571]: Detected new or changed devices on smithi203 2024-04-12T09:16:03.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:03 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:03.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:03 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:03.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:03 smithi117 ceph-mon[113571]: pgmap v7: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-12T09:16:05.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:05 smithi203 ceph-mon[36428]: Detected new or changed devices on smithi117 2024-04-12T09:16:05.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:05 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:05.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:05 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:05.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:05 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:05.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:05 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:16:05.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:05 smithi203 ceph-mon[36428]: Updating smithi117:/etc/ceph/ceph.conf 2024-04-12T09:16:05.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:05 smithi203 ceph-mon[36428]: Updating smithi203:/etc/ceph/ceph.conf 2024-04-12T09:16:05.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:05 smithi203 ceph-mon[36428]: pgmap v8: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-12T09:16:05.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:05 smithi203 ceph-mon[36428]: Updating smithi117:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T09:16:05.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:05 smithi203 ceph-mon[36428]: Updating smithi203:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T09:16:05.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:05 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:05.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:05 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:05.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:05 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:05.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:05 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:05.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:05 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:05.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:05 smithi117 ceph-mon[113571]: Detected new or changed devices on smithi117 2024-04-12T09:16:05.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:05 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:05.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:05 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:05.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:05 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:05.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:05 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:16:05.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:05 smithi117 ceph-mon[113571]: Updating smithi117:/etc/ceph/ceph.conf 2024-04-12T09:16:05.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:05 smithi117 ceph-mon[113571]: Updating smithi203:/etc/ceph/ceph.conf 2024-04-12T09:16:05.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:05 smithi117 ceph-mon[113571]: pgmap v8: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-12T09:16:05.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:05 smithi117 ceph-mon[113571]: Updating smithi117:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T09:16:05.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:05 smithi117 ceph-mon[113571]: Updating smithi203:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.conf 2024-04-12T09:16:05.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:05 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:05.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:05 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:05.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:05 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:05.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:05 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:05.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:05 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:06.560 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:06 smithi203 ceph-mon[36428]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2024-04-12T09:16:06.560 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:06 smithi203 ceph-mon[36428]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-04-12T09:16:06.560 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:06 smithi203 ceph-mon[36428]: Updating smithi117:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T09:16:06.560 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:06 smithi203 ceph-mon[36428]: Updating smithi203:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T09:16:06.560 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:06 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:16:06.560 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:06 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:16:06.560 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:06 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-12T09:16:06.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:06 smithi117 ceph-mon[113571]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2024-04-12T09:16:06.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:06 smithi117 ceph-mon[113571]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-04-12T09:16:06.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:06 smithi117 ceph-mon[113571]: Updating smithi117:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T09:16:06.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:06 smithi117 ceph-mon[113571]: Updating smithi203:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/config/ceph.client.admin.keyring 2024-04-12T09:16:06.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:06 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:16:06.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:06 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:16:06.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:06 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-12T09:16:07.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:07 smithi203 ceph-mon[36428]: pgmap v9: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-12T09:16:07.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:07 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:07.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:07 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T09:16:07.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:07 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-12T09:16:07.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:07 smithi203 ceph-mon[36428]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:07.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:07 smithi117 ceph-mon[113571]: pgmap v9: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-12T09:16:07.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:07 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:07.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:07 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T09:16:07.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:07 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-12T09:16:07.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:07 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:08.748 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:08 smithi203 ceph-mon[36428]: Upgrade: Updating mon.smithi203 2024-04-12T09:16:08.749 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:08 smithi203 ceph-mon[36428]: Deploying daemon mon.smithi203 on smithi203 2024-04-12T09:16:08.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:08 smithi117 ceph-mon[113571]: Upgrade: Updating mon.smithi203 2024-04-12T09:16:08.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:08 smithi117 ceph-mon[113571]: Deploying daemon mon.smithi203 on smithi203 2024-04-12T09:16:09.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:09 smithi203 systemd[1]: Stopping Ceph mon.smithi203 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:16:09.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:09 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi203[36398]: 2024-04-12T09:16:09.268+0000 7f9b8f365700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi203 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T09:16:09.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:09 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi203[36398]: 2024-04-12T09:16:09.268+0000 7f9b8f365700 -1 mon.smithi203@1(peon) e2 *** Got Signal Terminated *** 2024-04-12T09:16:09.628 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:09 smithi203 podman[86620]: 2024-04-12 09:16:09.341034837 +0000 UTC m=+0.165895865 container stop 17c0db49bb1672879f170ee9dd6cfe8c66d91093a6407979bdee6cf981f83349 (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi203, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240409, RELEASE=quincy-d3b5060, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-12T09:16:09.628 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:09 smithi203 podman[86620]: 2024-04-12 09:16:09.366805087 +0000 UTC m=+0.191666115 container died 17c0db49bb1672879f170ee9dd6cfe8c66d91093a6407979bdee6cf981f83349 (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi203, org.label-schema.build-date=20240409, GIT_CLEAN=True, RELEASE=quincy-d3b5060, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T09:16:09.953 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:09 smithi203 podman[86620]: 2024-04-12 09:16:09.743990773 +0000 UTC m=+0.568851805 container cleanup 17c0db49bb1672879f170ee9dd6cfe8c66d91093a6407979bdee6cf981f83349 (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi203, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, ceph=True, RELEASE=quincy-d3b5060, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=) 2024-04-12T09:16:09.953 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:09 smithi203 bash[86620]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi203 2024-04-12T09:16:10.242 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:09 smithi203 podman[86635]: 2024-04-12 09:16:09.953638237 +0000 UTC m=+0.602090755 container remove 17c0db49bb1672879f170ee9dd6cfe8c66d91093a6407979bdee6cf981f83349 (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi203, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=quincy-d3b5060, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T09:16:10.242 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 systemd[1]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968@mon.smithi203.service: Deactivated successfully. 2024-04-12T09:16:10.243 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 systemd[1]: Stopped Ceph mon.smithi203 for 12161984-f8ab-11ee-bc8c-c7b262605968. 2024-04-12T09:16:10.243 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 systemd[1]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968@mon.smithi203.service: Consumed 7.044s CPU time. 2024-04-12T09:16:10.547 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 systemd[1]: Starting Ceph mon.smithi203 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:16:10.547 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 podman[86763]: 2024-04-12 09:16:10.358579408 +0000 UTC m=+0.018432458 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:16:10.547 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 podman[86763]: 2024-04-12 09:16:10.463424988 +0000 UTC m=+0.123278017 container create 006c6e487bfbb2a5ff3fae7090d902845a49ca90851ca479f7c9ddbdc8059dfa (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi203, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=squid-b277feb, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240409) 2024-04-12T09:16:10.675 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 podman[86763]: 2024-04-12 09:16:10.641181015 +0000 UTC m=+0.301034044 container init 006c6e487bfbb2a5ff3fae7090d902845a49ca90851ca479f7c9ddbdc8059dfa (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi203, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-b277feb, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-04-12T09:16:10.675 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 podman[86763]: 2024-04-12 09:16:10.644314997 +0000 UTC m=+0.304168026 container start 006c6e487bfbb2a5ff3fae7090d902845a49ca90851ca479f7c9ddbdc8059dfa (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi203, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=squid-b277feb, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T09:16:10.675 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: set uid:gid to 167:167 (ceph:ceph) 2024-04-12T09:16:10.675 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev), process ceph-mon, pid 2 2024-04-12T09:16:10.675 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: pidfile_write: ignore empty --pid-file 2024-04-12T09:16:10.675 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: load: jerasure load: lrc 2024-04-12T09:16:10.675 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: RocksDB version: 7.9.2 2024-04-12T09:16:10.676 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Git sha 0 2024-04-12T09:16:10.676 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Compile date 2024-04-09 21:18:54 2024-04-12T09:16:10.676 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: DB SUMMARY 2024-04-12T09:16:10.676 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: DB Session ID: J4MXIIU9AJ3SO2Q2LSEH 2024-04-12T09:16:10.676 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: CURRENT file: CURRENT 2024-04-12T09:16:10.676 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: IDENTITY file: IDENTITY 2024-04-12T09:16:10.676 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1083 Bytes 2024-04-12T09:16:10.676 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi203/store.db dir, Total Num: 1, files: 000027.sst 2024-04-12T09:16:10.676 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi203/store.db: 000025.log size: 5775932 ; 2024-04-12T09:16:10.676 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.error_if_exists: 0 2024-04-12T09:16:10.676 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.create_if_missing: 0 2024-04-12T09:16:10.676 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.paranoid_checks: 1 2024-04-12T09:16:10.676 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-12T09:16:10.676 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-12T09:16:10.677 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-12T09:16:10.677 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.env: 0x5616a457cc60 2024-04-12T09:16:10.677 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.fs: PosixFileSystem 2024-04-12T09:16:10.677 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.info_log: 0x5616a6a4d9a0 2024-04-12T09:16:10.677 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_file_opening_threads: 16 2024-04-12T09:16:10.677 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.statistics: (nil) 2024-04-12T09:16:10.677 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.use_fsync: 0 2024-04-12T09:16:10.677 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_log_file_size: 0 2024-04-12T09:16:10.677 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-12T09:16:10.677 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-12T09:16:10.677 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.keep_log_file_num: 1000 2024-04-12T09:16:10.677 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.recycle_log_file_num: 0 2024-04-12T09:16:10.677 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.allow_fallocate: 1 2024-04-12T09:16:10.677 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.allow_mmap_reads: 0 2024-04-12T09:16:10.678 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.allow_mmap_writes: 0 2024-04-12T09:16:10.678 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.use_direct_reads: 0 2024-04-12T09:16:10.678 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-12T09:16:10.678 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.create_missing_column_families: 0 2024-04-12T09:16:10.678 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.db_log_dir: 2024-04-12T09:16:10.678 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.wal_dir: 2024-04-12T09:16:10.678 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-12T09:16:10.678 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-12T09:16:10.678 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-12T09:16:10.678 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-12T09:16:10.678 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-12T09:16:10.678 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-12T09:16:10.678 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.advise_random_on_open: 1 2024-04-12T09:16:10.679 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.db_write_buffer_size: 0 2024-04-12T09:16:10.679 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.write_buffer_manager: 0x5616a6a201e0 2024-04-12T09:16:10.679 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-12T09:16:10.679 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-12T09:16:10.679 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-12T09:16:10.679 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.rate_limiter: (nil) 2024-04-12T09:16:10.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-12T09:16:10.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.wal_recovery_mode: 2 2024-04-12T09:16:10.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.enable_thread_tracking: 0 2024-04-12T09:16:10.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.enable_pipelined_write: 0 2024-04-12T09:16:10.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.unordered_write: 0 2024-04-12T09:16:10.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-12T09:16:10.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-12T09:16:10.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-12T09:16:10.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-12T09:16:10.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.row_cache: None 2024-04-12T09:16:10.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.wal_filter: None 2024-04-12T09:16:10.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-12T09:16:10.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.allow_ingest_behind: 0 2024-04-12T09:16:10.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.two_write_queues: 0 2024-04-12T09:16:10.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.manual_wal_flush: 0 2024-04-12T09:16:10.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.wal_compression: 0 2024-04-12T09:16:10.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.atomic_flush: 0 2024-04-12T09:16:10.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-12T09:16:10.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-12T09:16:10.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-12T09:16:10.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.log_readahead_size: 0 2024-04-12T09:16:10.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-12T09:16:10.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.best_efforts_recovery: 0 2024-04-12T09:16:10.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-12T09:16:10.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-12T09:16:10.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.allow_data_in_errors: 0 2024-04-12T09:16:10.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.db_host_id: __hostname__ 2024-04-12T09:16:10.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-12T09:16:10.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_background_jobs: 2 2024-04-12T09:16:10.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_background_compactions: -1 2024-04-12T09:16:10.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_subcompactions: 1 2024-04-12T09:16:10.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-12T09:16:10.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-12T09:16:10.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-12T09:16:10.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_total_wal_size: 0 2024-04-12T09:16:10.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-12T09:16:10.827 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-12T09:16:10.827 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-12T09:16:10.827 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-12T09:16:10.827 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_open_files: -1 2024-04-12T09:16:10.827 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.bytes_per_sync: 0 2024-04-12T09:16:10.827 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-12T09:16:10.827 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-12T09:16:10.827 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.compaction_readahead_size: 0 2024-04-12T09:16:10.827 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_background_flushes: -1 2024-04-12T09:16:10.827 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Compression algorithms supported: 2024-04-12T09:16:10.827 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-12T09:16:10.827 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: kZSTD supported: 0 2024-04-12T09:16:10.827 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: kXpressCompression supported: 0 2024-04-12T09:16:10.827 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: kLZ4HCCompression supported: 1 2024-04-12T09:16:10.827 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: kZlibCompression supported: 1 2024-04-12T09:16:10.827 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: kSnappyCompression supported: 1 2024-04-12T09:16:10.828 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: kLZ4Compression supported: 1 2024-04-12T09:16:10.828 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: kBZip2Compression supported: 0 2024-04-12T09:16:10.828 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-12T09:16:10.828 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-12T09:16:10.828 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi203/store.db/MANIFEST-000009 2024-04-12T09:16:10.828 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-12T09:16:10.828 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-12T09:16:10.828 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.merge_operator: 2024-04-12T09:16:10.828 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.compaction_filter: None 2024-04-12T09:16:10.828 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.compaction_filter_factory: None 2024-04-12T09:16:10.828 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.sst_partitioner_factory: None 2024-04-12T09:16:10.828 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-12T09:16:10.828 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-12T09:16:10.828 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5616a6a4daa0) 2024-04-12T09:16:10.828 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: cache_index_and_filter_blocks: 1 2024-04-12T09:16:10.829 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-12T09:16:10.829 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-12T09:16:10.829 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: pin_top_level_index_and_filter: 1 2024-04-12T09:16:10.829 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: index_type: 0 2024-04-12T09:16:10.829 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: data_block_index_type: 0 2024-04-12T09:16:10.829 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: index_shortening: 1 2024-04-12T09:16:10.829 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-12T09:16:10.829 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: checksum: 4 2024-04-12T09:16:10.829 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: no_block_cache: 0 2024-04-12T09:16:10.829 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_cache: 0x5616a6a51090 2024-04-12T09:16:10.829 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_cache_name: BinnedLRUCache 2024-04-12T09:16:10.829 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_cache_options: 2024-04-12T09:16:10.829 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: capacity : 536870912 2024-04-12T09:16:10.829 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: num_shard_bits : 4 2024-04-12T09:16:10.829 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: strict_capacity_limit : 0 2024-04-12T09:16:10.830 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: high_pri_pool_ratio: 0.000 2024-04-12T09:16:10.830 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_cache_compressed: (nil) 2024-04-12T09:16:10.830 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: persistent_cache: (nil) 2024-04-12T09:16:10.830 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_size: 4096 2024-04-12T09:16:10.831 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_size_deviation: 10 2024-04-12T09:16:10.831 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_restart_interval: 16 2024-04-12T09:16:10.831 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: index_block_restart_interval: 1 2024-04-12T09:16:10.831 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: metadata_block_size: 4096 2024-04-12T09:16:10.831 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: partition_filters: 0 2024-04-12T09:16:10.831 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: use_delta_encoding: 1 2024-04-12T09:16:10.831 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: filter_policy: bloomfilter 2024-04-12T09:16:10.831 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: whole_key_filtering: 1 2024-04-12T09:16:10.831 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: verify_compression: 0 2024-04-12T09:16:10.832 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: read_amp_bytes_per_bit: 0 2024-04-12T09:16:10.832 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: format_version: 5 2024-04-12T09:16:10.832 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: enable_index_compression: 1 2024-04-12T09:16:10.832 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: block_align: 0 2024-04-12T09:16:10.832 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: max_auto_readahead_size: 262144 2024-04-12T09:16:10.832 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: prepopulate_block_cache: 0 2024-04-12T09:16:10.832 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: initial_auto_readahead_size: 8192 2024-04-12T09:16:10.832 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: num_file_reads_for_auto_readahead: 2 2024-04-12T09:16:10.832 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.write_buffer_size: 33554432 2024-04-12T09:16:10.832 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_write_buffer_number: 2 2024-04-12T09:16:10.832 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.compression: NoCompression 2024-04-12T09:16:10.832 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.bottommost_compression: Disabled 2024-04-12T09:16:10.832 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.prefix_extractor: nullptr 2024-04-12T09:16:10.832 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-12T09:16:10.832 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.num_levels: 7 2024-04-12T09:16:10.833 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-12T09:16:10.833 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-12T09:16:10.833 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-12T09:16:10.833 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-12T09:16:10.833 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-12T09:16:10.833 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-12T09:16:10.833 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-12T09:16:10.833 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-12T09:16:10.833 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-12T09:16:10.833 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-12T09:16:10.833 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-12T09:16:10.833 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-12T09:16:10.833 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-12T09:16:10.833 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.compression_opts.level: 32767 2024-04-12T09:16:10.833 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.compression_opts.strategy: 0 2024-04-12T09:16:10.834 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-12T09:16:10.834 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-12T09:16:10.834 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-12T09:16:10.834 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-12T09:16:10.834 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.compression_opts.enabled: false 2024-04-12T09:16:10.834 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-12T09:16:10.834 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-12T09:16:10.834 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-12T09:16:10.834 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-12T09:16:10.834 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.target_file_size_base: 67108864 2024-04-12T09:16:10.834 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-12T09:16:10.834 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-12T09:16:10.834 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-12T09:16:10.834 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-12T09:16:10.834 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-12T09:16:10.835 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-12T09:16:10.835 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-12T09:16:10.835 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-12T09:16:10.835 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-12T09:16:10.835 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-12T09:16:10.835 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-12T09:16:10.835 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-12T09:16:10.835 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-12T09:16:10.835 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-12T09:16:10.835 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.arena_block_size: 1048576 2024-04-12T09:16:10.835 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-12T09:16:10.835 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-12T09:16:10.835 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.disable_auto_compactions: 0 2024-04-12T09:16:10.835 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-12T09:16:10.835 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-12T09:16:10.836 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-12T09:16:10.836 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-12T09:16:10.836 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-12T09:16:10.836 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-12T09:16:10.836 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-12T09:16:10.836 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-12T09:16:10.836 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-12T09:16:10.836 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-12T09:16:10.836 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.table_properties_collectors: 2024-04-12T09:16:10.836 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.inplace_update_support: 0 2024-04-12T09:16:10.836 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-12T09:16:10.836 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-12T09:16:10.836 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-12T09:16:10.836 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-12T09:16:10.837 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.bloom_locality: 0 2024-04-12T09:16:10.837 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.max_successive_merges: 0 2024-04-12T09:16:10.837 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-12T09:16:10.837 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.paranoid_file_checks: 0 2024-04-12T09:16:10.837 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.force_consistency_checks: 1 2024-04-12T09:16:10.837 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.report_bg_io_stats: 0 2024-04-12T09:16:10.837 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.ttl: 2592000 2024-04-12T09:16:10.837 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-12T09:16:10.837 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-12T09:16:10.837 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-12T09:16:10.837 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.enable_blob_files: false 2024-04-12T09:16:10.837 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.min_blob_size: 0 2024-04-12T09:16:10.837 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.blob_file_size: 268435456 2024-04-12T09:16:10.837 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-12T09:16:10.837 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-12T09:16:10.838 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-12T09:16:10.838 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-12T09:16:10.838 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-12T09:16:10.838 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.blob_file_starting_level: 0 2024-04-12T09:16:10.838 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-12T09:16:10.838 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2024-04-12T09:16:10.838 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-12T09:16:10.838 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi203/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12242, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-12T09:16:10.838 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-04-12T09:16:10.838 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e26883ec-86ff-4a92-9293-4080f1cee69e 2024-04-12T09:16:10.838 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712913370674363, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-04-12T09:16:10.838 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-04-12T09:16:10.838 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712913370689346, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 3493517, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12239, "largest_seqno": 14539, "table_properties": {"data_size": 3483991, "index_size": 6138, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2373, "raw_key_size": 22143, "raw_average_key_size": 23, "raw_value_size": 3463985, "raw_average_value_size": 3681, "num_data_blocks": 278, "num_entries": 941, "num_filter_entries": 941, "num_deletions": 7, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1712913370, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e26883ec-86ff-4a92-9293-4080f1cee69e", "db_session_id": "J4MXIIU9AJ3SO2Q2LSEH", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-04-12T09:16:10.838 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: EVENT_LOG_v1 {"time_micros": 1712913370689449, "job": 1, "event": "recovery_finished"} 2024-04-12T09:16:10.839 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-04-12T09:16:10.839 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-12T09:16:10.839 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi203/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-12T09:16:10.839 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5616a6b42000 2024-04-12T09:16:10.839 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: DB pointer 0x5616a6b2c000 2024-04-12T09:16:10.839 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-12T09:16:10.839 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-12T09:16:10.839 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ** DB Stats ** 2024-04-12T09:16:10.839 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-12T09:16:10.839 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-12T09:16:10.839 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-12T09:16:10.839 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-12T09:16:10.839 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-12T09:16:10.839 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-12T09:16:10.839 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-12T09:16:10.840 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-04-12T09:16:10.840 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ** Compaction Stats [default] ** 2024-04-12T09:16:10.840 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-12T09:16:10.840 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-12T09:16:10.840 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: L0 1/0 3.33 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 494.0 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-04-12T09:16:10.840 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: L6 1/0 6.75 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-12T09:16:10.840 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Sum 2/0 10.08 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 494.0 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-04-12T09:16:10.840 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 494.0 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-04-12T09:16:10.840 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-04-12T09:16:10.840 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ** Compaction Stats [default] ** 2024-04-12T09:16:10.840 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-12T09:16:10.840 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-12T09:16:10.840 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 494.0 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-04-12T09:16:10.840 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-04-12T09:16:10.841 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-12T09:16:10.841 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-04-12T09:16:10.841 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-12T09:16:10.841 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-04-12T09:16:10.841 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-12T09:16:10.841 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-12T09:16:10.841 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-12T09:16:10.841 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-12T09:16:10.841 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Cumulative compaction: 0.00 GB write, 169.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-12T09:16:10.841 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Interval compaction: 0.00 GB write, 169.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-12T09:16:10.841 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-12T09:16:10.841 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Block cache BinnedLRUCache@0x5616a6a51090#2 capacity: 512.00 MB usage: 8.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-04-12T09:16:10.841 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.53 KB,0.000482798%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2024-04-12T09:16:10.841 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-04-12T09:16:10.841 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-12T09:16:10.842 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: starting mon.smithi203 rank 1 at public addrs [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] at bind addrs [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi203 fsid 12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:16:10.842 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: mon.smithi203@-1(???) e2 preinit fsid 12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:16:10.842 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: mon.smithi203@-1(???).mds e14 new map 2024-04-12T09:16:10.842 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: mon.smithi203@-1(???).mds e14 print_map 2024-04-12T09:16:10.842 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: e14 2024-04-12T09:16:10.842 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T09:16:10.842 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:16:10.842 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: legacy client fscid: 1 2024-04-12T09:16:10.842 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-04-12T09:16:10.842 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Filesystem 'cephfs' (1) 2024-04-12T09:16:10.842 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: fs_name cephfs 2024-04-12T09:16:10.842 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: epoch 14 2024-04-12T09:16:10.842 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T09:16:10.842 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: created 2024-04-12T09:08:12.488144+0000 2024-04-12T09:16:10.842 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: modified 2024-04-12T09:08:30.563184+0000 2024-04-12T09:16:10.843 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: tableserver 0 2024-04-12T09:16:10.843 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: root 0 2024-04-12T09:16:10.843 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: session_timeout 60 2024-04-12T09:16:10.843 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: session_autoclose 300 2024-04-12T09:16:10.843 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: max_file_size 1099511627776 2024-04-12T09:16:10.843 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: max_xattr_size 65536 2024-04-12T09:16:10.843 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: required_client_features {} 2024-04-12T09:16:10.843 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: last_failure 0 2024-04-12T09:16:10.843 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: last_failure_osd_epoch 46 2024-04-12T09:16:10.843 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:16:10.843 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: max_mds 1 2024-04-12T09:16:10.843 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: in 0 2024-04-12T09:16:10.843 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: up {0=14474} 2024-04-12T09:16:10.843 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: failed 2024-04-12T09:16:10.844 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: damaged 2024-04-12T09:16:10.844 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: stopped 2024-04-12T09:16:10.844 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: data_pools [3] 2024-04-12T09:16:10.844 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: metadata_pool 2 2024-04-12T09:16:10.844 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: inline_data disabled 2024-04-12T09:16:10.844 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: balancer 2024-04-12T09:16:10.844 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: bal_rank_mask -1 2024-04-12T09:16:10.844 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: standby_count_wanted 1 2024-04-12T09:16:10.844 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: qdb_cluster leader: 0 members: 2024-04-12T09:16:10.844 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: [mds.cephfs.smithi117.eslmxh{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.117:6828/2248590199,v1:172.21.15.117:6829/2248590199] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:16:10.844 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-04-12T09:16:10.844 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-04-12T09:16:10.844 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: Standby daemons: 2024-04-12T09:16:10.844 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: 2024-04-12T09:16:10.844 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: [mds.cephfs.smithi117.wddsgt{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/4010127141,v1:172.21.15.117:6827/4010127141] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:16:10.845 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: [mds.cephfs.smithi203.fbeixl{-1:24265} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.203:6824/840607003,v1:172.21.15.203:6825/840607003] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:16:10.845 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout: [mds.cephfs.smithi203.bszhxz{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/2731911290,v1:172.21.15.203:6827/2731911290] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:16:10.845 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: mon.smithi203@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-12T09:16:10.845 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: mon.smithi203@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-12T09:16:10.845 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: mon.smithi203@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-12T09:16:10.845 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: mon.smithi203@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-12T09:16:10.845 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 ceph-mon[86783]: mon.smithi203@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-04-12T09:16:10.845 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 bash[86763]: 006c6e487bfbb2a5ff3fae7090d902845a49ca90851ca479f7c9ddbdc8059dfa 2024-04-12T09:16:10.845 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:10 smithi203 systemd[1]: Started Ceph mon.smithi203 for 12161984-f8ab-11ee-bc8c-c7b262605968. 2024-04-12T09:16:12.003 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:11 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-04-12T09:16:12.003 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:11 smithi203 ceph-mon[86783]: mon.smithi117 calling monitor election 2024-04-12T09:16:12.003 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:11 smithi203 ceph-mon[86783]: mon.smithi203 calling monitor election 2024-04-12T09:16:12.003 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:11 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:16:12.003 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:11 smithi203 ceph-mon[86783]: mon.smithi117 is new leader, mons smithi117,smithi203 in quorum (ranks 0,1) 2024-04-12T09:16:12.003 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:11 smithi203 ceph-mon[86783]: monmap epoch 3 2024-04-12T09:16:12.004 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:11 smithi203 ceph-mon[86783]: fsid 12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:16:12.004 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:11 smithi203 ceph-mon[86783]: last_changed 2024-04-12T09:16:10.913060+0000 2024-04-12T09:16:12.004 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:11 smithi203 ceph-mon[86783]: created 2024-04-12T09:01:20.152816+0000 2024-04-12T09:16:12.004 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:11 smithi203 ceph-mon[86783]: min_mon_release 19 (squid) 2024-04-12T09:16:12.004 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:11 smithi203 ceph-mon[86783]: election_strategy: 1 2024-04-12T09:16:12.004 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:11 smithi203 ceph-mon[86783]: 0: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.smithi117 2024-04-12T09:16:12.004 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:11 smithi203 ceph-mon[86783]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.smithi203 2024-04-12T09:16:12.004 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:11 smithi203 ceph-mon[86783]: fsmap cephfs:1 {0=cephfs.smithi117.eslmxh=up:active} 3 up:standby 2024-04-12T09:16:12.004 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:11 smithi203 ceph-mon[86783]: osdmap e49: 6 total, 6 up, 6 in 2024-04-12T09:16:12.004 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:11 smithi203 ceph-mon[86783]: mgrmap e38: smithi117.oyaxql(active, since 16s), standbys: smithi203.apfqpo 2024-04-12T09:16:12.004 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:11 smithi203 ceph-mon[86783]: overall HEALTH_OK 2024-04-12T09:16:12.004 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:11 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:12.004 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:11 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:12.004 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:11 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:16:12.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:11 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-04-12T09:16:12.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:11 smithi117 ceph-mon[113571]: mon.smithi117 calling monitor election 2024-04-12T09:16:12.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:11 smithi117 ceph-mon[113571]: mon.smithi203 calling monitor election 2024-04-12T09:16:12.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:11 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mon metadata", "id": "smithi203"}]: dispatch 2024-04-12T09:16:12.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:11 smithi117 ceph-mon[113571]: mon.smithi117 is new leader, mons smithi117,smithi203 in quorum (ranks 0,1) 2024-04-12T09:16:12.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:11 smithi117 ceph-mon[113571]: monmap epoch 3 2024-04-12T09:16:12.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:11 smithi117 ceph-mon[113571]: fsid 12161984-f8ab-11ee-bc8c-c7b262605968 2024-04-12T09:16:12.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:11 smithi117 ceph-mon[113571]: last_changed 2024-04-12T09:16:10.913060+0000 2024-04-12T09:16:12.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:11 smithi117 ceph-mon[113571]: created 2024-04-12T09:01:20.152816+0000 2024-04-12T09:16:12.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:11 smithi117 ceph-mon[113571]: min_mon_release 19 (squid) 2024-04-12T09:16:12.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:11 smithi117 ceph-mon[113571]: election_strategy: 1 2024-04-12T09:16:12.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:11 smithi117 ceph-mon[113571]: 0: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.smithi117 2024-04-12T09:16:12.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:11 smithi117 ceph-mon[113571]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.smithi203 2024-04-12T09:16:12.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:11 smithi117 ceph-mon[113571]: fsmap cephfs:1 {0=cephfs.smithi117.eslmxh=up:active} 3 up:standby 2024-04-12T09:16:12.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:11 smithi117 ceph-mon[113571]: osdmap e49: 6 total, 6 up, 6 in 2024-04-12T09:16:12.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:11 smithi117 ceph-mon[113571]: mgrmap e38: smithi117.oyaxql(active, since 16s), standbys: smithi203.apfqpo 2024-04-12T09:16:12.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:11 smithi117 ceph-mon[113571]: overall HEALTH_OK 2024-04-12T09:16:12.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:11 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:12.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:11 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:12.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:11 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:16:12.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.474+0000 7f798c295700 1 -- 172.21.15.117:0/3705395579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7984102f50 msgr2=0x7f7984103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:12.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.474+0000 7f798c295700 1 --2- 172.21.15.117:0/3705395579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7984102f50 0x7f7984103320 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7974009ce0 tx=0x7f7974004d10 comp rx=0 tx=0).stop 2024-04-12T09:16:12.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.474+0000 7f798c295700 1 -- 172.21.15.117:0/3705395579 shutdown_connections 2024-04-12T09:16:12.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.474+0000 7f798c295700 1 --2- 172.21.15.117:0/3705395579 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79840fb4d0 0x7f79840fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:12.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.474+0000 7f798c295700 1 --2- 172.21.15.117:0/3705395579 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7984102f50 0x7f7984103320 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:12.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.474+0000 7f798c295700 1 -- 172.21.15.117:0/3705395579 >> 172.21.15.117:0/3705395579 conn(0x7f79840714c0 msgr2=0x7f79840718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:12.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.475+0000 7f798c295700 1 -- 172.21.15.117:0/3705395579 shutdown_connections 2024-04-12T09:16:12.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.475+0000 7f798c295700 1 -- 172.21.15.117:0/3705395579 wait complete. 2024-04-12T09:16:12.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.475+0000 7f798c295700 1 Processor -- start 2024-04-12T09:16:12.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.475+0000 7f798c295700 1 -- start start 2024-04-12T09:16:12.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.475+0000 7f798c295700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79840fb4d0 0x7f7984113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:12.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.475+0000 7f798c295700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7984102f50 0x7f7984114100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:12.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.475+0000 7f798c295700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7984114750 con 0x7f79840fb4d0 2024-04-12T09:16:12.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.475+0000 7f798c295700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798410dd30 con 0x7f7984102f50 2024-04-12T09:16:12.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.475+0000 7f798a031700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79840fb4d0 0x7f7984113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:12.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.475+0000 7f798a031700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79840fb4d0 0x7f7984113bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42434/0 (socket says 172.21.15.117:42434) 2024-04-12T09:16:12.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.475+0000 7f798a031700 1 -- 172.21.15.117:0/1891841469 learned_addr learned my addr 172.21.15.117:0/1891841469 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:16:12.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.475+0000 7f7989830700 1 --2- 172.21.15.117:0/1891841469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7984102f50 0x7f7984114100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:12.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.476+0000 7f7989830700 1 -- 172.21.15.117:0/1891841469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7984102f50 msgr2=0x7f7984114100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-12T09:16:12.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.476+0000 7f7989830700 1 -- 172.21.15.117:0/1891841469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7984102f50 msgr2=0x7f7984114100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-12T09:16:12.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.476+0000 7f7989830700 1 --2- 172.21.15.117:0/1891841469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7984102f50 0x7f7984114100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-12T09:16:12.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.476+0000 7f7989830700 1 --2- 172.21.15.117:0/1891841469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7984102f50 0x7f7984114100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T09:16:12.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.476+0000 7f798a031700 1 -- 172.21.15.117:0/1891841469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7984102f50 msgr2=0x7f7984114100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T09:16:12.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.476+0000 7f798a031700 1 --2- 172.21.15.117:0/1891841469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7984102f50 0x7f7984114100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:12.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.476+0000 7f798a031700 1 -- 172.21.15.117:0/1891841469 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7974009940 con 0x7f79840fb4d0 2024-04-12T09:16:12.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.476+0000 7f798a031700 1 --2- 172.21.15.117:0/1891841469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79840fb4d0 0x7f7984113bc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f797400be40 tx=0x7f7974004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:12.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.476+0000 7f7982ffd700 1 -- 172.21.15.117:0/1891841469 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f797400e040 con 0x7f79840fb4d0 2024-04-12T09:16:12.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.476+0000 7f798c295700 1 -- 172.21.15.117:0/1891841469 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f798410dfb0 con 0x7f79840fb4d0 2024-04-12T09:16:12.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.476+0000 7f7982ffd700 1 -- 172.21.15.117:0/1891841469 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7974004610 con 0x7f79840fb4d0 2024-04-12T09:16:12.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.476+0000 7f7982ffd700 1 -- 172.21.15.117:0/1891841469 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f797401c620 con 0x7f79840fb4d0 2024-04-12T09:16:12.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.476+0000 7f798c295700 1 -- 172.21.15.117:0/1891841469 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f798410e4f0 con 0x7f79840fb4d0 2024-04-12T09:16:12.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.477+0000 7f798c295700 1 -- 172.21.15.117:0/1891841469 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7984100200 con 0x7f79840fb4d0 2024-04-12T09:16:12.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.477+0000 7f7982ffd700 1 -- 172.21.15.117:0/1891841469 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 38) v1 ==== 91963+0+0 (secure 0 0 0) 0x7f7974008e20 con 0x7f79840fb4d0 2024-04-12T09:16:12.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.478+0000 7f7982ffd700 1 --2- 172.21.15.117:0/1891841469 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f796c06ddd0 0x7f796c070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:12.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.478+0000 7f7989830700 1 --2- 172.21.15.117:0/1891841469 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f796c06ddd0 0x7f796c070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:12.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.478+0000 7f7982ffd700 1 -- 172.21.15.117:0/1891841469 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f797408f230 con 0x7f79840fb4d0 2024-04-12T09:16:12.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.478+0000 7f7989830700 1 --2- 172.21.15.117:0/1891841469 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f796c06ddd0 0x7f796c070280 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f798410f460 tx=0x7f7978009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:12.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.483+0000 7f7982ffd700 1 -- 172.21.15.117:0/1891841469 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f797405c170 con 0x7f79840fb4d0 2024-04-12T09:16:12.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.699+0000 7f798c295700 1 -- 172.21.15.117:0/1891841469 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f798410f280 con 0x7f796c06ddd0 2024-04-12T09:16:12.701 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.700+0000 7f7982ffd700 1 -- 172.21.15.117:0/1891841469 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f798410f280 con 0x7f796c06ddd0 2024-04-12T09:16:12.703 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.702+0000 7f798c295700 1 -- 172.21.15.117:0/1891841469 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f796c06ddd0 msgr2=0x7f796c070280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:12.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.702+0000 7f798c295700 1 --2- 172.21.15.117:0/1891841469 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f796c06ddd0 0x7f796c070280 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f798410f460 tx=0x7f7978009040 comp rx=0 tx=0).stop 2024-04-12T09:16:12.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.702+0000 7f798c295700 1 -- 172.21.15.117:0/1891841469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79840fb4d0 msgr2=0x7f7984113bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:12.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.702+0000 7f798c295700 1 --2- 172.21.15.117:0/1891841469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79840fb4d0 0x7f7984113bc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f797400be40 tx=0x7f7974004d10 comp rx=0 tx=0).stop 2024-04-12T09:16:12.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.703+0000 7f798c295700 1 -- 172.21.15.117:0/1891841469 shutdown_connections 2024-04-12T09:16:12.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.703+0000 7f798c295700 1 --2- 172.21.15.117:0/1891841469 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f796c06ddd0 0x7f796c070280 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:12.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.703+0000 7f798c295700 1 --2- 172.21.15.117:0/1891841469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79840fb4d0 0x7f7984113bc0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:12.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.703+0000 7f798c295700 1 --2- 172.21.15.117:0/1891841469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7984102f50 0x7f7984114100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:12.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.703+0000 7f798c295700 1 -- 172.21.15.117:0/1891841469 >> 172.21.15.117:0/1891841469 conn(0x7f79840714c0 msgr2=0x7f79840fa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:12.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.703+0000 7f798c295700 1 -- 172.21.15.117:0/1891841469 shutdown_connections 2024-04-12T09:16:12.704 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.703+0000 7f798c295700 1 -- 172.21.15.117:0/1891841469 wait complete. 2024-04-12T09:16:12.714 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:16:12.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.805+0000 7fafac52c700 1 -- 172.21.15.117:0/166769522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafa4102e70 msgr2=0x7fafa4103240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:12.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.805+0000 7fafac52c700 1 --2- 172.21.15.117:0/166769522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafa4102e70 0x7fafa4103240 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fafa0004940 tx=0x7fafa0009e30 comp rx=0 tx=0).stop 2024-04-12T09:16:12.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.805+0000 7fafac52c700 1 -- 172.21.15.117:0/166769522 shutdown_connections 2024-04-12T09:16:12.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.805+0000 7fafac52c700 1 --2- 172.21.15.117:0/166769522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafa40fb4a0 0x7fafa40fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:12.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.805+0000 7fafac52c700 1 --2- 172.21.15.117:0/166769522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafa4102e70 0x7fafa4103240 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:12.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.805+0000 7fafac52c700 1 -- 172.21.15.117:0/166769522 >> 172.21.15.117:0/166769522 conn(0x7fafa40714c0 msgr2=0x7fafa40718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:12.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.805+0000 7fafac52c700 1 -- 172.21.15.117:0/166769522 shutdown_connections 2024-04-12T09:16:12.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.805+0000 7fafac52c700 1 -- 172.21.15.117:0/166769522 wait complete. 2024-04-12T09:16:12.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.805+0000 7fafac52c700 1 Processor -- start 2024-04-12T09:16:12.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.805+0000 7fafac52c700 1 -- start start 2024-04-12T09:16:12.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.806+0000 7fafac52c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafa40fb4a0 0x7fafa4113b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:12.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.806+0000 7fafac52c700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafa4102e70 0x7fafa4114090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:12.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.806+0000 7fafac52c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa41146e0 con 0x7fafa40fb4a0 2024-04-12T09:16:12.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.806+0000 7fafac52c700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa410dad0 con 0x7fafa4102e70 2024-04-12T09:16:12.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.806+0000 7fafaa2c8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafa40fb4a0 0x7fafa4113b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:12.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.806+0000 7fafaa2c8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafa40fb4a0 0x7fafa4113b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42460/0 (socket says 172.21.15.117:42460) 2024-04-12T09:16:12.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.806+0000 7fafaa2c8700 1 -- 172.21.15.117:0/4014698680 learned_addr learned my addr 172.21.15.117:0/4014698680 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:16:12.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.806+0000 7fafa9ac7700 1 --2- 172.21.15.117:0/4014698680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafa4102e70 0x7fafa4114090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:12.808 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.806+0000 7fafa9ac7700 1 -- 172.21.15.117:0/4014698680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafa4102e70 msgr2=0x7fafa4114090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-12T09:16:12.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.806+0000 7fafa9ac7700 1 -- 172.21.15.117:0/4014698680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafa4102e70 msgr2=0x7fafa4114090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-12T09:16:12.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.806+0000 7fafa9ac7700 1 --2- 172.21.15.117:0/4014698680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafa4102e70 0x7fafa4114090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-12T09:16:12.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.806+0000 7fafa9ac7700 1 --2- 172.21.15.117:0/4014698680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafa4102e70 0x7fafa4114090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T09:16:12.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.806+0000 7fafaa2c8700 1 -- 172.21.15.117:0/4014698680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafa4102e70 msgr2=0x7fafa4114090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T09:16:12.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.806+0000 7fafaa2c8700 1 --2- 172.21.15.117:0/4014698680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafa4102e70 0x7fafa4114090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:12.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.806+0000 7fafaa2c8700 1 -- 172.21.15.117:0/4014698680 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa0005040 con 0x7fafa40fb4a0 2024-04-12T09:16:12.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.806+0000 7fafaa2c8700 1 --2- 172.21.15.117:0/4014698680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafa40fb4a0 0x7fafa4113b50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fafa000b8b0 tx=0x7fafa0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:12.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.806+0000 7faf9affd700 1 -- 172.21.15.117:0/4014698680 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafa000e040 con 0x7fafa40fb4a0 2024-04-12T09:16:12.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.806+0000 7faf9affd700 1 -- 172.21.15.117:0/4014698680 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fafa0004290 con 0x7fafa40fb4a0 2024-04-12T09:16:12.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.806+0000 7fafac52c700 1 -- 172.21.15.117:0/4014698680 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa410dd50 con 0x7fafa40fb4a0 2024-04-12T09:16:12.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.806+0000 7faf9affd700 1 -- 172.21.15.117:0/4014698680 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafa001c3f0 con 0x7fafa40fb4a0 2024-04-12T09:16:12.809 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.806+0000 7fafac52c700 1 -- 172.21.15.117:0/4014698680 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa410e310 con 0x7fafa40fb4a0 2024-04-12T09:16:12.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.807+0000 7fafac52c700 1 -- 172.21.15.117:0/4014698680 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa4100110 con 0x7fafa40fb4a0 2024-04-12T09:16:12.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.808+0000 7faf9affd700 1 -- 172.21.15.117:0/4014698680 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 38) v1 ==== 91963+0+0 (secure 0 0 0) 0x7fafa00137b0 con 0x7fafa40fb4a0 2024-04-12T09:16:12.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.808+0000 7faf9affd700 1 --2- 172.21.15.117:0/4014698680 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7faf9006ddc0 0x7faf90070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:12.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.808+0000 7faf9affd700 1 -- 172.21.15.117:0/4014698680 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fafa008eab0 con 0x7fafa40fb4a0 2024-04-12T09:16:12.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.808+0000 7fafa9ac7700 1 --2- 172.21.15.117:0/4014698680 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7faf9006ddc0 0x7faf90070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:12.810 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.809+0000 7fafa9ac7700 1 --2- 172.21.15.117:0/4014698680 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7faf9006ddc0 0x7faf90070270 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fafa410ec90 tx=0x7faf94009f10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:12.813 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:12.813+0000 7faf9affd700 1 -- 172.21.15.117:0/4014698680 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fafa005ba70 con 0x7fafa40fb4a0 2024-04-12T09:16:13.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.026+0000 7fafac52c700 1 -- 172.21.15.117:0/4014698680 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fafa410f1a0 con 0x7faf9006ddc0 2024-04-12T09:16:13.027 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:12 smithi117 ceph-mon[113571]: pgmap v12: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:13.027 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:12 smithi117 ceph-mon[113571]: from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:16:13.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.027+0000 7faf9affd700 1 -- 172.21.15.117:0/4014698680 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fafa410f1a0 con 0x7faf9006ddc0 2024-04-12T09:16:13.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.029+0000 7fafac52c700 1 -- 172.21.15.117:0/4014698680 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7faf9006ddc0 msgr2=0x7faf90070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:13.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.029+0000 7fafac52c700 1 --2- 172.21.15.117:0/4014698680 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7faf9006ddc0 0x7faf90070270 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fafa410ec90 tx=0x7faf94009f10 comp rx=0 tx=0).stop 2024-04-12T09:16:13.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.029+0000 7fafac52c700 1 -- 172.21.15.117:0/4014698680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafa40fb4a0 msgr2=0x7fafa4113b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:13.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.029+0000 7fafac52c700 1 --2- 172.21.15.117:0/4014698680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafa40fb4a0 0x7fafa4113b50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fafa000b8b0 tx=0x7fafa0009e30 comp rx=0 tx=0).stop 2024-04-12T09:16:13.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.029+0000 7fafac52c700 1 -- 172.21.15.117:0/4014698680 shutdown_connections 2024-04-12T09:16:13.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.029+0000 7fafac52c700 1 --2- 172.21.15.117:0/4014698680 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7faf9006ddc0 0x7faf90070270 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:13.030 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.029+0000 7fafac52c700 1 --2- 172.21.15.117:0/4014698680 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fafa40fb4a0 0x7fafa4113b50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:13.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.029+0000 7fafac52c700 1 --2- 172.21.15.117:0/4014698680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafa4102e70 0x7fafa4114090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:13.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.029+0000 7fafac52c700 1 -- 172.21.15.117:0/4014698680 >> 172.21.15.117:0/4014698680 conn(0x7fafa40714c0 msgr2=0x7fafa40fa7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:13.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.029+0000 7fafac52c700 1 -- 172.21.15.117:0/4014698680 shutdown_connections 2024-04-12T09:16:13.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.029+0000 7fafac52c700 1 -- 172.21.15.117:0/4014698680 wait complete. 2024-04-12T09:16:13.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.129+0000 7f3fff4f1700 1 -- 172.21.15.117:0/2543288301 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff80fb500 msgr2=0x7f3ff80fb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:13.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.129+0000 7f3fff4f1700 1 --2- 172.21.15.117:0/2543288301 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff80fb500 0x7f3ff80fb970 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8004940 tx=0x7f3fe8009e30 comp rx=0 tx=0).stop 2024-04-12T09:16:13.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.129+0000 7f3fff4f1700 1 -- 172.21.15.117:0/2543288301 shutdown_connections 2024-04-12T09:16:13.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.129+0000 7f3fff4f1700 1 --2- 172.21.15.117:0/2543288301 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff80fb500 0x7f3ff80fb970 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:13.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.129+0000 7f3fff4f1700 1 --2- 172.21.15.117:0/2543288301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ff8101510 0x7f3ff81018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:13.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.129+0000 7f3fff4f1700 1 -- 172.21.15.117:0/2543288301 >> 172.21.15.117:0/2543288301 conn(0x7f3ff8072370 msgr2=0x7f3ff8072770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:13.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.130+0000 7f3fff4f1700 1 -- 172.21.15.117:0/2543288301 shutdown_connections 2024-04-12T09:16:13.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.130+0000 7f3fff4f1700 1 -- 172.21.15.117:0/2543288301 wait complete. 2024-04-12T09:16:13.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.130+0000 7f3fff4f1700 1 Processor -- start 2024-04-12T09:16:13.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.130+0000 7f3fff4f1700 1 -- start start 2024-04-12T09:16:13.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.130+0000 7f3fff4f1700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ff80fb500 0x7f3ff810ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:13.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.130+0000 7f3fff4f1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff8101510 0x7f3ff810f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:13.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.130+0000 7f3fff4f1700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff810f6b0 con 0x7f3ff8101510 2024-04-12T09:16:13.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.130+0000 7f3fff4f1700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff810f7f0 con 0x7f3ff80fb500 2024-04-12T09:16:13.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.130+0000 7f3ffca8c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff8101510 0x7f3ff810f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:13.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.130+0000 7f3ffca8c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff8101510 0x7f3ff810f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42486/0 (socket says 172.21.15.117:42486) 2024-04-12T09:16:13.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.130+0000 7f3ffca8c700 1 -- 172.21.15.117:0/1814940826 learned_addr learned my addr 172.21.15.117:0/1814940826 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:16:13.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.130+0000 7f3ffd28d700 1 --2- 172.21.15.117:0/1814940826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ff80fb500 0x7f3ff810ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:13.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.131+0000 7f3ffd28d700 1 -- 172.21.15.117:0/1814940826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ff80fb500 msgr2=0x7f3ff810ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-12T09:16:13.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.131+0000 7f3ffd28d700 1 -- 172.21.15.117:0/1814940826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ff80fb500 msgr2=0x7f3ff810ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-12T09:16:13.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.131+0000 7f3ffd28d700 1 --2- 172.21.15.117:0/1814940826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ff80fb500 0x7f3ff810ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-12T09:16:13.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.131+0000 7f3ffd28d700 1 --2- 172.21.15.117:0/1814940826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ff80fb500 0x7f3ff810ec30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T09:16:13.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.131+0000 7f3ffca8c700 1 -- 172.21.15.117:0/1814940826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ff80fb500 msgr2=0x7f3ff810ec30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T09:16:13.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.131+0000 7f3ffca8c700 1 --2- 172.21.15.117:0/1814940826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ff80fb500 0x7f3ff810ec30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:13.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.131+0000 7f3ffca8c700 1 -- 172.21.15.117:0/1814940826 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe8005040 con 0x7f3ff8101510 2024-04-12T09:16:13.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.131+0000 7f3ffca8c700 1 --2- 172.21.15.117:0/1814940826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff8101510 0x7f3ff810f170 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3fe800b3b0 tx=0x7f3fe8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:13.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.131+0000 7f3fedffb700 1 -- 172.21.15.117:0/1814940826 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fe800e040 con 0x7f3ff8101510 2024-04-12T09:16:13.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.131+0000 7f3fff4f1700 1 -- 172.21.15.117:0/1814940826 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff810fa70 con 0x7f3ff8101510 2024-04-12T09:16:13.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.131+0000 7f3fedffb700 1 -- 172.21.15.117:0/1814940826 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3fe800bbc0 con 0x7f3ff8101510 2024-04-12T09:16:13.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.131+0000 7f3fedffb700 1 -- 172.21.15.117:0/1814940826 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fe801c3f0 con 0x7f3ff8101510 2024-04-12T09:16:13.134 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.131+0000 7f3fff4f1700 1 -- 172.21.15.117:0/1814940826 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff8117f20 con 0x7f3ff8101510 2024-04-12T09:16:13.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.132+0000 7f3fff4f1700 1 -- 172.21.15.117:0/1814940826 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff81038f0 con 0x7f3ff8101510 2024-04-12T09:16:13.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.133+0000 7f3fedffb700 1 -- 172.21.15.117:0/1814940826 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 38) v1 ==== 91963+0+0 (secure 0 0 0) 0x7f3fe8013420 con 0x7f3ff8101510 2024-04-12T09:16:13.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.133+0000 7f3fedffb700 1 --2- 172.21.15.117:0/1814940826 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f3fe406ddd0 0x7f3fe4070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:13.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.133+0000 7f3fedffb700 1 -- 172.21.15.117:0/1814940826 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f3fe808e9f0 con 0x7f3ff8101510 2024-04-12T09:16:13.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.133+0000 7f3ffd28d700 1 --2- 172.21.15.117:0/1814940826 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f3fe406ddd0 0x7f3fe4070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:13.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.134+0000 7f3ffd28d700 1 --2- 172.21.15.117:0/1814940826 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f3fe406ddd0 0x7f3fe4070280 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009e50 tx=0x7f3ff4009f10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:13.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.138+0000 7f3fedffb700 1 -- 172.21.15.117:0/1814940826 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f3fe8090e60 con 0x7f3ff8101510 2024-04-12T09:16:13.249 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:12 smithi203 ceph-mon[86783]: pgmap v12: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:13.249 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:12 smithi203 ceph-mon[86783]: from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:16:13.340 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.340+0000 7f3fff4f1700 1 -- 172.21.15.117:0/1814940826 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ff80fda30 con 0x7f3fe406ddd0 2024-04-12T09:16:13.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.350+0000 7f3fedffb700 1 -- 172.21.15.117:0/1814940826 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f3ff80fda30 con 0x7f3fe406ddd0 2024-04-12T09:16:13.351 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:16:13.351 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 running (112s) 13s ago 13m 28.6M - 0.25.0 c8568f914cd2 204687f21ed7 2024-04-12T09:16:13.351 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (13m) 13s ago 13m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad 1e9f2c6a4491 2024-04-12T09:16:13.351 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (12m) 15s ago 12m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad e42da3f6e517 2024-04-12T09:16:13.351 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 running (96s) 13s ago 13m 75.1M - 9.4.12 2bacad6d85d8 a7b102216886 2024-04-12T09:16:13.351 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (7m) 13s ago 7m 141M - 17.2.7-827-gd3b5060a 21de9b7369ad de062e2c10e7 2024-04-12T09:16:13.351 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 running (7m) 13s ago 7m 14.0M - 17.2.7-827-gd3b5060a 21de9b7369ad 1e82c6241a18 2024-04-12T09:16:13.351 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (7m) 15s ago 7m 16.2M - 17.2.7-827-gd3b5060a 21de9b7369ad b05228e997f7 2024-04-12T09:16:13.351 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (7m) 15s ago 7m 16.8M - 17.2.7-827-gd3b5060a 21de9b7369ad 6d7f82c072c7 2024-04-12T09:16:13.351 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:8443,9283,8765 running (3m) 13s ago 14m 471M - 19.0.0-2053-gb277feb2 668895944f0e fee613d05ab7 2024-04-12T09:16:13.351 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283,8765 running (2m) 15s ago 12m 447M - 19.0.0-2053-gb277feb2 668895944f0e c793944c3e16 2024-04-12T09:16:13.351 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (27s) 13s ago 14m 29.8M 2048M 19.0.0-2053-gb277feb2 668895944f0e 6823aaff30ce 2024-04-12T09:16:13.352 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 starting - - - 2048M 2024-04-12T09:16:13.352 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 running (2m) 13s ago 13m 15.7M - 1.5.0 0da6a335fe13 c692bed9f6c7 2024-04-12T09:16:13.352 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (2m) 15s ago 12m 15.3M - 1.5.0 0da6a335fe13 f3b5a470f545 2024-04-12T09:16:13.352 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (11m) 13s ago 11m 225M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 77040a2498f3 2024-04-12T09:16:13.352 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (11m) 13s ago 11m 236M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 8f9dbf0274ed 2024-04-12T09:16:13.352 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (10m) 13s ago 10m 201M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 339c5a80d1dd 2024-04-12T09:16:13.352 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (10m) 15s ago 10m 275M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad fb87d616bae3 2024-04-12T09:16:13.352 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (9m) 15s ago 9m 246M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad c873826a2dea 2024-04-12T09:16:13.352 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (9m) 15s ago 9m 221M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad 69cb7c22f002 2024-04-12T09:16:13.352 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 running (2m) 13s ago 12m 58.8M - 2.43.0 a07b618ecd1d 43ce588d82cc 2024-04-12T09:16:13.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.352+0000 7f3fff4f1700 1 -- 172.21.15.117:0/1814940826 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f3fe406ddd0 msgr2=0x7f3fe4070280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:13.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.352+0000 7f3fff4f1700 1 --2- 172.21.15.117:0/1814940826 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f3fe406ddd0 0x7f3fe4070280 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009e50 tx=0x7f3ff4009f10 comp rx=0 tx=0).stop 2024-04-12T09:16:13.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.352+0000 7f3fff4f1700 1 -- 172.21.15.117:0/1814940826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff8101510 msgr2=0x7f3ff810f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:13.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.352+0000 7f3fff4f1700 1 --2- 172.21.15.117:0/1814940826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff8101510 0x7f3ff810f170 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3fe800b3b0 tx=0x7f3fe8009e30 comp rx=0 tx=0).stop 2024-04-12T09:16:13.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.352+0000 7f3fff4f1700 1 -- 172.21.15.117:0/1814940826 shutdown_connections 2024-04-12T09:16:13.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.352+0000 7f3fff4f1700 1 --2- 172.21.15.117:0/1814940826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3ff80fb500 0x7f3ff810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:13.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.352+0000 7f3fff4f1700 1 --2- 172.21.15.117:0/1814940826 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f3fe406ddd0 0x7f3fe4070280 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:13.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.352+0000 7f3fff4f1700 1 --2- 172.21.15.117:0/1814940826 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ff8101510 0x7f3ff810f170 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:13.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.352+0000 7f3fff4f1700 1 -- 172.21.15.117:0/1814940826 >> 172.21.15.117:0/1814940826 conn(0x7f3ff8072370 msgr2=0x7f3ff80fea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:13.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.352+0000 7f3fff4f1700 1 -- 172.21.15.117:0/1814940826 shutdown_connections 2024-04-12T09:16:13.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.352+0000 7f3fff4f1700 1 -- 172.21.15.117:0/1814940826 wait complete. 2024-04-12T09:16:13.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.450+0000 7fc659060700 1 -- 172.21.15.117:0/1063240431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc654102e00 msgr2=0x7fc6541031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:13.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.450+0000 7fc659060700 1 --2- 172.21.15.117:0/1063240431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc654102e00 0x7fc6541031d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009ce0 tx=0x7fc64c004d10 comp rx=0 tx=0).stop 2024-04-12T09:16:13.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.450+0000 7fc659060700 1 -- 172.21.15.117:0/1063240431 shutdown_connections 2024-04-12T09:16:13.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.450+0000 7fc659060700 1 --2- 172.21.15.117:0/1063240431 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6541037a0 0x7fc6540fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:13.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.450+0000 7fc659060700 1 --2- 172.21.15.117:0/1063240431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc654102e00 0x7fc6541031d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:13.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.450+0000 7fc659060700 1 -- 172.21.15.117:0/1063240431 >> 172.21.15.117:0/1063240431 conn(0x7fc6540f89b0 msgr2=0x7fc6540fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:13.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.450+0000 7fc659060700 1 -- 172.21.15.117:0/1063240431 shutdown_connections 2024-04-12T09:16:13.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.450+0000 7fc659060700 1 -- 172.21.15.117:0/1063240431 wait complete. 2024-04-12T09:16:13.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.450+0000 7fc659060700 1 Processor -- start 2024-04-12T09:16:13.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.451+0000 7fc659060700 1 -- start start 2024-04-12T09:16:13.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.451+0000 7fc659060700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc654102e00 0x7fc654113d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:13.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.451+0000 7fc659060700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6541037a0 0x7fc654114240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:13.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.451+0000 7fc659060700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc654114890 con 0x7fc654102e00 2024-04-12T09:16:13.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.451+0000 7fc659060700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65410dcb0 con 0x7fc6541037a0 2024-04-12T09:16:13.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.451+0000 7fc652d9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc654102e00 0x7fc654113d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:13.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.451+0000 7fc652d9d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc654102e00 0x7fc654113d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42508/0 (socket says 172.21.15.117:42508) 2024-04-12T09:16:13.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.451+0000 7fc652d9d700 1 -- 172.21.15.117:0/4086466098 learned_addr learned my addr 172.21.15.117:0/4086466098 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:16:13.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.451+0000 7fc65259c700 1 --2- 172.21.15.117:0/4086466098 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6541037a0 0x7fc654114240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:13.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.451+0000 7fc652d9d700 1 -- 172.21.15.117:0/4086466098 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6541037a0 msgr2=0x7fc654114240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:13.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.451+0000 7fc65259c700 1 -- 172.21.15.117:0/4086466098 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6541037a0 msgr2=0x7fc654114240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-12T09:16:13.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.451+0000 7fc65259c700 1 -- 172.21.15.117:0/4086466098 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6541037a0 msgr2=0x7fc654114240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-12T09:16:13.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.451+0000 7fc65259c700 1 --2- 172.21.15.117:0/4086466098 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6541037a0 0x7fc654114240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-12T09:16:13.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.451+0000 7fc65259c700 1 --2- 172.21.15.117:0/4086466098 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6541037a0 0x7fc654114240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T09:16:13.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.451+0000 7fc652d9d700 1 --2- 172.21.15.117:0/4086466098 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6541037a0 0x7fc654114240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:13.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.451+0000 7fc652d9d700 1 -- 172.21.15.117:0/4086466098 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c009940 con 0x7fc654102e00 2024-04-12T09:16:13.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.451+0000 7fc652d9d700 1 --2- 172.21.15.117:0/4086466098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc654102e00 0x7fc654113d00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc64c00be90 tx=0x7fc64c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:13.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.451+0000 7fc63b7fe700 1 -- 172.21.15.117:0/4086466098 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc64c00e040 con 0x7fc654102e00 2024-04-12T09:16:13.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.451+0000 7fc63b7fe700 1 -- 172.21.15.117:0/4086466098 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc64c008ea0 con 0x7fc654102e00 2024-04-12T09:16:13.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.452+0000 7fc659060700 1 -- 172.21.15.117:0/4086466098 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc65410df30 con 0x7fc654102e00 2024-04-12T09:16:13.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.452+0000 7fc63b7fe700 1 -- 172.21.15.117:0/4086466098 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc64c01c810 con 0x7fc654102e00 2024-04-12T09:16:13.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.452+0000 7fc659060700 1 -- 172.21.15.117:0/4086466098 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc65410e4f0 con 0x7fc654102e00 2024-04-12T09:16:13.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.452+0000 7fc659060700 1 -- 172.21.15.117:0/4086466098 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc654100110 con 0x7fc654102e00 2024-04-12T09:16:13.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.453+0000 7fc63b7fe700 1 -- 172.21.15.117:0/4086466098 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 38) v1 ==== 91963+0+0 (secure 0 0 0) 0x7fc64c012c00 con 0x7fc654102e00 2024-04-12T09:16:13.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.453+0000 7fc63b7fe700 1 --2- 172.21.15.117:0/4086466098 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc63c06ddc0 0x7fc63c070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:13.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.453+0000 7fc63b7fe700 1 -- 172.21.15.117:0/4086466098 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc64c08f310 con 0x7fc654102e00 2024-04-12T09:16:13.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.453+0000 7fc65259c700 1 --2- 172.21.15.117:0/4086466098 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc63c06ddc0 0x7fc63c070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:13.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.454+0000 7fc65259c700 1 --2- 172.21.15.117:0/4086466098 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc63c06ddc0 0x7fc63c070270 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc648007fd0 tx=0x7fc648009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:13.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.458+0000 7fc63b7fe700 1 -- 172.21.15.117:0/4086466098 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc64c05c250 con 0x7fc654102e00 2024-04-12T09:16:13.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.740+0000 7fc659060700 1 -- 172.21.15.117:0/4086466098 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc65410f350 con 0x7fc654102e00 2024-04-12T09:16:13.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.740+0000 7fc63b7fe700 1 -- 172.21.15.117:0/4086466098 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7fc64c004e10 con 0x7fc654102e00 2024-04-12T09:16:13.741 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:16:13.741 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": { 2024-04-12T09:16:13.741 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:16:13.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:16:13.741 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": { 2024-04-12T09:16:13.741 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:16:13.741 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:16:13.742 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": { 2024-04-12T09:16:13.742 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 6 2024-04-12T09:16:13.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:16:13.742 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-04-12T09:16:13.742 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 4 2024-04-12T09:16:13.742 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:16:13.742 INFO:teuthology.orchestra.run.smithi117.stdout: "overall": { 2024-04-12T09:16:13.742 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 10, 2024-04-12T09:16:13.742 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 4 2024-04-12T09:16:13.742 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:16:13.742 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:16:13.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.742+0000 7fc659060700 1 -- 172.21.15.117:0/4086466098 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc63c06ddc0 msgr2=0x7fc63c070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:13.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.742+0000 7fc659060700 1 --2- 172.21.15.117:0/4086466098 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc63c06ddc0 0x7fc63c070270 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc648007fd0 tx=0x7fc648009040 comp rx=0 tx=0).stop 2024-04-12T09:16:13.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.743+0000 7fc659060700 1 -- 172.21.15.117:0/4086466098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc654102e00 msgr2=0x7fc654113d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:13.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.743+0000 7fc659060700 1 --2- 172.21.15.117:0/4086466098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc654102e00 0x7fc654113d00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc64c00be90 tx=0x7fc64c004d10 comp rx=0 tx=0).stop 2024-04-12T09:16:13.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.743+0000 7fc659060700 1 -- 172.21.15.117:0/4086466098 shutdown_connections 2024-04-12T09:16:13.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.743+0000 7fc659060700 1 --2- 172.21.15.117:0/4086466098 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc63c06ddc0 0x7fc63c070270 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:13.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.743+0000 7fc659060700 1 --2- 172.21.15.117:0/4086466098 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc654102e00 0x7fc654113d00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:13.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.743+0000 7fc659060700 1 --2- 172.21.15.117:0/4086466098 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6541037a0 0x7fc654114240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:13.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.743+0000 7fc659060700 1 -- 172.21.15.117:0/4086466098 >> 172.21.15.117:0/4086466098 conn(0x7fc6540f89b0 msgr2=0x7fc6541073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:13.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.743+0000 7fc659060700 1 -- 172.21.15.117:0/4086466098 shutdown_connections 2024-04-12T09:16:13.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.743+0000 7fc659060700 1 -- 172.21.15.117:0/4086466098 wait complete. 2024-04-12T09:16:13.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.844+0000 7f528a141700 1 -- 172.21.15.117:0/1257376533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5284102710 msgr2=0x7f52840fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:13.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.844+0000 7f528a141700 1 --2- 172.21.15.117:0/1257376533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5284102710 0x7f52840fbd80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f526c004940 tx=0x7f526c009e30 comp rx=0 tx=0).stop 2024-04-12T09:16:13.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.844+0000 7f528a141700 1 -- 172.21.15.117:0/1257376533 shutdown_connections 2024-04-12T09:16:13.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.844+0000 7f528a141700 1 --2- 172.21.15.117:0/1257376533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5284102710 0x7f52840fbd80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:13.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.844+0000 7f528a141700 1 --2- 172.21.15.117:0/1257376533 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5284101d70 0x7f5284102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:13.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.844+0000 7f528a141700 1 -- 172.21.15.117:0/1257376533 >> 172.21.15.117:0/1257376533 conn(0x7f5284072bc0 msgr2=0x7f5284072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:13.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.844+0000 7f528a141700 1 -- 172.21.15.117:0/1257376533 shutdown_connections 2024-04-12T09:16:13.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.844+0000 7f528a141700 1 -- 172.21.15.117:0/1257376533 wait complete. 2024-04-12T09:16:13.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.844+0000 7f528a141700 1 Processor -- start 2024-04-12T09:16:13.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.845+0000 7f528a141700 1 -- start start 2024-04-12T09:16:13.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.845+0000 7f528a141700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5284101d70 0x7f52840fd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:13.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.845+0000 7f528a141700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5284102710 0x7f52840fdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:13.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.845+0000 7f528a141700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52840fe4c0 con 0x7f5284102710 2024-04-12T09:16:13.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.845+0000 7f528a141700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52840fe600 con 0x7f5284101d70 2024-04-12T09:16:13.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.845+0000 7f527affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5284102710 0x7f52840fdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:13.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.845+0000 7f527affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5284102710 0x7f52840fdf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42526/0 (socket says 172.21.15.117:42526) 2024-04-12T09:16:13.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.845+0000 7f527affd700 1 -- 172.21.15.117:0/1202402342 learned_addr learned my addr 172.21.15.117:0/1202402342 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:16:13.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.845+0000 7f52837fe700 1 --2- 172.21.15.117:0/1202402342 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5284101d70 0x7f52840fd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:13.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.845+0000 7f527affd700 1 -- 172.21.15.117:0/1202402342 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5284101d70 msgr2=0x7f52840fd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:13.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.845+0000 7f527affd700 1 --2- 172.21.15.117:0/1202402342 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5284101d70 0x7f52840fd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:13.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.845+0000 7f527affd700 1 -- 172.21.15.117:0/1202402342 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526c005040 con 0x7f5284102710 2024-04-12T09:16:13.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.845+0000 7f527affd700 1 --2- 172.21.15.117:0/1202402342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5284102710 0x7f52840fdf30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f526c009100 tx=0x7f526c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:13.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.845+0000 7f5280ff9700 1 -- 172.21.15.117:0/1202402342 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f526c00e040 con 0x7f5284102710 2024-04-12T09:16:13.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.846+0000 7f528a141700 1 -- 172.21.15.117:0/1202402342 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52840fe850 con 0x7f5284102710 2024-04-12T09:16:13.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.846+0000 7f5280ff9700 1 -- 172.21.15.117:0/1202402342 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f526c013420 con 0x7f5284102710 2024-04-12T09:16:13.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.846+0000 7f5280ff9700 1 -- 172.21.15.117:0/1202402342 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f526c01c610 con 0x7f5284102710 2024-04-12T09:16:13.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.846+0000 7f528a141700 1 -- 172.21.15.117:0/1202402342 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f528411a2f0 con 0x7f5284102710 2024-04-12T09:16:13.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.846+0000 7f528a141700 1 -- 172.21.15.117:0/1202402342 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52840fd4c0 con 0x7f5284102710 2024-04-12T09:16:13.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.847+0000 7f5280ff9700 1 -- 172.21.15.117:0/1202402342 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 38) v1 ==== 91963+0+0 (secure 0 0 0) 0x7f526c013590 con 0x7f5284102710 2024-04-12T09:16:13.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.847+0000 7f5280ff9700 1 --2- 172.21.15.117:0/1202402342 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f527006ddc0 0x7f5270070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:13.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.847+0000 7f5280ff9700 1 -- 172.21.15.117:0/1202402342 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f526c08e9d0 con 0x7f5284102710 2024-04-12T09:16:13.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.848+0000 7f52837fe700 1 --2- 172.21.15.117:0/1202402342 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f527006ddc0 0x7f5270070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:13.850 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.848+0000 7f52837fe700 1 --2- 172.21.15.117:0/1202402342 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f527006ddc0 0x7f5270070270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5274004cc0 tx=0x7f527400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:13.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:13.852+0000 7f5280ff9700 1 -- 172.21.15.117:0/1202402342 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f526c057e60 con 0x7f5284102710 2024-04-12T09:16:14.094 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.093+0000 7f528a141700 1 -- 172.21.15.117:0/1202402342 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5284108e50 con 0x7f5284102710 2024-04-12T09:16:14.095 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:13 smithi117 ceph-mon[113571]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:16:14.095 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:13 smithi117 ceph-mon[113571]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:16:14.095 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:13 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/4086466098' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:16:14.095 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:13 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:14.095 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:13 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:14.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.094+0000 7f5280ff9700 1 -- 172.21.15.117:0/1202402342 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1884 (secure 0 0 0) 0x7f526c05b520 con 0x7f5284102710 2024-04-12T09:16:14.096 INFO:teuthology.orchestra.run.smithi117.stdout:e14 2024-04-12T09:16:14.096 INFO:teuthology.orchestra.run.smithi117.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T09:16:14.096 INFO:teuthology.orchestra.run.smithi117.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:16:14.096 INFO:teuthology.orchestra.run.smithi117.stdout:legacy client fscid: 1 2024-04-12T09:16:14.096 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:16:14.096 INFO:teuthology.orchestra.run.smithi117.stdout:Filesystem 'cephfs' (1) 2024-04-12T09:16:14.096 INFO:teuthology.orchestra.run.smithi117.stdout:fs_name cephfs 2024-04-12T09:16:14.096 INFO:teuthology.orchestra.run.smithi117.stdout:epoch 14 2024-04-12T09:16:14.096 INFO:teuthology.orchestra.run.smithi117.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T09:16:14.096 INFO:teuthology.orchestra.run.smithi117.stdout:created 2024-04-12T09:08:12.488144+0000 2024-04-12T09:16:14.096 INFO:teuthology.orchestra.run.smithi117.stdout:modified 2024-04-12T09:08:30.563184+0000 2024-04-12T09:16:14.096 INFO:teuthology.orchestra.run.smithi117.stdout:tableserver 0 2024-04-12T09:16:14.096 INFO:teuthology.orchestra.run.smithi117.stdout:root 0 2024-04-12T09:16:14.097 INFO:teuthology.orchestra.run.smithi117.stdout:session_timeout 60 2024-04-12T09:16:14.097 INFO:teuthology.orchestra.run.smithi117.stdout:session_autoclose 300 2024-04-12T09:16:14.097 INFO:teuthology.orchestra.run.smithi117.stdout:max_file_size 1099511627776 2024-04-12T09:16:14.097 INFO:teuthology.orchestra.run.smithi117.stdout:max_xattr_size 65536 2024-04-12T09:16:14.097 INFO:teuthology.orchestra.run.smithi117.stdout:required_client_features {} 2024-04-12T09:16:14.097 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure 0 2024-04-12T09:16:14.097 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure_osd_epoch 46 2024-04-12T09:16:14.097 INFO:teuthology.orchestra.run.smithi117.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:16:14.097 INFO:teuthology.orchestra.run.smithi117.stdout:max_mds 1 2024-04-12T09:16:14.097 INFO:teuthology.orchestra.run.smithi117.stdout:in 0 2024-04-12T09:16:14.097 INFO:teuthology.orchestra.run.smithi117.stdout:up {0=14474} 2024-04-12T09:16:14.097 INFO:teuthology.orchestra.run.smithi117.stdout:failed 2024-04-12T09:16:14.097 INFO:teuthology.orchestra.run.smithi117.stdout:damaged 2024-04-12T09:16:14.097 INFO:teuthology.orchestra.run.smithi117.stdout:stopped 2024-04-12T09:16:14.097 INFO:teuthology.orchestra.run.smithi117.stdout:data_pools [3] 2024-04-12T09:16:14.098 INFO:teuthology.orchestra.run.smithi117.stdout:metadata_pool 2 2024-04-12T09:16:14.098 INFO:teuthology.orchestra.run.smithi117.stdout:inline_data disabled 2024-04-12T09:16:14.098 INFO:teuthology.orchestra.run.smithi117.stdout:balancer 2024-04-12T09:16:14.098 INFO:teuthology.orchestra.run.smithi117.stdout:bal_rank_mask -1 2024-04-12T09:16:14.098 INFO:teuthology.orchestra.run.smithi117.stdout:standby_count_wanted 1 2024-04-12T09:16:14.098 INFO:teuthology.orchestra.run.smithi117.stdout:qdb_cluster leader: 0 members: 2024-04-12T09:16:14.098 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.eslmxh{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.117:6828/2248590199,v1:172.21.15.117:6829/2248590199] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:16:14.098 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:16:14.098 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:16:14.098 INFO:teuthology.orchestra.run.smithi117.stdout:Standby daemons: 2024-04-12T09:16:14.098 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:16:14.098 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.wddsgt{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/4010127141,v1:172.21.15.117:6827/4010127141] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:16:14.098 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.fbeixl{-1:24265} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.203:6824/840607003,v1:172.21.15.203:6825/840607003] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:16:14.098 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.bszhxz{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/2731911290,v1:172.21.15.203:6827/2731911290] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:16:14.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.096+0000 7f528a141700 1 -- 172.21.15.117:0/1202402342 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f527006ddc0 msgr2=0x7f5270070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:14.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.096+0000 7f528a141700 1 --2- 172.21.15.117:0/1202402342 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f527006ddc0 0x7f5270070270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5274004cc0 tx=0x7f527400b040 comp rx=0 tx=0).stop 2024-04-12T09:16:14.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.096+0000 7f528a141700 1 -- 172.21.15.117:0/1202402342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5284102710 msgr2=0x7f52840fdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:14.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.096+0000 7f528a141700 1 --2- 172.21.15.117:0/1202402342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5284102710 0x7f52840fdf30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f526c009100 tx=0x7f526c009e30 comp rx=0 tx=0).stop 2024-04-12T09:16:14.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.096+0000 7f528a141700 1 -- 172.21.15.117:0/1202402342 shutdown_connections 2024-04-12T09:16:14.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.096+0000 7f528a141700 1 --2- 172.21.15.117:0/1202402342 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5284101d70 0x7f52840fd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:14.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.096+0000 7f528a141700 1 --2- 172.21.15.117:0/1202402342 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f527006ddc0 0x7f5270070270 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:14.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.096+0000 7f528a141700 1 --2- 172.21.15.117:0/1202402342 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5284102710 0x7f52840fdf30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:14.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.096+0000 7f528a141700 1 -- 172.21.15.117:0/1202402342 >> 172.21.15.117:0/1202402342 conn(0x7f5284072bc0 msgr2=0x7f52840659a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:14.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.096+0000 7f528a141700 1 -- 172.21.15.117:0/1202402342 shutdown_connections 2024-04-12T09:16:14.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.096+0000 7f528a141700 1 -- 172.21.15.117:0/1202402342 wait complete. 2024-04-12T09:16:14.100 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 14 2024-04-12T09:16:14.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.198+0000 7ff0199ec700 1 -- 172.21.15.117:0/4209704248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff014070300 msgr2=0x7ff0140706d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:14.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.198+0000 7ff0199ec700 1 --2- 172.21.15.117:0/4209704248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff014070300 0x7ff0140706d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff004004970 tx=0x7ff004009e30 comp rx=0 tx=0).stop 2024-04-12T09:16:14.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.198+0000 7ff0199ec700 1 -- 172.21.15.117:0/4209704248 shutdown_connections 2024-04-12T09:16:14.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.198+0000 7ff0199ec700 1 --2- 172.21.15.117:0/4209704248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff014070c10 0x7ff014109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:14.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.198+0000 7ff0199ec700 1 --2- 172.21.15.117:0/4209704248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff014070300 0x7ff0140706d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:14.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.198+0000 7ff0199ec700 1 -- 172.21.15.117:0/4209704248 >> 172.21.15.117:0/4209704248 conn(0x7ff0140f89b0 msgr2=0x7ff0140fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:14.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.198+0000 7ff0199ec700 1 -- 172.21.15.117:0/4209704248 shutdown_connections 2024-04-12T09:16:14.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.198+0000 7ff0199ec700 1 -- 172.21.15.117:0/4209704248 wait complete. 2024-04-12T09:16:14.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.198+0000 7ff0199ec700 1 Processor -- start 2024-04-12T09:16:14.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.198+0000 7ff0199ec700 1 -- start start 2024-04-12T09:16:14.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.199+0000 7ff0199ec700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff014070300 0x7ff014115b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:14.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.199+0000 7ff0199ec700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff014070c10 0x7ff014116080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:14.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.199+0000 7ff0199ec700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0141166d0 con 0x7ff014070c10 2024-04-12T09:16:14.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.199+0000 7ff0199ec700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01410fcb0 con 0x7ff014070300 2024-04-12T09:16:14.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.199+0000 7ff00a7fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff014070c10 0x7ff014116080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:14.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.199+0000 7ff00a7fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff014070c10 0x7ff014116080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42546/0 (socket says 172.21.15.117:42546) 2024-04-12T09:16:14.201 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.199+0000 7ff00a7fc700 1 -- 172.21.15.117:0/1360256469 learned_addr learned my addr 172.21.15.117:0/1360256469 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:16:14.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.199+0000 7ff012ffd700 1 --2- 172.21.15.117:0/1360256469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff014070300 0x7ff014115b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:14.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.199+0000 7ff012ffd700 1 -- 172.21.15.117:0/1360256469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff014070300 msgr2=0x7ff014115b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-12T09:16:14.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.199+0000 7ff012ffd700 1 -- 172.21.15.117:0/1360256469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff014070300 msgr2=0x7ff014115b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-12T09:16:14.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.199+0000 7ff012ffd700 1 --2- 172.21.15.117:0/1360256469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff014070300 0x7ff014115b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-12T09:16:14.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.199+0000 7ff012ffd700 1 --2- 172.21.15.117:0/1360256469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff014070300 0x7ff014115b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T09:16:14.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.199+0000 7ff00a7fc700 1 -- 172.21.15.117:0/1360256469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff014070300 msgr2=0x7ff014115b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T09:16:14.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.199+0000 7ff00a7fc700 1 --2- 172.21.15.117:0/1360256469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff014070300 0x7ff014115b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:14.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.199+0000 7ff00a7fc700 1 -- 172.21.15.117:0/1360256469 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff004005040 con 0x7ff014070c10 2024-04-12T09:16:14.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.199+0000 7ff00a7fc700 1 --2- 172.21.15.117:0/1360256469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff014070c10 0x7ff014116080 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7feffc002a50 tx=0x7feffc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:14.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.199+0000 7ff00bfff700 1 -- 172.21.15.117:0/1360256469 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feffc007cc0 con 0x7ff014070c10 2024-04-12T09:16:14.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.199+0000 7ff0199ec700 1 -- 172.21.15.117:0/1360256469 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01410ff90 con 0x7ff014070c10 2024-04-12T09:16:14.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.199+0000 7ff00bfff700 1 -- 172.21.15.117:0/1360256469 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feffc00f040 con 0x7ff014070c10 2024-04-12T09:16:14.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.199+0000 7ff00bfff700 1 -- 172.21.15.117:0/1360256469 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feffc009640 con 0x7ff014070c10 2024-04-12T09:16:14.202 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.200+0000 7ff0199ec700 1 -- 172.21.15.117:0/1360256469 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0141104d0 con 0x7ff014070c10 2024-04-12T09:16:14.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.200+0000 7ff0199ec700 1 -- 172.21.15.117:0/1360256469 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff014071a40 con 0x7ff014070c10 2024-04-12T09:16:14.203 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.201+0000 7ff00bfff700 1 -- 172.21.15.117:0/1360256469 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 38) v1 ==== 91963+0+0 (secure 0 0 0) 0x7feffc0097a0 con 0x7ff014070c10 2024-04-12T09:16:14.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.201+0000 7ff00bfff700 1 --2- 172.21.15.117:0/1360256469 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff00006ddd0 0x7ff000070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:14.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.202+0000 7ff012ffd700 1 --2- 172.21.15.117:0/1360256469 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff00006ddd0 0x7ff000070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:14.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.202+0000 7ff00bfff700 1 -- 172.21.15.117:0/1360256469 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7feffc08d520 con 0x7ff014070c10 2024-04-12T09:16:14.204 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.202+0000 7ff012ffd700 1 --2- 172.21.15.117:0/1360256469 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff00006ddd0 0x7ff000070280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff004009fd0 tx=0x7ff004009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:14.207 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.206+0000 7ff00bfff700 1 -- 172.21.15.117:0/1360256469 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7feffc05a460 con 0x7ff014070c10 2024-04-12T09:16:14.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:13 smithi203 ceph-mon[86783]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:16:14.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:13 smithi203 ceph-mon[86783]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:16:14.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:13 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/4086466098' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:16:14.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:13 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:14.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:13 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:14.425 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.424+0000 7ff0199ec700 1 -- 172.21.15.117:0/1360256469 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff01410c160 con 0x7ff00006ddd0 2024-04-12T09:16:14.426 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.426+0000 7ff00bfff700 1 -- 172.21.15.117:0/1360256469 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7ff01410c160 con 0x7ff00006ddd0 2024-04-12T09:16:14.427 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:16:14.427 INFO:teuthology.orchestra.run.smithi117.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec", 2024-04-12T09:16:14.427 INFO:teuthology.orchestra.run.smithi117.stdout: "in_progress": true, 2024-04-12T09:16:14.427 INFO:teuthology.orchestra.run.smithi117.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T09:16:14.427 INFO:teuthology.orchestra.run.smithi117.stdout: "services_complete": [ 2024-04-12T09:16:14.427 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr", 2024-04-12T09:16:14.427 INFO:teuthology.orchestra.run.smithi117.stdout: "mon" 2024-04-12T09:16:14.427 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2024-04-12T09:16:14.427 INFO:teuthology.orchestra.run.smithi117.stdout: "progress": "4/21 daemons upgraded", 2024-04-12T09:16:14.427 INFO:teuthology.orchestra.run.smithi117.stdout: "message": "Currently upgrading mon daemons", 2024-04-12T09:16:14.427 INFO:teuthology.orchestra.run.smithi117.stdout: "is_paused": false 2024-04-12T09:16:14.427 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:16:14.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.428+0000 7ff0199ec700 1 -- 172.21.15.117:0/1360256469 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff00006ddd0 msgr2=0x7ff000070280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:14.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.428+0000 7ff0199ec700 1 --2- 172.21.15.117:0/1360256469 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff00006ddd0 0x7ff000070280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff004009fd0 tx=0x7ff004009e30 comp rx=0 tx=0).stop 2024-04-12T09:16:14.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.428+0000 7ff0199ec700 1 -- 172.21.15.117:0/1360256469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff014070c10 msgr2=0x7ff014116080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:14.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.428+0000 7ff0199ec700 1 --2- 172.21.15.117:0/1360256469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff014070c10 0x7ff014116080 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7feffc002a50 tx=0x7feffc0046b0 comp rx=0 tx=0).stop 2024-04-12T09:16:14.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.428+0000 7ff0199ec700 1 -- 172.21.15.117:0/1360256469 shutdown_connections 2024-04-12T09:16:14.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.428+0000 7ff0199ec700 1 --2- 172.21.15.117:0/1360256469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff014070300 0x7ff014115b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:14.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.428+0000 7ff0199ec700 1 --2- 172.21.15.117:0/1360256469 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff00006ddd0 0x7ff000070280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:14.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.428+0000 7ff0199ec700 1 --2- 172.21.15.117:0/1360256469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff014070c10 0x7ff014116080 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:14.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.428+0000 7ff0199ec700 1 -- 172.21.15.117:0/1360256469 >> 172.21.15.117:0/1360256469 conn(0x7ff0140f89b0 msgr2=0x7ff0140f9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:14.429 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.428+0000 7ff0199ec700 1 -- 172.21.15.117:0/1360256469 shutdown_connections 2024-04-12T09:16:14.430 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.428+0000 7ff0199ec700 1 -- 172.21.15.117:0/1360256469 wait complete. 2024-04-12T09:16:14.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.530+0000 7f0537d35700 1 -- 172.21.15.117:0/348364360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0530101d20 msgr2=0x7f05301020f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:14.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.530+0000 7f0537d35700 1 --2- 172.21.15.117:0/348364360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0530101d20 0x7f05301020f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f052c004940 tx=0x7f052c009e30 comp rx=0 tx=0).stop 2024-04-12T09:16:14.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.530+0000 7f0537d35700 1 -- 172.21.15.117:0/348364360 shutdown_connections 2024-04-12T09:16:14.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.530+0000 7f0537d35700 1 --2- 172.21.15.117:0/348364360 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05301026c0 0x7f05300fbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:14.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.530+0000 7f0537d35700 1 --2- 172.21.15.117:0/348364360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0530101d20 0x7f05301020f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:14.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.530+0000 7f0537d35700 1 -- 172.21.15.117:0/348364360 >> 172.21.15.117:0/348364360 conn(0x7f05300f78b0 msgr2=0x7f05300f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:14.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.530+0000 7f0537d35700 1 -- 172.21.15.117:0/348364360 shutdown_connections 2024-04-12T09:16:14.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.530+0000 7f0537d35700 1 -- 172.21.15.117:0/348364360 wait complete. 2024-04-12T09:16:14.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.530+0000 7f0537d35700 1 Processor -- start 2024-04-12T09:16:14.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.530+0000 7f0537d35700 1 -- start start 2024-04-12T09:16:14.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.530+0000 7f0537d35700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0530101d20 0x7f0530112890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:14.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.531+0000 7f0537d35700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05301026c0 0x7f0530112dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:14.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.531+0000 7f0537d35700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0530113420 con 0x7f0530101d20 2024-04-12T09:16:14.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.531+0000 7f0537d35700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053010ca20 con 0x7f05301026c0 2024-04-12T09:16:14.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.531+0000 7f0535ad1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0530101d20 0x7f0530112890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:14.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.531+0000 7f0535ad1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0530101d20 0x7f0530112890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42558/0 (socket says 172.21.15.117:42558) 2024-04-12T09:16:14.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.531+0000 7f0535ad1700 1 -- 172.21.15.117:0/1457322451 learned_addr learned my addr 172.21.15.117:0/1457322451 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:16:14.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.531+0000 7f05352d0700 1 --2- 172.21.15.117:0/1457322451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05301026c0 0x7f0530112dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:14.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.531+0000 7f05352d0700 1 -- 172.21.15.117:0/1457322451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05301026c0 msgr2=0x7f0530112dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-12T09:16:14.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.531+0000 7f05352d0700 1 -- 172.21.15.117:0/1457322451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05301026c0 msgr2=0x7f0530112dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-12T09:16:14.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.531+0000 7f05352d0700 1 --2- 172.21.15.117:0/1457322451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05301026c0 0x7f0530112dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-12T09:16:14.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.531+0000 7f0535ad1700 1 -- 172.21.15.117:0/1457322451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05301026c0 msgr2=0x7f0530112dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:14.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.531+0000 7f05352d0700 1 --2- 172.21.15.117:0/1457322451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05301026c0 0x7f0530112dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T09:16:14.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.531+0000 7f0535ad1700 1 --2- 172.21.15.117:0/1457322451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05301026c0 0x7f0530112dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:14.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.531+0000 7f0535ad1700 1 -- 172.21.15.117:0/1457322451 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c005040 con 0x7f0530101d20 2024-04-12T09:16:14.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.531+0000 7f0535ad1700 1 --2- 172.21.15.117:0/1457322451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0530101d20 0x7f0530112890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f052c00b3b0 tx=0x7f052c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:14.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.531+0000 7f05267fc700 1 -- 172.21.15.117:0/1457322451 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f052c00e040 con 0x7f0530101d20 2024-04-12T09:16:14.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.531+0000 7f05267fc700 1 -- 172.21.15.117:0/1457322451 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f052c00bbc0 con 0x7f0530101d20 2024-04-12T09:16:14.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.531+0000 7f0537d35700 1 -- 172.21.15.117:0/1457322451 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053010cca0 con 0x7f0530101d20 2024-04-12T09:16:14.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.531+0000 7f05267fc700 1 -- 172.21.15.117:0/1457322451 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f052c01c3f0 con 0x7f0530101d20 2024-04-12T09:16:14.534 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.531+0000 7f0537d35700 1 -- 172.21.15.117:0/1457322451 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053010d260 con 0x7f0530101d20 2024-04-12T09:16:14.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.532+0000 7f0537d35700 1 -- 172.21.15.117:0/1457322451 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05300fd470 con 0x7f0530101d20 2024-04-12T09:16:14.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.533+0000 7f05267fc700 1 -- 172.21.15.117:0/1457322451 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 38) v1 ==== 91963+0+0 (secure 0 0 0) 0x7f052c00bd30 con 0x7f0530101d20 2024-04-12T09:16:14.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.533+0000 7f05267fc700 1 --2- 172.21.15.117:0/1457322451 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f051c06ddd0 0x7f051c070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:14.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.533+0000 7f05267fc700 1 -- 172.21.15.117:0/1457322451 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f052c08ea00 con 0x7f0530101d20 2024-04-12T09:16:14.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.533+0000 7f05352d0700 1 --2- 172.21.15.117:0/1457322451 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f051c06ddd0 0x7f051c070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:14.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.534+0000 7f05352d0700 1 --2- 172.21.15.117:0/1457322451 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f051c06ddd0 0x7f051c070280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f053010dbe0 tx=0x7f0520009f70 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:14.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.538+0000 7f05267fc700 1 -- 172.21.15.117:0/1457322451 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f052c05b940 con 0x7f0530101d20 2024-04-12T09:16:14.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.824+0000 7f0537d35700 1 -- 172.21.15.117:0/1457322451 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f05300fd470 con 0x7f0530101d20 2024-04-12T09:16:14.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.824+0000 7f05267fc700 1 -- 172.21.15.117:0/1457322451 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f052c05b4d0 con 0x7f0530101d20 2024-04-12T09:16:14.825 INFO:teuthology.orchestra.run.smithi117.stdout:HEALTH_OK 2024-04-12T09:16:14.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.826+0000 7f0537d35700 1 -- 172.21.15.117:0/1457322451 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f051c06ddd0 msgr2=0x7f051c070280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:14.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.826+0000 7f0537d35700 1 --2- 172.21.15.117:0/1457322451 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f051c06ddd0 0x7f051c070280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f053010dbe0 tx=0x7f0520009f70 comp rx=0 tx=0).stop 2024-04-12T09:16:14.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.826+0000 7f0537d35700 1 -- 172.21.15.117:0/1457322451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0530101d20 msgr2=0x7f0530112890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:14.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.826+0000 7f0537d35700 1 --2- 172.21.15.117:0/1457322451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0530101d20 0x7f0530112890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f052c00b3b0 tx=0x7f052c009e30 comp rx=0 tx=0).stop 2024-04-12T09:16:14.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.826+0000 7f0537d35700 1 -- 172.21.15.117:0/1457322451 shutdown_connections 2024-04-12T09:16:14.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.826+0000 7f0537d35700 1 --2- 172.21.15.117:0/1457322451 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f051c06ddd0 0x7f051c070280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:14.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.826+0000 7f0537d35700 1 --2- 172.21.15.117:0/1457322451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0530101d20 0x7f0530112890 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:14.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.826+0000 7f0537d35700 1 --2- 172.21.15.117:0/1457322451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05301026c0 0x7f0530112dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:14.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.826+0000 7f0537d35700 1 -- 172.21.15.117:0/1457322451 >> 172.21.15.117:0/1457322451 conn(0x7f05300f78b0 msgr2=0x7f05300f8840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:14.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.826+0000 7f0537d35700 1 -- 172.21.15.117:0/1457322451 shutdown_connections 2024-04-12T09:16:14.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:14.826+0000 7f0537d35700 1 -- 172.21.15.117:0/1457322451 wait complete. 2024-04-12T09:16:15.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:14 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/1202402342' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:16:15.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:14 smithi117 ceph-mon[113571]: from='client.34148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:16:15.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:14 smithi117 ceph-mon[113571]: pgmap v13: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:15.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:14 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/1457322451' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:16:15.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:14 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:15.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:14 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:15.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:14 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/1202402342' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:16:15.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:14 smithi203 ceph-mon[86783]: from='client.34148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:16:15.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:14 smithi203 ceph-mon[86783]: pgmap v13: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:15.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:14 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/1457322451' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:16:15.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:14 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:15.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:14 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:17.907 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:17 smithi203 ceph-mon[86783]: pgmap v14: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:18.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:17 smithi117 ceph-mon[113571]: pgmap v14: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:19.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:19 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:19.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:19 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:19.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:19 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:19.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:19 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:16:19.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:19 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:19.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:19 smithi203 ceph-mon[86783]: Reconfiguring mon.smithi117 (monmap changed)... 2024-04-12T09:16:19.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:19 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T09:16:19.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:19 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-12T09:16:19.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:19 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:19.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:19 smithi203 ceph-mon[86783]: Reconfiguring daemon mon.smithi117 on smithi117 2024-04-12T09:16:19.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:19 smithi203 ceph-mon[86783]: pgmap v15: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:19.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:19 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:19.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:19 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:19.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:19 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:19.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:19 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:16:19.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:19 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:19.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:19 smithi117 ceph-mon[113571]: Reconfiguring mon.smithi117 (monmap changed)... 2024-04-12T09:16:19.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:19 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T09:16:19.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:19 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-12T09:16:19.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:19 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:19.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:19 smithi117 ceph-mon[113571]: Reconfiguring daemon mon.smithi117 on smithi117 2024-04-12T09:16:19.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:19 smithi117 ceph-mon[113571]: pgmap v15: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:21.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:21.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:21.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:20 smithi117 ceph-mon[113571]: Reconfiguring mgr.smithi117.oyaxql (monmap changed)... 2024-04-12T09:16:21.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi117.oyaxql", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T09:16:21.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T09:16:21.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:21.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:20 smithi117 ceph-mon[113571]: Reconfiguring daemon mgr.smithi117.oyaxql on smithi117 2024-04-12T09:16:21.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:20 smithi117 ceph-mon[113571]: pgmap v16: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:21.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:21.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:21.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:20 smithi203 ceph-mon[86783]: Reconfiguring mgr.smithi117.oyaxql (monmap changed)... 2024-04-12T09:16:21.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi117.oyaxql", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T09:16:21.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T09:16:21.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:21.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:20 smithi203 ceph-mon[86783]: Reconfiguring daemon mgr.smithi117.oyaxql on smithi117 2024-04-12T09:16:21.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:20 smithi203 ceph-mon[86783]: pgmap v16: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:22.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:22 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:22.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:22 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:22.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:22 smithi117 ceph-mon[113571]: Reconfiguring crash.smithi117 (monmap changed)... 2024-04-12T09:16:22.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:22 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi117", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T09:16:22.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:22 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:22.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:22 smithi117 ceph-mon[113571]: Reconfiguring daemon crash.smithi117 on smithi117 2024-04-12T09:16:23.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:22 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:23.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:22 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:23.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:22 smithi203 ceph-mon[86783]: Reconfiguring crash.smithi117 (monmap changed)... 2024-04-12T09:16:23.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:22 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi117", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T09:16:23.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:22 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:23.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:22 smithi203 ceph-mon[86783]: Reconfiguring daemon crash.smithi117 on smithi117 2024-04-12T09:16:23.856 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:23 smithi117 ceph-mon[113571]: pgmap v17: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:23.856 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:23 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:23.856 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:23 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:23.857 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:23 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-12T09:16:23.857 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:23 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:24.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:23 smithi203 ceph-mon[86783]: pgmap v17: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:24.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:23 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:24.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:23 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:24.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:23 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-12T09:16:24.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:23 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:24.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:24 smithi117 ceph-mon[113571]: Reconfiguring osd.0 (monmap changed)... 2024-04-12T09:16:24.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:24 smithi117 ceph-mon[113571]: Reconfiguring daemon osd.0 on smithi117 2024-04-12T09:16:25.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:24 smithi203 ceph-mon[86783]: Reconfiguring osd.0 (monmap changed)... 2024-04-12T09:16:25.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:24 smithi203 ceph-mon[86783]: Reconfiguring daemon osd.0 on smithi117 2024-04-12T09:16:25.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:25 smithi117 ceph-mon[113571]: pgmap v18: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:25.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:25 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:16:25.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:25 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:25.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:25 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:25.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:25 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-12T09:16:25.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:25 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:26.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:25 smithi203 ceph-mon[86783]: pgmap v18: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:26.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:25 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:16:26.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:25 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:26.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:25 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:26.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:25 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-12T09:16:26.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:25 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:26.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:26 smithi117 ceph-mon[113571]: Reconfiguring osd.1 (monmap changed)... 2024-04-12T09:16:26.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:26 smithi117 ceph-mon[113571]: Reconfiguring daemon osd.1 on smithi117 2024-04-12T09:16:27.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:26 smithi203 ceph-mon[86783]: Reconfiguring osd.1 (monmap changed)... 2024-04-12T09:16:27.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:26 smithi203 ceph-mon[86783]: Reconfiguring daemon osd.1 on smithi117 2024-04-12T09:16:27.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:27 smithi117 ceph-mon[113571]: pgmap v19: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:27.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:27 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:27.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:27 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:27.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:27 smithi117 ceph-mon[113571]: Reconfiguring osd.2 (monmap changed)... 2024-04-12T09:16:27.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:27 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-12T09:16:27.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:27 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:27.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:27 smithi117 ceph-mon[113571]: Reconfiguring daemon osd.2 on smithi117 2024-04-12T09:16:28.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:27 smithi203 ceph-mon[86783]: pgmap v19: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:27 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:27 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:27 smithi203 ceph-mon[86783]: Reconfiguring osd.2 (monmap changed)... 2024-04-12T09:16:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:27 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-12T09:16:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:27 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:27 smithi203 ceph-mon[86783]: Reconfiguring daemon osd.2 on smithi117 2024-04-12T09:16:29.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:29 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:29.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:29 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:29.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:29 smithi117 ceph-mon[113571]: Reconfiguring mds.cephfs.smithi117.wddsgt (monmap changed)... 2024-04-12T09:16:29.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:29 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.wddsgt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T09:16:29.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:29 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:29.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:29 smithi117 ceph-mon[113571]: Reconfiguring daemon mds.cephfs.smithi117.wddsgt on smithi117 2024-04-12T09:16:29.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:29 smithi117 ceph-mon[113571]: pgmap v20: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:29.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:29 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:29.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:29 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:29.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:29 smithi203 ceph-mon[86783]: Reconfiguring mds.cephfs.smithi117.wddsgt (monmap changed)... 2024-04-12T09:16:29.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:29 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.wddsgt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T09:16:29.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:29 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:29.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:29 smithi203 ceph-mon[86783]: Reconfiguring daemon mds.cephfs.smithi117.wddsgt on smithi117 2024-04-12T09:16:29.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:29 smithi203 ceph-mon[86783]: pgmap v20: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:31.400 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:31 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:31.400 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:31 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:31.400 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:31 smithi117 ceph-mon[113571]: Reconfiguring mds.cephfs.smithi117.eslmxh (monmap changed)... 2024-04-12T09:16:31.400 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:31 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.eslmxh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T09:16:31.401 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:31 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:31.401 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:31 smithi117 ceph-mon[113571]: Reconfiguring daemon mds.cephfs.smithi117.eslmxh on smithi117 2024-04-12T09:16:31.401 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:31 smithi117 ceph-mon[113571]: pgmap v21: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:31.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:31 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:31.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:31 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:31.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:31 smithi203 ceph-mon[86783]: Reconfiguring mds.cephfs.smithi117.eslmxh (monmap changed)... 2024-04-12T09:16:31.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:31 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.eslmxh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T09:16:31.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:31 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:31.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:31 smithi203 ceph-mon[86783]: Reconfiguring daemon mds.cephfs.smithi117.eslmxh on smithi117 2024-04-12T09:16:31.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:31 smithi203 ceph-mon[86783]: pgmap v21: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:33.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:32 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:33.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:32 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:33.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:32 smithi203 ceph-mon[86783]: Reconfiguring crash.smithi203 (monmap changed)... 2024-04-12T09:16:33.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:32 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi203", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T09:16:33.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:32 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:33.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:32 smithi203 ceph-mon[86783]: Reconfiguring daemon crash.smithi203 on smithi203 2024-04-12T09:16:33.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:32 smithi203 ceph-mon[86783]: pgmap v22: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:33.121 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:32 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:33.121 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:32 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:33.121 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:32 smithi117 ceph-mon[113571]: Reconfiguring crash.smithi203 (monmap changed)... 2024-04-12T09:16:33.121 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:32 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi203", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T09:16:33.121 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:32 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:33.121 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:32 smithi117 ceph-mon[113571]: Reconfiguring daemon crash.smithi203 on smithi203 2024-04-12T09:16:33.121 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:32 smithi117 ceph-mon[113571]: pgmap v22: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:34.752 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:34 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:34.752 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:34 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:34.753 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:34 smithi203 ceph-mon[86783]: Reconfiguring mgr.smithi203.apfqpo (monmap changed)... 2024-04-12T09:16:34.753 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:34 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi203.apfqpo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T09:16:34.753 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:34 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T09:16:34.753 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:34 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:34.753 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:34 smithi203 ceph-mon[86783]: Reconfiguring daemon mgr.smithi203.apfqpo on smithi203 2024-04-12T09:16:34.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:34 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:34.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:34 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:34.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:34 smithi117 ceph-mon[113571]: Reconfiguring mgr.smithi203.apfqpo (monmap changed)... 2024-04-12T09:16:34.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:34 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi203.apfqpo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-12T09:16:34.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:34 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-12T09:16:34.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:34 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:34.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:34 smithi117 ceph-mon[113571]: Reconfiguring daemon mgr.smithi203.apfqpo on smithi203 2024-04-12T09:16:35.724 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:35 smithi203 ceph-mon[86783]: pgmap v23: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:35.724 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:35 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:35.724 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:35 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:35.724 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:35 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T09:16:35.724 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:35 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-12T09:16:35.724 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:35 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:35.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:35 smithi117 ceph-mon[113571]: pgmap v23: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:35.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:35 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:35.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:35 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:35.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:35 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-12T09:16:35.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:35 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-12T09:16:35.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:35 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:36.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:36 smithi203 ceph-mon[86783]: Reconfiguring mon.smithi203 (monmap changed)... 2024-04-12T09:16:36.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:36 smithi203 ceph-mon[86783]: Reconfiguring daemon mon.smithi203 on smithi203 2024-04-12T09:16:36.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:36 smithi117 ceph-mon[113571]: Reconfiguring mon.smithi203 (monmap changed)... 2024-04-12T09:16:36.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:36 smithi117 ceph-mon[113571]: Reconfiguring daemon mon.smithi203 on smithi203 2024-04-12T09:16:38.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:37 smithi203 ceph-mon[86783]: pgmap v24: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:38.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:37 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:38.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:37 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:38.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:37 smithi203 ceph-mon[86783]: Reconfiguring osd.3 (monmap changed)... 2024-04-12T09:16:38.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:37 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-12T09:16:38.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:37 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:38.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:37 smithi203 ceph-mon[86783]: Reconfiguring daemon osd.3 on smithi203 2024-04-12T09:16:38.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:37 smithi117 ceph-mon[113571]: pgmap v24: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:38.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:37 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:38.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:37 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:38.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:37 smithi117 ceph-mon[113571]: Reconfiguring osd.3 (monmap changed)... 2024-04-12T09:16:38.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:37 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-12T09:16:38.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:37 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:38.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:37 smithi117 ceph-mon[113571]: Reconfiguring daemon osd.3 on smithi203 2024-04-12T09:16:39.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:39.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:39.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:39 smithi117 ceph-mon[113571]: Reconfiguring osd.4 (monmap changed)... 2024-04-12T09:16:39.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-12T09:16:39.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:39.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:39 smithi117 ceph-mon[113571]: Reconfiguring daemon osd.4 on smithi203 2024-04-12T09:16:39.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:39 smithi117 ceph-mon[113571]: pgmap v25: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:39.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:39.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:39.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:39 smithi203 ceph-mon[86783]: Reconfiguring osd.4 (monmap changed)... 2024-04-12T09:16:39.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-12T09:16:39.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:39.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:39 smithi203 ceph-mon[86783]: Reconfiguring daemon osd.4 on smithi203 2024-04-12T09:16:39.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:39 smithi203 ceph-mon[86783]: pgmap v25: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:40.608 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:40 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:16:40.608 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:40 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:40.608 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:40 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:40.608 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:40 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-12T09:16:40.608 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:40 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:40.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:40 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:16:40.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:40 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:40.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:40 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:40.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:40 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-12T09:16:40.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:40 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:41.611 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:41 smithi203 ceph-mon[86783]: Reconfiguring osd.5 (monmap changed)... 2024-04-12T09:16:41.611 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:41 smithi203 ceph-mon[86783]: Reconfiguring daemon osd.5 on smithi203 2024-04-12T09:16:41.611 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:41 smithi203 ceph-mon[86783]: pgmap v26: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:41.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:41 smithi117 ceph-mon[113571]: Reconfiguring osd.5 (monmap changed)... 2024-04-12T09:16:41.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:41 smithi117 ceph-mon[113571]: Reconfiguring daemon osd.5 on smithi203 2024-04-12T09:16:41.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:41 smithi117 ceph-mon[113571]: pgmap v26: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:42.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:42 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:42.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:42 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:42.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:42 smithi203 ceph-mon[86783]: Reconfiguring mds.cephfs.smithi203.fbeixl (monmap changed)... 2024-04-12T09:16:42.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:42 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.fbeixl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T09:16:42.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:42 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:42.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:42 smithi203 ceph-mon[86783]: Reconfiguring daemon mds.cephfs.smithi203.fbeixl on smithi203 2024-04-12T09:16:42.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:42 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:42.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:42 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:42.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:42 smithi117 ceph-mon[113571]: Reconfiguring mds.cephfs.smithi203.fbeixl (monmap changed)... 2024-04-12T09:16:42.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:42 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.fbeixl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T09:16:42.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:42 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:42.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:42 smithi117 ceph-mon[113571]: Reconfiguring daemon mds.cephfs.smithi203.fbeixl on smithi203 2024-04-12T09:16:43.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:43 smithi117 ceph-mon[113571]: pgmap v27: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:43.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:43 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:43.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:43 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:43.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:43 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.bszhxz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T09:16:43.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:43 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:43.952 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:43 smithi203 ceph-mon[86783]: pgmap v27: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:43.952 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:43 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:43.952 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:43 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:43.952 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:43 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.bszhxz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T09:16:43.952 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:43 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:44.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:44 smithi117 ceph-mon[113571]: Reconfiguring mds.cephfs.smithi203.bszhxz (monmap changed)... 2024-04-12T09:16:44.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:44 smithi117 ceph-mon[113571]: Reconfiguring daemon mds.cephfs.smithi203.bszhxz on smithi203 2024-04-12T09:16:44.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.949+0000 7f7bdaf35700 1 -- 172.21.15.117:0/2432341107 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd40fe7b0 msgr2=0x7f7bd4106df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:44.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.949+0000 7f7bdaf35700 1 --2- 172.21.15.117:0/2432341107 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd40fe7b0 0x7f7bd4106df0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0004940 tx=0x7f7bc0009e30 comp rx=0 tx=0).stop 2024-04-12T09:16:44.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.949+0000 7f7bdaf35700 1 -- 172.21.15.117:0/2432341107 shutdown_connections 2024-04-12T09:16:44.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.949+0000 7f7bdaf35700 1 --2- 172.21.15.117:0/2432341107 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd40fe7b0 0x7f7bd4106df0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:44.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.949+0000 7f7bdaf35700 1 --2- 172.21.15.117:0/2432341107 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7bd40fde10 0x7f7bd40fe1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:44.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.949+0000 7f7bdaf35700 1 -- 172.21.15.117:0/2432341107 >> 172.21.15.117:0/2432341107 conn(0x7f7bd40f7880 msgr2=0x7f7bd40f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:44.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.949+0000 7f7bdaf35700 1 -- 172.21.15.117:0/2432341107 shutdown_connections 2024-04-12T09:16:44.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.949+0000 7f7bdaf35700 1 -- 172.21.15.117:0/2432341107 wait complete. 2024-04-12T09:16:44.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.950+0000 7f7bdaf35700 1 Processor -- start 2024-04-12T09:16:44.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.950+0000 7f7bdaf35700 1 -- start start 2024-04-12T09:16:44.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.950+0000 7f7bdaf35700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd40fde10 0x7f7bd40fbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:44.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.950+0000 7f7bdaf35700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7bd40fe7b0 0x7f7bd40fc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:44.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.950+0000 7f7bdaf35700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd40fc710 con 0x7f7bd40fde10 2024-04-12T09:16:44.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.950+0000 7f7bdaf35700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd40fc850 con 0x7f7bd40fe7b0 2024-04-12T09:16:44.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.950+0000 7f7bd8cd1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd40fde10 0x7f7bd40fbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:44.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.951+0000 7f7bd8cd1700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd40fde10 0x7f7bd40fbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57948/0 (socket says 172.21.15.117:57948) 2024-04-12T09:16:44.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.951+0000 7f7bd8cd1700 1 -- 172.21.15.117:0/3240292895 learned_addr learned my addr 172.21.15.117:0/3240292895 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:16:44.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.951+0000 7f7bd3fff700 1 --2- 172.21.15.117:0/3240292895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7bd40fe7b0 0x7f7bd40fc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:44.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.951+0000 7f7bd8cd1700 1 -- 172.21.15.117:0/3240292895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7bd40fe7b0 msgr2=0x7f7bd40fc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:44.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.951+0000 7f7bd8cd1700 1 --2- 172.21.15.117:0/3240292895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7bd40fe7b0 0x7f7bd40fc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:44.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.951+0000 7f7bd8cd1700 1 -- 172.21.15.117:0/3240292895 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc0005040 con 0x7f7bd40fde10 2024-04-12T09:16:44.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.951+0000 7f7bd8cd1700 1 --2- 172.21.15.117:0/3240292895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd40fde10 0x7f7bd40fbc40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800c8c0 tx=0x7f7bc80044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:44.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.951+0000 7f7bd17fa700 1 -- 172.21.15.117:0/3240292895 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bc800a980 con 0x7f7bd40fde10 2024-04-12T09:16:44.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.951+0000 7f7bdaf35700 1 -- 172.21.15.117:0/3240292895 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd411a220 con 0x7f7bd40fde10 2024-04-12T09:16:44.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.951+0000 7f7bdaf35700 1 -- 172.21.15.117:0/3240292895 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd411a620 con 0x7f7bd40fde10 2024-04-12T09:16:44.954 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.951+0000 7f7bd17fa700 1 -- 172.21.15.117:0/3240292895 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7bc800ce60 con 0x7f7bd40fde10 2024-04-12T09:16:44.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.952+0000 7f7bd17fa700 1 -- 172.21.15.117:0/3240292895 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bc80115e0 con 0x7f7bd40fde10 2024-04-12T09:16:44.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.953+0000 7f7bdaf35700 1 -- 172.21.15.117:0/3240292895 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd4066770 con 0x7f7bd40fde10 2024-04-12T09:16:44.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.953+0000 7f7bd17fa700 1 -- 172.21.15.117:0/3240292895 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 38) v1 ==== 91963+0+0 (secure 0 0 0) 0x7f7bc8012400 con 0x7f7bd40fde10 2024-04-12T09:16:44.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.954+0000 7f7bd17fa700 1 --2- 172.21.15.117:0/3240292895 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f7bc406ddc0 0x7f7bc4070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:44.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.954+0000 7f7bd17fa700 1 -- 172.21.15.117:0/3240292895 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f7bc808d650 con 0x7f7bd40fde10 2024-04-12T09:16:44.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.954+0000 7f7bd3fff700 1 --2- 172.21.15.117:0/3240292895 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f7bc406ddc0 0x7f7bc4070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:44.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.954+0000 7f7bd3fff700 1 --2- 172.21.15.117:0/3240292895 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f7bc406ddc0 0x7f7bc4070270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40fd580 tx=0x7f7bc0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:44.959 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:44.959+0000 7f7bd17fa700 1 -- 172.21.15.117:0/3240292895 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f7bc8056c90 con 0x7f7bd40fde10 2024-04-12T09:16:45.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:44 smithi203 ceph-mon[86783]: Reconfiguring mds.cephfs.smithi203.bszhxz (monmap changed)... 2024-04-12T09:16:45.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:44 smithi203 ceph-mon[86783]: Reconfiguring daemon mds.cephfs.smithi203.bszhxz on smithi203 2024-04-12T09:16:45.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.181+0000 7f7bdaf35700 1 -- 172.21.15.117:0/3240292895 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7bd404bf00 con 0x7f7bc406ddc0 2024-04-12T09:16:45.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.183+0000 7f7bd17fa700 1 -- 172.21.15.117:0/3240292895 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f7bd404bf00 con 0x7f7bc406ddc0 2024-04-12T09:16:45.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.185+0000 7f7bdaf35700 1 -- 172.21.15.117:0/3240292895 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f7bc406ddc0 msgr2=0x7f7bc4070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:45.185 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.185+0000 7f7bdaf35700 1 --2- 172.21.15.117:0/3240292895 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f7bc406ddc0 0x7f7bc4070270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40fd580 tx=0x7f7bc0009e30 comp rx=0 tx=0).stop 2024-04-12T09:16:45.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.185+0000 7f7bdaf35700 1 -- 172.21.15.117:0/3240292895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd40fde10 msgr2=0x7f7bd40fbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:45.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.185+0000 7f7bdaf35700 1 --2- 172.21.15.117:0/3240292895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd40fde10 0x7f7bd40fbc40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800c8c0 tx=0x7f7bc80044c0 comp rx=0 tx=0).stop 2024-04-12T09:16:45.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.185+0000 7f7bdaf35700 1 -- 172.21.15.117:0/3240292895 shutdown_connections 2024-04-12T09:16:45.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.185+0000 7f7bdaf35700 1 --2- 172.21.15.117:0/3240292895 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f7bc406ddc0 0x7f7bc4070270 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:45.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.185+0000 7f7bdaf35700 1 --2- 172.21.15.117:0/3240292895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd40fde10 0x7f7bd40fbc40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:45.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.185+0000 7f7bdaf35700 1 --2- 172.21.15.117:0/3240292895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7bd40fe7b0 0x7f7bd40fc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:45.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.185+0000 7f7bdaf35700 1 -- 172.21.15.117:0/3240292895 >> 172.21.15.117:0/3240292895 conn(0x7f7bd40f7880 msgr2=0x7f7bd40f8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:45.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.185+0000 7f7bdaf35700 1 -- 172.21.15.117:0/3240292895 shutdown_connections 2024-04-12T09:16:45.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.185+0000 7f7bdaf35700 1 -- 172.21.15.117:0/3240292895 wait complete. 2024-04-12T09:16:45.196 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:16:45.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.290+0000 7f680b3c2700 1 -- 172.21.15.117:0/2722981591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68040fde90 msgr2=0x7f68040fe260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:45.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.290+0000 7f680b3c2700 1 --2- 172.21.15.117:0/2722981591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68040fde90 0x7f68040fe260 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6800004940 tx=0x7f6800009e30 comp rx=0 tx=0).stop 2024-04-12T09:16:45.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.290+0000 7f680b3c2700 1 -- 172.21.15.117:0/2722981591 shutdown_connections 2024-04-12T09:16:45.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.290+0000 7f680b3c2700 1 --2- 172.21.15.117:0/2722981591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68040fe830 0x7f6804106f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:45.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.290+0000 7f680b3c2700 1 --2- 172.21.15.117:0/2722981591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68040fde90 0x7f68040fe260 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:45.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.290+0000 7f680b3c2700 1 -- 172.21.15.117:0/2722981591 >> 172.21.15.117:0/2722981591 conn(0x7f6804072bc0 msgr2=0x7f6804072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:45.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.290+0000 7f680b3c2700 1 -- 172.21.15.117:0/2722981591 shutdown_connections 2024-04-12T09:16:45.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.290+0000 7f680b3c2700 1 -- 172.21.15.117:0/2722981591 wait complete. 2024-04-12T09:16:45.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.291+0000 7f680b3c2700 1 Processor -- start 2024-04-12T09:16:45.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.291+0000 7f680b3c2700 1 -- start start 2024-04-12T09:16:45.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.291+0000 7f680b3c2700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68040fde90 0x7f68040fbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:45.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.291+0000 7f680b3c2700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68040fe830 0x7f68040fc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:45.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.291+0000 7f680b3c2700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68040fc820 con 0x7f68040fde90 2024-04-12T09:16:45.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.291+0000 7f680b3c2700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68040fc960 con 0x7f68040fe830 2024-04-12T09:16:45.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.291+0000 7f680915e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68040fde90 0x7f68040fbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:45.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.291+0000 7f680915e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68040fde90 0x7f68040fbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57964/0 (socket says 172.21.15.117:57964) 2024-04-12T09:16:45.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.291+0000 7f680915e700 1 -- 172.21.15.117:0/3908902735 learned_addr learned my addr 172.21.15.117:0/3908902735 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:16:45.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.291+0000 7f680895d700 1 --2- 172.21.15.117:0/3908902735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68040fe830 0x7f68040fc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:45.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.291+0000 7f680915e700 1 -- 172.21.15.117:0/3908902735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68040fe830 msgr2=0x7f68040fc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:45.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.291+0000 7f680915e700 1 --2- 172.21.15.117:0/3908902735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68040fe830 0x7f68040fc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:45.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.291+0000 7f680915e700 1 -- 172.21.15.117:0/3908902735 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6800005040 con 0x7f68040fde90 2024-04-12T09:16:45.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.292+0000 7f680915e700 1 --2- 172.21.15.117:0/3908902735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68040fde90 0x7f68040fbd50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6800009360 tx=0x7f6800009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:45.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.292+0000 7f67f9ffb700 1 -- 172.21.15.117:0/3908902735 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f680000e040 con 0x7f68040fde90 2024-04-12T09:16:45.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.292+0000 7f67f9ffb700 1 -- 172.21.15.117:0/3908902735 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6800013420 con 0x7f68040fde90 2024-04-12T09:16:45.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.292+0000 7f680b3c2700 1 -- 172.21.15.117:0/3908902735 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68040fcbb0 con 0x7f68040fde90 2024-04-12T09:16:45.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.292+0000 7f67f9ffb700 1 -- 172.21.15.117:0/3908902735 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f680001c630 con 0x7f68040fde90 2024-04-12T09:16:45.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.292+0000 7f680b3c2700 1 -- 172.21.15.117:0/3908902735 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680411a280 con 0x7f68040fde90 2024-04-12T09:16:45.295 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.293+0000 7f680b3c2700 1 -- 172.21.15.117:0/3908902735 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6804065e30 con 0x7f68040fde90 2024-04-12T09:16:45.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.294+0000 7f67f9ffb700 1 -- 172.21.15.117:0/3908902735 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 38) v1 ==== 91963+0+0 (secure 0 0 0) 0x7f6800013a90 con 0x7f68040fde90 2024-04-12T09:16:45.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.294+0000 7f67f9ffb700 1 --2- 172.21.15.117:0/3908902735 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f67f006ddc0 0x7f67f0070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:45.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.294+0000 7f67f9ffb700 1 -- 172.21.15.117:0/3908902735 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f680008e880 con 0x7f68040fde90 2024-04-12T09:16:45.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.294+0000 7f680895d700 1 --2- 172.21.15.117:0/3908902735 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f67f006ddc0 0x7f67f0070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:45.296 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.295+0000 7f680895d700 1 --2- 172.21.15.117:0/3908902735 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f67f006ddc0 0x7f67f0070270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f68040fd690 tx=0x7f67f4009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:45.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.299+0000 7f67f9ffb700 1 -- 172.21.15.117:0/3908902735 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f6800057d10 con 0x7f68040fde90 2024-04-12T09:16:45.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.536+0000 7f680b3c2700 1 -- 172.21.15.117:0/3908902735 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f68040fd440 con 0x7f67f006ddc0 2024-04-12T09:16:45.538 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.538+0000 7f67f9ffb700 1 -- 172.21.15.117:0/3908902735 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f68040fd440 con 0x7f67f006ddc0 2024-04-12T09:16:45.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.540+0000 7f680b3c2700 1 -- 172.21.15.117:0/3908902735 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f67f006ddc0 msgr2=0x7f67f0070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:45.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.540+0000 7f680b3c2700 1 --2- 172.21.15.117:0/3908902735 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f67f006ddc0 0x7f67f0070270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f68040fd690 tx=0x7f67f4009040 comp rx=0 tx=0).stop 2024-04-12T09:16:45.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.540+0000 7f680b3c2700 1 -- 172.21.15.117:0/3908902735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68040fde90 msgr2=0x7f68040fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:45.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.540+0000 7f680b3c2700 1 --2- 172.21.15.117:0/3908902735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68040fde90 0x7f68040fbd50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6800009360 tx=0x7f6800009e30 comp rx=0 tx=0).stop 2024-04-12T09:16:45.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.540+0000 7f680b3c2700 1 -- 172.21.15.117:0/3908902735 shutdown_connections 2024-04-12T09:16:45.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.540+0000 7f680b3c2700 1 --2- 172.21.15.117:0/3908902735 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f67f006ddc0 0x7f67f0070270 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:45.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.540+0000 7f680b3c2700 1 --2- 172.21.15.117:0/3908902735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68040fde90 0x7f68040fbd50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:45.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.540+0000 7f680b3c2700 1 --2- 172.21.15.117:0/3908902735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68040fe830 0x7f68040fc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:45.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.540+0000 7f680b3c2700 1 -- 172.21.15.117:0/3908902735 >> 172.21.15.117:0/3908902735 conn(0x7f6804072bc0 msgr2=0x7f68040ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:45.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.540+0000 7f680b3c2700 1 -- 172.21.15.117:0/3908902735 shutdown_connections 2024-04-12T09:16:45.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.540+0000 7f680b3c2700 1 -- 172.21.15.117:0/3908902735 wait complete. 2024-04-12T09:16:45.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.643+0000 7f7c91eb5700 1 -- 172.21.15.117:0/2818097239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c8c102fd0 msgr2=0x7f7c8c1033a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:45.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.643+0000 7f7c91eb5700 1 --2- 172.21.15.117:0/2818097239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c8c102fd0 0x7f7c8c1033a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c004940 tx=0x7f7c7c009e30 comp rx=0 tx=0).stop 2024-04-12T09:16:45.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.643+0000 7f7c91eb5700 1 -- 172.21.15.117:0/2818097239 shutdown_connections 2024-04-12T09:16:45.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.643+0000 7f7c91eb5700 1 --2- 172.21.15.117:0/2818097239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c8c0fb540 0x7f7c8c0fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:45.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.643+0000 7f7c91eb5700 1 --2- 172.21.15.117:0/2818097239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c8c102fd0 0x7f7c8c1033a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:45.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.643+0000 7f7c91eb5700 1 -- 172.21.15.117:0/2818097239 >> 172.21.15.117:0/2818097239 conn(0x7f7c8c071530 msgr2=0x7f7c8c071930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:45.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.643+0000 7f7c91eb5700 1 -- 172.21.15.117:0/2818097239 shutdown_connections 2024-04-12T09:16:45.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.643+0000 7f7c91eb5700 1 -- 172.21.15.117:0/2818097239 wait complete. 2024-04-12T09:16:45.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.644+0000 7f7c91eb5700 1 Processor -- start 2024-04-12T09:16:45.645 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.644+0000 7f7c91eb5700 1 -- start start 2024-04-12T09:16:45.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.644+0000 7f7c91eb5700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c8c0fb540 0x7f7c8c1139a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:45.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.644+0000 7f7c91eb5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c8c102fd0 0x7f7c8c113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:45.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.644+0000 7f7c91eb5700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c1145c0 con 0x7f7c8c102fd0 2024-04-12T09:16:45.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.644+0000 7f7c91eb5700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c10dba0 con 0x7f7c8c0fb540 2024-04-12T09:16:45.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.644+0000 7f7c8affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c8c102fd0 0x7f7c8c113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:45.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.644+0000 7f7c8affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c8c102fd0 0x7f7c8c113ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57978/0 (socket says 172.21.15.117:57978) 2024-04-12T09:16:45.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.644+0000 7f7c8affd700 1 -- 172.21.15.117:0/1970206138 learned_addr learned my addr 172.21.15.117:0/1970206138 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:16:45.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.644+0000 7f7c8b7fe700 1 --2- 172.21.15.117:0/1970206138 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c8c0fb540 0x7f7c8c1139a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:45.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.645+0000 7f7c8affd700 1 -- 172.21.15.117:0/1970206138 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c8c0fb540 msgr2=0x7f7c8c1139a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:45.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.645+0000 7f7c8affd700 1 --2- 172.21.15.117:0/1970206138 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c8c0fb540 0x7f7c8c1139a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:45.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.645+0000 7f7c8affd700 1 -- 172.21.15.117:0/1970206138 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c005040 con 0x7f7c8c102fd0 2024-04-12T09:16:45.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.645+0000 7f7c8affd700 1 --2- 172.21.15.117:0/1970206138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c8c102fd0 0x7f7c8c113ee0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000b790 tx=0x7f7c80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:45.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.645+0000 7f7c73fff700 1 -- 172.21.15.117:0/1970206138 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c8000f6f0 con 0x7f7c8c102fd0 2024-04-12T09:16:45.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.645+0000 7f7c91eb5700 1 -- 172.21.15.117:0/1970206138 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c8c10de80 con 0x7f7c8c102fd0 2024-04-12T09:16:45.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.645+0000 7f7c91eb5700 1 -- 172.21.15.117:0/1970206138 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c8c10e3c0 con 0x7f7c8c102fd0 2024-04-12T09:16:45.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.645+0000 7f7c73fff700 1 -- 172.21.15.117:0/1970206138 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7c8000fd20 con 0x7f7c8c102fd0 2024-04-12T09:16:45.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.645+0000 7f7c73fff700 1 -- 172.21.15.117:0/1970206138 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c80011400 con 0x7f7c8c102fd0 2024-04-12T09:16:45.648 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.646+0000 7f7c91eb5700 1 -- 172.21.15.117:0/1970206138 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c8c100270 con 0x7f7c8c102fd0 2024-04-12T09:16:45.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.647+0000 7f7c73fff700 1 -- 172.21.15.117:0/1970206138 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 38) v1 ==== 91963+0+0 (secure 0 0 0) 0x7f7c8001a400 con 0x7f7c8c102fd0 2024-04-12T09:16:45.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.647+0000 7f7c73fff700 1 --2- 172.21.15.117:0/1970206138 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f7c7406ddd0 0x7f7c74070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:45.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.647+0000 7f7c8b7fe700 1 --2- 172.21.15.117:0/1970206138 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f7c7406ddd0 0x7f7c74070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:45.649 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.648+0000 7f7c8b7fe700 1 --2- 172.21.15.117:0/1970206138 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f7c7406ddd0 0x7f7c74070280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c004f90 tx=0x7f7c7c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:45.650 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.649+0000 7f7c73fff700 1 -- 172.21.15.117:0/1970206138 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f7c8000fe90 con 0x7f7c8c102fd0 2024-04-12T09:16:45.656 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.656+0000 7f7c73fff700 1 -- 172.21.15.117:0/1970206138 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f7c80056950 con 0x7f7c8c102fd0 2024-04-12T09:16:45.867 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.866+0000 7f7c91eb5700 1 -- 172.21.15.117:0/1970206138 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c8c10f060 con 0x7f7c7406ddd0 2024-04-12T09:16:45.867 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:45 smithi117 ceph-mon[113571]: pgmap v28: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:45.867 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:45 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:45.867 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:45 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:45.867 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:45 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:16:45.867 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:45 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:16:45.867 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:45 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:16:45.868 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:45 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:45.868 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:45 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi117"}]: dispatch 2024-04-12T09:16:45.868 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:45 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi117"}]': finished 2024-04-12T09:16:45.868 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:45 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi203"}]: dispatch 2024-04-12T09:16:45.868 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:45 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi203"}]': finished 2024-04-12T09:16:45.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.876+0000 7f7c73fff700 1 -- 172.21.15.117:0/1970206138 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f7c8c10f060 con 0x7f7c7406ddd0 2024-04-12T09:16:45.877 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:16:45.877 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 running (2m) 45s ago 13m 28.6M - 0.25.0 c8568f914cd2 204687f21ed7 2024-04-12T09:16:45.877 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (14m) 45s ago 14m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad 1e9f2c6a4491 2024-04-12T09:16:45.877 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (13m) 32s ago 13m 6656k - 17.2.7-827-gd3b5060a 21de9b7369ad e42da3f6e517 2024-04-12T09:16:45.877 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 running (2m) 45s ago 13m 75.1M - 9.4.12 2bacad6d85d8 a7b102216886 2024-04-12T09:16:45.877 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (8m) 45s ago 8m 141M - 17.2.7-827-gd3b5060a 21de9b7369ad de062e2c10e7 2024-04-12T09:16:45.877 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 running (8m) 45s ago 8m 14.0M - 17.2.7-827-gd3b5060a 21de9b7369ad 1e82c6241a18 2024-04-12T09:16:45.877 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (8m) 32s ago 8m 16.7M - 17.2.7-827-gd3b5060a 21de9b7369ad b05228e997f7 2024-04-12T09:16:45.877 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (8m) 32s ago 8m 16.9M - 17.2.7-827-gd3b5060a 21de9b7369ad 6d7f82c072c7 2024-04-12T09:16:45.877 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:8443,9283,8765 running (4m) 45s ago 15m 471M - 19.0.0-2053-gb277feb2 668895944f0e fee613d05ab7 2024-04-12T09:16:45.877 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283,8765 running (3m) 32s ago 12m 447M - 19.0.0-2053-gb277feb2 668895944f0e c793944c3e16 2024-04-12T09:16:45.877 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (59s) 45s ago 15m 29.8M 2048M 19.0.0-2053-gb277feb2 668895944f0e 6823aaff30ce 2024-04-12T09:16:45.877 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (35s) 32s ago 12m 25.4M 2048M 19.0.0-2053-gb277feb2 668895944f0e 006c6e487bfb 2024-04-12T09:16:45.877 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 running (3m) 45s ago 14m 15.7M - 1.5.0 0da6a335fe13 c692bed9f6c7 2024-04-12T09:16:45.878 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (3m) 32s ago 12m 15.3M - 1.5.0 0da6a335fe13 f3b5a470f545 2024-04-12T09:16:45.878 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (12m) 45s ago 12m 225M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 77040a2498f3 2024-04-12T09:16:45.878 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (11m) 45s ago 11m 236M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 8f9dbf0274ed 2024-04-12T09:16:45.878 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (11m) 45s ago 11m 201M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 339c5a80d1dd 2024-04-12T09:16:45.878 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (10m) 32s ago 10m 275M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad fb87d616bae3 2024-04-12T09:16:45.878 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (10m) 32s ago 10m 247M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad c873826a2dea 2024-04-12T09:16:45.878 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (10m) 32s ago 10m 221M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad 69cb7c22f002 2024-04-12T09:16:45.878 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 running (2m) 45s ago 13m 58.8M - 2.43.0 a07b618ecd1d 43ce588d82cc 2024-04-12T09:16:45.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.878+0000 7f7c91eb5700 1 -- 172.21.15.117:0/1970206138 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f7c7406ddd0 msgr2=0x7f7c74070280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:45.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.878+0000 7f7c91eb5700 1 --2- 172.21.15.117:0/1970206138 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f7c7406ddd0 0x7f7c74070280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c004f90 tx=0x7f7c7c009e30 comp rx=0 tx=0).stop 2024-04-12T09:16:45.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.878+0000 7f7c91eb5700 1 -- 172.21.15.117:0/1970206138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c8c102fd0 msgr2=0x7f7c8c113ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:45.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.878+0000 7f7c91eb5700 1 --2- 172.21.15.117:0/1970206138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c8c102fd0 0x7f7c8c113ee0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000b790 tx=0x7f7c80009250 comp rx=0 tx=0).stop 2024-04-12T09:16:45.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.878+0000 7f7c91eb5700 1 -- 172.21.15.117:0/1970206138 shutdown_connections 2024-04-12T09:16:45.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.878+0000 7f7c91eb5700 1 --2- 172.21.15.117:0/1970206138 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c8c0fb540 0x7f7c8c1139a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:45.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.878+0000 7f7c91eb5700 1 --2- 172.21.15.117:0/1970206138 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f7c7406ddd0 0x7f7c74070280 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:45.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.878+0000 7f7c91eb5700 1 --2- 172.21.15.117:0/1970206138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c8c102fd0 0x7f7c8c113ee0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:45.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.878+0000 7f7c91eb5700 1 -- 172.21.15.117:0/1970206138 >> 172.21.15.117:0/1970206138 conn(0x7f7c8c071530 msgr2=0x7f7c8c0fa690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:45.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.878+0000 7f7c91eb5700 1 -- 172.21.15.117:0/1970206138 shutdown_connections 2024-04-12T09:16:45.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.878+0000 7f7c91eb5700 1 -- 172.21.15.117:0/1970206138 wait complete. 2024-04-12T09:16:45.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.981+0000 7ffa45269700 1 -- 172.21.15.117:0/2213394186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa401026c0 msgr2=0x7ffa400fbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:45.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.981+0000 7ffa45269700 1 --2- 172.21.15.117:0/2213394186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa401026c0 0x7ffa400fbd30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffa28004940 tx=0x7ffa28009e30 comp rx=0 tx=0).stop 2024-04-12T09:16:45.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.981+0000 7ffa45269700 1 -- 172.21.15.117:0/2213394186 shutdown_connections 2024-04-12T09:16:45.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.981+0000 7ffa45269700 1 --2- 172.21.15.117:0/2213394186 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa401026c0 0x7ffa400fbd30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:45.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.981+0000 7ffa45269700 1 --2- 172.21.15.117:0/2213394186 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa40101d20 0x7ffa401020f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:45.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.981+0000 7ffa45269700 1 -- 172.21.15.117:0/2213394186 >> 172.21.15.117:0/2213394186 conn(0x7ffa400f7870 msgr2=0x7ffa400f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:45.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.981+0000 7ffa45269700 1 -- 172.21.15.117:0/2213394186 shutdown_connections 2024-04-12T09:16:45.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.981+0000 7ffa45269700 1 -- 172.21.15.117:0/2213394186 wait complete. 2024-04-12T09:16:45.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.981+0000 7ffa45269700 1 Processor -- start 2024-04-12T09:16:45.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.981+0000 7ffa45269700 1 -- start start 2024-04-12T09:16:45.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.982+0000 7ffa45269700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa40101d20 0x7ffa400fd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:45.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.982+0000 7ffa45269700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa401026c0 0x7ffa400fdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:45.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.982+0000 7ffa45269700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa400ff8f0 con 0x7ffa401026c0 2024-04-12T09:16:45.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.982+0000 7ffa45269700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa400fe420 con 0x7ffa40101d20 2024-04-12T09:16:45.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.982+0000 7ffa37fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa401026c0 0x7ffa400fdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:45.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.982+0000 7ffa37fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa401026c0 0x7ffa400fdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57984/0 (socket says 172.21.15.117:57984) 2024-04-12T09:16:45.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.982+0000 7ffa37fff700 1 -- 172.21.15.117:0/1649065686 learned_addr learned my addr 172.21.15.117:0/1649065686 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:16:45.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.982+0000 7ffa3effd700 1 --2- 172.21.15.117:0/1649065686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa40101d20 0x7ffa400fd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:45.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.982+0000 7ffa37fff700 1 -- 172.21.15.117:0/1649065686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa40101d20 msgr2=0x7ffa400fd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:45.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.982+0000 7ffa37fff700 1 --2- 172.21.15.117:0/1649065686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa40101d20 0x7ffa400fd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:45.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.982+0000 7ffa37fff700 1 -- 172.21.15.117:0/1649065686 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa28005040 con 0x7ffa401026c0 2024-04-12T09:16:45.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.982+0000 7ffa37fff700 1 --2- 172.21.15.117:0/1649065686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa401026c0 0x7ffa400fdee0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009100 tx=0x7ffa28009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:45.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.982+0000 7ffa377fe700 1 -- 172.21.15.117:0/1649065686 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa2800e040 con 0x7ffa401026c0 2024-04-12T09:16:45.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.982+0000 7ffa377fe700 1 -- 172.21.15.117:0/1649065686 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa28013420 con 0x7ffa401026c0 2024-04-12T09:16:45.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.982+0000 7ffa45269700 1 -- 172.21.15.117:0/1649065686 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa400fe6a0 con 0x7ffa401026c0 2024-04-12T09:16:45.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.982+0000 7ffa377fe700 1 -- 172.21.15.117:0/1649065686 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa2801c610 con 0x7ffa401026c0 2024-04-12T09:16:45.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.983+0000 7ffa45269700 1 -- 172.21.15.117:0/1649065686 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa4011a0e0 con 0x7ffa401026c0 2024-04-12T09:16:45.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.984+0000 7ffa45269700 1 -- 172.21.15.117:0/1649065686 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa400fd470 con 0x7ffa401026c0 2024-04-12T09:16:45.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.984+0000 7ffa377fe700 1 -- 172.21.15.117:0/1649065686 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 38) v1 ==== 91963+0+0 (secure 0 0 0) 0x7ffa28013590 con 0x7ffa401026c0 2024-04-12T09:16:45.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.984+0000 7ffa377fe700 1 --2- 172.21.15.117:0/1649065686 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ffa2c06ddd0 0x7ffa2c070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:45.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.984+0000 7ffa377fe700 1 -- 172.21.15.117:0/1649065686 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ffa2808e9f0 con 0x7ffa401026c0 2024-04-12T09:16:45.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.984+0000 7ffa3effd700 1 --2- 172.21.15.117:0/1649065686 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ffa2c06ddd0 0x7ffa2c070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:45.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.985+0000 7ffa3effd700 1 --2- 172.21.15.117:0/1649065686 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ffa2c06ddd0 0x7ffa2c070280 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffa300041d0 tx=0x7ffa30009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:45.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:45.989+0000 7ffa377fe700 1 -- 172.21.15.117:0/1649065686 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ffa28090e60 con 0x7ffa401026c0 2024-04-12T09:16:46.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:45 smithi203 ceph-mon[86783]: pgmap v28: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:46.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:45 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:46.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:45 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:46.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:45 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:16:46.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:45 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:16:46.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:45 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:16:46.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:45 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:46.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:45 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi117"}]: dispatch 2024-04-12T09:16:46.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:45 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi117"}]': finished 2024-04-12T09:16:46.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:45 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi203"}]: dispatch 2024-04-12T09:16:46.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:45 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi203"}]': finished 2024-04-12T09:16:46.270 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.269+0000 7ffa45269700 1 -- 172.21.15.117:0/1649065686 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffa4011a2d0 con 0x7ffa401026c0 2024-04-12T09:16:46.271 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.270+0000 7ffa377fe700 1 -- 172.21.15.117:0/1649065686 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7ffa28057e80 con 0x7ffa401026c0 2024-04-12T09:16:46.271 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:16:46.271 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": { 2024-04-12T09:16:46.271 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:16:46.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:16:46.271 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": { 2024-04-12T09:16:46.271 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:16:46.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:16:46.271 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": { 2024-04-12T09:16:46.271 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 6 2024-04-12T09:16:46.271 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:16:46.272 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-04-12T09:16:46.272 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 4 2024-04-12T09:16:46.272 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:16:46.272 INFO:teuthology.orchestra.run.smithi117.stdout: "overall": { 2024-04-12T09:16:46.272 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 10, 2024-04-12T09:16:46.272 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 4 2024-04-12T09:16:46.272 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:16:46.272 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:16:46.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.272+0000 7ffa45269700 1 -- 172.21.15.117:0/1649065686 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ffa2c06ddd0 msgr2=0x7ffa2c070280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:46.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.272+0000 7ffa45269700 1 --2- 172.21.15.117:0/1649065686 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ffa2c06ddd0 0x7ffa2c070280 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffa300041d0 tx=0x7ffa30009040 comp rx=0 tx=0).stop 2024-04-12T09:16:46.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.272+0000 7ffa45269700 1 -- 172.21.15.117:0/1649065686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa401026c0 msgr2=0x7ffa400fdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:46.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.272+0000 7ffa45269700 1 --2- 172.21.15.117:0/1649065686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa401026c0 0x7ffa400fdee0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009100 tx=0x7ffa28009e30 comp rx=0 tx=0).stop 2024-04-12T09:16:46.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.272+0000 7ffa45269700 1 -- 172.21.15.117:0/1649065686 shutdown_connections 2024-04-12T09:16:46.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.272+0000 7ffa45269700 1 --2- 172.21.15.117:0/1649065686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa40101d20 0x7ffa400fd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:46.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.272+0000 7ffa45269700 1 --2- 172.21.15.117:0/1649065686 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ffa2c06ddd0 0x7ffa2c070280 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:46.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.272+0000 7ffa45269700 1 --2- 172.21.15.117:0/1649065686 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa401026c0 0x7ffa400fdee0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:46.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.272+0000 7ffa45269700 1 -- 172.21.15.117:0/1649065686 >> 172.21.15.117:0/1649065686 conn(0x7ffa400f7870 msgr2=0x7ffa400f8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:46.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.272+0000 7ffa45269700 1 -- 172.21.15.117:0/1649065686 shutdown_connections 2024-04-12T09:16:46.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.272+0000 7ffa45269700 1 -- 172.21.15.117:0/1649065686 wait complete. 2024-04-12T09:16:46.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.372+0000 7fc4a4ec9700 1 -- 172.21.15.117:0/2500813469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a00fe7c0 msgr2=0x7fc4a0106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:46.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.372+0000 7fc4a4ec9700 1 --2- 172.21.15.117:0/2500813469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a00fe7c0 0x7fc4a0106e00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc494004940 tx=0x7fc494009e30 comp rx=0 tx=0).stop 2024-04-12T09:16:46.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.373+0000 7fc4a4ec9700 1 -- 172.21.15.117:0/2500813469 shutdown_connections 2024-04-12T09:16:46.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.373+0000 7fc4a4ec9700 1 --2- 172.21.15.117:0/2500813469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a00fe7c0 0x7fc4a0106e00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:46.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.373+0000 7fc4a4ec9700 1 --2- 172.21.15.117:0/2500813469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4a00fde20 0x7fc4a00fe1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:46.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.373+0000 7fc4a4ec9700 1 -- 172.21.15.117:0/2500813469 >> 172.21.15.117:0/2500813469 conn(0x7fc4a00f78d0 msgr2=0x7fc4a00f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:46.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.373+0000 7fc4a4ec9700 1 -- 172.21.15.117:0/2500813469 shutdown_connections 2024-04-12T09:16:46.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.373+0000 7fc4a4ec9700 1 -- 172.21.15.117:0/2500813469 wait complete. 2024-04-12T09:16:46.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.373+0000 7fc4a4ec9700 1 Processor -- start 2024-04-12T09:16:46.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.373+0000 7fc4a4ec9700 1 -- start start 2024-04-12T09:16:46.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.373+0000 7fc4a4ec9700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4a00fde20 0x7fc4a0115df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:46.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.373+0000 7fc4a4ec9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a00fe7c0 0x7fc4a0116330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:46.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.373+0000 7fc4a4ec9700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a0116980 con 0x7fc4a00fe7c0 2024-04-12T09:16:46.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.373+0000 7fc4a4ec9700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a010fd90 con 0x7fc4a00fde20 2024-04-12T09:16:46.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.373+0000 7fc49dd9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a00fe7c0 0x7fc4a0116330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:46.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.374+0000 7fc49dd9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a00fe7c0 0x7fc4a0116330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58010/0 (socket says 172.21.15.117:58010) 2024-04-12T09:16:46.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.374+0000 7fc49dd9b700 1 -- 172.21.15.117:0/3611563262 learned_addr learned my addr 172.21.15.117:0/3611563262 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:16:46.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.374+0000 7fc49e59c700 1 --2- 172.21.15.117:0/3611563262 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4a00fde20 0x7fc4a0115df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:46.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.374+0000 7fc49dd9b700 1 -- 172.21.15.117:0/3611563262 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4a00fde20 msgr2=0x7fc4a0115df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:46.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.374+0000 7fc49dd9b700 1 --2- 172.21.15.117:0/3611563262 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4a00fde20 0x7fc4a0115df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:46.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.374+0000 7fc49dd9b700 1 -- 172.21.15.117:0/3611563262 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc494005040 con 0x7fc4a00fe7c0 2024-04-12T09:16:46.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.374+0000 7fc49dd9b700 1 --2- 172.21.15.117:0/3611563262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a00fe7c0 0x7fc4a0116330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc494004890 tx=0x7fc494009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:46.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.374+0000 7fc48effd700 1 -- 172.21.15.117:0/3611563262 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc49400e040 con 0x7fc4a00fe7c0 2024-04-12T09:16:46.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.374+0000 7fc48effd700 1 -- 172.21.15.117:0/3611563262 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc494009af0 con 0x7fc4a00fe7c0 2024-04-12T09:16:46.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.374+0000 7fc48effd700 1 -- 172.21.15.117:0/3611563262 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc49401c3f0 con 0x7fc4a00fe7c0 2024-04-12T09:16:46.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.374+0000 7fc4a4ec9700 1 -- 172.21.15.117:0/3611563262 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a0110010 con 0x7fc4a00fe7c0 2024-04-12T09:16:46.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.374+0000 7fc4a4ec9700 1 -- 172.21.15.117:0/3611563262 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a0110550 con 0x7fc4a00fe7c0 2024-04-12T09:16:46.378 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.375+0000 7fc4a4ec9700 1 -- 172.21.15.117:0/3611563262 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a0066770 con 0x7fc4a00fe7c0 2024-04-12T09:16:46.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.376+0000 7fc48effd700 1 -- 172.21.15.117:0/3611563262 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 38) v1 ==== 91963+0+0 (secure 0 0 0) 0x7fc49400baf0 con 0x7fc4a00fe7c0 2024-04-12T09:16:46.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.376+0000 7fc48effd700 1 --2- 172.21.15.117:0/3611563262 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc48806ddc0 0x7fc488070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:46.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.376+0000 7fc48effd700 1 -- 172.21.15.117:0/3611563262 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc49408e9d0 con 0x7fc4a00fe7c0 2024-04-12T09:16:46.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.376+0000 7fc49e59c700 1 --2- 172.21.15.117:0/3611563262 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc48806ddc0 0x7fc488070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:46.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.376+0000 7fc49e59c700 1 --2- 172.21.15.117:0/3611563262 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc48806ddc0 0x7fc488070270 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc490007fd0 tx=0x7fc490009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:46.381 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.381+0000 7fc48effd700 1 -- 172.21.15.117:0/3611563262 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc494057de0 con 0x7fc4a00fe7c0 2024-04-12T09:16:46.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.625+0000 7fc4a4ec9700 1 -- 172.21.15.117:0/3611563262 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc4a01101a0 con 0x7fc4a00fe7c0 2024-04-12T09:16:46.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.625+0000 7fc48effd700 1 -- 172.21.15.117:0/3611563262 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1884 (secure 0 0 0) 0x7fc4a01101a0 con 0x7fc4a00fe7c0 2024-04-12T09:16:46.626 INFO:teuthology.orchestra.run.smithi117.stdout:e14 2024-04-12T09:16:46.626 INFO:teuthology.orchestra.run.smithi117.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T09:16:46.626 INFO:teuthology.orchestra.run.smithi117.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:16:46.626 INFO:teuthology.orchestra.run.smithi117.stdout:legacy client fscid: 1 2024-04-12T09:16:46.626 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:16:46.626 INFO:teuthology.orchestra.run.smithi117.stdout:Filesystem 'cephfs' (1) 2024-04-12T09:16:46.626 INFO:teuthology.orchestra.run.smithi117.stdout:fs_name cephfs 2024-04-12T09:16:46.626 INFO:teuthology.orchestra.run.smithi117.stdout:epoch 14 2024-04-12T09:16:46.627 INFO:teuthology.orchestra.run.smithi117.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T09:16:46.627 INFO:teuthology.orchestra.run.smithi117.stdout:created 2024-04-12T09:08:12.488144+0000 2024-04-12T09:16:46.627 INFO:teuthology.orchestra.run.smithi117.stdout:modified 2024-04-12T09:08:30.563184+0000 2024-04-12T09:16:46.627 INFO:teuthology.orchestra.run.smithi117.stdout:tableserver 0 2024-04-12T09:16:46.627 INFO:teuthology.orchestra.run.smithi117.stdout:root 0 2024-04-12T09:16:46.627 INFO:teuthology.orchestra.run.smithi117.stdout:session_timeout 60 2024-04-12T09:16:46.627 INFO:teuthology.orchestra.run.smithi117.stdout:session_autoclose 300 2024-04-12T09:16:46.627 INFO:teuthology.orchestra.run.smithi117.stdout:max_file_size 1099511627776 2024-04-12T09:16:46.627 INFO:teuthology.orchestra.run.smithi117.stdout:max_xattr_size 65536 2024-04-12T09:16:46.627 INFO:teuthology.orchestra.run.smithi117.stdout:required_client_features {} 2024-04-12T09:16:46.627 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure 0 2024-04-12T09:16:46.627 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure_osd_epoch 46 2024-04-12T09:16:46.627 INFO:teuthology.orchestra.run.smithi117.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:16:46.627 INFO:teuthology.orchestra.run.smithi117.stdout:max_mds 1 2024-04-12T09:16:46.628 INFO:teuthology.orchestra.run.smithi117.stdout:in 0 2024-04-12T09:16:46.628 INFO:teuthology.orchestra.run.smithi117.stdout:up {0=14474} 2024-04-12T09:16:46.628 INFO:teuthology.orchestra.run.smithi117.stdout:failed 2024-04-12T09:16:46.628 INFO:teuthology.orchestra.run.smithi117.stdout:damaged 2024-04-12T09:16:46.628 INFO:teuthology.orchestra.run.smithi117.stdout:stopped 2024-04-12T09:16:46.628 INFO:teuthology.orchestra.run.smithi117.stdout:data_pools [3] 2024-04-12T09:16:46.628 INFO:teuthology.orchestra.run.smithi117.stdout:metadata_pool 2 2024-04-12T09:16:46.628 INFO:teuthology.orchestra.run.smithi117.stdout:inline_data disabled 2024-04-12T09:16:46.628 INFO:teuthology.orchestra.run.smithi117.stdout:balancer 2024-04-12T09:16:46.628 INFO:teuthology.orchestra.run.smithi117.stdout:bal_rank_mask -1 2024-04-12T09:16:46.628 INFO:teuthology.orchestra.run.smithi117.stdout:standby_count_wanted 1 2024-04-12T09:16:46.628 INFO:teuthology.orchestra.run.smithi117.stdout:qdb_cluster leader: 0 members: 2024-04-12T09:16:46.628 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.eslmxh{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.117:6828/2248590199,v1:172.21.15.117:6829/2248590199] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:16:46.628 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:16:46.629 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:16:46.629 INFO:teuthology.orchestra.run.smithi117.stdout:Standby daemons: 2024-04-12T09:16:46.629 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:16:46.629 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.wddsgt{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/4010127141,v1:172.21.15.117:6827/4010127141] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:16:46.629 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.fbeixl{-1:24265} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.203:6824/840607003,v1:172.21.15.203:6825/840607003] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:16:46.629 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.bszhxz{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/2731911290,v1:172.21.15.203:6827/2731911290] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:16:46.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.628+0000 7fc4a4ec9700 1 -- 172.21.15.117:0/3611563262 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc48806ddc0 msgr2=0x7fc488070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:46.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.628+0000 7fc4a4ec9700 1 --2- 172.21.15.117:0/3611563262 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc48806ddc0 0x7fc488070270 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc490007fd0 tx=0x7fc490009040 comp rx=0 tx=0).stop 2024-04-12T09:16:46.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.628+0000 7fc4a4ec9700 1 -- 172.21.15.117:0/3611563262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a00fe7c0 msgr2=0x7fc4a0116330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:46.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.628+0000 7fc4a4ec9700 1 --2- 172.21.15.117:0/3611563262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a00fe7c0 0x7fc4a0116330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc494004890 tx=0x7fc494009e30 comp rx=0 tx=0).stop 2024-04-12T09:16:46.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.628+0000 7fc4a4ec9700 1 -- 172.21.15.117:0/3611563262 shutdown_connections 2024-04-12T09:16:46.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.628+0000 7fc4a4ec9700 1 --2- 172.21.15.117:0/3611563262 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4a00fde20 0x7fc4a0115df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:46.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.628+0000 7fc4a4ec9700 1 --2- 172.21.15.117:0/3611563262 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc48806ddc0 0x7fc488070270 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:46.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.628+0000 7fc4a4ec9700 1 --2- 172.21.15.117:0/3611563262 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4a00fe7c0 0x7fc4a0116330 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:46.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.628+0000 7fc4a4ec9700 1 -- 172.21.15.117:0/3611563262 >> 172.21.15.117:0/3611563262 conn(0x7fc4a00f78d0 msgr2=0x7fc4a00f8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:46.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.628+0000 7fc4a4ec9700 1 -- 172.21.15.117:0/3611563262 shutdown_connections 2024-04-12T09:16:46.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.628+0000 7fc4a4ec9700 1 -- 172.21.15.117:0/3611563262 wait complete. 2024-04-12T09:16:46.631 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 14 2024-04-12T09:16:46.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.736+0000 7f9e42ef7700 1 -- 172.21.15.117:0/360884136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e3c1037c0 msgr2=0x7f9e3c0fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:46.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.736+0000 7f9e42ef7700 1 --2- 172.21.15.117:0/360884136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e3c1037c0 0x7f9e3c0fce30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9e28004940 tx=0x7f9e28009e30 comp rx=0 tx=0).stop 2024-04-12T09:16:46.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.736+0000 7f9e42ef7700 1 -- 172.21.15.117:0/360884136 shutdown_connections 2024-04-12T09:16:46.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.736+0000 7f9e42ef7700 1 --2- 172.21.15.117:0/360884136 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e3c1037c0 0x7f9e3c0fce30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:46.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.736+0000 7f9e42ef7700 1 --2- 172.21.15.117:0/360884136 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e3c102e20 0x7f9e3c1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:46.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.736+0000 7f9e42ef7700 1 -- 172.21.15.117:0/360884136 >> 172.21.15.117:0/360884136 conn(0x7f9e3c0f89d0 msgr2=0x7f9e3c0fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:46.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.736+0000 7f9e42ef7700 1 -- 172.21.15.117:0/360884136 shutdown_connections 2024-04-12T09:16:46.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.737+0000 7f9e42ef7700 1 -- 172.21.15.117:0/360884136 wait complete. 2024-04-12T09:16:46.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.737+0000 7f9e42ef7700 1 Processor -- start 2024-04-12T09:16:46.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.737+0000 7f9e42ef7700 1 -- start start 2024-04-12T09:16:46.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.737+0000 7f9e42ef7700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e3c102e20 0x7f9e3c115dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:46.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.737+0000 7f9e42ef7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e3c1037c0 0x7f9e3c116300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:46.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.737+0000 7f9e42ef7700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c116950 con 0x7f9e3c1037c0 2024-04-12T09:16:46.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.737+0000 7f9e42ef7700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c10fd20 con 0x7f9e3c102e20 2024-04-12T09:16:46.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.738+0000 7f9e3bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e3c1037c0 0x7f9e3c116300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:46.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.738+0000 7f9e3bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e3c1037c0 0x7f9e3c116300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58014/0 (socket says 172.21.15.117:58014) 2024-04-12T09:16:46.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.738+0000 7f9e3bfff700 1 -- 172.21.15.117:0/170358987 learned_addr learned my addr 172.21.15.117:0/170358987 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:16:46.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.738+0000 7f9e40c93700 1 --2- 172.21.15.117:0/170358987 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e3c102e20 0x7f9e3c115dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:46.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.738+0000 7f9e3bfff700 1 -- 172.21.15.117:0/170358987 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e3c102e20 msgr2=0x7f9e3c115dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:46.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.738+0000 7f9e3bfff700 1 --2- 172.21.15.117:0/170358987 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e3c102e20 0x7f9e3c115dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:46.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.738+0000 7f9e3bfff700 1 -- 172.21.15.117:0/170358987 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e28005040 con 0x7f9e3c1037c0 2024-04-12T09:16:46.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.738+0000 7f9e40c93700 1 --2- 172.21.15.117:0/170358987 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e3c102e20 0x7f9e3c115dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T09:16:46.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.738+0000 7f9e3bfff700 1 --2- 172.21.15.117:0/170358987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e3c1037c0 0x7f9e3c116300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9e28009100 tx=0x7f9e28009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:46.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.738+0000 7f9e397fa700 1 -- 172.21.15.117:0/170358987 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e2800e040 con 0x7f9e3c1037c0 2024-04-12T09:16:46.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.738+0000 7f9e42ef7700 1 -- 172.21.15.117:0/170358987 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3c10ffa0 con 0x7f9e3c1037c0 2024-04-12T09:16:46.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.738+0000 7f9e397fa700 1 -- 172.21.15.117:0/170358987 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e28013420 con 0x7f9e3c1037c0 2024-04-12T09:16:46.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.738+0000 7f9e397fa700 1 -- 172.21.15.117:0/170358987 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e2801c610 con 0x7f9e3c1037c0 2024-04-12T09:16:46.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.738+0000 7f9e42ef7700 1 -- 172.21.15.117:0/170358987 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3c110560 con 0x7f9e3c1037c0 2024-04-12T09:16:46.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.739+0000 7f9e42ef7700 1 -- 172.21.15.117:0/170358987 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e3c102140 con 0x7f9e3c1037c0 2024-04-12T09:16:46.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.740+0000 7f9e397fa700 1 -- 172.21.15.117:0/170358987 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 38) v1 ==== 91963+0+0 (secure 0 0 0) 0x7f9e2800baf0 con 0x7f9e3c1037c0 2024-04-12T09:16:46.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.740+0000 7f9e397fa700 1 --2- 172.21.15.117:0/170358987 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f9e2c06ddc0 0x7f9e2c070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:46.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.741+0000 7f9e397fa700 1 -- 172.21.15.117:0/170358987 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f9e2808e990 con 0x7f9e3c1037c0 2024-04-12T09:16:46.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.741+0000 7f9e40c93700 1 --2- 172.21.15.117:0/170358987 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f9e2c06ddc0 0x7f9e2c070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:46.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.741+0000 7f9e40c93700 1 --2- 172.21.15.117:0/170358987 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f9e2c06ddc0 0x7f9e2c070270 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9e30009fd0 tx=0x7f9e30009e50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:46.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.745+0000 7f9e397fa700 1 -- 172.21.15.117:0/170358987 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f9e2805b950 con 0x7f9e3c1037c0 2024-04-12T09:16:46.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:46 smithi117 ceph-mon[113571]: Upgrade: Setting container_image for all mon 2024-04-12T09:16:46.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:46 smithi117 ceph-mon[113571]: from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:16:46.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:46 smithi117 ceph-mon[113571]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:16:46.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:46 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/1649065686' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:16:46.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:46 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/3611563262' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:16:46.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.965+0000 7f9e42ef7700 1 -- 172.21.15.117:0/170358987 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e3c111480 con 0x7f9e2c06ddc0 2024-04-12T09:16:46.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.966+0000 7f9e397fa700 1 -- 172.21.15.117:0/170358987 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f9e3c111480 con 0x7f9e2c06ddc0 2024-04-12T09:16:46.967 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:16:46.967 INFO:teuthology.orchestra.run.smithi117.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec", 2024-04-12T09:16:46.967 INFO:teuthology.orchestra.run.smithi117.stdout: "in_progress": true, 2024-04-12T09:16:46.967 INFO:teuthology.orchestra.run.smithi117.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T09:16:46.967 INFO:teuthology.orchestra.run.smithi117.stdout: "services_complete": [ 2024-04-12T09:16:46.967 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr", 2024-04-12T09:16:46.967 INFO:teuthology.orchestra.run.smithi117.stdout: "mon" 2024-04-12T09:16:46.968 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2024-04-12T09:16:46.968 INFO:teuthology.orchestra.run.smithi117.stdout: "progress": "4/21 daemons upgraded", 2024-04-12T09:16:46.968 INFO:teuthology.orchestra.run.smithi117.stdout: "message": "Currently upgrading crash daemons", 2024-04-12T09:16:46.968 INFO:teuthology.orchestra.run.smithi117.stdout: "is_paused": false 2024-04-12T09:16:46.968 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:16:46.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.968+0000 7f9e42ef7700 1 -- 172.21.15.117:0/170358987 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f9e2c06ddc0 msgr2=0x7f9e2c070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:46.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.968+0000 7f9e42ef7700 1 --2- 172.21.15.117:0/170358987 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f9e2c06ddc0 0x7f9e2c070270 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9e30009fd0 tx=0x7f9e30009e50 comp rx=0 tx=0).stop 2024-04-12T09:16:46.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.968+0000 7f9e42ef7700 1 -- 172.21.15.117:0/170358987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e3c1037c0 msgr2=0x7f9e3c116300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:46.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.968+0000 7f9e42ef7700 1 --2- 172.21.15.117:0/170358987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e3c1037c0 0x7f9e3c116300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9e28009100 tx=0x7f9e28009e30 comp rx=0 tx=0).stop 2024-04-12T09:16:46.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.968+0000 7f9e42ef7700 1 -- 172.21.15.117:0/170358987 shutdown_connections 2024-04-12T09:16:46.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.968+0000 7f9e42ef7700 1 --2- 172.21.15.117:0/170358987 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e3c102e20 0x7f9e3c115dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:46.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.968+0000 7f9e42ef7700 1 --2- 172.21.15.117:0/170358987 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f9e2c06ddc0 0x7f9e2c070270 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:46.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.968+0000 7f9e42ef7700 1 --2- 172.21.15.117:0/170358987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e3c1037c0 0x7f9e3c116300 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:46.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.968+0000 7f9e42ef7700 1 -- 172.21.15.117:0/170358987 >> 172.21.15.117:0/170358987 conn(0x7f9e3c0f89d0 msgr2=0x7f9e3c0fa630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:46.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.969+0000 7f9e42ef7700 1 -- 172.21.15.117:0/170358987 shutdown_connections 2024-04-12T09:16:46.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:46.969+0000 7f9e42ef7700 1 -- 172.21.15.117:0/170358987 wait complete. 2024-04-12T09:16:47.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.072+0000 7f35ccd91700 1 -- 172.21.15.117:0/2652855797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35c81026a0 msgr2=0x7f35c80fbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:47.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.072+0000 7f35ccd91700 1 --2- 172.21.15.117:0/2652855797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35c81026a0 0x7f35c80fbd10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f35bc004940 tx=0x7f35bc009e30 comp rx=0 tx=0).stop 2024-04-12T09:16:47.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.072+0000 7f35ccd91700 1 -- 172.21.15.117:0/2652855797 shutdown_connections 2024-04-12T09:16:47.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.072+0000 7f35ccd91700 1 --2- 172.21.15.117:0/2652855797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35c81026a0 0x7f35c80fbd10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:47.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.072+0000 7f35ccd91700 1 --2- 172.21.15.117:0/2652855797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35c8101d00 0x7f35c81020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:47.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.072+0000 7f35ccd91700 1 -- 172.21.15.117:0/2652855797 >> 172.21.15.117:0/2652855797 conn(0x7f35c80f78d0 msgr2=0x7f35c80f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:47.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.072+0000 7f35ccd91700 1 -- 172.21.15.117:0/2652855797 shutdown_connections 2024-04-12T09:16:47.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.072+0000 7f35ccd91700 1 -- 172.21.15.117:0/2652855797 wait complete. 2024-04-12T09:16:47.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.072+0000 7f35ccd91700 1 Processor -- start 2024-04-12T09:16:47.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.072+0000 7f35ccd91700 1 -- start start 2024-04-12T09:16:47.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.072+0000 7f35ccd91700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35c8101d00 0x7f35c8112ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:47.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.072+0000 7f35ccd91700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35c81026a0 0x7f35c8113000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:47.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.072+0000 7f35ccd91700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c8113650 con 0x7f35c81026a0 2024-04-12T09:16:47.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.073+0000 7f35ccd91700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c810ca40 con 0x7f35c8101d00 2024-04-12T09:16:47.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.073+0000 7f35c5d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35c81026a0 0x7f35c8113000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:47.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.073+0000 7f35c5d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35c81026a0 0x7f35c8113000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58034/0 (socket says 172.21.15.117:58034) 2024-04-12T09:16:47.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.073+0000 7f35c5d9b700 1 -- 172.21.15.117:0/4069625039 learned_addr learned my addr 172.21.15.117:0/4069625039 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:16:47.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.073+0000 7f35c659c700 1 --2- 172.21.15.117:0/4069625039 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35c8101d00 0x7f35c8112ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:47.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.073+0000 7f35c5d9b700 1 -- 172.21.15.117:0/4069625039 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35c8101d00 msgr2=0x7f35c8112ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:47.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.073+0000 7f35c5d9b700 1 --2- 172.21.15.117:0/4069625039 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35c8101d00 0x7f35c8112ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:47.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.073+0000 7f35c5d9b700 1 -- 172.21.15.117:0/4069625039 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35bc005040 con 0x7f35c81026a0 2024-04-12T09:16:47.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.073+0000 7f35c5d9b700 1 --2- 172.21.15.117:0/4069625039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35c81026a0 0x7f35c8113000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00b3b0 tx=0x7f35bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:47.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.073+0000 7f35b6ffd700 1 -- 172.21.15.117:0/4069625039 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35bc00e040 con 0x7f35c81026a0 2024-04-12T09:16:47.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.073+0000 7f35ccd91700 1 -- 172.21.15.117:0/4069625039 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c810ccc0 con 0x7f35c81026a0 2024-04-12T09:16:47.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.073+0000 7f35b6ffd700 1 -- 172.21.15.117:0/4069625039 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f35bc00bd00 con 0x7f35c81026a0 2024-04-12T09:16:47.076 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.073+0000 7f35b6ffd700 1 -- 172.21.15.117:0/4069625039 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35bc013660 con 0x7f35c81026a0 2024-04-12T09:16:47.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:46 smithi203 ceph-mon[86783]: Upgrade: Setting container_image for all mon 2024-04-12T09:16:47.077 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:46 smithi203 ceph-mon[86783]: from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:16:47.077 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:46 smithi203 ceph-mon[86783]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:16:47.077 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:46 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/1649065686' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:16:47.077 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:46 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/3611563262' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:16:47.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.073+0000 7f35ccd91700 1 -- 172.21.15.117:0/4069625039 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c810d220 con 0x7f35c81026a0 2024-04-12T09:16:47.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.074+0000 7f35ccd91700 1 -- 172.21.15.117:0/4069625039 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c80fd450 con 0x7f35c81026a0 2024-04-12T09:16:47.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.075+0000 7f35b6ffd700 1 -- 172.21.15.117:0/4069625039 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 38) v1 ==== 91963+0+0 (secure 0 0 0) 0x7f35bc01e420 con 0x7f35c81026a0 2024-04-12T09:16:47.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.075+0000 7f35b6ffd700 1 --2- 172.21.15.117:0/4069625039 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f35b006ddc0 0x7f35b0070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:16:47.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.075+0000 7f35b6ffd700 1 -- 172.21.15.117:0/4069625039 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f35bc091680 con 0x7f35c81026a0 2024-04-12T09:16:47.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.075+0000 7f35c659c700 1 --2- 172.21.15.117:0/4069625039 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f35b006ddc0 0x7f35b0070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:16:47.078 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.076+0000 7f35c659c700 1 --2- 172.21.15.117:0/4069625039 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f35b006ddc0 0x7f35b0070270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f35b8004f40 tx=0x7f35b800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:16:47.080 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.080+0000 7f35b6ffd700 1 -- 172.21.15.117:0/4069625039 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f35bc05e5c0 con 0x7f35c81026a0 2024-04-12T09:16:47.376 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.376+0000 7f35ccd91700 1 -- 172.21.15.117:0/4069625039 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f35c8108de0 con 0x7f35c81026a0 2024-04-12T09:16:47.377 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.376+0000 7f35b6ffd700 1 -- 172.21.15.117:0/4069625039 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f35bc05e150 con 0x7f35c81026a0 2024-04-12T09:16:47.377 INFO:teuthology.orchestra.run.smithi117.stdout:HEALTH_OK 2024-04-12T09:16:47.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.378+0000 7f35ccd91700 1 -- 172.21.15.117:0/4069625039 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f35b006ddc0 msgr2=0x7f35b0070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:47.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.378+0000 7f35ccd91700 1 --2- 172.21.15.117:0/4069625039 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f35b006ddc0 0x7f35b0070270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f35b8004f40 tx=0x7f35b800b040 comp rx=0 tx=0).stop 2024-04-12T09:16:47.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.378+0000 7f35ccd91700 1 -- 172.21.15.117:0/4069625039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35c81026a0 msgr2=0x7f35c8113000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:16:47.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.378+0000 7f35ccd91700 1 --2- 172.21.15.117:0/4069625039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35c81026a0 0x7f35c8113000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00b3b0 tx=0x7f35bc009e30 comp rx=0 tx=0).stop 2024-04-12T09:16:47.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.378+0000 7f35ccd91700 1 -- 172.21.15.117:0/4069625039 shutdown_connections 2024-04-12T09:16:47.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.378+0000 7f35ccd91700 1 --2- 172.21.15.117:0/4069625039 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f35c8101d00 0x7f35c8112ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:47.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.378+0000 7f35ccd91700 1 --2- 172.21.15.117:0/4069625039 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f35b006ddc0 0x7f35b0070270 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:47.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.378+0000 7f35ccd91700 1 --2- 172.21.15.117:0/4069625039 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35c81026a0 0x7f35c8113000 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:16:47.379 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.378+0000 7f35ccd91700 1 -- 172.21.15.117:0/4069625039 >> 172.21.15.117:0/4069625039 conn(0x7f35c80f78d0 msgr2=0x7f35c80f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:16:47.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.378+0000 7f35ccd91700 1 -- 172.21.15.117:0/4069625039 shutdown_connections 2024-04-12T09:16:47.380 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:16:47.378+0000 7f35ccd91700 1 -- 172.21.15.117:0/4069625039 wait complete. 2024-04-12T09:16:47.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:47 smithi117 ceph-mon[113571]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:16:47.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:47 smithi117 ceph-mon[113571]: pgmap v29: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:47.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:47 smithi117 ceph-mon[113571]: Upgrade: Updating crash.smithi117 (1/2) 2024-04-12T09:16:47.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:47.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi117", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T09:16:47.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:47.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:47 smithi117 ceph-mon[113571]: Deploying daemon crash.smithi117 on smithi117 2024-04-12T09:16:47.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:47 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/4069625039' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:16:48.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:47 smithi203 ceph-mon[86783]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:16:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:47 smithi203 ceph-mon[86783]: pgmap v29: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:47 smithi203 ceph-mon[86783]: Upgrade: Updating crash.smithi117 (1/2) 2024-04-12T09:16:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi117", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T09:16:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:47 smithi203 ceph-mon[86783]: Deploying daemon crash.smithi117 on smithi117 2024-04-12T09:16:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:47 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/4069625039' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:16:48.838 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:48 smithi117 ceph-mon[113571]: from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:16:49.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:48 smithi203 ceph-mon[86783]: from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:16:49.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:49 smithi117 ceph-mon[113571]: pgmap v30: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:50.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:49 smithi203 ceph-mon[86783]: pgmap v30: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:51.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:51 smithi203 ceph-mon[86783]: pgmap v31: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:51.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:51 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:51.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:51 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:52.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:51 smithi117 ceph-mon[113571]: pgmap v31: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:52.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:51 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:52.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:51 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:53.533 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:53 smithi203 ceph-mon[86783]: Upgrade: Updating crash.smithi203 (2/2) 2024-04-12T09:16:53.533 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:53 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:53.533 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:53 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi203", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T09:16:53.533 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:53 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:53.533 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:53 smithi203 ceph-mon[86783]: Deploying daemon crash.smithi203 on smithi203 2024-04-12T09:16:53.533 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:53 smithi203 ceph-mon[86783]: pgmap v32: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:53.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:53 smithi117 ceph-mon[113571]: Upgrade: Updating crash.smithi203 (2/2) 2024-04-12T09:16:53.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:53 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:53.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:53 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi203", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-12T09:16:53.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:53 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:16:53.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:53 smithi117 ceph-mon[113571]: Deploying daemon crash.smithi203 on smithi203 2024-04-12T09:16:53.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:53 smithi117 ceph-mon[113571]: pgmap v32: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:54.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:54 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:16:55.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:16:55.944 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:55 smithi203 ceph-mon[86783]: pgmap v33: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:56.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:55 smithi117 ceph-mon[113571]: pgmap v33: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:57.029 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:56 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:57.029 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:56 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:57.029 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:56 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:16:57.029 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:56 smithi117 ceph-mon[113571]: pgmap v34: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:16:57.033 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:56 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:57.033 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:56 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:16:57.034 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:56 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:16:57.034 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:56 smithi203 ceph-mon[86783]: pgmap v34: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:00.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:59 smithi203 ceph-mon[86783]: pgmap v35: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:00.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:59 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:00.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:16:59 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:00.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:59 smithi117 ceph-mon[113571]: pgmap v35: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:00.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:59 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:00.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:16:59 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:01.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:00 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:01.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:00 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:01.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:00 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:01.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:00 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:01.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:01 smithi203 ceph-mon[86783]: pgmap v36: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:01.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:01 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:01.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:01 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:02.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:01 smithi117 ceph-mon[113571]: pgmap v36: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:02.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:01 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:02.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:01 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:03.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:03 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:03.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:03 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:03.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:03 smithi203 ceph-mon[86783]: pgmap v37: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:03.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:03 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:03.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:03 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:03.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:03 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:03.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:03 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:03.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:03 smithi117 ceph-mon[113571]: pgmap v37: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:03.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:03 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:03.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:03 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:05.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:05 smithi117 ceph-mon[113571]: pgmap v38: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:06.027 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:05 smithi203 ceph-mon[86783]: pgmap v38: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:07.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:06 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:07.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:06 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:07.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:06 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:17:07.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:06 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:17:07.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:06 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:07.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:06 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:17:07.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:06 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:17:07.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:06 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:17:07.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:06 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:17:07.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:06 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:07.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:06 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi117"}]: dispatch 2024-04-12T09:17:07.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:06 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi117"}]': finished 2024-04-12T09:17:07.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:06 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi203"}]: dispatch 2024-04-12T09:17:07.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:06 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi203"}]': finished 2024-04-12T09:17:07.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:06 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-12T09:17:07.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:06 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:07.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:06 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:07.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:06 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:17:07.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:06 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:17:07.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:06 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:07.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:06 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:17:07.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:06 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:17:07.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:06 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:17:07.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:06 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:17:07.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:06 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:07.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:06 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi117"}]: dispatch 2024-04-12T09:17:07.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:06 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi117"}]': finished 2024-04-12T09:17:07.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:06 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi203"}]: dispatch 2024-04-12T09:17:07.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:06 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi203"}]': finished 2024-04-12T09:17:07.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:06 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-12T09:17:08.058 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:07 smithi117 ceph-mon[113571]: Upgrade: Setting container_image for all crash 2024-04-12T09:17:08.058 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:07 smithi117 ceph-mon[113571]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-12T09:17:08.058 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:07 smithi117 ceph-mon[113571]: Upgrade: osd.0 is safe to restart 2024-04-12T09:17:08.058 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:07 smithi117 ceph-mon[113571]: pgmap v39: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:08.058 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:07 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:08.058 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:07 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-12T09:17:08.058 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:07 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:17:08.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:07 smithi203 ceph-mon[86783]: Upgrade: Setting container_image for all crash 2024-04-12T09:17:08.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:07 smithi203 ceph-mon[86783]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-12T09:17:08.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:07 smithi203 ceph-mon[86783]: Upgrade: osd.0 is safe to restart 2024-04-12T09:17:08.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:07 smithi203 ceph-mon[86783]: pgmap v39: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:08.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:07 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:08.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:07 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-12T09:17:08.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:07 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:17:08.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:08 smithi117 ceph-mon[113571]: Upgrade: Updating osd.0 2024-04-12T09:17:08.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:08 smithi117 ceph-mon[113571]: Deploying daemon osd.0 on smithi117 2024-04-12T09:17:09.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:08 smithi203 ceph-mon[86783]: Upgrade: Updating osd.0 2024-04-12T09:17:09.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:08 smithi203 ceph-mon[86783]: Deploying daemon osd.0 on smithi117 2024-04-12T09:17:09.869 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:09 smithi117 ceph-mon[113571]: pgmap v40: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:09.869 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:09 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:17:10.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:09 smithi203 ceph-mon[86783]: pgmap v40: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:10.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:09 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:17:11.109 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:10 smithi117 systemd[1]: Stopping Ceph osd.0 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:17:11.410 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:11 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0[47552]: 2024-04-12T09:17:11.108+0000 7f4195495700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T09:17:11.410 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:11 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0[47552]: 2024-04-12T09:17:11.108+0000 7f4195495700 -1 osd.0 49 *** Got signal Terminated *** 2024-04-12T09:17:11.410 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:11 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0[47552]: 2024-04-12T09:17:11.108+0000 7f4195495700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T09:17:12.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:11 smithi203 ceph-mon[86783]: pgmap v41: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:12.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:11 smithi203 ceph-mon[86783]: osd.0 marked itself down and dead 2024-04-12T09:17:12.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:11 smithi117 ceph-mon[113571]: pgmap v41: 65 pgs: 65 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:12.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:11 smithi117 ceph-mon[113571]: osd.0 marked itself down and dead 2024-04-12T09:17:12.492 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:12 smithi117 podman[124608]: 2024-04-12 09:17:12.179810514 +0000 UTC m=+1.189667647 container died 77040a2498f3e1d1b94b76f551974bd57e5a7d137bbdfaf013e9cc0e353acd40 (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, RELEASE=quincy-d3b5060, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T09:17:12.773 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:12 smithi117 podman[124608]: 2024-04-12 09:17:12.591913038 +0000 UTC m=+1.601770184 container cleanup 77040a2498f3e1d1b94b76f551974bd57e5a7d137bbdfaf013e9cc0e353acd40 (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-d3b5060, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, ceph=True) 2024-04-12T09:17:12.773 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:12 smithi117 bash[124608]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0 2024-04-12T09:17:13.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:12 smithi203 ceph-mon[86783]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-12T09:17:13.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:12 smithi203 ceph-mon[86783]: osdmap e50: 6 total, 5 up, 6 in 2024-04-12T09:17:13.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:12 smithi117 ceph-mon[113571]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-12T09:17:13.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:12 smithi117 ceph-mon[113571]: osdmap e50: 6 total, 5 up, 6 in 2024-04-12T09:17:13.160 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:12 smithi117 podman[124626]: 2024-04-12 09:17:12.860239162 +0000 UTC m=+0.681725419 container remove 77040a2498f3e1d1b94b76f551974bd57e5a7d137bbdfaf013e9cc0e353acd40 (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=quincy-d3b5060, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240409) 2024-04-12T09:17:13.481 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:13 smithi117 podman[124723]: 2024-04-12 09:17:13.096601778 +0000 UTC m=+0.017856549 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:17:13.481 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:13 smithi117 podman[124723]: 2024-04-12 09:17:13.236760259 +0000 UTC m=+0.158015054 container create 2f64e733162e9928938ec9302559acda9557afc1d2da6e5884602f04df28d426 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240409, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b277feb, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-12T09:17:13.481 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:13 smithi117 podman[124723]: 2024-04-12 09:17:13.481029011 +0000 UTC m=+0.402283764 container init 2f64e733162e9928938ec9302559acda9557afc1d2da6e5884602f04df28d426 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-b277feb, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-12T09:17:13.780 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:13 smithi117 podman[124723]: 2024-04-12 09:17:13.484310601 +0000 UTC m=+0.405565359 container start 2f64e733162e9928938ec9302559acda9557afc1d2da6e5884602f04df28d426 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0-deactivate, RELEASE=squid-b277feb, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409) 2024-04-12T09:17:13.780 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:13 smithi117 podman[124723]: 2024-04-12 09:17:13.581127354 +0000 UTC m=+0.502382108 container attach 2f64e733162e9928938ec9302559acda9557afc1d2da6e5884602f04df28d426 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-b277feb, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True) 2024-04-12T09:17:13.781 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:13 smithi117 podman[124723]: 2024-04-12 09:17:13.780230418 +0000 UTC m=+0.701485176 container died 2f64e733162e9928938ec9302559acda9557afc1d2da6e5884602f04df28d426 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b277feb, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-12T09:17:14.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:13 smithi203 ceph-mon[86783]: pgmap v43: 65 pgs: 9 stale+active+clean, 56 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:14.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:13 smithi203 ceph-mon[86783]: osdmap e51: 6 total, 5 up, 6 in 2024-04-12T09:17:14.118 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:13 smithi117 ceph-mon[113571]: pgmap v43: 65 pgs: 9 stale+active+clean, 56 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:14.118 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:13 smithi117 ceph-mon[113571]: osdmap e51: 6 total, 5 up, 6 in 2024-04-12T09:17:14.910 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:14 smithi117 podman[124749]: 2024-04-12 09:17:14.510167037 +0000 UTC m=+0.725063458 container remove 2f64e733162e9928938ec9302559acda9557afc1d2da6e5884602f04df28d426 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-b277feb, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-12T09:17:14.910 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:14 smithi117 systemd[1]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.0.service: Deactivated successfully. 2024-04-12T09:17:14.910 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:14 smithi117 systemd[1]: Stopped Ceph osd.0 for 12161984-f8ab-11ee-bc8c-c7b262605968. 2024-04-12T09:17:14.910 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:14 smithi117 systemd[1]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.0.service: Consumed 1min 798ms CPU time. 2024-04-12T09:17:14.910 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:14 smithi117 systemd[1]: Starting Ceph osd.0 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:17:15.226 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:14 smithi117 podman[124851]: 2024-04-12 09:17:14.875535004 +0000 UTC m=+0.018694507 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:17:15.226 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:15 smithi117 podman[124851]: 2024-04-12 09:17:15.019973533 +0000 UTC m=+0.163133018 container create 1d930ca8368e5379df33683e488c2a4500d53f79d2e55bfed5a07c9225fb8910 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0-activate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-b277feb, ceph=True, org.label-schema.license=GPLv2) 2024-04-12T09:17:15.226 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:15 smithi117 podman[124851]: 2024-04-12 09:17:15.2226287 +0000 UTC m=+0.365788185 container init 1d930ca8368e5379df33683e488c2a4500d53f79d2e55bfed5a07c9225fb8910 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0-activate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-b277feb, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-12T09:17:15.226 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:15 smithi117 podman[124851]: 2024-04-12 09:17:15.225847158 +0000 UTC m=+0.369006648 container start 1d930ca8368e5379df33683e488c2a4500d53f79d2e55bfed5a07c9225fb8910 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b277feb, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True) 2024-04-12T09:17:15.660 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:15 smithi117 podman[124851]: 2024-04-12 09:17:15.330883824 +0000 UTC m=+0.474043309 container attach 1d930ca8368e5379df33683e488c2a4500d53f79d2e55bfed5a07c9225fb8910 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0-activate, io.buildah.version=1.33.5, RELEASE=squid-b277feb, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409) 2024-04-12T09:17:16.022 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:15 smithi117 ceph-mon[113571]: pgmap v45: 65 pgs: 9 stale+active+clean, 56 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:16.023 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:15 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0-activate[124866]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-12T09:17:16.023 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:15 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0-activate[124866]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-12T09:17:16.023 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:15 smithi117 bash[124851]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-12T09:17:16.023 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:15 smithi117 bash[124851]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-12T09:17:16.023 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:15 smithi117 bash[124851]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-12T09:17:16.023 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:15 smithi117 bash[124851]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-12T09:17:16.023 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:15 smithi117 bash[124851]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-12T09:17:16.023 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:15 smithi117 bash[124851]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-12T09:17:16.023 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:15 smithi117 bash[124851]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-12T09:17:16.023 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:15 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0-activate[124866]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-12T09:17:16.024 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:15 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0-activate[124866]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-12T09:17:16.024 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:15 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0-activate[124866]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-12T09:17:16.024 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:15 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0-activate[124866]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-12T09:17:16.024 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:15 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0-activate[124866]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-12T09:17:16.024 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:15 smithi117 podman[124851]: 2024-04-12 09:17:15.692600359 +0000 UTC m=+0.835759845 container died 1d930ca8368e5379df33683e488c2a4500d53f79d2e55bfed5a07c9225fb8910 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0-activate, org.label-schema.license=GPLv2, RELEASE=squid-b277feb, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T09:17:16.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:15 smithi203 ceph-mon[86783]: pgmap v45: 65 pgs: 9 stale+active+clean, 56 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:16.644 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:16 smithi117 podman[125005]: 2024-04-12 09:17:16.393794678 +0000 UTC m=+0.691602248 container remove 1d930ca8368e5379df33683e488c2a4500d53f79d2e55bfed5a07c9225fb8910 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0-activate, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-b277feb, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T09:17:16.645 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:16 smithi117 podman[125071]: 2024-04-12 09:17:16.510719226 +0000 UTC m=+0.017734073 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:17:16.645 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:16 smithi117 podman[125071]: 2024-04-12 09:17:16.644986863 +0000 UTC m=+0.152001678 container create 59a180461e3c3c1eb5269e390fee1f3915cf5482c8cf0f569761bf4932c98a65 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-b277feb) 2024-04-12T09:17:16.904 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:16 smithi117 ceph-mon[113571]: pgmap v46: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 40/225 objects degraded (17.778%) 2024-04-12T09:17:16.904 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:16 smithi117 ceph-mon[113571]: Health check failed: Degraded data redundancy: 40/225 objects degraded (17.778%), 18 pgs degraded (PG_DEGRADED) 2024-04-12T09:17:16.905 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:16 smithi117 podman[125071]: 2024-04-12 09:17:16.881313233 +0000 UTC m=+0.388328053 container init 59a180461e3c3c1eb5269e390fee1f3915cf5482c8cf0f569761bf4932c98a65 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-b277feb, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-04-12T09:17:16.905 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:16 smithi117 podman[125071]: 2024-04-12 09:17:16.884523687 +0000 UTC m=+0.391538504 container start 59a180461e3c3c1eb5269e390fee1f3915cf5482c8cf0f569761bf4932c98a65 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-b277feb, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T09:17:17.160 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:16 smithi117 ceph-osd[125090]: -- 172.21.15.117:0/399274607 <== mon.0 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bff90e7680 con 0x55bff90b0c00 2024-04-12T09:17:17.160 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:16 smithi117 bash[125071]: 59a180461e3c3c1eb5269e390fee1f3915cf5482c8cf0f569761bf4932c98a65 2024-04-12T09:17:17.160 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:17 smithi117 systemd[1]: Started Ceph osd.0 for 12161984-f8ab-11ee-bc8c-c7b262605968. 2024-04-12T09:17:17.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:16 smithi203 ceph-mon[86783]: pgmap v46: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 40/225 objects degraded (17.778%) 2024-04-12T09:17:17.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:16 smithi203 ceph-mon[86783]: Health check failed: Degraded data redundancy: 40/225 objects degraded (17.778%), 18 pgs degraded (PG_DEGRADED) 2024-04-12T09:17:17.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.487+0000 7f1d41808700 1 -- 172.21.15.117:0/3167734737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d3c102e10 msgr2=0x7f1d3c1031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:17.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.487+0000 7f1d41808700 1 --2- 172.21.15.117:0/3167734737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d3c102e10 0x7f1d3c1031e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c004940 tx=0x7f1d2c009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:17.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.487+0000 7f1d41808700 1 -- 172.21.15.117:0/3167734737 shutdown_connections 2024-04-12T09:17:17.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.487+0000 7f1d41808700 1 --2- 172.21.15.117:0/3167734737 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d3c1037b0 0x7f1d3c0fce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:17.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.487+0000 7f1d41808700 1 --2- 172.21.15.117:0/3167734737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d3c102e10 0x7f1d3c1031e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:17.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.487+0000 7f1d41808700 1 -- 172.21.15.117:0/3167734737 >> 172.21.15.117:0/3167734737 conn(0x7f1d3c0f8980 msgr2=0x7f1d3c0fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:17.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.487+0000 7f1d41808700 1 -- 172.21.15.117:0/3167734737 shutdown_connections 2024-04-12T09:17:17.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.487+0000 7f1d41808700 1 -- 172.21.15.117:0/3167734737 wait complete. 2024-04-12T09:17:17.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.488+0000 7f1d41808700 1 Processor -- start 2024-04-12T09:17:17.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.488+0000 7f1d41808700 1 -- start start 2024-04-12T09:17:17.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.488+0000 7f1d41808700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d3c102e10 0x7f1d3c0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:17.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.488+0000 7f1d41808700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d3c1037b0 0x7f1d3c070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:17.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.488+0000 7f1d41808700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c070d90 con 0x7f1d3c102e10 2024-04-12T09:17:17.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.488+0000 7f1d41808700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c070ed0 con 0x7f1d3c1037b0 2024-04-12T09:17:17.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.489+0000 7f1d3affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d3c102e10 0x7f1d3c0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:17.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.489+0000 7f1d3affd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d3c102e10 0x7f1d3c0702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:49442/0 (socket says 172.21.15.117:49442) 2024-04-12T09:17:17.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.489+0000 7f1d3affd700 1 -- 172.21.15.117:0/3343336891 learned_addr learned my addr 172.21.15.117:0/3343336891 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:17:17.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.489+0000 7f1d3a7fc700 1 --2- 172.21.15.117:0/3343336891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d3c1037b0 0x7f1d3c070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:17.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.489+0000 7f1d3affd700 1 -- 172.21.15.117:0/3343336891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d3c1037b0 msgr2=0x7f1d3c070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:17.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.489+0000 7f1d3affd700 1 --2- 172.21.15.117:0/3343336891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d3c1037b0 0x7f1d3c070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:17.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.489+0000 7f1d3affd700 1 -- 172.21.15.117:0/3343336891 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c005040 con 0x7f1d3c102e10 2024-04-12T09:17:17.493 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.489+0000 7f1d3affd700 1 --2- 172.21.15.117:0/3343336891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d3c102e10 0x7f1d3c0702c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009150 tx=0x7f1d2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:17.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.489+0000 7f1d237fe700 1 -- 172.21.15.117:0/3343336891 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d2c00e040 con 0x7f1d3c102e10 2024-04-12T09:17:17.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.489+0000 7f1d237fe700 1 -- 172.21.15.117:0/3343336891 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1d2c013420 con 0x7f1d3c102e10 2024-04-12T09:17:17.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.489+0000 7f1d237fe700 1 -- 172.21.15.117:0/3343336891 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d2c01c610 con 0x7f1d3c102e10 2024-04-12T09:17:17.494 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.489+0000 7f1d41808700 1 -- 172.21.15.117:0/3343336891 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3c071120 con 0x7f1d3c102e10 2024-04-12T09:17:17.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.489+0000 7f1d41808700 1 -- 172.21.15.117:0/3343336891 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3c11a290 con 0x7f1d3c102e10 2024-04-12T09:17:17.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.491+0000 7f1d41808700 1 -- 172.21.15.117:0/3343336891 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d3c100120 con 0x7f1d3c102e10 2024-04-12T09:17:17.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.491+0000 7f1d237fe700 1 -- 172.21.15.117:0/3343336891 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 38) v1 ==== 91963+0+0 (secure 0 0 0) 0x7f1d2c00baf0 con 0x7f1d3c102e10 2024-04-12T09:17:17.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.491+0000 7f1d237fe700 1 --2- 172.21.15.117:0/3343336891 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f1d2406ddc0 0x7f1d24070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:17.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.491+0000 7f1d237fe700 1 -- 172.21.15.117:0/3343336891 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f1d2c08e880 con 0x7f1d3c102e10 2024-04-12T09:17:17.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.492+0000 7f1d3a7fc700 1 --2- 172.21.15.117:0/3343336891 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f1d2406ddc0 0x7f1d24070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:17.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.492+0000 7f1d3a7fc700 1 --2- 172.21.15.117:0/3343336891 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f1d2406ddc0 0x7f1d24070270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c071c00 tx=0x7f1d30009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:17.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.497+0000 7f1d237fe700 1 -- 172.21.15.117:0/3343336891 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f1d2c057db0 con 0x7f1d3c102e10 2024-04-12T09:17:17.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.764+0000 7f1d41808700 1 -- 172.21.15.117:0/3343336891 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d3c109f10 con 0x7f1d2406ddc0 2024-04-12T09:17:17.766 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:17 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0[125086]: 2024-04-12T09:17:17.427+0000 7f105b25e7c0 -1 Falling back to public interface 2024-04-12T09:17:17.766 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.765+0000 7f1d237fe700 1 -- 172.21.15.117:0/3343336891 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1d3c109f10 con 0x7f1d2406ddc0 2024-04-12T09:17:17.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.767+0000 7f1d41808700 1 -- 172.21.15.117:0/3343336891 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f1d2406ddc0 msgr2=0x7f1d24070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:17.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.767+0000 7f1d41808700 1 --2- 172.21.15.117:0/3343336891 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f1d2406ddc0 0x7f1d24070270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c071c00 tx=0x7f1d30009040 comp rx=0 tx=0).stop 2024-04-12T09:17:17.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.767+0000 7f1d41808700 1 -- 172.21.15.117:0/3343336891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d3c102e10 msgr2=0x7f1d3c0702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:17.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.767+0000 7f1d41808700 1 --2- 172.21.15.117:0/3343336891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d3c102e10 0x7f1d3c0702c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009150 tx=0x7f1d2c009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:17.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.767+0000 7f1d41808700 1 -- 172.21.15.117:0/3343336891 shutdown_connections 2024-04-12T09:17:17.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.767+0000 7f1d41808700 1 --2- 172.21.15.117:0/3343336891 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f1d2406ddc0 0x7f1d24070270 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:17.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.767+0000 7f1d41808700 1 --2- 172.21.15.117:0/3343336891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1d3c102e10 0x7f1d3c0702c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:17.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.767+0000 7f1d41808700 1 --2- 172.21.15.117:0/3343336891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d3c1037b0 0x7f1d3c070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:17.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.767+0000 7f1d41808700 1 -- 172.21.15.117:0/3343336891 >> 172.21.15.117:0/3343336891 conn(0x7f1d3c0f8980 msgr2=0x7f1d3c1073b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:17.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.768+0000 7f1d41808700 1 -- 172.21.15.117:0/3343336891 shutdown_connections 2024-04-12T09:17:17.769 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.768+0000 7f1d41808700 1 -- 172.21.15.117:0/3343336891 wait complete. 2024-04-12T09:17:17.782 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:17:17.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.871+0000 7fee2f6ad700 1 -- 172.21.15.117:0/4203147828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee281037b0 msgr2=0x7fee280fce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:17.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.871+0000 7fee2f6ad700 1 --2- 172.21.15.117:0/4203147828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee281037b0 0x7fee280fce20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fee18004940 tx=0x7fee18009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:17.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.871+0000 7fee2f6ad700 1 -- 172.21.15.117:0/4203147828 shutdown_connections 2024-04-12T09:17:17.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.871+0000 7fee2f6ad700 1 --2- 172.21.15.117:0/4203147828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee281037b0 0x7fee280fce20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:17.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.871+0000 7fee2f6ad700 1 --2- 172.21.15.117:0/4203147828 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee28102e10 0x7fee281031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:17.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.871+0000 7fee2f6ad700 1 -- 172.21.15.117:0/4203147828 >> 172.21.15.117:0/4203147828 conn(0x7fee280f89a0 msgr2=0x7fee280fadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:17.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.871+0000 7fee2f6ad700 1 -- 172.21.15.117:0/4203147828 shutdown_connections 2024-04-12T09:17:17.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.871+0000 7fee2f6ad700 1 -- 172.21.15.117:0/4203147828 wait complete. 2024-04-12T09:17:17.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.871+0000 7fee2f6ad700 1 Processor -- start 2024-04-12T09:17:17.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.871+0000 7fee2f6ad700 1 -- start start 2024-04-12T09:17:17.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.872+0000 7fee2f6ad700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee28102e10 0x7fee28113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:17.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.872+0000 7fee2f6ad700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee281037b0 0x7fee28114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:17.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.872+0000 7fee2f6ad700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee281146c0 con 0x7fee28102e10 2024-04-12T09:17:17.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.872+0000 7fee2f6ad700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2810db00 con 0x7fee281037b0 2024-04-12T09:17:17.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.872+0000 7fee2d449700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee28102e10 0x7fee28113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:17.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.872+0000 7fee2d449700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee28102e10 0x7fee28113b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:49462/0 (socket says 172.21.15.117:49462) 2024-04-12T09:17:17.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.872+0000 7fee2d449700 1 -- 172.21.15.117:0/1164962930 learned_addr learned my addr 172.21.15.117:0/1164962930 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:17:17.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.872+0000 7fee2cc48700 1 --2- 172.21.15.117:0/1164962930 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee281037b0 0x7fee28114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:17.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.872+0000 7fee2d449700 1 -- 172.21.15.117:0/1164962930 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee281037b0 msgr2=0x7fee28114070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:17.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.872+0000 7fee2d449700 1 --2- 172.21.15.117:0/1164962930 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee281037b0 0x7fee28114070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:17.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.872+0000 7fee2d449700 1 -- 172.21.15.117:0/1164962930 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee18005040 con 0x7fee28102e10 2024-04-12T09:17:17.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.872+0000 7fee2d449700 1 --2- 172.21.15.117:0/1164962930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee28102e10 0x7fee28113b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fee2000ec90 tx=0x7fee2000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:17.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.872+0000 7fee1dffb700 1 -- 172.21.15.117:0/1164962930 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee20007b30 con 0x7fee28102e10 2024-04-12T09:17:17.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.872+0000 7fee1dffb700 1 -- 172.21.15.117:0/1164962930 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee2000f040 con 0x7fee28102e10 2024-04-12T09:17:17.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.872+0000 7fee2f6ad700 1 -- 172.21.15.117:0/1164962930 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2810dde0 con 0x7fee28102e10 2024-04-12T09:17:17.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.872+0000 7fee1dffb700 1 -- 172.21.15.117:0/1164962930 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee2000cc80 con 0x7fee28102e10 2024-04-12T09:17:17.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.872+0000 7fee2f6ad700 1 -- 172.21.15.117:0/1164962930 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2810e2f0 con 0x7fee28102e10 2024-04-12T09:17:17.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.873+0000 7fee2f6ad700 1 -- 172.21.15.117:0/1164962930 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee281052e0 con 0x7fee28102e10 2024-04-12T09:17:17.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.874+0000 7fee1dffb700 1 -- 172.21.15.117:0/1164962930 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 38) v1 ==== 91963+0+0 (secure 0 0 0) 0x7fee20007c90 con 0x7fee28102e10 2024-04-12T09:17:17.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.874+0000 7fee1dffb700 1 --2- 172.21.15.117:0/1164962930 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fee1406ddc0 0x7fee14070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:17.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.874+0000 7fee1dffb700 1 -- 172.21.15.117:0/1164962930 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fee2008dae0 con 0x7fee28102e10 2024-04-12T09:17:17.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.874+0000 7fee2cc48700 1 --2- 172.21.15.117:0/1164962930 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fee1406ddc0 0x7fee14070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:17.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.875+0000 7fee2cc48700 1 --2- 172.21.15.117:0/1164962930 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fee1406ddc0 0x7fee14070270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fee18004890 tx=0x7fee18009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:17.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:17.879+0000 7fee1dffb700 1 -- 172.21.15.117:0/1164962930 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fee2005aaa0 con 0x7fee28102e10 2024-04-12T09:17:18.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.105+0000 7fee2f6ad700 1 -- 172.21.15.117:0/1164962930 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fee2810f1f0 con 0x7fee1406ddc0 2024-04-12T09:17:18.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.107+0000 7fee1dffb700 1 -- 172.21.15.117:0/1164962930 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fee2810f1f0 con 0x7fee1406ddc0 2024-04-12T09:17:18.109 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.109+0000 7fee2f6ad700 1 -- 172.21.15.117:0/1164962930 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fee1406ddc0 msgr2=0x7fee14070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:18.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.109+0000 7fee2f6ad700 1 --2- 172.21.15.117:0/1164962930 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fee1406ddc0 0x7fee14070270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fee18004890 tx=0x7fee18009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:18.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.109+0000 7fee2f6ad700 1 -- 172.21.15.117:0/1164962930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee28102e10 msgr2=0x7fee28113b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:18.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.109+0000 7fee2f6ad700 1 --2- 172.21.15.117:0/1164962930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee28102e10 0x7fee28113b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fee2000ec90 tx=0x7fee2000b040 comp rx=0 tx=0).stop 2024-04-12T09:17:18.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.109+0000 7fee2f6ad700 1 -- 172.21.15.117:0/1164962930 shutdown_connections 2024-04-12T09:17:18.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.109+0000 7fee2f6ad700 1 --2- 172.21.15.117:0/1164962930 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fee1406ddc0 0x7fee14070270 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:18.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.109+0000 7fee2f6ad700 1 --2- 172.21.15.117:0/1164962930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fee28102e10 0x7fee28113b30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:18.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.109+0000 7fee2f6ad700 1 --2- 172.21.15.117:0/1164962930 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee281037b0 0x7fee28114070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:18.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.109+0000 7fee2f6ad700 1 -- 172.21.15.117:0/1164962930 >> 172.21.15.117:0/1164962930 conn(0x7fee280f89a0 msgr2=0x7fee28102220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:18.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.109+0000 7fee2f6ad700 1 -- 172.21.15.117:0/1164962930 shutdown_connections 2024-04-12T09:17:18.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.109+0000 7fee2f6ad700 1 -- 172.21.15.117:0/1164962930 wait complete. 2024-04-12T09:17:18.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.212+0000 7fd622247700 1 -- 172.21.15.117:0/760085080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61c102e70 msgr2=0x7fd61c103240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:18.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.212+0000 7fd622247700 1 --2- 172.21.15.117:0/760085080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61c102e70 0x7fd61c103240 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd60c004940 tx=0x7fd60c009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:18.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.212+0000 7fd622247700 1 -- 172.21.15.117:0/760085080 shutdown_connections 2024-04-12T09:17:18.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.212+0000 7fd622247700 1 --2- 172.21.15.117:0/760085080 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd61c0fb4a0 0x7fd61c0fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:18.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.212+0000 7fd622247700 1 --2- 172.21.15.117:0/760085080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61c102e70 0x7fd61c103240 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:18.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.212+0000 7fd622247700 1 -- 172.21.15.117:0/760085080 >> 172.21.15.117:0/760085080 conn(0x7fd61c0714c0 msgr2=0x7fd61c0718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:18.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.212+0000 7fd622247700 1 -- 172.21.15.117:0/760085080 shutdown_connections 2024-04-12T09:17:18.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.212+0000 7fd622247700 1 -- 172.21.15.117:0/760085080 wait complete. 2024-04-12T09:17:18.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.212+0000 7fd622247700 1 Processor -- start 2024-04-12T09:17:18.214 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.213+0000 7fd622247700 1 -- start start 2024-04-12T09:17:18.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.213+0000 7fd622247700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd61c0fb4a0 0x7fd61c113b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:18.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.213+0000 7fd622247700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61c102e70 0x7fd61c114090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:18.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.213+0000 7fd622247700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c1146e0 con 0x7fd61c102e70 2024-04-12T09:17:18.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.213+0000 7fd622247700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c10dad0 con 0x7fd61c0fb4a0 2024-04-12T09:17:18.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.213+0000 7fd612ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61c102e70 0x7fd61c114090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:18.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.213+0000 7fd612ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61c102e70 0x7fd61c114090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:49484/0 (socket says 172.21.15.117:49484) 2024-04-12T09:17:18.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.213+0000 7fd612ffd700 1 -- 172.21.15.117:0/1030363412 learned_addr learned my addr 172.21.15.117:0/1030363412 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:17:18.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.213+0000 7fd61b7fe700 1 --2- 172.21.15.117:0/1030363412 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd61c0fb4a0 0x7fd61c113b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:18.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.213+0000 7fd612ffd700 1 -- 172.21.15.117:0/1030363412 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd61c0fb4a0 msgr2=0x7fd61c113b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:18.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.213+0000 7fd612ffd700 1 --2- 172.21.15.117:0/1030363412 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd61c0fb4a0 0x7fd61c113b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:18.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.213+0000 7fd612ffd700 1 -- 172.21.15.117:0/1030363412 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c005040 con 0x7fd61c102e70 2024-04-12T09:17:18.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.213+0000 7fd612ffd700 1 --2- 172.21.15.117:0/1030363412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61c102e70 0x7fd61c114090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd604002a50 tx=0x7fd6040046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:18.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.214+0000 7fd618ff9700 1 -- 172.21.15.117:0/1030363412 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd604007cc0 con 0x7fd61c102e70 2024-04-12T09:17:18.216 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.214+0000 7fd618ff9700 1 -- 172.21.15.117:0/1030363412 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd60400f040 con 0x7fd61c102e70 2024-04-12T09:17:18.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.214+0000 7fd622247700 1 -- 172.21.15.117:0/1030363412 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd61c10ddb0 con 0x7fd61c102e70 2024-04-12T09:17:18.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.214+0000 7fd618ff9700 1 -- 172.21.15.117:0/1030363412 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd60400da30 con 0x7fd61c102e70 2024-04-12T09:17:18.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.214+0000 7fd622247700 1 -- 172.21.15.117:0/1030363412 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd61c10e370 con 0x7fd61c102e70 2024-04-12T09:17:18.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.215+0000 7fd622247700 1 -- 172.21.15.117:0/1030363412 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd61c100110 con 0x7fd61c102e70 2024-04-12T09:17:18.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.215+0000 7fd618ff9700 1 -- 172.21.15.117:0/1030363412 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 38) v1 ==== 91963+0+0 (secure 0 0 0) 0x7fd60400db90 con 0x7fd61c102e70 2024-04-12T09:17:18.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.216+0000 7fd618ff9700 1 --2- 172.21.15.117:0/1030363412 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fd60806ddc0 0x7fd608070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:18.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.216+0000 7fd618ff9700 1 -- 172.21.15.117:0/1030363412 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd60408d4e0 con 0x7fd61c102e70 2024-04-12T09:17:18.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.216+0000 7fd61b7fe700 1 --2- 172.21.15.117:0/1030363412 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fd60806ddc0 0x7fd608070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:18.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.216+0000 7fd61b7fe700 1 --2- 172.21.15.117:0/1030363412 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fd60806ddc0 0x7fd608070270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd60c004f90 tx=0x7fd60c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:18.221 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.220+0000 7fd618ff9700 1 -- 172.21.15.117:0/1030363412 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fd60405a420 con 0x7fd61c102e70 2024-04-12T09:17:18.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:18 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:18.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:18 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:18.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:18 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:17:18.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:18 smithi203 ceph-mon[86783]: from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:17:18.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:18 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:18.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:18 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:18.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:18 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:17:18.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:18 smithi117 ceph-mon[113571]: from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:17:18.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.452+0000 7fd622247700 1 -- 172.21.15.117:0/1030363412 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd61c113820 con 0x7fd60806ddc0 2024-04-12T09:17:18.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.464+0000 7fd618ff9700 1 -- 172.21.15.117:0/1030363412 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd61c113820 con 0x7fd60806ddc0 2024-04-12T09:17:18.465 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:17:18.465 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 running (2m) 17s ago 14m 28.6M - 0.25.0 c8568f914cd2 204687f21ed7 2024-04-12T09:17:18.465 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (28s) 17s ago 14m 6656k - 19.0.0-2053-gb277feb2 668895944f0e 038f567b664b 2024-04-12T09:17:18.465 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (23s) 19s ago 13m 6660k - 19.0.0-2053-gb277feb2 668895944f0e 420dee66e230 2024-04-12T09:17:18.465 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 running (2m) 17s ago 14m 79.0M - 9.4.12 2bacad6d85d8 a7b102216886 2024-04-12T09:17:18.465 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (8m) 17s ago 8m 140M - 17.2.7-827-gd3b5060a 21de9b7369ad de062e2c10e7 2024-04-12T09:17:18.465 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 running (9m) 17s ago 9m 14.3M - 17.2.7-827-gd3b5060a 21de9b7369ad 1e82c6241a18 2024-04-12T09:17:18.465 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (8m) 19s ago 8m 16.9M - 17.2.7-827-gd3b5060a 21de9b7369ad b05228e997f7 2024-04-12T09:17:18.465 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (8m) 19s ago 8m 17.1M - 17.2.7-827-gd3b5060a 21de9b7369ad 6d7f82c072c7 2024-04-12T09:17:18.466 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:8443,9283,8765 running (4m) 17s ago 15m 495M - 19.0.0-2053-gb277feb2 668895944f0e fee613d05ab7 2024-04-12T09:17:18.466 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283,8765 running (3m) 19s ago 13m 449M - 19.0.0-2053-gb277feb2 668895944f0e c793944c3e16 2024-04-12T09:17:18.466 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (92s) 17s ago 15m 42.8M 2048M 19.0.0-2053-gb277feb2 668895944f0e 6823aaff30ce 2024-04-12T09:17:18.466 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (68s) 19s ago 13m 35.4M 2048M 19.0.0-2053-gb277feb2 668895944f0e 006c6e487bfb 2024-04-12T09:17:18.466 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 running (3m) 17s ago 14m 16.1M - 1.5.0 0da6a335fe13 c692bed9f6c7 2024-04-12T09:17:18.466 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (3m) 19s ago 13m 15.2M - 1.5.0 0da6a335fe13 f3b5a470f545 2024-04-12T09:17:18.466 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 starting - - - 1557M 2024-04-12T09:17:18.466 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (12m) 17s ago 12m 236M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 8f9dbf0274ed 2024-04-12T09:17:18.466 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (11m) 17s ago 11m 201M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 339c5a80d1dd 2024-04-12T09:17:18.466 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (11m) 19s ago 11m 275M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad fb87d616bae3 2024-04-12T09:17:18.466 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (10m) 19s ago 10m 247M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad c873826a2dea 2024-04-12T09:17:18.466 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (10m) 19s ago 10m 221M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad 69cb7c22f002 2024-04-12T09:17:18.466 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 running (3m) 17s ago 13m 58.8M - 2.43.0 a07b618ecd1d 43ce588d82cc 2024-04-12T09:17:18.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.466+0000 7fd622247700 1 -- 172.21.15.117:0/1030363412 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fd60806ddc0 msgr2=0x7fd608070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:18.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.466+0000 7fd622247700 1 --2- 172.21.15.117:0/1030363412 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fd60806ddc0 0x7fd608070270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd60c004f90 tx=0x7fd60c009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:18.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.466+0000 7fd622247700 1 -- 172.21.15.117:0/1030363412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61c102e70 msgr2=0x7fd61c114090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:18.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.466+0000 7fd622247700 1 --2- 172.21.15.117:0/1030363412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61c102e70 0x7fd61c114090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd604002a50 tx=0x7fd6040046b0 comp rx=0 tx=0).stop 2024-04-12T09:17:18.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.466+0000 7fd622247700 1 -- 172.21.15.117:0/1030363412 shutdown_connections 2024-04-12T09:17:18.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.466+0000 7fd622247700 1 --2- 172.21.15.117:0/1030363412 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd61c0fb4a0 0x7fd61c113b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:18.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.466+0000 7fd622247700 1 --2- 172.21.15.117:0/1030363412 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fd60806ddc0 0x7fd608070270 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:18.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.466+0000 7fd622247700 1 --2- 172.21.15.117:0/1030363412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd61c102e70 0x7fd61c114090 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:18.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.466+0000 7fd622247700 1 -- 172.21.15.117:0/1030363412 >> 172.21.15.117:0/1030363412 conn(0x7fd61c0714c0 msgr2=0x7fd61c0fa7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:18.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.466+0000 7fd622247700 1 -- 172.21.15.117:0/1030363412 shutdown_connections 2024-04-12T09:17:18.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.467+0000 7fd622247700 1 -- 172.21.15.117:0/1030363412 wait complete. 2024-04-12T09:17:18.581 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.581+0000 7f247a728700 1 -- 172.21.15.117:0/1221991332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24740fddb0 msgr2=0x7f24740fe180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:18.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.581+0000 7f247a728700 1 --2- 172.21.15.117:0/1221991332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24740fddb0 0x7f24740fe180 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2468004940 tx=0x7f2468009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:18.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.581+0000 7f247a728700 1 -- 172.21.15.117:0/1221991332 shutdown_connections 2024-04-12T09:17:18.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.581+0000 7f247a728700 1 --2- 172.21.15.117:0/1221991332 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24740fe750 0x7f2474106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:18.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.581+0000 7f247a728700 1 --2- 172.21.15.117:0/1221991332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24740fddb0 0x7f24740fe180 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:18.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.581+0000 7f247a728700 1 -- 172.21.15.117:0/1221991332 >> 172.21.15.117:0/1221991332 conn(0x7f24740f7860 msgr2=0x7f24740f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:18.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.581+0000 7f247a728700 1 -- 172.21.15.117:0/1221991332 shutdown_connections 2024-04-12T09:17:18.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.581+0000 7f247a728700 1 -- 172.21.15.117:0/1221991332 wait complete. 2024-04-12T09:17:18.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.581+0000 7f247a728700 1 Processor -- start 2024-04-12T09:17:18.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.582+0000 7f247a728700 1 -- start start 2024-04-12T09:17:18.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.582+0000 7f247a728700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24740fddb0 0x7f24740fbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:18.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.582+0000 7f247a728700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24740fe750 0x7f24740fc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:18.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.582+0000 7f247a728700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24740fc6b0 con 0x7f24740fe750 2024-04-12T09:17:18.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.582+0000 7f247a728700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24740fc7f0 con 0x7f24740fddb0 2024-04-12T09:17:18.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.582+0000 7f24737fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24740fe750 0x7f24740fc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:18.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.582+0000 7f24737fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24740fe750 0x7f24740fc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:49498/0 (socket says 172.21.15.117:49498) 2024-04-12T09:17:18.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.582+0000 7f24737fe700 1 -- 172.21.15.117:0/1768966633 learned_addr learned my addr 172.21.15.117:0/1768966633 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:17:18.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.582+0000 7f2473fff700 1 --2- 172.21.15.117:0/1768966633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24740fddb0 0x7f24740fbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:18.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.582+0000 7f24737fe700 1 -- 172.21.15.117:0/1768966633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24740fddb0 msgr2=0x7f24740fbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:18.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.582+0000 7f24737fe700 1 --2- 172.21.15.117:0/1768966633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24740fddb0 0x7f24740fbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:18.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.582+0000 7f24737fe700 1 -- 172.21.15.117:0/1768966633 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2468005040 con 0x7f24740fe750 2024-04-12T09:17:18.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.582+0000 7f24737fe700 1 --2- 172.21.15.117:0/1768966633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24740fe750 0x7f24740fc120 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2464002a50 tx=0x7f24640046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:18.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.582+0000 7f2470ff9700 1 -- 172.21.15.117:0/1768966633 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2464007cc0 con 0x7f24740fe750 2024-04-12T09:17:18.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.583+0000 7f2470ff9700 1 -- 172.21.15.117:0/1768966633 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f246400f040 con 0x7f24740fe750 2024-04-12T09:17:18.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.583+0000 7f247a728700 1 -- 172.21.15.117:0/1768966633 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2474119e80 con 0x7f24740fe750 2024-04-12T09:17:18.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.583+0000 7f2470ff9700 1 -- 172.21.15.117:0/1768966633 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2464009640 con 0x7f24740fe750 2024-04-12T09:17:18.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.583+0000 7f247a728700 1 -- 172.21.15.117:0/1768966633 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247411a280 con 0x7f24740fe750 2024-04-12T09:17:18.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.584+0000 7f247a728700 1 -- 172.21.15.117:0/1768966633 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2474066770 con 0x7f24740fe750 2024-04-12T09:17:18.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.584+0000 7f2470ff9700 1 -- 172.21.15.117:0/1768966633 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 38) v1 ==== 91963+0+0 (secure 0 0 0) 0x7f24640097c0 con 0x7f24740fe750 2024-04-12T09:17:18.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.585+0000 7f2470ff9700 1 --2- 172.21.15.117:0/1768966633 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f245c06ddc0 0x7f245c070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:18.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.585+0000 7f2473fff700 1 --2- 172.21.15.117:0/1768966633 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f245c06ddc0 0x7f245c070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:18.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.585+0000 7f2470ff9700 1 -- 172.21.15.117:0/1768966633 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f246408d4f0 con 0x7f24740fe750 2024-04-12T09:17:18.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.585+0000 7f2473fff700 1 --2- 172.21.15.117:0/1768966633 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f245c06ddc0 0x7f245c070270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2468004f90 tx=0x7f2468009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:18.590 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.589+0000 7f2470ff9700 1 -- 172.21.15.117:0/1768966633 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f2464056900 con 0x7f24740fe750 2024-04-12T09:17:18.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.877+0000 7f247a728700 1 -- 172.21.15.117:0/1768966633 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f247404bed0 con 0x7f24740fe750 2024-04-12T09:17:18.879 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.878+0000 7f2470ff9700 1 -- 172.21.15.117:0/1768966633 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f2464059fc0 con 0x7f24740fe750 2024-04-12T09:17:18.879 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:17:18.879 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": { 2024-04-12T09:17:18.879 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:17:18.879 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:17:18.880 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": { 2024-04-12T09:17:18.880 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:17:18.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:17:18.880 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": { 2024-04-12T09:17:18.880 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 5 2024-04-12T09:17:18.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:17:18.880 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-04-12T09:17:18.880 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 4 2024-04-12T09:17:18.880 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:17:18.880 INFO:teuthology.orchestra.run.smithi117.stdout: "overall": { 2024-04-12T09:17:18.881 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 9, 2024-04-12T09:17:18.881 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 4 2024-04-12T09:17:18.881 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:17:18.881 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:17:18.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.880+0000 7f247a728700 1 -- 172.21.15.117:0/1768966633 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f245c06ddc0 msgr2=0x7f245c070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:18.881 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.880+0000 7f247a728700 1 --2- 172.21.15.117:0/1768966633 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f245c06ddc0 0x7f245c070270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2468004f90 tx=0x7f2468009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:18.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.880+0000 7f247a728700 1 -- 172.21.15.117:0/1768966633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24740fe750 msgr2=0x7f24740fc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:18.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.880+0000 7f247a728700 1 --2- 172.21.15.117:0/1768966633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24740fe750 0x7f24740fc120 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2464002a50 tx=0x7f24640046b0 comp rx=0 tx=0).stop 2024-04-12T09:17:18.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.880+0000 7f247a728700 1 -- 172.21.15.117:0/1768966633 shutdown_connections 2024-04-12T09:17:18.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.880+0000 7f247a728700 1 --2- 172.21.15.117:0/1768966633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24740fddb0 0x7f24740fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:18.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.880+0000 7f247a728700 1 --2- 172.21.15.117:0/1768966633 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f245c06ddc0 0x7f245c070270 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:18.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.880+0000 7f247a728700 1 --2- 172.21.15.117:0/1768966633 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f24740fe750 0x7f24740fc120 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:18.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.880+0000 7f247a728700 1 -- 172.21.15.117:0/1768966633 >> 172.21.15.117:0/1768966633 conn(0x7f24740f7860 msgr2=0x7f24740f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:18.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.880+0000 7f247a728700 1 -- 172.21.15.117:0/1768966633 shutdown_connections 2024-04-12T09:17:18.882 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.880+0000 7f247a728700 1 -- 172.21.15.117:0/1768966633 wait complete. 2024-04-12T09:17:18.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.982+0000 7fc71d062700 1 -- 172.21.15.117:0/1301035798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc718101d70 msgr2=0x7fc718102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:18.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.982+0000 7fc71d062700 1 --2- 172.21.15.117:0/1301035798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc718101d70 0x7fc718102140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc70c004940 tx=0x7fc70c009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:18.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.982+0000 7fc71d062700 1 -- 172.21.15.117:0/1301035798 shutdown_connections 2024-04-12T09:17:18.983 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.982+0000 7fc71d062700 1 --2- 172.21.15.117:0/1301035798 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc718102710 0x7fc7180fbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:18.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.982+0000 7fc71d062700 1 --2- 172.21.15.117:0/1301035798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc718101d70 0x7fc718102140 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:18.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.982+0000 7fc71d062700 1 -- 172.21.15.117:0/1301035798 >> 172.21.15.117:0/1301035798 conn(0x7fc718072bc0 msgr2=0x7fc718072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:18.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.982+0000 7fc71d062700 1 -- 172.21.15.117:0/1301035798 shutdown_connections 2024-04-12T09:17:18.984 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.982+0000 7fc71d062700 1 -- 172.21.15.117:0/1301035798 wait complete. 2024-04-12T09:17:18.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.983+0000 7fc71d062700 1 Processor -- start 2024-04-12T09:17:18.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.983+0000 7fc71d062700 1 -- start start 2024-04-12T09:17:18.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.983+0000 7fc71d062700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc718101d70 0x7fc718113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:18.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.983+0000 7fc71d062700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc718102710 0x7fc718114060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:18.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.983+0000 7fc71d062700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7181146b0 con 0x7fc718102710 2024-04-12T09:17:18.985 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.983+0000 7fc71d062700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71810daa0 con 0x7fc718101d70 2024-04-12T09:17:18.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.983+0000 7fc71659c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc718102710 0x7fc718114060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:18.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.983+0000 7fc71659c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc718102710 0x7fc718114060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:49506/0 (socket says 172.21.15.117:49506) 2024-04-12T09:17:18.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.983+0000 7fc71659c700 1 -- 172.21.15.117:0/2245891901 learned_addr learned my addr 172.21.15.117:0/2245891901 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:17:18.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.984+0000 7fc716d9d700 1 --2- 172.21.15.117:0/2245891901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc718101d70 0x7fc718113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:18.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.984+0000 7fc71659c700 1 -- 172.21.15.117:0/2245891901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc718101d70 msgr2=0x7fc718113b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:18.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.984+0000 7fc71659c700 1 --2- 172.21.15.117:0/2245891901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc718101d70 0x7fc718113b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:18.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.984+0000 7fc71659c700 1 -- 172.21.15.117:0/2245891901 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70c005040 con 0x7fc718102710 2024-04-12T09:17:18.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.984+0000 7fc71659c700 1 --2- 172.21.15.117:0/2245891901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc718102710 0x7fc718114060 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc708002a50 tx=0x7fc708004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:18.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.984+0000 7fc6ff7fe700 1 -- 172.21.15.117:0/2245891901 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc708007cc0 con 0x7fc718102710 2024-04-12T09:17:18.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.984+0000 7fc6ff7fe700 1 -- 172.21.15.117:0/2245891901 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc70800f040 con 0x7fc718102710 2024-04-12T09:17:18.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.984+0000 7fc6ff7fe700 1 -- 172.21.15.117:0/2245891901 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc70800d9c0 con 0x7fc718102710 2024-04-12T09:17:18.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.984+0000 7fc71d062700 1 -- 172.21.15.117:0/2245891901 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc71810dd80 con 0x7fc718102710 2024-04-12T09:17:18.986 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.984+0000 7fc71d062700 1 -- 172.21.15.117:0/2245891901 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc71810e340 con 0x7fc718102710 2024-04-12T09:17:18.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.985+0000 7fc71d062700 1 -- 172.21.15.117:0/2245891901 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7180fd4c0 con 0x7fc718102710 2024-04-12T09:17:18.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.985+0000 7fc6ff7fe700 1 -- 172.21.15.117:0/2245891901 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 38) v1 ==== 91963+0+0 (secure 0 0 0) 0x7fc70800db40 con 0x7fc718102710 2024-04-12T09:17:18.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.986+0000 7fc6ff7fe700 1 --2- 172.21.15.117:0/2245891901 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc70006ddc0 0x7fc700070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:18.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.986+0000 7fc6ff7fe700 1 -- 172.21.15.117:0/2245891901 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc70808d4d0 con 0x7fc718102710 2024-04-12T09:17:18.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.986+0000 7fc716d9d700 1 --2- 172.21.15.117:0/2245891901 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc70006ddc0 0x7fc700070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:18.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.986+0000 7fc716d9d700 1 --2- 172.21.15.117:0/2245891901 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc70006ddc0 0x7fc700070270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc70c004f90 tx=0x7fc70c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:18.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:18.990+0000 7fc6ff7fe700 1 -- 172.21.15.117:0/2245891901 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc70805a410 con 0x7fc718102710 2024-04-12T09:17:19.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.233+0000 7fc71d062700 1 -- 172.21.15.117:0/2245891901 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc71804bed0 con 0x7fc718102710 2024-04-12T09:17:19.234 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.233+0000 7fc6ff7fe700 1 -- 172.21.15.117:0/2245891901 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1884 (secure 0 0 0) 0x7fc708059fa0 con 0x7fc718102710 2024-04-12T09:17:19.234 INFO:teuthology.orchestra.run.smithi117.stdout:e14 2024-04-12T09:17:19.234 INFO:teuthology.orchestra.run.smithi117.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T09:17:19.234 INFO:teuthology.orchestra.run.smithi117.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:17:19.234 INFO:teuthology.orchestra.run.smithi117.stdout:legacy client fscid: 1 2024-04-12T09:17:19.235 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:17:19.235 INFO:teuthology.orchestra.run.smithi117.stdout:Filesystem 'cephfs' (1) 2024-04-12T09:17:19.235 INFO:teuthology.orchestra.run.smithi117.stdout:fs_name cephfs 2024-04-12T09:17:19.235 INFO:teuthology.orchestra.run.smithi117.stdout:epoch 14 2024-04-12T09:17:19.235 INFO:teuthology.orchestra.run.smithi117.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T09:17:19.235 INFO:teuthology.orchestra.run.smithi117.stdout:created 2024-04-12T09:08:12.488144+0000 2024-04-12T09:17:19.235 INFO:teuthology.orchestra.run.smithi117.stdout:modified 2024-04-12T09:08:30.563184+0000 2024-04-12T09:17:19.235 INFO:teuthology.orchestra.run.smithi117.stdout:tableserver 0 2024-04-12T09:17:19.235 INFO:teuthology.orchestra.run.smithi117.stdout:root 0 2024-04-12T09:17:19.235 INFO:teuthology.orchestra.run.smithi117.stdout:session_timeout 60 2024-04-12T09:17:19.235 INFO:teuthology.orchestra.run.smithi117.stdout:session_autoclose 300 2024-04-12T09:17:19.235 INFO:teuthology.orchestra.run.smithi117.stdout:max_file_size 1099511627776 2024-04-12T09:17:19.235 INFO:teuthology.orchestra.run.smithi117.stdout:max_xattr_size 65536 2024-04-12T09:17:19.235 INFO:teuthology.orchestra.run.smithi117.stdout:required_client_features {} 2024-04-12T09:17:19.235 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure 0 2024-04-12T09:17:19.236 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure_osd_epoch 46 2024-04-12T09:17:19.236 INFO:teuthology.orchestra.run.smithi117.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:17:19.236 INFO:teuthology.orchestra.run.smithi117.stdout:max_mds 1 2024-04-12T09:17:19.236 INFO:teuthology.orchestra.run.smithi117.stdout:in 0 2024-04-12T09:17:19.236 INFO:teuthology.orchestra.run.smithi117.stdout:up {0=14474} 2024-04-12T09:17:19.236 INFO:teuthology.orchestra.run.smithi117.stdout:failed 2024-04-12T09:17:19.236 INFO:teuthology.orchestra.run.smithi117.stdout:damaged 2024-04-12T09:17:19.236 INFO:teuthology.orchestra.run.smithi117.stdout:stopped 2024-04-12T09:17:19.236 INFO:teuthology.orchestra.run.smithi117.stdout:data_pools [3] 2024-04-12T09:17:19.236 INFO:teuthology.orchestra.run.smithi117.stdout:metadata_pool 2 2024-04-12T09:17:19.236 INFO:teuthology.orchestra.run.smithi117.stdout:inline_data disabled 2024-04-12T09:17:19.236 INFO:teuthology.orchestra.run.smithi117.stdout:balancer 2024-04-12T09:17:19.236 INFO:teuthology.orchestra.run.smithi117.stdout:bal_rank_mask -1 2024-04-12T09:17:19.236 INFO:teuthology.orchestra.run.smithi117.stdout:standby_count_wanted 1 2024-04-12T09:17:19.237 INFO:teuthology.orchestra.run.smithi117.stdout:qdb_cluster leader: 0 members: 2024-04-12T09:17:19.237 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.eslmxh{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.117:6828/2248590199,v1:172.21.15.117:6829/2248590199] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:17:19.237 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:17:19.237 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:17:19.237 INFO:teuthology.orchestra.run.smithi117.stdout:Standby daemons: 2024-04-12T09:17:19.237 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:17:19.237 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.wddsgt{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/4010127141,v1:172.21.15.117:6827/4010127141] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:17:19.237 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.fbeixl{-1:24265} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.203:6824/840607003,v1:172.21.15.203:6825/840607003] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:17:19.237 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.bszhxz{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/2731911290,v1:172.21.15.203:6827/2731911290] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:17:19.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.236+0000 7fc71d062700 1 -- 172.21.15.117:0/2245891901 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc70006ddc0 msgr2=0x7fc700070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:19.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.236+0000 7fc71d062700 1 --2- 172.21.15.117:0/2245891901 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc70006ddc0 0x7fc700070270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc70c004f90 tx=0x7fc70c009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:19.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.236+0000 7fc71d062700 1 -- 172.21.15.117:0/2245891901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc718102710 msgr2=0x7fc718114060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:19.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.236+0000 7fc71d062700 1 --2- 172.21.15.117:0/2245891901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc718102710 0x7fc718114060 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc708002a50 tx=0x7fc708004600 comp rx=0 tx=0).stop 2024-04-12T09:17:19.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.236+0000 7fc71d062700 1 -- 172.21.15.117:0/2245891901 shutdown_connections 2024-04-12T09:17:19.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.236+0000 7fc71d062700 1 --2- 172.21.15.117:0/2245891901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc718101d70 0x7fc718113b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:19.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.236+0000 7fc71d062700 1 --2- 172.21.15.117:0/2245891901 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc70006ddc0 0x7fc700070270 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:19.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.236+0000 7fc71d062700 1 --2- 172.21.15.117:0/2245891901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc718102710 0x7fc718114060 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:19.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.236+0000 7fc71d062700 1 -- 172.21.15.117:0/2245891901 >> 172.21.15.117:0/2245891901 conn(0x7fc718072bc0 msgr2=0x7fc718105770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:19.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.236+0000 7fc71d062700 1 -- 172.21.15.117:0/2245891901 shutdown_connections 2024-04-12T09:17:19.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.236+0000 7fc71d062700 1 -- 172.21.15.117:0/2245891901 wait complete. 2024-04-12T09:17:19.238 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 14 2024-04-12T09:17:19.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:19 smithi203 ceph-mon[86783]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:17:19.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:19 smithi203 ceph-mon[86783]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:17:19.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:19 smithi203 ceph-mon[86783]: pgmap v47: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 40/225 objects degraded (17.778%) 2024-04-12T09:17:19.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:19 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/1768966633' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:17:19.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.355+0000 7fc394171700 1 -- 172.21.15.117:0/491027180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc38c0fe7b0 msgr2=0x7fc38c106df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:19.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.355+0000 7fc394171700 1 --2- 172.21.15.117:0/491027180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc38c0fe7b0 0x7fc38c106df0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc37c004940 tx=0x7fc37c009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:19.356 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:19 smithi117 ceph-mon[113571]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:17:19.357 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:19 smithi117 ceph-mon[113571]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:17:19.357 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:19 smithi117 ceph-mon[113571]: pgmap v47: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 40/225 objects degraded (17.778%) 2024-04-12T09:17:19.357 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:19 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/1768966633' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:17:19.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.355+0000 7fc394171700 1 -- 172.21.15.117:0/491027180 shutdown_connections 2024-04-12T09:17:19.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.355+0000 7fc394171700 1 --2- 172.21.15.117:0/491027180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc38c0fe7b0 0x7fc38c106df0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:19.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.355+0000 7fc394171700 1 --2- 172.21.15.117:0/491027180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc38c0fde10 0x7fc38c0fe1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:19.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.355+0000 7fc394171700 1 -- 172.21.15.117:0/491027180 >> 172.21.15.117:0/491027180 conn(0x7fc38c0f7880 msgr2=0x7fc38c0f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:19.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.355+0000 7fc394171700 1 -- 172.21.15.117:0/491027180 shutdown_connections 2024-04-12T09:17:19.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.356+0000 7fc394171700 1 -- 172.21.15.117:0/491027180 wait complete. 2024-04-12T09:17:19.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.357+0000 7fc394171700 1 Processor -- start 2024-04-12T09:17:19.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.357+0000 7fc394171700 1 -- start start 2024-04-12T09:17:19.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.357+0000 7fc394171700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc38c0fde10 0x7fc38c113f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:19.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.357+0000 7fc394171700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc38c0fe7b0 0x7fc38c114460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:19.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.357+0000 7fc394171700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c114ab0 con 0x7fc38c0fe7b0 2024-04-12T09:17:19.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.357+0000 7fc394171700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c10de80 con 0x7fc38c0fde10 2024-04-12T09:17:19.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.357+0000 7fc39170c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc38c0fe7b0 0x7fc38c114460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:19.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.357+0000 7fc39170c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc38c0fe7b0 0x7fc38c114460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:49520/0 (socket says 172.21.15.117:49520) 2024-04-12T09:17:19.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.357+0000 7fc39170c700 1 -- 172.21.15.117:0/4282866998 learned_addr learned my addr 172.21.15.117:0/4282866998 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:17:19.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.358+0000 7fc391f0d700 1 --2- 172.21.15.117:0/4282866998 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc38c0fde10 0x7fc38c113f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:19.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.358+0000 7fc39170c700 1 -- 172.21.15.117:0/4282866998 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc38c0fde10 msgr2=0x7fc38c113f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:19.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.358+0000 7fc39170c700 1 --2- 172.21.15.117:0/4282866998 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc38c0fde10 0x7fc38c113f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:19.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.358+0000 7fc39170c700 1 -- 172.21.15.117:0/4282866998 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c005040 con 0x7fc38c0fe7b0 2024-04-12T09:17:19.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.358+0000 7fc39170c700 1 --2- 172.21.15.117:0/4282866998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc38c0fe7b0 0x7fc38c114460 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc37c009380 tx=0x7fc37c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:19.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.358+0000 7fc3827fc700 1 -- 172.21.15.117:0/4282866998 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc37c00e040 con 0x7fc38c0fe7b0 2024-04-12T09:17:19.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.359+0000 7fc3827fc700 1 -- 172.21.15.117:0/4282866998 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc37c009af0 con 0x7fc38c0fe7b0 2024-04-12T09:17:19.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.359+0000 7fc394171700 1 -- 172.21.15.117:0/4282866998 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc38c10e100 con 0x7fc38c0fe7b0 2024-04-12T09:17:19.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.359+0000 7fc3827fc700 1 -- 172.21.15.117:0/4282866998 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc37c01c3f0 con 0x7fc38c0fe7b0 2024-04-12T09:17:19.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.359+0000 7fc394171700 1 -- 172.21.15.117:0/4282866998 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc38c10e640 con 0x7fc38c0fe7b0 2024-04-12T09:17:19.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.360+0000 7fc394171700 1 -- 172.21.15.117:0/4282866998 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc38c066770 con 0x7fc38c0fe7b0 2024-04-12T09:17:19.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.360+0000 7fc3827fc700 1 -- 172.21.15.117:0/4282866998 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 38) v1 ==== 91963+0+0 (secure 0 0 0) 0x7fc37c00baf0 con 0x7fc38c0fe7b0 2024-04-12T09:17:19.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.361+0000 7fc3827fc700 1 --2- 172.21.15.117:0/4282866998 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc37806ddc0 0x7fc378070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:19.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.361+0000 7fc3827fc700 1 -- 172.21.15.117:0/4282866998 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc37c08e9c0 con 0x7fc38c0fe7b0 2024-04-12T09:17:19.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.361+0000 7fc391f0d700 1 --2- 172.21.15.117:0/4282866998 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc37806ddc0 0x7fc378070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:19.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.361+0000 7fc391f0d700 1 --2- 172.21.15.117:0/4282866998 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc37806ddc0 0x7fc378070270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc388004f40 tx=0x7fc38800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:19.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.365+0000 7fc3827fc700 1 -- 172.21.15.117:0/4282866998 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc37c05b980 con 0x7fc38c0fe7b0 2024-04-12T09:17:19.584 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.583+0000 7fc394171700 1 -- 172.21.15.117:0/4282866998 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc38c109ea0 con 0x7fc37806ddc0 2024-04-12T09:17:19.585 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.585+0000 7fc3827fc700 1 -- 172.21.15.117:0/4282866998 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc38c109ea0 con 0x7fc37806ddc0 2024-04-12T09:17:19.585 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:17:19.585 INFO:teuthology.orchestra.run.smithi117.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec", 2024-04-12T09:17:19.586 INFO:teuthology.orchestra.run.smithi117.stdout: "in_progress": true, 2024-04-12T09:17:19.586 INFO:teuthology.orchestra.run.smithi117.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T09:17:19.586 INFO:teuthology.orchestra.run.smithi117.stdout: "services_complete": [ 2024-04-12T09:17:19.586 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr", 2024-04-12T09:17:19.586 INFO:teuthology.orchestra.run.smithi117.stdout: "mon", 2024-04-12T09:17:19.586 INFO:teuthology.orchestra.run.smithi117.stdout: "crash" 2024-04-12T09:17:19.586 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2024-04-12T09:17:19.586 INFO:teuthology.orchestra.run.smithi117.stdout: "progress": "6/21 daemons upgraded", 2024-04-12T09:17:19.586 INFO:teuthology.orchestra.run.smithi117.stdout: "message": "Currently upgrading osd daemons", 2024-04-12T09:17:19.586 INFO:teuthology.orchestra.run.smithi117.stdout: "is_paused": false 2024-04-12T09:17:19.586 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:17:19.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.587+0000 7fc394171700 1 -- 172.21.15.117:0/4282866998 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc37806ddc0 msgr2=0x7fc378070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:19.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.587+0000 7fc394171700 1 --2- 172.21.15.117:0/4282866998 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc37806ddc0 0x7fc378070270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc388004f40 tx=0x7fc38800b040 comp rx=0 tx=0).stop 2024-04-12T09:17:19.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.587+0000 7fc394171700 1 -- 172.21.15.117:0/4282866998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc38c0fe7b0 msgr2=0x7fc38c114460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:19.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.587+0000 7fc394171700 1 --2- 172.21.15.117:0/4282866998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc38c0fe7b0 0x7fc38c114460 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc37c009380 tx=0x7fc37c009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:19.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.587+0000 7fc394171700 1 -- 172.21.15.117:0/4282866998 shutdown_connections 2024-04-12T09:17:19.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.587+0000 7fc394171700 1 --2- 172.21.15.117:0/4282866998 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc38c0fde10 0x7fc38c113f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:19.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.587+0000 7fc394171700 1 --2- 172.21.15.117:0/4282866998 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc37806ddc0 0x7fc378070270 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:19.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.587+0000 7fc394171700 1 --2- 172.21.15.117:0/4282866998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc38c0fe7b0 0x7fc38c114460 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:19.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.587+0000 7fc394171700 1 -- 172.21.15.117:0/4282866998 >> 172.21.15.117:0/4282866998 conn(0x7fc38c0f7880 msgr2=0x7fc38c0f8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:19.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.587+0000 7fc394171700 1 -- 172.21.15.117:0/4282866998 shutdown_connections 2024-04-12T09:17:19.588 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.587+0000 7fc394171700 1 -- 172.21.15.117:0/4282866998 wait complete. 2024-04-12T09:17:19.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.694+0000 7fe0d0f1c700 1 -- 172.21.15.117:0/3226624805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0cc070360 msgr2=0x7fe0cc070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:19.696 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.694+0000 7fe0d0f1c700 1 --2- 172.21.15.117:0/3226624805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0cc070360 0x7fe0cc070730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009d10 tx=0x7fe0bc004d10 comp rx=0 tx=0).stop 2024-04-12T09:17:19.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.694+0000 7fe0d0f1c700 1 -- 172.21.15.117:0/3226624805 shutdown_connections 2024-04-12T09:17:19.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.694+0000 7fe0d0f1c700 1 --2- 172.21.15.117:0/3226624805 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0cc070c70 0x7fe0cc109120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:19.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.694+0000 7fe0d0f1c700 1 --2- 172.21.15.117:0/3226624805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0cc070360 0x7fe0cc070730 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:19.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.694+0000 7fe0d0f1c700 1 -- 172.21.15.117:0/3226624805 >> 172.21.15.117:0/3226624805 conn(0x7fe0cc0f8980 msgr2=0x7fe0cc0fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:19.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.694+0000 7fe0d0f1c700 1 -- 172.21.15.117:0/3226624805 shutdown_connections 2024-04-12T09:17:19.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.694+0000 7fe0d0f1c700 1 -- 172.21.15.117:0/3226624805 wait complete. 2024-04-12T09:17:19.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.695+0000 7fe0d0f1c700 1 Processor -- start 2024-04-12T09:17:19.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.695+0000 7fe0d0f1c700 1 -- start start 2024-04-12T09:17:19.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.695+0000 7fe0d0f1c700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0cc070360 0x7fe0cc115da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:19.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.695+0000 7fe0d0f1c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0cc070c70 0x7fe0cc1162e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:19.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.695+0000 7fe0d0f1c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc116930 con 0x7fe0cc070c70 2024-04-12T09:17:19.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.695+0000 7fe0d0f1c700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc10fd00 con 0x7fe0cc070360 2024-04-12T09:17:19.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.695+0000 7fe0c9d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0cc070c70 0x7fe0cc1162e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:19.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.695+0000 7fe0c9d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0cc070c70 0x7fe0cc1162e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57462/0 (socket says 172.21.15.117:57462) 2024-04-12T09:17:19.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.695+0000 7fe0c9d9b700 1 -- 172.21.15.117:0/521858299 learned_addr learned my addr 172.21.15.117:0/521858299 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:17:19.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.695+0000 7fe0ca59c700 1 --2- 172.21.15.117:0/521858299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0cc070360 0x7fe0cc115da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:19.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.695+0000 7fe0c9d9b700 1 -- 172.21.15.117:0/521858299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0cc070360 msgr2=0x7fe0cc115da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:19.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.695+0000 7fe0c9d9b700 1 --2- 172.21.15.117:0/521858299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0cc070360 0x7fe0cc115da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:19.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.695+0000 7fe0c9d9b700 1 -- 172.21.15.117:0/521858299 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc009940 con 0x7fe0cc070c70 2024-04-12T09:17:19.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.695+0000 7fe0c9d9b700 1 --2- 172.21.15.117:0/521858299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0cc070c70 0x7fe0cc1162e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400eb40 tx=0x7fe0b400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:19.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.695+0000 7fe0c2ffd700 1 -- 172.21.15.117:0/521858299 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0b4007cc0 con 0x7fe0cc070c70 2024-04-12T09:17:19.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.696+0000 7fe0c2ffd700 1 -- 172.21.15.117:0/521858299 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe0b400f040 con 0x7fe0cc070c70 2024-04-12T09:17:19.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.696+0000 7fe0d0f1c700 1 -- 172.21.15.117:0/521858299 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0cc10ff80 con 0x7fe0cc070c70 2024-04-12T09:17:19.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.696+0000 7fe0c2ffd700 1 -- 172.21.15.117:0/521858299 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0b4009620 con 0x7fe0cc070c70 2024-04-12T09:17:19.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.696+0000 7fe0d0f1c700 1 -- 172.21.15.117:0/521858299 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0cc1104c0 con 0x7fe0cc070c70 2024-04-12T09:17:19.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.697+0000 7fe0d0f1c700 1 -- 172.21.15.117:0/521858299 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0cc071aa0 con 0x7fe0cc070c70 2024-04-12T09:17:19.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.697+0000 7fe0c2ffd700 1 -- 172.21.15.117:0/521858299 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 38) v1 ==== 91963+0+0 (secure 0 0 0) 0x7fe0b4009780 con 0x7fe0cc070c70 2024-04-12T09:17:19.699 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.697+0000 7fe0c2ffd700 1 --2- 172.21.15.117:0/521858299 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe0b806ddc0 0x7fe0b8070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:19.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.697+0000 7fe0c2ffd700 1 -- 172.21.15.117:0/521858299 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe0b408d3d0 con 0x7fe0cc070c70 2024-04-12T09:17:19.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.697+0000 7fe0ca59c700 1 --2- 172.21.15.117:0/521858299 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe0b806ddc0 0x7fe0b8070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:19.700 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.698+0000 7fe0ca59c700 1 --2- 172.21.15.117:0/521858299 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe0b806ddc0 0x7fe0b8070270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc003400 tx=0x7fe0bc004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:19.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:19.702+0000 7fe0c2ffd700 1 -- 172.21.15.117:0/521858299 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fe0b405a3c0 con 0x7fe0cc070c70 2024-04-12T09:17:20.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:20.023+0000 7fe0d0f1c700 1 -- 172.21.15.117:0/521858299 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe0cc05f5f0 con 0x7fe0cc070c70 2024-04-12T09:17:20.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:20.024+0000 7fe0c2ffd700 1 -- 172.21.15.117:0/521858299 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1271 (secure 0 0 0) 0x7fe0b4059f50 con 0x7fe0cc070c70 2024-04-12T09:17:20.025 INFO:teuthology.orchestra.run.smithi117.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 40/225 objects degraded (17.778%), 18 pgs degraded 2024-04-12T09:17:20.025 INFO:teuthology.orchestra.run.smithi117.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-12T09:17:20.025 INFO:teuthology.orchestra.run.smithi117.stdout: osd.0 (root=default,host=smithi117) is down 2024-04-12T09:17:20.025 INFO:teuthology.orchestra.run.smithi117.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 40/225 objects degraded (17.778%), 18 pgs degraded 2024-04-12T09:17:20.025 INFO:teuthology.orchestra.run.smithi117.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-04-12T09:17:20.025 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-04-12T09:17:20.025 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-04-12T09:17:20.025 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-04-12T09:17:20.025 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-04-12T09:17:20.026 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-04-12T09:17:20.026 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-04-12T09:17:20.026 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-04-12T09:17:20.026 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-04-12T09:17:20.026 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-04-12T09:17:20.026 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-04-12T09:17:20.026 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-04-12T09:17:20.026 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-04-12T09:17:20.026 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-04-12T09:17:20.026 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-04-12T09:17:20.026 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-04-12T09:17:20.026 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-04-12T09:17:20.026 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-04-12T09:17:20.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:20.026+0000 7fe0d0f1c700 1 -- 172.21.15.117:0/521858299 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe0b806ddc0 msgr2=0x7fe0b8070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:20.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:20.026+0000 7fe0d0f1c700 1 --2- 172.21.15.117:0/521858299 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe0b806ddc0 0x7fe0b8070270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc003400 tx=0x7fe0bc004d10 comp rx=0 tx=0).stop 2024-04-12T09:17:20.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:20.026+0000 7fe0d0f1c700 1 -- 172.21.15.117:0/521858299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0cc070c70 msgr2=0x7fe0cc1162e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:20.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:20.026+0000 7fe0d0f1c700 1 --2- 172.21.15.117:0/521858299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0cc070c70 0x7fe0cc1162e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400eb40 tx=0x7fe0b400b040 comp rx=0 tx=0).stop 2024-04-12T09:17:20.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:20.026+0000 7fe0d0f1c700 1 -- 172.21.15.117:0/521858299 shutdown_connections 2024-04-12T09:17:20.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:20.026+0000 7fe0d0f1c700 1 --2- 172.21.15.117:0/521858299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0cc070360 0x7fe0cc115da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:20.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:20.026+0000 7fe0d0f1c700 1 --2- 172.21.15.117:0/521858299 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe0b806ddc0 0x7fe0b8070270 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:20.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:20.026+0000 7fe0d0f1c700 1 --2- 172.21.15.117:0/521858299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0cc070c70 0x7fe0cc1162e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:20.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:20.026+0000 7fe0d0f1c700 1 -- 172.21.15.117:0/521858299 >> 172.21.15.117:0/521858299 conn(0x7fe0cc0f8980 msgr2=0x7fe0cc0f9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:20.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:20.026+0000 7fe0d0f1c700 1 -- 172.21.15.117:0/521858299 shutdown_connections 2024-04-12T09:17:20.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:20.026+0000 7fe0d0f1c700 1 -- 172.21.15.117:0/521858299 wait complete. 2024-04-12T09:17:20.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:20 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/2245891901' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:17:20.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:20 smithi203 ceph-mon[86783]: from='client.34206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:17:20.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:20 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/521858299' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:17:20.354 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:20 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/2245891901' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:17:20.354 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:20 smithi117 ceph-mon[113571]: from='client.34206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:17:20.355 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:20 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/521858299' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:17:21.317 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:21 smithi117 ceph-mon[113571]: pgmap v48: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 40/225 objects degraded (17.778%) 2024-04-12T09:17:21.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:21 smithi203 ceph-mon[86783]: pgmap v48: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 206 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 40/225 objects degraded (17.778%) 2024-04-12T09:17:22.410 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:22 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0[125086]: 2024-04-12T09:17:22.355+0000 7f105b25e7c0 -1 osd.0 49 log_to_monitors true 2024-04-12T09:17:22.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:22 smithi203 ceph-mon[86783]: from='osd.0 [v2:172.21.15.117:6802/1144390473,v1:172.21.15.117:6803/1144390473]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-12T09:17:22.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:22 smithi117 ceph-mon[113571]: from='osd.0 [v2:172.21.15.117:6802/1144390473,v1:172.21.15.117:6803/1144390473]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-12T09:17:22.910 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:17:22 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0[125086]: 2024-04-12T09:17:22.430+0000 7f104c6b6700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T09:17:23.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:23 smithi203 ceph-mon[86783]: from='osd.0 [v2:172.21.15.117:6802/1144390473,v1:172.21.15.117:6803/1144390473]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-12T09:17:23.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:23 smithi203 ceph-mon[86783]: osdmap e52: 6 total, 5 up, 6 in 2024-04-12T09:17:23.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:23 smithi203 ceph-mon[86783]: from='osd.0 [v2:172.21.15.117:6802/1144390473,v1:172.21.15.117:6803/1144390473]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-04-12T09:17:23.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:23 smithi203 ceph-mon[86783]: pgmap v50: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 40/225 objects degraded (17.778%) 2024-04-12T09:17:23.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:23 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:23.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:23 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:23.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:23 smithi117 ceph-mon[113571]: from='osd.0 [v2:172.21.15.117:6802/1144390473,v1:172.21.15.117:6803/1144390473]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-12T09:17:23.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:23 smithi117 ceph-mon[113571]: osdmap e52: 6 total, 5 up, 6 in 2024-04-12T09:17:23.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:23 smithi117 ceph-mon[113571]: from='osd.0 [v2:172.21.15.117:6802/1144390473,v1:172.21.15.117:6803/1144390473]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-04-12T09:17:23.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:23 smithi117 ceph-mon[113571]: pgmap v50: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 40/225 objects degraded (17.778%) 2024-04-12T09:17:23.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:23 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:23.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:23 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:24.744 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:24 smithi117 ceph-mon[113571]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-12T09:17:24.744 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:24 smithi117 ceph-mon[113571]: osd.0 [v2:172.21.15.117:6802/1144390473,v1:172.21.15.117:6803/1144390473] boot 2024-04-12T09:17:24.744 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:24 smithi117 ceph-mon[113571]: osdmap e53: 6 total, 6 up, 6 in 2024-04-12T09:17:24.744 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:24 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T09:17:24.744 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:24 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:24.744 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:24 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:24.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:24 smithi203 ceph-mon[86783]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-12T09:17:24.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:24 smithi203 ceph-mon[86783]: osd.0 [v2:172.21.15.117:6802/1144390473,v1:172.21.15.117:6803/1144390473] boot 2024-04-12T09:17:24.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:24 smithi203 ceph-mon[86783]: osdmap e53: 6 total, 6 up, 6 in 2024-04-12T09:17:24.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:24 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-12T09:17:24.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:24 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:24.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:24 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:25.733 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:25 smithi117 ceph-mon[113571]: osdmap e54: 6 total, 6 up, 6 in 2024-04-12T09:17:25.733 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:25 smithi117 ceph-mon[113571]: pgmap v53: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 40/225 objects degraded (17.778%) 2024-04-12T09:17:25.733 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:25 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:25.733 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:25 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:17:25.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:25 smithi203 ceph-mon[86783]: osdmap e54: 6 total, 6 up, 6 in 2024-04-12T09:17:25.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:25 smithi203 ceph-mon[86783]: pgmap v53: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 40/225 objects degraded (17.778%) 2024-04-12T09:17:25.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:25 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:25.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:25 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:17:27.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:27 smithi117 ceph-mon[113571]: pgmap v54: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s; 7/225 objects degraded (3.111%) 2024-04-12T09:17:27.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:27 smithi117 ceph-mon[113571]: mgrmap e39: smithi117.oyaxql(active, since 92s), standbys: smithi203.apfqpo 2024-04-12T09:17:27.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:27 smithi117 ceph-mon[113571]: Health check update: Degraded data redundancy: 7/225 objects degraded (3.111%), 3 pgs degraded (PG_DEGRADED) 2024-04-12T09:17:27.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:27 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:27.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:27 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:27.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:27 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:17:27.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:27 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:17:27.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:27 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:27.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:27 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:17:27.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:27 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:17:27.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:27 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:17:27.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:27 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:17:27.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:27 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-12T09:17:28.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:27 smithi203 ceph-mon[86783]: pgmap v54: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s; 7/225 objects degraded (3.111%) 2024-04-12T09:17:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:27 smithi203 ceph-mon[86783]: mgrmap e39: smithi117.oyaxql(active, since 92s), standbys: smithi203.apfqpo 2024-04-12T09:17:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:27 smithi203 ceph-mon[86783]: Health check update: Degraded data redundancy: 7/225 objects degraded (3.111%), 3 pgs degraded (PG_DEGRADED) 2024-04-12T09:17:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:27 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:27 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:27 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:17:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:27 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:17:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:27 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:27 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:17:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:27 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:17:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:27 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:17:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:27 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:17:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:27 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-12T09:17:28.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:28 smithi117 ceph-mon[113571]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-12T09:17:28.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:28 smithi117 ceph-mon[113571]: Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2024-04-12T09:17:29.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:28 smithi203 ceph-mon[86783]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-12T09:17:29.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:28 smithi203 ceph-mon[86783]: Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2024-04-12T09:17:29.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:29 smithi117 ceph-mon[113571]: pgmap v55: 65 pgs: 65 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 498 B/s wr, 0 op/s 2024-04-12T09:17:29.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:29 smithi117 ceph-mon[113571]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/225 objects degraded (3.111%), 3 pgs degraded) 2024-04-12T09:17:29.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:29 smithi117 ceph-mon[113571]: Cluster is now healthy 2024-04-12T09:17:30.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:29 smithi203 ceph-mon[86783]: pgmap v55: 65 pgs: 65 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 498 B/s wr, 0 op/s 2024-04-12T09:17:30.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:29 smithi203 ceph-mon[86783]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/225 objects degraded (3.111%), 3 pgs degraded) 2024-04-12T09:17:30.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:29 smithi203 ceph-mon[86783]: Cluster is now healthy 2024-04-12T09:17:31.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:31 smithi117 ceph-mon[113571]: pgmap v56: 65 pgs: 65 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-04-12T09:17:32.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:31 smithi203 ceph-mon[86783]: pgmap v56: 65 pgs: 65 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-04-12T09:17:33.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:33 smithi117 ceph-mon[113571]: pgmap v57: 65 pgs: 65 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 335 B/s wr, 0 op/s 2024-04-12T09:17:34.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:33 smithi203 ceph-mon[86783]: pgmap v57: 65 pgs: 65 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 335 B/s wr, 0 op/s 2024-04-12T09:17:35.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:35 smithi117 ceph-mon[113571]: pgmap v58: 65 pgs: 65 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 302 B/s wr, 0 op/s 2024-04-12T09:17:35.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:35 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:36.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:35 smithi203 ceph-mon[86783]: pgmap v58: 65 pgs: 65 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 302 B/s wr, 0 op/s 2024-04-12T09:17:36.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:35 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:37.875 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:37 smithi203 ceph-mon[86783]: pgmap v59: 65 pgs: 65 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-12T09:17:37.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:37 smithi117 ceph-mon[113571]: pgmap v59: 65 pgs: 65 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-12T09:17:39.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:39 smithi117 ceph-mon[113571]: pgmap v60: 65 pgs: 65 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:39.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:39.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:17:40.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:39 smithi203 ceph-mon[86783]: pgmap v60: 65 pgs: 65 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:40.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:40.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:17:41.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:41 smithi117 ceph-mon[113571]: pgmap v61: 65 pgs: 65 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:42.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:41 smithi203 ceph-mon[86783]: pgmap v61: 65 pgs: 65 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:42.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:42 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-12T09:17:43.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:42 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-12T09:17:43.756 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:43 smithi117 ceph-mon[113571]: pgmap v62: 65 pgs: 65 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:43.756 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:43 smithi117 ceph-mon[113571]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-12T09:17:43.756 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:43 smithi117 ceph-mon[113571]: Upgrade: osd.1 is safe to restart 2024-04-12T09:17:44.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:43 smithi203 ceph-mon[86783]: pgmap v62: 65 pgs: 65 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:44.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:43 smithi203 ceph-mon[86783]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-12T09:17:44.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:43 smithi203 ceph-mon[86783]: Upgrade: osd.1 is safe to restart 2024-04-12T09:17:45.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:45 smithi117 ceph-mon[113571]: Upgrade: Updating osd.1 2024-04-12T09:17:45.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:45 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:45.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:45 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-12T09:17:45.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:45 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:17:45.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:45 smithi117 ceph-mon[113571]: Deploying daemon osd.1 on smithi117 2024-04-12T09:17:45.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:45 smithi117 ceph-mon[113571]: pgmap v63: 65 pgs: 65 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:45.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:45 smithi203 ceph-mon[86783]: Upgrade: Updating osd.1 2024-04-12T09:17:45.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:45 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:45.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:45 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-12T09:17:45.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:45 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:17:45.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:45 smithi203 ceph-mon[86783]: Deploying daemon osd.1 on smithi117 2024-04-12T09:17:45.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:45 smithi203 ceph-mon[86783]: pgmap v63: 65 pgs: 65 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:47.900 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:47 smithi117 ceph-mon[113571]: pgmap v64: 65 pgs: 65 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:47.901 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:47 smithi117 systemd[1]: Stopping Ceph osd.1 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:17:48.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:47 smithi203 ceph-mon[86783]: pgmap v64: 65 pgs: 65 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:48.160 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:47 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1[55103]: 2024-04-12T09:17:47.899+0000 7f2a4870a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T09:17:48.160 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:47 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1[55103]: 2024-04-12T09:17:47.899+0000 7f2a4870a700 -1 osd.1 54 *** Got signal Terminated *** 2024-04-12T09:17:48.160 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:47 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1[55103]: 2024-04-12T09:17:47.899+0000 7f2a4870a700 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T09:17:48.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:48 smithi117 ceph-mon[113571]: osd.1 marked itself down and dead 2024-04-12T09:17:49.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:48 smithi203 ceph-mon[86783]: osd.1 marked itself down and dead 2024-04-12T09:17:49.409 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:49 smithi117 podman[129999]: 2024-04-12 09:17:49.093818624 +0000 UTC m=+1.302846148 container died 8f9dbf0274edddbac56b5bcb2eb9c55163c18b68cb17cf5e57aea7554312348a (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, RELEASE=quincy-d3b5060, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-12T09:17:49.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:49 smithi117 ceph-mon[113571]: pgmap v65: 65 pgs: 65 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:49.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:49 smithi117 ceph-mon[113571]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-12T09:17:49.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:49 smithi117 ceph-mon[113571]: osdmap e55: 6 total, 5 up, 6 in 2024-04-12T09:17:49.660 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:49 smithi117 podman[129999]: 2024-04-12 09:17:49.490944978 +0000 UTC m=+1.699972501 container cleanup 8f9dbf0274edddbac56b5bcb2eb9c55163c18b68cb17cf5e57aea7554312348a (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=quincy-d3b5060, org.label-schema.build-date=20240409, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T09:17:49.661 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:49 smithi117 bash[129999]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1 2024-04-12T09:17:50.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:49 smithi203 ceph-mon[86783]: pgmap v65: 65 pgs: 65 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-12T09:17:50.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:49 smithi203 ceph-mon[86783]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-12T09:17:50.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:49 smithi203 ceph-mon[86783]: osdmap e55: 6 total, 5 up, 6 in 2024-04-12T09:17:50.108 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:49 smithi117 podman[130016]: 2024-04-12 09:17:49.78393921 +0000 UTC m=+0.690123447 container remove 8f9dbf0274edddbac56b5bcb2eb9c55163c18b68cb17cf5e57aea7554312348a (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-d3b5060, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-12T09:17:50.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.134+0000 7fc640e5a700 1 -- 172.21.15.117:0/3249894203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc63c1037b0 msgr2=0x7fc63c0fce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:50.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.134+0000 7fc640e5a700 1 --2- 172.21.15.117:0/3249894203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc63c1037b0 0x7fc63c0fce20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc630004940 tx=0x7fc630009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:50.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.134+0000 7fc640e5a700 1 -- 172.21.15.117:0/3249894203 shutdown_connections 2024-04-12T09:17:50.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.134+0000 7fc640e5a700 1 --2- 172.21.15.117:0/3249894203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc63c1037b0 0x7fc63c0fce20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:50.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.134+0000 7fc640e5a700 1 --2- 172.21.15.117:0/3249894203 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc63c102e10 0x7fc63c1031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:50.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.134+0000 7fc640e5a700 1 -- 172.21.15.117:0/3249894203 >> 172.21.15.117:0/3249894203 conn(0x7fc63c0f89a0 msgr2=0x7fc63c0fadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:50.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.134+0000 7fc640e5a700 1 -- 172.21.15.117:0/3249894203 shutdown_connections 2024-04-12T09:17:50.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.135+0000 7fc640e5a700 1 -- 172.21.15.117:0/3249894203 wait complete. 2024-04-12T09:17:50.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.135+0000 7fc640e5a700 1 Processor -- start 2024-04-12T09:17:50.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.135+0000 7fc640e5a700 1 -- start start 2024-04-12T09:17:50.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.135+0000 7fc640e5a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc63c102e10 0x7fc63c113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:50.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.135+0000 7fc640e5a700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc63c1037b0 0x7fc63c1140e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:50.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.135+0000 7fc640e5a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c114730 con 0x7fc63c102e10 2024-04-12T09:17:50.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.135+0000 7fc640e5a700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c10db20 con 0x7fc63c1037b0 2024-04-12T09:17:50.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.135+0000 7fc63a59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc63c102e10 0x7fc63c113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:50.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.135+0000 7fc63a59c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc63c102e10 0x7fc63c113ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34862/0 (socket says 172.21.15.117:34862) 2024-04-12T09:17:50.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.135+0000 7fc63a59c700 1 -- 172.21.15.117:0/98627870 learned_addr learned my addr 172.21.15.117:0/98627870 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:17:50.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.135+0000 7fc639d9b700 1 --2- 172.21.15.117:0/98627870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc63c1037b0 0x7fc63c1140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:50.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.136+0000 7fc63a59c700 1 -- 172.21.15.117:0/98627870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc63c1037b0 msgr2=0x7fc63c1140e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:50.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.136+0000 7fc63a59c700 1 --2- 172.21.15.117:0/98627870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc63c1037b0 0x7fc63c1140e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:50.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.136+0000 7fc63a59c700 1 -- 172.21.15.117:0/98627870 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc630005040 con 0x7fc63c102e10 2024-04-12T09:17:50.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.136+0000 7fc63a59c700 1 --2- 172.21.15.117:0/98627870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc63c102e10 0x7fc63c113ba0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc62c00c8c0 tx=0x7fc62c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:50.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.136+0000 7fc62affd700 1 -- 172.21.15.117:0/98627870 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc62c00a980 con 0x7fc63c102e10 2024-04-12T09:17:50.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.136+0000 7fc62affd700 1 -- 172.21.15.117:0/98627870 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc62c00ce60 con 0x7fc63c102e10 2024-04-12T09:17:50.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.136+0000 7fc640e5a700 1 -- 172.21.15.117:0/98627870 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc63c10de00 con 0x7fc63c102e10 2024-04-12T09:17:50.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.136+0000 7fc62affd700 1 -- 172.21.15.117:0/98627870 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc62c0115e0 con 0x7fc63c102e10 2024-04-12T09:17:50.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.136+0000 7fc640e5a700 1 -- 172.21.15.117:0/98627870 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63c10e3c0 con 0x7fc63c102e10 2024-04-12T09:17:50.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.137+0000 7fc640e5a700 1 -- 172.21.15.117:0/98627870 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc63c1052e0 con 0x7fc63c102e10 2024-04-12T09:17:50.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.138+0000 7fc62affd700 1 -- 172.21.15.117:0/98627870 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fc62c012400 con 0x7fc63c102e10 2024-04-12T09:17:50.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.138+0000 7fc62affd700 1 --2- 172.21.15.117:0/98627870 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc62406dca0 0x7fc624070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:50.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.138+0000 7fc62affd700 1 -- 172.21.15.117:0/98627870 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc62c08d5c0 con 0x7fc63c102e10 2024-04-12T09:17:50.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.138+0000 7fc639d9b700 1 --2- 172.21.15.117:0/98627870 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc62406dca0 0x7fc624070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:50.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.139+0000 7fc639d9b700 1 --2- 172.21.15.117:0/98627870 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc62406dca0 0x7fc624070150 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc63c10ece0 tx=0x7fc630009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:50.143 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.143+0000 7fc62affd700 1 -- 172.21.15.117:0/98627870 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc62c05a7a0 con 0x7fc63c102e10 2024-04-12T09:17:50.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.363+0000 7fc640e5a700 1 -- 172.21.15.117:0/98627870 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc63c10f1f0 con 0x7fc62406dca0 2024-04-12T09:17:50.365 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:50 smithi117 podman[130108]: 2024-04-12 09:17:50.011026089 +0000 UTC m=+0.017981167 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:17:50.365 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:50 smithi117 podman[130108]: 2024-04-12 09:17:50.118233509 +0000 UTC m=+0.125188578 container create 27d9e2eb8902ec330d3d8499285fe3c431decf6cd2d96da13f1af13e8a424543 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-b277feb, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-12T09:17:50.365 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:50 smithi117 podman[130108]: 2024-04-12 09:17:50.354701927 +0000 UTC m=+0.361657014 container init 27d9e2eb8902ec330d3d8499285fe3c431decf6cd2d96da13f1af13e8a424543 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-b277feb, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409) 2024-04-12T09:17:50.365 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:50 smithi117 podman[130108]: 2024-04-12 09:17:50.358119673 +0000 UTC m=+0.365074748 container start 27d9e2eb8902ec330d3d8499285fe3c431decf6cd2d96da13f1af13e8a424543 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=squid-b277feb, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-12T09:17:50.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.365+0000 7fc62affd700 1 -- 172.21.15.117:0/98627870 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc63c10f1f0 con 0x7fc62406dca0 2024-04-12T09:17:50.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.367+0000 7fc640e5a700 1 -- 172.21.15.117:0/98627870 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc62406dca0 msgr2=0x7fc624070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:50.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.367+0000 7fc640e5a700 1 --2- 172.21.15.117:0/98627870 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc62406dca0 0x7fc624070150 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc63c10ece0 tx=0x7fc630009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:50.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.367+0000 7fc640e5a700 1 -- 172.21.15.117:0/98627870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc63c102e10 msgr2=0x7fc63c113ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:50.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.367+0000 7fc640e5a700 1 --2- 172.21.15.117:0/98627870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc63c102e10 0x7fc63c113ba0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc62c00c8c0 tx=0x7fc62c0044c0 comp rx=0 tx=0).stop 2024-04-12T09:17:50.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.367+0000 7fc640e5a700 1 -- 172.21.15.117:0/98627870 shutdown_connections 2024-04-12T09:17:50.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.367+0000 7fc640e5a700 1 --2- 172.21.15.117:0/98627870 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc62406dca0 0x7fc624070150 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:50.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.367+0000 7fc640e5a700 1 --2- 172.21.15.117:0/98627870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc63c102e10 0x7fc63c113ba0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:50.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.367+0000 7fc640e5a700 1 --2- 172.21.15.117:0/98627870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc63c1037b0 0x7fc63c1140e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:50.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.367+0000 7fc640e5a700 1 -- 172.21.15.117:0/98627870 >> 172.21.15.117:0/98627870 conn(0x7fc63c0f89a0 msgr2=0x7fc63c102220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:50.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.367+0000 7fc640e5a700 1 -- 172.21.15.117:0/98627870 shutdown_connections 2024-04-12T09:17:50.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.367+0000 7fc640e5a700 1 -- 172.21.15.117:0/98627870 wait complete. 2024-04-12T09:17:50.379 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:17:50.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.473+0000 7f3c52631700 1 -- 172.21.15.117:0/304791753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c4c102e10 msgr2=0x7f3c4c1031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:50.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.473+0000 7f3c52631700 1 --2- 172.21.15.117:0/304791753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c4c102e10 0x7f3c4c1031e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c004940 tx=0x7f3c3c009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:50.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.473+0000 7f3c52631700 1 -- 172.21.15.117:0/304791753 shutdown_connections 2024-04-12T09:17:50.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.473+0000 7f3c52631700 1 --2- 172.21.15.117:0/304791753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c4c1037b0 0x7f3c4c0fce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:50.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.473+0000 7f3c52631700 1 --2- 172.21.15.117:0/304791753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c4c102e10 0x7f3c4c1031e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:50.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.473+0000 7f3c52631700 1 -- 172.21.15.117:0/304791753 >> 172.21.15.117:0/304791753 conn(0x7f3c4c0f89a0 msgr2=0x7f3c4c0fadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:50.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.473+0000 7f3c52631700 1 -- 172.21.15.117:0/304791753 shutdown_connections 2024-04-12T09:17:50.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.473+0000 7f3c52631700 1 -- 172.21.15.117:0/304791753 wait complete. 2024-04-12T09:17:50.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.474+0000 7f3c52631700 1 Processor -- start 2024-04-12T09:17:50.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.474+0000 7f3c52631700 1 -- start start 2024-04-12T09:17:50.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.475+0000 7f3c52631700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c4c102e10 0x7f3c4c115d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:50.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.475+0000 7f3c52631700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c4c1037b0 0x7f3c4c1162d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:50.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.475+0000 7f3c52631700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c116920 con 0x7f3c4c102e10 2024-04-12T09:17:50.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.475+0000 7f3c52631700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c10fcf0 con 0x7f3c4c1037b0 2024-04-12T09:17:50.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.475+0000 7f3c4bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c4c102e10 0x7f3c4c115d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:50.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.475+0000 7f3c4bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c4c102e10 0x7f3c4c115d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34884/0 (socket says 172.21.15.117:34884) 2024-04-12T09:17:50.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.475+0000 7f3c4bfff700 1 -- 172.21.15.117:0/321004736 learned_addr learned my addr 172.21.15.117:0/321004736 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:17:50.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.475+0000 7f3c4b7fe700 1 --2- 172.21.15.117:0/321004736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c4c1037b0 0x7f3c4c1162d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:50.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.475+0000 7f3c4bfff700 1 -- 172.21.15.117:0/321004736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c4c1037b0 msgr2=0x7f3c4c1162d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:50.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.475+0000 7f3c4bfff700 1 --2- 172.21.15.117:0/321004736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c4c1037b0 0x7f3c4c1162d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:50.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.475+0000 7f3c4bfff700 1 -- 172.21.15.117:0/321004736 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c005040 con 0x7f3c4c102e10 2024-04-12T09:17:50.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.475+0000 7f3c4bfff700 1 --2- 172.21.15.117:0/321004736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c4c102e10 0x7f3c4c115d90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00b3b0 tx=0x7f3c3c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:50.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.475+0000 7f3c48ff9700 1 -- 172.21.15.117:0/321004736 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c3c00e040 con 0x7f3c4c102e10 2024-04-12T09:17:50.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.475+0000 7f3c52631700 1 -- 172.21.15.117:0/321004736 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4c10ff70 con 0x7f3c4c102e10 2024-04-12T09:17:50.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.475+0000 7f3c48ff9700 1 -- 172.21.15.117:0/321004736 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c3c00bbc0 con 0x7f3c4c102e10 2024-04-12T09:17:50.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.476+0000 7f3c48ff9700 1 -- 172.21.15.117:0/321004736 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c3c01c3f0 con 0x7f3c4c102e10 2024-04-12T09:17:50.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.476+0000 7f3c52631700 1 -- 172.21.15.117:0/321004736 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4c110530 con 0x7f3c4c102e10 2024-04-12T09:17:50.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.476+0000 7f3c52631700 1 -- 172.21.15.117:0/321004736 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4c107310 con 0x7f3c4c102e10 2024-04-12T09:17:50.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.477+0000 7f3c48ff9700 1 -- 172.21.15.117:0/321004736 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f3c3c00bd30 con 0x7f3c4c102e10 2024-04-12T09:17:50.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.477+0000 7f3c48ff9700 1 --2- 172.21.15.117:0/321004736 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f3c3406dca0 0x7f3c34070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:50.479 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.477+0000 7f3c48ff9700 1 -- 172.21.15.117:0/321004736 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f3c3c08e680 con 0x7f3c4c102e10 2024-04-12T09:17:50.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.477+0000 7f3c4b7fe700 1 --2- 172.21.15.117:0/321004736 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f3c3406dca0 0x7f3c34070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:50.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.478+0000 7f3c4b7fe700 1 --2- 172.21.15.117:0/321004736 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f3c3406dca0 0x7f3c34070150 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3c40007fd0 tx=0x7f3c40009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:50.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.482+0000 7f3c48ff9700 1 -- 172.21.15.117:0/321004736 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f3c3c05b860 con 0x7f3c4c102e10 2024-04-12T09:17:50.644 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:50 smithi117 podman[130108]: 2024-04-12 09:17:50.471257777 +0000 UTC m=+0.478212865 container attach 27d9e2eb8902ec330d3d8499285fe3c431decf6cd2d96da13f1af13e8a424543 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=squid-b277feb, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-12T09:17:50.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.714+0000 7f3c52631700 1 -- 172.21.15.117:0/321004736 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c4c109f80 con 0x7f3c3406dca0 2024-04-12T09:17:50.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.715+0000 7f3c48ff9700 1 -- 172.21.15.117:0/321004736 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3c4c109f80 con 0x7f3c3406dca0 2024-04-12T09:17:50.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.717+0000 7f3c52631700 1 -- 172.21.15.117:0/321004736 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f3c3406dca0 msgr2=0x7f3c34070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:50.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.717+0000 7f3c52631700 1 --2- 172.21.15.117:0/321004736 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f3c3406dca0 0x7f3c34070150 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3c40007fd0 tx=0x7f3c40009040 comp rx=0 tx=0).stop 2024-04-12T09:17:50.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.717+0000 7f3c52631700 1 -- 172.21.15.117:0/321004736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c4c102e10 msgr2=0x7f3c4c115d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:50.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.717+0000 7f3c52631700 1 --2- 172.21.15.117:0/321004736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c4c102e10 0x7f3c4c115d90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00b3b0 tx=0x7f3c3c009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:50.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.717+0000 7f3c52631700 1 -- 172.21.15.117:0/321004736 shutdown_connections 2024-04-12T09:17:50.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.717+0000 7f3c52631700 1 --2- 172.21.15.117:0/321004736 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f3c3406dca0 0x7f3c34070150 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:50.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.717+0000 7f3c52631700 1 --2- 172.21.15.117:0/321004736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c4c102e10 0x7f3c4c115d90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:50.718 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.717+0000 7f3c52631700 1 --2- 172.21.15.117:0/321004736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c4c1037b0 0x7f3c4c1162d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:50.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.717+0000 7f3c52631700 1 -- 172.21.15.117:0/321004736 >> 172.21.15.117:0/321004736 conn(0x7f3c4c0f89a0 msgr2=0x7f3c4c0fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:50.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.717+0000 7f3c52631700 1 -- 172.21.15.117:0/321004736 shutdown_connections 2024-04-12T09:17:50.719 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.717+0000 7f3c52631700 1 -- 172.21.15.117:0/321004736 wait complete. 2024-04-12T09:17:50.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.820+0000 7f6e596db700 1 -- 172.21.15.117:0/542388953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e540fbca0 msgr2=0x7f6e540fc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:50.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.820+0000 7f6e596db700 1 --2- 172.21.15.117:0/542388953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e540fbca0 0x7f6e540fc110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6e48004940 tx=0x7f6e48009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:50.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.820+0000 7f6e596db700 1 -- 172.21.15.117:0/542388953 shutdown_connections 2024-04-12T09:17:50.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.820+0000 7f6e596db700 1 --2- 172.21.15.117:0/542388953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e540fbca0 0x7f6e540fc110 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:50.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.820+0000 7f6e596db700 1 --2- 172.21.15.117:0/542388953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6e54101cf0 0x7f6e541020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:50.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.820+0000 7f6e596db700 1 -- 172.21.15.117:0/542388953 >> 172.21.15.117:0/542388953 conn(0x7f6e54072bc0 msgr2=0x7f6e54072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:50.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.820+0000 7f6e596db700 1 -- 172.21.15.117:0/542388953 shutdown_connections 2024-04-12T09:17:50.821 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.820+0000 7f6e596db700 1 -- 172.21.15.117:0/542388953 wait complete. 2024-04-12T09:17:50.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.821+0000 7f6e596db700 1 Processor -- start 2024-04-12T09:17:50.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.821+0000 7f6e596db700 1 -- start start 2024-04-12T09:17:50.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.821+0000 7f6e596db700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6e540fbca0 0x7f6e54112a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:50.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.821+0000 7f6e596db700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e54101cf0 0x7f6e54112f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:50.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.821+0000 7f6e596db700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e54113590 con 0x7f6e54101cf0 2024-04-12T09:17:50.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.821+0000 7f6e596db700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5410c980 con 0x7f6e540fbca0 2024-04-12T09:17:50.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.821+0000 7f6e527fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e54101cf0 0x7f6e54112f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:50.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.821+0000 7f6e527fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e54101cf0 0x7f6e54112f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34904/0 (socket says 172.21.15.117:34904) 2024-04-12T09:17:50.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.821+0000 7f6e527fc700 1 -- 172.21.15.117:0/4071812548 learned_addr learned my addr 172.21.15.117:0/4071812548 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:17:50.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.821+0000 7f6e52ffd700 1 --2- 172.21.15.117:0/4071812548 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6e540fbca0 0x7f6e54112a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:50.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.821+0000 7f6e527fc700 1 -- 172.21.15.117:0/4071812548 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6e540fbca0 msgr2=0x7f6e54112a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:50.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.821+0000 7f6e527fc700 1 --2- 172.21.15.117:0/4071812548 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6e540fbca0 0x7f6e54112a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:50.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.821+0000 7f6e527fc700 1 -- 172.21.15.117:0/4071812548 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e48005040 con 0x7f6e54101cf0 2024-04-12T09:17:50.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.821+0000 7f6e527fc700 1 --2- 172.21.15.117:0/4071812548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e54101cf0 0x7f6e54112f40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6e4800b3b0 tx=0x7f6e48009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:50.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.822+0000 7f6e3b7fe700 1 -- 172.21.15.117:0/4071812548 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e4800e040 con 0x7f6e54101cf0 2024-04-12T09:17:50.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.822+0000 7f6e596db700 1 -- 172.21.15.117:0/4071812548 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5410cc00 con 0x7f6e54101cf0 2024-04-12T09:17:50.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.822+0000 7f6e3b7fe700 1 -- 172.21.15.117:0/4071812548 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e4800bbc0 con 0x7f6e54101cf0 2024-04-12T09:17:50.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.822+0000 7f6e3b7fe700 1 -- 172.21.15.117:0/4071812548 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e4801c3f0 con 0x7f6e54101cf0 2024-04-12T09:17:50.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.822+0000 7f6e596db700 1 -- 172.21.15.117:0/4071812548 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5410d1c0 con 0x7f6e54101cf0 2024-04-12T09:17:50.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.823+0000 7f6e596db700 1 -- 172.21.15.117:0/4071812548 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e540fd390 con 0x7f6e54101cf0 2024-04-12T09:17:50.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.823+0000 7f6e3b7fe700 1 -- 172.21.15.117:0/4071812548 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f6e4800bd30 con 0x7f6e54101cf0 2024-04-12T09:17:50.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.823+0000 7f6e3b7fe700 1 --2- 172.21.15.117:0/4071812548 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f6e3c06dca0 0x7f6e3c070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:50.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.824+0000 7f6e3b7fe700 1 -- 172.21.15.117:0/4071812548 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f6e4808e810 con 0x7f6e54101cf0 2024-04-12T09:17:50.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.824+0000 7f6e52ffd700 1 --2- 172.21.15.117:0/4071812548 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f6e3c06dca0 0x7f6e3c070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:50.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.824+0000 7f6e52ffd700 1 --2- 172.21.15.117:0/4071812548 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f6e3c06dca0 0x7f6e3c070150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c004e40 tx=0x7f6e4c009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:50.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:50.828+0000 7f6e3b7fe700 1 -- 172.21.15.117:0/4071812548 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f6e4805b970 con 0x7f6e54101cf0 2024-04-12T09:17:50.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:50 smithi117 ceph-mon[113571]: osdmap e56: 6 total, 5 up, 6 in 2024-04-12T09:17:50.910 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:50 smithi117 podman[130108]: 2024-04-12 09:17:50.663312371 +0000 UTC m=+0.670267441 container died 27d9e2eb8902ec330d3d8499285fe3c431decf6cd2d96da13f1af13e8a424543 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-b277feb, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-12T09:17:51.042 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.042+0000 7f6e596db700 1 -- 172.21.15.117:0/4071812548 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e54108d50 con 0x7f6e3c06dca0 2024-04-12T09:17:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.052+0000 7f6e3b7fe700 1 -- 172.21.15.117:0/4071812548 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f6e54108d50 con 0x7f6e3c06dca0 2024-04-12T09:17:51.053 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:17:51.053 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 running (3m) 28s ago 14m 28.6M - 0.25.0 c8568f914cd2 204687f21ed7 2024-04-12T09:17:51.053 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (60s) 28s ago 15m 6656k - 19.0.0-2053-gb277feb2 668895944f0e 038f567b664b 2024-04-12T09:17:51.053 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (55s) 52s ago 14m 6660k - 19.0.0-2053-gb277feb2 668895944f0e 420dee66e230 2024-04-12T09:17:51.053 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 running (3m) 28s ago 14m 80.5M - 9.4.12 2bacad6d85d8 a7b102216886 2024-04-12T09:17:51.053 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (9m) 28s ago 9m 140M - 17.2.7-827-gd3b5060a 21de9b7369ad de062e2c10e7 2024-04-12T09:17:51.053 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 running (9m) 28s ago 9m 14.4M - 17.2.7-827-gd3b5060a 21de9b7369ad 1e82c6241a18 2024-04-12T09:17:51.053 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (9m) 52s ago 9m 16.9M - 17.2.7-827-gd3b5060a 21de9b7369ad b05228e997f7 2024-04-12T09:17:51.053 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (9m) 52s ago 9m 17.1M - 17.2.7-827-gd3b5060a 21de9b7369ad 6d7f82c072c7 2024-04-12T09:17:51.053 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:8443,9283,8765 running (5m) 28s ago 16m 497M - 19.0.0-2053-gb277feb2 668895944f0e fee613d05ab7 2024-04-12T09:17:51.053 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283,8765 running (4m) 52s ago 14m 449M - 19.0.0-2053-gb277feb2 668895944f0e c793944c3e16 2024-04-12T09:17:51.053 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (2m) 28s ago 16m 44.8M 2048M 19.0.0-2053-gb277feb2 668895944f0e 6823aaff30ce 2024-04-12T09:17:51.053 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (100s) 52s ago 13m 35.4M 2048M 19.0.0-2053-gb277feb2 668895944f0e 006c6e487bfb 2024-04-12T09:17:51.053 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 running (4m) 28s ago 15m 16.2M - 1.5.0 0da6a335fe13 c692bed9f6c7 2024-04-12T09:17:51.054 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (4m) 52s ago 14m 15.2M - 1.5.0 0da6a335fe13 f3b5a470f545 2024-04-12T09:17:51.054 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (34s) 28s ago 13m 11.9M 1557M 19.0.0-2053-gb277feb2 668895944f0e 59a180461e3c 2024-04-12T09:17:51.054 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (12m) 28s ago 12m 237M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 8f9dbf0274ed 2024-04-12T09:17:51.054 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (12m) 28s ago 12m 200M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 339c5a80d1dd 2024-04-12T09:17:51.054 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (11m) 52s ago 11m 275M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad fb87d616bae3 2024-04-12T09:17:51.054 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (11m) 52s ago 11m 247M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad c873826a2dea 2024-04-12T09:17:51.054 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (11m) 52s ago 11m 221M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad 69cb7c22f002 2024-04-12T09:17:51.054 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 running (3m) 28s ago 14m 58.8M - 2.43.0 a07b618ecd1d 43ce588d82cc 2024-04-12T09:17:51.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.054+0000 7f6e596db700 1 -- 172.21.15.117:0/4071812548 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f6e3c06dca0 msgr2=0x7f6e3c070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:51.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.054+0000 7f6e596db700 1 --2- 172.21.15.117:0/4071812548 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f6e3c06dca0 0x7f6e3c070150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c004e40 tx=0x7f6e4c009040 comp rx=0 tx=0).stop 2024-04-12T09:17:51.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.054+0000 7f6e596db700 1 -- 172.21.15.117:0/4071812548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e54101cf0 msgr2=0x7f6e54112f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:51.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.054+0000 7f6e596db700 1 --2- 172.21.15.117:0/4071812548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e54101cf0 0x7f6e54112f40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6e4800b3b0 tx=0x7f6e48009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:51.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.054+0000 7f6e596db700 1 -- 172.21.15.117:0/4071812548 shutdown_connections 2024-04-12T09:17:51.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.054+0000 7f6e596db700 1 --2- 172.21.15.117:0/4071812548 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6e540fbca0 0x7f6e54112a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:51.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.054+0000 7f6e596db700 1 --2- 172.21.15.117:0/4071812548 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f6e3c06dca0 0x7f6e3c070150 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:51.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.054+0000 7f6e596db700 1 --2- 172.21.15.117:0/4071812548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e54101cf0 0x7f6e54112f40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:51.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.054+0000 7f6e596db700 1 -- 172.21.15.117:0/4071812548 >> 172.21.15.117:0/4071812548 conn(0x7f6e54072bc0 msgr2=0x7f6e540ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:51.055 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.054+0000 7f6e596db700 1 -- 172.21.15.117:0/4071812548 shutdown_connections 2024-04-12T09:17:51.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.054+0000 7f6e596db700 1 -- 172.21.15.117:0/4071812548 wait complete. 2024-04-12T09:17:51.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:50 smithi203 ceph-mon[86783]: osdmap e56: 6 total, 5 up, 6 in 2024-04-12T09:17:51.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.154+0000 7fe049fa8700 1 -- 172.21.15.117:0/2349591939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0440fe810 msgr2=0x7fe044106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:51.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.154+0000 7fe049fa8700 1 --2- 172.21.15.117:0/2349591939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0440fe810 0x7fe044106e50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe034004940 tx=0x7fe034009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:51.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.154+0000 7fe049fa8700 1 -- 172.21.15.117:0/2349591939 shutdown_connections 2024-04-12T09:17:51.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.154+0000 7fe049fa8700 1 --2- 172.21.15.117:0/2349591939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0440fe810 0x7fe044106e50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:51.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.154+0000 7fe049fa8700 1 --2- 172.21.15.117:0/2349591939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0440fde70 0x7fe0440fe240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:51.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.154+0000 7fe049fa8700 1 -- 172.21.15.117:0/2349591939 >> 172.21.15.117:0/2349591939 conn(0x7fe0440f7880 msgr2=0x7fe0440f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:51.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.154+0000 7fe049fa8700 1 -- 172.21.15.117:0/2349591939 shutdown_connections 2024-04-12T09:17:51.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.154+0000 7fe049fa8700 1 -- 172.21.15.117:0/2349591939 wait complete. 2024-04-12T09:17:51.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.155+0000 7fe049fa8700 1 Processor -- start 2024-04-12T09:17:51.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.155+0000 7fe049fa8700 1 -- start start 2024-04-12T09:17:51.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.155+0000 7fe049fa8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0440fde70 0x7fe044113e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:51.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.155+0000 7fe049fa8700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0440fe810 0x7fe044114370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:51.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.155+0000 7fe049fa8700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0441149c0 con 0x7fe0440fde70 2024-04-12T09:17:51.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.155+0000 7fe049fa8700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04410dd90 con 0x7fe0440fe810 2024-04-12T09:17:51.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.155+0000 7fe0437fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0440fde70 0x7fe044113e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:51.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.155+0000 7fe0437fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0440fde70 0x7fe044113e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34932/0 (socket says 172.21.15.117:34932) 2024-04-12T09:17:51.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.155+0000 7fe0437fe700 1 -- 172.21.15.117:0/1412102269 learned_addr learned my addr 172.21.15.117:0/1412102269 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:17:51.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.155+0000 7fe042ffd700 1 --2- 172.21.15.117:0/1412102269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0440fe810 0x7fe044114370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:51.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.156+0000 7fe0437fe700 1 -- 172.21.15.117:0/1412102269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0440fe810 msgr2=0x7fe044114370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:51.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.156+0000 7fe0437fe700 1 --2- 172.21.15.117:0/1412102269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0440fe810 0x7fe044114370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:51.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.156+0000 7fe0437fe700 1 -- 172.21.15.117:0/1412102269 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe034005040 con 0x7fe0440fde70 2024-04-12T09:17:51.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.156+0000 7fe042ffd700 1 --2- 172.21.15.117:0/1412102269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0440fe810 0x7fe044114370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T09:17:51.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.156+0000 7fe0437fe700 1 --2- 172.21.15.117:0/1412102269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0440fde70 0x7fe044113e30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe03800c8c0 tx=0x7fe0380044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:51.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.156+0000 7fe02bfff700 1 -- 172.21.15.117:0/1412102269 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe03800a980 con 0x7fe0440fde70 2024-04-12T09:17:51.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.156+0000 7fe02bfff700 1 -- 172.21.15.117:0/1412102269 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe03800ce60 con 0x7fe0440fde70 2024-04-12T09:17:51.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.156+0000 7fe049fa8700 1 -- 172.21.15.117:0/1412102269 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe04410e070 con 0x7fe0440fde70 2024-04-12T09:17:51.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.156+0000 7fe02bfff700 1 -- 172.21.15.117:0/1412102269 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0380115e0 con 0x7fe0440fde70 2024-04-12T09:17:51.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.156+0000 7fe049fa8700 1 -- 172.21.15.117:0/1412102269 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04410e5b0 con 0x7fe0440fde70 2024-04-12T09:17:51.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.157+0000 7fe049fa8700 1 -- 172.21.15.117:0/1412102269 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe044066710 con 0x7fe0440fde70 2024-04-12T09:17:51.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.157+0000 7fe02bfff700 1 -- 172.21.15.117:0/1412102269 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fe038012400 con 0x7fe0440fde70 2024-04-12T09:17:51.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.158+0000 7fe02bfff700 1 --2- 172.21.15.117:0/1412102269 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe02c06dca0 0x7fe02c070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:51.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.158+0000 7fe02bfff700 1 -- 172.21.15.117:0/1412102269 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe03808d590 con 0x7fe0440fde70 2024-04-12T09:17:51.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.158+0000 7fe042ffd700 1 --2- 172.21.15.117:0/1412102269 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe02c06dca0 0x7fe02c070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:51.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.158+0000 7fe042ffd700 1 --2- 172.21.15.117:0/1412102269 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe02c06dca0 0x7fe02c070150 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe03400b3b0 tx=0x7fe034009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:51.163 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.162+0000 7fe02bfff700 1 -- 172.21.15.117:0/1412102269 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fe03805a770 con 0x7fe0440fde70 2024-04-12T09:17:51.470 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:17:51.470 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": { 2024-04-12T09:17:51.470 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:17:51.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:17:51.470 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": { 2024-04-12T09:17:51.470 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:17:51.470 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:17:51.470 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": { 2024-04-12T09:17:51.471 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 4, 2024-04-12T09:17:51.471 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 1 2024-04-12T09:17:51.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:17:51.471 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-04-12T09:17:51.471 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 4 2024-04-12T09:17:51.471 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:17:51.471 INFO:teuthology.orchestra.run.smithi117.stdout: "overall": { 2024-04-12T09:17:51.471 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 8, 2024-04-12T09:17:51.471 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 5 2024-04-12T09:17:51.471 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:17:51.471 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:17:51.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.468+0000 7fe049fa8700 1 -- 172.21.15.117:0/1412102269 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe04405f5f0 con 0x7fe0440fde70 2024-04-12T09:17:51.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.468+0000 7fe02bfff700 1 -- 172.21.15.117:0/1412102269 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7fe0380126b0 con 0x7fe0440fde70 2024-04-12T09:17:51.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.471+0000 7fe049fa8700 1 -- 172.21.15.117:0/1412102269 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe02c06dca0 msgr2=0x7fe02c070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:51.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.471+0000 7fe049fa8700 1 --2- 172.21.15.117:0/1412102269 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe02c06dca0 0x7fe02c070150 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe03400b3b0 tx=0x7fe034009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:51.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.471+0000 7fe049fa8700 1 -- 172.21.15.117:0/1412102269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0440fde70 msgr2=0x7fe044113e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:51.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.471+0000 7fe049fa8700 1 --2- 172.21.15.117:0/1412102269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0440fde70 0x7fe044113e30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe03800c8c0 tx=0x7fe0380044c0 comp rx=0 tx=0).stop 2024-04-12T09:17:51.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.471+0000 7fe049fa8700 1 -- 172.21.15.117:0/1412102269 shutdown_connections 2024-04-12T09:17:51.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.471+0000 7fe049fa8700 1 --2- 172.21.15.117:0/1412102269 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe02c06dca0 0x7fe02c070150 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:51.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.471+0000 7fe049fa8700 1 --2- 172.21.15.117:0/1412102269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0440fde70 0x7fe044113e30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:51.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.471+0000 7fe049fa8700 1 --2- 172.21.15.117:0/1412102269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0440fe810 0x7fe044114370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:51.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.471+0000 7fe049fa8700 1 -- 172.21.15.117:0/1412102269 >> 172.21.15.117:0/1412102269 conn(0x7fe0440f7880 msgr2=0x7fe0440f8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:51.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.471+0000 7fe049fa8700 1 -- 172.21.15.117:0/1412102269 shutdown_connections 2024-04-12T09:17:51.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.471+0000 7fe049fa8700 1 -- 172.21.15.117:0/1412102269 wait complete. 2024-04-12T09:17:51.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.573+0000 7fe9a25e4700 1 -- 172.21.15.117:0/2028135924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe99c101d70 msgr2=0x7fe99c102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:51.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.573+0000 7fe9a25e4700 1 --2- 172.21.15.117:0/2028135924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe99c101d70 0x7fe99c102140 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe98c004940 tx=0x7fe98c009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:51.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.574+0000 7fe9a25e4700 1 -- 172.21.15.117:0/2028135924 shutdown_connections 2024-04-12T09:17:51.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.574+0000 7fe9a25e4700 1 --2- 172.21.15.117:0/2028135924 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe99c102710 0x7fe99c0fbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:51.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.574+0000 7fe9a25e4700 1 --2- 172.21.15.117:0/2028135924 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe99c101d70 0x7fe99c102140 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:51.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.574+0000 7fe9a25e4700 1 -- 172.21.15.117:0/2028135924 >> 172.21.15.117:0/2028135924 conn(0x7fe99c072bc0 msgr2=0x7fe99c072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:51.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.574+0000 7fe9a25e4700 1 -- 172.21.15.117:0/2028135924 shutdown_connections 2024-04-12T09:17:51.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.574+0000 7fe9a25e4700 1 -- 172.21.15.117:0/2028135924 wait complete. 2024-04-12T09:17:51.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.574+0000 7fe9a25e4700 1 Processor -- start 2024-04-12T09:17:51.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.574+0000 7fe9a25e4700 1 -- start start 2024-04-12T09:17:51.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.574+0000 7fe9a25e4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe99c101d70 0x7fe99c113b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:51.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.575+0000 7fe9a25e4700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe99c102710 0x7fe99c1140a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:51.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.575+0000 7fe9a25e4700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c1146f0 con 0x7fe99c101d70 2024-04-12T09:17:51.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.575+0000 7fe9a25e4700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c10db30 con 0x7fe99c102710 2024-04-12T09:17:51.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.575+0000 7fe99bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe99c101d70 0x7fe99c113b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:51.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.575+0000 7fe99bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe99c101d70 0x7fe99c113b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34952/0 (socket says 172.21.15.117:34952) 2024-04-12T09:17:51.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.575+0000 7fe99bfff700 1 -- 172.21.15.117:0/3287694511 learned_addr learned my addr 172.21.15.117:0/3287694511 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:17:51.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.575+0000 7fe99b7fe700 1 --2- 172.21.15.117:0/3287694511 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe99c102710 0x7fe99c1140a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:51.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.575+0000 7fe99bfff700 1 -- 172.21.15.117:0/3287694511 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe99c102710 msgr2=0x7fe99c1140a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:51.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.575+0000 7fe99bfff700 1 --2- 172.21.15.117:0/3287694511 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe99c102710 0x7fe99c1140a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:51.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.575+0000 7fe99bfff700 1 -- 172.21.15.117:0/3287694511 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c005040 con 0x7fe99c101d70 2024-04-12T09:17:51.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.575+0000 7fe99bfff700 1 --2- 172.21.15.117:0/3287694511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe99c101d70 0x7fe99c113b60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe98c00b8b0 tx=0x7fe98c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:51.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.575+0000 7fe998ff9700 1 -- 172.21.15.117:0/3287694511 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe98c00e040 con 0x7fe99c101d70 2024-04-12T09:17:51.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.575+0000 7fe9a25e4700 1 -- 172.21.15.117:0/3287694511 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99c10ddb0 con 0x7fe99c101d70 2024-04-12T09:17:51.577 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.575+0000 7fe998ff9700 1 -- 172.21.15.117:0/3287694511 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe98c004290 con 0x7fe99c101d70 2024-04-12T09:17:51.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.576+0000 7fe998ff9700 1 -- 172.21.15.117:0/3287694511 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe98c01c3f0 con 0x7fe99c101d70 2024-04-12T09:17:51.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.576+0000 7fe9a25e4700 1 -- 172.21.15.117:0/3287694511 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99c10e370 con 0x7fe99c101d70 2024-04-12T09:17:51.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.577+0000 7fe9a25e4700 1 -- 172.21.15.117:0/3287694511 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99c0ff080 con 0x7fe99c101d70 2024-04-12T09:17:51.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.577+0000 7fe998ff9700 1 -- 172.21.15.117:0/3287694511 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fe98c0137b0 con 0x7fe99c101d70 2024-04-12T09:17:51.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.577+0000 7fe998ff9700 1 --2- 172.21.15.117:0/3287694511 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe98406dca0 0x7fe984070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:51.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.577+0000 7fe998ff9700 1 -- 172.21.15.117:0/3287694511 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe98c08e830 con 0x7fe99c101d70 2024-04-12T09:17:51.578 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.577+0000 7fe99b7fe700 1 --2- 172.21.15.117:0/3287694511 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe98406dca0 0x7fe984070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:51.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.578+0000 7fe99b7fe700 1 --2- 172.21.15.117:0/3287694511 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe98406dca0 0x7fe984070150 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe990007fd0 tx=0x7fe990009040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:51.586 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.586+0000 7fe998ff9700 1 -- 172.21.15.117:0/3287694511 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fe98c05ba10 con 0x7fe99c101d70 2024-04-12T09:17:51.645 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:51 smithi117 podman[130182]: 2024-04-12 09:17:51.375915587 +0000 UTC m=+0.703206997 container remove 27d9e2eb8902ec330d3d8499285fe3c431decf6cd2d96da13f1af13e8a424543 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b277feb, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-04-12T09:17:51.646 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:51 smithi117 systemd[1]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.1.service: Deactivated successfully. 2024-04-12T09:17:51.646 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:51 smithi117 systemd[1]: Stopped Ceph osd.1 for 12161984-f8ab-11ee-bc8c-c7b262605968. 2024-04-12T09:17:51.646 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:51 smithi117 systemd[1]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.1.service: Consumed 1min 7.153s CPU time. 2024-04-12T09:17:51.646 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:51 smithi117 systemd[1]: Starting Ceph osd.1 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:17:51.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.860+0000 7fe9a25e4700 1 -- 172.21.15.117:0/3287694511 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe99c10f1b0 con 0x7fe99c101d70 2024-04-12T09:17:51.861 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.860+0000 7fe998ff9700 1 -- 172.21.15.117:0/3287694511 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1884 (secure 0 0 0) 0x7fe98c05b5a0 con 0x7fe99c101d70 2024-04-12T09:17:51.861 INFO:teuthology.orchestra.run.smithi117.stdout:e14 2024-04-12T09:17:51.861 INFO:teuthology.orchestra.run.smithi117.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T09:17:51.861 INFO:teuthology.orchestra.run.smithi117.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:17:51.861 INFO:teuthology.orchestra.run.smithi117.stdout:legacy client fscid: 1 2024-04-12T09:17:51.862 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:17:51.862 INFO:teuthology.orchestra.run.smithi117.stdout:Filesystem 'cephfs' (1) 2024-04-12T09:17:51.862 INFO:teuthology.orchestra.run.smithi117.stdout:fs_name cephfs 2024-04-12T09:17:51.862 INFO:teuthology.orchestra.run.smithi117.stdout:epoch 14 2024-04-12T09:17:51.862 INFO:teuthology.orchestra.run.smithi117.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T09:17:51.862 INFO:teuthology.orchestra.run.smithi117.stdout:created 2024-04-12T09:08:12.488144+0000 2024-04-12T09:17:51.862 INFO:teuthology.orchestra.run.smithi117.stdout:modified 2024-04-12T09:08:30.563184+0000 2024-04-12T09:17:51.862 INFO:teuthology.orchestra.run.smithi117.stdout:tableserver 0 2024-04-12T09:17:51.862 INFO:teuthology.orchestra.run.smithi117.stdout:root 0 2024-04-12T09:17:51.862 INFO:teuthology.orchestra.run.smithi117.stdout:session_timeout 60 2024-04-12T09:17:51.862 INFO:teuthology.orchestra.run.smithi117.stdout:session_autoclose 300 2024-04-12T09:17:51.862 INFO:teuthology.orchestra.run.smithi117.stdout:max_file_size 1099511627776 2024-04-12T09:17:51.862 INFO:teuthology.orchestra.run.smithi117.stdout:max_xattr_size 65536 2024-04-12T09:17:51.863 INFO:teuthology.orchestra.run.smithi117.stdout:required_client_features {} 2024-04-12T09:17:51.863 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure 0 2024-04-12T09:17:51.863 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure_osd_epoch 46 2024-04-12T09:17:51.863 INFO:teuthology.orchestra.run.smithi117.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:17:51.863 INFO:teuthology.orchestra.run.smithi117.stdout:max_mds 1 2024-04-12T09:17:51.863 INFO:teuthology.orchestra.run.smithi117.stdout:in 0 2024-04-12T09:17:51.863 INFO:teuthology.orchestra.run.smithi117.stdout:up {0=14474} 2024-04-12T09:17:51.863 INFO:teuthology.orchestra.run.smithi117.stdout:failed 2024-04-12T09:17:51.863 INFO:teuthology.orchestra.run.smithi117.stdout:damaged 2024-04-12T09:17:51.863 INFO:teuthology.orchestra.run.smithi117.stdout:stopped 2024-04-12T09:17:51.863 INFO:teuthology.orchestra.run.smithi117.stdout:data_pools [3] 2024-04-12T09:17:51.863 INFO:teuthology.orchestra.run.smithi117.stdout:metadata_pool 2 2024-04-12T09:17:51.863 INFO:teuthology.orchestra.run.smithi117.stdout:inline_data disabled 2024-04-12T09:17:51.863 INFO:teuthology.orchestra.run.smithi117.stdout:balancer 2024-04-12T09:17:51.864 INFO:teuthology.orchestra.run.smithi117.stdout:bal_rank_mask -1 2024-04-12T09:17:51.864 INFO:teuthology.orchestra.run.smithi117.stdout:standby_count_wanted 1 2024-04-12T09:17:51.864 INFO:teuthology.orchestra.run.smithi117.stdout:qdb_cluster leader: 0 members: 2024-04-12T09:17:51.864 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.eslmxh{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.117:6828/2248590199,v1:172.21.15.117:6829/2248590199] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:17:51.864 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:17:51.864 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:17:51.864 INFO:teuthology.orchestra.run.smithi117.stdout:Standby daemons: 2024-04-12T09:17:51.864 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:17:51.864 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.wddsgt{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/4010127141,v1:172.21.15.117:6827/4010127141] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:17:51.864 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.fbeixl{-1:24265} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.203:6824/840607003,v1:172.21.15.203:6825/840607003] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:17:51.864 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.bszhxz{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/2731911290,v1:172.21.15.203:6827/2731911290] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:17:51.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.862+0000 7fe9a25e4700 1 -- 172.21.15.117:0/3287694511 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe98406dca0 msgr2=0x7fe984070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:51.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.862+0000 7fe9a25e4700 1 --2- 172.21.15.117:0/3287694511 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe98406dca0 0x7fe984070150 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe990007fd0 tx=0x7fe990009040 comp rx=0 tx=0).stop 2024-04-12T09:17:51.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.862+0000 7fe9a25e4700 1 -- 172.21.15.117:0/3287694511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe99c101d70 msgr2=0x7fe99c113b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:51.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.862+0000 7fe9a25e4700 1 --2- 172.21.15.117:0/3287694511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe99c101d70 0x7fe99c113b60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe98c00b8b0 tx=0x7fe98c009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:51.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.862+0000 7fe9a25e4700 1 -- 172.21.15.117:0/3287694511 shutdown_connections 2024-04-12T09:17:51.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.862+0000 7fe9a25e4700 1 --2- 172.21.15.117:0/3287694511 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe98406dca0 0x7fe984070150 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:51.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.862+0000 7fe9a25e4700 1 --2- 172.21.15.117:0/3287694511 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe99c101d70 0x7fe99c113b60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:51.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.862+0000 7fe9a25e4700 1 --2- 172.21.15.117:0/3287694511 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe99c102710 0x7fe99c1140a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:51.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.862+0000 7fe9a25e4700 1 -- 172.21.15.117:0/3287694511 >> 172.21.15.117:0/3287694511 conn(0x7fe99c072bc0 msgr2=0x7fe99c0fb030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:51.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.863+0000 7fe9a25e4700 1 -- 172.21.15.117:0/3287694511 shutdown_connections 2024-04-12T09:17:51.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.863+0000 7fe9a25e4700 1 -- 172.21.15.117:0/3287694511 wait complete. 2024-04-12T09:17:51.866 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 14 2024-04-12T09:17:51.910 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:51 smithi117 podman[130352]: 2024-04-12 09:17:51.751991465 +0000 UTC m=+0.018156393 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:17:51.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:51 smithi117 ceph-mon[113571]: from='client.34216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:17:51.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:51 smithi117 ceph-mon[113571]: pgmap v68: 65 pgs: 11 active+undersized+degraded, 3 stale+active+clean, 18 active+undersized, 33 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 26/225 objects degraded (11.556%) 2024-04-12T09:17:51.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:51 smithi117 ceph-mon[113571]: Health check failed: Degraded data redundancy: 26/225 objects degraded (11.556%), 11 pgs degraded (PG_DEGRADED) 2024-04-12T09:17:51.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:51 smithi117 ceph-mon[113571]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:17:51.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:51 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/1412102269' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:17:51.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.966+0000 7fc1e01c5700 1 -- 172.21.15.117:0/2157201992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1d81037a0 msgr2=0x7fc1d80fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:51.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.966+0000 7fc1e01c5700 1 --2- 172.21.15.117:0/2157201992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1d81037a0 0x7fc1d80fce10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4004940 tx=0x7fc1d4009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:51.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.966+0000 7fc1e01c5700 1 -- 172.21.15.117:0/2157201992 shutdown_connections 2024-04-12T09:17:51.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.966+0000 7fc1e01c5700 1 --2- 172.21.15.117:0/2157201992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1d81037a0 0x7fc1d80fce10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:51.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.966+0000 7fc1e01c5700 1 --2- 172.21.15.117:0/2157201992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc1d8102e00 0x7fc1d81031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:51.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.966+0000 7fc1e01c5700 1 -- 172.21.15.117:0/2157201992 >> 172.21.15.117:0/2157201992 conn(0x7fc1d80f8970 msgr2=0x7fc1d80fad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:51.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.966+0000 7fc1e01c5700 1 -- 172.21.15.117:0/2157201992 shutdown_connections 2024-04-12T09:17:51.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.966+0000 7fc1e01c5700 1 -- 172.21.15.117:0/2157201992 wait complete. 2024-04-12T09:17:51.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.967+0000 7fc1e01c5700 1 Processor -- start 2024-04-12T09:17:51.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.967+0000 7fc1e01c5700 1 -- start start 2024-04-12T09:17:51.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.967+0000 7fc1e01c5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1d8102e00 0x7fc1d8113b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:51.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.967+0000 7fc1e01c5700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc1d81037a0 0x7fc1d81140a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:51.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.967+0000 7fc1e01c5700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d8114780 con 0x7fc1d8102e00 2024-04-12T09:17:51.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.967+0000 7fc1e01c5700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d810dae0 con 0x7fc1d81037a0 2024-04-12T09:17:51.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.967+0000 7fc1ddf61700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1d8102e00 0x7fc1d8113b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:51.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.967+0000 7fc1ddf61700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1d8102e00 0x7fc1d8113b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34970/0 (socket says 172.21.15.117:34970) 2024-04-12T09:17:51.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.967+0000 7fc1ddf61700 1 -- 172.21.15.117:0/4162062806 learned_addr learned my addr 172.21.15.117:0/4162062806 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:17:51.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.967+0000 7fc1dd760700 1 --2- 172.21.15.117:0/4162062806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc1d81037a0 0x7fc1d81140a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:51.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.967+0000 7fc1ddf61700 1 -- 172.21.15.117:0/4162062806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc1d81037a0 msgr2=0x7fc1d81140a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:51.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.967+0000 7fc1ddf61700 1 --2- 172.21.15.117:0/4162062806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc1d81037a0 0x7fc1d81140a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:51.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.967+0000 7fc1ddf61700 1 -- 172.21.15.117:0/4162062806 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d4005040 con 0x7fc1d8102e00 2024-04-12T09:17:51.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.967+0000 7fc1dd760700 1 --2- 172.21.15.117:0/4162062806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc1d81037a0 0x7fc1d81140a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T09:17:51.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.967+0000 7fc1ddf61700 1 --2- 172.21.15.117:0/4162062806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1d8102e00 0x7fc1d8113b60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800b790 tx=0x7fc1c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:51.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.967+0000 7fc1ce7fc700 1 -- 172.21.15.117:0/4162062806 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1c800f770 con 0x7fc1d8102e00 2024-04-12T09:17:51.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.968+0000 7fc1ce7fc700 1 -- 172.21.15.117:0/4162062806 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc1c800fda0 con 0x7fc1d8102e00 2024-04-12T09:17:51.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.968+0000 7fc1ce7fc700 1 -- 172.21.15.117:0/4162062806 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1c800d310 con 0x7fc1d8102e00 2024-04-12T09:17:51.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.968+0000 7fc1e01c5700 1 -- 172.21.15.117:0/4162062806 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d810ddc0 con 0x7fc1d8102e00 2024-04-12T09:17:51.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.968+0000 7fc1e01c5700 1 -- 172.21.15.117:0/4162062806 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d810e350 con 0x7fc1d8102e00 2024-04-12T09:17:51.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.969+0000 7fc1e01c5700 1 -- 172.21.15.117:0/4162062806 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d8100110 con 0x7fc1d8102e00 2024-04-12T09:17:51.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.969+0000 7fc1ce7fc700 1 -- 172.21.15.117:0/4162062806 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fc1c8010420 con 0x7fc1d8102e00 2024-04-12T09:17:51.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.969+0000 7fc1ce7fc700 1 --2- 172.21.15.117:0/4162062806 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc1c406dcb0 0x7fc1c4070160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:51.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.970+0000 7fc1ce7fc700 1 -- 172.21.15.117:0/4162062806 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc1c808d530 con 0x7fc1d8102e00 2024-04-12T09:17:51.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.970+0000 7fc1dd760700 1 --2- 172.21.15.117:0/4162062806 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc1c406dcb0 0x7fc1c4070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:51.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.970+0000 7fc1dd760700 1 --2- 172.21.15.117:0/4162062806 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc1c406dcb0 0x7fc1c4070160 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc1d810edc0 tx=0x7fc1d4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:51.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:51.974+0000 7fc1ce7fc700 1 -- 172.21.15.117:0/4162062806 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc1c805a710 con 0x7fc1d8102e00 2024-04-12T09:17:52.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:51 smithi203 ceph-mon[86783]: from='client.34216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:17:52.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:51 smithi203 ceph-mon[86783]: pgmap v68: 65 pgs: 11 active+undersized+degraded, 3 stale+active+clean, 18 active+undersized, 33 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 26/225 objects degraded (11.556%) 2024-04-12T09:17:52.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:51 smithi203 ceph-mon[86783]: Health check failed: Degraded data redundancy: 26/225 objects degraded (11.556%), 11 pgs degraded (PG_DEGRADED) 2024-04-12T09:17:52.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:51 smithi203 ceph-mon[86783]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:17:52.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:51 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/1412102269' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:17:52.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.193+0000 7fc1e01c5700 1 -- 172.21.15.117:0/4162062806 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1d810f220 con 0x7fc1c406dcb0 2024-04-12T09:17:52.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.195+0000 7fc1ce7fc700 1 -- 172.21.15.117:0/4162062806 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc1d810f220 con 0x7fc1c406dcb0 2024-04-12T09:17:52.195 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:17:52.195 INFO:teuthology.orchestra.run.smithi117.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec", 2024-04-12T09:17:52.195 INFO:teuthology.orchestra.run.smithi117.stdout: "in_progress": true, 2024-04-12T09:17:52.196 INFO:teuthology.orchestra.run.smithi117.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T09:17:52.196 INFO:teuthology.orchestra.run.smithi117.stdout: "services_complete": [ 2024-04-12T09:17:52.196 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr", 2024-04-12T09:17:52.196 INFO:teuthology.orchestra.run.smithi117.stdout: "mon", 2024-04-12T09:17:52.196 INFO:teuthology.orchestra.run.smithi117.stdout: "crash" 2024-04-12T09:17:52.196 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2024-04-12T09:17:52.196 INFO:teuthology.orchestra.run.smithi117.stdout: "progress": "7/21 daemons upgraded", 2024-04-12T09:17:52.196 INFO:teuthology.orchestra.run.smithi117.stdout: "message": "Currently upgrading osd daemons", 2024-04-12T09:17:52.196 INFO:teuthology.orchestra.run.smithi117.stdout: "is_paused": false 2024-04-12T09:17:52.196 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:17:52.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.197+0000 7fc1e01c5700 1 -- 172.21.15.117:0/4162062806 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc1c406dcb0 msgr2=0x7fc1c4070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:52.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.197+0000 7fc1e01c5700 1 --2- 172.21.15.117:0/4162062806 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc1c406dcb0 0x7fc1c4070160 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc1d810edc0 tx=0x7fc1d4009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:52.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.197+0000 7fc1e01c5700 1 -- 172.21.15.117:0/4162062806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1d8102e00 msgr2=0x7fc1d8113b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:52.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.197+0000 7fc1e01c5700 1 --2- 172.21.15.117:0/4162062806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1d8102e00 0x7fc1d8113b60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800b790 tx=0x7fc1c8009250 comp rx=0 tx=0).stop 2024-04-12T09:17:52.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.197+0000 7fc1e01c5700 1 -- 172.21.15.117:0/4162062806 shutdown_connections 2024-04-12T09:17:52.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.197+0000 7fc1e01c5700 1 --2- 172.21.15.117:0/4162062806 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc1c406dcb0 0x7fc1c4070160 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:52.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.197+0000 7fc1e01c5700 1 --2- 172.21.15.117:0/4162062806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1d8102e00 0x7fc1d8113b60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:52.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.197+0000 7fc1e01c5700 1 --2- 172.21.15.117:0/4162062806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc1d81037a0 0x7fc1d81140a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:52.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.197+0000 7fc1e01c5700 1 -- 172.21.15.117:0/4162062806 >> 172.21.15.117:0/4162062806 conn(0x7fc1d80f8970 msgr2=0x7fc1d80fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:52.198 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.197+0000 7fc1e01c5700 1 -- 172.21.15.117:0/4162062806 shutdown_connections 2024-04-12T09:17:52.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.197+0000 7fc1e01c5700 1 -- 172.21.15.117:0/4162062806 wait complete. 2024-04-12T09:17:52.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.299+0000 7f296750c700 1 -- 172.21.15.117:0/1736436191 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29601026c0 msgr2=0x7f29600fbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:52.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.299+0000 7f296750c700 1 --2- 172.21.15.117:0/1736436191 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29601026c0 0x7f29600fbd30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2954004940 tx=0x7f2954009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:52.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.299+0000 7f296750c700 1 -- 172.21.15.117:0/1736436191 shutdown_connections 2024-04-12T09:17:52.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.299+0000 7f296750c700 1 --2- 172.21.15.117:0/1736436191 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29601026c0 0x7f29600fbd30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:52.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.299+0000 7f296750c700 1 --2- 172.21.15.117:0/1736436191 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2960101d20 0x7f29601020f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:52.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.299+0000 7f296750c700 1 -- 172.21.15.117:0/1736436191 >> 172.21.15.117:0/1736436191 conn(0x7f29600f7870 msgr2=0x7f29600f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:52.301 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:52 smithi117 podman[130352]: 2024-04-12 09:17:52.078099642 +0000 UTC m=+0.344264553 container create 418cc28d16072f03039baff755f8acc51a13589c15a3c8bfbc579bb08f2acef9 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1-activate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b277feb, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409) 2024-04-12T09:17:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.300+0000 7f296750c700 1 -- 172.21.15.117:0/1736436191 shutdown_connections 2024-04-12T09:17:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.300+0000 7f296750c700 1 -- 172.21.15.117:0/1736436191 wait complete. 2024-04-12T09:17:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.300+0000 7f296750c700 1 Processor -- start 2024-04-12T09:17:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.300+0000 7f296750c700 1 -- start start 2024-04-12T09:17:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.300+0000 7f296750c700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2960101d20 0x7f29600fd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.300+0000 7f296750c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29601026c0 0x7f29600fdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.300+0000 7f296750c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29600ff8f0 con 0x7f29601026c0 2024-04-12T09:17:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.300+0000 7f296750c700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29600fe420 con 0x7f2960101d20 2024-04-12T09:17:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.300+0000 7f2964aa7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29601026c0 0x7f29600fdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.300+0000 7f2964aa7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29601026c0 0x7f29600fdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:34992/0 (socket says 172.21.15.117:34992) 2024-04-12T09:17:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.300+0000 7f2964aa7700 1 -- 172.21.15.117:0/2277321837 learned_addr learned my addr 172.21.15.117:0/2277321837 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:17:52.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.300+0000 7f29652a8700 1 --2- 172.21.15.117:0/2277321837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2960101d20 0x7f29600fd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:52.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.301+0000 7f2964aa7700 1 -- 172.21.15.117:0/2277321837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2960101d20 msgr2=0x7f29600fd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:52.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.301+0000 7f2964aa7700 1 --2- 172.21.15.117:0/2277321837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2960101d20 0x7f29600fd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:52.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.301+0000 7f2964aa7700 1 -- 172.21.15.117:0/2277321837 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2954005040 con 0x7f29601026c0 2024-04-12T09:17:52.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.301+0000 7f2964aa7700 1 --2- 172.21.15.117:0/2277321837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29601026c0 0x7f29600fdee0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2954009100 tx=0x7f2954009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:52.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.301+0000 7f295dffb700 1 -- 172.21.15.117:0/2277321837 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f295400e040 con 0x7f29601026c0 2024-04-12T09:17:52.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.301+0000 7f296750c700 1 -- 172.21.15.117:0/2277321837 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29600fe6a0 con 0x7f29601026c0 2024-04-12T09:17:52.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.301+0000 7f295dffb700 1 -- 172.21.15.117:0/2277321837 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2954009af0 con 0x7f29601026c0 2024-04-12T09:17:52.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.301+0000 7f295dffb700 1 -- 172.21.15.117:0/2277321837 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f295401c3f0 con 0x7f29601026c0 2024-04-12T09:17:52.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.301+0000 7f296750c700 1 -- 172.21.15.117:0/2277321837 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296011a120 con 0x7f29601026c0 2024-04-12T09:17:52.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.302+0000 7f296750c700 1 -- 172.21.15.117:0/2277321837 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29600fd470 con 0x7f29601026c0 2024-04-12T09:17:52.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.303+0000 7f295dffb700 1 -- 172.21.15.117:0/2277321837 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f295400baf0 con 0x7f29601026c0 2024-04-12T09:17:52.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.303+0000 7f295dffb700 1 --2- 172.21.15.117:0/2277321837 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f294806dca0 0x7f2948070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:17:52.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.303+0000 7f295dffb700 1 -- 172.21.15.117:0/2277321837 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f295408e650 con 0x7f29601026c0 2024-04-12T09:17:52.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.303+0000 7f29652a8700 1 --2- 172.21.15.117:0/2277321837 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f294806dca0 0x7f2948070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:17:52.305 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.304+0000 7f29652a8700 1 --2- 172.21.15.117:0/2277321837 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f294806dca0 0x7f2948070150 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2958004eb0 tx=0x7f295800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:17:52.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.308+0000 7f295dffb700 1 -- 172.21.15.117:0/2277321837 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f2954057da0 con 0x7f29601026c0 2024-04-12T09:17:52.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.597+0000 7f296750c700 1 -- 172.21.15.117:0/2277321837 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f296011a360 con 0x7f29601026c0 2024-04-12T09:17:52.599 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:52 smithi117 podman[130352]: 2024-04-12 09:17:52.322931498 +0000 UTC m=+0.589096419 container init 418cc28d16072f03039baff755f8acc51a13589c15a3c8bfbc579bb08f2acef9 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1-activate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b277feb, GIT_CLEAN=True, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-12T09:17:52.599 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:52 smithi117 podman[130352]: 2024-04-12 09:17:52.326720307 +0000 UTC m=+0.592885228 container start 418cc28d16072f03039baff755f8acc51a13589c15a3c8bfbc579bb08f2acef9 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-b277feb, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS) 2024-04-12T09:17:52.599 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:52 smithi117 podman[130352]: 2024-04-12 09:17:52.422699895 +0000 UTC m=+0.688864814 container attach 418cc28d16072f03039baff755f8acc51a13589c15a3c8bfbc579bb08f2acef9 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1-activate, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b277feb, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-12T09:17:52.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.598+0000 7f295dffb700 1 -- 172.21.15.117:0/2277321837 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+881 (secure 0 0 0) 0x7f295405b460 con 0x7f29601026c0 2024-04-12T09:17:52.599 INFO:teuthology.orchestra.run.smithi117.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 26/225 objects degraded (11.556%), 11 pgs degraded 2024-04-12T09:17:52.599 INFO:teuthology.orchestra.run.smithi117.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-12T09:17:52.599 INFO:teuthology.orchestra.run.smithi117.stdout: osd.1 (root=default,host=smithi117) is down 2024-04-12T09:17:52.599 INFO:teuthology.orchestra.run.smithi117.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 26/225 objects degraded (11.556%), 11 pgs degraded 2024-04-12T09:17:52.600 INFO:teuthology.orchestra.run.smithi117.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-04-12T09:17:52.600 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-04-12T09:17:52.600 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-04-12T09:17:52.600 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-04-12T09:17:52.600 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-04-12T09:17:52.600 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-04-12T09:17:52.600 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-04-12T09:17:52.600 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-04-12T09:17:52.600 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-04-12T09:17:52.600 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-04-12T09:17:52.600 INFO:teuthology.orchestra.run.smithi117.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-04-12T09:17:52.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.600+0000 7f296750c700 1 -- 172.21.15.117:0/2277321837 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f294806dca0 msgr2=0x7f2948070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:52.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.600+0000 7f296750c700 1 --2- 172.21.15.117:0/2277321837 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f294806dca0 0x7f2948070150 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2958004eb0 tx=0x7f295800b040 comp rx=0 tx=0).stop 2024-04-12T09:17:52.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.600+0000 7f296750c700 1 -- 172.21.15.117:0/2277321837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29601026c0 msgr2=0x7f29600fdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:17:52.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.600+0000 7f296750c700 1 --2- 172.21.15.117:0/2277321837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29601026c0 0x7f29600fdee0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2954009100 tx=0x7f2954009e30 comp rx=0 tx=0).stop 2024-04-12T09:17:52.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.600+0000 7f296750c700 1 -- 172.21.15.117:0/2277321837 shutdown_connections 2024-04-12T09:17:52.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.600+0000 7f296750c700 1 --2- 172.21.15.117:0/2277321837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2960101d20 0x7f29600fd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:52.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.600+0000 7f296750c700 1 --2- 172.21.15.117:0/2277321837 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f294806dca0 0x7f2948070150 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:52.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.600+0000 7f296750c700 1 --2- 172.21.15.117:0/2277321837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29601026c0 0x7f29600fdee0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:17:52.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.600+0000 7f296750c700 1 -- 172.21.15.117:0/2277321837 >> 172.21.15.117:0/2277321837 conn(0x7f29600f7870 msgr2=0x7f29600662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:17:52.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.600+0000 7f296750c700 1 -- 172.21.15.117:0/2277321837 shutdown_connections 2024-04-12T09:17:52.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:17:52.600+0000 7f296750c700 1 -- 172.21.15.117:0/2277321837 wait complete. 2024-04-12T09:17:52.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:52 smithi117 ceph-mon[113571]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:17:52.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:52 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/3287694511' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:17:52.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:52 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/2277321837' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:17:52.911 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:52 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1-activate[130390]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-12T09:17:52.911 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:52 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1-activate[130390]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-12T09:17:52.911 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:52 smithi117 bash[130352]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-12T09:17:52.911 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:52 smithi117 bash[130352]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-12T09:17:52.911 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:52 smithi117 bash[130352]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-12T09:17:52.911 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:52 smithi117 bash[130352]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-12T09:17:52.911 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:52 smithi117 bash[130352]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-12T09:17:52.912 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:52 smithi117 bash[130352]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-12T09:17:52.912 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:52 smithi117 bash[130352]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-12T09:17:52.912 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:52 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1-activate[130390]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-12T09:17:52.912 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:52 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1-activate[130390]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-12T09:17:52.912 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:52 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1-activate[130390]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-12T09:17:52.912 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:52 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1-activate[130390]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-12T09:17:52.912 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:52 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1-activate[130390]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-12T09:17:52.912 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:52 smithi117 podman[130352]: 2024-04-12 09:17:52.797191736 +0000 UTC m=+1.063356640 container died 418cc28d16072f03039baff755f8acc51a13589c15a3c8bfbc579bb08f2acef9 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-b277feb, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-04-12T09:17:53.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:52 smithi203 ceph-mon[86783]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:17:53.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:52 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/3287694511' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:17:53.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:52 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/2277321837' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:17:53.837 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:53 smithi117 ceph-mon[113571]: from='client.34236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:17:53.838 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:53 smithi117 ceph-mon[113571]: pgmap v69: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/225 objects degraded (12.000%) 2024-04-12T09:17:53.838 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:53 smithi117 podman[130544]: 2024-04-12 09:17:53.493850789 +0000 UTC m=+0.691228904 container remove 418cc28d16072f03039baff755f8acc51a13589c15a3c8bfbc579bb08f2acef9 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1-activate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b277feb, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T09:17:53.838 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:53 smithi117 podman[130610]: 2024-04-12 09:17:53.61501801 +0000 UTC m=+0.018586763 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:17:53.838 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:53 smithi117 podman[130610]: 2024-04-12 09:17:53.736668523 +0000 UTC m=+0.140237260 container create d40e2dfc164b3dd8bf13a8af028eda854480201d06cb3ff8e833755cb80653b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, RELEASE=squid-b277feb) 2024-04-12T09:17:54.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:53 smithi203 ceph-mon[86783]: from='client.34236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:17:54.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:53 smithi203 ceph-mon[86783]: pgmap v69: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/225 objects degraded (12.000%) 2024-04-12T09:17:54.410 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:53 smithi117 podman[130610]: 2024-04-12 09:17:53.955983216 +0000 UTC m=+0.359551953 container init d40e2dfc164b3dd8bf13a8af028eda854480201d06cb3ff8e833755cb80653b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1, RELEASE=squid-b277feb, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-12T09:17:54.410 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:53 smithi117 podman[130610]: 2024-04-12 09:17:53.959117554 +0000 UTC m=+0.362686292 container start d40e2dfc164b3dd8bf13a8af028eda854480201d06cb3ff8e833755cb80653b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-b277feb, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=) 2024-04-12T09:17:54.410 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:53 smithi117 ceph-osd[130628]: -- 172.21.15.117:0/450202097 <== mon.0 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e1b67ed680 con 0x55e1b67b6c00 2024-04-12T09:17:54.410 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:54 smithi117 bash[130610]: d40e2dfc164b3dd8bf13a8af028eda854480201d06cb3ff8e833755cb80653b4 2024-04-12T09:17:54.411 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:54 smithi117 systemd[1]: Started Ceph osd.1 for 12161984-f8ab-11ee-bc8c-c7b262605968. 2024-04-12T09:17:54.910 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:54 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1[130624]: 2024-04-12T09:17:54.496+0000 7fb4a398c7c0 -1 Falling back to public interface 2024-04-12T09:17:55.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:55 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:55.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:55 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:55.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:55 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:17:55.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:55 smithi117 ceph-mon[113571]: pgmap v70: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/225 objects degraded (12.000%) 2024-04-12T09:17:55.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:55 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:55.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:55 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:17:55.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:55 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:55.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:55 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:55.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:55 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:17:55.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:55 smithi203 ceph-mon[86783]: pgmap v70: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/225 objects degraded (12.000%) 2024-04-12T09:17:55.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:55 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:55.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:55 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:17:56.650 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:56 smithi117 ceph-mon[113571]: Health check update: Degraded data redundancy: 27/225 objects degraded (12.000%), 12 pgs degraded (PG_DEGRADED) 2024-04-12T09:17:56.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:56 smithi203 ceph-mon[86783]: Health check update: Degraded data redundancy: 27/225 objects degraded (12.000%), 12 pgs degraded (PG_DEGRADED) 2024-04-12T09:17:57.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:57 smithi117 ceph-mon[113571]: pgmap v71: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/225 objects degraded (12.000%) 2024-04-12T09:17:57.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:57 smithi203 ceph-mon[86783]: pgmap v71: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/225 objects degraded (12.000%) 2024-04-12T09:17:59.910 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:17:59 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1[130624]: 2024-04-12T09:17:59.584+0000 7fb4a398c7c0 -1 osd.1 54 log_to_monitors true 2024-04-12T09:17:59.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:59 smithi117 ceph-mon[113571]: pgmap v72: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/225 objects degraded (12.000%) 2024-04-12T09:17:59.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:59 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:59.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:59 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:17:59.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:17:59 smithi117 ceph-mon[113571]: from='osd.1 [v2:172.21.15.117:6810/2606394957,v1:172.21.15.117:6811/2606394957]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-12T09:18:00.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:59 smithi203 ceph-mon[86783]: pgmap v72: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 206 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/225 objects degraded (12.000%) 2024-04-12T09:18:00.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:59 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:00.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:59 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:00.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:17:59 smithi203 ceph-mon[86783]: from='osd.1 [v2:172.21.15.117:6810/2606394957,v1:172.21.15.117:6811/2606394957]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-12T09:18:00.910 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:18:00 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1[130624]: 2024-04-12T09:18:00.468+0000 7fb494de4700 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T09:18:01.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:01 smithi203 ceph-mon[86783]: from='osd.1 [v2:172.21.15.117:6810/2606394957,v1:172.21.15.117:6811/2606394957]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-12T09:18:01.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:01 smithi203 ceph-mon[86783]: osdmap e57: 6 total, 5 up, 6 in 2024-04-12T09:18:01.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:01 smithi203 ceph-mon[86783]: from='osd.1 [v2:172.21.15.117:6810/2606394957,v1:172.21.15.117:6811/2606394957]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-04-12T09:18:01.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:01 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:01.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:01 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:01.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:01 smithi203 ceph-mon[86783]: pgmap v74: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 27/225 objects degraded (12.000%) 2024-04-12T09:18:01.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:01 smithi117 ceph-mon[113571]: from='osd.1 [v2:172.21.15.117:6810/2606394957,v1:172.21.15.117:6811/2606394957]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-12T09:18:01.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:01 smithi117 ceph-mon[113571]: osdmap e57: 6 total, 5 up, 6 in 2024-04-12T09:18:01.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:01 smithi117 ceph-mon[113571]: from='osd.1 [v2:172.21.15.117:6810/2606394957,v1:172.21.15.117:6811/2606394957]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-04-12T09:18:01.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:01 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:01.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:01 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:01.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:01 smithi117 ceph-mon[113571]: pgmap v74: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 27/225 objects degraded (12.000%) 2024-04-12T09:18:02.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:02 smithi117 ceph-mon[113571]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-12T09:18:02.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:02 smithi117 ceph-mon[113571]: osd.1 [v2:172.21.15.117:6810/2606394957,v1:172.21.15.117:6811/2606394957] boot 2024-04-12T09:18:02.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:02 smithi117 ceph-mon[113571]: osdmap e58: 6 total, 6 up, 6 in 2024-04-12T09:18:02.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:02 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T09:18:02.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:02 smithi117 ceph-mon[113571]: osdmap e59: 6 total, 6 up, 6 in 2024-04-12T09:18:02.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:02 smithi203 ceph-mon[86783]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-12T09:18:02.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:02 smithi203 ceph-mon[86783]: osd.1 [v2:172.21.15.117:6810/2606394957,v1:172.21.15.117:6811/2606394957] boot 2024-04-12T09:18:02.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:02 smithi203 ceph-mon[86783]: osdmap e58: 6 total, 6 up, 6 in 2024-04-12T09:18:02.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:02 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-12T09:18:02.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:02 smithi203 ceph-mon[86783]: osdmap e59: 6 total, 6 up, 6 in 2024-04-12T09:18:03.529 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:03 smithi117 ceph-mon[113571]: pgmap v77: 65 pgs: 2 peering, 12 active+undersized+degraded, 20 active+undersized, 31 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 27/225 objects degraded (12.000%) 2024-04-12T09:18:03.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:03 smithi203 ceph-mon[86783]: pgmap v77: 65 pgs: 2 peering, 12 active+undersized+degraded, 20 active+undersized, 31 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 27/225 objects degraded (12.000%) 2024-04-12T09:18:05.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:05 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:05.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:05 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:05.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:05 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:18:05.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:05 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:18:05.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:05 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:05.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:05 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:18:05.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:05 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:18:05.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:05 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:18:05.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:05 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:18:05.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:05 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-12T09:18:05.325 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:05 smithi203 ceph-mon[86783]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-12T09:18:05.325 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:05 smithi203 ceph-mon[86783]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-04-12T09:18:05.325 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:05 smithi203 ceph-mon[86783]: pgmap v78: 65 pgs: 2 peering, 12 active+undersized+degraded, 20 active+undersized, 31 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 27/225 objects degraded (12.000%) 2024-04-12T09:18:05.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:05 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:05.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:05 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:05.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:05 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:18:05.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:05 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:18:05.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:05 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:05.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:05 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:18:05.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:05 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:18:05.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:05 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:18:05.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:05 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:18:05.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:05 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-12T09:18:05.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:05 smithi117 ceph-mon[113571]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-12T09:18:05.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:05 smithi117 ceph-mon[113571]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-04-12T09:18:05.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:05 smithi117 ceph-mon[113571]: pgmap v78: 65 pgs: 2 peering, 12 active+undersized+degraded, 20 active+undersized, 31 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 27/225 objects degraded (12.000%) 2024-04-12T09:18:07.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:06 smithi203 ceph-mon[86783]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 27/225 objects degraded (12.000%), 12 pgs degraded) 2024-04-12T09:18:07.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:06 smithi203 ceph-mon[86783]: Cluster is now healthy 2024-04-12T09:18:07.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:06 smithi117 ceph-mon[113571]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 27/225 objects degraded (12.000%), 12 pgs degraded) 2024-04-12T09:18:07.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:06 smithi117 ceph-mon[113571]: Cluster is now healthy 2024-04-12T09:18:08.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:07 smithi203 ceph-mon[86783]: pgmap v79: 65 pgs: 2 peering, 63 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:08.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:07 smithi117 ceph-mon[113571]: pgmap v79: 65 pgs: 2 peering, 63 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:10.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:09 smithi203 ceph-mon[86783]: pgmap v80: 65 pgs: 65 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:10.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:09 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:10.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:09 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:18:10.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:09 smithi117 ceph-mon[113571]: pgmap v80: 65 pgs: 65 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:10.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:09 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:10.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:09 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:18:12.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:11 smithi203 ceph-mon[86783]: pgmap v81: 65 pgs: 65 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:12.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:11 smithi117 ceph-mon[113571]: pgmap v81: 65 pgs: 65 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:13.979 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:13 smithi117 ceph-mon[113571]: pgmap v82: 65 pgs: 65 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:14.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:13 smithi203 ceph-mon[86783]: pgmap v82: 65 pgs: 65 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:15.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:15 smithi117 ceph-mon[113571]: pgmap v83: 65 pgs: 65 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:15.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:15 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:16.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:15 smithi203 ceph-mon[86783]: pgmap v83: 65 pgs: 65 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:16.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:15 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:17.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:17 smithi117 ceph-mon[113571]: pgmap v84: 65 pgs: 65 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:18.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:17 smithi203 ceph-mon[86783]: pgmap v84: 65 pgs: 65 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:19.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:19 smithi117 ceph-mon[113571]: pgmap v85: 65 pgs: 65 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:19.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:19 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-12T09:18:20.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:19 smithi203 ceph-mon[86783]: pgmap v85: 65 pgs: 65 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:20.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:19 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-12T09:18:20.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:20 smithi117 ceph-mon[113571]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-12T09:18:20.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:20 smithi117 ceph-mon[113571]: Upgrade: osd.2 is safe to restart 2024-04-12T09:18:21.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:20 smithi203 ceph-mon[86783]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-12T09:18:21.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:20 smithi203 ceph-mon[86783]: Upgrade: osd.2 is safe to restart 2024-04-12T09:18:21.766 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:21 smithi117 ceph-mon[113571]: pgmap v86: 65 pgs: 65 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:21.766 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:21 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:21.766 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:21 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-12T09:18:21.766 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:21 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:18:22.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:21 smithi203 ceph-mon[86783]: pgmap v86: 65 pgs: 65 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:22.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:21 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:22.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:21 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-12T09:18:22.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:21 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:18:22.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.719+0000 7f02a8941700 1 -- 172.21.15.117:0/1315627255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02a4102710 msgr2=0x7f02a40fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:22.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.719+0000 7f02a8941700 1 --2- 172.21.15.117:0/1315627255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02a4102710 0x7f02a40fbd80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0298004940 tx=0x7f0298009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:22.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.719+0000 7f02a8941700 1 -- 172.21.15.117:0/1315627255 shutdown_connections 2024-04-12T09:18:22.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.719+0000 7f02a8941700 1 --2- 172.21.15.117:0/1315627255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02a4102710 0x7f02a40fbd80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:22.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.719+0000 7f02a8941700 1 --2- 172.21.15.117:0/1315627255 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02a4101d70 0x7f02a4102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:22.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.719+0000 7f02a8941700 1 -- 172.21.15.117:0/1315627255 >> 172.21.15.117:0/1315627255 conn(0x7f02a4072bc0 msgr2=0x7f02a4072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:22.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.719+0000 7f02a8941700 1 -- 172.21.15.117:0/1315627255 shutdown_connections 2024-04-12T09:18:22.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.719+0000 7f02a8941700 1 -- 172.21.15.117:0/1315627255 wait complete. 2024-04-12T09:18:22.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.720+0000 7f02a8941700 1 Processor -- start 2024-04-12T09:18:22.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.720+0000 7f02a8941700 1 -- start start 2024-04-12T09:18:22.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.720+0000 7f02a8941700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02a4101d70 0x7f02a410eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:22.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.720+0000 7f02a8941700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02a4102710 0x7f02a410f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:22.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.720+0000 7f02a8941700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a410f6d0 con 0x7f02a4102710 2024-04-12T09:18:22.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.720+0000 7f02a8941700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a410f810 con 0x7f02a4101d70 2024-04-12T09:18:22.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.720+0000 7f02a1d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02a4102710 0x7f02a410f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:22.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.720+0000 7f02a259c700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02a4101d70 0x7f02a410eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:22.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.720+0000 7f02a1d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02a4102710 0x7f02a410f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44904/0 (socket says 172.21.15.117:44904) 2024-04-12T09:18:22.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.720+0000 7f02a1d9b700 1 -- 172.21.15.117:0/2892207180 learned_addr learned my addr 172.21.15.117:0/2892207180 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:18:22.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.721+0000 7f02a1d9b700 1 -- 172.21.15.117:0/2892207180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02a4101d70 msgr2=0x7f02a410eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:22.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.721+0000 7f02a1d9b700 1 --2- 172.21.15.117:0/2892207180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02a4101d70 0x7f02a410eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:22.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.721+0000 7f02a1d9b700 1 -- 172.21.15.117:0/2892207180 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0298005040 con 0x7f02a4102710 2024-04-12T09:18:22.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.721+0000 7f02a1d9b700 1 --2- 172.21.15.117:0/2892207180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02a4102710 0x7f02a410f080 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0298009100 tx=0x7f0298009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:22.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.721+0000 7f0292ffd700 1 -- 172.21.15.117:0/2892207180 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f029800e040 con 0x7f02a4102710 2024-04-12T09:18:22.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.721+0000 7f02a8941700 1 -- 172.21.15.117:0/2892207180 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a4117bb0 con 0x7f02a4102710 2024-04-12T09:18:22.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.721+0000 7f0292ffd700 1 -- 172.21.15.117:0/2892207180 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0298004290 con 0x7f02a4102710 2024-04-12T09:18:22.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.721+0000 7f0292ffd700 1 -- 172.21.15.117:0/2892207180 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f029801c3f0 con 0x7f02a4102710 2024-04-12T09:18:22.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.721+0000 7f02a8941700 1 -- 172.21.15.117:0/2892207180 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a41180c0 con 0x7f02a4102710 2024-04-12T09:18:22.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.722+0000 7f02a8941700 1 -- 172.21.15.117:0/2892207180 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a4104240 con 0x7f02a4102710 2024-04-12T09:18:22.724 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.723+0000 7f0292ffd700 1 -- 172.21.15.117:0/2892207180 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f0298013690 con 0x7f02a4102710 2024-04-12T09:18:22.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.723+0000 7f0292ffd700 1 --2- 172.21.15.117:0/2892207180 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f028c06dcb0 0x7f028c070160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:22.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.723+0000 7f0292ffd700 1 -- 172.21.15.117:0/2892207180 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f029808e540 con 0x7f02a4102710 2024-04-12T09:18:22.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.724+0000 7f02a259c700 1 --2- 172.21.15.117:0/2892207180 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f028c06dcb0 0x7f028c070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:22.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.724+0000 7f02a259c700 1 --2- 172.21.15.117:0/2892207180 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f028c06dcb0 0x7f028c070160 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0294004f40 tx=0x7f029400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:22.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.728+0000 7f0292ffd700 1 -- 172.21.15.117:0/2892207180 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f0298057c90 con 0x7f02a4102710 2024-04-12T09:18:22.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:22 smithi117 ceph-mon[113571]: Upgrade: Updating osd.2 2024-04-12T09:18:22.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:22 smithi117 ceph-mon[113571]: Deploying daemon osd.2 on smithi117 2024-04-12T09:18:22.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.951+0000 7f02a8941700 1 -- 172.21.15.117:0/2892207180 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f02a4065e20 con 0x7f028c06dcb0 2024-04-12T09:18:22.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.952+0000 7f0292ffd700 1 -- 172.21.15.117:0/2892207180 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f02a4065e20 con 0x7f028c06dcb0 2024-04-12T09:18:22.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.954+0000 7f02a8941700 1 -- 172.21.15.117:0/2892207180 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f028c06dcb0 msgr2=0x7f028c070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:22.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.954+0000 7f02a8941700 1 --2- 172.21.15.117:0/2892207180 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f028c06dcb0 0x7f028c070160 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0294004f40 tx=0x7f029400b040 comp rx=0 tx=0).stop 2024-04-12T09:18:22.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.954+0000 7f02a8941700 1 -- 172.21.15.117:0/2892207180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02a4102710 msgr2=0x7f02a410f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:22.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.954+0000 7f02a8941700 1 --2- 172.21.15.117:0/2892207180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02a4102710 0x7f02a410f080 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0298009100 tx=0x7f0298009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:22.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.954+0000 7f02a8941700 1 -- 172.21.15.117:0/2892207180 shutdown_connections 2024-04-12T09:18:22.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.954+0000 7f02a8941700 1 --2- 172.21.15.117:0/2892207180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02a4101d70 0x7f02a410eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:22.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.954+0000 7f02a8941700 1 --2- 172.21.15.117:0/2892207180 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f028c06dcb0 0x7f028c070160 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:22.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.954+0000 7f02a8941700 1 --2- 172.21.15.117:0/2892207180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02a4102710 0x7f02a410f080 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:22.955 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.954+0000 7f02a8941700 1 -- 172.21.15.117:0/2892207180 >> 172.21.15.117:0/2892207180 conn(0x7f02a4072bc0 msgr2=0x7f02a40fb080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:22.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.954+0000 7f02a8941700 1 -- 172.21.15.117:0/2892207180 shutdown_connections 2024-04-12T09:18:22.956 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:22.954+0000 7f02a8941700 1 -- 172.21.15.117:0/2892207180 wait complete. 2024-04-12T09:18:22.965 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:18:23.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.057+0000 7fac89aaa700 1 -- 172.21.15.117:0/652862004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac841026c0 msgr2=0x7fac840fbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:23.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.057+0000 7fac89aaa700 1 --2- 172.21.15.117:0/652862004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac841026c0 0x7fac840fbd30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fac6c004940 tx=0x7fac6c009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:23.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.057+0000 7fac89aaa700 1 -- 172.21.15.117:0/652862004 shutdown_connections 2024-04-12T09:18:23.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.057+0000 7fac89aaa700 1 --2- 172.21.15.117:0/652862004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac841026c0 0x7fac840fbd30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:23.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.057+0000 7fac89aaa700 1 --2- 172.21.15.117:0/652862004 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac84101d20 0x7fac841020f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:23.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.057+0000 7fac89aaa700 1 -- 172.21.15.117:0/652862004 >> 172.21.15.117:0/652862004 conn(0x7fac840f7870 msgr2=0x7fac840f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:23.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.057+0000 7fac89aaa700 1 -- 172.21.15.117:0/652862004 shutdown_connections 2024-04-12T09:18:23.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.057+0000 7fac89aaa700 1 -- 172.21.15.117:0/652862004 wait complete. 2024-04-12T09:18:23.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.057+0000 7fac89aaa700 1 Processor -- start 2024-04-12T09:18:23.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.057+0000 7fac89aaa700 1 -- start start 2024-04-12T09:18:23.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.058+0000 7fac89aaa700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac84101d20 0x7fac841128b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:23.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.058+0000 7fac89aaa700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac841026c0 0x7fac84112df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:23.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.058+0000 7fac89aaa700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac84113440 con 0x7fac841026c0 2024-04-12T09:18:23.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.058+0000 7fac89aaa700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8410ca40 con 0x7fac84101d20 2024-04-12T09:18:23.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.058+0000 7fac7bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac841026c0 0x7fac84112df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:23.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.058+0000 7fac7bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac841026c0 0x7fac84112df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44924/0 (socket says 172.21.15.117:44924) 2024-04-12T09:18:23.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.058+0000 7fac7bfff700 1 -- 172.21.15.117:0/2845978161 learned_addr learned my addr 172.21.15.117:0/2845978161 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:18:23.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.058+0000 7fac837fe700 1 --2- 172.21.15.117:0/2845978161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac84101d20 0x7fac841128b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:23.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.058+0000 7fac7bfff700 1 -- 172.21.15.117:0/2845978161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac84101d20 msgr2=0x7fac841128b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:23.060 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.058+0000 7fac7bfff700 1 --2- 172.21.15.117:0/2845978161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac84101d20 0x7fac841128b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:23.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.058+0000 7fac7bfff700 1 -- 172.21.15.117:0/2845978161 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac6c005040 con 0x7fac841026c0 2024-04-12T09:18:23.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.058+0000 7fac7bfff700 1 --2- 172.21.15.117:0/2845978161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac841026c0 0x7fac84112df0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009100 tx=0x7fac6c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:23.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.058+0000 7fac80ff9700 1 -- 172.21.15.117:0/2845978161 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac6c00e040 con 0x7fac841026c0 2024-04-12T09:18:23.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.058+0000 7fac89aaa700 1 -- 172.21.15.117:0/2845978161 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8410ccc0 con 0x7fac841026c0 2024-04-12T09:18:23.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.058+0000 7fac80ff9700 1 -- 172.21.15.117:0/2845978161 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fac6c009af0 con 0x7fac841026c0 2024-04-12T09:18:23.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.058+0000 7fac80ff9700 1 -- 172.21.15.117:0/2845978161 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac6c01c3f0 con 0x7fac841026c0 2024-04-12T09:18:23.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.058+0000 7fac89aaa700 1 -- 172.21.15.117:0/2845978161 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8410d280 con 0x7fac841026c0 2024-04-12T09:18:23.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.059+0000 7fac89aaa700 1 -- 172.21.15.117:0/2845978161 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac840fd470 con 0x7fac841026c0 2024-04-12T09:18:23.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.060+0000 7fac80ff9700 1 -- 172.21.15.117:0/2845978161 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fac6c00baf0 con 0x7fac841026c0 2024-04-12T09:18:23.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.060+0000 7fac80ff9700 1 --2- 172.21.15.117:0/2845978161 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fac7006dca0 0x7fac70070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:23.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.060+0000 7fac80ff9700 1 -- 172.21.15.117:0/2845978161 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fac6c08e720 con 0x7fac841026c0 2024-04-12T09:18:23.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.060+0000 7fac837fe700 1 --2- 172.21.15.117:0/2845978161 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fac7006dca0 0x7fac70070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:23.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.061+0000 7fac837fe700 1 --2- 172.21.15.117:0/2845978161 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fac7006dca0 0x7fac70070150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fac74004eb0 tx=0x7fac7400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:23.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.065+0000 7fac80ff9700 1 -- 172.21.15.117:0/2845978161 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fac6c05b900 con 0x7fac841026c0 2024-04-12T09:18:23.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:22 smithi203 ceph-mon[86783]: Upgrade: Updating osd.2 2024-04-12T09:18:23.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:22 smithi203 ceph-mon[86783]: Deploying daemon osd.2 on smithi117 2024-04-12T09:18:23.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.290+0000 7fac89aaa700 1 -- 172.21.15.117:0/2845978161 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fac84108e00 con 0x7fac7006dca0 2024-04-12T09:18:23.291 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.291+0000 7fac80ff9700 1 -- 172.21.15.117:0/2845978161 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fac84108e00 con 0x7fac7006dca0 2024-04-12T09:18:23.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.293+0000 7fac89aaa700 1 -- 172.21.15.117:0/2845978161 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fac7006dca0 msgr2=0x7fac70070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:23.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.293+0000 7fac89aaa700 1 --2- 172.21.15.117:0/2845978161 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fac7006dca0 0x7fac70070150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fac74004eb0 tx=0x7fac7400b040 comp rx=0 tx=0).stop 2024-04-12T09:18:23.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.293+0000 7fac89aaa700 1 -- 172.21.15.117:0/2845978161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac841026c0 msgr2=0x7fac84112df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:23.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.293+0000 7fac89aaa700 1 --2- 172.21.15.117:0/2845978161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac841026c0 0x7fac84112df0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009100 tx=0x7fac6c009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:23.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.293+0000 7fac89aaa700 1 -- 172.21.15.117:0/2845978161 shutdown_connections 2024-04-12T09:18:23.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.293+0000 7fac89aaa700 1 --2- 172.21.15.117:0/2845978161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac84101d20 0x7fac841128b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:23.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.293+0000 7fac89aaa700 1 --2- 172.21.15.117:0/2845978161 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fac7006dca0 0x7fac70070150 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:23.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.293+0000 7fac89aaa700 1 --2- 172.21.15.117:0/2845978161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac841026c0 0x7fac84112df0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:23.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.293+0000 7fac89aaa700 1 -- 172.21.15.117:0/2845978161 >> 172.21.15.117:0/2845978161 conn(0x7fac840f7870 msgr2=0x7fac840f8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:23.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.293+0000 7fac89aaa700 1 -- 172.21.15.117:0/2845978161 shutdown_connections 2024-04-12T09:18:23.294 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.293+0000 7fac89aaa700 1 -- 172.21.15.117:0/2845978161 wait complete. 2024-04-12T09:18:23.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.397+0000 7fb3078c6700 1 -- 172.21.15.117:0/1554602905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3001026c0 msgr2=0x7fb3000fbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:23.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.397+0000 7fb3078c6700 1 --2- 172.21.15.117:0/1554602905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3001026c0 0x7fb3000fbd30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0004940 tx=0x7fb2f0009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:23.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.397+0000 7fb3078c6700 1 -- 172.21.15.117:0/1554602905 shutdown_connections 2024-04-12T09:18:23.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.397+0000 7fb3078c6700 1 --2- 172.21.15.117:0/1554602905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3001026c0 0x7fb3000fbd30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:23.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.397+0000 7fb3078c6700 1 --2- 172.21.15.117:0/1554602905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb300101d20 0x7fb3001020f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:23.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.397+0000 7fb3078c6700 1 -- 172.21.15.117:0/1554602905 >> 172.21.15.117:0/1554602905 conn(0x7fb3000f78d0 msgr2=0x7fb3000f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:23.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.397+0000 7fb3078c6700 1 -- 172.21.15.117:0/1554602905 shutdown_connections 2024-04-12T09:18:23.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.397+0000 7fb3078c6700 1 -- 172.21.15.117:0/1554602905 wait complete. 2024-04-12T09:18:23.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.397+0000 7fb3078c6700 1 Processor -- start 2024-04-12T09:18:23.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.397+0000 7fb3078c6700 1 -- start start 2024-04-12T09:18:23.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.398+0000 7fb3078c6700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb300101d20 0x7fb300112b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:23.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.398+0000 7fb3078c6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3001026c0 0x7fb300113060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:23.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.398+0000 7fb3078c6700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3001136b0 con 0x7fb3001026c0 2024-04-12T09:18:23.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.398+0000 7fb3078c6700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30010caa0 con 0x7fb300101d20 2024-04-12T09:18:23.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.398+0000 7fb304e61700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3001026c0 0x7fb300113060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:23.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.398+0000 7fb304e61700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3001026c0 0x7fb300113060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44948/0 (socket says 172.21.15.117:44948) 2024-04-12T09:18:23.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.398+0000 7fb304e61700 1 -- 172.21.15.117:0/2924457005 learned_addr learned my addr 172.21.15.117:0/2924457005 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:18:23.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.398+0000 7fb305662700 1 --2- 172.21.15.117:0/2924457005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb300101d20 0x7fb300112b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:23.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.398+0000 7fb304e61700 1 -- 172.21.15.117:0/2924457005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb300101d20 msgr2=0x7fb300112b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:23.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.398+0000 7fb304e61700 1 --2- 172.21.15.117:0/2924457005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb300101d20 0x7fb300112b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:23.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.398+0000 7fb304e61700 1 -- 172.21.15.117:0/2924457005 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f0005040 con 0x7fb3001026c0 2024-04-12T09:18:23.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.398+0000 7fb304e61700 1 --2- 172.21.15.117:0/2924457005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3001026c0 0x7fb300113060 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0009100 tx=0x7fb2f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:23.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.398+0000 7fb2f5ffb700 1 -- 172.21.15.117:0/2924457005 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2f000e040 con 0x7fb3001026c0 2024-04-12T09:18:23.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.398+0000 7fb3078c6700 1 -- 172.21.15.117:0/2924457005 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb30010cd20 con 0x7fb3001026c0 2024-04-12T09:18:23.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.398+0000 7fb2f5ffb700 1 -- 172.21.15.117:0/2924457005 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb2f0013420 con 0x7fb3001026c0 2024-04-12T09:18:23.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.398+0000 7fb2f5ffb700 1 -- 172.21.15.117:0/2924457005 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2f001c610 con 0x7fb3001026c0 2024-04-12T09:18:23.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.399+0000 7fb3078c6700 1 -- 172.21.15.117:0/2924457005 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30010d2e0 con 0x7fb3001026c0 2024-04-12T09:18:23.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.400+0000 7fb3078c6700 1 -- 172.21.15.117:0/2924457005 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3000fd470 con 0x7fb3001026c0 2024-04-12T09:18:23.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.400+0000 7fb2f5ffb700 1 -- 172.21.15.117:0/2924457005 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fb2f0013590 con 0x7fb3001026c0 2024-04-12T09:18:23.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.401+0000 7fb2f5ffb700 1 --2- 172.21.15.117:0/2924457005 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb2ec06dca0 0x7fb2ec070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:23.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.401+0000 7fb2f5ffb700 1 -- 172.21.15.117:0/2924457005 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb2f008e640 con 0x7fb3001026c0 2024-04-12T09:18:23.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.401+0000 7fb305662700 1 --2- 172.21.15.117:0/2924457005 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb2ec06dca0 0x7fb2ec070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:23.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.401+0000 7fb305662700 1 --2- 172.21.15.117:0/2924457005 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb2ec06dca0 0x7fb2ec070150 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc009fd0 tx=0x7fb2fc009e50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:23.406 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.405+0000 7fb2f5ffb700 1 -- 172.21.15.117:0/2924457005 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb2f005b8c0 con 0x7fb3001026c0 2024-04-12T09:18:23.623 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.622+0000 7fb3078c6700 1 -- 172.21.15.117:0/2924457005 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb300108e00 con 0x7fb2ec06dca0 2024-04-12T09:18:23.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.632+0000 7fb2f5ffb700 1 -- 172.21.15.117:0/2924457005 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb300108e00 con 0x7fb2ec06dca0 2024-04-12T09:18:23.633 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:18:23.633 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 running (4m) 24s ago 15m 28.6M - 0.25.0 c8568f914cd2 204687f21ed7 2024-04-12T09:18:23.633 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (93s) 24s ago 15m 6656k - 19.0.0-2053-gb277feb2 668895944f0e 038f567b664b 2024-04-12T09:18:23.633 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (88s) 84s ago 14m 6660k - 19.0.0-2053-gb277feb2 668895944f0e 420dee66e230 2024-04-12T09:18:23.633 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 running (3m) 24s ago 15m 79.1M - 9.4.12 2bacad6d85d8 a7b102216886 2024-04-12T09:18:23.633 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (10m) 24s ago 10m 140M - 17.2.7-827-gd3b5060a 21de9b7369ad de062e2c10e7 2024-04-12T09:18:23.633 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 running (10m) 24s ago 10m 14.5M - 17.2.7-827-gd3b5060a 21de9b7369ad 1e82c6241a18 2024-04-12T09:18:23.633 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (9m) 84s ago 9m 16.9M - 17.2.7-827-gd3b5060a 21de9b7369ad b05228e997f7 2024-04-12T09:18:23.633 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (10m) 84s ago 10m 17.1M - 17.2.7-827-gd3b5060a 21de9b7369ad 6d7f82c072c7 2024-04-12T09:18:23.633 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:8443,9283,8765 running (5m) 24s ago 16m 499M - 19.0.0-2053-gb277feb2 668895944f0e fee613d05ab7 2024-04-12T09:18:23.634 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283,8765 running (4m) 84s ago 14m 449M - 19.0.0-2053-gb277feb2 668895944f0e c793944c3e16 2024-04-12T09:18:23.634 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (2m) 24s ago 16m 47.3M 2048M 19.0.0-2053-gb277feb2 668895944f0e 6823aaff30ce 2024-04-12T09:18:23.634 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (2m) 84s ago 14m 35.4M 2048M 19.0.0-2053-gb277feb2 668895944f0e 006c6e487bfb 2024-04-12T09:18:23.634 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 running (4m) 24s ago 15m 15.9M - 1.5.0 0da6a335fe13 c692bed9f6c7 2024-04-12T09:18:23.634 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (4m) 84s ago 14m 15.2M - 1.5.0 0da6a335fe13 f3b5a470f545 2024-04-12T09:18:23.634 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (67s) 24s ago 13m 88.0M 1557M 19.0.0-2053-gb277feb2 668895944f0e 59a180461e3c 2024-04-12T09:18:23.634 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (30s) 24s ago 13m 14.9M 1557M 19.0.0-2053-gb277feb2 668895944f0e d40e2dfc164b 2024-04-12T09:18:23.634 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (12m) 24s ago 12m 200M 1557M 17.2.7-827-gd3b5060a 21de9b7369ad 339c5a80d1dd 2024-04-12T09:18:23.634 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (12m) 84s ago 12m 275M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad fb87d616bae3 2024-04-12T09:18:23.634 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (12m) 84s ago 12m 247M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad c873826a2dea 2024-04-12T09:18:23.634 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (11m) 84s ago 11m 221M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad 69cb7c22f002 2024-04-12T09:18:23.634 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 running (4m) 24s ago 14m 61.0M - 2.43.0 a07b618ecd1d 43ce588d82cc 2024-04-12T09:18:23.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.634+0000 7fb3078c6700 1 -- 172.21.15.117:0/2924457005 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb2ec06dca0 msgr2=0x7fb2ec070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:23.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.634+0000 7fb3078c6700 1 --2- 172.21.15.117:0/2924457005 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb2ec06dca0 0x7fb2ec070150 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc009fd0 tx=0x7fb2fc009e50 comp rx=0 tx=0).stop 2024-04-12T09:18:23.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.634+0000 7fb3078c6700 1 -- 172.21.15.117:0/2924457005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3001026c0 msgr2=0x7fb300113060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:23.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.634+0000 7fb3078c6700 1 --2- 172.21.15.117:0/2924457005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3001026c0 0x7fb300113060 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0009100 tx=0x7fb2f0009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:23.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.634+0000 7fb3078c6700 1 -- 172.21.15.117:0/2924457005 shutdown_connections 2024-04-12T09:18:23.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.634+0000 7fb3078c6700 1 --2- 172.21.15.117:0/2924457005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb300101d20 0x7fb300112b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:23.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.634+0000 7fb3078c6700 1 --2- 172.21.15.117:0/2924457005 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb2ec06dca0 0x7fb2ec070150 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:23.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.634+0000 7fb3078c6700 1 --2- 172.21.15.117:0/2924457005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb3001026c0 0x7fb300113060 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:23.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.634+0000 7fb3078c6700 1 -- 172.21.15.117:0/2924457005 >> 172.21.15.117:0/2924457005 conn(0x7fb3000f78d0 msgr2=0x7fb3000f88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:23.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.635+0000 7fb3078c6700 1 -- 172.21.15.117:0/2924457005 shutdown_connections 2024-04-12T09:18:23.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.635+0000 7fb3078c6700 1 -- 172.21.15.117:0/2924457005 wait complete. 2024-04-12T09:18:23.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.736+0000 7faa38607700 1 -- 172.21.15.117:0/2394411111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa30101d20 msgr2=0x7faa301020f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:23.736 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.736+0000 7faa38607700 1 --2- 172.21.15.117:0/2394411111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa30101d20 0x7faa301020f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faa2c004940 tx=0x7faa2c009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:23.737 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:23 smithi117 ceph-mon[113571]: pgmap v87: 65 pgs: 65 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:23.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.736+0000 7faa38607700 1 -- 172.21.15.117:0/2394411111 shutdown_connections 2024-04-12T09:18:23.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.736+0000 7faa38607700 1 --2- 172.21.15.117:0/2394411111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa301026c0 0x7faa300fbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:23.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.736+0000 7faa38607700 1 --2- 172.21.15.117:0/2394411111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa30101d20 0x7faa301020f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:23.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.736+0000 7faa38607700 1 -- 172.21.15.117:0/2394411111 >> 172.21.15.117:0/2394411111 conn(0x7faa300f78d0 msgr2=0x7faa300f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:23.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.736+0000 7faa38607700 1 -- 172.21.15.117:0/2394411111 shutdown_connections 2024-04-12T09:18:23.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.736+0000 7faa38607700 1 -- 172.21.15.117:0/2394411111 wait complete. 2024-04-12T09:18:23.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.737+0000 7faa38607700 1 Processor -- start 2024-04-12T09:18:23.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.737+0000 7faa38607700 1 -- start start 2024-04-12T09:18:23.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.737+0000 7faa38607700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa30101d20 0x7faa30102b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:23.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.737+0000 7faa38607700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa301026c0 0x7faa301030c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:23.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.737+0000 7faa38607700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa30103650 con 0x7faa30101d20 2024-04-12T09:18:23.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.737+0000 7faa38607700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa30103790 con 0x7faa301026c0 2024-04-12T09:18:23.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.737+0000 7faa363a3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa30101d20 0x7faa30102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:23.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.737+0000 7faa363a3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa30101d20 0x7faa30102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44970/0 (socket says 172.21.15.117:44970) 2024-04-12T09:18:23.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.737+0000 7faa363a3700 1 -- 172.21.15.117:0/1466439119 learned_addr learned my addr 172.21.15.117:0/1466439119 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:18:23.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.737+0000 7faa35ba2700 1 --2- 172.21.15.117:0/1466439119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa301026c0 0x7faa301030c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:23.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.737+0000 7faa363a3700 1 -- 172.21.15.117:0/1466439119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa301026c0 msgr2=0x7faa301030c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:23.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.737+0000 7faa363a3700 1 --2- 172.21.15.117:0/1466439119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa301026c0 0x7faa301030c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:23.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.737+0000 7faa363a3700 1 -- 172.21.15.117:0/1466439119 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2c005040 con 0x7faa30101d20 2024-04-12T09:18:23.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.738+0000 7faa363a3700 1 --2- 172.21.15.117:0/1466439119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa30101d20 0x7faa30102b80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faa2c00b3b0 tx=0x7faa2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:23.740 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.738+0000 7faa26ffd700 1 -- 172.21.15.117:0/1466439119 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa2c00e040 con 0x7faa30101d20 2024-04-12T09:18:23.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.738+0000 7faa26ffd700 1 -- 172.21.15.117:0/1466439119 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faa2c013420 con 0x7faa30101d20 2024-04-12T09:18:23.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.738+0000 7faa38607700 1 -- 172.21.15.117:0/1466439119 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa301039e0 con 0x7faa30101d20 2024-04-12T09:18:23.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.738+0000 7faa26ffd700 1 -- 172.21.15.117:0/1466439119 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa2c01c630 con 0x7faa30101d20 2024-04-12T09:18:23.741 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.738+0000 7faa38607700 1 -- 172.21.15.117:0/1466439119 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa3011a310 con 0x7faa30101d20 2024-04-12T09:18:23.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.739+0000 7faa38607700 1 -- 172.21.15.117:0/1466439119 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa300fd470 con 0x7faa30101d20 2024-04-12T09:18:23.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.739+0000 7faa26ffd700 1 -- 172.21.15.117:0/1466439119 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7faa2c013590 con 0x7faa30101d20 2024-04-12T09:18:23.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.740+0000 7faa26ffd700 1 --2- 172.21.15.117:0/1466439119 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7faa1c06dca0 0x7faa1c070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:23.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.740+0000 7faa26ffd700 1 -- 172.21.15.117:0/1466439119 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7faa2c08e6c0 con 0x7faa30101d20 2024-04-12T09:18:23.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.740+0000 7faa35ba2700 1 --2- 172.21.15.117:0/1466439119 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7faa1c06dca0 0x7faa1c070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:23.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.740+0000 7faa35ba2700 1 --2- 172.21.15.117:0/1466439119 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7faa1c06dca0 0x7faa1c070150 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faa301044c0 tx=0x7faa2000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:23.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:23.747+0000 7faa26ffd700 1 -- 172.21.15.117:0/1466439119 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7faa2c057d70 con 0x7faa30101d20 2024-04-12T09:18:24.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.028+0000 7faa38607700 1 -- 172.21.15.117:0/1466439119 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faa30104270 con 0x7faa30101d20 2024-04-12T09:18:24.029 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.028+0000 7faa26ffd700 1 -- 172.21.15.117:0/1466439119 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7faa2c05b430 con 0x7faa30101d20 2024-04-12T09:18:24.029 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:18:24.029 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": { 2024-04-12T09:18:24.029 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:18:24.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:18:24.029 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": { 2024-04-12T09:18:24.029 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:18:24.029 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:18:24.029 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": { 2024-04-12T09:18:24.030 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 4, 2024-04-12T09:18:24.030 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:18:24.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:18:24.030 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-04-12T09:18:24.030 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 4 2024-04-12T09:18:24.030 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:18:24.030 INFO:teuthology.orchestra.run.smithi117.stdout: "overall": { 2024-04-12T09:18:24.030 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 8, 2024-04-12T09:18:24.030 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 6 2024-04-12T09:18:24.030 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:18:24.030 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:18:24.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.030+0000 7faa38607700 1 -- 172.21.15.117:0/1466439119 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7faa1c06dca0 msgr2=0x7faa1c070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:24.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.030+0000 7faa38607700 1 --2- 172.21.15.117:0/1466439119 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7faa1c06dca0 0x7faa1c070150 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faa301044c0 tx=0x7faa2000b040 comp rx=0 tx=0).stop 2024-04-12T09:18:24.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.030+0000 7faa38607700 1 -- 172.21.15.117:0/1466439119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa30101d20 msgr2=0x7faa30102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:24.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.030+0000 7faa38607700 1 --2- 172.21.15.117:0/1466439119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa30101d20 0x7faa30102b80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faa2c00b3b0 tx=0x7faa2c009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:24.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.030+0000 7faa38607700 1 -- 172.21.15.117:0/1466439119 shutdown_connections 2024-04-12T09:18:24.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.030+0000 7faa38607700 1 --2- 172.21.15.117:0/1466439119 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7faa1c06dca0 0x7faa1c070150 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:24.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.030+0000 7faa38607700 1 --2- 172.21.15.117:0/1466439119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa30101d20 0x7faa30102b80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:24.031 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.030+0000 7faa38607700 1 --2- 172.21.15.117:0/1466439119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa301026c0 0x7faa301030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:24.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.030+0000 7faa38607700 1 -- 172.21.15.117:0/1466439119 >> 172.21.15.117:0/1466439119 conn(0x7faa300f78d0 msgr2=0x7faa300f88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:24.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.030+0000 7faa38607700 1 -- 172.21.15.117:0/1466439119 shutdown_connections 2024-04-12T09:18:24.032 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.030+0000 7faa38607700 1 -- 172.21.15.117:0/1466439119 wait complete. 2024-04-12T09:18:24.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:23 smithi203 ceph-mon[86783]: pgmap v87: 65 pgs: 65 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:24.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.132+0000 7f0b05564700 1 -- 172.21.15.117:0/1033245976 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b001037c0 msgr2=0x7f0b000fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:24.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.132+0000 7f0b05564700 1 --2- 172.21.15.117:0/1033245976 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b001037c0 0x7f0b000fce30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0af4004940 tx=0x7f0af4009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:24.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.132+0000 7f0b05564700 1 -- 172.21.15.117:0/1033245976 shutdown_connections 2024-04-12T09:18:24.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.132+0000 7f0b05564700 1 --2- 172.21.15.117:0/1033245976 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b001037c0 0x7f0b000fce30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:24.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.132+0000 7f0b05564700 1 --2- 172.21.15.117:0/1033245976 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b00102e20 0x7f0b001031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:24.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.132+0000 7f0b05564700 1 -- 172.21.15.117:0/1033245976 >> 172.21.15.117:0/1033245976 conn(0x7f0b000f8970 msgr2=0x7f0b000fad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:24.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.132+0000 7f0b05564700 1 -- 172.21.15.117:0/1033245976 shutdown_connections 2024-04-12T09:18:24.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.132+0000 7f0b05564700 1 -- 172.21.15.117:0/1033245976 wait complete. 2024-04-12T09:18:24.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.133+0000 7f0b05564700 1 Processor -- start 2024-04-12T09:18:24.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.133+0000 7f0b05564700 1 -- start start 2024-04-12T09:18:24.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.133+0000 7f0b05564700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b00102e20 0x7f0b00113c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:24.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.133+0000 7f0b05564700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b001037c0 0x7f0b00114170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:24.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.133+0000 7f0b05564700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b001147c0 con 0x7f0b00102e20 2024-04-12T09:18:24.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.133+0000 7f0b05564700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0010db90 con 0x7f0b001037c0 2024-04-12T09:18:24.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.133+0000 7f0afeffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b00102e20 0x7f0b00113c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:24.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.133+0000 7f0afeffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b00102e20 0x7f0b00113c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:44976/0 (socket says 172.21.15.117:44976) 2024-04-12T09:18:24.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.133+0000 7f0afeffd700 1 -- 172.21.15.117:0/1593474059 learned_addr learned my addr 172.21.15.117:0/1593474059 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:18:24.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.133+0000 7f0afe7fc700 1 --2- 172.21.15.117:0/1593474059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b001037c0 0x7f0b00114170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:24.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.133+0000 7f0afeffd700 1 -- 172.21.15.117:0/1593474059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b001037c0 msgr2=0x7f0b00114170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:24.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.133+0000 7f0afeffd700 1 --2- 172.21.15.117:0/1593474059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b001037c0 0x7f0b00114170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:24.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.133+0000 7f0afeffd700 1 -- 172.21.15.117:0/1593474059 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af4005040 con 0x7f0b00102e20 2024-04-12T09:18:24.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.134+0000 7f0afeffd700 1 --2- 172.21.15.117:0/1593474059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b00102e20 0x7f0b00113c30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0af000c8c0 tx=0x7f0af00044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:24.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.134+0000 7f0ae77fe700 1 -- 172.21.15.117:0/1593474059 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0af000a760 con 0x7f0b00102e20 2024-04-12T09:18:24.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.134+0000 7f0ae77fe700 1 -- 172.21.15.117:0/1593474059 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0af000ad90 con 0x7f0b00102e20 2024-04-12T09:18:24.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.134+0000 7f0b05564700 1 -- 172.21.15.117:0/1593474059 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b0010de70 con 0x7f0b00102e20 2024-04-12T09:18:24.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.134+0000 7f0ae77fe700 1 -- 172.21.15.117:0/1593474059 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0af00113a0 con 0x7f0b00102e20 2024-04-12T09:18:24.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.134+0000 7f0b05564700 1 -- 172.21.15.117:0/1593474059 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b0010e400 con 0x7f0b00102e20 2024-04-12T09:18:24.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.135+0000 7f0b05564700 1 -- 172.21.15.117:0/1593474059 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b001052f0 con 0x7f0b00102e20 2024-04-12T09:18:24.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.135+0000 7f0ae77fe700 1 -- 172.21.15.117:0/1593474059 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f0af0012400 con 0x7f0b00102e20 2024-04-12T09:18:24.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.136+0000 7f0ae77fe700 1 --2- 172.21.15.117:0/1593474059 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f0ae806dca0 0x7f0ae8070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:24.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.136+0000 7f0ae77fe700 1 -- 172.21.15.117:0/1593474059 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f0af008d470 con 0x7f0b00102e20 2024-04-12T09:18:24.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.136+0000 7f0afe7fc700 1 --2- 172.21.15.117:0/1593474059 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f0ae806dca0 0x7f0ae8070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:24.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.136+0000 7f0afe7fc700 1 --2- 172.21.15.117:0/1593474059 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f0ae806dca0 0x7f0ae8070150 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0af4004890 tx=0x7f0af4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:24.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.140+0000 7f0ae77fe700 1 -- 172.21.15.117:0/1593474059 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f0af005a670 con 0x7f0b00102e20 2024-04-12T09:18:24.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.396+0000 7f0b05564700 1 -- 172.21.15.117:0/1593474059 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0b00109f00 con 0x7f0b00102e20 2024-04-12T09:18:24.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.397+0000 7f0ae77fe700 1 -- 172.21.15.117:0/1593474059 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1884 (secure 0 0 0) 0x7f0af005a200 con 0x7f0b00102e20 2024-04-12T09:18:24.398 INFO:teuthology.orchestra.run.smithi117.stdout:e14 2024-04-12T09:18:24.399 INFO:teuthology.orchestra.run.smithi117.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T09:18:24.399 INFO:teuthology.orchestra.run.smithi117.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:18:24.399 INFO:teuthology.orchestra.run.smithi117.stdout:legacy client fscid: 1 2024-04-12T09:18:24.399 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:18:24.399 INFO:teuthology.orchestra.run.smithi117.stdout:Filesystem 'cephfs' (1) 2024-04-12T09:18:24.399 INFO:teuthology.orchestra.run.smithi117.stdout:fs_name cephfs 2024-04-12T09:18:24.399 INFO:teuthology.orchestra.run.smithi117.stdout:epoch 14 2024-04-12T09:18:24.399 INFO:teuthology.orchestra.run.smithi117.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T09:18:24.399 INFO:teuthology.orchestra.run.smithi117.stdout:created 2024-04-12T09:08:12.488144+0000 2024-04-12T09:18:24.399 INFO:teuthology.orchestra.run.smithi117.stdout:modified 2024-04-12T09:08:30.563184+0000 2024-04-12T09:18:24.399 INFO:teuthology.orchestra.run.smithi117.stdout:tableserver 0 2024-04-12T09:18:24.399 INFO:teuthology.orchestra.run.smithi117.stdout:root 0 2024-04-12T09:18:24.399 INFO:teuthology.orchestra.run.smithi117.stdout:session_timeout 60 2024-04-12T09:18:24.399 INFO:teuthology.orchestra.run.smithi117.stdout:session_autoclose 300 2024-04-12T09:18:24.400 INFO:teuthology.orchestra.run.smithi117.stdout:max_file_size 1099511627776 2024-04-12T09:18:24.400 INFO:teuthology.orchestra.run.smithi117.stdout:max_xattr_size 65536 2024-04-12T09:18:24.400 INFO:teuthology.orchestra.run.smithi117.stdout:required_client_features {} 2024-04-12T09:18:24.400 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure 0 2024-04-12T09:18:24.400 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure_osd_epoch 46 2024-04-12T09:18:24.400 INFO:teuthology.orchestra.run.smithi117.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:18:24.400 INFO:teuthology.orchestra.run.smithi117.stdout:max_mds 1 2024-04-12T09:18:24.400 INFO:teuthology.orchestra.run.smithi117.stdout:in 0 2024-04-12T09:18:24.400 INFO:teuthology.orchestra.run.smithi117.stdout:up {0=14474} 2024-04-12T09:18:24.400 INFO:teuthology.orchestra.run.smithi117.stdout:failed 2024-04-12T09:18:24.400 INFO:teuthology.orchestra.run.smithi117.stdout:damaged 2024-04-12T09:18:24.400 INFO:teuthology.orchestra.run.smithi117.stdout:stopped 2024-04-12T09:18:24.400 INFO:teuthology.orchestra.run.smithi117.stdout:data_pools [3] 2024-04-12T09:18:24.400 INFO:teuthology.orchestra.run.smithi117.stdout:metadata_pool 2 2024-04-12T09:18:24.400 INFO:teuthology.orchestra.run.smithi117.stdout:inline_data disabled 2024-04-12T09:18:24.401 INFO:teuthology.orchestra.run.smithi117.stdout:balancer 2024-04-12T09:18:24.401 INFO:teuthology.orchestra.run.smithi117.stdout:bal_rank_mask -1 2024-04-12T09:18:24.401 INFO:teuthology.orchestra.run.smithi117.stdout:standby_count_wanted 1 2024-04-12T09:18:24.401 INFO:teuthology.orchestra.run.smithi117.stdout:qdb_cluster leader: 0 members: 2024-04-12T09:18:24.401 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.eslmxh{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.117:6828/2248590199,v1:172.21.15.117:6829/2248590199] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:18:24.401 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:18:24.401 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:18:24.401 INFO:teuthology.orchestra.run.smithi117.stdout:Standby daemons: 2024-04-12T09:18:24.401 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:18:24.401 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.wddsgt{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/4010127141,v1:172.21.15.117:6827/4010127141] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:18:24.401 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.fbeixl{-1:24265} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.203:6824/840607003,v1:172.21.15.203:6825/840607003] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:18:24.401 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.bszhxz{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/2731911290,v1:172.21.15.203:6827/2731911290] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:18:24.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.399+0000 7f0b05564700 1 -- 172.21.15.117:0/1593474059 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f0ae806dca0 msgr2=0x7f0ae8070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:24.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.399+0000 7f0b05564700 1 --2- 172.21.15.117:0/1593474059 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f0ae806dca0 0x7f0ae8070150 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0af4004890 tx=0x7f0af4009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:24.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.399+0000 7f0b05564700 1 -- 172.21.15.117:0/1593474059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b00102e20 msgr2=0x7f0b00113c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:24.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.399+0000 7f0b05564700 1 --2- 172.21.15.117:0/1593474059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b00102e20 0x7f0b00113c30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0af000c8c0 tx=0x7f0af00044c0 comp rx=0 tx=0).stop 2024-04-12T09:18:24.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.399+0000 7f0b05564700 1 -- 172.21.15.117:0/1593474059 shutdown_connections 2024-04-12T09:18:24.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.399+0000 7f0b05564700 1 --2- 172.21.15.117:0/1593474059 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f0ae806dca0 0x7f0ae8070150 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:24.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.399+0000 7f0b05564700 1 --2- 172.21.15.117:0/1593474059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b00102e20 0x7f0b00113c30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:24.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.399+0000 7f0b05564700 1 --2- 172.21.15.117:0/1593474059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b001037c0 0x7f0b00114170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:24.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.399+0000 7f0b05564700 1 -- 172.21.15.117:0/1593474059 >> 172.21.15.117:0/1593474059 conn(0x7f0b000f8970 msgr2=0x7f0b00102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:24.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.399+0000 7f0b05564700 1 -- 172.21.15.117:0/1593474059 shutdown_connections 2024-04-12T09:18:24.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.399+0000 7f0b05564700 1 -- 172.21.15.117:0/1593474059 wait complete. 2024-04-12T09:18:24.403 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 14 2024-04-12T09:18:24.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.503+0000 7f95e66f7700 1 -- 172.21.15.117:0/2955489171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95e01037c0 msgr2=0x7f95e00fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:24.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.503+0000 7f95e66f7700 1 --2- 172.21.15.117:0/2955489171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95e01037c0 0x7f95e00fce30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f95d4004940 tx=0x7f95d4009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:24.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.504+0000 7f95e66f7700 1 -- 172.21.15.117:0/2955489171 shutdown_connections 2024-04-12T09:18:24.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.504+0000 7f95e66f7700 1 --2- 172.21.15.117:0/2955489171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95e01037c0 0x7f95e00fce30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:24.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.504+0000 7f95e66f7700 1 --2- 172.21.15.117:0/2955489171 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95e0102e20 0x7f95e01031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:24.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.504+0000 7f95e66f7700 1 -- 172.21.15.117:0/2955489171 >> 172.21.15.117:0/2955489171 conn(0x7f95e00f89d0 msgr2=0x7f95e00fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:24.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.504+0000 7f95e66f7700 1 -- 172.21.15.117:0/2955489171 shutdown_connections 2024-04-12T09:18:24.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.504+0000 7f95e66f7700 1 -- 172.21.15.117:0/2955489171 wait complete. 2024-04-12T09:18:24.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.504+0000 7f95e66f7700 1 Processor -- start 2024-04-12T09:18:24.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.504+0000 7f95e66f7700 1 -- start start 2024-04-12T09:18:24.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.505+0000 7f95e66f7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95e0102e20 0x7f95e0113d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:24.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.505+0000 7f95e66f7700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95e0114270 0x7f95e010dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:24.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.505+0000 7f95e66f7700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e01147f0 con 0x7f95e0102e20 2024-04-12T09:18:24.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.505+0000 7f95e66f7700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e0114960 con 0x7f95e0114270 2024-04-12T09:18:24.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.505+0000 7f95dffff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95e0102e20 0x7f95e0113d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:24.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.505+0000 7f95dffff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95e0102e20 0x7f95e0113d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45000/0 (socket says 172.21.15.117:45000) 2024-04-12T09:18:24.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.505+0000 7f95dffff700 1 -- 172.21.15.117:0/4264318644 learned_addr learned my addr 172.21.15.117:0/4264318644 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:18:24.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.505+0000 7f95df7fe700 1 --2- 172.21.15.117:0/4264318644 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95e0114270 0x7f95e010dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:24.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.505+0000 7f95dffff700 1 -- 172.21.15.117:0/4264318644 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95e0114270 msgr2=0x7f95e010dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:24.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.505+0000 7f95dffff700 1 --2- 172.21.15.117:0/4264318644 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95e0114270 0x7f95e010dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:24.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.505+0000 7f95dffff700 1 -- 172.21.15.117:0/4264318644 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d4005040 con 0x7f95e0102e20 2024-04-12T09:18:24.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.506+0000 7f95dffff700 1 --2- 172.21.15.117:0/4264318644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95e0102e20 0x7f95e0113d30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f95d0002a50 tx=0x7f95d00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:24.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.506+0000 7f95dcff9700 1 -- 172.21.15.117:0/4264318644 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95d0007cc0 con 0x7f95e0102e20 2024-04-12T09:18:24.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.506+0000 7f95dcff9700 1 -- 172.21.15.117:0/4264318644 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f95d000f040 con 0x7f95e0102e20 2024-04-12T09:18:24.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.506+0000 7f95dcff9700 1 -- 172.21.15.117:0/4264318644 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95d0009640 con 0x7f95e0102e20 2024-04-12T09:18:24.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.506+0000 7f95e66f7700 1 -- 172.21.15.117:0/4264318644 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e010e290 con 0x7f95e0102e20 2024-04-12T09:18:24.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.506+0000 7f95e66f7700 1 -- 172.21.15.117:0/4264318644 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e010e850 con 0x7f95e0102e20 2024-04-12T09:18:24.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.507+0000 7f95e66f7700 1 -- 172.21.15.117:0/4264318644 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e01052f0 con 0x7f95e0102e20 2024-04-12T09:18:24.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.507+0000 7f95dcff9700 1 -- 172.21.15.117:0/4264318644 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f95d0009820 con 0x7f95e0102e20 2024-04-12T09:18:24.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.508+0000 7f95dcff9700 1 --2- 172.21.15.117:0/4264318644 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f95c806dca0 0x7f95c8070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:24.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.508+0000 7f95dcff9700 1 -- 172.21.15.117:0/4264318644 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f95d008d1f0 con 0x7f95e0102e20 2024-04-12T09:18:24.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.508+0000 7f95df7fe700 1 --2- 172.21.15.117:0/4264318644 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f95c806dca0 0x7f95c8070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:24.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.508+0000 7f95df7fe700 1 --2- 172.21.15.117:0/4264318644 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f95c806dca0 0x7f95c8070150 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f95d4009040 tx=0x7f95d4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:24.513 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.512+0000 7f95dcff9700 1 -- 172.21.15.117:0/4264318644 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f95d005a3d0 con 0x7f95e0102e20 2024-04-12T09:18:24.660 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:24 smithi117 systemd[1]: Stopping Ceph osd.2 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:18:24.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.763+0000 7f95e66f7700 1 -- 172.21.15.117:0/4264318644 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f95e005f650 con 0x7f95c806dca0 2024-04-12T09:18:24.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.764+0000 7f95dcff9700 1 -- 172.21.15.117:0/4264318644 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f95e005f650 con 0x7f95c806dca0 2024-04-12T09:18:24.765 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:18:24.765 INFO:teuthology.orchestra.run.smithi117.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec", 2024-04-12T09:18:24.765 INFO:teuthology.orchestra.run.smithi117.stdout: "in_progress": true, 2024-04-12T09:18:24.765 INFO:teuthology.orchestra.run.smithi117.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T09:18:24.765 INFO:teuthology.orchestra.run.smithi117.stdout: "services_complete": [ 2024-04-12T09:18:24.765 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr", 2024-04-12T09:18:24.765 INFO:teuthology.orchestra.run.smithi117.stdout: "mon", 2024-04-12T09:18:24.766 INFO:teuthology.orchestra.run.smithi117.stdout: "crash" 2024-04-12T09:18:24.766 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2024-04-12T09:18:24.766 INFO:teuthology.orchestra.run.smithi117.stdout: "progress": "8/21 daemons upgraded", 2024-04-12T09:18:24.766 INFO:teuthology.orchestra.run.smithi117.stdout: "message": "Currently upgrading osd daemons", 2024-04-12T09:18:24.766 INFO:teuthology.orchestra.run.smithi117.stdout: "is_paused": false 2024-04-12T09:18:24.766 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:18:24.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.766+0000 7f95e66f7700 1 -- 172.21.15.117:0/4264318644 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f95c806dca0 msgr2=0x7f95c8070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:24.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.766+0000 7f95e66f7700 1 --2- 172.21.15.117:0/4264318644 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f95c806dca0 0x7f95c8070150 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f95d4009040 tx=0x7f95d4009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:24.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.766+0000 7f95e66f7700 1 -- 172.21.15.117:0/4264318644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95e0102e20 msgr2=0x7f95e0113d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:24.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.766+0000 7f95e66f7700 1 --2- 172.21.15.117:0/4264318644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95e0102e20 0x7f95e0113d30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f95d0002a50 tx=0x7f95d00046b0 comp rx=0 tx=0).stop 2024-04-12T09:18:24.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.766+0000 7f95e66f7700 1 -- 172.21.15.117:0/4264318644 shutdown_connections 2024-04-12T09:18:24.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.766+0000 7f95e66f7700 1 --2- 172.21.15.117:0/4264318644 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f95c806dca0 0x7f95c8070150 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:24.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.766+0000 7f95e66f7700 1 --2- 172.21.15.117:0/4264318644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95e0102e20 0x7f95e0113d30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:24.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.766+0000 7f95e66f7700 1 --2- 172.21.15.117:0/4264318644 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95e0114270 0x7f95e010dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:24.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.766+0000 7f95e66f7700 1 -- 172.21.15.117:0/4264318644 >> 172.21.15.117:0/4264318644 conn(0x7f95e00f89d0 msgr2=0x7f95e00f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:24.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.767+0000 7f95e66f7700 1 -- 172.21.15.117:0/4264318644 shutdown_connections 2024-04-12T09:18:24.768 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.767+0000 7f95e66f7700 1 -- 172.21.15.117:0/4264318644 wait complete. 2024-04-12T09:18:24.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.869+0000 7fe369d45700 1 -- 172.21.15.117:0/1089076980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe364102e00 msgr2=0x7fe3641031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:24.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.869+0000 7fe369d45700 1 --2- 172.21.15.117:0/1089076980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe364102e00 0x7fe3641031d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe354004940 tx=0x7fe354009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:24.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.869+0000 7fe369d45700 1 -- 172.21.15.117:0/1089076980 shutdown_connections 2024-04-12T09:18:24.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.869+0000 7fe369d45700 1 --2- 172.21.15.117:0/1089076980 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3641037a0 0x7fe3640fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:24.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.869+0000 7fe369d45700 1 --2- 172.21.15.117:0/1089076980 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe364102e00 0x7fe3641031d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:24.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.869+0000 7fe369d45700 1 -- 172.21.15.117:0/1089076980 >> 172.21.15.117:0/1089076980 conn(0x7fe3640f89b0 msgr2=0x7fe3640fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:24.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.870+0000 7fe369d45700 1 -- 172.21.15.117:0/1089076980 shutdown_connections 2024-04-12T09:18:24.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.870+0000 7fe369d45700 1 -- 172.21.15.117:0/1089076980 wait complete. 2024-04-12T09:18:24.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.870+0000 7fe369d45700 1 Processor -- start 2024-04-12T09:18:24.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.870+0000 7fe369d45700 1 -- start start 2024-04-12T09:18:24.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.870+0000 7fe369d45700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe364102e00 0x7fe364113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:24.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.870+0000 7fe369d45700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3641037a0 0x7fe364113ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:24.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.870+0000 7fe369d45700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe364114520 con 0x7fe3641037a0 2024-04-12T09:18:24.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.870+0000 7fe369d45700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36410db70 con 0x7fe364102e00 2024-04-12T09:18:24.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.871+0000 7fe362ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3641037a0 0x7fe364113ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:24.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.871+0000 7fe362ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3641037a0 0x7fe364113ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45022/0 (socket says 172.21.15.117:45022) 2024-04-12T09:18:24.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.871+0000 7fe362ffd700 1 -- 172.21.15.117:0/169343064 learned_addr learned my addr 172.21.15.117:0/169343064 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:18:24.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.871+0000 7fe3637fe700 1 --2- 172.21.15.117:0/169343064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe364102e00 0x7fe364113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:24.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.871+0000 7fe362ffd700 1 -- 172.21.15.117:0/169343064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe364102e00 msgr2=0x7fe364113990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:24.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.871+0000 7fe362ffd700 1 --2- 172.21.15.117:0/169343064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe364102e00 0x7fe364113990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:24.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.871+0000 7fe362ffd700 1 -- 172.21.15.117:0/169343064 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe354005040 con 0x7fe3641037a0 2024-04-12T09:18:24.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.871+0000 7fe362ffd700 1 --2- 172.21.15.117:0/169343064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3641037a0 0x7fe364113ed0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe358002a50 tx=0x7fe358004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:24.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.871+0000 7fe34bfff700 1 -- 172.21.15.117:0/169343064 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe358007cc0 con 0x7fe3641037a0 2024-04-12T09:18:24.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.871+0000 7fe34bfff700 1 -- 172.21.15.117:0/169343064 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe35800f040 con 0x7fe3641037a0 2024-04-12T09:18:24.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.871+0000 7fe369d45700 1 -- 172.21.15.117:0/169343064 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe36410de50 con 0x7fe3641037a0 2024-04-12T09:18:24.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.871+0000 7fe34bfff700 1 -- 172.21.15.117:0/169343064 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe35800d9c0 con 0x7fe3641037a0 2024-04-12T09:18:24.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.871+0000 7fe369d45700 1 -- 172.21.15.117:0/169343064 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe36410e410 con 0x7fe3641037a0 2024-04-12T09:18:24.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.872+0000 7fe369d45700 1 -- 172.21.15.117:0/169343064 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe364100110 con 0x7fe3641037a0 2024-04-12T09:18:24.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.873+0000 7fe34bfff700 1 -- 172.21.15.117:0/169343064 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fe358009730 con 0x7fe3641037a0 2024-04-12T09:18:24.875 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.873+0000 7fe34bfff700 1 --2- 172.21.15.117:0/169343064 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe34c06dca0 0x7fe34c070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:24.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.873+0000 7fe34bfff700 1 -- 172.21.15.117:0/169343064 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe35808d210 con 0x7fe3641037a0 2024-04-12T09:18:24.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.873+0000 7fe3637fe700 1 --2- 172.21.15.117:0/169343064 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe34c06dca0 0x7fe34c070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:24.876 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.874+0000 7fe3637fe700 1 --2- 172.21.15.117:0/169343064 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe34c06dca0 0x7fe34c070150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe35400b3b0 tx=0x7fe354009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:24.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:24.878+0000 7fe34bfff700 1 -- 172.21.15.117:0/169343064 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fe35805a370 con 0x7fe3641037a0 2024-04-12T09:18:25.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:24 smithi203 ceph-mon[86783]: from='client.34248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:18:25.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:24 smithi203 ceph-mon[86783]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:18:25.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:24 smithi203 ceph-mon[86783]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:18:25.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:24 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/1466439119' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:18:25.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:24 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/1593474059' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:18:25.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:24 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:18:25.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:25.153+0000 7fe369d45700 1 -- 172.21.15.117:0/169343064 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe36410f010 con 0x7fe3641037a0 2024-04-12T09:18:25.154 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:24 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2[62861]: 2024-04-12T09:18:24.814+0000 7f689684c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T09:18:25.154 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:24 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2[62861]: 2024-04-12T09:18:24.814+0000 7f689684c700 -1 osd.2 59 *** Got signal Terminated *** 2024-04-12T09:18:25.154 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:24 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2[62861]: 2024-04-12T09:18:24.814+0000 7f689684c700 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T09:18:25.155 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:24 smithi117 ceph-mon[113571]: from='client.34248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:18:25.155 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:24 smithi117 ceph-mon[113571]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:18:25.155 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:24 smithi117 ceph-mon[113571]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:18:25.155 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:24 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/1466439119' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:18:25.155 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:24 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/1593474059' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:18:25.155 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:24 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:18:25.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:25.153+0000 7fe34bfff700 1 -- 172.21.15.117:0/169343064 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe358059f00 con 0x7fe3641037a0 2024-04-12T09:18:25.155 INFO:teuthology.orchestra.run.smithi117.stdout:HEALTH_OK 2024-04-12T09:18:25.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:25.155+0000 7fe369d45700 1 -- 172.21.15.117:0/169343064 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe34c06dca0 msgr2=0x7fe34c070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:25.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:25.155+0000 7fe369d45700 1 --2- 172.21.15.117:0/169343064 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe34c06dca0 0x7fe34c070150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe35400b3b0 tx=0x7fe354009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:25.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:25.155+0000 7fe369d45700 1 -- 172.21.15.117:0/169343064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3641037a0 msgr2=0x7fe364113ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:25.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:25.155+0000 7fe369d45700 1 --2- 172.21.15.117:0/169343064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3641037a0 0x7fe364113ed0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe358002a50 tx=0x7fe358004600 comp rx=0 tx=0).stop 2024-04-12T09:18:25.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:25.155+0000 7fe369d45700 1 -- 172.21.15.117:0/169343064 shutdown_connections 2024-04-12T09:18:25.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:25.155+0000 7fe369d45700 1 --2- 172.21.15.117:0/169343064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe364102e00 0x7fe364113990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:25.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:25.155+0000 7fe369d45700 1 --2- 172.21.15.117:0/169343064 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe34c06dca0 0x7fe34c070150 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:25.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:25.155+0000 7fe369d45700 1 --2- 172.21.15.117:0/169343064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3641037a0 0x7fe364113ed0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:25.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:25.155+0000 7fe369d45700 1 -- 172.21.15.117:0/169343064 >> 172.21.15.117:0/169343064 conn(0x7fe3640f89b0 msgr2=0x7fe3641073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:25.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:25.156+0000 7fe369d45700 1 -- 172.21.15.117:0/169343064 shutdown_connections 2024-04-12T09:18:25.157 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:25.156+0000 7fe369d45700 1 -- 172.21.15.117:0/169343064 wait complete. 2024-04-12T09:18:26.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:25 smithi203 ceph-mon[86783]: pgmap v88: 65 pgs: 65 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:26.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:25 smithi203 ceph-mon[86783]: from='client.34268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:18:26.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:25 smithi203 ceph-mon[86783]: osd.2 marked itself down and dead 2024-04-12T09:18:26.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:25 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/169343064' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:18:26.129 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:25 smithi117 ceph-mon[113571]: pgmap v88: 65 pgs: 65 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:26.129 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:25 smithi117 ceph-mon[113571]: from='client.34268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:18:26.129 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:25 smithi117 ceph-mon[113571]: osd.2 marked itself down and dead 2024-04-12T09:18:26.129 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:25 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/169343064' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:18:26.410 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:26 smithi117 podman[135649]: 2024-04-12 09:18:26.129246495 +0000 UTC m=+1.417707450 container stop 339c5a80d1dda44614da8640f64f1bfe8e365f4f7619da3858087ea4bb6d67f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, RELEASE=quincy-d3b5060, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-04-12T09:18:26.410 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:26 smithi117 podman[135649]: 2024-04-12 09:18:26.15516513 +0000 UTC m=+1.443626083 container died 339c5a80d1dda44614da8640f64f1bfe8e365f4f7619da3858087ea4bb6d67f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=quincy-d3b5060, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240409) 2024-04-12T09:18:26.799 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:26 smithi117 ceph-mon[113571]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-12T09:18:26.800 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:26 smithi117 ceph-mon[113571]: osdmap e60: 6 total, 5 up, 6 in 2024-04-12T09:18:26.800 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:26 smithi117 podman[135649]: 2024-04-12 09:18:26.560493253 +0000 UTC m=+1.848954209 container cleanup 339c5a80d1dda44614da8640f64f1bfe8e365f4f7619da3858087ea4bb6d67f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=quincy-d3b5060, ceph=True, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-12T09:18:26.800 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:26 smithi117 bash[135649]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2 2024-04-12T09:18:27.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:26 smithi203 ceph-mon[86783]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-12T09:18:27.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:26 smithi203 ceph-mon[86783]: osdmap e60: 6 total, 5 up, 6 in 2024-04-12T09:18:27.160 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:26 smithi117 podman[135694]: 2024-04-12 09:18:26.799818025 +0000 UTC m=+0.663791126 container remove 339c5a80d1dda44614da8640f64f1bfe8e365f4f7619da3858087ea4bb6d67f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2, GIT_CLEAN=True, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=quincy-d3b5060) 2024-04-12T09:18:27.511 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:27 smithi117 podman[135790]: 2024-04-12 09:18:27.102665802 +0000 UTC m=+0.018077856 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:18:27.511 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:27 smithi117 podman[135790]: 2024-04-12 09:18:27.208976686 +0000 UTC m=+0.124388724 container create 053ef4793bb9a6bf7ec7e6ad93676998743da2ead9654394eedd5ad23ecc4b81 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2-deactivate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-b277feb, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240409, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-12T09:18:27.512 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:27 smithi117 podman[135790]: 2024-04-12 09:18:27.411723668 +0000 UTC m=+0.327135708 container init 053ef4793bb9a6bf7ec7e6ad93676998743da2ead9654394eedd5ad23ecc4b81 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-b277feb, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240409, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-04-12T09:18:27.512 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:27 smithi117 podman[135790]: 2024-04-12 09:18:27.414873723 +0000 UTC m=+0.330285764 container start 053ef4793bb9a6bf7ec7e6ad93676998743da2ead9654394eedd5ad23ecc4b81 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2-deactivate, RELEASE=squid-b277feb, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-12T09:18:27.512 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:27 smithi117 podman[135790]: 2024-04-12 09:18:27.511737851 +0000 UTC m=+0.427149900 container attach 053ef4793bb9a6bf7ec7e6ad93676998743da2ead9654394eedd5ad23ecc4b81 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.build-date=20240409, RELEASE=squid-b277feb, ceph=True) 2024-04-12T09:18:27.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:27 smithi117 ceph-mon[113571]: pgmap v90: 65 pgs: 9 stale+active+clean, 56 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:27.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:27 smithi117 ceph-mon[113571]: osdmap e61: 6 total, 5 up, 6 in 2024-04-12T09:18:27.911 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:27 smithi117 podman[135790]: 2024-04-12 09:18:27.714286329 +0000 UTC m=+0.629698361 container died 053ef4793bb9a6bf7ec7e6ad93676998743da2ead9654394eedd5ad23ecc4b81 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-b277feb) 2024-04-12T09:18:28.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:27 smithi203 ceph-mon[86783]: pgmap v90: 65 pgs: 9 stale+active+clean, 56 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:28.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:27 smithi203 ceph-mon[86783]: osdmap e61: 6 total, 5 up, 6 in 2024-04-12T09:18:28.660 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:28 smithi117 podman[135816]: 2024-04-12 09:18:28.298564654 +0000 UTC m=+0.579024362 container remove 053ef4793bb9a6bf7ec7e6ad93676998743da2ead9654394eedd5ad23ecc4b81 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2-deactivate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, RELEASE=squid-b277feb, CEPH_POINT_RELEASE=) 2024-04-12T09:18:28.660 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:28 smithi117 systemd[1]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.2.service: Deactivated successfully. 2024-04-12T09:18:28.660 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:28 smithi117 systemd[1]: Stopped Ceph osd.2 for 12161984-f8ab-11ee-bc8c-c7b262605968. 2024-04-12T09:18:28.660 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:28 smithi117 systemd[1]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.2.service: Consumed 54.877s CPU time. 2024-04-12T09:18:28.660 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:28 smithi117 systemd[1]: Starting Ceph osd.2 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:18:28.981 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:28 smithi117 ceph-mon[113571]: Health check failed: Degraded data redundancy: 9/225 objects degraded (4.000%), 4 pgs degraded (PG_DEGRADED) 2024-04-12T09:18:28.981 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:28 smithi117 podman[135924]: 2024-04-12 09:18:28.633690588 +0000 UTC m=+0.017659395 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:18:28.981 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:28 smithi117 podman[135924]: 2024-04-12 09:18:28.758521037 +0000 UTC m=+0.142489868 container create eb82efea79789fa8423b881113e958fcc43e8169b896f367453a7f7abf82332d (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b277feb) 2024-04-12T09:18:28.982 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:28 smithi117 podman[135924]: 2024-04-12 09:18:28.978183492 +0000 UTC m=+0.362152297 container init eb82efea79789fa8423b881113e958fcc43e8169b896f367453a7f7abf82332d (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2-activate, org.label-schema.build-date=20240409, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b277feb, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-12T09:18:28.982 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:28 smithi117 podman[135924]: 2024-04-12 09:18:28.981495754 +0000 UTC m=+0.365464551 container start eb82efea79789fa8423b881113e958fcc43e8169b896f367453a7f7abf82332d (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2-activate, RELEASE=squid-b277feb, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240409, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-12T09:18:29.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:28 smithi203 ceph-mon[86783]: Health check failed: Degraded data redundancy: 9/225 objects degraded (4.000%), 4 pgs degraded (PG_DEGRADED) 2024-04-12T09:18:29.410 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:29 smithi117 podman[135924]: 2024-04-12 09:18:29.077987506 +0000 UTC m=+0.461956298 container attach eb82efea79789fa8423b881113e958fcc43e8169b896f367453a7f7abf82332d (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2-activate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b277feb, org.label-schema.build-date=20240409, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-04-12T09:18:29.731 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:29 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2-activate[135939]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-12T09:18:29.731 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:29 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2-activate[135939]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-12T09:18:29.731 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:29 smithi117 bash[135924]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-12T09:18:29.731 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:29 smithi117 bash[135924]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-12T09:18:29.732 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:29 smithi117 bash[135924]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-12T09:18:29.732 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:29 smithi117 bash[135924]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-12T09:18:29.732 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:29 smithi117 bash[135924]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-12T09:18:29.732 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:29 smithi117 bash[135924]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-12T09:18:29.732 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:29 smithi117 bash[135924]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-12T09:18:29.732 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:29 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2-activate[135939]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-12T09:18:29.732 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:29 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2-activate[135939]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-12T09:18:29.732 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:29 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2-activate[135939]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-12T09:18:29.732 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:29 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2-activate[135939]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-12T09:18:29.732 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:29 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2-activate[135939]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-12T09:18:29.732 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:29 smithi117 podman[135924]: 2024-04-12 09:18:29.453148254 +0000 UTC m=+0.837117055 container died eb82efea79789fa8423b881113e958fcc43e8169b896f367453a7f7abf82332d (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2-activate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b277feb, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-12T09:18:30.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:29 smithi203 ceph-mon[86783]: pgmap v92: 65 pgs: 4 active+undersized+degraded, 6 stale+active+clean, 4 active+undersized, 51 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 9/225 objects degraded (4.000%) 2024-04-12T09:18:30.106 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:29 smithi117 ceph-mon[113571]: pgmap v92: 65 pgs: 4 active+undersized+degraded, 6 stale+active+clean, 4 active+undersized, 51 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 9/225 objects degraded (4.000%) 2024-04-12T09:18:30.410 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:30 smithi117 podman[136078]: 2024-04-12 09:18:30.106963296 +0000 UTC m=+0.648133462 container remove eb82efea79789fa8423b881113e958fcc43e8169b896f367453a7f7abf82332d (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2-activate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b277feb, org.label-schema.license=GPLv2) 2024-04-12T09:18:30.410 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:30 smithi117 podman[136145]: 2024-04-12 09:18:30.316248911 +0000 UTC m=+0.112981087 container create fd7d5481cddb6ed0d8244945fdbfdcf12f2ce07e0eb2b59d420f22d3bb82f822 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2, RELEASE=squid-b277feb, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-12T09:18:30.410 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:30 smithi117 podman[136145]: 2024-04-12 09:18:30.220799722 +0000 UTC m=+0.017531867 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:18:30.910 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:30 smithi117 podman[136145]: 2024-04-12 09:18:30.519077507 +0000 UTC m=+0.315809644 container init fd7d5481cddb6ed0d8244945fdbfdcf12f2ce07e0eb2b59d420f22d3bb82f822 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b277feb, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=) 2024-04-12T09:18:30.910 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:30 smithi117 podman[136145]: 2024-04-12 09:18:30.52236643 +0000 UTC m=+0.319098574 container start fd7d5481cddb6ed0d8244945fdbfdcf12f2ce07e0eb2b59d420f22d3bb82f822 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-b277feb, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-12T09:18:30.910 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:30 smithi117 ceph-osd[136163]: -- 172.21.15.117:0/2279586437 <== mon.0 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55da4c64b680 con 0x55da4c615000 2024-04-12T09:18:30.910 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:30 smithi117 bash[136145]: fd7d5481cddb6ed0d8244945fdbfdcf12f2ce07e0eb2b59d420f22d3bb82f822 2024-04-12T09:18:30.910 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:30 smithi117 systemd[1]: Started Ceph osd.2 for 12161984-f8ab-11ee-bc8c-c7b262605968. 2024-04-12T09:18:31.410 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:31 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2[136159]: 2024-04-12T09:18:31.063+0000 7f593e0e97c0 -1 Falling back to public interface 2024-04-12T09:18:31.713 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:31 smithi117 ceph-mon[113571]: pgmap v93: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 30/225 objects degraded (13.333%) 2024-04-12T09:18:31.713 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:31 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:31.713 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:31 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:31.713 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:31 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:18:32.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:31 smithi203 ceph-mon[86783]: pgmap v93: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 30/225 objects degraded (13.333%) 2024-04-12T09:18:32.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:31 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:32.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:31 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:32.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:31 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:18:34.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:33 smithi203 ceph-mon[86783]: pgmap v94: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 30/225 objects degraded (13.333%) 2024-04-12T09:18:34.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:33 smithi117 ceph-mon[113571]: pgmap v94: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 30/225 objects degraded (13.333%) 2024-04-12T09:18:35.716 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:35 smithi117 ceph-mon[113571]: pgmap v95: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 30/225 objects degraded (13.333%) 2024-04-12T09:18:36.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:35 smithi203 ceph-mon[86783]: pgmap v95: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 30/225 objects degraded (13.333%) 2024-04-12T09:18:36.160 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:35 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2[136159]: 2024-04-12T09:18:35.795+0000 7f593e0e97c0 -1 osd.2 59 log_to_monitors true 2024-04-12T09:18:37.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:36 smithi203 ceph-mon[86783]: from='osd.2 [v2:172.21.15.117:6818/4153226618,v1:172.21.15.117:6819/4153226618]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-12T09:18:37.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:36 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:37.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:36 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:37.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:36 smithi203 ceph-mon[86783]: Health check update: Degraded data redundancy: 30/225 objects degraded (13.333%), 12 pgs degraded (PG_DEGRADED) 2024-04-12T09:18:37.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:36 smithi117 ceph-mon[113571]: from='osd.2 [v2:172.21.15.117:6818/4153226618,v1:172.21.15.117:6819/4153226618]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-12T09:18:37.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:36 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:37.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:36 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:37.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:36 smithi117 ceph-mon[113571]: Health check update: Degraded data redundancy: 30/225 objects degraded (13.333%), 12 pgs degraded (PG_DEGRADED) 2024-04-12T09:18:37.802 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:18:37 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2[136159]: 2024-04-12T09:18:37.526+0000 7f592b539700 -1 osd.2 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T09:18:37.802 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:37 smithi117 ceph-mon[113571]: pgmap v96: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 30/225 objects degraded (13.333%) 2024-04-12T09:18:37.802 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:37 smithi117 ceph-mon[113571]: from='osd.2 [v2:172.21.15.117:6818/4153226618,v1:172.21.15.117:6819/4153226618]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-12T09:18:37.802 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:37 smithi117 ceph-mon[113571]: osdmap e62: 6 total, 5 up, 6 in 2024-04-12T09:18:37.802 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:37 smithi117 ceph-mon[113571]: from='osd.2 [v2:172.21.15.117:6818/4153226618,v1:172.21.15.117:6819/4153226618]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-04-12T09:18:37.802 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:37 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:37.802 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:37 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:37.802 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:37 smithi117 ceph-mon[113571]: from='osd.2 [v2:172.21.15.117:6818/4153226618,v1:172.21.15.117:6819/4153226618]' entity='osd.2' 2024-04-12T09:18:37.974 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:37 smithi203 ceph-mon[86783]: pgmap v96: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 206 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 30/225 objects degraded (13.333%) 2024-04-12T09:18:37.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:37 smithi203 ceph-mon[86783]: from='osd.2 [v2:172.21.15.117:6818/4153226618,v1:172.21.15.117:6819/4153226618]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-12T09:18:37.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:37 smithi203 ceph-mon[86783]: osdmap e62: 6 total, 5 up, 6 in 2024-04-12T09:18:37.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:37 smithi203 ceph-mon[86783]: from='osd.2 [v2:172.21.15.117:6818/4153226618,v1:172.21.15.117:6819/4153226618]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-04-12T09:18:37.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:37 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:37.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:37 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:37.975 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:37 smithi203 ceph-mon[86783]: from='osd.2 [v2:172.21.15.117:6818/4153226618,v1:172.21.15.117:6819/4153226618]' entity='osd.2' 2024-04-12T09:18:39.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:38 smithi203 ceph-mon[86783]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-12T09:18:39.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:38 smithi203 ceph-mon[86783]: osd.2 [v2:172.21.15.117:6818/4153226618,v1:172.21.15.117:6819/4153226618] boot 2024-04-12T09:18:39.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:38 smithi203 ceph-mon[86783]: osdmap e63: 6 total, 6 up, 6 in 2024-04-12T09:18:39.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:38 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T09:18:39.085 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:38 smithi117 ceph-mon[113571]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-12T09:18:39.085 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:38 smithi117 ceph-mon[113571]: osd.2 [v2:172.21.15.117:6818/4153226618,v1:172.21.15.117:6819/4153226618] boot 2024-04-12T09:18:39.085 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:38 smithi117 ceph-mon[113571]: osdmap e63: 6 total, 6 up, 6 in 2024-04-12T09:18:39.085 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:38 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-12T09:18:40.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:39 smithi117 ceph-mon[113571]: pgmap v99: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 30/225 objects degraded (13.333%) 2024-04-12T09:18:40.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:39 smithi117 ceph-mon[113571]: osdmap e64: 6 total, 6 up, 6 in 2024-04-12T09:18:40.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:40.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:18:40.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:39 smithi203 ceph-mon[86783]: pgmap v99: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 30/225 objects degraded (13.333%) 2024-04-12T09:18:40.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:39 smithi203 ceph-mon[86783]: osdmap e64: 6 total, 6 up, 6 in 2024-04-12T09:18:40.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:40.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:18:42.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:41 smithi203 ceph-mon[86783]: pgmap v101: 65 pgs: 7 active+undersized+degraded, 7 active+undersized, 51 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 18/225 objects degraded (8.000%) 2024-04-12T09:18:42.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:41 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:42.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:41 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:42.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:41 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:18:42.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:41 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:18:42.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:41 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:42.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:41 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:18:42.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:41 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:18:42.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:41 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:18:42.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:41 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:18:42.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:41 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-12T09:18:42.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:41 smithi203 ceph-mon[86783]: Health check update: Degraded data redundancy: 18/225 objects degraded (8.000%), 7 pgs degraded (PG_DEGRADED) 2024-04-12T09:18:42.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:41 smithi117 ceph-mon[113571]: pgmap v101: 65 pgs: 7 active+undersized+degraded, 7 active+undersized, 51 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 18/225 objects degraded (8.000%) 2024-04-12T09:18:42.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:41 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:42.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:41 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:42.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:41 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:18:42.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:41 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:18:42.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:41 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:42.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:41 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:18:42.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:41 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:18:42.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:41 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:18:42.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:41 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:18:42.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:41 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-12T09:18:42.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:41 smithi117 ceph-mon[113571]: Health check update: Degraded data redundancy: 18/225 objects degraded (8.000%), 7 pgs degraded (PG_DEGRADED) 2024-04-12T09:18:43.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:42 smithi203 ceph-mon[86783]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-12T09:18:43.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:42 smithi203 ceph-mon[86783]: Upgrade: unsafe to stop osd(s) at this time (4 PGs are or would become offline) 2024-04-12T09:18:43.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:42 smithi117 ceph-mon[113571]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-12T09:18:43.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:42 smithi117 ceph-mon[113571]: Upgrade: unsafe to stop osd(s) at this time (4 PGs are or would become offline) 2024-04-12T09:18:44.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:43 smithi203 ceph-mon[86783]: pgmap v102: 65 pgs: 65 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:44.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:43 smithi203 ceph-mon[86783]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/225 objects degraded (8.000%), 7 pgs degraded) 2024-04-12T09:18:44.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:43 smithi203 ceph-mon[86783]: Cluster is now healthy 2024-04-12T09:18:44.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:43 smithi117 ceph-mon[113571]: pgmap v102: 65 pgs: 65 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:44.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:43 smithi117 ceph-mon[113571]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/225 objects degraded (8.000%), 7 pgs degraded) 2024-04-12T09:18:44.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:43 smithi117 ceph-mon[113571]: Cluster is now healthy 2024-04-12T09:18:46.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:45 smithi203 ceph-mon[86783]: pgmap v103: 65 pgs: 65 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:46.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:45 smithi117 ceph-mon[113571]: pgmap v103: 65 pgs: 65 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:48.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:47 smithi203 ceph-mon[86783]: pgmap v104: 65 pgs: 65 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:48.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:47 smithi117 ceph-mon[113571]: pgmap v104: 65 pgs: 65 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:50.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:49 smithi203 ceph-mon[86783]: pgmap v105: 65 pgs: 65 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:50.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:49 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:50.157 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:49 smithi117 ceph-mon[113571]: pgmap v105: 65 pgs: 65 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:50.157 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:49 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:52.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:51 smithi203 ceph-mon[86783]: pgmap v106: 65 pgs: 65 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:52.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:51 smithi117 ceph-mon[113571]: pgmap v106: 65 pgs: 65 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:54.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:53 smithi203 ceph-mon[86783]: pgmap v107: 65 pgs: 65 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:54.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:53 smithi117 ceph-mon[113571]: pgmap v107: 65 pgs: 65 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:55.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.272+0000 7f1e2ab4f700 1 -- 172.21.15.117:0/232066988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e240fb470 msgr2=0x7f1e240fb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:55.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.272+0000 7f1e2ab4f700 1 --2- 172.21.15.117:0/232066988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e240fb470 0x7f1e240fb8e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1e10004a50 tx=0x7f1e1000af40 comp rx=0 tx=0).stop 2024-04-12T09:18:55.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.272+0000 7f1e2ab4f700 1 -- 172.21.15.117:0/232066988 shutdown_connections 2024-04-12T09:18:55.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.272+0000 7f1e2ab4f700 1 --2- 172.21.15.117:0/232066988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e240fb470 0x7f1e240fb8e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:55.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.272+0000 7f1e2ab4f700 1 --2- 172.21.15.117:0/232066988 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e241014c0 0x7f1e24101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:55.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.272+0000 7f1e2ab4f700 1 -- 172.21.15.117:0/232066988 >> 172.21.15.117:0/232066988 conn(0x7f1e24071450 msgr2=0x7f1e24071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:55.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.272+0000 7f1e2ab4f700 1 -- 172.21.15.117:0/232066988 shutdown_connections 2024-04-12T09:18:55.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.272+0000 7f1e2ab4f700 1 -- 172.21.15.117:0/232066988 wait complete. 2024-04-12T09:18:55.273 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.272+0000 7f1e2ab4f700 1 Processor -- start 2024-04-12T09:18:55.274 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.272+0000 7f1e2ab4f700 1 -- start start 2024-04-12T09:18:55.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.273+0000 7f1e2ab4f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e240fb470 0x7f1e24113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:55.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.273+0000 7f1e2ab4f700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e241014c0 0x7f1e241140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:55.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.273+0000 7f1e2ab4f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e24114700 con 0x7f1e240fb470 2024-04-12T09:18:55.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.273+0000 7f1e2ab4f700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2410daf0 con 0x7f1e241014c0 2024-04-12T09:18:55.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.273+0000 7f1e288eb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e240fb470 0x7f1e24113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:55.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.273+0000 7f1e288eb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e240fb470 0x7f1e24113b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55066/0 (socket says 172.21.15.117:55066) 2024-04-12T09:18:55.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.273+0000 7f1e288eb700 1 -- 172.21.15.117:0/1561994281 learned_addr learned my addr 172.21.15.117:0/1561994281 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:18:55.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.273+0000 7f1e23fff700 1 --2- 172.21.15.117:0/1561994281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e241014c0 0x7f1e241140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:55.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.273+0000 7f1e288eb700 1 -- 172.21.15.117:0/1561994281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e241014c0 msgr2=0x7f1e241140b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:55.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.273+0000 7f1e288eb700 1 --2- 172.21.15.117:0/1561994281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e241014c0 0x7f1e241140b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:55.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.273+0000 7f1e288eb700 1 -- 172.21.15.117:0/1561994281 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e10005040 con 0x7f1e240fb470 2024-04-12T09:18:55.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.274+0000 7f1e288eb700 1 --2- 172.21.15.117:0/1561994281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e240fb470 0x7f1e24113b70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1e18002a50 tx=0x7f1e180046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:55.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.274+0000 7f1e217fa700 1 -- 172.21.15.117:0/1561994281 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e18007cc0 con 0x7f1e240fb470 2024-04-12T09:18:55.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.274+0000 7f1e2ab4f700 1 -- 172.21.15.117:0/1561994281 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2410ddd0 con 0x7f1e240fb470 2024-04-12T09:18:55.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.274+0000 7f1e217fa700 1 -- 172.21.15.117:0/1561994281 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1e1800f040 con 0x7f1e240fb470 2024-04-12T09:18:55.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.274+0000 7f1e2ab4f700 1 -- 172.21.15.117:0/1561994281 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2410e390 con 0x7f1e240fb470 2024-04-12T09:18:55.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.274+0000 7f1e217fa700 1 -- 172.21.15.117:0/1561994281 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e18009640 con 0x7f1e240fb470 2024-04-12T09:18:55.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.275+0000 7f1e2ab4f700 1 -- 172.21.15.117:0/1561994281 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e240fcb60 con 0x7f1e240fb470 2024-04-12T09:18:55.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.275+0000 7f1e217fa700 1 -- 172.21.15.117:0/1561994281 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f1e180097c0 con 0x7f1e240fb470 2024-04-12T09:18:55.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.276+0000 7f1e217fa700 1 --2- 172.21.15.117:0/1561994281 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f1e1406dca0 0x7f1e14070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:55.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.276+0000 7f1e217fa700 1 -- 172.21.15.117:0/1561994281 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f1e1808d270 con 0x7f1e240fb470 2024-04-12T09:18:55.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.276+0000 7f1e23fff700 1 --2- 172.21.15.117:0/1561994281 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f1e1406dca0 0x7f1e14070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:55.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.276+0000 7f1e23fff700 1 --2- 172.21.15.117:0/1561994281 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f1e1406dca0 0x7f1e14070150 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1e2410ecb0 tx=0x7f1e1000af40 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:55.281 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.280+0000 7f1e217fa700 1 -- 172.21.15.117:0/1561994281 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f1e1805a3d0 con 0x7f1e240fb470 2024-04-12T09:18:55.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.493+0000 7f1e2ab4f700 1 -- 172.21.15.117:0/1561994281 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e2410f260 con 0x7f1e1406dca0 2024-04-12T09:18:55.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.495+0000 7f1e217fa700 1 -- 172.21.15.117:0/1561994281 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1e2410f260 con 0x7f1e1406dca0 2024-04-12T09:18:55.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.497+0000 7f1e2ab4f700 1 -- 172.21.15.117:0/1561994281 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f1e1406dca0 msgr2=0x7f1e14070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:55.497 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.497+0000 7f1e2ab4f700 1 --2- 172.21.15.117:0/1561994281 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f1e1406dca0 0x7f1e14070150 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1e2410ecb0 tx=0x7f1e1000af40 comp rx=0 tx=0).stop 2024-04-12T09:18:55.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.497+0000 7f1e2ab4f700 1 -- 172.21.15.117:0/1561994281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e240fb470 msgr2=0x7f1e24113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:55.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.497+0000 7f1e2ab4f700 1 --2- 172.21.15.117:0/1561994281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e240fb470 0x7f1e24113b70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1e18002a50 tx=0x7f1e180046b0 comp rx=0 tx=0).stop 2024-04-12T09:18:55.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.497+0000 7f1e2ab4f700 1 -- 172.21.15.117:0/1561994281 shutdown_connections 2024-04-12T09:18:55.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.497+0000 7f1e2ab4f700 1 --2- 172.21.15.117:0/1561994281 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f1e1406dca0 0x7f1e14070150 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:55.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.497+0000 7f1e2ab4f700 1 --2- 172.21.15.117:0/1561994281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e240fb470 0x7f1e24113b70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:55.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.497+0000 7f1e2ab4f700 1 --2- 172.21.15.117:0/1561994281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e241014c0 0x7f1e241140b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:55.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.497+0000 7f1e2ab4f700 1 -- 172.21.15.117:0/1561994281 >> 172.21.15.117:0/1561994281 conn(0x7f1e24071450 msgr2=0x7f1e240f9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:55.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.497+0000 7f1e2ab4f700 1 -- 172.21.15.117:0/1561994281 shutdown_connections 2024-04-12T09:18:55.498 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.497+0000 7f1e2ab4f700 1 -- 172.21.15.117:0/1561994281 wait complete. 2024-04-12T09:18:55.508 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:18:55.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.601+0000 7f5770655700 1 -- 172.21.15.117:0/3840545632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57681025b0 msgr2=0x7f57680fc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:55.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.602+0000 7f5770655700 1 --2- 172.21.15.117:0/3840545632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57681025b0 0x7f57680fc7d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5758004940 tx=0x7f5758009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:55.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.602+0000 7f5770655700 1 -- 172.21.15.117:0/3840545632 shutdown_connections 2024-04-12T09:18:55.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.602+0000 7f5770655700 1 --2- 172.21.15.117:0/3840545632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57681025b0 0x7f57680fc7d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.602+0000 7f5770655700 1 --2- 172.21.15.117:0/3840545632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5768101ca0 0x7f5768102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.602+0000 7f5770655700 1 -- 172.21.15.117:0/3840545632 >> 172.21.15.117:0/3840545632 conn(0x7f57680f6b40 msgr2=0x7f57680f8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.602+0000 7f5770655700 1 -- 172.21.15.117:0/3840545632 shutdown_connections 2024-04-12T09:18:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.602+0000 7f5770655700 1 -- 172.21.15.117:0/3840545632 wait complete. 2024-04-12T09:18:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.602+0000 7f5770655700 1 Processor -- start 2024-04-12T09:18:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.602+0000 7f5770655700 1 -- start start 2024-04-12T09:18:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.602+0000 7f5770655700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5768101ca0 0x7f576810eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.602+0000 7f5770655700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57681025b0 0x7f576810f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.603+0000 7f5770655700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576810f6c0 con 0x7f57681025b0 2024-04-12T09:18:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.603+0000 7f5770655700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576810f800 con 0x7f5768101ca0 2024-04-12T09:18:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.603+0000 7f576dbf0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57681025b0 0x7f576810f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.603+0000 7f576e3f1700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5768101ca0 0x7f576810eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.603+0000 7f576dbf0700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57681025b0 0x7f576810f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55086/0 (socket says 172.21.15.117:55086) 2024-04-12T09:18:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.603+0000 7f576e3f1700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5768101ca0 0x7f576810eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.117:59094/0 (socket says 172.21.15.117:59094) 2024-04-12T09:18:55.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.603+0000 7f576dbf0700 1 -- 172.21.15.117:0/3494481899 learned_addr learned my addr 172.21.15.117:0/3494481899 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:18:55.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.603+0000 7f576dbf0700 1 -- 172.21.15.117:0/3494481899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5768101ca0 msgr2=0x7f576810eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:55.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.603+0000 7f576dbf0700 1 --2- 172.21.15.117:0/3494481899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5768101ca0 0x7f576810eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:55.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.603+0000 7f576dbf0700 1 -- 172.21.15.117:0/3494481899 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5758005040 con 0x7f57681025b0 2024-04-12T09:18:55.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.603+0000 7f576dbf0700 1 --2- 172.21.15.117:0/3494481899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57681025b0 0x7f576810f070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5758009100 tx=0x7f5758009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:55.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.603+0000 7f575effd700 1 -- 172.21.15.117:0/3494481899 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f575800e040 con 0x7f57681025b0 2024-04-12T09:18:55.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.603+0000 7f5770655700 1 -- 172.21.15.117:0/3494481899 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5768117ba0 con 0x7f57681025b0 2024-04-12T09:18:55.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.603+0000 7f575effd700 1 -- 172.21.15.117:0/3494481899 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5758013420 con 0x7f57681025b0 2024-04-12T09:18:55.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.604+0000 7f575effd700 1 -- 172.21.15.117:0/3494481899 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f575801c630 con 0x7f57681025b0 2024-04-12T09:18:55.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.604+0000 7f5770655700 1 -- 172.21.15.117:0/3494481899 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5768118030 con 0x7f57681025b0 2024-04-12T09:18:55.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.605+0000 7f575effd700 1 -- 172.21.15.117:0/3494481899 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f575800baf0 con 0x7f57681025b0 2024-04-12T09:18:55.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.605+0000 7f5770655700 1 -- 172.21.15.117:0/3494481899 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57680fb2a0 con 0x7f57681025b0 2024-04-12T09:18:55.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.605+0000 7f575effd700 1 --2- 172.21.15.117:0/3494481899 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f575406daa0 0x7f575406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:55.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.605+0000 7f575effd700 1 -- 172.21.15.117:0/3494481899 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f575808e3d0 con 0x7f57681025b0 2024-04-12T09:18:55.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.606+0000 7f576e3f1700 1 --2- 172.21.15.117:0/3494481899 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f575406daa0 0x7f575406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:55.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.606+0000 7f576e3f1700 1 --2- 172.21.15.117:0/3494481899 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f575406daa0 0x7f575406ff50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5768064be0 tx=0x7f576400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:55.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.610+0000 7f575effd700 1 -- 172.21.15.117:0/3494481899 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f5758057bd0 con 0x7f57681025b0 2024-04-12T09:18:55.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.825+0000 7f5770655700 1 -- 172.21.15.117:0/3494481899 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5768108d80 con 0x7f575406daa0 2024-04-12T09:18:55.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.827+0000 7f575effd700 1 -- 172.21.15.117:0/3494481899 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5768108d80 con 0x7f575406daa0 2024-04-12T09:18:55.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.829+0000 7f5770655700 1 -- 172.21.15.117:0/3494481899 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f575406daa0 msgr2=0x7f575406ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:55.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.829+0000 7f5770655700 1 --2- 172.21.15.117:0/3494481899 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f575406daa0 0x7f575406ff50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5768064be0 tx=0x7f576400b040 comp rx=0 tx=0).stop 2024-04-12T09:18:55.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.829+0000 7f5770655700 1 -- 172.21.15.117:0/3494481899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57681025b0 msgr2=0x7f576810f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:55.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.829+0000 7f5770655700 1 --2- 172.21.15.117:0/3494481899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57681025b0 0x7f576810f070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5758009100 tx=0x7f5758009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:55.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.829+0000 7f5770655700 1 -- 172.21.15.117:0/3494481899 shutdown_connections 2024-04-12T09:18:55.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.829+0000 7f5770655700 1 --2- 172.21.15.117:0/3494481899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5768101ca0 0x7f576810eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:55.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.829+0000 7f5770655700 1 --2- 172.21.15.117:0/3494481899 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f575406daa0 0x7f575406ff50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:55.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.829+0000 7f5770655700 1 --2- 172.21.15.117:0/3494481899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57681025b0 0x7f576810f070 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:55.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.829+0000 7f5770655700 1 -- 172.21.15.117:0/3494481899 >> 172.21.15.117:0/3494481899 conn(0x7f57680f6b40 msgr2=0x7f57680f7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:55.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.829+0000 7f5770655700 1 -- 172.21.15.117:0/3494481899 shutdown_connections 2024-04-12T09:18:55.830 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.829+0000 7f5770655700 1 -- 172.21.15.117:0/3494481899 wait complete. 2024-04-12T09:18:55.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:55 smithi117 ceph-mon[113571]: pgmap v108: 65 pgs: 65 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:55.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:55 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:55.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:55 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:18:55.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.929+0000 7fd970101700 1 -- 172.21.15.117:0/2471864619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9680fe7a0 msgr2=0x7fd968106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:55.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.929+0000 7fd970101700 1 --2- 172.21.15.117:0/2471864619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9680fe7a0 0x7fd968106de0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd958004940 tx=0x7fd958009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:55.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.929+0000 7fd970101700 1 -- 172.21.15.117:0/2471864619 shutdown_connections 2024-04-12T09:18:55.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.929+0000 7fd970101700 1 --2- 172.21.15.117:0/2471864619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9680fe7a0 0x7fd968106de0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:55.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.929+0000 7fd970101700 1 --2- 172.21.15.117:0/2471864619 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd9680fde00 0x7fd9680fe1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:55.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.929+0000 7fd970101700 1 -- 172.21.15.117:0/2471864619 >> 172.21.15.117:0/2471864619 conn(0x7fd9680f7850 msgr2=0x7fd9680f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:55.932 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.929+0000 7fd970101700 1 -- 172.21.15.117:0/2471864619 shutdown_connections 2024-04-12T09:18:55.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.930+0000 7fd970101700 1 -- 172.21.15.117:0/2471864619 wait complete. 2024-04-12T09:18:55.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.930+0000 7fd970101700 1 Processor -- start 2024-04-12T09:18:55.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.930+0000 7fd970101700 1 -- start start 2024-04-12T09:18:55.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.930+0000 7fd970101700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd9680fde00 0x7fd968113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:55.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.930+0000 7fd970101700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9680fe7a0 0x7fd968113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:55.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.930+0000 7fd970101700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd968114510 con 0x7fd9680fe7a0 2024-04-12T09:18:55.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.930+0000 7fd970101700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96810db10 con 0x7fd9680fde00 2024-04-12T09:18:55.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.930+0000 7fd96d69c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9680fe7a0 0x7fd968113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:55.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.930+0000 7fd96d69c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9680fe7a0 0x7fd968113ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55092/0 (socket says 172.21.15.117:55092) 2024-04-12T09:18:55.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.930+0000 7fd96d69c700 1 -- 172.21.15.117:0/753310228 learned_addr learned my addr 172.21.15.117:0/753310228 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:18:55.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.931+0000 7fd96d69c700 1 -- 172.21.15.117:0/753310228 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd9680fde00 msgr2=0x7fd968113980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:55.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.931+0000 7fd96d69c700 1 --2- 172.21.15.117:0/753310228 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd9680fde00 0x7fd968113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:55.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.931+0000 7fd96d69c700 1 -- 172.21.15.117:0/753310228 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd958005040 con 0x7fd9680fe7a0 2024-04-12T09:18:55.933 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.931+0000 7fd96d69c700 1 --2- 172.21.15.117:0/753310228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9680fe7a0 0x7fd968113ec0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd958009380 tx=0x7fd958009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:55.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.931+0000 7fd95e7fc700 1 -- 172.21.15.117:0/753310228 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd95800e040 con 0x7fd9680fe7a0 2024-04-12T09:18:55.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.931+0000 7fd95e7fc700 1 -- 172.21.15.117:0/753310228 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd958009af0 con 0x7fd9680fe7a0 2024-04-12T09:18:55.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.931+0000 7fd970101700 1 -- 172.21.15.117:0/753310228 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96810dd90 con 0x7fd9680fe7a0 2024-04-12T09:18:55.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.931+0000 7fd95e7fc700 1 -- 172.21.15.117:0/753310228 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd95801c630 con 0x7fd9680fe7a0 2024-04-12T09:18:55.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.931+0000 7fd970101700 1 -- 172.21.15.117:0/753310228 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96810e2d0 con 0x7fd9680fe7a0 2024-04-12T09:18:55.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.932+0000 7fd970101700 1 -- 172.21.15.117:0/753310228 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd968066b90 con 0x7fd9680fe7a0 2024-04-12T09:18:55.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.932+0000 7fd95e7fc700 1 -- 172.21.15.117:0/753310228 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fd95800bbc0 con 0x7fd9680fe7a0 2024-04-12T09:18:55.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.933+0000 7fd95e7fc700 1 --2- 172.21.15.117:0/753310228 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fd95406dca0 0x7fd954070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:55.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.933+0000 7fd95e7fc700 1 -- 172.21.15.117:0/753310228 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd95808e6f0 con 0x7fd9680fe7a0 2024-04-12T09:18:55.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.933+0000 7fd96de9d700 1 --2- 172.21.15.117:0/753310228 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fd95406dca0 0x7fd954070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:55.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.933+0000 7fd96de9d700 1 --2- 172.21.15.117:0/753310228 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fd95406dca0 0x7fd954070150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd964004d00 tx=0x7fd964009ce0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:55.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:55.937+0000 7fd95e7fc700 1 -- 172.21.15.117:0/753310228 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fd95805b970 con 0x7fd9680fe7a0 2024-04-12T09:18:56.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:55 smithi203 ceph-mon[86783]: pgmap v108: 65 pgs: 65 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:56.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:55 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:56.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:55 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:18:56.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.140+0000 7fd970101700 1 -- 172.21.15.117:0/753310228 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd968109e90 con 0x7fd95406dca0 2024-04-12T09:18:56.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.150+0000 7fd95e7fc700 1 -- 172.21.15.117:0/753310228 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd968109e90 con 0x7fd95406dca0 2024-04-12T09:18:56.151 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:18:56.151 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 running (4m) 20s ago 16m 27.1M - 0.25.0 c8568f914cd2 204687f21ed7 2024-04-12T09:18:56.151 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (2m) 20s ago 16m 6656k - 19.0.0-2053-gb277feb2 668895944f0e 038f567b664b 2024-04-12T09:18:56.151 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (2m) 117s ago 15m 6660k - 19.0.0-2053-gb277feb2 668895944f0e 420dee66e230 2024-04-12T09:18:56.151 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 running (4m) 20s ago 15m 79.6M - 9.4.12 2bacad6d85d8 a7b102216886 2024-04-12T09:18:56.151 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (10m) 20s ago 10m 140M - 17.2.7-827-gd3b5060a 21de9b7369ad de062e2c10e7 2024-04-12T09:18:56.151 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 running (10m) 20s ago 10m 14.7M - 17.2.7-827-gd3b5060a 21de9b7369ad 1e82c6241a18 2024-04-12T09:18:56.151 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (10m) 117s ago 10m 16.9M - 17.2.7-827-gd3b5060a 21de9b7369ad b05228e997f7 2024-04-12T09:18:56.152 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (10m) 117s ago 10m 17.1M - 17.2.7-827-gd3b5060a 21de9b7369ad 6d7f82c072c7 2024-04-12T09:18:56.152 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:8443,9283,8765 running (6m) 20s ago 17m 504M - 19.0.0-2053-gb277feb2 668895944f0e fee613d05ab7 2024-04-12T09:18:56.152 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283,8765 running (5m) 117s ago 15m 449M - 19.0.0-2053-gb277feb2 668895944f0e c793944c3e16 2024-04-12T09:18:56.152 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (3m) 20s ago 17m 48.0M 2048M 19.0.0-2053-gb277feb2 668895944f0e 6823aaff30ce 2024-04-12T09:18:56.152 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (2m) 117s ago 15m 35.4M 2048M 19.0.0-2053-gb277feb2 668895944f0e 006c6e487bfb 2024-04-12T09:18:56.152 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 running (5m) 20s ago 16m 16.2M - 1.5.0 0da6a335fe13 c692bed9f6c7 2024-04-12T09:18:56.152 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (5m) 117s ago 15m 15.2M - 1.5.0 0da6a335fe13 f3b5a470f545 2024-04-12T09:18:56.152 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (99s) 20s ago 14m 88.1M 1557M 19.0.0-2053-gb277feb2 668895944f0e 59a180461e3c 2024-04-12T09:18:56.152 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (62s) 20s ago 13m 95.0M 1557M 19.0.0-2053-gb277feb2 668895944f0e d40e2dfc164b 2024-04-12T09:18:56.152 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (25s) 20s ago 13m 12.5M 1557M 19.0.0-2053-gb277feb2 668895944f0e fd7d5481cddb 2024-04-12T09:18:56.152 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (13m) 117s ago 12m 275M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad fb87d616bae3 2024-04-12T09:18:56.152 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (12m) 117s ago 12m 247M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad c873826a2dea 2024-04-12T09:18:56.152 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (12m) 117s ago 12m 221M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad 69cb7c22f002 2024-04-12T09:18:56.152 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 running (4m) 20s ago 15m 61.0M - 2.43.0 a07b618ecd1d 43ce588d82cc 2024-04-12T09:18:56.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.153+0000 7fd970101700 1 -- 172.21.15.117:0/753310228 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fd95406dca0 msgr2=0x7fd954070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:56.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.153+0000 7fd970101700 1 --2- 172.21.15.117:0/753310228 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fd95406dca0 0x7fd954070150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd964004d00 tx=0x7fd964009ce0 comp rx=0 tx=0).stop 2024-04-12T09:18:56.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.153+0000 7fd970101700 1 -- 172.21.15.117:0/753310228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9680fe7a0 msgr2=0x7fd968113ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:56.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.153+0000 7fd970101700 1 --2- 172.21.15.117:0/753310228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9680fe7a0 0x7fd968113ec0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd958009380 tx=0x7fd958009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:56.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.153+0000 7fd970101700 1 -- 172.21.15.117:0/753310228 shutdown_connections 2024-04-12T09:18:56.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.153+0000 7fd970101700 1 --2- 172.21.15.117:0/753310228 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd9680fde00 0x7fd968113980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:56.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.153+0000 7fd970101700 1 --2- 172.21.15.117:0/753310228 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fd95406dca0 0x7fd954070150 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:56.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.153+0000 7fd970101700 1 --2- 172.21.15.117:0/753310228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9680fe7a0 0x7fd968113ec0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:56.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.153+0000 7fd970101700 1 -- 172.21.15.117:0/753310228 >> 172.21.15.117:0/753310228 conn(0x7fd9680f7850 msgr2=0x7fd9680f8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:56.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.153+0000 7fd970101700 1 -- 172.21.15.117:0/753310228 shutdown_connections 2024-04-12T09:18:56.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.153+0000 7fd970101700 1 -- 172.21.15.117:0/753310228 wait complete. 2024-04-12T09:18:56.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.253+0000 7fa5feb58700 1 -- 172.21.15.117:0/2180688302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5f80fc5b0 msgr2=0x7fa5f80fca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:56.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.253+0000 7fa5feb58700 1 --2- 172.21.15.117:0/2180688302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5f80fc5b0 0x7fa5f80fca20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8004940 tx=0x7fa5e8009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:56.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.253+0000 7fa5feb58700 1 -- 172.21.15.117:0/2180688302 shutdown_connections 2024-04-12T09:18:56.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.253+0000 7fa5feb58700 1 --2- 172.21.15.117:0/2180688302 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5f80fc5b0 0x7fa5f80fca20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:56.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.253+0000 7fa5feb58700 1 --2- 172.21.15.117:0/2180688302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5f8101d70 0x7fa5f8102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:56.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.253+0000 7fa5feb58700 1 -- 172.21.15.117:0/2180688302 >> 172.21.15.117:0/2180688302 conn(0x7fa5f80714c0 msgr2=0x7fa5f80718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:56.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.253+0000 7fa5feb58700 1 -- 172.21.15.117:0/2180688302 shutdown_connections 2024-04-12T09:18:56.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.253+0000 7fa5feb58700 1 -- 172.21.15.117:0/2180688302 wait complete. 2024-04-12T09:18:56.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.253+0000 7fa5feb58700 1 Processor -- start 2024-04-12T09:18:56.255 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.253+0000 7fa5feb58700 1 -- start start 2024-04-12T09:18:56.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.254+0000 7fa5feb58700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5f80fc5b0 0x7fa5f8112aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:56.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.254+0000 7fa5feb58700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5f8101d70 0x7fa5f8112fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:56.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.254+0000 7fa5feb58700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f8113630 con 0x7fa5f8101d70 2024-04-12T09:18:56.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.254+0000 7fa5feb58700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f810ca20 con 0x7fa5f80fc5b0 2024-04-12T09:18:56.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.254+0000 7fa5f7fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5f8101d70 0x7fa5f8112fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:56.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.254+0000 7fa5f7fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5f8101d70 0x7fa5f8112fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55108/0 (socket says 172.21.15.117:55108) 2024-04-12T09:18:56.256 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.254+0000 7fa5f7fff700 1 -- 172.21.15.117:0/1038516018 learned_addr learned my addr 172.21.15.117:0/1038516018 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:18:56.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.254+0000 7fa5fc8f4700 1 --2- 172.21.15.117:0/1038516018 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5f80fc5b0 0x7fa5f8112aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:56.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.254+0000 7fa5f7fff700 1 -- 172.21.15.117:0/1038516018 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5f80fc5b0 msgr2=0x7fa5f8112aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:56.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.254+0000 7fa5f7fff700 1 --2- 172.21.15.117:0/1038516018 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5f80fc5b0 0x7fa5f8112aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:56.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.254+0000 7fa5f7fff700 1 -- 172.21.15.117:0/1038516018 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e8005040 con 0x7fa5f8101d70 2024-04-12T09:18:56.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.254+0000 7fa5f7fff700 1 --2- 172.21.15.117:0/1038516018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5f8101d70 0x7fa5f8112fe0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800b3b0 tx=0x7fa5e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:56.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.255+0000 7fa5f57fa700 1 -- 172.21.15.117:0/1038516018 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5e800e040 con 0x7fa5f8101d70 2024-04-12T09:18:56.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.255+0000 7fa5f57fa700 1 -- 172.21.15.117:0/1038516018 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa5e8013420 con 0x7fa5f8101d70 2024-04-12T09:18:56.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.255+0000 7fa5feb58700 1 -- 172.21.15.117:0/1038516018 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f810cca0 con 0x7fa5f8101d70 2024-04-12T09:18:56.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.255+0000 7fa5f57fa700 1 -- 172.21.15.117:0/1038516018 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5e801c630 con 0x7fa5f8101d70 2024-04-12T09:18:56.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.255+0000 7fa5feb58700 1 -- 172.21.15.117:0/1038516018 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f810d260 con 0x7fa5f8101d70 2024-04-12T09:18:56.257 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.256+0000 7fa5feb58700 1 -- 172.21.15.117:0/1038516018 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f80fd5c0 con 0x7fa5f8101d70 2024-04-12T09:18:56.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.256+0000 7fa5f57fa700 1 -- 172.21.15.117:0/1038516018 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fa5e8013590 con 0x7fa5f8101d70 2024-04-12T09:18:56.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.257+0000 7fa5f57fa700 1 --2- 172.21.15.117:0/1038516018 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fa5e406dca0 0x7fa5e4070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:56.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.257+0000 7fa5f57fa700 1 -- 172.21.15.117:0/1038516018 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fa5e808e6b0 con 0x7fa5f8101d70 2024-04-12T09:18:56.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.257+0000 7fa5fc8f4700 1 --2- 172.21.15.117:0/1038516018 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fa5e406dca0 0x7fa5e4070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:56.258 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.257+0000 7fa5fc8f4700 1 --2- 172.21.15.117:0/1038516018 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fa5e406dca0 0x7fa5e4070150 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8064f70 tx=0x7fa5f000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:56.262 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.262+0000 7fa5f57fa700 1 -- 172.21.15.117:0/1038516018 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fa5e805b890 con 0x7fa5f8101d70 2024-04-12T09:18:56.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.536+0000 7fa5feb58700 1 -- 172.21.15.117:0/1038516018 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa5f8108df0 con 0x7fa5f8101d70 2024-04-12T09:18:56.537 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.537+0000 7fa5f57fa700 1 -- 172.21.15.117:0/1038516018 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7fa5e805b420 con 0x7fa5f8101d70 2024-04-12T09:18:56.537 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:18:56.537 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": { 2024-04-12T09:18:56.537 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:18:56.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:18:56.538 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": { 2024-04-12T09:18:56.538 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:18:56.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:18:56.538 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": { 2024-04-12T09:18:56.538 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 3, 2024-04-12T09:18:56.538 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 3 2024-04-12T09:18:56.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:18:56.538 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-04-12T09:18:56.538 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 4 2024-04-12T09:18:56.538 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:18:56.538 INFO:teuthology.orchestra.run.smithi117.stdout: "overall": { 2024-04-12T09:18:56.538 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 7, 2024-04-12T09:18:56.539 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 7 2024-04-12T09:18:56.539 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:18:56.539 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:18:56.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.539+0000 7fa5feb58700 1 -- 172.21.15.117:0/1038516018 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fa5e406dca0 msgr2=0x7fa5e4070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:56.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.539+0000 7fa5feb58700 1 --2- 172.21.15.117:0/1038516018 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fa5e406dca0 0x7fa5e4070150 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8064f70 tx=0x7fa5f000b040 comp rx=0 tx=0).stop 2024-04-12T09:18:56.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.539+0000 7fa5feb58700 1 -- 172.21.15.117:0/1038516018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5f8101d70 msgr2=0x7fa5f8112fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:56.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.539+0000 7fa5feb58700 1 --2- 172.21.15.117:0/1038516018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5f8101d70 0x7fa5f8112fe0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800b3b0 tx=0x7fa5e8009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:56.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.539+0000 7fa5feb58700 1 -- 172.21.15.117:0/1038516018 shutdown_connections 2024-04-12T09:18:56.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.539+0000 7fa5feb58700 1 --2- 172.21.15.117:0/1038516018 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5f80fc5b0 0x7fa5f8112aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:56.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.539+0000 7fa5feb58700 1 --2- 172.21.15.117:0/1038516018 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fa5e406dca0 0x7fa5e4070150 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:56.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.539+0000 7fa5feb58700 1 --2- 172.21.15.117:0/1038516018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5f8101d70 0x7fa5f8112fe0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:56.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.539+0000 7fa5feb58700 1 -- 172.21.15.117:0/1038516018 >> 172.21.15.117:0/1038516018 conn(0x7fa5f80714c0 msgr2=0x7fa5f80f98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:56.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.539+0000 7fa5feb58700 1 -- 172.21.15.117:0/1038516018 shutdown_connections 2024-04-12T09:18:56.542 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.539+0000 7fa5feb58700 1 -- 172.21.15.117:0/1038516018 wait complete. 2024-04-12T09:18:56.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.648+0000 7ff6cfb5f700 1 -- 172.21.15.117:0/629166482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6c8102f50 msgr2=0x7ff6c8103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:56.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.648+0000 7ff6cfb5f700 1 --2- 172.21.15.117:0/629166482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6c8102f50 0x7ff6c8103320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4004940 tx=0x7ff6c4009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:56.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.649+0000 7ff6cfb5f700 1 -- 172.21.15.117:0/629166482 shutdown_connections 2024-04-12T09:18:56.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.649+0000 7ff6cfb5f700 1 --2- 172.21.15.117:0/629166482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6c80fb4d0 0x7ff6c80fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:56.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.649+0000 7ff6cfb5f700 1 --2- 172.21.15.117:0/629166482 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6c8102f50 0x7ff6c8103320 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:56.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.649+0000 7ff6cfb5f700 1 -- 172.21.15.117:0/629166482 >> 172.21.15.117:0/629166482 conn(0x7ff6c80714c0 msgr2=0x7ff6c80718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:56.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.649+0000 7ff6cfb5f700 1 -- 172.21.15.117:0/629166482 shutdown_connections 2024-04-12T09:18:56.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.649+0000 7ff6cfb5f700 1 -- 172.21.15.117:0/629166482 wait complete. 2024-04-12T09:18:56.651 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.649+0000 7ff6cfb5f700 1 Processor -- start 2024-04-12T09:18:56.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.649+0000 7ff6cfb5f700 1 -- start start 2024-04-12T09:18:56.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.649+0000 7ff6cfb5f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6c80fb4d0 0x7ff6c8113a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:56.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.649+0000 7ff6cfb5f700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6c8102f50 0x7ff6c8113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:56.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.649+0000 7ff6cfb5f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c81145b0 con 0x7ff6c80fb4d0 2024-04-12T09:18:56.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.649+0000 7ff6cfb5f700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c810db90 con 0x7ff6c8102f50 2024-04-12T09:18:56.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.649+0000 7ff6cd8fb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6c80fb4d0 0x7ff6c8113a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:56.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.650+0000 7ff6cd8fb700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6c80fb4d0 0x7ff6c8113a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55126/0 (socket says 172.21.15.117:55126) 2024-04-12T09:18:56.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.650+0000 7ff6cd8fb700 1 -- 172.21.15.117:0/1267703088 learned_addr learned my addr 172.21.15.117:0/1267703088 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:18:56.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.650+0000 7ff6cd0fa700 1 --2- 172.21.15.117:0/1267703088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6c8102f50 0x7ff6c8113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:56.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.650+0000 7ff6cd8fb700 1 -- 172.21.15.117:0/1267703088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6c8102f50 msgr2=0x7ff6c8113f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:56.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.650+0000 7ff6cd8fb700 1 --2- 172.21.15.117:0/1267703088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6c8102f50 0x7ff6c8113f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:56.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.650+0000 7ff6cd8fb700 1 -- 172.21.15.117:0/1267703088 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c4005040 con 0x7ff6c80fb4d0 2024-04-12T09:18:56.652 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.650+0000 7ff6cd8fb700 1 --2- 172.21.15.117:0/1267703088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6c80fb4d0 0x7ff6c8113a20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4009100 tx=0x7ff6c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:56.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.650+0000 7ff6be7fc700 1 -- 172.21.15.117:0/1267703088 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6c400e040 con 0x7ff6c80fb4d0 2024-04-12T09:18:56.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.650+0000 7ff6be7fc700 1 -- 172.21.15.117:0/1267703088 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff6c4009af0 con 0x7ff6c80fb4d0 2024-04-12T09:18:56.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.650+0000 7ff6cfb5f700 1 -- 172.21.15.117:0/1267703088 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c810de10 con 0x7ff6c80fb4d0 2024-04-12T09:18:56.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.650+0000 7ff6be7fc700 1 -- 172.21.15.117:0/1267703088 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6c401c3f0 con 0x7ff6c80fb4d0 2024-04-12T09:18:56.653 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.650+0000 7ff6cfb5f700 1 -- 172.21.15.117:0/1267703088 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c810e350 con 0x7ff6c80fb4d0 2024-04-12T09:18:56.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.651+0000 7ff6cfb5f700 1 -- 172.21.15.117:0/1267703088 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c8100200 con 0x7ff6c80fb4d0 2024-04-12T09:18:56.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.652+0000 7ff6be7fc700 1 -- 172.21.15.117:0/1267703088 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7ff6c400baf0 con 0x7ff6c80fb4d0 2024-04-12T09:18:56.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.652+0000 7ff6be7fc700 1 --2- 172.21.15.117:0/1267703088 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff6b406dca0 0x7ff6b4070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:56.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.652+0000 7ff6be7fc700 1 -- 172.21.15.117:0/1267703088 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ff6c408e710 con 0x7ff6c80fb4d0 2024-04-12T09:18:56.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.652+0000 7ff6cd0fa700 1 --2- 172.21.15.117:0/1267703088 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff6b406dca0 0x7ff6b4070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:56.654 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.652+0000 7ff6cd0fa700 1 --2- 172.21.15.117:0/1267703088 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff6b406dca0 0x7ff6b4070150 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff6c810f2c0 tx=0x7ff6b800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:56.657 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.657+0000 7ff6be7fc700 1 -- 172.21.15.117:0/1267703088 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff6c405b8f0 con 0x7ff6c80fb4d0 2024-04-12T09:18:56.879 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:56 smithi203 ceph-mon[86783]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:18:56.879 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:56 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-12T09:18:56.879 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:56 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/1038516018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:18:56.894 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.892+0000 7ff6cfb5f700 1 -- 172.21.15.117:0/1267703088 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff6c810a0a0 con 0x7ff6c80fb4d0 2024-04-12T09:18:56.894 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:56 smithi117 ceph-mon[113571]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:18:56.894 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:56 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-12T09:18:56.894 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:56 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/1038516018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:18:56.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.893+0000 7ff6be7fc700 1 -- 172.21.15.117:0/1267703088 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1884 (secure 0 0 0) 0x7ff6c405b480 con 0x7ff6c80fb4d0 2024-04-12T09:18:56.895 INFO:teuthology.orchestra.run.smithi117.stdout:e14 2024-04-12T09:18:56.895 INFO:teuthology.orchestra.run.smithi117.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T09:18:56.895 INFO:teuthology.orchestra.run.smithi117.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:18:56.895 INFO:teuthology.orchestra.run.smithi117.stdout:legacy client fscid: 1 2024-04-12T09:18:56.895 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:18:56.895 INFO:teuthology.orchestra.run.smithi117.stdout:Filesystem 'cephfs' (1) 2024-04-12T09:18:56.895 INFO:teuthology.orchestra.run.smithi117.stdout:fs_name cephfs 2024-04-12T09:18:56.895 INFO:teuthology.orchestra.run.smithi117.stdout:epoch 14 2024-04-12T09:18:56.895 INFO:teuthology.orchestra.run.smithi117.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T09:18:56.896 INFO:teuthology.orchestra.run.smithi117.stdout:created 2024-04-12T09:08:12.488144+0000 2024-04-12T09:18:56.896 INFO:teuthology.orchestra.run.smithi117.stdout:modified 2024-04-12T09:08:30.563184+0000 2024-04-12T09:18:56.896 INFO:teuthology.orchestra.run.smithi117.stdout:tableserver 0 2024-04-12T09:18:56.896 INFO:teuthology.orchestra.run.smithi117.stdout:root 0 2024-04-12T09:18:56.896 INFO:teuthology.orchestra.run.smithi117.stdout:session_timeout 60 2024-04-12T09:18:56.896 INFO:teuthology.orchestra.run.smithi117.stdout:session_autoclose 300 2024-04-12T09:18:56.896 INFO:teuthology.orchestra.run.smithi117.stdout:max_file_size 1099511627776 2024-04-12T09:18:56.896 INFO:teuthology.orchestra.run.smithi117.stdout:max_xattr_size 65536 2024-04-12T09:18:56.896 INFO:teuthology.orchestra.run.smithi117.stdout:required_client_features {} 2024-04-12T09:18:56.896 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure 0 2024-04-12T09:18:56.896 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure_osd_epoch 46 2024-04-12T09:18:56.896 INFO:teuthology.orchestra.run.smithi117.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:18:56.896 INFO:teuthology.orchestra.run.smithi117.stdout:max_mds 1 2024-04-12T09:18:56.897 INFO:teuthology.orchestra.run.smithi117.stdout:in 0 2024-04-12T09:18:56.897 INFO:teuthology.orchestra.run.smithi117.stdout:up {0=14474} 2024-04-12T09:18:56.897 INFO:teuthology.orchestra.run.smithi117.stdout:failed 2024-04-12T09:18:56.897 INFO:teuthology.orchestra.run.smithi117.stdout:damaged 2024-04-12T09:18:56.897 INFO:teuthology.orchestra.run.smithi117.stdout:stopped 2024-04-12T09:18:56.897 INFO:teuthology.orchestra.run.smithi117.stdout:data_pools [3] 2024-04-12T09:18:56.897 INFO:teuthology.orchestra.run.smithi117.stdout:metadata_pool 2 2024-04-12T09:18:56.897 INFO:teuthology.orchestra.run.smithi117.stdout:inline_data disabled 2024-04-12T09:18:56.897 INFO:teuthology.orchestra.run.smithi117.stdout:balancer 2024-04-12T09:18:56.897 INFO:teuthology.orchestra.run.smithi117.stdout:bal_rank_mask -1 2024-04-12T09:18:56.898 INFO:teuthology.orchestra.run.smithi117.stdout:standby_count_wanted 1 2024-04-12T09:18:56.898 INFO:teuthology.orchestra.run.smithi117.stdout:qdb_cluster leader: 0 members: 2024-04-12T09:18:56.898 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.eslmxh{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.117:6828/2248590199,v1:172.21.15.117:6829/2248590199] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:18:56.898 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:18:56.898 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:18:56.898 INFO:teuthology.orchestra.run.smithi117.stdout:Standby daemons: 2024-04-12T09:18:56.898 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:18:56.898 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.wddsgt{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/4010127141,v1:172.21.15.117:6827/4010127141] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:18:56.898 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.fbeixl{-1:24265} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.203:6824/840607003,v1:172.21.15.203:6825/840607003] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:18:56.898 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.bszhxz{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/2731911290,v1:172.21.15.203:6827/2731911290] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:18:56.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.895+0000 7ff6cfb5f700 1 -- 172.21.15.117:0/1267703088 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff6b406dca0 msgr2=0x7ff6b4070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:56.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.895+0000 7ff6cfb5f700 1 --2- 172.21.15.117:0/1267703088 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff6b406dca0 0x7ff6b4070150 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff6c810f2c0 tx=0x7ff6b800b040 comp rx=0 tx=0).stop 2024-04-12T09:18:56.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.895+0000 7ff6cfb5f700 1 -- 172.21.15.117:0/1267703088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6c80fb4d0 msgr2=0x7ff6c8113a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:56.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.895+0000 7ff6cfb5f700 1 --2- 172.21.15.117:0/1267703088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6c80fb4d0 0x7ff6c8113a20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4009100 tx=0x7ff6c4009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:56.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.895+0000 7ff6cfb5f700 1 -- 172.21.15.117:0/1267703088 shutdown_connections 2024-04-12T09:18:56.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.895+0000 7ff6cfb5f700 1 --2- 172.21.15.117:0/1267703088 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff6b406dca0 0x7ff6b4070150 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:56.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.895+0000 7ff6cfb5f700 1 --2- 172.21.15.117:0/1267703088 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6c80fb4d0 0x7ff6c8113a20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:56.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.895+0000 7ff6cfb5f700 1 --2- 172.21.15.117:0/1267703088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6c8102f50 0x7ff6c8113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:56.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.895+0000 7ff6cfb5f700 1 -- 172.21.15.117:0/1267703088 >> 172.21.15.117:0/1267703088 conn(0x7ff6c80714c0 msgr2=0x7ff6c80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:56.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.895+0000 7ff6cfb5f700 1 -- 172.21.15.117:0/1267703088 shutdown_connections 2024-04-12T09:18:56.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.895+0000 7ff6cfb5f700 1 -- 172.21.15.117:0/1267703088 wait complete. 2024-04-12T09:18:56.900 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 14 2024-04-12T09:18:56.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.997+0000 7fdf45f1c700 1 -- 172.21.15.117:0/3280165225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf401037a0 msgr2=0x7fdf400fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:56.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.997+0000 7fdf45f1c700 1 --2- 172.21.15.117:0/3280165225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf401037a0 0x7fdf400fce10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdf34004940 tx=0x7fdf34009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:56.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.997+0000 7fdf45f1c700 1 -- 172.21.15.117:0/3280165225 shutdown_connections 2024-04-12T09:18:56.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.997+0000 7fdf45f1c700 1 --2- 172.21.15.117:0/3280165225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf401037a0 0x7fdf400fce10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:56.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.997+0000 7fdf45f1c700 1 --2- 172.21.15.117:0/3280165225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf40102e00 0x7fdf401031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:56.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.997+0000 7fdf45f1c700 1 -- 172.21.15.117:0/3280165225 >> 172.21.15.117:0/3280165225 conn(0x7fdf400f89b0 msgr2=0x7fdf400fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:56.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.997+0000 7fdf45f1c700 1 -- 172.21.15.117:0/3280165225 shutdown_connections 2024-04-12T09:18:56.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.997+0000 7fdf45f1c700 1 -- 172.21.15.117:0/3280165225 wait complete. 2024-04-12T09:18:56.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.997+0000 7fdf45f1c700 1 Processor -- start 2024-04-12T09:18:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.997+0000 7fdf45f1c700 1 -- start start 2024-04-12T09:18:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.998+0000 7fdf45f1c700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf40102e00 0x7fdf40113910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.998+0000 7fdf45f1c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf401037a0 0x7fdf40113e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.998+0000 7fdf45f1c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf401144a0 con 0x7fdf401037a0 2024-04-12T09:18:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.998+0000 7fdf45f1c700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4010daf0 con 0x7fdf40102e00 2024-04-12T09:18:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.998+0000 7fdf3effd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf401037a0 0x7fdf40113e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.998+0000 7fdf3effd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf401037a0 0x7fdf40113e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55142/0 (socket says 172.21.15.117:55142) 2024-04-12T09:18:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.998+0000 7fdf3effd700 1 -- 172.21.15.117:0/858631416 learned_addr learned my addr 172.21.15.117:0/858631416 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:18:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.998+0000 7fdf3f7fe700 1 --2- 172.21.15.117:0/858631416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf40102e00 0x7fdf40113910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:57.001 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.998+0000 7fdf3effd700 1 -- 172.21.15.117:0/858631416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf40102e00 msgr2=0x7fdf40113910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:57.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.998+0000 7fdf3effd700 1 --2- 172.21.15.117:0/858631416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf40102e00 0x7fdf40113910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:57.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.998+0000 7fdf3effd700 1 -- 172.21.15.117:0/858631416 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf34005040 con 0x7fdf401037a0 2024-04-12T09:18:57.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.998+0000 7fdf3effd700 1 --2- 172.21.15.117:0/858631416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf401037a0 0x7fdf40113e50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdf34000c00 tx=0x7fdf34009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:57.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.998+0000 7fdf27fff700 1 -- 172.21.15.117:0/858631416 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf34021070 con 0x7fdf401037a0 2024-04-12T09:18:57.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.998+0000 7fdf27fff700 1 -- 172.21.15.117:0/858631416 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdf34013c00 con 0x7fdf401037a0 2024-04-12T09:18:57.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.998+0000 7fdf27fff700 1 -- 172.21.15.117:0/858631416 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf3400e070 con 0x7fdf401037a0 2024-04-12T09:18:57.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.998+0000 7fdf45f1c700 1 -- 172.21.15.117:0/858631416 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf4010dd70 con 0x7fdf401037a0 2024-04-12T09:18:57.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.999+0000 7fdf45f1c700 1 -- 172.21.15.117:0/858631416 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf4010e200 con 0x7fdf401037a0 2024-04-12T09:18:57.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:56.999+0000 7fdf45f1c700 1 -- 172.21.15.117:0/858631416 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf401052d0 con 0x7fdf401037a0 2024-04-12T09:18:57.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.000+0000 7fdf27fff700 1 -- 172.21.15.117:0/858631416 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fdf3401ca60 con 0x7fdf401037a0 2024-04-12T09:18:57.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.000+0000 7fdf27fff700 1 --2- 172.21.15.117:0/858631416 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fdf2806dca0 0x7fdf28070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:57.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.000+0000 7fdf27fff700 1 -- 172.21.15.117:0/858631416 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fdf3408e8d0 con 0x7fdf401037a0 2024-04-12T09:18:57.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.000+0000 7fdf3f7fe700 1 --2- 172.21.15.117:0/858631416 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fdf2806dca0 0x7fdf28070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:57.003 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.001+0000 7fdf3f7fe700 1 --2- 172.21.15.117:0/858631416 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fdf2806dca0 0x7fdf28070150 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdf30001470 tx=0x7fdf3000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:57.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.005+0000 7fdf27fff700 1 -- 172.21.15.117:0/858631416 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fdf3405bab0 con 0x7fdf401037a0 2024-04-12T09:18:57.222 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.220+0000 7fdf45f1c700 1 -- 172.21.15.117:0/858631416 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf4010ef60 con 0x7fdf2806dca0 2024-04-12T09:18:57.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.221+0000 7fdf27fff700 1 -- 172.21.15.117:0/858631416 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fdf4010ef60 con 0x7fdf2806dca0 2024-04-12T09:18:57.223 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:18:57.223 INFO:teuthology.orchestra.run.smithi117.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec", 2024-04-12T09:18:57.223 INFO:teuthology.orchestra.run.smithi117.stdout: "in_progress": true, 2024-04-12T09:18:57.223 INFO:teuthology.orchestra.run.smithi117.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T09:18:57.223 INFO:teuthology.orchestra.run.smithi117.stdout: "services_complete": [ 2024-04-12T09:18:57.223 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr", 2024-04-12T09:18:57.223 INFO:teuthology.orchestra.run.smithi117.stdout: "mon", 2024-04-12T09:18:57.224 INFO:teuthology.orchestra.run.smithi117.stdout: "crash" 2024-04-12T09:18:57.224 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2024-04-12T09:18:57.224 INFO:teuthology.orchestra.run.smithi117.stdout: "progress": "9/21 daemons upgraded", 2024-04-12T09:18:57.224 INFO:teuthology.orchestra.run.smithi117.stdout: "message": "Currently upgrading osd daemons", 2024-04-12T09:18:57.224 INFO:teuthology.orchestra.run.smithi117.stdout: "is_paused": false 2024-04-12T09:18:57.224 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:18:57.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.224+0000 7fdf45f1c700 1 -- 172.21.15.117:0/858631416 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fdf2806dca0 msgr2=0x7fdf28070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:57.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.224+0000 7fdf45f1c700 1 --2- 172.21.15.117:0/858631416 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fdf2806dca0 0x7fdf28070150 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdf30001470 tx=0x7fdf3000b040 comp rx=0 tx=0).stop 2024-04-12T09:18:57.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.224+0000 7fdf45f1c700 1 -- 172.21.15.117:0/858631416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf401037a0 msgr2=0x7fdf40113e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:57.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.224+0000 7fdf45f1c700 1 --2- 172.21.15.117:0/858631416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf401037a0 0x7fdf40113e50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdf34000c00 tx=0x7fdf34009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:57.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.224+0000 7fdf45f1c700 1 -- 172.21.15.117:0/858631416 shutdown_connections 2024-04-12T09:18:57.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.224+0000 7fdf45f1c700 1 --2- 172.21.15.117:0/858631416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdf40102e00 0x7fdf40113910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:57.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.224+0000 7fdf45f1c700 1 --2- 172.21.15.117:0/858631416 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fdf2806dca0 0x7fdf28070150 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:57.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.224+0000 7fdf45f1c700 1 --2- 172.21.15.117:0/858631416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf401037a0 0x7fdf40113e50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:57.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.224+0000 7fdf45f1c700 1 -- 172.21.15.117:0/858631416 >> 172.21.15.117:0/858631416 conn(0x7fdf400f89b0 msgr2=0x7fdf401021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:57.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.224+0000 7fdf45f1c700 1 -- 172.21.15.117:0/858631416 shutdown_connections 2024-04-12T09:18:57.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.224+0000 7fdf45f1c700 1 -- 172.21.15.117:0/858631416 wait complete. 2024-04-12T09:18:57.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.324+0000 7ff670060700 1 -- 172.21.15.117:0/2587542253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff668102e00 msgr2=0x7ff6681031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:57.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.324+0000 7ff670060700 1 --2- 172.21.15.117:0/2587542253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff668102e00 0x7ff6681031d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff664004940 tx=0x7ff664009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:57.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.324+0000 7ff670060700 1 -- 172.21.15.117:0/2587542253 shutdown_connections 2024-04-12T09:18:57.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.324+0000 7ff670060700 1 --2- 172.21.15.117:0/2587542253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6681037a0 0x7ff6680fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:57.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.324+0000 7ff670060700 1 --2- 172.21.15.117:0/2587542253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff668102e00 0x7ff6681031d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:57.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.324+0000 7ff670060700 1 -- 172.21.15.117:0/2587542253 >> 172.21.15.117:0/2587542253 conn(0x7ff6680f89b0 msgr2=0x7ff6680fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:57.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.325+0000 7ff670060700 1 -- 172.21.15.117:0/2587542253 shutdown_connections 2024-04-12T09:18:57.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.325+0000 7ff670060700 1 -- 172.21.15.117:0/2587542253 wait complete. 2024-04-12T09:18:57.328 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.325+0000 7ff670060700 1 Processor -- start 2024-04-12T09:18:57.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.325+0000 7ff670060700 1 -- start start 2024-04-12T09:18:57.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.325+0000 7ff670060700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff668102e00 0x7ff668113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:57.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.325+0000 7ff670060700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6681037a0 0x7ff668113ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:57.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.325+0000 7ff670060700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff668114520 con 0x7ff668102e00 2024-04-12T09:18:57.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.325+0000 7ff670060700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66810db70 con 0x7ff6681037a0 2024-04-12T09:18:57.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.325+0000 7ff66ddfc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff668102e00 0x7ff668113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:57.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.325+0000 7ff66ddfc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff668102e00 0x7ff668113990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55166/0 (socket says 172.21.15.117:55166) 2024-04-12T09:18:57.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.325+0000 7ff66ddfc700 1 -- 172.21.15.117:0/1035280237 learned_addr learned my addr 172.21.15.117:0/1035280237 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:18:57.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.326+0000 7ff66d5fb700 1 --2- 172.21.15.117:0/1035280237 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6681037a0 0x7ff668113ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:57.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.326+0000 7ff66ddfc700 1 -- 172.21.15.117:0/1035280237 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6681037a0 msgr2=0x7ff668113ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:57.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.326+0000 7ff66ddfc700 1 --2- 172.21.15.117:0/1035280237 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6681037a0 0x7ff668113ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:57.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.326+0000 7ff66ddfc700 1 -- 172.21.15.117:0/1035280237 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff664005040 con 0x7ff668102e00 2024-04-12T09:18:57.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.326+0000 7ff66ddfc700 1 --2- 172.21.15.117:0/1035280237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff668102e00 0x7ff668113990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff66400b3b0 tx=0x7ff664009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:57.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.326+0000 7ff65e7fc700 1 -- 172.21.15.117:0/1035280237 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff66400e040 con 0x7ff668102e00 2024-04-12T09:18:57.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.326+0000 7ff65e7fc700 1 -- 172.21.15.117:0/1035280237 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff664013420 con 0x7ff668102e00 2024-04-12T09:18:57.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.326+0000 7ff670060700 1 -- 172.21.15.117:0/1035280237 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66810ddf0 con 0x7ff668102e00 2024-04-12T09:18:57.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.326+0000 7ff65e7fc700 1 -- 172.21.15.117:0/1035280237 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff66401c630 con 0x7ff668102e00 2024-04-12T09:18:57.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.326+0000 7ff670060700 1 -- 172.21.15.117:0/1035280237 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66810e3b0 con 0x7ff668102e00 2024-04-12T09:18:57.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.327+0000 7ff670060700 1 -- 172.21.15.117:0/1035280237 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff668100110 con 0x7ff668102e00 2024-04-12T09:18:57.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.328+0000 7ff65e7fc700 1 -- 172.21.15.117:0/1035280237 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7ff664013590 con 0x7ff668102e00 2024-04-12T09:18:57.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.328+0000 7ff65e7fc700 1 --2- 172.21.15.117:0/1035280237 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff65406dca0 0x7ff654070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:18:57.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.328+0000 7ff65e7fc700 1 -- 172.21.15.117:0/1035280237 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ff66408e6b0 con 0x7ff668102e00 2024-04-12T09:18:57.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.328+0000 7ff66d5fb700 1 --2- 172.21.15.117:0/1035280237 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff65406dca0 0x7ff654070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:18:57.331 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.328+0000 7ff66d5fb700 1 --2- 172.21.15.117:0/1035280237 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff65406dca0 0x7ff654070150 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff66810ece0 tx=0x7ff65800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:18:57.334 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.333+0000 7ff65e7fc700 1 -- 172.21.15.117:0/1035280237 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff66405b890 con 0x7ff668102e00 2024-04-12T09:18:57.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.606+0000 7ff670060700 1 -- 172.21.15.117:0/1035280237 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff66810efe0 con 0x7ff668102e00 2024-04-12T09:18:57.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.606+0000 7ff65e7fc700 1 -- 172.21.15.117:0/1035280237 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff66405b420 con 0x7ff668102e00 2024-04-12T09:18:57.608 INFO:teuthology.orchestra.run.smithi117.stdout:HEALTH_OK 2024-04-12T09:18:57.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.608+0000 7ff670060700 1 -- 172.21.15.117:0/1035280237 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff65406dca0 msgr2=0x7ff654070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:57.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.608+0000 7ff670060700 1 --2- 172.21.15.117:0/1035280237 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff65406dca0 0x7ff654070150 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff66810ece0 tx=0x7ff65800b040 comp rx=0 tx=0).stop 2024-04-12T09:18:57.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.608+0000 7ff670060700 1 -- 172.21.15.117:0/1035280237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff668102e00 msgr2=0x7ff668113990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:18:57.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.608+0000 7ff670060700 1 --2- 172.21.15.117:0/1035280237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff668102e00 0x7ff668113990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff66400b3b0 tx=0x7ff664009e30 comp rx=0 tx=0).stop 2024-04-12T09:18:57.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.609+0000 7ff670060700 1 -- 172.21.15.117:0/1035280237 shutdown_connections 2024-04-12T09:18:57.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.609+0000 7ff670060700 1 --2- 172.21.15.117:0/1035280237 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff65406dca0 0x7ff654070150 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:57.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.609+0000 7ff670060700 1 --2- 172.21.15.117:0/1035280237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff668102e00 0x7ff668113990 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:57.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.609+0000 7ff670060700 1 --2- 172.21.15.117:0/1035280237 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6681037a0 0x7ff668113ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:18:57.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.609+0000 7ff670060700 1 -- 172.21.15.117:0/1035280237 >> 172.21.15.117:0/1035280237 conn(0x7ff6680f89b0 msgr2=0x7ff6681073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:18:57.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.609+0000 7ff670060700 1 -- 172.21.15.117:0/1035280237 shutdown_connections 2024-04-12T09:18:57.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:18:57.609+0000 7ff670060700 1 -- 172.21.15.117:0/1035280237 wait complete. 2024-04-12T09:18:57.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:57 smithi203 ceph-mon[86783]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:18:57.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:57 smithi203 ceph-mon[86783]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-12T09:18:57.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:57 smithi203 ceph-mon[86783]: Upgrade: osd.3 is safe to restart 2024-04-12T09:18:57.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:57 smithi203 ceph-mon[86783]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:18:57.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:57 smithi203 ceph-mon[86783]: pgmap v109: 65 pgs: 65 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:57.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:57 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/1267703088' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:18:57.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:57 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/1035280237' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:18:57.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:57 smithi117 ceph-mon[113571]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:18:57.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:57 smithi117 ceph-mon[113571]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-12T09:18:57.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:57 smithi117 ceph-mon[113571]: Upgrade: osd.3 is safe to restart 2024-04-12T09:18:57.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:57 smithi117 ceph-mon[113571]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:18:57.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:57 smithi117 ceph-mon[113571]: pgmap v109: 65 pgs: 65 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:57.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:57 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/1267703088' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:18:57.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:57 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/1035280237' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:18:58.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:58 smithi203 ceph-mon[86783]: from='client.34300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:18:58.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:58 smithi203 ceph-mon[86783]: Upgrade: Updating osd.3 2024-04-12T09:18:58.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:58 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:58.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:58 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-12T09:18:58.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:58 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:18:58.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:58 smithi203 ceph-mon[86783]: Deploying daemon osd.3 on smithi203 2024-04-12T09:18:58.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:58 smithi117 ceph-mon[113571]: from='client.34300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:18:58.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:58 smithi117 ceph-mon[113571]: Upgrade: Updating osd.3 2024-04-12T09:18:58.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:58 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:18:58.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:58 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-12T09:18:58.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:58 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:18:58.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:58 smithi117 ceph-mon[113571]: Deploying daemon osd.3 on smithi203 2024-04-12T09:18:59.779 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:18:59 smithi203 ceph-mon[86783]: pgmap v110: 65 pgs: 65 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:18:59.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:18:59 smithi117 ceph-mon[113571]: pgmap v110: 65 pgs: 65 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:00.823 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:00 smithi203 systemd[1]: Stopping Ceph osd.3 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:19:01.323 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:00 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3[41837]: 2024-04-12T09:19:00.933+0000 7f324fb5a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T09:19:01.324 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:00 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3[41837]: 2024-04-12T09:19:00.933+0000 7f324fb5a700 -1 osd.3 64 *** Got signal Terminated *** 2024-04-12T09:19:01.324 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:00 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3[41837]: 2024-04-12T09:19:00.933+0000 7f324fb5a700 -1 osd.3 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T09:19:01.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:01 smithi117 ceph-mon[113571]: pgmap v111: 65 pgs: 65 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:01.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:01 smithi117 ceph-mon[113571]: osd.3 marked itself down and dead 2024-04-12T09:19:02.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:01 smithi203 ceph-mon[86783]: pgmap v111: 65 pgs: 65 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:02.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:01 smithi203 ceph-mon[86783]: osd.3 marked itself down and dead 2024-04-12T09:19:02.492 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:02 smithi203 podman[95687]: 2024-04-12 09:19:02.144984813 +0000 UTC m=+1.309949700 container died fb87d616bae3dae4f004103a16a183c15caf25b4a2552bf1178a94e61ed3f74e (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=quincy-d3b5060, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-12T09:19:02.492 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:02 smithi203 podman[95687]: 2024-04-12 09:19:02.492568473 +0000 UTC m=+1.657533361 container cleanup fb87d616bae3dae4f004103a16a183c15caf25b4a2552bf1178a94e61ed3f74e (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=quincy-d3b5060, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True) 2024-04-12T09:19:02.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:02 smithi203 ceph-mon[86783]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-12T09:19:02.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:02 smithi203 ceph-mon[86783]: osdmap e65: 6 total, 5 up, 6 in 2024-04-12T09:19:02.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:02 smithi203 ceph-mon[86783]: osdmap e66: 6 total, 5 up, 6 in 2024-04-12T09:19:02.824 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:02 smithi203 bash[95687]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3 2024-04-12T09:19:02.824 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:02 smithi203 podman[95715]: 2024-04-12 09:19:02.685455312 +0000 UTC m=+0.534763554 container remove fb87d616bae3dae4f004103a16a183c15caf25b4a2552bf1178a94e61ed3f74e (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=quincy-d3b5060, org.label-schema.build-date=20240409, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-12T09:19:03.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:02 smithi117 ceph-mon[113571]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-12T09:19:03.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:02 smithi117 ceph-mon[113571]: osdmap e65: 6 total, 5 up, 6 in 2024-04-12T09:19:03.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:02 smithi117 ceph-mon[113571]: osdmap e66: 6 total, 5 up, 6 in 2024-04-12T09:19:03.413 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:03 smithi203 podman[95801]: 2024-04-12 09:19:02.995718193 +0000 UTC m=+0.018127080 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:19:03.413 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:03 smithi203 podman[95801]: 2024-04-12 09:19:03.094668792 +0000 UTC m=+0.117077661 container create 2091f112260384ed930fca6e18bca117ee47ffc27bd644dd1fce5e218cbedad1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-b277feb, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409) 2024-04-12T09:19:03.414 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:03 smithi203 podman[95801]: 2024-04-12 09:19:03.330443066 +0000 UTC m=+0.352851928 container init 2091f112260384ed930fca6e18bca117ee47ffc27bd644dd1fce5e218cbedad1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, RELEASE=squid-b277feb, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-04-12T09:19:03.414 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:03 smithi203 podman[95801]: 2024-04-12 09:19:03.333622558 +0000 UTC m=+0.356031427 container start 2091f112260384ed930fca6e18bca117ee47ffc27bd644dd1fce5e218cbedad1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-b277feb, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240409) 2024-04-12T09:19:03.414 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:03 smithi203 podman[95801]: 2024-04-12 09:19:03.413587492 +0000 UTC m=+0.435996378 container attach 2091f112260384ed930fca6e18bca117ee47ffc27bd644dd1fce5e218cbedad1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-b277feb, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T09:19:03.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:03 smithi203 ceph-mon[86783]: pgmap v113: 65 pgs: 11 peering, 12 stale+active+clean, 42 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:03.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:03 smithi203 ceph-mon[86783]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-04-12T09:19:03.824 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:03 smithi203 podman[95801]: 2024-04-12 09:19:03.626659299 +0000 UTC m=+0.649068176 container died 2091f112260384ed930fca6e18bca117ee47ffc27bd644dd1fce5e218cbedad1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3-deactivate, RELEASE=squid-b277feb, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-12T09:19:04.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:03 smithi117 ceph-mon[113571]: pgmap v113: 65 pgs: 11 peering, 12 stale+active+clean, 42 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:04.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:03 smithi117 ceph-mon[113571]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-04-12T09:19:04.109 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:04 smithi203 podman[95827]: 2024-04-12 09:19:04.091834783 +0000 UTC m=+0.459769312 container remove 2091f112260384ed930fca6e18bca117ee47ffc27bd644dd1fce5e218cbedad1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, RELEASE=squid-b277feb, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-12T09:19:04.518 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:04 smithi203 systemd[1]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.3.service: Deactivated successfully. 2024-04-12T09:19:04.518 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:04 smithi203 systemd[1]: Stopped Ceph osd.3 for 12161984-f8ab-11ee-bc8c-c7b262605968. 2024-04-12T09:19:04.518 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:04 smithi203 systemd[1]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.3.service: Consumed 1min 17.204s CPU time. 2024-04-12T09:19:04.518 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:04 smithi203 systemd[1]: Starting Ceph osd.3 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:19:04.823 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:04 smithi203 podman[95928]: 2024-04-12 09:19:04.518081717 +0000 UTC m=+0.113824277 container create e2696e053cf9019354cdaabf21852e9e0ef09f561bc640a7b003da0639731fd3 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b277feb, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-04-12T09:19:04.824 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:04 smithi203 podman[95928]: 2024-04-12 09:19:04.422183778 +0000 UTC m=+0.017926357 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:19:05.277 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:04 smithi203 podman[95928]: 2024-04-12 09:19:04.829447196 +0000 UTC m=+0.425189756 container init e2696e053cf9019354cdaabf21852e9e0ef09f561bc640a7b003da0639731fd3 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3-activate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b277feb, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T09:19:05.278 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:04 smithi203 podman[95928]: 2024-04-12 09:19:04.833143225 +0000 UTC m=+0.428885795 container start e2696e053cf9019354cdaabf21852e9e0ef09f561bc640a7b003da0639731fd3 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b277feb, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, io.buildah.version=1.33.5) 2024-04-12T09:19:05.278 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:04 smithi203 podman[95928]: 2024-04-12 09:19:04.920659065 +0000 UTC m=+0.516401643 container attach e2696e053cf9019354cdaabf21852e9e0ef09f561bc640a7b003da0639731fd3 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-b277feb, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-12T09:19:05.574 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:05 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3-activate[95942]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-12T09:19:05.574 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:05 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3-activate[95942]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-12T09:19:05.574 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:05 smithi203 bash[95928]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-12T09:19:05.574 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:05 smithi203 bash[95928]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-12T09:19:05.574 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:05 smithi203 bash[95928]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-12T09:19:05.574 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:05 smithi203 bash[95928]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-12T09:19:05.574 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:05 smithi203 bash[95928]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-12T09:19:05.574 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:05 smithi203 bash[95928]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-12T09:19:05.574 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:05 smithi203 bash[95928]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-12T09:19:05.574 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:05 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3-activate[95942]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-12T09:19:05.575 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:05 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3-activate[95942]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-12T09:19:05.575 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:05 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3-activate[95942]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-12T09:19:05.575 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:05 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3-activate[95942]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-12T09:19:05.575 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:05 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3-activate[95942]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-12T09:19:05.575 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:05 smithi203 podman[95928]: 2024-04-12 09:19:05.302230526 +0000 UTC m=+0.897973086 container died e2696e053cf9019354cdaabf21852e9e0ef09f561bc640a7b003da0639731fd3 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-b277feb, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-12T09:19:06.020 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:05 smithi203 ceph-mon[86783]: pgmap v115: 65 pgs: 11 peering, 12 stale+active+clean, 42 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:06.020 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:05 smithi203 podman[96071]: 2024-04-12 09:19:05.80772836 +0000 UTC m=+0.500622235 container remove e2696e053cf9019354cdaabf21852e9e0ef09f561bc640a7b003da0639731fd3 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-b277feb, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409) 2024-04-12T09:19:06.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:05 smithi117 ceph-mon[113571]: pgmap v115: 65 pgs: 11 peering, 12 stale+active+clean, 42 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:06.319 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:06 smithi203 podman[96133]: 2024-04-12 09:19:05.922994041 +0000 UTC m=+0.018098556 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:19:06.319 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:06 smithi203 podman[96133]: 2024-04-12 09:19:06.042180455 +0000 UTC m=+0.137284957 container create 961db53f9ab1a95c7435c1b42c0bd0312e07cea3593f320ab37000737bcd901f (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-b277feb, org.label-schema.build-date=20240409, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-12T09:19:06.319 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:06 smithi203 podman[96133]: 2024-04-12 09:19:06.236188362 +0000 UTC m=+0.331292890 container init 961db53f9ab1a95c7435c1b42c0bd0312e07cea3593f320ab37000737bcd901f (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, RELEASE=squid-b277feb, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T09:19:06.319 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:06 smithi203 podman[96133]: 2024-04-12 09:19:06.23906193 +0000 UTC m=+0.334166442 container start 961db53f9ab1a95c7435c1b42c0bd0312e07cea3593f320ab37000737bcd901f (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b277feb, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T09:19:06.319 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:06 smithi203 ceph-osd[96152]: -- 172.21.15.203:0/4135665519 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558c174ed680 con 0x558c174b6c00 2024-04-12T09:19:06.320 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:06 smithi203 bash[96133]: 961db53f9ab1a95c7435c1b42c0bd0312e07cea3593f320ab37000737bcd901f 2024-04-12T09:19:06.573 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:06 smithi203 systemd[1]: Started Ceph osd.3 for 12161984-f8ab-11ee-bc8c-c7b262605968. 2024-04-12T09:19:07.073 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:06 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3[96148]: 2024-04-12T09:19:06.775+0000 7faca95107c0 -1 Falling back to public interface 2024-04-12T09:19:07.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:07 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:07.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:07 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:07.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:07 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:19:07.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:07 smithi117 ceph-mon[113571]: pgmap v116: 65 pgs: 13 active+undersized+degraded, 11 peering, 14 active+undersized, 27 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 42/225 objects degraded (18.667%) 2024-04-12T09:19:07.791 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:07 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:07.791 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:07 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:07.791 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:07 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:19:07.791 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:07 smithi203 ceph-mon[86783]: pgmap v116: 65 pgs: 13 active+undersized+degraded, 11 peering, 14 active+undersized, 27 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 42/225 objects degraded (18.667%) 2024-04-12T09:19:08.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:08 smithi117 ceph-mon[113571]: Health check failed: Degraded data redundancy: 42/225 objects degraded (18.667%), 13 pgs degraded (PG_DEGRADED) 2024-04-12T09:19:08.682 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:08 smithi203 ceph-mon[86783]: Health check failed: Degraded data redundancy: 42/225 objects degraded (18.667%), 13 pgs degraded (PG_DEGRADED) 2024-04-12T09:19:09.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:09 smithi117 ceph-mon[113571]: pgmap v117: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53/225 objects degraded (23.556%) 2024-04-12T09:19:09.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:09 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:09.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:09 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:09.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:09 smithi203 ceph-mon[86783]: pgmap v117: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53/225 objects degraded (23.556%) 2024-04-12T09:19:09.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:09 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:09.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:09 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:10.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:10 smithi117 ceph-mon[113571]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-04-12T09:19:10.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:10 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:10.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:10 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:19:10.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:10 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:10.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:10 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:10.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:10 smithi203 ceph-mon[86783]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-04-12T09:19:10.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:10 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:10.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:10 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:19:10.827 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:10 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:10.827 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:10 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:11.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:11 smithi203 ceph-mon[86783]: pgmap v118: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53/225 objects degraded (23.556%) 2024-04-12T09:19:11.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:11 smithi117 ceph-mon[113571]: pgmap v118: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 206 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53/225 objects degraded (23.556%) 2024-04-12T09:19:12.220 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:12 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3[96148]: 2024-04-12T09:19:12.018+0000 7faca95107c0 -1 osd.3 64 log_to_monitors true 2024-04-12T09:19:12.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:12 smithi203 ceph-mon[86783]: from='osd.3 [v2:172.21.15.203:6800/1424266498,v1:172.21.15.203:6801/1424266498]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-12T09:19:12.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:12 smithi203 ceph-mon[86783]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-12T09:19:12.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:12 smithi117 ceph-mon[113571]: from='osd.3 [v2:172.21.15.203:6800/1424266498,v1:172.21.15.203:6801/1424266498]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-12T09:19:12.663 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:12 smithi117 ceph-mon[113571]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-12T09:19:13.573 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:19:13 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3[96148]: 2024-04-12T09:19:13.258+0000 7fac96960700 -1 osd.3 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T09:19:13.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:13 smithi203 ceph-mon[86783]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-12T09:19:13.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:13 smithi203 ceph-mon[86783]: osdmap e67: 6 total, 5 up, 6 in 2024-04-12T09:19:13.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:13 smithi203 ceph-mon[86783]: from='osd.3 [v2:172.21.15.203:6800/1424266498,v1:172.21.15.203:6801/1424266498]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-04-12T09:19:13.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:13 smithi203 ceph-mon[86783]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-04-12T09:19:13.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:13 smithi203 ceph-mon[86783]: pgmap v120: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 53/225 objects degraded (23.556%) 2024-04-12T09:19:13.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:13 smithi203 ceph-mon[86783]: from='osd.3 ' entity='osd.3' 2024-04-12T09:19:13.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:13 smithi117 ceph-mon[113571]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-12T09:19:13.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:13 smithi117 ceph-mon[113571]: osdmap e67: 6 total, 5 up, 6 in 2024-04-12T09:19:13.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:13 smithi117 ceph-mon[113571]: from='osd.3 [v2:172.21.15.203:6800/1424266498,v1:172.21.15.203:6801/1424266498]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-04-12T09:19:13.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:13 smithi117 ceph-mon[113571]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-04-12T09:19:13.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:13 smithi117 ceph-mon[113571]: pgmap v120: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 53/225 objects degraded (23.556%) 2024-04-12T09:19:13.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:13 smithi117 ceph-mon[113571]: from='osd.3 ' entity='osd.3' 2024-04-12T09:19:15.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:14 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:15.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:14 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:15.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:14 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:19:15.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:14 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:19:15.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:14 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:15.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:14 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:19:15.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:14 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:19:15.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:14 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:19:15.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:14 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:19:15.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:14 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-12T09:19:15.325 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:14 smithi203 ceph-mon[86783]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-12T09:19:15.325 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:14 smithi203 ceph-mon[86783]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-04-12T09:19:15.325 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:14 smithi203 ceph-mon[86783]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-12T09:19:15.325 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:14 smithi203 ceph-mon[86783]: osd.3 [v2:172.21.15.203:6800/1424266498,v1:172.21.15.203:6801/1424266498] boot 2024-04-12T09:19:15.325 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:14 smithi203 ceph-mon[86783]: osdmap e68: 6 total, 6 up, 6 in 2024-04-12T09:19:15.325 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:14 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T09:19:15.325 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:14 smithi203 ceph-mon[86783]: pgmap v122: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 53/225 objects degraded (23.556%) 2024-04-12T09:19:15.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:14 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:15.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:14 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:15.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:14 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:19:15.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:14 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:19:15.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:14 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:15.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:14 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:19:15.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:14 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:19:15.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:14 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:19:15.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:14 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:19:15.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:14 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-12T09:19:15.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:14 smithi117 ceph-mon[113571]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-12T09:19:15.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:14 smithi117 ceph-mon[113571]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-04-12T09:19:15.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:14 smithi117 ceph-mon[113571]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-12T09:19:15.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:14 smithi117 ceph-mon[113571]: osd.3 [v2:172.21.15.203:6800/1424266498,v1:172.21.15.203:6801/1424266498] boot 2024-04-12T09:19:15.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:14 smithi117 ceph-mon[113571]: osdmap e68: 6 total, 6 up, 6 in 2024-04-12T09:19:15.411 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:14 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-12T09:19:15.412 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:14 smithi117 ceph-mon[113571]: pgmap v122: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 53/225 objects degraded (23.556%) 2024-04-12T09:19:16.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:16 smithi203 ceph-mon[86783]: osdmap e69: 6 total, 6 up, 6 in 2024-04-12T09:19:16.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:16 smithi117 ceph-mon[113571]: osdmap e69: 6 total, 6 up, 6 in 2024-04-12T09:19:17.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:17 smithi203 ceph-mon[86783]: Health check update: Degraded data redundancy: 53/225 objects degraded (23.556%), 18 pgs degraded (PG_DEGRADED) 2024-04-12T09:19:17.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:17 smithi203 ceph-mon[86783]: pgmap v124: 65 pgs: 12 active+undersized+degraded, 11 active+undersized, 42 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 32/225 objects degraded (14.222%) 2024-04-12T09:19:17.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:17 smithi117 ceph-mon[113571]: Health check update: Degraded data redundancy: 53/225 objects degraded (23.556%), 18 pgs degraded (PG_DEGRADED) 2024-04-12T09:19:17.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:17 smithi117 ceph-mon[113571]: pgmap v124: 65 pgs: 12 active+undersized+degraded, 11 active+undersized, 42 active+clean; 206 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 32/225 objects degraded (14.222%) 2024-04-12T09:19:19.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:18 smithi203 ceph-mon[86783]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/225 objects degraded (14.222%), 12 pgs degraded) 2024-04-12T09:19:19.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:18 smithi203 ceph-mon[86783]: Cluster is now healthy 2024-04-12T09:19:19.111 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:18 smithi117 ceph-mon[113571]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 32/225 objects degraded (14.222%), 12 pgs degraded) 2024-04-12T09:19:19.111 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:18 smithi117 ceph-mon[113571]: Cluster is now healthy 2024-04-12T09:19:20.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:19 smithi203 ceph-mon[86783]: pgmap v125: 65 pgs: 65 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:20.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:19 smithi117 ceph-mon[113571]: pgmap v125: 65 pgs: 65 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:22.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:21 smithi203 ceph-mon[86783]: pgmap v126: 65 pgs: 65 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:22.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:21 smithi117 ceph-mon[113571]: pgmap v126: 65 pgs: 65 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:24.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:23 smithi203 ceph-mon[86783]: pgmap v127: 65 pgs: 65 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:24.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:23 smithi117 ceph-mon[113571]: pgmap v127: 65 pgs: 65 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:25.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:25 smithi117 ceph-mon[113571]: pgmap v128: 65 pgs: 65 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:25.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:25 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:25.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:25 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:19:25.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:25 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:26.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:25 smithi203 ceph-mon[86783]: pgmap v128: 65 pgs: 65 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:26.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:25 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:26.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:25 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:19:26.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:25 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:27.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.724+0000 7f0f4deaf700 1 -- 172.21.15.117:0/2692290818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f48102e00 msgr2=0x7f0f481031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:27.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.724+0000 7f0f4deaf700 1 --2- 172.21.15.117:0/2692290818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f48102e00 0x7f0f481031d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0f38004940 tx=0x7f0f38009e30 comp rx=0 tx=0).stop 2024-04-12T09:19:27.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.724+0000 7f0f4deaf700 1 -- 172.21.15.117:0/2692290818 shutdown_connections 2024-04-12T09:19:27.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.724+0000 7f0f4deaf700 1 --2- 172.21.15.117:0/2692290818 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f481037a0 0x7f0f480fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:27.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.724+0000 7f0f4deaf700 1 --2- 172.21.15.117:0/2692290818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f48102e00 0x7f0f481031d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:27.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.724+0000 7f0f4deaf700 1 -- 172.21.15.117:0/2692290818 >> 172.21.15.117:0/2692290818 conn(0x7f0f480f89b0 msgr2=0x7f0f480fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:19:27.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.724+0000 7f0f4deaf700 1 -- 172.21.15.117:0/2692290818 shutdown_connections 2024-04-12T09:19:27.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.724+0000 7f0f4deaf700 1 -- 172.21.15.117:0/2692290818 wait complete. 2024-04-12T09:19:27.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.725+0000 7f0f4deaf700 1 Processor -- start 2024-04-12T09:19:27.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.725+0000 7f0f4deaf700 1 -- start start 2024-04-12T09:19:27.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.725+0000 7f0f4deaf700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f48102e00 0x7f0f48113930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:19:27.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.725+0000 7f0f4deaf700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f481037a0 0x7f0f48113e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:19:27.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.725+0000 7f0f4deaf700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f48114550 con 0x7f0f481037a0 2024-04-12T09:19:27.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.725+0000 7f0f4deaf700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4810dac0 con 0x7f0f48102e00 2024-04-12T09:19:27.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.725+0000 7f0f46ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f481037a0 0x7f0f48113e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:19:27.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.725+0000 7f0f46ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f481037a0 0x7f0f48113e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:36474/0 (socket says 172.21.15.117:36474) 2024-04-12T09:19:27.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.725+0000 7f0f46ffd700 1 -- 172.21.15.117:0/4198756327 learned_addr learned my addr 172.21.15.117:0/4198756327 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:19:27.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.725+0000 7f0f477fe700 1 --2- 172.21.15.117:0/4198756327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f48102e00 0x7f0f48113930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:19:27.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.726+0000 7f0f46ffd700 1 -- 172.21.15.117:0/4198756327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f48102e00 msgr2=0x7f0f48113930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:27.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.726+0000 7f0f46ffd700 1 --2- 172.21.15.117:0/4198756327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f48102e00 0x7f0f48113930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:27.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.726+0000 7f0f46ffd700 1 -- 172.21.15.117:0/4198756327 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f38005040 con 0x7f0f481037a0 2024-04-12T09:19:27.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.726+0000 7f0f46ffd700 1 --2- 172.21.15.117:0/4198756327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f481037a0 0x7f0f48113e70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c00b790 tx=0x7f0f3c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:19:27.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.726+0000 7f0f2ffff700 1 -- 172.21.15.117:0/4198756327 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f3c00f6f0 con 0x7f0f481037a0 2024-04-12T09:19:27.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.726+0000 7f0f2ffff700 1 -- 172.21.15.117:0/4198756327 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0f3c00fd20 con 0x7f0f481037a0 2024-04-12T09:19:27.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.726+0000 7f0f4deaf700 1 -- 172.21.15.117:0/4198756327 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f4810dda0 con 0x7f0f481037a0 2024-04-12T09:19:27.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.726+0000 7f0f2ffff700 1 -- 172.21.15.117:0/4198756327 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f3c0103a0 con 0x7f0f481037a0 2024-04-12T09:19:27.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.726+0000 7f0f4deaf700 1 -- 172.21.15.117:0/4198756327 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f4810e360 con 0x7f0f481037a0 2024-04-12T09:19:27.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.727+0000 7f0f4deaf700 1 -- 172.21.15.117:0/4198756327 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f480fe550 con 0x7f0f481037a0 2024-04-12T09:19:27.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.728+0000 7f0f2ffff700 1 -- 172.21.15.117:0/4198756327 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f0f3c011400 con 0x7f0f481037a0 2024-04-12T09:19:27.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.728+0000 7f0f2ffff700 1 --2- 172.21.15.117:0/4198756327 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f0f3006dca0 0x7f0f30070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:19:27.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.728+0000 7f0f477fe700 1 --2- 172.21.15.117:0/4198756327 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f0f3006dca0 0x7f0f30070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:19:27.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.728+0000 7f0f2ffff700 1 -- 172.21.15.117:0/4198756327 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f0f3c08d1d0 con 0x7f0f481037a0 2024-04-12T09:19:27.730 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.729+0000 7f0f477fe700 1 --2- 172.21.15.117:0/4198756327 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f0f3006dca0 0x7f0f30070150 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0f38004f90 tx=0x7f0f38009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:19:27.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.733+0000 7f0f2ffff700 1 -- 172.21.15.117:0/4198756327 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f0f3c05a450 con 0x7f0f481037a0 2024-04-12T09:19:27.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:27 smithi117 ceph-mon[113571]: pgmap v129: 65 pgs: 65 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:27.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.947+0000 7f0f4deaf700 1 -- 172.21.15.117:0/4198756327 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f48109fe0 con 0x7f0f3006dca0 2024-04-12T09:19:27.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.949+0000 7f0f2ffff700 1 -- 172.21.15.117:0/4198756327 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f0f48109fe0 con 0x7f0f3006dca0 2024-04-12T09:19:27.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.951+0000 7f0f4deaf700 1 -- 172.21.15.117:0/4198756327 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f0f3006dca0 msgr2=0x7f0f30070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:27.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.951+0000 7f0f4deaf700 1 --2- 172.21.15.117:0/4198756327 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f0f3006dca0 0x7f0f30070150 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0f38004f90 tx=0x7f0f38009e30 comp rx=0 tx=0).stop 2024-04-12T09:19:27.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.951+0000 7f0f4deaf700 1 -- 172.21.15.117:0/4198756327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f481037a0 msgr2=0x7f0f48113e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:27.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.951+0000 7f0f4deaf700 1 --2- 172.21.15.117:0/4198756327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f481037a0 0x7f0f48113e70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c00b790 tx=0x7f0f3c009220 comp rx=0 tx=0).stop 2024-04-12T09:19:27.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.951+0000 7f0f4deaf700 1 -- 172.21.15.117:0/4198756327 shutdown_connections 2024-04-12T09:19:27.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.951+0000 7f0f4deaf700 1 --2- 172.21.15.117:0/4198756327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f48102e00 0x7f0f48113930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:27.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.951+0000 7f0f4deaf700 1 --2- 172.21.15.117:0/4198756327 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f0f3006dca0 0x7f0f30070150 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:27.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.951+0000 7f0f4deaf700 1 --2- 172.21.15.117:0/4198756327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f481037a0 0x7f0f48113e70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:27.952 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.951+0000 7f0f4deaf700 1 -- 172.21.15.117:0/4198756327 >> 172.21.15.117:0/4198756327 conn(0x7f0f480f89b0 msgr2=0x7f0f480f98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:19:27.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.951+0000 7f0f4deaf700 1 -- 172.21.15.117:0/4198756327 shutdown_connections 2024-04-12T09:19:27.953 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:27.951+0000 7f0f4deaf700 1 -- 172.21.15.117:0/4198756327 wait complete. 2024-04-12T09:19:27.963 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:19:28.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.054+0000 7f9a48052700 1 -- 172.21.15.117:0/1198315970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a40102e00 msgr2=0x7f9a401031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:28.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.054+0000 7f9a48052700 1 --2- 172.21.15.117:0/1198315970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a40102e00 0x7f9a401031d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9a30009ce0 tx=0x7f9a30004d10 comp rx=0 tx=0).stop 2024-04-12T09:19:28.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.054+0000 7f9a48052700 1 -- 172.21.15.117:0/1198315970 shutdown_connections 2024-04-12T09:19:28.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.054+0000 7f9a48052700 1 --2- 172.21.15.117:0/1198315970 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a401037a0 0x7f9a400fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:28.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.054+0000 7f9a48052700 1 --2- 172.21.15.117:0/1198315970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a40102e00 0x7f9a401031d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:28.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.054+0000 7f9a48052700 1 -- 172.21.15.117:0/1198315970 >> 172.21.15.117:0/1198315970 conn(0x7f9a400f89b0 msgr2=0x7f9a400fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:19:28.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.054+0000 7f9a48052700 1 -- 172.21.15.117:0/1198315970 shutdown_connections 2024-04-12T09:19:28.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.054+0000 7f9a48052700 1 -- 172.21.15.117:0/1198315970 wait complete. 2024-04-12T09:19:28.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.055+0000 7f9a48052700 1 Processor -- start 2024-04-12T09:19:28.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.055+0000 7f9a48052700 1 -- start start 2024-04-12T09:19:28.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.055+0000 7f9a48052700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a40102e00 0x7f9a40113ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:19:28.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.055+0000 7f9a48052700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a401037a0 0x7f9a40114220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:19:28.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.055+0000 7f9a48052700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a40114870 con 0x7f9a40102e00 2024-04-12T09:19:28.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.055+0000 7f9a48052700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4010dc90 con 0x7f9a401037a0 2024-04-12T09:19:28.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.055+0000 7f9a45dee700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a40102e00 0x7f9a40113ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:19:28.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.055+0000 7f9a45dee700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a40102e00 0x7f9a40113ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:36498/0 (socket says 172.21.15.117:36498) 2024-04-12T09:19:28.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.055+0000 7f9a45dee700 1 -- 172.21.15.117:0/2056880809 learned_addr learned my addr 172.21.15.117:0/2056880809 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:19:28.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.055+0000 7f9a455ed700 1 --2- 172.21.15.117:0/2056880809 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a401037a0 0x7f9a40114220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:19:28.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.055+0000 7f9a45dee700 1 -- 172.21.15.117:0/2056880809 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a401037a0 msgr2=0x7f9a40114220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:28.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.055+0000 7f9a45dee700 1 --2- 172.21.15.117:0/2056880809 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a401037a0 0x7f9a40114220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:28.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.055+0000 7f9a45dee700 1 -- 172.21.15.117:0/2056880809 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a30009940 con 0x7f9a40102e00 2024-04-12T09:19:28.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.056+0000 7f9a45dee700 1 --2- 172.21.15.117:0/2056880809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a40102e00 0x7f9a40113ce0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9a30003400 tx=0x7f9a30004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:19:28.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.056+0000 7f9a3e7fc700 1 -- 172.21.15.117:0/2056880809 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a3000e040 con 0x7f9a40102e00 2024-04-12T09:19:28.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.056+0000 7f9a3e7fc700 1 -- 172.21.15.117:0/2056880809 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a30004610 con 0x7f9a40102e00 2024-04-12T09:19:28.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.056+0000 7f9a3e7fc700 1 -- 172.21.15.117:0/2056880809 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a3001c640 con 0x7f9a40102e00 2024-04-12T09:19:28.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.056+0000 7f9a48052700 1 -- 172.21.15.117:0/2056880809 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4010df10 con 0x7f9a40102e00 2024-04-12T09:19:28.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.056+0000 7f9a48052700 1 -- 172.21.15.117:0/2056880809 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4010e4d0 con 0x7f9a40102e00 2024-04-12T09:19:28.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.057+0000 7f9a48052700 1 -- 172.21.15.117:0/2056880809 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a40100110 con 0x7f9a40102e00 2024-04-12T09:19:28.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.057+0000 7f9a3e7fc700 1 -- 172.21.15.117:0/2056880809 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f9a30012a70 con 0x7f9a40102e00 2024-04-12T09:19:28.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.058+0000 7f9a3e7fc700 1 --2- 172.21.15.117:0/2056880809 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f9a2806dca0 0x7f9a28070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:19:28.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.058+0000 7f9a3e7fc700 1 -- 172.21.15.117:0/2056880809 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f9a3008eef0 con 0x7f9a40102e00 2024-04-12T09:19:28.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.058+0000 7f9a455ed700 1 --2- 172.21.15.117:0/2056880809 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f9a2806dca0 0x7f9a28070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:19:28.059 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.058+0000 7f9a455ed700 1 --2- 172.21.15.117:0/2056880809 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f9a2806dca0 0x7f9a28070150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9a4010f580 tx=0x7f9a3400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:19:28.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.062+0000 7f9a3e7fc700 1 -- 172.21.15.117:0/2056880809 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f9a3005c050 con 0x7f9a40102e00 2024-04-12T09:19:28.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:27 smithi203 ceph-mon[86783]: pgmap v129: 65 pgs: 65 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:28.275 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.275+0000 7f9a48052700 1 -- 172.21.15.117:0/2056880809 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a40109f20 con 0x7f9a2806dca0 2024-04-12T09:19:28.276 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.276+0000 7f9a3e7fc700 1 -- 172.21.15.117:0/2056880809 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f9a40109f20 con 0x7f9a2806dca0 2024-04-12T09:19:28.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.279+0000 7f9a48052700 1 -- 172.21.15.117:0/2056880809 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f9a2806dca0 msgr2=0x7f9a28070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:28.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.279+0000 7f9a48052700 1 --2- 172.21.15.117:0/2056880809 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f9a2806dca0 0x7f9a28070150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9a4010f580 tx=0x7f9a3400b040 comp rx=0 tx=0).stop 2024-04-12T09:19:28.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.279+0000 7f9a48052700 1 -- 172.21.15.117:0/2056880809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a40102e00 msgr2=0x7f9a40113ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:28.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.279+0000 7f9a48052700 1 --2- 172.21.15.117:0/2056880809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a40102e00 0x7f9a40113ce0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9a30003400 tx=0x7f9a30004d10 comp rx=0 tx=0).stop 2024-04-12T09:19:28.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.279+0000 7f9a48052700 1 -- 172.21.15.117:0/2056880809 shutdown_connections 2024-04-12T09:19:28.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.279+0000 7f9a48052700 1 --2- 172.21.15.117:0/2056880809 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f9a2806dca0 0x7f9a28070150 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:28.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.279+0000 7f9a48052700 1 --2- 172.21.15.117:0/2056880809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a40102e00 0x7f9a40113ce0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:28.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.279+0000 7f9a48052700 1 --2- 172.21.15.117:0/2056880809 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a401037a0 0x7f9a40114220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:28.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.279+0000 7f9a48052700 1 -- 172.21.15.117:0/2056880809 >> 172.21.15.117:0/2056880809 conn(0x7f9a400f89b0 msgr2=0x7f9a401073c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:19:28.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.279+0000 7f9a48052700 1 -- 172.21.15.117:0/2056880809 shutdown_connections 2024-04-12T09:19:28.280 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.279+0000 7f9a48052700 1 -- 172.21.15.117:0/2056880809 wait complete. 2024-04-12T09:19:28.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.379+0000 7fb6135ac700 1 -- 172.21.15.117:0/3502584087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb60c0fe9d0 msgr2=0x7fb60c0fee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:28.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.379+0000 7fb6135ac700 1 --2- 172.21.15.117:0/3502584087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb60c0fe9d0 0x7fb60c0fee40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc004940 tx=0x7fb5fc009e30 comp rx=0 tx=0).stop 2024-04-12T09:19:28.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.379+0000 7fb6135ac700 1 -- 172.21.15.117:0/3502584087 shutdown_connections 2024-04-12T09:19:28.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.379+0000 7fb6135ac700 1 --2- 172.21.15.117:0/3502584087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb60c0fe9d0 0x7fb60c0fee40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:28.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.379+0000 7fb6135ac700 1 --2- 172.21.15.117:0/3502584087 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb60c0fd1d0 0x7fb60c0fd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:28.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.379+0000 7fb6135ac700 1 -- 172.21.15.117:0/3502584087 >> 172.21.15.117:0/3502584087 conn(0x7fb60c0f89b0 msgr2=0x7fb60c0fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:19:28.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.380+0000 7fb6135ac700 1 -- 172.21.15.117:0/3502584087 shutdown_connections 2024-04-12T09:19:28.382 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.380+0000 7fb6135ac700 1 -- 172.21.15.117:0/3502584087 wait complete. 2024-04-12T09:19:28.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.380+0000 7fb6135ac700 1 Processor -- start 2024-04-12T09:19:28.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.380+0000 7fb6135ac700 1 -- start start 2024-04-12T09:19:28.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.380+0000 7fb6135ac700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb60c0fd1d0 0x7fb60c115b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:19:28.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.380+0000 7fb6135ac700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb60c0fe9d0 0x7fb60c1160c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:19:28.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.380+0000 7fb6135ac700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c116710 con 0x7fb60c0fe9d0 2024-04-12T09:19:28.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.380+0000 7fb6135ac700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c10fcf0 con 0x7fb60c0fd1d0 2024-04-12T09:19:28.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.380+0000 7fb610b47700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb60c0fe9d0 0x7fb60c1160c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:19:28.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.380+0000 7fb610b47700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb60c0fe9d0 0x7fb60c1160c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:36502/0 (socket says 172.21.15.117:36502) 2024-04-12T09:19:28.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.380+0000 7fb610b47700 1 -- 172.21.15.117:0/512714864 learned_addr learned my addr 172.21.15.117:0/512714864 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:19:28.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.381+0000 7fb611348700 1 --2- 172.21.15.117:0/512714864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb60c0fd1d0 0x7fb60c115b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:19:28.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.381+0000 7fb610b47700 1 -- 172.21.15.117:0/512714864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb60c0fd1d0 msgr2=0x7fb60c115b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:28.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.381+0000 7fb610b47700 1 --2- 172.21.15.117:0/512714864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb60c0fd1d0 0x7fb60c115b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:28.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.381+0000 7fb610b47700 1 -- 172.21.15.117:0/512714864 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc005040 con 0x7fb60c0fe9d0 2024-04-12T09:19:28.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.381+0000 7fb610b47700 1 --2- 172.21.15.117:0/512714864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb60c0fe9d0 0x7fb60c1160c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00b3b0 tx=0x7fb5fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:19:28.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.381+0000 7fb601ffb700 1 -- 172.21.15.117:0/512714864 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5fc00e040 con 0x7fb60c0fe9d0 2024-04-12T09:19:28.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.381+0000 7fb6135ac700 1 -- 172.21.15.117:0/512714864 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60c10ff70 con 0x7fb60c0fe9d0 2024-04-12T09:19:28.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.381+0000 7fb601ffb700 1 -- 172.21.15.117:0/512714864 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb5fc00bbc0 con 0x7fb60c0fe9d0 2024-04-12T09:19:28.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.381+0000 7fb601ffb700 1 -- 172.21.15.117:0/512714864 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5fc01c3f0 con 0x7fb60c0fe9d0 2024-04-12T09:19:28.384 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.381+0000 7fb6135ac700 1 -- 172.21.15.117:0/512714864 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60c110530 con 0x7fb60c0fe9d0 2024-04-12T09:19:28.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.382+0000 7fb6135ac700 1 -- 172.21.15.117:0/512714864 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb60c102250 con 0x7fb60c0fe9d0 2024-04-12T09:19:28.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.383+0000 7fb601ffb700 1 -- 172.21.15.117:0/512714864 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fb5fc00bd30 con 0x7fb60c0fe9d0 2024-04-12T09:19:28.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.383+0000 7fb601ffb700 1 --2- 172.21.15.117:0/512714864 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb5f806dca0 0x7fb5f8070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:19:28.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.383+0000 7fb601ffb700 1 -- 172.21.15.117:0/512714864 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb5fc08e770 con 0x7fb60c0fe9d0 2024-04-12T09:19:28.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.383+0000 7fb611348700 1 --2- 172.21.15.117:0/512714864 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb5f806dca0 0x7fb5f8070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:19:28.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.384+0000 7fb611348700 1 --2- 172.21.15.117:0/512714864 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb5f806dca0 0x7fb5f8070150 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb608004d60 tx=0x7fb60800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:19:28.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.388+0000 7fb601ffb700 1 -- 172.21.15.117:0/512714864 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb5fc05b8d0 con 0x7fb60c0fe9d0 2024-04-12T09:19:28.592 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.591+0000 7fb6135ac700 1 -- 172.21.15.117:0/512714864 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb60c04c710 con 0x7fb5f806dca0 2024-04-12T09:19:28.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.602+0000 7fb601ffb700 1 -- 172.21.15.117:0/512714864 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb60c04c710 con 0x7fb5f806dca0 2024-04-12T09:19:28.602 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:19:28.602 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 running (5m) 52s ago 16m 27.1M - 0.25.0 c8568f914cd2 204687f21ed7 2024-04-12T09:19:28.602 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (2m) 52s ago 16m 6656k - 19.0.0-2053-gb277feb2 668895944f0e 038f567b664b 2024-04-12T09:19:28.603 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (2m) 19s ago 15m 6660k - 19.0.0-2053-gb277feb2 668895944f0e 420dee66e230 2024-04-12T09:19:28.603 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 running (4m) 52s ago 16m 79.6M - 9.4.12 2bacad6d85d8 a7b102216886 2024-04-12T09:19:28.603 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (11m) 52s ago 11m 140M - 17.2.7-827-gd3b5060a 21de9b7369ad de062e2c10e7 2024-04-12T09:19:28.603 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 running (11m) 52s ago 11m 14.7M - 17.2.7-827-gd3b5060a 21de9b7369ad 1e82c6241a18 2024-04-12T09:19:28.603 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (11m) 19s ago 11m 17.5M - 17.2.7-827-gd3b5060a 21de9b7369ad b05228e997f7 2024-04-12T09:19:28.603 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (11m) 19s ago 11m 17.7M - 17.2.7-827-gd3b5060a 21de9b7369ad 6d7f82c072c7 2024-04-12T09:19:28.603 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:8443,9283,8765 running (6m) 52s ago 17m 504M - 19.0.0-2053-gb277feb2 668895944f0e fee613d05ab7 2024-04-12T09:19:28.603 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283,8765 running (6m) 19s ago 15m 450M - 19.0.0-2053-gb277feb2 668895944f0e c793944c3e16 2024-04-12T09:19:28.603 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (3m) 52s ago 18m 48.0M 2048M 19.0.0-2053-gb277feb2 668895944f0e 6823aaff30ce 2024-04-12T09:19:28.603 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (3m) 19s ago 15m 38.3M 2048M 19.0.0-2053-gb277feb2 668895944f0e 006c6e487bfb 2024-04-12T09:19:28.603 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 running (5m) 52s ago 16m 16.2M - 1.5.0 0da6a335fe13 c692bed9f6c7 2024-04-12T09:19:28.603 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (5m) 19s ago 15m 15.8M - 1.5.0 0da6a335fe13 f3b5a470f545 2024-04-12T09:19:28.603 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (2m) 52s ago 14m 88.1M 1557M 19.0.0-2053-gb277feb2 668895944f0e 59a180461e3c 2024-04-12T09:19:28.603 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (94s) 52s ago 14m 95.0M 1557M 19.0.0-2053-gb277feb2 668895944f0e d40e2dfc164b 2024-04-12T09:19:28.604 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (58s) 52s ago 13m 12.5M 1557M 19.0.0-2053-gb277feb2 668895944f0e fd7d5481cddb 2024-04-12T09:19:28.604 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (22s) 19s ago 13m 11.9M 2581M 19.0.0-2053-gb277feb2 668895944f0e 961db53f9ab1 2024-04-12T09:19:28.604 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (13m) 19s ago 13m 248M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad c873826a2dea 2024-04-12T09:19:28.604 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (12m) 19s ago 12m 222M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad 69cb7c22f002 2024-04-12T09:19:28.604 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 running (5m) 52s ago 16m 61.0M - 2.43.0 a07b618ecd1d 43ce588d82cc 2024-04-12T09:19:28.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.604+0000 7fb6135ac700 1 -- 172.21.15.117:0/512714864 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb5f806dca0 msgr2=0x7fb5f8070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:28.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.604+0000 7fb6135ac700 1 --2- 172.21.15.117:0/512714864 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb5f806dca0 0x7fb5f8070150 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb608004d60 tx=0x7fb60800b040 comp rx=0 tx=0).stop 2024-04-12T09:19:28.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.604+0000 7fb6135ac700 1 -- 172.21.15.117:0/512714864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb60c0fe9d0 msgr2=0x7fb60c1160c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:28.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.604+0000 7fb6135ac700 1 --2- 172.21.15.117:0/512714864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb60c0fe9d0 0x7fb60c1160c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00b3b0 tx=0x7fb5fc009e30 comp rx=0 tx=0).stop 2024-04-12T09:19:28.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.604+0000 7fb6135ac700 1 -- 172.21.15.117:0/512714864 shutdown_connections 2024-04-12T09:19:28.605 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.604+0000 7fb6135ac700 1 --2- 172.21.15.117:0/512714864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb60c0fd1d0 0x7fb60c115b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:28.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.604+0000 7fb6135ac700 1 --2- 172.21.15.117:0/512714864 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb5f806dca0 0x7fb5f8070150 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:28.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.604+0000 7fb6135ac700 1 --2- 172.21.15.117:0/512714864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb60c0fe9d0 0x7fb60c1160c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:28.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.604+0000 7fb6135ac700 1 -- 172.21.15.117:0/512714864 >> 172.21.15.117:0/512714864 conn(0x7fb60c0f89b0 msgr2=0x7fb60c0704d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:19:28.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.604+0000 7fb6135ac700 1 -- 172.21.15.117:0/512714864 shutdown_connections 2024-04-12T09:19:28.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.604+0000 7fb6135ac700 1 -- 172.21.15.117:0/512714864 wait complete. 2024-04-12T09:19:28.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.706+0000 7efce236e700 1 -- 172.21.15.117:0/1880178126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcdc101d10 msgr2=0x7efcdc1020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:28.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.706+0000 7efce236e700 1 --2- 172.21.15.117:0/1880178126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcdc101d10 0x7efcdc1020e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efcd0004940 tx=0x7efcd0009e30 comp rx=0 tx=0).stop 2024-04-12T09:19:28.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.706+0000 7efce236e700 1 -- 172.21.15.117:0/1880178126 shutdown_connections 2024-04-12T09:19:28.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.706+0000 7efce236e700 1 --2- 172.21.15.117:0/1880178126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efcdc1026b0 0x7efcdc0fbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:28.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.706+0000 7efce236e700 1 --2- 172.21.15.117:0/1880178126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcdc101d10 0x7efcdc1020e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:28.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.706+0000 7efce236e700 1 -- 172.21.15.117:0/1880178126 >> 172.21.15.117:0/1880178126 conn(0x7efcdc0f7880 msgr2=0x7efcdc0f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:19:28.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.706+0000 7efce236e700 1 -- 172.21.15.117:0/1880178126 shutdown_connections 2024-04-12T09:19:28.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.706+0000 7efce236e700 1 -- 172.21.15.117:0/1880178126 wait complete. 2024-04-12T09:19:28.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.707+0000 7efce236e700 1 Processor -- start 2024-04-12T09:19:28.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.707+0000 7efce236e700 1 -- start start 2024-04-12T09:19:28.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.707+0000 7efce236e700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efcdc101d10 0x7efcdc113e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:19:28.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.707+0000 7efce236e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcdc1026b0 0x7efcdc1143d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:19:28.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.707+0000 7efce236e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc114a20 con 0x7efcdc1026b0 2024-04-12T09:19:28.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.707+0000 7efce236e700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc10ddf0 con 0x7efcdc101d10 2024-04-12T09:19:28.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.707+0000 7efcdb7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcdc1026b0 0x7efcdc1143d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:19:28.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.707+0000 7efcdb7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcdc1026b0 0x7efcdc1143d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:36510/0 (socket says 172.21.15.117:36510) 2024-04-12T09:19:28.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.707+0000 7efcdb7fe700 1 -- 172.21.15.117:0/218633749 learned_addr learned my addr 172.21.15.117:0/218633749 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:19:28.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.707+0000 7efcdbfff700 1 --2- 172.21.15.117:0/218633749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efcdc101d10 0x7efcdc113e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:19:28.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.707+0000 7efcdb7fe700 1 -- 172.21.15.117:0/218633749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efcdc101d10 msgr2=0x7efcdc113e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:28.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.707+0000 7efcdb7fe700 1 --2- 172.21.15.117:0/218633749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efcdc101d10 0x7efcdc113e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:28.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.707+0000 7efcdb7fe700 1 -- 172.21.15.117:0/218633749 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd0005040 con 0x7efcdc1026b0 2024-04-12T09:19:28.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.708+0000 7efcdb7fe700 1 --2- 172.21.15.117:0/218633749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcdc1026b0 0x7efcdc1143d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efccc00c800 tx=0x7efccc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:19:28.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.708+0000 7efcd8ff9700 1 -- 172.21.15.117:0/218633749 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efccc00a760 con 0x7efcdc1026b0 2024-04-12T09:19:28.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.708+0000 7efce236e700 1 -- 172.21.15.117:0/218633749 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcdc10e0d0 con 0x7efcdc1026b0 2024-04-12T09:19:28.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.708+0000 7efcd8ff9700 1 -- 172.21.15.117:0/218633749 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efccc00ad90 con 0x7efcdc1026b0 2024-04-12T09:19:28.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.708+0000 7efcd8ff9700 1 -- 172.21.15.117:0/218633749 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efccc0113a0 con 0x7efcdc1026b0 2024-04-12T09:19:28.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.708+0000 7efce236e700 1 -- 172.21.15.117:0/218633749 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcdc10e690 con 0x7efcdc1026b0 2024-04-12T09:19:28.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.709+0000 7efce236e700 1 -- 172.21.15.117:0/218633749 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcdc0fd460 con 0x7efcdc1026b0 2024-04-12T09:19:28.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.709+0000 7efcd8ff9700 1 -- 172.21.15.117:0/218633749 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7efccc00a8c0 con 0x7efcdc1026b0 2024-04-12T09:19:28.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.710+0000 7efcd8ff9700 1 --2- 172.21.15.117:0/218633749 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7efcc406dca0 0x7efcc4070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:19:28.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.710+0000 7efcdbfff700 1 --2- 172.21.15.117:0/218633749 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7efcc406dca0 0x7efcc4070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:19:28.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.710+0000 7efcd8ff9700 1 -- 172.21.15.117:0/218633749 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7efccc08d420 con 0x7efcdc1026b0 2024-04-12T09:19:28.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.710+0000 7efcdbfff700 1 --2- 172.21.15.117:0/218633749 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7efcc406dca0 0x7efcc4070150 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efcd0004f90 tx=0x7efcd0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:19:28.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.714+0000 7efcd8ff9700 1 -- 172.21.15.117:0/218633749 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7efccc05a6a0 con 0x7efcdc1026b0 2024-04-12T09:19:28.992 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.991+0000 7efce236e700 1 -- 172.21.15.117:0/218633749 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efcdc04bed0 con 0x7efcdc1026b0 2024-04-12T09:19:28.993 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.992+0000 7efcd8ff9700 1 -- 172.21.15.117:0/218633749 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7efccc05a230 con 0x7efcdc1026b0 2024-04-12T09:19:28.993 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:19:28.993 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": { 2024-04-12T09:19:28.993 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:19:28.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:19:28.993 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": { 2024-04-12T09:19:28.993 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:19:28.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:19:28.993 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": { 2024-04-12T09:19:28.993 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 2, 2024-04-12T09:19:28.993 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 4 2024-04-12T09:19:28.993 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:19:28.994 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-04-12T09:19:28.994 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 4 2024-04-12T09:19:28.994 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:19:28.994 INFO:teuthology.orchestra.run.smithi117.stdout: "overall": { 2024-04-12T09:19:28.994 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 6, 2024-04-12T09:19:28.994 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 8 2024-04-12T09:19:28.994 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:19:28.994 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:19:28.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.994+0000 7efce236e700 1 -- 172.21.15.117:0/218633749 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7efcc406dca0 msgr2=0x7efcc4070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:28.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.994+0000 7efce236e700 1 --2- 172.21.15.117:0/218633749 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7efcc406dca0 0x7efcc4070150 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efcd0004f90 tx=0x7efcd0009e30 comp rx=0 tx=0).stop 2024-04-12T09:19:28.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.994+0000 7efce236e700 1 -- 172.21.15.117:0/218633749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcdc1026b0 msgr2=0x7efcdc1143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:28.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.994+0000 7efce236e700 1 --2- 172.21.15.117:0/218633749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcdc1026b0 0x7efcdc1143d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efccc00c800 tx=0x7efccc004470 comp rx=0 tx=0).stop 2024-04-12T09:19:28.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.994+0000 7efce236e700 1 -- 172.21.15.117:0/218633749 shutdown_connections 2024-04-12T09:19:28.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.994+0000 7efce236e700 1 --2- 172.21.15.117:0/218633749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efcdc101d10 0x7efcdc113e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:28.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.994+0000 7efce236e700 1 --2- 172.21.15.117:0/218633749 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7efcc406dca0 0x7efcc4070150 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:28.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.994+0000 7efce236e700 1 --2- 172.21.15.117:0/218633749 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcdc1026b0 0x7efcdc1143d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:28.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.994+0000 7efce236e700 1 -- 172.21.15.117:0/218633749 >> 172.21.15.117:0/218633749 conn(0x7efcdc0f7880 msgr2=0x7efcdc0f8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:19:28.995 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.994+0000 7efce236e700 1 -- 172.21.15.117:0/218633749 shutdown_connections 2024-04-12T09:19:28.996 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:28.994+0000 7efce236e700 1 -- 172.21.15.117:0/218633749 wait complete. 2024-04-12T09:19:29.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.096+0000 7f239a747700 1 -- 172.21.15.117:0/3972769832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23941037a0 msgr2=0x7f23940fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:29.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.096+0000 7f239a747700 1 --2- 172.21.15.117:0/3972769832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23941037a0 0x7f23940fce10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2388004940 tx=0x7f2388009e30 comp rx=0 tx=0).stop 2024-04-12T09:19:29.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.096+0000 7f239a747700 1 -- 172.21.15.117:0/3972769832 shutdown_connections 2024-04-12T09:19:29.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.096+0000 7f239a747700 1 --2- 172.21.15.117:0/3972769832 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23941037a0 0x7f23940fce10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:29.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.096+0000 7f239a747700 1 --2- 172.21.15.117:0/3972769832 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2394102e00 0x7f23941031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:29.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.096+0000 7f239a747700 1 -- 172.21.15.117:0/3972769832 >> 172.21.15.117:0/3972769832 conn(0x7f23940f89b0 msgr2=0x7f23940fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:19:29.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.096+0000 7f239a747700 1 -- 172.21.15.117:0/3972769832 shutdown_connections 2024-04-12T09:19:29.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.096+0000 7f239a747700 1 -- 172.21.15.117:0/3972769832 wait complete. 2024-04-12T09:19:29.097 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.096+0000 7f239a747700 1 Processor -- start 2024-04-12T09:19:29.098 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.096+0000 7f239a747700 1 -- start start 2024-04-12T09:19:29.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.097+0000 7f239a747700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2394102e00 0x7f2394113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:19:29.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.097+0000 7f239a747700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23941037a0 0x7f2394113ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:19:29.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.097+0000 7f239a747700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23941145b0 con 0x7f23941037a0 2024-04-12T09:19:29.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.097+0000 7f239a747700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239410db40 con 0x7f2394102e00 2024-04-12T09:19:29.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.097+0000 7f23937fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23941037a0 0x7f2394113ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:19:29.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.097+0000 7f23937fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23941037a0 0x7f2394113ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:36528/0 (socket says 172.21.15.117:36528) 2024-04-12T09:19:29.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.097+0000 7f23937fe700 1 -- 172.21.15.117:0/3443295655 learned_addr learned my addr 172.21.15.117:0/3443295655 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:19:29.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.097+0000 7f2393fff700 1 --2- 172.21.15.117:0/3443295655 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2394102e00 0x7f2394113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:19:29.099 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.097+0000 7f23937fe700 1 -- 172.21.15.117:0/3443295655 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2394102e00 msgr2=0x7f2394113990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:29.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.097+0000 7f23937fe700 1 --2- 172.21.15.117:0/3443295655 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2394102e00 0x7f2394113990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:29.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.097+0000 7f23937fe700 1 -- 172.21.15.117:0/3443295655 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2388005040 con 0x7f23941037a0 2024-04-12T09:19:29.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.097+0000 7f23937fe700 1 --2- 172.21.15.117:0/3443295655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23941037a0 0x7f2394113ed0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2388009100 tx=0x7f2388009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:19:29.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.098+0000 7f2390ff9700 1 -- 172.21.15.117:0/3443295655 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f238800e040 con 0x7f23941037a0 2024-04-12T09:19:29.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.098+0000 7f2390ff9700 1 -- 172.21.15.117:0/3443295655 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2388009af0 con 0x7f23941037a0 2024-04-12T09:19:29.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.098+0000 7f239a747700 1 -- 172.21.15.117:0/3443295655 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f239410ddc0 con 0x7f23941037a0 2024-04-12T09:19:29.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.098+0000 7f2390ff9700 1 -- 172.21.15.117:0/3443295655 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f238801c3f0 con 0x7f23941037a0 2024-04-12T09:19:29.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.098+0000 7f239a747700 1 -- 172.21.15.117:0/3443295655 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f239410e380 con 0x7f23941037a0 2024-04-12T09:19:29.100 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.099+0000 7f239a747700 1 -- 172.21.15.117:0/3443295655 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2394100110 con 0x7f23941037a0 2024-04-12T09:19:29.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.099+0000 7f2390ff9700 1 -- 172.21.15.117:0/3443295655 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f238800baf0 con 0x7f23941037a0 2024-04-12T09:19:29.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.099+0000 7f2390ff9700 1 --2- 172.21.15.117:0/3443295655 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f237c06dca0 0x7f237c070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:19:29.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.100+0000 7f2390ff9700 1 -- 172.21.15.117:0/3443295655 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f238808e6e0 con 0x7f23941037a0 2024-04-12T09:19:29.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.100+0000 7f2393fff700 1 --2- 172.21.15.117:0/3443295655 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f237c06dca0 0x7f237c070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:19:29.101 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.100+0000 7f2393fff700 1 --2- 172.21.15.117:0/3443295655 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f237c06dca0 0x7f237c070150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2384009b60 tx=0x7f23840091a0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:19:29.104 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.104+0000 7f2390ff9700 1 -- 172.21.15.117:0/3443295655 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f2388057d90 con 0x7f23941037a0 2024-04-12T09:19:29.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.341+0000 7f239a747700 1 -- 172.21.15.117:0/3443295655 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f23940fe550 con 0x7f23941037a0 2024-04-12T09:19:29.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.341+0000 7f2390ff9700 1 -- 172.21.15.117:0/3443295655 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1884 (secure 0 0 0) 0x7f238805b450 con 0x7f23941037a0 2024-04-12T09:19:29.342 INFO:teuthology.orchestra.run.smithi117.stdout:e14 2024-04-12T09:19:29.342 INFO:teuthology.orchestra.run.smithi117.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T09:19:29.342 INFO:teuthology.orchestra.run.smithi117.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:19:29.342 INFO:teuthology.orchestra.run.smithi117.stdout:legacy client fscid: 1 2024-04-12T09:19:29.342 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:19:29.342 INFO:teuthology.orchestra.run.smithi117.stdout:Filesystem 'cephfs' (1) 2024-04-12T09:19:29.343 INFO:teuthology.orchestra.run.smithi117.stdout:fs_name cephfs 2024-04-12T09:19:29.343 INFO:teuthology.orchestra.run.smithi117.stdout:epoch 14 2024-04-12T09:19:29.343 INFO:teuthology.orchestra.run.smithi117.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T09:19:29.343 INFO:teuthology.orchestra.run.smithi117.stdout:created 2024-04-12T09:08:12.488144+0000 2024-04-12T09:19:29.343 INFO:teuthology.orchestra.run.smithi117.stdout:modified 2024-04-12T09:08:30.563184+0000 2024-04-12T09:19:29.343 INFO:teuthology.orchestra.run.smithi117.stdout:tableserver 0 2024-04-12T09:19:29.343 INFO:teuthology.orchestra.run.smithi117.stdout:root 0 2024-04-12T09:19:29.343 INFO:teuthology.orchestra.run.smithi117.stdout:session_timeout 60 2024-04-12T09:19:29.343 INFO:teuthology.orchestra.run.smithi117.stdout:session_autoclose 300 2024-04-12T09:19:29.343 INFO:teuthology.orchestra.run.smithi117.stdout:max_file_size 1099511627776 2024-04-12T09:19:29.343 INFO:teuthology.orchestra.run.smithi117.stdout:max_xattr_size 65536 2024-04-12T09:19:29.343 INFO:teuthology.orchestra.run.smithi117.stdout:required_client_features {} 2024-04-12T09:19:29.343 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure 0 2024-04-12T09:19:29.343 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure_osd_epoch 46 2024-04-12T09:19:29.343 INFO:teuthology.orchestra.run.smithi117.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:19:29.344 INFO:teuthology.orchestra.run.smithi117.stdout:max_mds 1 2024-04-12T09:19:29.344 INFO:teuthology.orchestra.run.smithi117.stdout:in 0 2024-04-12T09:19:29.344 INFO:teuthology.orchestra.run.smithi117.stdout:up {0=14474} 2024-04-12T09:19:29.344 INFO:teuthology.orchestra.run.smithi117.stdout:failed 2024-04-12T09:19:29.344 INFO:teuthology.orchestra.run.smithi117.stdout:damaged 2024-04-12T09:19:29.344 INFO:teuthology.orchestra.run.smithi117.stdout:stopped 2024-04-12T09:19:29.344 INFO:teuthology.orchestra.run.smithi117.stdout:data_pools [3] 2024-04-12T09:19:29.344 INFO:teuthology.orchestra.run.smithi117.stdout:metadata_pool 2 2024-04-12T09:19:29.344 INFO:teuthology.orchestra.run.smithi117.stdout:inline_data disabled 2024-04-12T09:19:29.344 INFO:teuthology.orchestra.run.smithi117.stdout:balancer 2024-04-12T09:19:29.344 INFO:teuthology.orchestra.run.smithi117.stdout:bal_rank_mask -1 2024-04-12T09:19:29.344 INFO:teuthology.orchestra.run.smithi117.stdout:standby_count_wanted 1 2024-04-12T09:19:29.344 INFO:teuthology.orchestra.run.smithi117.stdout:qdb_cluster leader: 0 members: 2024-04-12T09:19:29.344 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.eslmxh{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.117:6828/2248590199,v1:172.21.15.117:6829/2248590199] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:19:29.345 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:19:29.345 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:19:29.345 INFO:teuthology.orchestra.run.smithi117.stdout:Standby daemons: 2024-04-12T09:19:29.345 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:19:29.345 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.wddsgt{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/4010127141,v1:172.21.15.117:6827/4010127141] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:19:29.345 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.fbeixl{-1:24265} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.203:6824/840607003,v1:172.21.15.203:6825/840607003] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:19:29.345 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.bszhxz{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/2731911290,v1:172.21.15.203:6827/2731911290] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:19:29.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.343+0000 7f239a747700 1 -- 172.21.15.117:0/3443295655 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f237c06dca0 msgr2=0x7f237c070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:29.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.343+0000 7f239a747700 1 --2- 172.21.15.117:0/3443295655 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f237c06dca0 0x7f237c070150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2384009b60 tx=0x7f23840091a0 comp rx=0 tx=0).stop 2024-04-12T09:19:29.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.343+0000 7f239a747700 1 -- 172.21.15.117:0/3443295655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23941037a0 msgr2=0x7f2394113ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:29.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.343+0000 7f239a747700 1 --2- 172.21.15.117:0/3443295655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23941037a0 0x7f2394113ed0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2388009100 tx=0x7f2388009e30 comp rx=0 tx=0).stop 2024-04-12T09:19:29.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.343+0000 7f239a747700 1 -- 172.21.15.117:0/3443295655 shutdown_connections 2024-04-12T09:19:29.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.343+0000 7f239a747700 1 --2- 172.21.15.117:0/3443295655 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2394102e00 0x7f2394113990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:29.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.343+0000 7f239a747700 1 --2- 172.21.15.117:0/3443295655 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f237c06dca0 0x7f237c070150 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:29.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.343+0000 7f239a747700 1 --2- 172.21.15.117:0/3443295655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23941037a0 0x7f2394113ed0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:29.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.343+0000 7f239a747700 1 -- 172.21.15.117:0/3443295655 >> 172.21.15.117:0/3443295655 conn(0x7f23940f89b0 msgr2=0x7f23940fa770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:19:29.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.343+0000 7f239a747700 1 -- 172.21.15.117:0/3443295655 shutdown_connections 2024-04-12T09:19:29.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.343+0000 7f239a747700 1 -- 172.21.15.117:0/3443295655 wait complete. 2024-04-12T09:19:29.347 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 14 2024-04-12T09:19:29.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.445+0000 7fe94831a700 1 -- 172.21.15.117:0/2850798806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe940101cf0 msgr2=0x7fe9401020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:29.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.445+0000 7fe94831a700 1 --2- 172.21.15.117:0/2850798806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe940101cf0 0x7fe9401020c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe93c004940 tx=0x7fe93c009e30 comp rx=0 tx=0).stop 2024-04-12T09:19:29.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.446+0000 7fe94831a700 1 -- 172.21.15.117:0/2850798806 shutdown_connections 2024-04-12T09:19:29.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.446+0000 7fe94831a700 1 --2- 172.21.15.117:0/2850798806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9400fbca0 0x7fe9400fc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:29.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.446+0000 7fe94831a700 1 --2- 172.21.15.117:0/2850798806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe940101cf0 0x7fe9401020c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:29.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.446+0000 7fe94831a700 1 -- 172.21.15.117:0/2850798806 >> 172.21.15.117:0/2850798806 conn(0x7fe940072bc0 msgr2=0x7fe940072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:19:29.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.446+0000 7fe94831a700 1 -- 172.21.15.117:0/2850798806 shutdown_connections 2024-04-12T09:19:29.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.446+0000 7fe94831a700 1 -- 172.21.15.117:0/2850798806 wait complete. 2024-04-12T09:19:29.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.446+0000 7fe94831a700 1 Processor -- start 2024-04-12T09:19:29.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.446+0000 7fe94831a700 1 -- start start 2024-04-12T09:19:29.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.446+0000 7fe94831a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9400fbca0 0x7fe940102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:19:29.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.446+0000 7fe94831a700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe940101cf0 0x7fe940102fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:19:29.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.446+0000 7fe94831a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe940103550 con 0x7fe9400fbca0 2024-04-12T09:19:29.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.446+0000 7fe94831a700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe940103690 con 0x7fe940101cf0 2024-04-12T09:19:29.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.446+0000 7fe9460b6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9400fbca0 0x7fe940102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:19:29.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.447+0000 7fe9460b6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9400fbca0 0x7fe940102a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:36534/0 (socket says 172.21.15.117:36534) 2024-04-12T09:19:29.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.447+0000 7fe9460b6700 1 -- 172.21.15.117:0/4266547915 learned_addr learned my addr 172.21.15.117:0/4266547915 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:19:29.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.447+0000 7fe9458b5700 1 --2- 172.21.15.117:0/4266547915 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe940101cf0 0x7fe940102fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:19:29.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.447+0000 7fe9460b6700 1 -- 172.21.15.117:0/4266547915 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe940101cf0 msgr2=0x7fe940102fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:29.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.447+0000 7fe9460b6700 1 --2- 172.21.15.117:0/4266547915 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe940101cf0 0x7fe940102fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:29.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.447+0000 7fe9460b6700 1 -- 172.21.15.117:0/4266547915 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93c005040 con 0x7fe9400fbca0 2024-04-12T09:19:29.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.447+0000 7fe9460b6700 1 --2- 172.21.15.117:0/4266547915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9400fbca0 0x7fe940102a80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe93c00b3b0 tx=0x7fe93c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:19:29.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.447+0000 7fe936ffd700 1 -- 172.21.15.117:0/4266547915 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe93c00e040 con 0x7fe9400fbca0 2024-04-12T09:19:29.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.447+0000 7fe94831a700 1 -- 172.21.15.117:0/4266547915 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9401038e0 con 0x7fe9400fbca0 2024-04-12T09:19:29.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.447+0000 7fe936ffd700 1 -- 172.21.15.117:0/4266547915 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe93c013420 con 0x7fe9400fbca0 2024-04-12T09:19:29.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.447+0000 7fe936ffd700 1 -- 172.21.15.117:0/4266547915 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe93c01c630 con 0x7fe9400fbca0 2024-04-12T09:19:29.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.447+0000 7fe94831a700 1 -- 172.21.15.117:0/4266547915 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe94011a210 con 0x7fe9400fbca0 2024-04-12T09:19:29.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.448+0000 7fe94831a700 1 -- 172.21.15.117:0/4266547915 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9400fd390 con 0x7fe9400fbca0 2024-04-12T09:19:29.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.449+0000 7fe936ffd700 1 -- 172.21.15.117:0/4266547915 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fe93c013590 con 0x7fe9400fbca0 2024-04-12T09:19:29.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.449+0000 7fe936ffd700 1 --2- 172.21.15.117:0/4266547915 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe92c06dca0 0x7fe92c070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:19:29.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.449+0000 7fe936ffd700 1 -- 172.21.15.117:0/4266547915 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe93c08e670 con 0x7fe9400fbca0 2024-04-12T09:19:29.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.449+0000 7fe9458b5700 1 --2- 172.21.15.117:0/4266547915 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe92c06dca0 0x7fe92c070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:19:29.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.450+0000 7fe9458b5700 1 --2- 172.21.15.117:0/4266547915 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe92c06dca0 0x7fe92c070150 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe9401043c0 tx=0x7fe93000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:19:29.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.457+0000 7fe936ffd700 1 -- 172.21.15.117:0/4266547915 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fe93c057dc0 con 0x7fe9400fbca0 2024-04-12T09:19:29.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.671+0000 7fe94831a700 1 -- 172.21.15.117:0/4266547915 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe940104170 con 0x7fe92c06dca0 2024-04-12T09:19:29.673 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.672+0000 7fe936ffd700 1 -- 172.21.15.117:0/4266547915 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fe940104170 con 0x7fe92c06dca0 2024-04-12T09:19:29.673 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:19:29.673 INFO:teuthology.orchestra.run.smithi117.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec", 2024-04-12T09:19:29.673 INFO:teuthology.orchestra.run.smithi117.stdout: "in_progress": true, 2024-04-12T09:19:29.673 INFO:teuthology.orchestra.run.smithi117.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T09:19:29.673 INFO:teuthology.orchestra.run.smithi117.stdout: "services_complete": [ 2024-04-12T09:19:29.673 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr", 2024-04-12T09:19:29.673 INFO:teuthology.orchestra.run.smithi117.stdout: "mon", 2024-04-12T09:19:29.674 INFO:teuthology.orchestra.run.smithi117.stdout: "crash" 2024-04-12T09:19:29.674 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2024-04-12T09:19:29.674 INFO:teuthology.orchestra.run.smithi117.stdout: "progress": "10/21 daemons upgraded", 2024-04-12T09:19:29.674 INFO:teuthology.orchestra.run.smithi117.stdout: "message": "Currently upgrading osd daemons", 2024-04-12T09:19:29.674 INFO:teuthology.orchestra.run.smithi117.stdout: "is_paused": false 2024-04-12T09:19:29.674 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:19:29.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.674+0000 7fe94831a700 1 -- 172.21.15.117:0/4266547915 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe92c06dca0 msgr2=0x7fe92c070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:29.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.674+0000 7fe94831a700 1 --2- 172.21.15.117:0/4266547915 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe92c06dca0 0x7fe92c070150 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe9401043c0 tx=0x7fe93000b040 comp rx=0 tx=0).stop 2024-04-12T09:19:29.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.675+0000 7fe94831a700 1 -- 172.21.15.117:0/4266547915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9400fbca0 msgr2=0x7fe940102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:29.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.675+0000 7fe94831a700 1 --2- 172.21.15.117:0/4266547915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9400fbca0 0x7fe940102a80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe93c00b3b0 tx=0x7fe93c009e30 comp rx=0 tx=0).stop 2024-04-12T09:19:29.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.675+0000 7fe94831a700 1 -- 172.21.15.117:0/4266547915 shutdown_connections 2024-04-12T09:19:29.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.675+0000 7fe94831a700 1 --2- 172.21.15.117:0/4266547915 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe92c06dca0 0x7fe92c070150 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:29.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.675+0000 7fe94831a700 1 --2- 172.21.15.117:0/4266547915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9400fbca0 0x7fe940102a80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:29.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.675+0000 7fe94831a700 1 --2- 172.21.15.117:0/4266547915 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe940101cf0 0x7fe940102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:29.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.675+0000 7fe94831a700 1 -- 172.21.15.117:0/4266547915 >> 172.21.15.117:0/4266547915 conn(0x7fe940072bc0 msgr2=0x7fe9400fa7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:19:29.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.675+0000 7fe94831a700 1 -- 172.21.15.117:0/4266547915 shutdown_connections 2024-04-12T09:19:29.676 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.675+0000 7fe94831a700 1 -- 172.21.15.117:0/4266547915 wait complete. 2024-04-12T09:19:29.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.776+0000 7fc779409700 1 -- 172.21.15.117:0/1681985603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc774102710 msgr2=0x7fc7740fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:29.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.776+0000 7fc779409700 1 --2- 172.21.15.117:0/1681985603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc774102710 0x7fc7740fbd80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc764004940 tx=0x7fc764009e30 comp rx=0 tx=0).stop 2024-04-12T09:19:29.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.776+0000 7fc779409700 1 -- 172.21.15.117:0/1681985603 shutdown_connections 2024-04-12T09:19:29.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.776+0000 7fc779409700 1 --2- 172.21.15.117:0/1681985603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc774102710 0x7fc7740fbd80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:29.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.776+0000 7fc779409700 1 --2- 172.21.15.117:0/1681985603 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc774101d70 0x7fc774102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:29.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.776+0000 7fc779409700 1 -- 172.21.15.117:0/1681985603 >> 172.21.15.117:0/1681985603 conn(0x7fc774072bc0 msgr2=0x7fc774072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:19:29.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.776+0000 7fc779409700 1 -- 172.21.15.117:0/1681985603 shutdown_connections 2024-04-12T09:19:29.777 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.776+0000 7fc779409700 1 -- 172.21.15.117:0/1681985603 wait complete. 2024-04-12T09:19:29.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.777+0000 7fc779409700 1 Processor -- start 2024-04-12T09:19:29.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.777+0000 7fc779409700 1 -- start start 2024-04-12T09:19:29.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.777+0000 7fc779409700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc774101d70 0x7fc77410eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:19:29.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.777+0000 7fc779409700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc774102710 0x7fc77410f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:19:29.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.777+0000 7fc779409700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77410f6d0 con 0x7fc774101d70 2024-04-12T09:19:29.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.777+0000 7fc779409700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77410f810 con 0x7fc774102710 2024-04-12T09:19:29.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.777+0000 7fc772ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc774101d70 0x7fc77410eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:19:29.779 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.777+0000 7fc772ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc774101d70 0x7fc77410eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:37174/0 (socket says 172.21.15.117:37174) 2024-04-12T09:19:29.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.777+0000 7fc772ffd700 1 -- 172.21.15.117:0/1988932837 learned_addr learned my addr 172.21.15.117:0/1988932837 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:19:29.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.777+0000 7fc7727fc700 1 --2- 172.21.15.117:0/1988932837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc774102710 0x7fc77410f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:19:29.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.777+0000 7fc772ffd700 1 -- 172.21.15.117:0/1988932837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc774102710 msgr2=0x7fc77410f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:29.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.777+0000 7fc772ffd700 1 --2- 172.21.15.117:0/1988932837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc774102710 0x7fc77410f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:29.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.777+0000 7fc772ffd700 1 -- 172.21.15.117:0/1988932837 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc764005040 con 0x7fc774101d70 2024-04-12T09:19:29.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.778+0000 7fc772ffd700 1 --2- 172.21.15.117:0/1988932837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc774101d70 0x7fc77410eb40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc768002a50 tx=0x7fc7680046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:19:29.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.778+0000 7fc75b7fe700 1 -- 172.21.15.117:0/1988932837 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc768007cc0 con 0x7fc774101d70 2024-04-12T09:19:29.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.778+0000 7fc75b7fe700 1 -- 172.21.15.117:0/1988932837 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc76800f040 con 0x7fc774101d70 2024-04-12T09:19:29.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.778+0000 7fc779409700 1 -- 172.21.15.117:0/1988932837 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc774117bb0 con 0x7fc774101d70 2024-04-12T09:19:29.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.778+0000 7fc75b7fe700 1 -- 172.21.15.117:0/1988932837 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc76800da30 con 0x7fc774101d70 2024-04-12T09:19:29.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.778+0000 7fc779409700 1 -- 172.21.15.117:0/1988932837 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc774118110 con 0x7fc774101d70 2024-04-12T09:19:29.780 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.779+0000 7fc779409700 1 -- 172.21.15.117:0/1988932837 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc774104240 con 0x7fc774101d70 2024-04-12T09:19:29.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.779+0000 7fc75b7fe700 1 -- 172.21.15.117:0/1988932837 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fc76800dbb0 con 0x7fc774101d70 2024-04-12T09:19:29.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.780+0000 7fc75b7fe700 1 --2- 172.21.15.117:0/1988932837 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc75c06dcb0 0x7fc75c070160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:19:29.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.780+0000 7fc75b7fe700 1 -- 172.21.15.117:0/1988932837 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc76808d160 con 0x7fc774101d70 2024-04-12T09:19:29.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.780+0000 7fc7727fc700 1 --2- 172.21.15.117:0/1988932837 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc75c06dcb0 0x7fc75c070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:19:29.781 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.780+0000 7fc7727fc700 1 --2- 172.21.15.117:0/1988932837 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc75c06dcb0 0x7fc75c070160 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc774066000 tx=0x7fc764009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:19:29.785 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:29.784+0000 7fc75b7fe700 1 -- 172.21.15.117:0/1988932837 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc768056810 con 0x7fc774101d70 2024-04-12T09:19:29.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:29 smithi117 ceph-mon[113571]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:19:29.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:29 smithi117 ceph-mon[113571]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:19:29.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:29 smithi117 ceph-mon[113571]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:19:29.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:29 smithi117 ceph-mon[113571]: pgmap v130: 65 pgs: 65 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:29.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:29 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/218633749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:19:29.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:29 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-12T09:19:29.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:29 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/3443295655' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:19:30.061 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:30.061+0000 7fc779409700 1 -- 172.21.15.117:0/1988932837 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc774108e80 con 0x7fc774101d70 2024-04-12T09:19:30.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:30.061+0000 7fc75b7fe700 1 -- 172.21.15.117:0/1988932837 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc768059ed0 con 0x7fc774101d70 2024-04-12T09:19:30.062 INFO:teuthology.orchestra.run.smithi117.stdout:HEALTH_OK 2024-04-12T09:19:30.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:30.063+0000 7fc779409700 1 -- 172.21.15.117:0/1988932837 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc75c06dcb0 msgr2=0x7fc75c070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:30.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:30.063+0000 7fc779409700 1 --2- 172.21.15.117:0/1988932837 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc75c06dcb0 0x7fc75c070160 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc774066000 tx=0x7fc764009e30 comp rx=0 tx=0).stop 2024-04-12T09:19:30.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:30.063+0000 7fc779409700 1 -- 172.21.15.117:0/1988932837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc774101d70 msgr2=0x7fc77410eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:19:30.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:30.063+0000 7fc779409700 1 --2- 172.21.15.117:0/1988932837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc774101d70 0x7fc77410eb40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc768002a50 tx=0x7fc7680046b0 comp rx=0 tx=0).stop 2024-04-12T09:19:30.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:30.063+0000 7fc779409700 1 -- 172.21.15.117:0/1988932837 shutdown_connections 2024-04-12T09:19:30.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:30.063+0000 7fc779409700 1 --2- 172.21.15.117:0/1988932837 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc75c06dcb0 0x7fc75c070160 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:30.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:30.063+0000 7fc779409700 1 --2- 172.21.15.117:0/1988932837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc774101d70 0x7fc77410eb40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:30.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:30.063+0000 7fc779409700 1 --2- 172.21.15.117:0/1988932837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc774102710 0x7fc77410f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:19:30.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:30.063+0000 7fc779409700 1 -- 172.21.15.117:0/1988932837 >> 172.21.15.117:0/1988932837 conn(0x7fc774072bc0 msgr2=0x7fc7740fb080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:19:30.064 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:30.063+0000 7fc779409700 1 -- 172.21.15.117:0/1988932837 shutdown_connections 2024-04-12T09:19:30.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:19:30.063+0000 7fc779409700 1 -- 172.21.15.117:0/1988932837 wait complete. 2024-04-12T09:19:30.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:29 smithi203 ceph-mon[86783]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:19:30.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:29 smithi203 ceph-mon[86783]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:19:30.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:29 smithi203 ceph-mon[86783]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:19:30.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:29 smithi203 ceph-mon[86783]: pgmap v130: 65 pgs: 65 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:30.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:29 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/218633749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:19:30.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:29 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-12T09:19:30.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:29 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/3443295655' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:19:30.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:30 smithi117 ceph-mon[113571]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-12T09:19:30.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:30 smithi117 ceph-mon[113571]: Upgrade: osd.4 is safe to restart 2024-04-12T09:19:30.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:30 smithi117 ceph-mon[113571]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:19:30.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:30 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/1988932837' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:19:31.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:30 smithi203 ceph-mon[86783]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-12T09:19:31.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:30 smithi203 ceph-mon[86783]: Upgrade: osd.4 is safe to restart 2024-04-12T09:19:31.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:30 smithi203 ceph-mon[86783]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:19:31.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:30 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/1988932837' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:19:32.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:31 smithi203 ceph-mon[86783]: pgmap v131: 65 pgs: 65 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:32.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:31 smithi203 ceph-mon[86783]: Upgrade: Updating osd.4 2024-04-12T09:19:32.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:31 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:32.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:31 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-12T09:19:32.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:31 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:19:32.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:31 smithi117 ceph-mon[113571]: pgmap v131: 65 pgs: 65 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:32.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:31 smithi117 ceph-mon[113571]: Upgrade: Updating osd.4 2024-04-12T09:19:32.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:31 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:32.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:31 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-12T09:19:32.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:31 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:19:33.018 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:32 smithi203 ceph-mon[86783]: Deploying daemon osd.4 on smithi203 2024-04-12T09:19:33.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:32 smithi117 ceph-mon[113571]: Deploying daemon osd.4 on smithi203 2024-04-12T09:19:34.032 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:33 smithi203 ceph-mon[86783]: pgmap v132: 65 pgs: 65 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:34.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:33 smithi117 ceph-mon[113571]: pgmap v132: 65 pgs: 65 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:34.303 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:34 smithi203 systemd[1]: Stopping Ceph osd.4 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:19:34.573 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:34 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4[48448]: 2024-04-12T09:19:34.301+0000 7febaf044700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T09:19:34.573 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:34 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4[48448]: 2024-04-12T09:19:34.301+0000 7febaf044700 -1 osd.4 69 *** Got signal Terminated *** 2024-04-12T09:19:34.573 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:34 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4[48448]: 2024-04-12T09:19:34.301+0000 7febaf044700 -1 osd.4 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T09:19:35.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:34 smithi117 ceph-mon[113571]: osd.4 marked itself down and dead 2024-04-12T09:19:35.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:34 smithi117 ceph-mon[113571]: pgmap v133: 65 pgs: 65 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:35.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:34 smithi203 ceph-mon[86783]: osd.4 marked itself down and dead 2024-04-12T09:19:35.294 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:34 smithi203 ceph-mon[86783]: pgmap v133: 65 pgs: 65 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:35.573 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:35 smithi203 podman[100563]: 2024-04-12 09:19:35.294088684 +0000 UTC m=+1.116390472 container died c873826a2dea5d7d43122ec964f6f52a9b4c375b5e078cd97bb5afe88b4c0d4f (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=quincy-d3b5060) 2024-04-12T09:19:35.837 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:35 smithi203 ceph-mon[86783]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-12T09:19:35.837 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:35 smithi203 podman[100563]: 2024-04-12 09:19:35.660611363 +0000 UTC m=+1.482913151 container cleanup c873826a2dea5d7d43122ec964f6f52a9b4c375b5e078cd97bb5afe88b4c0d4f (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=quincy-d3b5060, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T09:19:35.837 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:35 smithi203 bash[100563]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4 2024-04-12T09:19:35.837 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:35 smithi203 podman[100582]: 2024-04-12 09:19:35.803466379 +0000 UTC m=+0.512615645 container remove c873826a2dea5d7d43122ec964f6f52a9b4c375b5e078cd97bb5afe88b4c0d4f (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, ceph=True, RELEASE=quincy-d3b5060, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409) 2024-04-12T09:19:36.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:35 smithi117 ceph-mon[113571]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-12T09:19:36.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:35 smithi117 ceph-mon[113571]: osdmap e70: 6 total, 5 up, 6 in 2024-04-12T09:19:36.212 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:35 smithi203 ceph-mon[86783]: osdmap e70: 6 total, 5 up, 6 in 2024-04-12T09:19:36.534 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:36 smithi203 podman[100671]: 2024-04-12 09:19:36.212706805 +0000 UTC m=+0.105807028 container create 645b46a8976b930a3d2d6b6cfaa97d4deedfffe5251003b9a1d28b5900ba348c (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-b277feb, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-04-12T09:19:36.534 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:36 smithi203 podman[100671]: 2024-04-12 09:19:36.12468672 +0000 UTC m=+0.017786971 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:19:36.534 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:36 smithi203 podman[100671]: 2024-04-12 09:19:36.44234225 +0000 UTC m=+0.335442480 container init 645b46a8976b930a3d2d6b6cfaa97d4deedfffe5251003b9a1d28b5900ba348c (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-b277feb, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T09:19:36.534 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:36 smithi203 podman[100671]: 2024-04-12 09:19:36.445426334 +0000 UTC m=+0.338526566 container start 645b46a8976b930a3d2d6b6cfaa97d4deedfffe5251003b9a1d28b5900ba348c (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240409, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-b277feb, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-04-12T09:19:36.534 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:36 smithi203 podman[100671]: 2024-04-12 09:19:36.534064074 +0000 UTC m=+0.427164317 container attach 645b46a8976b930a3d2d6b6cfaa97d4deedfffe5251003b9a1d28b5900ba348c (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b277feb) 2024-04-12T09:19:36.824 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:36 smithi203 podman[100671]: 2024-04-12 09:19:36.73428473 +0000 UTC m=+0.627384971 container died 645b46a8976b930a3d2d6b6cfaa97d4deedfffe5251003b9a1d28b5900ba348c (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=squid-b277feb, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T09:19:37.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:36 smithi117 ceph-mon[113571]: osdmap e71: 6 total, 5 up, 6 in 2024-04-12T09:19:37.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:36 smithi117 ceph-mon[113571]: pgmap v136: 65 pgs: 13 peering, 4 stale+active+clean, 48 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:37.304 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:36 smithi203 ceph-mon[86783]: osdmap e71: 6 total, 5 up, 6 in 2024-04-12T09:19:37.305 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:36 smithi203 ceph-mon[86783]: pgmap v136: 65 pgs: 13 peering, 4 stale+active+clean, 48 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:37.573 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:37 smithi203 podman[100696]: 2024-04-12 09:19:37.304833838 +0000 UTC m=+0.565451460 container remove 645b46a8976b930a3d2d6b6cfaa97d4deedfffe5251003b9a1d28b5900ba348c (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-deactivate, ceph=True, RELEASE=squid-b277feb, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T09:19:37.574 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:37 smithi203 systemd[1]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.4.service: Deactivated successfully. 2024-04-12T09:19:37.574 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:37 smithi203 systemd[1]: Stopped Ceph osd.4 for 12161984-f8ab-11ee-bc8c-c7b262605968. 2024-04-12T09:19:37.574 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:37 smithi203 systemd[1]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.4.service: Consumed 1min 4.916s CPU time. 2024-04-12T09:19:37.574 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:37 smithi203 systemd[1]: Starting Ceph osd.4 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:19:38.025 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:37 smithi203 ceph-mon[86783]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-04-12T09:19:38.025 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:37 smithi203 podman[100804]: 2024-04-12 09:19:37.730790308 +0000 UTC m=+0.105081437 container create ff304168fdede35702740ea62e6d98a1b3182b6a9716fc02399b9a98a4f90dcf (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-activate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-b277feb, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240409) 2024-04-12T09:19:38.026 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:37 smithi203 podman[100804]: 2024-04-12 09:19:37.643463578 +0000 UTC m=+0.017754722 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:19:38.026 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:37 smithi203 podman[100804]: 2024-04-12 09:19:37.942189855 +0000 UTC m=+0.316480985 container init ff304168fdede35702740ea62e6d98a1b3182b6a9716fc02399b9a98a4f90dcf (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-activate, RELEASE=squid-b277feb, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-04-12T09:19:38.026 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:37 smithi203 podman[100804]: 2024-04-12 09:19:37.94535732 +0000 UTC m=+0.319648458 container start ff304168fdede35702740ea62e6d98a1b3182b6a9716fc02399b9a98a4f90dcf (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-activate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-b277feb, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-12T09:19:38.026 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:38 smithi203 podman[100804]: 2024-04-12 09:19:38.025576355 +0000 UTC m=+0.399867499 container attach ff304168fdede35702740ea62e6d98a1b3182b6a9716fc02399b9a98a4f90dcf (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-b277feb, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240409) 2024-04-12T09:19:38.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:37 smithi117 ceph-mon[113571]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-04-12T09:19:38.721 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:38 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-activate[100819]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-12T09:19:38.721 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:38 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-activate[100819]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-12T09:19:38.721 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:38 smithi203 bash[100804]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-12T09:19:38.721 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:38 smithi203 bash[100804]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-12T09:19:38.721 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:38 smithi203 bash[100804]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-12T09:19:38.721 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:38 smithi203 bash[100804]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-12T09:19:38.721 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:38 smithi203 bash[100804]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-12T09:19:38.721 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:38 smithi203 bash[100804]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-12T09:19:38.722 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:38 smithi203 bash[100804]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-12T09:19:38.722 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:38 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-activate[100819]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-12T09:19:38.722 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:38 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-activate[100819]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-12T09:19:38.722 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:38 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-activate[100819]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-12T09:19:38.722 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:38 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-activate[100819]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-12T09:19:38.722 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:38 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-activate[100819]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-12T09:19:38.722 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:38 smithi203 podman[100804]: 2024-04-12 09:19:38.416300493 +0000 UTC m=+0.790591615 container died ff304168fdede35702740ea62e6d98a1b3182b6a9716fc02399b9a98a4f90dcf (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-activate, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b277feb, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-12T09:19:39.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:38 smithi203 ceph-mon[86783]: pgmap v137: 65 pgs: 9 active+undersized+degraded, 13 peering, 12 active+undersized, 31 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27/225 objects degraded (12.000%) 2024-04-12T09:19:39.073 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:38 smithi203 podman[100953]: 2024-04-12 09:19:38.954674767 +0000 UTC m=+0.530208016 container remove ff304168fdede35702740ea62e6d98a1b3182b6a9716fc02399b9a98a4f90dcf (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-activate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b277feb) 2024-04-12T09:19:39.110 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:38 smithi117 ceph-mon[113571]: pgmap v137: 65 pgs: 9 active+undersized+degraded, 13 peering, 12 active+undersized, 31 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 27/225 objects degraded (12.000%) 2024-04-12T09:19:39.423 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:39 smithi203 podman[101017]: 2024-04-12 09:19:39.067789269 +0000 UTC m=+0.018020992 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:19:39.423 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:39 smithi203 podman[101017]: 2024-04-12 09:19:39.180722262 +0000 UTC m=+0.130953981 container create 7ec45de1eea6d8f6f5b766bc8bbc7eef9a9867fd551346815928c82a1efeb377 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, RELEASE=squid-b277feb, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-04-12T09:19:39.423 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:39 smithi203 podman[101017]: 2024-04-12 09:19:39.400078833 +0000 UTC m=+0.350310557 container init 7ec45de1eea6d8f6f5b766bc8bbc7eef9a9867fd551346815928c82a1efeb377 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b277feb, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-12T09:19:39.423 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:39 smithi203 podman[101017]: 2024-04-12 09:19:39.403178257 +0000 UTC m=+0.353409978 container start 7ec45de1eea6d8f6f5b766bc8bbc7eef9a9867fd551346815928c82a1efeb377 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-b277feb, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T09:19:39.423 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:39 smithi203 ceph-osd[101035]: -- 172.21.15.203:0/3887606113 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5649266fb680 con 0x5649266c4c00 2024-04-12T09:19:39.823 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:39 smithi203 bash[101017]: 7ec45de1eea6d8f6f5b766bc8bbc7eef9a9867fd551346815928c82a1efeb377 2024-04-12T09:19:39.823 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:39 smithi203 systemd[1]: Started Ceph osd.4 for 12161984-f8ab-11ee-bc8c-c7b262605968. 2024-04-12T09:19:40.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:39 smithi117 ceph-mon[113571]: Health check failed: Degraded data redundancy: 27/225 objects degraded (12.000%), 9 pgs degraded (PG_DEGRADED) 2024-04-12T09:19:40.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:40.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:40.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:19:40.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:40.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:19:40.323 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:39 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4[101031]: 2024-04-12T09:19:39.946+0000 7fb75750f7c0 -1 Falling back to public interface 2024-04-12T09:19:40.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:39 smithi203 ceph-mon[86783]: Health check failed: Degraded data redundancy: 27/225 objects degraded (12.000%), 9 pgs degraded (PG_DEGRADED) 2024-04-12T09:19:40.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:40.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:40.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:19:40.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:40.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:19:41.140 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:40 smithi203 ceph-mon[86783]: pgmap v138: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 40/225 objects degraded (17.778%) 2024-04-12T09:19:41.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:40 smithi117 ceph-mon[113571]: pgmap v138: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 40/225 objects degraded (17.778%) 2024-04-12T09:19:42.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:41 smithi117 ceph-mon[113571]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-12T09:19:42.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:41 smithi203 ceph-mon[86783]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-12T09:19:43.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:43 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:43.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:43 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:43.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:43 smithi203 ceph-mon[86783]: pgmap v139: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 40/225 objects degraded (17.778%) 2024-04-12T09:19:43.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:43 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:43.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:43 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:43.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:43 smithi117 ceph-mon[113571]: pgmap v139: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 40/225 objects degraded (17.778%) 2024-04-12T09:19:44.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:44 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:44.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:44 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:44.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:44 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:44.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:44 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:45.323 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:45 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4[101031]: 2024-04-12T09:19:45.066+0000 7fb75750f7c0 -1 osd.4 69 log_to_monitors true 2024-04-12T09:19:45.599 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:45 smithi203 ceph-mon[86783]: pgmap v140: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 40/225 objects degraded (17.778%) 2024-04-12T09:19:45.599 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:45 smithi203 ceph-mon[86783]: from='osd.4 [v2:172.21.15.203:6808/674159092,v1:172.21.15.203:6809/674159092]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-12T09:19:45.599 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:45 smithi203 ceph-mon[86783]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-12T09:19:45.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:45 smithi117 ceph-mon[113571]: pgmap v140: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 206 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 40/225 objects degraded (17.778%) 2024-04-12T09:19:45.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:45 smithi117 ceph-mon[113571]: from='osd.4 [v2:172.21.15.203:6808/674159092,v1:172.21.15.203:6809/674159092]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-12T09:19:45.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:45 smithi117 ceph-mon[113571]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-12T09:19:46.804 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:46 smithi203 ceph-mon[86783]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-12T09:19:46.804 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:46 smithi203 ceph-mon[86783]: from='osd.4 [v2:172.21.15.203:6808/674159092,v1:172.21.15.203:6809/674159092]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-04-12T09:19:46.804 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:46 smithi203 ceph-mon[86783]: osdmap e72: 6 total, 5 up, 6 in 2024-04-12T09:19:46.804 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:46 smithi203 ceph-mon[86783]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-04-12T09:19:46.804 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:46 smithi203 ceph-mon[86783]: Health check update: Degraded data redundancy: 40/225 objects degraded (17.778%), 15 pgs degraded (PG_DEGRADED) 2024-04-12T09:19:46.804 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:46 smithi203 ceph-mon[86783]: from='osd.4 ' entity='osd.4' 2024-04-12T09:19:46.804 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:19:46 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4[101031]: 2024-04-12T09:19:46.509+0000 7fb74495f700 -1 osd.4 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T09:19:46.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:46 smithi117 ceph-mon[113571]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-12T09:19:46.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:46 smithi117 ceph-mon[113571]: from='osd.4 [v2:172.21.15.203:6808/674159092,v1:172.21.15.203:6809/674159092]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-04-12T09:19:46.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:46 smithi117 ceph-mon[113571]: osdmap e72: 6 total, 5 up, 6 in 2024-04-12T09:19:46.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:46 smithi117 ceph-mon[113571]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-04-12T09:19:46.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:46 smithi117 ceph-mon[113571]: Health check update: Degraded data redundancy: 40/225 objects degraded (17.778%), 15 pgs degraded (PG_DEGRADED) 2024-04-12T09:19:46.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:46 smithi117 ceph-mon[113571]: from='osd.4 ' entity='osd.4' 2024-04-12T09:19:47.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:47 smithi117 ceph-mon[113571]: pgmap v142: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 40/225 objects degraded (17.778%) 2024-04-12T09:19:47.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:47.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:47.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:19:47.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:19:47.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:47.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:19:47.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:19:47.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:19:47.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:19:47.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-12T09:19:47.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:47 smithi117 ceph-mon[113571]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-12T09:19:47.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:47 smithi117 ceph-mon[113571]: osd.4 [v2:172.21.15.203:6808/674159092,v1:172.21.15.203:6809/674159092] boot 2024-04-12T09:19:47.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:47 smithi117 ceph-mon[113571]: osdmap e73: 6 total, 6 up, 6 in 2024-04-12T09:19:47.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T09:19:48.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:47 smithi203 ceph-mon[86783]: pgmap v142: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 40/225 objects degraded (17.778%) 2024-04-12T09:19:48.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:19:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:19:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:19:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:19:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:19:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:19:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-12T09:19:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:47 smithi203 ceph-mon[86783]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-12T09:19:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:47 smithi203 ceph-mon[86783]: osd.4 [v2:172.21.15.203:6808/674159092,v1:172.21.15.203:6809/674159092] boot 2024-04-12T09:19:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:47 smithi203 ceph-mon[86783]: osdmap e73: 6 total, 6 up, 6 in 2024-04-12T09:19:48.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-12T09:19:48.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:48 smithi203 ceph-mon[86783]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-12T09:19:48.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:48 smithi203 ceph-mon[86783]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-04-12T09:19:48.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:48 smithi203 ceph-mon[86783]: osdmap e74: 6 total, 6 up, 6 in 2024-04-12T09:19:48.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:48 smithi117 ceph-mon[113571]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-12T09:19:48.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:48 smithi117 ceph-mon[113571]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-04-12T09:19:48.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:48 smithi117 ceph-mon[113571]: osdmap e74: 6 total, 6 up, 6 in 2024-04-12T09:19:49.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:49 smithi117 ceph-mon[113571]: pgmap v145: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 40/225 objects degraded (17.778%) 2024-04-12T09:19:50.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:49 smithi203 ceph-mon[86783]: pgmap v145: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 40/225 objects degraded (17.778%) 2024-04-12T09:19:52.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:51 smithi203 ceph-mon[86783]: pgmap v146: 65 pgs: 10 active+undersized+degraded, 13 active+undersized, 42 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 29/225 objects degraded (12.889%) 2024-04-12T09:19:52.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:51 smithi203 ceph-mon[86783]: Health check update: Degraded data redundancy: 29/225 objects degraded (12.889%), 10 pgs degraded (PG_DEGRADED) 2024-04-12T09:19:52.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:51 smithi117 ceph-mon[113571]: pgmap v146: 65 pgs: 10 active+undersized+degraded, 13 active+undersized, 42 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 29/225 objects degraded (12.889%) 2024-04-12T09:19:52.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:51 smithi117 ceph-mon[113571]: Health check update: Degraded data redundancy: 29/225 objects degraded (12.889%), 10 pgs degraded (PG_DEGRADED) 2024-04-12T09:19:53.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:52 smithi203 ceph-mon[86783]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 29/225 objects degraded (12.889%), 10 pgs degraded) 2024-04-12T09:19:53.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:52 smithi203 ceph-mon[86783]: Cluster is now healthy 2024-04-12T09:19:53.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:52 smithi117 ceph-mon[113571]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 29/225 objects degraded (12.889%), 10 pgs degraded) 2024-04-12T09:19:53.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:52 smithi117 ceph-mon[113571]: Cluster is now healthy 2024-04-12T09:19:54.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:53 smithi203 ceph-mon[86783]: pgmap v147: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:54.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:53 smithi117 ceph-mon[113571]: pgmap v147: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:55.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:55 smithi117 ceph-mon[113571]: pgmap v148: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:55.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:55 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:55.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:55 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:19:56.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:55 smithi203 ceph-mon[86783]: pgmap v148: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:56.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:55 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:19:56.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:55 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:19:57.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:57 smithi117 ceph-mon[113571]: pgmap v149: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:19:57.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:57 smithi203 ceph-mon[86783]: pgmap v149: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:20:00.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:19:59 smithi203 ceph-mon[86783]: pgmap v150: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:20:00.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:19:59 smithi117 ceph-mon[113571]: pgmap v150: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:20:00.179 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.177+0000 7ffa35a64700 1 -- 172.21.15.117:0/3791587559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa301026c0 msgr2=0x7ffa300fbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:00.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.177+0000 7ffa35a64700 1 --2- 172.21.15.117:0/3791587559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa301026c0 0x7ffa300fbd30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffa24004940 tx=0x7ffa24009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:00.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.177+0000 7ffa35a64700 1 -- 172.21.15.117:0/3791587559 shutdown_connections 2024-04-12T09:20:00.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.177+0000 7ffa35a64700 1 --2- 172.21.15.117:0/3791587559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa301026c0 0x7ffa300fbd30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:00.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.177+0000 7ffa35a64700 1 --2- 172.21.15.117:0/3791587559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa30101d20 0x7ffa301020f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:00.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.177+0000 7ffa35a64700 1 -- 172.21.15.117:0/3791587559 >> 172.21.15.117:0/3791587559 conn(0x7ffa300f7870 msgr2=0x7ffa300f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:00.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.177+0000 7ffa35a64700 1 -- 172.21.15.117:0/3791587559 shutdown_connections 2024-04-12T09:20:00.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.177+0000 7ffa35a64700 1 -- 172.21.15.117:0/3791587559 wait complete. 2024-04-12T09:20:00.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.178+0000 7ffa35a64700 1 Processor -- start 2024-04-12T09:20:00.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.178+0000 7ffa35a64700 1 -- start start 2024-04-12T09:20:00.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.178+0000 7ffa35a64700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa30101d20 0x7ffa3010eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:00.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.178+0000 7ffa35a64700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa301026c0 0x7ffa3010f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:00.180 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.178+0000 7ffa35a64700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3010f560 con 0x7ffa30101d20 2024-04-12T09:20:00.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.178+0000 7ffa35a64700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3010f6a0 con 0x7ffa301026c0 2024-04-12T09:20:00.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.178+0000 7ffa2f7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa30101d20 0x7ffa3010eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:00.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.179+0000 7ffa2f7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa30101d20 0x7ffa3010eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:49694/0 (socket says 172.21.15.117:49694) 2024-04-12T09:20:00.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.179+0000 7ffa2f7fe700 1 -- 172.21.15.117:0/271556337 learned_addr learned my addr 172.21.15.117:0/271556337 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:20:00.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.179+0000 7ffa2effd700 1 --2- 172.21.15.117:0/271556337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa301026c0 0x7ffa3010f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:00.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.179+0000 7ffa2f7fe700 1 -- 172.21.15.117:0/271556337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa301026c0 msgr2=0x7ffa3010f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:00.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.179+0000 7ffa2f7fe700 1 --2- 172.21.15.117:0/271556337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa301026c0 0x7ffa3010f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:00.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.179+0000 7ffa2f7fe700 1 -- 172.21.15.117:0/271556337 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa24005040 con 0x7ffa30101d20 2024-04-12T09:20:00.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.179+0000 7ffa2effd700 1 --2- 172.21.15.117:0/271556337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa301026c0 0x7ffa3010f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T09:20:00.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.179+0000 7ffa2f7fe700 1 --2- 172.21.15.117:0/271556337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa30101d20 0x7ffa3010eae0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000b790 tx=0x7ffa20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:00.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.179+0000 7ffa17fff700 1 -- 172.21.15.117:0/271556337 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa2000f770 con 0x7ffa30101d20 2024-04-12T09:20:00.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.179+0000 7ffa35a64700 1 -- 172.21.15.117:0/271556337 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa30117b50 con 0x7ffa30101d20 2024-04-12T09:20:00.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.179+0000 7ffa17fff700 1 -- 172.21.15.117:0/271556337 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa2000fda0 con 0x7ffa30101d20 2024-04-12T09:20:00.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.179+0000 7ffa17fff700 1 -- 172.21.15.117:0/271556337 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa2000d310 con 0x7ffa30101d20 2024-04-12T09:20:00.181 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.179+0000 7ffa35a64700 1 -- 172.21.15.117:0/271556337 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa30117fd0 con 0x7ffa30101d20 2024-04-12T09:20:00.182 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.180+0000 7ffa35a64700 1 -- 172.21.15.117:0/271556337 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa300fd470 con 0x7ffa30101d20 2024-04-12T09:20:00.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.181+0000 7ffa17fff700 1 -- 172.21.15.117:0/271556337 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7ffa20010420 con 0x7ffa30101d20 2024-04-12T09:20:00.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.181+0000 7ffa17fff700 1 --2- 172.21.15.117:0/271556337 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ffa1806dca0 0x7ffa18070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:00.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.181+0000 7ffa17fff700 1 -- 172.21.15.117:0/271556337 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ffa2008d530 con 0x7ffa30101d20 2024-04-12T09:20:00.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.181+0000 7ffa2effd700 1 --2- 172.21.15.117:0/271556337 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ffa1806dca0 0x7ffa18070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:00.183 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.182+0000 7ffa2effd700 1 --2- 172.21.15.117:0/271556337 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ffa1806dca0 0x7ffa18070150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffa24009fd0 tx=0x7ffa24009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:00.186 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.186+0000 7ffa17fff700 1 -- 172.21.15.117:0/271556337 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ffa20056be0 con 0x7ffa30101d20 2024-04-12T09:20:00.397 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.396+0000 7ffa35a64700 1 -- 172.21.15.117:0/271556337 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa300f8fc0 con 0x7ffa1806dca0 2024-04-12T09:20:00.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.398+0000 7ffa17fff700 1 -- 172.21.15.117:0/271556337 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7ffa300f8fc0 con 0x7ffa1806dca0 2024-04-12T09:20:00.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.400+0000 7ffa35a64700 1 -- 172.21.15.117:0/271556337 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ffa1806dca0 msgr2=0x7ffa18070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:00.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.400+0000 7ffa35a64700 1 --2- 172.21.15.117:0/271556337 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ffa1806dca0 0x7ffa18070150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffa24009fd0 tx=0x7ffa24009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:00.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.400+0000 7ffa35a64700 1 -- 172.21.15.117:0/271556337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa30101d20 msgr2=0x7ffa3010eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:00.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.400+0000 7ffa35a64700 1 --2- 172.21.15.117:0/271556337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa30101d20 0x7ffa3010eae0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000b790 tx=0x7ffa20009250 comp rx=0 tx=0).stop 2024-04-12T09:20:00.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.400+0000 7ffa35a64700 1 -- 172.21.15.117:0/271556337 shutdown_connections 2024-04-12T09:20:00.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.400+0000 7ffa35a64700 1 --2- 172.21.15.117:0/271556337 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ffa1806dca0 0x7ffa18070150 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:00.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.400+0000 7ffa35a64700 1 --2- 172.21.15.117:0/271556337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa30101d20 0x7ffa3010eae0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:00.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.400+0000 7ffa35a64700 1 --2- 172.21.15.117:0/271556337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa301026c0 0x7ffa3010f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:00.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.400+0000 7ffa35a64700 1 -- 172.21.15.117:0/271556337 >> 172.21.15.117:0/271556337 conn(0x7ffa300f7870 msgr2=0x7ffa300f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:00.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.400+0000 7ffa35a64700 1 -- 172.21.15.117:0/271556337 shutdown_connections 2024-04-12T09:20:00.401 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.400+0000 7ffa35a64700 1 -- 172.21.15.117:0/271556337 wait complete. 2024-04-12T09:20:00.411 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:20:00.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.502+0000 7fdbc96d5700 1 -- 172.21.15.117:0/3070837786 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbc4102690 msgr2=0x7fdbc40fbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:00.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.502+0000 7fdbc96d5700 1 --2- 172.21.15.117:0/3070837786 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbc4102690 0x7fdbc40fbd00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8004940 tx=0x7fdbb8009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:00.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.502+0000 7fdbc96d5700 1 -- 172.21.15.117:0/3070837786 shutdown_connections 2024-04-12T09:20:00.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.502+0000 7fdbc96d5700 1 --2- 172.21.15.117:0/3070837786 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbc4102690 0x7fdbc40fbd00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:00.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.502+0000 7fdbc96d5700 1 --2- 172.21.15.117:0/3070837786 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdbc4101cf0 0x7fdbc41020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:00.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.502+0000 7fdbc96d5700 1 -- 172.21.15.117:0/3070837786 >> 172.21.15.117:0/3070837786 conn(0x7fdbc40f7860 msgr2=0x7fdbc40f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:00.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.502+0000 7fdbc96d5700 1 -- 172.21.15.117:0/3070837786 shutdown_connections 2024-04-12T09:20:00.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.502+0000 7fdbc96d5700 1 -- 172.21.15.117:0/3070837786 wait complete. 2024-04-12T09:20:00.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.503+0000 7fdbc96d5700 1 Processor -- start 2024-04-12T09:20:00.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.503+0000 7fdbc96d5700 1 -- start start 2024-04-12T09:20:00.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.503+0000 7fdbc96d5700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbc4101cf0 0x7fdbc40fd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:00.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.503+0000 7fdbc96d5700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdbc4102690 0x7fdbc40fdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:00.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.503+0000 7fdbc96d5700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40fe440 con 0x7fdbc4101cf0 2024-04-12T09:20:00.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.503+0000 7fdbc96d5700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40fe580 con 0x7fdbc4102690 2024-04-12T09:20:00.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.503+0000 7fdbc2ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbc4101cf0 0x7fdbc40fd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:00.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.503+0000 7fdbc2ffd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbc4101cf0 0x7fdbc40fd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:49712/0 (socket says 172.21.15.117:49712) 2024-04-12T09:20:00.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.503+0000 7fdbc2ffd700 1 -- 172.21.15.117:0/259282857 learned_addr learned my addr 172.21.15.117:0/259282857 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:20:00.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.504+0000 7fdbc27fc700 1 --2- 172.21.15.117:0/259282857 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdbc4102690 0x7fdbc40fdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:00.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.504+0000 7fdbc2ffd700 1 -- 172.21.15.117:0/259282857 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdbc4102690 msgr2=0x7fdbc40fdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:00.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.504+0000 7fdbc2ffd700 1 --2- 172.21.15.117:0/259282857 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdbc4102690 0x7fdbc40fdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:00.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.504+0000 7fdbc2ffd700 1 -- 172.21.15.117:0/259282857 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb8005040 con 0x7fdbc4101cf0 2024-04-12T09:20:00.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.504+0000 7fdbc2ffd700 1 --2- 172.21.15.117:0/259282857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbc4101cf0 0x7fdbc40fd970 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4002a50 tx=0x7fdbb40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:00.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.504+0000 7fdbab7fe700 1 -- 172.21.15.117:0/259282857 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbb4007cc0 con 0x7fdbc4101cf0 2024-04-12T09:20:00.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.504+0000 7fdbab7fe700 1 -- 172.21.15.117:0/259282857 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdbb400f040 con 0x7fdbc4101cf0 2024-04-12T09:20:00.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.504+0000 7fdbab7fe700 1 -- 172.21.15.117:0/259282857 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbb400da30 con 0x7fdbc4101cf0 2024-04-12T09:20:00.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.504+0000 7fdbc96d5700 1 -- 172.21.15.117:0/259282857 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc4119eb0 con 0x7fdbc4101cf0 2024-04-12T09:20:00.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.504+0000 7fdbc96d5700 1 -- 172.21.15.117:0/259282857 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc411a280 con 0x7fdbc4101cf0 2024-04-12T09:20:00.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.505+0000 7fdbc96d5700 1 -- 172.21.15.117:0/259282857 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc40fd440 con 0x7fdbc4101cf0 2024-04-12T09:20:00.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.506+0000 7fdbab7fe700 1 -- 172.21.15.117:0/259282857 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fdbb400db90 con 0x7fdbc4101cf0 2024-04-12T09:20:00.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.506+0000 7fdbab7fe700 1 --2- 172.21.15.117:0/259282857 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fdbac06dca0 0x7fdbac070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:00.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.506+0000 7fdbab7fe700 1 -- 172.21.15.117:0/259282857 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fdbb408d1a0 con 0x7fdbc4101cf0 2024-04-12T09:20:00.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.506+0000 7fdbc27fc700 1 --2- 172.21.15.117:0/259282857 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fdbac06dca0 0x7fdbac070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:00.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.507+0000 7fdbc27fc700 1 --2- 172.21.15.117:0/259282857 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fdbac06dca0 0x7fdbac070150 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8004890 tx=0x7fdbb8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:00.511 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.511+0000 7fdbab7fe700 1 -- 172.21.15.117:0/259282857 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fdbb40567d0 con 0x7fdbc4101cf0 2024-04-12T09:20:00.727 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.726+0000 7fdbc96d5700 1 -- 172.21.15.117:0/259282857 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbc404bed0 con 0x7fdbac06dca0 2024-04-12T09:20:00.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.727+0000 7fdbab7fe700 1 -- 172.21.15.117:0/259282857 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fdbc404bed0 con 0x7fdbac06dca0 2024-04-12T09:20:00.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.730+0000 7fdbc96d5700 1 -- 172.21.15.117:0/259282857 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fdbac06dca0 msgr2=0x7fdbac070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:00.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.730+0000 7fdbc96d5700 1 --2- 172.21.15.117:0/259282857 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fdbac06dca0 0x7fdbac070150 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8004890 tx=0x7fdbb8009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:00.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.730+0000 7fdbc96d5700 1 -- 172.21.15.117:0/259282857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbc4101cf0 msgr2=0x7fdbc40fd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:00.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.730+0000 7fdbc96d5700 1 --2- 172.21.15.117:0/259282857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbc4101cf0 0x7fdbc40fd970 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4002a50 tx=0x7fdbb40046b0 comp rx=0 tx=0).stop 2024-04-12T09:20:00.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.730+0000 7fdbc96d5700 1 -- 172.21.15.117:0/259282857 shutdown_connections 2024-04-12T09:20:00.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.730+0000 7fdbc96d5700 1 --2- 172.21.15.117:0/259282857 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fdbac06dca0 0x7fdbac070150 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:00.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.730+0000 7fdbc96d5700 1 --2- 172.21.15.117:0/259282857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbc4101cf0 0x7fdbc40fd970 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:00.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.730+0000 7fdbc96d5700 1 --2- 172.21.15.117:0/259282857 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdbc4102690 0x7fdbc40fdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:00.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.730+0000 7fdbc96d5700 1 -- 172.21.15.117:0/259282857 >> 172.21.15.117:0/259282857 conn(0x7fdbc40f7860 msgr2=0x7fdbc40f8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:00.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.730+0000 7fdbc96d5700 1 -- 172.21.15.117:0/259282857 shutdown_connections 2024-04-12T09:20:00.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.730+0000 7fdbc96d5700 1 -- 172.21.15.117:0/259282857 wait complete. 2024-04-12T09:20:00.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.831+0000 7fc6b17a3700 1 -- 172.21.15.117:0/4289332868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6ac0fe730 msgr2=0x7fc6ac106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:00.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.831+0000 7fc6b17a3700 1 --2- 172.21.15.117:0/4289332868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6ac0fe730 0x7fc6ac106e00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0004940 tx=0x7fc6a0009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:00.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.831+0000 7fc6b17a3700 1 -- 172.21.15.117:0/4289332868 shutdown_connections 2024-04-12T09:20:00.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.831+0000 7fc6b17a3700 1 --2- 172.21.15.117:0/4289332868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6ac0fe730 0x7fc6ac106e00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:00.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.831+0000 7fc6b17a3700 1 --2- 172.21.15.117:0/4289332868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6ac0fdd90 0x7fc6ac0fe160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:00.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.831+0000 7fc6b17a3700 1 -- 172.21.15.117:0/4289332868 >> 172.21.15.117:0/4289332868 conn(0x7fc6ac0f7850 msgr2=0x7fc6ac0f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:00.832 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.831+0000 7fc6b17a3700 1 -- 172.21.15.117:0/4289332868 shutdown_connections 2024-04-12T09:20:00.833 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:00 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:00.833 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:00 smithi117 ceph-mon[113571]: overall HEALTH_OK 2024-04-12T09:20:00.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.831+0000 7fc6b17a3700 1 -- 172.21.15.117:0/4289332868 wait complete. 2024-04-12T09:20:00.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.832+0000 7fc6b17a3700 1 Processor -- start 2024-04-12T09:20:00.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.832+0000 7fc6b17a3700 1 -- start start 2024-04-12T09:20:00.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.832+0000 7fc6b17a3700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6ac0fdd90 0x7fc6ac113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:00.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.832+0000 7fc6b17a3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6ac0fe730 0x7fc6ac114030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:00.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.832+0000 7fc6b17a3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac114680 con 0x7fc6ac0fe730 2024-04-12T09:20:00.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.832+0000 7fc6b17a3700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac10da70 con 0x7fc6ac0fdd90 2024-04-12T09:20:00.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.832+0000 7fc6aa7fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6ac0fe730 0x7fc6ac114030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:00.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.832+0000 7fc6aa7fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6ac0fe730 0x7fc6ac114030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:49722/0 (socket says 172.21.15.117:49722) 2024-04-12T09:20:00.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.832+0000 7fc6aa7fc700 1 -- 172.21.15.117:0/843544679 learned_addr learned my addr 172.21.15.117:0/843544679 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:20:00.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.832+0000 7fc6aaffd700 1 --2- 172.21.15.117:0/843544679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6ac0fdd90 0x7fc6ac113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:00.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.833+0000 7fc6aa7fc700 1 -- 172.21.15.117:0/843544679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6ac0fdd90 msgr2=0x7fc6ac113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:00.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.833+0000 7fc6aa7fc700 1 --2- 172.21.15.117:0/843544679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6ac0fdd90 0x7fc6ac113af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:00.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.833+0000 7fc6aa7fc700 1 -- 172.21.15.117:0/843544679 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a0005040 con 0x7fc6ac0fe730 2024-04-12T09:20:00.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.833+0000 7fc6aa7fc700 1 --2- 172.21.15.117:0/843544679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6ac0fe730 0x7fc6ac114030 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0000c00 tx=0x7fc6a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:00.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.833+0000 7fc6937fe700 1 -- 172.21.15.117:0/843544679 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6a0021070 con 0x7fc6ac0fe730 2024-04-12T09:20:00.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.833+0000 7fc6937fe700 1 -- 172.21.15.117:0/843544679 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc6a0013cd0 con 0x7fc6ac0fe730 2024-04-12T09:20:00.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.833+0000 7fc6b17a3700 1 -- 172.21.15.117:0/843544679 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ac10dcf0 con 0x7fc6ac0fe730 2024-04-12T09:20:00.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.833+0000 7fc6937fe700 1 -- 172.21.15.117:0/843544679 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6a000e070 con 0x7fc6ac0fe730 2024-04-12T09:20:00.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.833+0000 7fc6b17a3700 1 -- 172.21.15.117:0/843544679 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ac10e230 con 0x7fc6ac0fe730 2024-04-12T09:20:00.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.834+0000 7fc6b17a3700 1 -- 172.21.15.117:0/843544679 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ac0669f0 con 0x7fc6ac0fe730 2024-04-12T09:20:00.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.835+0000 7fc6937fe700 1 -- 172.21.15.117:0/843544679 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fc6a001c9d0 con 0x7fc6ac0fe730 2024-04-12T09:20:00.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.835+0000 7fc6937fe700 1 --2- 172.21.15.117:0/843544679 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc69406dca0 0x7fc694070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:00.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.835+0000 7fc6937fe700 1 -- 172.21.15.117:0/843544679 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc6a008e960 con 0x7fc6ac0fe730 2024-04-12T09:20:00.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.835+0000 7fc6aaffd700 1 --2- 172.21.15.117:0/843544679 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc69406dca0 0x7fc694070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:00.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.835+0000 7fc6aaffd700 1 --2- 172.21.15.117:0/843544679 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc69406dca0 0x7fc694070150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4004b50 tx=0x7fc6a400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:00.840 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:00.840+0000 7fc6937fe700 1 -- 172.21.15.117:0/843544679 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc6a005bb40 con 0x7fc6ac0fe730 2024-04-12T09:20:01.040 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.039+0000 7fc6b17a3700 1 -- 172.21.15.117:0/843544679 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6ac109e40 con 0x7fc69406dca0 2024-04-12T09:20:01.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.049+0000 7fc6937fe700 1 -- 172.21.15.117:0/843544679 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fc6ac109e40 con 0x7fc69406dca0 2024-04-12T09:20:01.049 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:20:01.050 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 running (5m) 85s ago 17m 27.1M - 0.25.0 c8568f914cd2 204687f21ed7 2024-04-12T09:20:01.050 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (3m) 85s ago 17m 6656k - 19.0.0-2053-gb277feb2 668895944f0e 038f567b664b 2024-04-12T09:20:01.050 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (3m) 18s ago 16m 6660k - 19.0.0-2053-gb277feb2 668895944f0e 420dee66e230 2024-04-12T09:20:01.050 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 running (5m) 85s ago 16m 79.6M - 9.4.12 2bacad6d85d8 a7b102216886 2024-04-12T09:20:01.050 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (11m) 85s ago 11m 140M - 17.2.7-827-gd3b5060a 21de9b7369ad de062e2c10e7 2024-04-12T09:20:01.050 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 running (11m) 85s ago 11m 14.7M - 17.2.7-827-gd3b5060a 21de9b7369ad 1e82c6241a18 2024-04-12T09:20:01.050 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (11m) 18s ago 11m 17.6M - 17.2.7-827-gd3b5060a 21de9b7369ad b05228e997f7 2024-04-12T09:20:01.050 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (11m) 18s ago 11m 17.8M - 17.2.7-827-gd3b5060a 21de9b7369ad 6d7f82c072c7 2024-04-12T09:20:01.050 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:8443,9283,8765 running (7m) 85s ago 18m 504M - 19.0.0-2053-gb277feb2 668895944f0e fee613d05ab7 2024-04-12T09:20:01.050 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283,8765 running (6m) 18s ago 16m 450M - 19.0.0-2053-gb277feb2 668895944f0e c793944c3e16 2024-04-12T09:20:01.050 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (4m) 85s ago 18m 48.0M 2048M 19.0.0-2053-gb277feb2 668895944f0e 6823aaff30ce 2024-04-12T09:20:01.051 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (3m) 18s ago 16m 39.6M 2048M 19.0.0-2053-gb277feb2 668895944f0e 006c6e487bfb 2024-04-12T09:20:01.051 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 running (6m) 85s ago 17m 16.2M - 1.5.0 0da6a335fe13 c692bed9f6c7 2024-04-12T09:20:01.051 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (6m) 18s ago 16m 15.5M - 1.5.0 0da6a335fe13 f3b5a470f545 2024-04-12T09:20:01.051 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (2m) 85s ago 15m 88.1M 1557M 19.0.0-2053-gb277feb2 668895944f0e 59a180461e3c 2024-04-12T09:20:01.051 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (2m) 85s ago 14m 95.0M 1557M 19.0.0-2053-gb277feb2 668895944f0e d40e2dfc164b 2024-04-12T09:20:01.051 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (90s) 85s ago 14m 12.5M 1557M 19.0.0-2053-gb277feb2 668895944f0e fd7d5481cddb 2024-04-12T09:20:01.051 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (55s) 18s ago 14m 114M 2581M 19.0.0-2053-gb277feb2 668895944f0e 961db53f9ab1 2024-04-12T09:20:01.051 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (21s) 18s ago 13m 11.9M 2581M 19.0.0-2053-gb277feb2 668895944f0e 7ec45de1eea6 2024-04-12T09:20:01.051 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (13m) 18s ago 13m 222M 2581M 17.2.7-827-gd3b5060a 21de9b7369ad 69cb7c22f002 2024-04-12T09:20:01.051 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 running (5m) 85s ago 16m 61.0M - 2.43.0 a07b618ecd1d 43ce588d82cc 2024-04-12T09:20:01.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.051+0000 7fc6b17a3700 1 -- 172.21.15.117:0/843544679 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc69406dca0 msgr2=0x7fc694070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:01.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.051+0000 7fc6b17a3700 1 --2- 172.21.15.117:0/843544679 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc69406dca0 0x7fc694070150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4004b50 tx=0x7fc6a400b040 comp rx=0 tx=0).stop 2024-04-12T09:20:01.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.051+0000 7fc6b17a3700 1 -- 172.21.15.117:0/843544679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6ac0fe730 msgr2=0x7fc6ac114030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:01.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.051+0000 7fc6b17a3700 1 --2- 172.21.15.117:0/843544679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6ac0fe730 0x7fc6ac114030 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0000c00 tx=0x7fc6a0009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:01.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.051+0000 7fc6b17a3700 1 -- 172.21.15.117:0/843544679 shutdown_connections 2024-04-12T09:20:01.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.051+0000 7fc6b17a3700 1 --2- 172.21.15.117:0/843544679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6ac0fdd90 0x7fc6ac113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:01.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.051+0000 7fc6b17a3700 1 --2- 172.21.15.117:0/843544679 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc69406dca0 0x7fc694070150 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:01.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.051+0000 7fc6b17a3700 1 --2- 172.21.15.117:0/843544679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6ac0fe730 0x7fc6ac114030 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:01.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.051+0000 7fc6b17a3700 1 -- 172.21.15.117:0/843544679 >> 172.21.15.117:0/843544679 conn(0x7fc6ac0f7850 msgr2=0x7fc6ac0f8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:01.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.051+0000 7fc6b17a3700 1 -- 172.21.15.117:0/843544679 shutdown_connections 2024-04-12T09:20:01.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.051+0000 7fc6b17a3700 1 -- 172.21.15.117:0/843544679 wait complete. 2024-04-12T09:20:01.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:00 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:01.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:00 smithi203 ceph-mon[86783]: overall HEALTH_OK 2024-04-12T09:20:01.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.151+0000 7f4dc4f13700 1 -- 172.21.15.117:0/1737255809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dc0102710 msgr2=0x7f4dc00fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:01.152 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.151+0000 7f4dc4f13700 1 --2- 172.21.15.117:0/1737255809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dc0102710 0x7f4dc00fbd80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4db4004940 tx=0x7f4db4009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:01.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.151+0000 7f4dc4f13700 1 -- 172.21.15.117:0/1737255809 shutdown_connections 2024-04-12T09:20:01.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.151+0000 7f4dc4f13700 1 --2- 172.21.15.117:0/1737255809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dc0102710 0x7f4dc00fbd80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:01.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.151+0000 7f4dc4f13700 1 --2- 172.21.15.117:0/1737255809 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4dc0101d70 0x7f4dc0102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:01.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.151+0000 7f4dc4f13700 1 -- 172.21.15.117:0/1737255809 >> 172.21.15.117:0/1737255809 conn(0x7f4dc0072bc0 msgr2=0x7f4dc0072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:01.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.151+0000 7f4dc4f13700 1 -- 172.21.15.117:0/1737255809 shutdown_connections 2024-04-12T09:20:01.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.151+0000 7f4dc4f13700 1 -- 172.21.15.117:0/1737255809 wait complete. 2024-04-12T09:20:01.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.152+0000 7f4dc4f13700 1 Processor -- start 2024-04-12T09:20:01.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.152+0000 7f4dc4f13700 1 -- start start 2024-04-12T09:20:01.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.152+0000 7f4dc4f13700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4dc0101d70 0x7f4dc0113ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:01.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.152+0000 7f4dc4f13700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dc0102710 0x7f4dc0114010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:01.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.152+0000 7f4dc4f13700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc0114660 con 0x7f4dc0102710 2024-04-12T09:20:01.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.152+0000 7f4dc4f13700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc010da50 con 0x7f4dc0101d70 2024-04-12T09:20:01.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.152+0000 7f4dbdd9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dc0102710 0x7f4dc0114010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:01.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.152+0000 7f4dbdd9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dc0102710 0x7f4dc0114010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:49740/0 (socket says 172.21.15.117:49740) 2024-04-12T09:20:01.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.152+0000 7f4dbdd9b700 1 -- 172.21.15.117:0/59747596 learned_addr learned my addr 172.21.15.117:0/59747596 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:20:01.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.152+0000 7f4dbe59c700 1 --2- 172.21.15.117:0/59747596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4dc0101d70 0x7f4dc0113ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:01.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.152+0000 7f4dbdd9b700 1 -- 172.21.15.117:0/59747596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4dc0101d70 msgr2=0x7f4dc0113ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:01.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.152+0000 7f4dbdd9b700 1 --2- 172.21.15.117:0/59747596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4dc0101d70 0x7f4dc0113ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:01.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.152+0000 7f4dbdd9b700 1 -- 172.21.15.117:0/59747596 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db4005040 con 0x7f4dc0102710 2024-04-12T09:20:01.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.152+0000 7f4dbdd9b700 1 --2- 172.21.15.117:0/59747596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dc0102710 0x7f4dc0114010 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009180 tx=0x7f4db4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:01.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.153+0000 7f4daeffd700 1 -- 172.21.15.117:0/59747596 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4db400e040 con 0x7f4dc0102710 2024-04-12T09:20:01.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.153+0000 7f4dc4f13700 1 -- 172.21.15.117:0/59747596 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc010dcd0 con 0x7f4dc0102710 2024-04-12T09:20:01.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.153+0000 7f4daeffd700 1 -- 172.21.15.117:0/59747596 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4db400bbc0 con 0x7f4dc0102710 2024-04-12T09:20:01.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.153+0000 7f4daeffd700 1 -- 172.21.15.117:0/59747596 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4db401c3f0 con 0x7f4dc0102710 2024-04-12T09:20:01.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.153+0000 7f4dc4f13700 1 -- 172.21.15.117:0/59747596 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc010e290 con 0x7f4dc0102710 2024-04-12T09:20:01.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.154+0000 7f4dc4f13700 1 -- 172.21.15.117:0/59747596 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc00fd4c0 con 0x7f4dc0102710 2024-04-12T09:20:01.155 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.154+0000 7f4daeffd700 1 -- 172.21.15.117:0/59747596 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f4db400bd30 con 0x7f4dc0102710 2024-04-12T09:20:01.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.155+0000 7f4daeffd700 1 --2- 172.21.15.117:0/59747596 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f4da806dca0 0x7f4da8070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:01.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.155+0000 7f4daeffd700 1 -- 172.21.15.117:0/59747596 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f4db408e800 con 0x7f4dc0102710 2024-04-12T09:20:01.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.155+0000 7f4dbe59c700 1 --2- 172.21.15.117:0/59747596 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f4da806dca0 0x7f4da8070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:01.156 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.155+0000 7f4dbe59c700 1 --2- 172.21.15.117:0/59747596 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f4da806dca0 0x7f4da8070150 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4db8004fd0 tx=0x7f4db800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:01.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.159+0000 7f4daeffd700 1 -- 172.21.15.117:0/59747596 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f4db405b9e0 con 0x7f4dc0102710 2024-04-12T09:20:01.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.436+0000 7f4dc4f13700 1 -- 172.21.15.117:0/59747596 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4dc0108e50 con 0x7f4dc0102710 2024-04-12T09:20:01.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.437+0000 7f4daeffd700 1 -- 172.21.15.117:0/59747596 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f4db405b570 con 0x7f4dc0102710 2024-04-12T09:20:01.437 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:20:01.438 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": { 2024-04-12T09:20:01.438 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:20:01.438 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:20:01.438 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": { 2024-04-12T09:20:01.438 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:20:01.438 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:20:01.438 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": { 2024-04-12T09:20:01.438 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 1, 2024-04-12T09:20:01.438 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 5 2024-04-12T09:20:01.438 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:20:01.438 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-04-12T09:20:01.438 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 4 2024-04-12T09:20:01.438 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:20:01.439 INFO:teuthology.orchestra.run.smithi117.stdout: "overall": { 2024-04-12T09:20:01.439 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 5, 2024-04-12T09:20:01.439 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 9 2024-04-12T09:20:01.439 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:20:01.439 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:20:01.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.439+0000 7f4dc4f13700 1 -- 172.21.15.117:0/59747596 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f4da806dca0 msgr2=0x7f4da8070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:01.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.439+0000 7f4dc4f13700 1 --2- 172.21.15.117:0/59747596 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f4da806dca0 0x7f4da8070150 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4db8004fd0 tx=0x7f4db800b040 comp rx=0 tx=0).stop 2024-04-12T09:20:01.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.439+0000 7f4dc4f13700 1 -- 172.21.15.117:0/59747596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dc0102710 msgr2=0x7f4dc0114010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:01.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.439+0000 7f4dc4f13700 1 --2- 172.21.15.117:0/59747596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dc0102710 0x7f4dc0114010 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009180 tx=0x7f4db4009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:01.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.439+0000 7f4dc4f13700 1 -- 172.21.15.117:0/59747596 shutdown_connections 2024-04-12T09:20:01.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.439+0000 7f4dc4f13700 1 --2- 172.21.15.117:0/59747596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4dc0101d70 0x7f4dc0113ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:01.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.439+0000 7f4dc4f13700 1 --2- 172.21.15.117:0/59747596 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f4da806dca0 0x7f4da8070150 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:01.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.439+0000 7f4dc4f13700 1 --2- 172.21.15.117:0/59747596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4dc0102710 0x7f4dc0114010 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:01.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.439+0000 7f4dc4f13700 1 -- 172.21.15.117:0/59747596 >> 172.21.15.117:0/59747596 conn(0x7f4dc0072bc0 msgr2=0x7f4dc00658e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:01.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.439+0000 7f4dc4f13700 1 -- 172.21.15.117:0/59747596 shutdown_connections 2024-04-12T09:20:01.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.439+0000 7f4dc4f13700 1 -- 172.21.15.117:0/59747596 wait complete. 2024-04-12T09:20:01.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.540+0000 7fe1b1b7f700 1 -- 172.21.15.117:0/3264170335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1ac102de0 msgr2=0x7fe1ac1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:01.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.540+0000 7fe1b1b7f700 1 --2- 172.21.15.117:0/3264170335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1ac102de0 0x7fe1ac1031b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe19c004940 tx=0x7fe19c009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:01.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.540+0000 7fe1b1b7f700 1 -- 172.21.15.117:0/3264170335 shutdown_connections 2024-04-12T09:20:01.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.540+0000 7fe1b1b7f700 1 --2- 172.21.15.117:0/3264170335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1ac103780 0x7fe1ac0fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:01.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.540+0000 7fe1b1b7f700 1 --2- 172.21.15.117:0/3264170335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1ac102de0 0x7fe1ac1031b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:01.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.540+0000 7fe1b1b7f700 1 -- 172.21.15.117:0/3264170335 >> 172.21.15.117:0/3264170335 conn(0x7fe1ac0f8950 msgr2=0x7fe1ac0fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:01.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.540+0000 7fe1b1b7f700 1 -- 172.21.15.117:0/3264170335 shutdown_connections 2024-04-12T09:20:01.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.540+0000 7fe1b1b7f700 1 -- 172.21.15.117:0/3264170335 wait complete. 2024-04-12T09:20:01.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.540+0000 7fe1b1b7f700 1 Processor -- start 2024-04-12T09:20:01.541 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.540+0000 7fe1b1b7f700 1 -- start start 2024-04-12T09:20:01.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.541+0000 7fe1b1b7f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1ac102de0 0x7fe1ac113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:01.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.541+0000 7fe1b1b7f700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1ac103780 0x7fe1ac113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:01.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.541+0000 7fe1b1b7f700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac114510 con 0x7fe1ac102de0 2024-04-12T09:20:01.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.541+0000 7fe1b1b7f700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac10db10 con 0x7fe1ac103780 2024-04-12T09:20:01.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.541+0000 7fe1ab7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1ac102de0 0x7fe1ac113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:01.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.541+0000 7fe1ab7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1ac102de0 0x7fe1ac113980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:49752/0 (socket says 172.21.15.117:49752) 2024-04-12T09:20:01.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.541+0000 7fe1ab7fe700 1 -- 172.21.15.117:0/1261559443 learned_addr learned my addr 172.21.15.117:0/1261559443 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:20:01.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.541+0000 7fe1aaffd700 1 --2- 172.21.15.117:0/1261559443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1ac103780 0x7fe1ac113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:01.543 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.541+0000 7fe1ab7fe700 1 -- 172.21.15.117:0/1261559443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1ac103780 msgr2=0x7fe1ac113ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:01.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.541+0000 7fe1ab7fe700 1 --2- 172.21.15.117:0/1261559443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1ac103780 0x7fe1ac113ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:01.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.541+0000 7fe1ab7fe700 1 -- 172.21.15.117:0/1261559443 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19c005040 con 0x7fe1ac102de0 2024-04-12T09:20:01.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.541+0000 7fe1ab7fe700 1 --2- 172.21.15.117:0/1261559443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1ac102de0 0x7fe1ac113980 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe19c00b3b0 tx=0x7fe19c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:01.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.541+0000 7fe193fff700 1 -- 172.21.15.117:0/1261559443 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe19c00e040 con 0x7fe1ac102de0 2024-04-12T09:20:01.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.541+0000 7fe193fff700 1 -- 172.21.15.117:0/1261559443 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe19c00bbc0 con 0x7fe1ac102de0 2024-04-12T09:20:01.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.541+0000 7fe193fff700 1 -- 172.21.15.117:0/1261559443 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe19c01c3f0 con 0x7fe1ac102de0 2024-04-12T09:20:01.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.541+0000 7fe1b1b7f700 1 -- 172.21.15.117:0/1261559443 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ac10dd90 con 0x7fe1ac102de0 2024-04-12T09:20:01.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.542+0000 7fe1b1b7f700 1 -- 172.21.15.117:0/1261559443 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ac10e350 con 0x7fe1ac102de0 2024-04-12T09:20:01.544 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.542+0000 7fe1b1b7f700 1 -- 172.21.15.117:0/1261559443 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ac1000f0 con 0x7fe1ac102de0 2024-04-12T09:20:01.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.543+0000 7fe193fff700 1 -- 172.21.15.117:0/1261559443 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fe19c00bd30 con 0x7fe1ac102de0 2024-04-12T09:20:01.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.543+0000 7fe193fff700 1 --2- 172.21.15.117:0/1261559443 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe19406dca0 0x7fe194070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:01.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.543+0000 7fe193fff700 1 -- 172.21.15.117:0/1261559443 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe19c08e680 con 0x7fe1ac102de0 2024-04-12T09:20:01.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.543+0000 7fe1aaffd700 1 --2- 172.21.15.117:0/1261559443 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe19406dca0 0x7fe194070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:01.545 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.544+0000 7fe1aaffd700 1 --2- 172.21.15.117:0/1261559443 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe19406dca0 0x7fe194070150 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac10ecd0 tx=0x7fe1a0009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:01.548 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.548+0000 7fe193fff700 1 -- 172.21.15.117:0/1261559443 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fe19c05b860 con 0x7fe1ac102de0 2024-04-12T09:20:01.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.787+0000 7fe1b1b7f700 1 -- 172.21.15.117:0/1261559443 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe1ac10efd0 con 0x7fe1ac102de0 2024-04-12T09:20:01.788 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:01 smithi117 ceph-mon[113571]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:20:01.788 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:01 smithi117 ceph-mon[113571]: pgmap v151: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:20:01.788 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:01 smithi117 ceph-mon[113571]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:20:01.788 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:01 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/59747596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:20:01.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.788+0000 7fe193fff700 1 -- 172.21.15.117:0/1261559443 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1884 (secure 0 0 0) 0x7fe19c05b3f0 con 0x7fe1ac102de0 2024-04-12T09:20:01.789 INFO:teuthology.orchestra.run.smithi117.stdout:e14 2024-04-12T09:20:01.789 INFO:teuthology.orchestra.run.smithi117.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T09:20:01.789 INFO:teuthology.orchestra.run.smithi117.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:20:01.789 INFO:teuthology.orchestra.run.smithi117.stdout:legacy client fscid: 1 2024-04-12T09:20:01.789 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:20:01.789 INFO:teuthology.orchestra.run.smithi117.stdout:Filesystem 'cephfs' (1) 2024-04-12T09:20:01.789 INFO:teuthology.orchestra.run.smithi117.stdout:fs_name cephfs 2024-04-12T09:20:01.789 INFO:teuthology.orchestra.run.smithi117.stdout:epoch 14 2024-04-12T09:20:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T09:20:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:created 2024-04-12T09:08:12.488144+0000 2024-04-12T09:20:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:modified 2024-04-12T09:08:30.563184+0000 2024-04-12T09:20:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:tableserver 0 2024-04-12T09:20:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:root 0 2024-04-12T09:20:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:session_timeout 60 2024-04-12T09:20:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:session_autoclose 300 2024-04-12T09:20:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:max_file_size 1099511627776 2024-04-12T09:20:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:max_xattr_size 65536 2024-04-12T09:20:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:required_client_features {} 2024-04-12T09:20:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure 0 2024-04-12T09:20:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure_osd_epoch 46 2024-04-12T09:20:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:20:01.790 INFO:teuthology.orchestra.run.smithi117.stdout:max_mds 1 2024-04-12T09:20:01.791 INFO:teuthology.orchestra.run.smithi117.stdout:in 0 2024-04-12T09:20:01.791 INFO:teuthology.orchestra.run.smithi117.stdout:up {0=14474} 2024-04-12T09:20:01.791 INFO:teuthology.orchestra.run.smithi117.stdout:failed 2024-04-12T09:20:01.791 INFO:teuthology.orchestra.run.smithi117.stdout:damaged 2024-04-12T09:20:01.791 INFO:teuthology.orchestra.run.smithi117.stdout:stopped 2024-04-12T09:20:01.791 INFO:teuthology.orchestra.run.smithi117.stdout:data_pools [3] 2024-04-12T09:20:01.791 INFO:teuthology.orchestra.run.smithi117.stdout:metadata_pool 2 2024-04-12T09:20:01.791 INFO:teuthology.orchestra.run.smithi117.stdout:inline_data disabled 2024-04-12T09:20:01.791 INFO:teuthology.orchestra.run.smithi117.stdout:balancer 2024-04-12T09:20:01.791 INFO:teuthology.orchestra.run.smithi117.stdout:bal_rank_mask -1 2024-04-12T09:20:01.791 INFO:teuthology.orchestra.run.smithi117.stdout:standby_count_wanted 1 2024-04-12T09:20:01.791 INFO:teuthology.orchestra.run.smithi117.stdout:qdb_cluster leader: 0 members: 2024-04-12T09:20:01.791 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.eslmxh{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.117:6828/2248590199,v1:172.21.15.117:6829/2248590199] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:20:01.791 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:20:01.792 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:20:01.792 INFO:teuthology.orchestra.run.smithi117.stdout:Standby daemons: 2024-04-12T09:20:01.792 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:20:01.792 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.wddsgt{-1:14484} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/4010127141,v1:172.21.15.117:6827/4010127141] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:20:01.792 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.fbeixl{-1:24265} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.203:6824/840607003,v1:172.21.15.203:6825/840607003] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:20:01.792 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.bszhxz{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/2731911290,v1:172.21.15.203:6827/2731911290] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:20:01.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.790+0000 7fe1b1b7f700 1 -- 172.21.15.117:0/1261559443 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe19406dca0 msgr2=0x7fe194070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:01.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.790+0000 7fe1b1b7f700 1 --2- 172.21.15.117:0/1261559443 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe19406dca0 0x7fe194070150 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac10ecd0 tx=0x7fe1a0009ee0 comp rx=0 tx=0).stop 2024-04-12T09:20:01.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.790+0000 7fe1b1b7f700 1 -- 172.21.15.117:0/1261559443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1ac102de0 msgr2=0x7fe1ac113980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:01.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.790+0000 7fe1b1b7f700 1 --2- 172.21.15.117:0/1261559443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1ac102de0 0x7fe1ac113980 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe19c00b3b0 tx=0x7fe19c009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:01.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.790+0000 7fe1b1b7f700 1 -- 172.21.15.117:0/1261559443 shutdown_connections 2024-04-12T09:20:01.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.790+0000 7fe1b1b7f700 1 --2- 172.21.15.117:0/1261559443 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe19406dca0 0x7fe194070150 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:01.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.790+0000 7fe1b1b7f700 1 --2- 172.21.15.117:0/1261559443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1ac102de0 0x7fe1ac113980 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:01.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.790+0000 7fe1b1b7f700 1 --2- 172.21.15.117:0/1261559443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1ac103780 0x7fe1ac113ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:01.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.790+0000 7fe1b1b7f700 1 -- 172.21.15.117:0/1261559443 >> 172.21.15.117:0/1261559443 conn(0x7fe1ac0f8950 msgr2=0x7fe1ac107350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:01.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.790+0000 7fe1b1b7f700 1 -- 172.21.15.117:0/1261559443 shutdown_connections 2024-04-12T09:20:01.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.791+0000 7fe1b1b7f700 1 -- 172.21.15.117:0/1261559443 wait complete. 2024-04-12T09:20:01.794 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 14 2024-04-12T09:20:01.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.892+0000 7f210c7d8700 1 -- 172.21.15.117:0/1196986412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2104102f50 msgr2=0x7f2104103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:01.895 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.892+0000 7f210c7d8700 1 --2- 172.21.15.117:0/1196986412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2104102f50 0x7f2104103320 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2100004940 tx=0x7f2100009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:01.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.893+0000 7f210c7d8700 1 -- 172.21.15.117:0/1196986412 shutdown_connections 2024-04-12T09:20:01.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.893+0000 7f210c7d8700 1 --2- 172.21.15.117:0/1196986412 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21040fb4d0 0x7f21040fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:01.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.893+0000 7f210c7d8700 1 --2- 172.21.15.117:0/1196986412 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2104102f50 0x7f2104103320 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:01.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.893+0000 7f210c7d8700 1 -- 172.21.15.117:0/1196986412 >> 172.21.15.117:0/1196986412 conn(0x7f21040714c0 msgr2=0x7f21040718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:01.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.893+0000 7f210c7d8700 1 -- 172.21.15.117:0/1196986412 shutdown_connections 2024-04-12T09:20:01.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.893+0000 7f210c7d8700 1 -- 172.21.15.117:0/1196986412 wait complete. 2024-04-12T09:20:01.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.893+0000 7f210c7d8700 1 Processor -- start 2024-04-12T09:20:01.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.893+0000 7f210c7d8700 1 -- start start 2024-04-12T09:20:01.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.893+0000 7f210c7d8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21040fb4d0 0x7f21040fc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:01.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.893+0000 7f210c7d8700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2104102f50 0x7f21040fcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:01.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.893+0000 7f210c7d8700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21040fe640 con 0x7f21040fb4d0 2024-04-12T09:20:01.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.893+0000 7f210c7d8700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21040fd130 con 0x7f2104102f50 2024-04-12T09:20:01.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.893+0000 7f210a574700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21040fb4d0 0x7f21040fc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:01.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.893+0000 7f210a574700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21040fb4d0 0x7f21040fc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:49776/0 (socket says 172.21.15.117:49776) 2024-04-12T09:20:01.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.893+0000 7f210a574700 1 -- 172.21.15.117:0/4179612140 learned_addr learned my addr 172.21.15.117:0/4179612140 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:20:01.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.894+0000 7f2109d73700 1 --2- 172.21.15.117:0/4179612140 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2104102f50 0x7f21040fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:01.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.894+0000 7f210a574700 1 -- 172.21.15.117:0/4179612140 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2104102f50 msgr2=0x7f21040fcbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:01.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.894+0000 7f210a574700 1 --2- 172.21.15.117:0/4179612140 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2104102f50 0x7f21040fcbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:01.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.894+0000 7f210a574700 1 -- 172.21.15.117:0/4179612140 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2100005040 con 0x7f21040fb4d0 2024-04-12T09:20:01.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.894+0000 7f2109d73700 1 --2- 172.21.15.117:0/4179612140 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2104102f50 0x7f21040fcbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T09:20:01.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.894+0000 7f210a574700 1 --2- 172.21.15.117:0/4179612140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21040fb4d0 0x7f21040fc6b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2100009100 tx=0x7f2100009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:01.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.894+0000 7f20faffd700 1 -- 172.21.15.117:0/4179612140 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f210000e040 con 0x7f21040fb4d0 2024-04-12T09:20:01.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.894+0000 7f20faffd700 1 -- 172.21.15.117:0/4179612140 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2100013420 con 0x7f21040fb4d0 2024-04-12T09:20:01.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.894+0000 7f20faffd700 1 -- 172.21.15.117:0/4179612140 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f210001c630 con 0x7f21040fb4d0 2024-04-12T09:20:01.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.894+0000 7f210c7d8700 1 -- 172.21.15.117:0/4179612140 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21040fd3b0 con 0x7f21040fb4d0 2024-04-12T09:20:01.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.894+0000 7f210c7d8700 1 -- 172.21.15.117:0/4179612140 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f210411a1c0 con 0x7f21040fb4d0 2024-04-12T09:20:01.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.895+0000 7f210c7d8700 1 -- 172.21.15.117:0/4179612140 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2104100200 con 0x7f21040fb4d0 2024-04-12T09:20:01.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.896+0000 7f20faffd700 1 -- 172.21.15.117:0/4179612140 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f2100013590 con 0x7f21040fb4d0 2024-04-12T09:20:01.900 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.896+0000 7f20faffd700 1 --2- 172.21.15.117:0/4179612140 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f20f006dca0 0x7f20f0070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:01.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.896+0000 7f20faffd700 1 -- 172.21.15.117:0/4179612140 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f210008e6f0 con 0x7f21040fb4d0 2024-04-12T09:20:01.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.896+0000 7f2109d73700 1 --2- 172.21.15.117:0/4179612140 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f20f006dca0 0x7f20f0070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:01.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.896+0000 7f2109d73700 1 --2- 172.21.15.117:0/4179612140 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f20f006dca0 0x7f20f0070150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f20f4006fd0 tx=0x7f20f4008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:01.901 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:01.901+0000 7f20faffd700 1 -- 172.21.15.117:0/4179612140 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f2100057da0 con 0x7f21040fb4d0 2024-04-12T09:20:02.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:01 smithi203 ceph-mon[86783]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:20:02.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:01 smithi203 ceph-mon[86783]: pgmap v151: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:20:02.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:01 smithi203 ceph-mon[86783]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:20:02.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:01 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/59747596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:20:02.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.112+0000 7f210c7d8700 1 -- 172.21.15.117:0/4179612140 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f21040fe780 con 0x7f20f006dca0 2024-04-12T09:20:02.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.113+0000 7f20faffd700 1 -- 172.21.15.117:0/4179612140 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f21040fe780 con 0x7f20f006dca0 2024-04-12T09:20:02.114 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:20:02.114 INFO:teuthology.orchestra.run.smithi117.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec", 2024-04-12T09:20:02.114 INFO:teuthology.orchestra.run.smithi117.stdout: "in_progress": true, 2024-04-12T09:20:02.114 INFO:teuthology.orchestra.run.smithi117.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T09:20:02.115 INFO:teuthology.orchestra.run.smithi117.stdout: "services_complete": [ 2024-04-12T09:20:02.115 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr", 2024-04-12T09:20:02.115 INFO:teuthology.orchestra.run.smithi117.stdout: "mon", 2024-04-12T09:20:02.115 INFO:teuthology.orchestra.run.smithi117.stdout: "crash" 2024-04-12T09:20:02.115 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2024-04-12T09:20:02.115 INFO:teuthology.orchestra.run.smithi117.stdout: "progress": "11/21 daemons upgraded", 2024-04-12T09:20:02.115 INFO:teuthology.orchestra.run.smithi117.stdout: "message": "Currently upgrading osd daemons", 2024-04-12T09:20:02.115 INFO:teuthology.orchestra.run.smithi117.stdout: "is_paused": false 2024-04-12T09:20:02.115 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:20:02.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.115+0000 7f210c7d8700 1 -- 172.21.15.117:0/4179612140 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f20f006dca0 msgr2=0x7f20f0070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:02.116 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.115+0000 7f210c7d8700 1 --2- 172.21.15.117:0/4179612140 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f20f006dca0 0x7f20f0070150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f20f4006fd0 tx=0x7f20f4008040 comp rx=0 tx=0).stop 2024-04-12T09:20:02.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.115+0000 7f210c7d8700 1 -- 172.21.15.117:0/4179612140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21040fb4d0 msgr2=0x7f21040fc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:02.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.115+0000 7f210c7d8700 1 --2- 172.21.15.117:0/4179612140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21040fb4d0 0x7f21040fc6b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2100009100 tx=0x7f2100009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:02.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.116+0000 7f210c7d8700 1 -- 172.21.15.117:0/4179612140 shutdown_connections 2024-04-12T09:20:02.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.116+0000 7f210c7d8700 1 --2- 172.21.15.117:0/4179612140 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f20f006dca0 0x7f20f0070150 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:02.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.116+0000 7f210c7d8700 1 --2- 172.21.15.117:0/4179612140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21040fb4d0 0x7f21040fc6b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:02.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.116+0000 7f210c7d8700 1 --2- 172.21.15.117:0/4179612140 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2104102f50 0x7f21040fcbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:02.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.116+0000 7f210c7d8700 1 -- 172.21.15.117:0/4179612140 >> 172.21.15.117:0/4179612140 conn(0x7f21040714c0 msgr2=0x7f21040fa710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:02.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.116+0000 7f210c7d8700 1 -- 172.21.15.117:0/4179612140 shutdown_connections 2024-04-12T09:20:02.117 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.116+0000 7f210c7d8700 1 -- 172.21.15.117:0/4179612140 wait complete. 2024-04-12T09:20:02.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.215+0000 7fe763f76700 1 -- 172.21.15.117:0/747852897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe75c0fc5b0 msgr2=0x7fe75c100bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:02.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.215+0000 7fe763f76700 1 --2- 172.21.15.117:0/747852897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe75c0fc5b0 0x7fe75c100bd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe74c004940 tx=0x7fe74c009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:02.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.215+0000 7fe763f76700 1 -- 172.21.15.117:0/747852897 shutdown_connections 2024-04-12T09:20:02.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.215+0000 7fe763f76700 1 --2- 172.21.15.117:0/747852897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe75c0fc5b0 0x7fe75c100bd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:02.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.215+0000 7fe763f76700 1 --2- 172.21.15.117:0/747852897 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe75c0fbc10 0x7fe75c0fbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:02.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.215+0000 7fe763f76700 1 -- 172.21.15.117:0/747852897 >> 172.21.15.117:0/747852897 conn(0x7fe75c0f7870 msgr2=0x7fe75c0f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:02.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.215+0000 7fe763f76700 1 -- 172.21.15.117:0/747852897 shutdown_connections 2024-04-12T09:20:02.217 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.215+0000 7fe763f76700 1 -- 172.21.15.117:0/747852897 wait complete. 2024-04-12T09:20:02.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.215+0000 7fe763f76700 1 Processor -- start 2024-04-12T09:20:02.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.215+0000 7fe763f76700 1 -- start start 2024-04-12T09:20:02.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.216+0000 7fe763f76700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe75c0fbc10 0x7fe75c11a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:02.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.216+0000 7fe763f76700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe75c0fc5b0 0x7fe75c11a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:02.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.216+0000 7fe763f76700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c11ac70 con 0x7fe75c0fc5b0 2024-04-12T09:20:02.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.216+0000 7fe763f76700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c114250 con 0x7fe75c0fbc10 2024-04-12T09:20:02.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.216+0000 7fe761511700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe75c0fc5b0 0x7fe75c11a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:02.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.216+0000 7fe761511700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe75c0fc5b0 0x7fe75c11a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:49784/0 (socket says 172.21.15.117:49784) 2024-04-12T09:20:02.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.216+0000 7fe761511700 1 -- 172.21.15.117:0/3609841327 learned_addr learned my addr 172.21.15.117:0/3609841327 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:20:02.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.216+0000 7fe761511700 1 -- 172.21.15.117:0/3609841327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe75c0fbc10 msgr2=0x7fe75c11a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:02.218 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.216+0000 7fe761511700 1 --2- 172.21.15.117:0/3609841327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe75c0fbc10 0x7fe75c11a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:02.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.216+0000 7fe761511700 1 -- 172.21.15.117:0/3609841327 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c005040 con 0x7fe75c0fc5b0 2024-04-12T09:20:02.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.216+0000 7fe761511700 1 --2- 172.21.15.117:0/3609841327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe75c0fc5b0 0x7fe75c11a620 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00b3b0 tx=0x7fe74c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:02.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.216+0000 7fe7527fc700 1 -- 172.21.15.117:0/3609841327 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe74c00e040 con 0x7fe75c0fc5b0 2024-04-12T09:20:02.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.216+0000 7fe763f76700 1 -- 172.21.15.117:0/3609841327 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75c1144d0 con 0x7fe75c0fc5b0 2024-04-12T09:20:02.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.216+0000 7fe7527fc700 1 -- 172.21.15.117:0/3609841327 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe74c00bbc0 con 0x7fe75c0fc5b0 2024-04-12T09:20:02.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.216+0000 7fe7527fc700 1 -- 172.21.15.117:0/3609841327 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe74c01c3f0 con 0x7fe75c0fc5b0 2024-04-12T09:20:02.219 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.216+0000 7fe763f76700 1 -- 172.21.15.117:0/3609841327 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75c114a10 con 0x7fe75c0fc5b0 2024-04-12T09:20:02.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.217+0000 7fe763f76700 1 -- 172.21.15.117:0/3609841327 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75c066b50 con 0x7fe75c0fc5b0 2024-04-12T09:20:02.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.218+0000 7fe7527fc700 1 -- 172.21.15.117:0/3609841327 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fe74c00bd30 con 0x7fe75c0fc5b0 2024-04-12T09:20:02.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.218+0000 7fe7527fc700 1 --2- 172.21.15.117:0/3609841327 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe74806dca0 0x7fe748070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:02.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.218+0000 7fe7527fc700 1 -- 172.21.15.117:0/3609841327 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe74c08e780 con 0x7fe75c0fc5b0 2024-04-12T09:20:02.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.218+0000 7fe761d12700 1 --2- 172.21.15.117:0/3609841327 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe74806dca0 0x7fe748070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:02.220 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.219+0000 7fe761d12700 1 --2- 172.21.15.117:0/3609841327 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe74806dca0 0x7fe748070150 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe758004d00 tx=0x7fe758009ce0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:02.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.223+0000 7fe7527fc700 1 -- 172.21.15.117:0/3609841327 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fe74c05b8e0 con 0x7fe75c0fc5b0 2024-04-12T09:20:02.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.506+0000 7fe763f76700 1 -- 172.21.15.117:0/3609841327 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe75c110520 con 0x7fe75c0fc5b0 2024-04-12T09:20:02.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.506+0000 7fe7527fc700 1 -- 172.21.15.117:0/3609841327 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe74c05b470 con 0x7fe75c0fc5b0 2024-04-12T09:20:02.507 INFO:teuthology.orchestra.run.smithi117.stdout:HEALTH_OK 2024-04-12T09:20:02.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.508+0000 7fe763f76700 1 -- 172.21.15.117:0/3609841327 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe74806dca0 msgr2=0x7fe748070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:02.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.508+0000 7fe763f76700 1 --2- 172.21.15.117:0/3609841327 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe74806dca0 0x7fe748070150 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe758004d00 tx=0x7fe758009ce0 comp rx=0 tx=0).stop 2024-04-12T09:20:02.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.508+0000 7fe763f76700 1 -- 172.21.15.117:0/3609841327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe75c0fc5b0 msgr2=0x7fe75c11a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:02.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.508+0000 7fe763f76700 1 --2- 172.21.15.117:0/3609841327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe75c0fc5b0 0x7fe75c11a620 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00b3b0 tx=0x7fe74c009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:02.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.508+0000 7fe763f76700 1 -- 172.21.15.117:0/3609841327 shutdown_connections 2024-04-12T09:20:02.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.508+0000 7fe763f76700 1 --2- 172.21.15.117:0/3609841327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe75c0fbc10 0x7fe75c11a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:02.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.508+0000 7fe763f76700 1 --2- 172.21.15.117:0/3609841327 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe74806dca0 0x7fe748070150 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:02.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.508+0000 7fe763f76700 1 --2- 172.21.15.117:0/3609841327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe75c0fc5b0 0x7fe75c11a620 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:02.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.508+0000 7fe763f76700 1 -- 172.21.15.117:0/3609841327 >> 172.21.15.117:0/3609841327 conn(0x7fe75c0f7870 msgr2=0x7fe75c0f8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:02.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.509+0000 7fe763f76700 1 -- 172.21.15.117:0/3609841327 shutdown_connections 2024-04-12T09:20:02.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:02.509+0000 7fe763f76700 1 -- 172.21.15.117:0/3609841327 wait complete. 2024-04-12T09:20:02.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:02 smithi117 ceph-mon[113571]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:20:02.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:02 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/1261559443' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:20:02.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:02 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-12T09:20:02.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:02 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/3609841327' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:20:02.962 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:02 smithi203 ceph-mon[86783]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:20:02.962 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:02 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/1261559443' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:20:02.962 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:02 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-12T09:20:02.962 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:02 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/3609841327' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:20:03.983 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:03 smithi203 ceph-mon[86783]: from='client.34360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:20:03.983 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:03 smithi203 ceph-mon[86783]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-12T09:20:03.983 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:03 smithi203 ceph-mon[86783]: Upgrade: osd.5 is safe to restart 2024-04-12T09:20:03.983 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:03 smithi203 ceph-mon[86783]: pgmap v152: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:20:04.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:03 smithi117 ceph-mon[113571]: from='client.34360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:20:04.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:03 smithi117 ceph-mon[113571]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-12T09:20:04.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:03 smithi117 ceph-mon[113571]: Upgrade: osd.5 is safe to restart 2024-04-12T09:20:04.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:03 smithi117 ceph-mon[113571]: pgmap v152: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:20:05.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:04 smithi203 ceph-mon[86783]: Upgrade: Updating osd.5 2024-04-12T09:20:05.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:04 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:05.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:04 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-12T09:20:05.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:04 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:20:05.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:04 smithi203 ceph-mon[86783]: Deploying daemon osd.5 on smithi203 2024-04-12T09:20:05.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:04 smithi203 ceph-mon[86783]: pgmap v153: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:20:05.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:04 smithi117 ceph-mon[113571]: Upgrade: Updating osd.5 2024-04-12T09:20:05.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:04 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:05.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:04 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-12T09:20:05.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:04 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:20:05.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:04 smithi117 ceph-mon[113571]: Deploying daemon osd.5 on smithi203 2024-04-12T09:20:05.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:04 smithi117 ceph-mon[113571]: pgmap v153: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:20:07.275 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:07 smithi203 systemd[1]: Stopping Ceph osd.5 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:20:07.573 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:07 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[55368]: 2024-04-12T09:20:07.274+0000 7ff861981700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T09:20:07.574 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:07 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[55368]: 2024-04-12T09:20:07.274+0000 7ff861981700 -1 osd.5 74 *** Got signal Terminated *** 2024-04-12T09:20:07.574 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:07 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[55368]: 2024-04-12T09:20:07.274+0000 7ff861981700 -1 osd.5 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T09:20:08.027 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:07 smithi203 ceph-mon[86783]: pgmap v154: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:20:08.027 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:07 smithi203 ceph-mon[86783]: osd.5 marked itself down and dead 2024-04-12T09:20:08.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:07 smithi117 ceph-mon[113571]: pgmap v154: 65 pgs: 65 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:20:08.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:07 smithi117 ceph-mon[113571]: osd.5 marked itself down and dead 2024-04-12T09:20:08.283 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:08 smithi203 podman[105900]: 2024-04-12 09:20:08.039704814 +0000 UTC m=+0.862997046 container died 69cb7c22f00268b0424db5b1509c58ffb731f14801286b11fe4312ea4d45b3e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5, org.label-schema.build-date=20240409, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=quincy-d3b5060) 2024-04-12T09:20:08.534 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:08 smithi203 podman[105900]: 2024-04-12 09:20:08.374268847 +0000 UTC m=+1.197561100 container cleanup 69cb7c22f00268b0424db5b1509c58ffb731f14801286b11fe4312ea4d45b3e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=quincy-d3b5060, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T09:20:08.534 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:08 smithi203 bash[105900]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5 2024-04-12T09:20:08.823 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:08 smithi203 podman[105916]: 2024-04-12 09:20:08.533920516 +0000 UTC m=+0.489662647 container remove 69cb7c22f00268b0424db5b1509c58ffb731f14801286b11fe4312ea4d45b3e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:5e334df698f432180b78bc9c46936bfdfbc92bc9a8983463e523f780d23765fe, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=quincy-d3b5060, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-12T09:20:08.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:08 smithi203 ceph-mon[86783]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-12T09:20:08.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:08 smithi203 ceph-mon[86783]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-04-12T09:20:08.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:08 smithi203 ceph-mon[86783]: osdmap e75: 6 total, 5 up, 6 in 2024-04-12T09:20:08.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:08 smithi203 ceph-mon[86783]: osdmap e76: 6 total, 5 up, 6 in 2024-04-12T09:20:09.111 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:08 smithi117 ceph-mon[113571]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-12T09:20:09.111 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:08 smithi117 ceph-mon[113571]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-04-12T09:20:09.112 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:08 smithi117 ceph-mon[113571]: osdmap e75: 6 total, 5 up, 6 in 2024-04-12T09:20:09.112 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:08 smithi117 ceph-mon[113571]: osdmap e76: 6 total, 5 up, 6 in 2024-04-12T09:20:09.262 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:08 smithi203 podman[106010]: 2024-04-12 09:20:08.95161567 +0000 UTC m=+0.113420136 container create 8f5632688187dc9bd2b815460f8035b3870a75392449e354cfedd30f67ec0b08 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-b277feb, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240409) 2024-04-12T09:20:09.263 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:08 smithi203 podman[106010]: 2024-04-12 09:20:08.856650311 +0000 UTC m=+0.018454735 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:20:09.263 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:09 smithi203 podman[106010]: 2024-04-12 09:20:09.18774375 +0000 UTC m=+0.349548174 container init 8f5632688187dc9bd2b815460f8035b3870a75392449e354cfedd30f67ec0b08 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-b277feb, org.label-schema.vendor=CentOS) 2024-04-12T09:20:09.263 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:09 smithi203 podman[106010]: 2024-04-12 09:20:09.191041709 +0000 UTC m=+0.352846134 container start 8f5632688187dc9bd2b815460f8035b3870a75392449e354cfedd30f67ec0b08 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.build-date=20240409, ceph=True, RELEASE=squid-b277feb, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T09:20:09.263 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:09 smithi203 podman[106010]: 2024-04-12 09:20:09.262637558 +0000 UTC m=+0.424441993 container attach 8f5632688187dc9bd2b815460f8035b3870a75392449e354cfedd30f67ec0b08 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, RELEASE=squid-b277feb, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-12T09:20:09.573 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:09 smithi203 podman[106010]: 2024-04-12 09:20:09.483917563 +0000 UTC m=+0.645721996 container died 8f5632688187dc9bd2b815460f8035b3870a75392449e354cfedd30f67ec0b08 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-b277feb, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-12T09:20:10.033 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:09 smithi203 ceph-mon[86783]: pgmap v156: 65 pgs: 13 stale+active+clean, 52 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:20:10.033 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:09 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:10.033 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:09 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:20:10.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:09 smithi117 ceph-mon[113571]: pgmap v156: 65 pgs: 13 stale+active+clean, 52 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-12T09:20:10.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:09 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:10.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:09 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:20:10.298 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:10 smithi203 podman[106036]: 2024-04-12 09:20:10.258797146 +0000 UTC m=+0.765083273 container remove 8f5632688187dc9bd2b815460f8035b3870a75392449e354cfedd30f67ec0b08 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=squid-b277feb, org.label-schema.vendor=CentOS) 2024-04-12T09:20:10.299 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:10 smithi203 systemd[1]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.5.service: Deactivated successfully. 2024-04-12T09:20:10.299 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:10 smithi203 systemd[1]: Stopped Ceph osd.5 for 12161984-f8ab-11ee-bc8c-c7b262605968. 2024-04-12T09:20:10.299 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:10 smithi203 systemd[1]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.5.service: Consumed 1min 3.535s CPU time. 2024-04-12T09:20:10.573 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:10 smithi203 systemd[1]: Starting Ceph osd.5 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:20:11.021 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:10 smithi203 ceph-mon[86783]: Health check failed: Degraded data redundancy: 1/225 objects degraded (0.444%), 1 pg degraded (PG_DEGRADED) 2024-04-12T09:20:11.021 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:10 smithi203 podman[106138]: 2024-04-12 09:20:10.61068928 +0000 UTC m=+0.018449055 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:20:11.021 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:10 smithi203 podman[106138]: 2024-04-12 09:20:10.726818484 +0000 UTC m=+0.134578299 container create c1af8c99e0f523de3937a49d56dcd0d1e9ccc6f9e7d3ba3f2e5be8e1f363f369 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5-activate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, RELEASE=squid-b277feb, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD) 2024-04-12T09:20:11.021 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:10 smithi203 podman[106138]: 2024-04-12 09:20:10.921743616 +0000 UTC m=+0.329503393 container init c1af8c99e0f523de3937a49d56dcd0d1e9ccc6f9e7d3ba3f2e5be8e1f363f369 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5-activate, RELEASE=squid-b277feb, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-04-12T09:20:11.021 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:10 smithi203 podman[106138]: 2024-04-12 09:20:10.925156962 +0000 UTC m=+0.332916742 container start c1af8c99e0f523de3937a49d56dcd0d1e9ccc6f9e7d3ba3f2e5be8e1f363f369 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5-activate, org.label-schema.build-date=20240409, RELEASE=squid-b277feb, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-12T09:20:11.021 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:11 smithi203 podman[106138]: 2024-04-12 09:20:11.021195601 +0000 UTC m=+0.428955388 container attach c1af8c99e0f523de3937a49d56dcd0d1e9ccc6f9e7d3ba3f2e5be8e1f363f369 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5-activate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b277feb, io.buildah.version=1.33.5) 2024-04-12T09:20:11.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:10 smithi117 ceph-mon[113571]: Health check failed: Degraded data redundancy: 1/225 objects degraded (0.444%), 1 pg degraded (PG_DEGRADED) 2024-04-12T09:20:11.700 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:11 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5-activate[106153]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-12T09:20:11.700 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:11 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5-activate[106153]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-12T09:20:11.700 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:11 smithi203 bash[106138]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-12T09:20:11.700 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:11 smithi203 bash[106138]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-12T09:20:11.700 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:11 smithi203 bash[106138]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-12T09:20:11.700 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:11 smithi203 bash[106138]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-12T09:20:11.701 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:11 smithi203 bash[106138]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-12T09:20:11.701 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:11 smithi203 bash[106138]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-12T09:20:11.701 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:11 smithi203 bash[106138]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-12T09:20:11.701 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:11 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5-activate[106153]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-12T09:20:11.701 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:11 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5-activate[106153]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-12T09:20:11.701 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:11 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5-activate[106153]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-12T09:20:11.701 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:11 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5-activate[106153]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-12T09:20:11.701 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:11 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5-activate[106153]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-12T09:20:11.701 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:11 smithi203 podman[106138]: 2024-04-12 09:20:11.393387197 +0000 UTC m=+0.801146977 container died c1af8c99e0f523de3937a49d56dcd0d1e9ccc6f9e7d3ba3f2e5be8e1f363f369 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5-activate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-b277feb, org.label-schema.build-date=20240409) 2024-04-12T09:20:11.966 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:11 smithi203 ceph-mon[86783]: pgmap v158: 65 pgs: 1 active+undersized+degraded, 12 stale+active+clean, 2 active+undersized, 50 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1/225 objects degraded (0.444%) 2024-04-12T09:20:12.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:11 smithi117 ceph-mon[113571]: pgmap v158: 65 pgs: 1 active+undersized+degraded, 12 stale+active+clean, 2 active+undersized, 50 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1/225 objects degraded (0.444%) 2024-04-12T09:20:12.286 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:11 smithi203 podman[106288]: 2024-04-12 09:20:11.967191409 +0000 UTC m=+0.568045158 container remove c1af8c99e0f523de3937a49d56dcd0d1e9ccc6f9e7d3ba3f2e5be8e1f363f369 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5-activate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, RELEASE=squid-b277feb) 2024-04-12T09:20:12.286 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:12 smithi203 podman[106351]: 2024-04-12 09:20:12.079725646 +0000 UTC m=+0.017995027 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:20:12.286 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:12 smithi203 podman[106351]: 2024-04-12 09:20:12.184970028 +0000 UTC m=+0.123239438 container create ad918b4139f72f850a7dea6e59dff46cf139cfb1f6727e3596d6834c1abb8ba2 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b277feb, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-12T09:20:12.573 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:12 smithi203 podman[106351]: 2024-04-12 09:20:12.404097847 +0000 UTC m=+0.342367215 container init ad918b4139f72f850a7dea6e59dff46cf139cfb1f6727e3596d6834c1abb8ba2 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=squid-b277feb, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-12T09:20:12.573 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:12 smithi203 podman[106351]: 2024-04-12 09:20:12.407090851 +0000 UTC m=+0.345360219 container start ad918b4139f72f850a7dea6e59dff46cf139cfb1f6727e3596d6834c1abb8ba2 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b277feb, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-12T09:20:12.574 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:12 smithi203 ceph-osd[106371]: -- 172.21.15.203:0/1391703075 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5649fcec1680 con 0x5649fce8ac00 2024-04-12T09:20:12.574 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:12 smithi203 bash[106351]: ad918b4139f72f850a7dea6e59dff46cf139cfb1f6727e3596d6834c1abb8ba2 2024-04-12T09:20:12.574 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:12 smithi203 systemd[1]: Started Ceph osd.5 for 12161984-f8ab-11ee-bc8c-c7b262605968. 2024-04-12T09:20:13.323 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:12 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:20:12.946+0000 7f73301dd7c0 -1 Falling back to public interface 2024-04-12T09:20:13.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:13 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:13.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:13 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:13.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:13 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:20:13.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:13 smithi203 ceph-mon[86783]: pgmap v159: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 35/225 objects degraded (15.556%) 2024-04-12T09:20:13.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:13 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:13.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:13 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:13.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:13 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:20:13.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:13 smithi117 ceph-mon[113571]: pgmap v159: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 35/225 objects degraded (15.556%) 2024-04-12T09:20:16.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:15 smithi203 ceph-mon[86783]: pgmap v160: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 35/225 objects degraded (15.556%) 2024-04-12T09:20:16.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:15 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:16.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:15 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:16.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:15 smithi117 ceph-mon[113571]: pgmap v160: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 35/225 objects degraded (15.556%) 2024-04-12T09:20:16.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:15 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:16.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:15 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:17.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:16 smithi203 ceph-mon[86783]: Health check update: Degraded data redundancy: 35/225 objects degraded (15.556%), 12 pgs degraded (PG_DEGRADED) 2024-04-12T09:20:17.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:16 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:17.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:16 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:17.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:16 smithi117 ceph-mon[113571]: Health check update: Degraded data redundancy: 35/225 objects degraded (15.556%), 12 pgs degraded (PG_DEGRADED) 2024-04-12T09:20:17.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:16 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:17.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:16 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:17.824 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:17 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:20:17.623+0000 7f73301dd7c0 -1 osd.5 74 log_to_monitors true 2024-04-12T09:20:17.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:17 smithi203 ceph-mon[86783]: pgmap v161: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 35/225 objects degraded (15.556%) 2024-04-12T09:20:17.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:17 smithi203 ceph-mon[86783]: from='osd.5 [v2:172.21.15.203:6816/3403215254,v1:172.21.15.203:6817/3403215254]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-12T09:20:17.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:17 smithi203 ceph-mon[86783]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-12T09:20:18.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:17 smithi117 ceph-mon[113571]: pgmap v161: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 206 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 35/225 objects degraded (15.556%) 2024-04-12T09:20:18.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:17 smithi117 ceph-mon[113571]: from='osd.5 [v2:172.21.15.203:6816/3403215254,v1:172.21.15.203:6817/3403215254]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-12T09:20:18.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:17 smithi117 ceph-mon[113571]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-12T09:20:18.671 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:20:18 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:20:18.545+0000 7f7321635700 -1 osd.5 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T09:20:19.716 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:19 smithi203 ceph-mon[86783]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-12T09:20:19.716 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:19 smithi203 ceph-mon[86783]: osdmap e77: 6 total, 5 up, 6 in 2024-04-12T09:20:19.716 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:19 smithi203 ceph-mon[86783]: from='osd.5 [v2:172.21.15.203:6816/3403215254,v1:172.21.15.203:6817/3403215254]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-04-12T09:20:19.716 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:19 smithi203 ceph-mon[86783]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-04-12T09:20:19.716 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:19 smithi203 ceph-mon[86783]: pgmap v163: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 35/225 objects degraded (15.556%) 2024-04-12T09:20:19.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:19 smithi117 ceph-mon[113571]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-12T09:20:19.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:19 smithi117 ceph-mon[113571]: osdmap e77: 6 total, 5 up, 6 in 2024-04-12T09:20:19.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:19 smithi117 ceph-mon[113571]: from='osd.5 [v2:172.21.15.203:6816/3403215254,v1:172.21.15.203:6817/3403215254]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-04-12T09:20:19.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:19 smithi117 ceph-mon[113571]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-04-12T09:20:19.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:19 smithi117 ceph-mon[113571]: pgmap v163: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 35/225 objects degraded (15.556%) 2024-04-12T09:20:20.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-12T09:20:20.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: osd.5 [v2:172.21.15.203:6816/3403215254,v1:172.21.15.203:6817/3403215254] boot 2024-04-12T09:20:20.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: osdmap e78: 6 total, 6 up, 6 in 2024-04-12T09:20:20.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T09:20:20.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:20.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:20.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:20:20.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:20:20.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:20.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:20:20.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:20:20.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:20:20.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:20:20.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:20:20.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:20.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-12T09:20:20.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-12T09:20:20.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-12T09:20:20.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-12T09:20:20.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-12T09:20:20.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-12T09:20:20.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-12T09:20:20.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-12T09:20:20.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-12T09:20:20.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-12T09:20:20.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-12T09:20:20.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-12T09:20:20.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-04-12T09:20:20.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-04-12T09:20:20.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-04-12T09:20:20.826 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:20 smithi203 ceph-mon[86783]: osdmap e79: 6 total, 6 up, 6 in 2024-04-12T09:20:20.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-12T09:20:20.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: osd.5 [v2:172.21.15.203:6816/3403215254,v1:172.21.15.203:6817/3403215254] boot 2024-04-12T09:20:20.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: osdmap e78: 6 total, 6 up, 6 in 2024-04-12T09:20:20.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-12T09:20:20.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:20.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:20.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:20:20.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:20:20.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:20.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:20:20.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:20:20.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:20:20.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:20:20.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:20:20.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:20.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-12T09:20:20.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-12T09:20:20.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-12T09:20:20.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-12T09:20:20.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-12T09:20:20.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-12T09:20:20.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-12T09:20:20.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-12T09:20:20.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-12T09:20:20.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-12T09:20:20.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-12T09:20:20.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-12T09:20:20.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-04-12T09:20:20.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-04-12T09:20:20.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-04-12T09:20:20.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:20 smithi117 ceph-mon[113571]: osdmap e79: 6 total, 6 up, 6 in 2024-04-12T09:20:21.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:21 smithi117 ceph-mon[113571]: Upgrade: Setting container_image for all osd 2024-04-12T09:20:21.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:21 smithi117 ceph-mon[113571]: Upgrade: Setting require_osd_release to 19 squid 2024-04-12T09:20:21.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:21 smithi117 ceph-mon[113571]: pgmap v166: 65 pgs: 2 peering, 12 active+undersized+degraded, 14 active+undersized, 37 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 35/225 objects degraded (15.556%) 2024-04-12T09:20:21.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:21 smithi203 ceph-mon[86783]: Upgrade: Setting container_image for all osd 2024-04-12T09:20:21.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:21 smithi203 ceph-mon[86783]: Upgrade: Setting require_osd_release to 19 squid 2024-04-12T09:20:21.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:21 smithi203 ceph-mon[86783]: pgmap v166: 65 pgs: 2 peering, 12 active+undersized+degraded, 14 active+undersized, 37 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 35/225 objects degraded (15.556%) 2024-04-12T09:20:23.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:23 smithi117 ceph-mon[113571]: Upgrade: Updating mds.cephfs.smithi117.wddsgt 2024-04-12T09:20:23.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:23 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:23.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:23 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.wddsgt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T09:20:23.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:23 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:20:23.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:23 smithi117 ceph-mon[113571]: Deploying daemon mds.cephfs.smithi117.wddsgt on smithi117 2024-04-12T09:20:23.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:23 smithi117 ceph-mon[113571]: pgmap v167: 65 pgs: 2 peering, 4 active+undersized+degraded, 9 active+undersized, 50 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 11/225 objects degraded (4.889%) 2024-04-12T09:20:23.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:23 smithi203 ceph-mon[86783]: Upgrade: Updating mds.cephfs.smithi117.wddsgt 2024-04-12T09:20:23.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:23 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:23.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:23 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.wddsgt", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T09:20:23.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:23 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:20:23.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:23 smithi203 ceph-mon[86783]: Deploying daemon mds.cephfs.smithi117.wddsgt on smithi117 2024-04-12T09:20:23.574 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:23 smithi203 ceph-mon[86783]: pgmap v167: 65 pgs: 2 peering, 4 active+undersized+degraded, 9 active+undersized, 50 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 11/225 objects degraded (4.889%) 2024-04-12T09:20:24.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:24 smithi117 ceph-mon[113571]: Health check update: Degraded data redundancy: 11/225 objects degraded (4.889%), 4 pgs degraded (PG_DEGRADED) 2024-04-12T09:20:24.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:24 smithi203 ceph-mon[86783]: Health check update: Degraded data redundancy: 11/225 objects degraded (4.889%), 4 pgs degraded (PG_DEGRADED) 2024-04-12T09:20:25.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:25 smithi117 ceph-mon[113571]: pgmap v168: 65 pgs: 2 peering, 63 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:20:25.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:25 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:25.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:25 smithi117 ceph-mon[113571]: osdmap e80: 6 total, 6 up, 6 in 2024-04-12T09:20:25.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:25 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:20:25.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:25 smithi117 ceph-mon[113571]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/225 objects degraded (4.889%), 4 pgs degraded) 2024-04-12T09:20:25.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:25 smithi117 ceph-mon[113571]: Cluster is now healthy 2024-04-12T09:20:25.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:25 smithi117 ceph-mon[113571]: fsmap cephfs:1 {0=cephfs.smithi117.eslmxh=up:active} 2 up:standby 2024-04-12T09:20:25.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:25 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.wddsgt"}]: dispatch 2024-04-12T09:20:26.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:25 smithi203 ceph-mon[86783]: pgmap v168: 65 pgs: 2 peering, 63 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:20:26.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:25 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:26.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:25 smithi203 ceph-mon[86783]: osdmap e80: 6 total, 6 up, 6 in 2024-04-12T09:20:26.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:25 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:20:26.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:25 smithi203 ceph-mon[86783]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/225 objects degraded (4.889%), 4 pgs degraded) 2024-04-12T09:20:26.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:25 smithi203 ceph-mon[86783]: Cluster is now healthy 2024-04-12T09:20:26.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:25 smithi203 ceph-mon[86783]: fsmap cephfs:1 {0=cephfs.smithi117.eslmxh=up:active} 2 up:standby 2024-04-12T09:20:26.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:25 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.wddsgt"}]: dispatch 2024-04-12T09:20:27.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:27 smithi117 ceph-mon[113571]: pgmap v170: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:20:28.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:27 smithi203 ceph-mon[86783]: pgmap v170: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:20:29.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:29 smithi117 ceph-mon[113571]: pgmap v171: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:20:29.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:29 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:29.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:29 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:29.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:29 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:20:30.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:29 smithi203 ceph-mon[86783]: pgmap v171: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:20:30.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:29 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:30.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:29 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:30.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:29 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:20:30.889 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:30 smithi117 ceph-mon[113571]: mds.? [v2:172.21.15.117:6826/2687704577,v1:172.21.15.117:6827/2687704577] up:boot 2024-04-12T09:20:30.889 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:30 smithi117 ceph-mon[113571]: fsmap cephfs:1 {0=cephfs.smithi117.eslmxh=up:active} 3 up:standby 2024-04-12T09:20:30.889 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:30 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.wddsgt"}]: dispatch 2024-04-12T09:20:31.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:30 smithi203 ceph-mon[86783]: mds.? [v2:172.21.15.117:6826/2687704577,v1:172.21.15.117:6827/2687704577] up:boot 2024-04-12T09:20:31.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:30 smithi203 ceph-mon[86783]: fsmap cephfs:1 {0=cephfs.smithi117.eslmxh=up:active} 3 up:standby 2024-04-12T09:20:31.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:30 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.wddsgt"}]: dispatch 2024-04-12T09:20:31.850 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:31 smithi117 ceph-mon[113571]: pgmap v172: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:20:32.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:31 smithi203 ceph-mon[86783]: pgmap v172: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:20:32.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.615+0000 7f51d455a700 1 -- 172.21.15.117:0/39011965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51cc1037a0 msgr2=0x7f51cc0fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:32.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.615+0000 7f51d455a700 1 --2- 172.21.15.117:0/39011965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51cc1037a0 0x7f51cc0fce10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f51bc004940 tx=0x7f51bc009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:32.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.616+0000 7f51d455a700 1 -- 172.21.15.117:0/39011965 shutdown_connections 2024-04-12T09:20:32.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.616+0000 7f51d455a700 1 --2- 172.21.15.117:0/39011965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51cc1037a0 0x7f51cc0fce10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:32.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.616+0000 7f51d455a700 1 --2- 172.21.15.117:0/39011965 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51cc102e00 0x7f51cc1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:32.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.616+0000 7f51d455a700 1 -- 172.21.15.117:0/39011965 >> 172.21.15.117:0/39011965 conn(0x7f51cc0f89b0 msgr2=0x7f51cc0fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:32.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.616+0000 7f51d455a700 1 -- 172.21.15.117:0/39011965 shutdown_connections 2024-04-12T09:20:32.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.616+0000 7f51d455a700 1 -- 172.21.15.117:0/39011965 wait complete. 2024-04-12T09:20:32.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.616+0000 7f51d455a700 1 Processor -- start 2024-04-12T09:20:32.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.616+0000 7f51d455a700 1 -- start start 2024-04-12T09:20:32.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.616+0000 7f51d455a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51cc102e00 0x7f51cc113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:32.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.616+0000 7f51d455a700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51cc1037a0 0x7f51cc113ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:32.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.616+0000 7f51d455a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc1145b0 con 0x7f51cc102e00 2024-04-12T09:20:32.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.616+0000 7f51d455a700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc10db40 con 0x7f51cc1037a0 2024-04-12T09:20:32.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.617+0000 7f51d22f6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51cc102e00 0x7f51cc113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:32.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.617+0000 7f51d22f6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51cc102e00 0x7f51cc113990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40444/0 (socket says 172.21.15.117:40444) 2024-04-12T09:20:32.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.617+0000 7f51d22f6700 1 -- 172.21.15.117:0/3495418426 learned_addr learned my addr 172.21.15.117:0/3495418426 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:20:32.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.617+0000 7f51d22f6700 1 -- 172.21.15.117:0/3495418426 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51cc1037a0 msgr2=0x7f51cc113ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:32.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.617+0000 7f51d1af5700 1 --2- 172.21.15.117:0/3495418426 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51cc1037a0 0x7f51cc113ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:32.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.617+0000 7f51d22f6700 1 --2- 172.21.15.117:0/3495418426 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51cc1037a0 0x7f51cc113ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:32.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.617+0000 7f51d22f6700 1 -- 172.21.15.117:0/3495418426 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc005040 con 0x7f51cc102e00 2024-04-12T09:20:32.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.617+0000 7f51d22f6700 1 --2- 172.21.15.117:0/3495418426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51cc102e00 0x7f51cc113990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f51c800b790 tx=0x7f51c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:32.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.617+0000 7f51c2ffd700 1 -- 172.21.15.117:0/3495418426 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51c800f770 con 0x7f51cc102e00 2024-04-12T09:20:32.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.617+0000 7f51c2ffd700 1 -- 172.21.15.117:0/3495418426 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f51c800fda0 con 0x7f51cc102e00 2024-04-12T09:20:32.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.617+0000 7f51c2ffd700 1 -- 172.21.15.117:0/3495418426 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51c800d310 con 0x7f51cc102e00 2024-04-12T09:20:32.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.617+0000 7f51d455a700 1 -- 172.21.15.117:0/3495418426 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51cc10de20 con 0x7f51cc102e00 2024-04-12T09:20:32.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.617+0000 7f51d455a700 1 -- 172.21.15.117:0/3495418426 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51cc10e3e0 con 0x7f51cc102e00 2024-04-12T09:20:32.620 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.618+0000 7f51d455a700 1 -- 172.21.15.117:0/3495418426 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51cc100110 con 0x7f51cc102e00 2024-04-12T09:20:32.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.619+0000 7f51c2ffd700 1 -- 172.21.15.117:0/3495418426 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f51c8010420 con 0x7f51cc102e00 2024-04-12T09:20:32.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.619+0000 7f51c2ffd700 1 --2- 172.21.15.117:0/3495418426 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f51b806dca0 0x7f51b8070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:32.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.619+0000 7f51c2ffd700 1 -- 172.21.15.117:0/3495418426 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f51c808d530 con 0x7f51cc102e00 2024-04-12T09:20:32.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.619+0000 7f51d1af5700 1 --2- 172.21.15.117:0/3495418426 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f51b806dca0 0x7f51b8070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:32.621 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.619+0000 7f51d1af5700 1 --2- 172.21.15.117:0/3495418426 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f51b806dca0 0x7f51b8070150 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00b3b0 tx=0x7f51bc009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:32.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.624+0000 7f51c2ffd700 1 -- 172.21.15.117:0/3495418426 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f51c8056be0 con 0x7f51cc102e00 2024-04-12T09:20:32.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.842+0000 7f51d455a700 1 -- 172.21.15.117:0/3495418426 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f51cc109fc0 con 0x7f51b806dca0 2024-04-12T09:20:32.844 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.843+0000 7f51c2ffd700 1 -- 172.21.15.117:0/3495418426 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f51cc109fc0 con 0x7f51b806dca0 2024-04-12T09:20:32.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.845+0000 7f51d455a700 1 -- 172.21.15.117:0/3495418426 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f51b806dca0 msgr2=0x7f51b8070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:32.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.845+0000 7f51d455a700 1 --2- 172.21.15.117:0/3495418426 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f51b806dca0 0x7f51b8070150 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00b3b0 tx=0x7f51bc009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:32.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.845+0000 7f51d455a700 1 -- 172.21.15.117:0/3495418426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51cc102e00 msgr2=0x7f51cc113990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:32.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.845+0000 7f51d455a700 1 --2- 172.21.15.117:0/3495418426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51cc102e00 0x7f51cc113990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f51c800b790 tx=0x7f51c8009250 comp rx=0 tx=0).stop 2024-04-12T09:20:32.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.845+0000 7f51d455a700 1 -- 172.21.15.117:0/3495418426 shutdown_connections 2024-04-12T09:20:32.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.845+0000 7f51d455a700 1 --2- 172.21.15.117:0/3495418426 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f51b806dca0 0x7f51b8070150 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:32.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.845+0000 7f51d455a700 1 --2- 172.21.15.117:0/3495418426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51cc102e00 0x7f51cc113990 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:32.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.845+0000 7f51d455a700 1 --2- 172.21.15.117:0/3495418426 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51cc1037a0 0x7f51cc113ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:32.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.846+0000 7f51d455a700 1 -- 172.21.15.117:0/3495418426 >> 172.21.15.117:0/3495418426 conn(0x7f51cc0f89b0 msgr2=0x7f51cc0fa770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:32.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.846+0000 7f51d455a700 1 -- 172.21.15.117:0/3495418426 shutdown_connections 2024-04-12T09:20:32.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.846+0000 7f51d455a700 1 -- 172.21.15.117:0/3495418426 wait complete. 2024-04-12T09:20:32.856 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:20:32.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.961+0000 7f083fd8c700 1 -- 172.21.15.117:0/2588435704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0838102e10 msgr2=0x7f08381031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:32.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.961+0000 7f083fd8c700 1 --2- 172.21.15.117:0/2588435704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0838102e10 0x7f08381031e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0834004940 tx=0x7f0834009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:32.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.961+0000 7f083fd8c700 1 -- 172.21.15.117:0/2588435704 shutdown_connections 2024-04-12T09:20:32.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.961+0000 7f083fd8c700 1 --2- 172.21.15.117:0/2588435704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08381037b0 0x7f08380fb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:32.962 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.961+0000 7f083fd8c700 1 --2- 172.21.15.117:0/2588435704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0838102e10 0x7f08381031e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:32.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.961+0000 7f083fd8c700 1 -- 172.21.15.117:0/2588435704 >> 172.21.15.117:0/2588435704 conn(0x7f0838073380 msgr2=0x7f0838073780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:32.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.962+0000 7f083fd8c700 1 -- 172.21.15.117:0/2588435704 shutdown_connections 2024-04-12T09:20:32.963 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.962+0000 7f083fd8c700 1 -- 172.21.15.117:0/2588435704 wait complete. 2024-04-12T09:20:32.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.962+0000 7f083fd8c700 1 Processor -- start 2024-04-12T09:20:32.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.962+0000 7f083fd8c700 1 -- start start 2024-04-12T09:20:32.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.962+0000 7f083fd8c700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0838102e10 0x7f083810b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:32.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.962+0000 7f083fd8c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08381037b0 0x7f083810bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:32.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.962+0000 7f083fd8c700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083810e8d0 con 0x7f08381037b0 2024-04-12T09:20:32.964 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.963+0000 7f083fd8c700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083810c410 con 0x7f0838102e10 2024-04-12T09:20:32.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.963+0000 7f083d327700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08381037b0 0x7f083810bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:32.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.963+0000 7f083d327700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08381037b0 0x7f083810bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40454/0 (socket says 172.21.15.117:40454) 2024-04-12T09:20:32.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.963+0000 7f083d327700 1 -- 172.21.15.117:0/1268812836 learned_addr learned my addr 172.21.15.117:0/1268812836 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:20:32.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.963+0000 7f083d327700 1 -- 172.21.15.117:0/1268812836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0838102e10 msgr2=0x7f083810b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:32.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.963+0000 7f083d327700 1 --2- 172.21.15.117:0/1268812836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0838102e10 0x7f083810b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:32.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.963+0000 7f083d327700 1 -- 172.21.15.117:0/1268812836 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0834005040 con 0x7f08381037b0 2024-04-12T09:20:32.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.963+0000 7f083d327700 1 --2- 172.21.15.117:0/1268812836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08381037b0 0x7f083810bed0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f082800c800 tx=0x7f0828004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:32.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.963+0000 7f082e7fc700 1 -- 172.21.15.117:0/1268812836 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f082800a760 con 0x7f08381037b0 2024-04-12T09:20:32.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.963+0000 7f082e7fc700 1 -- 172.21.15.117:0/1268812836 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f082800ad90 con 0x7f08381037b0 2024-04-12T09:20:32.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.963+0000 7f083fd8c700 1 -- 172.21.15.117:0/1268812836 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f083810c6f0 con 0x7f08381037b0 2024-04-12T09:20:32.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.963+0000 7f082e7fc700 1 -- 172.21.15.117:0/1268812836 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08280113a0 con 0x7f08381037b0 2024-04-12T09:20:32.965 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.963+0000 7f083fd8c700 1 -- 172.21.15.117:0/1268812836 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f083811e580 con 0x7f08381037b0 2024-04-12T09:20:32.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.965+0000 7f083fd8c700 1 -- 172.21.15.117:0/1268812836 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0838107310 con 0x7f08381037b0 2024-04-12T09:20:32.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.966+0000 7f082e7fc700 1 -- 172.21.15.117:0/1268812836 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f0828012400 con 0x7f08381037b0 2024-04-12T09:20:32.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.966+0000 7f082e7fc700 1 --2- 172.21.15.117:0/1268812836 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f082406dca0 0x7f0824070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:32.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.966+0000 7f082e7fc700 1 -- 172.21.15.117:0/1268812836 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f082808d4a0 con 0x7f08381037b0 2024-04-12T09:20:32.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.967+0000 7f083db28700 1 --2- 172.21.15.117:0/1268812836 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f082406dca0 0x7f0824070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:32.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.967+0000 7f083db28700 1 --2- 172.21.15.117:0/1268812836 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f082406dca0 0x7f0824070150 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0834004f90 tx=0x7f0834009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:32.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:32.971+0000 7f082e7fc700 1 -- 172.21.15.117:0/1268812836 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f0828056b30 con 0x7f08381037b0 2024-04-12T09:20:33.191 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.190+0000 7f083fd8c700 1 -- 172.21.15.117:0/1268812836 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f083810ceb0 con 0x7f082406dca0 2024-04-12T09:20:33.192 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.192+0000 7f082e7fc700 1 -- 172.21.15.117:0/1268812836 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f083810ceb0 con 0x7f082406dca0 2024-04-12T09:20:33.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.194+0000 7f083fd8c700 1 -- 172.21.15.117:0/1268812836 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f082406dca0 msgr2=0x7f0824070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:33.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.194+0000 7f083fd8c700 1 --2- 172.21.15.117:0/1268812836 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f082406dca0 0x7f0824070150 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0834004f90 tx=0x7f0834009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:33.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.194+0000 7f083fd8c700 1 -- 172.21.15.117:0/1268812836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08381037b0 msgr2=0x7f083810bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:33.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.194+0000 7f083fd8c700 1 --2- 172.21.15.117:0/1268812836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08381037b0 0x7f083810bed0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f082800c800 tx=0x7f0828004470 comp rx=0 tx=0).stop 2024-04-12T09:20:33.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.194+0000 7f083fd8c700 1 -- 172.21.15.117:0/1268812836 shutdown_connections 2024-04-12T09:20:33.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.194+0000 7f083fd8c700 1 --2- 172.21.15.117:0/1268812836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0838102e10 0x7f083810b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:33.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.194+0000 7f083fd8c700 1 --2- 172.21.15.117:0/1268812836 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f082406dca0 0x7f0824070150 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:33.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.194+0000 7f083fd8c700 1 --2- 172.21.15.117:0/1268812836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08381037b0 0x7f083810bed0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:33.195 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.194+0000 7f083fd8c700 1 -- 172.21.15.117:0/1268812836 >> 172.21.15.117:0/1268812836 conn(0x7f0838073380 msgr2=0x7f08380fab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:33.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.194+0000 7f083fd8c700 1 -- 172.21.15.117:0/1268812836 shutdown_connections 2024-04-12T09:20:33.196 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.194+0000 7f083fd8c700 1 -- 172.21.15.117:0/1268812836 wait complete. 2024-04-12T09:20:33.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.299+0000 7feac0d71700 1 -- 172.21.15.117:0/1175219984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feabc101d70 msgr2=0x7feabc102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:33.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.299+0000 7feac0d71700 1 --2- 172.21.15.117:0/1175219984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feabc101d70 0x7feabc102140 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7feab4004940 tx=0x7feab4009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:33.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.299+0000 7feac0d71700 1 -- 172.21.15.117:0/1175219984 shutdown_connections 2024-04-12T09:20:33.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.299+0000 7feac0d71700 1 --2- 172.21.15.117:0/1175219984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feabc102710 0x7feabc0fbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:33.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.299+0000 7feac0d71700 1 --2- 172.21.15.117:0/1175219984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feabc101d70 0x7feabc102140 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:33.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.299+0000 7feac0d71700 1 -- 172.21.15.117:0/1175219984 >> 172.21.15.117:0/1175219984 conn(0x7feabc072bc0 msgr2=0x7feabc072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:33.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.299+0000 7feac0d71700 1 -- 172.21.15.117:0/1175219984 shutdown_connections 2024-04-12T09:20:33.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.299+0000 7feac0d71700 1 -- 172.21.15.117:0/1175219984 wait complete. 2024-04-12T09:20:33.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.299+0000 7feac0d71700 1 Processor -- start 2024-04-12T09:20:33.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.300+0000 7feac0d71700 1 -- start start 2024-04-12T09:20:33.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.300+0000 7feac0d71700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feabc101d70 0x7feabc10eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:33.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.300+0000 7feac0d71700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feabc102710 0x7feabc10eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:33.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.300+0000 7feac0d71700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc10f6d0 con 0x7feabc102710 2024-04-12T09:20:33.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.300+0000 7feac0d71700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc10f810 con 0x7feabc101d70 2024-04-12T09:20:33.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.300+0000 7feab9d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feabc102710 0x7feabc10eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:33.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.300+0000 7feab9d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feabc102710 0x7feabc10eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40476/0 (socket says 172.21.15.117:40476) 2024-04-12T09:20:33.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.300+0000 7feab9d9b700 1 -- 172.21.15.117:0/3216679373 learned_addr learned my addr 172.21.15.117:0/3216679373 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:20:33.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.300+0000 7feaba59c700 1 --2- 172.21.15.117:0/3216679373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feabc101d70 0x7feabc10eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:33.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.300+0000 7feab9d9b700 1 -- 172.21.15.117:0/3216679373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feabc101d70 msgr2=0x7feabc10eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:33.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.300+0000 7feab9d9b700 1 --2- 172.21.15.117:0/3216679373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feabc101d70 0x7feabc10eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:33.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.300+0000 7feab9d9b700 1 -- 172.21.15.117:0/3216679373 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab4005040 con 0x7feabc102710 2024-04-12T09:20:33.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.300+0000 7feab9d9b700 1 --2- 172.21.15.117:0/3216679373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feabc102710 0x7feabc10eff0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7feab000b790 tx=0x7feab0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:33.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.301+0000 7feaaaffd700 1 -- 172.21.15.117:0/3216679373 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feab000f6f0 con 0x7feabc102710 2024-04-12T09:20:33.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.301+0000 7feaaaffd700 1 -- 172.21.15.117:0/3216679373 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feab000fd20 con 0x7feabc102710 2024-04-12T09:20:33.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.301+0000 7feaaaffd700 1 -- 172.21.15.117:0/3216679373 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feab00103a0 con 0x7feabc102710 2024-04-12T09:20:33.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.301+0000 7feac0d71700 1 -- 172.21.15.117:0/3216679373 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feabc117b80 con 0x7feabc102710 2024-04-12T09:20:33.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.301+0000 7feac0d71700 1 -- 172.21.15.117:0/3216679373 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feabc118110 con 0x7feabc102710 2024-04-12T09:20:33.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.302+0000 7feac0d71700 1 -- 172.21.15.117:0/3216679373 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feabc0ff080 con 0x7feabc102710 2024-04-12T09:20:33.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.302+0000 7feaaaffd700 1 -- 172.21.15.117:0/3216679373 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7feab0011400 con 0x7feabc102710 2024-04-12T09:20:33.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.303+0000 7feaaaffd700 1 --2- 172.21.15.117:0/3216679373 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7feaa406dca0 0x7feaa4070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:33.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.303+0000 7feaaaffd700 1 -- 172.21.15.117:0/3216679373 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6324+0+0 (secure 0 0 0) 0x7feab008dcc0 con 0x7feabc102710 2024-04-12T09:20:33.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.303+0000 7feaba59c700 1 --2- 172.21.15.117:0/3216679373 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7feaa406dca0 0x7feaa4070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:33.304 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.303+0000 7feaba59c700 1 --2- 172.21.15.117:0/3216679373 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7feaa406dca0 0x7feaa4070150 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feab4004f90 tx=0x7feab4009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:33.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.307+0000 7feaaaffd700 1 -- 172.21.15.117:0/3216679373 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7feab0057410 con 0x7feabc102710 2024-04-12T09:20:33.516 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.516+0000 7feac0d71700 1 -- 172.21.15.117:0/3216679373 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feabc108ee0 con 0x7feaa406dca0 2024-04-12T09:20:33.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.526+0000 7feaaaffd700 1 -- 172.21.15.117:0/3216679373 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7feabc108ee0 con 0x7feaa406dca0 2024-04-12T09:20:33.526 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:20:33.526 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 running (6m) 117s ago 17m 27.1M - 0.25.0 c8568f914cd2 204687f21ed7 2024-04-12T09:20:33.527 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (3m) 117s ago 17m 6656k - 19.0.0-2053-gb277feb2 668895944f0e 038f567b664b 2024-04-12T09:20:33.527 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (3m) 18s ago 16m 6660k - 19.0.0-2053-gb277feb2 668895944f0e 420dee66e230 2024-04-12T09:20:33.527 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 running (5m) 117s ago 17m 79.6M - 9.4.12 2bacad6d85d8 a7b102216886 2024-04-12T09:20:33.527 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (12m) 117s ago 12m 140M - 17.2.7-827-gd3b5060a 21de9b7369ad de062e2c10e7 2024-04-12T09:20:33.527 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 starting - - - - 2024-04-12T09:20:33.527 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (12m) 18s ago 12m 17.7M - 17.2.7-827-gd3b5060a 21de9b7369ad b05228e997f7 2024-04-12T09:20:33.527 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (12m) 18s ago 12m 18.0M - 17.2.7-827-gd3b5060a 21de9b7369ad 6d7f82c072c7 2024-04-12T09:20:33.527 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:8443,9283,8765 running (7m) 117s ago 19m 504M - 19.0.0-2053-gb277feb2 668895944f0e fee613d05ab7 2024-04-12T09:20:33.527 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283,8765 running (7m) 18s ago 16m 451M - 19.0.0-2053-gb277feb2 668895944f0e c793944c3e16 2024-04-12T09:20:33.527 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (4m) 117s ago 19m 48.0M 2048M 19.0.0-2053-gb277feb2 668895944f0e 6823aaff30ce 2024-04-12T09:20:33.527 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (4m) 18s ago 16m 40.6M 2048M 19.0.0-2053-gb277feb2 668895944f0e 006c6e487bfb 2024-04-12T09:20:33.527 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 running (6m) 117s ago 17m 16.2M - 1.5.0 0da6a335fe13 c692bed9f6c7 2024-04-12T09:20:33.527 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (6m) 18s ago 16m 15.5M - 1.5.0 0da6a335fe13 f3b5a470f545 2024-04-12T09:20:33.527 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (3m) 117s ago 15m 88.1M 1557M 19.0.0-2053-gb277feb2 668895944f0e 59a180461e3c 2024-04-12T09:20:33.527 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (2m) 117s ago 15m 95.0M 1557M 19.0.0-2053-gb277feb2 668895944f0e d40e2dfc164b 2024-04-12T09:20:33.528 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (2m) 117s ago 15m 12.5M 1557M 19.0.0-2053-gb277feb2 668895944f0e fd7d5481cddb 2024-04-12T09:20:33.528 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (87s) 18s ago 14m 116M 2581M 19.0.0-2053-gb277feb2 668895944f0e 961db53f9ab1 2024-04-12T09:20:33.528 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (54s) 18s ago 14m 102M 2581M 19.0.0-2053-gb277feb2 668895944f0e 7ec45de1eea6 2024-04-12T09:20:33.528 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (21s) 18s ago 13m 12.0M 2581M 19.0.0-2053-gb277feb2 668895944f0e ad918b4139f7 2024-04-12T09:20:33.528 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 running (6m) 117s ago 17m 61.0M - 2.43.0 a07b618ecd1d 43ce588d82cc 2024-04-12T09:20:33.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.528+0000 7feac0d71700 1 -- 172.21.15.117:0/3216679373 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7feaa406dca0 msgr2=0x7feaa4070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:33.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.528+0000 7feac0d71700 1 --2- 172.21.15.117:0/3216679373 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7feaa406dca0 0x7feaa4070150 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feab4004f90 tx=0x7feab4009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:33.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.528+0000 7feac0d71700 1 -- 172.21.15.117:0/3216679373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feabc102710 msgr2=0x7feabc10eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:33.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.528+0000 7feac0d71700 1 --2- 172.21.15.117:0/3216679373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feabc102710 0x7feabc10eff0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7feab000b790 tx=0x7feab0009220 comp rx=0 tx=0).stop 2024-04-12T09:20:33.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.528+0000 7feac0d71700 1 -- 172.21.15.117:0/3216679373 shutdown_connections 2024-04-12T09:20:33.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.528+0000 7feac0d71700 1 --2- 172.21.15.117:0/3216679373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feabc101d70 0x7feabc10eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:33.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.528+0000 7feac0d71700 1 --2- 172.21.15.117:0/3216679373 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7feaa406dca0 0x7feaa4070150 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:33.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.528+0000 7feac0d71700 1 --2- 172.21.15.117:0/3216679373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feabc102710 0x7feabc10eff0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:33.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.528+0000 7feac0d71700 1 -- 172.21.15.117:0/3216679373 >> 172.21.15.117:0/3216679373 conn(0x7feabc072bc0 msgr2=0x7feabc0fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:33.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.528+0000 7feac0d71700 1 -- 172.21.15.117:0/3216679373 shutdown_connections 2024-04-12T09:20:33.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.528+0000 7feac0d71700 1 -- 172.21.15.117:0/3216679373 wait complete. 2024-04-12T09:20:33.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.628+0000 7fa70a89a700 1 -- 172.21.15.117:0/1499669610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa704102710 msgr2=0x7fa7040fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:33.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.628+0000 7fa70a89a700 1 --2- 172.21.15.117:0/1499669610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa704102710 0x7fa7040fbd80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8004940 tx=0x7fa6f8009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:33.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.628+0000 7fa70a89a700 1 -- 172.21.15.117:0/1499669610 shutdown_connections 2024-04-12T09:20:33.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.628+0000 7fa70a89a700 1 --2- 172.21.15.117:0/1499669610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa704102710 0x7fa7040fbd80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:33.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.628+0000 7fa70a89a700 1 --2- 172.21.15.117:0/1499669610 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa704101d70 0x7fa704102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:33.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.628+0000 7fa70a89a700 1 -- 172.21.15.117:0/1499669610 >> 172.21.15.117:0/1499669610 conn(0x7fa704072bc0 msgr2=0x7fa704072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:33.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.628+0000 7fa70a89a700 1 -- 172.21.15.117:0/1499669610 shutdown_connections 2024-04-12T09:20:33.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.628+0000 7fa70a89a700 1 -- 172.21.15.117:0/1499669610 wait complete. 2024-04-12T09:20:33.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.628+0000 7fa70a89a700 1 Processor -- start 2024-04-12T09:20:33.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.629+0000 7fa70a89a700 1 -- start start 2024-04-12T09:20:33.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.629+0000 7fa70a89a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa704101d70 0x7fa704115cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:33.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.629+0000 7fa70a89a700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa704102710 0x7fa704116230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:33.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.629+0000 7fa70a89a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa704116880 con 0x7fa704101d70 2024-04-12T09:20:33.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.629+0000 7fa70a89a700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70410fd00 con 0x7fa704102710 2024-04-12T09:20:33.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.629+0000 7fa703fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa704101d70 0x7fa704115cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:33.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.629+0000 7fa703fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa704101d70 0x7fa704115cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40486/0 (socket says 172.21.15.117:40486) 2024-04-12T09:20:33.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.629+0000 7fa703fff700 1 -- 172.21.15.117:0/2875349995 learned_addr learned my addr 172.21.15.117:0/2875349995 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:20:33.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.629+0000 7fa703fff700 1 -- 172.21.15.117:0/2875349995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa704102710 msgr2=0x7fa704116230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:33.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.629+0000 7fa703fff700 1 --2- 172.21.15.117:0/2875349995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa704102710 0x7fa704116230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:33.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.629+0000 7fa703fff700 1 -- 172.21.15.117:0/2875349995 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f8005040 con 0x7fa704101d70 2024-04-12T09:20:33.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.630+0000 7fa703fff700 1 --2- 172.21.15.117:0/2875349995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa704101d70 0x7fa704115cf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4002a50 tx=0x7fa6f40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:33.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.630+0000 7fa700ff9700 1 -- 172.21.15.117:0/2875349995 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6f4007cc0 con 0x7fa704101d70 2024-04-12T09:20:33.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.630+0000 7fa70a89a700 1 -- 172.21.15.117:0/2875349995 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa70410ffe0 con 0x7fa704101d70 2024-04-12T09:20:33.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.630+0000 7fa700ff9700 1 -- 172.21.15.117:0/2875349995 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa6f400f040 con 0x7fa704101d70 2024-04-12T09:20:33.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.630+0000 7fa700ff9700 1 -- 172.21.15.117:0/2875349995 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6f4009640 con 0x7fa704101d70 2024-04-12T09:20:33.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.630+0000 7fa70a89a700 1 -- 172.21.15.117:0/2875349995 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7041105a0 con 0x7fa704101d70 2024-04-12T09:20:33.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.631+0000 7fa70a89a700 1 -- 172.21.15.117:0/2875349995 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7040fd4c0 con 0x7fa704101d70 2024-04-12T09:20:33.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.632+0000 7fa700ff9700 1 -- 172.21.15.117:0/2875349995 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fa6f40097c0 con 0x7fa704101d70 2024-04-12T09:20:33.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.632+0000 7fa700ff9700 1 --2- 172.21.15.117:0/2875349995 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fa6ec06dcb0 0x7fa6ec070160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:33.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.632+0000 7fa700ff9700 1 -- 172.21.15.117:0/2875349995 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fa6f408d270 con 0x7fa704101d70 2024-04-12T09:20:33.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.632+0000 7fa7037fe700 1 --2- 172.21.15.117:0/2875349995 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fa6ec06dcb0 0x7fa6ec070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:33.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.633+0000 7fa7037fe700 1 --2- 172.21.15.117:0/2875349995 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fa6ec06dcb0 0x7fa6ec070160 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8004f90 tx=0x7fa6f8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:33.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.637+0000 7fa700ff9700 1 -- 172.21.15.117:0/2875349995 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fa6f40568a0 con 0x7fa704101d70 2024-04-12T09:20:33.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:33 smithi117 ceph-mon[113571]: pgmap v173: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:20:33.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.944+0000 7fa70a89a700 1 -- 172.21.15.117:0/2875349995 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa704108e50 con 0x7fa704101d70 2024-04-12T09:20:33.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.944+0000 7fa700ff9700 1 -- 172.21.15.117:0/2875349995 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7fa6f4056070 con 0x7fa704101d70 2024-04-12T09:20:33.945 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:20:33.945 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": { 2024-04-12T09:20:33.945 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:20:33.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:20:33.945 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": { 2024-04-12T09:20:33.945 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:20:33.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:20:33.946 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": { 2024-04-12T09:20:33.946 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 6 2024-04-12T09:20:33.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:20:33.946 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-04-12T09:20:33.946 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 3, 2024-04-12T09:20:33.946 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 1 2024-04-12T09:20:33.946 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:20:33.946 INFO:teuthology.orchestra.run.smithi117.stdout: "overall": { 2024-04-12T09:20:33.946 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 3, 2024-04-12T09:20:33.946 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 11 2024-04-12T09:20:33.946 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:20:33.946 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:20:33.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.946+0000 7fa70a89a700 1 -- 172.21.15.117:0/2875349995 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fa6ec06dcb0 msgr2=0x7fa6ec070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:33.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.946+0000 7fa70a89a700 1 --2- 172.21.15.117:0/2875349995 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fa6ec06dcb0 0x7fa6ec070160 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8004f90 tx=0x7fa6f8009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:33.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.946+0000 7fa70a89a700 1 -- 172.21.15.117:0/2875349995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa704101d70 msgr2=0x7fa704115cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:33.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.946+0000 7fa70a89a700 1 --2- 172.21.15.117:0/2875349995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa704101d70 0x7fa704115cf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4002a50 tx=0x7fa6f40046b0 comp rx=0 tx=0).stop 2024-04-12T09:20:33.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.946+0000 7fa70a89a700 1 -- 172.21.15.117:0/2875349995 shutdown_connections 2024-04-12T09:20:33.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.946+0000 7fa70a89a700 1 --2- 172.21.15.117:0/2875349995 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fa6ec06dcb0 0x7fa6ec070160 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:33.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.946+0000 7fa70a89a700 1 --2- 172.21.15.117:0/2875349995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa704101d70 0x7fa704115cf0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:33.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.946+0000 7fa70a89a700 1 --2- 172.21.15.117:0/2875349995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa704102710 0x7fa704116230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:33.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.946+0000 7fa70a89a700 1 -- 172.21.15.117:0/2875349995 >> 172.21.15.117:0/2875349995 conn(0x7fa704072bc0 msgr2=0x7fa704065940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:33.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.947+0000 7fa70a89a700 1 -- 172.21.15.117:0/2875349995 shutdown_connections 2024-04-12T09:20:33.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:33.947+0000 7fa70a89a700 1 -- 172.21.15.117:0/2875349995 wait complete. 2024-04-12T09:20:34.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.047+0000 7f52a7b9e700 1 -- 172.21.15.117:0/2494496301 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52a00fb4d0 msgr2=0x7f52a00fb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:34.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.047+0000 7f52a7b9e700 1 --2- 172.21.15.117:0/2494496301 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52a00fb4d0 0x7f52a00fb940 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5290004940 tx=0x7f5290009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:34.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.047+0000 7f52a7b9e700 1 -- 172.21.15.117:0/2494496301 shutdown_connections 2024-04-12T09:20:34.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.047+0000 7f52a7b9e700 1 --2- 172.21.15.117:0/2494496301 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52a00fb4d0 0x7f52a00fb940 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:34.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.047+0000 7f52a7b9e700 1 --2- 172.21.15.117:0/2494496301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52a0102f50 0x7f52a0103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:34.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.047+0000 7f52a7b9e700 1 -- 172.21.15.117:0/2494496301 >> 172.21.15.117:0/2494496301 conn(0x7f52a00714c0 msgr2=0x7f52a00718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:34.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.048+0000 7f52a7b9e700 1 -- 172.21.15.117:0/2494496301 shutdown_connections 2024-04-12T09:20:34.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.048+0000 7f52a7b9e700 1 -- 172.21.15.117:0/2494496301 wait complete. 2024-04-12T09:20:34.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.048+0000 7f52a7b9e700 1 Processor -- start 2024-04-12T09:20:34.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.048+0000 7f52a7b9e700 1 -- start start 2024-04-12T09:20:34.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.048+0000 7f52a7b9e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52a00fb4d0 0x7f52a01139a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:34.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.048+0000 7f52a7b9e700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52a0102f50 0x7f52a0113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:34.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.048+0000 7f52a7b9e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a0114530 con 0x7f52a00fb4d0 2024-04-12T09:20:34.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.048+0000 7f52a7b9e700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a010db50 con 0x7f52a0102f50 2024-04-12T09:20:34.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.048+0000 7f52a593a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52a00fb4d0 0x7f52a01139a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:34.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.048+0000 7f52a593a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52a00fb4d0 0x7f52a01139a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40498/0 (socket says 172.21.15.117:40498) 2024-04-12T09:20:34.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.048+0000 7f52a593a700 1 -- 172.21.15.117:0/4074514697 learned_addr learned my addr 172.21.15.117:0/4074514697 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:20:34.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.048+0000 7f52a5139700 1 --2- 172.21.15.117:0/4074514697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52a0102f50 0x7f52a0113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:34.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.049+0000 7f52a593a700 1 -- 172.21.15.117:0/4074514697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52a0102f50 msgr2=0x7f52a0113ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:34.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.049+0000 7f52a593a700 1 --2- 172.21.15.117:0/4074514697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52a0102f50 0x7f52a0113ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:34.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.049+0000 7f52a593a700 1 -- 172.21.15.117:0/4074514697 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5290005040 con 0x7f52a00fb4d0 2024-04-12T09:20:34.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.049+0000 7f52a593a700 1 --2- 172.21.15.117:0/4074514697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52a00fb4d0 0x7f52a01139a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f529c002a80 tx=0x7f529c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:34.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.049+0000 7f52967fc700 1 -- 172.21.15.117:0/4074514697 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f529c007cc0 con 0x7f52a00fb4d0 2024-04-12T09:20:34.051 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.049+0000 7f52967fc700 1 -- 172.21.15.117:0/4074514697 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f529c00f040 con 0x7f52a00fb4d0 2024-04-12T09:20:34.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.049+0000 7f52a7b9e700 1 -- 172.21.15.117:0/4074514697 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a010de30 con 0x7f52a00fb4d0 2024-04-12T09:20:34.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.049+0000 7f52967fc700 1 -- 172.21.15.117:0/4074514697 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f529c00da30 con 0x7f52a00fb4d0 2024-04-12T09:20:34.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.049+0000 7f52a7b9e700 1 -- 172.21.15.117:0/4074514697 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a010e370 con 0x7f52a00fb4d0 2024-04-12T09:20:34.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.050+0000 7f52a7b9e700 1 -- 172.21.15.117:0/4074514697 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a0105330 con 0x7f52a00fb4d0 2024-04-12T09:20:34.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.051+0000 7f52967fc700 1 -- 172.21.15.117:0/4074514697 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f529c00db90 con 0x7f52a00fb4d0 2024-04-12T09:20:34.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.051+0000 7f52967fc700 1 --2- 172.21.15.117:0/4074514697 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f528c06dca0 0x7f528c070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:34.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.051+0000 7f52967fc700 1 -- 172.21.15.117:0/4074514697 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f529c08d260 con 0x7f52a00fb4d0 2024-04-12T09:20:34.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.051+0000 7f52a5139700 1 --2- 172.21.15.117:0/4074514697 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f528c06dca0 0x7f528c070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:34.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.051+0000 7f52a5139700 1 --2- 172.21.15.117:0/4074514697 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f528c06dca0 0x7f528c070150 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f52a010f240 tx=0x7f5290009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:34.056 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.056+0000 7f52967fc700 1 -- 172.21.15.117:0/4074514697 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f529c056890 con 0x7f52a00fb4d0 2024-04-12T09:20:34.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:33 smithi203 ceph-mon[86783]: pgmap v173: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:20:34.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.302+0000 7f52a7b9e700 1 -- 172.21.15.117:0/4074514697 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f52a010a0a0 con 0x7f52a00fb4d0 2024-04-12T09:20:34.303 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.302+0000 7f52967fc700 1 -- 172.21.15.117:0/4074514697 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1885 (secure 0 0 0) 0x7f529c059f50 con 0x7f52a00fb4d0 2024-04-12T09:20:34.303 INFO:teuthology.orchestra.run.smithi117.stdout:e16 2024-04-12T09:20:34.303 INFO:teuthology.orchestra.run.smithi117.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T09:20:34.303 INFO:teuthology.orchestra.run.smithi117.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:20:34.304 INFO:teuthology.orchestra.run.smithi117.stdout:legacy client fscid: 1 2024-04-12T09:20:34.304 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:20:34.304 INFO:teuthology.orchestra.run.smithi117.stdout:Filesystem 'cephfs' (1) 2024-04-12T09:20:34.304 INFO:teuthology.orchestra.run.smithi117.stdout:fs_name cephfs 2024-04-12T09:20:34.304 INFO:teuthology.orchestra.run.smithi117.stdout:epoch 14 2024-04-12T09:20:34.304 INFO:teuthology.orchestra.run.smithi117.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T09:20:34.304 INFO:teuthology.orchestra.run.smithi117.stdout:created 2024-04-12T09:08:12.488144+0000 2024-04-12T09:20:34.304 INFO:teuthology.orchestra.run.smithi117.stdout:modified 2024-04-12T09:08:30.563184+0000 2024-04-12T09:20:34.304 INFO:teuthology.orchestra.run.smithi117.stdout:tableserver 0 2024-04-12T09:20:34.304 INFO:teuthology.orchestra.run.smithi117.stdout:root 0 2024-04-12T09:20:34.304 INFO:teuthology.orchestra.run.smithi117.stdout:session_timeout 60 2024-04-12T09:20:34.304 INFO:teuthology.orchestra.run.smithi117.stdout:session_autoclose 300 2024-04-12T09:20:34.304 INFO:teuthology.orchestra.run.smithi117.stdout:max_file_size 1099511627776 2024-04-12T09:20:34.304 INFO:teuthology.orchestra.run.smithi117.stdout:max_xattr_size 65536 2024-04-12T09:20:34.305 INFO:teuthology.orchestra.run.smithi117.stdout:required_client_features {} 2024-04-12T09:20:34.305 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure 0 2024-04-12T09:20:34.305 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure_osd_epoch 46 2024-04-12T09:20:34.305 INFO:teuthology.orchestra.run.smithi117.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:20:34.305 INFO:teuthology.orchestra.run.smithi117.stdout:max_mds 1 2024-04-12T09:20:34.305 INFO:teuthology.orchestra.run.smithi117.stdout:in 0 2024-04-12T09:20:34.305 INFO:teuthology.orchestra.run.smithi117.stdout:up {0=14474} 2024-04-12T09:20:34.305 INFO:teuthology.orchestra.run.smithi117.stdout:failed 2024-04-12T09:20:34.305 INFO:teuthology.orchestra.run.smithi117.stdout:damaged 2024-04-12T09:20:34.305 INFO:teuthology.orchestra.run.smithi117.stdout:stopped 2024-04-12T09:20:34.305 INFO:teuthology.orchestra.run.smithi117.stdout:data_pools [3] 2024-04-12T09:20:34.305 INFO:teuthology.orchestra.run.smithi117.stdout:metadata_pool 2 2024-04-12T09:20:34.305 INFO:teuthology.orchestra.run.smithi117.stdout:inline_data disabled 2024-04-12T09:20:34.305 INFO:teuthology.orchestra.run.smithi117.stdout:balancer 2024-04-12T09:20:34.305 INFO:teuthology.orchestra.run.smithi117.stdout:bal_rank_mask -1 2024-04-12T09:20:34.305 INFO:teuthology.orchestra.run.smithi117.stdout:standby_count_wanted 1 2024-04-12T09:20:34.306 INFO:teuthology.orchestra.run.smithi117.stdout:qdb_cluster leader: 0 members: 2024-04-12T09:20:34.306 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.eslmxh{0:14474} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.117:6828/2248590199,v1:172.21.15.117:6829/2248590199] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:20:34.306 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:20:34.306 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:20:34.306 INFO:teuthology.orchestra.run.smithi117.stdout:Standby daemons: 2024-04-12T09:20:34.306 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:20:34.306 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.fbeixl{-1:24265} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.203:6824/840607003,v1:172.21.15.203:6825/840607003] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:20:34.306 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.bszhxz{-1:24273} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/2731911290,v1:172.21.15.203:6827/2731911290] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:20:34.306 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.wddsgt{-1:34372} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/2687704577,v1:172.21.15.117:6827/2687704577] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T09:20:34.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.305+0000 7f52a7b9e700 1 -- 172.21.15.117:0/4074514697 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f528c06dca0 msgr2=0x7f528c070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:34.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.305+0000 7f52a7b9e700 1 --2- 172.21.15.117:0/4074514697 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f528c06dca0 0x7f528c070150 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f52a010f240 tx=0x7f5290009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:34.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.305+0000 7f52a7b9e700 1 -- 172.21.15.117:0/4074514697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52a00fb4d0 msgr2=0x7f52a01139a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:34.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.305+0000 7f52a7b9e700 1 --2- 172.21.15.117:0/4074514697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52a00fb4d0 0x7f52a01139a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f529c002a80 tx=0x7f529c004600 comp rx=0 tx=0).stop 2024-04-12T09:20:34.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.305+0000 7f52a7b9e700 1 -- 172.21.15.117:0/4074514697 shutdown_connections 2024-04-12T09:20:34.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.305+0000 7f52a7b9e700 1 --2- 172.21.15.117:0/4074514697 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f528c06dca0 0x7f528c070150 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:34.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.305+0000 7f52a7b9e700 1 --2- 172.21.15.117:0/4074514697 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f52a00fb4d0 0x7f52a01139a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:34.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.305+0000 7f52a7b9e700 1 --2- 172.21.15.117:0/4074514697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52a0102f50 0x7f52a0113ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:34.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.305+0000 7f52a7b9e700 1 -- 172.21.15.117:0/4074514697 >> 172.21.15.117:0/4074514697 conn(0x7f52a00714c0 msgr2=0x7f52a00fa720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:34.307 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.305+0000 7f52a7b9e700 1 -- 172.21.15.117:0/4074514697 shutdown_connections 2024-04-12T09:20:34.308 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.306+0000 7f52a7b9e700 1 -- 172.21.15.117:0/4074514697 wait complete. 2024-04-12T09:20:34.308 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 16 2024-04-12T09:20:34.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.408+0000 7f82ee8d7700 1 -- 172.21.15.117:0/2320607954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82e80fb4a0 msgr2=0x7f82e80fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:34.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.408+0000 7f82ee8d7700 1 --2- 172.21.15.117:0/2320607954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82e80fb4a0 0x7f82e80fb910 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f82dc004940 tx=0x7f82dc009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:34.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.408+0000 7f82ee8d7700 1 -- 172.21.15.117:0/2320607954 shutdown_connections 2024-04-12T09:20:34.409 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.408+0000 7f82ee8d7700 1 --2- 172.21.15.117:0/2320607954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82e80fb4a0 0x7f82e80fb910 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:34.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.408+0000 7f82ee8d7700 1 --2- 172.21.15.117:0/2320607954 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82e8102e70 0x7f82e8103240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:34.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.408+0000 7f82ee8d7700 1 -- 172.21.15.117:0/2320607954 >> 172.21.15.117:0/2320607954 conn(0x7f82e80714c0 msgr2=0x7f82e80718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:34.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.408+0000 7f82ee8d7700 1 -- 172.21.15.117:0/2320607954 shutdown_connections 2024-04-12T09:20:34.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.408+0000 7f82ee8d7700 1 -- 172.21.15.117:0/2320607954 wait complete. 2024-04-12T09:20:34.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.409+0000 7f82ee8d7700 1 Processor -- start 2024-04-12T09:20:34.410 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.409+0000 7f82ee8d7700 1 -- start start 2024-04-12T09:20:34.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.409+0000 7f82ee8d7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82e80fb4a0 0x7f82e8113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:34.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.409+0000 7f82ee8d7700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82e8102e70 0x7f82e81140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:34.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.409+0000 7f82ee8d7700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e8114700 con 0x7f82e80fb4a0 2024-04-12T09:20:34.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.409+0000 7f82ee8d7700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e810daf0 con 0x7f82e8102e70 2024-04-12T09:20:34.411 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.409+0000 7f82e7fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82e80fb4a0 0x7f82e8113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:34.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.409+0000 7f82e7fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82e80fb4a0 0x7f82e8113b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40508/0 (socket says 172.21.15.117:40508) 2024-04-12T09:20:34.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.409+0000 7f82e7fff700 1 -- 172.21.15.117:0/556877317 learned_addr learned my addr 172.21.15.117:0/556877317 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:20:34.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.409+0000 7f82e77fe700 1 --2- 172.21.15.117:0/556877317 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82e8102e70 0x7f82e81140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:34.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.410+0000 7f82e7fff700 1 -- 172.21.15.117:0/556877317 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82e8102e70 msgr2=0x7f82e81140b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:34.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.410+0000 7f82e7fff700 1 --2- 172.21.15.117:0/556877317 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82e8102e70 0x7f82e81140b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:34.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.410+0000 7f82e7fff700 1 -- 172.21.15.117:0/556877317 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82dc005040 con 0x7f82e80fb4a0 2024-04-12T09:20:34.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.410+0000 7f82e7fff700 1 --2- 172.21.15.117:0/556877317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82e80fb4a0 0x7f82e8113b70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f82d800c830 tx=0x7f82d8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:34.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.410+0000 7f82e4ff9700 1 -- 172.21.15.117:0/556877317 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82d80106f0 con 0x7f82e80fb4a0 2024-04-12T09:20:34.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.410+0000 7f82e4ff9700 1 -- 172.21.15.117:0/556877317 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f82d8010d20 con 0x7f82e80fb4a0 2024-04-12T09:20:34.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.410+0000 7f82ee8d7700 1 -- 172.21.15.117:0/556877317 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e810ddd0 con 0x7f82e80fb4a0 2024-04-12T09:20:34.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.410+0000 7f82e4ff9700 1 -- 172.21.15.117:0/556877317 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82d80113a0 con 0x7f82e80fb4a0 2024-04-12T09:20:34.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.410+0000 7f82ee8d7700 1 -- 172.21.15.117:0/556877317 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e810e360 con 0x7f82e80fb4a0 2024-04-12T09:20:34.412 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.411+0000 7f82ee8d7700 1 -- 172.21.15.117:0/556877317 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e8100110 con 0x7f82e80fb4a0 2024-04-12T09:20:34.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.411+0000 7f82e4ff9700 1 -- 172.21.15.117:0/556877317 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f82d8012400 con 0x7f82e80fb4a0 2024-04-12T09:20:34.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.412+0000 7f82e4ff9700 1 --2- 172.21.15.117:0/556877317 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f82d006dca0 0x7f82d0070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:34.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.412+0000 7f82e4ff9700 1 -- 172.21.15.117:0/556877317 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f82d808d420 con 0x7f82e80fb4a0 2024-04-12T09:20:34.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.412+0000 7f82e77fe700 1 --2- 172.21.15.117:0/556877317 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f82d006dca0 0x7f82d0070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:34.413 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.412+0000 7f82e77fe700 1 --2- 172.21.15.117:0/556877317 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f82d006dca0 0x7f82d0070150 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f82e810edd0 tx=0x7f82dc009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:34.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.416+0000 7f82e4ff9700 1 -- 172.21.15.117:0/556877317 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f82d805a600 con 0x7f82e80fb4a0 2024-04-12T09:20:34.639 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.639+0000 7f82ee8d7700 1 -- 172.21.15.117:0/556877317 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f82e8109f40 con 0x7f82d006dca0 2024-04-12T09:20:34.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.640+0000 7f82e4ff9700 1 -- 172.21.15.117:0/556877317 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f82e8109f40 con 0x7f82d006dca0 2024-04-12T09:20:34.641 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:20:34.641 INFO:teuthology.orchestra.run.smithi117.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec", 2024-04-12T09:20:34.641 INFO:teuthology.orchestra.run.smithi117.stdout: "in_progress": true, 2024-04-12T09:20:34.641 INFO:teuthology.orchestra.run.smithi117.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T09:20:34.641 INFO:teuthology.orchestra.run.smithi117.stdout: "services_complete": [ 2024-04-12T09:20:34.641 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr", 2024-04-12T09:20:34.641 INFO:teuthology.orchestra.run.smithi117.stdout: "osd", 2024-04-12T09:20:34.641 INFO:teuthology.orchestra.run.smithi117.stdout: "mon", 2024-04-12T09:20:34.641 INFO:teuthology.orchestra.run.smithi117.stdout: "crash" 2024-04-12T09:20:34.641 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2024-04-12T09:20:34.641 INFO:teuthology.orchestra.run.smithi117.stdout: "progress": "13/21 daemons upgraded", 2024-04-12T09:20:34.641 INFO:teuthology.orchestra.run.smithi117.stdout: "message": "Currently upgrading mds daemons", 2024-04-12T09:20:34.641 INFO:teuthology.orchestra.run.smithi117.stdout: "is_paused": false 2024-04-12T09:20:34.642 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:20:34.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.642+0000 7f82ee8d7700 1 -- 172.21.15.117:0/556877317 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f82d006dca0 msgr2=0x7f82d0070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:34.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.642+0000 7f82ee8d7700 1 --2- 172.21.15.117:0/556877317 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f82d006dca0 0x7f82d0070150 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f82e810edd0 tx=0x7f82dc009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:34.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.642+0000 7f82ee8d7700 1 -- 172.21.15.117:0/556877317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82e80fb4a0 msgr2=0x7f82e8113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:34.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.642+0000 7f82ee8d7700 1 --2- 172.21.15.117:0/556877317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82e80fb4a0 0x7f82e8113b70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f82d800c830 tx=0x7f82d8004470 comp rx=0 tx=0).stop 2024-04-12T09:20:34.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.643+0000 7f82ee8d7700 1 -- 172.21.15.117:0/556877317 shutdown_connections 2024-04-12T09:20:34.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.643+0000 7f82ee8d7700 1 --2- 172.21.15.117:0/556877317 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f82d006dca0 0x7f82d0070150 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:34.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.643+0000 7f82ee8d7700 1 --2- 172.21.15.117:0/556877317 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82e80fb4a0 0x7f82e8113b70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:34.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.643+0000 7f82ee8d7700 1 --2- 172.21.15.117:0/556877317 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82e8102e70 0x7f82e81140b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:34.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.643+0000 7f82ee8d7700 1 -- 172.21.15.117:0/556877317 >> 172.21.15.117:0/556877317 conn(0x7f82e80714c0 msgr2=0x7f82e80fa810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:34.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.643+0000 7f82ee8d7700 1 -- 172.21.15.117:0/556877317 shutdown_connections 2024-04-12T09:20:34.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.643+0000 7f82ee8d7700 1 -- 172.21.15.117:0/556877317 wait complete. 2024-04-12T09:20:34.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.748+0000 7f54916ab700 1 -- 172.21.15.117:0/2506124295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f548c101d70 msgr2=0x7f548c102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:34.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.748+0000 7f54916ab700 1 --2- 172.21.15.117:0/2506124295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f548c101d70 0x7f548c102140 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5480004940 tx=0x7f5480009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:34.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.748+0000 7f54916ab700 1 -- 172.21.15.117:0/2506124295 shutdown_connections 2024-04-12T09:20:34.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.748+0000 7f54916ab700 1 --2- 172.21.15.117:0/2506124295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f548c102710 0x7f548c0fbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:34.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.748+0000 7f54916ab700 1 --2- 172.21.15.117:0/2506124295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f548c101d70 0x7f548c102140 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:34.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.749+0000 7f54916ab700 1 -- 172.21.15.117:0/2506124295 >> 172.21.15.117:0/2506124295 conn(0x7f548c072bc0 msgr2=0x7f548c072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:34.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.749+0000 7f54916ab700 1 -- 172.21.15.117:0/2506124295 shutdown_connections 2024-04-12T09:20:34.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.749+0000 7f54916ab700 1 -- 172.21.15.117:0/2506124295 wait complete. 2024-04-12T09:20:34.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.749+0000 7f54916ab700 1 Processor -- start 2024-04-12T09:20:34.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.749+0000 7f54916ab700 1 -- start start 2024-04-12T09:20:34.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.749+0000 7f54916ab700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f548c101d70 0x7f548c102bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:34.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.749+0000 7f54916ab700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f548c102710 0x7f548c103110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:34.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.749+0000 7f54916ab700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c103650 con 0x7f548c102710 2024-04-12T09:20:34.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.749+0000 7f54916ab700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c1037c0 con 0x7f548c101d70 2024-04-12T09:20:34.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.750+0000 7f548a7fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f548c102710 0x7f548c103110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:34.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.750+0000 7f548a7fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f548c102710 0x7f548c103110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40528/0 (socket says 172.21.15.117:40528) 2024-04-12T09:20:34.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.750+0000 7f548a7fc700 1 -- 172.21.15.117:0/2255278034 learned_addr learned my addr 172.21.15.117:0/2255278034 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:20:34.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.750+0000 7f548affd700 1 --2- 172.21.15.117:0/2255278034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f548c101d70 0x7f548c102bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:34.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.750+0000 7f548a7fc700 1 -- 172.21.15.117:0/2255278034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f548c101d70 msgr2=0x7f548c102bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:34.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.750+0000 7f548a7fc700 1 --2- 172.21.15.117:0/2255278034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f548c101d70 0x7f548c102bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:34.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.750+0000 7f548a7fc700 1 -- 172.21.15.117:0/2255278034 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5480005040 con 0x7f548c102710 2024-04-12T09:20:34.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.750+0000 7f548affd700 1 --2- 172.21.15.117:0/2255278034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f548c101d70 0x7f548c102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T09:20:34.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.750+0000 7f548a7fc700 1 --2- 172.21.15.117:0/2255278034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f548c102710 0x7f548c103110 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f547c00c890 tx=0x7f547c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:34.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.750+0000 7f54737fe700 1 -- 172.21.15.117:0/2255278034 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f547c00a7d0 con 0x7f548c102710 2024-04-12T09:20:34.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.750+0000 7f54737fe700 1 -- 172.21.15.117:0/2255278034 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f547c00ae00 con 0x7f548c102710 2024-04-12T09:20:34.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.750+0000 7f54737fe700 1 -- 172.21.15.117:0/2255278034 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f547c0113a0 con 0x7f548c102710 2024-04-12T09:20:34.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.750+0000 7f54916ab700 1 -- 172.21.15.117:0/2255278034 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548c119e20 con 0x7f548c102710 2024-04-12T09:20:34.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.750+0000 7f54916ab700 1 -- 172.21.15.117:0/2255278034 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548c11a220 con 0x7f548c102710 2024-04-12T09:20:34.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.751+0000 7f54916ab700 1 -- 172.21.15.117:0/2255278034 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548c0fd4c0 con 0x7f548c102710 2024-04-12T09:20:34.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.752+0000 7f54737fe700 1 -- 172.21.15.117:0/2255278034 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f547c012400 con 0x7f548c102710 2024-04-12T09:20:34.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.752+0000 7f54737fe700 1 --2- 172.21.15.117:0/2255278034 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f547406dca0 0x7f5474070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:20:34.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.752+0000 7f54737fe700 1 -- 172.21.15.117:0/2255278034 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f547c08d570 con 0x7f548c102710 2024-04-12T09:20:34.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.752+0000 7f548affd700 1 --2- 172.21.15.117:0/2255278034 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f547406dca0 0x7f5474070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:20:34.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.753+0000 7f548affd700 1 --2- 172.21.15.117:0/2255278034 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f547406dca0 0x7f5474070150 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5480004f90 tx=0x7f5480009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:20:34.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:34.757+0000 7f54737fe700 1 -- 172.21.15.117:0/2255278034 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f547c056c20 con 0x7f548c102710 2024-04-12T09:20:34.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:34 smithi117 ceph-mon[113571]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:20:34.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:34 smithi117 ceph-mon[113571]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:20:34.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:34 smithi117 ceph-mon[113571]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:20:34.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:34 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/2875349995' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:20:34.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:34 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/4074514697' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:20:34.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:34 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:34.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:34 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:35.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:35.049+0000 7f54916ab700 1 -- 172.21.15.117:0/2255278034 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f548c05f5f0 con 0x7f548c102710 2024-04-12T09:20:35.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:35.049+0000 7f54737fe700 1 -- 172.21.15.117:0/2255278034 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f547c05a2e0 con 0x7f548c102710 2024-04-12T09:20:35.050 INFO:teuthology.orchestra.run.smithi117.stdout:HEALTH_OK 2024-04-12T09:20:35.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:35.051+0000 7f54916ab700 1 -- 172.21.15.117:0/2255278034 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f547406dca0 msgr2=0x7f5474070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:35.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:35.051+0000 7f54916ab700 1 --2- 172.21.15.117:0/2255278034 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f547406dca0 0x7f5474070150 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5480004f90 tx=0x7f5480009e30 comp rx=0 tx=0).stop 2024-04-12T09:20:35.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:35.051+0000 7f54916ab700 1 -- 172.21.15.117:0/2255278034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f548c102710 msgr2=0x7f548c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:20:35.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:35.051+0000 7f54916ab700 1 --2- 172.21.15.117:0/2255278034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f548c102710 0x7f548c103110 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f547c00c890 tx=0x7f547c0044c0 comp rx=0 tx=0).stop 2024-04-12T09:20:35.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:35.052+0000 7f54916ab700 1 -- 172.21.15.117:0/2255278034 shutdown_connections 2024-04-12T09:20:35.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:35.052+0000 7f54916ab700 1 --2- 172.21.15.117:0/2255278034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f548c101d70 0x7f548c102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:35.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:35.052+0000 7f54916ab700 1 --2- 172.21.15.117:0/2255278034 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f547406dca0 0x7f5474070150 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:35.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:35.052+0000 7f54916ab700 1 --2- 172.21.15.117:0/2255278034 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f548c102710 0x7f548c103110 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:20:35.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:35.052+0000 7f54916ab700 1 -- 172.21.15.117:0/2255278034 >> 172.21.15.117:0/2255278034 conn(0x7f548c072bc0 msgr2=0x7f548c065940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:20:35.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:35.052+0000 7f54916ab700 1 -- 172.21.15.117:0/2255278034 shutdown_connections 2024-04-12T09:20:35.053 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:20:35.052+0000 7f54916ab700 1 -- 172.21.15.117:0/2255278034 wait complete. 2024-04-12T09:20:35.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:34 smithi203 ceph-mon[86783]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:20:35.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:34 smithi203 ceph-mon[86783]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:20:35.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:34 smithi203 ceph-mon[86783]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:20:35.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:34 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/2875349995' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:20:35.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:34 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/4074514697' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:20:35.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:34 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:35.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:34 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:36.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:35 smithi203 ceph-mon[86783]: pgmap v174: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:20:36.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:35 smithi203 ceph-mon[86783]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:20:36.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:35 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:36.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:35 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/2255278034' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:20:36.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:35 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:36.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:35 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:36.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:35 smithi117 ceph-mon[113571]: pgmap v174: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:20:36.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:35 smithi117 ceph-mon[113571]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:20:36.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:35 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:36.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:35 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/2255278034' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:20:36.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:35 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:36.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:35 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:38.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:37 smithi203 ceph-mon[86783]: pgmap v175: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:20:38.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:37 smithi117 ceph-mon[113571]: pgmap v175: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:20:40.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:39 smithi203 ceph-mon[86783]: pgmap v176: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:20:40.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:40.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:40.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:20:40.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:20:40.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:40.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:20:40.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:20:40.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:20:40.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:20:40.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:20:40.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:40.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:20:40.116 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:39 smithi117 ceph-mon[113571]: pgmap v176: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:20:40.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:40.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:40.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:20:40.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:20:40.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:40.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:20:40.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:20:40.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:20:40.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:20:40.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:20:40.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:40.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:20:41.938 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:41 smithi117 ceph-mon[113571]: pgmap v177: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:20:41.938 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:41 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:41.938 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:41 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.eslmxh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T09:20:41.938 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:41 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:20:42.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:41 smithi203 ceph-mon[86783]: pgmap v177: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:20:42.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:41 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:42.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:41 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.eslmxh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T09:20:42.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:41 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:20:42.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:42 smithi117 ceph-mon[113571]: Upgrade: Updating mds.cephfs.smithi117.eslmxh 2024-04-12T09:20:42.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:42 smithi117 ceph-mon[113571]: Deploying daemon mds.cephfs.smithi117.eslmxh on smithi117 2024-04-12T09:20:43.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:42 smithi203 ceph-mon[86783]: Upgrade: Updating mds.cephfs.smithi117.eslmxh 2024-04-12T09:20:43.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:42 smithi203 ceph-mon[86783]: Deploying daemon mds.cephfs.smithi117.eslmxh on smithi117 2024-04-12T09:20:43.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:43 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117[113567]: 2024-04-12T09:20:43.483+0000 7f68190ea700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T09:20:43.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:43 smithi117 ceph-mon[113571]: pgmap v178: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:20:43.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:43 smithi117 ceph-mon[113571]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-12T09:20:43.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:43 smithi117 ceph-mon[113571]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T09:20:43.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:43 smithi117 ceph-mon[113571]: osdmap e81: 6 total, 6 up, 6 in 2024-04-12T09:20:43.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:43 smithi117 ceph-mon[113571]: Standby daemon mds.cephfs.smithi203.fbeixl assigned to filesystem cephfs as rank 0 2024-04-12T09:20:43.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:43 smithi117 ceph-mon[113571]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-12T09:20:43.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:43 smithi117 ceph-mon[113571]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-12T09:20:43.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:43 smithi117 ceph-mon[113571]: fsmap cephfs:1/1 {0=cephfs.smithi203.fbeixl=up:replay} 2 up:standby 2024-04-12T09:20:44.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:43 smithi203 ceph-mon[86783]: pgmap v178: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:20:44.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:43 smithi203 ceph-mon[86783]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-12T09:20:44.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:43 smithi203 ceph-mon[86783]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T09:20:44.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:43 smithi203 ceph-mon[86783]: osdmap e81: 6 total, 6 up, 6 in 2024-04-12T09:20:44.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:43 smithi203 ceph-mon[86783]: Standby daemon mds.cephfs.smithi203.fbeixl assigned to filesystem cephfs as rank 0 2024-04-12T09:20:44.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:43 smithi203 ceph-mon[86783]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-12T09:20:44.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:43 smithi203 ceph-mon[86783]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-12T09:20:44.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:43 smithi203 ceph-mon[86783]: fsmap cephfs:1/1 {0=cephfs.smithi203.fbeixl=up:replay} 2 up:standby 2024-04-12T09:20:45.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:45 smithi117 ceph-mon[113571]: pgmap v180: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 0 op/s 2024-04-12T09:20:45.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:45 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.eslmxh"}]: dispatch 2024-04-12T09:20:46.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:45 smithi203 ceph-mon[86783]: pgmap v180: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 0 op/s 2024-04-12T09:20:46.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:45 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.eslmxh"}]: dispatch 2024-04-12T09:20:48.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:47 smithi203 ceph-mon[86783]: pgmap v181: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 1 op/s 2024-04-12T09:20:48.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:47 smithi117 ceph-mon[113571]: pgmap v181: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 1 op/s 2024-04-12T09:20:50.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:49 smithi203 ceph-mon[86783]: pgmap v182: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-04-12T09:20:50.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:49 smithi117 ceph-mon[113571]: pgmap v182: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-04-12T09:20:51.870 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:51 smithi117 ceph-mon[113571]: pgmap v183: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-12T09:20:52.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:51 smithi203 ceph-mon[86783]: pgmap v183: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-12T09:20:53.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:53 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:53.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:53 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:53.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:53 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:20:53.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:53 smithi117 ceph-mon[113571]: pgmap v184: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-04-12T09:20:53.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:53 smithi117 ceph-mon[113571]: reconnect by client.24317 192.168.0.1:0/3670805323 after 0 2024-04-12T09:20:53.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:53 smithi117 ceph-mon[113571]: reconnect by client.14524 192.168.0.1:0/32098587 after 0.000999975 2024-04-12T09:20:53.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:53 smithi117 ceph-mon[113571]: mds.? [v2:172.21.15.203:6824/840607003,v1:172.21.15.203:6825/840607003] up:reconnect 2024-04-12T09:20:53.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:53 smithi117 ceph-mon[113571]: mds.? [v2:172.21.15.117:6828/2675574893,v1:172.21.15.117:6829/2675574893] up:boot 2024-04-12T09:20:53.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:53 smithi117 ceph-mon[113571]: fsmap cephfs:1/1 {0=cephfs.smithi203.fbeixl=up:reconnect} 3 up:standby 2024-04-12T09:20:53.661 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:53 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.eslmxh"}]: dispatch 2024-04-12T09:20:53.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:53 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:53.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:53 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:53.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:53 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:20:53.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:53 smithi203 ceph-mon[86783]: pgmap v184: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-04-12T09:20:53.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:53 smithi203 ceph-mon[86783]: reconnect by client.24317 192.168.0.1:0/3670805323 after 0 2024-04-12T09:20:53.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:53 smithi203 ceph-mon[86783]: reconnect by client.14524 192.168.0.1:0/32098587 after 0.000999975 2024-04-12T09:20:53.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:53 smithi203 ceph-mon[86783]: mds.? [v2:172.21.15.203:6824/840607003,v1:172.21.15.203:6825/840607003] up:reconnect 2024-04-12T09:20:53.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:53 smithi203 ceph-mon[86783]: mds.? [v2:172.21.15.117:6828/2675574893,v1:172.21.15.117:6829/2675574893] up:boot 2024-04-12T09:20:53.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:53 smithi203 ceph-mon[86783]: fsmap cephfs:1/1 {0=cephfs.smithi203.fbeixl=up:reconnect} 3 up:standby 2024-04-12T09:20:53.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:53 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.eslmxh"}]: dispatch 2024-04-12T09:20:54.981 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:54 smithi117 ceph-mon[113571]: mds.? [v2:172.21.15.203:6824/840607003,v1:172.21.15.203:6825/840607003] up:rejoin 2024-04-12T09:20:54.981 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:54 smithi117 ceph-mon[113571]: fsmap cephfs:1/1 {0=cephfs.smithi203.fbeixl=up:rejoin} 3 up:standby 2024-04-12T09:20:54.981 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:54 smithi117 ceph-mon[113571]: daemon mds.cephfs.smithi203.fbeixl is now active in filesystem cephfs as rank 0 2024-04-12T09:20:54.981 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:54.981 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:20:55.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:54 smithi203 ceph-mon[86783]: mds.? [v2:172.21.15.203:6824/840607003,v1:172.21.15.203:6825/840607003] up:rejoin 2024-04-12T09:20:55.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:54 smithi203 ceph-mon[86783]: fsmap cephfs:1/1 {0=cephfs.smithi203.fbeixl=up:rejoin} 3 up:standby 2024-04-12T09:20:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:54 smithi203 ceph-mon[86783]: daemon mds.cephfs.smithi203.fbeixl is now active in filesystem cephfs as rank 0 2024-04-12T09:20:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:54 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:55.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:54 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:20:55.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:55 smithi203 ceph-mon[86783]: pgmap v185: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-12T09:20:55.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:55 smithi203 ceph-mon[86783]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-12T09:20:55.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:55 smithi203 ceph-mon[86783]: Cluster is now healthy 2024-04-12T09:20:55.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:55 smithi203 ceph-mon[86783]: mds.? [v2:172.21.15.203:6824/840607003,v1:172.21.15.203:6825/840607003] up:active 2024-04-12T09:20:55.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:55 smithi203 ceph-mon[86783]: fsmap cephfs:1 {0=cephfs.smithi203.fbeixl=up:active} 3 up:standby 2024-04-12T09:20:56.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:55 smithi117 ceph-mon[113571]: pgmap v185: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-12T09:20:56.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:55 smithi117 ceph-mon[113571]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-12T09:20:56.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:55 smithi117 ceph-mon[113571]: Cluster is now healthy 2024-04-12T09:20:56.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:55 smithi117 ceph-mon[113571]: mds.? [v2:172.21.15.203:6824/840607003,v1:172.21.15.203:6825/840607003] up:active 2024-04-12T09:20:56.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:55 smithi117 ceph-mon[113571]: fsmap cephfs:1 {0=cephfs.smithi203.fbeixl=up:active} 3 up:standby 2024-04-12T09:20:58.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:57 smithi203 ceph-mon[86783]: pgmap v186: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 5 op/s 2024-04-12T09:20:58.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:57 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:58.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:57 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:58.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:57 smithi117 ceph-mon[113571]: pgmap v186: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 5 op/s 2024-04-12T09:20:58.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:57 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:58.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:57 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:59.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:58 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:59.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:58 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:59.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:20:58 smithi117 ceph-mon[113571]: pgmap v187: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 511 B/s wr, 7 op/s 2024-04-12T09:20:59.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:58 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:59.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:58 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:20:59.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:20:58 smithi203 ceph-mon[86783]: pgmap v187: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 511 B/s wr, 7 op/s 2024-04-12T09:21:02.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:01 smithi203 ceph-mon[86783]: pgmap v188: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 4.2 MiB/s rd, 511 B/s wr, 4 op/s 2024-04-12T09:21:02.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:01 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:02.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:01 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:02.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:01 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:21:02.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:01 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:21:02.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:01 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:02.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:01 smithi117 ceph-mon[113571]: pgmap v188: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 4.2 MiB/s rd, 511 B/s wr, 4 op/s 2024-04-12T09:21:02.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:01 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:02.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:01 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:02.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:01 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:21:02.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:01 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:21:02.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:01 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:02.898 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:02 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:21:02.898 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:02 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:02.899 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:02 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:02.899 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:02 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:02.899 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:02 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:03.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:02 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:21:03.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:02 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:03.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:02 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:03.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:02 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:03.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:02 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:03.987 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:03 smithi203 ceph-mon[86783]: pgmap v189: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.8 KiB/s wr, 6 op/s 2024-04-12T09:21:03.987 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:03 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:03.987 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:03 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.fbeixl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T09:21:03.988 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:03 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:21:04.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:03 smithi117 ceph-mon[113571]: pgmap v189: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.8 KiB/s wr, 6 op/s 2024-04-12T09:21:04.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:03 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:04.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:03 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.fbeixl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T09:21:04.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:03 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:21:04.974 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:04 smithi203 ceph-mon[86783]: Upgrade: Updating mds.cephfs.smithi203.fbeixl 2024-04-12T09:21:04.974 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:04 smithi203 ceph-mon[86783]: Deploying daemon mds.cephfs.smithi203.fbeixl on smithi203 2024-04-12T09:21:05.060 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:04 smithi117 ceph-mon[113571]: Upgrade: Updating mds.cephfs.smithi203.fbeixl 2024-04-12T09:21:05.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:04 smithi117 ceph-mon[113571]: Deploying daemon mds.cephfs.smithi203.fbeixl on smithi203 2024-04-12T09:21:05.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.168+0000 7f0a46a63700 1 -- 172.21.15.117:0/2024416059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a401037a0 msgr2=0x7f0a400fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:05.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.168+0000 7f0a46a63700 1 --2- 172.21.15.117:0/2024416059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a401037a0 0x7f0a400fce10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0a34004940 tx=0x7f0a34009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:05.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.168+0000 7f0a46a63700 1 -- 172.21.15.117:0/2024416059 shutdown_connections 2024-04-12T09:21:05.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.168+0000 7f0a46a63700 1 --2- 172.21.15.117:0/2024416059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a401037a0 0x7f0a400fce10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:05.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.168+0000 7f0a46a63700 1 --2- 172.21.15.117:0/2024416059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a40102e00 0x7f0a401031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:05.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.168+0000 7f0a46a63700 1 -- 172.21.15.117:0/2024416059 >> 172.21.15.117:0/2024416059 conn(0x7f0a400f89b0 msgr2=0x7f0a400fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:05.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.168+0000 7f0a46a63700 1 -- 172.21.15.117:0/2024416059 shutdown_connections 2024-04-12T09:21:05.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.168+0000 7f0a46a63700 1 -- 172.21.15.117:0/2024416059 wait complete. 2024-04-12T09:21:05.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.168+0000 7f0a46a63700 1 Processor -- start 2024-04-12T09:21:05.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.169+0000 7f0a46a63700 1 -- start start 2024-04-12T09:21:05.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.169+0000 7f0a46a63700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a40102e00 0x7f0a400702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:05.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.169+0000 7f0a46a63700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a401037a0 0x7f0a40070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:05.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.169+0000 7f0a46a63700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a40072210 con 0x7f0a401037a0 2024-04-12T09:21:05.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.169+0000 7f0a46a63700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a40070d40 con 0x7f0a40102e00 2024-04-12T09:21:05.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.169+0000 7f0a3f7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a401037a0 0x7f0a40070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:05.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.169+0000 7f0a3f7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a401037a0 0x7f0a40070800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42526/0 (socket says 172.21.15.117:42526) 2024-04-12T09:21:05.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.169+0000 7f0a3f7fe700 1 -- 172.21.15.117:0/2718330675 learned_addr learned my addr 172.21.15.117:0/2718330675 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:21:05.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.169+0000 7f0a3ffff700 1 --2- 172.21.15.117:0/2718330675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a40102e00 0x7f0a400702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:05.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.169+0000 7f0a3f7fe700 1 -- 172.21.15.117:0/2718330675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a40102e00 msgr2=0x7f0a400702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:05.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.169+0000 7f0a3f7fe700 1 --2- 172.21.15.117:0/2718330675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a40102e00 0x7f0a400702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:05.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.169+0000 7f0a3f7fe700 1 -- 172.21.15.117:0/2718330675 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a34005040 con 0x7f0a401037a0 2024-04-12T09:21:05.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.169+0000 7f0a3f7fe700 1 --2- 172.21.15.117:0/2718330675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a401037a0 0x7f0a40070800 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009100 tx=0x7f0a34009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:05.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.170+0000 7f0a3cff9700 1 -- 172.21.15.117:0/2718330675 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a3400e040 con 0x7f0a401037a0 2024-04-12T09:21:05.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.170+0000 7f0a46a63700 1 -- 172.21.15.117:0/2718330675 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a40070fc0 con 0x7f0a401037a0 2024-04-12T09:21:05.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.170+0000 7f0a3cff9700 1 -- 172.21.15.117:0/2718330675 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0a34013420 con 0x7f0a401037a0 2024-04-12T09:21:05.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.170+0000 7f0a3cff9700 1 -- 172.21.15.117:0/2718330675 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a3401c630 con 0x7f0a401037a0 2024-04-12T09:21:05.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.170+0000 7f0a46a63700 1 -- 172.21.15.117:0/2718330675 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4011a0d0 con 0x7f0a401037a0 2024-04-12T09:21:05.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.171+0000 7f0a46a63700 1 -- 172.21.15.117:0/2718330675 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a401052d0 con 0x7f0a401037a0 2024-04-12T09:21:05.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.171+0000 7f0a3cff9700 1 -- 172.21.15.117:0/2718330675 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f0a34013a00 con 0x7f0a401037a0 2024-04-12T09:21:05.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.172+0000 7f0a3cff9700 1 --2- 172.21.15.117:0/2718330675 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f0a2806dca0 0x7f0a28070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:05.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.172+0000 7f0a3cff9700 1 -- 172.21.15.117:0/2718330675 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f0a3408e600 con 0x7f0a401037a0 2024-04-12T09:21:05.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.172+0000 7f0a3ffff700 1 --2- 172.21.15.117:0/2718330675 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f0a2806dca0 0x7f0a28070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:05.173 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.172+0000 7f0a3ffff700 1 --2- 172.21.15.117:0/2718330675 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f0a2806dca0 0x7f0a28070150 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0a300041d0 tx=0x7f0a300043c0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:05.177 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.176+0000 7f0a3cff9700 1 -- 172.21.15.117:0/2718330675 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f0a34057c60 con 0x7f0a401037a0 2024-04-12T09:21:05.398 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.398+0000 7f0a46a63700 1 -- 172.21.15.117:0/2718330675 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a40109f00 con 0x7f0a2806dca0 2024-04-12T09:21:05.399 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:05 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117[113567]: 2024-04-12T09:21:05.261+0000 7f68190ea700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T09:21:05.400 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.399+0000 7f0a3cff9700 1 -- 172.21.15.117:0/2718330675 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0a40109f00 con 0x7f0a2806dca0 2024-04-12T09:21:05.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.401+0000 7f0a46a63700 1 -- 172.21.15.117:0/2718330675 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f0a2806dca0 msgr2=0x7f0a28070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:05.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.401+0000 7f0a46a63700 1 --2- 172.21.15.117:0/2718330675 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f0a2806dca0 0x7f0a28070150 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0a300041d0 tx=0x7f0a300043c0 comp rx=0 tx=0).stop 2024-04-12T09:21:05.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.401+0000 7f0a46a63700 1 -- 172.21.15.117:0/2718330675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a401037a0 msgr2=0x7f0a40070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:05.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.401+0000 7f0a46a63700 1 --2- 172.21.15.117:0/2718330675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a401037a0 0x7f0a40070800 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009100 tx=0x7f0a34009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:05.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.401+0000 7f0a46a63700 1 -- 172.21.15.117:0/2718330675 shutdown_connections 2024-04-12T09:21:05.402 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.401+0000 7f0a46a63700 1 --2- 172.21.15.117:0/2718330675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a40102e00 0x7f0a400702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:05.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.401+0000 7f0a46a63700 1 --2- 172.21.15.117:0/2718330675 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f0a2806dca0 0x7f0a28070150 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:05.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.401+0000 7f0a46a63700 1 --2- 172.21.15.117:0/2718330675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a401037a0 0x7f0a40070800 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:05.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.401+0000 7f0a46a63700 1 -- 172.21.15.117:0/2718330675 >> 172.21.15.117:0/2718330675 conn(0x7f0a400f89b0 msgr2=0x7f0a40102200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:05.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.401+0000 7f0a46a63700 1 -- 172.21.15.117:0/2718330675 shutdown_connections 2024-04-12T09:21:05.403 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.401+0000 7f0a46a63700 1 -- 172.21.15.117:0/2718330675 wait complete. 2024-04-12T09:21:05.413 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:21:05.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.504+0000 7fadadcb2700 1 -- 172.21.15.117:0/1714475596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fada8103780 msgr2=0x7fada80fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:05.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.504+0000 7fadadcb2700 1 --2- 172.21.15.117:0/1714475596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fada8103780 0x7fada80fcdf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fad9c004940 tx=0x7fad9c009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:05.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.504+0000 7fadadcb2700 1 -- 172.21.15.117:0/1714475596 shutdown_connections 2024-04-12T09:21:05.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.504+0000 7fadadcb2700 1 --2- 172.21.15.117:0/1714475596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fada8103780 0x7fada80fcdf0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:05.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.504+0000 7fadadcb2700 1 --2- 172.21.15.117:0/1714475596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fada8102de0 0x7fada81031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:05.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.504+0000 7fadadcb2700 1 -- 172.21.15.117:0/1714475596 >> 172.21.15.117:0/1714475596 conn(0x7fada80f8950 msgr2=0x7fada80fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:05.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.504+0000 7fadadcb2700 1 -- 172.21.15.117:0/1714475596 shutdown_connections 2024-04-12T09:21:05.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.504+0000 7fadadcb2700 1 -- 172.21.15.117:0/1714475596 wait complete. 2024-04-12T09:21:05.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.504+0000 7fadadcb2700 1 Processor -- start 2024-04-12T09:21:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.505+0000 7fadadcb2700 1 -- start start 2024-04-12T09:21:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.505+0000 7fadadcb2700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fada8102de0 0x7fada81139a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.505+0000 7fadadcb2700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fada8103780 0x7fada8113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.505+0000 7fadadcb2700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada8114530 con 0x7fada8102de0 2024-04-12T09:21:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.505+0000 7fadadcb2700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada810db30 con 0x7fada8103780 2024-04-12T09:21:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.505+0000 7fada77fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fada8102de0 0x7fada81139a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.505+0000 7fada77fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fada8102de0 0x7fada81139a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42556/0 (socket says 172.21.15.117:42556) 2024-04-12T09:21:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.505+0000 7fada77fe700 1 -- 172.21.15.117:0/3291291657 learned_addr learned my addr 172.21.15.117:0/3291291657 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:21:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.505+0000 7fada6ffd700 1 --2- 172.21.15.117:0/3291291657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fada8103780 0x7fada8113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.505+0000 7fada77fe700 1 -- 172.21.15.117:0/3291291657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fada8103780 msgr2=0x7fada8113ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.505+0000 7fada77fe700 1 --2- 172.21.15.117:0/3291291657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fada8103780 0x7fada8113ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.505+0000 7fada77fe700 1 -- 172.21.15.117:0/3291291657 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c005040 con 0x7fada8102de0 2024-04-12T09:21:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.505+0000 7fada77fe700 1 --2- 172.21.15.117:0/3291291657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fada8102de0 0x7fada81139a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fad98001d00 tx=0x7fad98009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:05.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.505+0000 7fad8ffff700 1 -- 172.21.15.117:0/3291291657 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad98001e60 con 0x7fada8102de0 2024-04-12T09:21:05.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.506+0000 7fadadcb2700 1 -- 172.21.15.117:0/3291291657 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada810de10 con 0x7fada8102de0 2024-04-12T09:21:05.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.506+0000 7fad8ffff700 1 -- 172.21.15.117:0/3291291657 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad9800f040 con 0x7fada8102de0 2024-04-12T09:21:05.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.506+0000 7fad8ffff700 1 -- 172.21.15.117:0/3291291657 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad98009310 con 0x7fada8102de0 2024-04-12T09:21:05.508 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.506+0000 7fadadcb2700 1 -- 172.21.15.117:0/3291291657 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada810e3a0 con 0x7fada8102de0 2024-04-12T09:21:05.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.507+0000 7fadadcb2700 1 -- 172.21.15.117:0/3291291657 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada81052b0 con 0x7fada8102de0 2024-04-12T09:21:05.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.507+0000 7fad8ffff700 1 -- 172.21.15.117:0/3291291657 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fad98009470 con 0x7fada8102de0 2024-04-12T09:21:05.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.507+0000 7fad8ffff700 1 --2- 172.21.15.117:0/3291291657 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fad9006dca0 0x7fad90070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:05.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.508+0000 7fad8ffff700 1 -- 172.21.15.117:0/3291291657 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fad9808cee0 con 0x7fada8102de0 2024-04-12T09:21:05.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.508+0000 7fada6ffd700 1 --2- 172.21.15.117:0/3291291657 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fad9006dca0 0x7fad90070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:05.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.508+0000 7fada6ffd700 1 --2- 172.21.15.117:0/3291291657 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fad9006dca0 0x7fad90070150 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fada810ee10 tx=0x7fad9c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:05.512 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.512+0000 7fad8ffff700 1 -- 172.21.15.117:0/3291291657 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fad98059fa0 con 0x7fada8102de0 2024-04-12T09:21:05.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.727+0000 7fadadcb2700 1 -- 172.21.15.117:0/3291291657 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fada810eff0 con 0x7fad9006dca0 2024-04-12T09:21:05.729 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.728+0000 7fad8ffff700 1 -- 172.21.15.117:0/3291291657 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fada810eff0 con 0x7fad9006dca0 2024-04-12T09:21:05.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.730+0000 7fadadcb2700 1 -- 172.21.15.117:0/3291291657 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fad9006dca0 msgr2=0x7fad90070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:05.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.730+0000 7fadadcb2700 1 --2- 172.21.15.117:0/3291291657 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fad9006dca0 0x7fad90070150 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fada810ee10 tx=0x7fad9c009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:05.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.730+0000 7fadadcb2700 1 -- 172.21.15.117:0/3291291657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fada8102de0 msgr2=0x7fada81139a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:05.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.730+0000 7fadadcb2700 1 --2- 172.21.15.117:0/3291291657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fada8102de0 0x7fada81139a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fad98001d00 tx=0x7fad98009f30 comp rx=0 tx=0).stop 2024-04-12T09:21:05.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.730+0000 7fadadcb2700 1 -- 172.21.15.117:0/3291291657 shutdown_connections 2024-04-12T09:21:05.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.730+0000 7fadadcb2700 1 --2- 172.21.15.117:0/3291291657 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fad9006dca0 0x7fad90070150 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:05.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.730+0000 7fadadcb2700 1 --2- 172.21.15.117:0/3291291657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fada8102de0 0x7fada81139a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:05.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.730+0000 7fadadcb2700 1 --2- 172.21.15.117:0/3291291657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fada8103780 0x7fada8113ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:05.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.730+0000 7fadadcb2700 1 -- 172.21.15.117:0/3291291657 >> 172.21.15.117:0/3291291657 conn(0x7fada80f8950 msgr2=0x7fada81021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:05.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.730+0000 7fadadcb2700 1 -- 172.21.15.117:0/3291291657 shutdown_connections 2024-04-12T09:21:05.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.730+0000 7fadadcb2700 1 -- 172.21.15.117:0/3291291657 wait complete. 2024-04-12T09:21:05.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.832+0000 7f084adf6700 1 -- 172.21.15.117:0/1773936916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08441026b0 msgr2=0x7f08440fbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:05.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.832+0000 7f084adf6700 1 --2- 172.21.15.117:0/1773936916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08441026b0 0x7f08440fbd20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0830004940 tx=0x7f0830009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:05.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.832+0000 7f084adf6700 1 -- 172.21.15.117:0/1773936916 shutdown_connections 2024-04-12T09:21:05.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.832+0000 7f084adf6700 1 --2- 172.21.15.117:0/1773936916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08441026b0 0x7f08440fbd20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:05.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.832+0000 7f084adf6700 1 --2- 172.21.15.117:0/1773936916 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0844101d10 0x7f08441020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:05.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.832+0000 7f084adf6700 1 -- 172.21.15.117:0/1773936916 >> 172.21.15.117:0/1773936916 conn(0x7f08440f7880 msgr2=0x7f08440f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:05.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.832+0000 7f084adf6700 1 -- 172.21.15.117:0/1773936916 shutdown_connections 2024-04-12T09:21:05.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.832+0000 7f084adf6700 1 -- 172.21.15.117:0/1773936916 wait complete. 2024-04-12T09:21:05.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.833+0000 7f084adf6700 1 Processor -- start 2024-04-12T09:21:05.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.833+0000 7f084adf6700 1 -- start start 2024-04-12T09:21:05.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.833+0000 7f084adf6700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0844101d10 0x7f084410edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:05.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.833+0000 7f084adf6700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08441026b0 0x7f084410f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:05.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.833+0000 7f084adf6700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084410f950 con 0x7f08441026b0 2024-04-12T09:21:05.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.833+0000 7f084adf6700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084410fa90 con 0x7f0844101d10 2024-04-12T09:21:05.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.833+0000 7f0843fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08441026b0 0x7f084410f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:05.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.833+0000 7f0843fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08441026b0 0x7f084410f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42574/0 (socket says 172.21.15.117:42574) 2024-04-12T09:21:05.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.833+0000 7f0843fff700 1 -- 172.21.15.117:0/3556630322 learned_addr learned my addr 172.21.15.117:0/3556630322 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:21:05.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.833+0000 7f0848b92700 1 --2- 172.21.15.117:0/3556630322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0844101d10 0x7f084410edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:05.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.833+0000 7f0843fff700 1 -- 172.21.15.117:0/3556630322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0844101d10 msgr2=0x7f084410edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:05.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.833+0000 7f0843fff700 1 --2- 172.21.15.117:0/3556630322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0844101d10 0x7f084410edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:05.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.833+0000 7f0843fff700 1 -- 172.21.15.117:0/3556630322 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0830005040 con 0x7f08441026b0 2024-04-12T09:21:05.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.833+0000 7f0848b92700 1 --2- 172.21.15.117:0/3556630322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0844101d10 0x7f084410edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T09:21:05.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.834+0000 7f0843fff700 1 --2- 172.21.15.117:0/3556630322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08441026b0 0x7f084410f300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0830009b30 tx=0x7f0830009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:05.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.834+0000 7f08417fa700 1 -- 172.21.15.117:0/3556630322 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0830021070 con 0x7f08441026b0 2024-04-12T09:21:05.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.834+0000 7f08417fa700 1 -- 172.21.15.117:0/3556630322 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0830013cd0 con 0x7f08441026b0 2024-04-12T09:21:05.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.834+0000 7f084adf6700 1 -- 172.21.15.117:0/3556630322 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0844117e30 con 0x7f08441026b0 2024-04-12T09:21:05.836 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.834+0000 7f08417fa700 1 -- 172.21.15.117:0/3556630322 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f083000e070 con 0x7f08441026b0 2024-04-12T09:21:05.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.834+0000 7f084adf6700 1 -- 172.21.15.117:0/3556630322 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0844118290 con 0x7f08441026b0 2024-04-12T09:21:05.837 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.835+0000 7f084adf6700 1 -- 172.21.15.117:0/3556630322 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08440fd460 con 0x7f08441026b0 2024-04-12T09:21:05.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.835+0000 7f08417fa700 1 -- 172.21.15.117:0/3556630322 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f083001cad0 con 0x7f08441026b0 2024-04-12T09:21:05.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.836+0000 7f08417fa700 1 --2- 172.21.15.117:0/3556630322 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f083406dca0 0x7f0834070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:05.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.836+0000 7f08417fa700 1 -- 172.21.15.117:0/3556630322 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f083008e980 con 0x7f08441026b0 2024-04-12T09:21:05.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.836+0000 7f0848b92700 1 --2- 172.21.15.117:0/3556630322 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f083406dca0 0x7f0834070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:05.838 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.836+0000 7f0848b92700 1 --2- 172.21.15.117:0/3556630322 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f083406dca0 0x7f0834070150 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0838009b80 tx=0x7f083800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:05.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:05.841+0000 7f08417fa700 1 -- 172.21.15.117:0/3556630322 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f0830057f90 con 0x7f08441026b0 2024-04-12T09:21:06.044 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.043+0000 7f084adf6700 1 -- 172.21.15.117:0/3556630322 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0844108e60 con 0x7f083406dca0 2024-04-12T09:21:06.044 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:05 smithi117 ceph-mon[113571]: pgmap v190: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 4.8 KiB/s wr, 5 op/s 2024-04-12T09:21:06.044 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:05 smithi117 ceph-mon[113571]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-12T09:21:06.044 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:05 smithi117 ceph-mon[113571]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T09:21:06.044 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:05 smithi117 ceph-mon[113571]: osdmap e82: 6 total, 6 up, 6 in 2024-04-12T09:21:06.045 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:05 smithi117 ceph-mon[113571]: Standby daemon mds.cephfs.smithi203.bszhxz assigned to filesystem cephfs as rank 0 2024-04-12T09:21:06.045 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:05 smithi117 ceph-mon[113571]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-12T09:21:06.045 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:05 smithi117 ceph-mon[113571]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-12T09:21:06.045 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:05 smithi117 ceph-mon[113571]: fsmap cephfs:1/1 {0=cephfs.smithi203.bszhxz=up:replay} 2 up:standby 2024-04-12T09:21:06.045 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:05 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.fbeixl"}]: dispatch 2024-04-12T09:21:06.054 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.054+0000 7f08417fa700 1 -- 172.21.15.117:0/3556630322 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f0844108e60 con 0x7f083406dca0 2024-04-12T09:21:06.054 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:21:06.055 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 running (6m) 9s ago 18m 27.0M - 0.25.0 c8568f914cd2 204687f21ed7 2024-04-12T09:21:06.055 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (4m) 9s ago 18m 6656k - 19.0.0-2053-gb277feb2 668895944f0e 038f567b664b 2024-04-12T09:21:06.055 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (4m) 50s ago 17m 6660k - 19.0.0-2053-gb277feb2 668895944f0e 420dee66e230 2024-04-12T09:21:06.055 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 running (6m) 9s ago 17m 78.9M - 9.4.12 2bacad6d85d8 a7b102216886 2024-04-12T09:21:06.055 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (14s) 9s ago 12m 12.5M - 19.0.0-2053-gb277feb2 668895944f0e 561830e21baa 2024-04-12T09:21:06.055 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 running (37s) 9s ago 12m 11.8M - 19.0.0-2053-gb277feb2 668895944f0e 642a35bff3ee 2024-04-12T09:21:06.055 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (12m) 50s ago 12m 17.7M - 17.2.7-827-gd3b5060a 21de9b7369ad b05228e997f7 2024-04-12T09:21:06.055 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (12m) 50s ago 12m 18.0M - 17.2.7-827-gd3b5060a 21de9b7369ad 6d7f82c072c7 2024-04-12T09:21:06.055 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:8443,9283,8765 running (8m) 9s ago 19m 508M - 19.0.0-2053-gb277feb2 668895944f0e fee613d05ab7 2024-04-12T09:21:06.055 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283,8765 running (7m) 50s ago 17m 451M - 19.0.0-2053-gb277feb2 668895944f0e c793944c3e16 2024-04-12T09:21:06.055 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (5m) 9s ago 19m 55.2M 2048M 19.0.0-2053-gb277feb2 668895944f0e 6823aaff30ce 2024-04-12T09:21:06.055 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (4m) 50s ago 17m 40.6M 2048M 19.0.0-2053-gb277feb2 668895944f0e 006c6e487bfb 2024-04-12T09:21:06.055 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 running (7m) 9s ago 18m 16.8M - 1.5.0 0da6a335fe13 c692bed9f6c7 2024-04-12T09:21:06.056 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (7m) 50s ago 17m 15.5M - 1.5.0 0da6a335fe13 f3b5a470f545 2024-04-12T09:21:06.056 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (3m) 9s ago 16m 97.9M 1557M 19.0.0-2053-gb277feb2 668895944f0e 59a180461e3c 2024-04-12T09:21:06.056 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (3m) 9s ago 16m 105M 1557M 19.0.0-2053-gb277feb2 668895944f0e d40e2dfc164b 2024-04-12T09:21:06.056 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (2m) 9s ago 15m 97.7M 1557M 19.0.0-2053-gb277feb2 668895944f0e fd7d5481cddb 2024-04-12T09:21:06.056 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (2m) 50s ago 15m 116M 2581M 19.0.0-2053-gb277feb2 668895944f0e 961db53f9ab1 2024-04-12T09:21:06.056 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (86s) 50s ago 14m 102M 2581M 19.0.0-2053-gb277feb2 668895944f0e 7ec45de1eea6 2024-04-12T09:21:06.056 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (53s) 50s ago 14m 12.0M 2581M 19.0.0-2053-gb277feb2 668895944f0e ad918b4139f7 2024-04-12T09:21:06.056 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 running (7m) 9s ago 17m 61.0M - 2.43.0 a07b618ecd1d 43ce588d82cc 2024-04-12T09:21:06.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.056+0000 7f084adf6700 1 -- 172.21.15.117:0/3556630322 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f083406dca0 msgr2=0x7f0834070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:06.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.056+0000 7f084adf6700 1 --2- 172.21.15.117:0/3556630322 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f083406dca0 0x7f0834070150 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0838009b80 tx=0x7f083800b040 comp rx=0 tx=0).stop 2024-04-12T09:21:06.057 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.056+0000 7f084adf6700 1 -- 172.21.15.117:0/3556630322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08441026b0 msgr2=0x7f084410f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:06.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.056+0000 7f084adf6700 1 --2- 172.21.15.117:0/3556630322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08441026b0 0x7f084410f300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0830009b30 tx=0x7f0830009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:06.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.056+0000 7f084adf6700 1 -- 172.21.15.117:0/3556630322 shutdown_connections 2024-04-12T09:21:06.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.056+0000 7f084adf6700 1 --2- 172.21.15.117:0/3556630322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0844101d10 0x7f084410edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:06.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.056+0000 7f084adf6700 1 --2- 172.21.15.117:0/3556630322 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f083406dca0 0x7f0834070150 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:06.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.056+0000 7f084adf6700 1 --2- 172.21.15.117:0/3556630322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08441026b0 0x7f084410f300 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:06.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.056+0000 7f084adf6700 1 -- 172.21.15.117:0/3556630322 >> 172.21.15.117:0/3556630322 conn(0x7f08440f7880 msgr2=0x7f08440f8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:06.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.056+0000 7f084adf6700 1 -- 172.21.15.117:0/3556630322 shutdown_connections 2024-04-12T09:21:06.058 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.056+0000 7f084adf6700 1 -- 172.21.15.117:0/3556630322 wait complete. 2024-04-12T09:21:06.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:05 smithi203 ceph-mon[86783]: pgmap v190: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 4.8 KiB/s wr, 5 op/s 2024-04-12T09:21:06.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:05 smithi203 ceph-mon[86783]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-12T09:21:06.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:05 smithi203 ceph-mon[86783]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T09:21:06.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:05 smithi203 ceph-mon[86783]: osdmap e82: 6 total, 6 up, 6 in 2024-04-12T09:21:06.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:05 smithi203 ceph-mon[86783]: Standby daemon mds.cephfs.smithi203.bszhxz assigned to filesystem cephfs as rank 0 2024-04-12T09:21:06.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:05 smithi203 ceph-mon[86783]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-12T09:21:06.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:05 smithi203 ceph-mon[86783]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-12T09:21:06.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:05 smithi203 ceph-mon[86783]: fsmap cephfs:1/1 {0=cephfs.smithi203.bszhxz=up:replay} 2 up:standby 2024-04-12T09:21:06.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:05 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.fbeixl"}]: dispatch 2024-04-12T09:21:06.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.156+0000 7f84ba39d700 1 -- 172.21.15.117:0/3837540637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84b40fdc40 msgr2=0x7f84b40fe010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:06.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.156+0000 7f84ba39d700 1 --2- 172.21.15.117:0/3837540637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84b40fdc40 0x7f84b40fe010 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f84b0004940 tx=0x7f84b0009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:06.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.157+0000 7f84ba39d700 1 -- 172.21.15.117:0/3837540637 shutdown_connections 2024-04-12T09:21:06.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.157+0000 7f84ba39d700 1 --2- 172.21.15.117:0/3837540637 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84b40fe5e0 0x7f84b4106c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:06.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.157+0000 7f84ba39d700 1 --2- 172.21.15.117:0/3837540637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84b40fdc40 0x7f84b40fe010 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:06.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.157+0000 7f84ba39d700 1 -- 172.21.15.117:0/3837540637 >> 172.21.15.117:0/3837540637 conn(0x7f84b40f7670 msgr2=0x7f84b40f9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:06.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.157+0000 7f84ba39d700 1 -- 172.21.15.117:0/3837540637 shutdown_connections 2024-04-12T09:21:06.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.157+0000 7f84ba39d700 1 -- 172.21.15.117:0/3837540637 wait complete. 2024-04-12T09:21:06.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.157+0000 7f84ba39d700 1 Processor -- start 2024-04-12T09:21:06.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.157+0000 7f84ba39d700 1 -- start start 2024-04-12T09:21:06.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.157+0000 7f84ba39d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84b40fdc40 0x7f84b40fba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:06.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.157+0000 7f84ba39d700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84b40fe5e0 0x7f84b40fbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:06.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.157+0000 7f84ba39d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b40fc540 con 0x7f84b40fdc40 2024-04-12T09:21:06.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.157+0000 7f84ba39d700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b40fc680 con 0x7f84b40fe5e0 2024-04-12T09:21:06.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.157+0000 7f84b939b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84b40fdc40 0x7f84b40fba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:06.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.158+0000 7f84b939b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84b40fdc40 0x7f84b40fba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42588/0 (socket says 172.21.15.117:42588) 2024-04-12T09:21:06.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.158+0000 7f84b939b700 1 -- 172.21.15.117:0/360091764 learned_addr learned my addr 172.21.15.117:0/360091764 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:21:06.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.158+0000 7f84b8b9a700 1 --2- 172.21.15.117:0/360091764 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84b40fe5e0 0x7f84b40fbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:06.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.158+0000 7f84b939b700 1 -- 172.21.15.117:0/360091764 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84b40fe5e0 msgr2=0x7f84b40fbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:06.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.158+0000 7f84b939b700 1 --2- 172.21.15.117:0/360091764 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84b40fe5e0 0x7f84b40fbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:06.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.158+0000 7f84b939b700 1 -- 172.21.15.117:0/360091764 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b0005040 con 0x7f84b40fdc40 2024-04-12T09:21:06.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.158+0000 7f84b939b700 1 --2- 172.21.15.117:0/360091764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84b40fdc40 0x7f84b40fba70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f84b0004890 tx=0x7f84b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:06.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.158+0000 7f84a9ffb700 1 -- 172.21.15.117:0/360091764 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84b000e040 con 0x7f84b40fdc40 2024-04-12T09:21:06.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.158+0000 7f84a9ffb700 1 -- 172.21.15.117:0/360091764 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f84b0009af0 con 0x7f84b40fdc40 2024-04-12T09:21:06.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.158+0000 7f84ba39d700 1 -- 172.21.15.117:0/360091764 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b40fc8d0 con 0x7f84b40fdc40 2024-04-12T09:21:06.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.158+0000 7f84a9ffb700 1 -- 172.21.15.117:0/360091764 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84b001c3f0 con 0x7f84b40fdc40 2024-04-12T09:21:06.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.158+0000 7f84ba39d700 1 -- 172.21.15.117:0/360091764 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b4119ff0 con 0x7f84b40fdc40 2024-04-12T09:21:06.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.159+0000 7f84ba39d700 1 -- 172.21.15.117:0/360091764 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b4066930 con 0x7f84b40fdc40 2024-04-12T09:21:06.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.160+0000 7f84a9ffb700 1 -- 172.21.15.117:0/360091764 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f84b000baf0 con 0x7f84b40fdc40 2024-04-12T09:21:06.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.160+0000 7f84a9ffb700 1 --2- 172.21.15.117:0/360091764 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f84a006dca0 0x7f84a0070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:06.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.160+0000 7f84a9ffb700 1 -- 172.21.15.117:0/360091764 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f84b008e800 con 0x7f84b40fdc40 2024-04-12T09:21:06.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.160+0000 7f84b8b9a700 1 --2- 172.21.15.117:0/360091764 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f84a006dca0 0x7f84a0070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:06.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.161+0000 7f84b8b9a700 1 --2- 172.21.15.117:0/360091764 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f84a006dca0 0x7f84a0070150 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f84b40fd3b0 tx=0x7f84a400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:06.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.165+0000 7f84a9ffb700 1 -- 172.21.15.117:0/360091764 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f84b0057d90 con 0x7f84b40fdc40 2024-04-12T09:21:06.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.445+0000 7f84ba39d700 1 -- 172.21.15.117:0/360091764 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f84b404bf00 con 0x7f84b40fdc40 2024-04-12T09:21:06.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.445+0000 7f84a9ffb700 1 -- 172.21.15.117:0/360091764 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7f84b005b450 con 0x7f84b40fdc40 2024-04-12T09:21:06.446 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:21:06.446 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": { 2024-04-12T09:21:06.446 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:21:06.446 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:21:06.446 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": { 2024-04-12T09:21:06.447 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:21:06.447 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:21:06.447 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": { 2024-04-12T09:21:06.447 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 6 2024-04-12T09:21:06.447 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:21:06.447 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-04-12T09:21:06.447 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 1, 2024-04-12T09:21:06.447 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:21:06.447 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:21:06.447 INFO:teuthology.orchestra.run.smithi117.stdout: "overall": { 2024-04-12T09:21:06.447 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 17.2.7-827-gd3b5060a (d3b5060a17449edfae9385cdf792afec109fca5d) quincy (stable)": 1, 2024-04-12T09:21:06.447 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 12 2024-04-12T09:21:06.447 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:21:06.447 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:21:06.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.448+0000 7f84ba39d700 1 -- 172.21.15.117:0/360091764 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f84a006dca0 msgr2=0x7f84a0070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:06.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.448+0000 7f84ba39d700 1 --2- 172.21.15.117:0/360091764 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f84a006dca0 0x7f84a0070150 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f84b40fd3b0 tx=0x7f84a400b040 comp rx=0 tx=0).stop 2024-04-12T09:21:06.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.448+0000 7f84ba39d700 1 -- 172.21.15.117:0/360091764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84b40fdc40 msgr2=0x7f84b40fba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:06.448 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.448+0000 7f84ba39d700 1 --2- 172.21.15.117:0/360091764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84b40fdc40 0x7f84b40fba70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f84b0004890 tx=0x7f84b0009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:06.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.448+0000 7f84ba39d700 1 -- 172.21.15.117:0/360091764 shutdown_connections 2024-04-12T09:21:06.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.448+0000 7f84ba39d700 1 --2- 172.21.15.117:0/360091764 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f84a006dca0 0x7f84a0070150 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:06.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.448+0000 7f84ba39d700 1 --2- 172.21.15.117:0/360091764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84b40fdc40 0x7f84b40fba70 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:06.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.448+0000 7f84ba39d700 1 --2- 172.21.15.117:0/360091764 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84b40fe5e0 0x7f84b40fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:06.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.448+0000 7f84ba39d700 1 -- 172.21.15.117:0/360091764 >> 172.21.15.117:0/360091764 conn(0x7f84b40f7670 msgr2=0x7f84b40f8c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:06.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.448+0000 7f84ba39d700 1 -- 172.21.15.117:0/360091764 shutdown_connections 2024-04-12T09:21:06.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.448+0000 7f84ba39d700 1 -- 172.21.15.117:0/360091764 wait complete. 2024-04-12T09:21:06.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.550+0000 7f226a92d700 1 -- 172.21.15.117:0/134051433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2264101d10 msgr2=0x7f22641020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:06.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.550+0000 7f226a92d700 1 --2- 172.21.15.117:0/134051433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2264101d10 0x7f22641020e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2254004940 tx=0x7f2254009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:06.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.550+0000 7f226a92d700 1 -- 172.21.15.117:0/134051433 shutdown_connections 2024-04-12T09:21:06.551 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.550+0000 7f226a92d700 1 --2- 172.21.15.117:0/134051433 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f22641026b0 0x7f22640fbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:06.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.550+0000 7f226a92d700 1 --2- 172.21.15.117:0/134051433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2264101d10 0x7f22641020e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:06.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.550+0000 7f226a92d700 1 -- 172.21.15.117:0/134051433 >> 172.21.15.117:0/134051433 conn(0x7f22640f7860 msgr2=0x7f22640f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:06.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.550+0000 7f226a92d700 1 -- 172.21.15.117:0/134051433 shutdown_connections 2024-04-12T09:21:06.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.550+0000 7f226a92d700 1 -- 172.21.15.117:0/134051433 wait complete. 2024-04-12T09:21:06.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.551+0000 7f226a92d700 1 Processor -- start 2024-04-12T09:21:06.552 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.551+0000 7f226a92d700 1 -- start start 2024-04-12T09:21:06.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.551+0000 7f226a92d700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2264101d10 0x7f226410eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:06.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.551+0000 7f226a92d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22641026b0 0x7f226410f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:06.553 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.551+0000 7f226a92d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226410f770 con 0x7f22641026b0 2024-04-12T09:21:06.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.551+0000 7f226a92d700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226410f8b0 con 0x7f2264101d10 2024-04-12T09:21:06.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.551+0000 7f22637fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22641026b0 0x7f226410f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:06.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.551+0000 7f22637fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22641026b0 0x7f226410f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42600/0 (socket says 172.21.15.117:42600) 2024-04-12T09:21:06.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.551+0000 7f22637fe700 1 -- 172.21.15.117:0/2004533510 learned_addr learned my addr 172.21.15.117:0/2004533510 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:21:06.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.551+0000 7f2263fff700 1 --2- 172.21.15.117:0/2004533510 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2264101d10 0x7f226410eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:06.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.552+0000 7f22637fe700 1 -- 172.21.15.117:0/2004533510 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2264101d10 msgr2=0x7f226410eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:06.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.552+0000 7f22637fe700 1 --2- 172.21.15.117:0/2004533510 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2264101d10 0x7f226410eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:06.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.552+0000 7f22637fe700 1 -- 172.21.15.117:0/2004533510 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2254005040 con 0x7f22641026b0 2024-04-12T09:21:06.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.552+0000 7f22637fe700 1 --2- 172.21.15.117:0/2004533510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22641026b0 0x7f226410f090 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f225800b790 tx=0x7f2258009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:06.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.552+0000 7f2260ff9700 1 -- 172.21.15.117:0/2004533510 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f225800f6f0 con 0x7f22641026b0 2024-04-12T09:21:06.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.552+0000 7f2260ff9700 1 -- 172.21.15.117:0/2004533510 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f225800fd20 con 0x7f22641026b0 2024-04-12T09:21:06.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.552+0000 7f2260ff9700 1 -- 172.21.15.117:0/2004533510 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22580103a0 con 0x7f22641026b0 2024-04-12T09:21:06.554 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.552+0000 7f226a92d700 1 -- 172.21.15.117:0/2004533510 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2264117c20 con 0x7f22641026b0 2024-04-12T09:21:06.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.552+0000 7f226a92d700 1 -- 172.21.15.117:0/2004533510 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22641180e0 con 0x7f22641026b0 2024-04-12T09:21:06.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.553+0000 7f226a92d700 1 -- 172.21.15.117:0/2004533510 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22640fd460 con 0x7f22641026b0 2024-04-12T09:21:06.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.553+0000 7f2260ff9700 1 -- 172.21.15.117:0/2004533510 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f2258011400 con 0x7f22641026b0 2024-04-12T09:21:06.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.554+0000 7f2260ff9700 1 --2- 172.21.15.117:0/2004533510 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f224c06dca0 0x7f224c070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:06.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.554+0000 7f2260ff9700 1 -- 172.21.15.117:0/2004533510 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f225808d310 con 0x7f22641026b0 2024-04-12T09:21:06.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.554+0000 7f2263fff700 1 --2- 172.21.15.117:0/2004533510 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f224c06dca0 0x7f224c070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:06.556 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.554+0000 7f2263fff700 1 --2- 172.21.15.117:0/2004533510 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f224c06dca0 0x7f224c070150 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2254004f90 tx=0x7f2254009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:06.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.559+0000 7f2260ff9700 1 -- 172.21.15.117:0/2004533510 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f2258056920 con 0x7f22641026b0 2024-04-12T09:21:06.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.801+0000 7f226a92d700 1 -- 172.21.15.117:0/2004533510 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f226405f5f0 con 0x7f22641026b0 2024-04-12T09:21:06.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.802+0000 7f2260ff9700 1 -- 172.21.15.117:0/2004533510 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1710 (secure 0 0 0) 0x7f2258059fe0 con 0x7f22641026b0 2024-04-12T09:21:06.803 INFO:teuthology.orchestra.run.smithi117.stdout:e23 2024-04-12T09:21:06.803 INFO:teuthology.orchestra.run.smithi117.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T09:21:06.803 INFO:teuthology.orchestra.run.smithi117.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:21:06.803 INFO:teuthology.orchestra.run.smithi117.stdout:legacy client fscid: 1 2024-04-12T09:21:06.803 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:21:06.803 INFO:teuthology.orchestra.run.smithi117.stdout:Filesystem 'cephfs' (1) 2024-04-12T09:21:06.803 INFO:teuthology.orchestra.run.smithi117.stdout:fs_name cephfs 2024-04-12T09:21:06.803 INFO:teuthology.orchestra.run.smithi117.stdout:epoch 23 2024-04-12T09:21:06.803 INFO:teuthology.orchestra.run.smithi117.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T09:21:06.803 INFO:teuthology.orchestra.run.smithi117.stdout:created 2024-04-12T09:08:12.488144+0000 2024-04-12T09:21:06.803 INFO:teuthology.orchestra.run.smithi117.stdout:modified 2024-04-12T09:21:05.266388+0000 2024-04-12T09:21:06.803 INFO:teuthology.orchestra.run.smithi117.stdout:tableserver 0 2024-04-12T09:21:06.803 INFO:teuthology.orchestra.run.smithi117.stdout:root 0 2024-04-12T09:21:06.804 INFO:teuthology.orchestra.run.smithi117.stdout:session_timeout 60 2024-04-12T09:21:06.804 INFO:teuthology.orchestra.run.smithi117.stdout:session_autoclose 300 2024-04-12T09:21:06.804 INFO:teuthology.orchestra.run.smithi117.stdout:max_file_size 1099511627776 2024-04-12T09:21:06.804 INFO:teuthology.orchestra.run.smithi117.stdout:max_xattr_size 65536 2024-04-12T09:21:06.804 INFO:teuthology.orchestra.run.smithi117.stdout:required_client_features {} 2024-04-12T09:21:06.804 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure 0 2024-04-12T09:21:06.804 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure_osd_epoch 82 2024-04-12T09:21:06.804 INFO:teuthology.orchestra.run.smithi117.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:21:06.804 INFO:teuthology.orchestra.run.smithi117.stdout:max_mds 1 2024-04-12T09:21:06.804 INFO:teuthology.orchestra.run.smithi117.stdout:in 0 2024-04-12T09:21:06.804 INFO:teuthology.orchestra.run.smithi117.stdout:up {0=24273} 2024-04-12T09:21:06.804 INFO:teuthology.orchestra.run.smithi117.stdout:failed 2024-04-12T09:21:06.804 INFO:teuthology.orchestra.run.smithi117.stdout:damaged 2024-04-12T09:21:06.804 INFO:teuthology.orchestra.run.smithi117.stdout:stopped 2024-04-12T09:21:06.805 INFO:teuthology.orchestra.run.smithi117.stdout:data_pools [3] 2024-04-12T09:21:06.805 INFO:teuthology.orchestra.run.smithi117.stdout:metadata_pool 2 2024-04-12T09:21:06.805 INFO:teuthology.orchestra.run.smithi117.stdout:inline_data disabled 2024-04-12T09:21:06.805 INFO:teuthology.orchestra.run.smithi117.stdout:balancer 2024-04-12T09:21:06.805 INFO:teuthology.orchestra.run.smithi117.stdout:bal_rank_mask -1 2024-04-12T09:21:06.805 INFO:teuthology.orchestra.run.smithi117.stdout:standby_count_wanted 1 2024-04-12T09:21:06.805 INFO:teuthology.orchestra.run.smithi117.stdout:qdb_cluster leader: 0 members: 2024-04-12T09:21:06.805 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.bszhxz{0:24273} state up:replay seq 2 join_fscid=1 addr [v2:172.21.15.203:6826/2731911290,v1:172.21.15.203:6827/2731911290] compat {c=[1],r=[1],i=[7ff]}] 2024-04-12T09:21:06.805 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:21:06.805 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:21:06.805 INFO:teuthology.orchestra.run.smithi117.stdout:Standby daemons: 2024-04-12T09:21:06.805 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:21:06.805 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.wddsgt{-1:34372} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/2687704577,v1:172.21.15.117:6827/2687704577] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T09:21:06.805 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.eslmxh{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6828/2675574893,v1:172.21.15.117:6829/2675574893] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T09:21:06.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.805+0000 7f226a92d700 1 -- 172.21.15.117:0/2004533510 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f224c06dca0 msgr2=0x7f224c070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:06.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.805+0000 7f226a92d700 1 --2- 172.21.15.117:0/2004533510 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f224c06dca0 0x7f224c070150 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2254004f90 tx=0x7f2254009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:06.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.805+0000 7f226a92d700 1 -- 172.21.15.117:0/2004533510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22641026b0 msgr2=0x7f226410f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:06.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.805+0000 7f226a92d700 1 --2- 172.21.15.117:0/2004533510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22641026b0 0x7f226410f090 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f225800b790 tx=0x7f2258009220 comp rx=0 tx=0).stop 2024-04-12T09:21:06.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.805+0000 7f226a92d700 1 -- 172.21.15.117:0/2004533510 shutdown_connections 2024-04-12T09:21:06.806 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.805+0000 7f226a92d700 1 --2- 172.21.15.117:0/2004533510 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2264101d10 0x7f226410eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:06.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.805+0000 7f226a92d700 1 --2- 172.21.15.117:0/2004533510 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f224c06dca0 0x7f224c070150 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:06.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.805+0000 7f226a92d700 1 --2- 172.21.15.117:0/2004533510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22641026b0 0x7f226410f090 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:06.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.805+0000 7f226a92d700 1 -- 172.21.15.117:0/2004533510 >> 172.21.15.117:0/2004533510 conn(0x7f22640f7860 msgr2=0x7f22640f8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:06.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.805+0000 7f226a92d700 1 -- 172.21.15.117:0/2004533510 shutdown_connections 2024-04-12T09:21:06.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.805+0000 7f226a92d700 1 -- 172.21.15.117:0/2004533510 wait complete. 2024-04-12T09:21:06.807 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 23 2024-04-12T09:21:06.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.907+0000 7f312cf3a700 1 -- 172.21.15.117:0/2525201059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31281026b0 msgr2=0x7f31280fbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:06.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.907+0000 7f312cf3a700 1 --2- 172.21.15.117:0/2525201059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31281026b0 0x7f31280fbd20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f311c004940 tx=0x7f311c009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:06.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.907+0000 7f312cf3a700 1 -- 172.21.15.117:0/2525201059 shutdown_connections 2024-04-12T09:21:06.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.907+0000 7f312cf3a700 1 --2- 172.21.15.117:0/2525201059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31281026b0 0x7f31280fbd20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:06.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.907+0000 7f312cf3a700 1 --2- 172.21.15.117:0/2525201059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3128101d10 0x7f31281020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:06.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.907+0000 7f312cf3a700 1 -- 172.21.15.117:0/2525201059 >> 172.21.15.117:0/2525201059 conn(0x7f31280f7880 msgr2=0x7f31280f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:06.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.907+0000 7f312cf3a700 1 -- 172.21.15.117:0/2525201059 shutdown_connections 2024-04-12T09:21:06.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.907+0000 7f312cf3a700 1 -- 172.21.15.117:0/2525201059 wait complete. 2024-04-12T09:21:06.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.908+0000 7f312cf3a700 1 Processor -- start 2024-04-12T09:21:06.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.908+0000 7f312cf3a700 1 -- start start 2024-04-12T09:21:06.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.908+0000 7f312cf3a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3128101d10 0x7f31281127f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:06.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.908+0000 7f312cf3a700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31281026b0 0x7f3128112d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:06.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.908+0000 7f312cf3a700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3128113380 con 0x7f3128101d10 2024-04-12T09:21:06.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.908+0000 7f312cf3a700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312810c980 con 0x7f31281026b0 2024-04-12T09:21:06.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.908+0000 7f312659c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3128101d10 0x7f31281127f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:06.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.908+0000 7f312659c700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3128101d10 0x7f31281127f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42614/0 (socket says 172.21.15.117:42614) 2024-04-12T09:21:06.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.908+0000 7f312659c700 1 -- 172.21.15.117:0/3181015062 learned_addr learned my addr 172.21.15.117:0/3181015062 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:21:06.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.908+0000 7f3125d9b700 1 --2- 172.21.15.117:0/3181015062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31281026b0 0x7f3128112d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:06.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.908+0000 7f312659c700 1 -- 172.21.15.117:0/3181015062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31281026b0 msgr2=0x7f3128112d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:06.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.908+0000 7f312659c700 1 --2- 172.21.15.117:0/3181015062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31281026b0 0x7f3128112d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:06.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.908+0000 7f312659c700 1 -- 172.21.15.117:0/3181015062 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311c005040 con 0x7f3128101d10 2024-04-12T09:21:06.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.909+0000 7f312659c700 1 --2- 172.21.15.117:0/3181015062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3128101d10 0x7f31281127f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3118002a80 tx=0x7f31180046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:06.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.909+0000 7f3116ffd700 1 -- 172.21.15.117:0/3181015062 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3118007cc0 con 0x7f3128101d10 2024-04-12T09:21:06.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.909+0000 7f312cf3a700 1 -- 172.21.15.117:0/3181015062 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312810cc60 con 0x7f3128101d10 2024-04-12T09:21:06.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.909+0000 7f3116ffd700 1 -- 172.21.15.117:0/3181015062 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f311800f040 con 0x7f3128101d10 2024-04-12T09:21:06.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.909+0000 7f3116ffd700 1 -- 172.21.15.117:0/3181015062 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f311800dac0 con 0x7f3128101d10 2024-04-12T09:21:06.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.909+0000 7f312cf3a700 1 -- 172.21.15.117:0/3181015062 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312810d1f0 con 0x7f3128101d10 2024-04-12T09:21:06.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.910+0000 7f312cf3a700 1 -- 172.21.15.117:0/3181015062 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31280fd460 con 0x7f3128101d10 2024-04-12T09:21:06.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.910+0000 7f3116ffd700 1 -- 172.21.15.117:0/3181015062 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f311800dc20 con 0x7f3128101d10 2024-04-12T09:21:06.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.911+0000 7f3116ffd700 1 --2- 172.21.15.117:0/3181015062 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f311006dca0 0x7f3110070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:06.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.911+0000 7f3116ffd700 1 -- 172.21.15.117:0/3181015062 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f311808d160 con 0x7f3128101d10 2024-04-12T09:21:06.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.911+0000 7f3125d9b700 1 --2- 172.21.15.117:0/3181015062 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f311006dca0 0x7f3110070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:06.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.911+0000 7f3125d9b700 1 --2- 172.21.15.117:0/3181015062 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f311006dca0 0x7f3110070150 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f312810dc60 tx=0x7f311c009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:06.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:06.915+0000 7f3116ffd700 1 -- 172.21.15.117:0/3181015062 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f311805a220 con 0x7f3128101d10 2024-04-12T09:21:07.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:06 smithi203 ceph-mon[86783]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:21:07.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:06 smithi203 ceph-mon[86783]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:21:07.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:06 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/360091764' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:07.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.130+0000 7f312cf3a700 1 -- 172.21.15.117:0/3181015062 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3128108e40 con 0x7f311006dca0 2024-04-12T09:21:07.131 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:06 smithi117 ceph-mon[113571]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:21:07.131 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:06 smithi117 ceph-mon[113571]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:21:07.131 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:06 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/360091764' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:07.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.131+0000 7f3116ffd700 1 -- 172.21.15.117:0/3181015062 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3128108e40 con 0x7f311006dca0 2024-04-12T09:21:07.132 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:21:07.132 INFO:teuthology.orchestra.run.smithi117.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec", 2024-04-12T09:21:07.132 INFO:teuthology.orchestra.run.smithi117.stdout: "in_progress": true, 2024-04-12T09:21:07.132 INFO:teuthology.orchestra.run.smithi117.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T09:21:07.132 INFO:teuthology.orchestra.run.smithi117.stdout: "services_complete": [ 2024-04-12T09:21:07.132 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr", 2024-04-12T09:21:07.132 INFO:teuthology.orchestra.run.smithi117.stdout: "osd", 2024-04-12T09:21:07.132 INFO:teuthology.orchestra.run.smithi117.stdout: "mon", 2024-04-12T09:21:07.132 INFO:teuthology.orchestra.run.smithi117.stdout: "crash" 2024-04-12T09:21:07.132 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2024-04-12T09:21:07.132 INFO:teuthology.orchestra.run.smithi117.stdout: "progress": "14/21 daemons upgraded", 2024-04-12T09:21:07.132 INFO:teuthology.orchestra.run.smithi117.stdout: "message": "Currently upgrading mds daemons", 2024-04-12T09:21:07.132 INFO:teuthology.orchestra.run.smithi117.stdout: "is_paused": false 2024-04-12T09:21:07.132 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:21:07.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.134+0000 7f312cf3a700 1 -- 172.21.15.117:0/3181015062 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f311006dca0 msgr2=0x7f3110070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:07.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.134+0000 7f312cf3a700 1 --2- 172.21.15.117:0/3181015062 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f311006dca0 0x7f3110070150 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f312810dc60 tx=0x7f311c009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:07.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.134+0000 7f312cf3a700 1 -- 172.21.15.117:0/3181015062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3128101d10 msgr2=0x7f31281127f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:07.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.134+0000 7f312cf3a700 1 --2- 172.21.15.117:0/3181015062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3128101d10 0x7f31281127f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3118002a80 tx=0x7f31180046b0 comp rx=0 tx=0).stop 2024-04-12T09:21:07.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.134+0000 7f312cf3a700 1 -- 172.21.15.117:0/3181015062 shutdown_connections 2024-04-12T09:21:07.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.134+0000 7f312cf3a700 1 --2- 172.21.15.117:0/3181015062 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f311006dca0 0x7f3110070150 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:07.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.134+0000 7f312cf3a700 1 --2- 172.21.15.117:0/3181015062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3128101d10 0x7f31281127f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:07.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.134+0000 7f312cf3a700 1 --2- 172.21.15.117:0/3181015062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31281026b0 0x7f3128112d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:07.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.134+0000 7f312cf3a700 1 -- 172.21.15.117:0/3181015062 >> 172.21.15.117:0/3181015062 conn(0x7f31280f7880 msgr2=0x7f31280f8710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:07.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.134+0000 7f312cf3a700 1 -- 172.21.15.117:0/3181015062 shutdown_connections 2024-04-12T09:21:07.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.134+0000 7f312cf3a700 1 -- 172.21.15.117:0/3181015062 wait complete. 2024-04-12T09:21:07.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.237+0000 7fc3d59f2700 1 -- 172.21.15.117:0/549687139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3d01037a0 msgr2=0x7fc3d00fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:07.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.237+0000 7fc3d59f2700 1 --2- 172.21.15.117:0/549687139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3d01037a0 0x7fc3d00fce10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8004940 tx=0x7fc3b8009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:07.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.237+0000 7fc3d59f2700 1 -- 172.21.15.117:0/549687139 shutdown_connections 2024-04-12T09:21:07.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.237+0000 7fc3d59f2700 1 --2- 172.21.15.117:0/549687139 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3d01037a0 0x7fc3d00fce10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:07.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.237+0000 7fc3d59f2700 1 --2- 172.21.15.117:0/549687139 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3d0102e00 0x7fc3d01031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:07.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.237+0000 7fc3d59f2700 1 -- 172.21.15.117:0/549687139 >> 172.21.15.117:0/549687139 conn(0x7fc3d00f89b0 msgr2=0x7fc3d00fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:07.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.237+0000 7fc3d59f2700 1 -- 172.21.15.117:0/549687139 shutdown_connections 2024-04-12T09:21:07.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.237+0000 7fc3d59f2700 1 -- 172.21.15.117:0/549687139 wait complete. 2024-04-12T09:21:07.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.237+0000 7fc3d59f2700 1 Processor -- start 2024-04-12T09:21:07.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.237+0000 7fc3d59f2700 1 -- start start 2024-04-12T09:21:07.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.238+0000 7fc3d59f2700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3d0102e00 0x7fc3d0113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:07.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.238+0000 7fc3d59f2700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3d01037a0 0x7fc3d0113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:07.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.238+0000 7fc3d59f2700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d0114510 con 0x7fc3d01037a0 2024-04-12T09:21:07.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.238+0000 7fc3d59f2700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d010db10 con 0x7fc3d0102e00 2024-04-12T09:21:07.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.238+0000 7fc3c67fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3d01037a0 0x7fc3d0113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:07.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.238+0000 7fc3c67fc700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3d01037a0 0x7fc3d0113ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42630/0 (socket says 172.21.15.117:42630) 2024-04-12T09:21:07.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.238+0000 7fc3c67fc700 1 -- 172.21.15.117:0/2704434336 learned_addr learned my addr 172.21.15.117:0/2704434336 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:21:07.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.238+0000 7fc3ceffd700 1 --2- 172.21.15.117:0/2704434336 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3d0102e00 0x7fc3d0113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:07.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.238+0000 7fc3c67fc700 1 -- 172.21.15.117:0/2704434336 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3d0102e00 msgr2=0x7fc3d0113980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:07.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.238+0000 7fc3c67fc700 1 --2- 172.21.15.117:0/2704434336 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3d0102e00 0x7fc3d0113980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:07.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.238+0000 7fc3c67fc700 1 -- 172.21.15.117:0/2704434336 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b8005040 con 0x7fc3d01037a0 2024-04-12T09:21:07.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.238+0000 7fc3c67fc700 1 --2- 172.21.15.117:0/2704434336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3d01037a0 0x7fc3d0113ec0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800b3b0 tx=0x7fc3b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:07.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.238+0000 7fc3c7fff700 1 -- 172.21.15.117:0/2704434336 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3b800e040 con 0x7fc3d01037a0 2024-04-12T09:21:07.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.238+0000 7fc3c7fff700 1 -- 172.21.15.117:0/2704434336 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc3b8009b10 con 0x7fc3d01037a0 2024-04-12T09:21:07.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.238+0000 7fc3c7fff700 1 -- 172.21.15.117:0/2704434336 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3b8013420 con 0x7fc3d01037a0 2024-04-12T09:21:07.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.238+0000 7fc3d59f2700 1 -- 172.21.15.117:0/2704434336 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d010dd90 con 0x7fc3d01037a0 2024-04-12T09:21:07.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.238+0000 7fc3d59f2700 1 -- 172.21.15.117:0/2704434336 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d010e350 con 0x7fc3d01037a0 2024-04-12T09:21:07.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.239+0000 7fc3d59f2700 1 -- 172.21.15.117:0/2704434336 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d01052d0 con 0x7fc3d01037a0 2024-04-12T09:21:07.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.240+0000 7fc3c7fff700 1 -- 172.21.15.117:0/2704434336 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fc3b801c7c0 con 0x7fc3d01037a0 2024-04-12T09:21:07.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.240+0000 7fc3c7fff700 1 --2- 172.21.15.117:0/2704434336 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc3bc06dca0 0x7fc3bc070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:07.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.240+0000 7fc3c7fff700 1 -- 172.21.15.117:0/2704434336 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc3b808e030 con 0x7fc3d01037a0 2024-04-12T09:21:07.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.240+0000 7fc3ceffd700 1 --2- 172.21.15.117:0/2704434336 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc3bc06dca0 0x7fc3bc070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:07.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.241+0000 7fc3ceffd700 1 --2- 172.21.15.117:0/2704434336 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc3bc06dca0 0x7fc3bc070150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0004f60 tx=0x7fc3c000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:07.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.245+0000 7fc3c7fff700 1 -- 172.21.15.117:0/2704434336 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc3b805b220 con 0x7fc3d01037a0 2024-04-12T09:21:07.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.520+0000 7fc3d59f2700 1 -- 172.21.15.117:0/2704434336 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc3d00fe550 con 0x7fc3d01037a0 2024-04-12T09:21:07.521 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.521+0000 7fc3c7fff700 1 -- 172.21.15.117:0/2704434336 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7fc3b805adb0 con 0x7fc3d01037a0 2024-04-12T09:21:07.521 INFO:teuthology.orchestra.run.smithi117.stdout:HEALTH_WARN 1 filesystem is degraded 2024-04-12T09:21:07.522 INFO:teuthology.orchestra.run.smithi117.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-12T09:21:07.522 INFO:teuthology.orchestra.run.smithi117.stdout: fs cephfs is degraded 2024-04-12T09:21:07.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.523+0000 7fc3d59f2700 1 -- 172.21.15.117:0/2704434336 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc3bc06dca0 msgr2=0x7fc3bc070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:07.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.523+0000 7fc3d59f2700 1 --2- 172.21.15.117:0/2704434336 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc3bc06dca0 0x7fc3bc070150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0004f60 tx=0x7fc3c000b040 comp rx=0 tx=0).stop 2024-04-12T09:21:07.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.523+0000 7fc3d59f2700 1 -- 172.21.15.117:0/2704434336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3d01037a0 msgr2=0x7fc3d0113ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:07.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.523+0000 7fc3d59f2700 1 --2- 172.21.15.117:0/2704434336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3d01037a0 0x7fc3d0113ec0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800b3b0 tx=0x7fc3b8009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:07.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.523+0000 7fc3d59f2700 1 -- 172.21.15.117:0/2704434336 shutdown_connections 2024-04-12T09:21:07.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.523+0000 7fc3d59f2700 1 --2- 172.21.15.117:0/2704434336 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3d0102e00 0x7fc3d0113980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:07.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.523+0000 7fc3d59f2700 1 --2- 172.21.15.117:0/2704434336 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc3bc06dca0 0x7fc3bc070150 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:07.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.523+0000 7fc3d59f2700 1 --2- 172.21.15.117:0/2704434336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3d01037a0 0x7fc3d0113ec0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:07.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.523+0000 7fc3d59f2700 1 -- 172.21.15.117:0/2704434336 >> 172.21.15.117:0/2704434336 conn(0x7fc3d00f89b0 msgr2=0x7fc3d0102200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:07.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.523+0000 7fc3d59f2700 1 -- 172.21.15.117:0/2704434336 shutdown_connections 2024-04-12T09:21:07.524 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:07.523+0000 7fc3d59f2700 1 -- 172.21.15.117:0/2704434336 wait complete. 2024-04-12T09:21:07.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:07 smithi117 ceph-mon[113571]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:21:07.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:07 smithi117 ceph-mon[113571]: pgmap v192: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 5.6 KiB/s wr, 6 op/s 2024-04-12T09:21:07.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:07 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/2004533510' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:21:07.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:07 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/2704434336' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:21:07.974 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:07 smithi203 ceph-mon[86783]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:21:07.974 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:07 smithi203 ceph-mon[86783]: pgmap v192: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 5.6 KiB/s wr, 6 op/s 2024-04-12T09:21:07.974 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:07 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/2004533510' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:21:07.974 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:07 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/2704434336' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:21:08.989 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:08 smithi203 ceph-mon[86783]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:21:09.110 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:08 smithi117 ceph-mon[113571]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:21:10.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:09 smithi203 ceph-mon[86783]: pgmap v193: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 9.8 MiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-04-12T09:21:10.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:09 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:21:10.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:09 smithi117 ceph-mon[113571]: pgmap v193: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 9.8 MiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-04-12T09:21:10.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:09 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:21:12.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:11 smithi203 ceph-mon[86783]: pgmap v194: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-04-12T09:21:12.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:11 smithi117 ceph-mon[113571]: pgmap v194: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-04-12T09:21:14.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:13 smithi203 ceph-mon[86783]: pgmap v195: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-12T09:21:14.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:13 smithi117 ceph-mon[113571]: pgmap v195: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-12T09:21:16.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:15 smithi203 ceph-mon[86783]: pgmap v196: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-12T09:21:16.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:15 smithi203 ceph-mon[86783]: reconnect by client.14524 192.168.0.1:0/32098587 after 0.000999975 2024-04-12T09:21:16.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:15 smithi203 ceph-mon[86783]: reconnect by client.24317 192.168.0.1:0/3670805323 after 0.000999975 2024-04-12T09:21:16.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:15 smithi203 ceph-mon[86783]: mds.? [v2:172.21.15.203:6826/2731911290,v1:172.21.15.203:6827/2731911290] up:reconnect 2024-04-12T09:21:16.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:15 smithi203 ceph-mon[86783]: fsmap cephfs:1/1 {0=cephfs.smithi203.bszhxz=up:reconnect} 2 up:standby 2024-04-12T09:21:16.114 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:15 smithi117 ceph-mon[113571]: pgmap v196: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-12T09:21:16.114 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:15 smithi117 ceph-mon[113571]: reconnect by client.14524 192.168.0.1:0/32098587 after 0.000999975 2024-04-12T09:21:16.114 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:15 smithi117 ceph-mon[113571]: reconnect by client.24317 192.168.0.1:0/3670805323 after 0.000999975 2024-04-12T09:21:16.114 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:15 smithi117 ceph-mon[113571]: mds.? [v2:172.21.15.203:6826/2731911290,v1:172.21.15.203:6827/2731911290] up:reconnect 2024-04-12T09:21:16.114 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:15 smithi117 ceph-mon[113571]: fsmap cephfs:1/1 {0=cephfs.smithi203.bszhxz=up:reconnect} 2 up:standby 2024-04-12T09:21:17.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:16 smithi203 ceph-mon[86783]: mds.? [v2:172.21.15.203:6826/2731911290,v1:172.21.15.203:6827/2731911290] up:rejoin 2024-04-12T09:21:17.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:16 smithi203 ceph-mon[86783]: fsmap cephfs:1/1 {0=cephfs.smithi203.bszhxz=up:rejoin} 2 up:standby 2024-04-12T09:21:17.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:16 smithi203 ceph-mon[86783]: daemon mds.cephfs.smithi203.bszhxz is now active in filesystem cephfs as rank 0 2024-04-12T09:21:17.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:16 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:17.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:16 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:17.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:16 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:21:17.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:16 smithi117 ceph-mon[113571]: mds.? [v2:172.21.15.203:6826/2731911290,v1:172.21.15.203:6827/2731911290] up:rejoin 2024-04-12T09:21:17.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:16 smithi117 ceph-mon[113571]: fsmap cephfs:1/1 {0=cephfs.smithi203.bszhxz=up:rejoin} 2 up:standby 2024-04-12T09:21:17.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:16 smithi117 ceph-mon[113571]: daemon mds.cephfs.smithi203.bszhxz is now active in filesystem cephfs as rank 0 2024-04-12T09:21:17.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:16 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:17.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:16 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:17.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:16 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:21:18.015 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:17 smithi203 ceph-mon[86783]: pgmap v197: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-12T09:21:18.015 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:17 smithi203 ceph-mon[86783]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-12T09:21:18.015 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:17 smithi203 ceph-mon[86783]: Cluster is now healthy 2024-04-12T09:21:18.015 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:17 smithi203 ceph-mon[86783]: mds.? [v2:172.21.15.203:6826/2731911290,v1:172.21.15.203:6827/2731911290] up:active 2024-04-12T09:21:18.015 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:17 smithi203 ceph-mon[86783]: mds.? [v2:172.21.15.203:6824/3346773589,v1:172.21.15.203:6825/3346773589] up:boot 2024-04-12T09:21:18.015 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:17 smithi203 ceph-mon[86783]: fsmap cephfs:1 {0=cephfs.smithi203.bszhxz=up:active} 3 up:standby 2024-04-12T09:21:18.016 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:17 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.fbeixl"}]: dispatch 2024-04-12T09:21:18.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:17 smithi117 ceph-mon[113571]: pgmap v197: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-12T09:21:18.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:17 smithi117 ceph-mon[113571]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-12T09:21:18.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:17 smithi117 ceph-mon[113571]: Cluster is now healthy 2024-04-12T09:21:18.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:17 smithi117 ceph-mon[113571]: mds.? [v2:172.21.15.203:6826/2731911290,v1:172.21.15.203:6827/2731911290] up:active 2024-04-12T09:21:18.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:17 smithi117 ceph-mon[113571]: mds.? [v2:172.21.15.203:6824/3346773589,v1:172.21.15.203:6825/3346773589] up:boot 2024-04-12T09:21:18.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:17 smithi117 ceph-mon[113571]: fsmap cephfs:1 {0=cephfs.smithi203.bszhxz=up:active} 3 up:standby 2024-04-12T09:21:18.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:17 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.fbeixl"}]: dispatch 2024-04-12T09:21:20.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:19 smithi203 ceph-mon[86783]: pgmap v198: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 5 op/s 2024-04-12T09:21:20.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:19 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:20.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:19 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:20.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:19 smithi117 ceph-mon[113571]: pgmap v198: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 5 op/s 2024-04-12T09:21:20.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:19 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:20.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:19 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:21.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:21 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:21.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:21 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:21.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:21 smithi203 ceph-mon[86783]: pgmap v199: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 8.6 MiB/s rd, 170 B/s wr, 4 op/s 2024-04-12T09:21:21.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:21 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:21.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:21 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:21.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:21 smithi117 ceph-mon[113571]: pgmap v199: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 8.6 MiB/s rd, 170 B/s wr, 4 op/s 2024-04-12T09:21:24.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:23 smithi203 ceph-mon[86783]: pgmap v200: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 6.3 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-12T09:21:24.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:23 smithi117 ceph-mon[113571]: pgmap v200: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 6.3 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-12T09:21:25.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:24 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:25.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:24 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:25.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:24 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:21:25.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:24 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:21:25.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:24 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:25.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:24 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:21:25.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:24 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:25.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:24 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:25.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:24 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:25.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:24 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:25.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:24 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:25.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:24 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:21:25.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:24 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:25.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:24 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:25.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:24 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:21:25.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:24 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:21:25.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:24 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:25.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:24 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:21:25.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:24 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:25.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:24 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:25.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:24 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:25.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:24 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:25.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:24 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:25.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:24 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:21:26.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:25 smithi203 ceph-mon[86783]: pgmap v201: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-12T09:21:26.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:25 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:26.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:25 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.bszhxz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T09:21:26.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:25 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:21:26.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:25 smithi117 ceph-mon[113571]: pgmap v201: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-12T09:21:26.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:25 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:26.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:25 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi203.bszhxz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-12T09:21:26.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:25 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:21:27.055 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:26 smithi203 ceph-mon[86783]: Upgrade: Updating mds.cephfs.smithi203.bszhxz 2024-04-12T09:21:27.056 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:26 smithi203 ceph-mon[86783]: Deploying daemon mds.cephfs.smithi203.bszhxz on smithi203 2024-04-12T09:21:27.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:26 smithi117 ceph-mon[113571]: Upgrade: Updating mds.cephfs.smithi203.bszhxz 2024-04-12T09:21:27.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:26 smithi117 ceph-mon[113571]: Deploying daemon mds.cephfs.smithi203.bszhxz on smithi203 2024-04-12T09:21:27.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:27 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117[113567]: 2024-04-12T09:21:27.298+0000 7f68190ea700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T09:21:28.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:27 smithi203 ceph-mon[86783]: pgmap v202: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 599 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-12T09:21:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:27 smithi203 ceph-mon[86783]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-12T09:21:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:27 smithi203 ceph-mon[86783]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T09:21:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:27 smithi203 ceph-mon[86783]: osdmap e83: 6 total, 6 up, 6 in 2024-04-12T09:21:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:27 smithi203 ceph-mon[86783]: Standby daemon mds.cephfs.smithi117.wddsgt assigned to filesystem cephfs as rank 0 2024-04-12T09:21:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:27 smithi203 ceph-mon[86783]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-12T09:21:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:27 smithi203 ceph-mon[86783]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-12T09:21:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:27 smithi203 ceph-mon[86783]: fsmap cephfs:1/1 {0=cephfs.smithi117.wddsgt=up:replay} 2 up:standby 2024-04-12T09:21:28.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:27 smithi117 ceph-mon[113571]: pgmap v202: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 599 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-12T09:21:28.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:27 smithi117 ceph-mon[113571]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-12T09:21:28.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:27 smithi117 ceph-mon[113571]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-12T09:21:28.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:27 smithi117 ceph-mon[113571]: osdmap e83: 6 total, 6 up, 6 in 2024-04-12T09:21:28.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:27 smithi117 ceph-mon[113571]: Standby daemon mds.cephfs.smithi117.wddsgt assigned to filesystem cephfs as rank 0 2024-04-12T09:21:28.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:27 smithi117 ceph-mon[113571]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-12T09:21:28.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:27 smithi117 ceph-mon[113571]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-12T09:21:28.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:27 smithi117 ceph-mon[113571]: fsmap cephfs:1/1 {0=cephfs.smithi117.wddsgt=up:replay} 2 up:standby 2024-04-12T09:21:30.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:29 smithi203 ceph-mon[86783]: pgmap v204: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 4.9 KiB/s wr, 5 op/s 2024-04-12T09:21:30.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:29 smithi117 ceph-mon[113571]: pgmap v204: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 4.9 KiB/s wr, 5 op/s 2024-04-12T09:21:31.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:30 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.bszhxz"}]: dispatch 2024-04-12T09:21:31.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:30 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.bszhxz"}]: dispatch 2024-04-12T09:21:32.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:31 smithi203 ceph-mon[86783]: pgmap v205: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 6.2 MiB/s rd, 4.9 KiB/s wr, 6 op/s 2024-04-12T09:21:32.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:31 smithi117 ceph-mon[113571]: pgmap v205: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 6.2 MiB/s rd, 4.9 KiB/s wr, 6 op/s 2024-04-12T09:21:34.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:33 smithi203 ceph-mon[86783]: pgmap v206: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 0 B/s wr, 4 op/s 2024-04-12T09:21:34.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:33 smithi117 ceph-mon[113571]: pgmap v206: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 0 B/s wr, 4 op/s 2024-04-12T09:21:36.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:35 smithi203 ceph-mon[86783]: pgmap v207: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 0 B/s wr, 5 op/s 2024-04-12T09:21:36.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:35 smithi117 ceph-mon[113571]: pgmap v207: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 0 B/s wr, 5 op/s 2024-04-12T09:21:37.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.637+0000 7f5111d66700 1 -- 172.21.15.117:0/4141988056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f510c101d20 msgr2=0x7f510c1020f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:37.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.637+0000 7f5111d66700 1 --2- 172.21.15.117:0/4141988056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f510c101d20 0x7f510c1020f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f50fc004940 tx=0x7f50fc009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:37.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.637+0000 7f5111d66700 1 -- 172.21.15.117:0/4141988056 shutdown_connections 2024-04-12T09:21:37.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.637+0000 7f5111d66700 1 --2- 172.21.15.117:0/4141988056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f510c1026c0 0x7f510c0fbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:37.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.637+0000 7f5111d66700 1 --2- 172.21.15.117:0/4141988056 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f510c101d20 0x7f510c1020f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:37.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.637+0000 7f5111d66700 1 -- 172.21.15.117:0/4141988056 >> 172.21.15.117:0/4141988056 conn(0x7f510c0f7870 msgr2=0x7f510c0f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:37.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.637+0000 7f5111d66700 1 -- 172.21.15.117:0/4141988056 shutdown_connections 2024-04-12T09:21:37.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.637+0000 7f5111d66700 1 -- 172.21.15.117:0/4141988056 wait complete. 2024-04-12T09:21:37.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.637+0000 7f5111d66700 1 Processor -- start 2024-04-12T09:21:37.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.637+0000 7f5111d66700 1 -- start start 2024-04-12T09:21:37.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.638+0000 7f5111d66700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f510c101d20 0x7f510c10ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:37.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.638+0000 7f5111d66700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f510c1026c0 0x7f510c10efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:37.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.638+0000 7f5111d66700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c10f4f0 con 0x7f510c101d20 2024-04-12T09:21:37.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.638+0000 7f5111d66700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c10f630 con 0x7f510c1026c0 2024-04-12T09:21:37.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.638+0000 7f510b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f510c101d20 0x7f510c10ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:37.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.638+0000 7f510b7fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f510c101d20 0x7f510c10ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:59236/0 (socket says 172.21.15.117:59236) 2024-04-12T09:21:37.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.638+0000 7f510b7fe700 1 -- 172.21.15.117:0/676550479 learned_addr learned my addr 172.21.15.117:0/676550479 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:21:37.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.638+0000 7f5103fff700 1 --2- 172.21.15.117:0/676550479 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f510c1026c0 0x7f510c10efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:37.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.638+0000 7f510b7fe700 1 -- 172.21.15.117:0/676550479 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f510c1026c0 msgr2=0x7f510c10efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:37.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.638+0000 7f510b7fe700 1 --2- 172.21.15.117:0/676550479 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f510c1026c0 0x7f510c10efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:37.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.638+0000 7f510b7fe700 1 -- 172.21.15.117:0/676550479 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50fc005040 con 0x7f510c101d20 2024-04-12T09:21:37.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.638+0000 7f510b7fe700 1 --2- 172.21.15.117:0/676550479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f510c101d20 0x7f510c10ea70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009b30 tx=0x7f50fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:37.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.638+0000 7f5108ff9700 1 -- 172.21.15.117:0/676550479 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50fc021070 con 0x7f510c101d20 2024-04-12T09:21:37.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.638+0000 7f5108ff9700 1 -- 172.21.15.117:0/676550479 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f50fc013c00 con 0x7f510c101d20 2024-04-12T09:21:37.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.638+0000 7f5111d66700 1 -- 172.21.15.117:0/676550479 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f510c10f8b0 con 0x7f510c101d20 2024-04-12T09:21:37.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.639+0000 7f5108ff9700 1 -- 172.21.15.117:0/676550479 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50fc00e070 con 0x7f510c101d20 2024-04-12T09:21:37.642 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.639+0000 7f5111d66700 1 -- 172.21.15.117:0/676550479 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f510c117d60 con 0x7f510c101d20 2024-04-12T09:21:37.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.639+0000 7f5111d66700 1 -- 172.21.15.117:0/676550479 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f510c0fd470 con 0x7f510c101d20 2024-04-12T09:21:37.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.640+0000 7f5108ff9700 1 -- 172.21.15.117:0/676550479 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f50fc01cad0 con 0x7f510c101d20 2024-04-12T09:21:37.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.640+0000 7f5108ff9700 1 --2- 172.21.15.117:0/676550479 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f50f806dca0 0x7f50f8070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:37.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.641+0000 7f5108ff9700 1 -- 172.21.15.117:0/676550479 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f50fc08e9d0 con 0x7f510c101d20 2024-04-12T09:21:37.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.641+0000 7f5103fff700 1 --2- 172.21.15.117:0/676550479 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f50f806dca0 0x7f50f8070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:37.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.641+0000 7f5103fff700 1 --2- 172.21.15.117:0/676550479 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f50f806dca0 0x7f50f8070150 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f510c066ac0 tx=0x7f50f400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:37.647 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.646+0000 7f5108ff9700 1 -- 172.21.15.117:0/676550479 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f50fc057f80 con 0x7f510c101d20 2024-04-12T09:21:37.865 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.863+0000 7f5111d66700 1 -- 172.21.15.117:0/676550479 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f510c0f8e40 con 0x7f50f806dca0 2024-04-12T09:21:37.866 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.865+0000 7f5108ff9700 1 -- 172.21.15.117:0/676550479 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f510c0f8e40 con 0x7f50f806dca0 2024-04-12T09:21:37.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.867+0000 7f5111d66700 1 -- 172.21.15.117:0/676550479 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f50f806dca0 msgr2=0x7f50f8070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:37.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.867+0000 7f5111d66700 1 --2- 172.21.15.117:0/676550479 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f50f806dca0 0x7f50f8070150 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f510c066ac0 tx=0x7f50f400b040 comp rx=0 tx=0).stop 2024-04-12T09:21:37.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.867+0000 7f5111d66700 1 -- 172.21.15.117:0/676550479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f510c101d20 msgr2=0x7f510c10ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:37.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.867+0000 7f5111d66700 1 --2- 172.21.15.117:0/676550479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f510c101d20 0x7f510c10ea70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009b30 tx=0x7f50fc009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:37.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.867+0000 7f5111d66700 1 -- 172.21.15.117:0/676550479 shutdown_connections 2024-04-12T09:21:37.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.867+0000 7f5111d66700 1 --2- 172.21.15.117:0/676550479 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f50f806dca0 0x7f50f8070150 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:37.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.867+0000 7f5111d66700 1 --2- 172.21.15.117:0/676550479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f510c101d20 0x7f510c10ea70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:37.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.867+0000 7f5111d66700 1 --2- 172.21.15.117:0/676550479 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f510c1026c0 0x7f510c10efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:37.869 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.867+0000 7f5111d66700 1 -- 172.21.15.117:0/676550479 >> 172.21.15.117:0/676550479 conn(0x7f510c0f7870 msgr2=0x7f510c0f8730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:37.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.867+0000 7f5111d66700 1 -- 172.21.15.117:0/676550479 shutdown_connections 2024-04-12T09:21:37.870 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.867+0000 7f5111d66700 1 -- 172.21.15.117:0/676550479 wait complete. 2024-04-12T09:21:37.880 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:21:37.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:37 smithi117 ceph-mon[113571]: pgmap v208: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-12T09:21:37.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:37 smithi117 ceph-mon[113571]: reconnect by client.14524 192.168.0.1:0/32098587 after 0 2024-04-12T09:21:37.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:37 smithi117 ceph-mon[113571]: reconnect by client.24317 192.168.0.1:0/3670805323 after 0.00099998 2024-04-12T09:21:37.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:37 smithi117 ceph-mon[113571]: mds.? [v2:172.21.15.117:6826/2687704577,v1:172.21.15.117:6827/2687704577] up:reconnect 2024-04-12T09:21:37.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:37 smithi117 ceph-mon[113571]: fsmap cephfs:1/1 {0=cephfs.smithi117.wddsgt=up:reconnect} 2 up:standby 2024-04-12T09:21:37.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.970+0000 7f98d2145700 1 -- 172.21.15.117:0/2779432650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98cc101d20 msgr2=0x7f98cc1020f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:37.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.970+0000 7f98d2145700 1 --2- 172.21.15.117:0/2779432650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98cc101d20 0x7f98cc1020f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f98bc004940 tx=0x7f98bc009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:37.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.970+0000 7f98d2145700 1 -- 172.21.15.117:0/2779432650 shutdown_connections 2024-04-12T09:21:37.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.970+0000 7f98d2145700 1 --2- 172.21.15.117:0/2779432650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98cc1026c0 0x7f98cc0fbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:37.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.970+0000 7f98d2145700 1 --2- 172.21.15.117:0/2779432650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98cc101d20 0x7f98cc1020f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:37.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.970+0000 7f98d2145700 1 -- 172.21.15.117:0/2779432650 >> 172.21.15.117:0/2779432650 conn(0x7f98cc0f7870 msgr2=0x7f98cc0f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:37.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.970+0000 7f98d2145700 1 -- 172.21.15.117:0/2779432650 shutdown_connections 2024-04-12T09:21:37.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.970+0000 7f98d2145700 1 -- 172.21.15.117:0/2779432650 wait complete. 2024-04-12T09:21:37.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.971+0000 7f98d2145700 1 Processor -- start 2024-04-12T09:21:37.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.971+0000 7f98d2145700 1 -- start start 2024-04-12T09:21:37.974 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.971+0000 7f98d2145700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98cc101d20 0x7f98cc102b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:37.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.971+0000 7f98d2145700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98cc1026c0 0x7f98cc1030c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:37.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.971+0000 7f98d2145700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc104ad0 con 0x7f98cc1026c0 2024-04-12T09:21:37.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.971+0000 7f98d2145700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc103600 con 0x7f98cc101d20 2024-04-12T09:21:37.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.971+0000 7f98c3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98cc1026c0 0x7f98cc1030c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:37.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.971+0000 7f98c3fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98cc1026c0 0x7f98cc1030c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:59242/0 (socket says 172.21.15.117:59242) 2024-04-12T09:21:37.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.971+0000 7f98c3fff700 1 -- 172.21.15.117:0/3550316668 learned_addr learned my addr 172.21.15.117:0/3550316668 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:21:37.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.971+0000 7f98cb7fe700 1 --2- 172.21.15.117:0/3550316668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98cc101d20 0x7f98cc102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:37.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.972+0000 7f98c3fff700 1 -- 172.21.15.117:0/3550316668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98cc101d20 msgr2=0x7f98cc102b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:37.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.972+0000 7f98c3fff700 1 --2- 172.21.15.117:0/3550316668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98cc101d20 0x7f98cc102b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:37.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.972+0000 7f98c3fff700 1 -- 172.21.15.117:0/3550316668 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98bc005040 con 0x7f98cc1026c0 2024-04-12T09:21:37.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.972+0000 7f98c3fff700 1 --2- 172.21.15.117:0/3550316668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98cc1026c0 0x7f98cc1030c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f98b4002a50 tx=0x7f98b4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:37.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.972+0000 7f98c8ff9700 1 -- 172.21.15.117:0/3550316668 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98b4007cc0 con 0x7f98cc1026c0 2024-04-12T09:21:37.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.972+0000 7f98c8ff9700 1 -- 172.21.15.117:0/3550316668 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f98b400f040 con 0x7f98cc1026c0 2024-04-12T09:21:37.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.972+0000 7f98d2145700 1 -- 172.21.15.117:0/3550316668 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98cc1038e0 con 0x7f98cc1026c0 2024-04-12T09:21:37.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.972+0000 7f98c8ff9700 1 -- 172.21.15.117:0/3550316668 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98b400d9c0 con 0x7f98cc1026c0 2024-04-12T09:21:37.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.972+0000 7f98d2145700 1 -- 172.21.15.117:0/3550316668 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98cc11a150 con 0x7f98cc1026c0 2024-04-12T09:21:37.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.973+0000 7f98d2145700 1 -- 172.21.15.117:0/3550316668 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98cc0fd470 con 0x7f98cc1026c0 2024-04-12T09:21:37.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.973+0000 7f98c8ff9700 1 -- 172.21.15.117:0/3550316668 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f98b4009730 con 0x7f98cc1026c0 2024-04-12T09:21:37.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.974+0000 7f98c8ff9700 1 --2- 172.21.15.117:0/3550316668 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f98b806dca0 0x7f98b8070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:37.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.974+0000 7f98c8ff9700 1 -- 172.21.15.117:0/3550316668 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f98b408d3d0 con 0x7f98cc1026c0 2024-04-12T09:21:37.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.974+0000 7f98cb7fe700 1 --2- 172.21.15.117:0/3550316668 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f98b806dca0 0x7f98b8070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:37.977 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.974+0000 7f98cb7fe700 1 --2- 172.21.15.117:0/3550316668 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f98b806dca0 0x7f98b8070150 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f98bc00b3b0 tx=0x7f98bc009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:37.980 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:37.979+0000 7f98c8ff9700 1 -- 172.21.15.117:0/3550316668 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f98b4056860 con 0x7f98cc1026c0 2024-04-12T09:21:38.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:37 smithi203 ceph-mon[86783]: pgmap v208: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-04-12T09:21:38.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:37 smithi203 ceph-mon[86783]: reconnect by client.14524 192.168.0.1:0/32098587 after 0 2024-04-12T09:21:38.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:37 smithi203 ceph-mon[86783]: reconnect by client.24317 192.168.0.1:0/3670805323 after 0.00099998 2024-04-12T09:21:38.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:37 smithi203 ceph-mon[86783]: mds.? [v2:172.21.15.117:6826/2687704577,v1:172.21.15.117:6827/2687704577] up:reconnect 2024-04-12T09:21:38.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:37 smithi203 ceph-mon[86783]: fsmap cephfs:1/1 {0=cephfs.smithi117.wddsgt=up:reconnect} 2 up:standby 2024-04-12T09:21:38.193 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.193+0000 7f98d2145700 1 -- 172.21.15.117:0/3550316668 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f98cc0f8f70 con 0x7f98b806dca0 2024-04-12T09:21:38.194 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.194+0000 7f98c8ff9700 1 -- 172.21.15.117:0/3550316668 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f98cc0f8f70 con 0x7f98b806dca0 2024-04-12T09:21:38.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.196+0000 7f98d2145700 1 -- 172.21.15.117:0/3550316668 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f98b806dca0 msgr2=0x7f98b8070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:38.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.196+0000 7f98d2145700 1 --2- 172.21.15.117:0/3550316668 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f98b806dca0 0x7f98b8070150 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f98bc00b3b0 tx=0x7f98bc009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:38.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.196+0000 7f98d2145700 1 -- 172.21.15.117:0/3550316668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98cc1026c0 msgr2=0x7f98cc1030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:38.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.196+0000 7f98d2145700 1 --2- 172.21.15.117:0/3550316668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98cc1026c0 0x7f98cc1030c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f98b4002a50 tx=0x7f98b4004600 comp rx=0 tx=0).stop 2024-04-12T09:21:38.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.196+0000 7f98d2145700 1 -- 172.21.15.117:0/3550316668 shutdown_connections 2024-04-12T09:21:38.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.196+0000 7f98d2145700 1 --2- 172.21.15.117:0/3550316668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98cc101d20 0x7f98cc102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:38.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.196+0000 7f98d2145700 1 --2- 172.21.15.117:0/3550316668 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f98b806dca0 0x7f98b8070150 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:38.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.196+0000 7f98d2145700 1 --2- 172.21.15.117:0/3550316668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98cc1026c0 0x7f98cc1030c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:38.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.196+0000 7f98d2145700 1 -- 172.21.15.117:0/3550316668 >> 172.21.15.117:0/3550316668 conn(0x7f98cc0f7870 msgr2=0x7f98cc0f8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:38.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.196+0000 7f98d2145700 1 -- 172.21.15.117:0/3550316668 shutdown_connections 2024-04-12T09:21:38.197 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.196+0000 7f98d2145700 1 -- 172.21.15.117:0/3550316668 wait complete. 2024-04-12T09:21:38.297 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.296+0000 7fb41f2ac700 1 -- 172.21.15.117:0/2282893894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4180fb540 msgr2=0x7fb4180fb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:38.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.296+0000 7fb41f2ac700 1 --2- 172.21.15.117:0/2282893894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4180fb540 0x7fb4180fb990 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb408004940 tx=0x7fb408009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:38.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.297+0000 7fb41f2ac700 1 -- 172.21.15.117:0/2282893894 shutdown_connections 2024-04-12T09:21:38.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.297+0000 7fb41f2ac700 1 --2- 172.21.15.117:0/2282893894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb4180fb540 0x7fb4180fb990 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:38.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.297+0000 7fb41f2ac700 1 --2- 172.21.15.117:0/2282893894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb418102fd0 0x7fb4181033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:38.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.297+0000 7fb41f2ac700 1 -- 172.21.15.117:0/2282893894 >> 172.21.15.117:0/2282893894 conn(0x7fb418071530 msgr2=0x7fb418071930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:38.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.297+0000 7fb41f2ac700 1 -- 172.21.15.117:0/2282893894 shutdown_connections 2024-04-12T09:21:38.298 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.297+0000 7fb41f2ac700 1 -- 172.21.15.117:0/2282893894 wait complete. 2024-04-12T09:21:38.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.297+0000 7fb41f2ac700 1 Processor -- start 2024-04-12T09:21:38.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.297+0000 7fb41f2ac700 1 -- start start 2024-04-12T09:21:38.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.297+0000 7fb41f2ac700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4180fb540 0x7fb418113950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:38.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.297+0000 7fb41f2ac700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb418102fd0 0x7fb418113e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:38.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.297+0000 7fb41f2ac700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4181144e0 con 0x7fb418102fd0 2024-04-12T09:21:38.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.297+0000 7fb41f2ac700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41810dae0 con 0x7fb4180fb540 2024-04-12T09:21:38.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.298+0000 7fb41c847700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb418102fd0 0x7fb418113e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:38.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.298+0000 7fb41c847700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb418102fd0 0x7fb418113e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:59254/0 (socket says 172.21.15.117:59254) 2024-04-12T09:21:38.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.298+0000 7fb41c847700 1 -- 172.21.15.117:0/3907037425 learned_addr learned my addr 172.21.15.117:0/3907037425 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:21:38.300 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.298+0000 7fb41d048700 1 --2- 172.21.15.117:0/3907037425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4180fb540 0x7fb418113950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:38.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.298+0000 7fb41c847700 1 -- 172.21.15.117:0/3907037425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4180fb540 msgr2=0x7fb418113950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:38.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.298+0000 7fb41c847700 1 --2- 172.21.15.117:0/3907037425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4180fb540 0x7fb418113950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:38.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.298+0000 7fb41c847700 1 -- 172.21.15.117:0/3907037425 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb408005040 con 0x7fb418102fd0 2024-04-12T09:21:38.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.298+0000 7fb41c847700 1 --2- 172.21.15.117:0/3907037425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb418102fd0 0x7fb418113e90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb40800b8b0 tx=0x7fb408009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:38.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.298+0000 7fb40dffb700 1 -- 172.21.15.117:0/3907037425 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb40800e040 con 0x7fb418102fd0 2024-04-12T09:21:38.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.298+0000 7fb40dffb700 1 -- 172.21.15.117:0/3907037425 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb408004290 con 0x7fb418102fd0 2024-04-12T09:21:38.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.298+0000 7fb41f2ac700 1 -- 172.21.15.117:0/3907037425 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb41810dd60 con 0x7fb418102fd0 2024-04-12T09:21:38.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.298+0000 7fb40dffb700 1 -- 172.21.15.117:0/3907037425 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb40801c3f0 con 0x7fb418102fd0 2024-04-12T09:21:38.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.298+0000 7fb41f2ac700 1 -- 172.21.15.117:0/3907037425 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb41810e2a0 con 0x7fb418102fd0 2024-04-12T09:21:38.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.300+0000 7fb41f2ac700 1 -- 172.21.15.117:0/3907037425 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4181053b0 con 0x7fb418102fd0 2024-04-12T09:21:38.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.300+0000 7fb40dffb700 1 -- 172.21.15.117:0/3907037425 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fb408013420 con 0x7fb418102fd0 2024-04-12T09:21:38.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.300+0000 7fb40dffb700 1 --2- 172.21.15.117:0/3907037425 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb40406dca0 0x7fb404070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:38.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.301+0000 7fb40dffb700 1 -- 172.21.15.117:0/3907037425 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb40808e6e0 con 0x7fb418102fd0 2024-04-12T09:21:38.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.301+0000 7fb41d048700 1 --2- 172.21.15.117:0/3907037425 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb40406dca0 0x7fb404070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:38.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.301+0000 7fb41d048700 1 --2- 172.21.15.117:0/3907037425 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb40406dca0 0x7fb404070150 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb414009fd0 tx=0x7fb41400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:38.306 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.305+0000 7fb40dffb700 1 -- 172.21.15.117:0/3907037425 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb40805b860 con 0x7fb418102fd0 2024-04-12T09:21:38.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.509+0000 7fb41f2ac700 1 -- 172.21.15.117:0/3907037425 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb418113620 con 0x7fb40406dca0 2024-04-12T09:21:38.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.519+0000 7fb40dffb700 1 -- 172.21.15.117:0/3907037425 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fb418113620 con 0x7fb40406dca0 2024-04-12T09:21:38.520 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:21:38.520 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 running (7m) 41s ago 18m 27.0M - 0.25.0 c8568f914cd2 204687f21ed7 2024-04-12T09:21:38.520 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (4m) 41s ago 18m 6656k - 19.0.0-2053-gb277feb2 668895944f0e 038f567b664b 2024-04-12T09:21:38.520 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (4m) 19s ago 17m 6660k - 19.0.0-2053-gb277feb2 668895944f0e 420dee66e230 2024-04-12T09:21:38.520 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 running (7m) 41s ago 18m 78.9M - 9.4.12 2bacad6d85d8 a7b102216886 2024-04-12T09:21:38.520 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (46s) 41s ago 13m 12.5M - 19.0.0-2053-gb277feb2 668895944f0e 561830e21baa 2024-04-12T09:21:38.520 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 running (69s) 41s ago 13m 11.8M - 19.0.0-2053-gb277feb2 668895944f0e 642a35bff3ee 2024-04-12T09:21:38.520 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (13m) 19s ago 13m 87.6M - 17.2.7-827-gd3b5060a 21de9b7369ad b05228e997f7 2024-04-12T09:21:38.520 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (22s) 19s ago 13m 12.5M - 19.0.0-2053-gb277feb2 668895944f0e f3bba6c8874e 2024-04-12T09:21:38.520 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:8443,9283,8765 running (9m) 41s ago 20m 508M - 19.0.0-2053-gb277feb2 668895944f0e fee613d05ab7 2024-04-12T09:21:38.521 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283,8765 running (8m) 19s ago 17m 451M - 19.0.0-2053-gb277feb2 668895944f0e c793944c3e16 2024-04-12T09:21:38.521 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (5m) 41s ago 20m 55.2M 2048M 19.0.0-2053-gb277feb2 668895944f0e 6823aaff30ce 2024-04-12T09:21:38.521 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (5m) 19s ago 17m 44.0M 2048M 19.0.0-2053-gb277feb2 668895944f0e 006c6e487bfb 2024-04-12T09:21:38.521 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 running (7m) 41s ago 18m 16.8M - 1.5.0 0da6a335fe13 c692bed9f6c7 2024-04-12T09:21:38.521 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (7m) 19s ago 17m 15.4M - 1.5.0 0da6a335fe13 f3b5a470f545 2024-04-12T09:21:38.521 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (4m) 41s ago 17m 97.9M 1557M 19.0.0-2053-gb277feb2 668895944f0e 59a180461e3c 2024-04-12T09:21:38.521 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (3m) 41s ago 16m 105M 1557M 19.0.0-2053-gb277feb2 668895944f0e d40e2dfc164b 2024-04-12T09:21:38.521 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (3m) 41s ago 16m 97.7M 1557M 19.0.0-2053-gb277feb2 668895944f0e fd7d5481cddb 2024-04-12T09:21:38.521 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (2m) 19s ago 15m 127M 2581M 19.0.0-2053-gb277feb2 668895944f0e 961db53f9ab1 2024-04-12T09:21:38.521 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (119s) 19s ago 15m 108M 2581M 19.0.0-2053-gb277feb2 668895944f0e 7ec45de1eea6 2024-04-12T09:21:38.521 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (86s) 19s ago 14m 95.6M 2581M 19.0.0-2053-gb277feb2 668895944f0e ad918b4139f7 2024-04-12T09:21:38.521 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 running (7m) 41s ago 18m 61.0M - 2.43.0 a07b618ecd1d 43ce588d82cc 2024-04-12T09:21:38.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.521+0000 7fb41f2ac700 1 -- 172.21.15.117:0/3907037425 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb40406dca0 msgr2=0x7fb404070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:38.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.521+0000 7fb41f2ac700 1 --2- 172.21.15.117:0/3907037425 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb40406dca0 0x7fb404070150 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb414009fd0 tx=0x7fb41400b040 comp rx=0 tx=0).stop 2024-04-12T09:21:38.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.521+0000 7fb41f2ac700 1 -- 172.21.15.117:0/3907037425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb418102fd0 msgr2=0x7fb418113e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:38.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.521+0000 7fb41f2ac700 1 --2- 172.21.15.117:0/3907037425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb418102fd0 0x7fb418113e90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb40800b8b0 tx=0x7fb408009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:38.522 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.521+0000 7fb41f2ac700 1 -- 172.21.15.117:0/3907037425 shutdown_connections 2024-04-12T09:21:38.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.521+0000 7fb41f2ac700 1 --2- 172.21.15.117:0/3907037425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb4180fb540 0x7fb418113950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:38.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.521+0000 7fb41f2ac700 1 --2- 172.21.15.117:0/3907037425 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb40406dca0 0x7fb404070150 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:38.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.521+0000 7fb41f2ac700 1 --2- 172.21.15.117:0/3907037425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb418102fd0 0x7fb418113e90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:38.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.521+0000 7fb41f2ac700 1 -- 172.21.15.117:0/3907037425 >> 172.21.15.117:0/3907037425 conn(0x7fb418071530 msgr2=0x7fb4180fa6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:38.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.522+0000 7fb41f2ac700 1 -- 172.21.15.117:0/3907037425 shutdown_connections 2024-04-12T09:21:38.523 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.522+0000 7fb41f2ac700 1 -- 172.21.15.117:0/3907037425 wait complete. 2024-04-12T09:21:38.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.623+0000 7fc695439700 1 -- 172.21.15.117:0/341073795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc690102e00 msgr2=0x7fc6901031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:38.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.623+0000 7fc695439700 1 --2- 172.21.15.117:0/341073795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc690102e00 0x7fc6901031d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc680004940 tx=0x7fc680009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:38.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.623+0000 7fc695439700 1 -- 172.21.15.117:0/341073795 shutdown_connections 2024-04-12T09:21:38.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.623+0000 7fc695439700 1 --2- 172.21.15.117:0/341073795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6901037a0 0x7fc6900fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:38.624 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.623+0000 7fc695439700 1 --2- 172.21.15.117:0/341073795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc690102e00 0x7fc6901031d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:38.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.623+0000 7fc695439700 1 -- 172.21.15.117:0/341073795 >> 172.21.15.117:0/341073795 conn(0x7fc6900f89b0 msgr2=0x7fc6900fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:38.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.624+0000 7fc695439700 1 -- 172.21.15.117:0/341073795 shutdown_connections 2024-04-12T09:21:38.625 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.624+0000 7fc695439700 1 -- 172.21.15.117:0/341073795 wait complete. 2024-04-12T09:21:38.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.624+0000 7fc695439700 1 Processor -- start 2024-04-12T09:21:38.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.624+0000 7fc695439700 1 -- start start 2024-04-12T09:21:38.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.625+0000 7fc695439700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc690102e00 0x7fc690115bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:38.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.625+0000 7fc695439700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6901037a0 0x7fc6901160f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:38.626 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.625+0000 7fc695439700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc690116740 con 0x7fc690102e00 2024-04-12T09:21:38.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.625+0000 7fc695439700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69010fd20 con 0x7fc6901037a0 2024-04-12T09:21:38.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.625+0000 7fc68effd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc690102e00 0x7fc690115bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:38.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.625+0000 7fc68effd700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc690102e00 0x7fc690115bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:59268/0 (socket says 172.21.15.117:59268) 2024-04-12T09:21:38.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.625+0000 7fc68effd700 1 -- 172.21.15.117:0/3114495678 learned_addr learned my addr 172.21.15.117:0/3114495678 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:21:38.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.625+0000 7fc68e7fc700 1 --2- 172.21.15.117:0/3114495678 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6901037a0 0x7fc6901160f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:38.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.625+0000 7fc68effd700 1 -- 172.21.15.117:0/3114495678 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6901037a0 msgr2=0x7fc6901160f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:38.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.625+0000 7fc68effd700 1 --2- 172.21.15.117:0/3114495678 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6901037a0 0x7fc6901160f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:38.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.625+0000 7fc68effd700 1 -- 172.21.15.117:0/3114495678 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc680005040 con 0x7fc690102e00 2024-04-12T09:21:38.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.625+0000 7fc68effd700 1 --2- 172.21.15.117:0/3114495678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc690102e00 0x7fc690115bb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc68000b3b0 tx=0x7fc680009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:38.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.626+0000 7fc6777fe700 1 -- 172.21.15.117:0/3114495678 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc68000e040 con 0x7fc690102e00 2024-04-12T09:21:38.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.626+0000 7fc695439700 1 -- 172.21.15.117:0/3114495678 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69010ffa0 con 0x7fc690102e00 2024-04-12T09:21:38.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.626+0000 7fc6777fe700 1 -- 172.21.15.117:0/3114495678 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc68000bbc0 con 0x7fc690102e00 2024-04-12T09:21:38.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.626+0000 7fc695439700 1 -- 172.21.15.117:0/3114495678 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc690110560 con 0x7fc690102e00 2024-04-12T09:21:38.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.626+0000 7fc6777fe700 1 -- 172.21.15.117:0/3114495678 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc68001c3f0 con 0x7fc690102e00 2024-04-12T09:21:38.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.627+0000 7fc695439700 1 -- 172.21.15.117:0/3114495678 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc67c0052b0 con 0x7fc690102e00 2024-04-12T09:21:38.628 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.628+0000 7fc6777fe700 1 -- 172.21.15.117:0/3114495678 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fc680013420 con 0x7fc690102e00 2024-04-12T09:21:38.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.628+0000 7fc6777fe700 1 --2- 172.21.15.117:0/3114495678 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc67806dca0 0x7fc678070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:38.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.628+0000 7fc6777fe700 1 -- 172.21.15.117:0/3114495678 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fc68008e740 con 0x7fc690102e00 2024-04-12T09:21:38.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.628+0000 7fc68e7fc700 1 --2- 172.21.15.117:0/3114495678 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc67806dca0 0x7fc678070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:38.629 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.629+0000 7fc68e7fc700 1 --2- 172.21.15.117:0/3114495678 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc67806dca0 0x7fc678070150 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc690111450 tx=0x7fc684009ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:38.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.633+0000 7fc6777fe700 1 -- 172.21.15.117:0/3114495678 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc68005b820 con 0x7fc690102e00 2024-04-12T09:21:38.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:38 smithi117 ceph-mon[113571]: mds.? [v2:172.21.15.117:6826/2687704577,v1:172.21.15.117:6827/2687704577] up:rejoin 2024-04-12T09:21:38.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:38 smithi117 ceph-mon[113571]: fsmap cephfs:1/1 {0=cephfs.smithi117.wddsgt=up:rejoin} 2 up:standby 2024-04-12T09:21:38.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:38 smithi117 ceph-mon[113571]: daemon mds.cephfs.smithi117.wddsgt is now active in filesystem cephfs as rank 0 2024-04-12T09:21:38.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:38 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:38.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:38 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:38.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:38 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:21:38.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.914+0000 7fc695439700 1 -- 172.21.15.117:0/3114495678 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc67c005d70 con 0x7fc690102e00 2024-04-12T09:21:38.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.915+0000 7fc6777fe700 1 -- 172.21.15.117:0/3114495678 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fc68005b3b0 con 0x7fc690102e00 2024-04-12T09:21:38.915 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:21:38.915 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": { 2024-04-12T09:21:38.915 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:21:38.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:21:38.915 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": { 2024-04-12T09:21:38.915 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:21:38.915 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:21:38.916 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": { 2024-04-12T09:21:38.916 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 6 2024-04-12T09:21:38.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:21:38.916 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-04-12T09:21:38.916 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 4 2024-04-12T09:21:38.916 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:21:38.916 INFO:teuthology.orchestra.run.smithi117.stdout: "overall": { 2024-04-12T09:21:38.916 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 14 2024-04-12T09:21:38.916 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:21:38.916 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:21:38.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.917+0000 7fc695439700 1 -- 172.21.15.117:0/3114495678 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc67806dca0 msgr2=0x7fc678070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:38.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.917+0000 7fc695439700 1 --2- 172.21.15.117:0/3114495678 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc67806dca0 0x7fc678070150 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc690111450 tx=0x7fc684009ee0 comp rx=0 tx=0).stop 2024-04-12T09:21:38.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.917+0000 7fc695439700 1 -- 172.21.15.117:0/3114495678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc690102e00 msgr2=0x7fc690115bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:38.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.917+0000 7fc695439700 1 --2- 172.21.15.117:0/3114495678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc690102e00 0x7fc690115bb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc68000b3b0 tx=0x7fc680009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:38.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.917+0000 7fc695439700 1 -- 172.21.15.117:0/3114495678 shutdown_connections 2024-04-12T09:21:38.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.917+0000 7fc695439700 1 --2- 172.21.15.117:0/3114495678 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc67806dca0 0x7fc678070150 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:38.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.917+0000 7fc695439700 1 --2- 172.21.15.117:0/3114495678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc690102e00 0x7fc690115bb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:38.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.917+0000 7fc695439700 1 --2- 172.21.15.117:0/3114495678 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6901037a0 0x7fc6901160f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:38.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.917+0000 7fc695439700 1 -- 172.21.15.117:0/3114495678 >> 172.21.15.117:0/3114495678 conn(0x7fc6900f89b0 msgr2=0x7fc6901073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:38.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.917+0000 7fc695439700 1 -- 172.21.15.117:0/3114495678 shutdown_connections 2024-04-12T09:21:38.918 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:38.917+0000 7fc695439700 1 -- 172.21.15.117:0/3114495678 wait complete. 2024-04-12T09:21:39.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.018+0000 7efcf6529700 1 -- 172.21.15.117:0/3680520111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcf0101d20 msgr2=0x7efcf01020f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:39.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.018+0000 7efcf6529700 1 --2- 172.21.15.117:0/3680520111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcf0101d20 0x7efcf01020f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efce0004940 tx=0x7efce0009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:39.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.019+0000 7efcf6529700 1 -- 172.21.15.117:0/3680520111 shutdown_connections 2024-04-12T09:21:39.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.019+0000 7efcf6529700 1 --2- 172.21.15.117:0/3680520111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efcf01026c0 0x7efcf00fbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:39.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.019+0000 7efcf6529700 1 --2- 172.21.15.117:0/3680520111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcf0101d20 0x7efcf01020f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:39.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.019+0000 7efcf6529700 1 -- 172.21.15.117:0/3680520111 >> 172.21.15.117:0/3680520111 conn(0x7efcf00f7870 msgr2=0x7efcf00f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:39.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.019+0000 7efcf6529700 1 -- 172.21.15.117:0/3680520111 shutdown_connections 2024-04-12T09:21:39.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.019+0000 7efcf6529700 1 -- 172.21.15.117:0/3680520111 wait complete. 2024-04-12T09:21:39.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.019+0000 7efcf6529700 1 Processor -- start 2024-04-12T09:21:39.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.019+0000 7efcf6529700 1 -- start start 2024-04-12T09:21:39.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.019+0000 7efcf6529700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcf0101d20 0x7efcf0113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:39.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.019+0000 7efcf6529700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efcf01026c0 0x7efcf0113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:39.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.019+0000 7efcf6529700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf0114500 con 0x7efcf0101d20 2024-04-12T09:21:39.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.019+0000 7efcf6529700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf010db20 con 0x7efcf01026c0 2024-04-12T09:21:39.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.020+0000 7efceffff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcf0101d20 0x7efcf0113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:39.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.020+0000 7efceffff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcf0101d20 0x7efcf0113970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:59278/0 (socket says 172.21.15.117:59278) 2024-04-12T09:21:39.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.020+0000 7efceffff700 1 -- 172.21.15.117:0/108745339 learned_addr learned my addr 172.21.15.117:0/108745339 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:21:39.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.020+0000 7efcef7fe700 1 --2- 172.21.15.117:0/108745339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efcf01026c0 0x7efcf0113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:39.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.020+0000 7efceffff700 1 -- 172.21.15.117:0/108745339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efcf01026c0 msgr2=0x7efcf0113eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:39.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.020+0000 7efceffff700 1 --2- 172.21.15.117:0/108745339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efcf01026c0 0x7efcf0113eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:39.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.020+0000 7efceffff700 1 -- 172.21.15.117:0/108745339 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce0005040 con 0x7efcf0101d20 2024-04-12T09:21:39.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.020+0000 7efceffff700 1 --2- 172.21.15.117:0/108745339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcf0101d20 0x7efcf0113970 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efce000b8b0 tx=0x7efce0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:39.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.020+0000 7efcecff9700 1 -- 172.21.15.117:0/108745339 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efce000e040 con 0x7efcf0101d20 2024-04-12T09:21:39.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.020+0000 7efcecff9700 1 -- 172.21.15.117:0/108745339 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efce0004290 con 0x7efcf0101d20 2024-04-12T09:21:39.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.020+0000 7efcf6529700 1 -- 172.21.15.117:0/108745339 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf010dda0 con 0x7efcf0101d20 2024-04-12T09:21:39.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.020+0000 7efcecff9700 1 -- 172.21.15.117:0/108745339 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efce001c3f0 con 0x7efcf0101d20 2024-04-12T09:21:39.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.020+0000 7efcf6529700 1 -- 172.21.15.117:0/108745339 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf010e360 con 0x7efcf0101d20 2024-04-12T09:21:39.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.021+0000 7efcf6529700 1 -- 172.21.15.117:0/108745339 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf00ff030 con 0x7efcf0101d20 2024-04-12T09:21:39.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.022+0000 7efcecff9700 1 -- 172.21.15.117:0/108745339 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7efce0013420 con 0x7efcf0101d20 2024-04-12T09:21:39.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.022+0000 7efcecff9700 1 --2- 172.21.15.117:0/108745339 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7efcd806dca0 0x7efcd8070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:39.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.022+0000 7efcecff9700 1 -- 172.21.15.117:0/108745339 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7efce008e7e0 con 0x7efcf0101d20 2024-04-12T09:21:39.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.022+0000 7efcef7fe700 1 --2- 172.21.15.117:0/108745339 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7efcd806dca0 0x7efcd8070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:39.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.023+0000 7efcef7fe700 1 --2- 172.21.15.117:0/108745339 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7efcd806dca0 0x7efcd8070150 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efcf010f210 tx=0x7efce400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:39.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.027+0000 7efcecff9700 1 -- 172.21.15.117:0/108745339 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7efce0057d90 con 0x7efcf0101d20 2024-04-12T09:21:39.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:38 smithi203 ceph-mon[86783]: mds.? [v2:172.21.15.117:6826/2687704577,v1:172.21.15.117:6827/2687704577] up:rejoin 2024-04-12T09:21:39.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:38 smithi203 ceph-mon[86783]: fsmap cephfs:1/1 {0=cephfs.smithi117.wddsgt=up:rejoin} 2 up:standby 2024-04-12T09:21:39.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:38 smithi203 ceph-mon[86783]: daemon mds.cephfs.smithi117.wddsgt is now active in filesystem cephfs as rank 0 2024-04-12T09:21:39.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:38 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:39.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:38 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:39.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:38 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:21:39.277 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.277+0000 7efcf6529700 1 -- 172.21.15.117:0/108745339 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efcf00fd470 con 0x7efcf0101d20 2024-04-12T09:21:39.278 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.277+0000 7efcecff9700 1 -- 172.21.15.117:0/108745339 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) v1 ==== 76+0+1942 (secure 0 0 0) 0x7efce005b450 con 0x7efcf0101d20 2024-04-12T09:21:39.278 INFO:teuthology.orchestra.run.smithi117.stdout:e31 2024-04-12T09:21:39.278 INFO:teuthology.orchestra.run.smithi117.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T09:21:39.278 INFO:teuthology.orchestra.run.smithi117.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:21:39.278 INFO:teuthology.orchestra.run.smithi117.stdout:legacy client fscid: 1 2024-04-12T09:21:39.278 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:21:39.278 INFO:teuthology.orchestra.run.smithi117.stdout:Filesystem 'cephfs' (1) 2024-04-12T09:21:39.278 INFO:teuthology.orchestra.run.smithi117.stdout:fs_name cephfs 2024-04-12T09:21:39.278 INFO:teuthology.orchestra.run.smithi117.stdout:epoch 31 2024-04-12T09:21:39.279 INFO:teuthology.orchestra.run.smithi117.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T09:21:39.279 INFO:teuthology.orchestra.run.smithi117.stdout:created 2024-04-12T09:08:12.488144+0000 2024-04-12T09:21:39.279 INFO:teuthology.orchestra.run.smithi117.stdout:modified 2024-04-12T09:21:38.819333+0000 2024-04-12T09:21:39.279 INFO:teuthology.orchestra.run.smithi117.stdout:tableserver 0 2024-04-12T09:21:39.279 INFO:teuthology.orchestra.run.smithi117.stdout:root 0 2024-04-12T09:21:39.279 INFO:teuthology.orchestra.run.smithi117.stdout:session_timeout 60 2024-04-12T09:21:39.279 INFO:teuthology.orchestra.run.smithi117.stdout:session_autoclose 300 2024-04-12T09:21:39.279 INFO:teuthology.orchestra.run.smithi117.stdout:max_file_size 1099511627776 2024-04-12T09:21:39.279 INFO:teuthology.orchestra.run.smithi117.stdout:max_xattr_size 65536 2024-04-12T09:21:39.279 INFO:teuthology.orchestra.run.smithi117.stdout:required_client_features {} 2024-04-12T09:21:39.279 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure 0 2024-04-12T09:21:39.279 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure_osd_epoch 83 2024-04-12T09:21:39.279 INFO:teuthology.orchestra.run.smithi117.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-12T09:21:39.279 INFO:teuthology.orchestra.run.smithi117.stdout:max_mds 1 2024-04-12T09:21:39.280 INFO:teuthology.orchestra.run.smithi117.stdout:in 0 2024-04-12T09:21:39.280 INFO:teuthology.orchestra.run.smithi117.stdout:up {0=34372} 2024-04-12T09:21:39.280 INFO:teuthology.orchestra.run.smithi117.stdout:failed 2024-04-12T09:21:39.280 INFO:teuthology.orchestra.run.smithi117.stdout:damaged 2024-04-12T09:21:39.280 INFO:teuthology.orchestra.run.smithi117.stdout:stopped 2024-04-12T09:21:39.280 INFO:teuthology.orchestra.run.smithi117.stdout:data_pools [3] 2024-04-12T09:21:39.280 INFO:teuthology.orchestra.run.smithi117.stdout:metadata_pool 2 2024-04-12T09:21:39.280 INFO:teuthology.orchestra.run.smithi117.stdout:inline_data disabled 2024-04-12T09:21:39.280 INFO:teuthology.orchestra.run.smithi117.stdout:balancer 2024-04-12T09:21:39.280 INFO:teuthology.orchestra.run.smithi117.stdout:bal_rank_mask -1 2024-04-12T09:21:39.280 INFO:teuthology.orchestra.run.smithi117.stdout:standby_count_wanted 1 2024-04-12T09:21:39.280 INFO:teuthology.orchestra.run.smithi117.stdout:qdb_cluster leader: 34372 members: 34372 2024-04-12T09:21:39.281 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.wddsgt{0:34372} state up:active seq 20 join_fscid=1 addr [v2:172.21.15.117:6826/2687704577,v1:172.21.15.117:6827/2687704577] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T09:21:39.281 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:21:39.281 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:21:39.281 INFO:teuthology.orchestra.run.smithi117.stdout:Standby daemons: 2024-04-12T09:21:39.281 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:21:39.281 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.eslmxh{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6828/2675574893,v1:172.21.15.117:6829/2675574893] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T09:21:39.281 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.fbeixl{-1:44311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.203:6824/3346773589,v1:172.21.15.203:6825/3346773589] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T09:21:39.281 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.bszhxz{-1:44327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.203:6826/240713176,v1:172.21.15.203:6827/240713176] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T09:21:39.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.279+0000 7efcf6529700 1 -- 172.21.15.117:0/108745339 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7efcd806dca0 msgr2=0x7efcd8070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:39.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.279+0000 7efcf6529700 1 --2- 172.21.15.117:0/108745339 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7efcd806dca0 0x7efcd8070150 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efcf010f210 tx=0x7efce400b040 comp rx=0 tx=0).stop 2024-04-12T09:21:39.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.279+0000 7efcf6529700 1 -- 172.21.15.117:0/108745339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcf0101d20 msgr2=0x7efcf0113970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:39.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.279+0000 7efcf6529700 1 --2- 172.21.15.117:0/108745339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcf0101d20 0x7efcf0113970 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efce000b8b0 tx=0x7efce0009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:39.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.279+0000 7efcf6529700 1 -- 172.21.15.117:0/108745339 shutdown_connections 2024-04-12T09:21:39.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.279+0000 7efcf6529700 1 --2- 172.21.15.117:0/108745339 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7efcd806dca0 0x7efcd8070150 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:39.282 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.279+0000 7efcf6529700 1 --2- 172.21.15.117:0/108745339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcf0101d20 0x7efcf0113970 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:39.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.279+0000 7efcf6529700 1 --2- 172.21.15.117:0/108745339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efcf01026c0 0x7efcf0113eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:39.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.279+0000 7efcf6529700 1 -- 172.21.15.117:0/108745339 >> 172.21.15.117:0/108745339 conn(0x7efcf00f7870 msgr2=0x7efcf0106310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:39.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.280+0000 7efcf6529700 1 -- 172.21.15.117:0/108745339 shutdown_connections 2024-04-12T09:21:39.283 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.280+0000 7efcf6529700 1 -- 172.21.15.117:0/108745339 wait complete. 2024-04-12T09:21:39.283 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 31 2024-04-12T09:21:39.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.382+0000 7f73ba35e700 1 -- 172.21.15.117:0/3013078222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73b4102800 msgr2=0x7f73b40fc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:39.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.382+0000 7f73ba35e700 1 --2- 172.21.15.117:0/3013078222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73b4102800 0x7f73b40fc650 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f73a4004940 tx=0x7f73a4009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:39.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.382+0000 7f73ba35e700 1 -- 172.21.15.117:0/3013078222 shutdown_connections 2024-04-12T09:21:39.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.382+0000 7f73ba35e700 1 --2- 172.21.15.117:0/3013078222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73b4102800 0x7f73b40fc650 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:39.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.382+0000 7f73ba35e700 1 --2- 172.21.15.117:0/3013078222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73b4101e60 0x7f73b4102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:39.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.382+0000 7f73ba35e700 1 -- 172.21.15.117:0/3013078222 >> 172.21.15.117:0/3013078222 conn(0x7f73b4071530 msgr2=0x7f73b4071930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:39.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.382+0000 7f73ba35e700 1 -- 172.21.15.117:0/3013078222 shutdown_connections 2024-04-12T09:21:39.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.382+0000 7f73ba35e700 1 -- 172.21.15.117:0/3013078222 wait complete. 2024-04-12T09:21:39.383 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.382+0000 7f73ba35e700 1 Processor -- start 2024-04-12T09:21:39.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.383+0000 7f73ba35e700 1 -- start start 2024-04-12T09:21:39.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.383+0000 7f73ba35e700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73b4101e60 0x7f73b4102cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:39.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.383+0000 7f73ba35e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73b4102800 0x7f73b4103200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:39.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.383+0000 7f73ba35e700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b4104c10 con 0x7f73b4102800 2024-04-12T09:21:39.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.383+0000 7f73ba35e700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b4103740 con 0x7f73b4101e60 2024-04-12T09:21:39.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.383+0000 7f73b37fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73b4102800 0x7f73b4103200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:39.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.383+0000 7f73b37fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73b4102800 0x7f73b4103200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:59310/0 (socket says 172.21.15.117:59310) 2024-04-12T09:21:39.385 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.383+0000 7f73b37fe700 1 -- 172.21.15.117:0/2479642132 learned_addr learned my addr 172.21.15.117:0/2479642132 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:21:39.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.383+0000 7f73b3fff700 1 --2- 172.21.15.117:0/2479642132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73b4101e60 0x7f73b4102cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:39.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.383+0000 7f73b37fe700 1 -- 172.21.15.117:0/2479642132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73b4101e60 msgr2=0x7f73b4102cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:39.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.383+0000 7f73b37fe700 1 --2- 172.21.15.117:0/2479642132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73b4101e60 0x7f73b4102cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:39.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.383+0000 7f73b37fe700 1 -- 172.21.15.117:0/2479642132 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a4005040 con 0x7f73b4102800 2024-04-12T09:21:39.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.383+0000 7f73b37fe700 1 --2- 172.21.15.117:0/2479642132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73b4102800 0x7f73b4103200 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f73a4000c00 tx=0x7f73a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:39.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.384+0000 7f73b0ff9700 1 -- 172.21.15.117:0/2479642132 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73a4021070 con 0x7f73b4102800 2024-04-12T09:21:39.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.384+0000 7f73b0ff9700 1 -- 172.21.15.117:0/2479642132 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f73a4013c00 con 0x7f73b4102800 2024-04-12T09:21:39.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.384+0000 7f73ba35e700 1 -- 172.21.15.117:0/2479642132 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b41039c0 con 0x7f73b4102800 2024-04-12T09:21:39.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.384+0000 7f73b0ff9700 1 -- 172.21.15.117:0/2479642132 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73a400e070 con 0x7f73b4102800 2024-04-12T09:21:39.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.384+0000 7f73ba35e700 1 -- 172.21.15.117:0/2479642132 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b411a040 con 0x7f73b4102800 2024-04-12T09:21:39.386 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.385+0000 7f73ba35e700 1 -- 172.21.15.117:0/2479642132 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b41001d0 con 0x7f73b4102800 2024-04-12T09:21:39.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.385+0000 7f73b0ff9700 1 -- 172.21.15.117:0/2479642132 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f73a401ca60 con 0x7f73b4102800 2024-04-12T09:21:39.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.385+0000 7f73b0ff9700 1 --2- 172.21.15.117:0/2479642132 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f739c06dca0 0x7f739c070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:39.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.386+0000 7f73b0ff9700 1 -- 172.21.15.117:0/2479642132 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f73a408e8b0 con 0x7f73b4102800 2024-04-12T09:21:39.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.386+0000 7f73b3fff700 1 --2- 172.21.15.117:0/2479642132 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f739c06dca0 0x7f739c070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:39.387 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.386+0000 7f73b3fff700 1 --2- 172.21.15.117:0/2479642132 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f739c06dca0 0x7f739c070150 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f73a8009b80 tx=0x7f73a800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:39.390 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.390+0000 7f73b0ff9700 1 -- 172.21.15.117:0/2479642132 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f73a4057f00 con 0x7f73b4102800 2024-04-12T09:21:39.606 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.605+0000 7f73ba35e700 1 -- 172.21.15.117:0/2479642132 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f73b4104210 con 0x7f739c06dca0 2024-04-12T09:21:39.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.607+0000 7f73b0ff9700 1 -- 172.21.15.117:0/2479642132 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f73b4104210 con 0x7f739c06dca0 2024-04-12T09:21:39.607 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:21:39.607 INFO:teuthology.orchestra.run.smithi117.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec", 2024-04-12T09:21:39.607 INFO:teuthology.orchestra.run.smithi117.stdout: "in_progress": true, 2024-04-12T09:21:39.608 INFO:teuthology.orchestra.run.smithi117.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-12T09:21:39.608 INFO:teuthology.orchestra.run.smithi117.stdout: "services_complete": [ 2024-04-12T09:21:39.608 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr", 2024-04-12T09:21:39.608 INFO:teuthology.orchestra.run.smithi117.stdout: "osd", 2024-04-12T09:21:39.608 INFO:teuthology.orchestra.run.smithi117.stdout: "mon", 2024-04-12T09:21:39.608 INFO:teuthology.orchestra.run.smithi117.stdout: "crash" 2024-04-12T09:21:39.608 INFO:teuthology.orchestra.run.smithi117.stdout: ], 2024-04-12T09:21:39.608 INFO:teuthology.orchestra.run.smithi117.stdout: "progress": "15/21 daemons upgraded", 2024-04-12T09:21:39.608 INFO:teuthology.orchestra.run.smithi117.stdout: "message": "Currently upgrading mds daemons", 2024-04-12T09:21:39.608 INFO:teuthology.orchestra.run.smithi117.stdout: "is_paused": false 2024-04-12T09:21:39.608 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:21:39.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.609+0000 7f73ba35e700 1 -- 172.21.15.117:0/2479642132 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f739c06dca0 msgr2=0x7f739c070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:39.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.609+0000 7f73ba35e700 1 --2- 172.21.15.117:0/2479642132 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f739c06dca0 0x7f739c070150 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f73a8009b80 tx=0x7f73a800b040 comp rx=0 tx=0).stop 2024-04-12T09:21:39.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.609+0000 7f73ba35e700 1 -- 172.21.15.117:0/2479642132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73b4102800 msgr2=0x7f73b4103200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:39.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.609+0000 7f73ba35e700 1 --2- 172.21.15.117:0/2479642132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73b4102800 0x7f73b4103200 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f73a4000c00 tx=0x7f73a4009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:39.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.609+0000 7f73ba35e700 1 -- 172.21.15.117:0/2479642132 shutdown_connections 2024-04-12T09:21:39.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.609+0000 7f73ba35e700 1 --2- 172.21.15.117:0/2479642132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f73b4101e60 0x7f73b4102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:39.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.609+0000 7f73ba35e700 1 --2- 172.21.15.117:0/2479642132 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f739c06dca0 0x7f739c070150 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:39.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.609+0000 7f73ba35e700 1 --2- 172.21.15.117:0/2479642132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73b4102800 0x7f73b4103200 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:39.610 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.609+0000 7f73ba35e700 1 -- 172.21.15.117:0/2479642132 >> 172.21.15.117:0/2479642132 conn(0x7f73b4071530 msgr2=0x7f73b41052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:39.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.609+0000 7f73ba35e700 1 -- 172.21.15.117:0/2479642132 shutdown_connections 2024-04-12T09:21:39.611 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.610+0000 7f73ba35e700 1 -- 172.21.15.117:0/2479642132 wait complete. 2024-04-12T09:21:39.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.712+0000 7ff0dece7700 1 -- 172.21.15.117:0/2413133347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d8102f50 msgr2=0x7ff0d8103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:39.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.712+0000 7ff0dece7700 1 --2- 172.21.15.117:0/2413133347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d8102f50 0x7ff0d8103320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc004940 tx=0x7ff0cc009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:39.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.712+0000 7ff0dece7700 1 -- 172.21.15.117:0/2413133347 shutdown_connections 2024-04-12T09:21:39.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.712+0000 7ff0dece7700 1 --2- 172.21.15.117:0/2413133347 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff0d80fb4d0 0x7ff0d80fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:39.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.712+0000 7ff0dece7700 1 --2- 172.21.15.117:0/2413133347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d8102f50 0x7ff0d8103320 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:39.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.712+0000 7ff0dece7700 1 -- 172.21.15.117:0/2413133347 >> 172.21.15.117:0/2413133347 conn(0x7ff0d80714c0 msgr2=0x7ff0d80718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:39.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.712+0000 7ff0dece7700 1 -- 172.21.15.117:0/2413133347 shutdown_connections 2024-04-12T09:21:39.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.712+0000 7ff0dece7700 1 -- 172.21.15.117:0/2413133347 wait complete. 2024-04-12T09:21:39.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.712+0000 7ff0dece7700 1 Processor -- start 2024-04-12T09:21:39.714 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.713+0000 7ff0dece7700 1 -- start start 2024-04-12T09:21:39.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.713+0000 7ff0dece7700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff0d80fb4d0 0x7ff0d80fc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:39.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.713+0000 7ff0dece7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d8102f50 0x7ff0d80fcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:39.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.713+0000 7ff0dece7700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80fe600 con 0x7ff0d8102f50 2024-04-12T09:21:39.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.713+0000 7ff0dece7700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80fd130 con 0x7ff0d80fb4d0 2024-04-12T09:21:39.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.713+0000 7ff0d7fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d8102f50 0x7ff0d80fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:39.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.713+0000 7ff0dca83700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff0d80fb4d0 0x7ff0d80fc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:39.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.713+0000 7ff0dca83700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff0d80fb4d0 0x7ff0d80fc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.117:42780/0 (socket says 172.21.15.117:42780) 2024-04-12T09:21:39.715 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.713+0000 7ff0d7fff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d8102f50 0x7ff0d80fcbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:45228/0 (socket says 172.21.15.117:45228) 2024-04-12T09:21:39.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.713+0000 7ff0dca83700 1 -- 172.21.15.117:0/3968239214 learned_addr learned my addr 172.21.15.117:0/3968239214 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:21:39.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.713+0000 7ff0dca83700 1 -- 172.21.15.117:0/3968239214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d8102f50 msgr2=0x7ff0d80fcbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:39.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.713+0000 7ff0dca83700 1 --2- 172.21.15.117:0/3968239214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d8102f50 0x7ff0d80fcbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:39.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.713+0000 7ff0dca83700 1 -- 172.21.15.117:0/3968239214 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0cc005040 con 0x7ff0d80fb4d0 2024-04-12T09:21:39.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.714+0000 7ff0dca83700 1 --2- 172.21.15.117:0/3968239214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff0d80fb4d0 0x7ff0d80fc6b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc000c00 tx=0x7ff0cc009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:39.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.714+0000 7ff0d57fa700 1 -- 172.21.15.117:0/3968239214 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0cc021070 con 0x7ff0d80fb4d0 2024-04-12T09:21:39.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.714+0000 7ff0dece7700 1 -- 172.21.15.117:0/3968239214 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d80fd3b0 con 0x7ff0d80fb4d0 2024-04-12T09:21:39.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.714+0000 7ff0d57fa700 1 -- 172.21.15.117:0/3968239214 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff0cc013c00 con 0x7ff0d80fb4d0 2024-04-12T09:21:39.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.714+0000 7ff0d57fa700 1 -- 172.21.15.117:0/3968239214 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0cc00e070 con 0x7ff0d80fb4d0 2024-04-12T09:21:39.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.714+0000 7ff0dece7700 1 -- 172.21.15.117:0/3968239214 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d811a0f0 con 0x7ff0d80fb4d0 2024-04-12T09:21:39.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.715+0000 7ff0dece7700 1 -- 172.21.15.117:0/3968239214 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d8100200 con 0x7ff0d80fb4d0 2024-04-12T09:21:39.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.716+0000 7ff0d57fa700 1 -- 172.21.15.117:0/3968239214 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7ff0cc01ca60 con 0x7ff0d80fb4d0 2024-04-12T09:21:39.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.716+0000 7ff0d57fa700 1 --2- 172.21.15.117:0/3968239214 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff0c806dca0 0x7ff0c8070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:21:39.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.716+0000 7ff0d57fa700 1 -- 172.21.15.117:0/3968239214 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7ff0cc08ea10 con 0x7ff0d80fb4d0 2024-04-12T09:21:39.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.716+0000 7ff0d7fff700 1 --2- 172.21.15.117:0/3968239214 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff0c806dca0 0x7ff0c8070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:21:39.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.716+0000 7ff0d7fff700 1 --2- 172.21.15.117:0/3968239214 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff0c806dca0 0x7ff0c8070150 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff0d80fdde0 tx=0x7ff0c400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:21:39.721 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.720+0000 7ff0d57fa700 1 -- 172.21.15.117:0/3968239214 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff0cc057fe0 con 0x7ff0d80fb4d0 2024-04-12T09:21:39.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:39 smithi117 ceph-mon[113571]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:21:39.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:39 smithi117 ceph-mon[113571]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:21:39.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:39 smithi117 ceph-mon[113571]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:21:39.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:39 smithi117 ceph-mon[113571]: pgmap v209: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-12T09:21:39.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:39 smithi117 ceph-mon[113571]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-12T09:21:39.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:39 smithi117 ceph-mon[113571]: Cluster is now healthy 2024-04-12T09:21:39.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:39 smithi117 ceph-mon[113571]: mds.? [v2:172.21.15.117:6826/2687704577,v1:172.21.15.117:6827/2687704577] up:active 2024-04-12T09:21:39.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:39 smithi117 ceph-mon[113571]: mds.? [v2:172.21.15.203:6826/240713176,v1:172.21.15.203:6827/240713176] up:boot 2024-04-12T09:21:39.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:39 smithi117 ceph-mon[113571]: fsmap cephfs:1 {0=cephfs.smithi117.wddsgt=up:active} 3 up:standby 2024-04-12T09:21:39.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.bszhxz"}]: dispatch 2024-04-12T09:21:39.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:39 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/3114495678' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:39.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:39 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/108745339' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:21:39.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:21:39.931 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:39 smithi203 ceph-mon[86783]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:21:39.931 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:39 smithi203 ceph-mon[86783]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:21:39.931 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:39 smithi203 ceph-mon[86783]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:21:39.931 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:39 smithi203 ceph-mon[86783]: pgmap v209: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-12T09:21:39.931 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:39 smithi203 ceph-mon[86783]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-12T09:21:39.931 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:39 smithi203 ceph-mon[86783]: Cluster is now healthy 2024-04-12T09:21:39.932 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:39 smithi203 ceph-mon[86783]: mds.? [v2:172.21.15.117:6826/2687704577,v1:172.21.15.117:6827/2687704577] up:active 2024-04-12T09:21:39.932 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:39 smithi203 ceph-mon[86783]: mds.? [v2:172.21.15.203:6826/240713176,v1:172.21.15.203:6827/240713176] up:boot 2024-04-12T09:21:39.932 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:39 smithi203 ceph-mon[86783]: fsmap cephfs:1 {0=cephfs.smithi117.wddsgt=up:active} 3 up:standby 2024-04-12T09:21:39.932 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi203.bszhxz"}]: dispatch 2024-04-12T09:21:39.932 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:39 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/3114495678' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:39.932 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:39 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/108745339' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:21:39.932 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:21:39.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.996+0000 7ff0dece7700 1 -- 172.21.15.117:0/3968239214 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff0d810a0a0 con 0x7ff0d80fb4d0 2024-04-12T09:21:39.997 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.997+0000 7ff0d57fa700 1 -- 172.21.15.117:0/3968239214 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff0cc004490 con 0x7ff0d80fb4d0 2024-04-12T09:21:39.997 INFO:teuthology.orchestra.run.smithi117.stdout:HEALTH_OK 2024-04-12T09:21:39.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.999+0000 7ff0dece7700 1 -- 172.21.15.117:0/3968239214 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff0c806dca0 msgr2=0x7ff0c8070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:39.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.999+0000 7ff0dece7700 1 --2- 172.21.15.117:0/3968239214 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff0c806dca0 0x7ff0c8070150 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff0d80fdde0 tx=0x7ff0c400b040 comp rx=0 tx=0).stop 2024-04-12T09:21:39.999 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.999+0000 7ff0dece7700 1 -- 172.21.15.117:0/3968239214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff0d80fb4d0 msgr2=0x7ff0d80fc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:21:40.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.999+0000 7ff0dece7700 1 --2- 172.21.15.117:0/3968239214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff0d80fb4d0 0x7ff0d80fc6b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc000c00 tx=0x7ff0cc009e30 comp rx=0 tx=0).stop 2024-04-12T09:21:40.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.999+0000 7ff0dece7700 1 -- 172.21.15.117:0/3968239214 shutdown_connections 2024-04-12T09:21:40.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.999+0000 7ff0dece7700 1 --2- 172.21.15.117:0/3968239214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff0d80fb4d0 0x7ff0d80fc6b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:40.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.999+0000 7ff0dece7700 1 --2- 172.21.15.117:0/3968239214 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff0c806dca0 0x7ff0c8070150 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:40.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.999+0000 7ff0dece7700 1 --2- 172.21.15.117:0/3968239214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0d8102f50 0x7ff0d80fcbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:21:40.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.999+0000 7ff0dece7700 1 -- 172.21.15.117:0/3968239214 >> 172.21.15.117:0/3968239214 conn(0x7ff0d80714c0 msgr2=0x7ff0d80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:21:40.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.999+0000 7ff0dece7700 1 -- 172.21.15.117:0/3968239214 shutdown_connections 2024-04-12T09:21:40.000 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:21:39.999+0000 7ff0dece7700 1 -- 172.21.15.117:0/3968239214 wait complete. 2024-04-12T09:21:41.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:40 smithi117 ceph-mon[113571]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:21:41.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:40 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/3968239214' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:21:41.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:40 smithi203 ceph-mon[86783]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:21:41.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:40 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/3968239214' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:21:42.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:41 smithi117 ceph-mon[113571]: pgmap v210: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 0 B/s wr, 4 op/s 2024-04-12T09:21:42.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:41 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:42.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:41 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:42.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:41 smithi203 ceph-mon[86783]: pgmap v210: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 0 B/s wr, 4 op/s 2024-04-12T09:21:42.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:41 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:42.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:41 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:43.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:42 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:43.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:42 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:43.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:42 smithi203 ceph-mon[86783]: pgmap v211: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-04-12T09:21:43.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:42 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:43.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:42 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:43.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:42 smithi117 ceph-mon[113571]: pgmap v211: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-04-12T09:21:46.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:45 smithi203 ceph-mon[86783]: pgmap v212: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 5.6 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-12T09:21:46.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:45 smithi117 ceph-mon[113571]: pgmap v212: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 5.6 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-12T09:21:47.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:47.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:47.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:21:47.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:21:47.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:47.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:47 smithi203 ceph-mon[86783]: pgmap v213: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-12T09:21:47.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:21:47.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:47.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:47.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:47.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:47.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:47.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:47 smithi203 ceph-mon[86783]: Upgrade: Setting container_image for all mds 2024-04-12T09:21:47.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:47.824 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi117.eslmxh"}]: dispatch 2024-04-12T09:21:47.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi117.eslmxh"}]': finished 2024-04-12T09:21:47.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi117.wddsgt"}]: dispatch 2024-04-12T09:21:47.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi117.wddsgt"}]': finished 2024-04-12T09:21:47.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi203.bszhxz"}]: dispatch 2024-04-12T09:21:47.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi203.bszhxz"}]': finished 2024-04-12T09:21:47.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi203.fbeixl"}]: dispatch 2024-04-12T09:21:47.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi203.fbeixl"}]': finished 2024-04-12T09:21:47.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:47 smithi203 ceph-mon[86783]: Upgrade: Setting filesystem cephfs Joinable 2024-04-12T09:21:47.825 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:47 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-04-12T09:21:47.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:47.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:47.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:21:47.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:21:47.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:47.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:47 smithi117 ceph-mon[113571]: pgmap v213: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-12T09:21:47.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:21:47.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:47.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:47.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:47.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:47.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:47.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:47 smithi117 ceph-mon[113571]: Upgrade: Setting container_image for all mds 2024-04-12T09:21:47.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:47.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi117.eslmxh"}]: dispatch 2024-04-12T09:21:47.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi117.eslmxh"}]': finished 2024-04-12T09:21:47.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi117.wddsgt"}]: dispatch 2024-04-12T09:21:47.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi117.wddsgt"}]': finished 2024-04-12T09:21:47.911 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi203.bszhxz"}]: dispatch 2024-04-12T09:21:47.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi203.bszhxz"}]': finished 2024-04-12T09:21:47.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi203.fbeixl"}]: dispatch 2024-04-12T09:21:47.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi203.fbeixl"}]': finished 2024-04-12T09:21:47.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:47 smithi117 ceph-mon[113571]: Upgrade: Setting filesystem cephfs Joinable 2024-04-12T09:21:47.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:47 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-04-12T09:21:49.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-04-12T09:21:49.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: fsmap cephfs:1 {0=cephfs.smithi117.wddsgt=up:active} 3 up:standby 2024-04-12T09:21:49.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: Upgrade: Setting container_image for all rgw 2024-04-12T09:21:49.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:49.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: Upgrade: Setting container_image for all rbd-mirror 2024-04-12T09:21:49.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:49.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: Upgrade: Setting container_image for all ceph-exporter 2024-04-12T09:21:49.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:49.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: Upgrade: Setting container_image for all iscsi 2024-04-12T09:21:49.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:49.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: Upgrade: Setting container_image for all nfs 2024-04-12T09:21:49.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:49.075 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: Upgrade: Setting container_image for all nvmeof 2024-04-12T09:21:49.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:49.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: Upgrade: Finalizing container_image settings 2024-04-12T09:21:49.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-12T09:21:49.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-12T09:21:49.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:21:49.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-12T09:21:49.076 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-12T09:21:49.077 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-12T09:21:49.077 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-12T09:21:49.077 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-12T09:21:49.077 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-12T09:21:49.077 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-12T09:21:49.077 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-12T09:21:49.077 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-12T09:21:49.077 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-12T09:21:49.077 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-12T09:21:49.077 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:21:49.077 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-12T09:21:49.077 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-12T09:21:49.077 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-12T09:21:49.077 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-12T09:21:49.078 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-12T09:21:49.078 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-12T09:21:49.078 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-12T09:21:49.078 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-12T09:21:49.078 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:21:49.078 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:21:49.078 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:21:49.078 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:21:49.078 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:21:49.078 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:21:49.078 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: Upgrade: Complete! 2024-04-12T09:21:49.078 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-12T09:21:49.078 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-12T09:21:49.078 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:21:49.079 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:21:49.079 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:21:49.079 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:49.079 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:21:49.079 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:21:49.079 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:21:49.079 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:49.112 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-04-12T09:21:49.112 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: fsmap cephfs:1 {0=cephfs.smithi117.wddsgt=up:active} 3 up:standby 2024-04-12T09:21:49.112 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.112 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: Upgrade: Setting container_image for all rgw 2024-04-12T09:21:49.112 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:49.112 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.112 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: Upgrade: Setting container_image for all rbd-mirror 2024-04-12T09:21:49.112 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:49.113 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.113 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.113 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: Upgrade: Setting container_image for all ceph-exporter 2024-04-12T09:21:49.113 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:49.113 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.113 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: Upgrade: Setting container_image for all iscsi 2024-04-12T09:21:49.113 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:49.113 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.113 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: Upgrade: Setting container_image for all nfs 2024-04-12T09:21:49.113 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:49.113 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.113 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: Upgrade: Setting container_image for all nvmeof 2024-04-12T09:21:49.113 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:49.113 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.113 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.114 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.114 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.114 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.114 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:21:49.114 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: Upgrade: Finalizing container_image settings 2024-04-12T09:21:49.114 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-12T09:21:49.114 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-12T09:21:49.114 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:21:49.114 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-12T09:21:49.114 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-12T09:21:49.114 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-12T09:21:49.114 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-12T09:21:49.114 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-12T09:21:49.115 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-12T09:21:49.115 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-12T09:21:49.115 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-12T09:21:49.115 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-12T09:21:49.115 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-12T09:21:49.115 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-12T09:21:49.116 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:21:49.116 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-12T09:21:49.116 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-12T09:21:49.116 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-12T09:21:49.116 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-12T09:21:49.116 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-12T09:21:49.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-12T09:21:49.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-12T09:21:49.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-12T09:21:49.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:21:49.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:21:49.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:21:49.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:21:49.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:21:49.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-12T09:21:49.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: Upgrade: Complete! 2024-04-12T09:21:49.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-12T09:21:49.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-12T09:21:49.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:21:49.117 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:21:49.118 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:21:49.118 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:49.118 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:21:49.118 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:21:49.118 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:21:49.118 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:50.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:49 smithi203 ceph-mon[86783]: pgmap v214: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-12T09:21:50.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:49 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:50.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:49 smithi117 ceph-mon[113571]: pgmap v214: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-12T09:21:50.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:49 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:21:52.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:51 smithi203 ceph-mon[86783]: pgmap v215: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-12T09:21:52.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:51 smithi117 ceph-mon[113571]: pgmap v215: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-04-12T09:21:54.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:53 smithi203 ceph-mon[86783]: pgmap v216: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-04-12T09:21:54.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:53 smithi117 ceph-mon[113571]: pgmap v216: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-04-12T09:21:55.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:54 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:21:55.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:21:56.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:55 smithi203 ceph-mon[86783]: pgmap v217: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:21:56.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:55 smithi117 ceph-mon[113571]: pgmap v217: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:21:58.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:57 smithi203 ceph-mon[86783]: pgmap v218: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:21:58.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:57 smithi117 ceph-mon[113571]: pgmap v218: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:00.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:21:59 smithi203 ceph-mon[86783]: pgmap v219: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:00.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:21:59 smithi117 ceph-mon[113571]: pgmap v219: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:02.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:01 smithi203 ceph-mon[86783]: pgmap v220: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:02.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:01 smithi117 ceph-mon[113571]: pgmap v220: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:04.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:03 smithi203 ceph-mon[86783]: pgmap v221: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:04.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:03 smithi117 ceph-mon[113571]: pgmap v221: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:06.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:05 smithi203 ceph-mon[86783]: pgmap v222: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:06.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:05 smithi117 ceph-mon[113571]: pgmap v222: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:08.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:07 smithi203 ceph-mon[86783]: pgmap v223: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:08.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:07 smithi117 ceph-mon[113571]: pgmap v223: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:10.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:09 smithi203 ceph-mon[86783]: pgmap v224: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:10.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:09 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:22:10.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.101+0000 7efcdb7c3700 1 -- 172.21.15.117:0/579691044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd4101d20 msgr2=0x7efcd41020f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:22:10.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.101+0000 7efcdb7c3700 1 --2- 172.21.15.117:0/579691044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd4101d20 0x7efcd41020f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efccc004940 tx=0x7efccc009e30 comp rx=0 tx=0).stop 2024-04-12T09:22:10.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.101+0000 7efcdb7c3700 1 -- 172.21.15.117:0/579691044 shutdown_connections 2024-04-12T09:22:10.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.101+0000 7efcdb7c3700 1 --2- 172.21.15.117:0/579691044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efcd41026c0 0x7efcd40fbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:10.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.101+0000 7efcdb7c3700 1 --2- 172.21.15.117:0/579691044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd4101d20 0x7efcd41020f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:10.102 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.101+0000 7efcdb7c3700 1 -- 172.21.15.117:0/579691044 >> 172.21.15.117:0/579691044 conn(0x7efcd40f7870 msgr2=0x7efcd40f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:22:10.103 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:09 smithi117 ceph-mon[113571]: pgmap v224: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:10.103 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:09 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:22:10.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.101+0000 7efcdb7c3700 1 -- 172.21.15.117:0/579691044 shutdown_connections 2024-04-12T09:22:10.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.101+0000 7efcdb7c3700 1 -- 172.21.15.117:0/579691044 wait complete. 2024-04-12T09:22:10.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.102+0000 7efcdb7c3700 1 Processor -- start 2024-04-12T09:22:10.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.102+0000 7efcdb7c3700 1 -- start start 2024-04-12T09:22:10.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.102+0000 7efcdb7c3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd4101d20 0x7efcd4113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:22:10.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.102+0000 7efcdb7c3700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efcd41026c0 0x7efcd4113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:22:10.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.102+0000 7efcdb7c3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd4114590 con 0x7efcd4101d20 2024-04-12T09:22:10.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.102+0000 7efcdb7c3700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd410db20 con 0x7efcd41026c0 2024-04-12T09:22:10.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.102+0000 7efcd955f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd4101d20 0x7efcd4113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:22:10.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.102+0000 7efcd955f700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd4101d20 0x7efcd4113970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58494/0 (socket says 172.21.15.117:58494) 2024-04-12T09:22:10.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.102+0000 7efcd955f700 1 -- 172.21.15.117:0/2737498961 learned_addr learned my addr 172.21.15.117:0/2737498961 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:22:10.105 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.102+0000 7efcd8d5e700 1 --2- 172.21.15.117:0/2737498961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efcd41026c0 0x7efcd4113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:22:10.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.102+0000 7efcd955f700 1 -- 172.21.15.117:0/2737498961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efcd41026c0 msgr2=0x7efcd4113eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:22:10.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.102+0000 7efcd955f700 1 --2- 172.21.15.117:0/2737498961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efcd41026c0 0x7efcd4113eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:10.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.102+0000 7efcd955f700 1 -- 172.21.15.117:0/2737498961 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc005040 con 0x7efcd4101d20 2024-04-12T09:22:10.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.102+0000 7efcd8d5e700 1 --2- 172.21.15.117:0/2737498961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efcd41026c0 0x7efcd4113eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T09:22:10.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.103+0000 7efcd955f700 1 --2- 172.21.15.117:0/2737498961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd4101d20 0x7efcd4113970 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efccc00b3b0 tx=0x7efccc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:22:10.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.103+0000 7efcc9ffb700 1 -- 172.21.15.117:0/2737498961 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efccc00e040 con 0x7efcd4101d20 2024-04-12T09:22:10.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.103+0000 7efcc9ffb700 1 -- 172.21.15.117:0/2737498961 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efccc00bbc0 con 0x7efcd4101d20 2024-04-12T09:22:10.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.103+0000 7efcc9ffb700 1 -- 172.21.15.117:0/2737498961 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efccc01c3f0 con 0x7efcd4101d20 2024-04-12T09:22:10.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.103+0000 7efcdb7c3700 1 -- 172.21.15.117:0/2737498961 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd410dda0 con 0x7efcd4101d20 2024-04-12T09:22:10.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.103+0000 7efcdb7c3700 1 -- 172.21.15.117:0/2737498961 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd410e360 con 0x7efcd4101d20 2024-04-12T09:22:10.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.104+0000 7efcdb7c3700 1 -- 172.21.15.117:0/2737498961 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd40fd470 con 0x7efcd4101d20 2024-04-12T09:22:10.106 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.104+0000 7efcc9ffb700 1 -- 172.21.15.117:0/2737498961 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7efccc00bd30 con 0x7efcd4101d20 2024-04-12T09:22:10.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.105+0000 7efcc9ffb700 1 --2- 172.21.15.117:0/2737498961 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7efcc006dca0 0x7efcc0070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:22:10.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.105+0000 7efcc9ffb700 1 -- 172.21.15.117:0/2737498961 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7efccc08e780 con 0x7efcd4101d20 2024-04-12T09:22:10.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.105+0000 7efcd8d5e700 1 --2- 172.21.15.117:0/2737498961 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7efcc006dca0 0x7efcc0070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:22:10.107 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.105+0000 7efcd8d5e700 1 --2- 172.21.15.117:0/2737498961 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7efcc006dca0 0x7efcc0070150 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efcc4006fd0 tx=0x7efcc4008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:22:10.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.109+0000 7efcc9ffb700 1 -- 172.21.15.117:0/2737498961 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7efccc057d30 con 0x7efcd4101d20 2024-04-12T09:22:10.323 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.322+0000 7efcdb7c3700 1 -- 172.21.15.117:0/2737498961 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efcd410f080 con 0x7efcc006dca0 2024-04-12T09:22:10.324 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.323+0000 7efcc9ffb700 1 -- 172.21.15.117:0/2737498961 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7efcd410f080 con 0x7efcc006dca0 2024-04-12T09:22:10.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.326+0000 7efcdb7c3700 1 -- 172.21.15.117:0/2737498961 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7efcc006dca0 msgr2=0x7efcc0070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:22:10.326 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.326+0000 7efcdb7c3700 1 --2- 172.21.15.117:0/2737498961 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7efcc006dca0 0x7efcc0070150 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efcc4006fd0 tx=0x7efcc4008040 comp rx=0 tx=0).stop 2024-04-12T09:22:10.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.326+0000 7efcdb7c3700 1 -- 172.21.15.117:0/2737498961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd4101d20 msgr2=0x7efcd4113970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:22:10.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.326+0000 7efcdb7c3700 1 --2- 172.21.15.117:0/2737498961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd4101d20 0x7efcd4113970 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efccc00b3b0 tx=0x7efccc009e30 comp rx=0 tx=0).stop 2024-04-12T09:22:10.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.326+0000 7efcdb7c3700 1 -- 172.21.15.117:0/2737498961 shutdown_connections 2024-04-12T09:22:10.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.326+0000 7efcdb7c3700 1 --2- 172.21.15.117:0/2737498961 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7efcc006dca0 0x7efcc0070150 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:10.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.326+0000 7efcdb7c3700 1 --2- 172.21.15.117:0/2737498961 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcd4101d20 0x7efcd4113970 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:10.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.326+0000 7efcdb7c3700 1 --2- 172.21.15.117:0/2737498961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efcd41026c0 0x7efcd4113eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:10.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.326+0000 7efcdb7c3700 1 -- 172.21.15.117:0/2737498961 >> 172.21.15.117:0/2737498961 conn(0x7efcd40f7870 msgr2=0x7efcd40f8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:22:10.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.326+0000 7efcdb7c3700 1 -- 172.21.15.117:0/2737498961 shutdown_connections 2024-04-12T09:22:10.327 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:10.326+0000 7efcdb7c3700 1 -- 172.21.15.117:0/2737498961 wait complete. 2024-04-12T09:22:11.409 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'ceph orch ps' 2024-04-12T09:22:11.719 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:22:12.057 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:11 smithi117 ceph-mon[113571]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:22:12.057 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:11 smithi117 ceph-mon[113571]: pgmap v225: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:12.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:11 smithi203 ceph-mon[86783]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:22:12.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:11 smithi203 ceph-mon[86783]: pgmap v225: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:13.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.462+0000 7fcb004b3700 1 -- 172.21.15.117:0/4286122476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcaf8102e00 msgr2=0x7fcaf81031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:22:13.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.462+0000 7fcb004b3700 1 --2- 172.21.15.117:0/4286122476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcaf8102e00 0x7fcaf81031d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcae8004940 tx=0x7fcae8009e30 comp rx=0 tx=0).stop 2024-04-12T09:22:13.482 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.463+0000 7fcb004b3700 1 -- 172.21.15.117:0/4286122476 shutdown_connections 2024-04-12T09:22:13.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.463+0000 7fcb004b3700 1 --2- 172.21.15.117:0/4286122476 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcaf81037a0 0x7fcaf80fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:13.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.463+0000 7fcb004b3700 1 --2- 172.21.15.117:0/4286122476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcaf8102e00 0x7fcaf81031d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:13.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.463+0000 7fcb004b3700 1 -- 172.21.15.117:0/4286122476 >> 172.21.15.117:0/4286122476 conn(0x7fcaf80f89b0 msgr2=0x7fcaf80fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:22:13.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.463+0000 7fcb004b3700 1 -- 172.21.15.117:0/4286122476 shutdown_connections 2024-04-12T09:22:13.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.463+0000 7fcb004b3700 1 -- 172.21.15.117:0/4286122476 wait complete. 2024-04-12T09:22:13.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.463+0000 7fcb004b3700 1 Processor -- start 2024-04-12T09:22:13.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.463+0000 7fcb004b3700 1 -- start start 2024-04-12T09:22:13.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.463+0000 7fcb004b3700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcaf8102e00 0x7fcaf8113930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:22:13.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.463+0000 7fcb004b3700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcaf81037a0 0x7fcaf8113e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:22:13.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.463+0000 7fcb004b3700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf8114550 con 0x7fcaf81037a0 2024-04-12T09:22:13.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.463+0000 7fcb004b3700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf810dac0 con 0x7fcaf8102e00 2024-04-12T09:22:13.483 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.464+0000 7fcafda4e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcaf81037a0 0x7fcaf8113e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:22:13.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.464+0000 7fcafda4e700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcaf81037a0 0x7fcaf8113e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58508/0 (socket says 172.21.15.117:58508) 2024-04-12T09:22:13.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.464+0000 7fcafda4e700 1 -- 172.21.15.117:0/2434591532 learned_addr learned my addr 172.21.15.117:0/2434591532 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:22:13.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.464+0000 7fcafe24f700 1 --2- 172.21.15.117:0/2434591532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcaf8102e00 0x7fcaf8113930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:22:13.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.464+0000 7fcafda4e700 1 -- 172.21.15.117:0/2434591532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcaf8102e00 msgr2=0x7fcaf8113930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:22:13.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.464+0000 7fcafda4e700 1 --2- 172.21.15.117:0/2434591532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcaf8102e00 0x7fcaf8113930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:13.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.464+0000 7fcafda4e700 1 -- 172.21.15.117:0/2434591532 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae8005040 con 0x7fcaf81037a0 2024-04-12T09:22:13.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.464+0000 7fcafda4e700 1 --2- 172.21.15.117:0/2434591532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcaf81037a0 0x7fcaf8113e70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcaf400b790 tx=0x7fcaf4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:22:13.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.464+0000 7fcaeeffd700 1 -- 172.21.15.117:0/2434591532 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaf400f6f0 con 0x7fcaf81037a0 2024-04-12T09:22:13.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.464+0000 7fcb004b3700 1 -- 172.21.15.117:0/2434591532 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf810dda0 con 0x7fcaf81037a0 2024-04-12T09:22:13.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.464+0000 7fcaeeffd700 1 -- 172.21.15.117:0/2434591532 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcaf400fd20 con 0x7fcaf81037a0 2024-04-12T09:22:13.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.464+0000 7fcaeeffd700 1 -- 172.21.15.117:0/2434591532 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaf40103a0 con 0x7fcaf81037a0 2024-04-12T09:22:13.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.464+0000 7fcb004b3700 1 -- 172.21.15.117:0/2434591532 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf810e360 con 0x7fcaf81037a0 2024-04-12T09:22:13.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.465+0000 7fcb004b3700 1 -- 172.21.15.117:0/2434591532 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf80fe550 con 0x7fcaf81037a0 2024-04-12T09:22:13.484 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.466+0000 7fcaeeffd700 1 -- 172.21.15.117:0/2434591532 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fcaf4011400 con 0x7fcaf81037a0 2024-04-12T09:22:13.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.466+0000 7fcaeeffd700 1 --2- 172.21.15.117:0/2434591532 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fcae406dca0 0x7fcae4070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:22:13.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.466+0000 7fcaeeffd700 1 -- 172.21.15.117:0/2434591532 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fcaf408d470 con 0x7fcaf81037a0 2024-04-12T09:22:13.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.466+0000 7fcafe24f700 1 --2- 172.21.15.117:0/2434591532 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fcae406dca0 0x7fcae4070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:22:13.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.466+0000 7fcafe24f700 1 --2- 172.21.15.117:0/2434591532 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fcae406dca0 0x7fcae4070150 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcae8004f90 tx=0x7fcae8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:22:13.485 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.471+0000 7fcaeeffd700 1 -- 172.21.15.117:0/2434591532 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fcaf405a4d0 con 0x7fcaf81037a0 2024-04-12T09:22:13.677 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.676+0000 7fcb004b3700 1 -- 172.21.15.117:0/2434591532 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcaf8109f70 con 0x7fcae406dca0 2024-04-12T09:22:13.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.686+0000 7fcaeeffd700 1 -- 172.21.15.117:0/2434591532 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fcaf8109f70 con 0x7fcae406dca0 2024-04-12T09:22:13.687 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:22:13.687 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 running (7m) 76s ago 19m 27.0M - 0.25.0 c8568f914cd2 204687f21ed7 2024-04-12T09:22:13.687 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (5m) 76s ago 19m 6656k - 19.0.0-2053-gb277feb2 668895944f0e 038f567b664b 2024-04-12T09:22:13.687 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (5m) 32s ago 18m 6660k - 19.0.0-2053-gb277feb2 668895944f0e 420dee66e230 2024-04-12T09:22:13.687 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 running (7m) 76s ago 19m 78.9M - 9.4.12 2bacad6d85d8 a7b102216886 2024-04-12T09:22:13.687 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (81s) 76s ago 13m 12.5M - 19.0.0-2053-gb277feb2 668895944f0e 561830e21baa 2024-04-12T09:22:13.687 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 running (104s) 76s ago 13m 11.8M - 19.0.0-2053-gb277feb2 668895944f0e 642a35bff3ee 2024-04-12T09:22:13.687 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (35s) 32s ago 13m 11.6M - 19.0.0-2053-gb277feb2 668895944f0e d0fdb03b6cbc 2024-04-12T09:22:13.687 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (57s) 32s ago 13m 12.6M - 19.0.0-2053-gb277feb2 668895944f0e f3bba6c8874e 2024-04-12T09:22:13.688 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:8443,9283,8765 running (9m) 76s ago 20m 508M - 19.0.0-2053-gb277feb2 668895944f0e fee613d05ab7 2024-04-12T09:22:13.688 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283,8765 running (8m) 32s ago 18m 451M - 19.0.0-2053-gb277feb2 668895944f0e c793944c3e16 2024-04-12T09:22:13.688 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (6m) 76s ago 20m 55.2M 2048M 19.0.0-2053-gb277feb2 668895944f0e 6823aaff30ce 2024-04-12T09:22:13.688 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (6m) 32s ago 18m 44.8M 2048M 19.0.0-2053-gb277feb2 668895944f0e 006c6e487bfb 2024-04-12T09:22:13.688 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 running (8m) 76s ago 19m 16.8M - 1.5.0 0da6a335fe13 c692bed9f6c7 2024-04-12T09:22:13.688 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (8m) 32s ago 18m 15.4M - 1.5.0 0da6a335fe13 f3b5a470f545 2024-04-12T09:22:13.688 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (4m) 76s ago 17m 97.9M 1557M 19.0.0-2053-gb277feb2 668895944f0e 59a180461e3c 2024-04-12T09:22:13.688 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (4m) 76s ago 17m 105M 1557M 19.0.0-2053-gb277feb2 668895944f0e d40e2dfc164b 2024-04-12T09:22:13.688 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (3m) 76s ago 16m 97.7M 1557M 19.0.0-2053-gb277feb2 668895944f0e fd7d5481cddb 2024-04-12T09:22:13.688 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (3m) 32s ago 16m 128M 2581M 19.0.0-2053-gb277feb2 668895944f0e 961db53f9ab1 2024-04-12T09:22:13.688 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (2m) 32s ago 15m 109M 2581M 19.0.0-2053-gb277feb2 668895944f0e 7ec45de1eea6 2024-04-12T09:22:13.688 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (2m) 32s ago 15m 96.8M 2581M 19.0.0-2053-gb277feb2 668895944f0e ad918b4139f7 2024-04-12T09:22:13.688 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 running (8m) 76s ago 18m 61.0M - 2.43.0 a07b618ecd1d 43ce588d82cc 2024-04-12T09:22:13.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.688+0000 7fcb004b3700 1 -- 172.21.15.117:0/2434591532 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fcae406dca0 msgr2=0x7fcae4070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:22:13.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.688+0000 7fcb004b3700 1 --2- 172.21.15.117:0/2434591532 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fcae406dca0 0x7fcae4070150 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcae8004f90 tx=0x7fcae8009e30 comp rx=0 tx=0).stop 2024-04-12T09:22:13.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.688+0000 7fcb004b3700 1 -- 172.21.15.117:0/2434591532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcaf81037a0 msgr2=0x7fcaf8113e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:22:13.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.688+0000 7fcb004b3700 1 --2- 172.21.15.117:0/2434591532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcaf81037a0 0x7fcaf8113e70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcaf400b790 tx=0x7fcaf4009220 comp rx=0 tx=0).stop 2024-04-12T09:22:13.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.688+0000 7fcb004b3700 1 -- 172.21.15.117:0/2434591532 shutdown_connections 2024-04-12T09:22:13.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.688+0000 7fcb004b3700 1 --2- 172.21.15.117:0/2434591532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcaf8102e00 0x7fcaf8113930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:13.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.688+0000 7fcb004b3700 1 --2- 172.21.15.117:0/2434591532 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fcae406dca0 0x7fcae4070150 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:13.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.688+0000 7fcb004b3700 1 --2- 172.21.15.117:0/2434591532 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcaf81037a0 0x7fcaf8113e70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:13.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.688+0000 7fcb004b3700 1 -- 172.21.15.117:0/2434591532 >> 172.21.15.117:0/2434591532 conn(0x7fcaf80f89b0 msgr2=0x7fcaf80f98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:22:13.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.688+0000 7fcb004b3700 1 -- 172.21.15.117:0/2434591532 shutdown_connections 2024-04-12T09:22:13.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:13.688+0000 7fcb004b3700 1 -- 172.21.15.117:0/2434591532 wait complete. 2024-04-12T09:22:14.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:13 smithi203 ceph-mon[86783]: pgmap v226: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:14.132 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:13 smithi117 ceph-mon[113571]: pgmap v226: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:14.395 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'ceph orch upgrade status' 2024-04-12T09:22:14.660 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:22:14.925 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:14 smithi117 ceph-mon[113571]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:22:15.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:14 smithi203 ceph-mon[86783]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:22:15.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:15 smithi117 ceph-mon[113571]: pgmap v227: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:16.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:15 smithi203 ceph-mon[86783]: pgmap v227: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:16.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.471+0000 7fbfc7363700 1 -- 172.21.15.117:0/2446747112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfc0101d70 msgr2=0x7fbfc0102140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:22:16.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.471+0000 7fbfc7363700 1 --2- 172.21.15.117:0/2446747112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfc0101d70 0x7fbfc0102140 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8004940 tx=0x7fbfb8009e30 comp rx=0 tx=0).stop 2024-04-12T09:22:16.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.471+0000 7fbfc7363700 1 -- 172.21.15.117:0/2446747112 shutdown_connections 2024-04-12T09:22:16.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.471+0000 7fbfc7363700 1 --2- 172.21.15.117:0/2446747112 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfc0102710 0x7fbfc00fbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:16.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.471+0000 7fbfc7363700 1 --2- 172.21.15.117:0/2446747112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfc0101d70 0x7fbfc0102140 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:16.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.471+0000 7fbfc7363700 1 -- 172.21.15.117:0/2446747112 >> 172.21.15.117:0/2446747112 conn(0x7fbfc0072bc0 msgr2=0x7fbfc0072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:22:16.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.471+0000 7fbfc7363700 1 -- 172.21.15.117:0/2446747112 shutdown_connections 2024-04-12T09:22:16.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.471+0000 7fbfc7363700 1 -- 172.21.15.117:0/2446747112 wait complete. 2024-04-12T09:22:16.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.471+0000 7fbfc7363700 1 Processor -- start 2024-04-12T09:22:16.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.472+0000 7fbfc7363700 1 -- start start 2024-04-12T09:22:16.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.472+0000 7fbfc7363700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfc0101d70 0x7fbfc010ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:22:16.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.472+0000 7fbfc7363700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfc0102710 0x7fbfc010f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:22:16.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.472+0000 7fbfc7363700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc010f6d0 con 0x7fbfc0101d70 2024-04-12T09:22:16.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.472+0000 7fbfc7363700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc010f810 con 0x7fbfc0102710 2024-04-12T09:22:16.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.472+0000 7fbfc50ff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfc0101d70 0x7fbfc010ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:22:16.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.472+0000 7fbfc50ff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfc0101d70 0x7fbfc010ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58528/0 (socket says 172.21.15.117:58528) 2024-04-12T09:22:16.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.472+0000 7fbfc50ff700 1 -- 172.21.15.117:0/2821906341 learned_addr learned my addr 172.21.15.117:0/2821906341 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:22:16.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.472+0000 7fbfc50ff700 1 -- 172.21.15.117:0/2821906341 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfc0102710 msgr2=0x7fbfc010f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:22:16.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.472+0000 7fbfc48fe700 1 --2- 172.21.15.117:0/2821906341 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfc0102710 0x7fbfc010f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:22:16.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.472+0000 7fbfc50ff700 1 --2- 172.21.15.117:0/2821906341 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfc0102710 0x7fbfc010f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:16.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.472+0000 7fbfc50ff700 1 -- 172.21.15.117:0/2821906341 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb8005040 con 0x7fbfc0101d70 2024-04-12T09:22:16.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.472+0000 7fbfc48fe700 1 --2- 172.21.15.117:0/2821906341 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfc0102710 0x7fbfc010f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T09:22:16.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.472+0000 7fbfc50ff700 1 --2- 172.21.15.117:0/2821906341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfc0101d70 0x7fbfc010ec50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009150 tx=0x7fbfb8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:22:16.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.472+0000 7fbfb5ffb700 1 -- 172.21.15.117:0/2821906341 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfb800e040 con 0x7fbfc0101d70 2024-04-12T09:22:16.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.472+0000 7fbfc7363700 1 -- 172.21.15.117:0/2821906341 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc0117b60 con 0x7fbfc0101d70 2024-04-12T09:22:16.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.472+0000 7fbfb5ffb700 1 -- 172.21.15.117:0/2821906341 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbfb8013420 con 0x7fbfc0101d70 2024-04-12T09:22:16.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.473+0000 7fbfb5ffb700 1 -- 172.21.15.117:0/2821906341 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfb801c630 con 0x7fbfc0101d70 2024-04-12T09:22:16.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.473+0000 7fbfc7363700 1 -- 172.21.15.117:0/2821906341 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc0118120 con 0x7fbfc0101d70 2024-04-12T09:22:16.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.474+0000 7fbfc7363700 1 -- 172.21.15.117:0/2821906341 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc00ff080 con 0x7fbfc0101d70 2024-04-12T09:22:16.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.474+0000 7fbfb5ffb700 1 -- 172.21.15.117:0/2821906341 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fbfb8013590 con 0x7fbfc0101d70 2024-04-12T09:22:16.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.475+0000 7fbfb5ffb700 1 --2- 172.21.15.117:0/2821906341 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fbfac06dcb0 0x7fbfac070160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:22:16.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.475+0000 7fbfb5ffb700 1 -- 172.21.15.117:0/2821906341 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fbfb808e870 con 0x7fbfc0101d70 2024-04-12T09:22:16.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.475+0000 7fbfc48fe700 1 --2- 172.21.15.117:0/2821906341 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fbfac06dcb0 0x7fbfac070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:22:16.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.475+0000 7fbfc48fe700 1 --2- 172.21.15.117:0/2821906341 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fbfac06dcb0 0x7fbfac070160 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0006fd0 tx=0x7fbfb0008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:22:16.480 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.479+0000 7fbfb5ffb700 1 -- 172.21.15.117:0/2821906341 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fbfb8057e20 con 0x7fbfc0101d70 2024-04-12T09:22:16.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.693+0000 7fbfc7363700 1 -- 172.21.15.117:0/2821906341 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbfc004bed0 con 0x7fbfac06dcb0 2024-04-12T09:22:16.694 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.694+0000 7fbfb5ffb700 1 -- 172.21.15.117:0/2821906341 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fbfc004bed0 con 0x7fbfac06dcb0 2024-04-12T09:22:16.695 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:22:16.695 INFO:teuthology.orchestra.run.smithi117.stdout: "target_image": null, 2024-04-12T09:22:16.695 INFO:teuthology.orchestra.run.smithi117.stdout: "in_progress": false, 2024-04-12T09:22:16.695 INFO:teuthology.orchestra.run.smithi117.stdout: "which": "", 2024-04-12T09:22:16.695 INFO:teuthology.orchestra.run.smithi117.stdout: "services_complete": [], 2024-04-12T09:22:16.695 INFO:teuthology.orchestra.run.smithi117.stdout: "progress": null, 2024-04-12T09:22:16.695 INFO:teuthology.orchestra.run.smithi117.stdout: "message": "", 2024-04-12T09:22:16.695 INFO:teuthology.orchestra.run.smithi117.stdout: "is_paused": false 2024-04-12T09:22:16.695 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:22:16.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.696+0000 7fbfc7363700 1 -- 172.21.15.117:0/2821906341 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fbfac06dcb0 msgr2=0x7fbfac070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:22:16.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.696+0000 7fbfc7363700 1 --2- 172.21.15.117:0/2821906341 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fbfac06dcb0 0x7fbfac070160 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0006fd0 tx=0x7fbfb0008040 comp rx=0 tx=0).stop 2024-04-12T09:22:16.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.696+0000 7fbfc7363700 1 -- 172.21.15.117:0/2821906341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfc0101d70 msgr2=0x7fbfc010ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:22:16.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.696+0000 7fbfc7363700 1 --2- 172.21.15.117:0/2821906341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfc0101d70 0x7fbfc010ec50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009150 tx=0x7fbfb8009e30 comp rx=0 tx=0).stop 2024-04-12T09:22:16.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.696+0000 7fbfc7363700 1 -- 172.21.15.117:0/2821906341 shutdown_connections 2024-04-12T09:22:16.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.696+0000 7fbfc7363700 1 --2- 172.21.15.117:0/2821906341 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fbfac06dcb0 0x7fbfac070160 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:16.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.696+0000 7fbfc7363700 1 --2- 172.21.15.117:0/2821906341 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbfc0101d70 0x7fbfc010ec50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:16.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.696+0000 7fbfc7363700 1 --2- 172.21.15.117:0/2821906341 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfc0102710 0x7fbfc010f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:16.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.696+0000 7fbfc7363700 1 -- 172.21.15.117:0/2821906341 >> 172.21.15.117:0/2821906341 conn(0x7fbfc0072bc0 msgr2=0x7fbfc00fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:22:16.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.696+0000 7fbfc7363700 1 -- 172.21.15.117:0/2821906341 shutdown_connections 2024-04-12T09:22:16.698 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:16.696+0000 7fbfc7363700 1 -- 172.21.15.117:0/2821906341 wait complete. 2024-04-12T09:22:17.368 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'ceph health detail' 2024-04-12T09:22:17.628 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:22:18.046 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:17 smithi117 ceph-mon[113571]: pgmap v228: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:18.046 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:17 smithi117 ceph-mon[113571]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:22:18.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:17 smithi203 ceph-mon[86783]: pgmap v228: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:18.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:17 smithi203 ceph-mon[86783]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:22:19.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.241+0000 7f8c9fd18700 1 -- 172.21.15.117:0/290408658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c980fde10 msgr2=0x7f8c980fe1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:22:19.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.241+0000 7f8c9fd18700 1 --2- 172.21.15.117:0/290408658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c980fde10 0x7f8c980fe1e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8c90004940 tx=0x7f8c90009e30 comp rx=0 tx=0).stop 2024-04-12T09:22:19.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.241+0000 7f8c9fd18700 1 -- 172.21.15.117:0/290408658 shutdown_connections 2024-04-12T09:22:19.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.241+0000 7f8c9fd18700 1 --2- 172.21.15.117:0/290408658 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c980fe7b0 0x7f8c98106df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:19.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.241+0000 7f8c9fd18700 1 --2- 172.21.15.117:0/290408658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c980fde10 0x7f8c980fe1e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:19.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.241+0000 7f8c9fd18700 1 -- 172.21.15.117:0/290408658 >> 172.21.15.117:0/290408658 conn(0x7f8c980f7880 msgr2=0x7f8c980f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:22:19.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.241+0000 7f8c9fd18700 1 -- 172.21.15.117:0/290408658 shutdown_connections 2024-04-12T09:22:19.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.241+0000 7f8c9fd18700 1 -- 172.21.15.117:0/290408658 wait complete. 2024-04-12T09:22:19.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.242+0000 7f8c9fd18700 1 Processor -- start 2024-04-12T09:22:19.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.242+0000 7f8c9fd18700 1 -- start start 2024-04-12T09:22:19.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.242+0000 7f8c9fd18700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c980fde10 0x7f8c98113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:22:19.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.242+0000 7f8c9fd18700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c980fe7b0 0x7f8c98114400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:22:19.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.242+0000 7f8c9fd18700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c98114a50 con 0x7f8c980fde10 2024-04-12T09:22:19.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.242+0000 7f8c9fd18700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9810de20 con 0x7f8c980fe7b0 2024-04-12T09:22:19.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.242+0000 7f8c9dab4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c980fde10 0x7f8c98113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:22:19.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.242+0000 7f8c9dab4700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c980fde10 0x7f8c98113ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58552/0 (socket says 172.21.15.117:58552) 2024-04-12T09:22:19.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.242+0000 7f8c9dab4700 1 -- 172.21.15.117:0/3856599992 learned_addr learned my addr 172.21.15.117:0/3856599992 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:22:19.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.242+0000 7f8c9dab4700 1 -- 172.21.15.117:0/3856599992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c980fe7b0 msgr2=0x7f8c98114400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:22:19.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.242+0000 7f8c9dab4700 1 --2- 172.21.15.117:0/3856599992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c980fe7b0 0x7f8c98114400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:19.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.242+0000 7f8c9dab4700 1 -- 172.21.15.117:0/3856599992 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c90005040 con 0x7f8c980fde10 2024-04-12T09:22:19.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.243+0000 7f8c9dab4700 1 --2- 172.21.15.117:0/3856599992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c980fde10 0x7f8c98113ec0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8c9000b3b0 tx=0x7f8c90009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:22:19.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.243+0000 7f8c967fc700 1 -- 172.21.15.117:0/3856599992 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c9000e040 con 0x7f8c980fde10 2024-04-12T09:22:19.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.243+0000 7f8c967fc700 1 -- 172.21.15.117:0/3856599992 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c90013420 con 0x7f8c980fde10 2024-04-12T09:22:19.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.243+0000 7f8c9fd18700 1 -- 172.21.15.117:0/3856599992 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9810e0a0 con 0x7f8c980fde10 2024-04-12T09:22:19.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.243+0000 7f8c967fc700 1 -- 172.21.15.117:0/3856599992 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c9001c630 con 0x7f8c980fde10 2024-04-12T09:22:19.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.243+0000 7f8c9fd18700 1 -- 172.21.15.117:0/3856599992 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9810e5e0 con 0x7f8c980fde10 2024-04-12T09:22:19.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.244+0000 7f8c9fd18700 1 -- 172.21.15.117:0/3856599992 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c98066770 con 0x7f8c980fde10 2024-04-12T09:22:19.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.244+0000 7f8c967fc700 1 -- 172.21.15.117:0/3856599992 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f8c9000baf0 con 0x7f8c980fde10 2024-04-12T09:22:19.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.245+0000 7f8c967fc700 1 --2- 172.21.15.117:0/3856599992 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f8c8006dcb0 0x7f8c80070160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:22:19.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.245+0000 7f8c967fc700 1 -- 172.21.15.117:0/3856599992 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f8c9008e8b0 con 0x7f8c980fde10 2024-04-12T09:22:19.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.245+0000 7f8c9d2b3700 1 --2- 172.21.15.117:0/3856599992 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f8c8006dcb0 0x7f8c80070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:22:19.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.245+0000 7f8c9d2b3700 1 --2- 172.21.15.117:0/3856599992 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f8c8006dcb0 0x7f8c80070160 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c007fd0 tx=0x7f8c8c007bb0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:22:19.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.249+0000 7f8c967fc700 1 -- 172.21.15.117:0/3856599992 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f8c9005b990 con 0x7f8c980fde10 2024-04-12T09:22:19.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.529+0000 7f8c9fd18700 1 -- 172.21.15.117:0/3856599992 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8c9804bed0 con 0x7f8c980fde10 2024-04-12T09:22:19.530 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.529+0000 7f8c967fc700 1 -- 172.21.15.117:0/3856599992 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f8c9005b520 con 0x7f8c980fde10 2024-04-12T09:22:19.530 INFO:teuthology.orchestra.run.smithi117.stdout:HEALTH_OK 2024-04-12T09:22:19.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.531+0000 7f8c9fd18700 1 -- 172.21.15.117:0/3856599992 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f8c8006dcb0 msgr2=0x7f8c80070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:22:19.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.531+0000 7f8c9fd18700 1 --2- 172.21.15.117:0/3856599992 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f8c8006dcb0 0x7f8c80070160 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c007fd0 tx=0x7f8c8c007bb0 comp rx=0 tx=0).stop 2024-04-12T09:22:19.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.531+0000 7f8c9fd18700 1 -- 172.21.15.117:0/3856599992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c980fde10 msgr2=0x7f8c98113ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:22:19.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.531+0000 7f8c9fd18700 1 --2- 172.21.15.117:0/3856599992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c980fde10 0x7f8c98113ec0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8c9000b3b0 tx=0x7f8c90009e30 comp rx=0 tx=0).stop 2024-04-12T09:22:19.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.531+0000 7f8c9fd18700 1 -- 172.21.15.117:0/3856599992 shutdown_connections 2024-04-12T09:22:19.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.531+0000 7f8c9fd18700 1 --2- 172.21.15.117:0/3856599992 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f8c8006dcb0 0x7f8c80070160 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:19.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.531+0000 7f8c9fd18700 1 --2- 172.21.15.117:0/3856599992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c980fde10 0x7f8c98113ec0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:19.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.531+0000 7f8c9fd18700 1 --2- 172.21.15.117:0/3856599992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c980fe7b0 0x7f8c98114400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:19.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.531+0000 7f8c9fd18700 1 -- 172.21.15.117:0/3856599992 >> 172.21.15.117:0/3856599992 conn(0x7f8c980f7880 msgr2=0x7f8c980f8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:22:19.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.531+0000 7f8c9fd18700 1 -- 172.21.15.117:0/3856599992 shutdown_connections 2024-04-12T09:22:19.532 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:19.531+0000 7f8c9fd18700 1 -- 172.21.15.117:0/3856599992 wait complete. 2024-04-12T09:22:19.840 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:19 smithi117 ceph-mon[113571]: pgmap v229: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:19.841 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:19 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/3856599992' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:22:20.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:19 smithi203 ceph-mon[86783]: pgmap v229: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:20.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:19 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/3856599992' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-12T09:22:20.175 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'ceph versions' 2024-04-12T09:22:20.433 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:22:21.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:21 smithi117 ceph-mon[113571]: pgmap v230: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:22.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:21 smithi203 ceph-mon[86783]: pgmap v230: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:22.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.157+0000 7f505a9ba700 1 -- 172.21.15.117:0/2016073093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5054101ce0 msgr2=0x7f50541020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:22:22.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.157+0000 7f505a9ba700 1 --2- 172.21.15.117:0/2016073093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5054101ce0 0x7f50541020b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5044004940 tx=0x7f5044009e30 comp rx=0 tx=0).stop 2024-04-12T09:22:22.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.157+0000 7f505a9ba700 1 -- 172.21.15.117:0/2016073093 shutdown_connections 2024-04-12T09:22:22.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.157+0000 7f505a9ba700 1 --2- 172.21.15.117:0/2016073093 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5054102680 0x7f50540fbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:22.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.157+0000 7f505a9ba700 1 --2- 172.21.15.117:0/2016073093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5054101ce0 0x7f50541020b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:22.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.157+0000 7f505a9ba700 1 -- 172.21.15.117:0/2016073093 >> 172.21.15.117:0/2016073093 conn(0x7f50540f7890 msgr2=0x7f50540f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:22:22.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.157+0000 7f505a9ba700 1 -- 172.21.15.117:0/2016073093 shutdown_connections 2024-04-12T09:22:22.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.157+0000 7f505a9ba700 1 -- 172.21.15.117:0/2016073093 wait complete. 2024-04-12T09:22:22.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.157+0000 7f505a9ba700 1 Processor -- start 2024-04-12T09:22:22.158 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.157+0000 7f505a9ba700 1 -- start start 2024-04-12T09:22:22.159 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.158+0000 7f505a9ba700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5054101ce0 0x7f505410eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:22:22.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.158+0000 7f505a9ba700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5054102680 0x7f505410f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:22:22.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.158+0000 7f505a9ba700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505410f590 con 0x7f5054102680 2024-04-12T09:22:22.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.158+0000 7f505a9ba700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505410f6d0 con 0x7f5054101ce0 2024-04-12T09:22:22.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.158+0000 7f50537fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5054102680 0x7f505410f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:22:22.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.158+0000 7f50537fe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5054102680 0x7f505410f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:42344/0 (socket says 172.21.15.117:42344) 2024-04-12T09:22:22.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.158+0000 7f50537fe700 1 -- 172.21.15.117:0/3063444869 learned_addr learned my addr 172.21.15.117:0/3063444869 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:22:22.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.158+0000 7f5053fff700 1 --2- 172.21.15.117:0/3063444869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5054101ce0 0x7f505410eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:22:22.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.158+0000 7f50537fe700 1 -- 172.21.15.117:0/3063444869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5054101ce0 msgr2=0x7f505410eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:22:22.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.158+0000 7f50537fe700 1 --2- 172.21.15.117:0/3063444869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5054101ce0 0x7f505410eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:22.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.158+0000 7f50537fe700 1 -- 172.21.15.117:0/3063444869 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5044005040 con 0x7f5054102680 2024-04-12T09:22:22.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.158+0000 7f50537fe700 1 --2- 172.21.15.117:0/3063444869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5054102680 0x7f505410f050 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f504800b790 tx=0x7f5048009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:22:22.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.158+0000 7f5050ff9700 1 -- 172.21.15.117:0/3063444869 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f504800f6f0 con 0x7f5054102680 2024-04-12T09:22:22.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.158+0000 7f5050ff9700 1 -- 172.21.15.117:0/3063444869 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f504800fd20 con 0x7f5054102680 2024-04-12T09:22:22.160 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.158+0000 7f505a9ba700 1 -- 172.21.15.117:0/3063444869 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5054117b80 con 0x7f5054102680 2024-04-12T09:22:22.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.158+0000 7f5050ff9700 1 -- 172.21.15.117:0/3063444869 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50480103a0 con 0x7f5054102680 2024-04-12T09:22:22.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.158+0000 7f505a9ba700 1 -- 172.21.15.117:0/3063444869 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5054117fa0 con 0x7f5054102680 2024-04-12T09:22:22.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.160+0000 7f505a9ba700 1 -- 172.21.15.117:0/3063444869 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50540fd430 con 0x7f5054102680 2024-04-12T09:22:22.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.160+0000 7f5050ff9700 1 -- 172.21.15.117:0/3063444869 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f5048011400 con 0x7f5054102680 2024-04-12T09:22:22.161 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.160+0000 7f5050ff9700 1 --2- 172.21.15.117:0/3063444869 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f503c06dca0 0x7f503c070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:22:22.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.160+0000 7f5050ff9700 1 -- 172.21.15.117:0/3063444869 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f504808d3e0 con 0x7f5054102680 2024-04-12T09:22:22.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.160+0000 7f5053fff700 1 --2- 172.21.15.117:0/3063444869 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f503c06dca0 0x7f503c070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:22:22.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.161+0000 7f5053fff700 1 --2- 172.21.15.117:0/3063444869 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f503c06dca0 0x7f503c070150 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f504400b3b0 tx=0x7f5044009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:22:22.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.165+0000 7f5050ff9700 1 -- 172.21.15.117:0/3063444869 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f5048056910 con 0x7f5054102680 2024-04-12T09:22:22.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.443+0000 7f505a9ba700 1 -- 172.21.15.117:0/3063444869 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5054108e50 con 0x7f5054102680 2024-04-12T09:22:22.444 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.443+0000 7f5050ff9700 1 -- 172.21.15.117:0/3063444869 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f5048059fd0 con 0x7f5054102680 2024-04-12T09:22:22.444 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:22:22.444 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": { 2024-04-12T09:22:22.444 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:22:22.444 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:22:22.444 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": { 2024-04-12T09:22:22.444 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:22:22.444 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:22:22.444 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": { 2024-04-12T09:22:22.444 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 6 2024-04-12T09:22:22.445 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:22:22.445 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-04-12T09:22:22.445 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 4 2024-04-12T09:22:22.445 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:22:22.445 INFO:teuthology.orchestra.run.smithi117.stdout: "overall": { 2024-04-12T09:22:22.445 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 14 2024-04-12T09:22:22.445 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:22:22.445 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:22:22.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.445+0000 7f505a9ba700 1 -- 172.21.15.117:0/3063444869 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f503c06dca0 msgr2=0x7f503c070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:22:22.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.445+0000 7f505a9ba700 1 --2- 172.21.15.117:0/3063444869 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f503c06dca0 0x7f503c070150 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f504400b3b0 tx=0x7f5044009e30 comp rx=0 tx=0).stop 2024-04-12T09:22:22.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.445+0000 7f505a9ba700 1 -- 172.21.15.117:0/3063444869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5054102680 msgr2=0x7f505410f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:22:22.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.445+0000 7f505a9ba700 1 --2- 172.21.15.117:0/3063444869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5054102680 0x7f505410f050 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f504800b790 tx=0x7f5048009220 comp rx=0 tx=0).stop 2024-04-12T09:22:22.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.445+0000 7f505a9ba700 1 -- 172.21.15.117:0/3063444869 shutdown_connections 2024-04-12T09:22:22.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.445+0000 7f505a9ba700 1 --2- 172.21.15.117:0/3063444869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5054101ce0 0x7f505410eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:22.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.445+0000 7f505a9ba700 1 --2- 172.21.15.117:0/3063444869 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f503c06dca0 0x7f503c070150 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:22.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.445+0000 7f505a9ba700 1 --2- 172.21.15.117:0/3063444869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5054102680 0x7f505410f050 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:22:22.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.445+0000 7f505a9ba700 1 -- 172.21.15.117:0/3063444869 >> 172.21.15.117:0/3063444869 conn(0x7f50540f7890 msgr2=0x7f50540f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:22:22.446 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.445+0000 7f505a9ba700 1 -- 172.21.15.117:0/3063444869 shutdown_connections 2024-04-12T09:22:22.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:22:22.445+0000 7f505a9ba700 1 -- 172.21.15.117:0/3063444869 wait complete. 2024-04-12T09:22:23.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:22 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/3063444869' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:22:23.088 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:22 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/3063444869' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:22:23.114 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-04-12T09:22:23.370 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:22:24.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:23 smithi203 ceph-mon[86783]: pgmap v231: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:24.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:23 smithi117 ceph-mon[113571]: pgmap v231: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:24.840 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:24 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:22:25.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:24 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:22:25.074 INFO:teuthology.orchestra.run.smithi117.stdout:wait for servicemap items w/ changing names to refresh 2024-04-12T09:22:25.746 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'sleep 60' 2024-04-12T09:22:26.000 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:22:26.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:25 smithi203 ceph-mon[86783]: pgmap v232: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:26.121 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:25 smithi117 ceph-mon[113571]: pgmap v232: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:27.822 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:27 smithi117 ceph-mon[113571]: pgmap v233: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:28.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:27 smithi203 ceph-mon[86783]: pgmap v233: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:30.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:29 smithi203 ceph-mon[86783]: pgmap v234: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:30.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:29 smithi117 ceph-mon[113571]: pgmap v234: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:32.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:31 smithi203 ceph-mon[86783]: pgmap v235: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:32.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:31 smithi117 ceph-mon[113571]: pgmap v235: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:34.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:33 smithi203 ceph-mon[86783]: pgmap v236: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:34.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:33 smithi117 ceph-mon[113571]: pgmap v236: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:36.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:35 smithi203 ceph-mon[86783]: pgmap v237: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:36.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:35 smithi117 ceph-mon[113571]: pgmap v237: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:38.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:37 smithi203 ceph-mon[86783]: pgmap v238: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:38.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:37 smithi117 ceph-mon[113571]: pgmap v238: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:40.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:39 smithi203 ceph-mon[86783]: pgmap v239: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:40.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:22:40.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:39 smithi117 ceph-mon[113571]: pgmap v239: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:40.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:22:42.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:41 smithi203 ceph-mon[86783]: pgmap v240: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:42.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:41 smithi117 ceph-mon[113571]: pgmap v240: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:44.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:43 smithi203 ceph-mon[86783]: pgmap v241: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:44.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:43 smithi117 ceph-mon[113571]: pgmap v241: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:46.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:45 smithi203 ceph-mon[86783]: pgmap v242: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:46.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:45 smithi117 ceph-mon[113571]: pgmap v242: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:48.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:47 smithi203 ceph-mon[86783]: pgmap v243: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:48.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:47 smithi117 ceph-mon[113571]: pgmap v243: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:48.813 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:22:48.813 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:22:48.814 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:48 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:22:49.111 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:22:49.111 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:22:49.111 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:48 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:22:50.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:49 smithi203 ceph-mon[86783]: pgmap v244: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:50.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:49 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:22:50.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:49 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:22:50.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:49 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:22:50.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:49 smithi117 ceph-mon[113571]: pgmap v244: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:50.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:49 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:22:50.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:49 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:22:50.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:49 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:22:52.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:51 smithi203 ceph-mon[86783]: pgmap v245: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:52.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:51 smithi117 ceph-mon[113571]: pgmap v245: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:54.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:53 smithi117 ceph-mon[113571]: pgmap v246: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:54.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:53 smithi203 ceph-mon[86783]: pgmap v246: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:55.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:22:55.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:54 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:22:56.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:55 smithi117 ceph-mon[113571]: pgmap v247: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:56.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:55 smithi203 ceph-mon[86783]: pgmap v247: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:58.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:57 smithi117 ceph-mon[113571]: pgmap v248: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:22:58.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:57 smithi203 ceph-mon[86783]: pgmap v248: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:00.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:22:59 smithi117 ceph-mon[113571]: pgmap v249: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:00.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:22:59 smithi203 ceph-mon[86783]: pgmap v249: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:02.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:01 smithi117 ceph-mon[113571]: pgmap v250: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:02.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:01 smithi203 ceph-mon[86783]: pgmap v250: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:04.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:03 smithi117 ceph-mon[113571]: pgmap v251: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:04.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:03 smithi203 ceph-mon[86783]: pgmap v251: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:06.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:05 smithi117 ceph-mon[113571]: pgmap v252: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:06.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:05 smithi203 ceph-mon[86783]: pgmap v252: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:08.126 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:07 smithi203 ceph-mon[86783]: pgmap v253: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:08.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:07 smithi117 ceph-mon[113571]: pgmap v253: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:10.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:09 smithi117 ceph-mon[113571]: pgmap v254: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:10.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:09 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:23:10.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:09 smithi203 ceph-mon[86783]: pgmap v254: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:10.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:09 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:23:12.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:11 smithi117 ceph-mon[113571]: pgmap v255: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:12.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:11 smithi203 ceph-mon[86783]: pgmap v255: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:13.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:12 smithi117 ceph-mon[113571]: pgmap v256: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:13.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:12 smithi203 ceph-mon[86783]: pgmap v256: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:16.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:15 smithi203 ceph-mon[86783]: pgmap v257: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:16.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:15 smithi117 ceph-mon[113571]: pgmap v257: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:18.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:17 smithi203 ceph-mon[86783]: pgmap v258: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:18.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:17 smithi117 ceph-mon[113571]: pgmap v258: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:20.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:19 smithi203 ceph-mon[86783]: pgmap v259: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:20.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:19 smithi117 ceph-mon[113571]: pgmap v259: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:22.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:21 smithi203 ceph-mon[86783]: pgmap v260: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:22.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:21 smithi117 ceph-mon[113571]: pgmap v260: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:24.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:23 smithi203 ceph-mon[86783]: pgmap v261: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:24.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:23 smithi117 ceph-mon[113571]: pgmap v261: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:25.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:24 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:23:25.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:24 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:23:26.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:25 smithi203 ceph-mon[86783]: pgmap v262: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:26.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:25 smithi117 ceph-mon[113571]: pgmap v262: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:27.660 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:27 smithi117 ceph-mon[113571]: pgmap v263: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:27.823 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:27 smithi203 ceph-mon[86783]: pgmap v263: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:28.416 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'ceph orch ps' 2024-04-12T09:23:28.684 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:23:29.844 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:29 smithi117 ceph-mon[113571]: pgmap v264: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:30.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:29 smithi203 ceph-mon[86783]: pgmap v264: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:30.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.311+0000 7f93e4f57700 1 -- 172.21.15.117:0/4209204758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93e01026b0 msgr2=0x7f93e00fbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:30.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.311+0000 7f93e4f57700 1 --2- 172.21.15.117:0/4209204758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93e01026b0 0x7f93e00fbd20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f93c8004940 tx=0x7f93c8009e30 comp rx=0 tx=0).stop 2024-04-12T09:23:30.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.311+0000 7f93e4f57700 1 -- 172.21.15.117:0/4209204758 shutdown_connections 2024-04-12T09:23:30.314 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.311+0000 7f93e4f57700 1 --2- 172.21.15.117:0/4209204758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93e01026b0 0x7f93e00fbd20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:30.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.311+0000 7f93e4f57700 1 --2- 172.21.15.117:0/4209204758 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f93e0101d10 0x7f93e01020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:30.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.311+0000 7f93e4f57700 1 -- 172.21.15.117:0/4209204758 >> 172.21.15.117:0/4209204758 conn(0x7f93e00f7880 msgr2=0x7f93e00f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:30.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.311+0000 7f93e4f57700 1 -- 172.21.15.117:0/4209204758 shutdown_connections 2024-04-12T09:23:30.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.311+0000 7f93e4f57700 1 -- 172.21.15.117:0/4209204758 wait complete. 2024-04-12T09:23:30.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.312+0000 7f93e4f57700 1 Processor -- start 2024-04-12T09:23:30.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.312+0000 7f93e4f57700 1 -- start start 2024-04-12T09:23:30.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.312+0000 7f93e4f57700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f93e0101d10 0x7f93e010ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:30.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.312+0000 7f93e4f57700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93e01026b0 0x7f93e010f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:30.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.312+0000 7f93e4f57700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e010fa70 con 0x7f93e01026b0 2024-04-12T09:23:30.315 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.312+0000 7f93e4f57700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e010fbb0 con 0x7f93e0101d10 2024-04-12T09:23:30.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.312+0000 7f93d5d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93e01026b0 0x7f93e010f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:30.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.312+0000 7f93d5d9b700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93e01026b0 0x7f93e010f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55338/0 (socket says 172.21.15.117:55338) 2024-04-12T09:23:30.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.312+0000 7f93d5d9b700 1 -- 172.21.15.117:0/2858377134 learned_addr learned my addr 172.21.15.117:0/2858377134 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:30.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.312+0000 7f93de59c700 1 --2- 172.21.15.117:0/2858377134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f93e0101d10 0x7f93e010ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:30.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.312+0000 7f93d5d9b700 1 -- 172.21.15.117:0/2858377134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f93e0101d10 msgr2=0x7f93e010ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:30.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.312+0000 7f93d5d9b700 1 --2- 172.21.15.117:0/2858377134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f93e0101d10 0x7f93e010ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:30.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.312+0000 7f93d5d9b700 1 -- 172.21.15.117:0/2858377134 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c8005040 con 0x7f93e01026b0 2024-04-12T09:23:30.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.313+0000 7f93d5d9b700 1 --2- 172.21.15.117:0/2858377134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93e01026b0 0x7f93e010f390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f93c8009100 tx=0x7f93c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:30.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.313+0000 7f93d77fe700 1 -- 172.21.15.117:0/2858377134 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93c800e040 con 0x7f93e01026b0 2024-04-12T09:23:30.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.313+0000 7f93e4f57700 1 -- 172.21.15.117:0/2858377134 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e0117ec0 con 0x7f93e01026b0 2024-04-12T09:23:30.316 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.313+0000 7f93d77fe700 1 -- 172.21.15.117:0/2858377134 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f93c8013420 con 0x7f93e01026b0 2024-04-12T09:23:30.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.313+0000 7f93d77fe700 1 -- 172.21.15.117:0/2858377134 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93c801c610 con 0x7f93e01026b0 2024-04-12T09:23:30.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.313+0000 7f93e4f57700 1 -- 172.21.15.117:0/2858377134 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e0118450 con 0x7f93e01026b0 2024-04-12T09:23:30.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.314+0000 7f93e4f57700 1 -- 172.21.15.117:0/2858377134 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e00fd460 con 0x7f93e01026b0 2024-04-12T09:23:30.317 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.314+0000 7f93d77fe700 1 -- 172.21.15.117:0/2858377134 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f93c8013590 con 0x7f93e01026b0 2024-04-12T09:23:30.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.315+0000 7f93d77fe700 1 --2- 172.21.15.117:0/2858377134 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f93cc06dca0 0x7f93cc070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:30.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.315+0000 7f93de59c700 1 --2- 172.21.15.117:0/2858377134 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f93cc06dca0 0x7f93cc070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:30.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.315+0000 7f93d77fe700 1 -- 172.21.15.117:0/2858377134 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f93c808e870 con 0x7f93e01026b0 2024-04-12T09:23:30.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.315+0000 7f93de59c700 1 --2- 172.21.15.117:0/2858377134 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f93cc06dca0 0x7f93cc070150 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f93d0007ea0 tx=0x7f93d0007390 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:30.320 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.320+0000 7f93d77fe700 1 -- 172.21.15.117:0/2858377134 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f93c8057e20 con 0x7f93e01026b0 2024-04-12T09:23:30.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.524+0000 7f93e4f57700 1 -- 172.21.15.117:0/2858377134 --> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f93e004bed0 con 0x7f93cc06dca0 2024-04-12T09:23:30.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.535+0000 7f93d77fe700 1 -- 172.21.15.117:0/2858377134 <== mgr.34102 v2:172.21.15.117:6800/3722476776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f93e004bed0 con 0x7f93cc06dca0 2024-04-12T09:23:30.535 INFO:teuthology.orchestra.run.smithi117.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-12T09:23:30.536 INFO:teuthology.orchestra.run.smithi117.stdout:alertmanager.smithi117 smithi117 *:9093,9094 running (9m) 2m ago 20m 27.0M - 0.25.0 c8568f914cd2 204687f21ed7 2024-04-12T09:23:30.536 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi117 smithi117 running (6m) 2m ago 20m 6656k - 19.0.0-2053-gb277feb2 668895944f0e 038f567b664b 2024-04-12T09:23:30.536 INFO:teuthology.orchestra.run.smithi117.stdout:crash.smithi203 smithi203 running (6m) 109s ago 19m 6660k - 19.0.0-2053-gb277feb2 668895944f0e 420dee66e230 2024-04-12T09:23:30.536 INFO:teuthology.orchestra.run.smithi117.stdout:grafana.smithi117 smithi117 *:3000 running (8m) 2m ago 20m 78.9M - 9.4.12 2bacad6d85d8 a7b102216886 2024-04-12T09:23:30.536 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.eslmxh smithi117 running (2m) 2m ago 15m 12.5M - 19.0.0-2053-gb277feb2 668895944f0e 561830e21baa 2024-04-12T09:23:30.536 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi117.wddsgt smithi117 running (3m) 2m ago 15m 11.8M - 19.0.0-2053-gb277feb2 668895944f0e 642a35bff3ee 2024-04-12T09:23:30.536 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.bszhxz smithi203 running (112s) 109s ago 15m 11.6M - 19.0.0-2053-gb277feb2 668895944f0e d0fdb03b6cbc 2024-04-12T09:23:30.536 INFO:teuthology.orchestra.run.smithi117.stdout:mds.cephfs.smithi203.fbeixl smithi203 running (2m) 109s ago 15m 12.6M - 19.0.0-2053-gb277feb2 668895944f0e f3bba6c8874e 2024-04-12T09:23:30.537 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi117.oyaxql smithi117 *:8443,9283,8765 running (10m) 2m ago 21m 508M - 19.0.0-2053-gb277feb2 668895944f0e fee613d05ab7 2024-04-12T09:23:30.537 INFO:teuthology.orchestra.run.smithi117.stdout:mgr.smithi203.apfqpo smithi203 *:8443,9283,8765 running (10m) 109s ago 19m 451M - 19.0.0-2053-gb277feb2 668895944f0e c793944c3e16 2024-04-12T09:23:30.537 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi117 smithi117 running (7m) 2m ago 22m 55.2M 2048M 19.0.0-2053-gb277feb2 668895944f0e 6823aaff30ce 2024-04-12T09:23:30.537 INFO:teuthology.orchestra.run.smithi117.stdout:mon.smithi203 smithi203 running (7m) 109s ago 19m 44.8M 2048M 19.0.0-2053-gb277feb2 668895944f0e 006c6e487bfb 2024-04-12T09:23:30.537 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi117 smithi117 *:9100 running (9m) 2m ago 20m 16.8M - 1.5.0 0da6a335fe13 c692bed9f6c7 2024-04-12T09:23:30.537 INFO:teuthology.orchestra.run.smithi117.stdout:node-exporter.smithi203 smithi203 *:9100 running (9m) 109s ago 19m 15.4M - 1.5.0 0da6a335fe13 f3b5a470f545 2024-04-12T09:23:30.537 INFO:teuthology.orchestra.run.smithi117.stdout:osd.0 smithi117 running (6m) 2m ago 18m 97.9M 1557M 19.0.0-2053-gb277feb2 668895944f0e 59a180461e3c 2024-04-12T09:23:30.537 INFO:teuthology.orchestra.run.smithi117.stdout:osd.1 smithi117 running (5m) 2m ago 18m 105M 1557M 19.0.0-2053-gb277feb2 668895944f0e d40e2dfc164b 2024-04-12T09:23:30.537 INFO:teuthology.orchestra.run.smithi117.stdout:osd.2 smithi117 running (5m) 2m ago 17m 97.7M 1557M 19.0.0-2053-gb277feb2 668895944f0e fd7d5481cddb 2024-04-12T09:23:30.537 INFO:teuthology.orchestra.run.smithi117.stdout:osd.3 smithi203 running (4m) 109s ago 17m 128M 2581M 19.0.0-2053-gb277feb2 668895944f0e 961db53f9ab1 2024-04-12T09:23:30.537 INFO:teuthology.orchestra.run.smithi117.stdout:osd.4 smithi203 running (3m) 109s ago 17m 109M 2581M 19.0.0-2053-gb277feb2 668895944f0e 7ec45de1eea6 2024-04-12T09:23:30.537 INFO:teuthology.orchestra.run.smithi117.stdout:osd.5 smithi203 running (3m) 109s ago 16m 96.8M 2581M 19.0.0-2053-gb277feb2 668895944f0e ad918b4139f7 2024-04-12T09:23:30.537 INFO:teuthology.orchestra.run.smithi117.stdout:prometheus.smithi117 smithi117 *:9095 running (9m) 2m ago 20m 61.0M - 2.43.0 a07b618ecd1d 43ce588d82cc 2024-04-12T09:23:30.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.537+0000 7f93e4f57700 1 -- 172.21.15.117:0/2858377134 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f93cc06dca0 msgr2=0x7f93cc070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:30.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.537+0000 7f93e4f57700 1 --2- 172.21.15.117:0/2858377134 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f93cc06dca0 0x7f93cc070150 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f93d0007ea0 tx=0x7f93d0007390 comp rx=0 tx=0).stop 2024-04-12T09:23:30.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.537+0000 7f93e4f57700 1 -- 172.21.15.117:0/2858377134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93e01026b0 msgr2=0x7f93e010f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:30.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.537+0000 7f93e4f57700 1 --2- 172.21.15.117:0/2858377134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93e01026b0 0x7f93e010f390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f93c8009100 tx=0x7f93c8009e30 comp rx=0 tx=0).stop 2024-04-12T09:23:30.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.537+0000 7f93e4f57700 1 -- 172.21.15.117:0/2858377134 shutdown_connections 2024-04-12T09:23:30.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.537+0000 7f93e4f57700 1 --2- 172.21.15.117:0/2858377134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f93e0101d10 0x7f93e010ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:30.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.537+0000 7f93e4f57700 1 --2- 172.21.15.117:0/2858377134 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f93cc06dca0 0x7f93cc070150 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:30.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.537+0000 7f93e4f57700 1 --2- 172.21.15.117:0/2858377134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f93e01026b0 0x7f93e010f390 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:30.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.537+0000 7f93e4f57700 1 -- 172.21.15.117:0/2858377134 >> 172.21.15.117:0/2858377134 conn(0x7f93e00f7880 msgr2=0x7f93e0104e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:30.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.537+0000 7f93e4f57700 1 -- 172.21.15.117:0/2858377134 shutdown_connections 2024-04-12T09:23:30.539 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:30.537+0000 7f93e4f57700 1 -- 172.21.15.117:0/2858377134 wait complete. 2024-04-12T09:23:31.203 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'ceph versions' 2024-04-12T09:23:31.477 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:23:31.736 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:31 smithi117 ceph-mon[113571]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:23:31.736 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:31 smithi117 ceph-mon[113571]: pgmap v265: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:32.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:31 smithi203 ceph-mon[86783]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-12T09:23:32.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:31 smithi203 ceph-mon[86783]: pgmap v265: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:32.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.966+0000 7fe17735d700 1 -- 172.21.15.117:0/2767059887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe170102f70 msgr2=0x7fe170103340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:32.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.966+0000 7fe17735d700 1 --2- 172.21.15.117:0/2767059887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe170102f70 0x7fe170103340 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe168009ce0 tx=0x7fe168004d10 comp rx=0 tx=0).stop 2024-04-12T09:23:32.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.966+0000 7fe17735d700 1 -- 172.21.15.117:0/2767059887 shutdown_connections 2024-04-12T09:23:32.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.966+0000 7fe17735d700 1 --2- 172.21.15.117:0/2767059887 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1700fb3b0 0x7fe1700fb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:32.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.966+0000 7fe17735d700 1 --2- 172.21.15.117:0/2767059887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe170102f70 0x7fe170103340 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:32.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.966+0000 7fe17735d700 1 -- 172.21.15.117:0/2767059887 >> 172.21.15.117:0/2767059887 conn(0x7fe170072310 msgr2=0x7fe170072710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:32.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.966+0000 7fe17735d700 1 -- 172.21.15.117:0/2767059887 shutdown_connections 2024-04-12T09:23:32.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.966+0000 7fe17735d700 1 -- 172.21.15.117:0/2767059887 wait complete. 2024-04-12T09:23:32.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.967+0000 7fe17735d700 1 Processor -- start 2024-04-12T09:23:32.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.967+0000 7fe17735d700 1 -- start start 2024-04-12T09:23:32.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.967+0000 7fe17735d700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1700fb3b0 0x7fe1700fc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:32.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.967+0000 7fe17735d700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe170102f70 0x7fe1700fcad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:32.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.967+0000 7fe17735d700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1700fd010 con 0x7fe170102f70 2024-04-12T09:23:32.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.967+0000 7fe17735d700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1700fd180 con 0x7fe1700fb3b0 2024-04-12T09:23:32.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.967+0000 7fe1748f8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe170102f70 0x7fe1700fcad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:32.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.967+0000 7fe1748f8700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe170102f70 0x7fe1700fcad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55352/0 (socket says 172.21.15.117:55352) 2024-04-12T09:23:32.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.967+0000 7fe1748f8700 1 -- 172.21.15.117:0/3064815534 learned_addr learned my addr 172.21.15.117:0/3064815534 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:32.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.967+0000 7fe1750f9700 1 --2- 172.21.15.117:0/3064815534 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1700fb3b0 0x7fe1700fc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:32.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.968+0000 7fe1748f8700 1 -- 172.21.15.117:0/3064815534 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1700fb3b0 msgr2=0x7fe1700fc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:32.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.968+0000 7fe1748f8700 1 --2- 172.21.15.117:0/3064815534 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1700fb3b0 0x7fe1700fc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:32.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.968+0000 7fe1748f8700 1 -- 172.21.15.117:0/3064815534 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe168009940 con 0x7fe170102f70 2024-04-12T09:23:32.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.968+0000 7fe1748f8700 1 --2- 172.21.15.117:0/3064815534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe170102f70 0x7fe1700fcad0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe16000b790 tx=0x7fe160009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:32.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.968+0000 7fe165ffb700 1 -- 172.21.15.117:0/3064815534 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe16000f6f0 con 0x7fe170102f70 2024-04-12T09:23:32.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.968+0000 7fe17735d700 1 -- 172.21.15.117:0/3064815534 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17011a030 con 0x7fe170102f70 2024-04-12T09:23:32.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.968+0000 7fe165ffb700 1 -- 172.21.15.117:0/3064815534 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe16000fd20 con 0x7fe170102f70 2024-04-12T09:23:32.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.968+0000 7fe165ffb700 1 -- 172.21.15.117:0/3064815534 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1600103a0 con 0x7fe170102f70 2024-04-12T09:23:32.971 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.968+0000 7fe17735d700 1 -- 172.21.15.117:0/3064815534 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17011a380 con 0x7fe170102f70 2024-04-12T09:23:32.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.969+0000 7fe17735d700 1 -- 172.21.15.117:0/3064815534 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1700fe6d0 con 0x7fe170102f70 2024-04-12T09:23:32.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.970+0000 7fe165ffb700 1 -- 172.21.15.117:0/3064815534 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fe160011400 con 0x7fe170102f70 2024-04-12T09:23:32.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.970+0000 7fe165ffb700 1 --2- 172.21.15.117:0/3064815534 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe15c06dca0 0x7fe15c070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:32.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.970+0000 7fe165ffb700 1 -- 172.21.15.117:0/3064815534 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fe16008d3d0 con 0x7fe170102f70 2024-04-12T09:23:32.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.970+0000 7fe1750f9700 1 --2- 172.21.15.117:0/3064815534 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe15c06dca0 0x7fe15c070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:32.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.970+0000 7fe1750f9700 1 --2- 172.21.15.117:0/3064815534 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe15c06dca0 0x7fe15c070150 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe16800b740 tx=0x7fe168004d10 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:32.975 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:32.975+0000 7fe165ffb700 1 -- 172.21.15.117:0/3064815534 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fe160056980 con 0x7fe170102f70 2024-04-12T09:23:33.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:33.250+0000 7fe17735d700 1 -- 172.21.15.117:0/3064815534 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe170105390 con 0x7fe170102f70 2024-04-12T09:23:33.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:33.251+0000 7fe165ffb700 1 -- 172.21.15.117:0/3064815534 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fe16005a040 con 0x7fe170102f70 2024-04-12T09:23:33.251 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-04-12T09:23:33.251 INFO:teuthology.orchestra.run.smithi117.stdout: "mon": { 2024-04-12T09:23:33.252 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:23:33.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:23:33.252 INFO:teuthology.orchestra.run.smithi117.stdout: "mgr": { 2024-04-12T09:23:33.252 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 2 2024-04-12T09:23:33.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:23:33.252 INFO:teuthology.orchestra.run.smithi117.stdout: "osd": { 2024-04-12T09:23:33.252 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 6 2024-04-12T09:23:33.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:23:33.252 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-04-12T09:23:33.252 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 4 2024-04-12T09:23:33.252 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-04-12T09:23:33.252 INFO:teuthology.orchestra.run.smithi117.stdout: "overall": { 2024-04-12T09:23:33.252 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)": 14 2024-04-12T09:23:33.252 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-04-12T09:23:33.253 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-04-12T09:23:33.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:33.253+0000 7fe17735d700 1 -- 172.21.15.117:0/3064815534 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe15c06dca0 msgr2=0x7fe15c070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:33.253 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:33.253+0000 7fe17735d700 1 --2- 172.21.15.117:0/3064815534 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe15c06dca0 0x7fe15c070150 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe16800b740 tx=0x7fe168004d10 comp rx=0 tx=0).stop 2024-04-12T09:23:33.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:33.253+0000 7fe17735d700 1 -- 172.21.15.117:0/3064815534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe170102f70 msgr2=0x7fe1700fcad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:33.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:33.253+0000 7fe17735d700 1 --2- 172.21.15.117:0/3064815534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe170102f70 0x7fe1700fcad0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe16000b790 tx=0x7fe160009250 comp rx=0 tx=0).stop 2024-04-12T09:23:33.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:33.253+0000 7fe17735d700 1 -- 172.21.15.117:0/3064815534 shutdown_connections 2024-04-12T09:23:33.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:33.253+0000 7fe17735d700 1 --2- 172.21.15.117:0/3064815534 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1700fb3b0 0x7fe1700fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:33.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:33.253+0000 7fe17735d700 1 --2- 172.21.15.117:0/3064815534 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe15c06dca0 0x7fe15c070150 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:33.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:33.253+0000 7fe17735d700 1 --2- 172.21.15.117:0/3064815534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe170102f70 0x7fe1700fcad0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:33.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:33.253+0000 7fe17735d700 1 -- 172.21.15.117:0/3064815534 >> 172.21.15.117:0/3064815534 conn(0x7fe170072310 msgr2=0x7fe1700f9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:33.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:33.253+0000 7fe17735d700 1 -- 172.21.15.117:0/3064815534 shutdown_connections 2024-04-12T09:23:33.254 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:33.253+0000 7fe17735d700 1 -- 172.21.15.117:0/3064815534 wait complete. 2024-04-12T09:23:33.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:33 smithi117 ceph-mon[113571]: pgmap v266: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:33.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:33 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/3064815534' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:23:33.977 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-04-12T09:23:34.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:33 smithi203 ceph-mon[86783]: pgmap v266: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:34.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:33 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/3064815534' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:23:34.234 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:23:35.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.748+0000 7f88d2ad7700 1 -- 172.21.15.117:0/1988403837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88cc102710 msgr2=0x7f88cc0fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:35.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.748+0000 7f88d2ad7700 1 --2- 172.21.15.117:0/1988403837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88cc102710 0x7f88cc0fbd80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f88b8004940 tx=0x7f88b8009e30 comp rx=0 tx=0).stop 2024-04-12T09:23:35.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.748+0000 7f88d2ad7700 1 -- 172.21.15.117:0/1988403837 shutdown_connections 2024-04-12T09:23:35.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.748+0000 7f88d2ad7700 1 --2- 172.21.15.117:0/1988403837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88cc102710 0x7f88cc0fbd80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:35.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.748+0000 7f88d2ad7700 1 --2- 172.21.15.117:0/1988403837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88cc101d70 0x7f88cc102140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:35.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.748+0000 7f88d2ad7700 1 -- 172.21.15.117:0/1988403837 >> 172.21.15.117:0/1988403837 conn(0x7f88cc072bc0 msgr2=0x7f88cc072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:35.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.748+0000 7f88d2ad7700 1 -- 172.21.15.117:0/1988403837 shutdown_connections 2024-04-12T09:23:35.751 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.748+0000 7f88d2ad7700 1 -- 172.21.15.117:0/1988403837 wait complete. 2024-04-12T09:23:35.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.749+0000 7f88d2ad7700 1 Processor -- start 2024-04-12T09:23:35.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.749+0000 7f88d2ad7700 1 -- start start 2024-04-12T09:23:35.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.749+0000 7f88d2ad7700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88cc101d70 0x7f88cc10c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:35.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.749+0000 7f88d2ad7700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88cc102710 0x7f88cc10ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:35.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.749+0000 7f88d2ad7700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc10d430 con 0x7f88cc101d70 2024-04-12T09:23:35.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.749+0000 7f88d2ad7700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc10d5a0 con 0x7f88cc102710 2024-04-12T09:23:35.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.749+0000 7f88d0873700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88cc101d70 0x7f88cc10c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:35.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.749+0000 7f88d0873700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88cc101d70 0x7f88cc10c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55362/0 (socket says 172.21.15.117:55362) 2024-04-12T09:23:35.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.749+0000 7f88d0873700 1 -- 172.21.15.117:0/760578815 learned_addr learned my addr 172.21.15.117:0/760578815 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:35.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.750+0000 7f88cbfff700 1 --2- 172.21.15.117:0/760578815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88cc102710 0x7f88cc10ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:35.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.750+0000 7f88d0873700 1 -- 172.21.15.117:0/760578815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88cc102710 msgr2=0x7f88cc10ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:35.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.750+0000 7f88d0873700 1 --2- 172.21.15.117:0/760578815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88cc102710 0x7f88cc10ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:35.752 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.750+0000 7f88d0873700 1 -- 172.21.15.117:0/760578815 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b8005040 con 0x7f88cc101d70 2024-04-12T09:23:35.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.750+0000 7f88cbfff700 1 --2- 172.21.15.117:0/760578815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88cc102710 0x7f88cc10ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T09:23:35.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.750+0000 7f88d0873700 1 --2- 172.21.15.117:0/760578815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88cc101d70 0x7f88cc10c920 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f88c000b790 tx=0x7f88c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:35.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.750+0000 7f88c97fa700 1 -- 172.21.15.117:0/760578815 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88c000f770 con 0x7f88cc101d70 2024-04-12T09:23:35.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.750+0000 7f88d2ad7700 1 -- 172.21.15.117:0/760578815 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88cc119f90 con 0x7f88cc101d70 2024-04-12T09:23:35.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.750+0000 7f88c97fa700 1 -- 172.21.15.117:0/760578815 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f88c000fda0 con 0x7f88cc101d70 2024-04-12T09:23:35.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.750+0000 7f88c97fa700 1 -- 172.21.15.117:0/760578815 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88c000d310 con 0x7f88cc101d70 2024-04-12T09:23:35.753 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.750+0000 7f88d2ad7700 1 -- 172.21.15.117:0/760578815 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88cc11a3c0 con 0x7f88cc101d70 2024-04-12T09:23:35.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.751+0000 7f88d2ad7700 1 -- 172.21.15.117:0/760578815 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88cc0ff080 con 0x7f88cc101d70 2024-04-12T09:23:35.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.752+0000 7f88c97fa700 1 -- 172.21.15.117:0/760578815 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f88c0010420 con 0x7f88cc101d70 2024-04-12T09:23:35.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.752+0000 7f88c97fa700 1 --2- 172.21.15.117:0/760578815 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f88bc06dca0 0x7f88bc070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:35.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.752+0000 7f88c97fa700 1 -- 172.21.15.117:0/760578815 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f88c008d4a0 con 0x7f88cc101d70 2024-04-12T09:23:35.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.752+0000 7f88cbfff700 1 --2- 172.21.15.117:0/760578815 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f88bc06dca0 0x7f88bc070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:35.755 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.752+0000 7f88cbfff700 1 --2- 172.21.15.117:0/760578815 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f88bc06dca0 0x7f88bc070150 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f88b800b3b0 tx=0x7f88b8009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:35.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:35.757+0000 7f88c97fa700 1 -- 172.21.15.117:0/760578815 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f88c005a620 con 0x7f88cc101d70 2024-04-12T09:23:36.035 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:36.035+0000 7f88d2ad7700 1 -- 172.21.15.117:0/760578815 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f88cc108ec0 con 0x7f88cc101d70 2024-04-12T09:23:36.036 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:35 smithi117 ceph-mon[113571]: pgmap v267: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:36.036 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:36.035+0000 7f88c97fa700 1 -- 172.21.15.117:0/760578815 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f88c005a1b0 con 0x7f88cc101d70 2024-04-12T09:23:36.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:36.037+0000 7f88d2ad7700 1 -- 172.21.15.117:0/760578815 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f88bc06dca0 msgr2=0x7f88bc070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:36.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:36.037+0000 7f88d2ad7700 1 --2- 172.21.15.117:0/760578815 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f88bc06dca0 0x7f88bc070150 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f88b800b3b0 tx=0x7f88b8009e30 comp rx=0 tx=0).stop 2024-04-12T09:23:36.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:36.037+0000 7f88d2ad7700 1 -- 172.21.15.117:0/760578815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88cc101d70 msgr2=0x7f88cc10c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:36.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:36.037+0000 7f88d2ad7700 1 --2- 172.21.15.117:0/760578815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88cc101d70 0x7f88cc10c920 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f88c000b790 tx=0x7f88c0009250 comp rx=0 tx=0).stop 2024-04-12T09:23:36.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:36.037+0000 7f88d2ad7700 1 -- 172.21.15.117:0/760578815 shutdown_connections 2024-04-12T09:23:36.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:36.037+0000 7f88d2ad7700 1 --2- 172.21.15.117:0/760578815 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f88bc06dca0 0x7f88bc070150 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:36.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:36.037+0000 7f88d2ad7700 1 --2- 172.21.15.117:0/760578815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f88cc101d70 0x7f88cc10c920 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:36.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:36.037+0000 7f88d2ad7700 1 --2- 172.21.15.117:0/760578815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88cc102710 0x7f88cc10ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:36.038 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:36.037+0000 7f88d2ad7700 1 -- 172.21.15.117:0/760578815 >> 172.21.15.117:0/760578815 conn(0x7f88cc072bc0 msgr2=0x7f88cc0faf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:36.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:36.037+0000 7f88d2ad7700 1 -- 172.21.15.117:0/760578815 shutdown_connections 2024-04-12T09:23:36.039 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:36.037+0000 7f88d2ad7700 1 -- 172.21.15.117:0/760578815 wait complete. 2024-04-12T09:23:36.048 INFO:teuthology.orchestra.run.smithi117.stdout:true 2024-04-12T09:23:36.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:35 smithi203 ceph-mon[86783]: pgmap v267: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:36.671 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -e sha1=b277feb2c7beb4597d8ecc39d58d5c36b81f613a -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-04-12T09:23:36.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:36 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/760578815' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:23:36.929 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:23:37.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:36 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/760578815' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:23:38.012 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:37 smithi117 ceph-mon[113571]: pgmap v268: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:38.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:37 smithi203 ceph-mon[86783]: pgmap v268: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:38.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.486+0000 7fe9feebe700 1 -- 172.21.15.117:0/685771092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9f81037a0 msgr2=0x7fe9f80fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:38.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.486+0000 7fe9feebe700 1 --2- 172.21.15.117:0/685771092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9f81037a0 0x7fe9f80fce10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0004940 tx=0x7fe9e0009e30 comp rx=0 tx=0).stop 2024-04-12T09:23:38.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.486+0000 7fe9feebe700 1 -- 172.21.15.117:0/685771092 shutdown_connections 2024-04-12T09:23:38.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.486+0000 7fe9feebe700 1 --2- 172.21.15.117:0/685771092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9f81037a0 0x7fe9f80fce10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:38.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.486+0000 7fe9feebe700 1 --2- 172.21.15.117:0/685771092 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9f8102e00 0x7fe9f81031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:38.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.486+0000 7fe9feebe700 1 -- 172.21.15.117:0/685771092 >> 172.21.15.117:0/685771092 conn(0x7fe9f80f89b0 msgr2=0x7fe9f80fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:38.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.486+0000 7fe9feebe700 1 -- 172.21.15.117:0/685771092 shutdown_connections 2024-04-12T09:23:38.487 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.486+0000 7fe9feebe700 1 -- 172.21.15.117:0/685771092 wait complete. 2024-04-12T09:23:38.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.487+0000 7fe9feebe700 1 Processor -- start 2024-04-12T09:23:38.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.487+0000 7fe9feebe700 1 -- start start 2024-04-12T09:23:38.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.487+0000 7fe9feebe700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9f8102e00 0x7fe9f80702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:38.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.487+0000 7fe9feebe700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9f81037a0 0x7fe9f8070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:38.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.487+0000 7fe9feebe700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f80722a0 con 0x7fe9f8102e00 2024-04-12T09:23:38.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.487+0000 7fe9feebe700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f8070d40 con 0x7fe9f81037a0 2024-04-12T09:23:38.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.487+0000 7fe9fcc5a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9f8102e00 0x7fe9f80702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:38.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.487+0000 7fe9fcc5a700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9f8102e00 0x7fe9f80702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:55382/0 (socket says 172.21.15.117:55382) 2024-04-12T09:23:38.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.487+0000 7fe9fcc5a700 1 -- 172.21.15.117:0/835516834 learned_addr learned my addr 172.21.15.117:0/835516834 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:38.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.487+0000 7fe9f7fff700 1 --2- 172.21.15.117:0/835516834 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9f81037a0 0x7fe9f8070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:38.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.488+0000 7fe9fcc5a700 1 -- 172.21.15.117:0/835516834 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9f81037a0 msgr2=0x7fe9f8070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:38.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.488+0000 7fe9fcc5a700 1 --2- 172.21.15.117:0/835516834 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9f81037a0 0x7fe9f8070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:38.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.488+0000 7fe9fcc5a700 1 -- 172.21.15.117:0/835516834 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e0005040 con 0x7fe9f8102e00 2024-04-12T09:23:38.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.488+0000 7fe9f7fff700 1 --2- 172.21.15.117:0/835516834 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9f81037a0 0x7fe9f8070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T09:23:38.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.488+0000 7fe9fcc5a700 1 --2- 172.21.15.117:0/835516834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9f8102e00 0x7fe9f80702c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe9f000bbb0 tx=0x7fe9f0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:38.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.488+0000 7fe9f57fa700 1 -- 172.21.15.117:0/835516834 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9f00092e0 con 0x7fe9f8102e00 2024-04-12T09:23:38.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.488+0000 7fe9feebe700 1 -- 172.21.15.117:0/835516834 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f8071020 con 0x7fe9f8102e00 2024-04-12T09:23:38.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.488+0000 7fe9f57fa700 1 -- 172.21.15.117:0/835516834 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe9f000cbd0 con 0x7fe9f8102e00 2024-04-12T09:23:38.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.488+0000 7fe9f57fa700 1 -- 172.21.15.117:0/835516834 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9f0007400 con 0x7fe9f8102e00 2024-04-12T09:23:38.490 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.488+0000 7fe9feebe700 1 -- 172.21.15.117:0/835516834 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f811a230 con 0x7fe9f8102e00 2024-04-12T09:23:38.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.489+0000 7fe9feebe700 1 -- 172.21.15.117:0/835516834 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f8100110 con 0x7fe9f8102e00 2024-04-12T09:23:38.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.489+0000 7fe9f57fa700 1 -- 172.21.15.117:0/835516834 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fe9f0012070 con 0x7fe9f8102e00 2024-04-12T09:23:38.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.490+0000 7fe9f57fa700 1 --2- 172.21.15.117:0/835516834 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe9e406dca0 0x7fe9e4070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:38.491 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.490+0000 7fe9f57fa700 1 -- 172.21.15.117:0/835516834 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fe9f008d290 con 0x7fe9f8102e00 2024-04-12T09:23:38.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.490+0000 7fe9f7fff700 1 --2- 172.21.15.117:0/835516834 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe9e406dca0 0x7fe9e4070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:38.492 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.490+0000 7fe9f7fff700 1 --2- 172.21.15.117:0/835516834 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe9e406dca0 0x7fe9e4070150 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe9e000b3b0 tx=0x7fe9e0009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:38.495 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.495+0000 7fe9f57fa700 1 -- 172.21.15.117:0/835516834 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fe9f00567c0 con 0x7fe9f8102e00 2024-04-12T09:23:38.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.771+0000 7fe9feebe700 1 -- 172.21.15.117:0/835516834 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe9f8109f80 con 0x7fe9f8102e00 2024-04-12T09:23:38.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.772+0000 7fe9f57fa700 1 -- 172.21.15.117:0/835516834 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fe9f0059e80 con 0x7fe9f8102e00 2024-04-12T09:23:38.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.774+0000 7fe9feebe700 1 -- 172.21.15.117:0/835516834 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe9e406dca0 msgr2=0x7fe9e4070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:38.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.774+0000 7fe9feebe700 1 --2- 172.21.15.117:0/835516834 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe9e406dca0 0x7fe9e4070150 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe9e000b3b0 tx=0x7fe9e0009e30 comp rx=0 tx=0).stop 2024-04-12T09:23:38.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.774+0000 7fe9feebe700 1 -- 172.21.15.117:0/835516834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9f8102e00 msgr2=0x7fe9f80702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:38.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.774+0000 7fe9feebe700 1 --2- 172.21.15.117:0/835516834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9f8102e00 0x7fe9f80702c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe9f000bbb0 tx=0x7fe9f0009840 comp rx=0 tx=0).stop 2024-04-12T09:23:38.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.774+0000 7fe9feebe700 1 -- 172.21.15.117:0/835516834 shutdown_connections 2024-04-12T09:23:38.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.774+0000 7fe9feebe700 1 --2- 172.21.15.117:0/835516834 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe9e406dca0 0x7fe9e4070150 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:38.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.774+0000 7fe9feebe700 1 --2- 172.21.15.117:0/835516834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9f8102e00 0x7fe9f80702c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:38.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.774+0000 7fe9feebe700 1 --2- 172.21.15.117:0/835516834 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9f81037a0 0x7fe9f8070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:38.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.774+0000 7fe9feebe700 1 -- 172.21.15.117:0/835516834 >> 172.21.15.117:0/835516834 conn(0x7fe9f80f89b0 msgr2=0x7fe9f80fa770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:38.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.774+0000 7fe9feebe700 1 -- 172.21.15.117:0/835516834 shutdown_connections 2024-04-12T09:23:38.775 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:38.774+0000 7fe9feebe700 1 -- 172.21.15.117:0/835516834 wait complete. 2024-04-12T09:23:38.785 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph version 19.0.0-2053-gb277feb2 (b277feb2c7beb4597d8ecc39d58d5c36b81f613a) squid (dev)" 2024-04-12T09:23:39.507 DEBUG:teuthology.parallel:result is None 2024-04-12T09:23:39.507 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-12T09:23:39.519 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi117.front.sepia.ceph.com 2024-04-12T09:23:39.519 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-12T09:23:39.781 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/mon.smithi117/config 2024-04-12T09:23:40.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:39 smithi203 ceph-mon[86783]: pgmap v269: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:40.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:39 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/835516834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:23:40.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:23:40.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:39 smithi117 ceph-mon[113571]: pgmap v269: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:40.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:39 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/835516834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-12T09:23:40.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:23:41.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.662+0000 7ff472aa9700 1 -- 172.21.15.117:0/3404092247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff46c101d20 msgr2=0x7ff46c1020f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:41.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.662+0000 7ff472aa9700 1 --2- 172.21.15.117:0/3404092247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff46c101d20 0x7ff46c1020f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff464004940 tx=0x7ff464009e30 comp rx=0 tx=0).stop 2024-04-12T09:23:41.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.662+0000 7ff472aa9700 1 -- 172.21.15.117:0/3404092247 shutdown_connections 2024-04-12T09:23:41.665 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.662+0000 7ff472aa9700 1 --2- 172.21.15.117:0/3404092247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff46c1026c0 0x7ff46c0fbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:41.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.662+0000 7ff472aa9700 1 --2- 172.21.15.117:0/3404092247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff46c101d20 0x7ff46c1020f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:41.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.662+0000 7ff472aa9700 1 -- 172.21.15.117:0/3404092247 >> 172.21.15.117:0/3404092247 conn(0x7ff46c0f78d0 msgr2=0x7ff46c0f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:41.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.662+0000 7ff472aa9700 1 -- 172.21.15.117:0/3404092247 shutdown_connections 2024-04-12T09:23:41.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.662+0000 7ff472aa9700 1 -- 172.21.15.117:0/3404092247 wait complete. 2024-04-12T09:23:41.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.663+0000 7ff472aa9700 1 Processor -- start 2024-04-12T09:23:41.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.663+0000 7ff472aa9700 1 -- start start 2024-04-12T09:23:41.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.663+0000 7ff472aa9700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff46c101d20 0x7ff46c112ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:41.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.663+0000 7ff472aa9700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff46c1026c0 0x7ff46c113020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:41.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.663+0000 7ff472aa9700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c113670 con 0x7ff46c1026c0 2024-04-12T09:23:41.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.663+0000 7ff472aa9700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c10ca60 con 0x7ff46c101d20 2024-04-12T09:23:41.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.663+0000 7ff46bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff46c1026c0 0x7ff46c113020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:41.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.663+0000 7ff46bfff700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff46c1026c0 0x7ff46c113020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35184/0 (socket says 172.21.15.117:35184) 2024-04-12T09:23:41.666 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.663+0000 7ff46bfff700 1 -- 172.21.15.117:0/3438127608 learned_addr learned my addr 172.21.15.117:0/3438127608 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:41.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.664+0000 7ff470845700 1 --2- 172.21.15.117:0/3438127608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff46c101d20 0x7ff46c112ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:41.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.664+0000 7ff46bfff700 1 -- 172.21.15.117:0/3438127608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff46c101d20 msgr2=0x7ff46c112ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:41.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.664+0000 7ff46bfff700 1 --2- 172.21.15.117:0/3438127608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff46c101d20 0x7ff46c112ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:41.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.664+0000 7ff46bfff700 1 -- 172.21.15.117:0/3438127608 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff464005040 con 0x7ff46c1026c0 2024-04-12T09:23:41.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.664+0000 7ff470845700 1 --2- 172.21.15.117:0/3438127608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff46c101d20 0x7ff46c112ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T09:23:41.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.664+0000 7ff46bfff700 1 --2- 172.21.15.117:0/3438127608 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff46c1026c0 0x7ff46c113020 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff45c001d00 tx=0x7ff45c009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:41.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.664+0000 7ff4697fa700 1 -- 172.21.15.117:0/3438127608 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff45c007d10 con 0x7ff46c1026c0 2024-04-12T09:23:41.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.664+0000 7ff4697fa700 1 -- 172.21.15.117:0/3438127608 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff45c007e70 con 0x7ff46c1026c0 2024-04-12T09:23:41.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.664+0000 7ff472aa9700 1 -- 172.21.15.117:0/3438127608 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46c10cd40 con 0x7ff46c1026c0 2024-04-12T09:23:41.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.664+0000 7ff4697fa700 1 -- 172.21.15.117:0/3438127608 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff45c014640 con 0x7ff46c1026c0 2024-04-12T09:23:41.667 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.664+0000 7ff472aa9700 1 -- 172.21.15.117:0/3438127608 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46c10d300 con 0x7ff46c1026c0 2024-04-12T09:23:41.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.665+0000 7ff472aa9700 1 -- 172.21.15.117:0/3438127608 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff46c0fd470 con 0x7ff46c1026c0 2024-04-12T09:23:41.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.666+0000 7ff4697fa700 1 -- 172.21.15.117:0/3438127608 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7ff45c00e900 con 0x7ff46c1026c0 2024-04-12T09:23:41.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.666+0000 7ff4697fa700 1 --2- 172.21.15.117:0/3438127608 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff45806dca0 0x7ff458070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:41.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.666+0000 7ff4697fa700 1 -- 172.21.15.117:0/3438127608 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7ff45c08d410 con 0x7ff46c1026c0 2024-04-12T09:23:41.668 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.666+0000 7ff470845700 1 --2- 172.21.15.117:0/3438127608 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff45806dca0 0x7ff458070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:41.669 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.667+0000 7ff470845700 1 --2- 172.21.15.117:0/3438127608 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff45806dca0 0x7ff458070150 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff464004560 tx=0x7ff464009e30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:41.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.671+0000 7ff4697fa700 1 -- 172.21.15.117:0/3438127608 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff45c05a520 con 0x7ff46c1026c0 2024-04-12T09:23:41.908 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.907+0000 7ff472aa9700 1 -- 172.21.15.117:0/3438127608 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff46c108e50 con 0x7ff46c1026c0 2024-04-12T09:23:41.909 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.908+0000 7ff4697fa700 1 -- 172.21.15.117:0/3438127608 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1942 (secure 0 0 0) 0x7ff45c05a0b0 con 0x7ff46c1026c0 2024-04-12T09:23:41.909 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:41 smithi117 ceph-mon[113571]: pgmap v270: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:41.909 INFO:teuthology.orchestra.run.smithi117.stdout:e32 2024-04-12T09:23:41.909 INFO:teuthology.orchestra.run.smithi117.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-12T09:23:41.909 INFO:teuthology.orchestra.run.smithi117.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-12T09:23:41.909 INFO:teuthology.orchestra.run.smithi117.stdout:legacy client fscid: 1 2024-04-12T09:23:41.909 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:41.909 INFO:teuthology.orchestra.run.smithi117.stdout:Filesystem 'cephfs' (1) 2024-04-12T09:23:41.910 INFO:teuthology.orchestra.run.smithi117.stdout:fs_name cephfs 2024-04-12T09:23:41.910 INFO:teuthology.orchestra.run.smithi117.stdout:epoch 32 2024-04-12T09:23:41.910 INFO:teuthology.orchestra.run.smithi117.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-12T09:23:41.910 INFO:teuthology.orchestra.run.smithi117.stdout:created 2024-04-12T09:08:12.488144+0000 2024-04-12T09:23:41.910 INFO:teuthology.orchestra.run.smithi117.stdout:modified 2024-04-12T09:21:46.703814+0000 2024-04-12T09:23:41.910 INFO:teuthology.orchestra.run.smithi117.stdout:tableserver 0 2024-04-12T09:23:41.910 INFO:teuthology.orchestra.run.smithi117.stdout:root 0 2024-04-12T09:23:41.910 INFO:teuthology.orchestra.run.smithi117.stdout:session_timeout 60 2024-04-12T09:23:41.910 INFO:teuthology.orchestra.run.smithi117.stdout:session_autoclose 300 2024-04-12T09:23:41.910 INFO:teuthology.orchestra.run.smithi117.stdout:max_file_size 1099511627776 2024-04-12T09:23:41.910 INFO:teuthology.orchestra.run.smithi117.stdout:max_xattr_size 65536 2024-04-12T09:23:41.910 INFO:teuthology.orchestra.run.smithi117.stdout:required_client_features {} 2024-04-12T09:23:41.910 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure 0 2024-04-12T09:23:41.910 INFO:teuthology.orchestra.run.smithi117.stdout:last_failure_osd_epoch 83 2024-04-12T09:23:41.910 INFO:teuthology.orchestra.run.smithi117.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-12T09:23:41.911 INFO:teuthology.orchestra.run.smithi117.stdout:max_mds 1 2024-04-12T09:23:41.911 INFO:teuthology.orchestra.run.smithi117.stdout:in 0 2024-04-12T09:23:41.911 INFO:teuthology.orchestra.run.smithi117.stdout:up {0=34372} 2024-04-12T09:23:41.911 INFO:teuthology.orchestra.run.smithi117.stdout:failed 2024-04-12T09:23:41.911 INFO:teuthology.orchestra.run.smithi117.stdout:damaged 2024-04-12T09:23:41.911 INFO:teuthology.orchestra.run.smithi117.stdout:stopped 2024-04-12T09:23:41.911 INFO:teuthology.orchestra.run.smithi117.stdout:data_pools [3] 2024-04-12T09:23:41.911 INFO:teuthology.orchestra.run.smithi117.stdout:metadata_pool 2 2024-04-12T09:23:41.911 INFO:teuthology.orchestra.run.smithi117.stdout:inline_data disabled 2024-04-12T09:23:41.911 INFO:teuthology.orchestra.run.smithi117.stdout:balancer 2024-04-12T09:23:41.911 INFO:teuthology.orchestra.run.smithi117.stdout:bal_rank_mask -1 2024-04-12T09:23:41.911 INFO:teuthology.orchestra.run.smithi117.stdout:standby_count_wanted 1 2024-04-12T09:23:41.911 INFO:teuthology.orchestra.run.smithi117.stdout:qdb_cluster leader: 34372 members: 34372 2024-04-12T09:23:41.911 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.wddsgt{0:34372} state up:active seq 20 join_fscid=1 addr [v2:172.21.15.117:6826/2687704577,v1:172.21.15.117:6827/2687704577] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T09:23:41.912 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:41.912 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:41.912 INFO:teuthology.orchestra.run.smithi117.stdout:Standby daemons: 2024-04-12T09:23:41.912 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:41.912 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi117.eslmxh{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6828/2675574893,v1:172.21.15.117:6829/2675574893] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T09:23:41.912 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.fbeixl{-1:44311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.203:6824/3346773589,v1:172.21.15.203:6825/3346773589] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T09:23:41.912 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.cephfs.smithi203.bszhxz{-1:44327} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.203:6826/240713176,v1:172.21.15.203:6827/240713176] compat {c=[1],r=[1],i=[1fff]}] 2024-04-12T09:23:41.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.910+0000 7ff472aa9700 1 -- 172.21.15.117:0/3438127608 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff45806dca0 msgr2=0x7ff458070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:41.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.910+0000 7ff472aa9700 1 --2- 172.21.15.117:0/3438127608 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff45806dca0 0x7ff458070150 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff464004560 tx=0x7ff464009e30 comp rx=0 tx=0).stop 2024-04-12T09:23:41.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.910+0000 7ff472aa9700 1 -- 172.21.15.117:0/3438127608 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff46c1026c0 msgr2=0x7ff46c113020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:41.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.910+0000 7ff472aa9700 1 --2- 172.21.15.117:0/3438127608 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff46c1026c0 0x7ff46c113020 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff45c001d00 tx=0x7ff45c009e40 comp rx=0 tx=0).stop 2024-04-12T09:23:41.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.910+0000 7ff472aa9700 1 -- 172.21.15.117:0/3438127608 shutdown_connections 2024-04-12T09:23:41.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.910+0000 7ff472aa9700 1 --2- 172.21.15.117:0/3438127608 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff46c101d20 0x7ff46c112ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:41.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.910+0000 7ff472aa9700 1 --2- 172.21.15.117:0/3438127608 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff45806dca0 0x7ff458070150 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:41.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.910+0000 7ff472aa9700 1 --2- 172.21.15.117:0/3438127608 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff46c1026c0 0x7ff46c113020 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:41.913 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.910+0000 7ff472aa9700 1 -- 172.21.15.117:0/3438127608 >> 172.21.15.117:0/3438127608 conn(0x7ff46c0f78d0 msgr2=0x7ff46c0f88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:41.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.910+0000 7ff472aa9700 1 -- 172.21.15.117:0/3438127608 shutdown_connections 2024-04-12T09:23:41.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:41.910+0000 7ff472aa9700 1 -- 172.21.15.117:0/3438127608 wait complete. 2024-04-12T09:23:41.914 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 32 2024-04-12T09:23:42.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:41 smithi203 ceph-mon[86783]: pgmap v270: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:42.501 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-04-12T09:23:42.512 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T09:23:42.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.611+0000 7fabc98ee640 1 -- 172.21.15.117:0/4174173491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabc41011a0 msgr2=0x7fabc4101570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:42.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.611+0000 7fabc98ee640 1 --2- 172.21.15.117:0/4174173491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabc41011a0 0x7fabc4101570 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fabb40048d0 tx=0x7fabb4009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:42.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.611+0000 7fabc98ee640 1 -- 172.21.15.117:0/4174173491 shutdown_connections 2024-04-12T09:23:42.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.611+0000 7fabc98ee640 1 --2- 172.21.15.117:0/4174173491 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fabc4101b40 0x7fabc40fb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:42.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.611+0000 7fabc98ee640 1 --2- 172.21.15.117:0/4174173491 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabc41011a0 0x7fabc4101570 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:42.614 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.611+0000 7fabc98ee640 1 -- 172.21.15.117:0/4174173491 >> 172.21.15.117:0/4174173491 conn(0x7fabc40f6d70 msgr2=0x7fabc40f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:42.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.611+0000 7fabc98ee640 1 -- 172.21.15.117:0/4174173491 shutdown_connections 2024-04-12T09:23:42.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.611+0000 7fabc98ee640 1 -- 172.21.15.117:0/4174173491 wait complete. 2024-04-12T09:23:42.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.612+0000 7fabc98ee640 1 Processor -- start 2024-04-12T09:23:42.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.612+0000 7fabc98ee640 1 -- start start 2024-04-12T09:23:42.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.612+0000 7fabc98ee640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fabc41011a0 0x7fabc410ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:42.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.612+0000 7fabc98ee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabc4101b40 0x7fabc410e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:42.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.612+0000 7fabc98ee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc40664c0 con 0x7fabc4101b40 2024-04-12T09:23:42.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.612+0000 7fabc98ee640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc410e950 con 0x7fabc41011a0 2024-04-12T09:23:42.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.612+0000 7fabba7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabc4101b40 0x7fabc410e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:42.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.612+0000 7fabba7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabc4101b40 0x7fabc410e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35200/0 (socket says 172.21.15.117:35200) 2024-04-12T09:23:42.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.612+0000 7fabba7fc640 1 -- 172.21.15.117:0/2739726095 learned_addr learned my addr 172.21.15.117:0/2739726095 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:42.615 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.612+0000 7fabba7fc640 1 -- 172.21.15.117:0/2739726095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fabc41011a0 msgr2=0x7fabc410ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:42.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.612+0000 7fabba7fc640 1 --2- 172.21.15.117:0/2739726095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fabc41011a0 0x7fabc410ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:42.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.612+0000 7fabba7fc640 1 -- 172.21.15.117:0/2739726095 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb4005040 con 0x7fabc4101b40 2024-04-12T09:23:42.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.613+0000 7fabba7fc640 1 --2- 172.21.15.117:0/2739726095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabc4101b40 0x7fabc410e410 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fabac00c830 tx=0x7fabac004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:42.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.613+0000 7fabbbfff640 1 -- 172.21.15.117:0/2739726095 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabac00a850 con 0x7fabc4101b40 2024-04-12T09:23:42.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.613+0000 7fabc98ee640 1 -- 172.21.15.117:0/2739726095 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc410ec00 con 0x7fabc4101b40 2024-04-12T09:23:42.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.613+0000 7fabbbfff640 1 -- 172.21.15.117:0/2739726095 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fabac00ae80 con 0x7fabc4101b40 2024-04-12T09:23:42.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.613+0000 7fabbbfff640 1 -- 172.21.15.117:0/2739726095 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabac012ea0 con 0x7fabc4101b40 2024-04-12T09:23:42.616 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.613+0000 7fabc98ee640 1 -- 172.21.15.117:0/2739726095 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc4117190 con 0x7fabc4101b40 2024-04-12T09:23:42.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.614+0000 7fabc98ee640 1 -- 172.21.15.117:0/2739726095 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc40fc910 con 0x7fabc4101b40 2024-04-12T09:23:42.617 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.614+0000 7fabbbfff640 1 -- 172.21.15.117:0/2739726095 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fabac012400 con 0x7fabc4101b40 2024-04-12T09:23:42.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.615+0000 7fabbbfff640 1 --2- 172.21.15.117:0/2739726095 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fabb006dc10 0x7fabb00700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:42.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.615+0000 7fabc2ffd640 1 --2- 172.21.15.117:0/2739726095 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fabb006dc10 0x7fabb00700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:42.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.615+0000 7fabbbfff640 1 -- 172.21.15.117:0/2739726095 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fabac08d840 con 0x7fabc4101b40 2024-04-12T09:23:42.618 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.615+0000 7fabc2ffd640 1 --2- 172.21.15.117:0/2739726095 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fabb006dc10 0x7fabb00700c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fabb40043d0 tx=0x7fabb4009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:42.619 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.619+0000 7fabbbfff640 1 -- 172.21.15.117:0/2739726095 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fabac056df0 con 0x7fabc4101b40 2024-04-12T09:23:42.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.796+0000 7fabc98ee640 1 -- 172.21.15.117:0/2739726095 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabc404bcc0 con 0x7fabc4101b40 2024-04-12T09:23:42.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.798+0000 7fabbbfff640 1 -- 172.21.15.117:0/2739726095 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16854 (secure 0 0 0) 0x7fabac0126b0 con 0x7fabc4101b40 2024-04-12T09:23:42.798 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:42.799 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":83,"fsid":"12161984-f8ab-11ee-bc8c-c7b262605968","created":"2024-04-12T09:01:24.210047+0000","modified":"2024-04-12T09:21:27.299210+0000","last_up_change":"2024-04-12T09:20:19.524182+0000","last_in_change":"2024-04-12T09:06:33.833263+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T09:05:39.657213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-12T09:08:11.435513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-12T09:08:11.715605+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8bdd258-6f40-440f-b279-038d9b35e791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":1144390473},{"type":"v1","addr":"172.21.15.117:6803","nonce":1144390473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":1144390473},{"type":"v1","addr":"172.21.15.117:6805","nonce":1144390473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1144390473},{"type":"v1","addr":"172.21.15.117:6809","nonce":1144390473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":1144390473},{"type":"v1","addr":"172.21.15.117:6807","nonce":1144390473}]},"public_addr":"172.21.15.117:6803/1144390473","cluster_addr":"172.21.15.117:6805/1144390473","heartbeat_back_addr":"172.21.15.117:6809/1144390473","heartbeat_front_addr":"172.21.15.117:6807/1144390473","state":["exists","up"]},{"osd":1,"uuid":"ab723885-9e88-47ad-8e80-cb5871bf0d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2606394957},{"type":"v1","addr":"172.21.15.117:6811","nonce":2606394957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2606394957},{"type":"v1","addr":"172.21.15.117:6813","nonce":2606394957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2606394957},{"type":"v1","addr":"172.21.15.117:6817","nonce":2606394957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2606394957},{"type":"v1","addr":"172.21.15.117:6815","nonce":2606394957}]},"public_addr":"172.21.15.117:6811/2606394957","cluster_addr":"172.21.15.117:6813/2606394957","heartbeat_back_addr":"172.21.15.117:6817/2606394957","heartbeat_front_addr":"172.21.15.117:6815/2606394957","state":["exists","up"]},{"osd":2,"uuid":"14f76ed3-2938-45c1-9cc7-4c0486c602ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4153226618},{"type":"v1","addr":"172.21.15.117:6819","nonce":4153226618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4153226618},{"type":"v1","addr":"172.21.15.117:6821","nonce":4153226618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4153226618},{"type":"v1","addr":"172.21.15.117:6825","nonce":4153226618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4153226618},{"type":"v1","addr":"172.21.15.117:6823","nonce":4153226618}]},"public_addr":"172.21.15.117:6819/4153226618","cluster_addr":"172.21.15.117:6821/4153226618","heartbeat_back_addr":"172.21.15.117:6825/4153226618","heartbeat_front_addr":"172.21.15.117:6823/4153226618","state":["exists","up"]},{"osd":3,"uuid":"e2bd1672-4153-498a-a20b-838516b0876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1424266498},{"type":"v1","addr":"172.21.15.203:6801","nonce":1424266498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1424266498},{"type":"v1","addr":"172.21.15.203:6803","nonce":1424266498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1424266498},{"type":"v1","addr":"172.21.15.203:6807","nonce":1424266498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1424266498},{"type":"v1","addr":"172.21.15.203:6805","nonce":1424266498}]},"public_addr":"172.21.15.203:6801/1424266498","cluster_addr":"172.21.15.203:6803/1424266498","heartbeat_back_addr":"172.21.15.203:6807/1424266498","heartbeat_front_addr":"172.21.15.203:6805/1424266498","state":["exists","up"]},{"osd":4,"uuid":"e8e6b7b8-45c2-4186-aeef-9b2feccf9fe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":674159092},{"type":"v1","addr":"172.21.15.203:6809","nonce":674159092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":674159092},{"type":"v1","addr":"172.21.15.203:6811","nonce":674159092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":674159092},{"type":"v1","addr":"172.21.15.203:6815","nonce":674159092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":674159092},{"type":"v1","addr":"172.21.15.203:6813","nonce":674159092}]},"public_addr":"172.21.15.203:6809/674159092","cluster_addr":"172.21.15.203:6811/674159092","heartbeat_back_addr":"172.21.15.203:6815/674159092","heartbeat_front_addr":"172.21.15.203:6813/674159092","state":["exists","up"]},{"osd":5,"uuid":"abbad141-29e9-4028-9e29-293cc73169fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3403215254},{"type":"v1","addr":"172.21.15.203:6817","nonce":3403215254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":3403215254},{"type":"v1","addr":"172.21.15.203:6819","nonce":3403215254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3403215254},{"type":"v1","addr":"172.21.15.203:6823","nonce":3403215254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3403215254},{"type":"v1","addr":"172.21.15.203:6821","nonce":3403215254}]},"public_addr":"172.21.15.203:6817/3403215254","cluster_addr":"172.21.15.203:6819/3403215254","heartbeat_back_addr":"172.21.15.203:6823/3403215254","heartbeat_front_addr":"172.21.15.203:6821/3403215254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:04:41.240834+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:05:09.825336+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:05:37.699545+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:06:01.471956+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:06:25.743473+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:06:50.806872+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.203:6827/2731911290":"2024-04-13T09:21:27.299121+0000","172.21.15.203:6825/840607003":"2024-04-13T09:21:05.261605+0000","172.21.15.203:6824/840607003":"2024-04-13T09:21:05.261605+0000","172.21.15.117:0/4018826114":"2024-04-13T09:01:50.340337+0000","172.21.15.117:6800/2893585477":"2024-04-13T09:01:50.340337+0000","172.21.15.203:0/857573796":"2024-04-13T09:12:54.846397+0000","172.21.15.117:0/2084327023":"2024-04-13T09:10:44.739720+0000","172.21.15.203:0/117634547":"2024-04-13T09:12:54.846397+0000","172.21.15.117:0/3616310373":"2024-04-13T09:10:44.739720+0000","172.21.15.117:6801/3945342300":"2024-04-13T09:10:44.739720+0000","172.21.15.117:6800/3945342300":"2024-04-13T09:10:44.739720+0000","172.21.15.117:0/2514545829":"2024-04-13T09:03:31.333423+0000","172.21.15.203:0/2267178897":"2024-04-13T09:12:54.846397+0000","172.21.15.117:0/1161639266":"2024-04-13T09:15:54.541045+0000","172.21.15.117:6801/2893585477":"2024-04-13T09:01:50.340337+0000","172.21.15.117:6801/791370182":"2024-04-13T09:02:21.422544+0000","172.21.15.117:0/86407959":"2024-04-13T09:02:21.422544+0000","172.21.15.117:0/960981120":"2024-04-13T09:01:50.340337+0000","172.21.15.117:6828/2248590199":"2024-04-13T09:20:43.484776+0000","172.21.15.117:6829/2248590199":"2024-04-13T09:20:43.484776+0000","172.21.15.203:0/2976070431":"2024-04-13T09:12:54.846397+0000","172.21.15.117:0/801788487":"2024-04-13T09:10:44.739720+0000","172.21.15.117:0/2869338383":"2024-04-13T09:02:21.422544+0000","172.21.15.117:0/3452542055":"2024-04-13T09:15:54.541045+0000","172.21.15.117:0/3873562739":"2024-04-13T09:10:44.739720+0000","172.21.15.203:6829/2773660052":"2024-04-13T09:12:54.846397+0000","172.21.15.117:0/1603484270":"2024-04-13T09:15:54.541045+0000","172.21.15.117:6827/1717609783":"2024-04-13T09:08:27.549563+0000","172.21.15.117:0/2305921992":"2024-04-13T09:01:50.340337+0000","172.21.15.203:6828/2773660052":"2024-04-13T09:12:54.846397+0000","172.21.15.117:0/4061615302":"2024-04-13T09:03:31.333423+0000","172.21.15.117:6800/791370182":"2024-04-13T09:02:21.422544+0000","172.21.15.117:0/448067539":"2024-04-13T09:03:31.333423+0000","172.21.15.203:6826/2731911290":"2024-04-13T09:21:27.299121+0000","172.21.15.117:0/2635780056":"2024-04-13T09:02:21.422544+0000","172.21.15.117:6801/790148838":"2024-04-13T09:03:31.333423+0000","172.21.15.117:6826/1717609783":"2024-04-13T09:08:27.549563+0000","172.21.15.117:0/2884121108":"2024-04-13T09:15:54.541045+0000","172.21.15.117:6800/790148838":"2024-04-13T09:03:31.333423+0000","172.21.15.117:6800/1056729457":"2024-04-13T09:15:54.541045+0000","172.21.15.117:6801/1056729457":"2024-04-13T09:15:54.541045+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T09:23:42.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.800+0000 7fabc98ee640 1 -- 172.21.15.117:0/2739726095 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fabb006dc10 msgr2=0x7fabb00700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:42.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.800+0000 7fabc98ee640 1 --2- 172.21.15.117:0/2739726095 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fabb006dc10 0x7fabb00700c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fabb40043d0 tx=0x7fabb4009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.800+0000 7fabc98ee640 1 -- 172.21.15.117:0/2739726095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabc4101b40 msgr2=0x7fabc410e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.800+0000 7fabc98ee640 1 --2- 172.21.15.117:0/2739726095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabc4101b40 0x7fabc410e410 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fabac00c830 tx=0x7fabac004430 comp rx=0 tx=0).stop 2024-04-12T09:23:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.800+0000 7fabc98ee640 1 -- 172.21.15.117:0/2739726095 shutdown_connections 2024-04-12T09:23:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.800+0000 7fabc98ee640 1 --2- 172.21.15.117:0/2739726095 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fabb006dc10 0x7fabb00700c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.800+0000 7fabc98ee640 1 --2- 172.21.15.117:0/2739726095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabc4101b40 0x7fabc410e410 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.800+0000 7fabc98ee640 1 --2- 172.21.15.117:0/2739726095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fabc41011a0 0x7fabc410ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.800+0000 7fabc98ee640 1 -- 172.21.15.117:0/2739726095 >> 172.21.15.117:0/2739726095 conn(0x7fabc40f6d70 msgr2=0x7fabc4105730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.800+0000 7fabc98ee640 1 -- 172.21.15.117:0/2739726095 shutdown_connections 2024-04-12T09:23:42.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.800+0000 7fabc98ee640 1 -- 172.21.15.117:0/2739726095 wait complete. 2024-04-12T09:23:42.811 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-12T09:05:39.657213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-12T09:08:11.435513+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-12T09:08:11.715605+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-12T09:23:42.812 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-12T09:23:42.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.911+0000 7fc44b59e640 1 -- 172.21.15.117:0/4131255864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc44c100f90 msgr2=0x7fc44c101360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:42.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.911+0000 7fc44b59e640 1 --2- 172.21.15.117:0/4131255864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc44c100f90 0x7fc44c101360 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc43c0048d0 tx=0x7fc43c009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:42.914 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.912+0000 7fc44b59e640 1 -- 172.21.15.117:0/4131255864 shutdown_connections 2024-04-12T09:23:42.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.912+0000 7fc44b59e640 1 --2- 172.21.15.117:0/4131255864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc44c101930 0x7fc44c0fafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:42.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.912+0000 7fc44b59e640 1 --2- 172.21.15.117:0/4131255864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc44c100f90 0x7fc44c101360 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:42.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.912+0000 7fc44b59e640 1 -- 172.21.15.117:0/4131255864 >> 172.21.15.117:0/4131255864 conn(0x7fc44c0f6b40 msgr2=0x7fc44c0f8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:42.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.912+0000 7fc44b59e640 1 -- 172.21.15.117:0/4131255864 shutdown_connections 2024-04-12T09:23:42.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.912+0000 7fc44b59e640 1 -- 172.21.15.117:0/4131255864 wait complete. 2024-04-12T09:23:42.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.912+0000 7fc44b59e640 1 Processor -- start 2024-04-12T09:23:42.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.912+0000 7fc44b59e640 1 -- start start 2024-04-12T09:23:42.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.912+0000 7fc44b59e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc44c100f90 0x7fc44c112ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:42.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.912+0000 7fc44b59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc44c101930 0x7fc44c113010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:42.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.912+0000 7fc44b59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c113610 con 0x7fc44c101930 2024-04-12T09:23:42.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.912+0000 7fc44b59e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44c10cc60 con 0x7fc44c100f90 2024-04-12T09:23:42.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.912+0000 7fc449d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc44c101930 0x7fc44c113010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:42.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.913+0000 7fc449d9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc44c101930 0x7fc44c113010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35212/0 (socket says 172.21.15.117:35212) 2024-04-12T09:23:42.915 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.913+0000 7fc449d9b640 1 -- 172.21.15.117:0/2819425761 learned_addr learned my addr 172.21.15.117:0/2819425761 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:42.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.913+0000 7fc44a59c640 1 --2- 172.21.15.117:0/2819425761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc44c100f90 0x7fc44c112ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:42.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.913+0000 7fc449d9b640 1 -- 172.21.15.117:0/2819425761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc44c100f90 msgr2=0x7fc44c112ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:42.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.913+0000 7fc449d9b640 1 --2- 172.21.15.117:0/2819425761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc44c100f90 0x7fc44c112ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:42.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.913+0000 7fc449d9b640 1 -- 172.21.15.117:0/2819425761 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c005040 con 0x7fc44c101930 2024-04-12T09:23:42.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.913+0000 7fc449d9b640 1 --2- 172.21.15.117:0/2819425761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc44c101930 0x7fc44c113010 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc440002a50 tx=0x7fc440004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:42.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.913+0000 7fc43affd640 1 -- 172.21.15.117:0/2819425761 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc440007c30 con 0x7fc44c101930 2024-04-12T09:23:42.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.913+0000 7fc43affd640 1 -- 172.21.15.117:0/2819425761 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc44000f040 con 0x7fc44c101930 2024-04-12T09:23:42.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.913+0000 7fc44b59e640 1 -- 172.21.15.117:0/2819425761 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc44c10cf40 con 0x7fc44c101930 2024-04-12T09:23:42.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.913+0000 7fc43affd640 1 -- 172.21.15.117:0/2819425761 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc44000dbe0 con 0x7fc44c101930 2024-04-12T09:23:42.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.913+0000 7fc44b59e640 1 -- 172.21.15.117:0/2819425761 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc44c10d460 con 0x7fc44c101930 2024-04-12T09:23:42.916 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.914+0000 7fc44b59e640 1 -- 172.21.15.117:0/2819425761 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc44c0fc700 con 0x7fc44c101930 2024-04-12T09:23:42.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.914+0000 7fc43affd640 1 -- 172.21.15.117:0/2819425761 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fc44000dd40 con 0x7fc44c101930 2024-04-12T09:23:42.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.915+0000 7fc43affd640 1 --2- 172.21.15.117:0/2819425761 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc43406dc10 0x7fc4340700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:42.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.915+0000 7fc43affd640 1 -- 172.21.15.117:0/2819425761 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fc44008d520 con 0x7fc44c101930 2024-04-12T09:23:42.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.915+0000 7fc44a59c640 1 --2- 172.21.15.117:0/2819425761 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc43406dc10 0x7fc4340700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:42.917 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.915+0000 7fc44a59c640 1 --2- 172.21.15.117:0/2819425761 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc43406dc10 0x7fc4340700c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc43c003080 tx=0x7fc43c009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:42.920 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:42.919+0000 7fc43affd640 1 -- 172.21.15.117:0/2819425761 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc440056a50 con 0x7fc44c101930 2024-04-12T09:23:43.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:42 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/3438127608' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:23:43.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.092+0000 7fc44b59e640 1 -- 172.21.15.117:0/2819425761 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc44c1091d0 con 0x7fc44c101930 2024-04-12T09:23:43.092 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.092+0000 7fc43affd640 1 -- 172.21.15.117:0/2819425761 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc44005a110 con 0x7fc44c101930 2024-04-12T09:23:43.093 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 1 2024-04-12T09:23:43.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.094+0000 7fc44b59e640 1 -- 172.21.15.117:0/2819425761 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc43406dc10 msgr2=0x7fc4340700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:43.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.094+0000 7fc44b59e640 1 --2- 172.21.15.117:0/2819425761 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc43406dc10 0x7fc4340700c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc43c003080 tx=0x7fc43c009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:43.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.094+0000 7fc44b59e640 1 -- 172.21.15.117:0/2819425761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc44c101930 msgr2=0x7fc44c113010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:43.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.094+0000 7fc44b59e640 1 --2- 172.21.15.117:0/2819425761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc44c101930 0x7fc44c113010 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc440002a50 tx=0x7fc440004600 comp rx=0 tx=0).stop 2024-04-12T09:23:43.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.094+0000 7fc44b59e640 1 -- 172.21.15.117:0/2819425761 shutdown_connections 2024-04-12T09:23:43.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.094+0000 7fc44b59e640 1 --2- 172.21.15.117:0/2819425761 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc43406dc10 0x7fc4340700c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:43.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.094+0000 7fc44b59e640 1 --2- 172.21.15.117:0/2819425761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc44c101930 0x7fc44c113010 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:43.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.094+0000 7fc44b59e640 1 --2- 172.21.15.117:0/2819425761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc44c100f90 0x7fc44c112ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:43.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.094+0000 7fc44b59e640 1 -- 172.21.15.117:0/2819425761 >> 172.21.15.117:0/2819425761 conn(0x7fc44c0f6b40 msgr2=0x7fc44c105540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:43.095 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.094+0000 7fc44b59e640 1 -- 172.21.15.117:0/2819425761 shutdown_connections 2024-04-12T09:23:43.096 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.094+0000 7fc44b59e640 1 -- 172.21.15.117:0/2819425761 wait complete. 2024-04-12T09:23:43.104 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:42 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/3438127608' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-12T09:23:43.105 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-12T09:23:43.208 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.205+0000 7f3fcf0ee640 1 -- 172.21.15.117:0/763483166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fc81023e0 msgr2=0x7f3fc81027b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:43.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.205+0000 7f3fcf0ee640 1 --2- 172.21.15.117:0/763483166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fc81023e0 0x7f3fc81027b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc0048d0 tx=0x7f3fbc009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:43.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.205+0000 7f3fcf0ee640 1 -- 172.21.15.117:0/763483166 shutdown_connections 2024-04-12T09:23:43.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.205+0000 7f3fcf0ee640 1 --2- 172.21.15.117:0/763483166 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3fc8102d80 0x7f3fc80fc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:43.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.205+0000 7f3fcf0ee640 1 --2- 172.21.15.117:0/763483166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fc81023e0 0x7f3fc81027b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:43.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.205+0000 7f3fcf0ee640 1 -- 172.21.15.117:0/763483166 >> 172.21.15.117:0/763483166 conn(0x7f3fc80f7fb0 msgr2=0x7f3fc80fa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:43.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.205+0000 7f3fcf0ee640 1 -- 172.21.15.117:0/763483166 shutdown_connections 2024-04-12T09:23:43.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.205+0000 7f3fcf0ee640 1 -- 172.21.15.117:0/763483166 wait complete. 2024-04-12T09:23:43.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.205+0000 7f3fcf0ee640 1 Processor -- start 2024-04-12T09:23:43.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.206+0000 7f3fcf0ee640 1 -- start start 2024-04-12T09:23:43.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.206+0000 7f3fcf0ee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fc81023e0 0x7f3fc8112f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:43.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.206+0000 7f3fcf0ee640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3fc8102d80 0x7f3fc81134a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:43.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.206+0000 7f3fcf0ee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc8113b30 con 0x7f3fc81023e0 2024-04-12T09:23:43.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.206+0000 7f3fcf0ee640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc810d0f0 con 0x7f3fc8102d80 2024-04-12T09:23:43.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.206+0000 7f3fcce8a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fc81023e0 0x7f3fc8112f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:43.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.206+0000 7f3fcce8a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fc81023e0 0x7f3fc8112f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35222/0 (socket says 172.21.15.117:35222) 2024-04-12T09:23:43.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.206+0000 7f3fcce8a640 1 -- 172.21.15.117:0/2069987804 learned_addr learned my addr 172.21.15.117:0/2069987804 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:43.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.206+0000 7f3fcce8a640 1 -- 172.21.15.117:0/2069987804 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3fc8102d80 msgr2=0x7f3fc81134a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:43.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.206+0000 7f3fcce8a640 1 --2- 172.21.15.117:0/2069987804 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3fc8102d80 0x7f3fc81134a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:43.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.206+0000 7f3fcce8a640 1 -- 172.21.15.117:0/2069987804 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fbc005040 con 0x7f3fc81023e0 2024-04-12T09:23:43.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.206+0000 7f3fcce8a640 1 --2- 172.21.15.117:0/2069987804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fc81023e0 0x7f3fc8112f60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc004930 tx=0x7f3fbc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:43.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.207+0000 7f3fc57fa640 1 -- 172.21.15.117:0/2069987804 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fbc0094c0 con 0x7f3fc81023e0 2024-04-12T09:23:43.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.207+0000 7f3fcf0ee640 1 -- 172.21.15.117:0/2069987804 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc810d370 con 0x7f3fc81023e0 2024-04-12T09:23:43.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.207+0000 7f3fc57fa640 1 -- 172.21.15.117:0/2069987804 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3fbc032e50 con 0x7f3fc81023e0 2024-04-12T09:23:43.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.207+0000 7f3fc57fa640 1 -- 172.21.15.117:0/2069987804 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fbc0433b0 con 0x7f3fc81023e0 2024-04-12T09:23:43.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.207+0000 7f3fcf0ee640 1 -- 172.21.15.117:0/2069987804 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc810d830 con 0x7f3fc81023e0 2024-04-12T09:23:43.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.208+0000 7f3fcf0ee640 1 -- 172.21.15.117:0/2069987804 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc80fdb50 con 0x7f3fc81023e0 2024-04-12T09:23:43.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.208+0000 7f3fc57fa640 1 -- 172.21.15.117:0/2069987804 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f3fbc02f070 con 0x7f3fc81023e0 2024-04-12T09:23:43.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.209+0000 7f3fc57fa640 1 --2- 172.21.15.117:0/2069987804 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f3fb806dc10 0x7f3fb80700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:43.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.209+0000 7f3fc7fff640 1 --2- 172.21.15.117:0/2069987804 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f3fb806dc10 0x7f3fb80700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:43.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.209+0000 7f3fc57fa640 1 -- 172.21.15.117:0/2069987804 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f3fbc0af590 con 0x7f3fc81023e0 2024-04-12T09:23:43.211 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.209+0000 7f3fc7fff640 1 --2- 172.21.15.117:0/2069987804 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f3fb806dc10 0x7f3fb80700c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3fc810e820 tx=0x7f3fb4006d20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:43.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.213+0000 7f3fc57fa640 1 -- 172.21.15.117:0/2069987804 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f3fbc078ac0 con 0x7f3fc81023e0 2024-04-12T09:23:43.388 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.388+0000 7f3fcf0ee640 1 -- 172.21.15.117:0/2069987804 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f3fc8109630 con 0x7f3fc81023e0 2024-04-12T09:23:43.389 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.388+0000 7f3fc57fa640 1 -- 172.21.15.117:0/2069987804 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7f3fbc07c180 con 0x7f3fc81023e0 2024-04-12T09:23:43.389 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 32 2024-04-12T09:23:43.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.390+0000 7f3fcf0ee640 1 -- 172.21.15.117:0/2069987804 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f3fb806dc10 msgr2=0x7f3fb80700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:43.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.390+0000 7f3fcf0ee640 1 --2- 172.21.15.117:0/2069987804 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f3fb806dc10 0x7f3fb80700c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3fc810e820 tx=0x7f3fb4006d20 comp rx=0 tx=0).stop 2024-04-12T09:23:43.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.390+0000 7f3fcf0ee640 1 -- 172.21.15.117:0/2069987804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fc81023e0 msgr2=0x7f3fc8112f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:43.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.390+0000 7f3fcf0ee640 1 --2- 172.21.15.117:0/2069987804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fc81023e0 0x7f3fc8112f60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc004930 tx=0x7f3fbc009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:43.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.390+0000 7f3fcf0ee640 1 -- 172.21.15.117:0/2069987804 shutdown_connections 2024-04-12T09:23:43.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.390+0000 7f3fcf0ee640 1 --2- 172.21.15.117:0/2069987804 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f3fb806dc10 0x7f3fb80700c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:43.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.390+0000 7f3fcf0ee640 1 --2- 172.21.15.117:0/2069987804 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3fc8102d80 0x7f3fc81134a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:43.391 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.390+0000 7f3fcf0ee640 1 --2- 172.21.15.117:0/2069987804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3fc81023e0 0x7f3fc8112f60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:43.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.390+0000 7f3fcf0ee640 1 -- 172.21.15.117:0/2069987804 >> 172.21.15.117:0/2069987804 conn(0x7f3fc80f7fb0 msgr2=0x7f3fc80f8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:43.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.390+0000 7f3fcf0ee640 1 -- 172.21.15.117:0/2069987804 shutdown_connections 2024-04-12T09:23:43.392 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.390+0000 7f3fcf0ee640 1 -- 172.21.15.117:0/2069987804 wait complete. 2024-04-12T09:23:43.401 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-12T09:23:43.503 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.501+0000 7f83fe59d640 1 -- 172.21.15.117:0/1422855323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83f8102050 msgr2=0x7f83f8102420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:43.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.501+0000 7f83fe59d640 1 --2- 172.21.15.117:0/1422855323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83f8102050 0x7f83f8102420 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f83f40048d0 tx=0x7f83f4009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:43.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.501+0000 7f83fe59d640 1 -- 172.21.15.117:0/1422855323 shutdown_connections 2024-04-12T09:23:43.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.501+0000 7f83fe59d640 1 --2- 172.21.15.117:0/1422855323 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83f81029f0 0x7f83f80fc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:43.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.501+0000 7f83fe59d640 1 --2- 172.21.15.117:0/1422855323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83f8102050 0x7f83f8102420 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:43.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.501+0000 7f83fe59d640 1 -- 172.21.15.117:0/1422855323 >> 172.21.15.117:0/1422855323 conn(0x7f83f80f7be0 msgr2=0x7f83f80f9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:43.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.501+0000 7f83fe59d640 1 -- 172.21.15.117:0/1422855323 shutdown_connections 2024-04-12T09:23:43.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.501+0000 7f83fe59d640 1 -- 172.21.15.117:0/1422855323 wait complete. 2024-04-12T09:23:43.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.502+0000 7f83fe59d640 1 Processor -- start 2024-04-12T09:23:43.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.502+0000 7f83fe59d640 1 -- start start 2024-04-12T09:23:43.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.502+0000 7f83fe59d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83f8102050 0x7f83f806f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:43.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.502+0000 7f83fe59d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83f81029f0 0x7f83f806fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:43.504 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.502+0000 7f83fe59d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f8071660 con 0x7f83f8102050 2024-04-12T09:23:43.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.502+0000 7f83fe59d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f80717d0 con 0x7f83f81029f0 2024-04-12T09:23:43.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.502+0000 7f83fd59b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83f8102050 0x7f83f806f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:43.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.502+0000 7f83fd59b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83f8102050 0x7f83f806f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35242/0 (socket says 172.21.15.117:35242) 2024-04-12T09:23:43.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.502+0000 7f83fd59b640 1 -- 172.21.15.117:0/3184924019 learned_addr learned my addr 172.21.15.117:0/3184924019 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:43.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.502+0000 7f83fcd9a640 1 --2- 172.21.15.117:0/3184924019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83f81029f0 0x7f83f806fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:43.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.502+0000 7f83fd59b640 1 -- 172.21.15.117:0/3184924019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83f81029f0 msgr2=0x7f83f806fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:43.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.502+0000 7f83fd59b640 1 --2- 172.21.15.117:0/3184924019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83f81029f0 0x7f83f806fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:43.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.502+0000 7f83fd59b640 1 -- 172.21.15.117:0/3184924019 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f4005040 con 0x7f83f8102050 2024-04-12T09:23:43.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.502+0000 7f83fcd9a640 1 --2- 172.21.15.117:0/3184924019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83f81029f0 0x7f83f806fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T09:23:43.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.503+0000 7f83fd59b640 1 --2- 172.21.15.117:0/3184924019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83f8102050 0x7f83f806f7d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f83f4004930 tx=0x7f83f4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:43.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.503+0000 7f83edffb640 1 -- 172.21.15.117:0/3184924019 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83f40094c0 con 0x7f83f8102050 2024-04-12T09:23:43.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.503+0000 7f83edffb640 1 -- 172.21.15.117:0/3184924019 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f83f4032e50 con 0x7f83f8102050 2024-04-12T09:23:43.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.503+0000 7f83edffb640 1 -- 172.21.15.117:0/3184924019 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83f40433b0 con 0x7f83f8102050 2024-04-12T09:23:43.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.503+0000 7f83fe59d640 1 -- 172.21.15.117:0/3184924019 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f8070390 con 0x7f83f8102050 2024-04-12T09:23:43.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.503+0000 7f83fe59d640 1 -- 172.21.15.117:0/3184924019 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f8119290 con 0x7f83f8102050 2024-04-12T09:23:43.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.504+0000 7f83fe59d640 1 -- 172.21.15.117:0/3184924019 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f80fd7c0 con 0x7f83f8102050 2024-04-12T09:23:43.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.504+0000 7f83edffb640 1 -- 172.21.15.117:0/3184924019 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f83f402f070 con 0x7f83f8102050 2024-04-12T09:23:43.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.505+0000 7f83edffb640 1 --2- 172.21.15.117:0/3184924019 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f83e406dc10 0x7f83e40700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:43.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.505+0000 7f83edffb640 1 -- 172.21.15.117:0/3184924019 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f83f40af3d0 con 0x7f83f8102050 2024-04-12T09:23:43.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.505+0000 7f83fcd9a640 1 --2- 172.21.15.117:0/3184924019 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f83e406dc10 0x7f83e40700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:43.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.505+0000 7f83fcd9a640 1 --2- 172.21.15.117:0/3184924019 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f83e406dc10 0x7f83e40700c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f83f8070eb0 tx=0x7f83e800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:43.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.510+0000 7f83edffb640 1 -- 172.21.15.117:0/3184924019 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f83f4078900 con 0x7f83f8102050 2024-04-12T09:23:43.685 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.685+0000 7f83fe59d640 1 -- 172.21.15.117:0/3184924019 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f83f804bcc0 con 0x7f83f8102050 2024-04-12T09:23:43.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.685+0000 7f83edffb640 1 -- 172.21.15.117:0/3184924019 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7f83f407bfc0 con 0x7f83f8102050 2024-04-12T09:23:43.686 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 32 2024-04-12T09:23:43.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.687+0000 7f83fe59d640 1 -- 172.21.15.117:0/3184924019 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f83e406dc10 msgr2=0x7f83e40700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:43.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.687+0000 7f83fe59d640 1 --2- 172.21.15.117:0/3184924019 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f83e406dc10 0x7f83e40700c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f83f8070eb0 tx=0x7f83e800b040 comp rx=0 tx=0).stop 2024-04-12T09:23:43.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.687+0000 7f83fe59d640 1 -- 172.21.15.117:0/3184924019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83f8102050 msgr2=0x7f83f806f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:43.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.687+0000 7f83fe59d640 1 --2- 172.21.15.117:0/3184924019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83f8102050 0x7f83f806f7d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f83f4004930 tx=0x7f83f4009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:43.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.687+0000 7f83fe59d640 1 -- 172.21.15.117:0/3184924019 shutdown_connections 2024-04-12T09:23:43.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.687+0000 7f83fe59d640 1 --2- 172.21.15.117:0/3184924019 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f83e406dc10 0x7f83e40700c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:43.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.687+0000 7f83fe59d640 1 --2- 172.21.15.117:0/3184924019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83f81029f0 0x7f83f806fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:43.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.687+0000 7f83fe59d640 1 --2- 172.21.15.117:0/3184924019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83f8102050 0x7f83f806f7d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:43.688 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.687+0000 7f83fe59d640 1 -- 172.21.15.117:0/3184924019 >> 172.21.15.117:0/3184924019 conn(0x7f83f80f7be0 msgr2=0x7f83f80f8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:43.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.687+0000 7f83fe59d640 1 -- 172.21.15.117:0/3184924019 shutdown_connections 2024-04-12T09:23:43.689 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.687+0000 7f83fe59d640 1 -- 172.21.15.117:0/3184924019 wait complete. 2024-04-12T09:23:43.699 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-12T09:23:43.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.796+0000 7fd9415ff640 1 -- 172.21.15.117:0/3177130767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd93c102a00 msgr2=0x7fd93c0fc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:43.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.796+0000 7fd9415ff640 1 --2- 172.21.15.117:0/3177130767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd93c102a00 0x7fd93c0fc090 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd9300048d0 tx=0x7fd930009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:43.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.796+0000 7fd9415ff640 1 -- 172.21.15.117:0/3177130767 shutdown_connections 2024-04-12T09:23:43.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.796+0000 7fd9415ff640 1 --2- 172.21.15.117:0/3177130767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd93c102a00 0x7fd93c0fc090 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:43.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.796+0000 7fd9415ff640 1 --2- 172.21.15.117:0/3177130767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd93c102060 0x7fd93c102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:43.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.796+0000 7fd9415ff640 1 -- 172.21.15.117:0/3177130767 >> 172.21.15.117:0/3177130767 conn(0x7fd93c0f7c10 msgr2=0x7fd93c0fa020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:43.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.796+0000 7fd9415ff640 1 -- 172.21.15.117:0/3177130767 shutdown_connections 2024-04-12T09:23:43.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.796+0000 7fd9415ff640 1 -- 172.21.15.117:0/3177130767 wait complete. 2024-04-12T09:23:43.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.797+0000 7fd9415ff640 1 Processor -- start 2024-04-12T09:23:43.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.797+0000 7fd9415ff640 1 -- start start 2024-04-12T09:23:43.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.797+0000 7fd9415ff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd93c102060 0x7fd93c112bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:43.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.797+0000 7fd9415ff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd93c102a00 0x7fd93c113100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:43.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.797+0000 7fd9415ff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c113700 con 0x7fd93c102060 2024-04-12T09:23:43.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.797+0000 7fd9415ff640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c10cd50 con 0x7fd93c102a00 2024-04-12T09:23:43.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.797+0000 7fd93affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd93c102060 0x7fd93c112bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:43.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.797+0000 7fd93affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd93c102060 0x7fd93c112bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35250/0 (socket says 172.21.15.117:35250) 2024-04-12T09:23:43.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.797+0000 7fd93affd640 1 -- 172.21.15.117:0/2789011788 learned_addr learned my addr 172.21.15.117:0/2789011788 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:43.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.797+0000 7fd93affd640 1 -- 172.21.15.117:0/2789011788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd93c102a00 msgr2=0x7fd93c113100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:43.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.797+0000 7fd93a7fc640 1 --2- 172.21.15.117:0/2789011788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd93c102a00 0x7fd93c113100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:43.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.798+0000 7fd93affd640 1 --2- 172.21.15.117:0/2789011788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd93c102a00 0x7fd93c113100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:43.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.798+0000 7fd93affd640 1 -- 172.21.15.117:0/2789011788 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd930005040 con 0x7fd93c102060 2024-04-12T09:23:43.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.798+0000 7fd93affd640 1 --2- 172.21.15.117:0/2789011788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd93c102060 0x7fd93c112bc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00cae0 tx=0x7fd92c007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:43.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.798+0000 7fd9237fe640 1 -- 172.21.15.117:0/2789011788 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd92c00ab00 con 0x7fd93c102060 2024-04-12T09:23:43.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.798+0000 7fd9415ff640 1 -- 172.21.15.117:0/2789011788 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd93c10d030 con 0x7fd93c102060 2024-04-12T09:23:43.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.798+0000 7fd9237fe640 1 -- 172.21.15.117:0/2789011788 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd92c00ac60 con 0x7fd93c102060 2024-04-12T09:23:43.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.798+0000 7fd9237fe640 1 -- 172.21.15.117:0/2789011788 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd92c0116f0 con 0x7fd93c102060 2024-04-12T09:23:43.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.798+0000 7fd9415ff640 1 -- 172.21.15.117:0/2789011788 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd93c10d550 con 0x7fd93c102060 2024-04-12T09:23:43.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.799+0000 7fd9415ff640 1 -- 172.21.15.117:0/2789011788 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd93c0fd7d0 con 0x7fd93c102060 2024-04-12T09:23:43.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.799+0000 7fd9237fe640 1 -- 172.21.15.117:0/2789011788 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fd92c012440 con 0x7fd93c102060 2024-04-12T09:23:43.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.800+0000 7fd9237fe640 1 --2- 172.21.15.117:0/2789011788 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fd92406dc10 0x7fd9240700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:43.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.800+0000 7fd9237fe640 1 -- 172.21.15.117:0/2789011788 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fd92c08ded0 con 0x7fd93c102060 2024-04-12T09:23:43.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.800+0000 7fd93a7fc640 1 --2- 172.21.15.117:0/2789011788 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fd92406dc10 0x7fd9240700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:43.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.800+0000 7fd93a7fc640 1 --2- 172.21.15.117:0/2789011788 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fd92406dc10 0x7fd9240700c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd930000c00 tx=0x7fd930009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:43.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:43.805+0000 7fd9237fe640 1 -- 172.21.15.117:0/2789011788 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fd92c057400 con 0x7fd93c102060 2024-04-12T09:23:44.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.015+0000 7fd9415ff640 1 -- 172.21.15.117:0/2789011788 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd93c04bcc0 con 0x7fd93c102060 2024-04-12T09:23:44.016 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.015+0000 7fd9237fe640 1 -- 172.21.15.117:0/2789011788 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+5216 (secure 0 0 0) 0x7fd93c04bcc0 con 0x7fd93c102060 2024-04-12T09:23:44.016 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:44.016 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi117.eslmxh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6829/2675574893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":2675574893},{"type":"v1","addr":"172.21.15.117:6829","nonce":2675574893}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44311,"name":"cephfs.smithi203.fbeixl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6825/3346773589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3346773589},{"type":"v1","addr":"172.21.15.203:6825","nonce":3346773589}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44327,"name":"cephfs.smithi203.bszhxz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6827/240713176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":240713176},{"type":"v1","addr":"172.21.15.203:6827","nonce":240713176}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T09:08:12.488144+0000","modified":"2024-04-12T09:21:46.703814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34372":{"gid":34372,"name":"cephfs.smithi117.wddsgt","rank":0,"incarnation":28,"state":"up:active","state_seq":20,"addr":"172.21.15.117:6827/2687704577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":2687704577},{"type":"v1","addr":"172.21.15.117:6827","nonce":2687704577}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34372,"qdb_cluster":[34372]},"id":1}]} 2024-04-12T09:23:44.016 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 32 2024-04-12T09:23:44.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.017+0000 7fd9415ff640 1 -- 172.21.15.117:0/2789011788 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fd92406dc10 msgr2=0x7fd9240700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:44.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.017+0000 7fd9415ff640 1 --2- 172.21.15.117:0/2789011788 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fd92406dc10 0x7fd9240700c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd930000c00 tx=0x7fd930009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.018+0000 7fd9415ff640 1 -- 172.21.15.117:0/2789011788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd93c102060 msgr2=0x7fd93c112bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:44.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.018+0000 7fd9415ff640 1 --2- 172.21.15.117:0/2789011788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd93c102060 0x7fd93c112bc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00cae0 tx=0x7fd92c007e50 comp rx=0 tx=0).stop 2024-04-12T09:23:44.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.018+0000 7fd9415ff640 1 -- 172.21.15.117:0/2789011788 shutdown_connections 2024-04-12T09:23:44.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.018+0000 7fd9415ff640 1 --2- 172.21.15.117:0/2789011788 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fd92406dc10 0x7fd9240700c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.018+0000 7fd9415ff640 1 --2- 172.21.15.117:0/2789011788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd93c102a00 0x7fd93c113100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.018+0000 7fd9415ff640 1 --2- 172.21.15.117:0/2789011788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd93c102060 0x7fd93c112bc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.018+0000 7fd9415ff640 1 -- 172.21.15.117:0/2789011788 >> 172.21.15.117:0/2789011788 conn(0x7fd93c0f7c10 msgr2=0x7fd93c0f8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:44.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.018+0000 7fd9415ff640 1 -- 172.21.15.117:0/2789011788 shutdown_connections 2024-04-12T09:23:44.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.018+0000 7fd9415ff640 1 -- 172.21.15.117:0/2789011788 wait complete. 2024-04-12T09:23:44.028 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:43 smithi117 ceph-mon[113571]: pgmap v271: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:44.028 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:43 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/2739726095' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T09:23:44.028 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:43 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/2819425761' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-12T09:23:44.028 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:43 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/2069987804' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-12T09:23:44.028 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:43 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/3184924019' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-12T09:23:44.029 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 14, 'max_mds': 1, 'flags': 18} 2024-04-12T09:23:44.029 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 15 2024-04-12T09:23:44.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:43 smithi203 ceph-mon[86783]: pgmap v271: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:44.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:43 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/2739726095' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T09:23:44.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:43 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/2819425761' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-12T09:23:44.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:43 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/2069987804' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-12T09:23:44.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:43 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/3184924019' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-12T09:23:44.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.126+0000 7f302a0ee640 1 -- 172.21.15.117:0/2033148624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30241023d0 msgr2=0x7f30241027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:44.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.126+0000 7f302a0ee640 1 --2- 172.21.15.117:0/2033148624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30241023d0 0x7f30241027a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f30180048d0 tx=0x7f3018009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.127+0000 7f302a0ee640 1 -- 172.21.15.117:0/2033148624 shutdown_connections 2024-04-12T09:23:44.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.127+0000 7f302a0ee640 1 --2- 172.21.15.117:0/2033148624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3024102d70 0x7f30240fc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.127+0000 7f302a0ee640 1 --2- 172.21.15.117:0/2033148624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30241023d0 0x7f30241027a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.127+0000 7f302a0ee640 1 -- 172.21.15.117:0/2033148624 >> 172.21.15.117:0/2033148624 conn(0x7f30240f7fe0 msgr2=0x7f30240fa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:44.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.127+0000 7f302a0ee640 1 -- 172.21.15.117:0/2033148624 shutdown_connections 2024-04-12T09:23:44.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.127+0000 7f302a0ee640 1 -- 172.21.15.117:0/2033148624 wait complete. 2024-04-12T09:23:44.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.127+0000 7f302a0ee640 1 Processor -- start 2024-04-12T09:23:44.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.127+0000 7f302a0ee640 1 -- start start 2024-04-12T09:23:44.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.127+0000 7f302a0ee640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f30241023d0 0x7f3024112ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:44.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.127+0000 7f302a0ee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3024102d70 0x7f3024113400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:44.130 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.127+0000 7f302a0ee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3024113a00 con 0x7f3024102d70 2024-04-12T09:23:44.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.127+0000 7f302a0ee640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302410d050 con 0x7f30241023d0 2024-04-12T09:23:44.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.127+0000 7f3022ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3024102d70 0x7f3024113400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:44.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.128+0000 7f3022ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3024102d70 0x7f3024113400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35254/0 (socket says 172.21.15.117:35254) 2024-04-12T09:23:44.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.128+0000 7f3022ffd640 1 -- 172.21.15.117:0/3809267992 learned_addr learned my addr 172.21.15.117:0/3809267992 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:44.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.128+0000 7f30237fe640 1 --2- 172.21.15.117:0/3809267992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f30241023d0 0x7f3024112ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:44.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.128+0000 7f3022ffd640 1 -- 172.21.15.117:0/3809267992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f30241023d0 msgr2=0x7f3024112ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:44.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.128+0000 7f3022ffd640 1 --2- 172.21.15.117:0/3809267992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f30241023d0 0x7f3024112ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.128+0000 7f3022ffd640 1 -- 172.21.15.117:0/3809267992 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3018005040 con 0x7f3024102d70 2024-04-12T09:23:44.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.128+0000 7f30237fe640 1 --2- 172.21.15.117:0/3809267992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f30241023d0 0x7f3024112ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T09:23:44.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.128+0000 7f3022ffd640 1 --2- 172.21.15.117:0/3809267992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3024102d70 0x7f3024113400 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f301400c810 tx=0x7f30140043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:44.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.128+0000 7f300bfff640 1 -- 172.21.15.117:0/3809267992 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f301400a820 con 0x7f3024102d70 2024-04-12T09:23:44.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.128+0000 7f302a0ee640 1 -- 172.21.15.117:0/3809267992 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f302410d330 con 0x7f3024102d70 2024-04-12T09:23:44.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.128+0000 7f300bfff640 1 -- 172.21.15.117:0/3809267992 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f301400ae50 con 0x7f3024102d70 2024-04-12T09:23:44.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.128+0000 7f302a0ee640 1 -- 172.21.15.117:0/3809267992 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f302410d850 con 0x7f3024102d70 2024-04-12T09:23:44.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.128+0000 7f300bfff640 1 -- 172.21.15.117:0/3809267992 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f301401b5f0 con 0x7f3024102d70 2024-04-12T09:23:44.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.129+0000 7f302a0ee640 1 -- 172.21.15.117:0/3809267992 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30240fdb40 con 0x7f3024102d70 2024-04-12T09:23:44.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.130+0000 7f300bfff640 1 -- 172.21.15.117:0/3809267992 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f301400a980 con 0x7f3024102d70 2024-04-12T09:23:44.132 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.130+0000 7f300bfff640 1 --2- 172.21.15.117:0/3809267992 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f300c06dc10 0x7f300c0700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:44.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.130+0000 7f300bfff640 1 -- 172.21.15.117:0/3809267992 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f301408db20 con 0x7f3024102d70 2024-04-12T09:23:44.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.130+0000 7f30237fe640 1 --2- 172.21.15.117:0/3809267992 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f300c06dc10 0x7f300c0700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:44.133 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.130+0000 7f30237fe640 1 --2- 172.21.15.117:0/3809267992 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f300c06dc10 0x7f300c0700c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3018000c00 tx=0x7f3018009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:44.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.135+0000 7f300bfff640 1 -- 172.21.15.117:0/3809267992 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f3014057050 con 0x7f3024102d70 2024-04-12T09:23:44.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.344+0000 7f302a0ee640 1 -- 172.21.15.117:0/3809267992 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) v1 -- 0x7f3024109540 con 0x7f3024102d70 2024-04-12T09:23:44.345 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.344+0000 7f300bfff640 1 -- 172.21.15.117:0/3809267992 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v32) v1 ==== 107+0+4084 (secure 0 0 0) 0x7f301405a710 con 0x7f3024102d70 2024-04-12T09:23:44.345 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:44.345 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24265,"name":"cephfs.smithi203.fbeixl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.203:6825/840607003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":840607003},{"type":"v1","addr":"172.21.15.203:6825","nonce":840607003}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24273,"name":"cephfs.smithi203.bszhxz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.203:6827/2731911290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2731911290},{"type":"v1","addr":"172.21.15.203:6827","nonce":2731911290}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T09:08:12.488144+0000","modified":"2024-04-12T09:08:30.563184+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14474":{"gid":14474,"name":"cephfs.smithi117.eslmxh","rank":0,"incarnation":11,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6829/2248590199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":2248590199},{"type":"v1","addr":"172.21.15.117:6829","nonce":2248590199}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T09:23:44.345 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 15 2024-04-12T09:23:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.346+0000 7f302a0ee640 1 -- 172.21.15.117:0/3809267992 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f300c06dc10 msgr2=0x7f300c0700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.346+0000 7f302a0ee640 1 --2- 172.21.15.117:0/3809267992 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f300c06dc10 0x7f300c0700c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3018000c00 tx=0x7f3018009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.346+0000 7f302a0ee640 1 -- 172.21.15.117:0/3809267992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3024102d70 msgr2=0x7f3024113400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.346+0000 7f302a0ee640 1 --2- 172.21.15.117:0/3809267992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3024102d70 0x7f3024113400 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f301400c810 tx=0x7f30140043c0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.346+0000 7f302a0ee640 1 -- 172.21.15.117:0/3809267992 shutdown_connections 2024-04-12T09:23:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.346+0000 7f302a0ee640 1 --2- 172.21.15.117:0/3809267992 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f300c06dc10 0x7f300c0700c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.346+0000 7f302a0ee640 1 --2- 172.21.15.117:0/3809267992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3024102d70 0x7f3024113400 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.346+0000 7f302a0ee640 1 --2- 172.21.15.117:0/3809267992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f30241023d0 0x7f3024112ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.346+0000 7f302a0ee640 1 -- 172.21.15.117:0/3809267992 >> 172.21.15.117:0/3809267992 conn(0x7f30240f7fe0 msgr2=0x7f30240f8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:44.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.346+0000 7f302a0ee640 1 -- 172.21.15.117:0/3809267992 shutdown_connections 2024-04-12T09:23:44.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.346+0000 7f302a0ee640 1 -- 172.21.15.117:0/3809267992 wait complete. 2024-04-12T09:23:44.358 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 16 2024-04-12T09:23:44.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.456+0000 7f847b19d640 1 -- 172.21.15.117:0/1736395380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8474100f10 msgr2=0x7f84741012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:44.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.456+0000 7f847b19d640 1 --2- 172.21.15.117:0/1736395380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8474100f10 0x7f84741012e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f84700048d0 tx=0x7f8470009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.456+0000 7f847b19d640 1 -- 172.21.15.117:0/1736395380 shutdown_connections 2024-04-12T09:23:44.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.456+0000 7f847b19d640 1 --2- 172.21.15.117:0/1736395380 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84741018b0 0x7f84740faf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.456+0000 7f847b19d640 1 --2- 172.21.15.117:0/1736395380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8474100f10 0x7f84741012e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.456+0000 7f847b19d640 1 -- 172.21.15.117:0/1736395380 >> 172.21.15.117:0/1736395380 conn(0x7f8474071e80 msgr2=0x7f8474072280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:44.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.456+0000 7f847b19d640 1 -- 172.21.15.117:0/1736395380 shutdown_connections 2024-04-12T09:23:44.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.456+0000 7f847b19d640 1 -- 172.21.15.117:0/1736395380 wait complete. 2024-04-12T09:23:44.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.457+0000 7f847b19d640 1 Processor -- start 2024-04-12T09:23:44.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.457+0000 7f847b19d640 1 -- start start 2024-04-12T09:23:44.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.457+0000 7f847b19d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8474100f10 0x7f8474111a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:44.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.457+0000 7f847b19d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84741018b0 0x7f8474111f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:44.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.457+0000 7f847b19d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8474112580 con 0x7f84741018b0 2024-04-12T09:23:44.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.457+0000 7f847b19d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847410bbd0 con 0x7f8474100f10 2024-04-12T09:23:44.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.457+0000 7f847999a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84741018b0 0x7f8474111f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:44.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.457+0000 7f847999a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84741018b0 0x7f8474111f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35274/0 (socket says 172.21.15.117:35274) 2024-04-12T09:23:44.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.457+0000 7f847999a640 1 -- 172.21.15.117:0/2210265814 learned_addr learned my addr 172.21.15.117:0/2210265814 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:44.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.457+0000 7f847999a640 1 -- 172.21.15.117:0/2210265814 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8474100f10 msgr2=0x7f8474111a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:44.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.457+0000 7f847999a640 1 --2- 172.21.15.117:0/2210265814 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8474100f10 0x7f8474111a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.457+0000 7f847999a640 1 -- 172.21.15.117:0/2210265814 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8470005040 con 0x7f84741018b0 2024-04-12T09:23:44.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.457+0000 7f847999a640 1 --2- 172.21.15.117:0/2210265814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84741018b0 0x7f8474111f80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f846400c810 tx=0x7f84640043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:44.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.457+0000 7f846affd640 1 -- 172.21.15.117:0/2210265814 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f846400a820 con 0x7f84741018b0 2024-04-12T09:23:44.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.457+0000 7f846affd640 1 -- 172.21.15.117:0/2210265814 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f846400ae50 con 0x7f84741018b0 2024-04-12T09:23:44.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.457+0000 7f847b19d640 1 -- 172.21.15.117:0/2210265814 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f847410beb0 con 0x7f84741018b0 2024-04-12T09:23:44.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.457+0000 7f846affd640 1 -- 172.21.15.117:0/2210265814 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84640115c0 con 0x7f84741018b0 2024-04-12T09:23:44.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.458+0000 7f847b19d640 1 -- 172.21.15.117:0/2210265814 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f847410c3d0 con 0x7f84741018b0 2024-04-12T09:23:44.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.458+0000 7f847b19d640 1 -- 172.21.15.117:0/2210265814 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84740fc680 con 0x7f84741018b0 2024-04-12T09:23:44.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.459+0000 7f846affd640 1 -- 172.21.15.117:0/2210265814 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f846400a980 con 0x7f84741018b0 2024-04-12T09:23:44.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.459+0000 7f846affd640 1 --2- 172.21.15.117:0/2210265814 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f846006dc10 0x7f84600700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:44.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.459+0000 7f846affd640 1 -- 172.21.15.117:0/2210265814 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f846408db40 con 0x7f84741018b0 2024-04-12T09:23:44.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.459+0000 7f847a19b640 1 --2- 172.21.15.117:0/2210265814 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f846006dc10 0x7f84600700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:44.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.460+0000 7f847a19b640 1 --2- 172.21.15.117:0/2210265814 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f846006dc10 0x7f84600700c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f84700043d0 tx=0x7f8470009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:44.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.464+0000 7f846affd640 1 -- 172.21.15.117:0/2210265814 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f8464057070 con 0x7f84741018b0 2024-04-12T09:23:44.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.686+0000 7f847b19d640 1 -- 172.21.15.117:0/2210265814 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7f8474108050 con 0x7f84741018b0 2024-04-12T09:23:44.687 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.687+0000 7f846affd640 1 -- 172.21.15.117:0/2210265814 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v32) v1 ==== 107+0+4934 (secure 0 0 0) 0x7f846405a730 con 0x7f84741018b0 2024-04-12T09:23:44.688 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:44.688 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24265,"name":"cephfs.smithi203.fbeixl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.203:6825/840607003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":840607003},{"type":"v1","addr":"172.21.15.203:6825","nonce":840607003}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24273,"name":"cephfs.smithi203.bszhxz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.203:6827/2731911290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2731911290},{"type":"v1","addr":"172.21.15.203:6827","nonce":2731911290}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34372,"name":"cephfs.smithi117.wddsgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6827/2687704577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":2687704577},{"type":"v1","addr":"172.21.15.117:6827","nonce":2687704577}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T09:08:12.488144+0000","modified":"2024-04-12T09:08:30.563184+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14474},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14474":{"gid":14474,"name":"cephfs.smithi117.eslmxh","rank":0,"incarnation":11,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6829/2248590199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":2248590199},{"type":"v1","addr":"172.21.15.117:6829","nonce":2248590199}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T09:23:44.688 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 16 2024-04-12T09:23:44.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.689+0000 7f847b19d640 1 -- 172.21.15.117:0/2210265814 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f846006dc10 msgr2=0x7f84600700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:44.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.689+0000 7f847b19d640 1 --2- 172.21.15.117:0/2210265814 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f846006dc10 0x7f84600700c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f84700043d0 tx=0x7f8470009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.689+0000 7f847b19d640 1 -- 172.21.15.117:0/2210265814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84741018b0 msgr2=0x7f8474111f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:44.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.689+0000 7f847b19d640 1 --2- 172.21.15.117:0/2210265814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84741018b0 0x7f8474111f80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f846400c810 tx=0x7f84640043c0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.689+0000 7f847b19d640 1 -- 172.21.15.117:0/2210265814 shutdown_connections 2024-04-12T09:23:44.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.689+0000 7f847b19d640 1 --2- 172.21.15.117:0/2210265814 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f846006dc10 0x7f84600700c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.689+0000 7f847b19d640 1 --2- 172.21.15.117:0/2210265814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84741018b0 0x7f8474111f80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.689+0000 7f847b19d640 1 --2- 172.21.15.117:0/2210265814 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8474100f10 0x7f8474111a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.690 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.689+0000 7f847b19d640 1 -- 172.21.15.117:0/2210265814 >> 172.21.15.117:0/2210265814 conn(0x7f8474071e80 msgr2=0x7f8474103cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:44.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.689+0000 7f847b19d640 1 -- 172.21.15.117:0/2210265814 shutdown_connections 2024-04-12T09:23:44.691 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.689+0000 7f847b19d640 1 -- 172.21.15.117:0/2210265814 wait complete. 2024-04-12T09:23:44.701 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 17 2024-04-12T09:23:44.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.800+0000 7f6b17aee640 1 -- 172.21.15.117:0/949229642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b10102b70 msgr2=0x7f6b100fc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:44.823 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.800+0000 7f6b17aee640 1 --2- 172.21.15.117:0/949229642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b10102b70 0x7f6b100fc200 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c0048d0 tx=0x7f6b0c009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.800+0000 7f6b17aee640 1 -- 172.21.15.117:0/949229642 shutdown_connections 2024-04-12T09:23:44.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.800+0000 7f6b17aee640 1 --2- 172.21.15.117:0/949229642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b10102b70 0x7f6b100fc200 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.800+0000 7f6b17aee640 1 --2- 172.21.15.117:0/949229642 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b101021d0 0x7f6b101025a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.800+0000 7f6b17aee640 1 -- 172.21.15.117:0/949229642 >> 172.21.15.117:0/949229642 conn(0x7f6b100f7dc0 msgr2=0x7f6b100fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:44.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.800+0000 7f6b17aee640 1 -- 172.21.15.117:0/949229642 shutdown_connections 2024-04-12T09:23:44.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.800+0000 7f6b17aee640 1 -- 172.21.15.117:0/949229642 wait complete. 2024-04-12T09:23:44.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.800+0000 7f6b17aee640 1 Processor -- start 2024-04-12T09:23:44.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.800+0000 7f6b17aee640 1 -- start start 2024-04-12T09:23:44.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.801+0000 7f6b17aee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b101021d0 0x7f6b10112d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:44.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.801+0000 7f6b17aee640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b10102b70 0x7f6b101132b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:44.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.801+0000 7f6b17aee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b10113940 con 0x7f6b101021d0 2024-04-12T09:23:44.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.801+0000 7f6b17aee640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1010cf00 con 0x7f6b10102b70 2024-04-12T09:23:44.824 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.801+0000 7f6b1588a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b101021d0 0x7f6b10112d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:44.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.801+0000 7f6b1588a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b101021d0 0x7f6b10112d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35280/0 (socket says 172.21.15.117:35280) 2024-04-12T09:23:44.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.801+0000 7f6b1588a640 1 -- 172.21.15.117:0/1556669512 learned_addr learned my addr 172.21.15.117:0/1556669512 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:44.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.801+0000 7f6b1588a640 1 -- 172.21.15.117:0/1556669512 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b10102b70 msgr2=0x7f6b101132b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:44.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.801+0000 7f6b1588a640 1 --2- 172.21.15.117:0/1556669512 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b10102b70 0x7f6b101132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:44.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.801+0000 7f6b1588a640 1 -- 172.21.15.117:0/1556669512 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0c005040 con 0x7f6b101021d0 2024-04-12T09:23:44.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.801+0000 7f6b1588a640 1 --2- 172.21.15.117:0/1556669512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b101021d0 0x7f6b10112d70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400b790 tx=0x7f6b040091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:44.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.801+0000 7f6b027fc640 1 -- 172.21.15.117:0/1556669512 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b0400c700 con 0x7f6b101021d0 2024-04-12T09:23:44.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.801+0000 7f6b027fc640 1 -- 172.21.15.117:0/1556669512 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b0400cd30 con 0x7f6b101021d0 2024-04-12T09:23:44.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.801+0000 7f6b17aee640 1 -- 172.21.15.117:0/1556669512 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1010d1e0 con 0x7f6b101021d0 2024-04-12T09:23:44.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.801+0000 7f6b027fc640 1 -- 172.21.15.117:0/1556669512 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b04013370 con 0x7f6b101021d0 2024-04-12T09:23:44.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.801+0000 7f6b17aee640 1 -- 172.21.15.117:0/1556669512 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1010d700 con 0x7f6b101021d0 2024-04-12T09:23:44.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.802+0000 7f6b17aee640 1 -- 172.21.15.117:0/1556669512 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b100fd940 con 0x7f6b101021d0 2024-04-12T09:23:44.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.803+0000 7f6b027fc640 1 -- 172.21.15.117:0/1556669512 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f6b04012070 con 0x7f6b101021d0 2024-04-12T09:23:44.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.803+0000 7f6b027fc640 1 --2- 172.21.15.117:0/1556669512 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f6afc06dc10 0x7f6afc0700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:44.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.803+0000 7f6b15089640 1 --2- 172.21.15.117:0/1556669512 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f6afc06dc10 0x7f6afc0700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:44.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.803+0000 7f6b027fc640 1 -- 172.21.15.117:0/1556669512 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f6b0408d0e0 con 0x7f6b101021d0 2024-04-12T09:23:44.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.803+0000 7f6b15089640 1 --2- 172.21.15.117:0/1556669512 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f6afc06dc10 0x7f6afc0700c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c0043d0 tx=0x7f6b0c009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:44.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:44.808+0000 7f6b027fc640 1 -- 172.21.15.117:0/1556669512 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f6b04056690 con 0x7f6b101021d0 2024-04-12T09:23:45.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.021+0000 7f6b17aee640 1 -- 172.21.15.117:0/1556669512 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f6b10109420 con 0x7f6b101021d0 2024-04-12T09:23:45.022 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.021+0000 7f6b027fc640 1 -- 172.21.15.117:0/1556669512 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v32) v1 ==== 107+0+4141 (secure 0 0 0) 0x7f6b04059d50 con 0x7f6b101021d0 2024-04-12T09:23:45.022 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:45.022 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24265,"name":"cephfs.smithi203.fbeixl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.203:6825/840607003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":840607003},{"type":"v1","addr":"172.21.15.203:6825","nonce":840607003}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24273,"name":"cephfs.smithi203.bszhxz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.203:6827/2731911290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2731911290},{"type":"v1","addr":"172.21.15.203:6827","nonce":2731911290}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34372,"name":"cephfs.smithi117.wddsgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6827/2687704577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":2687704577},{"type":"v1","addr":"172.21.15.117:6827","nonce":2687704577}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T09:08:12.488144+0000","modified":"2024-04-12T09:20:43.484793+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T09:23:45.022 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 17 2024-04-12T09:23:45.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.023+0000 7f6b17aee640 1 -- 172.21.15.117:0/1556669512 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f6afc06dc10 msgr2=0x7f6afc0700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:45.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.023+0000 7f6b17aee640 1 --2- 172.21.15.117:0/1556669512 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f6afc06dc10 0x7f6afc0700c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c0043d0 tx=0x7f6b0c009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:45.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.023+0000 7f6b17aee640 1 -- 172.21.15.117:0/1556669512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b101021d0 msgr2=0x7f6b10112d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:45.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.023+0000 7f6b17aee640 1 --2- 172.21.15.117:0/1556669512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b101021d0 0x7f6b10112d70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400b790 tx=0x7f6b040091d0 comp rx=0 tx=0).stop 2024-04-12T09:23:45.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.023+0000 7f6b17aee640 1 -- 172.21.15.117:0/1556669512 shutdown_connections 2024-04-12T09:23:45.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.023+0000 7f6b17aee640 1 --2- 172.21.15.117:0/1556669512 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f6afc06dc10 0x7f6afc0700c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:45.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.023+0000 7f6b17aee640 1 --2- 172.21.15.117:0/1556669512 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b10102b70 0x7f6b101132b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:45.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.023+0000 7f6b17aee640 1 --2- 172.21.15.117:0/1556669512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b101021d0 0x7f6b10112d70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:45.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.023+0000 7f6b17aee640 1 -- 172.21.15.117:0/1556669512 >> 172.21.15.117:0/1556669512 conn(0x7f6b100f7dc0 msgr2=0x7f6b100f8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:45.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.024+0000 7f6b17aee640 1 -- 172.21.15.117:0/1556669512 shutdown_connections 2024-04-12T09:23:45.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.024+0000 7f6b17aee640 1 -- 172.21.15.117:0/1556669512 wait complete. 2024-04-12T09:23:45.033 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:44 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/2789011788' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-12T09:23:45.033 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:44 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/3809267992' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-04-12T09:23:45.034 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:44 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/2210265814' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-04-12T09:23:45.035 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-04-12T09:23:45.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:44 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/2789011788' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-12T09:23:45.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:44 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/3809267992' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-04-12T09:23:45.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:44 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/2210265814' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-04-12T09:23:45.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.133+0000 7f98b639d640 1 -- 172.21.15.117:0/350778407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98b0100f10 msgr2=0x7f98b01012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:45.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.133+0000 7f98b639d640 1 --2- 172.21.15.117:0/350778407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98b0100f10 0x7f98b01012e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f98ac009c50 tx=0x7f98ac004d10 comp rx=0 tx=0).stop 2024-04-12T09:23:45.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.133+0000 7f98b639d640 1 -- 172.21.15.117:0/350778407 shutdown_connections 2024-04-12T09:23:45.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.133+0000 7f98b639d640 1 --2- 172.21.15.117:0/350778407 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98b01018b0 0x7f98b00faf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:45.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.133+0000 7f98b639d640 1 --2- 172.21.15.117:0/350778407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98b0100f10 0x7f98b01012e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:45.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.133+0000 7f98b639d640 1 -- 172.21.15.117:0/350778407 >> 172.21.15.117:0/350778407 conn(0x7f98b00f6b20 msgr2=0x7f98b00f8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:45.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.133+0000 7f98b639d640 1 -- 172.21.15.117:0/350778407 shutdown_connections 2024-04-12T09:23:45.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.133+0000 7f98b639d640 1 -- 172.21.15.117:0/350778407 wait complete. 2024-04-12T09:23:45.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.133+0000 7f98b639d640 1 Processor -- start 2024-04-12T09:23:45.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.134+0000 7f98b639d640 1 -- start start 2024-04-12T09:23:45.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.134+0000 7f98b639d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98b0100f10 0x7f98b0111a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:45.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.134+0000 7f98b639d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98b01018b0 0x7f98b0111f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:45.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.134+0000 7f98b639d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b0112570 con 0x7f98b01018b0 2024-04-12T09:23:45.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.134+0000 7f98b639d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b010bbc0 con 0x7f98b0100f10 2024-04-12T09:23:45.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.134+0000 7f98b4b9a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98b01018b0 0x7f98b0111f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:45.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.134+0000 7f98b4b9a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98b01018b0 0x7f98b0111f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35298/0 (socket says 172.21.15.117:35298) 2024-04-12T09:23:45.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.134+0000 7f98b4b9a640 1 -- 172.21.15.117:0/2528437242 learned_addr learned my addr 172.21.15.117:0/2528437242 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:45.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.134+0000 7f98b539b640 1 --2- 172.21.15.117:0/2528437242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98b0100f10 0x7f98b0111a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:45.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.134+0000 7f98b4b9a640 1 -- 172.21.15.117:0/2528437242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98b0100f10 msgr2=0x7f98b0111a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:45.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.134+0000 7f98b4b9a640 1 --2- 172.21.15.117:0/2528437242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98b0100f10 0x7f98b0111a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:45.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.134+0000 7f98b4b9a640 1 -- 172.21.15.117:0/2528437242 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac0098b0 con 0x7f98b01018b0 2024-04-12T09:23:45.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.134+0000 7f98b4b9a640 1 --2- 172.21.15.117:0/2528437242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98b01018b0 0x7f98b0111f70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f98a0002a80 tx=0x7f98a0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:45.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.134+0000 7f98a5ffb640 1 -- 172.21.15.117:0/2528437242 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98a0007c30 con 0x7f98b01018b0 2024-04-12T09:23:45.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.134+0000 7f98a5ffb640 1 -- 172.21.15.117:0/2528437242 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f98a000f040 con 0x7f98b01018b0 2024-04-12T09:23:45.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.134+0000 7f98b639d640 1 -- 172.21.15.117:0/2528437242 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b010bea0 con 0x7f98b01018b0 2024-04-12T09:23:45.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.134+0000 7f98a5ffb640 1 -- 172.21.15.117:0/2528437242 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98a00096b0 con 0x7f98b01018b0 2024-04-12T09:23:45.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.135+0000 7f98b639d640 1 -- 172.21.15.117:0/2528437242 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b010c3c0 con 0x7f98b01018b0 2024-04-12T09:23:45.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.135+0000 7f98b639d640 1 -- 172.21.15.117:0/2528437242 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b00fc680 con 0x7f98b01018b0 2024-04-12T09:23:45.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.136+0000 7f98a5ffb640 1 -- 172.21.15.117:0/2528437242 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f98a000d6b0 con 0x7f98b01018b0 2024-04-12T09:23:45.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.136+0000 7f98a5ffb640 1 --2- 172.21.15.117:0/2528437242 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f989c06dc10 0x7f989c0700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:45.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.136+0000 7f98b539b640 1 --2- 172.21.15.117:0/2528437242 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f989c06dc10 0x7f989c0700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:45.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.136+0000 7f98a5ffb640 1 -- 172.21.15.117:0/2528437242 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f98a008cfb0 con 0x7f98b01018b0 2024-04-12T09:23:45.139 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.137+0000 7f98b539b640 1 --2- 172.21.15.117:0/2528437242 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f989c06dc10 0x7f989c0700c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f98ac004a30 tx=0x7f98ac02e040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:45.141 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.141+0000 7f98a5ffb640 1 -- 172.21.15.117:0/2528437242 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f98a00564e0 con 0x7f98b01018b0 2024-04-12T09:23:45.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.350+0000 7f98b639d640 1 -- 172.21.15.117:0/2528437242 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f98b004bcc0 con 0x7f98b01018b0 2024-04-12T09:23:45.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.351+0000 7f98a5ffb640 1 -- 172.21.15.117:0/2528437242 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v32) v1 ==== 107+0+4152 (secure 0 0 0) 0x7f98a0059ba0 con 0x7f98b01018b0 2024-04-12T09:23:45.352 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:45.352 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24273,"name":"cephfs.smithi203.bszhxz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.203:6827/2731911290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2731911290},{"type":"v1","addr":"172.21.15.203:6827","nonce":2731911290}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34372,"name":"cephfs.smithi117.wddsgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6827/2687704577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":2687704577},{"type":"v1","addr":"172.21.15.117:6827","nonce":2687704577}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T09:08:12.488144+0000","modified":"2024-04-12T09:20:43.490113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24265":{"gid":24265,"name":"cephfs.smithi203.fbeixl","rank":0,"incarnation":18,"state":"up:replay","state_seq":3,"addr":"172.21.15.203:6825/840607003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":840607003},{"type":"v1","addr":"172.21.15.203:6825","nonce":840607003}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T09:23:45.352 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 18 2024-04-12T09:23:45.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.353+0000 7f98b639d640 1 -- 172.21.15.117:0/2528437242 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f989c06dc10 msgr2=0x7f989c0700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:45.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.353+0000 7f98b639d640 1 --2- 172.21.15.117:0/2528437242 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f989c06dc10 0x7f989c0700c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f98ac004a30 tx=0x7f98ac02e040 comp rx=0 tx=0).stop 2024-04-12T09:23:45.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.353+0000 7f98b639d640 1 -- 172.21.15.117:0/2528437242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98b01018b0 msgr2=0x7f98b0111f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:45.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.353+0000 7f98b639d640 1 --2- 172.21.15.117:0/2528437242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98b01018b0 0x7f98b0111f70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f98a0002a80 tx=0x7f98a0004600 comp rx=0 tx=0).stop 2024-04-12T09:23:45.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.353+0000 7f98b639d640 1 -- 172.21.15.117:0/2528437242 shutdown_connections 2024-04-12T09:23:45.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.353+0000 7f98b639d640 1 --2- 172.21.15.117:0/2528437242 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f989c06dc10 0x7f989c0700c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:45.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.353+0000 7f98b639d640 1 --2- 172.21.15.117:0/2528437242 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98b01018b0 0x7f98b0111f70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:45.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.353+0000 7f98b639d640 1 --2- 172.21.15.117:0/2528437242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98b0100f10 0x7f98b0111a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:45.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.353+0000 7f98b639d640 1 -- 172.21.15.117:0/2528437242 >> 172.21.15.117:0/2528437242 conn(0x7f98b00f6b20 msgr2=0x7f98b00f7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:45.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.353+0000 7f98b639d640 1 -- 172.21.15.117:0/2528437242 shutdown_connections 2024-04-12T09:23:45.355 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.353+0000 7f98b639d640 1 -- 172.21.15.117:0/2528437242 wait complete. 2024-04-12T09:23:45.364 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-04-12T09:23:45.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.462+0000 7ff7fbfff640 1 -- 172.21.15.117:0/3624549141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc1029d0 msgr2=0x7ff7fc0643f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:45.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.462+0000 7ff7fbfff640 1 --2- 172.21.15.117:0/3624549141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc1029d0 0x7ff7fc0643f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00048d0 tx=0x7ff7f0009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:45.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.462+0000 7ff7fbfff640 1 -- 172.21.15.117:0/3624549141 shutdown_connections 2024-04-12T09:23:45.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.462+0000 7ff7fbfff640 1 --2- 172.21.15.117:0/3624549141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc1029d0 0x7ff7fc0643f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:45.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.462+0000 7ff7fbfff640 1 --2- 172.21.15.117:0/3624549141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7fc102030 0x7ff7fc102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:45.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.462+0000 7ff7fbfff640 1 -- 172.21.15.117:0/3624549141 >> 172.21.15.117:0/3624549141 conn(0x7ff7fc071e80 msgr2=0x7ff7fc072280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:45.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.462+0000 7ff7fbfff640 1 -- 172.21.15.117:0/3624549141 shutdown_connections 2024-04-12T09:23:45.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.462+0000 7ff7fbfff640 1 -- 172.21.15.117:0/3624549141 wait complete. 2024-04-12T09:23:45.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.463+0000 7ff7fbfff640 1 Processor -- start 2024-04-12T09:23:45.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.463+0000 7ff7fbfff640 1 -- start start 2024-04-12T09:23:45.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.463+0000 7ff7fbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc102030 0x7ff7fc0fafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:45.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.463+0000 7ff7fbfff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7fc1029d0 0x7ff7fc0fb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:45.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.463+0000 7ff7fbfff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc0fcf40 con 0x7ff7fc102030 2024-04-12T09:23:45.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.463+0000 7ff7fbfff640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc0fba50 con 0x7ff7fc1029d0 2024-04-12T09:23:45.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.463+0000 7ff7faffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc102030 0x7ff7fc0fafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:45.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.463+0000 7ff7faffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc102030 0x7ff7fc0fafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35316/0 (socket says 172.21.15.117:35316) 2024-04-12T09:23:45.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.463+0000 7ff7faffd640 1 -- 172.21.15.117:0/1554160666 learned_addr learned my addr 172.21.15.117:0/1554160666 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:45.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.463+0000 7ff7faffd640 1 -- 172.21.15.117:0/1554160666 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7fc1029d0 msgr2=0x7ff7fc0fb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:45.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.463+0000 7ff7faffd640 1 --2- 172.21.15.117:0/1554160666 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7fc1029d0 0x7ff7fc0fb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:45.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.463+0000 7ff7faffd640 1 -- 172.21.15.117:0/1554160666 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f0005040 con 0x7ff7fc102030 2024-04-12T09:23:45.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.464+0000 7ff7faffd640 1 --2- 172.21.15.117:0/1554160666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc102030 0x7ff7fc0fafd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00bbb0 tx=0x7ff7ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:45.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.464+0000 7ff7e37fe640 1 -- 172.21.15.117:0/1554160666 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7ec00c9c0 con 0x7ff7fc102030 2024-04-12T09:23:45.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.464+0000 7ff7e37fe640 1 -- 172.21.15.117:0/1554160666 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff7ec0092e0 con 0x7ff7fc102030 2024-04-12T09:23:45.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.464+0000 7ff7fbfff640 1 -- 172.21.15.117:0/1554160666 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7fc0fbcd0 con 0x7ff7fc102030 2024-04-12T09:23:45.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.464+0000 7ff7e37fe640 1 -- 172.21.15.117:0/1554160666 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7ec007640 con 0x7ff7fc102030 2024-04-12T09:23:45.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.464+0000 7ff7fbfff640 1 -- 172.21.15.117:0/1554160666 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7fc119420 con 0x7ff7fc102030 2024-04-12T09:23:45.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.465+0000 7ff7fbfff640 1 -- 172.21.15.117:0/1554160666 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7fc0fd7b0 con 0x7ff7fc102030 2024-04-12T09:23:45.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.465+0000 7ff7e37fe640 1 -- 172.21.15.117:0/1554160666 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7ff7ec012070 con 0x7ff7fc102030 2024-04-12T09:23:45.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.465+0000 7ff7e37fe640 1 --2- 172.21.15.117:0/1554160666 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff7e406dc10 0x7ff7e40700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:45.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.466+0000 7ff7e37fe640 1 -- 172.21.15.117:0/1554160666 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7ff7ec08d650 con 0x7ff7fc102030 2024-04-12T09:23:45.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.466+0000 7ff7fa7fc640 1 --2- 172.21.15.117:0/1554160666 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff7e406dc10 0x7ff7e40700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:45.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.466+0000 7ff7fa7fc640 1 --2- 172.21.15.117:0/1554160666 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff7e406dc10 0x7ff7e40700c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff7f002bda0 tx=0x7ff7f0009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:45.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.470+0000 7ff7e37fe640 1 -- 172.21.15.117:0/1554160666 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff7ec056b80 con 0x7ff7fc102030 2024-04-12T09:23:45.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.682+0000 7ff7fbfff640 1 -- 172.21.15.117:0/1554160666 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7ff7fc04bcc0 con 0x7ff7fc102030 2024-04-12T09:23:45.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.683+0000 7ff7e37fe640 1 -- 172.21.15.117:0/1554160666 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v32) v1 ==== 107+0+5007 (secure 0 0 0) 0x7ff7ec05a240 con 0x7ff7fc102030 2024-04-12T09:23:45.684 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:45.684 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24273,"name":"cephfs.smithi203.bszhxz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.203:6827/2731911290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2731911290},{"type":"v1","addr":"172.21.15.203:6827","nonce":2731911290}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34372,"name":"cephfs.smithi117.wddsgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6827/2687704577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":2687704577},{"type":"v1","addr":"172.21.15.117:6827","nonce":2687704577}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34404,"name":"cephfs.smithi117.eslmxh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6829/2675574893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":2675574893},{"type":"v1","addr":"172.21.15.117:6829","nonce":2675574893}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T09:08:12.488144+0000","modified":"2024-04-12T09:20:52.054470+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24265":{"gid":24265,"name":"cephfs.smithi203.fbeixl","rank":0,"incarnation":18,"state":"up:reconnect","state_seq":190,"addr":"172.21.15.203:6825/840607003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":840607003},{"type":"v1","addr":"172.21.15.203:6825","nonce":840607003}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T09:23:45.684 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 19 2024-04-12T09:23:45.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.685+0000 7ff7fbfff640 1 -- 172.21.15.117:0/1554160666 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff7e406dc10 msgr2=0x7ff7e40700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:45.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.685+0000 7ff7fbfff640 1 --2- 172.21.15.117:0/1554160666 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff7e406dc10 0x7ff7e40700c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff7f002bda0 tx=0x7ff7f0009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:45.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.685+0000 7ff7fbfff640 1 -- 172.21.15.117:0/1554160666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc102030 msgr2=0x7ff7fc0fafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:45.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.685+0000 7ff7fbfff640 1 --2- 172.21.15.117:0/1554160666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc102030 0x7ff7fc0fafd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00bbb0 tx=0x7ff7ec009840 comp rx=0 tx=0).stop 2024-04-12T09:23:45.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.685+0000 7ff7fbfff640 1 -- 172.21.15.117:0/1554160666 shutdown_connections 2024-04-12T09:23:45.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.685+0000 7ff7fbfff640 1 --2- 172.21.15.117:0/1554160666 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff7e406dc10 0x7ff7e40700c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:45.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.685+0000 7ff7fbfff640 1 --2- 172.21.15.117:0/1554160666 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7fc1029d0 0x7ff7fc0fb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:45.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.685+0000 7ff7fbfff640 1 --2- 172.21.15.117:0/1554160666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7fc102030 0x7ff7fc0fafd0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:45.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.685+0000 7ff7fbfff640 1 -- 172.21.15.117:0/1554160666 >> 172.21.15.117:0/1554160666 conn(0x7ff7fc071e80 msgr2=0x7ff7fc104dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:45.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.685+0000 7ff7fbfff640 1 -- 172.21.15.117:0/1554160666 shutdown_connections 2024-04-12T09:23:45.686 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.685+0000 7ff7fbfff640 1 -- 172.21.15.117:0/1554160666 wait complete. 2024-04-12T09:23:45.697 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-04-12T09:23:45.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.796+0000 7fe45999d640 1 -- 172.21.15.117:0/3358021244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4540fc2f0 msgr2=0x7fe454108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:45.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.796+0000 7fe45999d640 1 --2- 172.21.15.117:0/3358021244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4540fc2f0 0x7fe454108570 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe43c0048d0 tx=0x7fe43c009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:45.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.796+0000 7fe45999d640 1 -- 172.21.15.117:0/3358021244 shutdown_connections 2024-04-12T09:23:45.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.796+0000 7fe45999d640 1 --2- 172.21.15.117:0/3358021244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4540fc2f0 0x7fe454108570 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:45.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.796+0000 7fe45999d640 1 --2- 172.21.15.117:0/3358021244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4540fb9e0 0x7fe4540fbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:45.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.796+0000 7fe45999d640 1 -- 172.21.15.117:0/3358021244 >> 172.21.15.117:0/3358021244 conn(0x7fe454071e80 msgr2=0x7fe454072280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:45.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.797+0000 7fe45999d640 1 -- 172.21.15.117:0/3358021244 shutdown_connections 2024-04-12T09:23:45.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.797+0000 7fe45999d640 1 -- 172.21.15.117:0/3358021244 wait complete. 2024-04-12T09:23:45.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.797+0000 7fe45999d640 1 Processor -- start 2024-04-12T09:23:45.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.797+0000 7fe45999d640 1 -- start start 2024-04-12T09:23:45.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.797+0000 7fe45999d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4540fb9e0 0x7fe454114d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:45.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.797+0000 7fe45999d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4540fc2f0 0x7fe454115260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:45.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.797+0000 7fe45999d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe454115860 con 0x7fe4540fc2f0 2024-04-12T09:23:45.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.797+0000 7fe45999d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45410eeb0 con 0x7fe4540fb9e0 2024-04-12T09:23:45.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.797+0000 7fe453fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4540fc2f0 0x7fe454115260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:45.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.798+0000 7fe453fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4540fc2f0 0x7fe454115260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35344/0 (socket says 172.21.15.117:35344) 2024-04-12T09:23:45.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.798+0000 7fe453fff640 1 -- 172.21.15.117:0/2121638695 learned_addr learned my addr 172.21.15.117:0/2121638695 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:45.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.798+0000 7fe453fff640 1 -- 172.21.15.117:0/2121638695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4540fb9e0 msgr2=0x7fe454114d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:45.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.798+0000 7fe453fff640 1 --2- 172.21.15.117:0/2121638695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4540fb9e0 0x7fe454114d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:45.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.798+0000 7fe453fff640 1 -- 172.21.15.117:0/2121638695 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43c005040 con 0x7fe4540fc2f0 2024-04-12T09:23:45.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.798+0000 7fe453fff640 1 --2- 172.21.15.117:0/2121638695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4540fc2f0 0x7fe454115260 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe43c004930 tx=0x7fe43c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:45.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.798+0000 7fe4517fa640 1 -- 172.21.15.117:0/2121638695 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe43c0094c0 con 0x7fe4540fc2f0 2024-04-12T09:23:45.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.798+0000 7fe45999d640 1 -- 172.21.15.117:0/2121638695 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45410f130 con 0x7fe4540fc2f0 2024-04-12T09:23:45.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.798+0000 7fe4517fa640 1 -- 172.21.15.117:0/2121638695 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe43c032e50 con 0x7fe4540fc2f0 2024-04-12T09:23:45.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.798+0000 7fe4517fa640 1 -- 172.21.15.117:0/2121638695 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe43c0433b0 con 0x7fe4540fc2f0 2024-04-12T09:23:45.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.798+0000 7fe45999d640 1 -- 172.21.15.117:0/2121638695 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe45410f5f0 con 0x7fe4540fc2f0 2024-04-12T09:23:45.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.799+0000 7fe45999d640 1 -- 172.21.15.117:0/2121638695 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4540fb580 con 0x7fe4540fc2f0 2024-04-12T09:23:45.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.800+0000 7fe4517fa640 1 -- 172.21.15.117:0/2121638695 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fe43c02f070 con 0x7fe4540fc2f0 2024-04-12T09:23:45.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.800+0000 7fe4517fa640 1 --2- 172.21.15.117:0/2121638695 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe44006dc10 0x7fe4400700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:45.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.800+0000 7fe45899b640 1 --2- 172.21.15.117:0/2121638695 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe44006dc10 0x7fe4400700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:45.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.800+0000 7fe4517fa640 1 -- 172.21.15.117:0/2121638695 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fe43c0af430 con 0x7fe4540fc2f0 2024-04-12T09:23:45.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.800+0000 7fe45899b640 1 --2- 172.21.15.117:0/2121638695 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe44006dc10 0x7fe4400700c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe444009af0 tx=0x7fe444009cd0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:45.805 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:45.805+0000 7fe4517fa640 1 -- 172.21.15.117:0/2121638695 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fe43c078960 con 0x7fe4540fc2f0 2024-04-12T09:23:46.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.014+0000 7fe45999d640 1 -- 172.21.15.117:0/2121638695 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7fe45404bcc0 con 0x7fe4540fc2f0 2024-04-12T09:23:46.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.015+0000 7fe4517fa640 1 -- 172.21.15.117:0/2121638695 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v32) v1 ==== 107+0+5004 (secure 0 0 0) 0x7fe43c07c020 con 0x7fe4540fc2f0 2024-04-12T09:23:46.016 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:46.016 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24273,"name":"cephfs.smithi203.bszhxz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.203:6827/2731911290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2731911290},{"type":"v1","addr":"172.21.15.203:6827","nonce":2731911290}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34372,"name":"cephfs.smithi117.wddsgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6827/2687704577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":2687704577},{"type":"v1","addr":"172.21.15.117:6827","nonce":2687704577}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34404,"name":"cephfs.smithi117.eslmxh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6829/2675574893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":2675574893},{"type":"v1","addr":"172.21.15.117:6829","nonce":2675574893}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T09:08:12.488144+0000","modified":"2024-04-12T09:20:52.708977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24265":{"gid":24265,"name":"cephfs.smithi203.fbeixl","rank":0,"incarnation":18,"state":"up:rejoin","state_seq":191,"addr":"172.21.15.203:6825/840607003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":840607003},{"type":"v1","addr":"172.21.15.203:6825","nonce":840607003}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T09:23:46.016 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 20 2024-04-12T09:23:46.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.017+0000 7fe45999d640 1 -- 172.21.15.117:0/2121638695 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe44006dc10 msgr2=0x7fe4400700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:46.018 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.017+0000 7fe45999d640 1 --2- 172.21.15.117:0/2121638695 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe44006dc10 0x7fe4400700c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe444009af0 tx=0x7fe444009cd0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.017+0000 7fe45999d640 1 -- 172.21.15.117:0/2121638695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4540fc2f0 msgr2=0x7fe454115260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:46.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.017+0000 7fe45999d640 1 --2- 172.21.15.117:0/2121638695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4540fc2f0 0x7fe454115260 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe43c004930 tx=0x7fe43c009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.017+0000 7fe45999d640 1 -- 172.21.15.117:0/2121638695 shutdown_connections 2024-04-12T09:23:46.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.017+0000 7fe45999d640 1 --2- 172.21.15.117:0/2121638695 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe44006dc10 0x7fe4400700c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.017+0000 7fe45999d640 1 --2- 172.21.15.117:0/2121638695 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4540fc2f0 0x7fe454115260 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.017+0000 7fe45999d640 1 --2- 172.21.15.117:0/2121638695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4540fb9e0 0x7fe454114d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.017+0000 7fe45999d640 1 -- 172.21.15.117:0/2121638695 >> 172.21.15.117:0/2121638695 conn(0x7fe454071e80 msgr2=0x7fe454103530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:46.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.017+0000 7fe45999d640 1 -- 172.21.15.117:0/2121638695 shutdown_connections 2024-04-12T09:23:46.019 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.017+0000 7fe45999d640 1 -- 172.21.15.117:0/2121638695 wait complete. 2024-04-12T09:23:46.027 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:45 smithi117 ceph-mon[113571]: pgmap v272: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:46.027 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:45 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/1556669512' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-04-12T09:23:46.028 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:45 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/2528437242' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-04-12T09:23:46.028 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:45 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/1554160666' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-12T09:23:46.029 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-04-12T09:23:46.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:45 smithi203 ceph-mon[86783]: pgmap v272: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:46.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:45 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/1556669512' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-04-12T09:23:46.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:45 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/2528437242' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-04-12T09:23:46.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:45 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/1554160666' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-12T09:23:46.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.132+0000 7fe708aee640 1 -- 172.21.15.117:0/776047367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe704102b50 msgr2=0x7fe7040fc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:46.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.132+0000 7fe708aee640 1 --2- 172.21.15.117:0/776047367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe704102b50 0x7fe7040fc1e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0048d0 tx=0x7fe6ec009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.132+0000 7fe708aee640 1 -- 172.21.15.117:0/776047367 shutdown_connections 2024-04-12T09:23:46.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.132+0000 7fe708aee640 1 --2- 172.21.15.117:0/776047367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe704102b50 0x7fe7040fc1e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.132+0000 7fe708aee640 1 --2- 172.21.15.117:0/776047367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7041021b0 0x7fe704102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.132+0000 7fe708aee640 1 -- 172.21.15.117:0/776047367 >> 172.21.15.117:0/776047367 conn(0x7fe7040f7dc0 msgr2=0x7fe7040fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:46.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.132+0000 7fe708aee640 1 -- 172.21.15.117:0/776047367 shutdown_connections 2024-04-12T09:23:46.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.132+0000 7fe708aee640 1 -- 172.21.15.117:0/776047367 wait complete. 2024-04-12T09:23:46.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.133+0000 7fe708aee640 1 Processor -- start 2024-04-12T09:23:46.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.133+0000 7fe708aee640 1 -- start start 2024-04-12T09:23:46.135 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.133+0000 7fe708aee640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7041021b0 0x7fe704112cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:46.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.133+0000 7fe708aee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe704102b50 0x7fe704113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:46.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.133+0000 7fe708aee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe704113810 con 0x7fe704102b50 2024-04-12T09:23:46.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.133+0000 7fe708aee640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70410ce60 con 0x7fe7041021b0 2024-04-12T09:23:46.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.133+0000 7fe6fbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe704102b50 0x7fe704113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:46.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.133+0000 7fe6fbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe704102b50 0x7fe704113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35352/0 (socket says 172.21.15.117:35352) 2024-04-12T09:23:46.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.133+0000 7fe6fbfff640 1 -- 172.21.15.117:0/3199547589 learned_addr learned my addr 172.21.15.117:0/3199547589 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:46.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.133+0000 7fe70259c640 1 --2- 172.21.15.117:0/3199547589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7041021b0 0x7fe704112cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:46.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.133+0000 7fe6fbfff640 1 -- 172.21.15.117:0/3199547589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7041021b0 msgr2=0x7fe704112cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:46.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.133+0000 7fe6fbfff640 1 --2- 172.21.15.117:0/3199547589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7041021b0 0x7fe704112cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.133+0000 7fe6fbfff640 1 -- 172.21.15.117:0/3199547589 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec005040 con 0x7fe704102b50 2024-04-12T09:23:46.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.133+0000 7fe6fbfff640 1 --2- 172.21.15.117:0/3199547589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe704102b50 0x7fe704113210 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec004930 tx=0x7fe6ec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:46.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.133+0000 7fe6faffd640 1 -- 172.21.15.117:0/3199547589 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6ec0094c0 con 0x7fe704102b50 2024-04-12T09:23:46.136 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.134+0000 7fe6faffd640 1 -- 172.21.15.117:0/3199547589 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe6ec032e50 con 0x7fe704102b50 2024-04-12T09:23:46.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.134+0000 7fe708aee640 1 -- 172.21.15.117:0/3199547589 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe70410d0e0 con 0x7fe704102b50 2024-04-12T09:23:46.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.134+0000 7fe6faffd640 1 -- 172.21.15.117:0/3199547589 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6ec0433b0 con 0x7fe704102b50 2024-04-12T09:23:46.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.134+0000 7fe708aee640 1 -- 172.21.15.117:0/3199547589 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70410d5a0 con 0x7fe704102b50 2024-04-12T09:23:46.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.135+0000 7fe708aee640 1 -- 172.21.15.117:0/3199547589 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7040fd920 con 0x7fe704102b50 2024-04-12T09:23:46.137 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.135+0000 7fe6faffd640 1 -- 172.21.15.117:0/3199547589 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fe6ec02f070 con 0x7fe704102b50 2024-04-12T09:23:46.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.135+0000 7fe6faffd640 1 --2- 172.21.15.117:0/3199547589 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe6f006dc10 0x7fe6f00700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:46.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.135+0000 7fe6faffd640 1 -- 172.21.15.117:0/3199547589 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fe6ec0af3d0 con 0x7fe704102b50 2024-04-12T09:23:46.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.135+0000 7fe70259c640 1 --2- 172.21.15.117:0/3199547589 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe6f006dc10 0x7fe6f00700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:46.138 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.136+0000 7fe70259c640 1 --2- 172.21.15.117:0/3199547589 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe6f006dc10 0x7fe6f00700c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4004ce0 tx=0x7fe6f400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:46.140 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.140+0000 7fe6faffd640 1 -- 172.21.15.117:0/3199547589 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fe6ec078900 con 0x7fe704102b50 2024-04-12T09:23:46.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.349+0000 7fe708aee640 1 -- 172.21.15.117:0/3199547589 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fe704109320 con 0x7fe704102b50 2024-04-12T09:23:46.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.350+0000 7fe6faffd640 1 -- 172.21.15.117:0/3199547589 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v32) v1 ==== 107+0+5013 (secure 0 0 0) 0x7fe6ec07bfc0 con 0x7fe704102b50 2024-04-12T09:23:46.350 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:46.351 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24273,"name":"cephfs.smithi203.bszhxz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.203:6827/2731911290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2731911290},{"type":"v1","addr":"172.21.15.203:6827","nonce":2731911290}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34372,"name":"cephfs.smithi117.wddsgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6827/2687704577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":2687704577},{"type":"v1","addr":"172.21.15.117:6827","nonce":2687704577}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34404,"name":"cephfs.smithi117.eslmxh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6829/2675574893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":2675574893},{"type":"v1","addr":"172.21.15.117:6829","nonce":2675574893}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T09:08:12.488144+0000","modified":"2024-04-12T09:20:54.707732+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24265":{"gid":24265,"name":"cephfs.smithi203.fbeixl","rank":0,"incarnation":18,"state":"up:active","state_seq":192,"addr":"172.21.15.203:6825/840607003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":840607003},{"type":"v1","addr":"172.21.15.203:6825","nonce":840607003}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24265,"qdb_cluster":[24265]},"id":1}]} 2024-04-12T09:23:46.351 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 21 2024-04-12T09:23:46.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.352+0000 7fe708aee640 1 -- 172.21.15.117:0/3199547589 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe6f006dc10 msgr2=0x7fe6f00700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:46.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.352+0000 7fe708aee640 1 --2- 172.21.15.117:0/3199547589 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe6f006dc10 0x7fe6f00700c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4004ce0 tx=0x7fe6f400b040 comp rx=0 tx=0).stop 2024-04-12T09:23:46.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.352+0000 7fe708aee640 1 -- 172.21.15.117:0/3199547589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe704102b50 msgr2=0x7fe704113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:46.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.352+0000 7fe708aee640 1 --2- 172.21.15.117:0/3199547589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe704102b50 0x7fe704113210 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec004930 tx=0x7fe6ec009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.352+0000 7fe708aee640 1 -- 172.21.15.117:0/3199547589 shutdown_connections 2024-04-12T09:23:46.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.352+0000 7fe708aee640 1 --2- 172.21.15.117:0/3199547589 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fe6f006dc10 0x7fe6f00700c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.352+0000 7fe708aee640 1 --2- 172.21.15.117:0/3199547589 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe704102b50 0x7fe704113210 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.352+0000 7fe708aee640 1 --2- 172.21.15.117:0/3199547589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7041021b0 0x7fe704112cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.352+0000 7fe708aee640 1 -- 172.21.15.117:0/3199547589 >> 172.21.15.117:0/3199547589 conn(0x7fe7040f7dc0 msgr2=0x7fe7040f8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:46.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.352+0000 7fe708aee640 1 -- 172.21.15.117:0/3199547589 shutdown_connections 2024-04-12T09:23:46.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.352+0000 7fe708aee640 1 -- 172.21.15.117:0/3199547589 wait complete. 2024-04-12T09:23:46.363 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-04-12T09:23:46.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.462+0000 7fcbef59e640 1 -- 172.21.15.117:0/2790423326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbf00fd040 msgr2=0x7fcbf00fd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:46.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.462+0000 7fcbef59e640 1 --2- 172.21.15.117:0/2790423326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbf00fd040 0x7fcbf00fd410 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcbe40048d0 tx=0x7fcbe4009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.462+0000 7fcbef59e640 1 -- 172.21.15.117:0/2790423326 shutdown_connections 2024-04-12T09:23:46.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.462+0000 7fcbef59e640 1 --2- 172.21.15.117:0/2790423326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcbf00fd950 0x7fcbf01060b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.462+0000 7fcbef59e640 1 --2- 172.21.15.117:0/2790423326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbf00fd040 0x7fcbf00fd410 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.462+0000 7fcbef59e640 1 -- 172.21.15.117:0/2790423326 >> 172.21.15.117:0/2790423326 conn(0x7fcbf00f6ae0 msgr2=0x7fcbf00f8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:46.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.462+0000 7fcbef59e640 1 -- 172.21.15.117:0/2790423326 shutdown_connections 2024-04-12T09:23:46.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.462+0000 7fcbef59e640 1 -- 172.21.15.117:0/2790423326 wait complete. 2024-04-12T09:23:46.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.462+0000 7fcbef59e640 1 Processor -- start 2024-04-12T09:23:46.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.462+0000 7fcbef59e640 1 -- start start 2024-04-12T09:23:46.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.463+0000 7fcbef59e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcbf00fd040 0x7fcbf0112b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:46.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.463+0000 7fcbef59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbf00fd950 0x7fcbf01130b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:46.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.463+0000 7fcbef59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf01136b0 con 0x7fcbf00fd950 2024-04-12T09:23:46.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.463+0000 7fcbef59e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf0113820 con 0x7fcbf00fd040 2024-04-12T09:23:46.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.463+0000 7fcbedd9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbf00fd950 0x7fcbf01130b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:46.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.463+0000 7fcbedd9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbf00fd950 0x7fcbf01130b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35374/0 (socket says 172.21.15.117:35374) 2024-04-12T09:23:46.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.463+0000 7fcbedd9b640 1 -- 172.21.15.117:0/2224686272 learned_addr learned my addr 172.21.15.117:0/2224686272 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:46.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.463+0000 7fcbee59c640 1 --2- 172.21.15.117:0/2224686272 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcbf00fd040 0x7fcbf0112b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:46.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.463+0000 7fcbedd9b640 1 -- 172.21.15.117:0/2224686272 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcbf00fd040 msgr2=0x7fcbf0112b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:46.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.463+0000 7fcbedd9b640 1 --2- 172.21.15.117:0/2224686272 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcbf00fd040 0x7fcbf0112b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.463+0000 7fcbedd9b640 1 -- 172.21.15.117:0/2224686272 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe4005040 con 0x7fcbf00fd950 2024-04-12T09:23:46.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.463+0000 7fcbedd9b640 1 --2- 172.21.15.117:0/2224686272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbf00fd950 0x7fcbf01130b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcbe000c810 tx=0x7fcbe00043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:46.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.463+0000 7fcbdeffd640 1 -- 172.21.15.117:0/2224686272 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbe000a820 con 0x7fcbf00fd950 2024-04-12T09:23:46.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.463+0000 7fcbef59e640 1 -- 172.21.15.117:0/2224686272 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf010ceb0 con 0x7fcbf00fd950 2024-04-12T09:23:46.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.463+0000 7fcbdeffd640 1 -- 172.21.15.117:0/2224686272 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcbe000ae50 con 0x7fcbf00fd950 2024-04-12T09:23:46.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.463+0000 7fcbdeffd640 1 -- 172.21.15.117:0/2224686272 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbe00115c0 con 0x7fcbf00fd950 2024-04-12T09:23:46.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.463+0000 7fcbef59e640 1 -- 172.21.15.117:0/2224686272 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf010d3d0 con 0x7fcbf00fd950 2024-04-12T09:23:46.467 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.464+0000 7fcbef59e640 1 -- 172.21.15.117:0/2224686272 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf0065d90 con 0x7fcbf00fd950 2024-04-12T09:23:46.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.465+0000 7fcbdeffd640 1 -- 172.21.15.117:0/2224686272 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fcbe000a980 con 0x7fcbf00fd950 2024-04-12T09:23:46.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.465+0000 7fcbdeffd640 1 --2- 172.21.15.117:0/2224686272 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fcbd806dc10 0x7fcbd80700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:46.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.465+0000 7fcbee59c640 1 --2- 172.21.15.117:0/2224686272 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fcbd806dc10 0x7fcbd80700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:46.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.465+0000 7fcbdeffd640 1 -- 172.21.15.117:0/2224686272 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fcbe008dab0 con 0x7fcbf00fd950 2024-04-12T09:23:46.468 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.466+0000 7fcbee59c640 1 --2- 172.21.15.117:0/2224686272 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fcbd806dc10 0x7fcbd80700c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4031870 tx=0x7fcbe4009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:46.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.470+0000 7fcbdeffd640 1 -- 172.21.15.117:0/2224686272 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fcbe0056fe0 con 0x7fcbf00fd950 2024-04-12T09:23:46.680 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.680+0000 7fcbef59e640 1 -- 172.21.15.117:0/2224686272 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7fcbf004bcc0 con 0x7fcbf00fd950 2024-04-12T09:23:46.681 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.681+0000 7fcbdeffd640 1 -- 172.21.15.117:0/2224686272 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v32) v1 ==== 107+0+4212 (secure 0 0 0) 0x7fcbe005a6a0 con 0x7fcbf00fd950 2024-04-12T09:23:46.681 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:46.682 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24273,"name":"cephfs.smithi203.bszhxz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.203:6827/2731911290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2731911290},{"type":"v1","addr":"172.21.15.203:6827","nonce":2731911290}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34372,"name":"cephfs.smithi117.wddsgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6827/2687704577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":2687704577},{"type":"v1","addr":"172.21.15.117:6827","nonce":2687704577}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34404,"name":"cephfs.smithi117.eslmxh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6829/2675574893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":2675574893},{"type":"v1","addr":"172.21.15.117:6829","nonce":2675574893}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T09:08:12.488144+0000","modified":"2024-04-12T09:21:05.261827+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T09:23:46.682 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 22 2024-04-12T09:23:46.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.683+0000 7fcbef59e640 1 -- 172.21.15.117:0/2224686272 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fcbd806dc10 msgr2=0x7fcbd80700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:46.683 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.683+0000 7fcbef59e640 1 --2- 172.21.15.117:0/2224686272 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fcbd806dc10 0x7fcbd80700c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4031870 tx=0x7fcbe4009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.683+0000 7fcbef59e640 1 -- 172.21.15.117:0/2224686272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbf00fd950 msgr2=0x7fcbf01130b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:46.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.683+0000 7fcbef59e640 1 --2- 172.21.15.117:0/2224686272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbf00fd950 0x7fcbf01130b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcbe000c810 tx=0x7fcbe00043c0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.683+0000 7fcbef59e640 1 -- 172.21.15.117:0/2224686272 shutdown_connections 2024-04-12T09:23:46.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.683+0000 7fcbef59e640 1 --2- 172.21.15.117:0/2224686272 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fcbd806dc10 0x7fcbd80700c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.683+0000 7fcbef59e640 1 --2- 172.21.15.117:0/2224686272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbf00fd950 0x7fcbf01130b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.683+0000 7fcbef59e640 1 --2- 172.21.15.117:0/2224686272 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcbf00fd040 0x7fcbf0112b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.683+0000 7fcbef59e640 1 -- 172.21.15.117:0/2224686272 >> 172.21.15.117:0/2224686272 conn(0x7fcbf00f6ae0 msgr2=0x7fcbf00f8040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:46.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.683+0000 7fcbef59e640 1 -- 172.21.15.117:0/2224686272 shutdown_connections 2024-04-12T09:23:46.684 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.683+0000 7fcbef59e640 1 -- 172.21.15.117:0/2224686272 wait complete. 2024-04-12T09:23:46.694 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-04-12T09:23:46.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.794+0000 7f68c4cee640 1 -- 172.21.15.117:0/1392778638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68c0101a70 msgr2=0x7f68c00fb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:46.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.794+0000 7f68c4cee640 1 --2- 172.21.15.117:0/1392778638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68c0101a70 0x7f68c00fb100 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f68a80048d0 tx=0x7f68a8009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.794+0000 7f68c4cee640 1 -- 172.21.15.117:0/1392778638 shutdown_connections 2024-04-12T09:23:46.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.794+0000 7f68c4cee640 1 --2- 172.21.15.117:0/1392778638 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68c0101a70 0x7f68c00fb100 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.794+0000 7f68c4cee640 1 --2- 172.21.15.117:0/1392778638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68c01010d0 0x7f68c01014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.794+0000 7f68c4cee640 1 -- 172.21.15.117:0/1392778638 >> 172.21.15.117:0/1392778638 conn(0x7f68c00f6ca0 msgr2=0x7f68c00f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:46.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.794+0000 7f68c4cee640 1 -- 172.21.15.117:0/1392778638 shutdown_connections 2024-04-12T09:23:46.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.794+0000 7f68c4cee640 1 -- 172.21.15.117:0/1392778638 wait complete. 2024-04-12T09:23:46.796 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.794+0000 7f68c4cee640 1 Processor -- start 2024-04-12T09:23:46.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.794+0000 7f68c4cee640 1 -- start start 2024-04-12T09:23:46.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.794+0000 7f68c4cee640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68c01010d0 0x7f68c00fcd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:46.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.794+0000 7f68c4cee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68c0101a70 0x7f68c00fd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:46.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.794+0000 7f68c4cee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c00fec50 con 0x7f68c0101a70 2024-04-12T09:23:46.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.794+0000 7f68c4cee640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c00fd7f0 con 0x7f68c01010d0 2024-04-12T09:23:46.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.794+0000 7f68bdd9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68c0101a70 0x7f68c00fd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:46.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.794+0000 7f68bdd9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68c0101a70 0x7f68c00fd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35388/0 (socket says 172.21.15.117:35388) 2024-04-12T09:23:46.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.794+0000 7f68bdd9b640 1 -- 172.21.15.117:0/2053630725 learned_addr learned my addr 172.21.15.117:0/2053630725 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:46.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.795+0000 7f68bdd9b640 1 -- 172.21.15.117:0/2053630725 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68c01010d0 msgr2=0x7f68c00fcd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:46.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.795+0000 7f68bdd9b640 1 --2- 172.21.15.117:0/2053630725 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68c01010d0 0x7f68c00fcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:46.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.795+0000 7f68bdd9b640 1 -- 172.21.15.117:0/2053630725 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a8005040 con 0x7f68c0101a70 2024-04-12T09:23:46.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.795+0000 7f68bdd9b640 1 --2- 172.21.15.117:0/2053630725 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68c0101a70 0x7f68c00fd2b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f68a8004930 tx=0x7f68a8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:46.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.795+0000 7f68b6ffd640 1 -- 172.21.15.117:0/2053630725 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68a80094c0 con 0x7f68c0101a70 2024-04-12T09:23:46.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.795+0000 7f68c4cee640 1 -- 172.21.15.117:0/2053630725 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c00fda70 con 0x7f68c0101a70 2024-04-12T09:23:46.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.795+0000 7f68b6ffd640 1 -- 172.21.15.117:0/2053630725 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f68a8032e50 con 0x7f68c0101a70 2024-04-12T09:23:46.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.795+0000 7f68b6ffd640 1 -- 172.21.15.117:0/2053630725 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68a80433b0 con 0x7f68c0101a70 2024-04-12T09:23:46.798 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.795+0000 7f68c4cee640 1 -- 172.21.15.117:0/2053630725 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c01193c0 con 0x7f68c0101a70 2024-04-12T09:23:46.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.796+0000 7f68c4cee640 1 -- 172.21.15.117:0/2053630725 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c00fc840 con 0x7f68c0101a70 2024-04-12T09:23:46.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.796+0000 7f68b6ffd640 1 -- 172.21.15.117:0/2053630725 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f68a802f070 con 0x7f68c0101a70 2024-04-12T09:23:46.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.797+0000 7f68b6ffd640 1 --2- 172.21.15.117:0/2053630725 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f68ac06dc10 0x7f68ac0700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:46.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.797+0000 7f68be59c640 1 --2- 172.21.15.117:0/2053630725 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f68ac06dc10 0x7f68ac0700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:46.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.797+0000 7f68b6ffd640 1 -- 172.21.15.117:0/2053630725 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f68a80af440 con 0x7f68c0101a70 2024-04-12T09:23:46.799 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.797+0000 7f68be59c640 1 --2- 172.21.15.117:0/2053630725 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f68ac06dc10 0x7f68ac0700c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f68b8007e40 tx=0x7f68b8004f70 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:46.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:46.802+0000 7f68b6ffd640 1 -- 172.21.15.117:0/2053630725 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f68a8078970 con 0x7f68c0101a70 2024-04-12T09:23:47.011 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.011+0000 7f68c4cee640 1 -- 172.21.15.117:0/2053630725 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f68c0119550 con 0x7f68c0101a70 2024-04-12T09:23:47.012 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.011+0000 7f68b6ffd640 1 -- 172.21.15.117:0/2053630725 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v32) v1 ==== 107+0+4223 (secure 0 0 0) 0x7f68a807c030 con 0x7f68c0101a70 2024-04-12T09:23:47.012 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:47.012 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34372,"name":"cephfs.smithi117.wddsgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6827/2687704577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":2687704577},{"type":"v1","addr":"172.21.15.117:6827","nonce":2687704577}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34404,"name":"cephfs.smithi117.eslmxh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6829/2675574893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":2675574893},{"type":"v1","addr":"172.21.15.117:6829","nonce":2675574893}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T09:08:12.488144+0000","modified":"2024-04-12T09:21:05.266388+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24273":{"gid":24273,"name":"cephfs.smithi203.bszhxz","rank":0,"incarnation":23,"state":"up:replay","state_seq":2,"addr":"172.21.15.203:6827/2731911290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2731911290},{"type":"v1","addr":"172.21.15.203:6827","nonce":2731911290}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T09:23:47.012 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 23 2024-04-12T09:23:47.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.013+0000 7f68c4cee640 1 -- 172.21.15.117:0/2053630725 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f68ac06dc10 msgr2=0x7f68ac0700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:47.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.013+0000 7f68c4cee640 1 --2- 172.21.15.117:0/2053630725 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f68ac06dc10 0x7f68ac0700c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f68b8007e40 tx=0x7f68b8004f70 comp rx=0 tx=0).stop 2024-04-12T09:23:47.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.013+0000 7f68c4cee640 1 -- 172.21.15.117:0/2053630725 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68c0101a70 msgr2=0x7f68c00fd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:47.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.013+0000 7f68c4cee640 1 --2- 172.21.15.117:0/2053630725 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68c0101a70 0x7f68c00fd2b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f68a8004930 tx=0x7f68a8009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:47.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.013+0000 7f68c4cee640 1 -- 172.21.15.117:0/2053630725 shutdown_connections 2024-04-12T09:23:47.014 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.013+0000 7f68c4cee640 1 --2- 172.21.15.117:0/2053630725 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f68ac06dc10 0x7f68ac0700c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:47.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.013+0000 7f68c4cee640 1 --2- 172.21.15.117:0/2053630725 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68c0101a70 0x7f68c00fd2b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:47.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.013+0000 7f68c4cee640 1 --2- 172.21.15.117:0/2053630725 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68c01010d0 0x7f68c00fcd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:47.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.013+0000 7f68c4cee640 1 -- 172.21.15.117:0/2053630725 >> 172.21.15.117:0/2053630725 conn(0x7f68c00f6ca0 msgr2=0x7f68c00f7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:47.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.013+0000 7f68c4cee640 1 -- 172.21.15.117:0/2053630725 shutdown_connections 2024-04-12T09:23:47.015 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.014+0000 7f68c4cee640 1 -- 172.21.15.117:0/2053630725 wait complete. 2024-04-12T09:23:47.024 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:46 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/2121638695' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-12T09:23:47.024 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:46 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/3199547589' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-12T09:23:47.024 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:46 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/2224686272' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-12T09:23:47.025 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-04-12T09:23:47.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:46 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/2121638695' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-12T09:23:47.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:46 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/3199547589' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-12T09:23:47.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:46 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/2224686272' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-12T09:23:47.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.123+0000 7fa605b9d640 1 -- 172.21.15.117:0/4212872602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa600101ff0 msgr2=0x7fa6001023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:47.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.123+0000 7fa605b9d640 1 --2- 172.21.15.117:0/4212872602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa600101ff0 0x7fa6001023c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa5f40048d0 tx=0x7fa5f4009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:47.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.123+0000 7fa605b9d640 1 -- 172.21.15.117:0/4212872602 shutdown_connections 2024-04-12T09:23:47.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.123+0000 7fa605b9d640 1 --2- 172.21.15.117:0/4212872602 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa600102990 0x7fa6000fc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:47.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.123+0000 7fa605b9d640 1 --2- 172.21.15.117:0/4212872602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa600101ff0 0x7fa6001023c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:47.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.123+0000 7fa605b9d640 1 -- 172.21.15.117:0/4212872602 >> 172.21.15.117:0/4212872602 conn(0x7fa6000f7be0 msgr2=0x7fa6000f9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:47.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.123+0000 7fa605b9d640 1 -- 172.21.15.117:0/4212872602 shutdown_connections 2024-04-12T09:23:47.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.123+0000 7fa605b9d640 1 -- 172.21.15.117:0/4212872602 wait complete. 2024-04-12T09:23:47.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.124+0000 7fa605b9d640 1 Processor -- start 2024-04-12T09:23:47.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.124+0000 7fa605b9d640 1 -- start start 2024-04-12T09:23:47.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.124+0000 7fa605b9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa600101ff0 0x7fa600112ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:47.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.124+0000 7fa605b9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa600102990 0x7fa600113010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:47.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.124+0000 7fa605b9d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa600113610 con 0x7fa600101ff0 2024-04-12T09:23:47.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.124+0000 7fa605b9d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60010cc60 con 0x7fa600102990 2024-04-12T09:23:47.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.124+0000 7fa604b9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa600101ff0 0x7fa600112ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:47.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.124+0000 7fa604b9b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa600101ff0 0x7fa600112ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35416/0 (socket says 172.21.15.117:35416) 2024-04-12T09:23:47.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.124+0000 7fa604b9b640 1 -- 172.21.15.117:0/2989944155 learned_addr learned my addr 172.21.15.117:0/2989944155 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:47.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.124+0000 7fa5fffff640 1 --2- 172.21.15.117:0/2989944155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa600102990 0x7fa600113010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:47.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.124+0000 7fa604b9b640 1 -- 172.21.15.117:0/2989944155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa600102990 msgr2=0x7fa600113010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:47.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.124+0000 7fa604b9b640 1 --2- 172.21.15.117:0/2989944155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa600102990 0x7fa600113010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:47.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.124+0000 7fa604b9b640 1 -- 172.21.15.117:0/2989944155 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f4005040 con 0x7fa600101ff0 2024-04-12T09:23:47.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.124+0000 7fa5fffff640 1 --2- 172.21.15.117:0/2989944155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa600102990 0x7fa600113010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T09:23:47.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.125+0000 7fa604b9b640 1 --2- 172.21.15.117:0/2989944155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa600101ff0 0x7fa600112ad0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4004930 tx=0x7fa5f4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:47.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.125+0000 7fa5fd7fa640 1 -- 172.21.15.117:0/2989944155 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5f40094c0 con 0x7fa600101ff0 2024-04-12T09:23:47.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.125+0000 7fa5fd7fa640 1 -- 172.21.15.117:0/2989944155 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa5f4032e50 con 0x7fa600101ff0 2024-04-12T09:23:47.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.125+0000 7fa605b9d640 1 -- 172.21.15.117:0/2989944155 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60010cee0 con 0x7fa600101ff0 2024-04-12T09:23:47.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.125+0000 7fa5fd7fa640 1 -- 172.21.15.117:0/2989944155 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5f40433b0 con 0x7fa600101ff0 2024-04-12T09:23:47.128 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.125+0000 7fa605b9d640 1 -- 172.21.15.117:0/2989944155 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60010d3a0 con 0x7fa600101ff0 2024-04-12T09:23:47.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.126+0000 7fa605b9d640 1 -- 172.21.15.117:0/2989944155 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6000fd760 con 0x7fa600101ff0 2024-04-12T09:23:47.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.126+0000 7fa5fd7fa640 1 -- 172.21.15.117:0/2989944155 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fa5f402f070 con 0x7fa600101ff0 2024-04-12T09:23:47.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.127+0000 7fa5fd7fa640 1 --2- 172.21.15.117:0/2989944155 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fa5f006dc10 0x7fa5f00700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:47.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.127+0000 7fa5fd7fa640 1 -- 172.21.15.117:0/2989944155 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa5f40af3d0 con 0x7fa600101ff0 2024-04-12T09:23:47.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.127+0000 7fa5fffff640 1 --2- 172.21.15.117:0/2989944155 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fa5f006dc10 0x7fa5f00700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:47.129 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.127+0000 7fa5fffff640 1 --2- 172.21.15.117:0/2989944155 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fa5f006dc10 0x7fa5f00700c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec007fd0 tx=0x7fa5ec009e90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:47.131 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.131+0000 7fa5fd7fa640 1 -- 172.21.15.117:0/2989944155 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fa5f4078900 con 0x7fa600101ff0 2024-04-12T09:23:47.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.343+0000 7fa605b9d640 1 -- 172.21.15.117:0/2989944155 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fa60004bcc0 con 0x7fa600101ff0 2024-04-12T09:23:47.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.344+0000 7fa5fd7fa640 1 -- 172.21.15.117:0/2989944155 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v32) v1 ==== 107+0+4228 (secure 0 0 0) 0x7fa5f407bfc0 con 0x7fa600101ff0 2024-04-12T09:23:47.344 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:47.344 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34372,"name":"cephfs.smithi117.wddsgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6827/2687704577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":2687704577},{"type":"v1","addr":"172.21.15.117:6827","nonce":2687704577}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34404,"name":"cephfs.smithi117.eslmxh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6829/2675574893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":2675574893},{"type":"v1","addr":"172.21.15.117:6829","nonce":2675574893}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T09:08:12.488144+0000","modified":"2024-04-12T09:21:14.032453+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24273":{"gid":24273,"name":"cephfs.smithi203.bszhxz","rank":0,"incarnation":23,"state":"up:reconnect","state_seq":194,"addr":"172.21.15.203:6827/2731911290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2731911290},{"type":"v1","addr":"172.21.15.203:6827","nonce":2731911290}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T09:23:47.345 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 24 2024-04-12T09:23:47.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.346+0000 7fa605b9d640 1 -- 172.21.15.117:0/2989944155 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fa5f006dc10 msgr2=0x7fa5f00700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:47.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.346+0000 7fa605b9d640 1 --2- 172.21.15.117:0/2989944155 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fa5f006dc10 0x7fa5f00700c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec007fd0 tx=0x7fa5ec009e90 comp rx=0 tx=0).stop 2024-04-12T09:23:47.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.346+0000 7fa605b9d640 1 -- 172.21.15.117:0/2989944155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa600101ff0 msgr2=0x7fa600112ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:47.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.346+0000 7fa605b9d640 1 --2- 172.21.15.117:0/2989944155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa600101ff0 0x7fa600112ad0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4004930 tx=0x7fa5f4009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:47.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.346+0000 7fa605b9d640 1 -- 172.21.15.117:0/2989944155 shutdown_connections 2024-04-12T09:23:47.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.346+0000 7fa605b9d640 1 --2- 172.21.15.117:0/2989944155 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fa5f006dc10 0x7fa5f00700c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:47.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.346+0000 7fa605b9d640 1 --2- 172.21.15.117:0/2989944155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa600102990 0x7fa600113010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:47.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.346+0000 7fa605b9d640 1 --2- 172.21.15.117:0/2989944155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa600101ff0 0x7fa600112ad0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:47.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.346+0000 7fa605b9d640 1 -- 172.21.15.117:0/2989944155 >> 172.21.15.117:0/2989944155 conn(0x7fa6000f7be0 msgr2=0x7fa6000f8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:47.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.346+0000 7fa605b9d640 1 -- 172.21.15.117:0/2989944155 shutdown_connections 2024-04-12T09:23:47.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.346+0000 7fa605b9d640 1 -- 172.21.15.117:0/2989944155 wait complete. 2024-04-12T09:23:47.358 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-04-12T09:23:47.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.455+0000 7f9cc339d640 1 -- 172.21.15.117:0/366400005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cbc1029d0 msgr2=0x7f9cbc0fc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:47.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.455+0000 7f9cc339d640 1 --2- 172.21.15.117:0/366400005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cbc1029d0 0x7f9cbc0fc060 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0048d0 tx=0x7f9cac009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:47.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.455+0000 7f9cc339d640 1 -- 172.21.15.117:0/366400005 shutdown_connections 2024-04-12T09:23:47.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.455+0000 7f9cc339d640 1 --2- 172.21.15.117:0/366400005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cbc1029d0 0x7f9cbc0fc060 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:47.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.455+0000 7f9cc339d640 1 --2- 172.21.15.117:0/366400005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9cbc102030 0x7f9cbc102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:47.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.455+0000 7f9cc339d640 1 -- 172.21.15.117:0/366400005 >> 172.21.15.117:0/366400005 conn(0x7f9cbc0f7bc0 msgr2=0x7f9cbc0f9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:47.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.455+0000 7f9cc339d640 1 -- 172.21.15.117:0/366400005 shutdown_connections 2024-04-12T09:23:47.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.455+0000 7f9cc339d640 1 -- 172.21.15.117:0/366400005 wait complete. 2024-04-12T09:23:47.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.456+0000 7f9cc339d640 1 Processor -- start 2024-04-12T09:23:47.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.456+0000 7f9cc339d640 1 -- start start 2024-04-12T09:23:47.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.456+0000 7f9cc339d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cbc102030 0x7f9cbc112b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:47.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.456+0000 7f9cc339d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9cbc1029d0 0x7f9cbc1130b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:47.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.456+0000 7f9cc339d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc1136b0 con 0x7f9cbc102030 2024-04-12T09:23:47.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.456+0000 7f9cc339d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc10cd00 con 0x7f9cbc1029d0 2024-04-12T09:23:47.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.456+0000 7f9cc239b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cbc102030 0x7f9cbc112b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:47.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.456+0000 7f9cc239b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cbc102030 0x7f9cbc112b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35430/0 (socket says 172.21.15.117:35430) 2024-04-12T09:23:47.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.456+0000 7f9cc239b640 1 -- 172.21.15.117:0/2832694449 learned_addr learned my addr 172.21.15.117:0/2832694449 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:47.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.456+0000 7f9cc1b9a640 1 --2- 172.21.15.117:0/2832694449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9cbc1029d0 0x7f9cbc1130b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:47.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.456+0000 7f9cc239b640 1 -- 172.21.15.117:0/2832694449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9cbc1029d0 msgr2=0x7f9cbc1130b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:47.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.456+0000 7f9cc239b640 1 --2- 172.21.15.117:0/2832694449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9cbc1029d0 0x7f9cbc1130b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:47.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.456+0000 7f9cc239b640 1 -- 172.21.15.117:0/2832694449 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac005040 con 0x7f9cbc102030 2024-04-12T09:23:47.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.457+0000 7f9cc239b640 1 --2- 172.21.15.117:0/2832694449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cbc102030 0x7f9cbc112b70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800ece0 tx=0x7f9cb800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:47.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.457+0000 7f9cb2ffd640 1 -- 172.21.15.117:0/2832694449 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cb800ee40 con 0x7f9cbc102030 2024-04-12T09:23:47.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.457+0000 7f9cc339d640 1 -- 172.21.15.117:0/2832694449 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cbc10cfe0 con 0x7f9cbc102030 2024-04-12T09:23:47.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.457+0000 7f9cb2ffd640 1 -- 172.21.15.117:0/2832694449 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9cb800f040 con 0x7f9cbc102030 2024-04-12T09:23:47.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.457+0000 7f9cb2ffd640 1 -- 172.21.15.117:0/2832694449 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cb8009750 con 0x7f9cbc102030 2024-04-12T09:23:47.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.457+0000 7f9cc339d640 1 -- 172.21.15.117:0/2832694449 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cbc10d4d0 con 0x7f9cbc102030 2024-04-12T09:23:47.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.458+0000 7f9cc339d640 1 -- 172.21.15.117:0/2832694449 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cbc0fd7a0 con 0x7f9cbc102030 2024-04-12T09:23:47.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.458+0000 7f9cb2ffd640 1 -- 172.21.15.117:0/2832694449 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f9cb8007890 con 0x7f9cbc102030 2024-04-12T09:23:47.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.458+0000 7f9cb2ffd640 1 --2- 172.21.15.117:0/2832694449 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f9ca806dc10 0x7f9ca80700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:47.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.459+0000 7f9cb2ffd640 1 -- 172.21.15.117:0/2832694449 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f9cb808de50 con 0x7f9cbc102030 2024-04-12T09:23:47.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.459+0000 7f9cc1b9a640 1 --2- 172.21.15.117:0/2832694449 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f9ca806dc10 0x7f9ca80700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:47.461 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.459+0000 7f9cc1b9a640 1 --2- 172.21.15.117:0/2832694449 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f9ca806dc10 0x7f9ca80700c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc0fa650 tx=0x7f9cac009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:47.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.463+0000 7f9cb2ffd640 1 -- 172.21.15.117:0/2832694449 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f9cb8057430 con 0x7f9cbc102030 2024-04-12T09:23:47.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.674+0000 7f9cc339d640 1 -- 172.21.15.117:0/2832694449 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f9cbc10e1e0 con 0x7f9cbc102030 2024-04-12T09:23:47.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.675+0000 7f9cb2ffd640 1 -- 172.21.15.117:0/2832694449 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v32) v1 ==== 107+0+4225 (secure 0 0 0) 0x7f9cb805aaf0 con 0x7f9cbc102030 2024-04-12T09:23:47.676 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:47.676 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34372,"name":"cephfs.smithi117.wddsgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6827/2687704577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":2687704577},{"type":"v1","addr":"172.21.15.117:6827","nonce":2687704577}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34404,"name":"cephfs.smithi117.eslmxh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6829/2675574893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":2675574893},{"type":"v1","addr":"172.21.15.117:6829","nonce":2675574893}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T09:08:12.488144+0000","modified":"2024-04-12T09:21:14.717924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24273":{"gid":24273,"name":"cephfs.smithi203.bszhxz","rank":0,"incarnation":23,"state":"up:rejoin","state_seq":195,"addr":"172.21.15.203:6827/2731911290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2731911290},{"type":"v1","addr":"172.21.15.203:6827","nonce":2731911290}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T09:23:47.676 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 25 2024-04-12T09:23:47.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.677+0000 7f9cc339d640 1 -- 172.21.15.117:0/2832694449 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f9ca806dc10 msgr2=0x7f9ca80700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:47.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.677+0000 7f9cc339d640 1 --2- 172.21.15.117:0/2832694449 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f9ca806dc10 0x7f9ca80700c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc0fa650 tx=0x7f9cac009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:47.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.677+0000 7f9cc339d640 1 -- 172.21.15.117:0/2832694449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cbc102030 msgr2=0x7f9cbc112b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:47.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.677+0000 7f9cc339d640 1 --2- 172.21.15.117:0/2832694449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cbc102030 0x7f9cbc112b70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800ece0 tx=0x7f9cb800b040 comp rx=0 tx=0).stop 2024-04-12T09:23:47.678 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.677+0000 7f9cc339d640 1 -- 172.21.15.117:0/2832694449 shutdown_connections 2024-04-12T09:23:47.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.677+0000 7f9cc339d640 1 --2- 172.21.15.117:0/2832694449 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f9ca806dc10 0x7f9ca80700c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:47.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.677+0000 7f9cc339d640 1 --2- 172.21.15.117:0/2832694449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9cbc1029d0 0x7f9cbc1130b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:47.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.677+0000 7f9cc339d640 1 --2- 172.21.15.117:0/2832694449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9cbc102030 0x7f9cbc112b70 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:47.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.677+0000 7f9cc339d640 1 -- 172.21.15.117:0/2832694449 >> 172.21.15.117:0/2832694449 conn(0x7f9cbc0f7bc0 msgr2=0x7f9cbc0f8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:47.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.677+0000 7f9cc339d640 1 -- 172.21.15.117:0/2832694449 shutdown_connections 2024-04-12T09:23:47.679 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.677+0000 7f9cc339d640 1 -- 172.21.15.117:0/2832694449 wait complete. 2024-04-12T09:23:47.689 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-04-12T09:23:47.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.789+0000 7f29fc8ee640 1 -- 172.21.15.117:0/2477565160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29f81012e0 msgr2=0x7f29f81016b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:47.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.789+0000 7f29fc8ee640 1 --2- 172.21.15.117:0/2477565160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29f81012e0 0x7f29f81016b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f29e80048d0 tx=0x7f29e8009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:47.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.789+0000 7f29fc8ee640 1 -- 172.21.15.117:0/2477565160 shutdown_connections 2024-04-12T09:23:47.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.789+0000 7f29fc8ee640 1 --2- 172.21.15.117:0/2477565160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29f8101c80 0x7f29f80fb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:47.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.789+0000 7f29fc8ee640 1 --2- 172.21.15.117:0/2477565160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29f81012e0 0x7f29f81016b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:47.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.789+0000 7f29fc8ee640 1 -- 172.21.15.117:0/2477565160 >> 172.21.15.117:0/2477565160 conn(0x7f29f80f6eb0 msgr2=0x7f29f80f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:47.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.789+0000 7f29fc8ee640 1 -- 172.21.15.117:0/2477565160 shutdown_connections 2024-04-12T09:23:47.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.789+0000 7f29fc8ee640 1 -- 172.21.15.117:0/2477565160 wait complete. 2024-04-12T09:23:47.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.789+0000 7f29fc8ee640 1 Processor -- start 2024-04-12T09:23:47.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.789+0000 7f29fc8ee640 1 -- start start 2024-04-12T09:23:47.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.790+0000 7f29fc8ee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29f81012e0 0x7f29f810e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:47.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.790+0000 7f29fc8ee640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29f8101c80 0x7f29f810e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:47.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.790+0000 7f29fc8ee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f810ebc0 con 0x7f29f81012e0 2024-04-12T09:23:47.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.790+0000 7f29fc8ee640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f810ed30 con 0x7f29f8101c80 2024-04-12T09:23:47.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.790+0000 7f29f659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29f81012e0 0x7f29f810e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:47.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.790+0000 7f29f659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29f81012e0 0x7f29f810e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35448/0 (socket says 172.21.15.117:35448) 2024-04-12T09:23:47.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.790+0000 7f29f659c640 1 -- 172.21.15.117:0/3156325092 learned_addr learned my addr 172.21.15.117:0/3156325092 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:47.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.790+0000 7f29effff640 1 --2- 172.21.15.117:0/3156325092 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29f8101c80 0x7f29f810e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:47.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.790+0000 7f29f659c640 1 -- 172.21.15.117:0/3156325092 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29f8101c80 msgr2=0x7f29f810e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:47.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.790+0000 7f29f659c640 1 --2- 172.21.15.117:0/3156325092 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29f8101c80 0x7f29f810e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:47.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.790+0000 7f29f659c640 1 -- 172.21.15.117:0/3156325092 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e8005040 con 0x7f29f81012e0 2024-04-12T09:23:47.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.790+0000 7f29effff640 1 --2- 172.21.15.117:0/3156325092 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29f8101c80 0x7f29f810e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T09:23:47.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.790+0000 7f29f659c640 1 --2- 172.21.15.117:0/3156325092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29f81012e0 0x7f29f810e140 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f29e8004930 tx=0x7f29e8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:47.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.790+0000 7f29eeffd640 1 -- 172.21.15.117:0/3156325092 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29e80094c0 con 0x7f29f81012e0 2024-04-12T09:23:47.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.790+0000 7f29eeffd640 1 -- 172.21.15.117:0/3156325092 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f29e8032e50 con 0x7f29f81012e0 2024-04-12T09:23:47.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.790+0000 7f29fc8ee640 1 -- 172.21.15.117:0/3156325092 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f810efb0 con 0x7f29f81012e0 2024-04-12T09:23:47.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.790+0000 7f29eeffd640 1 -- 172.21.15.117:0/3156325092 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29e80433b0 con 0x7f29f81012e0 2024-04-12T09:23:47.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.790+0000 7f29fc8ee640 1 -- 172.21.15.117:0/3156325092 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f8117460 con 0x7f29f81012e0 2024-04-12T09:23:47.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.791+0000 7f29fc8ee640 1 -- 172.21.15.117:0/3156325092 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f80fca50 con 0x7f29f81012e0 2024-04-12T09:23:47.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.792+0000 7f29eeffd640 1 -- 172.21.15.117:0/3156325092 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f29e802f070 con 0x7f29f81012e0 2024-04-12T09:23:47.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.792+0000 7f29eeffd640 1 --2- 172.21.15.117:0/3156325092 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f29e406dc10 0x7f29e40700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:47.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.792+0000 7f29effff640 1 --2- 172.21.15.117:0/3156325092 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f29e406dc10 0x7f29e40700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:47.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.792+0000 7f29eeffd640 1 -- 172.21.15.117:0/3156325092 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f29e80af3a0 con 0x7f29f81012e0 2024-04-12T09:23:47.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.793+0000 7f29effff640 1 --2- 172.21.15.117:0/3156325092 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f29e406dc10 0x7f29e40700c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f29e0006fd0 tx=0x7f29e0008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:47.797 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:47.797+0000 7f29eeffd640 1 -- 172.21.15.117:0/3156325092 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f29e80788d0 con 0x7f29f81012e0 2024-04-12T09:23:48.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.006+0000 7f29fc8ee640 1 -- 172.21.15.117:0/3156325092 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f29f810efb0 con 0x7f29f81012e0 2024-04-12T09:23:48.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.007+0000 7f29eeffd640 1 -- 172.21.15.117:0/3156325092 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v32) v1 ==== 107+0+5084 (secure 0 0 0) 0x7f29f810efb0 con 0x7f29f81012e0 2024-04-12T09:23:48.008 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:48.008 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34372,"name":"cephfs.smithi117.wddsgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6827/2687704577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":2687704577},{"type":"v1","addr":"172.21.15.117:6827","nonce":2687704577}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34404,"name":"cephfs.smithi117.eslmxh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6829/2675574893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":2675574893},{"type":"v1","addr":"172.21.15.117:6829","nonce":2675574893}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44311,"name":"cephfs.smithi203.fbeixl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6825/3346773589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3346773589},{"type":"v1","addr":"172.21.15.203:6825","nonce":3346773589}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T09:08:12.488144+0000","modified":"2024-04-12T09:21:16.721263+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24273":{"gid":24273,"name":"cephfs.smithi203.bszhxz","rank":0,"incarnation":23,"state":"up:active","state_seq":196,"addr":"172.21.15.203:6827/2731911290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2731911290},{"type":"v1","addr":"172.21.15.203:6827","nonce":2731911290}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24273,"qdb_cluster":[24273]},"id":1}]} 2024-04-12T09:23:48.008 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 26 2024-04-12T09:23:48.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.009+0000 7f29fc8ee640 1 -- 172.21.15.117:0/3156325092 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f29e406dc10 msgr2=0x7f29e40700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:48.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.009+0000 7f29fc8ee640 1 --2- 172.21.15.117:0/3156325092 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f29e406dc10 0x7f29e40700c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f29e0006fd0 tx=0x7f29e0008040 comp rx=0 tx=0).stop 2024-04-12T09:23:48.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.009+0000 7f29fc8ee640 1 -- 172.21.15.117:0/3156325092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29f81012e0 msgr2=0x7f29f810e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:48.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.009+0000 7f29fc8ee640 1 --2- 172.21.15.117:0/3156325092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29f81012e0 0x7f29f810e140 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f29e8004930 tx=0x7f29e8009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.009+0000 7f29fc8ee640 1 -- 172.21.15.117:0/3156325092 shutdown_connections 2024-04-12T09:23:48.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.009+0000 7f29fc8ee640 1 --2- 172.21.15.117:0/3156325092 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f29e406dc10 0x7f29e40700c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.009+0000 7f29fc8ee640 1 --2- 172.21.15.117:0/3156325092 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29f8101c80 0x7f29f810e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.009+0000 7f29fc8ee640 1 --2- 172.21.15.117:0/3156325092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f29f81012e0 0x7f29f810e140 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.009+0000 7f29fc8ee640 1 -- 172.21.15.117:0/3156325092 >> 172.21.15.117:0/3156325092 conn(0x7f29f80f6eb0 msgr2=0x7f29f80f7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:48.010 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.009+0000 7f29fc8ee640 1 -- 172.21.15.117:0/3156325092 shutdown_connections 2024-04-12T09:23:48.011 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.009+0000 7f29fc8ee640 1 -- 172.21.15.117:0/3156325092 wait complete. 2024-04-12T09:23:48.019 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:47 smithi117 ceph-mon[113571]: pgmap v273: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:48.019 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:47 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/2053630725' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-12T09:23:48.019 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:47 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/2989944155' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-12T09:23:48.020 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:47 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/2832694449' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-12T09:23:48.021 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-04-12T09:23:48.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:47 smithi203 ceph-mon[86783]: pgmap v273: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:48.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:47 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/2053630725' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-12T09:23:48.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:47 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/2989944155' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-12T09:23:48.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:47 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/2832694449' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-12T09:23:48.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.118+0000 7fab998ee640 1 -- 172.21.15.117:0/3925346129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab94102b90 msgr2=0x7fab940fc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:48.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.118+0000 7fab998ee640 1 --2- 172.21.15.117:0/3925346129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab94102b90 0x7fab940fc220 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fab880048d0 tx=0x7fab88009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.118+0000 7fab998ee640 1 -- 172.21.15.117:0/3925346129 shutdown_connections 2024-04-12T09:23:48.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.118+0000 7fab998ee640 1 --2- 172.21.15.117:0/3925346129 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab94102b90 0x7fab940fc220 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.118+0000 7fab998ee640 1 --2- 172.21.15.117:0/3925346129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab941021f0 0x7fab941025c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.118+0000 7fab998ee640 1 -- 172.21.15.117:0/3925346129 >> 172.21.15.117:0/3925346129 conn(0x7fab940f7dc0 msgr2=0x7fab940fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:48.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.118+0000 7fab998ee640 1 -- 172.21.15.117:0/3925346129 shutdown_connections 2024-04-12T09:23:48.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.118+0000 7fab998ee640 1 -- 172.21.15.117:0/3925346129 wait complete. 2024-04-12T09:23:48.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.119+0000 7fab998ee640 1 Processor -- start 2024-04-12T09:23:48.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.119+0000 7fab998ee640 1 -- start start 2024-04-12T09:23:48.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.119+0000 7fab998ee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab941021f0 0x7fab94112cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:48.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.119+0000 7fab998ee640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab94102b90 0x7fab94113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:48.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.119+0000 7fab998ee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab94113830 con 0x7fab941021f0 2024-04-12T09:23:48.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.119+0000 7fab998ee640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9410ce80 con 0x7fab94102b90 2024-04-12T09:23:48.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.119+0000 7fab92ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab941021f0 0x7fab94112cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:48.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.119+0000 7fab92ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab941021f0 0x7fab94112cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35458/0 (socket says 172.21.15.117:35458) 2024-04-12T09:23:48.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.119+0000 7fab92ffd640 1 -- 172.21.15.117:0/2060822559 learned_addr learned my addr 172.21.15.117:0/2060822559 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:48.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.119+0000 7fab927fc640 1 --2- 172.21.15.117:0/2060822559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab94102b90 0x7fab94113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:48.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.119+0000 7fab92ffd640 1 -- 172.21.15.117:0/2060822559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab94102b90 msgr2=0x7fab94113230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:48.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.119+0000 7fab92ffd640 1 --2- 172.21.15.117:0/2060822559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab94102b90 0x7fab94113230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.119+0000 7fab92ffd640 1 -- 172.21.15.117:0/2060822559 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab88005040 con 0x7fab941021f0 2024-04-12T09:23:48.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.119+0000 7fab927fc640 1 --2- 172.21.15.117:0/2060822559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab94102b90 0x7fab94113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T09:23:48.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.120+0000 7fab92ffd640 1 --2- 172.21.15.117:0/2060822559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab941021f0 0x7fab94112cf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fab8400cae0 tx=0x7fab84007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:48.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.120+0000 7fab7b7fe640 1 -- 172.21.15.117:0/2060822559 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab8400ab00 con 0x7fab941021f0 2024-04-12T09:23:48.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.120+0000 7fab7b7fe640 1 -- 172.21.15.117:0/2060822559 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab8400ac60 con 0x7fab941021f0 2024-04-12T09:23:48.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.120+0000 7fab998ee640 1 -- 172.21.15.117:0/2060822559 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab9410d160 con 0x7fab941021f0 2024-04-12T09:23:48.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.120+0000 7fab7b7fe640 1 -- 172.21.15.117:0/2060822559 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab840116f0 con 0x7fab941021f0 2024-04-12T09:23:48.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.120+0000 7fab998ee640 1 -- 172.21.15.117:0/2060822559 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab9410d650 con 0x7fab941021f0 2024-04-12T09:23:48.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.121+0000 7fab998ee640 1 -- 172.21.15.117:0/2060822559 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab940fd960 con 0x7fab941021f0 2024-04-12T09:23:48.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.121+0000 7fab7b7fe640 1 -- 172.21.15.117:0/2060822559 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fab84012440 con 0x7fab941021f0 2024-04-12T09:23:48.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.122+0000 7fab7b7fe640 1 --2- 172.21.15.117:0/2060822559 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fab7c06dc10 0x7fab7c0700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:48.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.122+0000 7fab927fc640 1 --2- 172.21.15.117:0/2060822559 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fab7c06dc10 0x7fab7c0700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:48.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.122+0000 7fab7b7fe640 1 -- 172.21.15.117:0/2060822559 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fab8408ded0 con 0x7fab941021f0 2024-04-12T09:23:48.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.122+0000 7fab927fc640 1 --2- 172.21.15.117:0/2060822559 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fab7c06dc10 0x7fab7c0700c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fab940fa7f0 tx=0x7fab88009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:48.126 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.126+0000 7fab7b7fe640 1 -- 172.21.15.117:0/2060822559 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fab84057400 con 0x7fab941021f0 2024-04-12T09:23:48.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.335+0000 7fab998ee640 1 -- 172.21.15.117:0/2060822559 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7fab9410e360 con 0x7fab941021f0 2024-04-12T09:23:48.336 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.336+0000 7fab7b7fe640 1 -- 172.21.15.117:0/2060822559 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v32) v1 ==== 107+0+4280 (secure 0 0 0) 0x7fab8405aac0 con 0x7fab941021f0 2024-04-12T09:23:48.336 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:48.336 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34372,"name":"cephfs.smithi117.wddsgt","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6827/2687704577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":2687704577},{"type":"v1","addr":"172.21.15.117:6827","nonce":2687704577}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34404,"name":"cephfs.smithi117.eslmxh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6829/2675574893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":2675574893},{"type":"v1","addr":"172.21.15.117:6829","nonce":2675574893}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44311,"name":"cephfs.smithi203.fbeixl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6825/3346773589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3346773589},{"type":"v1","addr":"172.21.15.203:6825","nonce":3346773589}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T09:08:12.488144+0000","modified":"2024-04-12T09:21:27.299469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T09:23:48.337 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 27 2024-04-12T09:23:48.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.338+0000 7fab998ee640 1 -- 172.21.15.117:0/2060822559 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fab7c06dc10 msgr2=0x7fab7c0700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:48.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.338+0000 7fab998ee640 1 --2- 172.21.15.117:0/2060822559 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fab7c06dc10 0x7fab7c0700c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fab940fa7f0 tx=0x7fab88009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.338+0000 7fab998ee640 1 -- 172.21.15.117:0/2060822559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab941021f0 msgr2=0x7fab94112cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:48.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.338+0000 7fab998ee640 1 --2- 172.21.15.117:0/2060822559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab941021f0 0x7fab94112cf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fab8400cae0 tx=0x7fab84007e50 comp rx=0 tx=0).stop 2024-04-12T09:23:48.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.338+0000 7fab998ee640 1 -- 172.21.15.117:0/2060822559 shutdown_connections 2024-04-12T09:23:48.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.338+0000 7fab998ee640 1 --2- 172.21.15.117:0/2060822559 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fab7c06dc10 0x7fab7c0700c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.338+0000 7fab998ee640 1 --2- 172.21.15.117:0/2060822559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab94102b90 0x7fab94113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.338+0000 7fab998ee640 1 --2- 172.21.15.117:0/2060822559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fab941021f0 0x7fab94112cf0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.338+0000 7fab998ee640 1 -- 172.21.15.117:0/2060822559 >> 172.21.15.117:0/2060822559 conn(0x7fab940f7dc0 msgr2=0x7fab940f8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:48.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.338+0000 7fab998ee640 1 -- 172.21.15.117:0/2060822559 shutdown_connections 2024-04-12T09:23:48.339 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.338+0000 7fab998ee640 1 -- 172.21.15.117:0/2060822559 wait complete. 2024-04-12T09:23:48.349 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-04-12T09:23:48.449 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.447+0000 7f9c19eee640 1 -- 172.21.15.117:0/267555583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c140fb110 msgr2=0x7f9c140fb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:48.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.447+0000 7f9c19eee640 1 --2- 172.21.15.117:0/267555583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c140fb110 0x7f9c140fb560 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9c080048d0 tx=0x7f9c08009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.447+0000 7f9c19eee640 1 -- 172.21.15.117:0/267555583 shutdown_connections 2024-04-12T09:23:48.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.447+0000 7f9c19eee640 1 --2- 172.21.15.117:0/267555583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c140fb110 0x7f9c140fb560 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.447+0000 7f9c19eee640 1 --2- 172.21.15.117:0/267555583 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c14101140 0x7f9c14101510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.447+0000 7f9c19eee640 1 -- 172.21.15.117:0/267555583 >> 172.21.15.117:0/267555583 conn(0x7f9c140710b0 msgr2=0x7f9c140714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:48.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.447+0000 7f9c19eee640 1 -- 172.21.15.117:0/267555583 shutdown_connections 2024-04-12T09:23:48.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.447+0000 7f9c19eee640 1 -- 172.21.15.117:0/267555583 wait complete. 2024-04-12T09:23:48.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.447+0000 7f9c19eee640 1 Processor -- start 2024-04-12T09:23:48.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.448+0000 7f9c19eee640 1 -- start start 2024-04-12T09:23:48.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.448+0000 7f9c19eee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c140fb110 0x7f9c1410df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:48.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.448+0000 7f9c19eee640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c14101140 0x7f9c1410e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:48.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.448+0000 7f9c19eee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1410e9b0 con 0x7f9c140fb110 2024-04-12T09:23:48.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.448+0000 7f9c19eee640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1410eb20 con 0x7f9c14101140 2024-04-12T09:23:48.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.448+0000 7f9c137fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c140fb110 0x7f9c1410df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:48.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.448+0000 7f9c137fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c140fb110 0x7f9c1410df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35480/0 (socket says 172.21.15.117:35480) 2024-04-12T09:23:48.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.448+0000 7f9c137fe640 1 -- 172.21.15.117:0/2740930261 learned_addr learned my addr 172.21.15.117:0/2740930261 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:48.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.448+0000 7f9c12ffd640 1 --2- 172.21.15.117:0/2740930261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c14101140 0x7f9c1410e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:48.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.448+0000 7f9c137fe640 1 -- 172.21.15.117:0/2740930261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c14101140 msgr2=0x7f9c1410e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:48.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.448+0000 7f9c137fe640 1 --2- 172.21.15.117:0/2740930261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c14101140 0x7f9c1410e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.448+0000 7f9c137fe640 1 -- 172.21.15.117:0/2740930261 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c08005040 con 0x7f9c140fb110 2024-04-12T09:23:48.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.448+0000 7f9c137fe640 1 --2- 172.21.15.117:0/2740930261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c140fb110 0x7f9c1410df30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9c0400b790 tx=0x7f9c040091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:48.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.449+0000 7f9bfbfff640 1 -- 172.21.15.117:0/2740930261 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c0400c700 con 0x7f9c140fb110 2024-04-12T09:23:48.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.449+0000 7f9bfbfff640 1 -- 172.21.15.117:0/2740930261 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9c0400cd30 con 0x7f9c140fb110 2024-04-12T09:23:48.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.449+0000 7f9c19eee640 1 -- 172.21.15.117:0/2740930261 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c14116fa0 con 0x7f9c140fb110 2024-04-12T09:23:48.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.449+0000 7f9bfbfff640 1 -- 172.21.15.117:0/2740930261 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c04013370 con 0x7f9c140fb110 2024-04-12T09:23:48.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.449+0000 7f9c19eee640 1 -- 172.21.15.117:0/2740930261 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c141172d0 con 0x7f9c140fb110 2024-04-12T09:23:48.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.450+0000 7f9c19eee640 1 -- 172.21.15.117:0/2740930261 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c140fc800 con 0x7f9c140fb110 2024-04-12T09:23:48.452 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.450+0000 7f9bfbfff640 1 -- 172.21.15.117:0/2740930261 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f9c04012070 con 0x7f9c140fb110 2024-04-12T09:23:48.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.450+0000 7f9bfbfff640 1 --2- 172.21.15.117:0/2740930261 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f9bfc06dc10 0x7f9bfc0700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:48.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.450+0000 7f9bfbfff640 1 -- 172.21.15.117:0/2740930261 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f9c0408d1d0 con 0x7f9c140fb110 2024-04-12T09:23:48.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.450+0000 7f9c12ffd640 1 --2- 172.21.15.117:0/2740930261 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f9bfc06dc10 0x7f9bfc0700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:48.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.451+0000 7f9c12ffd640 1 --2- 172.21.15.117:0/2740930261 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f9bfc06dc10 0x7f9bfc0700c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9c080043d0 tx=0x7f9c08009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:48.455 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.455+0000 7f9bfbfff640 1 -- 172.21.15.117:0/2740930261 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f9c04056700 con 0x7f9c140fb110 2024-04-12T09:23:48.671 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.671+0000 7f9c19eee640 1 -- 172.21.15.117:0/2740930261 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f9c1404bcc0 con 0x7f9c140fb110 2024-04-12T09:23:48.672 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.671+0000 7f9bfbfff640 1 -- 172.21.15.117:0/2740930261 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v32) v1 ==== 107+0+4359 (secure 0 0 0) 0x7f9c04059dc0 con 0x7f9c140fb110 2024-04-12T09:23:48.672 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:48.672 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi117.eslmxh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6829/2675574893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":2675574893},{"type":"v1","addr":"172.21.15.117:6829","nonce":2675574893}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44311,"name":"cephfs.smithi203.fbeixl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6825/3346773589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3346773589},{"type":"v1","addr":"172.21.15.203:6825","nonce":3346773589}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T09:08:12.488144+0000","modified":"2024-04-12T09:21:27.304904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34372":{"gid":34372,"name":"cephfs.smithi117.wddsgt","rank":0,"incarnation":28,"state":"up:replay","state_seq":1,"addr":"172.21.15.117:6827/2687704577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":2687704577},{"type":"v1","addr":"172.21.15.117:6827","nonce":2687704577}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T09:23:48.672 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 28 2024-04-12T09:23:48.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.673+0000 7f9c19eee640 1 -- 172.21.15.117:0/2740930261 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f9bfc06dc10 msgr2=0x7f9bfc0700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:48.674 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.673+0000 7f9c19eee640 1 --2- 172.21.15.117:0/2740930261 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f9bfc06dc10 0x7f9bfc0700c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9c080043d0 tx=0x7f9c08009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.673+0000 7f9c19eee640 1 -- 172.21.15.117:0/2740930261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c140fb110 msgr2=0x7f9c1410df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:48.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.673+0000 7f9c19eee640 1 --2- 172.21.15.117:0/2740930261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c140fb110 0x7f9c1410df30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9c0400b790 tx=0x7f9c040091d0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.674+0000 7f9c19eee640 1 -- 172.21.15.117:0/2740930261 shutdown_connections 2024-04-12T09:23:48.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.674+0000 7f9c19eee640 1 --2- 172.21.15.117:0/2740930261 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f9bfc06dc10 0x7f9bfc0700c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.674+0000 7f9c19eee640 1 --2- 172.21.15.117:0/2740930261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c14101140 0x7f9c1410e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.674+0000 7f9c19eee640 1 --2- 172.21.15.117:0/2740930261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c140fb110 0x7f9c1410df30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.674+0000 7f9c19eee640 1 -- 172.21.15.117:0/2740930261 >> 172.21.15.117:0/2740930261 conn(0x7f9c140710b0 msgr2=0x7f9c140f9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:48.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.674+0000 7f9c19eee640 1 -- 172.21.15.117:0/2740930261 shutdown_connections 2024-04-12T09:23:48.675 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.674+0000 7f9c19eee640 1 -- 172.21.15.117:0/2740930261 wait complete. 2024-04-12T09:23:48.685 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-04-12T09:23:48.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.784+0000 7fd4e7fff640 1 -- 172.21.15.117:0/341717206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4e8102010 msgr2=0x7fd4e81023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:48.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.784+0000 7fd4e7fff640 1 --2- 172.21.15.117:0/341717206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4e8102010 0x7fd4e81023e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80048d0 tx=0x7fd4d8009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.784+0000 7fd4e7fff640 1 -- 172.21.15.117:0/341717206 shutdown_connections 2024-04-12T09:23:48.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.784+0000 7fd4e7fff640 1 --2- 172.21.15.117:0/341717206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4e81029b0 0x7fd4e80fc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.784+0000 7fd4e7fff640 1 --2- 172.21.15.117:0/341717206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4e8102010 0x7fd4e81023e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.786 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.784+0000 7fd4e7fff640 1 -- 172.21.15.117:0/341717206 >> 172.21.15.117:0/341717206 conn(0x7fd4e80f7c20 msgr2=0x7fd4e80fa030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:48.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.784+0000 7fd4e7fff640 1 -- 172.21.15.117:0/341717206 shutdown_connections 2024-04-12T09:23:48.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.784+0000 7fd4e7fff640 1 -- 172.21.15.117:0/341717206 wait complete. 2024-04-12T09:23:48.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.785+0000 7fd4e7fff640 1 Processor -- start 2024-04-12T09:23:48.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.785+0000 7fd4e7fff640 1 -- start start 2024-04-12T09:23:48.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.785+0000 7fd4e7fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4e8102010 0x7fd4e8112b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:48.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.785+0000 7fd4e7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4e81029b0 0x7fd4e81130d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:48.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.785+0000 7fd4e7fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e8113760 con 0x7fd4e81029b0 2024-04-12T09:23:48.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.785+0000 7fd4e7fff640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e810cd20 con 0x7fd4e8102010 2024-04-12T09:23:48.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.785+0000 7fd4e67fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4e81029b0 0x7fd4e81130d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:48.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.785+0000 7fd4e67fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4e81029b0 0x7fd4e81130d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35496/0 (socket says 172.21.15.117:35496) 2024-04-12T09:23:48.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.785+0000 7fd4e67fc640 1 -- 172.21.15.117:0/830549937 learned_addr learned my addr 172.21.15.117:0/830549937 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:48.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.785+0000 7fd4e67fc640 1 -- 172.21.15.117:0/830549937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4e8102010 msgr2=0x7fd4e8112b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:48.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.785+0000 7fd4e67fc640 1 --2- 172.21.15.117:0/830549937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4e8102010 0x7fd4e8112b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:48.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.785+0000 7fd4e67fc640 1 -- 172.21.15.117:0/830549937 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d8005040 con 0x7fd4e81029b0 2024-04-12T09:23:48.787 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.785+0000 7fd4e67fc640 1 --2- 172.21.15.117:0/830549937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4e81029b0 0x7fd4e81130d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00b790 tx=0x7fd4dc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:48.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.786+0000 7fd4cf7fe640 1 -- 172.21.15.117:0/830549937 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4dc00c700 con 0x7fd4e81029b0 2024-04-12T09:23:48.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.786+0000 7fd4e7fff640 1 -- 172.21.15.117:0/830549937 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e810d000 con 0x7fd4e81029b0 2024-04-12T09:23:48.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.786+0000 7fd4cf7fe640 1 -- 172.21.15.117:0/830549937 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd4dc00cd30 con 0x7fd4e81029b0 2024-04-12T09:23:48.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.786+0000 7fd4cf7fe640 1 -- 172.21.15.117:0/830549937 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4dc013370 con 0x7fd4e81029b0 2024-04-12T09:23:48.788 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.786+0000 7fd4e7fff640 1 -- 172.21.15.117:0/830549937 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e810d520 con 0x7fd4e81029b0 2024-04-12T09:23:48.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.787+0000 7fd4e7fff640 1 -- 172.21.15.117:0/830549937 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e80fd780 con 0x7fd4e81029b0 2024-04-12T09:23:48.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.787+0000 7fd4cf7fe640 1 -- 172.21.15.117:0/830549937 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fd4dc012070 con 0x7fd4e81029b0 2024-04-12T09:23:48.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.787+0000 7fd4cf7fe640 1 --2- 172.21.15.117:0/830549937 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fd4d006dc10 0x7fd4d00700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:48.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.788+0000 7fd4cf7fe640 1 -- 172.21.15.117:0/830549937 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fd4dc08d230 con 0x7fd4e81029b0 2024-04-12T09:23:48.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.788+0000 7fd4e6ffd640 1 --2- 172.21.15.117:0/830549937 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fd4d006dc10 0x7fd4d00700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:48.789 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.788+0000 7fd4e6ffd640 1 --2- 172.21.15.117:0/830549937 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fd4d006dc10 0x7fd4d00700c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80043d0 tx=0x7fd4d8009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:48.792 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:48.792+0000 7fd4cf7fe640 1 -- 172.21.15.117:0/830549937 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fd4dc056760 con 0x7fd4e81029b0 2024-04-12T09:23:49.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.001+0000 7fd4e7fff640 1 -- 172.21.15.117:0/830549937 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7fd4e8109200 con 0x7fd4e81029b0 2024-04-12T09:23:49.002 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.002+0000 7fd4cf7fe640 1 -- 172.21.15.117:0/830549937 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v32) v1 ==== 107+0+4363 (secure 0 0 0) 0x7fd4dc059e20 con 0x7fd4e81029b0 2024-04-12T09:23:49.003 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:49.003 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi117.eslmxh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6829/2675574893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":2675574893},{"type":"v1","addr":"172.21.15.117:6829","nonce":2675574893}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44311,"name":"cephfs.smithi203.fbeixl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6825/3346773589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3346773589},{"type":"v1","addr":"172.21.15.203:6825","nonce":3346773589}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T09:08:12.488144+0000","modified":"2024-04-12T09:21:36.067756+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34372":{"gid":34372,"name":"cephfs.smithi117.wddsgt","rank":0,"incarnation":28,"state":"up:reconnect","state_seq":18,"addr":"172.21.15.117:6827/2687704577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":2687704577},{"type":"v1","addr":"172.21.15.117:6827","nonce":2687704577}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T09:23:49.003 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 29 2024-04-12T09:23:49.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.004+0000 7fd4e7fff640 1 -- 172.21.15.117:0/830549937 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fd4d006dc10 msgr2=0x7fd4d00700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:49.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.004+0000 7fd4e7fff640 1 --2- 172.21.15.117:0/830549937 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fd4d006dc10 0x7fd4d00700c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80043d0 tx=0x7fd4d8009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.004+0000 7fd4e7fff640 1 -- 172.21.15.117:0/830549937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4e81029b0 msgr2=0x7fd4e81130d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:49.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.004+0000 7fd4e7fff640 1 --2- 172.21.15.117:0/830549937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4e81029b0 0x7fd4e81130d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00b790 tx=0x7fd4dc0091d0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.004+0000 7fd4e7fff640 1 -- 172.21.15.117:0/830549937 shutdown_connections 2024-04-12T09:23:49.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.004+0000 7fd4e7fff640 1 --2- 172.21.15.117:0/830549937 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fd4d006dc10 0x7fd4d00700c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.004+0000 7fd4e7fff640 1 --2- 172.21.15.117:0/830549937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4e81029b0 0x7fd4e81130d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.004+0000 7fd4e7fff640 1 --2- 172.21.15.117:0/830549937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4e8102010 0x7fd4e8112b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.004+0000 7fd4e7fff640 1 -- 172.21.15.117:0/830549937 >> 172.21.15.117:0/830549937 conn(0x7fd4e80f7c20 msgr2=0x7fd4e80f8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:49.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.004+0000 7fd4e7fff640 1 -- 172.21.15.117:0/830549937 shutdown_connections 2024-04-12T09:23:49.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.004+0000 7fd4e7fff640 1 -- 172.21.15.117:0/830549937 wait complete. 2024-04-12T09:23:49.014 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:48 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/3156325092' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-12T09:23:49.014 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:48 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/2060822559' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-12T09:23:49.014 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:48 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/2740930261' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-12T09:23:49.016 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-04-12T09:23:49.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:48 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/3156325092' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-12T09:23:49.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:48 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/2060822559' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-12T09:23:49.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:48 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/2740930261' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-12T09:23:49.118 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.114+0000 7feb5f39d640 1 -- 172.21.15.117:0/596587429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb581018b0 msgr2=0x7feb580faf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:49.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.114+0000 7feb5f39d640 1 --2- 172.21.15.117:0/596587429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb581018b0 0x7feb580faf40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7feb480048d0 tx=0x7feb48009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.115+0000 7feb5f39d640 1 -- 172.21.15.117:0/596587429 shutdown_connections 2024-04-12T09:23:49.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.115+0000 7feb5f39d640 1 --2- 172.21.15.117:0/596587429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb581018b0 0x7feb580faf40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.115+0000 7feb5f39d640 1 --2- 172.21.15.117:0/596587429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb58100f10 0x7feb581012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.115+0000 7feb5f39d640 1 -- 172.21.15.117:0/596587429 >> 172.21.15.117:0/596587429 conn(0x7feb58071e80 msgr2=0x7feb58072280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:49.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.115+0000 7feb5f39d640 1 -- 172.21.15.117:0/596587429 shutdown_connections 2024-04-12T09:23:49.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.115+0000 7feb5f39d640 1 -- 172.21.15.117:0/596587429 wait complete. 2024-04-12T09:23:49.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.115+0000 7feb5f39d640 1 Processor -- start 2024-04-12T09:23:49.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.115+0000 7feb5f39d640 1 -- start start 2024-04-12T09:23:49.119 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.115+0000 7feb5f39d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb58100f10 0x7feb58111a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:49.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.115+0000 7feb5f39d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb581018b0 0x7feb58111f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:49.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.115+0000 7feb5f39d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb58112580 con 0x7feb58100f10 2024-04-12T09:23:49.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.115+0000 7feb5f39d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5810bbd0 con 0x7feb581018b0 2024-04-12T09:23:49.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.115+0000 7feb5e39b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb58100f10 0x7feb58111a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:49.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.115+0000 7feb5e39b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb58100f10 0x7feb58111a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35510/0 (socket says 172.21.15.117:35510) 2024-04-12T09:23:49.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.115+0000 7feb5e39b640 1 -- 172.21.15.117:0/2615236202 learned_addr learned my addr 172.21.15.117:0/2615236202 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:49.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.115+0000 7feb5db9a640 1 --2- 172.21.15.117:0/2615236202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb581018b0 0x7feb58111f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:49.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.116+0000 7feb5e39b640 1 -- 172.21.15.117:0/2615236202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb581018b0 msgr2=0x7feb58111f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:49.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.116+0000 7feb5e39b640 1 --2- 172.21.15.117:0/2615236202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb581018b0 0x7feb58111f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.116+0000 7feb5e39b640 1 -- 172.21.15.117:0/2615236202 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb48005040 con 0x7feb58100f10 2024-04-12T09:23:49.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.116+0000 7feb5db9a640 1 --2- 172.21.15.117:0/2615236202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb581018b0 0x7feb58111f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T09:23:49.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.116+0000 7feb5e39b640 1 --2- 172.21.15.117:0/2615236202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb58100f10 0x7feb58111a40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7feb54002a50 tx=0x7feb54004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:49.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.116+0000 7feb4effd640 1 -- 172.21.15.117:0/2615236202 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb54007c30 con 0x7feb58100f10 2024-04-12T09:23:49.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.116+0000 7feb5f39d640 1 -- 172.21.15.117:0/2615236202 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb5810beb0 con 0x7feb58100f10 2024-04-12T09:23:49.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.116+0000 7feb4effd640 1 -- 172.21.15.117:0/2615236202 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb5400f040 con 0x7feb58100f10 2024-04-12T09:23:49.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.116+0000 7feb4effd640 1 -- 172.21.15.117:0/2615236202 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb5400db50 con 0x7feb58100f10 2024-04-12T09:23:49.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.116+0000 7feb5f39d640 1 -- 172.21.15.117:0/2615236202 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb5810c3a0 con 0x7feb58100f10 2024-04-12T09:23:49.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.117+0000 7feb5f39d640 1 -- 172.21.15.117:0/2615236202 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb580fc680 con 0x7feb58100f10 2024-04-12T09:23:49.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.117+0000 7feb4effd640 1 -- 172.21.15.117:0/2615236202 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7feb5401c400 con 0x7feb58100f10 2024-04-12T09:23:49.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.118+0000 7feb4effd640 1 --2- 172.21.15.117:0/2615236202 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7feb4406dc10 0x7feb440700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:49.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.118+0000 7feb5db9a640 1 --2- 172.21.15.117:0/2615236202 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7feb4406dc10 0x7feb440700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:49.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.118+0000 7feb4effd640 1 -- 172.21.15.117:0/2615236202 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7feb5408cee0 con 0x7feb58100f10 2024-04-12T09:23:49.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.118+0000 7feb5db9a640 1 --2- 172.21.15.117:0/2615236202 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7feb4406dc10 0x7feb440700c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7feb580f8ed0 tx=0x7feb48009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:49.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.123+0000 7feb4effd640 1 -- 172.21.15.117:0/2615236202 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7feb54056410 con 0x7feb58100f10 2024-04-12T09:23:49.350 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.349+0000 7feb5f39d640 1 -- 172.21.15.117:0/2615236202 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7feb5810d0b0 con 0x7feb58100f10 2024-04-12T09:23:49.351 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.350+0000 7feb4effd640 1 -- 172.21.15.117:0/2615236202 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v32) v1 ==== 107+0+4360 (secure 0 0 0) 0x7feb54059ad0 con 0x7feb58100f10 2024-04-12T09:23:49.351 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:49.351 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi117.eslmxh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6829/2675574893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":2675574893},{"type":"v1","addr":"172.21.15.117:6829","nonce":2675574893}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44311,"name":"cephfs.smithi203.fbeixl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6825/3346773589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3346773589},{"type":"v1","addr":"172.21.15.203:6825","nonce":3346773589}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T09:08:12.488144+0000","modified":"2024-04-12T09:21:36.814274+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34372":{"gid":34372,"name":"cephfs.smithi117.wddsgt","rank":0,"incarnation":28,"state":"up:rejoin","state_seq":19,"addr":"172.21.15.117:6827/2687704577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":2687704577},{"type":"v1","addr":"172.21.15.117:6827","nonce":2687704577}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-12T09:23:49.351 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 30 2024-04-12T09:23:49.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.352+0000 7feb5f39d640 1 -- 172.21.15.117:0/2615236202 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7feb4406dc10 msgr2=0x7feb440700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:49.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.352+0000 7feb5f39d640 1 --2- 172.21.15.117:0/2615236202 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7feb4406dc10 0x7feb440700c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7feb580f8ed0 tx=0x7feb48009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.352+0000 7feb5f39d640 1 -- 172.21.15.117:0/2615236202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb58100f10 msgr2=0x7feb58111a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:49.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.352+0000 7feb5f39d640 1 --2- 172.21.15.117:0/2615236202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb58100f10 0x7feb58111a40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7feb54002a50 tx=0x7feb54004600 comp rx=0 tx=0).stop 2024-04-12T09:23:49.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.352+0000 7feb5f39d640 1 -- 172.21.15.117:0/2615236202 shutdown_connections 2024-04-12T09:23:49.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.352+0000 7feb5f39d640 1 --2- 172.21.15.117:0/2615236202 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7feb4406dc10 0x7feb440700c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.352+0000 7feb5f39d640 1 --2- 172.21.15.117:0/2615236202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb581018b0 0x7feb58111f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.353 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.352+0000 7feb5f39d640 1 --2- 172.21.15.117:0/2615236202 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb58100f10 0x7feb58111a40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.352+0000 7feb5f39d640 1 -- 172.21.15.117:0/2615236202 >> 172.21.15.117:0/2615236202 conn(0x7feb58071e80 msgr2=0x7feb580feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:49.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.352+0000 7feb5f39d640 1 -- 172.21.15.117:0/2615236202 shutdown_connections 2024-04-12T09:23:49.354 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.352+0000 7feb5f39d640 1 -- 172.21.15.117:0/2615236202 wait complete. 2024-04-12T09:23:49.365 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-04-12T09:23:49.469 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.467+0000 7ff1046ee640 1 -- 172.21.15.117:0/3240510081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0fc101a80 msgr2=0x7ff0fc0fb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:49.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.467+0000 7ff1046ee640 1 --2- 172.21.15.117:0/3240510081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0fc101a80 0x7ff0fc0fb110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0048d0 tx=0x7ff0ec009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.467+0000 7ff1046ee640 1 -- 172.21.15.117:0/3240510081 shutdown_connections 2024-04-12T09:23:49.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.467+0000 7ff1046ee640 1 --2- 172.21.15.117:0/3240510081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0fc101a80 0x7ff0fc0fb110 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.467+0000 7ff1046ee640 1 --2- 172.21.15.117:0/3240510081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff0fc1010e0 0x7ff0fc1014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.467+0000 7ff1046ee640 1 -- 172.21.15.117:0/3240510081 >> 172.21.15.117:0/3240510081 conn(0x7ff0fc0f6cb0 msgr2=0x7ff0fc0f90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:49.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.467+0000 7ff1046ee640 1 -- 172.21.15.117:0/3240510081 shutdown_connections 2024-04-12T09:23:49.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.467+0000 7ff1046ee640 1 -- 172.21.15.117:0/3240510081 wait complete. 2024-04-12T09:23:49.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.468+0000 7ff1046ee640 1 Processor -- start 2024-04-12T09:23:49.470 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.468+0000 7ff1046ee640 1 -- start start 2024-04-12T09:23:49.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.468+0000 7ff1046ee640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff0fc1010e0 0x7ff0fc10de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:49.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.468+0000 7ff1046ee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0fc101a80 0x7ff0fc10e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:49.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.468+0000 7ff1046ee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc10e8d0 con 0x7ff0fc101a80 2024-04-12T09:23:49.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.468+0000 7ff1046ee640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc10ea40 con 0x7ff0fc1010e0 2024-04-12T09:23:49.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.468+0000 7ff101c89640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0fc101a80 0x7ff0fc10e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:49.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.468+0000 7ff101c89640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0fc101a80 0x7ff0fc10e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35514/0 (socket says 172.21.15.117:35514) 2024-04-12T09:23:49.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.468+0000 7ff101c89640 1 -- 172.21.15.117:0/3357466689 learned_addr learned my addr 172.21.15.117:0/3357466689 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:49.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.468+0000 7ff10248a640 1 --2- 172.21.15.117:0/3357466689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff0fc1010e0 0x7ff0fc10de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:49.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.468+0000 7ff101c89640 1 -- 172.21.15.117:0/3357466689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff0fc1010e0 msgr2=0x7ff0fc10de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:49.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.468+0000 7ff101c89640 1 --2- 172.21.15.117:0/3357466689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff0fc1010e0 0x7ff0fc10de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.468+0000 7ff101c89640 1 -- 172.21.15.117:0/3357466689 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec005040 con 0x7ff0fc101a80 2024-04-12T09:23:49.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.468+0000 7ff101c89640 1 --2- 172.21.15.117:0/3357466689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0fc101a80 0x7ff0fc10e390 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0047f0 tx=0x7ff0ec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:49.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.468+0000 7ff0f2ffd640 1 -- 172.21.15.117:0/3357466689 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0ec0094c0 con 0x7ff0fc101a80 2024-04-12T09:23:49.471 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.469+0000 7ff1046ee640 1 -- 172.21.15.117:0/3357466689 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0fc10ecc0 con 0x7ff0fc101a80 2024-04-12T09:23:49.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.469+0000 7ff0f2ffd640 1 -- 172.21.15.117:0/3357466689 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff0ec032e50 con 0x7ff0fc101a80 2024-04-12T09:23:49.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.469+0000 7ff0f2ffd640 1 -- 172.21.15.117:0/3357466689 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0ec0433b0 con 0x7ff0fc101a80 2024-04-12T09:23:49.472 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.469+0000 7ff1046ee640 1 -- 172.21.15.117:0/3357466689 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0fc117110 con 0x7ff0fc101a80 2024-04-12T09:23:49.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.470+0000 7ff1046ee640 1 -- 172.21.15.117:0/3357466689 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0fc0fc850 con 0x7ff0fc101a80 2024-04-12T09:23:49.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.470+0000 7ff0f2ffd640 1 -- 172.21.15.117:0/3357466689 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7ff0ec02f070 con 0x7ff0fc101a80 2024-04-12T09:23:49.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.470+0000 7ff0f2ffd640 1 --2- 172.21.15.117:0/3357466689 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff0e806dc20 0x7ff0e80700d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:49.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.470+0000 7ff0f2ffd640 1 -- 172.21.15.117:0/3357466689 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7ff0ec0af2c0 con 0x7ff0fc101a80 2024-04-12T09:23:49.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.470+0000 7ff10248a640 1 --2- 172.21.15.117:0/3357466689 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff0e806dc20 0x7ff0e80700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:49.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.471+0000 7ff10248a640 1 --2- 172.21.15.117:0/3357466689 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff0e806dc20 0x7ff0e80700d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8004ed0 tx=0x7ff0f800b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:49.475 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.475+0000 7ff0f2ffd640 1 -- 172.21.15.117:0/3357466689 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7ff0ec0788a0 con 0x7ff0fc101a80 2024-04-12T09:23:49.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.721+0000 7ff1046ee640 1 -- 172.21.15.117:0/3357466689 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7ff0fc1082a0 con 0x7ff0fc101a80 2024-04-12T09:23:49.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.722+0000 7ff0f2ffd640 1 -- 172.21.15.117:0/3357466689 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v32) v1 ==== 107+0+5216 (secure 0 0 0) 0x7ff0ec07bf60 con 0x7ff0fc101a80 2024-04-12T09:23:49.723 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:49.723 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi117.eslmxh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6829/2675574893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":2675574893},{"type":"v1","addr":"172.21.15.117:6829","nonce":2675574893}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":44311,"name":"cephfs.smithi203.fbeixl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6825/3346773589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3346773589},{"type":"v1","addr":"172.21.15.203:6825","nonce":3346773589}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44327,"name":"cephfs.smithi203.bszhxz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6827/240713176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":240713176},{"type":"v1","addr":"172.21.15.203:6827","nonce":240713176}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T09:08:12.488144+0000","modified":"2024-04-12T09:21:38.819333+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34372},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34372":{"gid":34372,"name":"cephfs.smithi117.wddsgt","rank":0,"incarnation":28,"state":"up:active","state_seq":20,"addr":"172.21.15.117:6827/2687704577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":2687704577},{"type":"v1","addr":"172.21.15.117:6827","nonce":2687704577}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34372,"qdb_cluster":[34372]},"id":1}]} 2024-04-12T09:23:49.723 INFO:teuthology.orchestra.run.smithi117.stderr:dumped fsmap epoch 31 2024-04-12T09:23:49.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.724+0000 7ff1046ee640 1 -- 172.21.15.117:0/3357466689 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff0e806dc20 msgr2=0x7ff0e80700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:49.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.724+0000 7ff1046ee640 1 --2- 172.21.15.117:0/3357466689 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff0e806dc20 0x7ff0e80700d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8004ed0 tx=0x7ff0f800b040 comp rx=0 tx=0).stop 2024-04-12T09:23:49.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.724+0000 7ff1046ee640 1 -- 172.21.15.117:0/3357466689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0fc101a80 msgr2=0x7ff0fc10e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:49.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.724+0000 7ff1046ee640 1 --2- 172.21.15.117:0/3357466689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0fc101a80 0x7ff0fc10e390 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0047f0 tx=0x7ff0ec009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.724+0000 7ff1046ee640 1 -- 172.21.15.117:0/3357466689 shutdown_connections 2024-04-12T09:23:49.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.724+0000 7ff1046ee640 1 --2- 172.21.15.117:0/3357466689 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7ff0e806dc20 0x7ff0e80700d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.724+0000 7ff1046ee640 1 --2- 172.21.15.117:0/3357466689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff0fc101a80 0x7ff0fc10e390 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.724+0000 7ff1046ee640 1 --2- 172.21.15.117:0/3357466689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff0fc1010e0 0x7ff0fc10de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.724+0000 7ff1046ee640 1 -- 172.21.15.117:0/3357466689 >> 172.21.15.117:0/3357466689 conn(0x7ff0fc0f6cb0 msgr2=0x7ff0fc0f7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:49.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.724+0000 7ff1046ee640 1 -- 172.21.15.117:0/3357466689 shutdown_connections 2024-04-12T09:23:49.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.724+0000 7ff1046ee640 1 -- 172.21.15.117:0/3357466689 wait complete. 2024-04-12T09:23:49.736 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-12T09:23:49.747 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-12T09:23:49.747 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-12T09:23:49.747 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-12T09:23:49.765 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-12T09:23:49.765 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-12T09:23:49.823 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T09:23:49.966 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.964+0000 7fc46ef9d640 1 -- 172.21.15.117:0/2227850351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4680fa720 msgr2=0x7fc4680fab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:49.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.964+0000 7fc46ef9d640 1 --2- 172.21.15.117:0/2227850351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4680fa720 0x7fc4680fab70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc4580048d0 tx=0x7fc458009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.964+0000 7fc46ef9d640 1 -- 172.21.15.117:0/2227850351 shutdown_connections 2024-04-12T09:23:49.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.964+0000 7fc46ef9d640 1 --2- 172.21.15.117:0/2227850351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4680fa720 0x7fc4680fab70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.964+0000 7fc46ef9d640 1 --2- 172.21.15.117:0/2227850351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4681020d0 0x7fc4681024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.964+0000 7fc46ef9d640 1 -- 172.21.15.117:0/2227850351 >> 172.21.15.117:0/2227850351 conn(0x7fc468071680 msgr2=0x7fc468071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:49.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.964+0000 7fc46ef9d640 1 -- 172.21.15.117:0/2227850351 shutdown_connections 2024-04-12T09:23:49.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.964+0000 7fc46ef9d640 1 -- 172.21.15.117:0/2227850351 wait complete. 2024-04-12T09:23:49.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.965+0000 7fc46ef9d640 1 Processor -- start 2024-04-12T09:23:49.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.965+0000 7fc46ef9d640 1 -- start start 2024-04-12T09:23:49.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.965+0000 7fc46ef9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4680fa720 0x7fc468112bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:49.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.965+0000 7fc46ef9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4681020d0 0x7fc468113100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:49.967 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.965+0000 7fc46ef9d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc468113700 con 0x7fc4681020d0 2024-04-12T09:23:49.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.965+0000 7fc46ef9d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46810cd50 con 0x7fc4680fa720 2024-04-12T09:23:49.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.965+0000 7fc46d79a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4681020d0 0x7fc468113100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:49.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.965+0000 7fc46d79a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4681020d0 0x7fc468113100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39042/0 (socket says 172.21.15.117:39042) 2024-04-12T09:23:49.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.965+0000 7fc46d79a640 1 -- 172.21.15.117:0/3679970169 learned_addr learned my addr 172.21.15.117:0/3679970169 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:49.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.965+0000 7fc46df9b640 1 --2- 172.21.15.117:0/3679970169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4680fa720 0x7fc468112bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:49.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.965+0000 7fc46d79a640 1 -- 172.21.15.117:0/3679970169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4680fa720 msgr2=0x7fc468112bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:49.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.965+0000 7fc46d79a640 1 --2- 172.21.15.117:0/3679970169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4680fa720 0x7fc468112bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:49.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.965+0000 7fc46d79a640 1 -- 172.21.15.117:0/3679970169 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc458005040 con 0x7fc4681020d0 2024-04-12T09:23:49.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.965+0000 7fc46d79a640 1 --2- 172.21.15.117:0/3679970169 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4681020d0 0x7fc468113100 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc4580047f0 tx=0x7fc458009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:49.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.965+0000 7fc45e7fc640 1 -- 172.21.15.117:0/3679970169 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4580092b0 con 0x7fc4681020d0 2024-04-12T09:23:49.968 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.965+0000 7fc46ef9d640 1 -- 172.21.15.117:0/3679970169 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc46810cfd0 con 0x7fc4681020d0 2024-04-12T09:23:49.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.965+0000 7fc45e7fc640 1 -- 172.21.15.117:0/3679970169 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc45803b400 con 0x7fc4681020d0 2024-04-12T09:23:49.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.965+0000 7fc45e7fc640 1 -- 172.21.15.117:0/3679970169 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4580435b0 con 0x7fc4681020d0 2024-04-12T09:23:49.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.965+0000 7fc46ef9d640 1 -- 172.21.15.117:0/3679970169 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc46810d490 con 0x7fc4681020d0 2024-04-12T09:23:49.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.967+0000 7fc46ef9d640 1 -- 172.21.15.117:0/3679970169 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc46804bcc0 con 0x7fc4681020d0 2024-04-12T09:23:49.969 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.967+0000 7fc45e7fc640 1 -- 172.21.15.117:0/3679970169 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fc45802f070 con 0x7fc4681020d0 2024-04-12T09:23:49.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.967+0000 7fc45e7fc640 1 --2- 172.21.15.117:0/3679970169 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc45406dc10 0x7fc4540700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:49.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.967+0000 7fc45e7fc640 1 -- 172.21.15.117:0/3679970169 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fc4580af210 con 0x7fc4681020d0 2024-04-12T09:23:49.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.967+0000 7fc46df9b640 1 --2- 172.21.15.117:0/3679970169 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc45406dc10 0x7fc4540700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:49.970 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.968+0000 7fc46df9b640 1 --2- 172.21.15.117:0/3679970169 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc45406dc10 0x7fc4540700c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc464009af0 tx=0x7fc46400b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:49.972 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:49.972+0000 7fc45e7fc640 1 -- 172.21.15.117:0/3679970169 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc4580787f0 con 0x7fc4681020d0 2024-04-12T09:23:50.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:49 smithi203 ceph-mon[86783]: pgmap v274: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:50.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:49 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/830549937' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-12T09:23:50.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:49 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:23:50.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:49 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/2615236202' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-12T09:23:50.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:49 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/3357466689' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-04-12T09:23:50.149 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.149+0000 7fc46ef9d640 1 -- 172.21.15.117:0/3679970169 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4680652b0 con 0x7fc4681020d0 2024-04-12T09:23:50.151 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.150+0000 7fc45e7fc640 1 -- 172.21.15.117:0/3679970169 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16854 (secure 0 0 0) 0x7fc45807beb0 con 0x7fc4681020d0 2024-04-12T09:23:50.151 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:50.151 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":83,"fsid":"12161984-f8ab-11ee-bc8c-c7b262605968","created":"2024-04-12T09:01:24.210047+0000","modified":"2024-04-12T09:21:27.299210+0000","last_up_change":"2024-04-12T09:20:19.524182+0000","last_in_change":"2024-04-12T09:06:33.833263+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T09:05:39.657213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-12T09:08:11.435513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-12T09:08:11.715605+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8bdd258-6f40-440f-b279-038d9b35e791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":1144390473},{"type":"v1","addr":"172.21.15.117:6803","nonce":1144390473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":1144390473},{"type":"v1","addr":"172.21.15.117:6805","nonce":1144390473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1144390473},{"type":"v1","addr":"172.21.15.117:6809","nonce":1144390473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":1144390473},{"type":"v1","addr":"172.21.15.117:6807","nonce":1144390473}]},"public_addr":"172.21.15.117:6803/1144390473","cluster_addr":"172.21.15.117:6805/1144390473","heartbeat_back_addr":"172.21.15.117:6809/1144390473","heartbeat_front_addr":"172.21.15.117:6807/1144390473","state":["exists","up"]},{"osd":1,"uuid":"ab723885-9e88-47ad-8e80-cb5871bf0d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2606394957},{"type":"v1","addr":"172.21.15.117:6811","nonce":2606394957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2606394957},{"type":"v1","addr":"172.21.15.117:6813","nonce":2606394957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2606394957},{"type":"v1","addr":"172.21.15.117:6817","nonce":2606394957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2606394957},{"type":"v1","addr":"172.21.15.117:6815","nonce":2606394957}]},"public_addr":"172.21.15.117:6811/2606394957","cluster_addr":"172.21.15.117:6813/2606394957","heartbeat_back_addr":"172.21.15.117:6817/2606394957","heartbeat_front_addr":"172.21.15.117:6815/2606394957","state":["exists","up"]},{"osd":2,"uuid":"14f76ed3-2938-45c1-9cc7-4c0486c602ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4153226618},{"type":"v1","addr":"172.21.15.117:6819","nonce":4153226618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4153226618},{"type":"v1","addr":"172.21.15.117:6821","nonce":4153226618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4153226618},{"type":"v1","addr":"172.21.15.117:6825","nonce":4153226618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4153226618},{"type":"v1","addr":"172.21.15.117:6823","nonce":4153226618}]},"public_addr":"172.21.15.117:6819/4153226618","cluster_addr":"172.21.15.117:6821/4153226618","heartbeat_back_addr":"172.21.15.117:6825/4153226618","heartbeat_front_addr":"172.21.15.117:6823/4153226618","state":["exists","up"]},{"osd":3,"uuid":"e2bd1672-4153-498a-a20b-838516b0876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1424266498},{"type":"v1","addr":"172.21.15.203:6801","nonce":1424266498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1424266498},{"type":"v1","addr":"172.21.15.203:6803","nonce":1424266498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1424266498},{"type":"v1","addr":"172.21.15.203:6807","nonce":1424266498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1424266498},{"type":"v1","addr":"172.21.15.203:6805","nonce":1424266498}]},"public_addr":"172.21.15.203:6801/1424266498","cluster_addr":"172.21.15.203:6803/1424266498","heartbeat_back_addr":"172.21.15.203:6807/1424266498","heartbeat_front_addr":"172.21.15.203:6805/1424266498","state":["exists","up"]},{"osd":4,"uuid":"e8e6b7b8-45c2-4186-aeef-9b2feccf9fe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":674159092},{"type":"v1","addr":"172.21.15.203:6809","nonce":674159092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":674159092},{"type":"v1","addr":"172.21.15.203:6811","nonce":674159092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":674159092},{"type":"v1","addr":"172.21.15.203:6815","nonce":674159092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":674159092},{"type":"v1","addr":"172.21.15.203:6813","nonce":674159092}]},"public_addr":"172.21.15.203:6809/674159092","cluster_addr":"172.21.15.203:6811/674159092","heartbeat_back_addr":"172.21.15.203:6815/674159092","heartbeat_front_addr":"172.21.15.203:6813/674159092","state":["exists","up"]},{"osd":5,"uuid":"abbad141-29e9-4028-9e29-293cc73169fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3403215254},{"type":"v1","addr":"172.21.15.203:6817","nonce":3403215254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":3403215254},{"type":"v1","addr":"172.21.15.203:6819","nonce":3403215254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3403215254},{"type":"v1","addr":"172.21.15.203:6823","nonce":3403215254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3403215254},{"type":"v1","addr":"172.21.15.203:6821","nonce":3403215254}]},"public_addr":"172.21.15.203:6817/3403215254","cluster_addr":"172.21.15.203:6819/3403215254","heartbeat_back_addr":"172.21.15.203:6823/3403215254","heartbeat_front_addr":"172.21.15.203:6821/3403215254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:04:41.240834+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:05:09.825336+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:05:37.699545+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:06:01.471956+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:06:25.743473+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:06:50.806872+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.203:6827/2731911290":"2024-04-13T09:21:27.299121+0000","172.21.15.203:6825/840607003":"2024-04-13T09:21:05.261605+0000","172.21.15.203:6824/840607003":"2024-04-13T09:21:05.261605+0000","172.21.15.117:0/4018826114":"2024-04-13T09:01:50.340337+0000","172.21.15.117:6800/2893585477":"2024-04-13T09:01:50.340337+0000","172.21.15.203:0/857573796":"2024-04-13T09:12:54.846397+0000","172.21.15.117:0/2084327023":"2024-04-13T09:10:44.739720+0000","172.21.15.203:0/117634547":"2024-04-13T09:12:54.846397+0000","172.21.15.117:0/3616310373":"2024-04-13T09:10:44.739720+0000","172.21.15.117:6801/3945342300":"2024-04-13T09:10:44.739720+0000","172.21.15.117:6800/3945342300":"2024-04-13T09:10:44.739720+0000","172.21.15.117:0/2514545829":"2024-04-13T09:03:31.333423+0000","172.21.15.203:0/2267178897":"2024-04-13T09:12:54.846397+0000","172.21.15.117:0/1161639266":"2024-04-13T09:15:54.541045+0000","172.21.15.117:6801/2893585477":"2024-04-13T09:01:50.340337+0000","172.21.15.117:6801/791370182":"2024-04-13T09:02:21.422544+0000","172.21.15.117:0/86407959":"2024-04-13T09:02:21.422544+0000","172.21.15.117:0/960981120":"2024-04-13T09:01:50.340337+0000","172.21.15.117:6828/2248590199":"2024-04-13T09:20:43.484776+0000","172.21.15.117:6829/2248590199":"2024-04-13T09:20:43.484776+0000","172.21.15.203:0/2976070431":"2024-04-13T09:12:54.846397+0000","172.21.15.117:0/801788487":"2024-04-13T09:10:44.739720+0000","172.21.15.117:0/2869338383":"2024-04-13T09:02:21.422544+0000","172.21.15.117:0/3452542055":"2024-04-13T09:15:54.541045+0000","172.21.15.117:0/3873562739":"2024-04-13T09:10:44.739720+0000","172.21.15.203:6829/2773660052":"2024-04-13T09:12:54.846397+0000","172.21.15.117:0/1603484270":"2024-04-13T09:15:54.541045+0000","172.21.15.117:6827/1717609783":"2024-04-13T09:08:27.549563+0000","172.21.15.117:0/2305921992":"2024-04-13T09:01:50.340337+0000","172.21.15.203:6828/2773660052":"2024-04-13T09:12:54.846397+0000","172.21.15.117:0/4061615302":"2024-04-13T09:03:31.333423+0000","172.21.15.117:6800/791370182":"2024-04-13T09:02:21.422544+0000","172.21.15.117:0/448067539":"2024-04-13T09:03:31.333423+0000","172.21.15.203:6826/2731911290":"2024-04-13T09:21:27.299121+0000","172.21.15.117:0/2635780056":"2024-04-13T09:02:21.422544+0000","172.21.15.117:6801/790148838":"2024-04-13T09:03:31.333423+0000","172.21.15.117:6826/1717609783":"2024-04-13T09:08:27.549563+0000","172.21.15.117:0/2884121108":"2024-04-13T09:15:54.541045+0000","172.21.15.117:6800/790148838":"2024-04-13T09:03:31.333423+0000","172.21.15.117:6800/1056729457":"2024-04-13T09:15:54.541045+0000","172.21.15.117:6801/1056729457":"2024-04-13T09:15:54.541045+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T09:23:50.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.152+0000 7fc46ef9d640 1 -- 172.21.15.117:0/3679970169 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc45406dc10 msgr2=0x7fc4540700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:50.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.152+0000 7fc46ef9d640 1 --2- 172.21.15.117:0/3679970169 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc45406dc10 0x7fc4540700c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc464009af0 tx=0x7fc46400b040 comp rx=0 tx=0).stop 2024-04-12T09:23:50.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.152+0000 7fc46ef9d640 1 -- 172.21.15.117:0/3679970169 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4681020d0 msgr2=0x7fc468113100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:50.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.152+0000 7fc46ef9d640 1 --2- 172.21.15.117:0/3679970169 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4681020d0 0x7fc468113100 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc4580047f0 tx=0x7fc458009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:50.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.152+0000 7fc46ef9d640 1 -- 172.21.15.117:0/3679970169 shutdown_connections 2024-04-12T09:23:50.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.152+0000 7fc46ef9d640 1 --2- 172.21.15.117:0/3679970169 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc45406dc10 0x7fc4540700c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:50.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.152+0000 7fc46ef9d640 1 --2- 172.21.15.117:0/3679970169 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4681020d0 0x7fc468113100 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:50.153 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.152+0000 7fc46ef9d640 1 --2- 172.21.15.117:0/3679970169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4680fa720 0x7fc468112bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:50.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.152+0000 7fc46ef9d640 1 -- 172.21.15.117:0/3679970169 >> 172.21.15.117:0/3679970169 conn(0x7fc468071680 msgr2=0x7fc4680f9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:50.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.152+0000 7fc46ef9d640 1 -- 172.21.15.117:0/3679970169 shutdown_connections 2024-04-12T09:23:50.154 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.152+0000 7fc46ef9d640 1 -- 172.21.15.117:0/3679970169 wait complete. 2024-04-12T09:23:50.159 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:49 smithi117 ceph-mon[113571]: pgmap v274: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:50.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:49 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/830549937' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-12T09:23:50.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:49 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:23:50.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:49 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/2615236202' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-12T09:23:50.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:49 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/3357466689' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-04-12T09:23:50.164 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-12T09:05:39.657213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-12T09:08:11.435513+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-12T09:08:11.715605+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-12T09:23:50.164 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-12T09:23:50.266 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.264+0000 7f8d9f59e640 1 -- 172.21.15.117:0/2380561777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8da0102990 msgr2=0x7f8da00fc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.264+0000 7f8d9f59e640 1 --2- 172.21.15.117:0/2380561777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8da0102990 0x7f8da00fc020 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8d900048d0 tx=0x7f8d90009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.264+0000 7f8d9f59e640 1 -- 172.21.15.117:0/2380561777 shutdown_connections 2024-04-12T09:23:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.264+0000 7f8d9f59e640 1 --2- 172.21.15.117:0/2380561777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8da0102990 0x7f8da00fc020 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.264+0000 7f8d9f59e640 1 --2- 172.21.15.117:0/2380561777 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8da0101ff0 0x7f8da01023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.264+0000 7f8d9f59e640 1 -- 172.21.15.117:0/2380561777 >> 172.21.15.117:0/2380561777 conn(0x7f8da00f7be0 msgr2=0x7f8da00f9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.264+0000 7f8d9f59e640 1 -- 172.21.15.117:0/2380561777 shutdown_connections 2024-04-12T09:23:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.264+0000 7f8d9f59e640 1 -- 172.21.15.117:0/2380561777 wait complete. 2024-04-12T09:23:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.264+0000 7f8d9f59e640 1 Processor -- start 2024-04-12T09:23:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.265+0000 7f8d9f59e640 1 -- start start 2024-04-12T09:23:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.265+0000 7f8d9f59e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8da0101ff0 0x7f8da0112b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.265+0000 7f8d9f59e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8da0102990 0x7f8da0113050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:50.267 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.265+0000 7f8d9f59e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da0113650 con 0x7f8da0101ff0 2024-04-12T09:23:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.265+0000 7f8d9f59e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da010cca0 con 0x7f8da0102990 2024-04-12T09:23:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.265+0000 7f8d9e59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8da0101ff0 0x7f8da0112b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.265+0000 7f8d9e59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8da0101ff0 0x7f8da0112b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39068/0 (socket says 172.21.15.117:39068) 2024-04-12T09:23:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.265+0000 7f8d9e59c640 1 -- 172.21.15.117:0/437243339 learned_addr learned my addr 172.21.15.117:0/437243339 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.265+0000 7f8d9dd9b640 1 --2- 172.21.15.117:0/437243339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8da0102990 0x7f8da0113050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.265+0000 7f8d9e59c640 1 -- 172.21.15.117:0/437243339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8da0102990 msgr2=0x7f8da0113050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.265+0000 7f8d9e59c640 1 --2- 172.21.15.117:0/437243339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8da0102990 0x7f8da0113050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.265+0000 7f8d9e59c640 1 -- 172.21.15.117:0/437243339 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d90005040 con 0x7f8da0101ff0 2024-04-12T09:23:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.265+0000 7f8d9e59c640 1 --2- 172.21.15.117:0/437243339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8da0101ff0 0x7f8da0112b10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8d94002a50 tx=0x7f8d94004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.265+0000 7f8d8effd640 1 -- 172.21.15.117:0/437243339 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d94007c30 con 0x7f8da0101ff0 2024-04-12T09:23:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.265+0000 7f8d9f59e640 1 -- 172.21.15.117:0/437243339 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da010cf80 con 0x7f8da0101ff0 2024-04-12T09:23:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.265+0000 7f8d8effd640 1 -- 172.21.15.117:0/437243339 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8d9400f040 con 0x7f8da0101ff0 2024-04-12T09:23:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.265+0000 7f8d8effd640 1 -- 172.21.15.117:0/437243339 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d9400db50 con 0x7f8da0101ff0 2024-04-12T09:23:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.266+0000 7f8d9f59e640 1 -- 172.21.15.117:0/437243339 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da010d470 con 0x7f8da0101ff0 2024-04-12T09:23:50.268 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.266+0000 7f8d9f59e640 1 -- 172.21.15.117:0/437243339 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8da00fd760 con 0x7f8da0101ff0 2024-04-12T09:23:50.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.267+0000 7f8d8effd640 1 -- 172.21.15.117:0/437243339 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f8d9401c400 con 0x7f8da0101ff0 2024-04-12T09:23:50.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.267+0000 7f8d8effd640 1 --2- 172.21.15.117:0/437243339 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f8d8806dc10 0x7f8d880700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:50.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.267+0000 7f8d9dd9b640 1 --2- 172.21.15.117:0/437243339 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f8d8806dc10 0x7f8d880700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:50.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.267+0000 7f8d8effd640 1 -- 172.21.15.117:0/437243339 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f8d9408ce30 con 0x7f8da0101ff0 2024-04-12T09:23:50.269 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.268+0000 7f8d9dd9b640 1 --2- 172.21.15.117:0/437243339 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f8d8806dc10 0x7f8d880700c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8da00fa680 tx=0x7f8d90009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:50.272 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.272+0000 7f8d8effd640 1 -- 172.21.15.117:0/437243339 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f8d94056410 con 0x7f8da0101ff0 2024-04-12T09:23:50.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.446+0000 7f8d9f59e640 1 -- 172.21.15.117:0/437243339 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8da0109150 con 0x7f8da0101ff0 2024-04-12T09:23:50.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.447+0000 7f8d8effd640 1 -- 172.21.15.117:0/437243339 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8d94059ad0 con 0x7f8da0101ff0 2024-04-12T09:23:50.447 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 1 2024-04-12T09:23:50.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.449+0000 7f8d9f59e640 1 -- 172.21.15.117:0/437243339 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f8d8806dc10 msgr2=0x7f8d880700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:50.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.449+0000 7f8d9f59e640 1 --2- 172.21.15.117:0/437243339 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f8d8806dc10 0x7f8d880700c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8da00fa680 tx=0x7f8d90009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:50.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.449+0000 7f8d9f59e640 1 -- 172.21.15.117:0/437243339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8da0101ff0 msgr2=0x7f8da0112b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:50.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.449+0000 7f8d9f59e640 1 --2- 172.21.15.117:0/437243339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8da0101ff0 0x7f8da0112b10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8d94002a50 tx=0x7f8d94004600 comp rx=0 tx=0).stop 2024-04-12T09:23:50.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.449+0000 7f8d9f59e640 1 -- 172.21.15.117:0/437243339 shutdown_connections 2024-04-12T09:23:50.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.449+0000 7f8d9f59e640 1 --2- 172.21.15.117:0/437243339 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f8d8806dc10 0x7f8d880700c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:50.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.449+0000 7f8d9f59e640 1 --2- 172.21.15.117:0/437243339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8da0102990 0x7f8da0113050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:50.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.449+0000 7f8d9f59e640 1 --2- 172.21.15.117:0/437243339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8da0101ff0 0x7f8da0112b10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:50.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.449+0000 7f8d9f59e640 1 -- 172.21.15.117:0/437243339 >> 172.21.15.117:0/437243339 conn(0x7f8da00f7be0 msgr2=0x7f8da00f8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:50.450 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.449+0000 7f8d9f59e640 1 -- 172.21.15.117:0/437243339 shutdown_connections 2024-04-12T09:23:50.451 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.449+0000 7f8d9f59e640 1 -- 172.21.15.117:0/437243339 wait complete. 2024-04-12T09:23:50.461 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-12T09:23:50.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.567+0000 7fb8f8cee640 1 -- 172.21.15.117:0/3286942128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8f40fb1f0 msgr2=0x7fb8f40fb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:50.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.567+0000 7fb8f8cee640 1 --2- 172.21.15.117:0/3286942128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8f40fb1f0 0x7fb8f40fb5c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40048d0 tx=0x7fb8e4009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:50.571 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.567+0000 7fb8f8cee640 1 -- 172.21.15.117:0/3286942128 shutdown_connections 2024-04-12T09:23:50.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.567+0000 7fb8f8cee640 1 --2- 172.21.15.117:0/3286942128 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8f40fbb00 0x7fb8f41001b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:50.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.567+0000 7fb8f8cee640 1 --2- 172.21.15.117:0/3286942128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8f40fb1f0 0x7fb8f40fb5c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:50.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.567+0000 7fb8f8cee640 1 -- 172.21.15.117:0/3286942128 >> 172.21.15.117:0/3286942128 conn(0x7fb8f40f6e70 msgr2=0x7fb8f40f9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:50.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.567+0000 7fb8f8cee640 1 -- 172.21.15.117:0/3286942128 shutdown_connections 2024-04-12T09:23:50.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.567+0000 7fb8f8cee640 1 -- 172.21.15.117:0/3286942128 wait complete. 2024-04-12T09:23:50.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.568+0000 7fb8f8cee640 1 Processor -- start 2024-04-12T09:23:50.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.568+0000 7fb8f8cee640 1 -- start start 2024-04-12T09:23:50.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.568+0000 7fb8f8cee640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8f40fb1f0 0x7fb8f4119590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:50.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.568+0000 7fb8f8cee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8f40fbb00 0x7fb8f4119ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:50.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.568+0000 7fb8f8cee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f411a120 con 0x7fb8f40fbb00 2024-04-12T09:23:50.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.568+0000 7fb8f8cee640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4113740 con 0x7fb8f40fb1f0 2024-04-12T09:23:50.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.568+0000 7fb8ebfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8f40fbb00 0x7fb8f4119ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:50.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.568+0000 7fb8ebfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8f40fbb00 0x7fb8f4119ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39082/0 (socket says 172.21.15.117:39082) 2024-04-12T09:23:50.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.568+0000 7fb8ebfff640 1 -- 172.21.15.117:0/2330865090 learned_addr learned my addr 172.21.15.117:0/2330865090 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:50.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.568+0000 7fb8ebfff640 1 -- 172.21.15.117:0/2330865090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8f40fb1f0 msgr2=0x7fb8f4119590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:50.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.568+0000 7fb8ebfff640 1 --2- 172.21.15.117:0/2330865090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8f40fb1f0 0x7fb8f4119590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:50.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.568+0000 7fb8ebfff640 1 -- 172.21.15.117:0/2330865090 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e4005040 con 0x7fb8f40fbb00 2024-04-12T09:23:50.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.568+0000 7fb8ebfff640 1 --2- 172.21.15.117:0/2330865090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8f40fbb00 0x7fb8f4119ad0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc002a80 tx=0x7fb8dc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:50.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.568+0000 7fb8eaffd640 1 -- 172.21.15.117:0/2330865090 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8dc007c30 con 0x7fb8f40fbb00 2024-04-12T09:23:50.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.568+0000 7fb8eaffd640 1 -- 172.21.15.117:0/2330865090 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb8dc00f040 con 0x7fb8f40fbb00 2024-04-12T09:23:50.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.568+0000 7fb8f8cee640 1 -- 172.21.15.117:0/2330865090 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f4113a20 con 0x7fb8f40fbb00 2024-04-12T09:23:50.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.568+0000 7fb8eaffd640 1 -- 172.21.15.117:0/2330865090 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8dc0096b0 con 0x7fb8f40fbb00 2024-04-12T09:23:50.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.569+0000 7fb8f8cee640 1 -- 172.21.15.117:0/2330865090 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f4113f40 con 0x7fb8f40fbb00 2024-04-12T09:23:50.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.569+0000 7fb8f8cee640 1 -- 172.21.15.117:0/2330865090 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f4065e30 con 0x7fb8f40fbb00 2024-04-12T09:23:50.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.570+0000 7fb8eaffd640 1 -- 172.21.15.117:0/2330865090 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fb8dc00d6b0 con 0x7fb8f40fbb00 2024-04-12T09:23:50.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.570+0000 7fb8eaffd640 1 --2- 172.21.15.117:0/2330865090 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb8e006dc10 0x7fb8e00700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:50.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.570+0000 7fb8eaffd640 1 -- 172.21.15.117:0/2330865090 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb8dc08cfb0 con 0x7fb8f40fbb00 2024-04-12T09:23:50.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.570+0000 7fb8f259c640 1 --2- 172.21.15.117:0/2330865090 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb8e006dc10 0x7fb8e00700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:50.574 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.571+0000 7fb8f259c640 1 --2- 172.21.15.117:0/2330865090 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb8e006dc10 0x7fb8e00700c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009a10 tx=0x7fb8e4009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:50.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.575+0000 7fb8eaffd640 1 -- 172.21.15.117:0/2330865090 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb8dc0564e0 con 0x7fb8f40fbb00 2024-04-12T09:23:50.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.753+0000 7fb8f8cee640 1 -- 172.21.15.117:0/2330865090 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fb8f4114c30 con 0x7fb8f40fbb00 2024-04-12T09:23:50.754 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.754+0000 7fb8eaffd640 1 -- 172.21.15.117:0/2330865090 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7fb8dc059ba0 con 0x7fb8f40fbb00 2024-04-12T09:23:50.754 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 32 2024-04-12T09:23:50.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.756+0000 7fb8f8cee640 1 -- 172.21.15.117:0/2330865090 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb8e006dc10 msgr2=0x7fb8e00700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:50.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.756+0000 7fb8f8cee640 1 --2- 172.21.15.117:0/2330865090 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb8e006dc10 0x7fb8e00700c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009a10 tx=0x7fb8e4009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:50.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.756+0000 7fb8f8cee640 1 -- 172.21.15.117:0/2330865090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8f40fbb00 msgr2=0x7fb8f4119ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:50.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.756+0000 7fb8f8cee640 1 --2- 172.21.15.117:0/2330865090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8f40fbb00 0x7fb8f4119ad0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc002a80 tx=0x7fb8dc004600 comp rx=0 tx=0).stop 2024-04-12T09:23:50.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.756+0000 7fb8f8cee640 1 -- 172.21.15.117:0/2330865090 shutdown_connections 2024-04-12T09:23:50.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.756+0000 7fb8f8cee640 1 --2- 172.21.15.117:0/2330865090 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb8e006dc10 0x7fb8e00700c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:50.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.756+0000 7fb8f8cee640 1 --2- 172.21.15.117:0/2330865090 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8f40fbb00 0x7fb8f4119ad0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:50.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.756+0000 7fb8f8cee640 1 --2- 172.21.15.117:0/2330865090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8f40fb1f0 0x7fb8f4119590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:50.757 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.756+0000 7fb8f8cee640 1 -- 172.21.15.117:0/2330865090 >> 172.21.15.117:0/2330865090 conn(0x7fb8f40f6e70 msgr2=0x7fb8f40f8430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:50.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.756+0000 7fb8f8cee640 1 -- 172.21.15.117:0/2330865090 shutdown_connections 2024-04-12T09:23:50.758 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.756+0000 7fb8f8cee640 1 -- 172.21.15.117:0/2330865090 wait complete. 2024-04-12T09:23:50.767 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-12T09:23:50.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.869+0000 7f18ce99d640 1 -- 172.21.15.117:0/464586331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18c80fa900 msgr2=0x7f18c80facd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:50.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.869+0000 7f18ce99d640 1 --2- 172.21.15.117:0/464586331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18c80fa900 0x7f18c80facd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f18b8004900 tx=0x7f18b8009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:50.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.869+0000 7f18ce99d640 1 -- 172.21.15.117:0/464586331 shutdown_connections 2024-04-12T09:23:50.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.869+0000 7f18ce99d640 1 --2- 172.21.15.117:0/464586331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18c80fb210 0x7f18c810c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:50.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.869+0000 7f18ce99d640 1 --2- 172.21.15.117:0/464586331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18c80fa900 0x7f18c80facd0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:50.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.869+0000 7f18ce99d640 1 -- 172.21.15.117:0/464586331 >> 172.21.15.117:0/464586331 conn(0x7f18c8072630 msgr2=0x7f18c8072a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:50.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.869+0000 7f18ce99d640 1 -- 172.21.15.117:0/464586331 shutdown_connections 2024-04-12T09:23:50.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.869+0000 7f18ce99d640 1 -- 172.21.15.117:0/464586331 wait complete. 2024-04-12T09:23:50.871 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.869+0000 7f18ce99d640 1 Processor -- start 2024-04-12T09:23:50.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.869+0000 7f18ce99d640 1 -- start start 2024-04-12T09:23:50.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.870+0000 7f18ce99d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18c80fa900 0x7f18c81191d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:50.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.870+0000 7f18ce99d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18c80fb210 0x7f18c8119710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:50.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.870+0000 7f18ce99d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c8119da0 con 0x7f18c80fb210 2024-04-12T09:23:50.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.870+0000 7f18ce99d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c8113360 con 0x7f18c80fa900 2024-04-12T09:23:50.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.870+0000 7f18cd19a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18c80fb210 0x7f18c8119710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:50.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.870+0000 7f18cd19a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18c80fb210 0x7f18c8119710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39106/0 (socket says 172.21.15.117:39106) 2024-04-12T09:23:50.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.870+0000 7f18cd19a640 1 -- 172.21.15.117:0/1646282723 learned_addr learned my addr 172.21.15.117:0/1646282723 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:50.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.870+0000 7f18cd99b640 1 --2- 172.21.15.117:0/1646282723 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18c80fa900 0x7f18c81191d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:50.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.870+0000 7f18cd19a640 1 -- 172.21.15.117:0/1646282723 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18c80fa900 msgr2=0x7f18c81191d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:50.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.870+0000 7f18cd19a640 1 --2- 172.21.15.117:0/1646282723 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18c80fa900 0x7f18c81191d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:50.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.870+0000 7f18cd19a640 1 -- 172.21.15.117:0/1646282723 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b8005040 con 0x7f18c80fb210 2024-04-12T09:23:50.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.870+0000 7f18cd19a640 1 --2- 172.21.15.117:0/1646282723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18c80fb210 0x7f18c8119710 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f18c400b560 tx=0x7f18c40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:50.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.870+0000 7f18be7fc640 1 -- 172.21.15.117:0/1646282723 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18c400f6f0 con 0x7f18c80fb210 2024-04-12T09:23:50.872 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.870+0000 7f18be7fc640 1 -- 172.21.15.117:0/1646282723 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f18c400fd20 con 0x7f18c80fb210 2024-04-12T09:23:50.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.870+0000 7f18ce99d640 1 -- 172.21.15.117:0/1646282723 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c8113640 con 0x7f18c80fb210 2024-04-12T09:23:50.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.870+0000 7f18be7fc640 1 -- 172.21.15.117:0/1646282723 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18c40103a0 con 0x7f18c80fb210 2024-04-12T09:23:50.873 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.870+0000 7f18ce99d640 1 -- 172.21.15.117:0/1646282723 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c8113b60 con 0x7f18c80fb210 2024-04-12T09:23:50.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.871+0000 7f18ce99d640 1 -- 172.21.15.117:0/1646282723 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18c80fb6e0 con 0x7f18c80fb210 2024-04-12T09:23:50.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.872+0000 7f18be7fc640 1 -- 172.21.15.117:0/1646282723 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f18c4011400 con 0x7f18c80fb210 2024-04-12T09:23:50.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.872+0000 7f18be7fc640 1 --2- 172.21.15.117:0/1646282723 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f18b406dc10 0x7f18b40700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:50.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.872+0000 7f18cd99b640 1 --2- 172.21.15.117:0/1646282723 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f18b406dc10 0x7f18b40700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:50.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.872+0000 7f18be7fc640 1 -- 172.21.15.117:0/1646282723 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f18c408d2f0 con 0x7f18c80fb210 2024-04-12T09:23:50.874 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.873+0000 7f18cd99b640 1 --2- 172.21.15.117:0/1646282723 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f18b406dc10 0x7f18b40700c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f18b8000c00 tx=0x7f18b8009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:50.878 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:50.877+0000 7f18be7fc640 1 -- 172.21.15.117:0/1646282723 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f18c405a470 con 0x7f18c80fb210 2024-04-12T09:23:51.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.049+0000 7f18ce99d640 1 -- 172.21.15.117:0/1646282723 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f18c810f860 con 0x7f18c80fb210 2024-04-12T09:23:51.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.049+0000 7f18be7fc640 1 -- 172.21.15.117:0/1646282723 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7f18c405a000 con 0x7f18c80fb210 2024-04-12T09:23:51.050 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 32 2024-04-12T09:23:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.051+0000 7f18ce99d640 1 -- 172.21.15.117:0/1646282723 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f18b406dc10 msgr2=0x7f18b40700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.051+0000 7f18ce99d640 1 --2- 172.21.15.117:0/1646282723 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f18b406dc10 0x7f18b40700c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f18b8000c00 tx=0x7f18b8009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.051+0000 7f18ce99d640 1 -- 172.21.15.117:0/1646282723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18c80fb210 msgr2=0x7f18c8119710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.051+0000 7f18ce99d640 1 --2- 172.21.15.117:0/1646282723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18c80fb210 0x7f18c8119710 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f18c400b560 tx=0x7f18c40090f0 comp rx=0 tx=0).stop 2024-04-12T09:23:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.051+0000 7f18ce99d640 1 -- 172.21.15.117:0/1646282723 shutdown_connections 2024-04-12T09:23:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.051+0000 7f18ce99d640 1 --2- 172.21.15.117:0/1646282723 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f18b406dc10 0x7f18b40700c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.051+0000 7f18ce99d640 1 --2- 172.21.15.117:0/1646282723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18c80fb210 0x7f18c8119710 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.051+0000 7f18ce99d640 1 --2- 172.21.15.117:0/1646282723 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18c80fa900 0x7f18c81191d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.051+0000 7f18ce99d640 1 -- 172.21.15.117:0/1646282723 >> 172.21.15.117:0/1646282723 conn(0x7f18c8072630 msgr2=0x7f18c80fbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.051+0000 7f18ce99d640 1 -- 172.21.15.117:0/1646282723 shutdown_connections 2024-04-12T09:23:51.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.051+0000 7f18ce99d640 1 -- 172.21.15.117:0/1646282723 wait complete. 2024-04-12T09:23:51.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:50 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:23:51.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:50 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:23:51.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:50 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/3679970169' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T09:23:51.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:50 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/437243339' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-12T09:23:51.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:50 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:23:51.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:50 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:23:51.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:50 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:23:51.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:50 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/2330865090' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-12T09:23:51.063 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-12T09:23:51.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.162+0000 7fae7739d640 1 -- 172.21.15.117:0/4235868862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae70102010 msgr2=0x7fae701023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:51.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.162+0000 7fae7739d640 1 --2- 172.21.15.117:0/4235868862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae70102010 0x7fae701023e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fae68009c50 tx=0x7fae68004d10 comp rx=0 tx=0).stop 2024-04-12T09:23:51.164 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.162+0000 7fae7739d640 1 -- 172.21.15.117:0/4235868862 shutdown_connections 2024-04-12T09:23:51.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.162+0000 7fae7739d640 1 --2- 172.21.15.117:0/4235868862 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae701029b0 0x7fae700fc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:51.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.162+0000 7fae7739d640 1 --2- 172.21.15.117:0/4235868862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae70102010 0x7fae701023e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:51.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.162+0000 7fae7739d640 1 -- 172.21.15.117:0/4235868862 >> 172.21.15.117:0/4235868862 conn(0x7fae700f7c20 msgr2=0x7fae700fa030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:51.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.162+0000 7fae7739d640 1 -- 172.21.15.117:0/4235868862 shutdown_connections 2024-04-12T09:23:51.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.162+0000 7fae7739d640 1 -- 172.21.15.117:0/4235868862 wait complete. 2024-04-12T09:23:51.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.162+0000 7fae7739d640 1 Processor -- start 2024-04-12T09:23:51.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.162+0000 7fae7739d640 1 -- start start 2024-04-12T09:23:51.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.163+0000 7fae7739d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae70102010 0x7fae70112b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:51.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.163+0000 7fae7739d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae701029b0 0x7fae70113070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:51.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.163+0000 7fae7739d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae70113670 con 0x7fae70102010 2024-04-12T09:23:51.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.163+0000 7fae7739d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7010ccc0 con 0x7fae701029b0 2024-04-12T09:23:51.165 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.163+0000 7fae7639b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae70102010 0x7fae70112b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:51.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.163+0000 7fae7639b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae70102010 0x7fae70112b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39130/0 (socket says 172.21.15.117:39130) 2024-04-12T09:23:51.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.163+0000 7fae7639b640 1 -- 172.21.15.117:0/386879651 learned_addr learned my addr 172.21.15.117:0/386879651 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:51.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.163+0000 7fae7639b640 1 -- 172.21.15.117:0/386879651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae701029b0 msgr2=0x7fae70113070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:51.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.163+0000 7fae75b9a640 1 --2- 172.21.15.117:0/386879651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae701029b0 0x7fae70113070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:51.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.163+0000 7fae7639b640 1 --2- 172.21.15.117:0/386879651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae701029b0 0x7fae70113070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:51.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.163+0000 7fae7639b640 1 -- 172.21.15.117:0/386879651 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae680098b0 con 0x7fae70102010 2024-04-12T09:23:51.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.163+0000 7fae75b9a640 1 --2- 172.21.15.117:0/386879651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae701029b0 0x7fae70113070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T09:23:51.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.163+0000 7fae7639b640 1 --2- 172.21.15.117:0/386879651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae70102010 0x7fae70112b30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fae68004a30 tx=0x7fae68004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:51.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.163+0000 7fae66ffd640 1 -- 172.21.15.117:0/386879651 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae6803a070 con 0x7fae70102010 2024-04-12T09:23:51.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.163+0000 7fae7739d640 1 -- 172.21.15.117:0/386879651 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7010cf40 con 0x7fae70102010 2024-04-12T09:23:51.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.163+0000 7fae66ffd640 1 -- 172.21.15.117:0/386879651 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae68035b20 con 0x7fae70102010 2024-04-12T09:23:51.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.163+0000 7fae66ffd640 1 -- 172.21.15.117:0/386879651 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae6803ea70 con 0x7fae70102010 2024-04-12T09:23:51.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.163+0000 7fae7739d640 1 -- 172.21.15.117:0/386879651 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7010d4e0 con 0x7fae70102010 2024-04-12T09:23:51.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.164+0000 7fae7739d640 1 -- 172.21.15.117:0/386879651 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae700fd780 con 0x7fae70102010 2024-04-12T09:23:51.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.165+0000 7fae66ffd640 1 -- 172.21.15.117:0/386879651 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fae68032070 con 0x7fae70102010 2024-04-12T09:23:51.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.165+0000 7fae66ffd640 1 --2- 172.21.15.117:0/386879651 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fae5c06dc10 0x7fae5c0700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:51.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.165+0000 7fae75b9a640 1 --2- 172.21.15.117:0/386879651 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fae5c06dc10 0x7fae5c0700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:51.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.165+0000 7fae66ffd640 1 -- 172.21.15.117:0/386879651 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fae680af760 con 0x7fae70102010 2024-04-12T09:23:51.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.166+0000 7fae75b9a640 1 --2- 172.21.15.117:0/386879651 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fae5c06dc10 0x7fae5c0700c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fae7010e3f0 tx=0x7fae6000b040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:51.170 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.170+0000 7fae66ffd640 1 -- 172.21.15.117:0/386879651 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fae68078e00 con 0x7fae70102010 2024-04-12T09:23:51.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:50 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:23:51.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:50 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:23:51.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:50 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/3679970169' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T09:23:51.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:50 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/437243339' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-12T09:23:51.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:50 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:23:51.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:50 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:23:51.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:50 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:23:51.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:50 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/2330865090' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-12T09:23:51.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.355+0000 7fae7739d640 1 -- 172.21.15.117:0/386879651 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fae70109170 con 0x7fae70102010 2024-04-12T09:23:51.356 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.356+0000 7fae66ffd640 1 -- 172.21.15.117:0/386879651 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v83) v1 ==== 81+0+2466 (secure 0 0 0) 0x7fae6807c4c0 con 0x7fae70102010 2024-04-12T09:23:51.356 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.203:6827/2731911290 2024-04-13T09:21:27.299121+0000 2024-04-12T09:23:51.356 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.203:6825/840607003 2024-04-13T09:21:05.261605+0000 2024-04-12T09:23:51.356 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.203:6824/840607003 2024-04-13T09:21:05.261605+0000 2024-04-12T09:23:51.356 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/4018826114 2024-04-13T09:01:50.340337+0000 2024-04-12T09:23:51.357 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6800/2893585477 2024-04-13T09:01:50.340337+0000 2024-04-12T09:23:51.357 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.203:0/857573796 2024-04-13T09:12:54.846397+0000 2024-04-12T09:23:51.357 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/2084327023 2024-04-13T09:10:44.739720+0000 2024-04-12T09:23:51.357 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.203:0/117634547 2024-04-13T09:12:54.846397+0000 2024-04-12T09:23:51.357 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/3616310373 2024-04-13T09:10:44.739720+0000 2024-04-12T09:23:51.357 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6801/3945342300 2024-04-13T09:10:44.739720+0000 2024-04-12T09:23:51.357 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6800/3945342300 2024-04-13T09:10:44.739720+0000 2024-04-12T09:23:51.357 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/2514545829 2024-04-13T09:03:31.333423+0000 2024-04-12T09:23:51.357 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.203:0/2267178897 2024-04-13T09:12:54.846397+0000 2024-04-12T09:23:51.357 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/1161639266 2024-04-13T09:15:54.541045+0000 2024-04-12T09:23:51.357 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6801/2893585477 2024-04-13T09:01:50.340337+0000 2024-04-12T09:23:51.357 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6801/791370182 2024-04-13T09:02:21.422544+0000 2024-04-12T09:23:51.357 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/86407959 2024-04-13T09:02:21.422544+0000 2024-04-12T09:23:51.357 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/960981120 2024-04-13T09:01:50.340337+0000 2024-04-12T09:23:51.357 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6828/2248590199 2024-04-13T09:20:43.484776+0000 2024-04-12T09:23:51.358 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6829/2248590199 2024-04-13T09:20:43.484776+0000 2024-04-12T09:23:51.358 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.203:0/2976070431 2024-04-13T09:12:54.846397+0000 2024-04-12T09:23:51.358 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/801788487 2024-04-13T09:10:44.739720+0000 2024-04-12T09:23:51.358 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/2869338383 2024-04-13T09:02:21.422544+0000 2024-04-12T09:23:51.358 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/3452542055 2024-04-13T09:15:54.541045+0000 2024-04-12T09:23:51.358 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/3873562739 2024-04-13T09:10:44.739720+0000 2024-04-12T09:23:51.358 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.203:6829/2773660052 2024-04-13T09:12:54.846397+0000 2024-04-12T09:23:51.358 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/1603484270 2024-04-13T09:15:54.541045+0000 2024-04-12T09:23:51.358 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6827/1717609783 2024-04-13T09:08:27.549563+0000 2024-04-12T09:23:51.358 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/2305921992 2024-04-13T09:01:50.340337+0000 2024-04-12T09:23:51.358 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.203:6828/2773660052 2024-04-13T09:12:54.846397+0000 2024-04-12T09:23:51.358 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/4061615302 2024-04-13T09:03:31.333423+0000 2024-04-12T09:23:51.358 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6800/791370182 2024-04-13T09:02:21.422544+0000 2024-04-12T09:23:51.358 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/448067539 2024-04-13T09:03:31.333423+0000 2024-04-12T09:23:51.359 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.203:6826/2731911290 2024-04-13T09:21:27.299121+0000 2024-04-12T09:23:51.359 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/2635780056 2024-04-13T09:02:21.422544+0000 2024-04-12T09:23:51.359 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6801/790148838 2024-04-13T09:03:31.333423+0000 2024-04-12T09:23:51.359 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6826/1717609783 2024-04-13T09:08:27.549563+0000 2024-04-12T09:23:51.359 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/2884121108 2024-04-13T09:15:54.541045+0000 2024-04-12T09:23:51.359 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6800/790148838 2024-04-13T09:03:31.333423+0000 2024-04-12T09:23:51.359 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6800/1056729457 2024-04-13T09:15:54.541045+0000 2024-04-12T09:23:51.359 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6801/1056729457 2024-04-13T09:15:54.541045+0000 2024-04-12T09:23:51.360 INFO:teuthology.orchestra.run.smithi117.stderr:listed 41 entries 2024-04-12T09:23:51.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.358+0000 7fae7739d640 1 -- 172.21.15.117:0/386879651 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fae5c06dc10 msgr2=0x7fae5c0700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:51.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.358+0000 7fae7739d640 1 --2- 172.21.15.117:0/386879651 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fae5c06dc10 0x7fae5c0700c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fae7010e3f0 tx=0x7fae6000b040 comp rx=0 tx=0).stop 2024-04-12T09:23:51.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.358+0000 7fae7739d640 1 -- 172.21.15.117:0/386879651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae70102010 msgr2=0x7fae70112b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:51.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.358+0000 7fae7739d640 1 --2- 172.21.15.117:0/386879651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae70102010 0x7fae70112b30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fae68004a30 tx=0x7fae68004d10 comp rx=0 tx=0).stop 2024-04-12T09:23:51.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.358+0000 7fae7739d640 1 -- 172.21.15.117:0/386879651 shutdown_connections 2024-04-12T09:23:51.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.358+0000 7fae7739d640 1 --2- 172.21.15.117:0/386879651 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fae5c06dc10 0x7fae5c0700c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:51.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.358+0000 7fae7739d640 1 --2- 172.21.15.117:0/386879651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae701029b0 0x7fae70113070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:51.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.358+0000 7fae7739d640 1 --2- 172.21.15.117:0/386879651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae70102010 0x7fae70112b30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:51.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.358+0000 7fae7739d640 1 -- 172.21.15.117:0/386879651 >> 172.21.15.117:0/386879651 conn(0x7fae700f7c20 msgr2=0x7fae700f8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:51.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.358+0000 7fae7739d640 1 -- 172.21.15.117:0/386879651 shutdown_connections 2024-04-12T09:23:51.361 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.358+0000 7fae7739d640 1 -- 172.21.15.117:0/386879651 wait complete. 2024-04-12T09:23:51.369 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-04-12T09:23:51.369 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-12T09:23:51.385 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T09:23:51.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.522+0000 7f79653ff640 1 -- 172.21.15.117:0/2044510308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7960100f30 msgr2=0x7f7960101300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:51.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.522+0000 7f79653ff640 1 --2- 172.21.15.117:0/2044510308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7960100f30 0x7f7960101300 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f79540048d0 tx=0x7f7954009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:51.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.522+0000 7f79653ff640 1 -- 172.21.15.117:0/2044510308 shutdown_connections 2024-04-12T09:23:51.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.522+0000 7f79653ff640 1 --2- 172.21.15.117:0/2044510308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79601018d0 0x7f79600faf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:51.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.522+0000 7f79653ff640 1 --2- 172.21.15.117:0/2044510308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7960100f30 0x7f7960101300 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:51.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.522+0000 7f79653ff640 1 -- 172.21.15.117:0/2044510308 >> 172.21.15.117:0/2044510308 conn(0x7f7960071ef0 msgr2=0x7f79600722f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:51.525 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.522+0000 7f79653ff640 1 -- 172.21.15.117:0/2044510308 shutdown_connections 2024-04-12T09:23:51.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.522+0000 7f79653ff640 1 -- 172.21.15.117:0/2044510308 wait complete. 2024-04-12T09:23:51.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.523+0000 7f79653ff640 1 Processor -- start 2024-04-12T09:23:51.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.523+0000 7f79653ff640 1 -- start start 2024-04-12T09:23:51.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.523+0000 7f79653ff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7960100f30 0x7f7960111ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:51.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.523+0000 7f79653ff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79601018d0 0x7f7960112020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:51.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.523+0000 7f79653ff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79601126b0 con 0x7f79601018d0 2024-04-12T09:23:51.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.523+0000 7f79653ff640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796010bc70 con 0x7f7960100f30 2024-04-12T09:23:51.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.523+0000 7f795e7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79601018d0 0x7f7960112020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:51.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.523+0000 7f795e7fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79601018d0 0x7f7960112020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39148/0 (socket says 172.21.15.117:39148) 2024-04-12T09:23:51.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.523+0000 7f795e7fc640 1 -- 172.21.15.117:0/1494107621 learned_addr learned my addr 172.21.15.117:0/1494107621 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:51.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.523+0000 7f795effd640 1 --2- 172.21.15.117:0/1494107621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7960100f30 0x7f7960111ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:51.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.524+0000 7f795e7fc640 1 -- 172.21.15.117:0/1494107621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7960100f30 msgr2=0x7f7960111ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:51.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.524+0000 7f795e7fc640 1 --2- 172.21.15.117:0/1494107621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7960100f30 0x7f7960111ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:51.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.524+0000 7f795e7fc640 1 -- 172.21.15.117:0/1494107621 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7954005040 con 0x7f79601018d0 2024-04-12T09:23:51.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.524+0000 7f795e7fc640 1 --2- 172.21.15.117:0/1494107621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79601018d0 0x7f7960112020 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f795000b790 tx=0x7f79500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:51.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.524+0000 7f79477fe640 1 -- 172.21.15.117:0/1494107621 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f795000c700 con 0x7f79601018d0 2024-04-12T09:23:51.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.524+0000 7f79653ff640 1 -- 172.21.15.117:0/1494107621 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796010bf50 con 0x7f79601018d0 2024-04-12T09:23:51.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.524+0000 7f79477fe640 1 -- 172.21.15.117:0/1494107621 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f795000cd30 con 0x7f79601018d0 2024-04-12T09:23:51.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.524+0000 7f79477fe640 1 -- 172.21.15.117:0/1494107621 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7950013370 con 0x7f79601018d0 2024-04-12T09:23:51.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.524+0000 7f79653ff640 1 -- 172.21.15.117:0/1494107621 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796010c470 con 0x7f79601018d0 2024-04-12T09:23:51.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.525+0000 7f79653ff640 1 -- 172.21.15.117:0/1494107621 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79600fc6a0 con 0x7f79601018d0 2024-04-12T09:23:51.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.526+0000 7f79477fe640 1 -- 172.21.15.117:0/1494107621 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f7950012070 con 0x7f79601018d0 2024-04-12T09:23:51.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.526+0000 7f79477fe640 1 --2- 172.21.15.117:0/1494107621 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f794806dc10 0x7f79480700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:51.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.526+0000 7f79477fe640 1 -- 172.21.15.117:0/1494107621 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f795008d180 con 0x7f79601018d0 2024-04-12T09:23:51.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.526+0000 7f795effd640 1 --2- 172.21.15.117:0/1494107621 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f794806dc10 0x7f79480700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:51.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.526+0000 7f795effd640 1 --2- 172.21.15.117:0/1494107621 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f794806dc10 0x7f79480700c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7954031870 tx=0x7f7954009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:51.531 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.531+0000 7f79477fe640 1 -- 172.21.15.117:0/1494107621 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f79500566b0 con 0x7f79601018d0 2024-04-12T09:23:51.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.707+0000 7f79653ff640 1 -- 172.21.15.117:0/1494107621 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79601080f0 con 0x7f79601018d0 2024-04-12T09:23:51.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.708+0000 7f79477fe640 1 -- 172.21.15.117:0/1494107621 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16854 (secure 0 0 0) 0x7f7950059d70 con 0x7f79601018d0 2024-04-12T09:23:51.709 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-04-12T09:23:51.709 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":83,"fsid":"12161984-f8ab-11ee-bc8c-c7b262605968","created":"2024-04-12T09:01:24.210047+0000","modified":"2024-04-12T09:21:27.299210+0000","last_up_change":"2024-04-12T09:20:19.524182+0000","last_in_change":"2024-04-12T09:06:33.833263+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T09:05:39.657213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-12T09:08:11.435513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-12T09:08:11.715605+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8bdd258-6f40-440f-b279-038d9b35e791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":1144390473},{"type":"v1","addr":"172.21.15.117:6803","nonce":1144390473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":1144390473},{"type":"v1","addr":"172.21.15.117:6805","nonce":1144390473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":1144390473},{"type":"v1","addr":"172.21.15.117:6809","nonce":1144390473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":1144390473},{"type":"v1","addr":"172.21.15.117:6807","nonce":1144390473}]},"public_addr":"172.21.15.117:6803/1144390473","cluster_addr":"172.21.15.117:6805/1144390473","heartbeat_back_addr":"172.21.15.117:6809/1144390473","heartbeat_front_addr":"172.21.15.117:6807/1144390473","state":["exists","up"]},{"osd":1,"uuid":"ab723885-9e88-47ad-8e80-cb5871bf0d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2606394957},{"type":"v1","addr":"172.21.15.117:6811","nonce":2606394957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2606394957},{"type":"v1","addr":"172.21.15.117:6813","nonce":2606394957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2606394957},{"type":"v1","addr":"172.21.15.117:6817","nonce":2606394957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2606394957},{"type":"v1","addr":"172.21.15.117:6815","nonce":2606394957}]},"public_addr":"172.21.15.117:6811/2606394957","cluster_addr":"172.21.15.117:6813/2606394957","heartbeat_back_addr":"172.21.15.117:6817/2606394957","heartbeat_front_addr":"172.21.15.117:6815/2606394957","state":["exists","up"]},{"osd":2,"uuid":"14f76ed3-2938-45c1-9cc7-4c0486c602ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":4153226618},{"type":"v1","addr":"172.21.15.117:6819","nonce":4153226618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":4153226618},{"type":"v1","addr":"172.21.15.117:6821","nonce":4153226618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":4153226618},{"type":"v1","addr":"172.21.15.117:6825","nonce":4153226618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":4153226618},{"type":"v1","addr":"172.21.15.117:6823","nonce":4153226618}]},"public_addr":"172.21.15.117:6819/4153226618","cluster_addr":"172.21.15.117:6821/4153226618","heartbeat_back_addr":"172.21.15.117:6825/4153226618","heartbeat_front_addr":"172.21.15.117:6823/4153226618","state":["exists","up"]},{"osd":3,"uuid":"e2bd1672-4153-498a-a20b-838516b0876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1424266498},{"type":"v1","addr":"172.21.15.203:6801","nonce":1424266498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1424266498},{"type":"v1","addr":"172.21.15.203:6803","nonce":1424266498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1424266498},{"type":"v1","addr":"172.21.15.203:6807","nonce":1424266498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1424266498},{"type":"v1","addr":"172.21.15.203:6805","nonce":1424266498}]},"public_addr":"172.21.15.203:6801/1424266498","cluster_addr":"172.21.15.203:6803/1424266498","heartbeat_back_addr":"172.21.15.203:6807/1424266498","heartbeat_front_addr":"172.21.15.203:6805/1424266498","state":["exists","up"]},{"osd":4,"uuid":"e8e6b7b8-45c2-4186-aeef-9b2feccf9fe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":674159092},{"type":"v1","addr":"172.21.15.203:6809","nonce":674159092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":674159092},{"type":"v1","addr":"172.21.15.203:6811","nonce":674159092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":674159092},{"type":"v1","addr":"172.21.15.203:6815","nonce":674159092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":674159092},{"type":"v1","addr":"172.21.15.203:6813","nonce":674159092}]},"public_addr":"172.21.15.203:6809/674159092","cluster_addr":"172.21.15.203:6811/674159092","heartbeat_back_addr":"172.21.15.203:6815/674159092","heartbeat_front_addr":"172.21.15.203:6813/674159092","state":["exists","up"]},{"osd":5,"uuid":"abbad141-29e9-4028-9e29-293cc73169fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3403215254},{"type":"v1","addr":"172.21.15.203:6817","nonce":3403215254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":3403215254},{"type":"v1","addr":"172.21.15.203:6819","nonce":3403215254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":3403215254},{"type":"v1","addr":"172.21.15.203:6823","nonce":3403215254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3403215254},{"type":"v1","addr":"172.21.15.203:6821","nonce":3403215254}]},"public_addr":"172.21.15.203:6817/3403215254","cluster_addr":"172.21.15.203:6819/3403215254","heartbeat_back_addr":"172.21.15.203:6823/3403215254","heartbeat_front_addr":"172.21.15.203:6821/3403215254","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:04:41.240834+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:05:09.825336+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:05:37.699545+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:06:01.471956+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:06:25.743473+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T09:06:50.806872+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.203:6827/2731911290":"2024-04-13T09:21:27.299121+0000","172.21.15.203:6825/840607003":"2024-04-13T09:21:05.261605+0000","172.21.15.203:6824/840607003":"2024-04-13T09:21:05.261605+0000","172.21.15.117:0/4018826114":"2024-04-13T09:01:50.340337+0000","172.21.15.117:6800/2893585477":"2024-04-13T09:01:50.340337+0000","172.21.15.203:0/857573796":"2024-04-13T09:12:54.846397+0000","172.21.15.117:0/2084327023":"2024-04-13T09:10:44.739720+0000","172.21.15.203:0/117634547":"2024-04-13T09:12:54.846397+0000","172.21.15.117:0/3616310373":"2024-04-13T09:10:44.739720+0000","172.21.15.117:6801/3945342300":"2024-04-13T09:10:44.739720+0000","172.21.15.117:6800/3945342300":"2024-04-13T09:10:44.739720+0000","172.21.15.117:0/2514545829":"2024-04-13T09:03:31.333423+0000","172.21.15.203:0/2267178897":"2024-04-13T09:12:54.846397+0000","172.21.15.117:0/1161639266":"2024-04-13T09:15:54.541045+0000","172.21.15.117:6801/2893585477":"2024-04-13T09:01:50.340337+0000","172.21.15.117:6801/791370182":"2024-04-13T09:02:21.422544+0000","172.21.15.117:0/86407959":"2024-04-13T09:02:21.422544+0000","172.21.15.117:0/960981120":"2024-04-13T09:01:50.340337+0000","172.21.15.117:6828/2248590199":"2024-04-13T09:20:43.484776+0000","172.21.15.117:6829/2248590199":"2024-04-13T09:20:43.484776+0000","172.21.15.203:0/2976070431":"2024-04-13T09:12:54.846397+0000","172.21.15.117:0/801788487":"2024-04-13T09:10:44.739720+0000","172.21.15.117:0/2869338383":"2024-04-13T09:02:21.422544+0000","172.21.15.117:0/3452542055":"2024-04-13T09:15:54.541045+0000","172.21.15.117:0/3873562739":"2024-04-13T09:10:44.739720+0000","172.21.15.203:6829/2773660052":"2024-04-13T09:12:54.846397+0000","172.21.15.117:0/1603484270":"2024-04-13T09:15:54.541045+0000","172.21.15.117:6827/1717609783":"2024-04-13T09:08:27.549563+0000","172.21.15.117:0/2305921992":"2024-04-13T09:01:50.340337+0000","172.21.15.203:6828/2773660052":"2024-04-13T09:12:54.846397+0000","172.21.15.117:0/4061615302":"2024-04-13T09:03:31.333423+0000","172.21.15.117:6800/791370182":"2024-04-13T09:02:21.422544+0000","172.21.15.117:0/448067539":"2024-04-13T09:03:31.333423+0000","172.21.15.203:6826/2731911290":"2024-04-13T09:21:27.299121+0000","172.21.15.117:0/2635780056":"2024-04-13T09:02:21.422544+0000","172.21.15.117:6801/790148838":"2024-04-13T09:03:31.333423+0000","172.21.15.117:6826/1717609783":"2024-04-13T09:08:27.549563+0000","172.21.15.117:0/2884121108":"2024-04-13T09:15:54.541045+0000","172.21.15.117:6800/790148838":"2024-04-13T09:03:31.333423+0000","172.21.15.117:6800/1056729457":"2024-04-13T09:15:54.541045+0000","172.21.15.117:6801/1056729457":"2024-04-13T09:15:54.541045+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T09:23:51.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.710+0000 7f79653ff640 1 -- 172.21.15.117:0/1494107621 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f794806dc10 msgr2=0x7f79480700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:51.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.710+0000 7f79653ff640 1 --2- 172.21.15.117:0/1494107621 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f794806dc10 0x7f79480700c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7954031870 tx=0x7f7954009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:51.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.710+0000 7f79653ff640 1 -- 172.21.15.117:0/1494107621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79601018d0 msgr2=0x7f7960112020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:51.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.710+0000 7f79653ff640 1 --2- 172.21.15.117:0/1494107621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79601018d0 0x7f7960112020 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f795000b790 tx=0x7f79500091d0 comp rx=0 tx=0).stop 2024-04-12T09:23:51.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.710+0000 7f79653ff640 1 -- 172.21.15.117:0/1494107621 shutdown_connections 2024-04-12T09:23:51.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.710+0000 7f79653ff640 1 --2- 172.21.15.117:0/1494107621 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f794806dc10 0x7f79480700c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:51.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.710+0000 7f79653ff640 1 --2- 172.21.15.117:0/1494107621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79601018d0 0x7f7960112020 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:51.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.710+0000 7f79653ff640 1 --2- 172.21.15.117:0/1494107621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7960100f30 0x7f7960111ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:51.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.710+0000 7f79653ff640 1 -- 172.21.15.117:0/1494107621 >> 172.21.15.117:0/1494107621 conn(0x7f7960071ef0 msgr2=0x7f79600f9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:51.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.710+0000 7f79653ff640 1 -- 172.21.15.117:0/1494107621 shutdown_connections 2024-04-12T09:23:51.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.710+0000 7f79653ff640 1 -- 172.21.15.117:0/1494107621 wait complete. 2024-04-12T09:23:51.722 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-12T09:05:39.657213+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-12T09:08:11.435513+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-12T09:08:11.715605+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-12T09:23:51.722 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-12T09:23:51.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.822+0000 7f3a18d9d640 1 -- 172.21.15.117:0/1338398057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a14100f10 msgr2=0x7f3a141012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:51.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.822+0000 7f3a18d9d640 1 --2- 172.21.15.117:0/1338398057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a14100f10 0x7f3a141012e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3a040048d0 tx=0x7f3a04009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:51.825 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.822+0000 7f3a18d9d640 1 -- 172.21.15.117:0/1338398057 shutdown_connections 2024-04-12T09:23:51.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.822+0000 7f3a18d9d640 1 --2- 172.21.15.117:0/1338398057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a141018b0 0x7f3a140faf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:51.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.822+0000 7f3a18d9d640 1 --2- 172.21.15.117:0/1338398057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a14100f10 0x7f3a141012e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:51.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.823+0000 7f3a18d9d640 1 -- 172.21.15.117:0/1338398057 >> 172.21.15.117:0/1338398057 conn(0x7f3a14071e80 msgr2=0x7f3a14072280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:51.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.823+0000 7f3a18d9d640 1 -- 172.21.15.117:0/1338398057 shutdown_connections 2024-04-12T09:23:51.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.823+0000 7f3a18d9d640 1 -- 172.21.15.117:0/1338398057 wait complete. 2024-04-12T09:23:51.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.823+0000 7f3a18d9d640 1 Processor -- start 2024-04-12T09:23:51.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.823+0000 7f3a18d9d640 1 -- start start 2024-04-12T09:23:51.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.823+0000 7f3a18d9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a14100f10 0x7f3a1410ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:51.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.823+0000 7f3a18d9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a141018b0 0x7f3a1410e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:51.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.823+0000 7f3a18d9d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1410e830 con 0x7f3a141018b0 2024-04-12T09:23:51.826 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.823+0000 7f3a18d9d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1410e9a0 con 0x7f3a14100f10 2024-04-12T09:23:51.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.823+0000 7f3a12ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a141018b0 0x7f3a1410e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:51.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.824+0000 7f3a12ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a141018b0 0x7f3a1410e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39174/0 (socket says 172.21.15.117:39174) 2024-04-12T09:23:51.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.824+0000 7f3a12ffd640 1 -- 172.21.15.117:0/1660075527 learned_addr learned my addr 172.21.15.117:0/1660075527 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:51.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.824+0000 7f3a137fe640 1 --2- 172.21.15.117:0/1660075527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a14100f10 0x7f3a1410ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:51.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.824+0000 7f3a12ffd640 1 -- 172.21.15.117:0/1660075527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a14100f10 msgr2=0x7f3a1410ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:51.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.824+0000 7f3a12ffd640 1 --2- 172.21.15.117:0/1660075527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a14100f10 0x7f3a1410ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:51.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.824+0000 7f3a12ffd640 1 -- 172.21.15.117:0/1660075527 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a04005040 con 0x7f3a141018b0 2024-04-12T09:23:51.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.824+0000 7f3a12ffd640 1 --2- 172.21.15.117:0/1660075527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a141018b0 0x7f3a1410e2f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3a0800b790 tx=0x7f3a080091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:51.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.824+0000 7f39fbfff640 1 -- 172.21.15.117:0/1660075527 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a0800c700 con 0x7f3a141018b0 2024-04-12T09:23:51.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.824+0000 7f3a18d9d640 1 -- 172.21.15.117:0/1660075527 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a14116e20 con 0x7f3a141018b0 2024-04-12T09:23:51.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.824+0000 7f39fbfff640 1 -- 172.21.15.117:0/1660075527 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a0800cd30 con 0x7f3a141018b0 2024-04-12T09:23:51.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.824+0000 7f39fbfff640 1 -- 172.21.15.117:0/1660075527 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a08013370 con 0x7f3a141018b0 2024-04-12T09:23:51.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.824+0000 7f3a18d9d640 1 -- 172.21.15.117:0/1660075527 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a14117150 con 0x7f3a141018b0 2024-04-12T09:23:51.827 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.825+0000 7f3a18d9d640 1 -- 172.21.15.117:0/1660075527 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a140fc680 con 0x7f3a141018b0 2024-04-12T09:23:51.828 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.826+0000 7f39fbfff640 1 -- 172.21.15.117:0/1660075527 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f3a08012070 con 0x7f3a141018b0 2024-04-12T09:23:51.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.826+0000 7f39fbfff640 1 --2- 172.21.15.117:0/1660075527 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f39fc06dc10 0x7f39fc0700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:51.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.826+0000 7f39fbfff640 1 -- 172.21.15.117:0/1660075527 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f3a0808d230 con 0x7f3a141018b0 2024-04-12T09:23:51.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.826+0000 7f3a137fe640 1 --2- 172.21.15.117:0/1660075527 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f39fc06dc10 0x7f39fc0700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:51.829 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.826+0000 7f3a137fe640 1 --2- 172.21.15.117:0/1660075527 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f39fc06dc10 0x7f39fc0700c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3a04003080 tx=0x7f3a04009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:51.833 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:51.833+0000 7f39fbfff640 1 -- 172.21.15.117:0/1660075527 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f3a08056760 con 0x7f3a141018b0 2024-04-12T09:23:52.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.004+0000 7f3a18d9d640 1 -- 172.21.15.117:0/1660075527 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a141080d0 con 0x7f3a141018b0 2024-04-12T09:23:52.005 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.004+0000 7f39fbfff640 1 -- 172.21.15.117:0/1660075527 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a08059e20 con 0x7f3a141018b0 2024-04-12T09:23:52.005 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 1 2024-04-12T09:23:52.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.006+0000 7f3a18d9d640 1 -- 172.21.15.117:0/1660075527 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f39fc06dc10 msgr2=0x7f39fc0700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:52.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.006+0000 7f3a18d9d640 1 --2- 172.21.15.117:0/1660075527 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f39fc06dc10 0x7f39fc0700c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3a04003080 tx=0x7f3a04009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.006+0000 7f3a18d9d640 1 -- 172.21.15.117:0/1660075527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a141018b0 msgr2=0x7f3a1410e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:52.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.006+0000 7f3a18d9d640 1 --2- 172.21.15.117:0/1660075527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a141018b0 0x7f3a1410e2f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3a0800b790 tx=0x7f3a080091d0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.006+0000 7f3a18d9d640 1 -- 172.21.15.117:0/1660075527 shutdown_connections 2024-04-12T09:23:52.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.006+0000 7f3a18d9d640 1 --2- 172.21.15.117:0/1660075527 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f39fc06dc10 0x7f39fc0700c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.006+0000 7f3a18d9d640 1 --2- 172.21.15.117:0/1660075527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a141018b0 0x7f3a1410e2f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.006+0000 7f3a18d9d640 1 --2- 172.21.15.117:0/1660075527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a14100f10 0x7f3a1410ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.006+0000 7f3a18d9d640 1 -- 172.21.15.117:0/1660075527 >> 172.21.15.117:0/1660075527 conn(0x7f3a14071e80 msgr2=0x7f3a14103cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:52.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.007+0000 7f3a18d9d640 1 -- 172.21.15.117:0/1660075527 shutdown_connections 2024-04-12T09:23:52.008 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.007+0000 7f3a18d9d640 1 -- 172.21.15.117:0/1660075527 wait complete. 2024-04-12T09:23:52.017 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:51 smithi117 ceph-mon[113571]: pgmap v275: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:52.017 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:51 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/1646282723' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-12T09:23:52.017 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:51 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/386879651' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-12T09:23:52.017 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:51 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/1494107621' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T09:23:52.018 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-12T09:23:52.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.117+0000 7fc4420ee640 1 -- 172.21.15.117:0/2662329684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c0643a0 msgr2=0x7fc43c0647d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:52.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.117+0000 7fc4420ee640 1 --2- 172.21.15.117:0/2662329684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c0643a0 0x7fc43c0647d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc4300048d0 tx=0x7fc430009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.117+0000 7fc4420ee640 1 -- 172.21.15.117:0/2662329684 shutdown_connections 2024-04-12T09:23:52.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.117+0000 7fc4420ee640 1 --2- 172.21.15.117:0/2662329684 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c0643a0 0x7fc43c0647d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.117+0000 7fc4420ee640 1 --2- 172.21.15.117:0/2662329684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc43c102240 0x7fc43c102610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.117+0000 7fc4420ee640 1 -- 172.21.15.117:0/2662329684 >> 172.21.15.117:0/2662329684 conn(0x7fc43c0710b0 msgr2=0x7fc43c0714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:52.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.117+0000 7fc4420ee640 1 -- 172.21.15.117:0/2662329684 shutdown_connections 2024-04-12T09:23:52.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.117+0000 7fc4420ee640 1 -- 172.21.15.117:0/2662329684 wait complete. 2024-04-12T09:23:52.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.118+0000 7fc4420ee640 1 Processor -- start 2024-04-12T09:23:52.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.118+0000 7fc4420ee640 1 -- start start 2024-04-12T09:23:52.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.118+0000 7fc4420ee640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc43c0643a0 0x7fc43c112cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:52.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.118+0000 7fc4420ee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c102240 0x7fc43c113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:52.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.118+0000 7fc4420ee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c113800 con 0x7fc43c102240 2024-04-12T09:23:52.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.118+0000 7fc4420ee640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c10ce50 con 0x7fc43c0643a0 2024-04-12T09:23:52.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.118+0000 7fc43affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c102240 0x7fc43c113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:52.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.118+0000 7fc43affd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c102240 0x7fc43c113200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39194/0 (socket says 172.21.15.117:39194) 2024-04-12T09:23:52.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.118+0000 7fc43affd640 1 -- 172.21.15.117:0/2388362116 learned_addr learned my addr 172.21.15.117:0/2388362116 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:52.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.118+0000 7fc43b7fe640 1 --2- 172.21.15.117:0/2388362116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc43c0643a0 0x7fc43c112cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:52.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.118+0000 7fc43affd640 1 -- 172.21.15.117:0/2388362116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc43c0643a0 msgr2=0x7fc43c112cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:52.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.118+0000 7fc43affd640 1 --2- 172.21.15.117:0/2388362116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc43c0643a0 0x7fc43c112cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.118+0000 7fc43affd640 1 -- 172.21.15.117:0/2388362116 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc430005040 con 0x7fc43c102240 2024-04-12T09:23:52.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.118+0000 7fc43b7fe640 1 --2- 172.21.15.117:0/2388362116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc43c0643a0 0x7fc43c112cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T09:23:52.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.119+0000 7fc43affd640 1 --2- 172.21.15.117:0/2388362116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c102240 0x7fc43c113200 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc430004930 tx=0x7fc430009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:52.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.119+0000 7fc423fff640 1 -- 172.21.15.117:0/2388362116 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4300094c0 con 0x7fc43c102240 2024-04-12T09:23:52.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.119+0000 7fc423fff640 1 -- 172.21.15.117:0/2388362116 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc430032e50 con 0x7fc43c102240 2024-04-12T09:23:52.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.119+0000 7fc4420ee640 1 -- 172.21.15.117:0/2388362116 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43c10d0d0 con 0x7fc43c102240 2024-04-12T09:23:52.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.119+0000 7fc423fff640 1 -- 172.21.15.117:0/2388362116 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4300433b0 con 0x7fc43c102240 2024-04-12T09:23:52.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.119+0000 7fc4420ee640 1 -- 172.21.15.117:0/2388362116 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43c10d590 con 0x7fc43c102240 2024-04-12T09:23:52.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.120+0000 7fc4420ee640 1 -- 172.21.15.117:0/2388362116 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43c0fd940 con 0x7fc43c102240 2024-04-12T09:23:52.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.120+0000 7fc423fff640 1 -- 172.21.15.117:0/2388362116 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fc43002f070 con 0x7fc43c102240 2024-04-12T09:23:52.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.121+0000 7fc423fff640 1 --2- 172.21.15.117:0/2388362116 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc42406dc10 0x7fc4240700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:52.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.121+0000 7fc423fff640 1 -- 172.21.15.117:0/2388362116 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fc4300af460 con 0x7fc43c102240 2024-04-12T09:23:52.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.121+0000 7fc43b7fe640 1 --2- 172.21.15.117:0/2388362116 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc42406dc10 0x7fc4240700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:52.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.121+0000 7fc43b7fe640 1 --2- 172.21.15.117:0/2388362116 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc42406dc10 0x7fc4240700c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009fd0 tx=0x7fc42c009e50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:52.125 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.125+0000 7fc423fff640 1 -- 172.21.15.117:0/2388362116 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fc430078990 con 0x7fc43c102240 2024-04-12T09:23:52.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.298+0000 7fc4420ee640 1 -- 172.21.15.117:0/2388362116 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fc43c109300 con 0x7fc43c102240 2024-04-12T09:23:52.299 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.299+0000 7fc423fff640 1 -- 172.21.15.117:0/2388362116 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7fc43007c050 con 0x7fc43c102240 2024-04-12T09:23:52.299 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 32 2024-04-12T09:23:52.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.300+0000 7fc4420ee640 1 -- 172.21.15.117:0/2388362116 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc42406dc10 msgr2=0x7fc4240700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:52.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.300+0000 7fc4420ee640 1 --2- 172.21.15.117:0/2388362116 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc42406dc10 0x7fc4240700c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009fd0 tx=0x7fc42c009e50 comp rx=0 tx=0).stop 2024-04-12T09:23:52.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.300+0000 7fc4420ee640 1 -- 172.21.15.117:0/2388362116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c102240 msgr2=0x7fc43c113200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:52.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.300+0000 7fc4420ee640 1 --2- 172.21.15.117:0/2388362116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c102240 0x7fc43c113200 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc430004930 tx=0x7fc430009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.301+0000 7fc4420ee640 1 -- 172.21.15.117:0/2388362116 shutdown_connections 2024-04-12T09:23:52.301 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.301+0000 7fc4420ee640 1 --2- 172.21.15.117:0/2388362116 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fc42406dc10 0x7fc4240700c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.301+0000 7fc4420ee640 1 --2- 172.21.15.117:0/2388362116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc43c102240 0x7fc43c113200 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.301+0000 7fc4420ee640 1 --2- 172.21.15.117:0/2388362116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc43c0643a0 0x7fc43c112cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.301+0000 7fc4420ee640 1 -- 172.21.15.117:0/2388362116 >> 172.21.15.117:0/2388362116 conn(0x7fc43c0710b0 msgr2=0x7fc43c0f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:52.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.301+0000 7fc4420ee640 1 -- 172.21.15.117:0/2388362116 shutdown_connections 2024-04-12T09:23:52.302 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.301+0000 7fc4420ee640 1 -- 172.21.15.117:0/2388362116 wait complete. 2024-04-12T09:23:52.312 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-12T09:23:52.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:51 smithi203 ceph-mon[86783]: pgmap v275: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:52.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:51 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/1646282723' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-12T09:23:52.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:51 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/386879651' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-12T09:23:52.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:51 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/1494107621' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-12T09:23:52.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.412+0000 7fb203cee640 1 -- 172.21.15.117:0/4255994531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1fc101140 msgr2=0x7fb1fc101510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:52.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.412+0000 7fb203cee640 1 --2- 172.21.15.117:0/4255994531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1fc101140 0x7fb1fc101510 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb1f80048d0 tx=0x7fb1f8009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.412+0000 7fb203cee640 1 -- 172.21.15.117:0/4255994531 shutdown_connections 2024-04-12T09:23:52.415 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.412+0000 7fb203cee640 1 --2- 172.21.15.117:0/4255994531 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1fc0fb110 0x7fb1fc0fb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.412+0000 7fb203cee640 1 --2- 172.21.15.117:0/4255994531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1fc101140 0x7fb1fc101510 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.412+0000 7fb203cee640 1 -- 172.21.15.117:0/4255994531 >> 172.21.15.117:0/4255994531 conn(0x7fb1fc0710b0 msgr2=0x7fb1fc0714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:52.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.412+0000 7fb203cee640 1 -- 172.21.15.117:0/4255994531 shutdown_connections 2024-04-12T09:23:52.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.412+0000 7fb203cee640 1 -- 172.21.15.117:0/4255994531 wait complete. 2024-04-12T09:23:52.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.413+0000 7fb203cee640 1 Processor -- start 2024-04-12T09:23:52.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.413+0000 7fb203cee640 1 -- start start 2024-04-12T09:23:52.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.413+0000 7fb203cee640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1fc0fb110 0x7fb1fc10de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:52.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.413+0000 7fb203cee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1fc101140 0x7fb1fc10e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:52.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.413+0000 7fb203cee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc10e8d0 con 0x7fb1fc101140 2024-04-12T09:23:52.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.413+0000 7fb203cee640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc10ea40 con 0x7fb1fc0fb110 2024-04-12T09:23:52.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.413+0000 7fb201289640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1fc101140 0x7fb1fc10e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:52.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.413+0000 7fb201289640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1fc101140 0x7fb1fc10e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39208/0 (socket says 172.21.15.117:39208) 2024-04-12T09:23:52.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.413+0000 7fb201289640 1 -- 172.21.15.117:0/1266453497 learned_addr learned my addr 172.21.15.117:0/1266453497 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:52.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.413+0000 7fb201a8a640 1 --2- 172.21.15.117:0/1266453497 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1fc0fb110 0x7fb1fc10de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:52.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.413+0000 7fb201289640 1 -- 172.21.15.117:0/1266453497 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1fc0fb110 msgr2=0x7fb1fc10de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:52.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.413+0000 7fb201289640 1 --2- 172.21.15.117:0/1266453497 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1fc0fb110 0x7fb1fc10de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.413+0000 7fb201289640 1 -- 172.21.15.117:0/1266453497 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f8005040 con 0x7fb1fc101140 2024-04-12T09:23:52.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.414+0000 7fb201289640 1 --2- 172.21.15.117:0/1266453497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1fc101140 0x7fb1fc10e390 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec002a50 tx=0x7fb1ec004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:52.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.414+0000 7fb1f27fc640 1 -- 172.21.15.117:0/1266453497 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1ec007c30 con 0x7fb1fc101140 2024-04-12T09:23:52.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.414+0000 7fb1f27fc640 1 -- 172.21.15.117:0/1266453497 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb1ec00f040 con 0x7fb1fc101140 2024-04-12T09:23:52.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.414+0000 7fb203cee640 1 -- 172.21.15.117:0/1266453497 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1fc116ec0 con 0x7fb1fc101140 2024-04-12T09:23:52.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.414+0000 7fb1f27fc640 1 -- 172.21.15.117:0/1266453497 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1ec00db50 con 0x7fb1fc101140 2024-04-12T09:23:52.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.414+0000 7fb203cee640 1 -- 172.21.15.117:0/1266453497 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1fc1171f0 con 0x7fb1fc101140 2024-04-12T09:23:52.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.415+0000 7fb203cee640 1 -- 172.21.15.117:0/1266453497 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1fc0fc800 con 0x7fb1fc101140 2024-04-12T09:23:52.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.415+0000 7fb1f27fc640 1 -- 172.21.15.117:0/1266453497 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7fb1ec01c400 con 0x7fb1fc101140 2024-04-12T09:23:52.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.416+0000 7fb1f27fc640 1 --2- 172.21.15.117:0/1266453497 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb1e806dc20 0x7fb1e80700d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:52.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.416+0000 7fb1f27fc640 1 -- 172.21.15.117:0/1266453497 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb1ec08cee0 con 0x7fb1fc101140 2024-04-12T09:23:52.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.416+0000 7fb201a8a640 1 --2- 172.21.15.117:0/1266453497 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb1e806dc20 0x7fb1e80700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:52.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.416+0000 7fb201a8a640 1 --2- 172.21.15.117:0/1266453497 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb1e806dc20 0x7fb1e80700d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8003080 tx=0x7fb1f8009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:52.420 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.420+0000 7fb1f27fc640 1 -- 172.21.15.117:0/1266453497 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7fb1ec056410 con 0x7fb1fc101140 2024-04-12T09:23:52.595 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.595+0000 7fb203cee640 1 -- 172.21.15.117:0/1266453497 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fb1fc04bcc0 con 0x7fb1fc101140 2024-04-12T09:23:52.596 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.595+0000 7fb1f27fc640 1 -- 172.21.15.117:0/1266453497 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v83) v1 ==== 107+0+11 (secure 0 0 0) 0x7fb1ec059ad0 con 0x7fb1fc101140 2024-04-12T09:23:52.596 INFO:teuthology.orchestra.run.smithi117.stdout:pg_num: 32 2024-04-12T09:23:52.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.597+0000 7fb203cee640 1 -- 172.21.15.117:0/1266453497 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb1e806dc20 msgr2=0x7fb1e80700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:52.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.597+0000 7fb203cee640 1 --2- 172.21.15.117:0/1266453497 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb1e806dc20 0x7fb1e80700d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8003080 tx=0x7fb1f8009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.597+0000 7fb203cee640 1 -- 172.21.15.117:0/1266453497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1fc101140 msgr2=0x7fb1fc10e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:52.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.597+0000 7fb203cee640 1 --2- 172.21.15.117:0/1266453497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1fc101140 0x7fb1fc10e390 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec002a50 tx=0x7fb1ec004600 comp rx=0 tx=0).stop 2024-04-12T09:23:52.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.597+0000 7fb203cee640 1 -- 172.21.15.117:0/1266453497 shutdown_connections 2024-04-12T09:23:52.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.597+0000 7fb203cee640 1 --2- 172.21.15.117:0/1266453497 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7fb1e806dc20 0x7fb1e80700d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.598 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.597+0000 7fb203cee640 1 --2- 172.21.15.117:0/1266453497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1fc101140 0x7fb1fc10e390 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.597+0000 7fb203cee640 1 --2- 172.21.15.117:0/1266453497 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1fc0fb110 0x7fb1fc10de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.597+0000 7fb203cee640 1 -- 172.21.15.117:0/1266453497 >> 172.21.15.117:0/1266453497 conn(0x7fb1fc0710b0 msgr2=0x7fb1fc0f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:52.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.597+0000 7fb203cee640 1 -- 172.21.15.117:0/1266453497 shutdown_connections 2024-04-12T09:23:52.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.597+0000 7fb203cee640 1 -- 172.21.15.117:0/1266453497 wait complete. 2024-04-12T09:23:52.609 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-12T09:23:52.710 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.708+0000 7f78e9cee640 1 -- 172.21.15.117:0/3155632385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78e4101a90 msgr2=0x7f78e40fb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:52.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.708+0000 7f78e9cee640 1 --2- 172.21.15.117:0/3155632385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78e4101a90 0x7f78e40fb120 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f78d80048d0 tx=0x7f78d8009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.708+0000 7f78e9cee640 1 -- 172.21.15.117:0/3155632385 shutdown_connections 2024-04-12T09:23:52.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.708+0000 7f78e9cee640 1 --2- 172.21.15.117:0/3155632385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78e4101a90 0x7f78e40fb120 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.708+0000 7f78e9cee640 1 --2- 172.21.15.117:0/3155632385 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f78e41010f0 0x7f78e41014c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.708+0000 7f78e9cee640 1 -- 172.21.15.117:0/3155632385 >> 172.21.15.117:0/3155632385 conn(0x7f78e40f6d00 msgr2=0x7f78e40f9110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:52.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.708+0000 7f78e9cee640 1 -- 172.21.15.117:0/3155632385 shutdown_connections 2024-04-12T09:23:52.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.708+0000 7f78e9cee640 1 -- 172.21.15.117:0/3155632385 wait complete. 2024-04-12T09:23:52.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.708+0000 7f78e9cee640 1 Processor -- start 2024-04-12T09:23:52.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.709+0000 7f78e9cee640 1 -- start start 2024-04-12T09:23:52.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.709+0000 7f78e9cee640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78e41010f0 0x7f78e410e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:52.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.709+0000 7f78e9cee640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f78e4101a90 0x7f78e410e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:52.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.709+0000 7f78e9cee640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e4066530 con 0x7f78e41010f0 2024-04-12T09:23:52.711 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.709+0000 7f78e9cee640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e410ec60 con 0x7f78e4101a90 2024-04-12T09:23:52.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.709+0000 7f78e37fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78e41010f0 0x7f78e410e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:52.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.709+0000 7f78e37fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78e41010f0 0x7f78e410e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:39226/0 (socket says 172.21.15.117:39226) 2024-04-12T09:23:52.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.709+0000 7f78e37fe640 1 -- 172.21.15.117:0/1519922108 learned_addr learned my addr 172.21.15.117:0/1519922108 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-04-12T09:23:52.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.709+0000 7f78e37fe640 1 -- 172.21.15.117:0/1519922108 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f78e4101a90 msgr2=0x7f78e410e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:52.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.709+0000 7f78e37fe640 1 --2- 172.21.15.117:0/1519922108 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f78e4101a90 0x7f78e410e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.709+0000 7f78e37fe640 1 -- 172.21.15.117:0/1519922108 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d8005040 con 0x7f78e41010f0 2024-04-12T09:23:52.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.709+0000 7f78e37fe640 1 --2- 172.21.15.117:0/1519922108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78e41010f0 0x7f78e410e1e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f78d4002a50 tx=0x7f78d4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:52.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.709+0000 7f78cbfff640 1 -- 172.21.15.117:0/1519922108 <== mon.0 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78d4007c30 con 0x7f78e41010f0 2024-04-12T09:23:52.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.710+0000 7f78e9cee640 1 -- 172.21.15.117:0/1519922108 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e410ef40 con 0x7f78e41010f0 2024-04-12T09:23:52.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.710+0000 7f78cbfff640 1 -- 172.21.15.117:0/1519922108 <== mon.0 v2:172.21.15.117:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f78d400f040 con 0x7f78e41010f0 2024-04-12T09:23:52.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.710+0000 7f78cbfff640 1 -- 172.21.15.117:0/1519922108 <== mon.0 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78d400db50 con 0x7f78e41010f0 2024-04-12T09:23:52.712 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.710+0000 7f78e9cee640 1 -- 172.21.15.117:0/1519922108 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e4117500 con 0x7f78e41010f0 2024-04-12T09:23:52.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.710+0000 7f78e9cee640 1 -- 172.21.15.117:0/1519922108 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e40fc860 con 0x7f78e41010f0 2024-04-12T09:23:52.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.711+0000 7f78cbfff640 1 -- 172.21.15.117:0/1519922108 <== mon.0 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 39) v1 ==== 91861+0+0 (secure 0 0 0) 0x7f78d401c400 con 0x7f78e41010f0 2024-04-12T09:23:52.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.711+0000 7f78cbfff640 1 --2- 172.21.15.117:0/1519922108 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f78cc06dc20 0x7f78cc0700d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T09:23:52.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.711+0000 7f78cbfff640 1 -- 172.21.15.117:0/1519922108 <== mon.0 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f78d408ced0 con 0x7f78e41010f0 2024-04-12T09:23:52.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.711+0000 7f78e2ffd640 1 --2- 172.21.15.117:0/1519922108 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f78cc06dc20 0x7f78cc0700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T09:23:52.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.712+0000 7f78e2ffd640 1 --2- 172.21.15.117:0/1519922108 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f78cc06dc20 0x7f78cc0700d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f78d8003080 tx=0x7f78d8009da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T09:23:52.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.716+0000 7f78cbfff640 1 -- 172.21.15.117:0/1519922108 <== mon.0 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184932 (secure 0 0 0) 0x7f78d4056400 con 0x7f78e41010f0 2024-04-12T09:23:52.906 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.905+0000 7f78e9cee640 1 -- 172.21.15.117:0/1519922108 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f78e4066bd0 con 0x7f78e41010f0 2024-04-12T09:23:52.907 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.906+0000 7f78cbfff640 1 -- 172.21.15.117:0/1519922108 <== mon.0 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v83) v1 ==== 81+0+2466 (secure 0 0 0) 0x7f78d4059ac0 con 0x7f78e41010f0 2024-04-12T09:23:52.907 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.203:6827/2731911290 2024-04-13T09:21:27.299121+0000 2024-04-12T09:23:52.907 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.203:6825/840607003 2024-04-13T09:21:05.261605+0000 2024-04-12T09:23:52.907 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.203:6824/840607003 2024-04-13T09:21:05.261605+0000 2024-04-12T09:23:52.907 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/4018826114 2024-04-13T09:01:50.340337+0000 2024-04-12T09:23:52.907 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6800/2893585477 2024-04-13T09:01:50.340337+0000 2024-04-12T09:23:52.907 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.203:0/857573796 2024-04-13T09:12:54.846397+0000 2024-04-12T09:23:52.907 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/2084327023 2024-04-13T09:10:44.739720+0000 2024-04-12T09:23:52.907 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.203:0/117634547 2024-04-13T09:12:54.846397+0000 2024-04-12T09:23:52.908 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/3616310373 2024-04-13T09:10:44.739720+0000 2024-04-12T09:23:52.908 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6801/3945342300 2024-04-13T09:10:44.739720+0000 2024-04-12T09:23:52.908 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6800/3945342300 2024-04-13T09:10:44.739720+0000 2024-04-12T09:23:52.908 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/2514545829 2024-04-13T09:03:31.333423+0000 2024-04-12T09:23:52.908 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.203:0/2267178897 2024-04-13T09:12:54.846397+0000 2024-04-12T09:23:52.908 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/1161639266 2024-04-13T09:15:54.541045+0000 2024-04-12T09:23:52.908 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6801/2893585477 2024-04-13T09:01:50.340337+0000 2024-04-12T09:23:52.908 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6801/791370182 2024-04-13T09:02:21.422544+0000 2024-04-12T09:23:52.908 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/86407959 2024-04-13T09:02:21.422544+0000 2024-04-12T09:23:52.908 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/960981120 2024-04-13T09:01:50.340337+0000 2024-04-12T09:23:52.908 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6828/2248590199 2024-04-13T09:20:43.484776+0000 2024-04-12T09:23:52.909 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6829/2248590199 2024-04-13T09:20:43.484776+0000 2024-04-12T09:23:52.909 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.203:0/2976070431 2024-04-13T09:12:54.846397+0000 2024-04-12T09:23:52.909 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/801788487 2024-04-13T09:10:44.739720+0000 2024-04-12T09:23:52.909 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/2869338383 2024-04-13T09:02:21.422544+0000 2024-04-12T09:23:52.909 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/3452542055 2024-04-13T09:15:54.541045+0000 2024-04-12T09:23:52.909 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/3873562739 2024-04-13T09:10:44.739720+0000 2024-04-12T09:23:52.909 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.203:6829/2773660052 2024-04-13T09:12:54.846397+0000 2024-04-12T09:23:52.909 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/1603484270 2024-04-13T09:15:54.541045+0000 2024-04-12T09:23:52.909 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6827/1717609783 2024-04-13T09:08:27.549563+0000 2024-04-12T09:23:52.909 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/2305921992 2024-04-13T09:01:50.340337+0000 2024-04-12T09:23:52.909 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.203:6828/2773660052 2024-04-13T09:12:54.846397+0000 2024-04-12T09:23:52.909 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/4061615302 2024-04-13T09:03:31.333423+0000 2024-04-12T09:23:52.909 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6800/791370182 2024-04-13T09:02:21.422544+0000 2024-04-12T09:23:52.909 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/448067539 2024-04-13T09:03:31.333423+0000 2024-04-12T09:23:52.909 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.203:6826/2731911290 2024-04-13T09:21:27.299121+0000 2024-04-12T09:23:52.910 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/2635780056 2024-04-13T09:02:21.422544+0000 2024-04-12T09:23:52.910 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6801/790148838 2024-04-13T09:03:31.333423+0000 2024-04-12T09:23:52.910 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6826/1717609783 2024-04-13T09:08:27.549563+0000 2024-04-12T09:23:52.910 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:0/2884121108 2024-04-13T09:15:54.541045+0000 2024-04-12T09:23:52.910 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6800/790148838 2024-04-13T09:03:31.333423+0000 2024-04-12T09:23:52.910 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6800/1056729457 2024-04-13T09:15:54.541045+0000 2024-04-12T09:23:52.910 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117:6801/1056729457 2024-04-13T09:15:54.541045+0000 2024-04-12T09:23:52.911 INFO:teuthology.orchestra.run.smithi117.stderr:listed 41 entries 2024-04-12T09:23:52.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.908+0000 7f78e9cee640 1 -- 172.21.15.117:0/1519922108 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f78cc06dc20 msgr2=0x7f78cc0700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:52.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.908+0000 7f78e9cee640 1 --2- 172.21.15.117:0/1519922108 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f78cc06dc20 0x7f78cc0700d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f78d8003080 tx=0x7f78d8009da0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.908+0000 7f78e9cee640 1 -- 172.21.15.117:0/1519922108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78e41010f0 msgr2=0x7f78e410e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T09:23:52.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.908+0000 7f78e9cee640 1 --2- 172.21.15.117:0/1519922108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78e41010f0 0x7f78e410e1e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f78d4002a50 tx=0x7f78d4004600 comp rx=0 tx=0).stop 2024-04-12T09:23:52.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.908+0000 7f78e9cee640 1 -- 172.21.15.117:0/1519922108 shutdown_connections 2024-04-12T09:23:52.911 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.908+0000 7f78e9cee640 1 --2- 172.21.15.117:0/1519922108 >> [v2:172.21.15.117:6800/3722476776,v1:172.21.15.117:6801/3722476776] conn(0x7f78cc06dc20 0x7f78cc0700d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.908+0000 7f78e9cee640 1 --2- 172.21.15.117:0/1519922108 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f78e4101a90 0x7f78e410e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.908+0000 7f78e9cee640 1 --2- 172.21.15.117:0/1519922108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f78e41010f0 0x7f78e410e1e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T09:23:52.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.908+0000 7f78e9cee640 1 -- 172.21.15.117:0/1519922108 >> 172.21.15.117:0/1519922108 conn(0x7f78e40f6d00 msgr2=0x7f78e40f7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T09:23:52.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.908+0000 7f78e9cee640 1 -- 172.21.15.117:0/1519922108 shutdown_connections 2024-04-12T09:23:52.912 INFO:teuthology.orchestra.run.smithi117.stderr:2024-04-12T09:23:52.908+0000 7f78e9cee640 1 -- 172.21.15.117:0/1519922108 wait complete. 2024-04-12T09:23:52.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:52 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/1660075527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-12T09:23:52.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:52 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/2388362116' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-12T09:23:52.912 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:52 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/1266453497' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-12T09:23:52.919 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi117.front.sepia.ceph.com... 2024-04-12T09:23:52.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T09:23:52.920 DEBUG:teuthology.orchestra.run.smithi117:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-12T09:23:52.946 INFO:teuthology.orchestra.run:waiting for 300 2024-04-12T09:23:53.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:52 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/1660075527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-12T09:23:53.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:52 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/2388362116' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-12T09:23:53.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:52 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/1266453497' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-12T09:23:54.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:53 smithi117 ceph-mon[113571]: pgmap v276: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:54.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:53 smithi117 ceph-mon[113571]: from='client.? 172.21.15.117:0/1519922108' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-12T09:23:54.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:53 smithi203 ceph-mon[86783]: pgmap v276: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:54.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:53 smithi203 ceph-mon[86783]: from='client.? 172.21.15.117:0/1519922108' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-12T09:23:55.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:23:55.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:54 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:23:56.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:55 smithi117 ceph-mon[113571]: pgmap v277: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:56.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:55 smithi203 ceph-mon[86783]: pgmap v277: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:58.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:57 smithi117 ceph-mon[113571]: pgmap v278: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:23:58.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:57 smithi203 ceph-mon[86783]: pgmap v278: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:00.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:23:59 smithi117 ceph-mon[113571]: pgmap v279: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:00.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:23:59 smithi203 ceph-mon[86783]: pgmap v279: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:02.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:01 smithi117 ceph-mon[113571]: pgmap v280: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:02.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:01 smithi203 ceph-mon[86783]: pgmap v280: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:04.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:03 smithi117 ceph-mon[113571]: pgmap v281: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:04.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:03 smithi203 ceph-mon[86783]: pgmap v281: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:06.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:05 smithi117 ceph-mon[113571]: pgmap v282: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:06.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:05 smithi203 ceph-mon[86783]: pgmap v282: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:08.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:07 smithi117 ceph-mon[113571]: pgmap v283: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:08.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:07 smithi203 ceph-mon[86783]: pgmap v283: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:10.125 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:09 smithi203 ceph-mon[86783]: pgmap v284: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:10.125 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:09 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:24:10.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:09 smithi117 ceph-mon[113571]: pgmap v284: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:10.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:09 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:24:12.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:11 smithi117 ceph-mon[113571]: pgmap v285: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:12.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:11 smithi203 ceph-mon[86783]: pgmap v285: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:13.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:12 smithi117 ceph-mon[113571]: pgmap v286: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:13.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:12 smithi203 ceph-mon[86783]: pgmap v286: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:16.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:15 smithi203 ceph-mon[86783]: pgmap v287: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:16.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:15 smithi117 ceph-mon[113571]: pgmap v287: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:18.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:17 smithi203 ceph-mon[86783]: pgmap v288: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:18.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:17 smithi117 ceph-mon[113571]: pgmap v288: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:20.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:19 smithi203 ceph-mon[86783]: pgmap v289: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:20.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:19 smithi117 ceph-mon[113571]: pgmap v289: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:22.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:21 smithi203 ceph-mon[86783]: pgmap v290: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:22.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:21 smithi117 ceph-mon[113571]: pgmap v290: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:24.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:23 smithi203 ceph-mon[86783]: pgmap v291: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:24.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:23 smithi117 ceph-mon[113571]: pgmap v291: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:25.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:24 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:24:25.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:24 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:24:26.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:25 smithi203 ceph-mon[86783]: pgmap v292: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:26.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:25 smithi117 ceph-mon[113571]: pgmap v292: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:28.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:27 smithi203 ceph-mon[86783]: pgmap v293: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:28.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:27 smithi117 ceph-mon[113571]: pgmap v293: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:30.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:29 smithi203 ceph-mon[86783]: pgmap v294: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:30.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:29 smithi117 ceph-mon[113571]: pgmap v294: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:32.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:31 smithi203 ceph-mon[86783]: pgmap v295: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:32.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:31 smithi117 ceph-mon[113571]: pgmap v295: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:34.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:33 smithi203 ceph-mon[86783]: pgmap v296: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:34.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:33 smithi117 ceph-mon[113571]: pgmap v296: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:36.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:35 smithi203 ceph-mon[86783]: pgmap v297: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:36.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:35 smithi117 ceph-mon[113571]: pgmap v297: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:38.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:37 smithi203 ceph-mon[86783]: pgmap v298: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:38.154 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:37 smithi117 ceph-mon[113571]: pgmap v298: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:40.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:39 smithi203 ceph-mon[86783]: pgmap v299: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:40.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:24:40.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:39 smithi117 ceph-mon[113571]: pgmap v299: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:40.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:24:42.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:41 smithi203 ceph-mon[86783]: pgmap v300: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:42.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:41 smithi117 ceph-mon[113571]: pgmap v300: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:44.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:43 smithi203 ceph-mon[86783]: pgmap v301: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:44.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:43 smithi117 ceph-mon[113571]: pgmap v301: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:46.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:45 smithi203 ceph-mon[86783]: pgmap v302: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:46.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:45 smithi117 ceph-mon[113571]: pgmap v302: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:47.910 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:47 smithi117 ceph-mon[113571]: pgmap v303: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:48.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:47 smithi203 ceph-mon[86783]: pgmap v303: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:50.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:49 smithi203 ceph-mon[86783]: pgmap v304: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:50.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:49 smithi117 ceph-mon[113571]: pgmap v304: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:51.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:50 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:24:51.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:50 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:24:52.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:51 smithi203 ceph-mon[86783]: pgmap v305: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:52.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:51 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:24:52.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:51 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:24:52.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:51 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:24:52.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:51 smithi117 ceph-mon[113571]: pgmap v305: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:52.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:51 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:24:52.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:51 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:24:52.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:51 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:24:54.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:53 smithi203 ceph-mon[86783]: pgmap v306: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:54.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:53 smithi117 ceph-mon[113571]: pgmap v306: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:55.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:54 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:24:55.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:24:56.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:55 smithi203 ceph-mon[86783]: pgmap v307: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:56.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:55 smithi117 ceph-mon[113571]: pgmap v307: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:58.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:57 smithi203 ceph-mon[86783]: pgmap v308: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:24:58.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:57 smithi117 ceph-mon[113571]: pgmap v308: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:00.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:24:59 smithi203 ceph-mon[86783]: pgmap v309: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:00.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:24:59 smithi117 ceph-mon[113571]: pgmap v309: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:02.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:01 smithi203 ceph-mon[86783]: pgmap v310: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:02.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:01 smithi117 ceph-mon[113571]: pgmap v310: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:04.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:03 smithi203 ceph-mon[86783]: pgmap v311: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:04.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:03 smithi117 ceph-mon[113571]: pgmap v311: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:06.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:05 smithi203 ceph-mon[86783]: pgmap v312: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:06.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:05 smithi117 ceph-mon[113571]: pgmap v312: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:08.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:07 smithi203 ceph-mon[86783]: pgmap v313: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:08.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:07 smithi117 ceph-mon[113571]: pgmap v313: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:10.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:09 smithi203 ceph-mon[86783]: pgmap v314: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:10.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:09 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:25:10.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:09 smithi117 ceph-mon[113571]: pgmap v314: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:10.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:09 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:25:12.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:11 smithi203 ceph-mon[86783]: pgmap v315: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:12.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:11 smithi117 ceph-mon[113571]: pgmap v315: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:14.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:13 smithi117 ceph-mon[113571]: pgmap v316: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:14.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:13 smithi203 ceph-mon[86783]: pgmap v316: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:16.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:15 smithi117 ceph-mon[113571]: pgmap v317: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:16.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:15 smithi203 ceph-mon[86783]: pgmap v317: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:18.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:17 smithi117 ceph-mon[113571]: pgmap v318: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:18.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:17 smithi203 ceph-mon[86783]: pgmap v318: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:20.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:19 smithi117 ceph-mon[113571]: pgmap v319: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:20.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:19 smithi203 ceph-mon[86783]: pgmap v319: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:22.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:21 smithi117 ceph-mon[113571]: pgmap v320: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:22.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:21 smithi203 ceph-mon[86783]: pgmap v320: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:24.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:23 smithi117 ceph-mon[113571]: pgmap v321: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:24.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:23 smithi203 ceph-mon[86783]: pgmap v321: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:25.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:24 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:25:25.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:24 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:25:26.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:25 smithi117 ceph-mon[113571]: pgmap v322: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:26.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:25 smithi203 ceph-mon[86783]: pgmap v322: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:28.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:27 smithi117 ceph-mon[113571]: pgmap v323: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:28.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:27 smithi203 ceph-mon[86783]: pgmap v323: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:30.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:29 smithi117 ceph-mon[113571]: pgmap v324: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:30.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:29 smithi203 ceph-mon[86783]: pgmap v324: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:32.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:31 smithi117 ceph-mon[113571]: pgmap v325: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:32.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:31 smithi203 ceph-mon[86783]: pgmap v325: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:34.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:33 smithi117 ceph-mon[113571]: pgmap v326: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:34.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:33 smithi203 ceph-mon[86783]: pgmap v326: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:36.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:35 smithi117 ceph-mon[113571]: pgmap v327: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:36.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:35 smithi203 ceph-mon[86783]: pgmap v327: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:38.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:37 smithi117 ceph-mon[113571]: pgmap v328: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:38.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:37 smithi203 ceph-mon[86783]: pgmap v328: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:40.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:39 smithi117 ceph-mon[113571]: pgmap v329: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:40.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:25:40.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:39 smithi203 ceph-mon[86783]: pgmap v329: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:40.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:25:42.126 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:41 smithi203 ceph-mon[86783]: pgmap v330: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:42.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:41 smithi117 ceph-mon[113571]: pgmap v330: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:44.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:43 smithi117 ceph-mon[113571]: pgmap v331: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:44.327 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:43 smithi203 ceph-mon[86783]: pgmap v331: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:46.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:45 smithi117 ceph-mon[113571]: pgmap v332: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:46.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:45 smithi203 ceph-mon[86783]: pgmap v332: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:48.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:47 smithi117 ceph-mon[113571]: pgmap v333: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:48.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:47 smithi203 ceph-mon[86783]: pgmap v333: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:49.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:48 smithi117 ceph-mon[113571]: pgmap v334: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:49.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:48 smithi203 ceph-mon[86783]: pgmap v334: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:52.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:51 smithi203 ceph-mon[86783]: pgmap v335: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:52.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:51 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:25:52.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:51 smithi117 ceph-mon[113571]: pgmap v335: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:52.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:51 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:25:53.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:52 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:25:53.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:52 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:25:53.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:52 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:25:53.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:52 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:25:53.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:52 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:25:53.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:52 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:25:54.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:53 smithi203 ceph-mon[86783]: pgmap v336: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:54.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:53 smithi117 ceph-mon[113571]: pgmap v336: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:55.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:54 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:25:55.163 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:25:56.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:55 smithi203 ceph-mon[86783]: pgmap v337: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:56.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:55 smithi117 ceph-mon[113571]: pgmap v337: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:58.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:57 smithi203 ceph-mon[86783]: pgmap v338: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:25:58.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:57 smithi117 ceph-mon[113571]: pgmap v338: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:00.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:25:59 smithi203 ceph-mon[86783]: pgmap v339: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:00.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:25:59 smithi117 ceph-mon[113571]: pgmap v339: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:02.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:01 smithi203 ceph-mon[86783]: pgmap v340: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:02.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:01 smithi117 ceph-mon[113571]: pgmap v340: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:04.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:03 smithi203 ceph-mon[86783]: pgmap v341: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:04.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:03 smithi117 ceph-mon[113571]: pgmap v341: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:06.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:05 smithi203 ceph-mon[86783]: pgmap v342: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:06.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:05 smithi117 ceph-mon[113571]: pgmap v342: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:08.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:07 smithi203 ceph-mon[86783]: pgmap v343: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:08.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:07 smithi117 ceph-mon[113571]: pgmap v343: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:10.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:09 smithi203 ceph-mon[86783]: pgmap v344: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:10.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:09 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:26:10.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:09 smithi117 ceph-mon[113571]: pgmap v344: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:10.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:09 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:26:12.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:11 smithi203 ceph-mon[86783]: pgmap v345: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:12.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:11 smithi117 ceph-mon[113571]: pgmap v345: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:14.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:13 smithi203 ceph-mon[86783]: pgmap v346: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:14.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:13 smithi117 ceph-mon[113571]: pgmap v346: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:16.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:15 smithi203 ceph-mon[86783]: pgmap v347: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:16.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:15 smithi117 ceph-mon[113571]: pgmap v347: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:18.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:17 smithi203 ceph-mon[86783]: pgmap v348: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:18.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:17 smithi117 ceph-mon[113571]: pgmap v348: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:20.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:19 smithi203 ceph-mon[86783]: pgmap v349: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:20.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:19 smithi117 ceph-mon[113571]: pgmap v349: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:22.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:21 smithi203 ceph-mon[86783]: pgmap v350: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:22.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:21 smithi117 ceph-mon[113571]: pgmap v350: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:24.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:23 smithi203 ceph-mon[86783]: pgmap v351: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:24.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:23 smithi117 ceph-mon[113571]: pgmap v351: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:25.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:24 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:26:25.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:24 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:26:26.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:25 smithi203 ceph-mon[86783]: pgmap v352: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:26.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:25 smithi117 ceph-mon[113571]: pgmap v352: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:28.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:27 smithi203 ceph-mon[86783]: pgmap v353: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:28.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:27 smithi117 ceph-mon[113571]: pgmap v353: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:30.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:29 smithi203 ceph-mon[86783]: pgmap v354: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:30.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:29 smithi117 ceph-mon[113571]: pgmap v354: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:32.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:31 smithi203 ceph-mon[86783]: pgmap v355: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:32.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:31 smithi117 ceph-mon[113571]: pgmap v355: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:34.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:33 smithi117 ceph-mon[113571]: pgmap v356: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:34.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:33 smithi203 ceph-mon[86783]: pgmap v356: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:36.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:35 smithi117 ceph-mon[113571]: pgmap v357: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:36.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:35 smithi203 ceph-mon[86783]: pgmap v357: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:38.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:37 smithi117 ceph-mon[113571]: pgmap v358: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:38.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:37 smithi203 ceph-mon[86783]: pgmap v358: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:40.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:39 smithi117 ceph-mon[113571]: pgmap v359: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:40.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:26:40.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:39 smithi203 ceph-mon[86783]: pgmap v359: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:40.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:26:42.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:41 smithi117 ceph-mon[113571]: pgmap v360: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:42.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:41 smithi203 ceph-mon[86783]: pgmap v360: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:44.126 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:43 smithi203 ceph-mon[86783]: pgmap v361: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:44.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:43 smithi117 ceph-mon[113571]: pgmap v361: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:46.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:45 smithi117 ceph-mon[113571]: pgmap v362: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:46.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:45 smithi203 ceph-mon[86783]: pgmap v362: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:48.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:47 smithi117 ceph-mon[113571]: pgmap v363: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:48.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:47 smithi203 ceph-mon[86783]: pgmap v363: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:50.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:49 smithi117 ceph-mon[113571]: pgmap v364: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:50.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:49 smithi203 ceph-mon[86783]: pgmap v364: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:52.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:51 smithi117 ceph-mon[113571]: pgmap v365: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:52.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:51 smithi203 ceph-mon[86783]: pgmap v365: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:53.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:52 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:26:53.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:52 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:26:53.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:52 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:26:53.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:52 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:26:53.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:52 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:26:53.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:52 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:26:53.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:52 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:26:53.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:52 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:26:54.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:53 smithi117 ceph-mon[113571]: pgmap v366: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:54.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:53 smithi203 ceph-mon[86783]: pgmap v366: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:55.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:26:55.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:54 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:26:56.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:55 smithi117 ceph-mon[113571]: pgmap v367: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:56.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:55 smithi203 ceph-mon[86783]: pgmap v367: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:58.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:57 smithi117 ceph-mon[113571]: pgmap v368: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:26:58.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:57 smithi203 ceph-mon[86783]: pgmap v368: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:00.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:26:59 smithi117 ceph-mon[113571]: pgmap v369: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:00.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:26:59 smithi203 ceph-mon[86783]: pgmap v369: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:02.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:01 smithi117 ceph-mon[113571]: pgmap v370: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:02.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:01 smithi203 ceph-mon[86783]: pgmap v370: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:04.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:03 smithi117 ceph-mon[113571]: pgmap v371: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:04.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:03 smithi203 ceph-mon[86783]: pgmap v371: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:06.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:05 smithi117 ceph-mon[113571]: pgmap v372: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:06.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:05 smithi203 ceph-mon[86783]: pgmap v372: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:08.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:07 smithi117 ceph-mon[113571]: pgmap v373: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:08.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:07 smithi203 ceph-mon[86783]: pgmap v373: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:10.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:09 smithi117 ceph-mon[113571]: pgmap v374: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:10.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:09 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:27:10.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:09 smithi203 ceph-mon[86783]: pgmap v374: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:10.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:09 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:27:12.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:11 smithi117 ceph-mon[113571]: pgmap v375: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:12.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:11 smithi203 ceph-mon[86783]: pgmap v375: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:13.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:12 smithi117 ceph-mon[113571]: pgmap v376: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:13.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:12 smithi203 ceph-mon[86783]: pgmap v376: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:16.026 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:15 smithi203 ceph-mon[86783]: pgmap v377: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:16.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:15 smithi117 ceph-mon[113571]: pgmap v377: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:18.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:17 smithi203 ceph-mon[86783]: pgmap v378: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:18.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:17 smithi117 ceph-mon[113571]: pgmap v378: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:20.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:19 smithi203 ceph-mon[86783]: pgmap v379: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:20.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:19 smithi117 ceph-mon[113571]: pgmap v379: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:22.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:21 smithi203 ceph-mon[86783]: pgmap v380: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:22.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:21 smithi117 ceph-mon[113571]: pgmap v380: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:24.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:23 smithi203 ceph-mon[86783]: pgmap v381: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:24.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:23 smithi117 ceph-mon[113571]: pgmap v381: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:25.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:24 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:27:25.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:24 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:27:26.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:25 smithi203 ceph-mon[86783]: pgmap v382: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:26.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:25 smithi117 ceph-mon[113571]: pgmap v382: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:28.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:27 smithi203 ceph-mon[86783]: pgmap v383: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:28.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:27 smithi117 ceph-mon[113571]: pgmap v383: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:30.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:29 smithi203 ceph-mon[86783]: pgmap v384: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:30.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:29 smithi117 ceph-mon[113571]: pgmap v384: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:32.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:31 smithi203 ceph-mon[86783]: pgmap v385: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:32.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:31 smithi117 ceph-mon[113571]: pgmap v385: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:34.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:33 smithi203 ceph-mon[86783]: pgmap v386: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:34.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:33 smithi117 ceph-mon[113571]: pgmap v386: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:36.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:35 smithi203 ceph-mon[86783]: pgmap v387: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:36.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:35 smithi117 ceph-mon[113571]: pgmap v387: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:38.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:37 smithi203 ceph-mon[86783]: pgmap v388: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:38.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:37 smithi117 ceph-mon[113571]: pgmap v388: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:40.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:39 smithi203 ceph-mon[86783]: pgmap v389: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:40.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:27:40.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:39 smithi117 ceph-mon[113571]: pgmap v389: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:40.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:27:42.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:41 smithi203 ceph-mon[86783]: pgmap v390: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:42.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:41 smithi117 ceph-mon[113571]: pgmap v390: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:44.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:43 smithi203 ceph-mon[86783]: pgmap v391: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:44.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:43 smithi117 ceph-mon[113571]: pgmap v391: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:46.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:45 smithi117 ceph-mon[113571]: pgmap v392: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:46.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:45 smithi203 ceph-mon[86783]: pgmap v392: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:48.126 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:47 smithi203 ceph-mon[86783]: pgmap v393: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:48.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:47 smithi117 ceph-mon[113571]: pgmap v393: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:50.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:49 smithi117 ceph-mon[113571]: pgmap v394: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:50.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:49 smithi203 ceph-mon[86783]: pgmap v394: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:52.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:51 smithi117 ceph-mon[113571]: pgmap v395: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:52.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:51 smithi203 ceph-mon[86783]: pgmap v395: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:53.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:52 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:27:53.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:52 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-12T09:27:54.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:53 smithi117 ceph-mon[113571]: pgmap v396: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:54.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:53 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:27:54.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:53 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:27:54.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:53 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:27:54.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:53 smithi203 ceph-mon[86783]: pgmap v396: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:54.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:53 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-12T09:27:54.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:53 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-12T09:27:54.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:53 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' 2024-04-12T09:27:55.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:54 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:27:55.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:54 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:27:56.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:55 smithi117 ceph-mon[113571]: pgmap v397: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:56.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:55 smithi203 ceph-mon[86783]: pgmap v397: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:58.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:57 smithi117 ceph-mon[113571]: pgmap v398: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:27:58.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:57 smithi203 ceph-mon[86783]: pgmap v398: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:00.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:27:59 smithi117 ceph-mon[113571]: pgmap v399: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:00.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:27:59 smithi203 ceph-mon[86783]: pgmap v399: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:02.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:01 smithi117 ceph-mon[113571]: pgmap v400: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:02.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:01 smithi203 ceph-mon[86783]: pgmap v400: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:04.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:03 smithi117 ceph-mon[113571]: pgmap v401: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:04.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:03 smithi203 ceph-mon[86783]: pgmap v401: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:06.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:05 smithi117 ceph-mon[113571]: pgmap v402: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:06.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:05 smithi203 ceph-mon[86783]: pgmap v402: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:08.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:07 smithi117 ceph-mon[113571]: pgmap v403: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:08.326 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:07 smithi203 ceph-mon[86783]: pgmap v403: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:10.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:09 smithi117 ceph-mon[113571]: pgmap v404: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:10.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:09 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:28:10.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:09 smithi203 ceph-mon[86783]: pgmap v404: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:10.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:09 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:28:12.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:11 smithi117 ceph-mon[113571]: pgmap v405: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:12.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:11 smithi203 ceph-mon[86783]: pgmap v405: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:14.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:13 smithi117 ceph-mon[113571]: pgmap v406: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:14.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:13 smithi203 ceph-mon[86783]: pgmap v406: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:16.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:15 smithi117 ceph-mon[113571]: pgmap v407: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:16.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:15 smithi203 ceph-mon[86783]: pgmap v407: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:18.162 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:17 smithi117 ceph-mon[113571]: pgmap v408: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:18.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:17 smithi203 ceph-mon[86783]: pgmap v408: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:20.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:19 smithi117 ceph-mon[113571]: pgmap v409: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:20.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:19 smithi203 ceph-mon[86783]: pgmap v409: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:22.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:21 smithi117 ceph-mon[113571]: pgmap v410: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:22.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:21 smithi203 ceph-mon[86783]: pgmap v410: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:24.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:23 smithi117 ceph-mon[113571]: pgmap v411: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:24.324 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:23 smithi203 ceph-mon[86783]: pgmap v411: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:25.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:24 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:28:25.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:24 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:28:26.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:25 smithi117 ceph-mon[113571]: pgmap v412: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:26.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:25 smithi203 ceph-mon[86783]: pgmap v412: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:28.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:27 smithi117 ceph-mon[113571]: pgmap v413: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:28.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:27 smithi203 ceph-mon[86783]: pgmap v413: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:30.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:29 smithi117 ceph-mon[113571]: pgmap v414: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:30.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:29 smithi203 ceph-mon[86783]: pgmap v414: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:32.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:31 smithi117 ceph-mon[113571]: pgmap v415: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:32.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:31 smithi203 ceph-mon[86783]: pgmap v415: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:33.323 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:32 smithi203 ceph-mon[86783]: pgmap v416: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:33.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:32 smithi117 ceph-mon[113571]: pgmap v416: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:36.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:35 smithi203 ceph-mon[86783]: pgmap v417: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:36.113 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:35 smithi117 ceph-mon[113571]: pgmap v417: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:38.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:37 smithi203 ceph-mon[86783]: pgmap v418: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:38.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:37 smithi117 ceph-mon[113571]: pgmap v418: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:40.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:39 smithi203 ceph-mon[86783]: pgmap v419: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:40.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:39 smithi203 ceph-mon[86783]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:28:40.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:39 smithi117 ceph-mon[113571]: pgmap v419: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:40.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:39 smithi117 ceph-mon[113571]: from='mgr.34102 172.21.15.117:0/289028876' entity='mgr.smithi117.oyaxql' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-12T09:28:42.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:41 smithi203 ceph-mon[86783]: pgmap v420: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:42.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:41 smithi117 ceph-mon[113571]: pgmap v420: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:44.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:43 smithi203 ceph-mon[86783]: pgmap v421: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:44.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:43 smithi117 ceph-mon[113571]: pgmap v421: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:46.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:45 smithi203 ceph-mon[86783]: pgmap v422: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:46.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:45 smithi117 ceph-mon[113571]: pgmap v422: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:48.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:47 smithi203 ceph-mon[86783]: pgmap v423: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:48.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:47 smithi117 ceph-mon[113571]: pgmap v423: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:50.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:49 smithi203 ceph-mon[86783]: pgmap v424: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:50.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:49 smithi117 ceph-mon[113571]: pgmap v424: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:52.029 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-04-12T09:28:52.030 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_dea717a37c7849ca8459c02fb965020aedcc0a9a/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_dea717a37c7849ca8459c02fb965020aedcc0a9a/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-12T09:28:52.032 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-12T09:28:52.043 INFO:tasks.cephadm:Teardown begin 2024-04-12T09:28:52.043 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_dea717a37c7849ca8459c02fb965020aedcc0a9a/qa/tasks/cephadm.py", line 1807, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_dea717a37c7849ca8459c02fb965020aedcc0a9a/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_dea717a37c7849ca8459c02fb965020aedcc0a9a/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-12T09:28:52.044 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-12T09:28:52.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:51 smithi203 ceph-mon[86783]: pgmap v425: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:52.074 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:51 smithi117 ceph-mon[113571]: pgmap v425: 65 pgs: 65 active+clean; 206 MiB data, 866 MiB used, 536 GiB / 536 GiB avail 2024-04-12T09:28:52.080 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-12T09:28:52.115 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-12T09:28:52.115 DEBUG:teuthology.orchestra.run.smithi117:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-12T09:28:52.138 DEBUG:teuthology.orchestra.run.smithi203:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-12T09:28:52.172 INFO:tasks.cephadm:Stopping all daemons... 2024-04-12T09:28:52.173 INFO:tasks.cephadm.mon.smithi117:Stopping mon.smithi117... 2024-04-12T09:28:52.173 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-12161984-f8ab-11ee-bc8c-c7b262605968@mon.smithi117 2024-04-12T09:28:52.410 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:52 smithi117 systemd[1]: Stopping Ceph mon.smithi117 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:28:52.871 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:52 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117[113567]: 2024-04-12T09:28:52.494+0000 7f681e8f5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi117 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T09:28:52.871 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:52 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117[113567]: 2024-04-12T09:28:52.494+0000 7f681e8f5700 -1 mon.smithi117@0(leader) e3 *** Got Signal Terminated *** 2024-04-12T09:28:52.871 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:52 smithi117 podman[154355]: 2024-04-12 09:28:52.577331625 +0000 UTC m=+0.209396323 container died 6823aaff30ce3c92ac69dc3427dc1e67e6827d3e2387b5d421fb18fb990e14e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=squid-b277feb, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-04-12T09:28:53.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:53 smithi117 podman[154355]: 2024-04-12 09:28:53.04508166 +0000 UTC m=+0.677146364 container cleanup 6823aaff30ce3c92ac69dc3427dc1e67e6827d3e2387b5d421fb18fb990e14e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, RELEASE=squid-b277feb, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-12T09:28:53.160 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Apr 12 09:28:53 smithi117 bash[154355]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi117 2024-04-12T09:28:53.456 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-12161984-f8ab-11ee-bc8c-c7b262605968@mon.smithi117.service' 2024-04-12T09:28:53.505 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-12T09:28:53.505 INFO:tasks.cephadm.mon.smithi117:Stopped mon.smithi117 2024-04-12T09:28:53.506 INFO:tasks.cephadm.mon.smithi203:Stopping mon.smithi203... 2024-04-12T09:28:53.506 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-12161984-f8ab-11ee-bc8c-c7b262605968@mon.smithi203 2024-04-12T09:28:53.807 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:53 smithi203 systemd[1]: Stopping Ceph mon.smithi203 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:28:54.073 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:53 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi203[86779]: 2024-04-12T09:28:53.805+0000 7f8509a45700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi203 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T09:28:54.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:53 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi203[86779]: 2024-04-12T09:28:53.805+0000 7f8509a45700 -1 mon.smithi203@1(peon) e3 *** Got Signal Terminated *** 2024-04-12T09:28:54.074 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:53 smithi203 podman[119146]: 2024-04-12 09:28:53.980702861 +0000 UTC m=+0.281075797 container died 006c6e487bfbb2a5ff3fae7090d902845a49ca90851ca479f7c9ddbdc8059dfa (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi203, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b277feb, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-12T09:28:54.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:54 smithi203 podman[119146]: 2024-04-12 09:28:54.432056141 +0000 UTC m=+0.732429054 container cleanup 006c6e487bfbb2a5ff3fae7090d902845a49ca90851ca479f7c9ddbdc8059dfa (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi203, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b277feb, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-12T09:28:54.573 INFO:journalctl@ceph.mon.smithi203.smithi203.stdout:Apr 12 09:28:54 smithi203 bash[119146]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968-mon-smithi203 2024-04-12T09:28:54.862 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-12161984-f8ab-11ee-bc8c-c7b262605968@mon.smithi203.service' 2024-04-12T09:28:54.911 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-12T09:28:54.911 INFO:tasks.cephadm.mon.smithi203:Stopped mon.smithi203 2024-04-12T09:28:54.912 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-12T09:28:54.912 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.0 2024-04-12T09:28:55.216 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:28:54 smithi117 systemd[1]: Stopping Ceph osd.0 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:28:55.660 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:28:55 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0[125086]: 2024-04-12T09:28:55.215+0000 7f10510c4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T09:28:55.660 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:28:55 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0[125086]: 2024-04-12T09:28:55.215+0000 7f10510c4700 -1 osd.0 83 *** Got signal Terminated *** 2024-04-12T09:28:55.660 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:28:55 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0[125086]: 2024-04-12T09:28:55.215+0000 7f10510c4700 -1 osd.0 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T09:29:00.883 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:29:00 smithi117 podman[154487]: 2024-04-12 09:29:00.599580672 +0000 UTC m=+5.496298495 container died 59a180461e3c3c1eb5269e390fee1f3915cf5482c8cf0f569761bf4932c98a65 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b277feb, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-12T09:29:01.160 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:29:00 smithi117 podman[154487]: 2024-04-12 09:29:00.974077464 +0000 UTC m=+5.870795294 container cleanup 59a180461e3c3c1eb5269e390fee1f3915cf5482c8cf0f569761bf4932c98a65 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-b277feb, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, ceph=True, GIT_CLEAN=True) 2024-04-12T09:29:01.160 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:29:00 smithi117 bash[154487]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0 2024-04-12T09:29:01.580 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:29:01 smithi117 podman[154505]: 2024-04-12 09:29:01.25931151 +0000 UTC m=+0.654526323 container remove 59a180461e3c3c1eb5269e390fee1f3915cf5482c8cf0f569761bf4932c98a65 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-b277feb) 2024-04-12T09:29:01.863 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:29:01 smithi117 podman[154600]: 2024-04-12 09:29:01.484366953 +0000 UTC m=+0.018095871 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:29:01.863 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:29:01 smithi117 podman[154600]: 2024-04-12 09:29:01.61024586 +0000 UTC m=+0.143974799 container create 3624c1a3c1ab7bb0cc2a441fd5fcb0322baababcceff4ff5a35f6903f3abeb23 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-b277feb, org.label-schema.license=GPLv2) 2024-04-12T09:29:01.863 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:29:01 smithi117 podman[154600]: 2024-04-12 09:29:01.862983665 +0000 UTC m=+0.396712562 container init 3624c1a3c1ab7bb0cc2a441fd5fcb0322baababcceff4ff5a35f6903f3abeb23 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240409, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b277feb, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-12T09:29:02.158 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:29:01 smithi117 podman[154600]: 2024-04-12 09:29:01.866474403 +0000 UTC m=+0.400203307 container start 3624c1a3c1ab7bb0cc2a441fd5fcb0322baababcceff4ff5a35f6903f3abeb23 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0-deactivate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-b277feb) 2024-04-12T09:29:02.159 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:29:01 smithi117 podman[154600]: 2024-04-12 09:29:01.946138105 +0000 UTC m=+0.479867012 container attach 3624c1a3c1ab7bb0cc2a441fd5fcb0322baababcceff4ff5a35f6903f3abeb23 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-b277feb, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-04-12T09:29:02.410 INFO:journalctl@ceph.osd.0.smithi117.stdout:Apr 12 09:29:02 smithi117 podman[154600]: 2024-04-12 09:29:02.158444345 +0000 UTC m=+0.692173250 container died 3624c1a3c1ab7bb0cc2a441fd5fcb0322baababcceff4ff5a35f6903f3abeb23 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=squid-b277feb, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-04-12T09:29:02.778 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.0.service' 2024-04-12T09:29:02.820 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-12T09:29:02.820 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-12T09:29:02.820 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-12T09:29:02.821 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.1 2024-04-12T09:29:03.160 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:29:02 smithi117 systemd[1]: Stopping Ceph osd.1 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:29:03.660 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:29:03 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1[130624]: 2024-04-12T09:29:03.161+0000 7fb4997f2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T09:29:03.660 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:29:03 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1[130624]: 2024-04-12T09:29:03.161+0000 7fb4997f2700 -1 osd.1 83 *** Got signal Terminated *** 2024-04-12T09:29:03.660 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:29:03 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1[130624]: 2024-04-12T09:29:03.161+0000 7fb4997f2700 -1 osd.1 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T09:29:08.838 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:29:08 smithi117 podman[154717]: 2024-04-12 09:29:08.545676735 +0000 UTC m=+5.492476837 container died d40e2dfc164b3dd8bf13a8af028eda854480201d06cb3ff8e833755cb80653b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-b277feb, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-12T09:29:09.111 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:29:08 smithi117 podman[154717]: 2024-04-12 09:29:08.952714384 +0000 UTC m=+5.899514531 container cleanup d40e2dfc164b3dd8bf13a8af028eda854480201d06cb3ff8e833755cb80653b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-b277feb, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409) 2024-04-12T09:29:09.112 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:29:08 smithi117 bash[154717]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1 2024-04-12T09:29:09.410 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:29:09 smithi117 podman[154736]: 2024-04-12 09:29:09.262559081 +0000 UTC m=+0.713117514 container remove d40e2dfc164b3dd8bf13a8af028eda854480201d06cb3ff8e833755cb80653b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1, RELEASE=squid-b277feb, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409) 2024-04-12T09:29:09.891 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:29:09 smithi117 podman[154829]: 2024-04-12 09:29:09.533620345 +0000 UTC m=+0.018104315 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:29:09.891 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:29:09 smithi117 podman[154829]: 2024-04-12 09:29:09.655430285 +0000 UTC m=+0.139914243 container create b314794544be5db594e8937796feb0e788b672c5a490e71bd09a7d6e2a175470 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-b277feb) 2024-04-12T09:29:09.891 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:29:09 smithi117 podman[154829]: 2024-04-12 09:29:09.891131976 +0000 UTC m=+0.375615935 container init b314794544be5db594e8937796feb0e788b672c5a490e71bd09a7d6e2a175470 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-b277feb, org.label-schema.build-date=20240409) 2024-04-12T09:29:10.160 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:29:09 smithi117 podman[154829]: 2024-04-12 09:29:09.894328389 +0000 UTC m=+0.378812356 container start b314794544be5db594e8937796feb0e788b672c5a490e71bd09a7d6e2a175470 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1-deactivate, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-b277feb) 2024-04-12T09:29:10.160 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:29:09 smithi117 podman[154829]: 2024-04-12 09:29:09.974408555 +0000 UTC m=+0.458892530 container attach b314794544be5db594e8937796feb0e788b672c5a490e71bd09a7d6e2a175470 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-b277feb, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-04-12T09:29:10.486 INFO:journalctl@ceph.osd.1.smithi117.stdout:Apr 12 09:29:10 smithi117 podman[154829]: 2024-04-12 09:29:10.189523931 +0000 UTC m=+0.674007890 container died b314794544be5db594e8937796feb0e788b672c5a490e71bd09a7d6e2a175470 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-1-deactivate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-b277feb, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-04-12T09:29:10.795 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.1.service' 2024-04-12T09:29:10.841 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-12T09:29:10.841 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-12T09:29:10.841 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-12T09:29:10.842 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.2 2024-04-12T09:29:11.139 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:29:10 smithi117 systemd[1]: Stopping Ceph osd.2 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:29:11.410 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:29:11 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2[136159]: 2024-04-12T09:29:11.138+0000 7f5933f4f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T09:29:11.410 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:29:11 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2[136159]: 2024-04-12T09:29:11.138+0000 7f5933f4f700 -1 osd.2 83 *** Got signal Terminated *** 2024-04-12T09:29:11.410 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:29:11 smithi117 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2[136159]: 2024-04-12T09:29:11.138+0000 7f5933f4f700 -1 osd.2 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T09:29:16.805 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:29:16 smithi117 podman[154935]: 2024-04-12 09:29:16.476318568 +0000 UTC m=+5.442115504 container died fd7d5481cddb6ed0d8244945fdbfdcf12f2ce07e0eb2b59d420f22d3bb82f822 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, RELEASE=squid-b277feb, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5) 2024-04-12T09:29:16.805 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:29:16 smithi117 podman[154935]: 2024-04-12 09:29:16.8046932 +0000 UTC m=+5.770490136 container cleanup fd7d5481cddb6ed0d8244945fdbfdcf12f2ce07e0eb2b59d420f22d3bb82f822 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-b277feb, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-12T09:29:17.160 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:29:16 smithi117 bash[154935]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2 2024-04-12T09:29:17.160 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:29:17 smithi117 podman[154954]: 2024-04-12 09:29:17.006278451 +0000 UTC m=+0.526193704 container remove fd7d5481cddb6ed0d8244945fdbfdcf12f2ce07e0eb2b59d420f22d3bb82f822 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, RELEASE=squid-b277feb, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-04-12T09:29:17.726 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:29:17 smithi117 podman[155048]: 2024-04-12 09:29:17.324092834 +0000 UTC m=+0.017475211 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:29:17.726 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:29:17 smithi117 podman[155048]: 2024-04-12 09:29:17.448971692 +0000 UTC m=+0.142354052 container create 78c4bbd9cf74f293e75c2588cd11baf62c4ecff8c14c41b5d2933c4a5e8a4e70 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=squid-b277feb, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0) 2024-04-12T09:29:17.726 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:29:17 smithi117 podman[155048]: 2024-04-12 09:29:17.651568015 +0000 UTC m=+0.344950372 container init 78c4bbd9cf74f293e75c2588cd11baf62c4ecff8c14c41b5d2933c4a5e8a4e70 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-b277feb, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T09:29:17.726 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:29:17 smithi117 podman[155048]: 2024-04-12 09:29:17.654734664 +0000 UTC m=+0.348117032 container start 78c4bbd9cf74f293e75c2588cd11baf62c4ecff8c14c41b5d2933c4a5e8a4e70 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=HEAD, RELEASE=squid-b277feb, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5) 2024-04-12T09:29:17.726 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:29:17 smithi117 podman[155048]: 2024-04-12 09:29:17.726200279 +0000 UTC m=+0.419582656 container attach 78c4bbd9cf74f293e75c2588cd11baf62c4ecff8c14c41b5d2933c4a5e8a4e70 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2-deactivate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-b277feb, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-12T09:29:18.160 INFO:journalctl@ceph.osd.2.smithi117.stdout:Apr 12 09:29:17 smithi117 podman[155048]: 2024-04-12 09:29:17.939564847 +0000 UTC m=+0.632947207 container died 78c4bbd9cf74f293e75c2588cd11baf62c4ecff8c14c41b5d2933c4a5e8a4e70 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b277feb, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.build-date=20240409, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T09:29:18.595 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.2.service' 2024-04-12T09:29:18.637 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-12T09:29:18.637 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-12T09:29:18.637 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-12T09:29:18.638 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.3 2024-04-12T09:29:18.960 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:29:18 smithi203 systemd[1]: Stopping Ceph osd.3 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:29:19.323 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:29:18 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3[96148]: 2024-04-12T09:29:18.959+0000 7fac9f376700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T09:29:19.323 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:29:18 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3[96148]: 2024-04-12T09:29:18.959+0000 7fac9f376700 -1 osd.3 83 *** Got signal Terminated *** 2024-04-12T09:29:19.324 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:29:18 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3[96148]: 2024-04-12T09:29:18.959+0000 7fac9f376700 -1 osd.3 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T09:29:22.073 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:29:21 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3[96148]: 2024-04-12T09:29:21.830+0000 7fac98163700 -1 osd.3 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:57.899249+0000 front 2024-04-12T09:28:57.899199+0000 (oldest deadline 2024-04-12T09:29:21.398970+0000) 2024-04-12T09:29:22.074 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:21 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:21.629+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:57.595199+0000 front 2024-04-12T09:28:57.595253+0000 (oldest deadline 2024-04-12T09:29:21.095044+0000) 2024-04-12T09:29:23.073 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:29:22 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3[96148]: 2024-04-12T09:29:22.819+0000 7fac98163700 -1 osd.3 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:57.899249+0000 front 2024-04-12T09:28:57.899199+0000 (oldest deadline 2024-04-12T09:29:21.398970+0000) 2024-04-12T09:29:23.074 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:22 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:22.588+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:57.595199+0000 front 2024-04-12T09:28:57.595253+0000 (oldest deadline 2024-04-12T09:29:21.095044+0000) 2024-04-12T09:29:23.986 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:29:23 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3[96148]: 2024-04-12T09:29:23.782+0000 7fac98163700 -1 osd.3 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:57.899249+0000 front 2024-04-12T09:28:57.899199+0000 (oldest deadline 2024-04-12T09:29:21.398970+0000) 2024-04-12T09:29:23.986 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:23 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:23.628+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:57.595199+0000 front 2024-04-12T09:28:57.595253+0000 (oldest deadline 2024-04-12T09:29:21.095044+0000) 2024-04-12T09:29:24.324 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:23 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4[101031]: 2024-04-12T09:29:23.985+0000 7fb746162700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:58.139139+0000 front 2024-04-12T09:28:58.139245+0000 (oldest deadline 2024-04-12T09:29:23.939430+0000) 2024-04-12T09:29:24.745 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:24 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:24.664+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:57.595199+0000 front 2024-04-12T09:28:57.595253+0000 (oldest deadline 2024-04-12T09:29:21.095044+0000) 2024-04-12T09:29:24.745 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:29:24 smithi203 podman[119269]: 2024-04-12 09:29:24.478888454 +0000 UTC m=+5.647872040 container died 961db53f9ab1a95c7435c1b42c0bd0312e07cea3593f320ab37000737bcd901f (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-b277feb, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-12T09:29:25.074 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:24 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4[101031]: 2024-04-12T09:29:24.953+0000 7fb746162700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:58.139139+0000 front 2024-04-12T09:28:58.139245+0000 (oldest deadline 2024-04-12T09:29:23.939430+0000) 2024-04-12T09:29:25.074 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:29:24 smithi203 podman[119269]: 2024-04-12 09:29:24.86895869 +0000 UTC m=+6.037942276 container cleanup 961db53f9ab1a95c7435c1b42c0bd0312e07cea3593f320ab37000737bcd901f (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-b277feb, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T09:29:25.074 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:29:24 smithi203 bash[119269]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3 2024-04-12T09:29:25.370 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:29:25 smithi203 podman[119298]: 2024-04-12 09:29:25.078677289 +0000 UTC m=+0.597836606 container remove 961db53f9ab1a95c7435c1b42c0bd0312e07cea3593f320ab37000737bcd901f (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3, RELEASE=squid-b277feb, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, ceph=True) 2024-04-12T09:29:25.649 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:29:25 smithi203 podman[119387]: 2024-04-12 09:29:25.272878907 +0000 UTC m=+0.018369835 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:29:25.649 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:29:25 smithi203 podman[119387]: 2024-04-12 09:29:25.396653028 +0000 UTC m=+0.142143984 container create c524abeecf27a4c616962181080ddec0b55eeeab9f9e7069f46aa039858e398a (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240409, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-b277feb, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-12T09:29:25.649 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:29:25 smithi203 podman[119387]: 2024-04-12 09:29:25.649266141 +0000 UTC m=+0.394757055 container init c524abeecf27a4c616962181080ddec0b55eeeab9f9e7069f46aa039858e398a (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b277feb, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T09:29:25.923 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:25 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:25.656+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:57.595199+0000 front 2024-04-12T09:28:57.595253+0000 (oldest deadline 2024-04-12T09:29:21.095044+0000) 2024-04-12T09:29:25.924 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:29:25 smithi203 podman[119387]: 2024-04-12 09:29:25.653298133 +0000 UTC m=+0.398789048 container start c524abeecf27a4c616962181080ddec0b55eeeab9f9e7069f46aa039858e398a (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, RELEASE=squid-b277feb, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-12T09:29:25.924 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:29:25 smithi203 podman[119387]: 2024-04-12 09:29:25.749438102 +0000 UTC m=+0.494929022 container attach c524abeecf27a4c616962181080ddec0b55eeeab9f9e7069f46aa039858e398a (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3-deactivate, RELEASE=squid-b277feb, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-12T09:29:26.236 INFO:journalctl@ceph.osd.3.smithi203.stdout:Apr 12 09:29:25 smithi203 podman[119387]: 2024-04-12 09:29:25.946656808 +0000 UTC m=+0.692147726 container died c524abeecf27a4c616962181080ddec0b55eeeab9f9e7069f46aa039858e398a (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-3-deactivate, RELEASE=squid-b277feb, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-12T09:29:26.236 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:25 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4[101031]: 2024-04-12T09:29:25.922+0000 7fb746162700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:58.139139+0000 front 2024-04-12T09:28:58.139245+0000 (oldest deadline 2024-04-12T09:29:23.939430+0000) 2024-04-12T09:29:26.523 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.3.service' 2024-04-12T09:29:26.567 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-12T09:29:26.567 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-12T09:29:26.568 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-12T09:29:26.568 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.4 2024-04-12T09:29:26.823 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:26 smithi203 systemd[1]: Stopping Ceph osd.4 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:29:26.823 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:26 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:26.663+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:57.595199+0000 front 2024-04-12T09:28:57.595253+0000 (oldest deadline 2024-04-12T09:29:21.095044+0000) 2024-04-12T09:29:27.323 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:26 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4[101031]: 2024-04-12T09:29:26.908+0000 7fb746162700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:58.139139+0000 front 2024-04-12T09:28:58.139245+0000 (oldest deadline 2024-04-12T09:29:23.939430+0000) 2024-04-12T09:29:27.324 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:26 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4[101031]: 2024-04-12T09:29:26.923+0000 7fb74d375700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T09:29:27.324 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:26 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4[101031]: 2024-04-12T09:29:26.923+0000 7fb74d375700 -1 osd.4 83 *** Got signal Terminated *** 2024-04-12T09:29:27.324 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:26 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4[101031]: 2024-04-12T09:29:26.923+0000 7fb74d375700 -1 osd.4 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T09:29:27.930 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:27 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:27.675+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:57.595199+0000 front 2024-04-12T09:28:57.595253+0000 (oldest deadline 2024-04-12T09:29:21.095044+0000) 2024-04-12T09:29:28.323 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:27 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4[101031]: 2024-04-12T09:29:27.929+0000 7fb746162700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:58.139139+0000 front 2024-04-12T09:28:58.139245+0000 (oldest deadline 2024-04-12T09:29:23.939430+0000) 2024-04-12T09:29:28.894 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:28 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:28.633+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:57.595199+0000 front 2024-04-12T09:28:57.595253+0000 (oldest deadline 2024-04-12T09:29:21.095044+0000) 2024-04-12T09:29:29.323 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:28 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4[101031]: 2024-04-12T09:29:28.893+0000 7fb746162700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:58.139139+0000 front 2024-04-12T09:28:58.139245+0000 (oldest deadline 2024-04-12T09:29:23.939430+0000) 2024-04-12T09:29:29.925 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:29 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:29.641+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:57.595199+0000 front 2024-04-12T09:28:57.595253+0000 (oldest deadline 2024-04-12T09:29:21.095044+0000) 2024-04-12T09:29:30.323 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:29 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4[101031]: 2024-04-12T09:29:29.924+0000 7fb746162700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:58.139139+0000 front 2024-04-12T09:28:58.139245+0000 (oldest deadline 2024-04-12T09:29:23.939430+0000) 2024-04-12T09:29:30.323 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:29 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4[101031]: 2024-04-12T09:29:29.924+0000 7fb746162700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.117:6814 osd.1 since back 2024-04-12T09:29:03.939872+0000 front 2024-04-12T09:29:03.939901+0000 (oldest deadline 2024-04-12T09:29:29.839802+0000) 2024-04-12T09:29:31.073 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:30 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:30.657+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:57.595199+0000 front 2024-04-12T09:28:57.595253+0000 (oldest deadline 2024-04-12T09:29:21.095044+0000) 2024-04-12T09:29:31.074 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:30 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4[101031]: 2024-04-12T09:29:30.889+0000 7fb746162700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:58.139139+0000 front 2024-04-12T09:28:58.139245+0000 (oldest deadline 2024-04-12T09:29:23.939430+0000) 2024-04-12T09:29:31.074 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:30 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4[101031]: 2024-04-12T09:29:30.889+0000 7fb746162700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.117:6814 osd.1 since back 2024-04-12T09:29:03.939872+0000 front 2024-04-12T09:29:03.939901+0000 (oldest deadline 2024-04-12T09:29:29.839802+0000) 2024-04-12T09:29:32.073 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:31 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:31.705+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:57.595199+0000 front 2024-04-12T09:28:57.595253+0000 (oldest deadline 2024-04-12T09:29:21.095044+0000) 2024-04-12T09:29:32.074 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:31 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4[101031]: 2024-04-12T09:29:31.897+0000 7fb746162700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:58.139139+0000 front 2024-04-12T09:28:58.139245+0000 (oldest deadline 2024-04-12T09:29:23.939430+0000) 2024-04-12T09:29:32.074 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:31 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4[101031]: 2024-04-12T09:29:31.897+0000 7fb746162700 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.117:6814 osd.1 since back 2024-04-12T09:29:03.939872+0000 front 2024-04-12T09:29:03.939901+0000 (oldest deadline 2024-04-12T09:29:29.839802+0000) 2024-04-12T09:29:32.566 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:32 smithi203 podman[119493]: 2024-04-12 09:29:32.298180749 +0000 UTC m=+5.500256768 container died 7ec45de1eea6d8f6f5b766bc8bbc7eef9a9867fd551346815928c82a1efeb377 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, RELEASE=squid-b277feb, maintainer=Guillaume Abrioux , ceph=True) 2024-04-12T09:29:32.823 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:32 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:32.754+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:57.595199+0000 front 2024-04-12T09:28:57.595253+0000 (oldest deadline 2024-04-12T09:29:21.095044+0000) 2024-04-12T09:29:32.824 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:32 smithi203 podman[119493]: 2024-04-12 09:29:32.648631917 +0000 UTC m=+5.850707946 container cleanup 7ec45de1eea6d8f6f5b766bc8bbc7eef9a9867fd551346815928c82a1efeb377 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4, org.label-schema.license=GPLv2, RELEASE=squid-b277feb, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240409) 2024-04-12T09:29:32.824 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:32 smithi203 bash[119493]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4 2024-04-12T09:29:33.260 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:32 smithi203 podman[119512]: 2024-04-12 09:29:32.850223848 +0000 UTC m=+0.543450098 container remove 7ec45de1eea6d8f6f5b766bc8bbc7eef9a9867fd551346815928c82a1efeb377 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b277feb, org.label-schema.license=GPLv2, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-12T09:29:33.546 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:33 smithi203 podman[119602]: 2024-04-12 09:29:33.162846146 +0000 UTC m=+0.018006681 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:29:33.546 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:33 smithi203 podman[119602]: 2024-04-12 09:29:33.268133122 +0000 UTC m=+0.123293688 container create 77979466cd363612276face2e70db42e473b5736f1c0ad358b6d7b232f17adcc (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b277feb, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, ceph=True) 2024-04-12T09:29:33.546 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:33 smithi203 podman[119602]: 2024-04-12 09:29:33.479637404 +0000 UTC m=+0.334797928 container init 77979466cd363612276face2e70db42e473b5736f1c0ad358b6d7b232f17adcc (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-b277feb, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-12T09:29:33.546 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:33 smithi203 podman[119602]: 2024-04-12 09:29:33.482857606 +0000 UTC m=+0.338018132 container start 77979466cd363612276face2e70db42e473b5736f1c0ad358b6d7b232f17adcc (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, RELEASE=squid-b277feb, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, ceph=True) 2024-04-12T09:29:33.546 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:33 smithi203 podman[119602]: 2024-04-12 09:29:33.545662025 +0000 UTC m=+0.400822561 container attach 77979466cd363612276face2e70db42e473b5736f1c0ad358b6d7b232f17adcc (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b277feb, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-12T09:29:33.824 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:33 smithi203 podman[119602]: 2024-04-12 09:29:33.776439137 +0000 UTC m=+0.631599655 container died 77979466cd363612276face2e70db42e473b5736f1c0ad358b6d7b232f17adcc (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-b277feb, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-04-12T09:29:33.824 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:33 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:33.704+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:57.595199+0000 front 2024-04-12T09:28:57.595253+0000 (oldest deadline 2024-04-12T09:29:21.095044+0000) 2024-04-12T09:29:33.824 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:33 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:33.704+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6814 osd.1 since back 2024-04-12T09:29:07.496167+0000 front 2024-04-12T09:29:07.496263+0000 (oldest deadline 2024-04-12T09:29:33.396082+0000) 2024-04-12T09:29:34.292 INFO:journalctl@ceph.osd.4.smithi203.stdout:Apr 12 09:29:34 smithi203 podman[119628]: 2024-04-12 09:29:34.282776778 +0000 UTC m=+0.496946427 container remove 77979466cd363612276face2e70db42e473b5736f1c0ad358b6d7b232f17adcc (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-4-deactivate, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, RELEASE=squid-b277feb, ceph=True, org.label-schema.vendor=CentOS) 2024-04-12T09:29:34.297 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.4.service' 2024-04-12T09:29:34.338 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-12T09:29:34.338 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-12T09:29:34.339 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-12T09:29:34.339 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.5 2024-04-12T09:29:34.573 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:34 smithi203 systemd[1]: Stopping Ceph osd.5 for 12161984-f8ab-11ee-bc8c-c7b262605968... 2024-04-12T09:29:35.073 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:34 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:34.676+0000 7f7326043700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-12T09:29:35.073 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:34 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:34.676+0000 7f7326043700 -1 osd.5 83 *** Got signal Terminated *** 2024-04-12T09:29:35.074 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:34 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:34.676+0000 7f7326043700 -1 osd.5 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T09:29:35.074 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:34 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:34.754+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:57.595199+0000 front 2024-04-12T09:28:57.595253+0000 (oldest deadline 2024-04-12T09:29:21.095044+0000) 2024-04-12T09:29:35.074 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:34 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:34.754+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6814 osd.1 since back 2024-04-12T09:29:07.496167+0000 front 2024-04-12T09:29:07.496263+0000 (oldest deadline 2024-04-12T09:29:33.396082+0000) 2024-04-12T09:29:36.073 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:35 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:35.719+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:57.595199+0000 front 2024-04-12T09:28:57.595253+0000 (oldest deadline 2024-04-12T09:29:21.095044+0000) 2024-04-12T09:29:36.073 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:35 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:35.719+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6814 osd.1 since back 2024-04-12T09:29:07.496167+0000 front 2024-04-12T09:29:07.496263+0000 (oldest deadline 2024-04-12T09:29:33.396082+0000) 2024-04-12T09:29:36.823 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:36 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:36.691+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:57.595199+0000 front 2024-04-12T09:28:57.595253+0000 (oldest deadline 2024-04-12T09:29:21.095044+0000) 2024-04-12T09:29:36.823 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:36 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:36.691+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6814 osd.1 since back 2024-04-12T09:29:07.496167+0000 front 2024-04-12T09:29:07.496263+0000 (oldest deadline 2024-04-12T09:29:33.396082+0000) 2024-04-12T09:29:38.073 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:37 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:37.731+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:57.595199+0000 front 2024-04-12T09:28:57.595253+0000 (oldest deadline 2024-04-12T09:29:21.095044+0000) 2024-04-12T09:29:38.074 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:37 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:37.731+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6814 osd.1 since back 2024-04-12T09:29:07.496167+0000 front 2024-04-12T09:29:07.496263+0000 (oldest deadline 2024-04-12T09:29:33.396082+0000) 2024-04-12T09:29:39.073 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:38 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:38.749+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6806 osd.0 since back 2024-04-12T09:28:57.595199+0000 front 2024-04-12T09:28:57.595253+0000 (oldest deadline 2024-04-12T09:29:21.095044+0000) 2024-04-12T09:29:39.074 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:38 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:38.749+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6814 osd.1 since back 2024-04-12T09:29:07.496167+0000 front 2024-04-12T09:29:07.496263+0000 (oldest deadline 2024-04-12T09:29:33.396082+0000) 2024-04-12T09:29:39.074 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:38 smithi203 ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5[106367]: 2024-04-12T09:29:38.749+0000 7f7322e38700 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.117:6822 osd.2 since back 2024-04-12T09:29:13.396664+0000 front 2024-04-12T09:29:13.396681+0000 (oldest deadline 2024-04-12T09:29:38.096442+0000) 2024-04-12T09:29:40.402 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:40 smithi203 podman[119709]: 2024-04-12 09:29:40.125418734 +0000 UTC m=+5.559064793 container died ad918b4139f72f850a7dea6e59dff46cf139cfb1f6727e3596d6834c1abb8ba2 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-b277feb, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-12T09:29:40.402 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:40 smithi203 podman[119709]: 2024-04-12 09:29:40.402701955 +0000 UTC m=+5.836348031 container cleanup ad918b4139f72f850a7dea6e59dff46cf139cfb1f6727e3596d6834c1abb8ba2 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, RELEASE=squid-b277feb) 2024-04-12T09:29:40.823 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:40 smithi203 bash[119709]: ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5 2024-04-12T09:29:40.823 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:40 smithi203 podman[119726]: 2024-04-12 09:29:40.620636642 +0000 UTC m=+0.498941616 container remove ad918b4139f72f850a7dea6e59dff46cf139cfb1f6727e3596d6834c1abb8ba2 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5, GIT_BRANCH=HEAD, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b277feb, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-12T09:29:41.208 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:40 smithi203 podman[119817]: 2024-04-12 09:29:40.930107226 +0000 UTC m=+0.111539499 container create 4f74a1b9d8009f440ad2d1f5b6ce26e69a5c173e9452269963959a55fbfc3b64 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b277feb, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-12T09:29:41.208 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:40 smithi203 podman[119817]: 2024-04-12 09:29:40.836739542 +0000 UTC m=+0.018171840 image pull 668895944f0ec64b67a5b7564961d2756f2966e5d4b9338516300dbec9984951 quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec 2024-04-12T09:29:41.208 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:41 smithi203 podman[119817]: 2024-04-12 09:29:41.132701661 +0000 UTC m=+0.314133936 container init 4f74a1b9d8009f440ad2d1f5b6ce26e69a5c173e9452269963959a55fbfc3b64 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b277feb, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-12T09:29:41.208 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:41 smithi203 podman[119817]: 2024-04-12 09:29:41.135864162 +0000 UTC m=+0.317296435 container start 4f74a1b9d8009f440ad2d1f5b6ce26e69a5c173e9452269963959a55fbfc3b64 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b277feb, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, ceph=True, org.label-schema.build-date=20240409) 2024-04-12T09:29:41.208 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:41 smithi203 podman[119817]: 2024-04-12 09:29:41.207559721 +0000 UTC m=+0.388992019 container attach 4f74a1b9d8009f440ad2d1f5b6ce26e69a5c173e9452269963959a55fbfc3b64 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=squid-b277feb, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-12T09:29:41.574 INFO:journalctl@ceph.osd.5.smithi203.stdout:Apr 12 09:29:41 smithi203 podman[119817]: 2024-04-12 09:29:41.424976451 +0000 UTC m=+0.606408744 container died 4f74a1b9d8009f440ad2d1f5b6ce26e69a5c173e9452269963959a55fbfc3b64 (image=quay.ceph.io/ceph-ci/ceph@sha256:7a231d9b74270e9fc5dba084646cc7a148bd8e84d7c66434198a233cfee0f4ec, name=ceph-12161984-f8ab-11ee-bc8c-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b277feb, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240409, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0) 2024-04-12T09:29:42.007 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-12161984-f8ab-11ee-bc8c-c7b262605968@osd.5.service' 2024-04-12T09:29:42.048 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-12T09:29:42.048 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-12T09:29:42.049 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 --force --keep-logs 2024-04-12T09:29:45.567 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi117.stderr:ceph-fuse[77011]: fuse finished with error 0 and tester_r 0 2024-04-12T09:30:05.558 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 --force --keep-logs 2024-04-12T09:30:19.109 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-12T09:30:19.146 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-12T09:30:19.175 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-12T09:30:19.177 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-04-12_02:08:08-upgrade-squid-distro-default-smithi/7653418/remote/smithi117/crash 2024-04-12T09:30:19.178 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/crash -- . 2024-04-12T09:30:19.215 INFO:teuthology.orchestra.run.smithi117.stderr:tar: /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/crash: Cannot open: No such file or directory 2024-04-12T09:30:19.215 INFO:teuthology.orchestra.run.smithi117.stderr:tar: Error is not recoverable: exiting now 2024-04-12T09:30:19.217 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-04-12_02:08:08-upgrade-squid-distro-default-smithi/7653418/remote/smithi203/crash 2024-04-12T09:30:19.218 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/crash -- . 2024-04-12T09:30:19.244 INFO:teuthology.orchestra.run.smithi203.stderr:tar: /var/lib/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/crash: Cannot open: No such file or directory 2024-04-12T09:30:19.244 INFO:teuthology.orchestra.run.smithi203.stderr:tar: Error is not recoverable: exiting now 2024-04-12T09:30:19.245 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-12T09:30:19.245 DEBUG:teuthology.orchestra.run.smithi117:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-04-12T09:30:19.290 INFO:teuthology.orchestra.run.smithi117.stdout:1712913175.7260473 mon.smithi117 (mon.0) 905 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-12T09:30:19.290 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-04-12T09:30:19.290 INFO:tasks.cephadm:Compressing logs... 2024-04-12T09:30:19.291 DEBUG:teuthology.orchestra.run.smithi117:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-12T09:30:19.333 DEBUG:teuthology.orchestra.run.smithi203:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-12T09:30:19.359 INFO:teuthology.orchestra.run.smithi117.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-12T09:30:19.359 INFO:teuthology.orchestra.run.smithi117.stderr:: No such file or directory 2024-04-12T09:30:19.359 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-04-12T09:30:19.359 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-mds.cephfs.smithi117.eslmxh.log 2024-04-12T09:30:19.359 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph.audit.log 2024-04-12T09:30:19.359 INFO:teuthology.orchestra.run.smithi117.stderr:gzip/var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-mds.cephfs.smithi117.eslmxh.log: -5 --verbose -- /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-osd.1.log 2024-04-12T09:30:19.363 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-mgr.smithi117.oyaxql.log 2024-04-12T09:30:19.364 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph.audit.log: /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-mon.smithi117.log 2024-04-12T09:30:19.364 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-mgr.smithi117.oyaxql.log: gzip -5 --verbose -- /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-mds.cephfs.smithi117.wddsgt.log 2024-04-12T09:30:19.364 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-mon.smithi117.log: /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-mds.cephfs.smithi117.wddsgt.log: gzip -5 --verbose -- /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-osd.0.log 2024-04-12T09:30:19.367 INFO:teuthology.orchestra.run.smithi117.stderr: 91.1% -- replaced with /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph.audit.log.gz 2024-04-12T09:30:19.368 INFO:teuthology.orchestra.run.smithi203.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-12T09:30:19.368 INFO:teuthology.orchestra.run.smithi203.stderr:: No such file or directory 2024-04-12T09:30:19.368 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-04-12T09:30:19.368 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-mgr.smithi203.apfqpo.log 2024-04-12T09:30:19.368 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.1.log: gzip -5 --verbose -- /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph.audit.log 2024-04-12T09:30:19.368 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-mgr.smithi203.apfqpo.log: gzip -5 --verbose -- /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-osd.4.log 2024-04-12T09:30:19.368 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-mon.smithi203.log 2024-04-12T09:30:19.368 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph.audit.log: /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-osd.5.log 2024-04-12T09:30:19.368 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-mon.smithi203.log: gzip -5 --verbose -- /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-osd.3.log 2024-04-12T09:30:19.368 INFO:teuthology.orchestra.run.smithi203.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-12T09:30:19.368 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-mds.cephfs.smithi203.fbeixl.log 2024-04-12T09:30:19.368 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-mds.cephfs.smithi203.bszhxz.log 2024-04-12T09:30:19.368 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-mds.cephfs.smithi203.fbeixl.log: 91.2% -- replaced with /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph.audit.log.gz 2024-04-12T09:30:19.368 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph.cephadm.log 2024-04-12T09:30:19.375 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph.cephadm.log 2024-04-12T09:30:19.375 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-mds.cephfs.smithi203.bszhxz.log: gzip -5 --verbose -- /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph.log 2024-04-12T09:30:19.387 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph.log 2024-04-12T09:30:19.388 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph.cephadm.log: 85.4% -- replaced with /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph.cephadm.log.gz 2024-04-12T09:30:19.389 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph.cephadm.log: 85.3% -- replaced with /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph.cephadm.log.gz 2024-04-12T09:30:19.392 INFO:teuthology.orchestra.run.smithi117.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-12T09:30:19.392 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-osd.2.log 2024-04-12T09:30:19.396 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-volume.log 2024-04-12T09:30:19.396 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph.log: 88.0% -- replaced with /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph.log.gz 2024-04-12T09:30:19.396 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-volume.log 2024-04-12T09:30:19.399 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph.log: 88.0% -- replaced with /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph.log.gz 2024-04-12T09:30:19.432 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-volume.log: 89.7% -- replaced with /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-mgr.smithi203.apfqpo.log.gz 2024-04-12T09:30:19.446 INFO:teuthology.orchestra.run.smithi203.stderr: 91.0% -- replaced with /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-volume.log.gz 2024-04-12T09:30:19.460 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-osd.2.log: /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-volume.log: 91.0% -- replaced with /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-volume.log.gz 2024-04-12T09:30:19.766 INFO:teuthology.orchestra.run.smithi117.stderr: 88.7% -- replaced with /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-mgr.smithi117.oyaxql.log.gz 2024-04-12T09:30:19.817 INFO:teuthology.orchestra.run.smithi203.stderr: 92.6% -- replaced with /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-mon.smithi203.log.gz 2024-04-12T09:30:20.602 INFO:teuthology.orchestra.run.smithi117.stderr: 90.5% -- replaced with /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-mon.smithi117.log.gz 2024-04-12T09:30:23.625 INFO:teuthology.orchestra.run.smithi203.stderr: 93.3% -- replaced with /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-osd.4.log.gz 2024-04-12T09:30:24.904 INFO:teuthology.orchestra.run.smithi117.stderr: 93.4% -- replaced with /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-osd.1.log.gz 2024-04-12T09:30:25.366 INFO:teuthology.orchestra.run.smithi117.stderr: 93.4% -- replaced with /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-osd.2.log.gz 2024-04-12T09:30:26.100 INFO:teuthology.orchestra.run.smithi117.stderr: 93.4% -- replaced with /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-osd.0.log.gz 2024-04-12T09:30:26.557 INFO:teuthology.orchestra.run.smithi203.stderr: 94.8% -- replaced with /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-mds.cephfs.smithi203.fbeixl.log.gz 2024-04-12T09:30:26.942 INFO:teuthology.orchestra.run.smithi203.stderr: 93.5% -- replaced with /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-osd.3.log.gz 2024-04-12T09:30:27.012 INFO:teuthology.orchestra.run.smithi117.stderr: 94.7% -- replaced with /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-mds.cephfs.smithi117.wddsgt.log.gz 2024-04-12T09:30:27.047 INFO:teuthology.orchestra.run.smithi203.stderr: 93.6% -- replaced with /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-osd.5.log.gz 2024-04-12T09:30:27.642 INFO:teuthology.orchestra.run.smithi203.stderr: 94.8% -- replaced with /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-mds.cephfs.smithi203.bszhxz.log.gz 2024-04-12T09:30:33.319 INFO:teuthology.orchestra.run.smithi203.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-04-12T09:30:33.319 INFO:teuthology.orchestra.run.smithi203.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-04-12T09:30:33.319 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-12T09:30:33.319 INFO:teuthology.orchestra.run.smithi203.stderr:real 0m13.971s 2024-04-12T09:30:33.319 INFO:teuthology.orchestra.run.smithi203.stderr:user 0m48.058s 2024-04-12T09:30:33.320 INFO:teuthology.orchestra.run.smithi203.stderr:sys 0m1.384s 2024-04-12T09:30:35.648 INFO:teuthology.orchestra.run.smithi117.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-04-12T09:31:44.408 INFO:teuthology.orchestra.run.smithi117.stderr: 92.7% -- replaced with /var/log/ceph/12161984-f8ab-11ee-bc8c-c7b262605968/ceph-mds.cephfs.smithi117.eslmxh.log.gz 2024-04-12T09:31:44.409 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-04-12T09:31:44.409 INFO:teuthology.orchestra.run.smithi117.stderr:real 1m25.063s 2024-04-12T09:31:44.409 INFO:teuthology.orchestra.run.smithi117.stderr:user 2m4.633s 2024-04-12T09:31:44.409 INFO:teuthology.orchestra.run.smithi117.stderr:sys 0m3.993s 2024-04-12T09:31:44.410 INFO:tasks.cephadm:Archiving logs... 2024-04-12T09:31:44.410 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-12_02:08:08-upgrade-squid-distro-default-smithi/7653418/remote/smithi117/log 2024-04-12T09:31:44.411 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-12T09:32:03.537 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-12_02:08:08-upgrade-squid-distro-default-smithi/7653418/remote/smithi203/log 2024-04-12T09:32:03.538 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-12T09:32:09.612 INFO:tasks.cephadm:Removing cluster... 2024-04-12T09:32:09.612 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 --force 2024-04-12T09:32:10.215 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 12161984-f8ab-11ee-bc8c-c7b262605968 --force 2024-04-12T09:32:10.717 INFO:tasks.cephadm:Removing cephadm ... 2024-04-12T09:32:10.718 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-12T09:32:10.733 DEBUG:teuthology.orchestra.run.smithi203:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-12T09:32:10.749 INFO:tasks.cephadm:Teardown complete 2024-04-12T09:32:10.749 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-12T09:32:10.765 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_dea717a37c7849ca8459c02fb965020aedcc0a9a/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_dea717a37c7849ca8459c02fb965020aedcc0a9a/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-12T09:32:10.766 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-12T09:32:10.766 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-12T09:32:10.776 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-12T09:32:10.864 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-12T09:32:10.876 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-12T09:32:10.877 DEBUG:teuthology.orchestra.run.smithi117:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-12T09:32:10.880 DEBUG:teuthology.orchestra.run.smithi203:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-12T09:32:10.891 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-04-12T09:32:10.893 INFO:teuthology.orchestra.run.smithi203.stderr:bash: line 1: ntpq: command not found 2024-04-12T09:32:10.896 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-12T09:32:10.896 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-04-12T09:32:10.896 INFO:teuthology.orchestra.run.smithi117.stdout:^* hv01.front.sepia.ceph.com 3 6 377 16 +241us[ +249us] +/- 54ms 2024-04-12T09:32:10.896 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 15 -1221us[-1221us] +/- 60ms 2024-04-12T09:32:10.896 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 +1243us[+1243us] +/- 80ms 2024-04-12T09:32:10.896 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T09:32:10.897 INFO:teuthology.orchestra.run.smithi203.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-12T09:32:10.898 INFO:teuthology.orchestra.run.smithi203.stdout:=============================================================================== 2024-04-12T09:32:10.898 INFO:teuthology.orchestra.run.smithi203.stdout:^* hv01.front.sepia.ceph.com 3 6 377 18 +279us[ +274us] +/- 54ms 2024-04-12T09:32:10.898 INFO:teuthology.orchestra.run.smithi203.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 19 -1234us[-1239us] +/- 60ms 2024-04-12T09:32:10.898 INFO:teuthology.orchestra.run.smithi203.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 +1231us[+1231us] +/- 80ms 2024-04-12T09:32:10.898 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T09:32:10.899 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-12T09:32:10.927 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-12T09:32:10.929 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-12T09:32:10.940 DEBUG:teuthology.orchestra.run.smithi117:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-12T09:32:11.025 DEBUG:teuthology.orchestra.run.smithi203:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-12T09:32:11.107 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-12T09:32:11.138 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T09:32:11.139 DEBUG:teuthology.orchestra.run.smithi203:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-12T09:32:11.169 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T09:32:11.169 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-12T09:32:11.183 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-12T09:32:11.194 INFO:teuthology.task.internal:Duration was 2352.740209 seconds 2024-04-12T09:32:11.194 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-12T09:32:11.254 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-12T09:32:11.255 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-12T09:32:11.257 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-12T09:32:11.298 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-12T09:32:11.300 INFO:teuthology.orchestra.run.smithi203.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-12T09:32:11.453 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-12T09:32:11.453 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi117.front.sepia.ceph.com 2024-04-12T09:32:11.454 DEBUG:teuthology.orchestra.run.smithi117:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-12T09:32:11.513 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi203.front.sepia.ceph.com 2024-04-12T09:32:11.513 DEBUG:teuthology.orchestra.run.smithi203:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-12T09:32:11.544 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-12T09:32:11.545 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-12T09:32:11.556 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-12T09:32:11.613 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-12T09:32:11.613 DEBUG:teuthology.orchestra.run.smithi117:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-12T09:32:11.624 DEBUG:teuthology.orchestra.run.smithi203:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-12T09:32:12.262 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-12T09:32:12.276 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-12T09:32:12.276 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-12T09:32:12.303 DEBUG:teuthology.orchestra.run.smithi203:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-12T09:32:12.332 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-12T09:32:12.351 DEBUG:teuthology.orchestra.run.smithi117:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-12T09:32:12.354 DEBUG:teuthology.orchestra.run.smithi203:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-12T09:32:12.376 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = core 2024-04-12T09:32:12.398 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = core 2024-04-12T09:32:12.442 DEBUG:teuthology.orchestra.run.smithi117:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-12T09:32:12.457 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T09:32:12.457 DEBUG:teuthology.orchestra.run.smithi203:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-12T09:32:12.496 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T09:32:12.496 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-12T09:32:12.537 INFO:teuthology.task.internal:Transferring archived files... 2024-04-12T09:32:12.540 DEBUG:teuthology.misc:Transferring archived files from smithi117:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-12_02:08:08-upgrade-squid-distro-default-smithi/7653418/remote/smithi117 2024-04-12T09:32:12.540 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-12T09:32:12.615 DEBUG:teuthology.misc:Transferring archived files from smithi203:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-12_02:08:08-upgrade-squid-distro-default-smithi/7653418/remote/smithi203 2024-04-12T09:32:12.615 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-12T09:32:12.659 INFO:teuthology.task.internal:Removing archive directory... 2024-04-12T09:32:12.660 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-12T09:32:12.662 DEBUG:teuthology.orchestra.run.smithi203:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-12T09:32:12.705 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-12T09:32:12.732 INFO:teuthology.task.internal:Not uploading archives. 2024-04-12T09:32:12.732 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-12T09:32:12.929 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-12T09:32:12.929 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-12T09:32:12.932 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-12T09:32:12.944 INFO:teuthology.orchestra.run.smithi117.stdout: 265306 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 12 09:32 /home/ubuntu/cephtest 2024-04-12T09:32:12.944 INFO:teuthology.orchestra.run.smithi117.stdout: 556088 4 d--------- 2 ubuntu ubuntu 4096 Apr 12 09:08 /home/ubuntu/cephtest/mnt.0 2024-04-12T09:32:12.945 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T09:32:12.945 INFO:teuthology.orchestra.run.smithi117.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-04-12T09:32:12.945 INFO:teuthology.orchestra.run.smithi117.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-12T09:32:12.946 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_dea717a37c7849ca8459c02fb965020aedcc0a9a/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_dea717a37c7849ca8459c02fb965020aedcc0a9a/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi117 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-12T09:32:12.946 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-12T09:32:13.165 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-12T09:32:13.572 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-12T09:32:13.572 INFO:teuthology.nuke:Checking targets against current locks 2024-04-12T09:32:13.595 DEBUG:teuthology.nuke:shortname: smithi117 2024-04-12T09:32:13.595 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-12T09:32:13.619 DEBUG:teuthology.nuke:shortname: smithi203 2024-04-12T09:32:13.620 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-12T09:32:13.624 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-12_02:08:08-upgrade-squid-distro-default-smithi/7653418', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-12 08:44:35.228725', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBX02lT+8/Swb0ZZ8s7+G74H5QTgwdzuwLaznPB+oSDIPzp8EgIYBtQyq4pTiUh1pQbavH1uSEzPYxyxl8thauY='} 2024-04-12T09:32:13.646 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-12_02:08:08-upgrade-squid-distro-default-smithi/7653418', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-12 08:44:35.230332', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKZ5ZfnugmmW22l6pAd2PxnrjQ8ZUw6NSveXv7WGK3wGyDcZvNarpUDOiju1QmgKgyDhlnjpyC8o+8F2BxSH9Es='} 2024-04-12T09:32:13.673 INFO:teuthology.orchestra.console.smithi117:Power off 2024-04-12T09:32:13.674 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-12T09:32:13.709 INFO:teuthology.orchestra.console.smithi203:Power off 2024-04-12T09:32:13.710 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-12T09:32:13.721 DEBUG:teuthology.orchestra.console.smithi117:power off output: Chassis Power Control: Down/Off 2024-04-12T09:32:13.721 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T09:32:13.734 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2024-04-12T09:32:13.734 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T09:32:13.744 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on 2024-04-12T09:32:13.757 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2024-04-12T09:32:17.745 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T09:32:17.758 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T09:32:17.856 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on 2024-04-12T09:32:17.868 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2024-04-12T09:32:21.858 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T09:32:21.869 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T09:32:21.968 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off 2024-04-12T09:32:21.978 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2024-04-12T09:32:22.070 INFO:teuthology.orchestra.console.smithi117:Power off completed 2024-04-12T09:32:25.983 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T09:32:26.093 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2024-04-12T09:32:26.194 INFO:teuthology.orchestra.console.smithi203:Power off completed 2024-04-12T09:32:26.298 INFO:teuthology.run:Summary data: description: upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2352.740209341049 failure_reason: reached maximum tries (51) after waiting for 300 seconds flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-04-12T09:32:26.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T09:32:26.375 INFO:teuthology.run:FAIL